Forum Discussion

Jarkko Seppo Tapani Tornberg's avatar
Feb 06, 2018
Solved

Possible problems with periodic sync aproach?

We would like to sync CSV-files periodically. Before the start of each period we would only list courses (sections) starting that period + teachers & students attending these courses on the CSV-files. Will the students and teachers from the classes (sections) of previous periods stay unchanged so that students are not removes from previous courses (sections) etc.?

  • Thanks for the quick answer. I know that the sections stay intact but what about the students if in the new CSV-files there is no mention of the section listed in previous CSV-files. Here is the scenario:

     

    Sync 1 with CSV files batch 1: Section A (SIS ID 11111) with students

     

    Sync 2 with CSV files batch 2 (same sync profile as Sync 1): Section B (SIS ID 2222) with students . In the batch 2 there is no mention of Section A in the section CSV file nor the student enrollment or teacher roster CSV files!

     

    What will happen to Section A after Sync 2 is run?

    1. Section A will be gone and students too (I beleive this will not be the case)
    2. Section A will be there but with no students
    3. Section A will be there with the students

    So, I want to find out how does the comparison actually work between different CSV-files :)

     

14 Replies

  • Marko Franken's avatar
    Marko Franken
    Copper Contributor

    Hello.

    Despite of all answers, here are my 2 cents.

     

    When you archive a section (it is not included anymore in the SDS data), the O365 Group and the attached Team in the cloud will remain at the state, where they are left at that point. You do not have to include those groups in further sync data. 

     

    SDS will not delete Groups/Teams.

     

    This is not only tested, but running in production (several tenants/ > 100k Students) and actually, overall concept is based on the fact that "archived" sections will stay in the cloud until deleted by some other measures than SDS.

     

    Best Regards

    Marko

     

    • Tapio Aalto's avatar
      Tapio Aalto
      Copper Contributor

      Hi!

       

      "When you archive a section (it is not included anymore in the SDS data)"

       

      That depends how you define your query.

       

      "Group and the attached Team in the cloud will remain at the state, where they are left at that point."


      Thats interesting. If I understand you correctly, you mean that also members will remain in those groups?

       

      "SDS will not delete Groups/Teams."

       

      No it don't.

       

      br Tapio

      • Marko Franken's avatar
        Marko Franken
        Copper Contributor

        Hi.

        I don't understand your first point, of course depends on query, but as stated, if course/class data is not included anymore, the state will be left were it was when last synced.

         

        "Group and the attached Team in the cloud will remain at the state, where they are left at that point."


        Thats interesting. If I understand you correctly, you mean that also members will remain in those groups?

         

        Yes.

         

        MF

    • Jarkko Seppo Tapani Tornberg's avatar
      Jarkko Seppo Tapani Tornberg
      Brass Contributor

      We have also done archiving at the end of the term. And it works just like you describe it. But we are looking for a "mid-term" solution to secure courses of previous periods. I guess we use a different sync profile for each period or build a database of some sort inbetween SIS and SDS as a "safety measure".

      • Marko Franken's avatar
        Marko Franken
        Copper Contributor

        hi.

        Pls define "secure courses". Do you mean from teacher accidental deletion? Probably not possible, as teacher being owner of O365 group, thus capable of deletion. As stated in my other posts, data will remain, if not synced anymore, until deleted in cloud, SDS is not helping you there. And members will stay in group until group or member removed from group or cloud entirely.

         

        But I'm interested in your additional sync profile idea, as I still struggle to understand, what cause there would be for me to use more than one, please elaborate, if possible?

         

        MF

  • Anonymous's avatar
    Anonymous

    Hi Jarkko,

    If I understand your question correctly, you want to make sure the groups that SDS creates from the CSV file from your student information system will not go away when you do a new sync.

    One of the designs of School Data Sync is to make sure it does not over-write or delete anything.   While a group may change (for example, if a student leaves a school or gets added mid-term), SDS will not delete the group.  However, if you remove any or all users from a group in your SIS, then that change will be reflected the next time SDS Sync runs.  

    So the answer to your question depends on the data that is in the new CSV file you sync. 

    for example:

    If you create a section in September called "Science 101", the members of that section (teachers and students) will be added to the group in Office 365 called "Science 101".  (The actual group will have a unique SIS ID).  If a student gets added in October, the group will be automatically updated with the new student next time SDS sync runs.  If a student leaves the class, they will be removed.  

    Now it is January, the start of a new term.  There is a new group of students in Science 101.  The most common scenario is your SIS ID for that section is unique, and a new group will be created for science 101.  The old group will remain until you, as the tenant global administrator, take action to remove it.  

    If you re-use the exact same SIS ID for Science 101 in January that you used in September, then I expect all the old group members would be removed.  This is something I would need to test/verify since the more common scenario is the SIS uses a different SIS ID.  

    The disadvantage to SDS not removing groups is that in some cases you may want them to be gone.  

    If you want to remove users or sections, here is some more information on that:

    • Here is a SOC article which walks through removing users - https://support.office.com/en-us/article/Delete-a-user-from-your-organization-D5155593-3BAC-4D8D-9D8B-F4513A81479E
    • If you want to remove users in bulk, PowerShell is the way to go. Use the https://go.microsoft.com/fwlink/?linkid=842230 PowerShell cmdlet

    I hope this helps, 

    Matt McGinnis

    • Jarkko Seppo Tapani Tornberg's avatar
      Jarkko Seppo Tapani Tornberg
      Brass Contributor

      Thanks for the quick answer. I know that the sections stay intact but what about the students if in the new CSV-files there is no mention of the section listed in previous CSV-files. Here is the scenario:

       

      Sync 1 with CSV files batch 1: Section A (SIS ID 11111) with students

       

      Sync 2 with CSV files batch 2 (same sync profile as Sync 1): Section B (SIS ID 2222) with students . In the batch 2 there is no mention of Section A in the section CSV file nor the student enrollment or teacher roster CSV files!

       

      What will happen to Section A after Sync 2 is run?

      1. Section A will be gone and students too (I beleive this will not be the case)
      2. Section A will be there but with no students
      3. Section A will be there with the students

      So, I want to find out how does the comparison actually work between different CSV-files :)

       

      • Anonymous's avatar
        Anonymous

        My sincere apologies for the inexcusably late response.  For some reason I'm no longer getting the notifications for responses on the forum- I need to fix that.

        In your scenario, you have control over what happens.

        your "option 1" will not happen- SDS will not remove the group if the group no longer exists in the CSV file.

        If your "section" CSV file for 11111 is updated in the new CSV and the teachers and students are removed, they will be removed from the group.

        If you "section" CSV file makes no reference to section 11111 at all, then it will be retained with all members still there.

         

        We are working on additional end of term functionality and will have more information and details in the coming months.  Stay tuned!

         

        thanks,

         

        Matt McGinnis

         

Resources