9 Replies Latest reply on Oct 19, 2018 6:49 AM by Bill Robinson

    Has anybody experienced incorrect Snapshot Change Tracking Result?

    Peng Yang

      Hi everyone,

       

      I just found in my BL deployment (Application server v8.9, Console v8.9, Agent v8.7),

      the Snapshot Change Tracking Result was different from what was expected, and the results could be inconsistent even if I use the same script to test (not every time, but quite often)

      Does anyone has idea of what I have seen?

       

      Following are some evidences.

      Snapshot objects:

      BLPoC\folderlv1-1\

      BLPoC\filelv1-1.txt

      excludes:

      folderlv2-2

      folderlv2-1\*.log

       

      Operation log:

      Init

      2018-08-27 11:57:33 created \\hostname\c$\BLPoC

      2018-08-27 11:57:33 created \\hostname\c$\BLPoC\folderlv1-1

      2018-08-27 11:57:33 created \\hostname\c$\BLPoC\folderlv1-1\folderlv2-1

      2018-08-27 11:57:33 created \\hostname\c$\BLPoC\folderlv1-1\folderlv2-2

      2018-08-27 11:57:33 created \\hostname\c$\BLPoC\filelv1-1.txt

       

      Creation

      2018-08-27 12:02:44 created \\hostname\c$\BLPoC\folderlv1-1\folderlv2-1\folderlv3-1

      2018-08-27 12:02:44 created \\hostname\c$\BLPoC\folderlv1-1\folderlv2-2\folderlv3-2

      2018-08-27 12:02:44 created \\hostname\c$\BLPoC\folderlv1-1\filelv2-1.txt

      2018-08-27 12:02:44 created \\hostname\c$\BLPoC\folderlv1-1\filelv2-2.txt

      2018-08-27 12:02:44 created \\hostname\c$\BLPoC\folderlv1-1\folderlv2-2\filelv3-1.txt

      2018-08-27 12:02:44 created \\hostname\c$\BLPoC\folderlv1-1\folderlv2-1\filelv3-1.log

       

      Change

      2018-08-27 12:03:40 changed \\hostname\c$\BLPoC\folderlv1-1\filelv2-1.txt

      2018-08-27 12:03:40 changed \\hostname\c$\BLPoC\folderlv1-1\folderlv2-2\filelv3-1.txt

      2018-08-27 12:03:40 changed \\hostname\c$\BLPoC\folderlv1-1\folderlv2-1\filelv3-1.log

       

      Deletion

      2018-08-27 12:04:25 deleted \\hostname\c$\BLPoC\folderlv1-1\folderlv2-1\folderlv3-1

      2018-08-27 12:04:25 deleted \\hostname\c$\BLPoC\folderlv1-1\folderlv2-2\folderlv3-2

      2018-08-27 12:04:25 deleted \\hostname\c$\BLPoC\folderlv1-1\filelv2-1.txt

      2018-08-27 12:04:25 deleted \\hostname\c$\BLPoC\folderlv1-1\folderlv2-2\filelv3-1.txt

      2018-08-27 12:04:25 deleted \\hostname\c$\BLPoC\folderlv1-1\folderlv2-1\filelv3-1.log

       

      Mix

      2018-08-27 12:05:00 created \\hostname\c$\BLPoC\folderlv1-1\folderlv2-1\folderlv3-1

      2018-08-27 12:05:00 changed \\hostname\c$\BLPoC\filelv1-1.txt

      2018-08-27 12:05:00 deleted \\hostname\c$\BLPoC\folderlv1-1\filelv2-2.txt

       

      After deletion (Snapshot Change Tracking Notification)

      Job id: 10

      Name: snapshot1

      Description:

      Job Group id: 2000017

      Job Run id: 24

      Start Time: Mon Aug 27 12:04:36 JST 2018 End Time: Mon Aug 27 12:04:39 JST 2018

      **************** Snapshot Change Tracking Result Details ****************

      **************** Breakdown of Changed assets ****************

      Target: (component) snapshot1 (BLAgent1)

      **************** Changed assets ****************

      Object: /C/BLPoC/folderlv1-1

      Object Type: Directory

      (Changed) /C/BLPoC/folderlv1-1/ - "Changed" [Date Modified "(M: 2018/08/27 12:02:43+0900,2018/08/27 12:02:44+0900)"]

      (Missing) /C/BLPoC/folderlv1-1/filelv2-1.txt  <- filelv2-1.txt was missing, expected

      (Changed) /C/BLPoC/folderlv1-1/folderlv2-1 - "Changed" [Date Modified "(M: 2018/08/27 12:02:43+0900,2018/08/27 12:04:25+0900)"]

      (Missing) /C/BLPoC/folderlv1-1/folderlv2-1/folderlv3-1 <- folderlv3-1 was missing, expected

       

      After Mix (Snapshot Change Tracking Notification)

      Job id: 10

      Name: snapshot1

      Description:

      Job Group id: 2000017

      Job Run id: 25

      Start Time: Mon Aug 27 12:05:06 JST 2018 End Time: Mon Aug 27 12:05:09 JST 2018

      **************** Breakdown of Changed assets ****************

      Target: (component) snapshot1 (BLAgent1)

      **************** Changed assets ****************

      Object: /C/BLPoC/folderlv1-1

      Object Type: Directory

      (Changed) /C/BLPoC/folderlv1-1/ - "Changed" [Date Modified "(M: 2018/08/27 12:02:44+0900,2018/08/27 12:04:25+0900)"]

      (Missing) /C/BLPoC/folderlv1-1/filelv2-1.txt <- why did I see this again?

      (Missing) /C/BLPoC/folderlv1-1/filelv2-2.txt

      (Changed) /C/BLPoC/folderlv1-1/folderlv2-1 - "Changed" [Date Modified "(M: 2018/08/27 12:02:44+0900,2018/08/27 12:04:25+0900)"]

      (Changed) /C/BLPoC/folderlv1-1/folderlv2-1/folderlv3-1 - "Changed" [Date Created (Windows) "(M: 2018/08/27 12:02:43+0900,2018/08/27 12:05:00+0900)"] [Date Modified "(M: 2018/08/27 12:02:43+0900,2018/08/27 12:05:00+0900)"] <- folderlv3-1 should be a new folder as I deleted it in my last step, it should be "extra" instead of "changed"

      Object: /C/BLPoC/filelv1-1.txt

      Object Type: File

      (Changed) /C/BLPoC/filelv1-1.txt/ - "Changed" [Size (bytes) "(M: 28,56)"] [Date Modified "(M: 2018/08/27 11:57:33+0900,2018/08/27 12:05:00+0900)"]

       

      Please also refer the screenshots.

      I would highly appreciate any thoughts or ideas on this.

        • 1. Re: Has anybody experienced incorrect Snapshot Change Tracking Result?
          Bill Robinson

          just so i understand the order of events:

          you ran a snapshot job.

          you deleted some files and directories that were included in the snapshot job list

          you ran the same snapshot job again

          the 'change tracking' tab of the snapshot job result correctly showed the list of files and directories you deleted as 'missing' in the result ?

          then you did a change, addition and deletion

          you ran the same snapshot job again

          the 'change tracking tab' now shows some confusing results:

          - a file you deleted after the first job run is still shown as missing.

          - the folder you created in 'mix' had been deleted after the first run and now shows as 'changed' instead of extra

          - the file you deleted correctly shows as deleted

           

          so it almost seems like the 'baseline' being used here is based off the original state of the snapshot and not the 2nd one ?  the changes are relative to the 1st run, not the 2nd ?

          off the top of my head i'm not sure what could cause that - the 2nd run didn't get deleted before you ran the 3rd run ?

          your screenshot shows a lot of runs.  do you see this same behaviour if you create a new job and only run it three times ? 

          • 2. Re: Has anybody experienced incorrect Snapshot Change Tracking Result?
            Peng Yang

            Thanks,Bill Robinson

             

            To make it more clear, below is the events sequences.

             

            -Steps

            1. Init

            2. Run snapshot job

            3. Create

            4. Run snapshot job

            5. Change

            6. Run snapshot job

            7. Delete

            8. Run snapshot job (I can see nearly correct change tracking result in this snapshot job run, see the screenshot)

            9. Mix

            10. Run snapshot job (the change tracking result is confusing, see the screenshot)

             

            - In step 8, the result is almost correct except for the \\hostname\c$\BLPoC\folderlv1-1\filelv2-1.txt. As I appended a new line in it in step 5, so the size was supposed to be 56 not 28.

             

            - In the last step (step 10). The result is confusing because:

            a. File \\hostname\c$\BLPoC\folderlv1-1\filelv2-1.txt should not have been in the tracking result, as it had already been shown as missing in the result of step 8 and I didn't manipulate it in step 9.

            b. Folder \\hostname\c$\BLPoC\folderlv1-1\folderlv2-1\folderlv3-1 was in the tracking result which is expected, but it should be "extra" instead of "change" as it was already deleted in Step 7.

             

            I hope my above comments could make it clear.

            Again, I very much appreciate your reply and and thoughts on this.

            • 3. Re: Has anybody experienced incorrect Snapshot Change Tracking Result?
              Bill Robinson

              did you get a chance to try w/ a new job ?  just to eliminate any possibility that it's related to the number of job runs you have in the job in the screenshot ?  and if that works as we expect it to work that's also important information - why does your older job have a problem and a newer one doesn't.

               

              i'd open a support ticket so someone can look at what might be happening in your env.

              • 4. Re: Has anybody experienced incorrect Snapshot Change Tracking Result?
                Peng Yang

                Bill Robinson

                 

                Yes, I tried.

                I created a new snapshot job from scratch with name "sp_win_bl8.9_v1" on Console of v8.9 and "sp_win_bl8.7_v1" on Console of v8.7.

                The target server is same with agent version 8.7.

                I ran snapshots one by one from the two consoles and still observed the same unexpected result from both tracking result.

                 

                log for the last step (step 10):

                sp_win_bl8.7_v1

                 

                **************** Breakdown of Changed assets ****************

                Target: (component) sp_win_bl8.7_v1 (BLAgent1)

                **************** Changed assets ****************

                Object: /C/BLPoC/folderlv1-1

                Object Type: Directory

                (Changed) /C/BLPoC/folderlv1-1/ - "Changed" [Date Modified "(M: 2018/09/10 10:33:55+0900,2018/09/10 10:47:08+0900)"]

                (Missing) /C/BLPoC/folderlv1-1/filelv2-1.txt <= I saw this again

                (Missing) /C/BLPoC/folderlv1-1/filelv2-2.txt

                (Changed) /C/BLPoC/folderlv1-1/folderlv2-1 - "Changed" [Date Modified "(M: 2018/09/10 10:33:55+0900,2018/09/10 10:47:08+0900)"]

                (Changed) /C/BLPoC/folderlv1-1/folderlv2-1/folderlv3-1 - "Changed" [Date Created (Windows) "(M: 2018/09/10 10:33:55+0900,2018/09/10 10:47:08+0900)"] [Date Modified "(M: 2018/09/10 10:33:55+0900,2018/09/10 10:47:08+0900)"]

                Object: /C/BLPoC/filelv1-1.txt

                Object Type: File

                (Changed) /C/BLPoC/filelv1-1.txt/ - "Changed" [Size (bytes) "(M: 33,66)"] [Date Modified "(M: 2018/09/10 10:28:47+0900,2018/09/10 10:47:08+0900)"]

                 

                 

                log for the last step (step 10):

                sp_win_bl8.9_v1

                **************** Breakdown of Changed assets ****************

                Target: (component) sp_win_bl8.9_v1 (BLAgent1)

                **************** Changed assets ****************

                Object: /C/BLPoC/folderlv1-1

                Object Type: Directory

                (Changed) /C/BLPoC/folderlv1-1/ - "Changed" [Date Modified "(M: 2018/09/10 10:33:55+0900,2018/09/10 10:47:08+0900)"]

                (Missing) /C/BLPoC/folderlv1-1/filelv2-1.txt <= I saw this again

                (Missing) /C/BLPoC/folderlv1-1/filelv2-2.txt

                (Changed) /C/BLPoC/folderlv1-1/folderlv2-1 - "Changed" [Date Modified "(M: 2018/09/10 10:33:55+0900,2018/09/10 10:42:55+0900)"]

                (Changed) /C/BLPoC/folderlv1-1/folderlv2-1/folderlv3-1 - "Changed" [Date Modified "(M: 2018/09/10 10:33:55+0900,2018/09/10 10:47:08+0900)"] [Date Created (Windows) "(M: 2018/09/10 10:33:55+0900,2018/09/10 10:47:08+0900)"]

                Object: /C/BLPoC/filelv1-1.txt

                Object Type: File

                (Changed) /C/BLPoC/filelv1-1.txt/ - "Changed" [Size (bytes) "(M: 33,66)"] [Date Modified "(M: 2018/09/10 10:28:47+0900,2018/09/10 10:47:08+0900)"]

                • 5. Re: Has anybody experienced incorrect Snapshot Change Tracking Result?
                  Peng Yang

                  Hi,

                  Bill Robinson

                   

                  Just to check if you had the chance to open a support ticket.

                  • 6. Re: Has anybody experienced incorrect Snapshot Change Tracking Result?
                    Bill Robinson

                    why would i open a support ticket for your problem ? you need to open a support ticket.

                     

                    i'd open a support ticket so someone can look at what might be happening in your env.

                    means 'i would' or 'if i were you, i would'

                    • 7. Re: Has anybody experienced incorrect Snapshot Change Tracking Result?
                      Peng Yang

                      Bill Robinson

                       

                      Sorry for misunderstanding what you were saying, yes, I got it.

                      • 8. Re: Has anybody experienced incorrect Snapshot Change Tracking Result?
                        Peng Yang

                        After changing the database from MSSQL to Oracle, I've no longer seen the issue.