Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sync Test Plan #172

Closed
67 of 74 tasks
btlechowski opened this issue Jul 22, 2020 · 2 comments
Closed
67 of 74 tasks

Sync Test Plan #172

btlechowski opened this issue Jul 22, 2020 · 2 comments

Comments

@btlechowski
Copy link

btlechowski commented Jul 22, 2020 •
edited by kjozwiak
Loading

Sync Test Plan

Important testing notes Sync update takes right now up to 60 seconds

When syncing lots of bookmarks use staging server; command line parameter is --sync-url="https://sync-v2.bravesoftware.com/v2"

Logs can be shown with command params: --enable-logging=stderr --v=0 --vmodule=*/sync/*=3,*/brave_sync/*=3,*/sync_bookmarks/*=3
Additional params: --enable-logging=stderr --vmodule=traffic_logger=3
To lower sync cycle add sync_cycle=0: --enable-logging=stderr --v=0 --vmodule=*/sync/*=3,*/brave_sync/*=3,*/sync_bookmarks/*=3,sync_cycle=0

Use custom profile path to test many clients on one machine, example:

Client A: `--user-data-dir=/home/bartlomiej/.config/BraveSoftware/TEST/A`
Client B: `--user-data-dir=/home/bartlomiej/.config/BraveSoftware/TEST/B`

Standalone sync chain

  • Create standalone sync chain with code words
Steps
  1. Clean install
  2. Open brave://settings/braveSync/setup
  3. Click Start a new sync chain
  4. Click Computer
  5. Copy the code words
  6. Click OK
  7. Click Manage your synced devices
  • Expected behavior
    • Able to copy code words
    • Sync chain is created
    • Device list contains only one device
    • Copied code word is the same as in View Sync Code
    • In brave://sync-internals/:Passphrase Type is PassphraseType::kCustomPassphrase (from Sync v2 brave-core#5294)
    • In brave://sync-internals/:Encrypted Types is Bookmarks, Preferences, Passwords, Autofill Profiles, Autofill, Autofill Wallet Metadata, Themes, Typed URLs, Extensions, Search Engines, Sessions, Apps, App settings, Extension settings, Dictionary, Favicon Images, Favicon Tracking, Device Info, App List, Arc Package, Printers, Reading List, Send Tab To Self, Wifi Configurations, Web Apps, OS Preferences (from Sync v2 brave-core#5294)
    • In brave://sync-internals/:Has Token is true (from Sync v2 brave-core#5294)
    • In [profile]/Default/Preferences: seed in brave_sync_v2 should not be your sync code (it is encrypted) (from Sync v2 brave-core#5294)
    • In [profile]/Default/Preferences: v1_meta_info_cleared is true (from Sync v2 brave-core#5294)
    • In [profile]/Default/Preferences: v1_migrated is true (from Sync v2 brave-core#5294)
  • Create standalone sync chain with QR code
Steps
  1. Clean install
  2. Open brave://settings/braveSync/setup
  3. Click Start a new sync chain
  4. Click Phone/Tablet
  5. Click OK
  6. Click Manage your synced devices
  • Expected behavior
    • Sync chain is created
    • Device list contains only one device
    • In brave://sync-internals/:Passphrase Type is PassphraseType::kCustomPassphrase (from Sync v2 brave-core#5294)
    • In brave://sync-internals/:Encrypted Types is Bookmarks, Preferences, Passwords, Autofill Profiles, Autofill, Autofill Wallet Metadata, Themes, Typed URLs, Extensions, Search Engines, Sessions, Apps, App settings, Extension settings, Dictionary, Favicon Images, Favicon Tracking, Device Info, App List, Arc Package, Printers, Reading List, Send Tab To Self, Wifi Configurations, Web Apps, OS Preferences (from Sync v2 brave-core#5294)
    • In brave://sync-internals/:Has Token is true (from Sync v2 brave-core#5294)
    • In [profile]/Default/Preferences: seed in brave_sync_v2 should not be your sync code (it is encrypted) (from Sync v2 brave-core#5294)
    • In [profile]/Default/Preferences: v1_meta_info_cleared is true (from Sync v2 brave-core#5294)
    • In [profile]/Default/Preferences: v1_migrated is true (from Sync v2 brave-core#5294)
  • Create standalone sync chain - reload
Steps
  1. Clean install
  2. Open brave://settings/braveSync/setup
  3. Click Start a new sync chain
  4. Click Computer
  5. Reload
  • Expected behavior
    • A prompt is shown warning against reloading the sync creation page.
  • Create standalone sync chain - cancel
Steps
  1. Clean install
  2. Open brave://settings/braveSync/setup
  3. Click Start a new sync chain
  4. Click Computer
  5. Copy code words
  6. Click x located in the top right corner
  • Expected behavior
    • Prompt is shown warning against leaving the sync creation process because it will create new code words
  • Create standalone sync chain - when offlline
Steps
  1. Go offline
  2. Clean install
  3. Open brave://settings/braveSync/setup
  4. Click Start a new sync chain
  5. Click Computer
  6. Click OK
  7. Click Manage your synced devices
  • Expected behavior
    • Device List is shown but it is empty
    • All Sync Settings are turned off
  • Create standalone sync chain - when going back online
Steps
  1. Do steps from Create standalone sync chain - when offlline
  2. Go back online
  3. Wait for the sync chain creation
  • Expected behavior
    • Device List is automatically updated and it shows one device (no need to reload the page)
    • All Sync Settings are automatically turned on
    • Transport State is set to Active in brave://sync-internals/
    • In brave://sync-internals/:Passphrase Type is PassphraseType::kCustomPassphrase (from Sync v2 brave-core#5294)
    • In brave://sync-internals/:Encrypted Types is Bookmarks, Preferences, Passwords, Autofill Profiles, Autofill, Autofill Wallet Metadata, Themes, Typed URLs, Extensions, Search Engines, Sessions, Apps, App settings, Extension settings, Dictionary, Favicon Images, Favicon Tracking, Device Info, App List, Arc Package, Printers, Reading List, Send Tab To Self, Wifi Configurations, Web Apps, OS Preferences (from Sync v2 brave-core#5294)
    • In brave://sync-internals/:Has Token is true (from Sync v2 brave-core#5294)
    • In [profile]/Default/Preferences: seed in brave_sync_v2 should not be your sync code (it is encrypted) (from Sync v2 brave-core#5294)
    • In [profile]/Default/Preferences: v1_meta_info_cleared is true (from Sync v2 brave-core#5294)
    • In [profile]/Default/Preferences: v1_migrated is true (from Sync v2 brave-core#5294)
  • Create sync chain when Client clock is out of date
Steps
  1. Move system clock forward 25hours
  2. Follow steps in Create standalone sync chain with code words
  • Expected behavior
    • Sync chain is created
    • Transport State is set to Active in brave://sync-internals/
  • Leave standalone sync chain when offline - created when offline
Steps
  1. Do steps from Create standalone sync chain - when offline
  2. Remain offline
  3. Leave sync chain
  • Expected behavior
    • Sync is reset
    • Transport State is set to Disabled in brave://sync-internals/
    • In [profile]/Default/Preferences: seed is deleted from brave_sync_v2
  • Leave standalone sync chain when going back online - created when online
Steps
  1. Do steps from Create standalone sync chain with code words
  2. Go offline
  3. Leave sync chain
  4. Go online
  • Expected behavior
    • Sync is reset
    • Transport State is set to Disabled in brave://sync-internals/
    • In [profile]/Default/Preferences: seed is deleted from brave_sync_v2

Multiple devices sync chain

  • Create sync chain with code word when online
Steps
  1. Clean install DeviceA and DeviceB
  2. On DeviceA open brave://settings/braveSync/setup
  3. On DeviceA click Start a new sync chain
  4. On DeviceA click Computer
  5. On DeviceA copy the code words
  6. On DeviceA click OK
  7. On DeviceB open brave://settings/braveSync/setup
  8. On DeviceB click I have a sync Code
  9. On DeviceB paste the code words
  10. On DeviceB click Confirm
  11. Wait for the sync chain creation
  • Expected behavior
    • Possible to copy the code words
    • Possible to paste the code words
    • Sync chain is created successfully
    • OnDeviceA: Device list contains both DeviceA and DeviceB
    • OnDeviceB: Device list contains both DeviceA and DeviceB
    • The device list is updated automatically (no need to reload the sync page)
  • Create sync chain with code word when going back online
Steps
  1. Go offline DeviceA and DeviceB
  2. Clean install DeviceA and DeviceB
  3. On DeviceA open brave://settings/braveSync/setup
  4. On DeviceA click Start a new sync chain
  5. On DeviceA click Computer
  6. On DeviceA copy the code words
  7. On DeviceA click OK
  8. On DeviceB open brave://settings/braveSync/setup
  9. On DeviceB click I have a sync Code
  10. On DeviceB paste the code words
  11. On DeviceB click Confirm
  12. Go online DeviceA and DeviceB
  13. Wait for the sync chain creation
  • Expected behavior
    • Possible to copy the code words
    • Possible to paste the code words
    • Sync chain is created successfully
    • OnDeviceA: Device list contains both DeviceA and DeviceB
    • OnDeviceB: Device list contains both DeviceA and DeviceB
    • The device list is updated automatically (no need to reload the sync page)
  • Create sync chain with invalid code words
Steps
  1. Clean install DeviceA and DeviceB
  2. On DeviceA open brave://settings/braveSync/setup
  3. On DeviceA click Start a new sync chain
  4. On DeviceA click Computer
  5. On DeviceA copy the code words
  6. Change last word of the code words to make invalid code words
  7. On DeviceB use the invalid code words
  8. On DeviceB use the proper code words
  9. Wait for the sync chain creation
  • Expected behavior
    • Error is shown when invalid code words are used
    • Sync chain is created after proper code words are used
  • Create sync chain with no code words
Steps
  1. Clean install DeviceA and DeviceB
  2. On DeviceA open brave://settings/braveSync/setup
  3. On DeviceA click Start a new sync chain
  4. On DeviceA click Computer
  5. On DeviceA copy the code words
  6. On DeviceB use empty code words
  7. On DeviceB use the proper code words
  8. Wait for the sync chain creation
  • Expected behavior
    • Error is shown when empty code words are used
    • Sync chain is created after proper code words are used
  • Create sync chain with code words that have leading and trailing white space
Steps
  1. Clean install DeviceA and DeviceB
  2. On DeviceA open brave://settings/braveSync/setup
  3. On DeviceA click Start a new sync chain
  4. On DeviceA click Computer
  5. On DeviceA copy the code words
  6. Add leading and trailing white space to the code words
  7. On DeviceB use the code words
  8. Wait for the sync chain creation
  • Expected behavior
    • Sync chain is created
  • Leave sync chain when online
Steps
  1. Follow Create sync chain with code word when online
  2. DeviceB: Leave sync chain
  • Expected behavior
    • DeviceB: Prompt is shown asking if user is sure to leave sync chain
    • DeviceB: Sync chain is reset
      image
    • DeviceA: DeviceB is deleted from the sync chain
  • Leave sync chain when going back online
Steps
  1. Follow Create sync chain with code word when online
  2. Go offline
  3. DeviceB: Leave sync chain
  4. (Optional) Restart Brave
  5. Go online
  • Expected behavior
    • DeviceB: Prompt is shown asking if user is sure to leave sync chain
    • DeviceB: Sync chain is reset
      image
    • DeviceA: DeviceB is deleted from the sync chain
  • Create sync chain when error from server
Steps
  1. TODO
  • Leave sync chain when error from server
Steps
  1. TODO

Sync Bookmarks and Folders

  • Existing bookmarks
Steps
  1. Clean install on DeviceA and DeviceB
  2. DeviceA: Add bookmark A1
  3. DeviceB: Add bookmark B1
  4. Establish sync chain between DeviceA and DeviceB
  5. Wait for sync update
  • Expected behavior
    • Bookmarks are synced
    • The order of bookmarks is the same on both devices
  • Existing bookmark folders
Steps
  1. Clean install on DeviceA and DeviceB
  2. DeviceA: Add bookmark folder FA1
  3. DeviceB: Add bookmark folder FB1
  4. Establish sync chain between DeviceA and DeviceB
  5. Wait for sync update
  • Expected behavior
    • Bookmark folders are synced
    • The order is the same on both devices
  • Existing imported bookmarks and bookmark folders
Steps
  1. Clean install on DeviceA and DeviceB
  2. DeviceA: Import sync1_DeviceA.html.txt
  3. DeviceB: Import sync1_DeviceB.html.txt
  4. Establish sync chain between DeviceA and DeviceB
  5. Wait for sync update
  • Expected behavior
    • The structure and order is the same every time on both devices
    • image
  • Add bookmarks
Steps
  1. Follow steps from Existing bookmark folders
  2. DeviceA: Add bookmark A1
  3. DeviceB: Add bookmark B1
  4. DeviceA: Add bookmark A2 to FB1
  5. DeviceB: Add bookmark B2 to FA1
  6. Wait for sync update
  • Expected behavior
    • Bookmark folders are synced
    • The order and structure is the same on both devices
  • Add bookmarks when going back online
Steps
  1. Follow steps from Existing bookmark folders
  2. Go offline
  3. DeviceA: Add bookmark A1
  4. DeviceB: Add bookmark B1
  5. DeviceA: Add bookmark A2 to FB1
  6. DeviceB: Add bookmark B2 to FA1
  7. (Optional) Restart browser
  8. Go online
  9. Wait for sync update
  • Expected behavior
    • Bookmark folders are synced
    • The order and structure is the same on both devices
  • Add imported bookmarks and bookmark folders - parallel import
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Import sync1_DeviceA.html.txt
  4. DeviceB: Import sync1_DeviceB.html.txt
  5. Wait for sync update
  • Expected behavior
    • The structure and order is the same on both devices
    • image
  • Add imported bookmarks and bookmark folders - sequence import
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Import sync1_DeviceA.html.txt
  4. Wait for sync update
  5. DeviceB: Import sync1_DeviceB.html.txt
  6. Wait for sync update
  • Expected behavior
    • The structure and order is the same on both devices
    • image
  • Add bookmark folders
Steps
  1. Follow steps from Existing bookmark folders
  2. DeviceA: Add bookmark folder FA2
  3. DeviceB: Add bookmark folder FB2
  4. DeviceA: Add bookmark folder FA2 to FB1
  5. DeviceB: Add bookmark folder FB2 to FA1
  6. Wait for sync update
  • Expected behavior
    • Bookmark folders are synced
    • The order and structure is the same on both devices
  • Move bookmarks to the end
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark A1
  4. DeviceA: Add bookmark A2
  5. DeviceA: Add bookmark A3
  6. Wait till bookmarks are synced to DeviceB
  7. DeviceA OR DeviceB: Move A1 to the end
  8. Wait for sync update
  • Expected behavior
    • The order on both devices is A2 A3 A1
  • Move bookmarks to the beginning
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark A1
  4. DeviceA: Add bookmark A2
  5. DeviceA: Add bookmark A3
  6. Wait till bookmarks are synced to DeviceB
  7. DeviceA OR DeviceB: Move A3 to the beginning
  8. Wait for sync update
  • Expected behavior
    • The order on both devices is A3 A1 A2
  • Move bookmarks to a folder
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark folder FA1
  4. DeviceB: Add bookmark folder FB1
  5. DeviceA: Add bookmark A1
  6. DeviceA: Add bookmark A2
  7. Wait for sync update
  8. DeviceB: Move A1 to FA1
  9. DeviceA: Move A2 to FB1
  10. Wait for sync update
  • Expected behavior
    • The structure is: FA1 -> A1 FB1 -> A2
  • Move bookmark in a folder to another folder
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark folder FA1
  4. DeviceB: Add bookmark folder FB1
  5. DeviceA: Add bookmark A1 to FA1
  6. Wait for sync update
  7. DeviceB: Move A1 to FB1
  8. Wait for sync update
  • Expected behavior
    • A1 is moved to FB1 on both devices
  • Move bookmark within one folder
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark folder FA1
  4. DeviceA: Add bookmark A1 to FA1
  5. DeviceA: Add bookmark A2 to FA1
  6. DeviceA: Add bookmark A3 to FA1
  7. Make sure structure is FA1 -> A1 A2 A3
  8. Wait till bookmarks are synced to DeviceB
  9. DeviceA OR DeviceB: Move A1 to the end
  10. Wait for sync update
  • Expected behavior
    • The order on both devices is FA1 -> A2 A3 A1
  • Move bookmark folder to another folder
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark folder FA1
  4. DeviceB: Add bookmark folder FB1
  5. DeviceA: Add bookmark folder FA2
  6. Wait for sync update
  7. DeviceB: Move FA1 to FA2
  8. DeviceA: Move FA2 to FB1
  9. Wait for sync update
  • Expected behavior
    • The structure is: FB1 -> FA2 -> FA1
  • Rename bookmarks
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark A1
  4. DeviceA: Add bookmark A2
  5. DeviceA: Add bookmark A3
  6. Wait till bookmarks are synced to DeviceB
  7. DeviceA: Rename A1 to A4
  8. DeviceA: Rename A2 to B1
  9. Wait for sync update
  • Expected behavior
    • A1 is renamed to A4
    • A2 is renamed to B1
  • Rename same bookmark at the same time
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark A1
  4. Wait till bookmark is synced to DeviceB
  5. DeviceA: Rename A1 to A2
  6. DeviceA: Rename A1 to B1
  7. Wait for sync update
  • Expected behavior
    • The bookmark is named the same on both devices
    • The bookmark is named: A2 or B1
    • The bookmark is NOT named: A1
  • Change bookmarks URL
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark A1 with URL A1.com
  4. Wait till bookmarks are synced to DeviceB
  5. DeviceA: Change URL to A2.com
  6. Wait for sync update
  • Expected behavior
    • The bookmark's URL is A2.com on both devices
  • Delete bookmarks
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark A1
  4. Wait till bookmark is synced to DeviceB
  5. DeviceB: Delete A1
  6. Wait for sync update
  • Expected behavior
    • A1 is deleted on both devices
  • Rename bookmark folder
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark folder FA1
  4. Wait till bookmark is synced to DeviceB
  5. DeviceB: Rename FA1 to FB1
  6. Wait for sync update
  • Expected behavior
    • FA1 is rename to FB1 on both devices
  • Delete bookmarks folder
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark folder FA1
  4. Wait till bookmark is synced to DeviceB
  5. DeviceB: Delete FA1
  6. Wait for sync update
  • Expected behavior
    • FA1 is deleted on both devices
  • Move bookmark to a deleted bookmark folder
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark folder FA1
  4. DeviceA: Add bookmark A1
  5. Wait for sync update
  6. DeviceB: Delete FA1 and the same time on DeviceA: Move A1 to FA1
  7. Wait for sync update
  • Expected behavior
    • The bookmark structure is the same on both devices
  • Move bookmark to a renamed bookmark folder
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark folder FA1
  4. DeviceA: Add bookmark A1
  5. Wait till bookmark is synced to DeviceB
  6. DeviceB: Rename FA1 to FB1 and the same time on DeviceA: Move A1 to FA1
  7. Wait for sync update
  • Expected behavior
    • The bookmark structure is the same on both devices
    • The structure is FB1 -> A1
  • Sync bookmarks favicons
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open interia.pl and bookmark it
  4. Wait till the bookmark is synced to DeviceB
  • Expected behavior
    • Bookmark is synced
    • Bookmark Favicon is propagated to DeviceB
    • Bookmark Favicon is the same on both devices
  • Change bookmarks URL - favicons
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open https://www.onet.pl
  4. DeviceA: Open https://www.interia.pl and bookmark it
  5. Wait till the bookmark is synced to DeviceB
  6. DeviceA: Change URL to https://www.onet.pl
  7. Wait for sync update
  • Expected behavior
    • URL is changed to https://www.onet.pl on both devices
    • Favicon is changed to onet.pl on both devices
  • Sync 1000 bookmarks (stress test)
Steps

Important: It is best to stress test on staging server, use --sync-url="https://sync-v2.bravesoftware.com/v2"

  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB on staging server
  3. DeviceA: Import brave_sorted_1000.html
  4. Wait for sync update
  • Expected behavior
    • The structure and order is the same on both devices (best to use brave://bookmarks)
  • Sync 5000 bookmarks (stress test)
Steps

Important: It is best to stress test on staging server, use --sync-url="https://sync-v2.bravesoftware.com/v2"

  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB on staging server
  3. DeviceA: Import brave_sorted_5000.html
  4. Wait for sync update
  • Expected behavior
    • The structure and order is the same on both devices (best to use brave://bookmarks)
  • Add bookmarks to Other Bookmarks
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark A1 to Other Bookmarks
  4. Wait for sync update
  • Expected behavior
    • Bookmarks are synced
    • Other Bookmarks folder is automatically shown on the right side of Bookmark bar
    • The order and structure is the same on both devices
  • Delete all bookmarks from Other Bookmarks
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Add bookmark A1 to Other Bookmarks
  4. DeviceB: Add bookmark B1 to Other Bookmarks
  5. DeviceA: Add bookmark folder FA1 to Other Bookmarks
  6. DeviceB: Add bookmark folder FB1 to Other Bookmarks
  7. Wait for sync update
  8. DeviceA: Delete all bookmarks and bookmarks folders from Other Bookmarks
  • Expected behavior
    • All bookmarks and bookmarks folders are deleted from Other Bookmarks
    • Other Bookmarks folder is automatically hidden from Bookmark bar

Sync other stuff

  • Sync Browsing History
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open interia.pl
  4. DeviceA: Open onet.pl
  5. Wait for sync update
  • Expected behavior
    • DeviceB: interia.pl is present in brave://history/
    • DeviceB: onet.pl is present in brave://history/
  • Sync Browsing History - delete all history
Steps
  1. Follow Sync Browsing History
  2. DeviceA: Open brave://settings/clearBrowserData and clear browsing data
  3. Wait for sync update
  • Expected behavior
    • DeviceB: interia.pl is not present in brave://history/
    • DeviceB: onet.pl is not present in brave://history/
  • Sync Browsing History - going back online
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. Go Offline
  4. DeviceA: Open interia.pl
  5. DeviceA: Open onet.pl
  6. Wait for sync update
  7. Go Online
  • Expected behavior
    • DeviceB: interia.pl is present in brave://history/
    • DeviceB: onet.pl is present in brave://history/
  • Sync Browsing History - turn off in Sync Settings
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. Turn off History syncing
  4. DeviceA: Open interia.pl
  5. DeviceA: Open onet.pl
  6. Wait for sync update
  • Expected behavior
    • DeviceB: History is not synced, history is empty in brave://history/
  • Sync Browsing History - Guest Window
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open interia.pl in Guest Window
  4. DeviceA: Open onet.pl in Guest Window
  5. Wait for sync update
  • Expected behavior
    • DeviceB: interia.pl is not present in brave://history/
    • DeviceB: onet.pl is not present in brave://history/
  • Sync Browsing History - Private Window
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open interia.pl in Private Window
  4. DeviceA: Open onet.pl in Private Window
  5. Wait for sync update
  • Expected behavior
    • DeviceB: interia.pl is not present in brave://history/
    • DeviceB: onet.pl is not present in brave://history/
  • Sync Browsing History - Private Window with Tor
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open interia.pl in Private Window with Tor
  4. DeviceA: Open onet.pl in Private Window with Tor
  5. Wait for sync update
  • Expected behavior
    • DeviceB: interia.pl is not present in brave://history/
    • DeviceB: onet.pl is not present in brave://history/
  • Sync Tab (Send Tab To Self)
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open interia.pl
  4. DeviceA: In URL field click Send this page image
  5. Wait for sync update
  6. DeviceB: Click the Notification
  • Expected behavior
    • DeviceB: Notification is shown containing the page URL
    • DeviceB: When notification is clicked, page is opened in Brave
  • Sync Open Tabs
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open interia.pl
  4. DeviceA: Open onet.pl in new tab
  5. Wait for sync update
  • Expected behavior
    • DeviceB: interia.pl is present in Hamburger Menu -> History
    • DeviceB: onet.pl is present in Hamburger Menu -> History
  • Sync Open Tabs - Guest Window
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open Guest Window
  4. DeviceA: Open interia.pl
  5. DeviceA: Open onet.pl in new tab
  6. Wait for sync update
  • Expected behavior
    • DeviceB: interia.pl is not present in Hamburger Menu -> History
    • DeviceB: onet.pl is not present in Hamburger Menu -> History
  • Sync Open Tabs - Private Window
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open Private Window
  4. DeviceA: Open cnn.com
  5. DeviceA: Open foxnews.com in new tab
  6. Wait for sync update
  • Expected behavior
    • DeviceB: cnn.com is not present in Hamburger Menu -> History
    • DeviceB: foxnews.com is not present in Hamburger Menu -> History
  • Sync Open Tabs - Private Window with Tor
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open Private Window with Tor
  4. DeviceA: Open wp.pl
  5. DeviceA: Open o2.pl in new tab
  6. Wait for sync update
  • Expected behavior
    • DeviceB: wp.pl is not present in Hamburger Menu -> History
    • DeviceB: o2.pl is not present in Hamburger Menu -> History
  • Sync Open Tabs - going back online
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. Go Offline
  4. DeviceA: Open interia.pl
  5. DeviceA: Open onet.pl in new tab
  6. Go online
  7. Wait for sync update
  • Expected behavior
    • DeviceB: interia.pl is present in Hamburger Menu -> History
    • DeviceB: onet.pl is present in Hamburger Menu -> History
  • Sync Open Tabs - turn off in Sync Settings
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open interia.pl
  4. DeviceA: Open onet.pl in new tab
  5. DeviceA: Turn Sync Open Tabs off
  6. Wait for sync update
  • Expected behavior
    • DeviceB: interia.pl is not present in Hamburger Menu -> History
    • DeviceB: onet.pl is not present in Hamburger Menu -> History
  • Sync Search engines - default search engine
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open brave://settings/search
  4. DeviceA: Change default search engine to Qwant
  5. Wait for sync update
  6. DeviceB: Search for test in URL bar
  • Expected behavior
    • DeviceB: Qwant is used in URL bar as default search engine
    • DeviceB: Default search engine in brave://settings/search is Qwant
  • Sync Search engines - new search engine
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open brave://settings/searchEngines
  4. DeviceA: Add new search engine
    Search engine: techrepublic.com
    Keyword: techrepublic
    URL: http://www.techrepublic.com/search/?q=%s`
  5. Wait for sync update
  • Expected behavior
    • DeviceB: New search engine is added in brave://settings/searchEngines
    • DeviceB: Able to search with the new engine (Enter techrepublic in URL Field and the hit space)
  • Sync Search engines - default search engine - going back online
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. Go offline
  4. DeviceA: Open brave://settings/search
  5. DeviceA: Change default search engine to Qwant
  6. Go online
  7. Wait for sync update
  8. DeviceB: Search for test in URL bar
  • Expected behavior
    • DeviceB: Qwant is used in URL bar as default search engine
    • DeviceB: Default search engine in brave://settings/search is Qwant
  • Sync Extensions
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: install https://chrome.google.com/webstore/detail/custom-cursor-for-chrome/ogdlpmhglpejoiomcodnpjnfgcpmgale/related
  4. Wait for sync update
  • Expected behavior
    • DeviceB: the extension is synced
  • Sync Extensions Settings
Steps
  1. Follow Sync Extensions
  2. DeviceA: Open brave://extensions/?id=ogdlpmhglpejoiomcodnpjnfgcpmgale
  3. DeviceA: Turn on Allow in private
  4. Wait for sync update
  5. DeviceB: Open brave://extensions/?id=ogdlpmhglpejoiomcodnpjnfgcpmgale
  • Expected behavior
    • DeviceB: Allow in private is turned on
  • Sync Extensions - turn off in Sync Settings
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. Turn Sync Extensions off in Sync Settings
  4. DeviceA: install https://chrome.google.com/webstore/detail/custom-cursor-for-chrome/ogdlpmhglpejoiomcodnpjnfgcpmgale/related
  5. Wait for sync update
  • Expected behavior
    • DeviceB: the extension is not synced
  • Sync Extensions - going back online
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. Go offline
  4. DeviceA: install https://chrome.google.com/webstore/detail/custom-cursor-for-chrome/ogdlpmhglpejoiomcodnpjnfgcpmgale/related
  5. Go online
  6. Wait for sync update
  • Expected behavior
    • DeviceB: the extension is synced
  • Sync Theme
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Install theme: https://chrome.google.com/webstore/detail/pro-grey/enhpebdanojkmhbbneclbkmpleemilaj
  4. Wait for sync update
  • Expected behavior
    • DeviceB: pro grey theme is used
  • Sync Passwords
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: open https://www.w3schools.com/Tags/tryit.asp?filename=tryhtml5_input_type_password
  4. Enter
    user : test
    password : test1
  5. Save the password
  6. Wait for sync update
  7. DeviceB: open https://www.w3schools.com/Tags/tryit.asp?filename=tryhtml5_input_type_password
  8. Autofill the passwords
  • Expected behavior
    • DeviceB: user and password fill the fields
  • Sync Passwords - turn off in Sync Settings
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: open https://www.w3schools.com/Tags/tryit.asp?filename=tryhtml5_input_type_password
  4. Enter
    user : test
    password : test1
  5. Save the password
  6. Wait for sync update
  7. DeviceB: open https://www.w3schools.com/Tags/tryit.asp?filename=tryhtml5_input_type_password
  8. Autofill the passwords
  • Expected behavior
    • DeviceB: user and password fill the fields
  • Sync Autofill - Payment methods
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open brave://settings/payments
  4. DeviceA: Add new Payment method
  5. Wait for sync update
  • Expected behavior
    • DeviceB: The payment method is synced
  • Sync Autofill - Addresses
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open brave://settings/addresses
  4. DeviceA: Add new Address
  5. Wait for sync update
  • Expected behavior
    • DeviceB: The address is synced
  • Sync Apps
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  3. DeviceA: Open interia.pl
  4. DeviceA: Click Install Interia in the URL field image
  5. Wait for sync update
  6. DeviceB: Open interia.pl
  • Expected behavior
    • DeviceB: Interia app is synced
  • Sync Preferences
Steps
  1. Clean install on DeviceA and DeviceB
  2. Establish sync chain between DeviceA and DeviceB
  • Expected behavior
    • DeviceB:
@btlechowski btlechowski mentioned this issue Aug 6, 2020
Closed
@kjozwiak
Copy link
Member

kjozwiak commented Aug 12, 2020 •
edited
Loading

Verification PASSED on Win 10 x64 using the following build:

Brave | 1.12.108 Chromium: 84.0.4147.105 (Official Build) (64-bit)
--- | ---
Revision | a6b12dfad6663f13a7e16e9a42a6a4975374096b-refs/branch-heads/4147@{#943}
OS | Windows 10 OS Version 2004 (Build 19041.423)
  • Sync Browsing History - PASSED
  • Sync Browsing History - delete all history - PASSED
  • Sync Browsing History - turn off in Sync Settings - PASSED
  • Sync Browsing History - Guest Window - PASSED
  • Sync Browsing History - Private Window - PASSED
  • Sync Browsing History - Private Window with Tor - PASSED
  • Sync Tab (Send Tab To Self) - PASSED
  • Sync Open Tabs - Guest Window - PASSED
  • Sync Open Tabs - Private Window - PASSED
  • Sync Open Tabs - Private Window with Tor - PASSED
  • Sync Open Tabs - turn off in Sync Settings - PASSED
  • Sync Search engines - default search engine - PASSED
  • Sync Search engines - new search engine - PASSED
  • Sync Extensions - PASSED
  • Sync Extensions Settings - PASSED
  • Sync Extensions - turn off in Sync Settings - PASSED
  • Sync Theme - PASSED
  • Sync Passwords - PASSED
  • Sync Passwords - turn off in Sync Settings - PASSED
  • Sync Autofill - Addresses - PASSED
  • Sync Apps - PASSED
  • Sync Preferences - PASSED

Invalid/Can't run through the following cases:

  • Sync Browsing History - going back online
  • Sync Open Tabs - going back online
  • Sync Search engines - default search engine - going back online
  • Sync Extensions - going back online
  • Sync Autofill - Payment methods

Verification passed on

Brave | 1.12.108 Chromium: 84.0.4147.105 (Official Build) (64-bit)
-- | --
Revision | a6b12dfad6663f13a7e16e9a42a6a4975374096b-refs/branch-heads/4147@{#943}
OS | Windows 10 OS Version 1903 (Build 18362.959)
  • Logged Tabs opened via top tiles are not synced in Desktop brave-browser#11196 and [Desktop] Devices are not synced after upgrade from V1 brave-browser#11206
  • Create standalone sync chain with code words – PASS
  • Create standalone sync chain with QR code – PASS
  • Create standalone sync chain - reload – PASS
  • Create standalone sync chain - cancel - PASS encountered #10859
  • Create standalone sync chain - when offline – PASS
  • Create standalone sync chain - when going back online – PASS
  • Create sync chain when Client clock is out of date – PASS
  • Leave standalone sync chain when offline - created when offline – PASS
  • Leave standalone sync chain when going back online - created when online – PASS
  • Create sync chain with code word when online – PASS
  • Create sync chain with code word when going back online – PASS
  • Create sync chain with invalid code words – PASS
  • Create sync chain with no code words – PASS
  • Create sync chain with code words that have leading and trailing white space – PASS
  • Leave sync chain when online – PASS
  • Leave sync chain when going back online -PASS
  • Existing bookmarks - PASS
  • Existing bookmark folders – PASS
  • Existing imported bookmarks and bookmark folders – PASS
  • Add bookmarks – PASS
  • Add bookmarks when going back online – PASS
  • Add imported bookmarks and bookmark folders - parallel import - PASS
  • Add imported bookmarks and bookmark folders - sequence import – PASS
  • Add bookmark folders -PASS
  • Move bookmarks to the end - PASS
  • Move bookmarks to the beginning - PASS
  • Move bookmarks to a folder - PASS
  • Move bookmark in a folder to another folder - PASS
  • Move bookmark within one folder - PASS
  • Move bookmark folder to another folder- PASS
  • Rename bookmarks – PASS
  • Rename same bookmark at the same time – PASS
  • Change bookmarks URL – PASS
  • Delete bookmarks – PASS
  • Rename bookmark folder – PASS
  • Delete bookmarks folder – PASS
  • Move bookmark to a deleted bookmark folder – PASS encountered #11156
  • Move bookmark to a renamed bookmark folder – PASS
  • Sync bookmarks favicons -PASS
  • Change bookmarks URL – favicons – PASS
  • Sync 1000 bookmarks (stress test) - PASS
  • Sync 5000 bookmarks (stress test) – PASS
  • Add bookmarks to Other Bookmarks – PASS
  • Delete all bookmarks from Other Bookmarks - PASS

@kjozwiak
Copy link
Member

@btlechowski closing this off as it's basically completed 👍 Awesome job getting this created.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@kjozwiak @btlechowski