WinAppDriver test infrastructure

[crutkas]

We can do unit testing on a lot of parts, but true app testing is needed. We will enable WinAppDriver testing in common scenarios to verify end to end scenarios continue to work.

[crutkas]

@SeraphimaZ what is the game plan for what is being implemented here? what items are planned / phases to get checked in?

[SeraphimaZykova]

@crutkas I’ve done some tests for fancy zones settings: I interact with elements and check if they are saved correctly in settings file. I’m planning to finish this part today.
After that I was planning to do same thing with editor: create and modify zone layouts and check settings file. It would take about a week I think.
Then I’ll do tests for applying zones and interacting with them with different settings, there should be many tests and it’ll take a time.

[crutkas]

Rather than once big PR, let’s do a few smaller ones. I would love to see this checked in and start playing with it.

[enricogior]

Sure, we can do it.

[SeraphimaZykova]

Current progress with tests:

Tray tests:

• Open settings by clicking on tray icon
• Open settings with context menu
• Exit PowerToys

FancyZones Settings: all tests interact with elements and check saved settings file

• Click toggles
• Set zone highlight opacity
  • valid value
  • negative value
  • too big value
  • non-digit characters
  • insert from clipboard
• Change highlight opacity by clicking increase/decrease buttons
• Send to rgb/hex inputs different symbols and combinations
• Write excluded apps
• Set hotkey combinations
• Test exit/save/cancel buttons if there were unsaved changes on closing

Editor:

• Open editor by clicking button/by hotkey
  • without settings file
  • without settings folder
  • with valid settings file
  • with valid settings file contained cyrillic characters
  • with invalid settings file
  • with cropped settings file
• Increase/decrease zone count, check min and max possible values
• Test if settings are saved in file properly
  • Show spacing checked/unchecked
  • Space around zone saved correctly
• Space around zone possible input values
• Edit templates, check settings files
• Apply templates, check settings files
• Create new different custom layouts
• Remove custom layout
• Edit custom layout
  • resize canvas zones
  • resize grid zones
  • create splitters for grid layout
  • merge zones in grid layout

[enricogior]

The core of the WinAppDriver testing is completed, more test are under development but we can consider this work item done.
We should move the test list to a wiki page and continue adding test cases there.