Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Automated UI Tests for iOS #39

Closed
15 of 17 tasks
roblabs opened this issue Mar 5, 2021 · 2 comments
Closed
15 of 17 tasks

Automated UI Tests for iOS #39

roblabs opened this issue Mar 5, 2021 · 2 comments
Labels
build Related to build, configuration or CI/CD iOS

Comments

@roblabs
Copy link
Collaborator

roblabs commented Mar 5, 2021 •
edited
Loading

Initial Automated UI Tests demo for Xcode

  • Create initial UITest scaffolding for iOS
  • Add UITests based on XCTest with deployment target of iOS 9.0
  • Save a PNG screenshot to the UITest results. Add XCTest extension for screenshots
  • Provide PNG & Video .MOV samples to demonstrate automated UITests running in Xcode
  • Add flag to make iproj CI=1 to run in headless mode (for GitHub Actions & Xcode Server Bots)
  • Add UITests for the Scheme iosapp
  • Enable UITests for the Scheme bench while in the iosapp scheme
  • For the Scheme bench, Write the Benchmark log to the Documents Directory of the Simulator or Device to facilitate testing of many Benchmarking runs and iterations for testing FPS. Useful for Metal versus Open GL testing.
  • Review tests for for FPS performance (for example, for Metal)
  • Add Zero Configuration (Zeroconf) Styles to the Scheme iosapp to facilitate automated testing without an access token nor secrets (for GitHub Actions & Xcode Server Bots).
    • Add tests for other tile providers and TileJSON sources
  • Demonstrate automated UITests running in GitHub Actions
  • Demonstrate with Xcode Server Bots (XCS) for locally made builds.
  • Determine where Xcode xcresult result bundles should be stored (for example, attached as part of a release)
  • Test with command line builds (xcodebuild & make test)
  • Demonstrate running automated UI Tests in AWS Device Farm
  • Submit PR from working branch https://github.com/roblabs/maplibre-gl-native/commits/uitests

Sample Test PNG & MOV

Sample output file saved in .xcresult
MapLibre-Screenshot-Null Island Tiles-iPhone 6s-13.7.png
@roblabs
Copy link
Collaborator Author

roblabs commented Mar 8, 2021

  • Add Zero Configuration (Zeroconf) Styles to the Scheme iosapp to facilitate automated testing without an access token nor secrets (for GitHub Actions & Xcode Server Bots).

Screen recording of Zeroconf Tiles using Xcode 12.5

UITests.mov

@roblabs roblabs mentioned this issue Mar 10, 2021
Merged
@wipfli
Copy link
Contributor

wipfli commented Jul 1, 2022

Can this be closed @roblabs? It looks like to implemented automated ui tests in #47...

@roblabs roblabs closed this as completed Jul 1, 2022
@roblabs roblabs added build Related to build, configuration or CI/CD iOS labels Jul 1, 2022
@roblabs roblabs mentioned this issue Feb 8, 2023
Closed
@louwers louwers mentioned this issue May 27, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
build Related to build, configuration or CI/CD iOS
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@roblabs @wipfli