Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(ci): E2E RN Version Matrix #2735

Merged
merged 24 commits into from
Jan 18, 2023
Merged

chore(ci): E2E RN Version Matrix #2735

merged 24 commits into from
Jan 18, 2023

Conversation

krystofwoldrich
Copy link
Member

@krystofwoldrich krystofwoldrich commented Jan 6, 2023

📢 Type of change

  • Bugfix
  • New feature
  • Enhancement
  • Refactoring

📜 Description

This PR builds on top of the RN Version matrix that builds RN app with the SDK for any given RN version and RN architecture.

It takes the built app and runs e2e tests against it. To do this the e2e tests are extracted from the sample app into separate npm packages that can be integrated with and run against any RN app.

💡 Motivation and Context

Closes:

💚 How did you test it?

ci, run tests locally

📝 Checklist

  • I reviewed submitted code
  • I added tests to verify changes
  • All tests passing
  • No breaking changes

🔮 Next steps

#skip-changelog

This will enable as inject the test to the different rn version project.
@github-actions
Copy link
Contributor

github-actions bot commented Jan 6, 2023

Android (legacy) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 264.29 ms 274.78 ms 10.49 ms
Size 17.73 MiB 20.08 MiB 2.34 MiB

Baseline results on branch: 5.0.0

Startup times

Revision Plain With Sentry Diff
b868b53+dirty 339.52 ms 369.84 ms 30.32 ms
d091239+dirty 425.61 ms 447.11 ms 21.50 ms

App size

Revision Plain With Sentry Diff
b868b53+dirty 17.73 MiB 19.95 MiB 2.22 MiB
d091239+dirty 17.73 MiB 19.95 MiB 2.22 MiB

@github-actions
Copy link
Contributor

github-actions bot commented Jan 6, 2023

Android (new) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 265.43 ms 288.70 ms 23.27 ms
Size 7.15 MiB 8.13 MiB 1002.36 KiB

Baseline results on branch: 5.0.0

Startup times

Revision Plain With Sentry Diff
b868b53+dirty 321.42 ms 342.74 ms 21.32 ms
d091239+dirty 340.16 ms 366.42 ms 26.26 ms

App size

Revision Plain With Sentry Diff
b868b53+dirty 7.15 MiB 8.00 MiB 874.27 KiB
d091239+dirty 7.15 MiB 8.00 MiB 874.38 KiB

@krystofwoldrich krystofwoldrich marked this pull request as ready for review January 10, 2023 13:16
@krystofwoldrich krystofwoldrich requested review from marandaneto and vaind and removed request for marandaneto January 10, 2023 13:17
@krystofwoldrich krystofwoldrich changed the title Extract e2e test to standalone library chore(ci): E2E RN Version Matrix Jan 10, 2023
'./ios/DerivedData/Build/Products/Release-iphonesimulator/sample.app',
'appium:derivedDataPath': path.resolve('./ios/DerivedData'),
'appium:app': process.env.APPIUM_APP,
// DerivedData of the WebDriverRunner Xcode project.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't we need this anymore?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We do need to set the app, but now it's done by ENV so it can be dynamic. For all the apps we are testing (different paths for different RN versions.)

@marandaneto
Copy link
Contributor

@vaind would you be willing to review this? it touches on some stuff you worked on, I guess you will have more context than me.

Copy link
Collaborator

@vaind vaind left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've had a look @marandaneto but this actually doesn't change the code I've contributed here (metrics apps & CI job) so I'm not at all familiar with the changes.

.github/workflows/e2e.yml Show resolved Hide resolved
@marandaneto
Copy link
Contributor

I've had a look @marandaneto but this actually doesn't change the code I've contributed here (metrics apps & CI job) so I'm not at all familiar with the changes.

gotcha, my bad then, but I guess it's a bit of the code that you refactored due to the E2E flakiness, I will review it as well, thanks.

@krystofwoldrich krystofwoldrich merged commit 07e0b52 into 5.0.0 Jan 18, 2023
@krystofwoldrich krystofwoldrich deleted the e2e-tests-rn-matrix branch January 18, 2023 12:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants