-
Notifications
You must be signed in to change notification settings - Fork 313
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Introduce rally-tracks compatibility testing #1564
Introduce rally-tracks compatibility testing #1564
Commits on Aug 22, 2022
-
Add ability to run track repo tests within the Rally repo.
This commit modifies and extends `pytest-rally` so that it can be invoked from within the Rally repo. This enables Rally developers and CI jobs to test Rally changes against arbitrary revisions of local track repositories, using arbitrary versions of Elasticsearch. The actual contents of the tests live in the track repository. The plugin will run any tests found in the `it` subdirectory of the provided track repository by default, including those that are auto-generated by `pytest-rally`. By default, tests will be run against the `master` branch of the track repository checked out in `$RALLY_HOME/benchmarks/tracks/default` (typically `rally-tracks`), using a build of the `main` branch of Elasticsearch. To run tests with these defaults, run the following from the root of this repository: `pytest it/track_repo_compatibility` Here is an example invocation that overrides these defaults: ``` pytest it/track_repo_compatibility \ --track-repository=/path/to/repo \ --track-revision=some-branch \ --distribution-version=8.3.2 ```
Mike Baamonde committedAug 22, 2022 Configuration menu - View commit details
-
Copy full SHA for f5190a1 - Browse repository at this point
Copy the full SHA f5190a1View commit details -
Add a
rally-tracks-compat
tox environment.Mike Baamonde committedAug 22, 2022 Configuration menu - View commit details
-
Copy full SHA for cdb27d7 - Browse repository at this point
Copy the full SHA cdb27d7View commit details -
Add
rally-tracks-compat
support to Makefile and build script.Mike Baamonde committedAug 22, 2022 Configuration menu - View commit details
-
Copy full SHA for 7a07e32 - Browse repository at this point
Copy the full SHA 7a07e32View commit details -
Add
rally-tracks-compat
pull request Jenkins job.Mike Baamonde committedAug 22, 2022 Configuration menu - View commit details
-
Copy full SHA for ce9737f - Browse repository at this point
Copy the full SHA ce9737fView commit details
Commits on Aug 23, 2022
-
Make sure that rally-tracks is actually on disk.
Mike Baamonde committedAug 23, 2022 Configuration menu - View commit details
-
Copy full SHA for fc8e4aa - Browse repository at this point
Copy the full SHA fc8e4aaView commit details -
Mike Baamonde committed
Aug 23, 2022 Configuration menu - View commit details
-
Copy full SHA for 93ae346 - Browse repository at this point
Copy the full SHA 93ae346View commit details -
Live-tail the pytest logs for track repo compatibility tests.
Mike Baamonde committedAug 23, 2022 Configuration menu - View commit details
-
Copy full SHA for fe81648 - Browse repository at this point
Copy the full SHA fe81648View commit details
Commits on Aug 24, 2022
-
Mike Baamonde committed
Aug 24, 2022 Configuration menu - View commit details
-
Copy full SHA for 9258e28 - Browse repository at this point
Copy the full SHA 9258e28View commit details -
Explicitly clone rally-tracks into a distinct location by default.
Mike Baamonde committedAug 24, 2022 Configuration menu - View commit details
-
Copy full SHA for 257794b - Browse repository at this point
Copy the full SHA 257794bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 56ca636 - Browse repository at this point
Copy the full SHA 56ca636View commit details -
Mike Baamonde committed
Aug 24, 2022 Configuration menu - View commit details
-
Copy full SHA for f437d8a - Browse repository at this point
Copy the full SHA f437d8aView commit details -
Mike Baamonde committed
Aug 24, 2022 Configuration menu - View commit details
-
Copy full SHA for 6d084f5 - Browse repository at this point
Copy the full SHA 6d084f5View commit details