Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add 1.1 version of test report yml with bundle and rc information #4887

Merged

Conversation

peterzhuamazon
Copy link
Member

@peterzhuamazon peterzhuamazon commented Jul 24, 2024

Description

Add 1.1 version of test report yml with bundle and rc information
Adding version, platform, architecture, distribution, build id, rc number information.

Issues Resolved

opensearch-project/opensearch-metrics#51

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Peter Zhu <[email protected]>
Signed-off-by: Peter Zhu <[email protected]>
@peterzhuamazon
Copy link
Member Author

peterzhuamazon commented Jul 26, 2024

Example: (Note that schema version is default to 1.1 for now, if you use 1.0 specifically it will not have the new information)

% ./report.sh manifests/2.15.0/opensearch-2.15.0-test.yml --test-run-id 123 --test-type integ-test --base-path test-results --component security -p opensearch=tar --schema-version 1.1 --release-candidate 100
Installing dependencies in . ...
Installing dependencies from Pipfile.lock (6b098c)...
To activate this project's virtualenv, run pipenv shell.
Alternatively, run a command inside the virtualenv with pipenv run.
Running ./src/run_test_report.py manifests/2.15.0/opensearch-2.15.0-test.yml --test-run-id 123 --test-type integ-test --base-path test-results --component security -p opensearch=tar --schema-version 1.1 --release-candidate 100 ...
2024-07-26 21:05:48 INFO     Loading manifests/2.15.0/opensearch-2.15.0-test.yml
2024-07-26 21:05:48 INFO     Loading <>/opensearch-build-peterzhuamazon/tar/dist/opensearch/manifest.yml
2024-07-26 21:05:48 INFO     ./test.sh integ-test manifests/2.15.0/opensearch-2.15.0-test.yml --paths opensearch=/local/home/zhujiaxi/opensearch-build-peterzhuamazon/tar
2024-07-26 21:05:48 INFO     Skipping alerting
2024-07-26 21:05:48 INFO     Skipping anomaly-detection
2024-07-26 21:05:48 INFO     Skipping flow-framework
2024-07-26 21:05:48 INFO     Skipping asynchronous-search
2024-07-26 21:05:48 INFO     Skipping cross-cluster-replication
2024-07-26 21:05:48 INFO     Skipping geospatial
2024-07-26 21:05:48 INFO     Skipping index-management
2024-07-26 21:05:48 INFO     Skipping k-NN
2024-07-26 21:05:48 INFO     Skipping ml-commons
2024-07-26 21:05:48 INFO     Skipping neural-search
2024-07-26 21:05:48 INFO     Skipping notifications
2024-07-26 21:05:48 INFO     Skipping opensearch-observability
2024-07-26 21:05:48 INFO     Skipping opensearch-reports
2024-07-26 21:05:48 INFO     ./test.sh integ-test manifests/2.15.0/opensearch-2.15.0-test.yml --paths opensearch=<>/opensearch-build-peterzhuamazon/tar --component security
2024-07-26 21:05:48 INFO     Configs for security on integ-test are ['with-security']
2024-07-26 21:05:48 INFO     Loading test-results/test-results/123/integ-test/security/with-security/security.yml
2024-07-26 21:05:48 INFO     Component yml file for security for with-security is missing or the base path is incorrect.
2024-07-26 21:05:48 INFO     Skipping security-analytics
2024-07-26 21:05:48 INFO     Skipping sql
2024-07-26 21:05:48 INFO     Skipping custom-codecs
2024-07-26 21:05:48 INFO     Skipping skills
2024-07-26 21:05:48 INFO     Use schema-version 1.1
2024-07-26 21:05:48 INFO     Generating test-report.yml in /local/home/zhujiaxi/opensearch-build-peterzhuamazon


% cat test-report.yml
---
schema-version: '1.1'
name: OpenSearch
version: 2.15.0
platform: linux
architecture: x64
distribution: tar
id: '9992'
rc: '100'
test-run:
  Command: ./test.sh integ-test manifests/2.15.0/opensearch-2.15.0-test.yml --paths
    opensearch=/local/home/zhujiaxi/opensearch-build-peterzhuamazon/tar
  TestType: integ-test
  TestManifest: manifests/2.15.0/opensearch-2.15.0-test.yml
  DistributionManifest: <>/opensearch-build-peterzhuamazon/tar/dist/opensearch/manifest.yml
  TestID: '123'
components:
  - name: security
    command: ./test.sh integ-test manifests/2.15.0/opensearch-2.15.0-test.yml --paths
      opensearch=<>/opensearch-build-peterzhuamazon/tar --component
      security
    configs:
      - name: with-security
        status: Not Available
        yml: URL not available
        cluster_stdout:
          - test-results/test-results/123/integ-test/security/with-security/local-cluster-logs/id-0/stdout.txt
        cluster_stderr:
          - test-results/test-results/123/integ-test/security/with-security/local-cluster-logs/id-0/stderr.txt

Signed-off-by: Peter Zhu <[email protected]>
Signed-off-by: Peter Zhu <[email protected]>
@peterzhuamazon peterzhuamazon changed the title Add 1.1 version of test report yml with more information Add 1.1 version of test report yml with bundle and rc information Jul 29, 2024
src/report_workflow/test_report_runner.py Outdated Show resolved Hide resolved
src/report_workflow/report_args.py Show resolved Hide resolved
src/report_workflow/test_report_runner.py Outdated Show resolved Hide resolved
@prudhvigodithi
Copy link
Collaborator

Thanks for this change @peterzhuamazon, Once @zelinh is ok with this PR we can go ahead and merge it.
Thanks

Copy link
Member

@zelinh zelinh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks @peterzhuamazon

@peterzhuamazon peterzhuamazon merged commit 76a1313 into opensearch-project:main Jul 31, 2024
10 checks passed
@peterzhuamazon peterzhuamazon deleted the reports-yml-improve branch July 31, 2024 18:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: ✅ Done
Development

Successfully merging this pull request may close these issues.

3 participants