Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Testground checks on push #5887

Merged
merged 2 commits into from
Apr 29, 2021
Merged

Testground checks on push #5887

merged 2 commits into from
Apr 29, 2021

Conversation

coryschwartz
Copy link

No description provided.

@arajasek
Copy link
Contributor

arajasek commented Apr 5, 2021

We need to figure out which of these test plans we'll actually want (concerns around stability / we already fail some of these). Need to poke @nonsense probably.

@arajasek arajasek changed the title checks on push Testground checks on push Apr 5, 2021
Comment on lines 13 to 16
- backend_addr: ci.testground.ipfs.team
backend_proto: https
plan_directory: testplans/graphsync
composition_file: testplans/graphsync/_compositions/stress-k8s.toml
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This one probably doesn't belong to Lotus. I think if we have the graphsync repo first the graphsync tests, it'd be better!

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, I'll remove this one.

@nonsense
Copy link
Member

nonsense commented Apr 6, 2021

We need to figure out which of these test plans we'll actually want (concerns around stability / we already fail some of these). Need to poke @nonsense probably.

I believe we want both testplans related to Lotus - the end-to-end deals one, as well as the payment channels stress-test. The graphsync test plan should live in the graphsync repo I believe. There is no reason for any of these to be flaky or to not work ever, so I think it is great that we are adding the status checks! Thanks @coryschwartz !!!

@BigLep
Copy link
Member

BigLep commented Apr 12, 2021

@magik6k is going to open a GitHub issue to track the work for fixing the failing/flaky tests and then relate to this PR, since that is what's blocking this.

@nonsense
Copy link
Member

I think this is a great start. Ideally Testground itself could handle this (this functionality is buggy and not working on Testground unfortunately), and not have an additional Github Action handle the status checks updates, but I think for now this is fine.

Given that we will probably have more test plans in the future, It'd be nice to collect all Testground testplans related to Lotus under one status check, and not as individual status checks, however we only have 2 tests right now, so this is fine as is for a start.

Once graphsync is removed, I think we could merge.

@nonsense
Copy link
Member

nonsense commented Apr 29, 2021

@magik6k is going to open a GitHub issue to track the work for fixing the failing/flaky tests and then relate to this PR, since that is what's blocking this.

I think both the deals end-to-end test (i.e. baseline-k8s-3-1.toml) and payment channel stress tests (i.e. paych-stress-k8s.toml) are no longer flaky, given that we merge the following PRs:

@magik6k magik6k merged commit 84d7565 into master Apr 29, 2021
@magik6k magik6k deleted the feat/gh-action-testground-prs branch April 29, 2021 17:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants