Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: remove WebUI e2e-tests dependency on det-deploy #575

Merged
merged 26 commits into from
Jun 2, 2020

Conversation

hamidzr
Copy link
Member

@hamidzr hamidzr commented May 22, 2020

Description

This PR removes the webui e2e tests dependency on det-deploy and improves developer interactions with the test runner e2e-tests.py

https://determinedai.atlassian.net/browse/DET-3072
https://determinedai.atlassian.net/browse/DET-2652

Test Plan

Ran tests locally and got all greens.

Commentary (optional)

left 1004ef8 as a direct copy of the tools directory so that part probably doesn't need a review.

@hamidzr hamidzr requested a review from hkang1 May 22, 2020 23:11
@hamidzr hamidzr force-pushed the 3072-webui-remove-det-deploy branch from 69e2b8c to b23fd92 Compare May 28, 2020 23:08
@cla-bot cla-bot bot added the cla-signed label May 28, 2020
@hamidzr hamidzr force-pushed the 3072-webui-remove-det-deploy branch from b23fd92 to 2636e19 Compare May 28, 2020 23:51
Copy link
Contributor

@hkang1 hkang1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sooooooo much faster than docker image build 👍 👍 👍

I added some comments, but there was a question regarding $PROJECT_ROOT. I don't have that defined and can't find any references to it. My equivalent is $DET_PROJ but that might be specific to my setup. The relative path approach (how the original Makefile had it) makes more sense so it doesn't rely on an env var.

webui/tests/e2e-cluster/Makefile Outdated Show resolved Hide resolved
webui/tests/bin/createUserAndExperiments.py Show resolved Hide resolved
webui/tests/bin/createUserAndExperiments.py Show resolved Hide resolved
webui/tests/bin/e2e-tests.py Outdated Show resolved Hide resolved
webui/tests/e2e-cluster/Makefile Outdated Show resolved Hide resolved
webui/tests/e2e-cluster/run-server.py Outdated Show resolved Hide resolved
@hkang1 hkang1 assigned hamidzr and unassigned hkang1 May 29, 2020
)

return subprocess.run(
f"seq {count} | xargs -n 1 -P 0 -I[] {cmd}", shell=True, check=True,
Copy link
Member Author

@hamidzr hamidzr May 29, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you test that this works on mac? @hkang1

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hamidzr For this part I encounter this error:

no matches found: -I[]

It didn't like the -I[] option...

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

swapped it for a python solution.

@hamidzr hamidzr assigned hkang1 and unassigned hamidzr May 29, 2020
Copy link
Contributor

@hkang1 hkang1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I ran into an issue with xargs portion. Specifically the -I[] option not matching anything.

@hkang1 hkang1 assigned hamidzr and unassigned hkang1 May 30, 2020
@hamidzr hamidzr force-pushed the 3072-webui-remove-det-deploy branch from fdcee5c to 669c4cc Compare June 1, 2020 19:59
@hamidzr hamidzr assigned hkang1 and unassigned hamidzr Jun 1, 2020
@hamidzr
Copy link
Member Author

hamidzr commented Jun 1, 2020

e2e-tests got stuck on cancelling an experiment: video

@hkang1
Copy link
Contributor

hkang1 commented Jun 1, 2020

e2e-tests got stuck on cancelling an experiment: video

For me it only failed locally on should be able to log out from React
Sign inout -- should be able to log out from React (failed)

But make test itself ran from start to finish.

@hamidzr
Copy link
Member Author

hamidzr commented Jun 1, 2020

e2e-tests got stuck on cancelling an experiment: video

For me it only failed locally on should be able to log out from React
Sign inout -- should be able to log out from React (failed)

But make test itself ran from start to finish.

based on the UI I think you are using build files from another branch :)

Copy link
Contributor

@hkang1 hkang1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM make test ran great while another cluster was running simultaneously!

@hkang1 hkang1 assigned hamidzr and unassigned hkang1 Jun 1, 2020
@hamidzr hamidzr merged commit 3379eca into determined-ai:master Jun 2, 2020
@hamidzr hamidzr deleted the 3072-webui-remove-det-deploy branch June 2, 2020 00:28
@dannysauer dannysauer added this to the 0.12.7 milestone Feb 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants