dialogflow: use unique names for all resources for tests to avoid col… #2696
Conversation
googlebot
added
the
cla: yes
|
I think the problem is way back when these tests were written they all sorta rely on one machine running them at a time, now with 4 in parallel some of the requests are expecting to list one resource but find multiple and that is one problem. I'm breaking the tests up into individual files and have proper setup teardown rather than rely on them running in order which some do. |
|
Alright looks like I need to request a quota increase, it caps out at 60 requests per minute and with 4 different versions running at once that is quite soon. |
| pytest.KNOWLEDGE_BASE_ID = None | ||
|
|
||
|
|
||
| @pytest.fixture(scope="function", autouse=True) |
There was a problem hiding this comment.
@gguuss, while I wait for the quota increase.
How do you feel about these types of tests?
I was gonna modify the rest and separate them into individual files in different PRs, but the current Knowledge and Document tests were checking that only 1 thing existing, so I at least had to update those for the 4 python versions.
There was a problem hiding this comment.
I'm fine for checking that all the response parameters are there but adding more detailed checks, particularly in ML APIs, can make the checks more brittle. If these are mocks, then it diverges a bit from the spirit of doing integration testing to make sure we see whether our p;roducts are encountering outages or the client libraries are breaking.
|
@nnegrey I think you should be able to merge when green, just lmk if you need me to take a look again. |
|
Getting errors about the long running client: Let me see if something changed in the client or something. |
|
I believe these tests failed cus the old tests ran over night and caused some issues cus they fail on multiple run times of python. |
|
I have a couple PRs ready to fix those oddities, but this one should go first. |
…… [(#2696)](GoogleCloudPlatform/python-docs-samples#2696) * dialogflow: use unique names for all resources for tests to avoid collision * lint: line length * break up knowledge base tests and document tests from one file into individual tests * lint * bump library version * ping googleapis-common-protos to avoid release breakage * Update requirements.txt Co-authored-by: Gus Class <[email protected]>
…… [(#2696)](GoogleCloudPlatform/python-docs-samples#2696) * dialogflow: use unique names for all resources for tests to avoid collision * lint: line length * break up knowledge base tests and document tests from one file into individual tests * lint * bump library version * ping googleapis-common-protos to avoid release breakage * Update requirements.txt Co-authored-by: Gus Class <[email protected]>
…… [(#2696)](#2696) * dialogflow: use unique names for all resources for tests to avoid collision * lint: line length * break up knowledge base tests and document tests from one file into individual tests * lint * bump library version * ping googleapis-common-protos to avoid release breakage * Update requirements.txt Co-authored-by: Gus Class <[email protected]>
…… [(#2696)](#2696) * dialogflow: use unique names for all resources for tests to avoid collision * lint: line length * break up knowledge base tests and document tests from one file into individual tests * lint * bump library version * ping googleapis-common-protos to avoid release breakage * Update requirements.txt Co-authored-by: Gus Class <[email protected]>
…… [(#2696)](#2696) * dialogflow: use unique names for all resources for tests to avoid collision * lint: line length * break up knowledge base tests and document tests from one file into individual tests * lint * bump library version * ping googleapis-common-protos to avoid release breakage * Update requirements.txt Co-authored-by: Gus Class <[email protected]>
…… [(#2696)](GoogleCloudPlatform/python-docs-samples#2696) * dialogflow: use unique names for all resources for tests to avoid collision * lint: line length * break up knowledge base tests and document tests from one file into individual tests * lint * bump library version * ping googleapis-common-protos to avoid release breakage * Update requirements.txt Co-authored-by: Gus Class <[email protected]>
…lision