systemtest.TestFleetIntegration fails on deleting agent policy

[axw]

TestFleetIntegration is reliably failing on master now. The call to delete the agent policy returns a 404 error, despite the policy existing. The call also results in the policy being deleted. I see the same thing when deleting the policy created by the test through Kibana. However, if I create a policy in the UI and then delete it, I do not see this error.

[2021-02-06T00:49:19.850Z] === RUN   TestFleetIntegration
[2021-02-06T00:49:19.850Z] 2021/02/06 00:46:55 Starting container id: fc87585ee914 image: quay.io/testcontainers/ryuk:0.2.3
[2021-02-06T00:49:19.850Z] 2021/02/06 00:46:55 Waiting for container id fc87585ee914 image: quay.io/testcontainers/ryuk:0.2.3
[2021-02-06T00:49:19.850Z] 2021/02/06 00:46:55 Container is ready id: fc87585ee914 image: quay.io/testcontainers/ryuk:0.2.3
[2021-02-06T00:49:19.850Z] 2021/02/06 00:46:56 Starting container id: 8374982d2dc3 image: docker.elastic.co/beats/elastic-agent:8.0.0-SNAPSHOT
[2021-02-06T00:49:19.850Z] 2021/02/06 00:46:56 Waiting for container id 8374982d2dc3 image: docker.elastic.co/beats/elastic-agent:8.0.0-SNAPSHOT
[2021-02-06T00:49:19.850Z] 2021/02/06 00:47:01 Container is ready id: 8374982d2dc3 image: docker.elastic.co/beats/elastic-agent:8.0.0-SNAPSHOT
[2021-02-06T00:49:19.850Z]     fleet_test.go:173: 
[2021-02-06T00:49:19.850Z]         	Error Trace:	fleet_test.go:173
[2021-02-06T00:49:19.850Z]         	            				fleet_test.go:149
[2021-02-06T00:49:19.850Z]         	Error:      	Received unexpected error:
[2021-02-06T00:49:19.850Z]         	            	request failed (404 Not Found): {"statusCode":404,"error":"Not Found","message":"Saved object [ingest-agent-policies/be6b9bd0-6814-11eb-98d6-055555338797] not found"}
[2021-02-06T00:49:19.850Z]         	Test:       	TestFleetIntegration
[2021-02-06T00:49:19.850Z] --- FAIL: TestFleetIntegration (61.27s)

[axw]

However, if I create a policy in the UI and then delete it, I do not see this error.

Actually, the difference may just be that I did not assign an agent when I tested in the UI. I modified the test to skip creating an agent, and deleting the agent policy worked.

[axw]

Yep, can reproduce through the UI. Opened elastic/kibana#90544