TestGlobalAndLocalTSO failed

[rleungx]

Flaky Test

Which jobs are failing

--- FAIL: TestGlobalAndLocalTSO (25.27s)
    client_test.go:458: 
        	Error Trace:	/home/runner/work/pd/pd/tests/integrations/client/client_test.go:458
        	            				/home/runner/work/pd/pd/tests/integrations/client/asm_amd64.s:1598
        	Error:      	Received unexpected error:
        	            	rpc error: code = Unknown desc = [PD:tso:ErrGenerateTimestamp]generate timestamp failed, requested pd is not leader of dc-2 allocator
        	            	github.com/tikv/pd/client.(*pdTSOStream).processRequests
        	            		/home/runner/work/pd/pd/client/tso_stream.go:134
        	            	github.com/tikv/pd/client.(*tsoClient).processRequests
        	            		/home/runner/work/pd/pd/client/tso_dispatcher.go:702
        	            	github.com/tikv/pd/client.(*tsoClient).handleDispatcher
        	            		/home/runner/work/pd/pd/client/tso_dispatcher.go:443
        	            	runtime.goexit
        	            		/opt/hostedtoolcache/go/1.20.1/x64/src/runtime/asm_amd64.s:1598
        	            	github.com/tikv/pd/client.(*tsoRequest).Wait
        	            		/home/runner/work/pd/pd/client/tso_dispatcher.go:93
        	            	github.com/tikv/pd/client.(*client).GetLocalTS
        	            		/home/runner/work/pd/pd/client/client.go:629
        	            	github.com/tikv/pd/tests/integrations/client_test.requestGlobalAndLocalTSO.func1
        	            		/home/runner/work/pd/pd/tests/integrations/client/client_test.go:457
        	            	runtime.goexit
        	            		/opt/hostedtoolcache/go/1.20.1/x64/src/runtime/asm_amd64.s:1598
        	Test:       	TestGlobalAndLocalTSO

CI link

https://github.com/tikv/pd/actions/runs/4563140126/jobs/8051267525?pr=6249

Reason for failure (if possible)

Anything else

[rleungx]

https://github.com/tikv/pd/actions/runs/6244003696/job/16950748384?pr=7023