[Bugfix] FIx benchmark args for randomly sampled dataset

[haichuan1221]

add benchmark testing; compared the existing test, new test has two advantages:

1. the input is random sampled with fixed length
2. the output is also fixed

[DarkLight1337]

To speed up the CI queue, I've cancelled the distributed tests for the latest CI run in this PR since they won't pass anyway until #5905 has been merged. Now that it has been merged, please merge main into your branch so that the CI can pass once again.

[haichuan1221]

To speed up the CI queue, I've cancelled the distributed tests for the latest CI run in this PR since they won't pass anyway until #5905 has been merged. Now that it has been merged, please merge main into your branch so that the CI can pass once again.

Already done this

[ywang96]

@haichuan1221 Ah looks like this is for patching the previous PR I merged, sorry that I didn't catch the error.

[haichuan1221]

@haichuan1221 Ah looks like this is for patching the previous PR I merged, sorry that I didn't catch the error.

I didn't catch the error either, sorry for the inconvenience