[skip ci] Revert "[ci] Default to n=2 for test parallelism (apache#12376

)" (apache#12413)

This reverts commit 369e8b2.

There are certain tests that need to be serialized first before this can
merge or else failures like
https://ci.tlcpack.ai/job/tvm/job/main/4040/display/redirect will happen
based on which tests happen to be run together or not

Co-authored-by: driazati <[email protected]>