Run Jellyfish Tests in parallel

[canonbrother]

Summary

• speed up jellyfish ci by running with 10 instances, from (approximately) 2 hrs to 40 (30+15) mins

[sieniven]

Am I missing something - I dont exactly see how running 10 instances of the same jellyfish test will speed up the CI runtime?

[canonbrother]

Am I missing something - I dont exactly see how running 10 instances of the same jellyfish test will speed up the CI runtime?

here for your reference about to compare the before/after of total duration
before https://github.com/DeFiCh/ain/actions/runs/8337022104
after https://github.com/DeFiCh/ain/actions/runs/8338085780/job/22817831027?pr=2865

[Jouzo]

jest.sequencer.js

class CustomSequencer extends Sequencer {
  sort (tests) {
    // In CI, GitHub Actions tests are parallelized across multiple instance
    if (process.env.GH_INSTANCE_TOTAL) {
      const total = parseInt(process.env.GH_INSTANCE_TOTAL, 10)
      const index = parseInt(process.env.GH_INSTANCE_INDEX, 10)

      return ShuffleSeed.shuffle(tests, 'deterministic')
        .filter((_, i) => i % total === index)
    }

    return tests
  }
}

That's where the magic happens

[sieniven]

If this is the case, we should then separate the docker build stage and then run the tests in 10 instances instead. Does not make sense to block 10 runners while building the same image on every instance.

[canonbrother]

sigh.. the workflow_run is not supported on PR

[Jouzo]

Great improvements, thanks @canonbrother !