Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[VM] update VM test runner #849

Merged
merged 6 commits into from
Sep 17, 2020
Merged

[VM] update VM test runner #849

merged 6 commits into from
Sep 17, 2020

Commits on Sep 16, 2020

  1. [VM] fix skip tests in testLoader

    [VM] do not return after an error
    
    [VM] tests: fail test if we expect an error but VM did not throw
    jochem-brouwer committed Sep 16, 2020
    Configuration menu
    Copy the full SHA
    8b3a80d View commit details
    Browse the repository at this point in the history
  2. [VM] tests: create a Common in config; fix fork filtering; re-check f…

    …ailing tests in config
    
    [VM] add support for transition tests common
    
    [VM] block now transitions to new HF on a transition block
    jochem-brouwer committed Sep 16, 2020
    Configuration menu
    Copy the full SHA
    ab35da7 View commit details
    Browse the repository at this point in the history
  3. [VM] tests: add docs/fix config

    [VM] remove auto-switch fork
    
    [VM] add method to get directories for fork
    
    [VM] tests: identify broken test, dump list of broken tests after run
    jochem-brouwer committed Sep 16, 2020
    Configuration menu
    Copy the full SHA
    b5a4cf4 View commit details
    Browse the repository at this point in the history
  4. run all tests

    jochem-brouwer committed Sep 16, 2020
    Configuration menu
    Copy the full SHA
    f0e22e7 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    f1b958d View commit details
    Browse the repository at this point in the history
  6. [VM] tests: correctly set Common; throw on re-orgs

    temporarily test forks in parallel
    
    fix get number
    
    [VM] skip reorg tests
    
    [VM] tests: add --expected-test-amount
    
    fix yaml
    
    [VM] add flag to verify against known test count
    
    [VM] StateTests: apply filter in testLoader
    
    [VM] add state tests assert count checks
    jochem-brouwer committed Sep 16, 2020
    1 Configuration menu
    Copy the full SHA
    c146bc7 View commit details
    Browse the repository at this point in the history