Runtime errors

[samfoot]

Summary

I am getting a large number of runtime errors when running stryker. I have tried running with loglevel: 'debug' but I don't see any obvious errors, the tests run manually with jest without issue. How can I find out what is causing me to have so many runtime errors?

Stryker config

module.exports = function(config) {
  config.set({
    testRunner: "jest",
    mutator: "javascript",
    transpilers: [],
    // logLevel: 'debug',
    reporter: ["clear-text", "progress"],
    coverageAnalysis: "off",
    mutate: [
      'src/**/*.js',
      '!src/**/*.test.js',
      '!src/test/*',
    ],
  });
};

Stryker environment

[email protected]
[email protected]
[email protected]
[email protected]
[email protected]

Your Environment

software	version(s)
node	10.6.0
npm	6.1.0
Operating System	OSX 10.13.5

Screenshot

[nicojs]

Hmm interesting. Could you try again with loglevel: 'trace'? Testrunner processes are currently silenced unless loglevel is trace.

[samfoot]

thanks for getting back to me @nicojs

I ran it with trace and I am now getting loads of Mutant caused a runtime error! errors in the output:

I also don't see any of these errors as it's running, just loads of [2018-07-12 11:14:55.643] [TRACE] TestRunnerChildProcessAdapter - [2018-07-12 11:14:55.643] [TRACE] JestPromiseTestAdapter - Invoking Jest with config calls

[nicojs]

If you scroll up you should be able to see the runtime errors themselves. It is printed before the actual results. We're working on a feature for logging to a file. Untill then, you could use stryker run > out.txt to redirect output to a file

[samfoot]

I can't see any runtime errors in the output. I just ran one of the tests manually by copying the trace output:

{"collectCoverage":false,"collectCoverageFrom":["**/*.{js,jsx}","!**/node_modules/**","!src/test/**","!coverage/**","!src/index.js"],"coverageReporters":["text","lcov"],"coverageThreshold":{"global":{"branches":10,"functions":10,"lines":10,"statements":10}},"verbose":false,"bail":false,"rootDir":"/Users/sf/proj1/.stryker-tmp/sandbox7222091","reporters":[]}

When I run the above I get no output at all, if I remove "reporters":[] I see jest running the tests correctly.

[nicojs]

Hmm ok, so we know the problem is somewhere in Stryker. Could you send me the console output somehow? You can use nicojs [AT] infosupport [DOT] com (no spaces)

[samfoot]

With the help of @nicojs we found the problem to be one of my tests leaking state. A global Object.defineProperty in one of my dependencies was causing Jest to throw a TypeError: Cannot redefine property: error, this happens in Stryker because the same test is being run multiple times in the same process.

Currently these errors are not being output to the user even with the loglevel: 'trace' configuration, which makes it hard to debug.

Many thanks to @nicojs for the help, and the whole Stryker team for creating an awesome tool.

[Prerna237]

With the help of @nicojs we found the problem to be one of my tests leaking state. A global Object.defineProperty in one of my dependencies was causing Jest to throw a TypeError: Cannot redefine property: error, this happens in Stryker because the same test is being run multiple times in the same process.

Currently these errors are not being output to the user even with the loglevel: 'trace' configuration, which makes it hard to debug.

Many thanks to @nicojs for the help, and the whole Stryker team for creating an awesome tool.

@samfoot: Could you name the dependency that was causing this problem? I am facing a similar issue here