We support the following logging "keys":
fuzz
: fuzzing loop;mgen
: model generation;smt
: constraints in smt solving;exec
: model execution;viz
: graphviz visualization;dtest
: dtype_test;core
: seed setting, etc;
The show messages above "INFO" level (see Python's logging module). To show debug level message, add hydra.verbose=[${keys}]
(also see hydra.logging).
# Show debug information related to `fuzz`:
${NNSMITH_CMD} hydra.verbose=fuzz
# Show debug info for `fuzz` and `exec`:
${NNSMITH_CMD} hydra.verbose="[fuzz,exec]"
By default, NNSmith logs things both in console
and file
. You can find the loggings in outputs/${DATE}/${APP}.log
(current working directory).
See nnsmith/error.py
:
ConstraintError
: Unsatisfiable constraints which is a hint to re-try;InternalError
: NNSmith has some internal bugs that should be fixed.
Takeways:
- Catch
ConstraintError
as a hint to re-try graph generation (no satisfiable solution yet); - Never catch
InternalError
-- but let the maintainer know the issue and fix it.