Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fail to run all benchmarks #253

Open
Kenun99 opened this issue Jun 2, 2023 · 7 comments
Open

Fail to run all benchmarks #253

Kenun99 opened this issue Jun 2, 2023 · 7 comments
Assignees
@ziyadedher

Comments

@Kenun99
Copy link

Kenun99 commented Jun 2, 2023

I was just wondering whether it is possible to help to address the build issue.

Environment: Ubuntu20.04 X86 Rust: x86_64-unknown-linux-gnu rustc v1.70.0
Here are my build commands

git clone https://github.com/ziyadedher/evm-bench.git
git checkout  6d26d92 # the latest commit 

curl -sSL https://install.python-poetry.org | python3 - && export PATH="$HOME/.local/bin:$PATH"` #  install the dependency poetry
sudo apt install pypy3 -y` #  install the dependency pypy3

RUST_LOG=info cargo run --release -- # run

Although all benchmarks are built successfully, none of the eight runners can evaluate any benchmark. Here is the output I obtained.

[2023-06-02T09:17:35Z INFO  evm_bench::metadata] found 5 benchmarks: erc20.mint, snailtracer, erc20.transfer, ten-thousand-hashes, erc20.approval-transfer
[2023-06-02T09:17:35Z INFO  evm_bench::metadata] found 8 runners: py-evm.pypy, ethereumjs, akula, evmone, geth, py-evm.cpython, pyrevm, revm
[2023-06-02T09:17:35Z INFO  evm_bench::build] building 5 benchmarks...
[2023-06-02T09:17:35Z INFO  evm_bench::build] building benchmark erc20.approval-transfer (ERC20ApprovalTransfer.sol w/ solc@stable)...
[2023-06-02T09:17:37Z INFO  evm_bench::build] building benchmark erc20.mint (ERC20Mint.sol w/ solc@stable)...
[2023-06-02T09:17:39Z INFO  evm_bench::build] building benchmark erc20.transfer (ERC20Transfer.sol w/ solc@stable)...
[2023-06-02T09:17:41Z INFO  evm_bench::build] building benchmark snailtracer (SnailTracer.sol w/ [email protected])...
[2023-06-02T09:17:44Z INFO  evm_bench::build] building benchmark ten-thousand-hashes (TenThousandHashes.sol w/ solc@stable)...
[2023-06-02T09:17:55Z INFO  evm_bench::run] running 5 benchmarks...
[2023-06-02T09:17:55Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on 8 runners...
[2023-06-02T09:17:55Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner akula...
[2023-06-02T09:18:17Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner akula: exit status: 101
[2023-06-02T09:18:17Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner ethereumjs...
[2023-06-02T09:18:18Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner ethereumjs: exit status: 254
[2023-06-02T09:18:18Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner evmone...
[2023-06-02T09:18:20Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner evmone: exit status: 1
[2023-06-02T09:18:20Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner geth...
[2023-06-02T09:18:20Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner geth: exit status: 1
[2023-06-02T09:18:20Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner py-evm.cpython...
[2023-06-02T09:18:20Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner py-evm.cpython: exit status: 1
[2023-06-02T09:18:20Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner py-evm.pypy...
[2023-06-02T09:18:20Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner py-evm.pypy: exit status: 1
[2023-06-02T09:18:20Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner pyrevm...
[2023-06-02T09:18:21Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner pyrevm: exit status: 1
[2023-06-02T09:18:21Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner revm...
[2023-06-02T09:18:35Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner revm: exit status: 101
[2023-06-02T09:18:35Z INFO  evm_bench::run] running benchmark erc20.mint on 8 runners...
[2023-06-02T09:18:35Z INFO  evm_bench::run] running benchmark erc20.mint on runner akula...
[2023-06-02T09:18:40Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner akula: exit status: 101
[2023-06-02T09:18:40Z INFO  evm_bench::run] running benchmark erc20.mint on runner ethereumjs...
[2023-06-02T09:18:42Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner ethereumjs: exit status: 254
[2023-06-02T09:18:42Z INFO  evm_bench::run] running benchmark erc20.mint on runner evmone...
[2023-06-02T09:18:43Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner evmone: exit status: 1
[2023-06-02T09:18:43Z INFO  evm_bench::run] running benchmark erc20.mint on runner geth...
[2023-06-02T09:18:44Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner geth: exit status: 1
[2023-06-02T09:18:44Z INFO  evm_bench::run] running benchmark erc20.mint on runner py-evm.cpython...
[2023-06-02T09:18:44Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner py-evm.cpython: exit status: 1
[2023-06-02T09:18:44Z INFO  evm_bench::run] running benchmark erc20.mint on runner py-evm.pypy...
[2023-06-02T09:18:44Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner py-evm.pypy: exit status: 1
[2023-06-02T09:18:44Z INFO  evm_bench::run] running benchmark erc20.mint on runner pyrevm...
[2023-06-02T09:18:45Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner pyrevm: exit status: 1
[2023-06-02T09:18:45Z INFO  evm_bench::run] running benchmark erc20.mint on runner revm...
[2023-06-02T09:18:45Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner revm: exit status: 101
[2023-06-02T09:18:45Z INFO  evm_bench::run] running benchmark erc20.transfer on 8 runners...
[2023-06-02T09:18:45Z INFO  evm_bench::run] running benchmark erc20.transfer on runner akula...
[2023-06-02T09:18:55Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner akula: exit status: 101
[2023-06-02T09:18:55Z INFO  evm_bench::run] running benchmark erc20.transfer on runner ethereumjs...
[2023-06-02T09:18:57Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner ethereumjs: exit status: 254
[2023-06-02T09:18:57Z INFO  evm_bench::run] running benchmark erc20.transfer on runner evmone...
[2023-06-02T09:18:58Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner evmone: exit status: 1
[2023-06-02T09:18:58Z INFO  evm_bench::run] running benchmark erc20.transfer on runner geth...
[2023-06-02T09:18:58Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner geth: exit status: 1
[2023-06-02T09:18:58Z INFO  evm_bench::run] running benchmark erc20.transfer on runner py-evm.cpython...
[2023-06-02T09:18:59Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner py-evm.cpython: exit status: 1
[2023-06-02T09:18:59Z INFO  evm_bench::run] running benchmark erc20.transfer on runner py-evm.pypy...
[2023-06-02T09:18:59Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner py-evm.pypy: exit status: 1
[2023-06-02T09:18:59Z INFO  evm_bench::run] running benchmark erc20.transfer on runner pyrevm...
[2023-06-02T09:19:00Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner pyrevm: exit status: 1
[2023-06-02T09:19:00Z INFO  evm_bench::run] running benchmark erc20.transfer on runner revm...
[2023-06-02T09:19:00Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner revm: exit status: 101
[2023-06-02T09:19:00Z INFO  evm_bench::run] running benchmark snailtracer on 8 runners...
[2023-06-02T09:19:00Z INFO  evm_bench::run] running benchmark snailtracer on runner akula...
[2023-06-02T09:19:10Z WARN  evm_bench::run] could not run benchmark snailtracer on runner akula: exit status: 101
[2023-06-02T09:19:10Z INFO  evm_bench::run] running benchmark snailtracer on runner ethereumjs...
[2023-06-02T09:19:11Z WARN  evm_bench::run] could not run benchmark snailtracer on runner ethereumjs: exit status: 254
[2023-06-02T09:19:11Z INFO  evm_bench::run] running benchmark snailtracer on runner evmone...
[2023-06-02T09:19:13Z INFO  evm_bench::run] running benchmark snailtracer on runner geth...
[2023-06-02T09:19:13Z WARN  evm_bench::run] could not run benchmark snailtracer on runner geth: exit status: 1
[2023-06-02T09:19:13Z INFO  evm_bench::run] running benchmark snailtracer on runner py-evm.cpython...
[2023-06-02T09:19:13Z WARN  evm_bench::run] could not run benchmark snailtracer on runner py-evm.cpython: exit status: 1
[2023-06-02T09:19:13Z INFO  evm_bench::run] running benchmark snailtracer on runner py-evm.pypy...
[2023-06-02T09:19:14Z WARN  evm_bench::run] could not run benchmark snailtracer on runner py-evm.pypy: exit status: 1
[2023-06-02T09:19:14Z INFO  evm_bench::run] running benchmark snailtracer on runner pyrevm...
[2023-06-02T09:19:14Z WARN  evm_bench::run] could not run benchmark snailtracer on runner pyrevm: exit status: 1
[2023-06-02T09:19:14Z INFO  evm_bench::run] running benchmark snailtracer on runner revm...
[2023-06-02T09:19:14Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on 8 runners...
[2023-06-02T09:19:14Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner akula...
[2023-06-02T09:19:16Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner akula: exit status: 101
[2023-06-02T09:19:16Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner ethereumjs...
[2023-06-02T09:19:17Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner ethereumjs: exit status: 254
[2023-06-02T09:19:17Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner evmone...
[2023-06-02T09:19:19Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner evmone: exit status: 1
[2023-06-02T09:19:19Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner geth...
[2023-06-02T09:19:19Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner geth: exit status: 1
[2023-06-02T09:19:19Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner py-evm.cpython...
[2023-06-02T09:19:20Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner py-evm.cpython: exit status: 1
[2023-06-02T09:19:20Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner py-evm.pypy...
[2023-06-02T09:19:20Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner py-evm.pypy: exit status: 1
[2023-06-02T09:19:20Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner pyrevm...
[2023-06-02T09:19:21Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner pyrevm: exit status: 1
[2023-06-02T09:19:21Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner revm...
[2023-06-02T09:19:21Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner revm: exit status: 101
[2023-06-02T09:19:21Z INFO  evm_bench::results] wrote out results to /home/kenun/ethsema/Artifact/evm-bench/outputs/results/2023-06-02T09:19:21.157890950+00:00.evm-bench.results.json
@ziyadedher
Copy link
Owner

ziyadedher commented Jun 13, 2023 •
edited
Loading

Do you mind turning on trace or debug for RUST_LOG? That should give us full error messages.

@ziyadedher ziyadedher self-assigned this Jun 13, 2023
@Kenun99
Copy link
Author

Kenun99 commented Jun 14, 2023

Sry for my late reply. I ran again by RUST_LOG=debug cargo run --release --. The error messages are shown below.
evm-bench panicks eventually because it attempt to parse an empty file generated from the benchmarks.
I failed to run any benchmark, and thus only obtained an empty json output.

$ RUST_LOG=debug cargo run --release --
    Finished release [optimized] target(s) in 0.09s
     Running `target/release/evm-bench`
[2023-06-14T15:16:41Z DEBUG evm_bench::exec] found docker (docker): Docker version 20.10.9, build c2ea9bc
[2023-06-14T15:16:41Z DEBUG evm_bench::exec] found cargo (cargo): cargo 1.70.0 (ec8a8a0ca 2023-04-25)
[2023-06-14T15:16:41Z DEBUG evm_bench::exec] found poetry (poetry): Poetry (version 1.5.1)
[2023-06-14T15:16:41Z DEBUG evm_bench::exec] found python3 (python3): Python 3.8.10
[2023-06-14T15:16:42Z DEBUG evm_bench::exec] found pypy3 (pypy3): Python 3.6.9 (7.3.1+dfsg-4, Apr 22 2020, 05:15:29)
    [PyPy 7.3.1 with GCC 9.3.0]
[2023-06-14T15:16:42Z DEBUG evm_bench::exec] found npm (npm): 6.14.13
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] found erc20/approval-transfer/benchmark.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed benchmark metadata: erc20.approval-transfer
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed erc20/approval-transfer/benchmark.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] found erc20/mint/benchmark.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed benchmark metadata: erc20.mint
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed erc20/mint/benchmark.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] found erc20/transfer/benchmark.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed benchmark metadata: erc20.transfer
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed erc20/transfer/benchmark.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] found snailtracer/benchmark.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed benchmark metadata: snailtracer
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed snailtracer/benchmark.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] found ten-thousand-hashes/benchmark.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed benchmark metadata: ten-thousand-hashes
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed ten-thousand-hashes/benchmark.evm-bench.json
[2023-06-14T15:16:42Z INFO  evm_bench::metadata] found 5 benchmarks: erc20.mint, erc20.approval-transfer, ten-thousand-hashes, snailtracer, erc20.transfer
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] found akula/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed runner metadata: akula
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed akula/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] found ethereumjs/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed runner metadata: ethereumjs
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed ethereumjs/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] found evmone/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed runner metadata: evmone
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed evmone/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] found geth/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed runner metadata: geth
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed geth/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] found py-evm/cpython/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed runner metadata: py-evm.cpython
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed py-evm/cpython/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] found py-evm/pypy/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed runner metadata: py-evm.pypy
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed py-evm/pypy/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] found pyrevm/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed runner metadata: pyrevm
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed pyrevm/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] found revm/runner.evm-bench.json
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed runner metadata: revm
[2023-06-14T15:16:42Z DEBUG evm_bench::metadata] parsed revm/runner.evm-bench.json
[2023-06-14T15:16:42Z INFO  evm_bench::metadata] found 8 runners: geth, py-evm.pypy, ethereumjs, revm, pyrevm, akula, py-evm.cpython, evmone
[2023-06-14T15:16:42Z INFO  evm_bench::build] building 5 benchmarks...
[2023-06-14T15:16:42Z DEBUG evm_bench::build] benchmarks: erc20.mint, snailtracer, erc20.transfer, ten-thousand-hashes, erc20.approval-transfer
[2023-06-14T15:16:42Z INFO  evm_bench::build] building benchmark erc20.approval-transfer (ERC20ApprovalTransfer.sol w/ solc@stable)...
[2023-06-14T15:16:44Z DEBUG evm_bench::build] built benchmark erc20.approval-transfer
[2023-06-14T15:16:44Z INFO  evm_bench::build] building benchmark erc20.mint (ERC20Mint.sol w/ solc@stable)...
[2023-06-14T15:16:47Z DEBUG evm_bench::build] built benchmark erc20.mint
[2023-06-14T15:16:47Z INFO  evm_bench::build] building benchmark erc20.transfer (ERC20Transfer.sol w/ solc@stable)...
[2023-06-14T15:16:50Z DEBUG evm_bench::build] built benchmark erc20.transfer
[2023-06-14T15:16:50Z INFO  evm_bench::build] building benchmark snailtracer (SnailTracer.sol w/ [email protected])...
[2023-06-14T15:16:53Z DEBUG evm_bench::build] built benchmark snailtracer
[2023-06-14T15:16:53Z INFO  evm_bench::build] building benchmark ten-thousand-hashes (TenThousandHashes.sol w/ solc@stable)...
[2023-06-14T15:16:55Z DEBUG evm_bench::build] built benchmark ten-thousand-hashes
[2023-06-14T15:16:55Z DEBUG evm_bench::build] built 5 benchmarks (5 successful)
[2023-06-14T15:16:55Z INFO  evm_bench::run] running 5 benchmarks...
[2023-06-14T15:16:55Z DEBUG evm_bench::run] benchmarks: erc20.mint, erc20.transfer, ten-thousand-hashes, erc20.approval-transfer, snailtracer
[2023-06-14T15:16:55Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on 8 runners...
[2023-06-14T15:16:55Z DEBUG evm_bench::run] runners: evmone, ethereumjs, py-evm.pypy, pyrevm, geth, revm, akula, py-evm.cpython
[2023-06-14T15:16:55Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner akula...
[2023-06-14T15:16:55Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-14T15:16:56Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner akula: exit status: 101
[2023-06-14T15:16:56Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner ethereumjs...
[2023-06-14T15:16:56Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-14T15:16:57Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner ethereumjs: exit status: 254
[2023-06-14T15:16:57Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner evmone...
[2023-06-14T15:16:57Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-14T15:16:59Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner evmone: exit status: 1
[2023-06-14T15:16:59Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner geth...
[2023-06-14T15:16:59Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-14T15:16:59Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner geth: exit status: 1
[2023-06-14T15:16:59Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner py-evm.cpython...
[2023-06-14T15:16:59Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-14T15:16:59Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner py-evm.cpython: exit status: 1
[2023-06-14T15:16:59Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner py-evm.pypy...
[2023-06-14T15:16:59Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-14T15:17:00Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner py-evm.pypy: exit status: 1
[2023-06-14T15:17:00Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner pyrevm...
[2023-06-14T15:17:00Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-14T15:17:00Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner pyrevm: exit status: 1
[2023-06-14T15:17:00Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner revm...
[2023-06-14T15:17:00Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-14T15:17:00Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner revm: exit status: 101
[2023-06-14T15:17:00Z DEBUG evm_bench::run] ran benchmark erc20.approval-transfer on 8 runners (0 successful)
[2023-06-14T15:17:00Z INFO  evm_bench::run] running benchmark erc20.mint on 8 runners...
[2023-06-14T15:17:00Z DEBUG evm_bench::run] runners: geth, py-evm.cpython, pyrevm, ethereumjs, py-evm.pypy, akula, revm, evmone
[2023-06-14T15:17:00Z INFO  evm_bench::run] running benchmark erc20.mint on runner akula...
[2023-06-14T15:17:00Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-14T15:17:01Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner akula: exit status: 101
[2023-06-14T15:17:01Z INFO  evm_bench::run] running benchmark erc20.mint on runner ethereumjs...
[2023-06-14T15:17:01Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-14T15:17:02Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner ethereumjs: exit status: 254
[2023-06-14T15:17:02Z INFO  evm_bench::run] running benchmark erc20.mint on runner evmone...
[2023-06-14T15:17:02Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-14T15:17:04Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner evmone: exit status: 1
[2023-06-14T15:17:04Z INFO  evm_bench::run] running benchmark erc20.mint on runner geth...
[2023-06-14T15:17:04Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-14T15:17:04Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner geth: exit status: 1
[2023-06-14T15:17:04Z INFO  evm_bench::run] running benchmark erc20.mint on runner py-evm.cpython...
[2023-06-14T15:17:04Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-14T15:17:05Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner py-evm.cpython: exit status: 1
[2023-06-14T15:17:05Z INFO  evm_bench::run] running benchmark erc20.mint on runner py-evm.pypy...
[2023-06-14T15:17:05Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-14T15:17:05Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner py-evm.pypy: exit status: 1
[2023-06-14T15:17:05Z INFO  evm_bench::run] running benchmark erc20.mint on runner pyrevm...
[2023-06-14T15:17:05Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-14T15:17:05Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner pyrevm: exit status: 1
[2023-06-14T15:17:05Z INFO  evm_bench::run] running benchmark erc20.mint on runner revm...
[2023-06-14T15:17:05Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-14T15:17:06Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner revm: exit status: 101
[2023-06-14T15:17:06Z DEBUG evm_bench::run] ran benchmark erc20.mint on 8 runners (0 successful)
[2023-06-14T15:17:06Z INFO  evm_bench::run] running benchmark erc20.transfer on 8 runners...
[2023-06-14T15:17:06Z DEBUG evm_bench::run] runners: pyrevm, ethereumjs, akula, py-evm.cpython, py-evm.pypy, geth, revm, evmone
[2023-06-14T15:17:06Z INFO  evm_bench::run] running benchmark erc20.transfer on runner akula...
[2023-06-14T15:17:06Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-14T15:17:06Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner akula: exit status: 101
[2023-06-14T15:17:06Z INFO  evm_bench::run] running benchmark erc20.transfer on runner ethereumjs...
[2023-06-14T15:17:06Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-14T15:17:07Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner ethereumjs: exit status: 254
[2023-06-14T15:17:07Z INFO  evm_bench::run] running benchmark erc20.transfer on runner evmone...
[2023-06-14T15:17:07Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-14T15:17:09Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner evmone: exit status: 1
[2023-06-14T15:17:09Z INFO  evm_bench::run] running benchmark erc20.transfer on runner geth...
[2023-06-14T15:17:09Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-14T15:17:09Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner geth: exit status: 1
[2023-06-14T15:17:09Z INFO  evm_bench::run] running benchmark erc20.transfer on runner py-evm.cpython...
[2023-06-14T15:17:09Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-14T15:17:10Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner py-evm.cpython: exit status: 1
[2023-06-14T15:17:10Z INFO  evm_bench::run] running benchmark erc20.transfer on runner py-evm.pypy...
[2023-06-14T15:17:10Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-14T15:17:10Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner py-evm.pypy: exit status: 1
[2023-06-14T15:17:10Z INFO  evm_bench::run] running benchmark erc20.transfer on runner pyrevm...
[2023-06-14T15:17:10Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-14T15:17:10Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner pyrevm: exit status: 1
[2023-06-14T15:17:10Z INFO  evm_bench::run] running benchmark erc20.transfer on runner revm...
[2023-06-14T15:17:10Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-14T15:17:11Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner revm: exit status: 101
[2023-06-14T15:17:11Z DEBUG evm_bench::run] ran benchmark erc20.transfer on 8 runners (0 successful)
[2023-06-14T15:17:11Z INFO  evm_bench::run] running benchmark snailtracer on 8 runners...
[2023-06-14T15:17:11Z DEBUG evm_bench::run] runners: geth, akula, py-evm.pypy, py-evm.cpython, evmone, pyrevm, ethereumjs, revm
[2023-06-14T15:17:11Z INFO  evm_bench::run] running benchmark snailtracer on runner akula...
[2023-06-14T15:17:11Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-14T15:17:11Z WARN  evm_bench::run] could not run benchmark snailtracer on runner akula: exit status: 101
[2023-06-14T15:17:11Z INFO  evm_bench::run] running benchmark snailtracer on runner ethereumjs...
[2023-06-14T15:17:11Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-14T15:17:12Z WARN  evm_bench::run] could not run benchmark snailtracer on runner ethereumjs: exit status: 254
[2023-06-14T15:17:12Z INFO  evm_bench::run] running benchmark snailtracer on runner evmone...
[2023-06-14T15:17:12Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-14T15:17:14Z DEBUG evm_bench::run] ran benchmark snailtracer on runner evmone
[2023-06-14T15:17:14Z INFO  evm_bench::run] running benchmark snailtracer on runner geth...
[2023-06-14T15:17:14Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-14T15:17:14Z WARN  evm_bench::run] could not run benchmark snailtracer on runner geth: exit status: 1
[2023-06-14T15:17:14Z INFO  evm_bench::run] running benchmark snailtracer on runner py-evm.cpython...
[2023-06-14T15:17:14Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-14T15:17:15Z WARN  evm_bench::run] could not run benchmark snailtracer on runner py-evm.cpython: exit status: 1
[2023-06-14T15:17:15Z INFO  evm_bench::run] running benchmark snailtracer on runner py-evm.pypy...
[2023-06-14T15:17:15Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-14T15:17:15Z WARN  evm_bench::run] could not run benchmark snailtracer on runner py-evm.pypy: exit status: 1
[2023-06-14T15:17:15Z INFO  evm_bench::run] running benchmark snailtracer on runner pyrevm...
[2023-06-14T15:17:15Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-14T15:17:16Z WARN  evm_bench::run] could not run benchmark snailtracer on runner pyrevm: exit status: 1
[2023-06-14T15:17:16Z INFO  evm_bench::run] running benchmark snailtracer on runner revm...
[2023-06-14T15:17:16Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-14T15:17:16Z DEBUG evm_bench::run] ran benchmark snailtracer on runner revm
[2023-06-14T15:17:16Z DEBUG evm_bench::run] ran benchmark snailtracer on 8 runners (2 successful)
[2023-06-14T15:17:16Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on 8 runners...
[2023-06-14T15:17:16Z DEBUG evm_bench::run] runners: py-evm.cpython, py-evm.pypy, pyrevm, ethereumjs, akula, evmone, revm, geth
[2023-06-14T15:17:16Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner akula...
[2023-06-14T15:17:16Z DEBUG evm_bench::run] running 1 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-14T15:17:16Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner akula: exit status: 101
[2023-06-14T15:17:16Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner ethereumjs...
[2023-06-14T15:17:16Z DEBUG evm_bench::run] running 1 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-14T15:17:17Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner ethereumjs: exit status: 254
[2023-06-14T15:17:17Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner evmone...
[2023-06-14T15:17:17Z DEBUG evm_bench::run] running 1 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-14T15:17:19Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner evmone: exit status: 1
[2023-06-14T15:17:19Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner geth...
[2023-06-14T15:17:19Z DEBUG evm_bench::run] running 1 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-14T15:17:19Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner geth: exit status: 1
[2023-06-14T15:17:19Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner py-evm.cpython...
[2023-06-14T15:17:19Z DEBUG evm_bench::run] running 1 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-14T15:17:20Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner py-evm.cpython: exit status: 1
[2023-06-14T15:17:20Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner py-evm.pypy...
[2023-06-14T15:17:20Z DEBUG evm_bench::run] running 1 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-14T15:17:20Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner py-evm.pypy: exit status: 1
[2023-06-14T15:17:20Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner pyrevm...
[2023-06-14T15:17:20Z DEBUG evm_bench::run] running 1 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-14T15:17:21Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner pyrevm: exit status: 1
[2023-06-14T15:17:21Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner revm...
[2023-06-14T15:17:21Z DEBUG evm_bench::run] running 1 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-14T15:17:21Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner revm: exit status: 101
[2023-06-14T15:17:21Z DEBUG evm_bench::run] ran benchmark ten-thousand-hashes on 8 runners (0 successful)
[2023-06-14T15:17:21Z DEBUG evm_bench::run] ran 5 benchmarks (5 successful)
[2023-06-14T15:17:21Z DEBUG evm_bench::results] writing all results out...
[2023-06-14T15:17:21Z INFO  evm_bench::results] wrote out results to /home/kenun/ethsema/Artifact/evm-bench/outputs/results/2023-06-14T15:17:21.419323185+00:00.evm-bench.results.json
[2023-06-14T15:17:21Z INFO  evm_bench::results] reading and parsing results from /home/kenun/ethsema/Artifact/evm-bench/outputs/results/2023-06-14T15:17:21.419323185+00:00.evm-bench.results.json...
[2023-06-14T15:17:21Z DEBUG evm_bench::results] read and parsed results from /home/kenun/ethsema/Artifact/evm-bench/outputs/results/2023-06-14T15:17:21.419323185+00:00.evm-bench.results.json
thread 'main' panicked at 'called `Option::unwrap()` on a `None` value', src/results.rs:107:55
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

@ziyadedher
Copy link
Owner

Sorry for the late response! Could you try out trace? I can't seem to figure out what's going wrong yet :(

@valo
Copy link
Contributor

valo commented Jun 20, 2023

I am getting similar output. I think there are a couple of problems:

There is a problem building akula:

error: failed to run custom build command for `e2p-sys v0.1.0`

Caused by:
  process didn't exit successfully: `/home/valentin/workspace/evm-bench/runners/akula/target/release/build/e2p-sys-4ca5c91eaa078149/build-script-build` (exit status: 101)
  --- stdout
  cargo:rerun-if-env-changed=E2P_NO_PKG_CONFIG
  cargo:rerun-if-env-changed=PKG_CONFIG_x86_64-unknown-linux-gnu
  cargo:rerun-if-env-changed=PKG_CONFIG_x86_64_unknown_linux_gnu
  cargo:rerun-if-env-changed=HOST_PKG_CONFIG
  cargo:rerun-if-env-changed=PKG_CONFIG
  cargo:rerun-if-env-changed=E2P_STATIC
  cargo:rerun-if-env-changed=E2P_DYNAMIC
  cargo:rerun-if-env-changed=PKG_CONFIG_ALL_STATIC
  cargo:rerun-if-env-changed=PKG_CONFIG_ALL_DYNAMIC
  cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64-unknown-linux-gnu
  cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64_unknown_linux_gnu
  cargo:rerun-if-env-changed=HOST_PKG_CONFIG_PATH
  cargo:rerun-if-env-changed=PKG_CONFIG_PATH
  cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64-unknown-linux-gnu
  cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64_unknown_linux_gnu
  cargo:rerun-if-env-changed=HOST_PKG_CONFIG_LIBDIR
  cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR
  cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64-unknown-linux-gnu
  cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64_unknown_linux_gnu
  cargo:rerun-if-env-changed=HOST_PKG_CONFIG_SYSROOT_DIR
  cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR
  cargo:rerun-if-env-changed=E2P_STATIC
  cargo:rerun-if-env-changed=E2P_DYNAMIC
  cargo:rerun-if-env-changed=PKG_CONFIG_ALL_STATIC
  cargo:rerun-if-env-changed=PKG_CONFIG_ALL_DYNAMIC
  cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64-unknown-linux-gnu
  cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64_unknown_linux_gnu
  cargo:rerun-if-env-changed=HOST_PKG_CONFIG_PATH
  cargo:rerun-if-env-changed=PKG_CONFIG_PATH
  cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64-unknown-linux-gnu
  cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64_unknown_linux_gnu
  cargo:rerun-if-env-changed=HOST_PKG_CONFIG_LIBDIR
  cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR
  cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64-unknown-linux-gnu
  cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64_unknown_linux_gnu
  cargo:rerun-if-env-changed=HOST_PKG_CONFIG_SYSROOT_DIR
  cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR

  --- stderr
  thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Error(PkgConfig(Failed to run command `PKG_CONFIG_ALLOW_SYSTEM_CFLAGS="1" PKG_CONFIG_ALLOW_SYSTEM_LIBS="1" "pkg-config" "--libs" "--cflags" "e2p" "e2p >= *"`, because: Permission denied (os error 13)), State { next_error: None })', /home/valentin/.cargo/registry/src/index.crates.io-6f17d22bba15001f/e2p-sys-0.1.0/build.rs:36:23
  note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

The other problem is invalid OpCode errors for all the benchmarks, except snailtracer

[2023-06-20T19:10:45Z INFO  evm_bench::run] running 5 benchmarks...
[2023-06-20T19:10:45Z DEBUG evm_bench::run] benchmarks: erc20.mint, snailtracer, ten-thousand-hashes, erc20.approval-transfer, erc20.transfer
[2023-06-20T19:10:45Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on 1 runners...
[2023-06-20T19:10:45Z DEBUG evm_bench::run] runners: revm
[2023-06-20T19:10:45Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner revm...
[2023-06-20T19:10:45Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-20T19:10:45Z TRACE evm_bench::run] stdout:
[2023-06-20T19:10:45Z TRACE evm_bench::run] stderr:     Finished release [optimized] target(s) in 0.10s
         Running `runners/revm/target/release/runner-revm --contract-code-path /home/valentin/workspace/evm-bench/outputs/build/erc20.approval-transfer/ERC20ApprovalTransfer.bin --calldata 30627b7c --num-runs 5`
    thread 'main' panicked at 'unexpected exit reason while creating: OpcodeNotFound', src/main.rs:62:19
    note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

[2023-06-20T19:10:45Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner revm: exit status: 101
[2023-06-20T19:10:45Z DEBUG evm_bench::run] ran benchmark erc20.approval-transfer on 1 runners (0 successful)
[2023-06-20T19:10:45Z INFO  evm_bench::run] running benchmark erc20.mint on 1 runners...
[2023-06-20T19:10:45Z DEBUG evm_bench::run] runners: revm
[2023-06-20T19:10:45Z INFO  evm_bench::run] running benchmark erc20.mint on runner revm...
[2023-06-20T19:10:45Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-20T19:10:45Z TRACE evm_bench::run] stdout:
[2023-06-20T19:10:45Z TRACE evm_bench::run] stderr:     Finished release [optimized] target(s) in 0.06s
         Running `runners/revm/target/release/runner-revm --contract-code-path /home/valentin/workspace/evm-bench/outputs/build/erc20.mint/ERC20Mint.bin --calldata 30627b7c --num-runs 5`
    thread 'main' panicked at 'unexpected exit reason while creating: OpcodeNotFound', src/main.rs:62:19
    note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

[2023-06-20T19:10:45Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner revm: exit status: 101
[2023-06-20T19:10:45Z DEBUG evm_bench::run] ran benchmark erc20.mint on 1 runners (0 successful)
[2023-06-20T19:10:45Z INFO  evm_bench::run] running benchmark erc20.transfer on 1 runners...
[2023-06-20T19:10:45Z DEBUG evm_bench::run] runners: revm
[2023-06-20T19:10:45Z INFO  evm_bench::run] running benchmark erc20.transfer on runner revm...
[2023-06-20T19:10:45Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-20T19:10:45Z TRACE evm_bench::run] stdout:
[2023-06-20T19:10:45Z TRACE evm_bench::run] stderr:     Finished release [optimized] target(s) in 0.09s
         Running `runners/revm/target/release/runner-revm --contract-code-path /home/valentin/workspace/evm-bench/outputs/build/erc20.transfer/ERC20Transfer.bin --calldata 30627b7c --num-runs 5`
    thread 'main' panicked at 'unexpected exit reason while creating: OpcodeNotFound', src/main.rs:62:19
    note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

[2023-06-20T19:10:45Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner revm: exit status: 101
[2023-06-20T19:10:45Z DEBUG evm_bench::run] ran benchmark erc20.transfer on 1 runners (0 successful)
[2023-06-20T19:10:45Z INFO  evm_bench::run] running benchmark snailtracer on 1 runners...
[2023-06-20T19:10:45Z DEBUG evm_bench::run] runners: revm
[2023-06-20T19:10:45Z INFO  evm_bench::run] running benchmark snailtracer on runner revm...
[2023-06-20T19:10:45Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-20T19:10:45Z TRACE evm_bench::run] stdout: 126.979

[2023-06-20T19:10:45Z TRACE evm_bench::run] stderr:     Finished release [optimized] target(s) in 0.07s
         Running `runners/revm/target/release/runner-revm --contract-code-path /home/valentin/workspace/evm-bench/outputs/build/snailtracer/SnailTracer.bin --calldata 30627b7c --num-runs 1`

[2023-06-20T19:10:45Z DEBUG evm_bench::run] ran benchmark snailtracer on runner revm
[2023-06-20T19:10:45Z DEBUG evm_bench::run] ran benchmark snailtracer on 1 runners (1 successful)
[2023-06-20T19:10:45Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on 1 runners...
[2023-06-20T19:10:45Z DEBUG evm_bench::run] runners: revm
[2023-06-20T19:10:45Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner revm...
[2023-06-20T19:10:45Z DEBUG evm_bench::run] running 5 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-20T19:10:45Z TRACE evm_bench::run] stdout:
[2023-06-20T19:10:45Z TRACE evm_bench::run] stderr:     Finished release [optimized] target(s) in 0.09s
         Running `runners/revm/target/release/runner-revm --contract-code-path /home/valentin/workspace/evm-bench/outputs/build/ten-thousand-hashes/TenThousandHashes.bin --calldata 30627b7c --num-runs 5`
    thread 'main' panicked at 'unexpected exit reason while creating: OpcodeNotFound', src/main.rs:62:19
    note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

[2023-06-20T19:10:45Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner revm: exit status: 101
[2023-06-20T19:10:45Z DEBUG evm_bench::run] ran benchmark ten-thousand-hashes on 1 runners (0 successful)
[2023-06-20T19:10:45Z DEBUG evm_bench::run] ran 5 benchmarks (5 successful)

@valo
Copy link
Contributor

valo commented Jun 20, 2023

Easier way to reproduce is by running

runners/revm/target/release/runner-revm --contract-code-path outputs/build/ten-thousand-hashes/TenThousandHashes.bin --calldata 30627b7c --num-runs 5

On this bytecode of TenThousandHashes.bin:

608060405234801561000f575f80fd5b5060c28061001c5f395ff3fe6080604052348015600e575f80fd5b50600436106026575f3560e01c806330627b7c14602a575b5f80fd5b60306032565b005b5f5b614e2081101560665760408051602081018390520160408051601f198184030190525280605f816069565b9150506034565b50565b5f60018201608557634e487b7160e01b5f52601160045260245ffd5b506001019056fea2646970667358221220c5562cfa4786ec70cddaf90608bf244f70ae35b0a65a86b12e8be77302b2594864736f6c63430008140033

@valo
Copy link
Contributor

valo commented Jun 20, 2023

The invalid OpCode is resolved by pinning the solc version when running the bench:

cargo run --release -- --default-solc-version 0.8.17

@Kenun99
Copy link
Author

Kenun99 commented Jun 22, 2023

I ran RUST_LOG=trace cargo run --release -- --default-solc-version 0.8.17. The output is attached.

    Finished release [optimized] target(s) in 0.07s
     Running `target/release/evm-bench --default-solc-version 0.8.17`
[2023-06-22T03:19:47Z TRACE evm_bench::exec] validating executable docker (docker)
[2023-06-22T03:19:47Z DEBUG evm_bench::exec] found docker (docker): Docker version 20.10.9, build c2ea9bc
[2023-06-22T03:19:47Z TRACE evm_bench::exec] validating executable cargo (cargo)
[2023-06-22T03:19:47Z DEBUG evm_bench::exec] found cargo (cargo): cargo 1.70.0 (ec8a8a0ca 2023-04-25)
[2023-06-22T03:19:47Z TRACE evm_bench::exec] validating executable poetry (poetry)
[2023-06-22T03:19:48Z DEBUG evm_bench::exec] found poetry (poetry): Poetry (version 1.5.1)
[2023-06-22T03:19:48Z TRACE evm_bench::exec] validating executable python3 (python3)
[2023-06-22T03:19:48Z DEBUG evm_bench::exec] found python3 (python3): Python 3.8.10
[2023-06-22T03:19:48Z TRACE evm_bench::exec] validating executable pypy3 (pypy3)
[2023-06-22T03:19:48Z DEBUG evm_bench::exec] found pypy3 (pypy3): Python 3.6.9 (7.3.1+dfsg-4, Apr 22 2020, 05:15:29)
    [PyPy 7.3.1 with GCC 9.3.0]
[2023-06-22T03:19:48Z TRACE evm_bench::exec] validating executable npm (npm)
[2023-06-22T03:19:48Z DEBUG evm_bench::exec] found npm (npm): 6.14.13
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] found erc20/approval-transfer/benchmark.evm-bench.json
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] parsing benchmark metadata...
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed benchmark metadata: erc20.approval-transfer
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] benchmark metadata: Benchmark { name: "erc20.approval-transfer", solc_version: "0.8.17", num_runs: 5, contract: "/home/kenun/ethsema/Artifact/evm-bench/benchmarks/erc20/approval-transfer/ERC20ApprovalTransfer.sol", build_context: "/home/kenun/ethsema/Artifact/evm-bench/benchmarks/erc20", calldata: [48, 98, 123, 124] }
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed erc20/approval-transfer/benchmark.evm-bench.json
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] found erc20/mint/benchmark.evm-bench.json
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] parsing benchmark metadata...
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed benchmark metadata: erc20.mint
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] benchmark metadata: Benchmark { name: "erc20.mint", solc_version: "0.8.17", num_runs: 5, contract: "/home/kenun/ethsema/Artifact/evm-bench/benchmarks/erc20/mint/ERC20Mint.sol", build_context: "/home/kenun/ethsema/Artifact/evm-bench/benchmarks/erc20", calldata: [48, 98, 123, 124] }
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed erc20/mint/benchmark.evm-bench.json
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] found erc20/transfer/benchmark.evm-bench.json
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] parsing benchmark metadata...
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed benchmark metadata: erc20.transfer
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] benchmark metadata: Benchmark { name: "erc20.transfer", solc_version: "0.8.17", num_runs: 5, contract: "/home/kenun/ethsema/Artifact/evm-bench/benchmarks/erc20/transfer/ERC20Transfer.sol", build_context: "/home/kenun/ethsema/Artifact/evm-bench/benchmarks/erc20", calldata: [48, 98, 123, 124] }
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed erc20/transfer/benchmark.evm-bench.json
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] found snailtracer/benchmark.evm-bench.json
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] parsing benchmark metadata...
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed benchmark metadata: snailtracer
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] benchmark metadata: Benchmark { name: "snailtracer", solc_version: "0.4.26", num_runs: 1, contract: "/home/kenun/ethsema/Artifact/evm-bench/benchmarks/snailtracer/SnailTracer.sol", build_context: "/home/kenun/ethsema/Artifact/evm-bench/benchmarks/snailtracer", calldata: [48, 98, 123, 124] }
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed snailtracer/benchmark.evm-bench.json
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] found ten-thousand-hashes/benchmark.evm-bench.json
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] parsing benchmark metadata...
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed benchmark metadata: ten-thousand-hashes
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] benchmark metadata: Benchmark { name: "ten-thousand-hashes", solc_version: "0.8.17", num_runs: 5, contract: "/home/kenun/ethsema/Artifact/evm-bench/benchmarks/ten-thousand-hashes/TenThousandHashes.sol", build_context: "/home/kenun/ethsema/Artifact/evm-bench/benchmarks/ten-thousand-hashes", calldata: [48, 98, 123, 124] }
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed ten-thousand-hashes/benchmark.evm-bench.json
[2023-06-22T03:19:48Z INFO  evm_bench::metadata] found 5 benchmarks: erc20.transfer, erc20.mint, snailtracer, ten-thousand-hashes, erc20.approval-transfer
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] found akula/runner.evm-bench.json
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] parsing runner metadata...
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed runner metadata: akula
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] runner metadata: Runner { name: "akula", entry: "/home/kenun/ethsema/Artifact/evm-bench/runners/akula/entry.sh" }
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed akula/runner.evm-bench.json
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] found ethereumjs/runner.evm-bench.json
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] parsing runner metadata...
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed runner metadata: ethereumjs
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] runner metadata: Runner { name: "ethereumjs", entry: "/home/kenun/ethsema/Artifact/evm-bench/runners/ethereumjs/entry.sh" }
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed ethereumjs/runner.evm-bench.json
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] found evmone/runner.evm-bench.json
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] parsing runner metadata...
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed runner metadata: evmone
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] runner metadata: Runner { name: "evmone", entry: "/home/kenun/ethsema/Artifact/evm-bench/runners/evmone/entry.sh" }
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed evmone/runner.evm-bench.json
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] found geth/runner.evm-bench.json
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] parsing runner metadata...
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed runner metadata: geth
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] runner metadata: Runner { name: "geth", entry: "/home/kenun/ethsema/Artifact/evm-bench/runners/geth/entry.sh" }
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed geth/runner.evm-bench.json
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] found py-evm/cpython/runner.evm-bench.json
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] parsing runner metadata...
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed runner metadata: py-evm.cpython
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] runner metadata: Runner { name: "py-evm.cpython", entry: "/home/kenun/ethsema/Artifact/evm-bench/runners/py-evm/cpython/entry.sh" }
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed py-evm/cpython/runner.evm-bench.json
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] found py-evm/pypy/runner.evm-bench.json
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] parsing runner metadata...
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed runner metadata: py-evm.pypy
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] runner metadata: Runner { name: "py-evm.pypy", entry: "/home/kenun/ethsema/Artifact/evm-bench/runners/py-evm/pypy/entry.sh" }
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed py-evm/pypy/runner.evm-bench.json
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] found pyrevm/runner.evm-bench.json
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] parsing runner metadata...
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed runner metadata: pyrevm
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] runner metadata: Runner { name: "pyrevm", entry: "/home/kenun/ethsema/Artifact/evm-bench/runners/pyrevm/entry.sh" }
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed pyrevm/runner.evm-bench.json
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] found revm/runner.evm-bench.json
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] parsing runner metadata...
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed runner metadata: revm
[2023-06-22T03:19:48Z TRACE evm_bench::metadata] runner metadata: Runner { name: "revm", entry: "/home/kenun/ethsema/Artifact/evm-bench/runners/revm/entry.sh" }
[2023-06-22T03:19:48Z DEBUG evm_bench::metadata] parsed revm/runner.evm-bench.json
[2023-06-22T03:19:48Z INFO  evm_bench::metadata] found 8 runners: evmone, py-evm.pypy, py-evm.cpython, pyrevm, revm, geth, akula, ethereumjs
[2023-06-22T03:19:48Z INFO  evm_bench::build] building 5 benchmarks...
[2023-06-22T03:19:48Z DEBUG evm_bench::build] benchmarks: erc20.transfer, snailtracer, ten-thousand-hashes, erc20.mint, erc20.approval-transfer
[2023-06-22T03:19:48Z INFO  evm_bench::build] building benchmark erc20.approval-transfer (ERC20ApprovalTransfer.sol w/ [email protected])...
[2023-06-22T03:19:48Z TRACE users::base] Running getuid
[2023-06-22T03:19:48Z TRACE users::base] Running getgid
[2023-06-22T03:19:51Z TRACE evm_bench::build] stdout: Compiler run successful. Artifact(s) can be found in directory "/build".
    
[2023-06-22T03:19:51Z TRACE evm_bench::build] stderr: 
[2023-06-22T03:19:51Z DEBUG evm_bench::build] built benchmark erc20.approval-transfer
[2023-06-22T03:19:51Z INFO  evm_bench::build] building benchmark erc20.mint (ERC20Mint.sol w/ [email protected])...
[2023-06-22T03:19:51Z TRACE users::base] Running getuid
[2023-06-22T03:19:51Z TRACE users::base] Running getgid
[2023-06-22T03:19:53Z TRACE evm_bench::build] stdout: Compiler run successful. Artifact(s) can be found in directory "/build".
    
[2023-06-22T03:19:53Z TRACE evm_bench::build] stderr: 
[2023-06-22T03:19:53Z DEBUG evm_bench::build] built benchmark erc20.mint
[2023-06-22T03:19:53Z INFO  evm_bench::build] building benchmark erc20.transfer (ERC20Transfer.sol w/ [email protected])...
[2023-06-22T03:19:53Z TRACE users::base] Running getuid
[2023-06-22T03:19:53Z TRACE users::base] Running getgid
[2023-06-22T03:19:56Z TRACE evm_bench::build] stdout: Compiler run successful. Artifact(s) can be found in directory "/build".
    
[2023-06-22T03:19:56Z TRACE evm_bench::build] stderr: 
[2023-06-22T03:19:56Z DEBUG evm_bench::build] built benchmark erc20.transfer
[2023-06-22T03:19:56Z INFO  evm_bench::build] building benchmark snailtracer (SnailTracer.sol w/ [email protected])...
[2023-06-22T03:19:56Z TRACE users::base] Running getuid
[2023-06-22T03:19:56Z TRACE users::base] Running getgid
[2023-06-22T03:19:58Z TRACE evm_bench::build] stdout: 
[2023-06-22T03:19:58Z TRACE evm_bench::build] stderr: /benchmark/SnailTracer.sol:5:1: Warning: Source file does not specify required compiler version!Consider adding "pragma solidity ^0.4.26;"
    contract SnailTracer {
    ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:355:5: Warning: This declaration shadows an existing declaration.
        Vector memory intersect = add(ray.origin, div(mul(ray.direction, dist), 1000000));
        ^---------------------^
    /benchmark/SnailTracer.sol:269:3: The shadowed declaration is here:
      function intersect(Triangle t, Ray r) internal returns (int) {
      ^ (Relevant source part starts here and spans across multiple lines).
    
    /benchmark/SnailTracer.sol:371:5: Warning: This declaration shadows an existing declaration.
        Vector memory intersect = add(ray.origin, div(mul(ray.direction, dist), 1000000));
        ^---------------------^
    /benchmark/SnailTracer.sol:269:3: The shadowed declaration is here:
      function intersect(Triangle t, Ray r) internal returns (int) {
      ^ (Relevant source part starts here and spans across multiple lines).
    
    /benchmark/SnailTracer.sol:389:29: Warning: This declaration shadows an existing declaration.
      function diffuse(Ray ray, Vector intersect, Vector normal) internal returns (Vector) {
                                ^--------------^
    /benchmark/SnailTracer.sol:269:3: The shadowed declaration is here:
      function intersect(Triangle t, Ray r) internal returns (int) {
      ^ (Relevant source part starts here and spans across multiple lines).
    
    /benchmark/SnailTracer.sol:408:30: Warning: This declaration shadows an existing declaration.
      function specular(Ray ray, Vector intersect, Vector normal) internal returns (Vector) {
                                 ^--------------^
    /benchmark/SnailTracer.sol:269:3: The shadowed declaration is here:
      function intersect(Triangle t, Ray r) internal returns (int) {
      ^ (Relevant source part starts here and spans across multiple lines).
    
    /benchmark/SnailTracer.sol:412:32: Warning: This declaration shadows an existing declaration.
      function refractive(Ray ray, Vector intersect, Vector normal, int nnt, int ddn, int cos2t) internal returns (Vector) {
                                   ^--------------^
    /benchmark/SnailTracer.sol:269:3: The shadowed declaration is here:
      function intersect(Triangle t, Ray r) internal returns (int) {
      ^ (Relevant source part starts here and spans across multiple lines).
    
    /benchmark/SnailTracer.sol:21:3: Warning: No visibility specified. Defaulting to "public". 
      function TracePixel(int x, int y, int spp) constant returns (byte r, byte g, byte b) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:28:3: Warning: No visibility specified. Defaulting to "public". 
      function TraceScanline(int y, int spp) constant returns (bytes) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:42:3: Warning: No visibility specified. Defaulting to "public". 
      function TraceImage(int spp) constant returns (bytes) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:56:3: Warning: No visibility specified. Defaulting to "public". 
      function Benchmark() constant returns (byte r, byte g, byte b) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:22:27: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        Vector memory color = trace(x, y, spp);
                              ^--------------^
    /benchmark/SnailTracer.sol:30:29: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
          Vector memory color = trace(x, y, spp);
                                ^--------------^
    /benchmark/SnailTracer.sol:32:7: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
          buffer.push(byte(color.x));
          ^------------------------^
    /benchmark/SnailTracer.sol:33:7: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
          buffer.push(byte(color.y));
          ^------------------------^
    /benchmark/SnailTracer.sol:34:7: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
          buffer.push(byte(color.z));
          ^------------------------^
    /benchmark/SnailTracer.sol:45:31: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
            Vector memory color = trace(x, y, spp);
                                  ^--------------^
    /benchmark/SnailTracer.sol:47:9: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
            buffer.push(byte(color.x));
            ^------------------------^
    /benchmark/SnailTracer.sol:48:9: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
            buffer.push(byte(color.y));
            ^------------------------^
    /benchmark/SnailTracer.sol:49:9: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
            buffer.push(byte(color.z));
            ^------------------------^
    /benchmark/SnailTracer.sol:58:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        width = 1024; height = 768;
        ^---^
    /benchmark/SnailTracer.sol:58:19: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        width = 1024; height = 768;
                      ^----^
    /benchmark/SnailTracer.sol:61:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        camera = Ray(Vector(50000000, 52000000, 295600000), norm(Vector(0, -42612, -1000000)), 0, false);
        ^----^
    /benchmark/SnailTracer.sol:61:57: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        camera = Ray(Vector(50000000, 52000000, 295600000), norm(Vector(0, -42612, -1000000)), 0, false);
                                                            ^-------------------------------^
    /benchmark/SnailTracer.sol:62:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        deltaX = Vector(width * 513500 / height, 0, 0);
        ^----^
    /benchmark/SnailTracer.sol:63:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        deltaY = div(mul(norm(cross(deltaX, camera.direction)), 513500), 1000000);
        ^----^
    /benchmark/SnailTracer.sol:63:27: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        deltaY = div(mul(norm(cross(deltaX, camera.direction)), 513500), 1000000);
                              ^-----------------------------^
    /benchmark/SnailTracer.sol:63:22: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        deltaY = div(mul(norm(cross(deltaX, camera.direction)), 513500), 1000000);
                         ^-----------------------------------^
    /benchmark/SnailTracer.sol:63:18: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        deltaY = div(mul(norm(cross(deltaX, camera.direction)), 513500), 1000000);
                     ^------------------------------------------------^
    /benchmark/SnailTracer.sol:63:14: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        deltaY = div(mul(norm(cross(deltaX, camera.direction)), 513500), 1000000);
                 ^--------------------------------------------------------------^
    /benchmark/SnailTracer.sol:66:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        spheres.push(Sphere(100000000000, Vector(100001000000, 40800000, 81600000), Vector(0, 0, 0), Vector(750000, 250000, 250000), Material.Diffuse));
        ^---------------------------------------------------------------------------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:67:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        spheres.push(Sphere(100000000000, Vector(-99901000000, 40800000, 81600000), Vector(0, 0, 0), Vector(250000, 250000, 750000), Material.Diffuse));
        ^---------------------------------------------------------------------------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:68:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        spheres.push(Sphere(100000000000, Vector(50000000, 40800000, 100000000000), Vector(0, 0, 0), Vector(750000, 750000, 750000), Material.Diffuse));
        ^---------------------------------------------------------------------------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:69:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        spheres.push(Sphere(100000000000, Vector(50000000, 40800000, -99830000000), Vector(0, 0, 0), Vector(0, 0, 0), Material.Diffuse));
        ^------------------------------------------------------------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:70:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        spheres.push(Sphere(100000000000, Vector(50000000, 100000000000, 81600000), Vector(0, 0, 0), Vector(750000, 750000, 750000), Material.Diffuse));
        ^---------------------------------------------------------------------------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:71:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        spheres.push(Sphere(100000000000, Vector(50000000, -99918400000, 81600000), Vector(0, 0, 0), Vector(750000, 750000, 750000), Material.Diffuse));
        ^---------------------------------------------------------------------------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:74:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        spheres.push(Sphere(16500000, Vector(27000000, 16500000, 47000000), Vector(0, 0, 0), Vector(999000, 999000, 999000), Material.Specular));
        ^--------------------------------------------------------------------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:75:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        spheres.push(Sphere(600000000, Vector(50000000, 681330000, 81600000), Vector(12000000, 12000000, 12000000), Vector(0, 0, 0), Material.Diffuse));
        ^---------------------------------------------------------------------------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:79:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        triangles.push(Triangle(Vector(5650 ... 99000, 999000), Material.Specular));
        ^-------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:80:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        triangles.push(Triangle(Vector(5650 ... 99000, 999000), Material.Specular));
        ^-------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:81:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        triangles.push(Triangle(Vector(8950 ... 99000, 999000), Material.Specular));
        ^-------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:82:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        triangles.push(Triangle(Vector(8950 ... 99000, 999000), Material.Specular));
        ^-------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:85:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        triangles.push(Triangle(Vector(5650 ... 99000, 999000), Material.Specular));
        ^-------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:86:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        triangles.push(Triangle(Vector(5650 ... 99000, 999000), Material.Specular));
        ^-------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:87:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        triangles.push(Triangle(Vector(8950 ... 99000, 999000), Material.Specular));
        ^-------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:88:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        triangles.push(Triangle(Vector(8950 ... 99000, 999000), Material.Specular));
        ^-------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:91:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        triangles.push(Triangle(Vector(5650 ... 99000, 999000), Material.Specular));
        ^-------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:92:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        triangles.push(Triangle(Vector(5650 ... 99000, 999000), Material.Specular));
        ^-------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:93:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        triangles.push(Triangle(Vector(5650 ... 99000, 999000), Material.Specular));
        ^-------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:94:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        triangles.push(Triangle(Vector(5650 ... 99000, 999000), Material.Specular));
        ^-------------------------------------------------------------------------^
    /benchmark/SnailTracer.sol:99:7: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
          triangles[i].normal = norm(cross(sub(tri.b, tri.a), sub(tri.c, tri.a)));
          ^-----------------^
    /benchmark/SnailTracer.sol:99:40: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
          triangles[i].normal = norm(cross(sub(tri.b, tri.a), sub(tri.c, tri.a)));
                                           ^---------------^
    /benchmark/SnailTracer.sol:99:59: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
          triangles[i].normal = norm(cross(sub(tri.b, tri.a), sub(tri.c, tri.a)));
                                                              ^---------------^
    /benchmark/SnailTracer.sol:99:34: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
          triangles[i].normal = norm(cross(sub(tri.b, tri.a), sub(tri.c, tri.a)));
                                     ^-----------------------------------------^
    /benchmark/SnailTracer.sol:99:29: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
          triangles[i].normal = norm(cross(sub(tri.b, tri.a), sub(tri.c, tri.a)));
                                ^-----------------------------------------------^
    /benchmark/SnailTracer.sol:102:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        deltaX = Vector(width * 513500 / height, 0, 0);
        ^----^
    /benchmark/SnailTracer.sol:103:5: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        deltaY = div(mul(norm(cross(deltaX, camera.direction)), 513500), 1000000);
        ^----^
    /benchmark/SnailTracer.sol:103:27: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        deltaY = div(mul(norm(cross(deltaX, camera.direction)), 513500), 1000000);
                              ^-----------------------------^
    /benchmark/SnailTracer.sol:103:22: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        deltaY = div(mul(norm(cross(deltaX, camera.direction)), 513500), 1000000);
                         ^-----------------------------------^
    /benchmark/SnailTracer.sol:103:18: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        deltaY = div(mul(norm(cross(deltaX, camera.direction)), 513500), 1000000);
                     ^------------------------------------------------^
    /benchmark/SnailTracer.sol:103:14: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        deltaY = div(mul(norm(cross(deltaX, camera.direction)), 513500), 1000000);
                 ^--------------------------------------------------------------^
    /benchmark/SnailTracer.sol:108:24: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        color = add(color, trace(512, 384, 8)); // Flat diffuse surface, opposite wall
                           ^----------------^
    /benchmark/SnailTracer.sol:108:13: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        color = add(color, trace(512, 384, 8)); // Flat diffuse surface, opposite wall
                ^----------------------------^
    /benchmark/SnailTracer.sol:109:24: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        color = add(color, trace(325, 540, 8)); // Reflective surface mirroring left wall
                           ^----------------^
    /benchmark/SnailTracer.sol:109:13: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        color = add(color, trace(325, 540, 8)); // Reflective surface mirroring left wall
                ^----------------------------^
    /benchmark/SnailTracer.sol:110:24: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        color = add(color, trace(600, 600, 8)); // Refractive surface reflecting right wall
                           ^----------------^
    /benchmark/SnailTracer.sol:110:13: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        color = add(color, trace(600, 600, 8)); // Refractive surface reflecting right wall
                ^----------------------------^
    /benchmark/SnailTracer.sol:111:24: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        color = add(color, trace(522, 524, 8)); // Reflective surface mirroring the refractive surface reflecting the light
                           ^----------------^
    /benchmark/SnailTracer.sol:111:13: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        color = add(color, trace(522, 524, 8)); // Reflective surface mirroring the refractive surface reflecting the light
                ^----------------------------^
    /benchmark/SnailTracer.sol:112:13: Warning: Function declared as view, but this expression (potentially) modifies the state and thus requires non-payable (the default) or payable.
        color = div(color, 4);
                ^-----------^
    /benchmark/SnailTracer.sol:137:3: Warning: Function state mutability can be restricted to pure
      function clamp(int x) internal returns (int) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:143:3: Warning: Function state mutability can be restricted to pure
      function sqrt(int x) internal returns (int y) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:152:3: Warning: Function state mutability can be restricted to pure
      function sin(int x) internal returns (int y) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:175:3: Warning: Function state mutability can be restricted to pure
      function abs(int x) internal returns (int) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:186:3: Warning: Function state mutability can be restricted to pure
      function add(Vector u, Vector v) internal returns (Vector) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:189:3: Warning: Function state mutability can be restricted to pure
      function sub(Vector u, Vector v) internal returns (Vector) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:192:3: Warning: Function state mutability can be restricted to pure
      function mul(Vector v, int m) internal returns (Vector) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:195:3: Warning: Function state mutability can be restricted to pure
      function mul(Vector u, Vector v) internal returns (Vector) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:198:3: Warning: Function state mutability can be restricted to pure
      function div(Vector v, int d) internal returns (Vector) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:201:3: Warning: Function state mutability can be restricted to pure
      function dot(Vector u, Vector v) internal returns (int) {
      ^ (Relevant source part starts here and spans across multiple lines).
    /benchmark/SnailTracer.sol:204:3: Warning: Function state mutability can be restricted to pure
      function cross(Vector u, Vector v) internal returns (Vector) {
      ^ (Relevant source part starts here and spans across multiple lines).
    
[2023-06-22T03:19:58Z DEBUG evm_bench::build] built benchmark snailtracer
[2023-06-22T03:19:58Z INFO  evm_bench::build] building benchmark ten-thousand-hashes (TenThousandHashes.sol w/ [email protected])...
[2023-06-22T03:19:58Z TRACE users::base] Running getuid
[2023-06-22T03:19:58Z TRACE users::base] Running getgid
[2023-06-22T03:20:01Z TRACE evm_bench::build] stdout: Compiler run successful. Artifact(s) can be found in directory "/build".
    
[2023-06-22T03:20:01Z TRACE evm_bench::build] stderr: 
[2023-06-22T03:20:01Z DEBUG evm_bench::build] built benchmark ten-thousand-hashes
[2023-06-22T03:20:01Z DEBUG evm_bench::build] built 5 benchmarks (5 successful)
[2023-06-22T03:20:01Z INFO  evm_bench::run] running 5 benchmarks...
[2023-06-22T03:20:01Z DEBUG evm_bench::run] benchmarks: erc20.approval-transfer, snailtracer, ten-thousand-hashes, erc20.transfer, erc20.mint
[2023-06-22T03:20:01Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on 8 runners...
[2023-06-22T03:20:01Z DEBUG evm_bench::run] runners: akula, ethereumjs, py-evm.pypy, evmone, revm, geth, py-evm.cpython, pyrevm
[2023-06-22T03:20:01Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner akula...
[2023-06-22T03:20:01Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-22T03:20:02Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:02Z TRACE evm_bench::run] stderr:    Compiling e2p-sys v0.1.0
       Compiling trust-dns-proto v0.22.0
       Compiling hashbrown v0.13.2
    error: failed to run custom build command for `e2p-sys v0.1.0`
    
    Caused by:
      process didn't exit successfully: `/home/kenun/ethsema/Artifact/evm-bench/runners/akula/target/production/build/e2p-sys-d487bab60a699c27/build-script-build` (exit status: 101)
      --- stdout
      cargo:rerun-if-env-changed=E2P_NO_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG
      cargo:rerun-if-env-changed=E2P_STATIC
      cargo:rerun-if-env-changed=E2P_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_STATIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_SYSROOT_DIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR
    
      --- stderr
      thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Error(PkgConfig(`PKG_CONFIG_ALLOW_SYSTEM_CFLAGS="1" PKG_CONFIG_ALLOW_SYSTEM_LIBS="1" "pkg-config" "--libs" "--cflags" "e2p" "e2p >= *"` did not exit successfully: exit status: 1
      error: could not find system library 'e2p' required by the 'e2p-sys' crate
    
      --- stderr
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      ), State { next_error: None })', /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/e2p-sys-0.1.0/build.rs:36:23
      note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    warning: build failed, waiting for other jobs to finish...
    error: failed to run custom build command for `e2p-sys v0.1.0`
    
    Caused by:
      process didn't exit successfully: `/home/kenun/ethsema/Artifact/evm-bench/runners/akula/target/production/build/e2p-sys-d487bab60a699c27/build-script-build` (exit status: 101)
      --- stdout
      cargo:rerun-if-env-changed=E2P_NO_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG
      cargo:rerun-if-env-changed=E2P_STATIC
      cargo:rerun-if-env-changed=E2P_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_STATIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_SYSROOT_DIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR
    
      --- stderr
      thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Error(PkgConfig(`PKG_CONFIG_ALLOW_SYSTEM_CFLAGS="1" PKG_CONFIG_ALLOW_SYSTEM_LIBS="1" "pkg-config" "--libs" "--cflags" "e2p" "e2p >= *"` did not exit successfully: exit status: 1
      error: could not find system library 'e2p' required by the 'e2p-sys' crate
    
      --- stderr
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      ), State { next_error: None })', /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/e2p-sys-0.1.0/build.rs:36:23
      note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:15:5
       |
    15 | /     feature(
    16 | |         test,
    17 | |         core_intrinsics,
    18 | |         dropck_eyepatch,
    ...  |
    25 | |         build_hasher_simple_hash_one
    26 | |     )
       | |_____^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:16:9
       |
    16 |         test,
       |         ^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:17:9
       |
    17 |         core_intrinsics,
       |         ^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:20:9
       |
    20 |         extend_one,
       |         ^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:21:9
       |
    21 |         allocator_api,
       |         ^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:22:9
       |
    22 |         slice_ptr_get,
       |         ^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:23:9
       |
    23 |         nonnull_slice_from_raw_parts,
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:24:9
       |
    24 |         maybe_uninit_array_assume_init,
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:25:9
       |
    25 |         build_hasher_simple_hash_one
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    For more information about this error, try `rustc --explain E0554`.
    error: could not compile `hashbrown` (lib) due to 9 previous errors
    error[E0592]: duplicate definitions with name `is_soa`
       --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/trust-dns-proto-0.22.0/src/rr/record_data.rs:55:17
        |
    55  | #[derive(Debug, EnumAsInner, PartialEq, Clone, Eq)]
        |                 ^^^^^^^^^^^ duplicate definitions for `is_soa`
    ...
    994 |     pub fn is_soa(&self) -> bool {
        |     ---------------------------- other definition for `is_soa`
        |
        = note: this error originates in the derive macro `EnumAsInner` (in Nightly builds, run with -Z macro-backtrace for more info)
    
    For more information about this error, try `rustc --explain E0592`.
    error: could not compile `trust-dns-proto` (lib) due to previous error
    
[2023-06-22T03:20:02Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner akula: exit status: 101
[2023-06-22T03:20:02Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner ethereumjs...
[2023-06-22T03:20:02Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-22T03:20:03Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:03Z TRACE evm_bench::run] stderr: npm WARN read-shrinkwrap This version of npm is compatible with lockfileVersion@1, but package-lock.json was generated for lockfileVersion@3. I'll try to do my best with it!
    npm WARN runner-ethereumjs@ No description
    npm WARN runner-ethereumjs@ No repository field.
    npm WARN runner-ethereumjs@ No license field.
    
    npm ERR! code ENOENT
    npm ERR! syscall chmod
    npm ERR! path /home/kenun/ethsema/Artifact/evm-bench/runners/ethereumjs/node_modules/deno/try-deno
    npm ERR! errno -2
    npm ERR! enoent ENOENT: no such file or directory, chmod '/home/kenun/ethsema/Artifact/evm-bench/runners/ethereumjs/node_modules/deno/try-deno'
    npm ERR! enoent This is related to npm not being able to find a file.
    npm ERR! enoent 
    
    npm ERR! A complete log of this run can be found in:
    npm ERR!     /home/kenun/.npm/_logs/2023-06-22T03_20_03_074Z-debug.log
    
[2023-06-22T03:20:03Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner ethereumjs: exit status: 254
[2023-06-22T03:20:03Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner evmone...
[2023-06-22T03:20:03Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-22T03:20:05Z TRACE evm_bench::run] stdout: 8.1231
    8.18247
    8.34526
    7.99651
    7.97082
    
[2023-06-22T03:20:05Z TRACE evm_bench::run] stderr: success
    success
    success
    success
    success
    success
    
[2023-06-22T03:20:05Z DEBUG evm_bench::run] ran benchmark erc20.approval-transfer on runner evmone
[2023-06-22T03:20:05Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner geth...
[2023-06-22T03:20:05Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-22T03:20:05Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:05Z TRACE evm_bench::run] stderr: runner.go:9:2: cannot find package "github.com/ethereum/go-ethereum/common" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/common (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/common (from $GOPATH)
    runner.go:10:2: cannot find package "github.com/ethereum/go-ethereum/core" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core (from $GOPATH)
    runner.go:11:2: cannot find package "github.com/ethereum/go-ethereum/core/rawdb" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/rawdb (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/rawdb (from $GOPATH)
    runner.go:12:2: cannot find package "github.com/ethereum/go-ethereum/core/state" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/state (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/state (from $GOPATH)
    runner.go:13:2: cannot find package "github.com/ethereum/go-ethereum/core/types" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/types (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/types (from $GOPATH)
    runner.go:14:2: cannot find package "github.com/ethereum/go-ethereum/core/vm" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/vm (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/vm (from $GOPATH)
    runner.go:15:2: cannot find package "github.com/ethereum/go-ethereum/params" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/params (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/params (from $GOPATH)
    runner.go:16:2: cannot find package "github.com/spf13/cobra" in any of:
    	/usr/local/go/src/github.com/spf13/cobra (from $GOROOT)
    	/home/kenun/.go/src/github.com/spf13/cobra (from $GOPATH)
    
[2023-06-22T03:20:05Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner geth: exit status: 1
[2023-06-22T03:20:05Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner py-evm.cpython...
[2023-06-22T03:20:05Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-22T03:20:05Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:05Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.8.10) is not supported by the project (^3.9).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:05Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner py-evm.cpython: exit status: 1
[2023-06-22T03:20:05Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner py-evm.pypy...
[2023-06-22T03:20:05Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-22T03:20:06Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:06Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.6.9) is not supported by the project (^3.9).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:06Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner py-evm.pypy: exit status: 1
[2023-06-22T03:20:06Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner pyrevm...
[2023-06-22T03:20:06Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-22T03:20:06Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:06Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.8.10) is not supported by the project (^3.10).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:06Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner pyrevm: exit status: 1
[2023-06-22T03:20:06Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner revm...
[2023-06-22T03:20:06Z DEBUG evm_bench::run] running 5 times using code ERC20ApprovalTransfer.bin with calldata 30627b7c...
[2023-06-22T03:20:06Z TRACE evm_bench::run] stdout: 10.864
    10.454
    10.396
    10.409
    10.399
    
[2023-06-22T03:20:06Z TRACE evm_bench::run] stderr:     Finished release [optimized] target(s) in 0.04s
         Running `runners/revm/target/release/runner-revm --contract-code-path /home/kenun/ethsema/Artifact/evm-bench/outputs/build/erc20.approval-transfer/ERC20ApprovalTransfer.bin --calldata 30627b7c --num-runs 5`
    
[2023-06-22T03:20:06Z DEBUG evm_bench::run] ran benchmark erc20.approval-transfer on runner revm
[2023-06-22T03:20:06Z DEBUG evm_bench::run] ran benchmark erc20.approval-transfer on 8 runners (2 successful)
[2023-06-22T03:20:06Z INFO  evm_bench::run] running benchmark erc20.mint on 8 runners...
[2023-06-22T03:20:06Z DEBUG evm_bench::run] runners: revm, geth, evmone, ethereumjs, pyrevm, py-evm.cpython, py-evm.pypy, akula
[2023-06-22T03:20:06Z INFO  evm_bench::run] running benchmark erc20.mint on runner akula...
[2023-06-22T03:20:06Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-22T03:20:07Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:07Z TRACE evm_bench::run] stderr:    Compiling e2p-sys v0.1.0
       Compiling trust-dns-proto v0.22.0
       Compiling hashbrown v0.13.2
    error: failed to run custom build command for `e2p-sys v0.1.0`
    
    Caused by:
      process didn't exit successfully: `/home/kenun/ethsema/Artifact/evm-bench/runners/akula/target/production/build/e2p-sys-d487bab60a699c27/build-script-build` (exit status: 101)
      --- stdout
      cargo:rerun-if-env-changed=E2P_NO_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG
      cargo:rerun-if-env-changed=E2P_STATIC
      cargo:rerun-if-env-changed=E2P_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_STATIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_SYSROOT_DIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR
    
      --- stderr
      thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Error(PkgConfig(`PKG_CONFIG_ALLOW_SYSTEM_CFLAGS="1" PKG_CONFIG_ALLOW_SYSTEM_LIBS="1" "pkg-config" "--libs" "--cflags" "e2p" "e2p >= *"` did not exit successfully: exit status: 1
      error: could not find system library 'e2p' required by the 'e2p-sys' crate
    
      --- stderr
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      ), State { next_error: None })', /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/e2p-sys-0.1.0/build.rs:36:23
      note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    warning: build failed, waiting for other jobs to finish...
    error: failed to run custom build command for `e2p-sys v0.1.0`
    
    Caused by:
      process didn't exit successfully: `/home/kenun/ethsema/Artifact/evm-bench/runners/akula/target/production/build/e2p-sys-d487bab60a699c27/build-script-build` (exit status: 101)
      --- stdout
      cargo:rerun-if-env-changed=E2P_NO_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG
      cargo:rerun-if-env-changed=E2P_STATIC
      cargo:rerun-if-env-changed=E2P_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_STATIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_SYSROOT_DIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR
    
      --- stderr
      thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Error(PkgConfig(`PKG_CONFIG_ALLOW_SYSTEM_CFLAGS="1" PKG_CONFIG_ALLOW_SYSTEM_LIBS="1" "pkg-config" "--libs" "--cflags" "e2p" "e2p >= *"` did not exit successfully: exit status: 1
      error: could not find system library 'e2p' required by the 'e2p-sys' crate
    
      --- stderr
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      ), State { next_error: None })', /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/e2p-sys-0.1.0/build.rs:36:23
      note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:15:5
       |
    15 | /     feature(
    16 | |         test,
    17 | |         core_intrinsics,
    18 | |         dropck_eyepatch,
    ...  |
    25 | |         build_hasher_simple_hash_one
    26 | |     )
       | |_____^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:16:9
       |
    16 |         test,
       |         ^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:17:9
       |
    17 |         core_intrinsics,
       |         ^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:20:9
       |
    20 |         extend_one,
       |         ^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:21:9
       |
    21 |         allocator_api,
       |         ^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:22:9
       |
    22 |         slice_ptr_get,
       |         ^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:23:9
       |
    23 |         nonnull_slice_from_raw_parts,
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:24:9
       |
    24 |         maybe_uninit_array_assume_init,
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:25:9
       |
    25 |         build_hasher_simple_hash_one
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    For more information about this error, try `rustc --explain E0554`.
    error: could not compile `hashbrown` (lib) due to 9 previous errors
    error[E0592]: duplicate definitions with name `is_soa`
       --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/trust-dns-proto-0.22.0/src/rr/record_data.rs:55:17
        |
    55  | #[derive(Debug, EnumAsInner, PartialEq, Clone, Eq)]
        |                 ^^^^^^^^^^^ duplicate definitions for `is_soa`
    ...
    994 |     pub fn is_soa(&self) -> bool {
        |     ---------------------------- other definition for `is_soa`
        |
        = note: this error originates in the derive macro `EnumAsInner` (in Nightly builds, run with -Z macro-backtrace for more info)
    
    For more information about this error, try `rustc --explain E0592`.
    error: could not compile `trust-dns-proto` (lib) due to previous error
    
[2023-06-22T03:20:07Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner akula: exit status: 101
[2023-06-22T03:20:07Z INFO  evm_bench::run] running benchmark erc20.mint on runner ethereumjs...
[2023-06-22T03:20:07Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-22T03:20:08Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:08Z TRACE evm_bench::run] stderr: npm WARN read-shrinkwrap This version of npm is compatible with lockfileVersion@1, but package-lock.json was generated for lockfileVersion@3. I'll try to do my best with it!
    npm WARN runner-ethereumjs@ No description
    npm WARN runner-ethereumjs@ No repository field.
    npm WARN runner-ethereumjs@ No license field.
    
    npm ERR! code ENOENT
    npm ERR! syscall chmod
    npm ERR! path /home/kenun/ethsema/Artifact/evm-bench/runners/ethereumjs/node_modules/deno/try-deno
    npm ERR! errno -2
    npm ERR! enoent ENOENT: no such file or directory, chmod '/home/kenun/ethsema/Artifact/evm-bench/runners/ethereumjs/node_modules/deno/try-deno'
    npm ERR! enoent This is related to npm not being able to find a file.
    npm ERR! enoent 
    
    npm ERR! A complete log of this run can be found in:
    npm ERR!     /home/kenun/.npm/_logs/2023-06-22T03_20_08_476Z-debug.log
    
[2023-06-22T03:20:08Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner ethereumjs: exit status: 254
[2023-06-22T03:20:08Z INFO  evm_bench::run] running benchmark erc20.mint on runner evmone...
[2023-06-22T03:20:08Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-22T03:20:10Z TRACE evm_bench::run] stdout: 6.32278
    6.35035
    6.0591
    6.92042
    6.02641
    
[2023-06-22T03:20:10Z TRACE evm_bench::run] stderr: success
    success
    success
    success
    success
    success
    
[2023-06-22T03:20:10Z DEBUG evm_bench::run] ran benchmark erc20.mint on runner evmone
[2023-06-22T03:20:10Z INFO  evm_bench::run] running benchmark erc20.mint on runner geth...
[2023-06-22T03:20:10Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-22T03:20:10Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:10Z TRACE evm_bench::run] stderr: runner.go:9:2: cannot find package "github.com/ethereum/go-ethereum/common" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/common (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/common (from $GOPATH)
    runner.go:10:2: cannot find package "github.com/ethereum/go-ethereum/core" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core (from $GOPATH)
    runner.go:11:2: cannot find package "github.com/ethereum/go-ethereum/core/rawdb" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/rawdb (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/rawdb (from $GOPATH)
    runner.go:12:2: cannot find package "github.com/ethereum/go-ethereum/core/state" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/state (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/state (from $GOPATH)
    runner.go:13:2: cannot find package "github.com/ethereum/go-ethereum/core/types" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/types (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/types (from $GOPATH)
    runner.go:14:2: cannot find package "github.com/ethereum/go-ethereum/core/vm" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/vm (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/vm (from $GOPATH)
    runner.go:15:2: cannot find package "github.com/ethereum/go-ethereum/params" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/params (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/params (from $GOPATH)
    runner.go:16:2: cannot find package "github.com/spf13/cobra" in any of:
    	/usr/local/go/src/github.com/spf13/cobra (from $GOROOT)
    	/home/kenun/.go/src/github.com/spf13/cobra (from $GOPATH)
    
[2023-06-22T03:20:10Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner geth: exit status: 1
[2023-06-22T03:20:10Z INFO  evm_bench::run] running benchmark erc20.mint on runner py-evm.cpython...
[2023-06-22T03:20:10Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-22T03:20:11Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:11Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.8.10) is not supported by the project (^3.9).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:11Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner py-evm.cpython: exit status: 1
[2023-06-22T03:20:11Z INFO  evm_bench::run] running benchmark erc20.mint on runner py-evm.pypy...
[2023-06-22T03:20:11Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-22T03:20:11Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:11Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.6.9) is not supported by the project (^3.9).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:11Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner py-evm.pypy: exit status: 1
[2023-06-22T03:20:11Z INFO  evm_bench::run] running benchmark erc20.mint on runner pyrevm...
[2023-06-22T03:20:11Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-22T03:20:12Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:12Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.8.10) is not supported by the project (^3.10).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:12Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner pyrevm: exit status: 1
[2023-06-22T03:20:12Z INFO  evm_bench::run] running benchmark erc20.mint on runner revm...
[2023-06-22T03:20:12Z DEBUG evm_bench::run] running 5 times using code ERC20Mint.bin with calldata 30627b7c...
[2023-06-22T03:20:12Z TRACE evm_bench::run] stdout: 6.018
    5.497
    5.423
    5.549
    5.419
    
[2023-06-22T03:20:12Z TRACE evm_bench::run] stderr:     Finished release [optimized] target(s) in 0.04s
         Running `runners/revm/target/release/runner-revm --contract-code-path /home/kenun/ethsema/Artifact/evm-bench/outputs/build/erc20.mint/ERC20Mint.bin --calldata 30627b7c --num-runs 5`
    
[2023-06-22T03:20:12Z DEBUG evm_bench::run] ran benchmark erc20.mint on runner revm
[2023-06-22T03:20:12Z DEBUG evm_bench::run] ran benchmark erc20.mint on 8 runners (2 successful)
[2023-06-22T03:20:12Z INFO  evm_bench::run] running benchmark erc20.transfer on 8 runners...
[2023-06-22T03:20:12Z DEBUG evm_bench::run] runners: pyrevm, revm, ethereumjs, akula, evmone, py-evm.pypy, geth, py-evm.cpython
[2023-06-22T03:20:12Z INFO  evm_bench::run] running benchmark erc20.transfer on runner akula...
[2023-06-22T03:20:12Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-22T03:20:12Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:12Z TRACE evm_bench::run] stderr:    Compiling e2p-sys v0.1.0
       Compiling trust-dns-proto v0.22.0
       Compiling hashbrown v0.13.2
    error: failed to run custom build command for `e2p-sys v0.1.0`
    
    Caused by:
      process didn't exit successfully: `/home/kenun/ethsema/Artifact/evm-bench/runners/akula/target/production/build/e2p-sys-d487bab60a699c27/build-script-build` (exit status: 101)
      --- stdout
      cargo:rerun-if-env-changed=E2P_NO_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG
      cargo:rerun-if-env-changed=E2P_STATIC
      cargo:rerun-if-env-changed=E2P_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_STATIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_SYSROOT_DIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR
    
      --- stderr
      thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Error(PkgConfig(`PKG_CONFIG_ALLOW_SYSTEM_CFLAGS="1" PKG_CONFIG_ALLOW_SYSTEM_LIBS="1" "pkg-config" "--libs" "--cflags" "e2p" "e2p >= *"` did not exit successfully: exit status: 1
      error: could not find system library 'e2p' required by the 'e2p-sys' crate
    
      --- stderr
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      ), State { next_error: None })', /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/e2p-sys-0.1.0/build.rs:36:23
      note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    warning: build failed, waiting for other jobs to finish...
    error: failed to run custom build command for `e2p-sys v0.1.0`
    
    Caused by:
      process didn't exit successfully: `/home/kenun/ethsema/Artifact/evm-bench/runners/akula/target/production/build/e2p-sys-d487bab60a699c27/build-script-build` (exit status: 101)
      --- stdout
      cargo:rerun-if-env-changed=E2P_NO_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG
      cargo:rerun-if-env-changed=E2P_STATIC
      cargo:rerun-if-env-changed=E2P_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_STATIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_SYSROOT_DIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR
    
      --- stderr
      thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Error(PkgConfig(`PKG_CONFIG_ALLOW_SYSTEM_CFLAGS="1" PKG_CONFIG_ALLOW_SYSTEM_LIBS="1" "pkg-config" "--libs" "--cflags" "e2p" "e2p >= *"` did not exit successfully: exit status: 1
      error: could not find system library 'e2p' required by the 'e2p-sys' crate
    
      --- stderr
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      ), State { next_error: None })', /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/e2p-sys-0.1.0/build.rs:36:23
      note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:15:5
       |
    15 | /     feature(
    16 | |         test,
    17 | |         core_intrinsics,
    18 | |         dropck_eyepatch,
    ...  |
    25 | |         build_hasher_simple_hash_one
    26 | |     )
       | |_____^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:16:9
       |
    16 |         test,
       |         ^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:17:9
       |
    17 |         core_intrinsics,
       |         ^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:20:9
       |
    20 |         extend_one,
       |         ^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:21:9
       |
    21 |         allocator_api,
       |         ^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:22:9
       |
    22 |         slice_ptr_get,
       |         ^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:23:9
       |
    23 |         nonnull_slice_from_raw_parts,
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:24:9
       |
    24 |         maybe_uninit_array_assume_init,
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:25:9
       |
    25 |         build_hasher_simple_hash_one
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    For more information about this error, try `rustc --explain E0554`.
    error: could not compile `hashbrown` (lib) due to 9 previous errors
    error[E0592]: duplicate definitions with name `is_soa`
       --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/trust-dns-proto-0.22.0/src/rr/record_data.rs:55:17
        |
    55  | #[derive(Debug, EnumAsInner, PartialEq, Clone, Eq)]
        |                 ^^^^^^^^^^^ duplicate definitions for `is_soa`
    ...
    994 |     pub fn is_soa(&self) -> bool {
        |     ---------------------------- other definition for `is_soa`
        |
        = note: this error originates in the derive macro `EnumAsInner` (in Nightly builds, run with -Z macro-backtrace for more info)
    
    For more information about this error, try `rustc --explain E0592`.
    error: could not compile `trust-dns-proto` (lib) due to previous error
    
[2023-06-22T03:20:12Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner akula: exit status: 101
[2023-06-22T03:20:12Z INFO  evm_bench::run] running benchmark erc20.transfer on runner ethereumjs...
[2023-06-22T03:20:12Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-22T03:20:13Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:13Z TRACE evm_bench::run] stderr: npm WARN read-shrinkwrap This version of npm is compatible with lockfileVersion@1, but package-lock.json was generated for lockfileVersion@3. I'll try to do my best with it!
    npm WARN runner-ethereumjs@ No description
    npm WARN runner-ethereumjs@ No repository field.
    npm WARN runner-ethereumjs@ No license field.
    
    npm ERR! code ENOENT
    npm ERR! syscall chmod
    npm ERR! path /home/kenun/ethsema/Artifact/evm-bench/runners/ethereumjs/node_modules/deno/try-deno
    npm ERR! errno -2
    npm ERR! enoent ENOENT: no such file or directory, chmod '/home/kenun/ethsema/Artifact/evm-bench/runners/ethereumjs/node_modules/deno/try-deno'
    npm ERR! enoent This is related to npm not being able to find a file.
    npm ERR! enoent 
    
    npm ERR! A complete log of this run can be found in:
    npm ERR!     /home/kenun/.npm/_logs/2023-06-22T03_20_13_814Z-debug.log
    
[2023-06-22T03:20:13Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner ethereumjs: exit status: 254
[2023-06-22T03:20:13Z INFO  evm_bench::run] running benchmark erc20.transfer on runner evmone...
[2023-06-22T03:20:13Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-22T03:20:15Z TRACE evm_bench::run] stdout: 10.2328
    10.4109
    10.0438
    10.7353
    9.89038
    
[2023-06-22T03:20:15Z TRACE evm_bench::run] stderr: success
    success
    success
    success
    success
    success
    
[2023-06-22T03:20:15Z DEBUG evm_bench::run] ran benchmark erc20.transfer on runner evmone
[2023-06-22T03:20:15Z INFO  evm_bench::run] running benchmark erc20.transfer on runner geth...
[2023-06-22T03:20:15Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-22T03:20:15Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:15Z TRACE evm_bench::run] stderr: runner.go:9:2: cannot find package "github.com/ethereum/go-ethereum/common" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/common (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/common (from $GOPATH)
    runner.go:10:2: cannot find package "github.com/ethereum/go-ethereum/core" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core (from $GOPATH)
    runner.go:11:2: cannot find package "github.com/ethereum/go-ethereum/core/rawdb" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/rawdb (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/rawdb (from $GOPATH)
    runner.go:12:2: cannot find package "github.com/ethereum/go-ethereum/core/state" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/state (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/state (from $GOPATH)
    runner.go:13:2: cannot find package "github.com/ethereum/go-ethereum/core/types" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/types (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/types (from $GOPATH)
    runner.go:14:2: cannot find package "github.com/ethereum/go-ethereum/core/vm" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/vm (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/vm (from $GOPATH)
    runner.go:15:2: cannot find package "github.com/ethereum/go-ethereum/params" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/params (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/params (from $GOPATH)
    runner.go:16:2: cannot find package "github.com/spf13/cobra" in any of:
    	/usr/local/go/src/github.com/spf13/cobra (from $GOROOT)
    	/home/kenun/.go/src/github.com/spf13/cobra (from $GOPATH)
    
[2023-06-22T03:20:15Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner geth: exit status: 1
[2023-06-22T03:20:15Z INFO  evm_bench::run] running benchmark erc20.transfer on runner py-evm.cpython...
[2023-06-22T03:20:15Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-22T03:20:16Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:16Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.8.10) is not supported by the project (^3.9).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:16Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner py-evm.cpython: exit status: 1
[2023-06-22T03:20:16Z INFO  evm_bench::run] running benchmark erc20.transfer on runner py-evm.pypy...
[2023-06-22T03:20:16Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-22T03:20:16Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:16Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.6.9) is not supported by the project (^3.9).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:16Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner py-evm.pypy: exit status: 1
[2023-06-22T03:20:16Z INFO  evm_bench::run] running benchmark erc20.transfer on runner pyrevm...
[2023-06-22T03:20:16Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-22T03:20:17Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:17Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.8.10) is not supported by the project (^3.10).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:17Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner pyrevm: exit status: 1
[2023-06-22T03:20:17Z INFO  evm_bench::run] running benchmark erc20.transfer on runner revm...
[2023-06-22T03:20:17Z DEBUG evm_bench::run] running 5 times using code ERC20Transfer.bin with calldata 30627b7c...
[2023-06-22T03:20:17Z TRACE evm_bench::run] stdout: 16.702
    11.649
    11.773
    11.574
    11.584
    
[2023-06-22T03:20:17Z TRACE evm_bench::run] stderr:     Finished release [optimized] target(s) in 0.05s
         Running `runners/revm/target/release/runner-revm --contract-code-path /home/kenun/ethsema/Artifact/evm-bench/outputs/build/erc20.transfer/ERC20Transfer.bin --calldata 30627b7c --num-runs 5`
    
[2023-06-22T03:20:17Z DEBUG evm_bench::run] ran benchmark erc20.transfer on runner revm
[2023-06-22T03:20:17Z DEBUG evm_bench::run] ran benchmark erc20.transfer on 8 runners (2 successful)
[2023-06-22T03:20:17Z INFO  evm_bench::run] running benchmark snailtracer on 8 runners...
[2023-06-22T03:20:17Z DEBUG evm_bench::run] runners: revm, pyrevm, evmone, geth, py-evm.cpython, akula, ethereumjs, py-evm.pypy
[2023-06-22T03:20:17Z INFO  evm_bench::run] running benchmark snailtracer on runner akula...
[2023-06-22T03:20:17Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-22T03:20:17Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:17Z TRACE evm_bench::run] stderr:    Compiling e2p-sys v0.1.0
       Compiling trust-dns-proto v0.22.0
       Compiling hashbrown v0.13.2
    error: failed to run custom build command for `e2p-sys v0.1.0`
    
    Caused by:
      process didn't exit successfully: `/home/kenun/ethsema/Artifact/evm-bench/runners/akula/target/production/build/e2p-sys-d487bab60a699c27/build-script-build` (exit status: 101)
      --- stdout
      cargo:rerun-if-env-changed=E2P_NO_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG
      cargo:rerun-if-env-changed=E2P_STATIC
      cargo:rerun-if-env-changed=E2P_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_STATIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_SYSROOT_DIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR
    
      --- stderr
      thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Error(PkgConfig(`PKG_CONFIG_ALLOW_SYSTEM_CFLAGS="1" PKG_CONFIG_ALLOW_SYSTEM_LIBS="1" "pkg-config" "--libs" "--cflags" "e2p" "e2p >= *"` did not exit successfully: exit status: 1
      error: could not find system library 'e2p' required by the 'e2p-sys' crate
    
      --- stderr
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      ), State { next_error: None })', /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/e2p-sys-0.1.0/build.rs:36:23
      note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    warning: build failed, waiting for other jobs to finish...
    error: failed to run custom build command for `e2p-sys v0.1.0`
    
    Caused by:
      process didn't exit successfully: `/home/kenun/ethsema/Artifact/evm-bench/runners/akula/target/production/build/e2p-sys-d487bab60a699c27/build-script-build` (exit status: 101)
      --- stdout
      cargo:rerun-if-env-changed=E2P_NO_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG
      cargo:rerun-if-env-changed=E2P_STATIC
      cargo:rerun-if-env-changed=E2P_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_STATIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_SYSROOT_DIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR
    
      --- stderr
      thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Error(PkgConfig(`PKG_CONFIG_ALLOW_SYSTEM_CFLAGS="1" PKG_CONFIG_ALLOW_SYSTEM_LIBS="1" "pkg-config" "--libs" "--cflags" "e2p" "e2p >= *"` did not exit successfully: exit status: 1
      error: could not find system library 'e2p' required by the 'e2p-sys' crate
    
      --- stderr
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      ), State { next_error: None })', /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/e2p-sys-0.1.0/build.rs:36:23
      note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:15:5
       |
    15 | /     feature(
    16 | |         test,
    17 | |         core_intrinsics,
    18 | |         dropck_eyepatch,
    ...  |
    25 | |         build_hasher_simple_hash_one
    26 | |     )
       | |_____^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:16:9
       |
    16 |         test,
       |         ^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:17:9
       |
    17 |         core_intrinsics,
       |         ^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:20:9
       |
    20 |         extend_one,
       |         ^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:21:9
       |
    21 |         allocator_api,
       |         ^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:22:9
       |
    22 |         slice_ptr_get,
       |         ^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:23:9
       |
    23 |         nonnull_slice_from_raw_parts,
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:24:9
       |
    24 |         maybe_uninit_array_assume_init,
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:25:9
       |
    25 |         build_hasher_simple_hash_one
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    For more information about this error, try `rustc --explain E0554`.
    error: could not compile `hashbrown` (lib) due to 9 previous errors
    error[E0592]: duplicate definitions with name `is_soa`
       --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/trust-dns-proto-0.22.0/src/rr/record_data.rs:55:17
        |
    55  | #[derive(Debug, EnumAsInner, PartialEq, Clone, Eq)]
        |                 ^^^^^^^^^^^ duplicate definitions for `is_soa`
    ...
    994 |     pub fn is_soa(&self) -> bool {
        |     ---------------------------- other definition for `is_soa`
        |
        = note: this error originates in the derive macro `EnumAsInner` (in Nightly builds, run with -Z macro-backtrace for more info)
    
    For more information about this error, try `rustc --explain E0592`.
    error: could not compile `trust-dns-proto` (lib) due to previous error
    
[2023-06-22T03:20:17Z WARN  evm_bench::run] could not run benchmark snailtracer on runner akula: exit status: 101
[2023-06-22T03:20:17Z INFO  evm_bench::run] running benchmark snailtracer on runner ethereumjs...
[2023-06-22T03:20:17Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-22T03:20:18Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:18Z TRACE evm_bench::run] stderr: npm WARN read-shrinkwrap This version of npm is compatible with lockfileVersion@1, but package-lock.json was generated for lockfileVersion@3. I'll try to do my best with it!
    npm WARN runner-ethereumjs@ No description
    npm WARN runner-ethereumjs@ No repository field.
    npm WARN runner-ethereumjs@ No license field.
    
    npm ERR! code ENOENT
    npm ERR! syscall chmod
    npm ERR! path /home/kenun/ethsema/Artifact/evm-bench/runners/ethereumjs/node_modules/deno/try-deno
    npm ERR! errno -2
    npm ERR! enoent ENOENT: no such file or directory, chmod '/home/kenun/ethsema/Artifact/evm-bench/runners/ethereumjs/node_modules/deno/try-deno'
    npm ERR! enoent This is related to npm not being able to find a file.
    npm ERR! enoent 
    
    npm ERR! A complete log of this run can be found in:
    npm ERR!     /home/kenun/.npm/_logs/2023-06-22T03_20_18_862Z-debug.log
    
[2023-06-22T03:20:18Z WARN  evm_bench::run] could not run benchmark snailtracer on runner ethereumjs: exit status: 254
[2023-06-22T03:20:18Z INFO  evm_bench::run] running benchmark snailtracer on runner evmone...
[2023-06-22T03:20:18Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-22T03:20:20Z TRACE evm_bench::run] stdout: 57.7357
    
[2023-06-22T03:20:20Z TRACE evm_bench::run] stderr: success
    success
    
[2023-06-22T03:20:20Z DEBUG evm_bench::run] ran benchmark snailtracer on runner evmone
[2023-06-22T03:20:20Z INFO  evm_bench::run] running benchmark snailtracer on runner geth...
[2023-06-22T03:20:20Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-22T03:20:20Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:20Z TRACE evm_bench::run] stderr: runner.go:9:2: cannot find package "github.com/ethereum/go-ethereum/common" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/common (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/common (from $GOPATH)
    runner.go:10:2: cannot find package "github.com/ethereum/go-ethereum/core" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core (from $GOPATH)
    runner.go:11:2: cannot find package "github.com/ethereum/go-ethereum/core/rawdb" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/rawdb (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/rawdb (from $GOPATH)
    runner.go:12:2: cannot find package "github.com/ethereum/go-ethereum/core/state" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/state (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/state (from $GOPATH)
    runner.go:13:2: cannot find package "github.com/ethereum/go-ethereum/core/types" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/types (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/types (from $GOPATH)
    runner.go:14:2: cannot find package "github.com/ethereum/go-ethereum/core/vm" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/vm (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/vm (from $GOPATH)
    runner.go:15:2: cannot find package "github.com/ethereum/go-ethereum/params" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/params (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/params (from $GOPATH)
    runner.go:16:2: cannot find package "github.com/spf13/cobra" in any of:
    	/usr/local/go/src/github.com/spf13/cobra (from $GOROOT)
    	/home/kenun/.go/src/github.com/spf13/cobra (from $GOPATH)
    
[2023-06-22T03:20:20Z WARN  evm_bench::run] could not run benchmark snailtracer on runner geth: exit status: 1
[2023-06-22T03:20:20Z INFO  evm_bench::run] running benchmark snailtracer on runner py-evm.cpython...
[2023-06-22T03:20:20Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-22T03:20:21Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:21Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.8.10) is not supported by the project (^3.9).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:21Z WARN  evm_bench::run] could not run benchmark snailtracer on runner py-evm.cpython: exit status: 1
[2023-06-22T03:20:21Z INFO  evm_bench::run] running benchmark snailtracer on runner py-evm.pypy...
[2023-06-22T03:20:21Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-22T03:20:21Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:21Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.6.9) is not supported by the project (^3.9).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:21Z WARN  evm_bench::run] could not run benchmark snailtracer on runner py-evm.pypy: exit status: 1
[2023-06-22T03:20:21Z INFO  evm_bench::run] running benchmark snailtracer on runner pyrevm...
[2023-06-22T03:20:21Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-22T03:20:22Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:22Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.8.10) is not supported by the project (^3.10).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:22Z WARN  evm_bench::run] could not run benchmark snailtracer on runner pyrevm: exit status: 1
[2023-06-22T03:20:22Z INFO  evm_bench::run] running benchmark snailtracer on runner revm...
[2023-06-22T03:20:22Z DEBUG evm_bench::run] running 1 times using code SnailTracer.bin with calldata 30627b7c...
[2023-06-22T03:20:22Z TRACE evm_bench::run] stdout: 58.053
    
[2023-06-22T03:20:22Z TRACE evm_bench::run] stderr:     Finished release [optimized] target(s) in 0.04s
         Running `runners/revm/target/release/runner-revm --contract-code-path /home/kenun/ethsema/Artifact/evm-bench/outputs/build/snailtracer/SnailTracer.bin --calldata 30627b7c --num-runs 1`
    
[2023-06-22T03:20:22Z DEBUG evm_bench::run] ran benchmark snailtracer on runner revm
[2023-06-22T03:20:22Z DEBUG evm_bench::run] ran benchmark snailtracer on 8 runners (2 successful)
[2023-06-22T03:20:22Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on 8 runners...
[2023-06-22T03:20:22Z DEBUG evm_bench::run] runners: akula, ethereumjs, evmone, pyrevm, revm, py-evm.pypy, py-evm.cpython, geth
[2023-06-22T03:20:22Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner akula...
[2023-06-22T03:20:22Z DEBUG evm_bench::run] running 5 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-22T03:20:22Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:22Z TRACE evm_bench::run] stderr:    Compiling e2p-sys v0.1.0
       Compiling trust-dns-proto v0.22.0
       Compiling hashbrown v0.13.2
    error: failed to run custom build command for `e2p-sys v0.1.0`
    
    Caused by:
      process didn't exit successfully: `/home/kenun/ethsema/Artifact/evm-bench/runners/akula/target/production/build/e2p-sys-d487bab60a699c27/build-script-build` (exit status: 101)
      --- stdout
      cargo:rerun-if-env-changed=E2P_NO_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG
      cargo:rerun-if-env-changed=E2P_STATIC
      cargo:rerun-if-env-changed=E2P_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_STATIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_SYSROOT_DIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR
    
      --- stderr
      thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Error(PkgConfig(`PKG_CONFIG_ALLOW_SYSTEM_CFLAGS="1" PKG_CONFIG_ALLOW_SYSTEM_LIBS="1" "pkg-config" "--libs" "--cflags" "e2p" "e2p >= *"` did not exit successfully: exit status: 1
      error: could not find system library 'e2p' required by the 'e2p-sys' crate
    
      --- stderr
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      ), State { next_error: None })', /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/e2p-sys-0.1.0/build.rs:36:23
      note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    warning: build failed, waiting for other jobs to finish...
    error: failed to run custom build command for `e2p-sys v0.1.0`
    
    Caused by:
      process didn't exit successfully: `/home/kenun/ethsema/Artifact/evm-bench/runners/akula/target/production/build/e2p-sys-d487bab60a699c27/build-script-build` (exit status: 101)
      --- stdout
      cargo:rerun-if-env-changed=E2P_NO_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG
      cargo:rerun-if-env-changed=PKG_CONFIG
      cargo:rerun-if-env-changed=E2P_STATIC
      cargo:rerun-if-env-changed=E2P_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_STATIC
      cargo:rerun-if-env-changed=PKG_CONFIG_ALL_DYNAMIC
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_PATH
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_LIBDIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64-unknown-linux-gnu
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR_x86_64_unknown_linux_gnu
      cargo:rerun-if-env-changed=HOST_PKG_CONFIG_SYSROOT_DIR
      cargo:rerun-if-env-changed=PKG_CONFIG_SYSROOT_DIR
    
      --- stderr
      thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: Error(PkgConfig(`PKG_CONFIG_ALLOW_SYSTEM_CFLAGS="1" PKG_CONFIG_ALLOW_SYSTEM_LIBS="1" "pkg-config" "--libs" "--cflags" "e2p" "e2p >= *"` did not exit successfully: exit status: 1
      error: could not find system library 'e2p' required by the 'e2p-sys' crate
    
      --- stderr
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      Package e2p was not found in the pkg-config search path.
      Perhaps you should add the directory containing `e2p.pc'
      to the PKG_CONFIG_PATH environment variable
      No package 'e2p' found
      ), State { next_error: None })', /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/e2p-sys-0.1.0/build.rs:36:23
      note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:15:5
       |
    15 | /     feature(
    16 | |         test,
    17 | |         core_intrinsics,
    18 | |         dropck_eyepatch,
    ...  |
    25 | |         build_hasher_simple_hash_one
    26 | |     )
       | |_____^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:16:9
       |
    16 |         test,
       |         ^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:17:9
       |
    17 |         core_intrinsics,
       |         ^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:20:9
       |
    20 |         extend_one,
       |         ^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:21:9
       |
    21 |         allocator_api,
       |         ^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:22:9
       |
    22 |         slice_ptr_get,
       |         ^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:23:9
       |
    23 |         nonnull_slice_from_raw_parts,
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:24:9
       |
    24 |         maybe_uninit_array_assume_init,
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    error[E0554]: `#![feature]` may not be used on the stable release channel
      --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/hashbrown-0.13.2/src/lib.rs:25:9
       |
    25 |         build_hasher_simple_hash_one
       |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    
    For more information about this error, try `rustc --explain E0554`.
    error: could not compile `hashbrown` (lib) due to 9 previous errors
    error[E0592]: duplicate definitions with name `is_soa`
       --> /home/kenun/.cargo/registry/src/index.crates.io-6f17d22bba15001f/trust-dns-proto-0.22.0/src/rr/record_data.rs:55:17
        |
    55  | #[derive(Debug, EnumAsInner, PartialEq, Clone, Eq)]
        |                 ^^^^^^^^^^^ duplicate definitions for `is_soa`
    ...
    994 |     pub fn is_soa(&self) -> bool {
        |     ---------------------------- other definition for `is_soa`
        |
        = note: this error originates in the derive macro `EnumAsInner` (in Nightly builds, run with -Z macro-backtrace for more info)
    
    For more information about this error, try `rustc --explain E0592`.
    error: could not compile `trust-dns-proto` (lib) due to previous error
    
[2023-06-22T03:20:22Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner akula: exit status: 101
[2023-06-22T03:20:22Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner ethereumjs...
[2023-06-22T03:20:22Z DEBUG evm_bench::run] running 5 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-22T03:20:24Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:24Z TRACE evm_bench::run] stderr: npm WARN read-shrinkwrap This version of npm is compatible with lockfileVersion@1, but package-lock.json was generated for lockfileVersion@3. I'll try to do my best with it!
    npm WARN runner-ethereumjs@ No description
    npm WARN runner-ethereumjs@ No repository field.
    npm WARN runner-ethereumjs@ No license field.
    
    npm ERR! code ENOENT
    npm ERR! syscall chmod
    npm ERR! path /home/kenun/ethsema/Artifact/evm-bench/runners/ethereumjs/node_modules/deno/try-deno
    npm ERR! errno -2
    npm ERR! enoent ENOENT: no such file or directory, chmod '/home/kenun/ethsema/Artifact/evm-bench/runners/ethereumjs/node_modules/deno/try-deno'
    npm ERR! enoent This is related to npm not being able to find a file.
    npm ERR! enoent 
    
    npm ERR! A complete log of this run can be found in:
    npm ERR!     /home/kenun/.npm/_logs/2023-06-22T03_20_23_962Z-debug.log
    
[2023-06-22T03:20:24Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner ethereumjs: exit status: 254
[2023-06-22T03:20:24Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner evmone...
[2023-06-22T03:20:24Z DEBUG evm_bench::run] running 5 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-22T03:20:25Z TRACE evm_bench::run] stdout: 2.82827
    2.67099
    2.28523
    2.24101
    2.25478
    
[2023-06-22T03:20:25Z TRACE evm_bench::run] stderr: success
    success
    success
    success
    success
    success
    
[2023-06-22T03:20:25Z DEBUG evm_bench::run] ran benchmark ten-thousand-hashes on runner evmone
[2023-06-22T03:20:25Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner geth...
[2023-06-22T03:20:25Z DEBUG evm_bench::run] running 5 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-22T03:20:25Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:25Z TRACE evm_bench::run] stderr: runner.go:9:2: cannot find package "github.com/ethereum/go-ethereum/common" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/common (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/common (from $GOPATH)
    runner.go:10:2: cannot find package "github.com/ethereum/go-ethereum/core" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core (from $GOPATH)
    runner.go:11:2: cannot find package "github.com/ethereum/go-ethereum/core/rawdb" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/rawdb (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/rawdb (from $GOPATH)
    runner.go:12:2: cannot find package "github.com/ethereum/go-ethereum/core/state" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/state (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/state (from $GOPATH)
    runner.go:13:2: cannot find package "github.com/ethereum/go-ethereum/core/types" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/types (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/types (from $GOPATH)
    runner.go:14:2: cannot find package "github.com/ethereum/go-ethereum/core/vm" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/core/vm (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/core/vm (from $GOPATH)
    runner.go:15:2: cannot find package "github.com/ethereum/go-ethereum/params" in any of:
    	/usr/local/go/src/github.com/ethereum/go-ethereum/params (from $GOROOT)
    	/home/kenun/.go/src/github.com/ethereum/go-ethereum/params (from $GOPATH)
    runner.go:16:2: cannot find package "github.com/spf13/cobra" in any of:
    	/usr/local/go/src/github.com/spf13/cobra (from $GOROOT)
    	/home/kenun/.go/src/github.com/spf13/cobra (from $GOPATH)
    
[2023-06-22T03:20:25Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner geth: exit status: 1
[2023-06-22T03:20:25Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner py-evm.cpython...
[2023-06-22T03:20:25Z DEBUG evm_bench::run] running 5 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-22T03:20:26Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:26Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.8.10) is not supported by the project (^3.9).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:26Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner py-evm.cpython: exit status: 1
[2023-06-22T03:20:26Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner py-evm.pypy...
[2023-06-22T03:20:26Z DEBUG evm_bench::run] running 5 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-22T03:20:26Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:26Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.6.9) is not supported by the project (^3.9).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:26Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner py-evm.pypy: exit status: 1
[2023-06-22T03:20:26Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner pyrevm...
[2023-06-22T03:20:26Z DEBUG evm_bench::run] running 5 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-22T03:20:27Z TRACE evm_bench::run] stdout: 
[2023-06-22T03:20:27Z TRACE evm_bench::run] stderr: 
    The specified Python version (3.8.10) is not supported by the project (^3.10).
    Please choose a compatible version or loosen the python constraint specified in the pyproject.toml file.
    
[2023-06-22T03:20:27Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner pyrevm: exit status: 1
[2023-06-22T03:20:27Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner revm...
[2023-06-22T03:20:27Z DEBUG evm_bench::run] running 5 times using code TenThousandHashes.bin with calldata 30627b7c...
[2023-06-22T03:20:27Z TRACE evm_bench::run] stdout: 4.647
    4.434
    3.966
    3.969
    4.036
    
[2023-06-22T03:20:27Z TRACE evm_bench::run] stderr:     Finished release [optimized] target(s) in 0.04s
         Running `runners/revm/target/release/runner-revm --contract-code-path /home/kenun/ethsema/Artifact/evm-bench/outputs/build/ten-thousand-hashes/TenThousandHashes.bin --calldata 30627b7c --num-runs 5`
    
[2023-06-22T03:20:27Z DEBUG evm_bench::run] ran benchmark ten-thousand-hashes on runner revm
[2023-06-22T03:20:27Z DEBUG evm_bench::run] ran benchmark ten-thousand-hashes on 8 runners (2 successful)
[2023-06-22T03:20:27Z DEBUG evm_bench::run] ran 5 benchmarks (5 successful)
[2023-06-22T03:20:27Z DEBUG evm_bench::results] writing all results out...
[2023-06-22T03:20:27Z INFO  evm_bench::results] wrote out results to /home/kenun/ethsema/Artifact/evm-bench/outputs/results/2023-06-22T03:20:27.289740628+00:00.evm-bench.results.json
[2023-06-22T03:20:27Z INFO  evm_bench::results] reading and parsing results from /home/kenun/ethsema/Artifact/evm-bench/outputs/results/2023-06-22T03:20:27.289740628+00:00.evm-bench.results.json...
[2023-06-22T03:20:27Z DEBUG evm_bench::results] read and parsed results from /home/kenun/ethsema/Artifact/evm-bench/outputs/results/2023-06-22T03:20:27.289740628+00:00.evm-bench.results.json
|                         | evmone | revm   |
|-------------------------|--------|--------|
| **sum**                 | 84.8ms | 90.8ms |
| **relative**            | 1.000x | 1.071x |
| erc20.approval-transfer | 8ms    | 10.2ms |
| erc20.mint              | 6.2ms  | 5.4ms  |
| erc20.transfer          | 10.2ms | 13ms   |
| snailtracer             | 58ms   | 58ms   |
| ten-thousand-hashes     | 2.4ms  | 4.2ms  |

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ziyadedher ziyadedher

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@valo @ziyadedher @Kenun99