invalid merkle root issues persists even after reboot

[texanraj]

I've been running on mainnet for several weeks and all of a sudden I get this issue with invalid merkle root. I'm really hosed with my Geth client and need some help. I saw this prior post (#23531) and rebooted to see if it helps. Nada!

System information

Your Smartnode is currently using the Ethereum Mainnet.

Rocket Pool client version: 1.0.0-pre4
Rocket Pool service version: 1.0.0-pre4
Selected Eth 1.0 client: Geth (ethereum/client-go:v1.10.11)
Selected Eth 2.0 client: Prysm (prysmaticlabs/prysm-beacon-chain:HEAD-a80b1c-debug)

Geth version: 1.10.11
OS & Version: Ubuntu 20.04

Steps to reproduce the behaviour

Run Geth 1.10.11

Logs

eth1_1           | Error: invalid merkle root (remote: 83c468f39876d438e346644efc8f2aa93622ec612ff5c83347e3d63936e74462 local: fca2f9c7a46da755c75282c7d2fb5834797e58a8097e839be2c52de0ec2e124b)
eth1_1           | ##############################
eth1_1           |
eth1_1           | WARN [11-06|21:42:29.319] Synchronisation failed, dropping peer    peer=bbab4bc87fbc0c88592b24e26a664a21175089adc6593cd320be8f3ae9d17c9a err="retrieved hash chain is invalid: invalid merkle root (remote: 83c468f39876d438e346644efc8f2aa93622ec612ff5c83347e3d63936e74462 local: fca2f9c7a46da755c75282c7d2fb5834797e58a8097e839be2c52de0ec2e124b)"
eth1_1           | INFO [11-06|21:42:33.378] Looking for peers                        peercount=0 tried=32 static=0
eth1_1           | INFO [11-06|21:42:43.737] Looking for peers                        peercount=0 tried=32 static=0
....

**When it starts up it is fine but then I get the above invalid merkle error within a few mintues...**

eth1_1           | INFO [11-06|21:52:51.457] Starting Geth on Ethereum mainnet...
eth1_1           | INFO [11-06|21:52:51.457] Bumping default cache on mainnet         provided=1024 updated=4096
eth1_1           | INFO [11-06|21:52:51.461] Maximum peer count                       ETH=50 LES=0 total=50
eth1_1           | INFO [11-06|21:52:51.461] Smartcard socket not found, disabling    err="stat /run/pcscd/pcscd.comm: no such file or directory"
eth1_1           | INFO [11-06|21:52:51.462] Set global gas cap                       cap=50,000,000
eth1_1           | INFO [11-06|21:52:51.484] Allocated trie memory caches             clean=614.00MiB dirty=1024.00MiB
eth1_1           | INFO [11-06|21:52:51.484] Allocated cache and file handles         database=/ethclient/geth/geth/chaindata cache=2.00GiB handles=524,288
eth1_1           | INFO [11-06|21:52:53.381] Opened ancient database                  database=/ethclient/geth/geth/chaindata/ancient readonly=false
eth1_1           | INFO [11-06|21:52:53.824] Persisted trie from memory database      nodes=12356 size=1.78MiB time=72.341905ms gcnodes=0 gcsize=0.00B gctime=0s livenodes=1 livesize=0.00B
eth1_1           | INFO [11-06|21:52:53.829] Initialised chain configuration          config="{ChainID: 1 Homestead: 1150000 DAO: 1920000 DAOSupport: true EIP150: 2463000 EIP155: 2675000 EIP158: 2675000 Byzantium: 4370000 Constantinople: 7280000 Petersburg: 7280000 Istanbul: 9069000, Muir Glacier: 9200000, Berlin: 12244000, London: 12965000, Engine: ethash}"
eth1_1           | INFO [11-06|21:52:54.671] Disk storage enabled for ethash caches   dir=/ethclient/geth/geth/ethash count=3
eth1_1           | INFO [11-06|21:52:54.671] Disk storage enabled for ethash DAGs     dir=/root/.ethash               count=2
eth1_1           | INFO [11-06|21:52:54.672] Initialising Ethereum protocol           network=1 dbversion=8
eth1_1           | INFO [11-06|21:52:56.192] Loaded most recent local header          number=13,514,138 hash=518355..17b1f9 td=33,358,052,461,745,838,605,537 age=1w1d1h
eth1_1           | INFO [11-06|21:52:56.192] Loaded most recent local full block      number=13,514,138 hash=518355..17b1f9 td=33,358,052,461,745,838,605,537 age=1w1d1h
eth1_1           | INFO [11-06|21:52:56.192] Loaded most recent local fast block      number=13,514,138 hash=518355..17b1f9 td=33,358,052,461,745,838,605,537 age=1w1d1h
eth1_1           | INFO [11-06|21:52:56.192] Loaded last fast-sync pivot marker       number=13,414,302
eth1_1           | INFO [11-06|21:52:56.205] Resuming state snapshot generation       root=6bee2b..7b4fff in=d1e7d3..7b4049 at=290dec..f3e563 accounts=124,977,580 slots=438,511,638 storage=37.15GiB elapsed="137.778µs"
eth1_1           | INFO [11-06|21:52:56.213] Trie missing, state snapshotting paused  root=6bee2b..7b4fff in=d1e7d3..7b4049 at=290dec..f3e563 accounts=124,977,585 slots=438,511,642 storage=37.15GiB elapsed=8.684ms
eth1_1           | INFO [11-06|21:52:56.213] Loaded local transaction journal         transactions=0 dropped=0
eth1_1           | INFO [11-06|21:52:56.213] Regenerated local transaction journal    transactions=0 accounts=0
eth1_1           | WARN [11-06|21:52:56.213] Switch sync mode from fast sync to full sync
eth1_1           | INFO [11-06|21:52:56.214] Gasprice oracle is ignoring threshold set threshold=2
eth1_1           | WARN [11-06|21:52:56.216] Unclean shutdown detected                booted=2021-10-31T14:03:37+0000 age=6d7h49m
eth1_1           | WARN [11-06|21:52:56.216] Unclean shutdown detected                booted=2021-11-01T05:00:29+0000 age=5d16h52m
eth1_1           | WARN [11-06|21:52:56.216] Unclean shutdown detected                booted=2021-11-06T21:30:20+0000 age=22m36s
eth1_1           | WARN [11-06|21:52:56.216] Unclean shutdown detected                booted=2021-11-06T21:41:32+0000 age=11m24s
eth1_1           | INFO [11-06|21:52:56.216] Starting peer-to-peer node               instance=Geth/v1.10.11-stable-7231b3ef/linux-amd64/go1.17.2
eth1_1           | INFO [11-06|21:52:56.343] New local node record                    seq=19 id=56d89104037cae25 ip=127.0.0.1 udp=30303 tcp=30303
eth1_1           | INFO [11-06|21:52:56.345] IPC endpoint opened                      url=/ethclient/geth/geth.ipc
eth1_1           | INFO [11-06|21:52:56.345] HTTP server started                      endpoint=[::]:8545 prefix= cors= vhosts=*
eth1_1           | INFO [11-06|21:52:56.345] WebSocket enabled                        url=ws://[::]:8546
eth1_1           | INFO [11-06|21:52:56.347] Started P2P networking                   self=enode://7898c930b42a3044a7ee3b00b7fc10a6d82d0c98482bb66856e8f76f03089c68d3eed7d7483bf5944a2ae9735debe3f44444083d0c66b210db1e4891a1cd2020@127.0.0.1:30303
eth1_1           | INFO [11-06|21:53:06.646] New local node record                    seq=20 id=56d89104037cae25 ip=73.155.212.118 udp=30303 tcp=30303
eth1_1           | INFO [11-06|21:53:06.945] Looking for peers                        peercount=0 tried=27 static=0
eth1_1           | INFO [11-06|21:53:16.945] Looking for peers                        peercount=0 tried=21 static=0
eth1_1           | INFO [11-06|21:53:27.946] Looking for peers                        peercount=0 tried=26 static=0
eth1_1           | INFO [11-06|21:53:38.322] Looking for peers                        peercount=0 tried=21 static=0

[karalabe]

Did you node crash before? Were you still generating the snapshot?

Answering my question above, seems you indeed were still generating the snapshot and did crash.

So, my guess is that the snapshot is fried. We did fix an issue in the last release 2 weeks ago, unsure if you were running with that or an older version when the problem happened. Either way, what you can try to do is "nuke" Geth's snapshot acceleration structure and have Geth regenerate it (will be fast-ish until it reaches the current progress).

To do that, you should stop Geth and run geth db delete 0x536e617073686f74526f6f74 (potentially adding any --datadir flag you might be running with). This will delete a small metadata item that signals to Geth what the snapshot's root is. Without this item, the snapshot cannot be used, so Geth will regenerate it, reusing all the current data (verifying and fixing any issues along the way).

[plasticalligator]

wow, this all issue instills so much hope and faith into ethereum, the developers here clearly know exactly what they're doing and this is definitely not a half-baked project by a bunch of people who are constantly breaking core features by just gaze alone like some sort of techno-medusa whose mere proximity guarantees catastrophic failure.

[opsidao]

I'm getting a similar issue here on 1.10.15 (it actually started on 1.10.14).

I have tried to db delete SnapshotRoot combined with debug.setHead to a previous block (like 1000 blocks earlier), but as soon as it gets to this one, it fails:

########## BAD BLOCK #########
Chain config: {ChainID: 1 Homestead: 1150000 DAO: 1920000 DAOSupport: true EIP150: 2463000 EIP155: 2675000 EIP158: 2675000 Byzantium: 4370000 Constantinople: 7280000 Petersburg: 7280000 Istanbul: 9069000, Muir Glacier: 9200000, Berlin: 12244000, London: 12965000, Arrow Glacier: 13773000, MergeFork: <nil>, Engine: ethash}

Number: 14093238
Hash: 0xc4f0fcbd67fb66a59989b68f6ebad105790c31cbc8038985fba166762972a310
         0: cumulative: 229559 gas: 229559 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xfc077af753848b54e701396b7758629976f3e60990630dfb8bff60f0c4f3f2ed logs: [0xc0667d0210 0xc000158370 0xc000158580 0xc000158630 0xc0004536b0 0xc000453760 0xc000453810 0xc0004538c0 0xc0667d02c0 0xc0667d0370 0xc0001586e0 0xc000158790 0xc000158840] bloom: 0020000000000000000000008000000000000000000000002000000020000400000000000040000080008000000000000a000000080000000000000000000000000000000000000000000008000000201080000000000400000000000000000000008000020030000000000000000800040000000008000000000010000200000000000880000000000000000000000000000000000000280000004020000002000000000000000000000001010000000000000000200000000000000000000000000002000000000000000000000000200000000000001000000200000460000000210000000000000000000000000000000000400004000000400000000000 state:
         1: cumulative: 250559 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x0cc12ec366d56568fcedfb1512ea40dcd98b4fdbdbaf5518a2b61c14053476a7 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         2: cumulative: 297262 gas: 46703 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x0c1db42e794a5fd4bf30f0b49560bdf9ddf815916cf57a077ee65e3b11e667e7 logs: [0xc0006ac580] bloom: 00000000000000000000000000000000000000000000000000000800000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000000000000400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000400000000200000000000000000000000000000200820000000000000000000000000000200000000000000000000000000 state:
         3: cumulative: 479314 gas: 182052 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x4419affdae49d27e44681edfde9ab0c3a6d2da63c64e23ceb16b6ae88f2dfe81 logs: [0xc0667d0420 0xc0667d04d0 0xc0667d0580 0xc0667d0630] bloom: 00000000000000000000000000004004000000000000000000000000000000001000000000000000000002000000000002000000085000000000000000000000000000000000000000000108000020800000000000000000000000008000000000004000002000000000100000000000000000400000000000000010000000000000000000000000000000400000000200000001000000002000000000000100040000000000000000000000000000000000000000002000000100000000004100000002000000000100000000080000002000000000000000000000001000000004200000020000000000000004000004000000000000400000000000000000 state:
         4: cumulative: 500314 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xdd21186665ed39e2ba949506cac67fd44a67906f4c99513801e48e04b1c7c928 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         5: cumulative: 521314 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x3fb37f197af90a10342e8486922fd2af25fb2d71f4c6e5d86f2973ad0e810748 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         6: cumulative: 562623 gas: 41309 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x9b6233301c527e77fdc36fe0208b78c584fd68264a052640ef09b06197c83d2e logs: [0xc05fca8000] bloom: 00000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000010000000000400000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000100000000000000000000000000080000000000000000000000000000000000000000040000002000000000000000000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000040000000000020 state:
         7: cumulative: 583623 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x3b46d2d1746d164de60507821b95b4984d9ee999522161787133ef2aff67e5f8 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         8: cumulative: 604623 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xcfa1891e4a45de83247061a8023befb23c3efd72685359954f04f261cb873982 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         9: cumulative: 625623 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x66652870bc8e9850fc86ea069f63a3eba1e3a764760ae145ca76efbd40a77ac0 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         10: cumulative: 646623 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x38f46cd24c6daed1dd3208ecf12482f99a948b2a175ba08cdc52ee642e4a1168 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         11: cumulative: 712248 gas: 65625 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x9b92ea09f727905a7a827484454a76b26c79f8e8b03cb2f74f9886699477597c logs: [0xc05fca8210] bloom: 00000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000008000008000000000000020000000000000000000000000000000000000000000100000000000000000000000000000000000010000000000000000000000000000000000000000000000000010000000000000000000000000000000000200000000000000000000000000000000000000000000000000000000002000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000800000000000000000000020 state:
         12: cumulative: 758357 gas: 46109 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x2b40de10ba04afa505eac481070aa93cb7659704852b87ae9462db8fbe5571aa logs: [0xc0667d08f0] bloom: 00004000200000000000000000000000000000000000000000000000000000000000000000000000000000000000014000000000000000000000000000000000000000000004000000000008000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000100000000000000000000000000080000000000000000000000000000000000000000000000002000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         13: cumulative: 793610 gas: 35253 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xee18e855b0c82c628c5d807e0d0137dd02e2ac00577d646bf413ca5df31acd7b logs: [0xc0667d09a0] bloom: 00000000000020000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000001000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000002000000000000000000000000000000000000000000000000000000000000000000000400000000000000000400000000000000000000000000000000002000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000800000 state:
         14: cumulative: 856819 gas: 63209 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x9f45f168bf7820d62dc4cff00156baf40868a69db67638ae4c58eb17c28c25ac logs: [0xc05b3ee000] bloom: 00000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000010000001000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000100000000000000000000008000080080000000000000000000000000100000000000000002002000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         15: cumulative: 898128 gas: 41309 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xcf607530ac9a6100853a193d51f9e169cbf11596d1e04c0a12070734d3ddfe51 logs: [0xc000453970] bloom: 00000000000000400000000000000000000000000000000000000000000000000000020000000000000000000000010000000000000000000000000000000000000000000000000000000008000000000000000040000000000000000000000001000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000100000000000000000000000000080000000000000000000000000000000000000000000000002000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000 state:
         16: cumulative: 919128 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x45c4283241344d0cbf05d6281922c1e6fcc647a4b8c21c2131ca19a40dbb16b3 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         17: cumulative: 948751 gas: 29623 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x205a16cd71b445d8b1213269d883383dd9c6047fbe021ef51f10d385c7c642b0 logs: [0xc000453a20] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000008000000000000000000200000000000000000000000000000080200000000000000000000000000000000000002000010000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000800000000000000000000000000000020000000000000002000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         18: cumulative: 1000425 gas: 51674 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x74da4ed0e6f09a2af9e1d8f35f5ca2870136c217bb926da493112c959d93ca09 logs: [0xc05b3ee0b0] bloom: 00000000000000000000000000000000000000000000000000000200000000000000000000000000001000000001000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000800000000000000000040000000000000000000000000002000000000000000080000000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000010000000000000000000000000 state:
         19: cumulative: 1107574 gas: 107149 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x07d46eff4b0ba69e5977f3745d70888081d68f0cb04a230cef3d2bfa78365696 logs: [0xc0667d0b00 0xc0667d0bb0] bloom: 00000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000008010000000000000000000000000000000010000000000000000000000000000000020000000000000080000000000010000000000000000000000000000000004000000040000000000000000000004000100000000000000000001000000080000000000400000000000000000000000000000000000002000000000000000000081000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         20: cumulative: 1314065 gas: 206491 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xf9d0bd550e183c61d0590cc2a24ef34024bb3c3f599eb45b73726e325e934ca8 logs: [0xc000453b80 0xc000453c30 0xc000453ce0 0xc000453d90 0xc06e47e000 0xc06e47e0b0] bloom: 00000000000000008000800000000000000000000000000000000000000000000000000000040100000000000000000000000000000080000000000000000000000000000000000000000008000000000400000000000000000000000000000000000000000000000000000000000080000000000000000100000410000000000000000000000000000201000000000000000000000000000000000000000000000000000000000000000000000000000400000000000000000000000000000000000002000000000000000000000000004000000000000808000000000020000000000000000000800000200000000000000000000000002000000000208000 state:
         21: cumulative: 1335065 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xa863d9454844e76ee9dce42a7fdc608587cab55e3e16508b5f57ba406e9a357d logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         22: cumulative: 1383602 gas: 48537 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xd9ca143582a136a809d11cbd3f0cd205c614f53f9561127033ad410327155a00 logs: [0xc06e47e210] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000100000000000000000000000000000008000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000050000000000000000000000000000000000002000000000000010000000000000000000000000000000080200000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000020000000000010000000000000000000000000000000000000000000000000000000000000000000000000 state:
         23: cumulative: 1429711 gas: 46109 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x25d245ee68acbf0cca15024efa7090a9006d81b200177194c2776f1b001782cc logs: [0xc06e47e2c0] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000800000000000000000000000000000000000000000000000000000000000010000000000000000000000000000800000000000000000000000000100000000000100000000000000000000000000080000000000000000000000000000000000000000000000002000000000000000000000000000000040000000400000000000000000000001000000000000000000000000000000000000000000000000000000000 state:
         24: cumulative: 1450711 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xc73fa8f28742eeecf6c2d7ab99e62a8da4e11bb960f907afff0fc8025f371804 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         25: cumulative: 1471711 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xff4eb18ffa99c6cae5996a7e4c0675083b3fab93426107c6f5dcbc98822ffc3a logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         26: cumulative: 1492711 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x800ec62a5bccb01b4df02377c8d613e760aab68594b24c1b8bc8439698e2b115 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         27: cumulative: 1513711 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x357d35107d83574aac9ce89303b3a5d6b6e76cc9ee246f37d17436cd15ffc52a logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         28: cumulative: 1572114 gas: 58403 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x4367781de86aac9723b23e0784cef421ba146e6d2cc5b293f1cecac311b77480 logs: [0xc06ecfe000] bloom: 08000000000000000000000000000000100000014000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000010000000000000000000040000008000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000002000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         29: cumulative: 1593114 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x411fb0169e4de78c79796f0343cb68e9986983a5ad756f1dc3574a066dede350 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         30: cumulative: 1614114 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x6589e9559907106c48e263f8b548b6fa0f18f10bb95eaf9c60b7f49945c5ae45 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         31: cumulative: 1635114 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x820947c5896543e49dc856db54b206c91ddc4f42a9d1dc1bbc716fe0a59b9dfb logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         32: cumulative: 1749788 gas: 114674 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x03b45c706f8eb52807105d48fdb81e8ea1b581a948276004a76b19cbdaa0e856 logs: [0xc06e47e370 0xc06e47e420 0xc06e47e4d0 0xc06e47e580] bloom: 00000100002000000020000000000000000000000000000000000000000000000000000000000000000000000000000002000000080020000000000000000000000000000000000800000008000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000010000800000000000080000000000800000000000000000001000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000002000000000100000000000000080000000000000000000100000000000000200020000800000000000040080000000000000000500000000000000001 state:
         33: cumulative: 1799826 gas: 50038 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x43add67b40b7b68e0b11bee68de12eb09e270630993d5795949a2ee012e196d3 logs: [0xc06e47e790 0xc06e47e840] bloom: 000000000000000000000000000000000000400000000000001002000000000000000000000000000000000000000000000000400000000000000000002000000000000000000000000000080000000000000000002000000000000080000000000000000a0000000000000000000800000000000000000000000010000000000000000000000000000000000000040000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000002000000000000000080000000000000000000000000000000000020000010000000000000000000000200000000000000000000000100000000000010 state:
         34: cumulative: 1829845 gas: 30019 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x42777dbe97aed719b2ea1c6815d0ee8e0168060f09c8789c5e700f3f792f4085 logs: [0xc06e47e9a0] bloom: 00200000200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000008000000100000400000000000000000000000000000000000000000000000000000000000000000000420000000000000000000000000000000002000000400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000100000000000000000000000 state:
         35: cumulative: 1895482 gas: 65637 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xec41882b00b3b8db3a70d72b4f4b7c07e7d5ebc8b0ccb713a6be4710a90867cd logs: [0xc06e47eb00] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000008000008000000000000000000000000000000000000000000002000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000010000000000000000000000000000000000200000000000000000000000000000000001000000000000000040000002000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000400000000000000004000000000000 state:
         36: cumulative: 1916482 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xe2be28786d008336d62f6a07611d9e7f67c3b40311af01de6b429e5d58178cd5 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         37: cumulative: 1937482 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xe935aafe110ea86e3ac4b533174ab222a06169badd657c52eb67eaf00b711a04 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         38: cumulative: 1982520 gas: 45038 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x8ccd5b0ba33427e09a800ff34eba5a67289806700c075010fb53acd12250cd96 logs: [0xc06e47ebb0] bloom: 00000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000002000000080000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010001000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000400000000000000000 state:
         39: cumulative: 2003520 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x7aa030fdd2383a85c35250fd8ffb68fec712c8b746ae0c98eaabc18189ca4a02 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         40: cumulative: 2589314 gas: 585794 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x995eb05afe6db7c8ef1133043cccb15a7a673896e433f7c7fae9847f4ae28f03 logs: [0xc000453e40 0xc000453ef0 0xc0736ba000 0xc06e47ec60 0xc06e47ed10 0xc06e47edc0 0xc0006ac790 0xc0006ac840 0xc0006ac8f0] bloom: 00000000000000000000000000000002000000040000000000000000000000000000000000000000000040000000000000008008000000000000000000200000000000000400010000020008000000000000000000040000000000000000000002000000028000000000000000400800000000000000100000000010000000000000000010000001000000000000000000000000000000200000000000000200020000000000000000000000000000000000000000000400000000001002000040002002110000002000000000000000000000000000000000000000000020000010000000800000000000000000000000020000200000000000000000020000 state:
         41: cumulative: 2619742 gas: 30428 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x2b7f2ee2394554de508ae4153c3c4fabd4154cafab20c1a1cab2fef8546e46c3 logs: [0xc0006acb00] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000001000000000000000002000000080000000000000000000000000000000000000000000000000000000000000000400000000000000000000000000000000000000000000000000000000000000000040000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000002400000000000200000000000000000000000000000000000000000000000000000000000 state:
         42: cumulative: 2719660 gas: 99918 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xbef547af53ddc56936b3ea49d12a71bfda40e875068293bf3f7a4ee5476de805 logs: [0xc0006acbb0] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000240000000000000000000000000000000800000000000000000008000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000030040000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000080400000002000000000000000000002000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         43: cumulative: 2952148 gas: 232488 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xc990ef37f2f6cf3ffd1528d0b197694c3f2c23d2c4f0fbb489c826fd0e4087bd logs: [0xc0667d0d10 0xc0667d0dc0 0xc06ecfe160 0xc06ecfe210 0xc06ecfe2c0 0xc06ecfe370 0xc06ecfe420 0xc06ecfe4d0 0xc06ecfe580 0xc06ecfe630] bloom: 02000000008000000080000080000000000000000000000000000000000000000004000000000000000000000018000002000000080000000000000000200010000000000000000000000008000000000000000000400000000000000000000000000004020000000000000000000800000000000000040000000010000400000000000002000000000010000000080000000000000000080000000000000080030000000400004000000000008000000000000000000000000000000000000000000002000000000000000000000000800000000400001000000002000020000010200000000000000000002000000000000000000001000000000000000000 state:
         44: cumulative: 3015345 gas: 63197 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x199829a96e0c8c85aa444396daa6cc93ac442462dbe24ad7a87a1727c3f41037 logs: [0xc0667d0e70] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000004080002000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000002000000000000000000000000100000000000080000000000000080000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         45: cumulative: 3036345 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xb761132c33665d096ff9db1652e1cf1728951d4ca7534512d36286adc7349694 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         46: cumulative: 3099554 gas: 63209 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x6819dae7b22e075383036df1ba2930c6ad19c792b481a8995ee694d172721417 logs: [0xc0667d0f20] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000200000080002000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000100000000001080000000000000080000000000000000000000000000400000000000000000002000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         47: cumulative: 3120554 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x74f51ec2cf5010be341c753cc0135923a0aea426f132d3f7b5c989bf0c3a5000 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         48: cumulative: 3141554 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x5cb4e63bfa3299d02635a41a6081079ab1c7b8a74b16f5fdc60fe73239b5903c logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         49: cumulative: 3187651 gas: 46097 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x6a48562f794c20065a395fbe4daeecccb899ca2f25b3b555d365abaf736b1c9b logs: [0xc06e47ef20] bloom: 00000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000020000000000000000000000000000000000000008000000000000000100000000000000000000000000080010000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000400000000000000000 state:
         50: cumulative: 3234399 gas: 46748 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xe120fcc324086971a8d3cf53674659bcd0fe336c331f1a74df9f669d3772068f logs: [0xc06ecfe840] bloom: 00000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000080000000000000200000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000800000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000010000000000000000000000000088000000000000000000000000000000000 state:
         51: cumulative: 3280842 gas: 46443 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x73834b726b8939a8b543bc75da2bd55dc826eabb3e4b790ac478f9fa0ce1c349 logs: [0xc06ecfe9a0] bloom: 00000000000000000000000000000000000000000000000000000080002800000000000000000000000000000000000000000000000000000000000100000000000000000000000100000000000000000000000000000000000000000000020002000000000000000000400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000080000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200800000000000000000000000000000000000000000000000000000000 state:
         52: cumulative: 3327054 gas: 46212 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x824118398e10927c61705b77fa225bf7057936b00cc1f666a249385ae903a9d1 logs: [0xc0667d0fd0] bloom: 00100000000000000000000000000000000000000000000000000080000800000000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000820000000000080000000002000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000400000000000000000000000200800000000000000000000000000000000000000000000000000000000 state:
         53: cumulative: 3441936 gas: 114882 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xe42599878630445091bb8cb69b2cc4e7ca959661f9449000b4b61d85d55ae3c4 logs: [0xc0667d1130 0xc06ecfeb00 0xc05fca8420] bloom: 00000000000000000000080000004000000000000000000000000000000000000000000000000000000002000000100000000000000000000000000000008000000000000000000008000008000020000000000000000000000000000000000000000000000000000000110000000000000000400000000000000010000000000080000000000000000000000000004200000000010000002000000010000000000004000000200000000000000000000010000000000000000100000000000000000002000000000100000000000000002000000000000020000080001000000000000000000000000000000020000004000000000000000000000000000000 state:
         54: cumulative: 3488203 gas: 46267 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xcc9848d13db25686c5a192b152b856b4ad4111fcfdfbe886d3db99905d02e5e4 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         55: cumulative: 3761607 gas: 273404 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xc5141b1805a874c632a98767264c3bb878a6505031b32caff0fb056cf3f4e154 logs: [0xc0736ba0b0] bloom: 00000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000100000000040004000000000000000020000000000000000000800000000000000000000000010004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000 state:
         56: cumulative: 3986095 gas: 224488 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xb5d659879617ea74135f4c853458fc7a7de904e8814c5cb4a73096ef44e46455 logs: [0xc0667d11e0 0xc0667d1290 0xc0667d1340 0xc0006ac4d0] bloom: 00000000000000000000000020000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000200000000002000000000000002008000000000000001000000000000000000000000000000000020008000000000000000800000000000200000000000010000000000000000000001000000000000000000000000000000000000000000000000000020000000000080000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000001020000014000000000000000000001400000000000000000000008000000000000000 state:
         57: cumulative: 4134832 gas: 148737 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x0febe2457fe09b9ed8a846593abc1dba5236807f5fbdf2bdc293596761ff81a3 logs: [0xc0667d13f0 0xc0667d14a0 0xc0667d1550 0xc0006ace70] bloom: 000000000000000080000000000000000000000000000000000000000c0000000000000000000000000100000000000000000000000000000000000000200008000008000000000000000008200000000000000000000000000000000000000000000000020000000000000000000800000000000000000000004010000000000010000000000000000000000000000000000000000000000000000010000000120000000000000000000000000000000000000004000001000000000000000000000002010000000000000000000000000000008200000000000000000020000011000000000000000000004000000000000000000000000000000000000000 state:
         58: cumulative: 4266865 gas: 132033 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xe1d1db53c5de444f3f886b32a222f91a0b6d4a87d6956d4849a6e5243930a698 logs: [0xc06e47efd0 0xc06ecfebb0] bloom: 00000000000000000000000000000000000000000000008001000000000001010000000000000000000000000000000000003000000000000000000000000000040000000000000000000008000200000000000000000000000000000400000000000400000000000000000000000000000000000000000400000010000000000000000000000000000000000000000000080000000000000080000000000000000000080000000000000000000000000000000000000040000000200000000000000002001000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000 state:
         59: cumulative: 4454897 gas: 188032 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x13b4b71e216239de06d5e4398b5abcd6d0d0f754013365f00ca0f1f9cb8e80c9 logs: [0xc0667d1600 0xc0667d16b0] bloom: 00000000000000000000000000000000000080000000000000000000000000000000800000800000000000000000000000000001000000000000000000000000000000000000000000000008001000000000000000001000000000000000000000000000000000040000000000000000000080000000000000000010000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000000000000202000000002020000000000000000000000000000000000000000000000000000000000000800000000000000000000001000000000000000040000000 state:
         60: cumulative: 4497351 gas: 42454 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x928776f48c42efcb95c4d290e0c2b2473f9e6b4eef6b9145aed2f7ba98172997 logs: [0xc05fca86e0] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000000008000080800100000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000004000000000000000000000000000200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000000020000000000000000000000000000000000000000000000000000040000000000000000000000000000000000000000000000000400000000 state:
         61: cumulative: 4543623 gas: 46272 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xd21ad665ec19c208181e8a1d062c724980e55e4bb5fcea6cb643d5456e33dac6 logs: [0xc05fca8840] bloom: 00000000000000000000000000000000000000000400000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000100000000000000002000000000000000000010000000000000000000000000000000000000000000080000020000000000000000000000000000000000000000000000000000000000000000000000000000400000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200800000000000000000000000000040000000000000000000000000000 state:
         62: cumulative: 4592453 gas: 48830 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xe6e82db13a4ee1388fe0f30a28043a9f6ff6ff3a60efe35389b77cdadf040ac3 logs: [0xc05fca89a0] bloom: 00000000000000000000000000000000000000000000000000000000000000000000800000000040000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000002000400000000000000080000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000001000000000000000000000000 state:
         63: cumulative: 4644348 gas: 51895 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xb3aeae6af6b5f9b5be0a68e7884a316cf0e6f85f80944a2b375aaefe29357c37 logs: [0xc05fca8b00] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000200000010000000000000000000000000000000000000000010000000000000000000000800000000000100000400000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000002000000400000000000000400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000800000 state:
         64: cumulative: 4719322 gas: 74974 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x58a1c99447c9e93ddda1906b06b7b4afb4fd37797b79cc9bcca23e099b04c16e logs: [0xc05fca8bb0] bloom: 00000000000000010000000000000000000000000000000000000000000000000000000000000000000000000000800000008000000000000000000000000000000000000000010000000000000000000800000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001000000000000800000000000000000010000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         65: cumulative: 4974717 gas: 255395 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x195db6622f4bbace00f82e3787d3ca4920c03f4f66eb4623d99d6b388251c8ee logs: [0xc0006ad130 0xc06e47f080] bloom: 00200000000400000000000000000000000000000000000000000000000000000008000000000000000000400100008000000000000000000000010000022000000000000000000000000000000000000000020000000000000000000000000100000000000000000000000000000200080000000000000000000000002020000000000000400000000000000000000000000000000000000000001000000000000000000000000000000800000000000000000000000000000000000000000000000000000000000000000001000000000000000088000000000000000000000000000200000000000000000040000000000010000000000000080000000100 state:
         66: cumulative: 5026035 gas: 51318 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x159232107af65b14d39ef02cde8fe687d96650b7c9d30497c5a799fddf6e2644 logs: [0xc0006ad1e0] bloom: 00000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000800000000000000000000000000100000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000100000000000000000000000000000000000000000000000000001000000008000000000000000000000100000000000000000000000000000000000000000000000000080000000000 state:
         67: cumulative: 5211621 gas: 185586 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x4e8393869f1b787a2895856f29fd7c1779e194c49aacce34ac873a779f70af3e logs: [0xc05b3ee210 0xc05b3ee2c0 0xc05b3ee370 0xc06e47f3f0 0xc06e47f4a0 0xc06e47f550 0xc06e47f600] bloom: 00200000000000000000000080000000000000000000000001000000000000000000000000000000028000000000080002000000080000040000000000200800001000000000000000000008000000200000000000400000000000000000000000000000000000000000000000000000000000000000040000800010000000000000000000000000000800000000000000000000000000080000004000000000020000000000000000000000000000000000000000000200000000000080000100000002000000000000000000000000800000000000001000000102000000000010200000000000000000000000080000000000000000000008000000400000 state:
         68: cumulative: 5248366 gas: 36745 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xdfee93e92dfaa6b4682ab430161a16d0e46c2c63c0116148986569ed26ef21cf logs: [0xc0667d18c0 0xc0667d1970] bloom: 00000000000200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000800000000008000000000000000000000000000000040000000400000000000200000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000040000000000000000000000000000000200000000000000000000000000000200000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000004000000000000000000000000000 state:
         69: cumulative: 5294611 gas: 46245 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x86ba3fb6ac3be9d6876c30f48adaf2b9522f5fd83f0e3648b9f4da89c55eb93d logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state:
         70: cumulative: 5419778 gas: 125167 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xd1fc35956b6e67a65bf86f44ffc9e4c7afa090661c90ec18533172e30864380b logs: [0xc0667d1ad0 0xc0667d1b80 0xc0667d1c30] bloom: 04010000000000000000000400000000000000000000000000000000000000000000000000000000000000000400000000000000000000000000000000000000000000000000008000000008000000080000000001000000000000000000000000000000020000000000000000000800000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000000000000400000000000000000000000008000000000000000000000000000001000000000002000000000000000000000000080000000000000000000000000020000000400000000000080800000000000000000000000000000100000000000000 state:
         71: cumulative: 5570397 gas: 150619 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x820e25cc2af0eb44dc963b99579ac904d9670a02d1fb6b519fa0d0a296aaf37a logs: [0xc0667d1d90 0xc0667d1e40] bloom: 00000000000000000000000000000010000000000000000001000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000002008000000000000000000000000000000000000000000000000020000000000000000000800100000000000400000000010040000000000000000000000000000000000000000400000000000000000000000000000000080000000000000000000000000000000000000000000000000000000000000000002000010000000000000000000000000000000000000000000000020000000000000000400000000000000000000000000000000000400000000000000 state:
         72: cumulative: 5788070 gas: 217673 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x53d3b0d0a9d33dbb5ddd42d332b183bdd68f69ccb22a7d1212786dec15bd4195 logs: [0xc0736ba2c0 0xc0736ba370 0xc0736ba420] bloom: 00000000000000000000000000010000000000000000800000000000000000000000000000000000000000000000001000000000000000000000000000040000000000000000000000000008000000000000800008040000000000000000000002000000020000000000000000000808000000100000000000000010000000000000000000000000000000000000000010000000000000000000000000000000000000020000000000008000000000000000000000000000000000000000000200000002000800000000000000000000000000000000004000000000000060000080200800000000000000200000000000000000000000000000000000000000 state:
         73: cumulative: 5834820 gas: 46750 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x6d68544ad020cbf7bd9df7a3c08ecafdbf902733167f86a59f5967a56d5eb286 logs: [0xc06e47f970] bloom: 00000000000000000000000000100000000000000000000000000000000000000000000000001000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000100400000000100000002000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000400000000000000000020000000000000000000000200800000000000000000000000000000000000000000000000000000000 state:
         74: cumulative: 6052563 gas: 217743 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x89837d3bd1f4cb98ce9907dc45006f348bd6125388768fc8e8a6fded221804bb logs: [0xc05fca8d10 0xc05fca8dc0] bloom: 000000000000000000000000000000000000800000000000000000000000000000000000008000000000000000000000000000010000000000000000000000000000000000000000000000080010000000000000000010000000000000000000000000000000000000000000000000200000a0000000000000000010000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000000000200202000000002020000000000000000000000000000000000000000000000000000000000000000000000000000000000001000000000000000040000000 state:
         75: cumulative: 6172907 gas: 120344 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xd5114bd92b5e87dda97f6aa1cc841812537f2eac598b549b17ac862d5c98bb01 logs: [0xc06e47fad0 0xc06e47fb80 0xc06e47fc30] bloom: 00000000000000000000000000000008000000100000000000000000000000040000000000000000000000000000000000000000000000000100000000000000000200000000000000000008000000000000000001000000000000000000000000000000020001800002000000000800000000000000000000000010000000000000000000000000000000000000000000000000000400000000000000000000000000000000000000000000020000000000000000000000000000000000000000000002000000000000000000000000000000008000000000200000000020000000000000000000000000000000000080000000000000040000000000000000 state:
         76: cumulative: 6226446 gas: 53539 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x27a34d10fb10a1413426e959717fdcb7ab5c1031c2b6cf2ec498284460ed5430 logs: [0xc06e47fd90] bloom: 00000000000000000800000000000002000000000000000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000400000000000000000000000000000000000000000000000000000002000000000000000008000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000004800000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200800000000000000000000000000000000000000000000000000000000 state:
         77: cumulative: 6346790 gas: 120344 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x53df7f934bbccb9b29d3313348c2b691aa162bec9e5f10061b091a7a7aa28672 logs: [0xc05fca8e70 0xc05fca8f20 0xc05fca8fd0] bloom: 00000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000080000200000002000000020000800000000000000800020000000000400000000010000000000800000000000000000000000000000000800000000000000000000000000000000000000000000000000000001000000000000000000000080000800000000000000002000000000000000000000000000000400000000000200000000020000000000000000000000000000000000040000000000000000000000000000000 state:
         78: cumulative: 6724662 gas: 377872 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x6c069752caf4926905c894b160312491dac925a590a458624d334a9dec3e5ec8 logs: [0xc06e47fe40 0xc06ecfee70 0xc06ecfef20 0xc06ecfefd0 0xc0006ad340 0xc0006ad3f0 0xc0006ad4a0] bloom: 00200000000000000000000080000000000000000000000000010002010000000000000000000000400000000000010002000000080000000000000000000000000000000100000001000008000000200100000000000000001000400040000000000000000000000000000200010000000000000000000000000010020000000800800000000000004000100000000000400000000000080000004000100000000000000000000000000080000000000000000000000000000000000000000004000002000000000000000000000080000000000080001000000000000020000000200100000000000004000000000000000000000000000000000000000000 state:


Error: invalid merkle root (remote: 08886851c2535ce42360e8d090ad12d3e60d80101f5513eb495beaa9159182bd local: c1392c02c67c710fa34c87bec9d87583821a168144be7fec6ecae83ed358ad66)
##############################

On start, the node does report some old unclean shutdowns, but the nearest one was 4 weeks ago...

Any idea how to fix it without removing the whole db?

[karalabe]

It's a bit hard to guess what could have happened back then. We did fix an extremely unlikely snapshot corruption case that could happen during initial sync, but I doubt you were hitting this. Either way, there's not much information to go on now, so gonna close this, but would be interesting if this appears again with a node snap synced with a fresher version of Geth.