BAD BLOCK errors

[MysticRyuujin]

System information

Geth version: 1.9.10-unstable-f51cf573-20191212
OS & Version: Ubuntu 18.04.3

Expected behaviour

Block is imported successfully

Actual behaviour

BAD BLOCK

Number: 4385565
Hash: 0xeaba95c4970a9a0aaed6432a15ef86906db7b3ec882e1e9834c5a56a9a67c820
...
Error: invalid merkle root (remote: 57bb8a49fdbecb83bc43d1f8a2c5218052775cadf27aec4a91e80870899648de local: 540273554e5ed35860ea6cb1738581957d550d28296d3f53229059d5e76bf564)
...
ERROR[12-20|15:07:39.893] Import error                             err="invalid block 4387500: invalid merkle root (remote: 57bb8a49fdbecb83bc43d1f8a2c5218052775cadf27aec4a91e80870899648de local: 540273554e5ed35860ea6cb1738581957d550d28296d3f53229059d5e76bf564)"

Steps to reproduce the behaviour

From a fully sync'd node (Fast Sync'd > 3 months ago)
geth --datadir /data/ethereum --datadir.ancient /archive/ancient export <file>

Wiped chaindata, wiped ancient folder

geth --datadir /data/ethereum --datadir.ancient /archive/ancient --syncmode full import file

Crash ( #20477 ). Restart

geth --datadir /data/ethereum --datadir.ancient /archive/ancient --syncmode full import file

This error. Restart (same command). Same error.

Backtrace

error.log

[holiman]

That repro isn't accurate is it? You also had a non-empty ancients but otherwise wiped chaindata right?

[MysticRyuujin]

Oh, sorry, you're correct. I updated.

The attached log file is from my re-try to import.

Upon initial import my chaindata and ancients was empty. While importing, ancients data was filling up. There was a crash ( #20477 ) which seemed to recover just fine...hours later, this happened. I tried to restart it again, same error. Can't proceed with import any further.

[MysticRyuujin]

I received the same error on a different block.

This time it was from the network, not DB import. This is like the 4th time I've been unable to perform a full sync.

1.9.9-stable-01744997

INFO [01-02|09:25:01.777] Imported new chain segment               blocks=52   txs=6101  mgas=366.683 elapsed=8.142s    mgasps=45.035  number=5642714 hash=cf14d6…a808b2 age=1y7mo3w  dirty=1.29GiB
INFO [01-02|09:25:10.015] Imported new chain segment               blocks=53   txs=6103  mgas=366.276 elapsed=8.237s    mgasps=44.466  number=5642767 hash=9166a8…a2e245 age=1y7mo3w  dirty=1.29GiB
INFO [01-02|09:25:18.096] Imported new chain segment               blocks=48   txs=5734  mgas=355.059 elapsed=8.080s    mgasps=43.938  number=5642815 hash=57d3d4…add936 age=1y7mo3w  dirty=1.29GiB
INFO [01-02|09:25:24.994] Deep froze chain segment                 blocks=370  elapsed=4.231s    number=5552829 hash=5f9dfe…c4fc57
INFO [01-02|09:25:26.102] Imported new chain segment               blocks=41   txs=4742  mgas=282.153 elapsed=8.006s    mgasps=35.242  number=5642856 hash=93a873…f260ff age=1y7mo3w  dirty=1.29GiB
INFO [01-02|09:25:27.684] message loop                             peer=d10e9e308d6d5cfa err=EOF
INFO [01-02|09:25:34.199] Imported new chain segment               blocks=46   txs=6151  mgas=305.808 elapsed=8.096s    mgasps=37.768  number=5642902 hash=7c47b9…5a8d52 age=1y7mo3w  dirty=1.30GiB
INFO [01-02|09:25:42.273] Imported new chain segment               blocks=43   txs=5305  mgas=315.946 elapsed=8.074s    mgasps=39.130  number=5642945 hash=216203…9d22f5 age=1y7mo3w  dirty=1.29GiB
ERROR[01-02|09:25:43.742] 
########## BAD BLOCK #########
Chain config: {ChainID: 1 Homestead: 1150000 DAO: 1920000 DAOSupport: true EIP150: 2463000 EIP155: 2675000 EIP158: 2675000 Byzantium: 4370000 Constantinople: 7280000 Petersburg: 7280000 Istanbul: 9069000, Muir Glacier: 9200000, Engine: ethash}

Number: 5642963
Hash: 0x3a73459dc39604c4e1152c3f6fbc88137675a7c5663349536d6d875dc2f86800
	 0: cumulative: 21000 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x6dd299de608293de3448eafa0eea82155abf9382b7e9119422863c91e7f65103 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 1: cumulative: 73848 gas: 52848 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x88c5fd75d6d6546505eb8fb683c82cfc7751b575e3e135de35eac6b11ab83e4b logs: [0xc020e76a50] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000400000000000000000000000000000000010000000000000800000000000000000000000000000000000000000000000000000000000004100000000000000000000000000000000000000000000008000000000000000002002000000000000000000000000000000000000000000000000000000000000000000000000000100000000200000000000000000000000100000000000 state: 
	 2: cumulative: 126895 gas: 53047 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x844c0763ae86d6f07a8cbb2ba28bcf3f1e125e3bc4ce2bf23ad9bc935600e8f1 logs: [0xc020e76b00] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000008000000000000000000000000000080000000000000000000000000000000000000000000000000000000000000000010000000000040000000400000000000040000000000000010000000000000000000000000000000000000000000000000000000000000000000000000000004000000200000000006000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 3: cumulative: 147895 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xa4c15f866bebb1a449d29a18226282210ae51194122a43d4c4fa102365b2f0c5 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 4: cumulative: 200425 gas: 52530 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xd2a0e6073305a2043c6e05d88c3b8f24152333af8b93221e5377113da24047ce logs: [0xc020e76bb0] bloom: 00000000000000000000000000000000000000000000000000000040000000000000000000000000000000000000000000000000000000000000000000000000000000000000000040000008000000000002000000000000000000000000000000000000000000090000000000000000000000000000000000000010000000000000000040000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000020000000000000000 state: 
	 5: cumulative: 256128 gas: 55703 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xe09e169afc0e263eff60c0b7dca743889a711220adf61fde7f230e2c66ce3373 logs: [0xc020e76c60] bloom: 00000000000000010100000802000000000000000000000000000000000000000000000000000000000000000000040000002000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000004000000000000000000000000000008000000000000000000000000000000000000000800000000000000000040000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000001000000000000000000000000000000000000000000000040000000000000000800000 state: 
	 6: cumulative: 339910 gas: 83782 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xe88248168355e1b1154f0c87773ee1eac10020b53c75925f721ea56dbf455820 logs: [0xc020e76d10 0xc020e76dc0] bloom: 00400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000040000000000000000000000000000000000000800000000000008000000000000000000000000000000000000080000000000020000000000000000000800000000000000000000000010100000000000000100000000000000000000000000008000000000000000000000000000080000000000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000020000000010000000000000000000000000000000000000000000000000000000000 state: 
	 7: cumulative: 423736 gas: 83826 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x703caffd4ba14780ae123a33a18dcf6a20a9a7d34987c42d3ab2094b32999626 logs: [0xc020e76e70 0xc020e76f20] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000008000000000000000000000000000000000000000000000000020000000000000000000800000000000000000000000010100000000000000000000000100000000000000000000000000000000000000000000000080000000000000000000000000000000000000000000000000000000000000000000002000000000000000000200000000000200000000000000000000020000000010000000000000000000000800000000000000080000000000000000000 state: 
	 8: cumulative: 507518 gas: 83782 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x558523a606eccd55af2a06ef59c567e14e01747ab757a7d3cdacb31f8c206f9b logs: [0xc020e76fd0 0xc020e77080] bloom: 80000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000020000000000000000000800000000000080000800000010100000000000000000000000000000000000000000000000000000000000000000000000080000000004000000400000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000020000000010000000000000000000000000000000000000000000000000000000000 state: 
	 9: cumulative: 741239 gas: 233721 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xf2a600611f6394bc1f7e6b3ba7d9091d56b25169c2edcfecc3fe301dbfae16cd logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 10: cumulative: 819815 gas: 78576 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x09ca133c64e3239e7480f2f841623053c23016fbc0a6298e863ee32abc85117c logs: [0xc020e77130 0xc020e771e0] bloom: 00000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000004000000000000000000000000000000000008000000000000000000000000000000000000000000000000020000000000000000000800000000000000000000000010100000000000000000800000000000000000000000000000000000080000000080000000080000000000000000000000000000000000000000000000000000000000000000000002000000000000000001000000000000000000000000000000000020000000010000000000000000000000000000000000000000000000000000000000 state: 
	 11: cumulative: 842699 gas: 22884 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x33b9bf44d36fea09aa5eaf65a79a7cd335f415d0745fc032651e81969ea3e2aa logs: [0xc020e77290] bloom: 00000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000002000000010000000000000000000000018000000000000000200000000000000000000000000000000000000000000000000000000080000000000000000000080000000000000000000000000000000000000000800000002000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 12: cumulative: 865583 gas: 22884 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xaf7f89a4f394d4a87080a1f9ed1e7509b6bc9ebab1cf728e579b20849bb11df2 logs: [0xc020e77340] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001008000000000000000000000000000000000000000000000000000000000000002000000010000000000000000000000018000000000000000200000000000000000000080000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000800000002000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000010000000000 state: 
	 13: cumulative: 888467 gas: 22884 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xfb9f4b08ce870f3109bfbff36189dd82aa6fd76b05ba80c020b07024ba61f454 logs: [0xc020e773f0] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000008000000000000000000000000000000000000000000000000000000000000002000000010000000000000000000000018000000000000000200000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000800000002000000000000000000000000000000000000004000000000000000000000000000000000000000000000000001000000000000000000000000000000 state: 
	 14: cumulative: 911351 gas: 22884 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x488315adfa85977f5f63492f490a937fd7c6afba32c326b247f9af955983d8bd logs: [0xc020e774a0] bloom: 00000000000000000000000000000000000000000000000400000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000002000000010000000000000000000000018000000000000000200000000000000002000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000800000002000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 15: cumulative: 934235 gas: 22884 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xbf31d6155ac378f8db4a8dd0c444281845dc0f9d27ccff0dfd47dcae43b5bfe8 logs: [0xc020e77550] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000002000008010000000000000000000000018000000000000000200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000800000002000000000000000000000000010000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 16: cumulative: 986731 gas: 52496 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x87b794da4bb5e9350a6d95fa602867984983b76c2f1405f032046abfa8707505 logs: [0xc020e77600] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000400000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000010000000000000000000000000000000000000000000000000000000000000000400000000000000000000000000000000000000000000000000000000000000000000000000000002100000000000000000000000000000000000000000000000000400200000000020000000000200000000000000000000000000000000000000000000 state: 
	 17: cumulative: 1021456 gas: 34725 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x232d5099b8b4f3179ee4361a542aa6d345f8969253ac8a4125699122df1bbe82 logs: [0xc020e776b0] bloom: 00000000000000000000000000000000000000000000000000000000000800000000000000000000000000000000000000000000000000000000000000000000000000400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000800000000400000000000000000000000000000000 state: 
	 18: cumulative: 1179548 gas: 158092 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x5a905702ddcc992570a92c6f0f90f09bf55ae2a1e23e20e46c5f24f9fddf534d logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 19: cumulative: 1257701 gas: 78153 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x23a79fe68854f26387630c7118ad2574a198c74f84e03ee4a713575048f82375 logs: [0xc020e77760 0xc020e77810] bloom: 00000000000000000000000400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000000000000000000000008000000000000000000000000000000000000000000000000020000000000200000000800000000000000000000000010100000000000000000000000000000000000000000000000040000000000000000000000080000000000000000000000000000400000000000000000000000000000000000000002000000000000000000000000000000000000001000000000000020000000010000000000000000000000000000000000000000000000000000000000 state: 
	 20: cumulative: 1287194 gas: 29493 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xc9a1cd24d8932a56ead64c9ad9701d9505450f1b397e4ffd672637c593ffef44 logs: [0xc020e778c0] bloom: 00000000000000000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000000000000000000000000000000000400000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000040008000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 21: cumulative: 1537194 gas: 250000 contract: 0x0000000000000000000000000000000000000000 status: 0 tx: 0xc61663a131b2b42ecb349c835664af6610a65fe739e8e1e6dc57fdf76194a02e logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 22: cumulative: 1713195 gas: 176001 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x860393837d9326fe37ede4ce9d67c1f9991ee7686a522871dad12ab944fb268f logs: [0xc020e77970 0xc020e77a20 0xc020e77ad0 0xc020e77b80 0xc020e77c30 0xc020e77ce0 0xc020e77d90] bloom: 00000000020000000000000000000000000000000000000000000400000040000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000008000000400000000000000000020000000000014000000800000000000000000880000110000000000000400000000000000020000000000000000000000000000000000000000000004000000000000000000008000040000000000000000400000000000000000000000002000000000000002000000000000800000000000001000000000020000000000000000000000000000000000401000000000000000000000000000000 state: 
	 23: cumulative: 2269535 gas: 556340 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xcecde21a58f2b93e79c43207dfcb4c15067e653b23a7b7aa220233d558c046de logs: [0xc020e77e40 0xc020e77ef0 0xc022340000 0xc0223400b0 0xc022340160 0xc022340210 0xc0223402c0 0xc022340370 0xc022340420 0xc0223404d0 0xc022340580 0xc022340630 0xc0223406e0 0xc022340790 0xc022340840 0xc0223408f0 0xc0223409a0 0xc022340a50 0xc022340b00 0xc022340bb0] bloom: 00800008000000010000000000000000000080000000000000000000000000000002000000000010000000000000000000000040100004002040000000200000000800000000000000041008000000000a000010800004000000000022000000000080000800000001000000000000000000000004400000000000100000000000000000000000004000000c0000000000000040048000080801040000000000020000000000000080000000000000000000000080002000000100800000000000000002010000000000002040000400000080000102080000000000000000000010000000020000800000000000000000000000000000000200002020004000 state: 
	 24: cumulative: 2291928 gas: 22393 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xc649333bb53f8c0319dd8b12a0e022e176ae50dbf87c66b9bd2e479b5886fa6b logs: [0xc022340c60] bloom: 00008000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000400000000000000000000000000000000008000000000000000000000000000000004000002000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000004000000000000000400000000000000000000000000000000000000000000000800000000000000000000040 state: 
	 25: cumulative: 2314037 gas: 22109 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xc783a7cea3131ab6821b62a226fcd7a2265ddb687d462517892b2b1a3148c595 logs: [0xc022340d10] bloom: 00000000000000000000000000000000000800000000000000000000000000000080000000000000040000000000000000000000000000000000000000040000000000000000000000000008800000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000080000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000000000000080000000000 state: 
	 26: cumulative: 2336430 gas: 22393 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x9d8fb35cad9bf3ceedc5183f824b5274ec118e612bb206bcf7ce63821b464d0e logs: [0xc022340dc0] bloom: 00008000000000000000000000000000000000000400000000000000000000000000000000000000000000000200000000000000000000000000400000000000000000000000000000000008000000000000000000000000000000004000000000000000000000000000000000000004000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000002000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000040 state: 
	 27: cumulative: 2358588 gas: 22158 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xe6652ce2ffe6a62153e7dd8495cc7ce773d0271ce1c88e19a0a0dbf3954a43d3 logs: [0xc022340e70] bloom: 00000000000000100000000000000000000000000000000000000000000000000000000000000000000000000040000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000020000000000400000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000004000000100400000000 state: 
	 28: cumulative: 2379588 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x22936747575ad4a725665ddd98bf9845b87a8dd385e731cb8c8a466e3a2a420f logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 29: cumulative: 2416061 gas: 36473 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x0c0f1eeff0cd4f132a5f5be0870f3d838ffcdb9e0e26a007c110e5fdc3d9c19c logs: [0xc022340f20] bloom: 00000000000000000000100000000010000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008c00000040000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000200000000000000000002000002000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010 state: 
	 30: cumulative: 2449421 gas: 33360 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x238f56be77dba1faefbac4dcd585b2c1c795d020fd082f6a2d1d887215a1bd5a logs: [0xc022340fd0 0xc022341080] bloom: 00000000000000000000000000000000000001000000000020000000000000000000000000000000200000000000000000000000000000000000000008000000000000000000000000000008000000000000000000000400000000000000000000000000000000800000000000000000800000000800000000000010000000002000000000000000000000000000000000000000000000000000000004000000004000000000000000000000000000000000000100000000000000000000000000000002000004000008000000000000000000000000000000000000000000000040000000000000000000000000000000000000000000000000000000000000 state: 
	 31: cumulative: 2627194 gas: 177773 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x0cda5cc0cccbb0ba65afbc072baff6bfeec2aa1ec761d21d2f4d3a2b1dc8a4f0 logs: [0xc022341130 0xc0223411e0] bloom: 00000000000080000000000000000000000200000000000000020000000000000004100000000000000000020000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000040400000000000008000000000000040000000000000000000000000000000000000008000020000000000000000008000000000000000000008200000040000000000000000000000000000000000000008000000000000000000000080000000000000000 state: 
	 32: cumulative: 2676683 gas: 49489 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x24214e267cae4cc51098306f9d5cb721ce13ccc2d4ce3ef83b70b3c4a2f72ef3 logs: [0xc022341290 0xc022341340] bloom: 00000000000000000000000000000000000001000000000000000000000000040000000000000000000000000400000000000000800000000008000000200000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000010000000800000000000000000000002000000000000000000000000000000004000000000000000000000000000000020000000000000000000000000000000000000100000010000000000000000000000008000000000008000000000000000000000000000000000000000000000050000000000000000000000000000000000000000000000000000000000000 state: 
	 33: cumulative: 2726172 gas: 49489 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x9e0f49d451a51cd3ce53df12df119e0b72fd4b3358a118454f7fb365a815d417 logs: [0xc0223413f0 0xc0223414a0] bloom: 00000000000000000000000000000000000001000000000000010000000000040000000000000000000000000400000000000000800000000008000000200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000800000000000000000000002000000000000000000000000000000000000000000000800000000000000000020000000000000000000000000000000000000100000000000000000000000000000008000000000008000000000000000000000000000000000000000000000050000000000000000000000000000000000000000000000000000000000000 state: 
	 34: cumulative: 2775661 gas: 49489 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x43166b35a0d76b03a5098c2541fdd4100e88cd4b8bc6ebdaf86a928b4321a31e logs: [0xc022341550 0xc022341600] bloom: 00000000000000000000000000000000000001000000000000000000000000040000000000000000000000000400400000000000820000000008000000200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000010000000800000000000000000000002000000000000000000000000000000000000000000000000000000000000000020000000000000000040000000000000000000100000000000000000000000000000008000000000008000000000000000000000000000000000000000000000050000000000000000000000000000000000000000000000000000000000000 state: 
	 35: cumulative: 3403377 gas: 627716 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x6f5e8c3f53eb21e6e97fef9abdfee38fbcf10e991eab01bb864fe719be76f8a6 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 36: cumulative: 4531714 gas: 1128337 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x87aa5e421f0386954cff74ab9f3f1f5bfc746c7266b814aa4ca81e2a7294ebba logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 37: cumulative: 5660051 gas: 1128337 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xfd91ed264ca65b6b4e26d4bf222577c3f795accde2bfb8c630bae5d02838478e logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 38: cumulative: 5697241 gas: 37190 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x24d5b48f8b03963248c5c00a600d6f991216fdf5aa8353fd2bd592f31c240e6b logs: [0xc0223416b0] bloom: 00000000040000000000000000000000000000000000000000000000000000000000000000000000000000000040000000000000000000000000000000000000000000000000000000000008000020000000000080040000000000000000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000000010000000000002000040000000000000000040000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 39: cumulative: 5740150 gas: 42909 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x60c5d9161ace05fd9594ab3e02b8f5176e7370ba8700f1d7f1d1b20355e59c17 logs: [0xc022341760 0xc022341810] bloom: 00000000000000000000000000040000000000000000000000000000000000000000000800000000000000000200000000000000000000000000000000000000000000000000000000000000000000400000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000001000000800000000000000001000000010000000000000200000000000000000000000000000000000000000000000000000000000000000000000000002000000002080000000000000000000000000002080000000002000000000000000000000000000000004000000000000000000000000000008000000000000000000 state: 
	 40: cumulative: 5784447 gas: 44297 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xf9f36322433ae6a72021744fe8c1e169c0ab377640b5b8d60e30f874c7c92d9e logs: [0xc0223418c0] bloom: 00000000000000000000000000000000000000000000000000000000000040000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000100000000000000004000000000000000000000000000000000000004000000000000000000000000000000000000000000000000100000000020000000000000 state: 
	 41: cumulative: 6049446 gas: 264999 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x251523f85d56741b228246043af58257b3fe5eccdca31f3d2684ddab8e6a4b62 logs: [0xc022341970 0xc022341a20 0xc022341ad0 0xc022341b80 0xc022341c30 0xc022341ce0 0xc022341d90 0xc022341e40 0xc022341ef0] bloom: 0010000000000000000400100000000000000000002000000000010000000000400000100010800000000000020400000000000000800000000000000000010202080000001000000008000a200800020000000000200000000000000000000000000000000000020080000000000000000000000800004000200010000000000020000000080000000204000400400002000000000000200000000000000000000000000020000082000000000400000000000000000000000000000000000000000002000000000000000000000020000080000000000000000004000000000008000000000800000000040800000000000200500000100100000000000400 state: 
	 42: cumulative: 7335837 gas: 1286391 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xc8381080f91b8f5af741dfc1a13ab23584689e4d915ae3288070d596bf0a3056 logs: [0xc0228ca000 0xc0228ca0b0 0xc0228ca160 0xc0228ca210] bloom: 04000000000000000000000000000000000000002002000410080000000000080800010000000000000000000000000040000000000000000000000000000000000000000000022000000000000000400000000000000000000000000000200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000100000000000000000000400000000000000000000000000100000001000000000000000000000000080000000000000000000004000000000000000000000004000000000000000000080000004000000000 state: 
	 43: cumulative: 7385196 gas: 49359 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xef3f3b6b5acf501e7b610edb2399fda04cd4f7894c2f40bef25b42b3ad925595 logs: [0xc0228ca2c0 0xc0228ca370 0xc0228ca420] bloom: 00000000000080000001000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000020000000000000000400000000000000000400020000000000000000000000001000000020000000000000000400000010000200000000000000000000000000000000000000000000000000000000000000000000000000000000000020000010000000000000000000000000080000000000000000000000000000010000000000000000000400000040000000002000000000020000000000000 state: 
	 44: cumulative: 7434555 gas: 49359 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xdfe0c3aba09bfcec14c3e2ce5a250ad396daccbb40cdfcb9df8d8db46b656742 logs: [0xc0228ca4d0 0xc0228ca580 0xc0228ca630] bloom: 00000000000080000000000400000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000000000000000001000000020000000020000000000000000000000000000000000000000000000400000000000000000400020000004000000000000000000040000020000000000020000400000000000200000000000000000000000000000000000000000000000000000000000000000000000000000000000020000010000000000000000000020000080000000000000020000000000000000000000000000000000000000000000000000000000000020000000000000 state: 
	 45: cumulative: 7455555 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x214a5a20e21df83960937a4dfeaad543662f6a52a16be246becbb89ac7f4e318 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 46: cumulative: 7504914 gas: 49359 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x7e7e8fa9ed56864aca0fbb8e93572dfa1d8463499e4e674f5f6d1f6e42631652 logs: [0xc0228ca6e0 0xc0228ca790 0xc0228ca840] bloom: 00000000000080000000000000000000000000000000000000400000000000000000000000000000000000000200000000000000000000000000000400000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000400000200000000000400020000000000000000000000000000000020000000000000000400000000000200000000000000080000000000000000000020000000000000000000000000000001000000000000000024000010000000000000000000020000080000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000 state: 
	 47: cumulative: 7529938 gas: 25024 contract: 0x0000000000000000000000000000000000000000 status: 0 tx: 0xb971c0d131c3e359d6f03c4a7e36ca305b6822cdf8217fe9fc6feb3a85a6f4b7 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 48: cumulative: 7613738 gas: 83800 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xfec8304f78b19a20aade895b9a99d7fc73796ced7702111ab623fcb0400be3ac logs: [0xc0228ca8f0 0xc0228ca9a0] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000400000000000000000000000000000000008000040000000000000000000000000000000000000000000020000000000000000000800000000000000000010000010100000000000000000000000000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000004004000000000000000000020000000010000000000000000000000000000000000000000000000000000000000 state: 
	 49: cumulative: 7693738 gas: 80000 contract: 0x0000000000000000000000000000000000000000 status: 0 tx: 0x3852a3c30f97260dc10321b7e9c1f4449d116abb46587b3aed5614e94e66694f logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 
	 50: cumulative: 7777538 gas: 83800 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xa5ab19109d0c16f078e5ad5d834937f84457d0dd9295f6c3c39e44e02cb3ec86 logs: [0xc0228cabb0 0xc0228cac60] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000400000000000000000000000000000000008000000000000000000000000000000000000000000000000020000000000000000000800000000800000000000000010100000000000000000000000000000000000000000000000000000000000000000100000080000000000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000004000000000000000000020000000010000000000000000000000000000000000000000000000000000800000 state: 
	 51: cumulative: 7861338 gas: 83800 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x3b81eea85fea7508b7afc5128c31d0b078d58c8e20c1ca2d5d02745d1ad73e57 logs: [0xc0228cad10 0xc0228cadc0] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000000000000000000000400000000000000000000000000000000008000000100000000000000000000000000000000000000000020000000000000000000800000000001000000000000010100000000000000000000000000000000000000000000000000000000000000000000000080000000000000000000001000000000000000000000000000000000000000000000002000000000000000000000000000000004000000000000000000020000000010000000000000000000000000000000000000000000000000000000000 state: 
	 52: cumulative: 7898909 gas: 37571 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x4fb951243885f3206b9d515422c00f6c6eed494eb495bcca139e610614b46d63 logs: [0xc0228cae70] bloom: 00000000000000000000000040000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000100000000000100000000000000000000000000000000000000000000000000000000000000000000000010008004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000800000000000000022000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000002000000000000000000000000 state: 
	 53: cumulative: 7936668 gas: 37759 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xccb26798f6b56002a5d0db4fb3e8020e18bde0a05f766c9270e4217b8211d5bc logs: [0xc0228caf20] bloom: 00000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000000000000000000000000000000000000000040000000000010000000000000000000000000000010000008000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000400000000000000000000000000200000000000000000000000000000000000000 state: 
	 54: cumulative: 7957668 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 0 tx: 0x1410efe0dedb319c30384024bdf1a1024d52440889460bcff76fe09095bfec3e logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 


Error: invalid merkle root (remote: ba1a2ea6c8fed949facf7b843141e1d93f0ab66202508d96a2efcba216062a70 local: 02be8ade558a4698a8d77d8608feb3cd52a126a72b976c9ede37b94097ea027d)
##############################
 
WARN [01-02|09:25:43.742] Synchronisation failed, dropping peer    peer=75f9b28001f63a0c err=timeout

[MysticRyuujin]

Again. Block number: 3793414

USBHDD_BADBLOCK.txt

The difference between this run and the other runs is that I moved the freezer folder to a locally attached USB drive. Didn't help.

I'm going to buy a new SSD and try again after it comes...

[holiman]

I suspect your disk is toast...

[MysticRyuujin]

Alright, I tried to perform a full sync on a 100% different workstation. Windows this time.

INFO [01-04|21:14:16.153] Imported new chain segment               blocks=66    txs=14378 mgas=518.846  elapsed=8.015s    mgasps=64.733  number=4761891 hash=a31073…7a530b age=2y3w5d    dirty=2.00GiB
INFO [01-04|21:14:24.159] Imported new chain segment               blocks=46    txs=9830  mgas=367.454  elapsed=8.006s    mgasps=45.897  number=4761937 hash=13174c…ce35dc age=2y3w5d    dirty=2.00GiB
INFO [01-04|21:14:26.600] Deep froze chain segment                 blocks=473   elapsed=447.380ms number=4671950 hash=8eb710…683dee
INFO [01-04|21:14:32.209] Imported new chain segment               blocks=41    txs=7751  mgas=314.650  elapsed=8.049s    mgasps=39.088  number=4761978 hash=81bf2f…3450a9 age=2y3w5d    dirty=2.00GiB
INFO [01-04|21:14:40.277] Imported new chain segment               blocks=63    txs=12891 mgas=495.303  elapsed=8.067s    mgasps=61.392  number=4762041 hash=770cbc…613358 age=2y3w5d    dirty=2.00GiB
INFO [01-04|21:14:48.286] Imported new chain segment               blocks=87    txs=15893 mgas=662.162  elapsed=8.009s    mgasps=82.677  number=4762128 hash=dd87b7…90ad63 age=2y3w5d    dirty=2.00GiB
INFO [01-04|21:14:54.264] Imported new chain segment               blocks=61    txs=11342 mgas=474.084  elapsed=5.977s    mgasps=79.313  number=4762189 hash=c51177…ccf70b age=2y3w5d    dirty=2.00GiB
INFO [01-04|21:15:02.553] Imported new chain segment               blocks=41    txs=7747  mgas=320.175  elapsed=8.260s    mgasps=38.760  number=4762230 hash=a8ef01…50ca95 age=2y3w5d    dirty=2.00GiB
INFO [01-04|21:15:10.574] Imported new chain segment               blocks=83    txs=14275 mgas=658.683  elapsed=8.021s    mgasps=82.119  number=4762313 hash=03fec1…2abd66 age=2y3w5d    dirty=1.99GiB
ERROR[01-04|21:15:11.061] 
########## BAD BLOCK #########
Chain config: {ChainID: 1 Homestead: 1150000 DAO: 1920000 DAOSupport: true EIP150: 2463000 EIP155: 2675000 EIP158: 2675000 Byzantium: 4370000 Constantinople: 7280000 Petersburg: 7280000 Istanbul: 9069000, Muir Glacier: 9200000, Engine: ethash}

Number: 4762319
Hash: 0x41e7e12dd0e1cd2a0d8d6a993448dd12111c0a9dde81c36c97d5dda90c4749e1


Error: nonce too high
##############################
 
WARN [01-04|21:15:11.061] Synchronisation failed, dropping peer    peer=51d8940abf23af67 err="retrieved hash chain is invalid"
WARN [01-04|21:15:12.342] Synchronisation failed, dropping peer    peer=e12e3d7e68fb81cc err="action from bad peer ignored"

Error is different...?

When exiting I received this:

INFO [01-04|23:38:46.470] Writing cached state to disk             block=4762318 hash=cc961c…e1830f root=b783a9…77cbec
ERROR[01-04|23:38:46.473] Failed to commit recent state trie       err="leveldb/table: corruption on data-block (pos=683158): checksum mismatch, want=0xa7c23af got=0x99f2513d [file=088662.ldb]"
INFO [01-04|23:38:46.474] Writing cached state to disk             block=4762317 hash=e03c0d…505d7a root=72090f…34732f
ERROR[01-04|23:38:46.475] Failed to commit recent state trie       err="leveldb/table: corruption on data-block (pos=683158): checksum mismatch, want=0xa7c23af got=0x99f2513d [file=088662.ldb]"
INFO [01-04|23:38:46.475] Writing cached state to disk             block=4762191 hash=e6c31a…bd59af root=919289…85476a
ERROR[01-04|23:38:46.476] Failed to commit recent state trie       err="leveldb/table: corruption on data-block (pos=683158): checksum mismatch, want=0xa7c23af got=0x99f2513d [file=088662.ldb]"
WARN [01-04|23:38:59.681] Header broke chain ancestry              peer=aa447ecec6052875 number=4777491 hash=718a20…62a64b
WARN [01-04|23:39:01.123] Header broke chain ancestry              peer=aa447ecec6052875 number=4778284 hash=786bf4…b567a9
WARN [01-04|23:39:03.677] Header broke chain ancestry              peer=aa447ecec6052875 number=4780953 hash=21d68b…a5dc38
WARN [01-04|23:39:04.489] Header broke chain ancestry              peer=aa447ecec6052875 number=4781910 hash=7f8079…fe58ed
WARN [01-04|23:39:06.988] Header broke chain ancestry              peer=aa447ecec6052875 number=4784595 hash=708542…401206
ERROR[01-04|23:39:10.287] Dangling trie nodes after full cleanup
INFO [01-04|23:39:10.287] Blockchain manager stopped

After restarting the node I got this:

INFO [01-04|23:45:51.575] Opened ancient database                  database=D:\\Geth\\Freezer
CRIT [01-04|23:45:51.583] Failed to store chain config             err="leveldb/table: corruption on data-block (pos=683158): checksum mismatch, want=0xa7c23af got=0x99f2513d [file=088662.ldb]"

[MysticRyuujin]

I purchased brand new SSDs yesterday, re-installed Ubuntu 18.04.3 LTS fresh.

I then ran a full sync and it failed, again.

1.9.9-stable-01744997

INFO [01-12|05:10:54.323] Deep froze chain segment                 blocks=9531  elapsed=5.333s    number=2859097 hash=93eafd…57fc3d
INFO [01-12|05:10:56.805] Imported new chain segment               blocks=1062  txs=7743  mgas=230.886  elapsed=8.003s    mgasps=28.849  number=2950152 hash=e26718…2d03c8 age=3y2w6d    dirty=298.83MiB
INFO [01-12|05:11:01.009] Imported new chain segment               blocks=986   txs=6882  mgas=223.298  elapsed=4.203s    mgasps=53.118  number=2951138 hash=ee7e89…2119ef age=3y2w5d    dirty=298.85MiB
INFO [01-12|05:11:07.719] Storing bloom trie                       section=89 head=76d4cdfdab94e1caea622afbd11154a4c3351e507576907a8ce3e6e7d51c3982 root=d061b34a42294ae97ea6d3cd58c053f981d726de5e892830b554f5561790494e compression=0.053
INFO [01-12|05:11:08.447] Storing CHT                              section=89 head=76d4cdfdab94e1caea622afbd11154a4c3351e507576907a8ce3e6e7d51c3982 root=a4883b10d5d99a985925ccc256754cc583b82241e1a29a071c5ec1e48bb800f3
INFO [01-12|05:11:09.052] Imported new chain segment               blocks=558   txs=3265  mgas=112.902  elapsed=8.012s    mgasps=14.091  number=2951696 hash=a59579…684075 age=3y2w5d    dirty=299.96MiB
ERROR[01-12|05:11:11.615] 
########## BAD BLOCK #########
Chain config: {ChainID: 1 Homestead: 1150000 DAO: 1920000 DAOSupport: true EIP150: 2463000 EIP155: 2675000 EIP158: 2675000 Byzantium: 4370000 Constantinople: 7280000 Petersburg: 7280000 Istanbul: 9069000, Muir Glacier: 9200000, Engine: ethash}

Number: 2952165
Hash: 0xe3821eeacc776d2f5c5ce6509c2dfd6f2f1711973f758365d5b044d1a5be6c7e
	 0: cumulative: 21000 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x2766a974e0f0c46322eadd24f20f75847457a25b9b295cc0a541ead837ba50f2 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 1409e5827cf5b2ecf99e447ac5c58e89a655053bc897471c4e2c1833e48e0fff
	 1: cumulative: 86864 gas: 65864 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x874411e7c0ed99b451f2248556cd038ae4ec9cba62b766ac6a7b8e90afd26088 logs: [0xc0525cc630] bloom: 00000000000000000000000000000000000000000000000000000000000020000000000000000000000000040000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000120000000000200000000000000000000000000000000000000000000000000000000000000000 state: ac6438485489effbdee6150e3f0d7c3094373d27e1326c0e90674fa1776dc3bc
	 2: cumulative: 107864 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x60ad0e3ce7a0bbeb03afe94bd642934bf245878a65df742a5b4a354923f31293 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 75b368b78eaff54414e983620bfc43fb0be4360f7f3b5c7c96016a781a269422
	 3: cumulative: 128864 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x90a60a0996ff5eb47e943861d332325fdf28ceb5e248c3758b24667086b12aa2 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 704dfb1295e0dd2ec372d8a91ef701eceb42ac78cfe74c46a757c28f53e99413
	 4: cumulative: 149864 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xbf5ab50cadc0054c5b7720911b5746c74defd5617f2e133fd28d80eb9eecbb27 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 83c846cd617267b510a0d5130ead4d72818cbd6546ac03179c15b951b07e8dd3
	 5: cumulative: 170864 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xc90560d72e6055bef162efe7c75631ed639080539a1d0ba21fdb23da24c6bda8 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 5aca7fa2a54ceccf78a1981ad2400f342440debdc28918eeddf39a0162bff746
	 6: cumulative: 191864 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xd16a73540ae98c6ed6ca41f9f5f3bbe40c2054cf161c436daedb974af4806d9c logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 49d7098d71ef7167b9330c9612b36de9115ec499918cf857457fbcfcfa93dc1a
	 7: cumulative: 212864 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xd213ea5d1b760fb8a082a13bef3dc2dd4939d89adb38dad65b07779be43bbb0a logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 1aaa89d4b7352f6f07ad922b4014d88adbd04372c83bb32ec0ff92a94241a7d8
	 8: cumulative: 365354 gas: 152490 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xf7884ab6f7afa9ce16e6587566256fecefd0b3ff57eb20ec8d36875f6a630092 logs: [0xc0525cc6e0 0xc0525cc790] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200000000100000000800000000000000004000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000040000000000000000040100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000008000000000000000000000000000000000000000000000040000000000000000000008000000000000000000000080000000000000000 state: 45a5dde5f8a7635b99a3db595e525bdd5c1fea6a467e3ca4fd0222cfe2069332
	 9: cumulative: 386354 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x004b72e6345f847942c481807e68a328936bf2d97959fb8fdd627e120a55b526 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 43039e130d08b7a621d6afa65e868488143f05e1d87e4f93854693b51dc59678
	 10: cumulative: 416770 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x05180be3ccaba7f8b5ce6739c8208ac4cbd0103376f7d59d2adfa5f511950ac8 logs: [0xc0525cc840] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 06f368c0eb68d0bc57c659761c1713bffbeee849e23939a4e9879383fe0f9e29
	 11: cumulative: 447186 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x07e0f18b3ed4d1e1775c1c543a1543b36cecd5bac667235258716dd18621b727 logs: [0xc0525cc8f0] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 46facf42cb811da9bb657197462fbecbb6d9f40fb8bef5e414a89eb72c987ff0
	 12: cumulative: 477602 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x0f28fab5eb609cfe1e77156da759188578f7d45c0e3a08feb54f25e2060d4184 logs: [0xc0525cc9a0] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 8b9fa0cacb847956f6304dc881e975338f8a5b41d77197b73001ae7bcf6fe89c
	 13: cumulative: 508018 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x28f279a03d609a0dbf1da99a2f99ae647f6058083cb148e47095fa4ad01508f2 logs: [0xc0525cca50] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 7d8878fdb133f808fe95bf4c1e070c413c6013762bf7ef529b8feae7108aded9
	 14: cumulative: 529018 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x2c9f8fcd708248c0085537da6933975190bd388d6294d9141caf412d3dd093f1 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 9d59d2b0c8b2796bca5a66d710d4418053942045151810fa83f58c83f78e3e6d
	 15: cumulative: 550018 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x2cc2bacc1790900b129f8eb62f9cd629f7c4877d7bc7798a69e40c3ba7f3a874 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 8307ff3ebb61c86c4824c8bdb3361d57fc2eb85fd5e9723821ce30c1b4446fea
	 16: cumulative: 580434 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x2e2d63e3e4fa88d3d564da171dc69ed630f3365f9738ae53b42db3fc506eea2d logs: [0xc0525ccb00] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 4f3bc2c9117b3f7436e7a1969a56651523cded57b0a68c80b9c49edf4759fafd
	 17: cumulative: 601434 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x2eb0a1a61cd32aece92bf9b16c82cfcbbae8480d2b852f3139bcb9a00f0b3fde logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: a3e33287e9e73404153ed87e313f3d44c646c76562c95dc460afd71fe0eee042
	 18: cumulative: 631850 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x3b163efa024972364394e1e2eca34a0fa66a1ee94405cf6d8d17fa96984ddf60 logs: [0xc0525ccbb0] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: e6b8b5a55b5e7ba6df0894ee8b5f64ee424c2bbb245c2521077f85bcb0f7077d
	 19: cumulative: 662266 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x3f3c52b860ceab2c777c3a018af55c16f8a5b4e9e5571c0b4174edac4b54c83b logs: [0xc0525ccc60] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 4f72126ebbde0aa2788306842a8b57bb4ec96899f312dea432e3b4de33164fe6
	 20: cumulative: 696736 gas: 34470 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x4284407bcc87f6e5ca65d73cd334a6acdddf8ed2cadf9e0c8bb18c82470e6e89 logs: [0xc0525ccd10] bloom: 00000000040000000000000000000000000000000000000000800000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 7cbc20d9fd2f6aad2cfdab46bde76c9ac4eeb8c7921c7dc4814262082ca122da
	 21: cumulative: 727152 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x4360b19a7b2a9eb35ba06a7bcef6c0bee080a2eecf689438c6f87553ee6518ac logs: [0xc0525ccdc0] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 7b5cfab9d2ee5ad951886c6ac7709992075a4ac4eb5e3470851b103a19f5c958
	 22: cumulative: 748152 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x4c7ff012801c9b94657e939291d3be394aee3f7ad613ccd2fbf4be746fbea451 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: a26547cd0c84ebc3e05dcfad5e79db9499b3bf3fc7d6b91328cc003f397667bd
	 23: cumulative: 769152 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x546eff5d67f64f5085472365220afec5d623e78e981d1fae06c67b292c7521cc logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: da11b701765f35e88851a9c1df950bf02b73840c86faef5b6a7e05b2470c41cf
	 24: cumulative: 799568 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x589f48526b34c4bd8e375870dbfe54c34fd6aa69ef63327798dea8261a624e8c logs: [0xc0525cce70] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 931d49231c5957ead72830c5a2e1473ec90ba50654174004c361f5705802f7e4
	 25: cumulative: 829984 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x5ac7a209995677b2bfe08ece6171852fbe14fd57523ad64ff9b8c73662770a1d logs: [0xc0525ccf20] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 52f045fd30d45e2fb1eead1ced781327cfa1944a454b20c2d58f59f33f32d28e
	 26: cumulative: 860400 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x5bd2219c752bae7f14e46d9561b235ef4f6d7b418e224b9d46876444c41c28c3 logs: [0xc0525ccfd0] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: ee8422e51fbed1db966544aea1ba92be63f6854dcbcdc7d642daa3783d28ba05
	 27: cumulative: 890816 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x65879f37534fc8a916e7f0bb268f74b7f1c16e4a8c63bfa8c484e9c16fc7c48e logs: [0xc0525cd080] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 4caa488d2bdd2ceca08e8336b9aec8265cf70cf796ecb1a74b71e70e085e117f
	 28: cumulative: 921232 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x6b6b941cc70fdd5e350fb2e6b79edcf5075a50b7a8f1e13d66f18a4b5cd52e77 logs: [0xc0525cd130] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 49aa78ecefb38989dc04499ab7d6bc697ab137847009ebb351361213f0554087
	 29: cumulative: 951648 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x6d9fb004de8e774352fb8e2a3d3fd007446bf5795d5afe101a075ab7ea82bcc3 logs: [0xc0525cd1e0] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 578c05bf559451e5204c41aee4f02e4c60c25fc524f7e36cf199624e8235c3eb
	 30: cumulative: 982064 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x6e77df2b37791d1509f422fbaf8b5ea053d3f14afdbc0db0f2047cc1caab459f logs: [0xc0525cd290] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: f0dd33d769ba3fef616e53d0428692e0969806d93bd40b012cd1a9206de6ab0d
	 31: cumulative: 1012480 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x71f993c8db92d4c00e22dbe18bb5dc0235fcce4339612ff3fdbf973f3f10d000 logs: [0xc0525cd340] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 9ad8945cda0bf3bbd4baf08d49a76b1ff2ada61dcf7d826dfd776896dc59d99c
	 32: cumulative: 1033480 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x75338922aec17dfb68a8a096c9dde3281964097b7e4fdda08a2a876275926208 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 8fa65c71ec510fbf239bc0890caa0c7aa48cb34b905295b3d8dade4cf1764324
	 33: cumulative: 1063896 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x75efd63b54077156ddf6d31b3543dca3de89d1dc8d452e5ae8aec25c5530b73c logs: [0xc0525cd3f0] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: ddd96c4f787f44149b58bf247b20678130b1e8095d3d1d411ac346ce568e73f8
	 34: cumulative: 1094312 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x764ba98bee8bd81e1ff45985d60e9e20e4ec9c8fe8956408dad560677360fbc4 logs: [0xc0525cd4a0] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: c5612433b17f90915d5e402a256643bb2d00d1a96ee3931f91928c2ccdc714eb
	 35: cumulative: 1115312 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x7c2c3a498573506f1a6c2ba136e7fce754b2a6e5851a816de40dffa737db931d logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 6fba194e2ce5f83889de05eaa3d2bcee15086301232fbd3651c944a7fa79a39d
	 36: cumulative: 1145728 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x8740821e4ff3907efaf0dc57967c5caaa1bae64b28d477d64c5e496e6f135d69 logs: [0xc0525cd550] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 24b6c26672b2d60f3a9b7154e1683eee8c82fefeae1dcc486b8e7c8161cc3cf4
	 37: cumulative: 1176144 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x91bbc946b58c545866ce27afa78eaa0e477361401d9ac11029ffef71702c281d logs: [0xc0525cd600] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 1e443b73ae1620e14327183ff0b325f9fde3ba6b3c07671c6a08d58e921068c1
	 38: cumulative: 1197144 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x96803c37de9f44b7d5c9077e601785c3dbc745a2d4f52c5d4f01234b5c0e1da2 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 9f3cec44c4a96af0bf6b60cfb55c843e33be8431367095f5fc46037972f0e53b
	 39: cumulative: 1227560 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xa030c4c4e7201c9b9064fa487c1d93822bd2acde38741c6ae4d2a6bed2bf2408 logs: [0xc0525cd6b0] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 99b5384698371cb8095fb6b3966cd73bf5fa4ee08ab54218c7796de09bc68ef5
	 40: cumulative: 1257976 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xa1ba79cc0f663c056c11e35ad548f4d7f95ba772f6b74d184aebd145c77d2671 logs: [0xc0525cd760] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 76bee72816e7f3b8103fa0cf97c266af35331e4b53d288e2d9ac8e7028ac2043
	 41: cumulative: 1288392 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xa86932f948dc515fba7838bf9061e04affbb86294ce5c4ceb38544e75e9ff7c2 logs: [0xc0525cd810] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 933a915878d278c4f8f9c02c53a6f61189dca27af2bb3a1233baa1ad7d7ea0ca
	 42: cumulative: 1318808 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xc6192f7808a900c808561e93c14b912b6349f2f088fcfccab774d33952a167dc logs: [0xc0525cd8c0] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 09a2393c6d3a2195b1c89ca6d4ca45101e7ef6a4790228600c236c750299d34d
	 43: cumulative: 1349224 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xd6c81388d4b136f25a0e9a6db444e6f4f90e2d9c5a232232eec99f0ba77c2dff logs: [0xc0525cd970] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 3957cb30992b94e72da39d889e4a5dc519628a5333e32e90dd4a6233038835fc
	 44: cumulative: 1379640 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xd99dca9041354db018128f3725e3d3146277b674bf60fb4ada4f680a68520712 logs: [0xc0525cda20] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: bca2bff53de30b83f1923210aba704a5262502336450c59abacee59ce705eda0
	 45: cumulative: 1410056 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xda59f56091b10fc4e87d15d2eb61ac52c65401ebe6fbd760db6b2101e893be7c logs: [0xc0525cdad0] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 2e576ba048b4b47bf19c3aaa145d5b3ea88a8cf1ac56365e82e6eedcb68d6b2f
	 46: cumulative: 1444526 gas: 34470 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xe2447607f60fd836303959c12545cd0fde02da5fed8a8f49d0f539bf3cd1dcd5 logs: [0xc0525cdb80] bloom: 00000000040000000000000000000000000000000000000000800000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: ef9b06c18aeb7973bd753d0535ba588cb46aabec5fb93b7a0b9bbbc5708bd00b
	 47: cumulative: 1474942 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xe5c1bd1842315b085b1e9888514ee8c0452a8e98f87d6364231c6130b86d899c logs: [0xc0525cdc30] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 2043595e6f5366b92c0decaf57335f83fb8feacdb4497d64205c3f5876cb90dd
	 48: cumulative: 1505358 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xe985af519d549d77672ae90fd65782368ad3893cea0603b14cfb57d429f3c168 logs: [0xc0525cdce0] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 87608e11a0d5b2acf3ef95b8ecf5fbb7eae6180b626f27f8eace2fa27699e55c
	 49: cumulative: 1535774 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xf502ace00d411ecbbadd77d1e8814fad4827210afe6425ed6a4a77180cd54b75 logs: [0xc0525cdd90] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: d7088cf90494d3b6e7ae153aa8fdaf8b4f54aa59d95a6db4887448e8ea124b8d
	 50: cumulative: 1566190 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xf552b73406dd68e4594e23243001965fa5f3b5e586eb0ea4c802af1f7faaa5fc logs: [0xc0525cde40] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: fbd6dbb3f0e06da8cc0823be9065a93f2d96e7550def586faec4da624a6cf5d4
	 51: cumulative: 1596606 gas: 30416 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xfe8a5ff3df5b7161bd719fdefa42654fa38dc89f98b59f14cce44739ea9449ce logs: [0xc0525cdef0] bloom: 00000000000000000000000000000002000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000004000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 96c772ae824974ac7a6f3cea8b201e06f81e4bbea0ad6e4109edfbb3827ac08c
	 52: cumulative: 1617606 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xffb1df7f66cbc116ba5fedfe3f0d6854d9bdd0c3f3bfe135595563d3e83cc3f1 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 939f68e942915b82e599066ee87a89de0f925df182fae0182852555aa46a7c10
	 53: cumulative: 1638606 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xd95b8c2a41b156bf8471b798350e7fca119916dd455f845a7ac7f1d5927b9a23 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 5bae5d0a42f13b3db6d63d4b1772cc9820c9c7e382838e9ca5ff721e79586b35
	 54: cumulative: 1659606 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x1508c9046f42c7f22e3c4afd6d4cdf11a172098ebf941dabdde138397b3aa535 logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 5de40df573df81583e5b63fb6d9b17e38321b5cd361163eb534f5a968f0d08b1
	 55: cumulative: 1680606 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0x1b95892c8eab91c55f74fa1f39a4f89b7db9e79f93bfc1cefec3b14757b4582a logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: e418f61106bd89812b3f6ba5cfe8c572a215e265f43774f287546afb739e3ed5
	 56: cumulative: 1701606 gas: 21000 contract: 0x0000000000000000000000000000000000000000 status: 1 tx: 0xa58e9b2bf62105b206c3d0ba50a37a515af33083eedd91b142e50dc59276157a logs: [] bloom: 00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 state: 5e7e43bf736ac31d33a76f647d8fa2233160fdfeae94cef3224aee073a55429e


Error: invalid receipt root hash (remote: 10e976294b1eda359c0a0fca9c6bccd9eef4c8649a6a1b924356632ec5af5aa3 local: ec49e2ad4e89122c7c97c4c88913400272086a77ab8d987d3fe3d041a6477819)
##############################
 
WARN [01-12|05:11:11.616] Synchronisation failed, dropping peer    peer=7ee49e2a929b84d5 err="retrieved hash chain is invalid"

[holiman]

Wow, that is strange indeed! I've done four-five full syncs the last couple of weeks, never hit any problems like these.. makes me wonder... Gripping at straws here, could you do a bios memtest? 

[MysticRyuujin]

MemTest86 reports no memory errors

[MysticRyuujin]

Theoretically, could a single 'static-peer' provide bad block(s) resulting in the behavior? I have to assume that even 1 connected peer providing good block(s) would be enough, but I'm curious if that scenario would be enough to cause this behavior? Would receiving invalid or corrupt block(s) cause this behavior? I would assume it would NOT given that the node is processing each block, but I'm also grasping at straws 😄

[holiman]

Hm, I'm a bit confused, I thought this ticket and #20485 were the same, but they're not. So, is everything in this ticket about import of existing rlp dump?

Theoretically, could a single 'static-peer' provide bad block(s) resulting in the behavior?

No, block 2952165 does indeed have hash 0xe3821eeacc776d2f5c5ce6509c2dfd6f2f1711973f758365d5b044d1a5be6c7e, so it's a canon block all right. If a peer screwed with it, it would choke earlier, because the block body would not match up to the hash specified in the header, and if the header was modified the header hash would be different (and the PoW would fail)

The receipts you posted seem to match http://mon04.ethdevops.io/block/2952165 , at least concerning the accumulated gas, though I suspect that there's some mismatch in one of the receipts, will need to investigate it further.

All of this (both tickets) seem to come from a data corruption, and things like this typically happens when there's a disk corruption which causes leveldb to be unable to provide e.g. correct state (which makes geth miss a state entry, which could make it think a nonce is 0, but it can also lead to different hash root -- basically a whole plethora of possible faults). So it's really odd that you're seeing this on a brand new SSD. I really can't figure out what could possibly cause this.

Did you compile the code yourself? And if so, what go compiler version did you use?

[MysticRyuujin]

Sorry for the confusion. I didn't want to open a new error every time.

Basically I only tried to import the DB twice, then you suggested that the export was corrupt. So I switched to just syncing from the network.

I tried that a few times but it failed so I switched to the PPA release on Ubuntu (stable). That also failed multiple times.

So I switched to the binary release for Windows on a different workstation, that failed too.

I bought a new SSD, tried again on Ubuntu stable from PPA after fresh OS install.

The only thing that is equal between all runs (2 different workstations, 2 different OS) is that they're all on the same local network. Which is where my last question came from, I thought it might be possible that I have a neighbor peer node with corrupt data poisoning the sync process somehow.

To fuel my theory, I had 2 Geth nodes:

1. Geth01 - The one I was trying to do a full sync with many times
2. Geth02 - A previously Fast Sync node that I never messed with, but always pointed to via 'static-peers.json'

Yesterday I thought screw it I'll try to do a Full Sync on Geth02 also. So I wiped BOTH nodes and started them at the same time. Geth01 is now on block 4,731,858 and still going. Granted, it could still fail, it's only 1/2 way to the tip. But so far it's going better than previous runs.

[holiman]

I thought it might be possible that I have a neighbor peer node with corrupt data poisoning the sync process somehow.

Nope (unless there's some deep flaw being exploited by some really really advanced attacker). A full sync fetches blocks from the network. It verifies the block content against the header, and executes every transaction. There's no way a peer can influence that, really.

A fast sync is a different matter, where in theory at least there are more avenues for a peer to do something bad. However, all state downloads are verified against the trie, so in practice I don't think a peer can do stuff which actually causes corrupt data on the victim.

[holiman]

On your windows-machine, this message indicates that you got a data corruption on leveldb:

ERROR[01-04|23:38:46.473] Failed to commit recent state trie       err="leveldb/table: corruption on data-block (pos=683158): checksum mismatch, want=0xa7c23af got=0x99f2513d [file=088662.ldb]"

specifically: leveldb/table: corruption on data-block (pos=683158): checksum mismatch, want=0xa7c23af got=0x99f2513d [file=088662.ldb].

So is Get01 the windows-machine that you replaced SSD on?

[MysticRyuujin]

No, Geth01 is the Ubuntu machine that all of these errors came from except for the single run that I did on windows. Geth01 is the system that I replaced the SSD.

FWIW the windows machine is also brand new...