Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Erigon fails to return deposit logs #4666

Closed
SeaMonkey82 opened this issue Jul 7, 2022 · 17 comments
Closed

Erigon fails to return deposit logs #4666

SeaMonkey82 opened this issue Jul 7, 2022 · 17 comments
Assignees

Comments

@SeaMonkey82
Copy link

SeaMonkey82 commented Jul 7, 2022

In prysm:

[2022-07-06 22:46:40] ERROR powchain: Unable to process past deposit contract logs: Could not process deposit log: received incorrect merkle index: wanted 0 but got 356

eth_getLogs REQUEST and RESPONSE

Jul  6 22:39:50.805 2022 REQUEST
{
  "jsonrpc": "2.0",
  "id": 8,
  "method": "eth_getLogs",
  "params": [
    {
      "address": [
        "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d"
      ],
      "fromBlock": "0xbc11d3",
      "toBlock": "0xbc15bb",
      "topics": null
    }
  ]
}

Jul  6 22:39:50.805 2022 RESPONSE
{
  "jsonrpc": "2.0",
  "id": 8,
  "result": [
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000140000000000000000000000000000000000000000000000000000000000000018000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000030ab25b7617d3bf0f423296acd7466da482175fa70c50195c3d1aaf14d0cc9de6789c16857b1aca668005400a11ed95a0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000c04f1629824783d41a40e5f05ab2aa52be0d4d8915b95d2643db358d08995300000000000000000000000000000000000000000000000000000000000000080040597307000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000006084c4904508bc5ae5b30405ba6b3ec058e5cb133e8b5417efcb5033f52b60a58c0cd435da72bd0b966659a5137b58c9c40111e819c38a019cb49628027ad2575540a05cc12d28129d34d8ae6d44f1bd47fdcf713be6b4030fc5ef2f31dc3f6eba00000000000000000000000000000000000000000000000000000000000000086401000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc1200",
      "transactionHash": "0xd3a8bc85792abc38a9ba18b1869f1e33e932de12da423511df437a996051e493",
      "transactionIndex": "0xa",
      "blockHash": "0x0fff630bf3774a21247c29247015de2eb26acaa6013b150320df6fb6ef8c2d77",
      "logIndex": "0x18",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000001400000000000000000000000000000000000000000000000000000000000000180000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000308ce3539d03cfade856aa980cf4a6baeca77cd58c5b929a62db6a85e854685ceccb9cb7160382b4bba643979f1ea2ebf200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000e4329d6d05af060619d1efe181d48658226bc90ec45dbcb429f2f314b63aea000000000000000000000000000000000000000000000000000000000000000800405973070000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000060b33801639ed664de5daf2d3e569b96f95ff0c942eeff42147cded69a052b67748e5f982aae3c6d93f3661c8f8e22549b0afac72b6eca53f7b17f9dff0fcfab81dd8f2527f32f5614a4617d259823f8899df2e7fabead3425b2d3981f38eb2b2e00000000000000000000000000000000000000000000000000000000000000086501000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc1200",
      "transactionHash": "0x0e3b0a54bc0e96a65d6b4ad1a3ea3e9b54e7f72455c00c067aa31b03c86a4cb7",
      "transactionIndex": "0xb",
      "blockHash": "0x0fff630bf3774a21247c29247015de2eb26acaa6013b150320df6fb6ef8c2d77",
      "logIndex": "0x19",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000140000000000000000000000000000000000000000000000000000000000000018000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000030ac1815b35ae7bd66be03b2aa468126871bde874d5bb0510c014ff77e6e19913eccd0410a04b8989f0d39851f80fa3c19000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020007b942e5a78fa7b25397c6461bd175c58371c426b12bc6a5a27b6451bc49684000000000000000000000000000000000000000000000000000000000000000800405973070000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000060b4c7a080e3a0631f03ad425fa607c9a0404031fcb6c511e18372282c43ac6e95f95d77b5165be03f6097e9d9e1710cd90aef738785c69e6cafa8ecdfe2b507b6f78c8c13715662f8c58a05eda004423b1cd5f47a191391eb424f2f3481afaf1600000000000000000000000000000000000000000000000000000000000000086601000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc1200",
      "transactionHash": "0xa6815890e86b78a2032e8fc2a48fb5e6af38ba296b6069db4bdbd26c612307b6",
      "transactionIndex": "0xc",
      "blockHash": "0x0fff630bf3774a21247c29247015de2eb26acaa6013b150320df6fb6ef8c2d77",
      "logIndex": "0x1a",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000140000000000000000000000000000000000000000000000000000000000000018000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000030958e19d623a05c4b8faf82313e45bf9db7dbee120a8fc1e4ddbb67d558a3b05bed8e13a0b56c8894ffb529c18452e6f000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000dbe371286a492fdbc803dcf03d87da38140772266a18a0bb6275262342ac7f000000000000000000000000000000000000000000000000000000000000000800405973070000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000060b07b94111fd890c8a366dc9f6117f3b592b33102b2c0371e486502116ac7c2a338d5566a70e13f2e019430ba8869e4b215d7888067c0ef428abec0787ea6b9fd5a50b755f1001f35c8aa5dcd130bd79079771ff5e2becfa20e42a34b43966e1000000000000000000000000000000000000000000000000000000000000000086701000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc12a4",
      "transactionHash": "0xf216bbe1d337d470d6d7fac49241e0f1ffef5c786a5b6cf720065eee6d676029",
      "transactionIndex": "0x5",
      "blockHash": "0x8643ff5d18173fd4435c60a8ee72521c8008710556ac2bbe7275d715661fb9f8",
      "logIndex": "0x3",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000140000000000000000000000000000000000000000000000000000000000000018000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000030a01dfa2a0b1fbb5b3168e797b40fc3473237a874006d5692ce3dea6751ef33d15fd7451f954a1a286c8b1573cf489ce10000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200016dcc51e4822a9e6208c82fc019e38177d0a2eb248ca8a972b7277082afe2d000000000000000000000000000000000000000000000000000000000000000800405973070000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000060b23b6090393d37a5395752e931391259605d42964de1506389e9957aa1fa2f519d3e7e6ba524a6ee99aa28aadd0f89bc02fd8a209b9e3864595168c9950fe0a3451f74e7b25999cb6631928e25e35686c40232bc4b04e4157b9d943d79cff25f00000000000000000000000000000000000000000000000000000000000000086801000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc1300",
      "transactionHash": "0xc4721282a979c934a0125addbefe73e267c330b191634881425b99b95e5c1282",
      "transactionIndex": "0x19",
      "blockHash": "0x7ceeb887c7e9bc55efc314daedfee9fa544d42b11172ca863fbecb547066840f",
      "logIndex": "0x1c",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000140000000000000000000000000000000000000000000000000000000000000018000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000030a7edf541a757257dbe3184ac50b6b8acda1dd2f9f8b3f2466f2443a5715e7e593502c1536f47e7c87b68a4b236af39fe000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020010000000000000000000000299248561958f4c4c6a25168317a5361ddae794d00000000000000000000000000000000000000000000000000000000000000080040597307000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000006099a1be4088af15d4b69f143131fee3750211e0c5ac9f8f1f9a6b78b04f504daaed50d796d9fd02e89e866266117530d902fbeb1a49c7cdeb71c9d6b6532fdd00bf042a04cd57b6494d2d4756359e96b17af54231c3d92ac0e7ac258b137b244d00000000000000000000000000000000000000000000000000000000000000086901000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc139b",
      "transactionHash": "0xabe98a9103b6655f972844f0690f97880987e1819f944c16f4fc11ba77eb5114",
      "transactionIndex": "0x11",
      "blockHash": "0x55c210a54ffe94866f1f0bd41421802467bfe949757c7167ec0c7c072fc66b7f",
      "logIndex": "0x1b",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000001400000000000000000000000000000000000000000000000000000000000000180000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000308c37e43ab1e40eea73cd8bc34755909222bb80e059c8bc0986079037857cab8c45a2778787a567dace538c5d2374304d000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020010000000000000000000000b655b39d3ca5f26d04e6185fc204ace6fb016a02000000000000000000000000000000000000000000000000000000000000000800405973070000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000060923c6630c22f1e6806a2d49e33bcd454499065b50284c73599726ced4de8b3db19c5c13c6949f7e9b2811c8f54c4c5e415f7d2ffcade61d8115cf3b280fe744bf84afdc2b2af3a73da3475c9af8794d819ad8e17e31fd9184602789ca782c7af00000000000000000000000000000000000000000000000000000000000000086a01000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc13bb",
      "transactionHash": "0xb2aa7a1636e632775b0e642d5e07776cf5f51feeced478103bf6fe66c87089ca",
      "transactionIndex": "0x16",
      "blockHash": "0x21fa0ca6d14d56652a8145daa7d42d205f1e25a027966a8fd3b67f3d3ee87df8",
      "logIndex": "0x14",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a00000000000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000014000000000000000000000000000000000000000000000000000000000000001800000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000000000000000003099c383af390ac6d7e5429fa8aeb28ad0a4c508f1a1cdd185e24a0befecc58af9b0e807a29137e9ae543a955052ba6ed80000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200095232e43b5cf9deee4f2f7475fdc40cd135d9bf06264fba2f6f445adae0d8800000000000000000000000000000000000000000000000000000000000000080040597307000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000006090228ef0215fde24887a5cfc87ffe313385c8c8f83db5cf3bee7e8f2e140039abf20859bdf908916f5a29cd873858f17123f8642d45234f80cf17ad5c9942689f9a1a45d2c1d182a21e02902dced4df42f21369793b2adbe10e0c15cfbd0b92700000000000000000000000000000000000000000000000000000000000000086b01000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc13d0",
      "transactionHash": "0x94c0193c2b6bd5578f029d661d320c44cf9b82f54332decfd6a1bc74c4e9c975",
      "transactionIndex": "0x7",
      "blockHash": "0xcfe22da8bb3c1d778873f5adac34ac918956799320792013cff6e518e4f8c477",
      "logIndex": "0x3",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000140000000000000000000000000000000000000000000000000000000000000018000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000030949deeea852e91777e02dcef8a42deb0faf933b14a2351585dcd78f106cadd41258eb198a7c2ef94116d60a35c82e8cb00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000f33ddce3711fc58ef6fe045d59032d434d3c1cf1c0d975177e84d1e5d2ad1e000000000000000000000000000000000000000000000000000000000000000800405973070000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000060a4224c235cfb4aeacfad8dcdc37c6c61e35700814514136b29bc372aeb325e2f245f38bf635a67a089662f22f7d4417f05ca9a7e10682c3f348a13de4cd4300c000641a8c9da3103a96009ef79d908e86904e45868fc646ecc5922b731e3c3d800000000000000000000000000000000000000000000000000000000000000086c01000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc13e9",
      "transactionHash": "0x46985a04fc907df279f5905f087a74a66ceff82095675f2942c820ffb81f74c7",
      "transactionIndex": "0x25",
      "blockHash": "0xdbc5703d4c325f761ed9031f585cda75aa38cb75126065e3d92e48aa3ddb6148",
      "logIndex": "0x40",
      "removed": false
    }
  ]
}
@mandrigin
Copy link
Collaborator

@SeaMonkey82 which network is that?

@SeaMonkey82
Copy link
Author

Ropsten

@mandrigin
Copy link
Collaborator

commit 329d586
unpruned

from the chatroom

okay, I will check what it returns on my validators

@mandrigin
Copy link
Collaborator

Is being investigated by @dmitriyselivanov

@dmitriyselivanov
Copy link

@SeaMonkey82 @mandrigin the erigon (rosten, unpruned, commit 329d586) response to the provided eth_getLogs request is semantically identical to infura's one (and infura uses geth client according to FAQ)
erigon_329d586.txt
infura.txt

@SeaMonkey82
Copy link
Author

@SeaMonkey82 @mandrigin the erigon (rosten, unpruned, commit 329d586) response to the provided eth_getLogs request is semantically identical to infura's one (and infura uses geth client according to FAQ) erigon_329d586.txt infura.txt

If the response is semantically identical to geth, I wonder why the same error doesn't occur with prysm-geth.

@mandrigin
Copy link
Collaborator

@SeaMonkey82 if you get infura.txt, and your json and use something like http://jsondiff.com, it shows no differences whatsoever. So maybe its another request that fails or something?

@SeaMonkey82
Copy link
Author

SeaMonkey82 commented Jul 16, 2022

@SeaMonkey82 if you get infura.txt, and your json and use something like http://jsondiff.com, it shows no differences whatsoever. So maybe its another request that fails or something?

In my original post the timestamps don't match up between the JSON RPC call and my prysm logging, so I grabbed another example to prove that this is indeed the call generating the error.

[2022-07-16 19:14:39] ERROR powchain: Unable to process past deposit contract logs: Could not process deposit log: received incorrect merkle index: wanted 0 but got 356
Jul 16 19:14:39.144 2022 REQUEST
{
  "jsonrpc": "2.0",
  "id": 7,
  "method": "eth_getLogs",
  "params": [
    {
      "address": [
        "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d"
      ],
      "fromBlock": "0xbc11d3",
      "toBlock": "0xbc15bb",
      "topics": null
    }
  ]
}

Jul 16 19:14:39.144 2022 RESPONSE
{
  "jsonrpc": "2.0",
  "id": 7,
  "result": [
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000140000000000000000000000000000000000000000000000000000000000000018000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000030ab25b7617d3bf0f423296acd7466da482175fa70c50195c3d1aaf14d0cc9de6789c16857b1aca668005400a11ed95a0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000c04f1629824783d41a40e5f05ab2aa52be0d4d8915b95d2643db358d08995300000000000000000000000000000000000000000000000000000000000000080040597307000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000006084c4904508bc5ae5b30405ba6b3ec058e5cb133e8b5417efcb5033f52b60a58c0cd435da72bd0b966659a5137b58c9c40111e819c38a019cb49628027ad2575540a05cc12d28129d34d8ae6d44f1bd47fdcf713be6b4030fc5ef2f31dc3f6eba00000000000000000000000000000000000000000000000000000000000000086401000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc1200",
      "transactionHash": "0xd3a8bc85792abc38a9ba18b1869f1e33e932de12da423511df437a996051e493",
      "transactionIndex": "0xa",
      "blockHash": "0x0fff630bf3774a21247c29247015de2eb26acaa6013b150320df6fb6ef8c2d77",
      "logIndex": "0x18",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000001400000000000000000000000000000000000000000000000000000000000000180000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000308ce3539d03cfade856aa980cf4a6baeca77cd58c5b929a62db6a85e854685ceccb9cb7160382b4bba643979f1ea2ebf200000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000e4329d6d05af060619d1efe181d48658226bc90ec45dbcb429f2f314b63aea000000000000000000000000000000000000000000000000000000000000000800405973070000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000060b33801639ed664de5daf2d3e569b96f95ff0c942eeff42147cded69a052b67748e5f982aae3c6d93f3661c8f8e22549b0afac72b6eca53f7b17f9dff0fcfab81dd8f2527f32f5614a4617d259823f8899df2e7fabead3425b2d3981f38eb2b2e00000000000000000000000000000000000000000000000000000000000000086501000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc1200",
      "transactionHash": "0x0e3b0a54bc0e96a65d6b4ad1a3ea3e9b54e7f72455c00c067aa31b03c86a4cb7",
      "transactionIndex": "0xb",
      "blockHash": "0x0fff630bf3774a21247c29247015de2eb26acaa6013b150320df6fb6ef8c2d77",
      "logIndex": "0x19",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000140000000000000000000000000000000000000000000000000000000000000018000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000030ac1815b35ae7bd66be03b2aa468126871bde874d5bb0510c014ff77e6e19913eccd0410a04b8989f0d39851f80fa3c19000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020007b942e5a78fa7b25397c6461bd175c58371c426b12bc6a5a27b6451bc49684000000000000000000000000000000000000000000000000000000000000000800405973070000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000060b4c7a080e3a0631f03ad425fa607c9a0404031fcb6c511e18372282c43ac6e95f95d77b5165be03f6097e9d9e1710cd90aef738785c69e6cafa8ecdfe2b507b6f78c8c13715662f8c58a05eda004423b1cd5f47a191391eb424f2f3481afaf1600000000000000000000000000000000000000000000000000000000000000086601000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc1200",
      "transactionHash": "0xa6815890e86b78a2032e8fc2a48fb5e6af38ba296b6069db4bdbd26c612307b6",
      "transactionIndex": "0xc",
      "blockHash": "0x0fff630bf3774a21247c29247015de2eb26acaa6013b150320df6fb6ef8c2d77",
      "logIndex": "0x1a",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000140000000000000000000000000000000000000000000000000000000000000018000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000030958e19d623a05c4b8faf82313e45bf9db7dbee120a8fc1e4ddbb67d558a3b05bed8e13a0b56c8894ffb529c18452e6f000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000dbe371286a492fdbc803dcf03d87da38140772266a18a0bb6275262342ac7f000000000000000000000000000000000000000000000000000000000000000800405973070000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000060b07b94111fd890c8a366dc9f6117f3b592b33102b2c0371e486502116ac7c2a338d5566a70e13f2e019430ba8869e4b215d7888067c0ef428abec0787ea6b9fd5a50b755f1001f35c8aa5dcd130bd79079771ff5e2becfa20e42a34b43966e1000000000000000000000000000000000000000000000000000000000000000086701000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc12a4",
      "transactionHash": "0xf216bbe1d337d470d6d7fac49241e0f1ffef5c786a5b6cf720065eee6d676029",
      "transactionIndex": "0x5",
      "blockHash": "0x8643ff5d18173fd4435c60a8ee72521c8008710556ac2bbe7275d715661fb9f8",
      "logIndex": "0x3",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000140000000000000000000000000000000000000000000000000000000000000018000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000030a01dfa2a0b1fbb5b3168e797b40fc3473237a874006d5692ce3dea6751ef33d15fd7451f954a1a286c8b1573cf489ce10000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200016dcc51e4822a9e6208c82fc019e38177d0a2eb248ca8a972b7277082afe2d000000000000000000000000000000000000000000000000000000000000000800405973070000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000060b23b6090393d37a5395752e931391259605d42964de1506389e9957aa1fa2f519d3e7e6ba524a6ee99aa28aadd0f89bc02fd8a209b9e3864595168c9950fe0a3451f74e7b25999cb6631928e25e35686c40232bc4b04e4157b9d943d79cff25f00000000000000000000000000000000000000000000000000000000000000086801000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc1300",
      "transactionHash": "0xc4721282a979c934a0125addbefe73e267c330b191634881425b99b95e5c1282",
      "transactionIndex": "0x19",
      "blockHash": "0x7ceeb887c7e9bc55efc314daedfee9fa544d42b11172ca863fbecb547066840f",
      "logIndex": "0x1c",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000140000000000000000000000000000000000000000000000000000000000000018000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000030a7edf541a757257dbe3184ac50b6b8acda1dd2f9f8b3f2466f2443a5715e7e593502c1536f47e7c87b68a4b236af39fe000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020010000000000000000000000299248561958f4c4c6a25168317a5361ddae794d00000000000000000000000000000000000000000000000000000000000000080040597307000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000006099a1be4088af15d4b69f143131fee3750211e0c5ac9f8f1f9a6b78b04f504daaed50d796d9fd02e89e866266117530d902fbeb1a49c7cdeb71c9d6b6532fdd00bf042a04cd57b6494d2d4756359e96b17af54231c3d92ac0e7ac258b137b244d00000000000000000000000000000000000000000000000000000000000000086901000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc139b",
      "transactionHash": "0xabe98a9103b6655f972844f0690f97880987e1819f944c16f4fc11ba77eb5114",
      "transactionIndex": "0x11",
      "blockHash": "0x55c210a54ffe94866f1f0bd41421802467bfe949757c7167ec0c7c072fc66b7f",
      "logIndex": "0x1b",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a0000000000000000000000000000000000000000000000000000000000000010000000000000000000000000000000000000000000000000000000000000001400000000000000000000000000000000000000000000000000000000000000180000000000000000000000000000000000000000000000000000000000000020000000000000000000000000000000000000000000000000000000000000000308c37e43ab1e40eea73cd8bc34755909222bb80e059c8bc0986079037857cab8c45a2778787a567dace538c5d2374304d000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000020010000000000000000000000b655b39d3ca5f26d04e6185fc204ace6fb016a02000000000000000000000000000000000000000000000000000000000000000800405973070000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000060923c6630c22f1e6806a2d49e33bcd454499065b50284c73599726ced4de8b3db19c5c13c6949f7e9b2811c8f54c4c5e415f7d2ffcade61d8115cf3b280fe744bf84afdc2b2af3a73da3475c9af8794d819ad8e17e31fd9184602789ca782c7af00000000000000000000000000000000000000000000000000000000000000086a01000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc13bb",
      "transactionHash": "0xb2aa7a1636e632775b0e642d5e07776cf5f51feeced478103bf6fe66c87089ca",
      "transactionIndex": "0x16",
      "blockHash": "0x21fa0ca6d14d56652a8145daa7d42d205f1e25a027966a8fd3b67f3d3ee87df8",
      "logIndex": "0x14",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a00000000000000000000000000000000000000000000000000000000000000100000000000000000000000000000000000000000000000000000000000000014000000000000000000000000000000000000000000000000000000000000001800000000000000000000000000000000000000000000000000000000000000200000000000000000000000000000000000000000000000000000000000000003099c383af390ac6d7e5429fa8aeb28ad0a4c508f1a1cdd185e24a0befecc58af9b0e807a29137e9ae543a955052ba6ed80000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000200095232e43b5cf9deee4f2f7475fdc40cd135d9bf06264fba2f6f445adae0d8800000000000000000000000000000000000000000000000000000000000000080040597307000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000006090228ef0215fde24887a5cfc87ffe313385c8c8f83db5cf3bee7e8f2e140039abf20859bdf908916f5a29cd873858f17123f8642d45234f80cf17ad5c9942689f9a1a45d2c1d182a21e02902dced4df42f21369793b2adbe10e0c15cfbd0b92700000000000000000000000000000000000000000000000000000000000000086b01000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc13d0",
      "transactionHash": "0x94c0193c2b6bd5578f029d661d320c44cf9b82f54332decfd6a1bc74c4e9c975",
      "transactionIndex": "0x7",
      "blockHash": "0xcfe22da8bb3c1d778873f5adac34ac918956799320792013cff6e518e4f8c477",
      "logIndex": "0x3",
      "removed": false
    },
    {
      "address": "0x6f22ffbc56eff051aecf839396dd1ed9ad6bba9d",
      "topics": [
        "0x649bbc62d0e31342afea4e5cd82d4049e7e1ee912fc0889aa790803be39038c5"
      ],
      "data": "0x00000000000000000000000000000000000000000000000000000000000000a000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000140000000000000000000000000000000000000000000000000000000000000018000000000000000000000000000000000000000000000000000000000000002000000000000000000000000000000000000000000000000000000000000000030949deeea852e91777e02dcef8a42deb0faf933b14a2351585dcd78f106cadd41258eb198a7c2ef94116d60a35c82e8cb00000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000002000f33ddce3711fc58ef6fe045d59032d434d3c1cf1c0d975177e84d1e5d2ad1e000000000000000000000000000000000000000000000000000000000000000800405973070000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000060a4224c235cfb4aeacfad8dcdc37c6c61e35700814514136b29bc372aeb325e2f245f38bf635a67a089662f22f7d4417f05ca9a7e10682c3f348a13de4cd4300c000641a8c9da3103a96009ef79d908e86904e45868fc646ecc5922b731e3c3d800000000000000000000000000000000000000000000000000000000000000086c01000000000000000000000000000000000000000000000000000000000000",
      "blockNumber": "0xbc13e9",
      "transactionHash": "0x46985a04fc907df279f5905f087a74a66ceff82095675f2942c820ffb81f74c7",
      "transactionIndex": "0x25",
      "blockHash": "0xdbc5703d4c325f761ed9031f585cda75aa38cb75126065e3d92e48aa3ddb6148",
      "logIndex": "0x40",
      "removed": false
    }
  ]
}

@SeaMonkey82
Copy link
Author

SeaMonkey82 commented Jul 28, 2022

For what it's worth, I'm not seeing this error on goerli-prysm-besu pre-merge.

@mandrigin
Copy link
Collaborator

curl 'http://erigon' \
  -H 'accept: application/json' \
  -H 'content-type: application/json' \
  --data-raw '{"id":848101922,"jsonrpc":"2.0","method":"eth_getLogs","params":[{"fromBlock":"0x757e20","toBlock":"latest","address":"0x888ea6ab349c854936b98586ce6a17e98bf254b2","topics":["0x2a65d0fe76508fb4e604d4804927dce75b70f82e64a2025e3bffb2fc00341850","0x0000000000000000000000000000000000000000000000000000000000000028"]}]}'

{"jsonrpc":"2.0","id":848101922,"result":[]}

Erigon params: /home/erigon/erigon/build/bin/erigon --datadir /data/erigon --prune=htc --private.api.addr 127.0.0.1:9090

RPC daemon: /home/erigon/erigon/build/bin/rpcdaemon --datadir /data/erigon --http.api web3,eth,net --http.addr 10.2.0.7 --http.vhosts '*' --http.corsdomain='*' --ws --verbosity 4

Affected the "stable" branch, but we need to try on the alpha one.

@mandrigin
Copy link
Collaborator

infura returns logs just fine

curl 'https://mainnet.infura.io/v3/<apikey> \
  -H 'accept: application/json' \
  -H 'content-type: application/json' \
  --data-raw '{"id":848101922,"jsonrpc":"2.0","method":"eth_getLogs","params":[{"fromBlock":"0x757e20","toBlock":"latest","address":"0x888ea6ab349c854936b98586ce6a17e98bf254b2","topics":["0x2a65d0fe76508fb4e604d4804927dce75b70f82e64a2025e3bffb2fc00341850","0x0000000000000000000000000000000000000000000000000000000000000028"]}]}'

{"jsonrpc":"2.0","id":848101922,"result":[{"address":"0x888ea6ab349c854936b98586ce6a17e98bf254b2","blockHash":"0x3143d2db44999476f302f6770c1ad0c7100d05f6f62f408b7f1cac687efedfe6","blockNumber":"0xbeff13","data":"0x00000000000000000000000000000000000000000000000000000000000000400000000000000000000000000000000000000000000000000000000000000080000000000000000000000000000000000000000000000000000000000000001e55706461746520506f6f6c206164647265737320706172616d65746572730000000000000000000000000000000000000000000000000000000000000000002e516d5942747a4a4c3650746f6e57317a57484b34394e6f754d777743417269513633613574736a6f76725639427a000000000000000000000000000000000000","logIndex":"0xc1","removed":false,"topics":["0x2a65d0fe76508fb4e604d4804927dce75b70f82e64a2025e3bffb2fc00341850","0x0000000000000000000000000000000000000000000000000000000000000028"],"transactionHash":"0x22ea4cb0aa346592f0e62cc52389ed47798a501e27c6198d882ba7af31a89134","transactionIndex":"0x5d"}]}

@SeaMonkey82
Copy link
Author

SeaMonkey82 commented Sep 27, 2022

Came back to this issue because I'm seeing the same thing in goerli-prysm-erigon now.

[2022-09-26 21:28:21] ERROR powchain: Could not process deposit log: received incorrect merkle index: wanted 181465 but got 182416

and

Missing logs with goerli-lodestar-erigon

Sep-26 22:01:16.362[eth1]            error: Error updating eth1 chain cache  code=ETH1_ERROR_NON_CONSECUTIVE_LOGS, newIndex=182452, lastLogIndex=181358
Error: ETH1_ERROR_NON_CONSECUTIVE_LOGS
    at Eth1DepositsCache.add (file:///home/seamonkey/Downloads/goerli/lodestar/packages/beacon-node/src/eth1/eth1DepositsCache.ts:93:15)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)
    at Eth1DepositDataTracker.updateDepositCache (file:///home/seamonkey/Downloads/goerli/lodestar/packages/beacon-node/src/eth1/eth1DepositDataTracker.ts:244:5)
    at Eth1DepositDataTracker.update (file:///home/seamonkey/Downloads/goerli/lodestar/packages/beacon-node/src/eth1/eth1DepositDataTracker.ts:207:33)
    at Eth1DepositDataTracker.runAutoUpdate (file:///home/seamonkey/Downloads/goerli/lodestar/packages/beacon-node/src/eth1/eth1DepositDataTracker.ts:170:29)

@OndrejKuchta
Copy link

OndrejKuchta commented Oct 5, 2022

I'm getting the same log on Mainnet Erigon(v2022.10.1)+Prysm(3.1.1):

time="2022-10-05 12:09:20" level=error msg="Unable to process past deposit contract logs, perhaps your execution client is not fully synced" error="Could not process deposit log: received incorrect merkle index: wanted 429299 but got 431983" prefix=powchain

@SeaMonkey82
Copy link
Author

The fix for missing deposit logs seems to be running the CL client in checkpoint sync mode. This worked for me both with prysm-erigon and teku-erigon on Goerli.

@rhmaxdotorg
Copy link

@SeaMonkey82 is there a flag or config to enable checkpoint sync mode?

I'm having this issue with prysm + erigon as well.

*blockchain.Service: OK
*initialsync.Service: OK
*sync.Service: OK
*builder.Service: OK
*prometheus.Service: OK
*execution.Service: ERROR, Could not process deposit log: received incorrect merkle index: wanted 0 but got 191015
*attestations.Service: OK
*rpc.Service: OK
*gateway.Gateway: OK
*p2p.Service: OK

@SeaMonkey82
Copy link
Author

@SeaMonkey82 is there a flag or config to enable checkpoint sync mode?

https://docs.prylabs.network/docs/prysm-usage/checkpoint-sync

@yperbasis
Copy link
Member

Please re-open if it's still the case with v2.59.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants