eth rpc restarts in prod

[shunjizhan]

if everything is perfect, it should keep running for a long time, need to figure out why it restarts

[zjb0807]

eth-rpc-adapter log of blockscout

80fd5b60008083601f8401126114d0576114cf6114ab565b5b8235905067ffffffffffffffff8111156114ed576114ec6114b0565b5b602083019150836020820283011115611509576115086114b5565b5b9250929050565b60008083601f840112611526576115256114ab565b5b8235905067ffffffffffffffff811115611543576115426114b0565b5b60208301915083602082028301111561155f5761155e6114b5565b5b9250929050565b600080600080604085870312156115805761157f611289565b5b600085013567ffffffffffffffff81111561159e5761159d61128e565b5b6115aa878288016114ba565b9450945050602085013567ffffffffffffffff8111156115cd576115cc61128e565b5b6115d987828801611510565b925092505092959194509250565b6115f0816112b3565b82525050565b600060208201905061160b60008301846115e7565b92915050565b6000806040838503121561162857611627611289565b5b6000611636858286016112dc565b9250506020611647858286016112dc565b9150509250929050565b7f4e487b7100000000000000000000000000000000000000000000000000000000600052602260045260246000fd5b6000600282049050600182168061169857607f821691505b6020821081036116ab576116aa611651565b5b50919050565b7f3c6d696e743e206e6f206d696e74207065726d697373696f6e00000000000000600082015250565b60006116e76019836111e2565b91506116f2826116b1565b602082019050919050565b60006020820190508181036000830152611716816116da565b9050919050565b7f3c6d696e7442617463683e206e6f206d696e74207065726d697373696f6e0000600082015250565b6000611753601e836111e2565b915061175e8261171d565b602082019050919050565b6000602082019050818103600083015261178281611746565b9050919050565b7f3c6d696e7442617463683e206164647220616e6420616d6f756e74206c656e6760008201527f746873206d69736d617463680000000000000000000000000000000000000000602082015250565b60006117e5602c836111e2565b91506117f082611789565b604082019050919050565b60006020820190508181036000830152611814816117d8565b9050919050565b7f4e487b7100000000000000000000000000000000000000000000000000000000600052603260045260246000fd5b600060608201905061185f60008301866115e7565b61186c602083018561139d565b611879604083018461139d565b949350505050565b7f4e487b7100000000000000000000000000000000000000000000000000000000600052601160045260246000fd5b60006118bb826112f1565b91506118c6836112f1565b92508282019050808211156118de576118dd611881565b5b9291505056fea2646970667358221220e41b61bbf7b2ebbf1679e9cf18eae37bea3cd6bd9a7b131139cf397317bb7ca964736f6c63430008180033"},"msg":"✨ response"}
2024-08-14 16:47:25        RPC-CORE: getHeader(hash?: BlockHash): Header:: disconnected from wss://acala-internal-rpc.aca-api.network:8443: 1006:: Abnormal Closure
2024-08-14 16:47:37        RPC-CORE: getHeader(hash?: BlockHash): Header:: disconnected from wss://acala-internal-rpc.aca-api.network:8443: 1006:: Abnormal Closure
2024-08-14 16:47:40        RPC-CORE: call(method: Text, data: Bytes, at?: BlockHash): Bytes:: No response received from RPC endpoint in 60s
2024-08-14 16:47:40        RPC-CORE: call(method: Text, data: Bytes, at?: BlockHash): Bytes:: No response received from RPC endpoint in 60s
2024-08-14 16:47:40        RPC-CORE: call(method: Text, data: Bytes, at?: BlockHash): Bytes:: No response received from RPC endpoint in 60s
2024-08-14 16:47:40        RPC-CORE: call(method: Text, data: Bytes, at?: BlockHash): Bytes:: No response received from RPC endpoint in 60s
2024-08-14 16:47:40        RPC-CORE: call(method: Text, data: Bytes, at?: BlockHash): Bytes:: No response received from RPC endpoint in 60s
2024-08-14 16:47:40        RPC-CORE: call(method: Text, data: Bytes, at?: BlockHash): Bytes:: No response received from RPC endpoint in 60s
2024-08-14 16:47:50        RPC-CORE: getHeader(hash?: BlockHash): Header:: disconnected from wss://acala-internal-rpc.aca-api.network:8443: 1006:: Abnormal Closure
2024-08-14 16:47:50        RPC-CORE: getHeader(hash?: BlockHash): Header:: No response received from RPC endpoint in 60s
2024-08-14 16:47:50        RPC-CORE: getHeader(hash?: BlockHash): Header:: No response received from RPC endpoint in 60s
2024-08-14 16:47:50        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
2024-08-14 16:47:50        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
2024-08-14 16:47:51        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
2024-08-14 16:47:51        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
2024-08-14 16:47:52        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
2024-08-14 16:47:52        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
2024-08-14 16:47:53        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
2024-08-14 16:47:53        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
2024-08-14 16:47:54        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
_onNewFinalizedHead task failed, give up 0x4118b4550f421e8cad8583a0d44593aefcc59cb7613946cc4c197ddf88d54ef0 Error: No response received from RPC endpoint in 60s
2024-08-14 16:47:54        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
_onNewFinalizedHead task failed, give up 0x588c3eb814658ae5a066a99d5748e45543c01ed159bc483c043a2c38f247ff9d Error: No response received from RPC endpoint in 60s
2024-08-14 16:47:56        RPC-CORE: getStorage(key: StorageKey, at?: BlockHash): StorageData:: No response received from RPC endpoint in 60s
2024-08-14 16:47:56        RPC-CORE: getStorage(key: StorageKey, at?: BlockHash): StorageData:: No response received from RPC endpoint in 60s
2024-08-14 16:47:56        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
2024-08-14 16:47:56        RPC-CORE: getStorage(key: StorageKey, at?: BlockHash): StorageData:: No response received from RPC endpoint in 60s
2024-08-14 16:47:56        RPC-CORE: getStorage(key: StorageKey, at?: BlockHash): StorageData:: No response received from RPC endpoint in 60s
2024-08-14 16:47:56        RPC-CORE: getStorage(key: StorageKey, at?: BlockHash): StorageData:: No response received from RPC endpoint in 60s
2024-08-14 16:47:56        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
2024-08-14 16:47:56        RPC-CORE: getStorage(key: StorageKey, at?: BlockHash): StorageData:: No response received from RPC endpoint in 60s
2024-08-14 16:47:57        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
2024-08-14 16:47:57        RPC-CORE: getStorage(key: StorageKey, at?: BlockHash): StorageData:: No response received from RPC endpoint in 60s
2024-08-14 16:47:57        RPC-CORE: getBlock(hash?: BlockHash): SignedBlock:: No response received from RPC endpoint in 60s
2024-08-14 16:47:57        RPC-CORE: getStorage(key: StorageKey, at?: BlockHash): StorageData:: No response received from RPC endpoint in 60s
/app/node_modules/@polkadot/api/cjs/base/Init.js:148
            throw new Error('Unable to retrieve header and parent from supplied hash');
                  ^

Error: Unable to retrieve header and parent from supplied hash
    at ApiPromise._getBlockRegistryViaHash (/app/node_modules/@polkadot/api/cjs/base/Init.js:148:19)
    at processTicksAndRejections (node:internal/process/task_queues:96:5)

It seems that eth_getCode puts too much load on the node

{"level":20,"time":1723653985713,"pid":1,"hostname":"8a0d379858a8","dd":{"trace_id":"1587659674534353339","span_id":"6269908281131761906","service":"eth rpc","version":"2.8.7"},"0":{"id":0,"jsonrpc":"2.0","method":
"eth_getCode","params":["0x0000000000000000000000000000000000000000","0x564100"]},"1":{"id":1,"jsonrpc":"2.0","method":"eth_getCode","params":["0x0000000000000000000000000000000000000000","0x564101"]},"2":{"id":2,"
jsonrpc":"2.0","method":"eth_getCode","params":["0x0000000000000000000000000000000000000000","0x5641B5"]},"3":{"id":3,"jsonrpc":"2.0","method":"eth_getCode","params":["0x0000000000000000000000000000000000000000","0
x5641B5"]},"4":{"id":4,"jsonrpc":"2.0","method":"eth_getCode","params":["0x2abb17f36fed70412efbe2a10f639fc28b6dd4b9","0x59A043"]},"5":{"id":5,"jsonrpc":"2.0","method":"eth_getCode","params":["0x125a0384792b3505da5c
3a571c973cf14f605954","0x59A043"]},"6":{"id":6,"jsonrpc":"2.0","method":"eth_getCode","params":["0x52466a4759be5bfb880e38dc90dc4c2ec8ad9fcb","0x59A0D4"]},"7":{"id":7,"jsonrpc":"2.0","method":"eth_getCode","params":
["0x3f20a40d596dda7a1093f5277bf333fa1a701a5d","0x5B8B8C"]},"8":{"id":8,"jsonrpc":"2.0","method":"eth_getCode","params":["0x0000000000000000000000000000000000000000","0x1F4610"]},"9":{"id":9,"jsonrpc":"2.0","method"
:"eth_getCode","params":["0x45c720c13fa1b5504d283d441e35cb4156f727db","0x5B8B86"]},"msg":"⬇ request"}