Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

sim/pyspec: bubble error #777

Merged
merged 1 commit into from
May 5, 2023
Merged

sim/pyspec: bubble error #777

merged 1 commit into from
May 5, 2023

Conversation

holiman
Copy link
Collaborator

@holiman holiman commented May 5, 2023

This fixes #774. It also adds support for -sim.limit
Example:

user@debian-work:~/workspace/hive$ ./hive --sim ethereum/pyspec --client go-ethereum_latest  --sim.loglevel 3 --docker.output -sim.limit=pyspec/invalid_blob_txs
INFO[05-05|14:14:41] running simulation: ethereum/pyspec 
INFO[05-05|14:14:42] hiveproxy started                        container=1f6d4f6eb159 addr=172.17.0.2:8081
INFO[05-05|14:14:42] API: suite started                       suite=0 name=pyspec
INFO[05-05|14:14:42] API: test started                        suite=0 test=1 name=pytest_fixture_runner
[34c50e31] parallelism set to: 1
[34c50e31] file root directory: /fixtures/
[34c50e31] skip eips/eip3651/warm_coinbase_call_out_of_gas
[34c50e31] skip eips/eip3651/warm_coinbase_gas_usage
INFO[05-05|14:14:42] API: test started                        suite=0 test=2 name=eips/eip4844/excess_data_gas/invalid_blob_txs/000/type_3_tx_pre_fork/shanghai
INFO[05-05|14:14:42] API: test ended                          suite=0 test=2 pass=false
[34c50e31] skip eips/eip3855/push0
INFO[05-05|14:14:42] API: test started                        suite=0 test=3 name=eips/eip4844/excess_data_gas/invalid_blob_txs/001/empty_type_3_tx_pre_fork/shanghai
INFO[05-05|14:14:42] API: test ended                          suite=0 test=3 pass=false
[34c50e31] skip eips/eip3860/initcode_limit_contract_creating_tx
[34c50e31] skip eips/eip3860/initcode_limit_contract_creating_tx_gas_usage
[34c50e31] skip eips/eip3860/initcode_limit_create2_opcode
[34c50e31] skip eips/eip3860/initcode_limit_create_opcode
INFO[05-05|14:14:42] API: test ended                          suite=0 test=1 pass=true
INFO[05-05|14:14:42] API: suite ended                         suite=0
[34c50e31] test invalid_blob_txs.json / 000/type_3_tx_pre_fork/shanghai: unable to extract fixture fields: failed to decode block: transaction type not supported
[34c50e31] test invalid_blob_txs.json / 001/empty_type_3_tx_pre_fork/shanghai: unable to extract fixture fields: failed to decode block: transaction type not supported
[34c50e31] setting variables required for starting client.
[34c50e31] test failed early: unable to extract fixture fields: failed to decode block: transaction type not supported
[34c50e31] skip example/acl_example/access_list
[34c50e31] skip example/yul_example/yul
[34c50e31] skip security/selfdestruct_balance_bug/tx_selfdestruct_balance_bug
[34c50e31] skip vm/chain_id/chain_id
[34c50e31] skip vm/dup/dup
[34c50e31] skip withdrawals/withdrawals/balance_within_block
[34c50e31] skip withdrawals/withdrawals/large_amount
[34c50e31] skip withdrawals/withdrawals/many_withdrawals
[34c50e31] skip withdrawals/withdrawals/multiple_withdrawals_same_address
[34c50e31] skip withdrawals/withdrawals/newly_created_contract
[34c50e31] skip withdrawals/withdrawals/no_evm_execution
[34c50e31] skip withdrawals/withdrawals/self_destructing_account
[34c50e31] skip withdrawals/withdrawals/use_value_in_contract
[34c50e31] skip withdrawals/withdrawals/use_value_in_tx
[34c50e31] skip withdrawals/withdrawals/zero_amount
[34c50e31] setting variables required for starting client.
[34c50e31] test failed early: unable to extract fixture fields: failed to decode block: transaction type not supported
[34c50e31] failing tests:
[34c50e31] go-ethereum_latest/eips/eip4844/excess_data_gas/invalid_blob_txs/000/type_3_tx_pre_fork/shanghai: unable to extract fixture fields: failed to decode block: transaction type not supported
[34c50e31] go-ethereum_latest/eips/eip4844/excess_data_gas/invalid_blob_txs/001/empty_type_3_tx_pre_fork/shanghai: unable to extract fixture fields: failed to decode block: transaction type not supported
INFO[05-05|14:14:43] simulation ethereum/pyspec finished      suites=1 tests=3 failed=2

@holiman holiman merged commit 1b2273d into ethereum:master May 5, 2023
mattsse pushed a commit to paradigmxyz/hive that referenced this pull request May 12, 2023
* simulators/ethereum/engine: send `eth_` requests to port 8545 (ethereum#752)

simulators/ethereum/engine: send `eth_` requests to 8545

* clients/ethereumjs: Update branch (ethereum#753)

* clients/ethereumjs: Change git branch

* clients/ethereumjs: Fix bash script issues

* simulators/ethereum/engine: node: unsubscribe from events

* simulators/ethereum/engine: clmock: add extra logs

* simulators/ethereum/engine: correctly stop secondary clients

* simulators/eth2/common: create client interfaces, update mock builder (ethereum#738)

* simulators/eth2/common: refactor clients

* simulators/eth2/engine: fixes due to refactor

* simulators/eth2/common: builder: invalidate payloads

* simulators/eth2/common: builder readme

* simulators/eth2/common: builder: add option to build a payload on an outdated version

* simulators/eth2/withdrawals: add invalid built payload version test

* simulators/eth2/common: builder: remove check to build invalid payload

* simulators/eth2/withdrawals: Fix check

* simulators/eth2/withdrawals: test case validation

* simulators/eth2/common: builder: fix invalidation

* simulators/eth2/withdrawals: fix verifications again

* simulators/ethereum/pyspec: Comment Dockerfile to run local fixtures (ethereum#755)

simulators/ethereum/pyspec: Add Dockerfile comment to run locally generated fixtures

* clients/besu: add --data-storage-format=BONSAI  (ethereum#758)

* simulators/ethereum/engine: Unique Payload ID Tests (ethereum#757)

* simulators/ethereum/engine: expose generic fcu, np

* simulators/ethereum/engine: Unique payload id test

* simulators/ethereum/engine: Add payload id test

* simulators/ethereum/engine: Parallel getPayloadBodies Test (ethereum#749)

* simulators/ethereum/engine: parallel getpayloadbodies

* simulators/ethereum/withdrawals: readme

* clients/erigon: --externalcl flag is not supported anymore (ethereum#760)

* graphql: consistent rule for Long outputs and args (ethereum#746)

* simulators/eth2: Verify block signatures on blocks sent to builder (ethereum#756)

* simulators/eth2/common/builder: interfaces changes

* simulators/eth2/common/builder: verify signatures

* simulators/eth2/withdrawals: Verify block signatures

* simulators/eth2/withdrawals: Update README

* simulators/eth2/withdrawals: minor nit comment

* clients/erigon: explicit --db.size.limit value (ethereum#766)

* clients/nethermind: Cancun support (ethereum#762)

* clients/nethermind: Cancun Support

* clients/nethermind: Dockerfile args

* clients/besu: Cancun Support (ethereum#769)

* clients/ethereumjs: Cancun Support (ethereum#768)

clients/ethereumjs: Cancun Support.

* clients/go-ethereum: remove deprecated PoW (ethereum#773)

Remove ethash-related flags and utils from go-ethereum, since they were
deprecated upstream.

---------

Co-authored-by: Martin Holst Swende <[email protected]>

* clients/nethermind: Add excessDataGas to genesis mapper. (ethereum#771)

* sim/pyspec: bubble error (ethereum#777)

* simulators/devp2p: fix issue causing ethereumjs to crash (ethereum#778)

sim/devp2p: fix issue causing ethereumjs to crash

It seems ethereumjs crashes if the chainid is not present in the genesis.

---------

Co-authored-by: Mario Vega <[email protected]>
Co-authored-by: Gabriel Fukushima <[email protected]>
Co-authored-by: Andrew Ashikhmin <[email protected]>
Co-authored-by: Sina Mahmoodi <[email protected]>
Co-authored-by: Spencer Taylor-Brown <[email protected]>
Co-authored-by: Martin Holst Swende <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

pyspec simulator failure
1 participant