lib(runtime/wazero): next_key returned a key with no value at []

[EclesioMeloJunior]

Describe the bug

• Sync stalled after the log

2023-09-02T05:39:32Z CRITICAL target=frame_support::storage message=next_key returned a key with no value at [] ext_logging_log_version_1 pkg=runtime module=wazero

• The problem could be related to

  • ext_storage_next_key_version_1
  • ext_default_child_storage_next_key_version_1

• Looks like the it tries to retrieve the value is empty, the empty brackets in the message [...] at [] is supposed to be the key so the host function *_next_key_version_1 is returning empty (should it return None)

• Links to substrate where the log happens

  • https://github.com/paritytech/polkadot-sdk/blob/ddab7156b4d579516d81a8ae3b6233250bd2ba45/substrate/frame/support/src/storage/mod.rs#L1031
  • https://github.com/paritytech/polkadot-sdk/blob/ddab7156b4d579516d81a8ae3b6233250bd2ba45/substrate/frame/support/src/storage/mod.rs#L1244

• The log happens after finalizing the block #7280128 and it does not show what block/extrinsic call drives that

[EclesioMeloJunior]

By using the polkadot/crowdloan pallet I could simulate the error using the ChildTriePrefixIterator which returns an iterator that goes over the ext_default_child_storage_next_key_version_1