Implement Blob Decoupling

[StefanBratanov]

EIP-4844: Free the blobs #3244

SSZ Containers

• [DECOUPLING] Add BlobSidecar container #6776

KZG

• [DECOUPLING] Add KZG multi verify function #6782

Gossip

• [DECOUPLING] Add blob_sidecar gossip topic #6777

RPC

• [DECOUPLING] Implement BlobSidecarByRange RPC method #6778
• [DECOUPLING] Implement getBlobSidecarBySlotAndBlockRoot #6821
• [DECOUPLING] Implement BlobSidecarsByRoot RPC method #6830
• Add BlobSidecarsByRangeIntegrationTest #6834
• Change maximum number of blocks in an RPC request #6870
• Make sure BlobSidecarByRange RPC responds with only canonical blobs #7246

Block Import and State Transition

• Change BlobsSidecarManager to import blob sidecars in similar fashion to BlockManager #6848
• Implement BlobSidecar pooling #6849
• Implement BlobSidecarsAvailabilityChecker #7080
• Integrate ForkChoice:onBlock with new async BlobSidecarsAvailabilityChecker #7110
• BlobSidecar fetch retry on DATA_UNAVAILABLE #7112

Validator Coordinator

• Revisit block production

Sync

• Implement Forward Sync for Decoupled Blobs #6948
• Implement RecentBlobSidecarFetcher #6985
• Implement Historical Syncing for Deneb #7010
• Sync state tracker must be Data Availability aware #7243
• Improve Historical Sync to speed up backfill #7244

Engine API

• Merge getPayloadV3 and getBlobsBundleV1 ethereum/execution-apis#402

Builder API

• Implement updated builder apis #7170

Storage

• Add BlobSidecars to ChainBuilder #6837
• Integrate BlobSidecars in Store and StoreTransaction #7111

Beacon API

• Add getBlobsSidecar endpoint  #6781
• [DECOUPLING] Beacon API SSZ containers #6819
• [DECOUPLING] Update the GetNewBlindedBlock endpoint #7012
• Update the PostBlock endpoint #7013
• [DECOUPLING] Update the GetNewBlock endpoint #7019
• Implement Deneb GetBlock endpoint #7048
• Update the PostBlindedBlock API #7075

Validator Client

• Implement sendBlobSidecar in ValidatorApiChannel  #6967
• [DEOCUPLING] Blob Sidecars Validator's signing #6959
• Implement blob sidecars external signing #6963
• Implement createUnsignedBlobSidecar in ValidatorApiChannel #6966
• Remote call from VC -> BN for creating/sending BlockContents

Cleanup

• [DECOUPLING] Remove BlobsSidecarsByRange RPC method #6831
• [DECOUPLING] Remove BeaconBlockAndBlobsSidecar gossip and RPC method #6832
• [DECOUPLING] Remove old containers/schemas  #6833
• Remove old way of historical and recent block sync with coupled blobs
• Remove old way of forward sync with coupled blobs
• Remove TODO: remove when blobs decoupling sync is implemented and TODO: remove once the block publishing is switched to a decoupling version

Nice to have

• Retrieve available blobs only #6880
• Refactor blob sidecars slot and indices iteration #6881

[StefanBratanov]

Finally closing this since all tasks are done :)