base-org / blob-archiver Goto Github PK

View Code? Open in Web Editor NEW

62.0 62.0 33.0 175 KB

License: MIT License

Dockerfile 0.41% Makefile 1.35% Go 98.23%

blob-archiver's People

Contributors

Stargazers

Watchers

blob-archiver's Issues

Add license

Ge,
Can you add a license? It would be useful in case someone wants to use this repository.
Thanks

Add blob validation

Currently the API and Archiver require a trusted L1 endpoint.

We should add an option to verify the blobs (see the op-stack verification here) to both the Archiver and API.

Consolidate Beacon Clients

Currently we use a different beacon client from the optimism monorepo. It would be nice to consolidate efforts in to a single library.

The blob archiver uses go-eth-2 while the optimism monorepo has its own implementation.

This is due to go-eth-2 supporting SSZ of blob types out of the box. It would be ideal to combine efforts by either:

Migrating the monorepo to go-eth-2
Adding SSZ support to the monorepo and migrating the blob-archiver to use the client there.

failed to decode blob sidecars: xx

I trying to set up blob-archiver using docker-compose up and connecting it to my beacon node (with Prysm)
I am getting this error, no idea how to fix it:

archiver_1        | t=2024-03-16T13:12:54+0000 lvl=info msg="Initializing Archiver Service"
archiver_1        | {"level":"trace","service":"client","impl":"http","time":"2024-03-16T13:12:54Z","message":"Context done; closing connection"}
archiver_1        | t=2024-03-16T13:12:54+0000 lvl=info msg="starting metrics server"       addr=0.0.0.0 port=7300
archiver_1        | t=2024-03-16T13:12:54+0000 lvl=info msg="started metrics server"        addr=[::]:7300
archiver_1        | t=2024-03-16T13:12:54+0000 lvl=info msg="Archiver API server started"   address=[::]:8000
archiver_1        | {"level":"trace","service":"client","impl":"http","id":"1de5098c","address":"http://MY_BEACON_NODE:PORT","endpoint":"/eth/v1/beacon/headers/head","time":"2024-03-16T13:12:54Z","message":"GET request"}
archiver_1        | {"level":"trace","service":"client","impl":"http","id":"3ac0b1c","address":"http://MY_BEACON_NODE:PORT","endpoint":"/eth/v1/beacon/blob_sidecars/0xb02f2ca9c5892a4e6a31bea43be747f8f1232a419c012b81d306d86e4a92c207","time":"2024-03-16T13:12:54Z","message":"GET request"}
blob-archiver_create-buckets_1 exited with code 0
archiver_1        | t=2024-03-16T13:12:54+0000 lvl=eror msg="failed to fetch blob sidecars" err="failed to decode blob sidecars: xx"
archiver_1        | {"level":"trace","service":"client","impl":"http","id":"2a5b3e44","address":"http://MY_BEACON_NODE:PORT","endpoint":"/eth/v1/beacon/headers/head","time":"2024-03-16T13:12:55Z","message":"GET request"}
archiver_1        | {"level":"trace","service":"client","impl":"http","id":"11b6f22f","address":"http://MY_BEACON_NODE:PORT","endpoint":"/eth/v1/beacon/blob_sidecars/0xb02f2ca9c5892a4e6a31bea43be747f8f1232a419c012b81d306d86e4a92c207","time":"2024-03-16T13:12:55Z","message":"GET request"}
archiver_1        | t=2024-03-16T13:12:55+0000 lvl=eror msg="failed to fetch blob sidecars" err="failed to decode blob sidecars: xx"
archiver_1        | {"level":"trace","service":"client","impl":"http","id":"4a71ead8","address":"http://MY_BEACON_NODE:PORT","endpoint":"/eth/v1/beacon/headers/head","time":"2024-03-16T13:12:58Z","message":"GET request"}
archiver_1        | {"level":"trace","service":"client","impl":"http","id":"498b6717","address":"http://MY_BEACON_NODE:PORT","endpoint":"/eth/v1/beacon/blob_sidecars/0xb02f2ca9c5892a4e6a31bea43be747f8f1232a419c012b81d306d86e4a92c207","time":"2024-03-16T13:12:58Z","message":"GET request"}
archiver_1        | t=2024-03-16T13:12:58+0000 lvl=eror msg="failed to fetch blob sidecars" err="failed to decode blob sidecars: xx"
archiver_1        | t=2024-03-16T13:12:58+0000 lvl=eror msg="failed to seed archiver with initial block" err="operation failed permanently after 3 attempts: failed to decode blob sidecars: xx"
archiver_1        | t=2024-03-16T13:12:58+0000 lvl=crit msg="Application failed"            message="failed to start: operation failed permanently after 3 attempts: failed to decode blob sidecars: xx"
blob-archiver_archiver_1 exited with code 1

I've checked my beacon api endpoint, it returns the data and blob successfully. Any advise?

Unreviewed commit on master!

Unreviewed commit(s) COMPARE was merged to master by danyalprout.

Comment with appropriate number of 👍 to approve.

Reviewed requirements satisfied? No
Ancestors reviewed? Yes