The blob-hub service acts as an intermediary between Greenfield and Ethereum/BSC, continuously retrieving blobs from Ethereum/BSC and persisting in Greenfield.. These blobs, collected from a specific Beacon slot range on Ethereum or specific block height range on BSC, are consolidated into a bundle and transmitted to the Bundle Service for further processing. Subsequently, the bundle is stored in Greenfield for long-term archival purposes. Additionally, the blob-hub service offers APIs that enable users to access and retrieve historical blobs as needed.
- Data Accessibility. Due to the limited size of the Greenfield traffic package purchased, this service does not guarantee constant data access but ensures eventual access.
- Data latency. As the blob syncer need to bundle blobs across multi blocks, the latency is around 10-20 minutes before the blob is accessible on Greenfield.
- syncer: This component is specifically engineered to synchronize blobs and securely store them in Greenfield. It includes a post-verification process to ensure the integrity of blob storage.
- server: This component functions as the API server, catering to users' requests for querying blobs.
| Network | Endpoint | Bucket |
|---|---|---|
| Ethereum | https://gnfd-blobhub.bnbchain.org | ethereum-mainnet-blobs |
| BSC | https://gnfd-blobhub-bsc.bnbchain.org | bsc-mainnet-blobs |
The Blob hub server provides eth compatible API to query historical blob
- GET /eth/v1/beacon/blob_sidecars/{block_id}?indices={indices}
| ParameterName | Type | Description |
|---|---|---|
| block_id | string | Block identifier. Can be one of: slot(beacon chain), <hex encoded blockRoot with 0x prefix>. note: "head" (canonical head in node's view), "genesis", "finalized" are not support |
| indices | array of string | Array of indices for blob sidecars to request for in the specified block. Returns all blob sidecars in the block if not specified, like "indices=0,1 |
200: Ok response
{
"data": [
{
"index": "0",
"blob": "0x00b900026b636f6e74656e745479706569696d6167652f706e6767636f6e7465006e745a0001c8aa1f8b0800000000000003c497e55714dc17ef67e8ee6e8691009666405a1c4a40a4bb4b4a40ba41a41ba44b910649e998a11ba4bbbb4b...",
"kzg_commitment": "0x8f5b5ac395257c71080721a72dfbc2a4260184a9fe6442d53ab17cd3c7246cfc263fbad5f063456bcfefea2c2795378a",
"kzg_proof": "0x9952be38421793ca564e3cb779e14345912184bd883b8532629c23e948ba5c29103ddd072d1fbbb5e521a9bee3ee7925",
"kzg_commitment_inclusion_proof": [
"0x82ba896ae27ae4d01108146fa4a8313522b966697b088ec0e8f1e53f56c83626",
"0x256135c2cf896b0790ab66a3a9b5cbbe5971968cbc72fc151063e92f500440a2",
"0x93de7d5c33984c7e6c91d486aa097662517e933655c2155c0857a05e43074da5",
"0xc78009fdf07fc56a11f122370658a353aaa542ed63e44c4bc15ff4cd105ab33c",
"0x536d98837f2dd165a55d5eeae91485954472d56f246df256bf3cae19352a123c",
"0x9efde052aa15429fae05bad4d0b1d7c64da64d03d7a1854a588c2cb8430c0d30",
"0xd88ddfeed400a8755596b21942c1497e114c302e6118290f91e6772976041fa1",
"0x87eb0ddba57e35f6d286673802a4af5975e22506c7cf4c64bb6be5ee11527f2c",
"0x26846476fd5fc54a5d43385167c95144f2643f533cc85bb9d16b782f8d7db193",
"0x506d86582d252405b840018792cad2bf1259f1ef5aa5f887e13cb2f0094f51e1",
"0xffff0ad7e659772f9534c195c815efc4014ef1e1daed4404c06385d11192e92b",
"0x6cf04127db05441cd833107a52be852868890e4317e6a02ab47683aa75964220",
"0x0600000000000000000000000000000000000000000000000000000000000000",
"0x792930bbd5baac43bcc798ee49aa8185ef76bb3b44ba62b91d86ae569e4bb535",
"0x16c5286816e0c2fe95421dc404efb8919aa762db0a15e852933a2ad965aa9ed5",
"0xdb56114e00fdd4c1f85c892bf35ac9a89289aaecb1ebd0a96cde606a748b5d71",
"0xd5be0ed2682550ce71db46a6d05873d67bbb855b43a9e017eb76afe317cf7e7d"
],
"signed_block_header": {
"message": {
"body_root": "0xfeffb7e2e57b5dac8849ce45723c701033053788dd8615fd8e2ad68689ea2cbf",
"parent_root": "0xd39e1b7b8c5c2226d80a071cf919744679b22d95ce241210e6dee5dd76317dce",
"proposer_index": "452467",
"slot": "8783262",
"state_root": "0xf014944ead7b1524d3b3d3e76c0285e20ffb277f3778c5f6be63c487904204cf"
}
}
}
]
} request body example, the params should specify the block num
{
"jsonrpc": "2.0",
"method": "eth_getBlobSidecars",
"params": [
"0x260B4F8"
],
"id": 1
}response
{
"id": 1,
"jsonrpc": "2.0",
"result": [
{
"blobSidecar": {
"blobs": [
"0x230001fbfc0......",
"0x230001fbfc0......",
"0x230001fbfc0......"
],
"commitments": [
"0x8dc46b688da90f6c4e73f45edf45b469af02b08614929724c47561096144dccda42d750a54207056970e4fb594382d0d",
"0x88ca84e6120edbc3501f38d5d33fcef72e4b9f93a87adcd0f01cbed75a502ba4904b44f0f4e90a32a60deaff16ca72fd",
"0x8c5bac684f3ec774cea2e1069d10f5b572d06f1a0e22e935760ae6d781056a29ad39d97e09eb21c4e38433b7975ed809"
],
"proofs": [
"0x83580500abf93afb6e3d5b8c8f95ecefa8da6f6c4fa49b35dc8bf526c58c579cf9958f68d7da3dcb76e5bde536bf396b",
"0xb70a87a4747158024d86a7b7a6bf946fd0c661717083498c9159e7d693ff1fece43157458318a412575ecc66aa17072b",
"0x94c5a6e875936674265cd3d46d7a2af2f1600b85042f363d97c5eb8501fdc046268fddb3de85c9c7bd8c9b3b64ae416f"
]
},
"blockNumber": "0x260B4F8",
"txIndex": "0x59",
"txHash": "6f357e3162706ce7965f41eb17bd3711dcc4ae1fb3305c54efaf369efc1ec100"
}
]
}In scenarios where the Bundle Service is inaccessible, direct access to blob data stored in Greenfield may be necessary, as blobs are consolidated into a bundle object. User can retrieve the bundle object and extract specific blobs from it.
The bundle objects uploaded to Greenfield adhere to the naming pattern blobs_s{startSlot}_e{endSlot}. For instance, if a bundle encompasses blobs within 30 slots, the bundle object could be named blobs_s8864048_e8864077, where 8864048 represents the start slot and 8864077 denotes the end slot. The individual blobs contained within this bundle follow the naming convention blob_h{slot}_i{index}, such as blob_h8864074_i3.
The bundle SDK offers commands to fetch the bundle object from Greenfield. Follow the steps below:
git submodule update --init --recursive
cd bundle-sdk && make build
./build/bundler download -bucket ethereum-mainnet-blobs -object blobs_s9374167_e9374196 -chain-id greenfield_1017-1 -rpc-url https://greenfield-chain.bnbchain.org:443 -output ./tmpOnce the bundle is downloaded and extracted, all original blob files can be found within the tmp directory.
Go version above 1.22
if you don't have a bucket yet, set up one for blob storage. There are a few ways to create one, below shows examples via greenfield-go-sdk and using provided script.
Visit https://dcellar.io/ and create a bucket with at least 100G read quota per month.
You can use the script, before runinng it, modify the the scripts/.env file(the GRANTEE_BUNDLE_ACCOUNT does not need to modified at this moment):
bash scripts/set_up.sh --create_bucketRequest a bundle account from the Bundle Service, you need to grant the bundle account permission in next step, so that bundle service can create object behave of your account.
curl -X POST https://gnfd-mainnet-bundle.nodereal.io/v1/bundlerAccount/0xf74d8897D8BeafDF4b766E19A62078DE84570656
{"address":"0x4605BFc98E0a5EA63D9D5a4a1Df549732a6963f3"} bucketActions := []permTypes.ActionType{permTypes.ACTION_CREATE_OBJECT}
statements := utils.NewStatement(bucketActions, permTypes.EFFECT_ALLOW, nil, sdktypes.NewStatementOptions{})
bundleAgentPrincipal, err := utils.NewPrincipalWithAccount(sdk.MustAccAddressFromHex(bundleAddrToGrant))
if err != nil {
util.Logger.Fatalf("NewPrincipalWithAccount: %v", err)
return
}
_, err = cli.PutBucketPolicy(ctx, BlobBucketName, BundleAgentPrincipal, []*permTypes.Statement{&statements}, sdktypes.PutPolicyOption{})
if err != nil {
util.Logger.Fatalf("put policy failed: %v", err)
return
}grant allowance,
the example shows allowance amount of 1 BNB, considered each object creation gas consumed is 0.000006 BNB, it is approximately for 1666667 objects.
allowanceAmount := math.NewIntWithDecimal(1, 19)
_, err = cli.GrantBasicAllowance(ctx, bundleAcct.String(), allowanceAmount, nil, gnfdsdktypes.TxOption{})
if err != nil {
util.Logger.Fatalf("grant fee allowance failed: %v", err)
}You can find similar example permission:
or you can use the script, replace GRANTEE_BUNDLE_ACCOUNT with the addr got from Bundle Service in step 2, and modify the ALLOWANCE to your expect amount, so that transacion
gas will be paid your account:
bash scripts/set_up.sh --grantAfter above steps are done, you can start running the Blob Syncer Service.
make buildmake build_syncermake build_server./build/syncer --config-path config/local/config-syncer.jsonconfig example:
{
"chain": "ETH",
"bucket_name": "your-bucket",
"start_slot_or_block": 8783000,
"create_bundle_slot_or_block_interval": 10,
"beacon_rpc_addrs": [
"https://eth2-beacon-mainnet.nodereal.io"
],
"bundle_service_endpoints": [
"https://gnfd-mainnet-bundle.nodereal.io"
],
"rpc_addrs": [
"https://eth-mainnet.nodereal.io"
],
"temp_dir": "temp",
"private_key": "0x....",
"bundle_not_sealed_reupload_threshold": 3600,
"enable_indiv_blob_verification": false,
"db_config": {
"dialect": "mysql",
"username": "root",
"password": "pass",
"url": "/blob-hub?charset=utf8&parseTime=True&loc=Local",
"max_idle_conns": 10,
"max_open_conns": 100
},
"metrics_config": {
"enable": true,
"http_address": ""
"sp_endpoint": "https://greenfield-sp.nodereal.io"
},
"log_config": {
"level": "DEBUG",
"filename": "",
"max_file_size_in_mb": 0,
"max_backups_of_log_files": 0,
"max_age_to_retain_log_files_in_days": 0,
"use_console_logger": true,
"use_file_logger": false,
"compress": false
}
}config example:
{
"chain": "BSC",
"bucket_name": "your-bucket",
"start_slot_or_block": 39769787,
"create_bundle_slot_or_block_interval": 200,
"bundle_service_endpoints": [
"https://gnfd-mainnet-bundle.nodereal.io"
],
"rpc_addrs": [
"https://bsc-mainnet.nodereal.io/"
],
"temp_dir": "temp",
"private_key": "0x....",
"bundle_not_sealed_reupload_threshold": 3600,
"enable_indiv_blob_verification": false,
"db_config": {
"dialect": "mysql",
"username": "root",
"password": "pass",
"url": "/blob-hub?charset=utf8&parseTime=True&loc=Local",
"max_idle_conns": 10,
"max_open_conns": 100
},
"metrics_config": {
"enable": true,
"http_address": ""
"sp_endpoint": "https://greenfield-sp.nodereal.io"
},
"log_config": {
"level": "DEBUG",
"filename": "",
"max_file_size_in_mb": 0,
"max_backups_of_log_files": 0,
"max_age_to_retain_log_files_in_days": 0,
"use_console_logger": true,
"use_file_logger": false,
"compress": false
}
}./build/server --config-path config/local/config-server.json --port 8080