Skip to content

feat: standardized peerdas metrics#7095

Closed
matthewkeil wants to merge 49 commits into
peerDASfrom
mkeil/standardized-peerdas-metrics
Closed

feat: standardized peerdas metrics#7095
matthewkeil wants to merge 49 commits into
peerDASfrom
mkeil/standardized-peerdas-metrics

Conversation

@matthewkeil
Copy link
Copy Markdown
Member

Motivation

Pari requested that these standardized metrics be added to Lodestar. Once matrix reconstruction is implemented, will implement the metrics in that function, added them to the metrics object for now though so they are available in that PR.

https://discord.com/channels/595666850260713488/1252403418941624532/1285889840746856498

g11tech and others added 30 commits August 9, 2024 13:56
add types stub and epoch config

fix types
add some presets

add further params and types

add data column to types repo and network

move to max request data columns to preset

add the datacolumns data in blockinput and fix breaking errors in seen gossip blockinput

handle data columns in gossip and the seengossip

further propagate forkaware blockdata and resolve build/type issues

further handle datacolumns sync by range by root and forkaware data handling

fix issues

chore: update c-kzg to peerDas version

feat: add peerDas ckzg functions to interface

fix the lookups

handle the publishing flow

various sync try fixes

fixes

compute blob side car

various misl debuggings and fixes

debug and apply fixes and get range and by root sync to work will full custody

enable syncing with lower custody requirement

use node peerid rather than a dummy string

get and use the nodeid from enr and correctly compute subnets and column indexes

filterout and connect to peers only matching out custody requiremnt

try adding custody requirement

add protection for subnet calc

get the sync working with devnet 0

correctly set the enr with custody subnet info

rebase fixes

small refactor
wip: REPLACE THIS COMMIT

commit yarn lock

rebase fixes

fix: update c-zkg install workflow

feat: add trustedSetupPrecompute cli flag

fix: update trusted-setup for testing

fix: update c-zkg install workflow to remove sudo

fix: add rsync to apk deps
some network options to control peering behavior

allow setting node custody capability via --params

use eip754 names for the peerdas config
rebase fixes
fixes for metadata, working locally

change the condition to update metadata csc change
g11tech and others added 9 commits September 13, 2024 17:31
* refactor: getDataColumnSidecars

* test: unit test getDataColumnSidecars with mocks from c-kzg library

* refactor: use fromHex util

* chore: update numbering on mocks

* chore: update c-kzg to latest version

* chore: fix type export syntax

* test: add verification for cells from sidecars

* test: add verification to DataColumnSidecars tests

* refactor: getDataColumnSidecars for PR comments

* feat: narrow type and remove unnecessary conditional

* fix: getDataColumnSidecars param type

* refactor: rename to computeDataColumnSidecars
* feat: update c-kzg to final DAS version

* refactor: use trusted-setup from c-kzg package
* fix: remove unused ckzg build script

* fix: remove unused rsync dep from Dockerfile
* feat: update c-kzg to final DAS version

* refactor: use trusted-setup from c-kzg package

* feat: implement validateDataColumnsSidecars

* feat: check block and column commitments match

* test: add unit test for validateDataColumnsSidecars

* fix: invalid build and update validity condition of validateDataColumnsSidecars

* fix: make error messages better

* fix: electra vs peerdas type conflict
@matthewkeil matthewkeil requested a review from a team as a code owner September 19, 2024 11:29
@matthewkeil matthewkeil requested a review from g11tech September 19, 2024 11:29
@nflaig
Copy link
Copy Markdown
Member

nflaig commented Sep 19, 2024

There is a PR related to this ethereum/beacon-metrics#13

@matthewkeil
Copy link
Copy Markdown
Member Author

matthewkeil commented Sep 20, 2024

There is a PR related to this ethereum/beacon-metrics#13

Sweet. Ill read that more deeply. Looks like the branch I got these from is the one being merged in. Got it from Pari at ethpandops was looking for here:
https://github.com/KatyaRyazantseva/beacon-metrics/blob/master/metrics.md#peerdas-metrics

Ill add the couple for gossip and what not

@matthewkeil matthewkeil marked this pull request as draft September 20, 2024 07:32
@matthewkeil matthewkeil added the status-do-not-merge Merging this issue will break the build. Do not merge! label Sep 23, 2024
@matthewkeil
Copy link
Copy Markdown
Member Author

The spec is still being hammered out so some of the metric names may change.

ethereum/beacon-metrics#13

Will keep this PR open and update accordingly.

@matthewkeil
Copy link
Copy Markdown
Member Author

Some of the metric were added in the gossipsub package here
ChainSafe/js-libp2p-gossipsub#508

@nflaig
Copy link
Copy Markdown
Member

nflaig commented May 3, 2025

this PR seems really stale to me, the diff is out of control, need to rebase or close, it doesn't even serve as demonstration purpose

@wemeetagain
Copy link
Copy Markdown
Member

this PR seems really stale to me, the diff is out of control, need to rebase or close, it doesn't even serve as demonstration purpose

yeah. Thoughts? cc @matthewkeil @KatyaRyazantseva

@matthewkeil
Copy link
Copy Markdown
Member Author

this is based on old spec and i forgot to close

@matthewkeil matthewkeil closed this Aug 6, 2025
@matthewkeil matthewkeil deleted the mkeil/standardized-peerdas-metrics branch January 14, 2026 12:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

status-do-not-merge Merging this issue will break the build. Do not merge!

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants