DHT Crawler for the Substrate Blockchain Network

[duythien]

Hello

Currently, Do we have a example to get all peers networks in substrate, if not could give me a point to start research on that

Thanks

[mxinden]

You can use https://github.com/mxinden/kademlia-exporter/. See deployment on kademlia-exporter.max-inden.de/.

[duythien]

@mxinden Thank you for answer. I will take a look it

[duythien]

@mxinden kademlia just give a total peer, the idea i want to get more details such as the tool nebula

{"PeerID":"12D3KooWHsvEicXjWWraktbZ4MQBizuyADQtuEGr3NbDvtm5rFA5","Maddrs":["/ip4/145.239.2.111/tcp/30333","/ip4/145.239.2.111/tcp/30334/ws"],"Protocols":["/ipfs/id/push/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/send_dispute/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/block-announces/1","/polkadot/validation/1","/polkadot/collation/1","/ipfs/id/1.0.0","/ipfs/ping/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/light/2","/dot/light/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_statement/1","/dot/block-announces/1","/polkadot/req_pov/1","/polkadot/req_collation/1","/polkadot/req_available_data/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_chunk/1","/polkadot/req_chunk/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/2","/polkadot/req_statement/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/validation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/transactions/1","/dot/transactions/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_pov/1","/paritytech/grandpa/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_available_data/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/grandpa/1","/dot/kad","/dot/sync/warp","/polkadot/send_dispute/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/warp","/dot/sync/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/kad","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/state/2","/dot/state/2"],"AgentVersion":"Parity Polkadot/v1.0.0-1ed6e2e50a4 (polkadot-bootnode-2)","ConnectDuration":"1.436783671s","CrawlDuration":"1.892435744s","VisitStartedAt":"2023-09-02T15:45:18.067538925Z","VisitEndedAt":"2023-09-02T15:45:19.959974608Z","ConnectErrorStr":"","CrawlErrorStr":"","IsExposed":null}
{"PeerID":"12D3KooWKer8bYqpYjwurVABu13mkELpX2X7mSpEicpjShLeg7D6","Maddrs":["/ip4/35.204.10.154/tcp/30333","/ip4/35.204.10.154/tcp/30334/ws"],"Protocols":["/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/transactions/1","/polkadot/req_pov/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/light/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_pov/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/warp","/polkadot/req_available_data/1","/paritytech/grandpa/1","/polkadot/validation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/kad","/dot/sync/2","/dot/block-announces/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/send_dispute/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/2","/polkadot/req_chunk/1","/dot/light/2","/dot/state/2","/ipfs/ping/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/1","/polkadot/send_dispute/1","/dot/transactions/1","/ipfs/id/push/1.0.0","/polkadot/req_collation/1","/polkadot/req_statement/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/block-announces/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/collation/1","/polkadot/collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_statement/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/validation/1","/ipfs/id/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_chunk/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_available_data/1","/dot/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/grandpa/1","/dot/kad","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/state/2"],"AgentVersion":"Parity Polkadot/v1.0.0-1ed6e2e50a4 (polkadot-bootnode-gcp-0)","ConnectDuration":"1.474787612s","CrawlDuration":"1.990836781s","VisitStartedAt":"2023-09-02T15:45:18.067477612Z","VisitEndedAt":"2023-09-02T15:45:20.058314319Z","ConnectErrorStr":"","CrawlErrorStr":"","IsExposed":null}
{"PeerID":"12D3KooWSz8r2WyCdsfWHgPyvD8GKQdJ1UAiRmrcrs8sQB3fe2KU","Maddrs":["/ip4/51.75.144.133/tcp/30333","/ip4/51.75.144.133/tcp/30334/ws"],"Protocols":["/dot/block-announces/1","/ipfs/id/1.0.0","/polkadot/req_statement/1","/dot/state/2","/dot/kad","/polkadot/req_chunk/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_statement/1","/dot/sync/2","/polkadot/send_dispute/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_available_data/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/grandpa/1","/polkadot/validation/1","/ipfs/ping/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/kad","/dot/transactions/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/state/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/light/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/1","/polkadot/req_collation/1","/polkadot/collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_chunk/1","/polkadot/req_pov/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/2","/paritytech/grandpa/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/send_dispute/1","/polkadot/req_available_data/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_pov/1","/dot/light/2","/dot/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/block-announces/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/validation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/transactions/1","/ipfs/id/push/1.0.0"],"AgentVersion":"Parity Polkadot/v1.0.0-1ed6e2e50a4 (polkadot-bootnode-0)","ConnectDuration":"1.448136448s","CrawlDuration":"1.990667455s","VisitStartedAt":"2023-09-02T15:45:18.067905898Z","VisitEndedAt":"2023-09-02T15:45:20.058573274Z","ConnectErrorStr":"","CrawlErrorStr":"","IsExposed":null}
{"PeerID":"12D3KooWQz2q2UWVCiy9cFX1hHYEmhSKQB2hjEZCccScHLGUPjcc","Maddrs":["/ip4/145.239.5.61/tcp/30333","/ip4/145.239.5.61/tcp/30334/ws","/ip6/2001:41d0:800:13d::/tcp/30334/ws","/ip6/2001:41d0:800:13d::/tcp/30333"],"Protocols":["/dot/light/2","/dot/block-announces/1","/ipfs/ping/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_chunk/1","/polkadot/req_chunk/1","/polkadot/validation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/kad","/polkadot/req_available_data/1","/polkadot/send_dispute/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/validation/1","/ipfs/id/push/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/state/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_available_data/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_pov/1","/polkadot/req_pov/1","/dot/kad","/polkadot/req_collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/block-announces/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/grandpa/1","/paritytech/grandpa/1","/ipfs/id/1.0.0","/dot/transactions/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_statement/1","/polkadot/req_statement/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/collation/1","/polkadot/collation/1","/dot/sync/warp","/dot/state/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/send_dispute/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/transactions/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/warp","/dot/sync/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/light/2"],"AgentVersion":"Parity Polkadot/v1.0.0-1ed6e2e50a4 (polkadot-bootnode-3)","ConnectDuration":"1.493151478s","CrawlDuration":"1.993205029s","VisitStartedAt":"2023-09-02T15:45:18.067403286Z","VisitEndedAt":"2023-09-02T15:45:20.060608253Z","ConnectErrorStr":"","CrawlErrorStr":"","IsExposed":null}
{"PeerID":"12D3KooWAsuCEVCzUVUrtib8W82Yne3jgVGhQZN3hizko5FTnDg3","Maddrs":["/ip4/213.167.226.189/tcp/30333/ws","/ip4/213.167.226.189/tcp/30333"],"Protocols":["/ipfs/id/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_available_data/1","/polkadot/req_collation/1","/dot/transactions/1","/ipfs/id/push/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/state/2","/polkadot/req_pov/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/grandpa/1","/polkadot/send_dispute/1","/dot/state/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/light/2","/dot/light/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/1","/dot/block-announces/1","/polkadot/req_statement/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/send_dispute/1","/dot/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/collation/1","/paritytech/grandpa/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/validation/1","/polkadot/collation/1","/dot/kad","/dot/sync/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/block-announces/1","/polkadot/req_chunk/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_pov/1","/polkadot/req_available_data/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_chunk/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_statement/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/transactions/1","/ipfs/ping/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/kad","/polkadot/validation/1"],"AgentVersion":"Parity Polkadot/v1.0.0-1ed6e2e50a4 (Amforc Bootnode)","ConnectDuration":"1.699726931s","CrawlDuration":"2.202144082s","VisitStartedAt":"2023-09-02T15:45:18.067397686Z","VisitEndedAt":"2023-09-02T15:45:20.269541726Z","ConnectErrorStr":"","CrawlErrorStr":"","IsExposed":null}
{"PeerID":"12D3KooWSRjL9LcEQd5u2fQTbyLxTEHq1tUFgQ6amXSp8Eu7TfKP","Maddrs":["/ip4/35.204.7.236/tcp/30333","/ip4/35.204.7.236/tcp/30334/ws"],"Protocols":["/polkadot/validation/1","/polkadot/collation/1","/dot/transactions/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/1","/dot/light/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/collation/1","/ipfs/id/1.0.0","/polkadot/req_statement/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/send_dispute/1","/dot/sync/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/kad","/polkadot/req_collation/1","/polkadot/req_chunk/1","/dot/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/transactions/1","/polkadot/req_available_data/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/state/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_available_data/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_pov/1","/polkadot/req_pov/1","/paritytech/grandpa/1","/ipfs/id/push/1.0.0","/dot/kad","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_statement/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/light/2","/dot/block-announces/1","/dot/state/2","/polkadot/send_dispute/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/block-announces/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/grandpa/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/validation/1","/ipfs/ping/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_chunk/1"],"AgentVersion":"Parity Polkadot/v1.0.0-1ed6e2e50a4 (polkadot-bootnode-gcp-1)","ConnectDuration":"1.473629495s","CrawlDuration":"2.217455512s","VisitStartedAt":"2023-09-02T15:45:18.067364518Z","VisitEndedAt":"2023-09-02T15:45:20.284819964Z","ConnectErrorStr":"","CrawlErrorStr":"","IsExposed":null}
{"PeerID":"12D3KooWLo5aBqyqaCJMeW1tttzmUUyx8WbPSXfv74eJNeEkSmZz","Maddrs":["/ip4/54.234.110.22/tcp/11133/ws"],"Protocols":null,"AgentVersion":"","ConnectDuration":"366.316904ms","CrawlDuration":"366.607879ms","VisitStartedAt":"2023-09-02T15:45:19.962110533Z","VisitEndedAt":"2023-09-02T15:45:20.328718429Z","ConnectErrorStr":"connection_refused","CrawlErrorStr":"","IsExposed":null}
{"PeerID":"12D3KooWGJQysxrQcSvUWWNw88RkqYvJhH3ZcDpWJ8zrXKhLP5Vr","Maddrs":["/ip4/144.217.70.137/tcp/30333","/ip4/144.217.70.137/tcp/30334/ws"],"Protocols":["/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_available_data/1","/polkadot/req_available_data/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/send_dispute/1","/polkadot/send_dispute/1","/dot/transactions/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_pov/1","/polkadot/req_pov/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_statement/1","/polkadot/req_chunk/1","/dot/block-announces/1","/polkadot/collation/1","/ipfs/id/push/1.0.0","/polkadot/req_collation/1","/polkadot/req_statement/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/block-announces/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/grandpa/1","/ipfs/id/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/light/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/2","/dot/state/2","/dot/kad","/dot/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/validation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/transactions/1","/ipfs/ping/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/kad","/dot/light/2","/dot/sync/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/state/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_chunk/1","/paritytech/grandpa/1","/polkadot/validation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/1"],"AgentVersion":"Parity Polkadot/v1.0.0-1ed6e2e50a4 (polkadot-bootnode-5)","ConnectDuration":"1.844406292s","CrawlDuration":"2.482649573s","VisitStartedAt":"2023-09-02T15:45:18.067371985Z","VisitEndedAt":"2023-09-02T15:45:20.550021524Z","ConnectErrorStr":"","CrawlErrorStr":"","IsExposed":null}
{"PeerID":"12D3KooWFN2mhgpkJsDBuNuE5427AcDrsib8EoqGMZmkxWwx3Md4","Maddrs":["/ip4/158.69.117.69/tcp/30333","/ip4/158.69.117.69/tcp/30334/ws"],"Protocols":["/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/collation/1","/polkadot/collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/transactions/1","/ipfs/ping/1.0.0","/polkadot/req_collation/1","/polkadot/send_dispute/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/block-announces/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_chunk/1","/polkadot/validation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_pov/1","/polkadot/req_pov/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/warp","/dot/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/grandpa/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/validation/1","/ipfs/id/push/1.0.0","/dot/kad","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/state/2","/dot/transactions/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/kad","/polkadot/req_chunk/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_statement/1","/polkadot/req_statement/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_available_data/1","/polkadot/req_available_data/1","/paritytech/grandpa/1","/ipfs/id/1.0.0","/dot/light/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/1","/dot/sync/2","/dot/block-announces/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/light/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/send_dispute/1","/dot/state/2"],"AgentVersion":"Parity Polkadot/v1.0.0-1ed6e2e50a4 (polkadot-bootnode-1)","ConnectDuration":"1.847800566s","CrawlDuration":"2.490604372s","VisitStartedAt":"2023-09-02T15:45:18.067881088Z","VisitEndedAt":"2023-09-02T15:45:20.558485458Z","ConnectErrorStr":"","CrawlErrorStr":"stream_reset","IsExposed":null}
{"PeerID":"12D3KooWRjHFApinuqSBjoaDjQHvxwubQSpEVy5hrgC9Smvh92WF","Maddrs":["/ip4/195.144.22.130/tcp/30333","/ip4/195.144.22.131/tcp/30333","/ip4/195.144.22.133/tcp/30333"],"Protocols":["/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/grandpa/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/validation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/send_dispute/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_available_data/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_pov/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/warp","/dot/state/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/block-announces/1","/dot/transactions/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/kad","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/light/2","/polkadot/validation/1","/polkadot/collation/1","/ipfs/id/1.0.0","/polkadot/send_dispute/1","/dot/light/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_statement/1","/polkadot/req_chunk/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/transactions/1","/ipfs/ping/1.0.0","/dot/kad","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/1","/polkadot/req_collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_chunk/1","/dot/block-announces/1","/paritytech/grandpa/1","/ipfs/id/push/1.0.0","/polkadot/req_available_data/1","/polkadot/req_pov/1","/dot/sync/2","/dot/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/state/2","/polkadot/req_statement/1"],"AgentVersion":"Parity Polkadot/v1.0.0-1ed6e2e50a4 (METASPAN-BOOT)","ConnectDuration":"1.988053145s","CrawlDuration":"2.500209046s","VisitStartedAt":"2023-09-02T15:45:18.067921284Z","VisitEndedAt":"2023-09-02T15:45:20.568130276Z","ConnectErrorStr":"","CrawlErrorStr":"","IsExposed":null}
{"PeerID":"12D3KooWKvdDyRKqUfSAaUCbYiLwKY8uK3wDWpCuy2FiDLbkPTDJ","Maddrs":["/ip4/185.127.231.68/tcp/30334/ws","/ip4/185.127.231.66/tcp/30334/ws"],"Protocols":["/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/2","/dot/block-announces/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/grandpa/1","/polkadot/collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/kad","/dot/light/2","/dot/sync/2","/polkadot/req_statement/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/1","/polkadot/req_collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_available_data/1","/polkadot/req_pov/1","/polkadot/validation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_statement/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/send_dispute/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/light/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_pov/1","/paritytech/grandpa/1","/ipfs/ping/1.0.0","/polkadot/req_chunk/1","/dot/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/validation/1","/ipfs/id/push/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/block-announces/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/transactions/1","/dot/transactions/1","/ipfs/id/1.0.0","/dot/kad","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/state/2","/polkadot/send_dispute/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_chunk/1","/dot/state/2","/polkadot/req_available_data/1"],"AgentVersion":"Parity Polkadot/v1.0.0-1ed6e2e50a4 (🛡 DWELLIR POLKADOT BOOT 🛡)","ConnectDuration":"2.015763196s","CrawlDuration":"2.524237412s","VisitStartedAt":"2023-09-02T15:45:18.067582795Z","VisitEndedAt":"2023-09-02T15:45:20.591820155Z","ConnectErrorStr":"","CrawlErrorStr":"","IsExposed":null}
{"PeerID":"12D3KooWS9ZcvRxyzrSf6p63QfTCWs12nLoNKhGux865crgxVA4H","Maddrs":["/ip4/77.92.101.227/tcp/8020","/ip4/77.92.101.227/tcp/8021/ws"],"Protocols":["/dot/block-announces/1","/paritytech/grandpa/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/transactions/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/kad","/polkadot/req_collation/1","/polkadot/validation/1","/polkadot/send_dispute/1","/polkadot/req_statement/1","/polkadot/req_available_data/1","/dot/sync/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/block-announces/1","/dot/kad","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/state/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/send_dispute/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/collation/1","/polkadot/req_pov/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_statement/1","/dot/light/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/grandpa/1","/ipfs/ping/1.0.0","/polkadot/req_chunk/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/validation/1","/dot/state/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_chunk/1","/polkadot/collation/1","/dot/transactions/1","/ipfs/id/1.0.0","/ipfs/id/push/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/light/2","/dot/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_pov/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_available_data/1"],"AgentVersion":"Parity Polkadot/v1.0.0-1ed6e2e50a4 (⛰ HELIKON ⛰ IBP BOOT NODE 001)","ConnectDuration":"1.945812499s","CrawlDuration":"2.530041729s","VisitStartedAt":"2023-09-02T15:45:18.067929308Z","VisitEndedAt":"2023-09-02T15:45:20.597970967Z","ConnectErrorStr":"","CrawlErrorStr":"","IsExposed":null}
{"PeerID":"12D3KooWEPmjoRpDSUuiTjvyNDd8fejZ9eNWH5bE965nyBMDrB4o","Maddrs":["/ip4/35.234.84.149/tcp/30334/ws","/ip4/35.234.84.149/tcp/30333"],"Protocols":["/polkadot/req_statement/1","/dot/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/block-announces/1","/polkadot/collation/1","/dot/kad","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/state/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/validation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/transactions/1","/dot/transactions/1","/polkadot/req_available_data/1","/ipfs/id/push/1.0.0","/dot/sync/2","/polkadot/req_pov/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/light/2","/dot/light/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/warp","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/grandpa/1","/paritytech/grandpa/1","/polkadot/req_collation/1","/dot/state/2","/dot/block-announces/1","/polkadot/validation/1","/polkadot/req_chunk/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_chunk/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/sync/2","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_available_data/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/kad","/polkadot/send_dispute/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_collation/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_pov/1","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/req_statement/1","/ipfs/ping/1.0.0","/ipfs/id/1.0.0","/91b171bb158e2d3848fa23a9f1c25182fb8e20313b2c1eb49219da7a70ce90c3/send_dispute/1"],"AgentVersion":"Parity Polkadot/v1.0.0-1ed6e2e50a4 (polkadot-connect-0)","ConnectDuration":"2.173218302s","CrawlDuration":"2.631890074s","VisitStartedAt":"2023-09-02T15:45:18.067470663Z","VisitEndedAt":"2023-09-02T15:45:20.699360674Z","ConnectErrorStr":"","CrawlErrorStr":"","IsExposed":null}

[mxinden]

In such case I recommend you continue to use nebula. It is the better tool across many dimensions anyways. //CC @dennis-tra

[dennis-tra]

Hey @duythien, Nebula allows crawling other networks. For example, Nebula can also crawl Polkadot, and Kusama networks. If your network also uses go-libp2p-kad-dht or the rust equivalent Nebula should be able to crawl your network. I'm happy to assist 👍

[duythien]

@dennis-tra Thanks you, here my point dennis-tra/nebula#40 :)