Crawleth

Ethereum crawler

Crawleth

Project sheet

Status
Functional
Scope
Academic
Start
January 15th, 2021
End
May 1st, 2021

Technical sheet

Fields
Databases, data processing, networks
Language
Python
DBMS
Redis
Tools
Git, Latex

Crawl the entire Ethereum mainnet in minutes

Crawleth is an Ethereum crawler created in pairs as part of the Télécom Nancy Interdisciplinary Research Project. The objective of this module is to learn about the world of research by producing a scientific article.

The crawler takes, at a low level, the specifications of Node Discovery Protocol v4 from devp2p on which Ethereum is based. It contacts all the nodes in the network to find out their current status and ask them for their closest peers in order to scan the entire network. Among many metrics such as the number of nodes and up nodes, we analysed the geographical localization of peers and the way they were accessing the Ethereum network.

Finally, we measured short- and medium-term variations in the Ethereum network by quantifying churn and establishing a 24-hour worldwide classification of nodes.


Discover more projects

Made with hearth and who may interest you