Crawl the entire Ethereum mainnet in minutes
Crawleth is an Ethereum crawler created in pairs as part of the Télécom Nancy Interdisciplinary Research Project. The objective of this module is to learn about the world of research by producing a scientific article.
The crawler takes, at a low level, the specifications of Node Discovery Protocol v4 from devp2p on which Ethereum is based. It contacts all the nodes in the network to find out their current status and ask them for their closest peers in order to scan the entire network. Among many metrics such as the number of nodes and up nodes, we analysed the geographical localization of peers and the way they were accessing the Ethereum network.
Finally, we measured short- and medium-term variations in the Ethereum network by quantifying churn and establishing a 24-hour worldwide classification of nodes.