In this article we’ll cover our Ethereum 2.0 ETL tools for exporting Ethereum 2.0 blockchain data, the public Medalla dataset in BigQuery, and a Nansen.ai dashboard we built with some interesting charts and tables. The article is broken down into three parts: A quickstart guide for Ethereum 2.0 ETL. The…

In this article you’ll learn how to package a JavaScript library for use in a BigQuery UDF. We’ll consider a particular example — ethers.js —a complete Ethereum library and wallet implementation in JavaScript. It will allow us to decode raw transactions and logs data in the bigquery-public-data.crypto_ethereum dataset in BigQuery. …

This is a tutorial article explaining how to replay time series data from a BigQuery table into a Pub/Sub topic. There are several use cases when you might need it: Backtesting. Demos / Visualizations. Integration testing. The go-to GCP service for moving data between different services is Dataflow. While there…

You can now easily query parsed ENS, 0x and many more (see below) smart contract events in Google BigQuery: 0x tables, ENS tables. Those tables are near real-time. You can easily add events for any Ethereum contract you are interested in to public blockchain-etl datasets. Find instructions below. Accessing Datasets in BigQuery After you…

The crypto_ethereum and crypto_bitcoin datasets in BigQuery are now updated using the streaming technology. You can also subscribe to public Pub/Sub topics that feed those tables. The overall architecture is depicted below: The following blockchains are covered: Ethereum Bitcoin ZCash Litecoin Doge Dash We added delays for each blockchain that…

The Laws of Human Nature by Robert Greene For every law the author provides an example from history, interprets and explains it and gives advice on how to use the law. Pros: very interesting historical examples. Cons: the author didn’t provide any scientific evidence for the laws in the book…

With our recent release of Bitcoin-derived blockchain datasets, BigQuery now contains 8 cryptocurrencies in total including Bitcoin, Bitcoin Cash, Zcash, Litecoin, Dogecoin, Dash, Ethereum, and Ethereum Classic. Below is the graph demonstrating daily transaction counts for those blockchains: Ethereum is clearly leading with almost 600k daily transactions on average in…

In this article I will guide you through the process of creating an ERC20 token recommendation system built with TensorFlow, Cloud Machine Learning Engine, Cloud Endpoints, and App Engine. The solution is based on the tutorial article by Google. …

The Gini coefficient, also known as the Gini index, is a common econometric tool for measuring inequality of asset distribution. Here is the query that outputs Gini coefficient for each day given daily non-zero (anonymous) account balances: It uses 1 — 2B formula from this Wikipedia page https://en.wikipedia.org/wiki/Gini_coefficient, …