Per-Transaction Models.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Computing Per-Transaction Responsibility for Ethereum\n",
    "\n",
    "Ethereum miners use energy that causes emissions. The amount of emissions varies with respect to energy sources, and the about of energy varies mainly as a function of time with respect to GPU efficiency. To simplify this discussion, we will work with hashrate (hashes per second) and hashcount (hashes) instead of energy or emissions.\n",
    "\n",
    "We assume:\n",
    "\n",
    "* It is more meaningful to allocate hashcount responsibility across all miners, or all transactions, than across both simultaneously. Here we allocate based on transactions, because the goal is to create accountability at the point of use.\n",
    "* The hashrate does not vary directly based on the properties of the transactions. This means allocating a hashcount to each transaction is a philosophical question rather than a technical question.\n",
    "* The sum of allocated usage should add up to the total usage. This means the sum of transaction hashcounts should add up to the total Ethereum hashcount. Or that the sum of all allocated emissions should add up to the total emissions.\n",
    "* Transactions contribute to the hashrate in proportion to how much the transaction incentivizes miners.\n",
    "\n",
    "Miners are incentivized by payments in Ethereum, and by speculation about the future value of Ethereum. Miners are paid in two ways:\n",
    "\n",
    "1. Varying transaction fees paid by users when making a transaction, recently around 2ETH total.\n",
    "2. A fixed per-block reward at 2ETH (which was previously 3ETH and 5ETH), with additional nuances for uncle blocks.\n",
    "\n",
    "There are a few big questions to keep in mind:\n",
    "\n",
    "- Should responsibility be allocated based on first order effects (like payment of transaction fees) or second order effects (like increasing the hashrate)? If the hashrate of Ethereum was fixed, how could we allocate responsibility?\n",
    "- Should responsibility be assigned as a portion of a block's energy usage (assuming each block is the same throughout a day), a portion of one day, or as a portion of a longer timeline like the entire history of Ethereum? Should a transaction years ago also be considered partially responsible for energy usage today?\n",
    "- Should the block rewards be ignored, or should they factor in to the model evenly across all transactions, based on gas usage, or something else?\n",
    "- When comparing over longer timelines, how can we account for the fact that a higher price for Ethereum provides a higher incentive to miners?\n",
    "\n",
    "The following models explore the effects of different answers to these questions."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Preparation\n",
    "\n",
    "First we download some daily statistics about Ethereum, and load them into dictionaries."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "!wget --quiet -O \"data/statistics.csv\" \"https://docs.google.com/spreadsheets/d/e/2PACX-1vRigeH5xVkOZNOtBM6blHfrPXNqyWrtS7fVzOUm_d9fbNtTyTCBwAnbBPdQ76q6-2p0xoNcy7VxhXnZ/pub?output=csv\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "\n",
    "class EthereumHistory:\n",
    "    def __init__(self, fn='data/statistics.csv'):\n",
    "        df = pd.read_csv(fn)\n",
    "        \n",
    "        dates = [e.date() for e in pd.to_datetime(df['Date'])]\n",
    "        self.dates = dates\n",
    "        \n",
    "        self.tx_count = dict(zip(dates, df['Tx count']))\n",
    "        self.tx_fees = dict(zip(dates, df['Tx fees (ETH)']))\n",
    "        self.block_count = dict(zip(dates, df['Block count']))\n",
    "        self.block_rewards = dict(zip(dates, df['Block rewards (ETH)']))\n",
    "        self.gas_used = dict(zip(dates, df['Gas used']))\n",
    "        self.price = dict(zip(dates, df['Price (USD)']))\n",
    "        self.hashcount = dict(zip(dates, df['Hashcount (EH/day)']))\n",
    "        \n",
    "        self.tx_count_total = sum(self.tx_count.values())\n",
    "        self.tx_fees_total = sum(self.tx_fees.values())\n",
    "        self.block_count_total = sum(self.block_count.values())\n",
    "        self.block_rewards_total = sum(self.block_rewards.values())\n",
    "        self.gas_used_total = sum(self.gas_used.values())\n",
    "        self.price_total = sum(self.price.values())\n",
    "        self.hashcount_total = sum(self.hashcount.values())\n",
    "        \n",
    "history = EthereumHistory()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Some helper functions for simplifying the code behind different models."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "from etherscan import Etherscan, etherscan_gas_fees, etherscan_gas_used, etherscan_timestamp\n",
    "from nifty_gateway import list_nifty_gateway\n",
    "from utils import load_contracts\n",
    "\n",
    "def get_tx_date(tx):\n",
    "    return etherscan_timestamp(tx).date()\n",
    "    \n",
    "def get_tx_fees(tx):\n",
    "    return etherscan_gas_fees(tx) / 1e18 # convert wei to eth\n",
    "\n",
    "def get_tx_gas(tx):\n",
    "    return etherscan_gas_used(tx)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Simple models\n",
    "\n",
    "Initial discussion around allocating energy and emissions was focused on [per-transaction allocation](https://digiconomist.net/ethereum-energy-consumption):\n",
    "\n",
    "$\n",
    "hashcount_{date} \\times \\dfrac{1}{txcount_{date}}\n",
    "$\n",
    "\n",
    "Or [gas-weighted allocation](https://memoakten.medium.com/the-unreasonable-ecological-cost-of-cryptoart-2221d3eb2053):\n",
    "\n",
    "$\n",
    "hashcount_{date} \\times \\dfrac{gas_{tx}}{gas_{date}}\n",
    "$\n",
    "\n",
    "We repeat that here."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "def model_tx_count(tx):\n",
    "    date = get_tx_date(tx)\n",
    "    return history.hashcount[date] / history.tx_count[date]\n",
    "\n",
    "def model_gas(tx):\n",
    "    date = get_tx_date(tx)\n",
    "    return history.hashcount[date] * get_tx_gas(tx) / history.gas_used[date]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## FeesOnly model\n",
    "\n",
    "This is the simplest interpretation of the idea that \"users should be held accountable for a service proportional to how much they pay for that service\", because the payment is what rewards and therefore incentivizes the service to continue running. This is similar to the gas-based model, adding gas price to the mix.\n",
    "\n",
    "$\n",
    "hashcount_{date}\\times\\dfrac{fees_{tx}}{fees_{date}}\n",
    "$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "def model_fees_only(tx):\n",
    "    tx_date = get_tx_date(tx)\n",
    "    fee_ratio = get_tx_fees(tx) / history.tx_fees[tx_date]\n",
    "    return history.hashcount[tx_date] * fee_ratio"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## HistoricalFees model\n",
    "\n",
    "The approach of the FeesOnly model looks at each transaction in the context of the day on which it was made. This time envelope could be narrowed or expanded. It could be narrowed to the block on which it was made (which should be similar to FeesOnly with some added noise). Or it could be expanded to include the entire history of Ethereum. Expanding would account for the fact that Ethereum transactions do not happen in a vacuum, but they build on all previous transactions, and lay a foundation for future transactions.\n",
    "\n",
    "One challenge of this model: until Ethereum docks with Ethereum 2, these numbers will changes over time as the `history.hashcount_total` and `history.fees_total` changes.\n",
    "\n",
    "$\n",
    "hashcount_{total}\\times\\dfrac{fees_{tx}}{fees_{total}}\n",
    "$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "def model_historical_fees(tx):\n",
    "    fee_ratio = get_tx_fees(tx) / history.tx_fees_total\n",
    "    return history.hashcount_total * fee_ratio"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## HistoricalFeesTimesPrice model\n",
    "\n",
    "Because the price of Ethereum varies from day to day, a transaction fee on a high-priced day pays more to miners in fiat equivalent than the same transaction fee on a low-priced day.\n",
    "\n",
    "$\n",
    "hashcount_{total}\\times\\dfrac{fees_{tx} \\times price_{date}}{\\sum_{d}^{history} fees_{d} \\times price_{d}}\n",
    "$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [],
   "source": [
    "# compute the fee volume across all dates \n",
    "all_fees_price = sum([history.tx_fees[date] * history.price[date] for date in history.dates])\n",
    "\n",
    "def model_historical_fees_price(tx):\n",
    "    tx_date = get_tx_date(tx)\n",
    "    tx_fees_price = get_tx_fees(tx) * history.price[tx_date]\n",
    "    fees_price_ratio = tx_fees_price / all_fees_price\n",
    "    return history.hashcount_total * fees_price_ratio"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## FeesAndBlock model\n",
    "\n",
    "It could be argued that miners are only half-incentivized by transaction fees, because transaction fees only make up about half of their income, with the other half coming from block rewards.\n",
    "\n",
    "Consider two blocks with two transactions each:\n",
    "\n",
    "1. Block 1 has transaction A paying 200 gwei and transaction B paying 100 gwei\n",
    "2. Block 2 has transaction A paying 2 ETH and transaction B paying 1 ETH\n",
    "\n",
    "Although the ratio between transactions A and B are similar in each block, the miner is arguably disproportionately more incentivized by transaction A over transaction B in block 2 compared to block 1. If the block reward is 2 ETH, and we assume that every transaction is equally responsible for the block reward, then we could argue that the weighting for the transactions in each block is as follows:\n",
    "\n",
    "* block 1 tx A = (200 gwei + 2 ETH / 2) / (200 gwei + 100 gwei + 2 ETH) ~= 1/2\n",
    "* block 1 tx B = (100 gwei + 2 ETH / 2) / (200 gwei + 100 gwei + 2 ETH) ~= 1/2\n",
    "* block 2 tx A = (2 ETH + 2 ETH / 2) / (2 ETH + 1 ETH + 2 ETH) = 4/6\n",
    "* block 2 tx B = (1 ETH + 2 ETH / 2) / (2 ETH + 1 ETH + 2 ETH) = 2/6\n",
    "\n",
    "Like other models, this model operates on a per-day basis, so the block rewards include uncle block rewards.\n",
    "\n",
    "$\n",
    "hashcount_{date}\\times\\dfrac{fees_{tx} + blockrewards_{date} \\times \\dfrac{1}{txcount_{date}}}{fees_{date} + blockrewards_{date}}\n",
    "$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "def model_fees_block(tx):\n",
    "    tx_date = get_tx_date(tx)\n",
    "    block_rewards = history.block_rewards[tx_date]\n",
    "    block_rewards_portion = block_rewards / history.tx_count[tx_date]\n",
    "    tx_fees_and_block = get_tx_fees(tx) + block_rewards_portion\n",
    "    all_fees_and_block = history.tx_fees[tx_date] + block_rewards\n",
    "    fees_and_block_ratio = tx_fees_and_block / all_fees_and_block\n",
    "    return history.hashcount[tx_date] * fees_and_block_ratio"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## FeesAndBlockTimesGas model\n",
    "\n",
    "Instead of assuming every transaction is equally responsible for the block reward, we can use gas as a weighting factor. This makes sense because high-gas transactions effectively \"push out\" low-gas transactions. If one transaction used 12,000,000 gas, then it uses part of the block that could be otherwised used for 120x transactions that use 100,000 gas.\n",
    "\n",
    "$\n",
    "hashcount_{date}\\times\\dfrac{fees_{tx} + blockrewards_{date} \\times \\dfrac{gas_{tx}}{gas_{date}}}{fees_{date} + blockrewards_{date}}\n",
    "$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "def model_fees_block_gas(tx):\n",
    "    tx_date = get_tx_date(tx)\n",
    "    block_rewards = history.block_rewards[tx_date]\n",
    "    tx_gas_ratio = get_tx_gas(tx) / history.gas_used[tx_date]\n",
    "    block_rewards_portion = block_rewards * tx_gas_ratio\n",
    "    tx_fees_and_block = get_tx_fees(tx) + block_rewards_portion\n",
    "    all_fees_and_block = history.tx_fees[tx_date] + block_rewards\n",
    "    fees_and_block_ratio = tx_fees_and_block / all_fees_and_block\n",
    "    return history.hashcount[tx_date] * fees_and_block_ratio"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## HistoricalFeesAndBlock model\n",
    "\n",
    "This opens the \"time envelope\" of the FeesAndBlock approach to cover all of Ethereum's history.\n",
    "\n",
    "$hashcount_{total}\\times\\dfrac{fees_{tx} + blockrewards_{total} \\times \\dfrac{1}{txcount_{total}}}{fees_{total} + blockrewards_{total}}$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "def model_historical_fees_block(tx):\n",
    "    block_rewards = history.block_rewards_total\n",
    "    block_rewards_portion = block_rewards / history.tx_count_total\n",
    "    tx_fees_and_block = get_tx_fees(tx) + block_rewards_portion\n",
    "    all_fees_and_block = history.tx_fees_total + block_rewards\n",
    "    fees_and_block_ratio = tx_fees_and_block / all_fees_and_block\n",
    "    return history.hashcount_total * fees_and_block_ratio"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## HistoricalFeesAndBlockTimesGas model\n",
    "\n",
    "This adds gas weighting to the HistoricalFeesAndBlock model.\n",
    "\n",
    "$hashcount_{total}\\times\\dfrac{fees_{tx} + blockrewards_{total} \\times \\dfrac{gas_{tx}}{gas_{total}}}{fees_{total} + blockrewards_{total}}$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "def model_historical_fees_block_gas(tx):\n",
    "    block_rewards = history.block_rewards_total\n",
    "    tx_gas_ratio = get_tx_gas(tx) / history.gas_used_total\n",
    "    block_rewards_portion = block_rewards * tx_gas_ratio\n",
    "    tx_fees_and_block = get_tx_fees(tx) + block_rewards_portion\n",
    "    all_fees_and_block = history.tx_fees_total + block_rewards\n",
    "    fees_and_block_ratio = tx_fees_and_block / all_fees_and_block\n",
    "    return history.hashcount_total * fees_and_block_ratio"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## HistoricalFeesAndBlockTimesPrice model\n",
    "\n",
    "This weights HistoricalFeesAndBlock by the price of Ethereum.\n",
    "\n",
    "$hashcount_{total}\\times\\dfrac{(fees_{tx} + blockrewards_{total} \\times \\dfrac{1}{txcount_{total}}) \\times price_{date}}{\\sum_{d}^{history} (fees_{d} + blockrewards_{d}) \\times price_{d}}$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "all_fees_block_price = \\\n",
    "    sum([(history.tx_fees[date] + history.block_rewards[date]) * history.price[date] \n",
    "         for date in history.dates])\n",
    "\n",
    "def model_historical_fees_block_price(tx):\n",
    "    tx_price = history.price[get_tx_date(tx)]\n",
    "    block_rewards = history.block_rewards_total\n",
    "    block_rewards_portion = block_rewards / history.tx_count_total\n",
    "    tx_fees_and_block_price = (get_tx_fees(tx) + block_rewards_portion) * tx_price\n",
    "    fees_and_block_price_ratio = tx_fees_and_block_price / all_fees_block_price\n",
    "    return history.hashcount_total * fees_and_block_price_ratio"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## HistoricalFeesAndBlockTimesGasAndPrice model\n",
    "\n",
    "This weights HistoricalFeesAndBlockTimesPrice by the gas used instead of treating each transaction equally.\n",
    "\n",
    "$hashcount_{total}\\times\\dfrac{(fees_{tx} + blockrewards_{total} \\times \\dfrac{gas_{tx}}{gas_{total}}) \\times price_{date}}{\\sum_{d}^{history} (fees_{d} + blockrewards_{d}) \\times price_{d}}$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "def model_historical_fees_block_gas_price(tx):\n",
    "    tx_price = history.price[get_tx_date(tx)]\n",
    "    block_rewards = history.block_rewards_total\n",
    "    tx_gas_ratio = get_tx_gas(tx) / history.gas_used_total\n",
    "    block_rewards_portion = block_rewards * tx_gas_ratio\n",
    "    tx_fees_and_block_price = (get_tx_fees(tx) + block_rewards_portion) * tx_price\n",
    "    fees_and_block_price_ratio = tx_fees_and_block_price / all_fees_block_price\n",
    "    return history.hashcount_total * fees_and_block_price_ratio"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The last two models are harder to implement because they require close analysis of the Ethereum blockchain.\n",
    "\n",
    "## ExtraPrice model\n",
    "\n",
    "Miners prefer transactions that pay higher gas prices. To the extent that a transaction is higher than the minimum gas price that might have been paid, we may consider that transaction to be disproportionately incentivizing miners, and therefore disproportionately responsible for energy use. Something like:\n",
    "\n",
    "```python\n",
    "def model_extra_fee(tx):\n",
    "    block_tx = get_transactions(get_block(tx))\n",
    "    gas_prices = [get_gas_price(e) for e in block_tx]\n",
    "    min_gas_price = min(gas_prices)\n",
    "    tx_weight = get_gas_price(tx) - min_gas_price\n",
    "    all_weights = sum([(get_gas_price(e) - min_gas_price) for e in block_tx])\n",
    "    block_hashcount = history.hashcount[date] / history.block_count[date]\n",
    "    return block_hashcount * tx_weight / all_weights\n",
    "```\n",
    "\n",
    "## ExtraFee model\n",
    "\n",
    "Instead of looking at the increase over minimum gas price alone, we can also consider that a large gas usage with a larger gas price pays more to miners than a low gas usage with the same gas price. This could be considered the \"extra\" beyond what the miner would have been \"guaranteed\" to get paid otherwise. Something like:\n",
    "\n",
    "```python\n",
    "def model_extra_fee(tx):\n",
    "    block_tx = get_transactions(get_block(tx))\n",
    "    gas_prices = [get_gas_price(e) for e in block_tx]\n",
    "    min_gas_price = min(gas_prices)\n",
    "    tx_extra = get_tx_fees(tx) - min_gas_price * get_tx_gas(tx)\n",
    "    all_extra = sum([(get_tx_fees(e) - min_gas_price * get_tx_gas(e)) for e in block_tx])\n",
    "    block_hashcount = history.hashcount[date] / history.block_count[date]\n",
    "    return block_hashcount * tx_extra / all_extra\n",
    "```\n",
    "\n",
    "Both of these techniques have two related problems:\n",
    "\n",
    "1. Any transaction that has the lowest gas price will be held unaccountable.\n",
    "2. If all transactions have the same gas price, the result is undefined."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Test on one contract\n",
    "\n",
    "Let's test all the methods on a single contract. First we load the transactions then compute the different model results. Results are in exahashes (EH). For context, an average day on Ethereum at the beginning of 2021-04 was 42EH/day."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      " 2.2EH model_tx_count\n",
      " 4.3EH model_gas\n",
      " 3.7EH model_fees_only\n",
      " 8.5EH model_historical_fees\n",
      "18.0EH model_historical_fees_price\n",
      " 2.9EH model_fees_block\n",
      " 4.1EH model_fees_block_gas\n",
      " 2.1EH model_historical_fees_block\n",
      " 3.6EH model_historical_fees_block_gas\n",
      "13.9EH model_historical_fees_block_price\n",
      "23.8EH model_historical_fees_block_gas_price\n"
     ]
    }
   ],
   "source": [
    "methods = [\n",
    "    model_tx_count,\n",
    "    model_gas,\n",
    "    model_fees_only,\n",
    "    model_historical_fees,\n",
    "    model_historical_fees_price,\n",
    "    model_fees_block,\n",
    "    model_fees_block_gas,\n",
    "    model_historical_fees_block,\n",
    "    model_historical_fees_block_gas,\n",
    "    model_historical_fees_block_price,\n",
    "    model_historical_fees_block_gas_price\n",
    "]\n",
    "\n",
    "contracts = load_contracts()\n",
    "etherscan = Etherscan()\n",
    "address = contracts['Foundation/ERC-721']\n",
    "transactions = etherscan.load_transactions(address)\n",
    "for method in methods:\n",
    "    energy = sum(map(method, transactions))\n",
    "    print(f'{energy:4.1f}EH {method.__name__}')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Run on all contracts\n",
    "\n",
    "Finally we run all methods on all contracts."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Name</th>\n",
       "      <th>Kind</th>\n",
       "      <th>model_tx_count</th>\n",
       "      <th>model_gas</th>\n",
       "      <th>model_fees_only</th>\n",
       "      <th>model_historical_fees</th>\n",
       "      <th>model_historical_fees_price</th>\n",
       "      <th>model_fees_block</th>\n",
       "      <th>model_fees_block_gas</th>\n",
       "      <th>model_historical_fees_block</th>\n",
       "      <th>model_historical_fees_block_gas</th>\n",
       "      <th>model_historical_fees_block_price</th>\n",
       "      <th>model_historical_fees_block_gas_price</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Async</td>\n",
       "      <td>ASYNC</td>\n",
       "      <td>0.143748</td>\n",
       "      <td>0.162558</td>\n",
       "      <td>0.124107</td>\n",
       "      <td>0.139823</td>\n",
       "      <td>0.067317</td>\n",
       "      <td>0.143883</td>\n",
       "      <td>0.159391</td>\n",
       "      <td>0.172663</td>\n",
       "      <td>0.219798</td>\n",
       "      <td>0.163095</td>\n",
       "      <td>0.208760</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Async</td>\n",
       "      <td>ASYNC-V2</td>\n",
       "      <td>0.200851</td>\n",
       "      <td>0.344032</td>\n",
       "      <td>0.296351</td>\n",
       "      <td>0.709047</td>\n",
       "      <td>0.940308</td>\n",
       "      <td>0.239131</td>\n",
       "      <td>0.323761</td>\n",
       "      <td>0.237860</td>\n",
       "      <td>0.396614</td>\n",
       "      <td>0.838347</td>\n",
       "      <td>1.370288</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Foundation</td>\n",
       "      <td>ERC-721</td>\n",
       "      <td>2.164738</td>\n",
       "      <td>4.345547</td>\n",
       "      <td>3.725619</td>\n",
       "      <td>8.474106</td>\n",
       "      <td>18.038222</td>\n",
       "      <td>2.883011</td>\n",
       "      <td>4.056971</td>\n",
       "      <td>2.119077</td>\n",
       "      <td>3.630994</td>\n",
       "      <td>13.865983</td>\n",
       "      <td>23.775195</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Foundation</td>\n",
       "      <td>FND NFT (FNDNFT) ERC-20</td>\n",
       "      <td>0.892060</td>\n",
       "      <td>3.661544</td>\n",
       "      <td>3.048163</td>\n",
       "      <td>6.859674</td>\n",
       "      <td>14.622932</td>\n",
       "      <td>1.881579</td>\n",
       "      <td>3.376217</td>\n",
       "      <td>1.109844</td>\n",
       "      <td>3.030809</td>\n",
       "      <td>7.278497</td>\n",
       "      <td>19.887193</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Known Origin</td>\n",
       "      <td>KnownOriginDigitalAsset (KODA)</td>\n",
       "      <td>0.494542</td>\n",
       "      <td>1.785069</td>\n",
       "      <td>1.121553</td>\n",
       "      <td>1.695370</td>\n",
       "      <td>2.455538</td>\n",
       "      <td>0.680474</td>\n",
       "      <td>1.713380</td>\n",
       "      <td>0.574115</td>\n",
       "      <td>1.885666</td>\n",
       "      <td>1.479002</td>\n",
       "      <td>4.087416</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Makersplace</td>\n",
       "      <td>MakersTokenV2 (MKT2)</td>\n",
       "      <td>1.737923</td>\n",
       "      <td>8.157515</td>\n",
       "      <td>5.467773</td>\n",
       "      <td>9.116728</td>\n",
       "      <td>14.254929</td>\n",
       "      <td>2.980914</td>\n",
       "      <td>7.812724</td>\n",
       "      <td>2.293773</td>\n",
       "      <td>8.939848</td>\n",
       "      <td>6.699187</td>\n",
       "      <td>22.346666</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Nifty Gateway</td>\n",
       "      <td>multiple</td>\n",
       "      <td>4.166663</td>\n",
       "      <td>17.908292</td>\n",
       "      <td>19.258833</td>\n",
       "      <td>49.140657</td>\n",
       "      <td>95.725269</td>\n",
       "      <td>11.150536</td>\n",
       "      <td>18.546008</td>\n",
       "      <td>6.780348</td>\n",
       "      <td>17.766044</td>\n",
       "      <td>38.859482</td>\n",
       "      <td>99.169371</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Nifty Gateway</td>\n",
       "      <td>GUSD cashout</td>\n",
       "      <td>0.665149</td>\n",
       "      <td>0.519574</td>\n",
       "      <td>0.587835</td>\n",
       "      <td>1.446186</td>\n",
       "      <td>2.869845</td>\n",
       "      <td>0.630255</td>\n",
       "      <td>0.549573</td>\n",
       "      <td>0.615913</td>\n",
       "      <td>0.498730</td>\n",
       "      <td>3.559316</td>\n",
       "      <td>2.942581</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>OpenSea</td>\n",
       "      <td>Wyvern Exchange</td>\n",
       "      <td>20.732939</td>\n",
       "      <td>59.701787</td>\n",
       "      <td>43.841142</td>\n",
       "      <td>77.360625</td>\n",
       "      <td>138.746225</td>\n",
       "      <td>28.929100</td>\n",
       "      <td>57.856826</td>\n",
       "      <td>23.098735</td>\n",
       "      <td>59.997372</td>\n",
       "      <td>88.764434</td>\n",
       "      <td>190.863013</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>OpenSea</td>\n",
       "      <td>OpenSeaENSResolver</td>\n",
       "      <td>0.050202</td>\n",
       "      <td>0.032034</td>\n",
       "      <td>0.017652</td>\n",
       "      <td>0.004431</td>\n",
       "      <td>0.001010</td>\n",
       "      <td>0.049057</td>\n",
       "      <td>0.031526</td>\n",
       "      <td>0.047421</td>\n",
       "      <td>0.033440</td>\n",
       "      <td>0.031388</td>\n",
       "      <td>0.022623</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>OpenSea</td>\n",
       "      <td>WyvernProxyRegistry</td>\n",
       "      <td>3.607342</td>\n",
       "      <td>20.737222</td>\n",
       "      <td>16.053683</td>\n",
       "      <td>33.905935</td>\n",
       "      <td>65.514859</td>\n",
       "      <td>8.776520</td>\n",
       "      <td>19.361405</td>\n",
       "      <td>5.245888</td>\n",
       "      <td>19.149887</td>\n",
       "      <td>27.438575</td>\n",
       "      <td>91.820173</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>OpenSea</td>\n",
       "      <td>Wallet</td>\n",
       "      <td>0.018610</td>\n",
       "      <td>0.025581</td>\n",
       "      <td>0.021745</td>\n",
       "      <td>0.013668</td>\n",
       "      <td>0.011156</td>\n",
       "      <td>0.017611</td>\n",
       "      <td>0.024957</td>\n",
       "      <td>0.018571</td>\n",
       "      <td>0.024620</td>\n",
       "      <td>0.031153</td>\n",
       "      <td>0.039768</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>OpenSea</td>\n",
       "      <td>OpenSea Shared Storefront (OPENSTORE)</td>\n",
       "      <td>0.596648</td>\n",
       "      <td>0.610884</td>\n",
       "      <td>0.520495</td>\n",
       "      <td>1.167926</td>\n",
       "      <td>2.461713</td>\n",
       "      <td>0.562001</td>\n",
       "      <td>0.569387</td>\n",
       "      <td>0.503962</td>\n",
       "      <td>0.514627</td>\n",
       "      <td>3.248495</td>\n",
       "      <td>3.301427</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>OpenSea</td>\n",
       "      <td>OpenSea Token (OPT)</td>\n",
       "      <td>0.001303</td>\n",
       "      <td>0.002073</td>\n",
       "      <td>0.001793</td>\n",
       "      <td>0.008280</td>\n",
       "      <td>0.016686</td>\n",
       "      <td>0.001609</td>\n",
       "      <td>0.001904</td>\n",
       "      <td>0.001727</td>\n",
       "      <td>0.002380</td>\n",
       "      <td>0.010696</td>\n",
       "      <td>0.014707</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Rarible</td>\n",
       "      <td>MintableToken (RARI)</td>\n",
       "      <td>5.645323</td>\n",
       "      <td>13.601075</td>\n",
       "      <td>11.033884</td>\n",
       "      <td>25.590527</td>\n",
       "      <td>45.418417</td>\n",
       "      <td>7.960261</td>\n",
       "      <td>12.547744</td>\n",
       "      <td>6.303276</td>\n",
       "      <td>13.216937</td>\n",
       "      <td>32.223103</td>\n",
       "      <td>64.040930</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Rarible</td>\n",
       "      <td>RariToken (RARI)</td>\n",
       "      <td>1.622427</td>\n",
       "      <td>0.946999</td>\n",
       "      <td>0.858146</td>\n",
       "      <td>2.237027</td>\n",
       "      <td>3.174045</td>\n",
       "      <td>1.318784</td>\n",
       "      <td>0.910913</td>\n",
       "      <td>1.622143</td>\n",
       "      <td>1.060510</td>\n",
       "      <td>6.275408</td>\n",
       "      <td>4.146298</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>SuperRare</td>\n",
       "      <td>Bids</td>\n",
       "      <td>1.977734</td>\n",
       "      <td>1.884419</td>\n",
       "      <td>1.355568</td>\n",
       "      <td>2.727154</td>\n",
       "      <td>3.093423</td>\n",
       "      <td>1.866526</td>\n",
       "      <td>1.788397</td>\n",
       "      <td>2.198745</td>\n",
       "      <td>2.316748</td>\n",
       "      <td>4.862681</td>\n",
       "      <td>5.002817</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>SuperRare</td>\n",
       "      <td>SupeRare (SUPR)</td>\n",
       "      <td>0.849810</td>\n",
       "      <td>1.078560</td>\n",
       "      <td>0.560690</td>\n",
       "      <td>0.447884</td>\n",
       "      <td>0.579403</td>\n",
       "      <td>0.819236</td>\n",
       "      <td>1.053778</td>\n",
       "      <td>0.788263</td>\n",
       "      <td>1.005947</td>\n",
       "      <td>1.238957</td>\n",
       "      <td>1.340990</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>SuperRare</td>\n",
       "      <td>SuperRareV2 (SUPR)</td>\n",
       "      <td>0.727469</td>\n",
       "      <td>1.945337</td>\n",
       "      <td>1.411567</td>\n",
       "      <td>2.874003</td>\n",
       "      <td>4.040988</td>\n",
       "      <td>0.978684</td>\n",
       "      <td>1.846257</td>\n",
       "      <td>0.884211</td>\n",
       "      <td>2.206989</td>\n",
       "      <td>2.825138</td>\n",
       "      <td>6.127261</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>SuperRare</td>\n",
       "      <td>Unknown 1</td>\n",
       "      <td>0.614534</td>\n",
       "      <td>0.797429</td>\n",
       "      <td>0.716208</td>\n",
       "      <td>1.613156</td>\n",
       "      <td>3.384383</td>\n",
       "      <td>0.661845</td>\n",
       "      <td>0.760543</td>\n",
       "      <td>0.546111</td>\n",
       "      <td>0.677138</td>\n",
       "      <td>3.515993</td>\n",
       "      <td>4.344091</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>SuperRare</td>\n",
       "      <td>Unknown 2</td>\n",
       "      <td>0.351213</td>\n",
       "      <td>0.661289</td>\n",
       "      <td>0.570290</td>\n",
       "      <td>1.373644</td>\n",
       "      <td>2.704921</td>\n",
       "      <td>0.451026</td>\n",
       "      <td>0.621652</td>\n",
       "      <td>0.370056</td>\n",
       "      <td>0.617292</td>\n",
       "      <td>2.137184</td>\n",
       "      <td>3.516997</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>Zora</td>\n",
       "      <td>Market</td>\n",
       "      <td>0.000044</td>\n",
       "      <td>0.000616</td>\n",
       "      <td>0.000620</td>\n",
       "      <td>0.001456</td>\n",
       "      <td>0.001256</td>\n",
       "      <td>0.000254</td>\n",
       "      <td>0.000618</td>\n",
       "      <td>0.000148</td>\n",
       "      <td>0.000777</td>\n",
       "      <td>0.000390</td>\n",
       "      <td>0.002056</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>Zora</td>\n",
       "      <td>Media (ZORA)</td>\n",
       "      <td>0.252030</td>\n",
       "      <td>1.011055</td>\n",
       "      <td>0.835619</td>\n",
       "      <td>2.133766</td>\n",
       "      <td>4.295377</td>\n",
       "      <td>0.523185</td>\n",
       "      <td>0.925441</td>\n",
       "      <td>0.340511</td>\n",
       "      <td>0.921455</td>\n",
       "      <td>2.104826</td>\n",
       "      <td>5.641103</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "             Name                                   Kind  model_tx_count  \\\n",
       "0           Async                                  ASYNC        0.143748   \n",
       "1           Async                               ASYNC-V2        0.200851   \n",
       "2      Foundation                                ERC-721        2.164738   \n",
       "3      Foundation                FND NFT (FNDNFT) ERC-20        0.892060   \n",
       "4    Known Origin         KnownOriginDigitalAsset (KODA)        0.494542   \n",
       "5     Makersplace                   MakersTokenV2 (MKT2)        1.737923   \n",
       "6   Nifty Gateway                               multiple        4.166663   \n",
       "7   Nifty Gateway                           GUSD cashout        0.665149   \n",
       "8         OpenSea                        Wyvern Exchange       20.732939   \n",
       "9         OpenSea                     OpenSeaENSResolver        0.050202   \n",
       "10        OpenSea                    WyvernProxyRegistry        3.607342   \n",
       "11        OpenSea                                 Wallet        0.018610   \n",
       "12        OpenSea  OpenSea Shared Storefront (OPENSTORE)        0.596648   \n",
       "13        OpenSea                    OpenSea Token (OPT)        0.001303   \n",
       "14        Rarible                   MintableToken (RARI)        5.645323   \n",
       "15        Rarible                       RariToken (RARI)        1.622427   \n",
       "16      SuperRare                                   Bids        1.977734   \n",
       "17      SuperRare                        SupeRare (SUPR)        0.849810   \n",
       "18      SuperRare                     SuperRareV2 (SUPR)        0.727469   \n",
       "19      SuperRare                              Unknown 1        0.614534   \n",
       "20      SuperRare                              Unknown 2        0.351213   \n",
       "21           Zora                                 Market        0.000044   \n",
       "22           Zora                           Media (ZORA)        0.252030   \n",
       "\n",
       "    model_gas  model_fees_only  model_historical_fees  \\\n",
       "0    0.162558         0.124107               0.139823   \n",
       "1    0.344032         0.296351               0.709047   \n",
       "2    4.345547         3.725619               8.474106   \n",
       "3    3.661544         3.048163               6.859674   \n",
       "4    1.785069         1.121553               1.695370   \n",
       "5    8.157515         5.467773               9.116728   \n",
       "6   17.908292        19.258833              49.140657   \n",
       "7    0.519574         0.587835               1.446186   \n",
       "8   59.701787        43.841142              77.360625   \n",
       "9    0.032034         0.017652               0.004431   \n",
       "10  20.737222        16.053683              33.905935   \n",
       "11   0.025581         0.021745               0.013668   \n",
       "12   0.610884         0.520495               1.167926   \n",
       "13   0.002073         0.001793               0.008280   \n",
       "14  13.601075        11.033884              25.590527   \n",
       "15   0.946999         0.858146               2.237027   \n",
       "16   1.884419         1.355568               2.727154   \n",
       "17   1.078560         0.560690               0.447884   \n",
       "18   1.945337         1.411567               2.874003   \n",
       "19   0.797429         0.716208               1.613156   \n",
       "20   0.661289         0.570290               1.373644   \n",
       "21   0.000616         0.000620               0.001456   \n",
       "22   1.011055         0.835619               2.133766   \n",
       "\n",
       "    model_historical_fees_price  model_fees_block  model_fees_block_gas  \\\n",
       "0                      0.067317          0.143883              0.159391   \n",
       "1                      0.940308          0.239131              0.323761   \n",
       "2                     18.038222          2.883011              4.056971   \n",
       "3                     14.622932          1.881579              3.376217   \n",
       "4                      2.455538          0.680474              1.713380   \n",
       "5                     14.254929          2.980914              7.812724   \n",
       "6                     95.725269         11.150536             18.546008   \n",
       "7                      2.869845          0.630255              0.549573   \n",
       "8                    138.746225         28.929100             57.856826   \n",
       "9                      0.001010          0.049057              0.031526   \n",
       "10                    65.514859          8.776520             19.361405   \n",
       "11                     0.011156          0.017611              0.024957   \n",
       "12                     2.461713          0.562001              0.569387   \n",
       "13                     0.016686          0.001609              0.001904   \n",
       "14                    45.418417          7.960261             12.547744   \n",
       "15                     3.174045          1.318784              0.910913   \n",
       "16                     3.093423          1.866526              1.788397   \n",
       "17                     0.579403          0.819236              1.053778   \n",
       "18                     4.040988          0.978684              1.846257   \n",
       "19                     3.384383          0.661845              0.760543   \n",
       "20                     2.704921          0.451026              0.621652   \n",
       "21                     0.001256          0.000254              0.000618   \n",
       "22                     4.295377          0.523185              0.925441   \n",
       "\n",
       "    model_historical_fees_block  model_historical_fees_block_gas  \\\n",
       "0                      0.172663                         0.219798   \n",
       "1                      0.237860                         0.396614   \n",
       "2                      2.119077                         3.630994   \n",
       "3                      1.109844                         3.030809   \n",
       "4                      0.574115                         1.885666   \n",
       "5                      2.293773                         8.939848   \n",
       "6                      6.780348                        17.766044   \n",
       "7                      0.615913                         0.498730   \n",
       "8                     23.098735                        59.997372   \n",
       "9                      0.047421                         0.033440   \n",
       "10                     5.245888                        19.149887   \n",
       "11                     0.018571                         0.024620   \n",
       "12                     0.503962                         0.514627   \n",
       "13                     0.001727                         0.002380   \n",
       "14                     6.303276                        13.216937   \n",
       "15                     1.622143                         1.060510   \n",
       "16                     2.198745                         2.316748   \n",
       "17                     0.788263                         1.005947   \n",
       "18                     0.884211                         2.206989   \n",
       "19                     0.546111                         0.677138   \n",
       "20                     0.370056                         0.617292   \n",
       "21                     0.000148                         0.000777   \n",
       "22                     0.340511                         0.921455   \n",
       "\n",
       "    model_historical_fees_block_price  model_historical_fees_block_gas_price  \n",
       "0                            0.163095                               0.208760  \n",
       "1                            0.838347                               1.370288  \n",
       "2                           13.865983                              23.775195  \n",
       "3                            7.278497                              19.887193  \n",
       "4                            1.479002                               4.087416  \n",
       "5                            6.699187                              22.346666  \n",
       "6                           38.859482                              99.169371  \n",
       "7                            3.559316                               2.942581  \n",
       "8                           88.764434                             190.863013  \n",
       "9                            0.031388                               0.022623  \n",
       "10                          27.438575                              91.820173  \n",
       "11                           0.031153                               0.039768  \n",
       "12                           3.248495                               3.301427  \n",
       "13                           0.010696                               0.014707  \n",
       "14                          32.223103                              64.040930  \n",
       "15                           6.275408                               4.146298  \n",
       "16                           4.862681                               5.002817  \n",
       "17                           1.238957                               1.340990  \n",
       "18                           2.825138                               6.127261  \n",
       "19                           3.515993                               4.344091  \n",
       "20                           2.137184                               3.516997  \n",
       "21                           0.000390                               0.002056  \n",
       "22                           2.104826                               5.641103  "
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cols = ('Name', 'Kind', *[e.__name__ for e in methods])\n",
    "\n",
    "rows = []\n",
    "for name_kind, address in contracts.items():\n",
    "    if name_kind == 'Nifty Gateway/multiple':\n",
    "        addresses = list_nifty_gateway(update=False)\n",
    "        transactions = etherscan.load_transactions_multiple(addresses)\n",
    "    else:\n",
    "        transactions = etherscan.load_transactions(address)\n",
    "        \n",
    "    row = name_kind.split('/')\n",
    "    for method in methods:\n",
    "        energy = sum(map(method, transactions))\n",
    "        row.append(energy)\n",
    "    rows.append(row)\n",
    "    \n",
    "df = pd.DataFrame(rows, columns=cols)\n",
    "df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Disclaimers\n",
    "\n",
    "* Analyzing hashcount (and implicitly, energy usage and emissions) is only half of a cost-benefit analysis. To determine whether Ethereum as a whole is an efficient use of energy, it is more appropriate to compare the costs and benefits of Ethereum to the costs and benefits of other markets or industries. This work only evaluates the costs.\n",
    "* To compute energy or emissions instead of hashcount, `hashcount` must be substituted with `energy` or `emissions` in all models. Neither energy nor emissions can be computed from hashcount directly because hashing efficiency (hashes per Watt) and emissions intensity (CO2 per Watt) vary over time."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.5"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}