coffea-casa-template.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Coffea Casa Analysis Template"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Table of Contents\n",
    "- [Introduction](#Introduction)\n",
    "- [Loading Files](#Loading-Files)\n",
    "- [The Processor Class](#The-Processor-Class)\n",
    "    - [Skeleton](#Skeleton)\n",
    "    - [Specifications](#Specifications)\n",
    "    - [Minimal Processor](#Minimal-Processor)\n",
    "- [The Dask Executor](#The-Dask-Executor)\n",
    "    - [Scheduler Setup](#Scheduler-Setup)\n",
    "    - [Running the Analysis](#Running-the-Analysis)\n",
    "- [Miscellaneous](#Miscellaneous)\n",
    "    - [ServiceX](#ServiceX)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Introduction\n",
    "This is a template file to elucidate the structure of a typical analysis notebook on coffe-casa. We will load in sample data, create a minimal processor class, and run the Dask executor."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import coffea\n",
    "import coffea.processor as processor\n",
    "import hist"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Loading Files\n",
    "\n",
    "A dataset is parsed as a dictionary where each key is a dataset name, and each value is a list of files in that dataset. You can have multiple datasets (multiple keys), and you can have multiple files in a dataset (multiple pointers in the list). Typically, CMS files will require authentication, but coffea-casa does away with this by implementation of tokens. In order to bypass authentication, replace the redirector portion of your file with xcache; i.e., the file:\n",
    "\n",
    "`root://`**xrootd.unl.edu**`//eos/cms/store/mc/RunIIAutumn18NanoAODv7/DYJetsToLL_M-50_TuneCP5_13TeV-amcatnloFXFX-pythia8/NANOAODSIM/Nano02Apr2020_102X_upgrade2018_realistic_v21_ext2-v1/260000/47DA174D-9F5A-F745-B2AA-B9F66CDADB1A.root`\n",
    "\n",
    "becomes\n",
    "\n",
    "`root://`**xcache**`//eos/cms/store/mc/RunIIAutumn18NanoAODv7/DYJetsToLL_M-50_TuneCP5_13TeV-amcatnloFXFX-pythia8/NANOAODSIM/Nano02Apr2020_102X_upgrade2018_realistic_v21_ext2-v1/260000/47DA174D-9F5A-F745-B2AA-B9F66CDADB1A.root`\n",
    "\n",
    "Below, we load in two datasets. The first has six files, and the second has four."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "fileset = {'tHq': ['root://xcache//store/mc/RunIISummer16NanoAODv5/THQ_Hincl_13TeV-madgraph-pythia8_TuneCUETP8M1/NANOAODSIM/PUMoriond17_Nano1June2019_102X_mcRun2_asymptotic_v7-v1/100000/38E83594-51BD-7D46-B96D-620DD60078A7.root',\n",
    "                    'root://xcache//store/mc/RunIISummer16NanoAODv5/THQ_Hincl_13TeV-madgraph-pythia8_TuneCUETP8M1/NANOAODSIM/PUMoriond17_Nano1June2019_102X_mcRun2_asymptotic_v7-v1/100000/3A3BA22C-AA71-2544-810A-6DF4C6BA96FC.root',\n",
    "                    'root://xcache//store/mc/RunIISummer16NanoAODv5/THQ_Hincl_13TeV-madgraph-pythia8_TuneCUETP8M1/NANOAODSIM/PUMoriond17_Nano1June2019_102X_mcRun2_asymptotic_v7-v1/100000/3AFB1F42-BC6D-D44E-86FD-DB93C83F88FF.root',\n",
    "                    'root://xcache//store/mc/RunIISummer16NanoAODv5/THQ_Hincl_13TeV-madgraph-pythia8_TuneCUETP8M1/NANOAODSIM/PUMoriond17_Nano1June2019_102X_mcRun2_asymptotic_v7-v1/100000/A37B4B7A-FB5B-484D-8577-40B860D77D23.root',\n",
    "                    'root://xcache//store/mc/RunIISummer16NanoAODv5/THQ_Hincl_13TeV-madgraph-pythia8_TuneCUETP8M1/NANOAODSIM/PUMoriond17_Nano1June2019_102X_mcRun2_asymptotic_v7-v1/100000/E3C7548E-EE40-BA45-9130-17DF56FBE537.root',\n",
    "                    'root://xcache//store/mc/RunIISummer16NanoAODv5/THQ_Hincl_13TeV-madgraph-pythia8_TuneCUETP8M1/NANOAODSIM/PUMoriond17_Nano1June2019_102X_mcRun2_asymptotic_v7-v1/100000/F9EFC559-09E9-BB48-8150-9AA8B7F02C1C.root'],\n",
    "            'tHW': ['root://xcache//store/mc/RunIISummer16NanoAODv5/THW_Hincl_13TeV-madgraph-pythia8_TuneCUETP8M1/NANOAODSIM/PUMoriond17_Nano1June2019_102X_mcRun2_asymptotic_v7-v1/70000/2806293E-D1DD-4A49-A274-0CC3BA57BBDF.root',\n",
    "                    'root://xcache//store/mc/RunIISummer16NanoAODv5/THW_Hincl_13TeV-madgraph-pythia8_TuneCUETP8M1/NANOAODSIM/PUMoriond17_Nano1June2019_102X_mcRun2_asymptotic_v7-v1/70000/2F19962E-1DFB-A14A-91C2-30B69D5651D3.root',\n",
    "                    'root://xcache//store/mc/RunIISummer16NanoAODv5/THW_Hincl_13TeV-madgraph-pythia8_TuneCUETP8M1/NANOAODSIM/PUMoriond17_Nano1June2019_102X_mcRun2_asymptotic_v7-v1/70000/D9744111-ED04-3F47-A52A-C18424F01609.root',\n",
    "                    'root://xcache//store/mc/RunIISummer16NanoAODv5/THW_Hincl_13TeV-madgraph-pythia8_TuneCUETP8M1/NANOAODSIM/PUMoriond17_Nano1June2019_102X_mcRun2_asymptotic_v7-v1/70000/E4CFA095-E7DB-B449-986D-1A5D21FD1D50.root']}"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## The Processor Class"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Skeleton"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "class Processor(processor.ProcessorABC):\n",
    "    def __init__(self):\n",
    "        ''' Initialize histogram properties here. Define self.output as an accumulator dictionary of the final histograms. '''\n",
    "        self.output = processor.dict_accumulator({})\n",
    "    def process(self, events):\n",
    "        ''' Define analysis details here. Fill the histograms in the dictionary, then return the accumulator. '''\n",
    "        return self.output\n",
    "\n",
    "    def postprocess(self, accumulator):\n",
    "        ''' This step executes once the accumulator has received all chunks of data. Handle weights, scaling, rebinning here.'''\n",
    "        return self.output"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Specifications\n",
    "This part is pure [Coffea](https://coffeateam.github.io/coffea/reference.html). The processor class encapsulates all of our analysis. It is what we send to our executor, which forwards it to our workers. For detailed instructions on how to create the processor class, see the Coffea examples and documentation, or refer to the benchmarks and analysis in this repository. In short:\n",
    "\n",
    "`__init__`: This is where we define our histograms, as per the [hist](https://hist.readthedocs.io/en/latest/) library. Categorical or sparse axes split data vertically, into different categories. Bin or dense axes split data horizontally, into the 'bars' of the histogram. Histograms are an accumulator, as are dictionaries of histograms. An accumulator is just any object that enables easy object addition; i.e., \\[AwkwardArray1\\] + \\[AwkwardArray2\\] = \\[AwkwardArray1 + AwkwardArray2\\]. They are the core of the coffea processor, as if you chunk up the data, the way in which you fill an accumulator with the chunks is irrelevant and you will always end up with the same result once all chunks have been processed. \n",
    "\n",
    "`process`: This is where all of the magic actually happens. All of your analysis code should go here. The current Coffea standard is to use NanoEvents for reading data. For a primer on columnar analysis, see the benchmarks and analysis in this repository, or the Coffea documentation's examples.\n",
    "\n",
    "`postprocess`: This is where we can make post-analysis adjustments, such as rebinning or scaling our histograms.\n",
    "\n",
    "### Minimal Processor\n",
    "We'll just plot the MET of our sample datasets. MET is an event-level property, so our arrays are flat and not jagged, which makes things a little more simple."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [],
   "source": [
    "class Processor(processor.ProcessorABC):\n",
    "    def __init__(self):\n",
    "        dataset_axis = hist.axis.StrCategory(name=\"dataset\", label=\"\", categories=[], growth=True)\n",
    "        # Split data into 50 bins, ranging from 0 to 100.\n",
    "        MET_axis = hist.axis.Regular(name=\"MET\", label=\"MET [GeV]\", bins=50, start=0, stop=100)\n",
    "        \n",
    "        self.output = processor.dict_accumulator({\n",
    "            'MET': hist.Hist(dataset_axis, MET_axis),\n",
    "        })\n",
    "    \n",
    "    def process(self, events):\n",
    "        dataset = events.metadata[\"dataset\"]\n",
    "        MET = events.MET.pt\n",
    "\n",
    "        self.output['MET'].fill(dataset=dataset, MET=MET)\n",
    "        return self.output\n",
    "\n",
    "    def postprocess(self, accumulator):\n",
    "        return accumulator"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## The Dask Executor\n",
    "\n",
    "### Scheduler Setup\n",
    "This is where [Dask](https://dask.org/) comes in. Now that we have a minimal processor put together, we can execute it on our sample data. This requires an executor. Coffea comes with basic executors such as `futures_executor` and `iterative_executor` which use strictly Pythonic tools. The Dask executor (`dask_executor`), however, is more sophisticated for cluster computing, and coffea-casa enables its usage.\n",
    "\n",
    "In the JupyterLab sidebar, you should see a sidecar dedicated to Dask:\n",
    "\n",
    "\n",
    "<img src=\"docs/dask.png\" alt=\"Drawing\" width=\"35%\"/>\n",
    "\n",
    "\n",
    "You can click on the UNL HTCondor Cluster button and drag it out into a block of the Jupyter Notebook, and it will paste everything necessary to connect to the Dask scheduler. It should look something like this (of course, the IP will be different):\n",
    "\n",
    "\n",
    "<img src=\"docs/daskclient.png\" alt=\"Drawing\" width=\"50%\"/>\n",
    "\n",
    "\n",
    "The Dask workers will then connect to this scheduler when the executor is run. You can also point to localhost:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "from dask.distributed import Client\n",
    "\n",
    "client = Client(\"tls://localhost:8786\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Running the Analysis\n",
    "\n",
    "Then, all we have to do is run the executor. This is done through the `processor.run_uproot_job` method. It requires the following to be provided as arguments:\n",
    "\n",
    "`fileset`: The files we want to run our analysis on. In our case, the sample file defined earlier.\n",
    "\n",
    "`treename`: This is the name of the tree inside of the root file. For NanoAODs, I believe this should always just be 'Events.'\n",
    "\n",
    "`executor`: The executor that we wish to use; coffea-casa is intended to be used with the Dask executor. You can also try `futures_executor` and `iterative_executor`, and both can be useful for debugging or troubleshooting when workers are acting up with errors.\n",
    "\n",
    "`executor_args`: There's a lot of optional arguments you can put in the dictionary here. See the run_uproot_job [documentation](https://coffeateam.github.io/coffea/api/coffea.processor.run_uproot_job.html). At minimum, we need to point to a Dask scheduler (`'client': client`) if we're using the Dask executor; we do not need to do this for the futures or iterative executor. If you're using NanoEvents, then you need to say so (`'schema': processor.NanoAODSchema`).\n",
    "\n",
    "`chunksize`: Coffea will split your data into chunks with this many events. If your data has a million events and your chunksize is 250000, you'll have four chunks. There is also a `maxchunks` argument you can put in, which will stop the analysis after a certain number of chunks are reached. In other words, `maxchunks=2` will only process 500000 events of your million. This can be useful for debugging."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[########################################] | 100% Completed | 12.4s\r"
     ]
    }
   ],
   "source": [
    "output = processor.run_uproot_job(fileset=fileset, \n",
    "                       treename=\"Events\",\n",
    "                       processor_instance=Processor(),\n",
    "                       executor=processor.dask_executor,\n",
    "                       executor_args={'client': client, 'schema': processor.NanoAODSchema},\n",
    "                       chunksize=250000)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[StairsArtists(stairs=<matplotlib.patches.StepPatch object at 0x7f501b0a8190>, errorbar=None, legend_artist=None),\n",
       " StairsArtists(stairs=<matplotlib.patches.StepPatch object at 0x7f501b0a8370>, errorbar=None, legend_artist=None)]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYQAAAEGCAYAAABlxeIAAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjUuMSwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/YYfK9AAAACXBIWXMAAAsTAAALEwEAmpwYAAAcjElEQVR4nO3df7DV9X3n8edLiIi2EH+SKxe8ZCXpgllNuTW0plk3tA35scGd1Xizk5V0mSXj2Gh3uhOhmWmTzrKDszsak1QbRqNoo0BprNSVGIPrdjKDEHStBowrCsoNV1GgSNuoQN77x/dzksO555x77rnn9/f1mDlzz3mf7+d7vp9Izvt+Pu/P93MVEZiZmZ3S7gswM7PO4IRgZmaAE4KZmSVOCGZmBjghmJlZMrndF1Cvc845JwYGBtp9GWZmXeXJJ598IyLOLfde1yaEgYEBduzY0e7LMDPrKpJervSep4zMzAxwQjAzs8QJwczMACcEMzNLnBDMzAxwQjAzs8QJwczMACcEMzNLuvbGNLN2+urf7mTX/jfLvjfv/Gn86b+d3+IrMps4JwSzOuza/ya7Rt5kXt+0k+Mj5ZMEOIlY53NCMKui0pd4IRms/8JvnhS/+ltb2TXyJld/a+uoNtv2HALgQ3POGhXftudQ2c9xorBWckIwq6LSSGBe3zTmnT9t1PHlYgUfmnNW2S/4aknHrJWcEMwY/0igknp+m6/Uptwow6yZnBDMGP9IoFUqTT9V4ikmmwgnBMuVRo0EWmG8ici1CJsoJwTLlU4dCZQz3i9w1yJsosZMCJLeD6wvCr0X+BPgnhQfAPYCn4mIw6nNSmAZcAK4PiIeSfEFwN3AVOBh4IaICElT0vkWAAeBqyNi74R7Z1ZGp40EGsW1CJuoMe9UjojnI+KSiLiE7Av7n4EHgBXAloiYC2xJr5E0DxgC5gOLgdskTUqnux1YDsxNj8Upvgw4HBEXArcANzWkd2ZmVrPxThktAl6MiJclLQEuT/G1wOPAjcASYF1EvA3skbQbuFTSXmBaRGwFkHQPcAWwObX5SjrXRuCbkhQRUV+3LO/GqhWY2WjjTQhDwP3p+YyIGAGIiBFJ56X4TOCJojbDKXYsPS+NF9rsS+c6LukIcDbwRvGHS1pONsJg9uzZ47x0y5NuqhW0QqXVSi42W7GaE4KkU4FPAyvHOrRMLKrEq7U5ORCxBlgDMDg46NGDddWqoXaplABdbLZS4xkhfBx4KiJeS69fk9SXRgd9wIEUHwZmFbXrB/aneH+ZeHGbYUmTgenAoXH1xHLJI4GxVSs2e+RgxcaTED7LL6eLADYBS4HV6eeDRfH7JN0MnE9WPN4eESckHZW0ENgGXAN8o+RcW4ErgcdcP7BaeSRQH48crFRNCUHS6cDvAl8oCq8GNkhaBrwCXAUQETslbQB2AceB6yLiRGpzLb9cdro5PQDuBO5NBehDZLUKM2siL1O1UjUlhIj4Z7Iib3HsINmqo3LHrwJWlYnvAC4qE3+LlFDMzKw9fKeydQUvIzVrPicE6wouHreWi8355IRgXcPF49ZwsTm/nBDM7CRepppfTghmVhOPHHqfE4KZ1cTLVHufE4J1FK8mMmufMbe/NmulwmqiUl5NZNZ8HiFYx/Fqou7jYnNvcEIwswlxsbl3OCGY2YS42Nw7XEMwMzPAIwRrE68myodKtQVwfaETOSFYW3hvot5X7b+j6wudyQnB2sariXpbtd/+XV/oTK4hmJkZ4IRgZmaJp4ysqVw8NuseTgjWVC4eWyW+u7nz1JQQJL0buIPs7yEH8J+A54H1wACwF/hMRBxOx68ElgEngOsj4pEUXwDcDUwFHgZuiIiQNAW4B1gAHASujoi9DeifdQAXj62U727uTLWOEG4FvhcRV0o6FTgd+GNgS0SslrQCWAHcKGkeMATMB84HfiDpfRFxArgdWA48QZYQFgObyZLH4Yi4UNIQcBNwdcN6aWYdxXc3d6YxE4KkacBHgM8DRMQ7wDuSlgCXp8PWAo8DNwJLgHUR8TawR9Ju4FJJe4FpEbE1nfce4AqyhLAE+Eo610bgm5IUETHRDppZd/FUUvvUMkJ4L/A6cJeki4EngRuAGRExAhARI5LOS8fPJBsBFAyn2LH0vDReaLMvneu4pCPA2cAbxRciaTnZCIPZs2fX2EUz6xaeSmqvWhLCZODXgS9GxDZJt5JND1WiMrGoEq/W5uRAxBpgDcDg4KBHD2Y9xlNJ7VVLQhgGhiNiW3q9kSwhvCapL40O+oADRcfPKmrfD+xP8f4y8eI2w5ImA9OBQ3X0x9rEy0vNut+YN6ZFxKvAPknvT6FFwC5gE7A0xZYCD6bnm4AhSVMkzQHmAtvT9NJRSQslCbimpE3hXFcCj7l+0F38l87Mul+tq4y+CHwnrTB6Cfh9smSyQdIy4BXgKoCI2ClpA1nSOA5cl1YYAVzLL5edbk4PgDuBe1MB+hDZKiXrMl5eatbdakoIEfE0MFjmrUUVjl8FrCoT30F2L0Np/C1SQjEzK8erj5rPdyqbWcfz6qPWcEIws47n1Uet4d1OzcwM8AjBzLqcawuN44RgZl3LtYXGckIws67l2kJjOSFYzSrdjQy+I9msF7iobDWrdDcy+I5ks17gEYKNi+9GNutdTghm1pO8+mj8nBDMrOd49VF9nBDMrOd49VF9XFQ2MzPACcHMzBInBDMzA1xDsDL85zCtl3n1UWVOCDZK4Qa00i9/33xm3c6rj6pzQrCyfAOa9SKvPqrONQQzMwNqTAiS9kp6VtLTknak2FmSHpX0Qvp5ZtHxKyXtlvS8pI8VxRek8+yW9HVJSvEpktan+DZJAw3up5mZjWE8I4R/ExGXRMRger0C2BIRc4Et6TWS5gFDwHxgMXCbpEmpze3AcmBueixO8WXA4Yi4ELgFuKn+LpmZWT0mUkNYAlyenq8FHgduTPF1EfE2sEfSbuBSSXuBaRGxFUDSPcAVwObU5ivpXBuBb0pSRMQErs/MrGZefVR7Qgjg+5IC+FZErAFmRMQIQESMSDovHTsTeKKo7XCKHUvPS+OFNvvSuY5LOgKcDbxRfBGSlpONMJg9e3aNl26VeHmpWcarjzK1JoTLImJ/+tJ/VNJPqhyrMrGoEq/W5uRAlojWAAwODnr0MEFeXmqW8eqjTE0JISL2p58HJD0AXAq8JqkvjQ76gAPp8GFgVlHzfmB/iveXiRe3GZY0GZgOHKqvSzYeXl5qZgVjJgRJZwCnRMTR9Pz3gD8DNgFLgdXp54OpySbgPkk3A+eTFY+3R8QJSUclLQS2AdcA3yhqsxTYClwJPOb6gZl1gjzVFmoZIcwAHkgrRCcD90XE9yT9CNggaRnwCnAVQETslLQB2AUcB66LiBPpXNcCdwNTyYrJm1P8TuDeVIA+RLZKycysrfJWWxgzIUTES8DFZeIHgUUV2qwCVpWJ7wAuKhN/i5RQzMw6Rd5qC75T2czMACcEMzNLnBDMzAzwbqdmZnXpxdVHTghmZuPUq6uPnBBywFtUmDVWr64+cg0hBwpbVJTyFhVmVswjhJzwFhVmNhYnBDOzBurmYrMTgplZg3R7sdkJwcysQbq92OyispmZAR4hmJm1RDfUFpwQzMyarFtqC04IZmZN1i21BdcQzMwM8Aihp3iLCjObCCeEHlLYoqL0y99bVJh1rkrFZmh9wdkJocd4iwqz7lHtF7V2FJxrTgiSJgE7gJ9GxKcknQWsBwaAvcBnIuJwOnYlsAw4AVwfEY+k+ALgbmAq8DBwQ0SEpCnAPcAC4CBwdUTsbUD/zMw6VrXf/ttRcB5PUfkG4Lmi1yuALRExF9iSXiNpHjAEzAcWA7elZAJwO7AcmJsei1N8GXA4Ii4EbgFuqqs3ZmZWt5oSgqR+4JPAHUXhJcDa9HwtcEVRfF1EvB0Re4DdwKWS+oBpEbE1IoJsRHBFmXNtBBZJUl09MjOzutQ6ZfQ14EvArxbFZkTECEBEjEg6L8VnAk8UHTecYsfS89J4oc2+dK7jko4AZwNvFF+EpOVkIwxmz55d46WbmXWnVt/dPGZCkPQp4EBEPCnp8hrOWe43+6gSr9bm5EDEGmANwODg4Kj3zcx6RTvubq5lhHAZ8GlJnwBOA6ZJ+kvgNUl9aXTQBxxIxw8Ds4ra9wP7U7y/TLy4zbCkycB04FCdfTIz63rtuLt5zBpCRKyMiP6IGCArFj8WEZ8DNgFL02FLgQfT803AkKQpkuaQFY+3p+mlo5IWpvrANSVtCue6Mn2GRwBmZi00kfsQVgMbJC0DXgGuAoiInZI2ALuA48B1EXEitbmWXy473ZweAHcC90raTTYyGJrAdZmZWR3GlRAi4nHg8fT8ILCownGrgFVl4juAi8rE3yIlFBubt6gws2bw5nZdqLBFRSlvUWFmE+GtK7qUt6gws0bzCMHMzAAnBDMzS5wQzMwMcEIwM7PECcHMzAAnBDMzS5wQzMwMcEIwM7PEN6Z1MG9RYWat5BFCB/MWFWbWSh4hdDhvUWFmreIRgpmZAU4IZmaWOCGYmRnghGBmZokTgpmZAU4IZmaWjJkQJJ0mabukv5e0U9JXU/wsSY9KeiH9PLOozUpJuyU9L+ljRfEFkp5N731dklJ8iqT1Kb5N0kAT+mpmZlXUMkJ4G/hoRFwMXAIslrQQWAFsiYi5wJb0GknzgCFgPrAYuE3SpHSu24HlwNz0WJziy4DDEXEhcAtw08S7ZmZm4zHmjWkREcA/ppfvSo8AlgCXp/ha4HHgxhRfFxFvA3sk7QYulbQXmBYRWwEk3QNcAWxObb6SzrUR+KYkpc/ued6iwsw6QU01BEmTJD0NHAAejYhtwIyIGAFIP89Lh88E9hU1H06xmel5afykNhFxHDgCnF3mOpZL2iFpx+uvv15TB7uBt6gws05Q09YVEXECuETSu4EHJF1U5XCVO0WVeLU2pdexBlgDMDg42FOjB29RYWbtNq5VRhHxD2RTQ4uB1yT1AaSfB9Jhw8Csomb9wP4U7y8TP6mNpMnAdODQeK7NzMwmppZVRuemkQGSpgK/A/wE2AQsTYctBR5MzzcBQ2nl0Byy4vH2NK10VNLCtLrompI2hXNdCTyWl/qBmVmnqGXKqA9Ym1YKnQJsiIiHJG0FNkhaBrwCXAUQETslbQB2AceB69KUE8C1wN3AVLJi8uYUvxO4NxWgD5GtUrJetnkFvPpscz/jPR+Aj69u7meY9ZBaVhk9A3ywTPwgsKhCm1XAqjLxHcCo+kNEvEVKKNZjKn3xv/zD7OcFH27O5778w+xR7rOdKMzK8t9DsOZ69dns8Z4PnBy/4MPN/WKuloicKMzKckKwxqj0BVxIBr//v1p7PZW+2J0ozCpyQrDaVZv3rzQF9J4PjB4dtJMThVlFTghWu0rTP9D8KaBmG2+iaHZB3KwNnBBsfNox/dNOlRLFXZ/MksJdnxz9XjcnRss1JwQbbax6gFX+36HaFFOhnZOFdSgnhBbqmk3sKk0NdVo9oJ3GO8UEnmayjueE0EKFTexKv/w7chO7vE0NNUq13/49zWQdzgmhxTpqEztPDbVWPdNMThTWQk4IeeapodbySibrcE4IeeepofartpLJrIWcEPLAU0PdyzUHayEnhDzw1FB3qvTfxlNJ1iROCHnhqaHu45virMWcEMy6jVcrWZM4IfQS1wrywauVrEmcEHqJawX55tVKNkFOCL3GtQIrxzUHq4ETQhN0zZ5Flg+uOViNxkwIkmYB9wDvAX4OrImIWyWdBawHBoC9wGci4nBqsxJYBpwAro+IR1J8AXA3MBV4GLghIkLSlPQZC4CDwNURsbdhvWyxrtqzyHqfaw5Wo1pGCMeBP4qIpyT9KvCkpEeBzwNbImK1pBXACuBGSfOAIWA+cD7wA0nvi4gTwO3AcuAJsoSwGNhMljwOR8SFkoaAm4CrG9nRVmvqnkUuHlsjeFmrlThlrAMiYiQinkrPjwLPATOBJcDadNha4Ir0fAmwLiLejog9wG7gUkl9wLSI2BoRQTYiKG5TONdGYJEkTbBvvatQPC7l4rE1QqV/R5X+3VnPGFcNQdIA8EFgGzAjIkYgSxqSzkuHzSQbARQMp9ix9Lw0XmizL53ruKQjwNnAG+O5vlxx8diaxSOH3Ko5IUj6FeCvgT+MiDer/AJf7o2oEq/WpvQalpNNOTF79uyxLtnMGsnF6Z5XU0KQ9C6yZPCdiPhuCr8mqS+NDvqAAyk+DMwqat4P7E/x/jLx4jbDkiYD04FDpdcREWuANQCDg4OjEoaZNZGL0z2vllVGAu4EnouIm4ve2gQsBVannw8Wxe+TdDNZUXkusD0iTkg6Kmkh2ZTTNcA3Ss61FbgSeCzVGfLNxWPrBr4hrmfUMkK4DPiPwLOSnk6xPyZLBBskLQNeAa4CiIidkjYAu8hWKF2XVhgBXMsvl51uTg/IEs69knaTjQyGJtatHuE7j63bVao5gKeTOtCYCSEifkj5OX6ARRXarAJWlYnvAC4qE3+LlFCshIvH1q2q/dLiukNH8p3KZtYc1b7UXXfoSE4IZtZ6XtrakZwQOoGLx2YZL21tKyeECWjYJnYuHptlxru01YmioZwQJqChm9i5eGxWme+BaAknhAlq6iZ2ZladaxEN5YRgZr3HtYi6OCGYWe/xFFNdnBDMLD88xVSVE0IreXmpWWfyFBPghNBaXl5q1pm83BVwQmg9Ly816x45SxROCGZm49WjRWsnBDOzRunyorUTgplZs9VTtC60a2GycEIwM2u28U4xQcVk8ScHj/Dy5H8BNH6HBCeEMVTawA6qbGLn5aVmVos6/mbEwLGXmnY5TghjqLSBHVTZxM7LS81soioki73//cNN+0gnhBrUtYGdl5eaWZc5pd0XYGZmnWHMhCDp25IOSPpxUewsSY9KeiH9PLPovZWSdkt6XtLHiuILJD2b3vu6JKX4FEnrU3ybpIEG99HMzGpQywjhbmBxSWwFsCUi5gJb0mskzQOGgPmpzW2SJqU2twPLgbnpUTjnMuBwRFwI3ALcVG9nzMysfmMmhIj4O+BQSXgJsDY9XwtcURRfFxFvR8QeYDdwqaQ+YFpEbI2IAO4paVM410ZgUWH0YGZmrVNvUXlGRIwARMSIpPNSfCbwRNFxwyl2LD0vjRfa7EvnOi7pCHA28Ebph0paTjbKYPbs2XVeegN5eamZ9ZBGF5XL/WYfVeLV2owORqyJiMGIGDz33HPrvMQGKiwvLeXlpWbWheodIbwmqS+NDvqAAyk+DMwqOq4f2J/i/WXixW2GJU0GpjN6iqpzeXmpmfWIekcIm4Cl6flS4MGi+FBaOTSHrHi8PU0vHZW0MNUHrilpUzjXlcBjqc5gZmYtNOYIQdL9wOXAOZKGgT8FVgMbJC0DXgGuAoiInZI2ALuA48B1EXEinepashVLU4HN6QFwJ3CvpN1kI4OhhvTMzMzGZcyEEBGfrfDWogrHrwJWlYnvAC4qE3+LlFDMzKx9vHVFUmkTu4ob2JmZ9RgnhKTSJnY3nX4f846+DHedMbqRl5eaWQ9xQihSdhO7u/4bvPoSUOaL38tLzayHOCHUwktLzSwHvNupmZkBTghmZpY4IZiZGeCEYGZmiROCmZkBXmX0C0uP/AUXHH8R7pp+8hu+18DMcsIjhOSC4y8ycOyl0W/4XgMzywmPEIrsfdd7me/7DcwspzxCMDMzwAnBzMyS3E0ZVdrV9L++c4LTT53UhisyM+sMuRshFHY1LXX6qZM449Tc5Uczs1/I5Tdg+V1Np5c/2MwsJ3KXEHy/gZlZebmbMvL9BmZm5XXMCEHSYuBWYBJwR0SsbtZn+X4DM7PROmKEIGkS8OfAx4F5wGclzWvvVZmZ5UtHJATgUmB3RLwUEe8A64Albb4mM7Nc6ZQpo5nAvqLXw8CHSg+StBxYnl7+o6Tn6/y8c/iy3qizbbc6B3Cfe5/7nA8T+Q67oNIbnZIQVCYWowIRa4A1E/4waUdEDE70PN3Efc4H9zkfmtXnTpkyGgZmFb3uB/a36VrMzHKpUxLCj4C5kuZIOhUYAja1+ZrMzHKlI6aMIuK4pD8AHiFbdvrtiNjZxI+c8LRTF3Kf88F9zoem9FkRo6bqzcwshzplysjMzNrMCcHMzIAcJgRJiyU9L2m3pBXtvp5mkDRL0v+W9JyknZJuSPGzJD0q6YX088x2X2sjSZok6f9Keii97vX+vlvSRkk/Sf+tfzMHff4v6d/0jyXdL+m0XuuzpG9LOiDpx0Wxin2UtDJ9nz0v6WMT+excJYQcbZFxHPijiPiXwELgutTPFcCWiJgLbEmve8kNwHNFr3u9v7cC34uIXwMuJut7z/ZZ0kzgemAwIi4iW4AyRO/1+W5gcUmsbB/T/6+HgPmpzW3pe64uuUoI5GSLjIgYiYin0vOjZF8UM8n6ujYdtha4oi0X2ASS+oFPAncUhXu5v9OAjwB3AkTEOxHxD/Rwn5PJwFRJk4HTye5X6qk+R8TfAYdKwpX6uARYFxFvR8QeYDfZ91xd8pYQym2RMbNN19ISkgaADwLbgBkRMQJZ0gDOa+OlNdrXgC8BPy+K9XJ/3wu8DtyVpsnukHQGPdzniPgp8D+BV4AR4EhEfJ8e7nORSn1s6Hda3hJCTVtk9ApJvwL8NfCHETH674b2CEmfAg5ExJPtvpYWmgz8OnB7RHwQ+Ce6f6qkqjRvvgSYA5wPnCHpc+29qrZr6Hda3hJCbrbIkPQusmTwnYj4bgq/Jqkvvd8HHGjX9TXYZcCnJe0lmwb8qKS/pHf7C9m/5eGI2JZebyRLEL3c598B9kTE6xFxDPgu8Fv0dp8LKvWxod9peUsIudgiQ5LI5pafi4ibi97aBCxNz5cCD7b62pohIlZGRH9EDJD9N30sIj5Hj/YXICJeBfZJen8KLQJ20cN9JpsqWijp9PRvfBFZfayX+1xQqY+bgCFJUyTNAeYC2+v+lIjI1QP4BPD/gBeBL7f7eprUxw+TDRufAZ5Oj08AZ5OtUHgh/Tyr3dfahL5fDjyUnvd0f4FLgB3pv/PfAGfmoM9fBX4C/Bi4F5jSa30G7ierkRwjGwEsq9ZH4Mvp++x54OMT+WxvXWFmZkD+pozMzKwCJwQzMwOcEMzMLHFCMDMzwAnBzMwSJwQzMwOcECxnJIWke4teT5b0etGW2Z9Pr58uelxc9PyQpD3p+Q9Kzj0g6WeSni6KzZB0n6SXJD0paaukfzfGNe4puuGsEPuapC9J+m1Ju4q3RjZrlI74m8pmLfRPwEWSpkbEz4DfBX5acsz6iPiDktglAJLuJrvxbWOF878YEYVjRXbD2NqI+A8pdgHw6TGucR3ZHddfTW1OAa4ELouIlyV9AnhojHOYjZtHCJZHm8m2ygb4LNmdoc3wUeCdiPiLQiAiXo6Ib8Av/qDP/5D0I0nPSPpCOux+soRQ8BFgb0S83KTrNAOcECyf1pHt/3Ia8K/ItgYvdnXJlNHUOj9nPvBUlfeXkW3h/BvAbwD/WdKciHgG+Lmki9NxQzQvaZn9ghOC5U76wh0gGx08XOaQ9RFxSdHjZ434XEl/LunvJf0ohX4PuCbVHLaR7VczN713P1nSmky25fNfNeIazKpxDcHyahPZH1u5nOyLuBl2Av++8CIirpN0DtmGdJDtZf/FiHikTNv7ge8D/wd4JiJ6cUtn6zAeIVhefRv4s4h4tomf8RhwmqRri2KnFz1/BLg2/e0KJL0v/dUzIuJF4CCwGk8XWYs4IVguRcRwRNxa4e3SGsJv1fkZQfa3b/91Wkq6nezv4d6YDrmD7G8YPJWWkX6Lk0ft9wO/BjxQz+ebjZe3vzZrkPT3qx+KiIt64XMsfzxCMGucE8D04hvTGk3SbwN/C7zRrM+w/PIIwczMAI8QzMwscUIwMzPACcHMzBInBDMzA+D/A7Oxw+VcXuRPAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "output['MET'].plot1d()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Miscellaneous\n",
    "\n",
    "### ServiceX\n",
    "[ServiceX](https://servicex.readthedocs.io/en/latest/introduction/) is a data delivery package which uses [func_adl](https://pypi.org/project/func-adl/) to fetch data. \n",
    "\n",
    "**The coffea-casa facility is built to support ServiceX, though it is currently in experimental stages. This section will be updated as ServiceX implementation becomes more stable.**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.13"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}