Clean_Data.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Clean WhoPaysWriters Data\n",
    "\n",
    "A sloppy, nevertheless effective way to clean data from [WhoPaysWriters.com](http://whopayswriters.com/#/results)\n",
    "\n",
    "[allData_raw.csv](allData_raw.csv) is created by [scrapeWPW.py](scrapeWPW.py)\n",
    "\n",
    "A few of the decisions that I've made:\n",
    "* I'm replacing most `other` entries with NaNs.\n",
    "* I'm dropping everything with fewer than 100 words\n",
    "* I'm dropping all `fiction` and `poetry` entries\n",
    "* I'm dropping entries for 2019\n",
    "* Potential spam, unreasonable outliers are cut. They are addressed on a case-by-case basis"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>comment</th>\n",
       "      <th>contract</th>\n",
       "      <th>dollar</th>\n",
       "      <th>flatRate</th>\n",
       "      <th>levelOfReporting</th>\n",
       "      <th>paidYet</th>\n",
       "      <th>paymentDifficulty</th>\n",
       "      <th>platform</th>\n",
       "      <th>publication</th>\n",
       "      <th>relationship</th>\n",
       "      <th>rights</th>\n",
       "      <th>storyType</th>\n",
       "      <th>wordCount</th>\n",
       "      <th>year</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>694</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract:</td>\n",
       "      <td>$0.05</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>Haven't gotten it yet (as of this reporting)</td>\n",
       "      <td>svg-3</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>The Brooklyn Quarterly</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>opinion, editorial, column or essay</td>\n",
       "      <td>2500</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2544</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.18</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>Haven't gotten it yet (as of this reporting)</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Into</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: Other / I don't know</td>\n",
       "      <td>opinion, editorial, column or essay</td>\n",
       "      <td>1400</td>\n",
       "      <td>2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>560</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.03</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Jackson Free Press</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>criticism, review, or arts/entertainment conve...</td>\n",
       "      <td>~750</td>\n",
       "      <td>2014</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>289</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.33</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 1 month</td>\n",
       "      <td>svg-2</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Quartz</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>news story</td>\n",
       "      <td>750</td>\n",
       "      <td>2016</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3039</th>\n",
       "      <td>\"Did not ask rate before publication (glad to ...</td>\n",
       "      <td>Contract: No</td>\n",
       "      <td>$0.20</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Los Angeles Times</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>opinion, editorial, column or essay</td>\n",
       "      <td>~750</td>\n",
       "      <td>2015</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1506</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.10</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 15 days</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: print</td>\n",
       "      <td>Timeline</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights: Secondary Rights/Reprint</td>\n",
       "      <td>feature</td>\n",
       "      <td>5800</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1802</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.05</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 15 days</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Submittable</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>blog post</td>\n",
       "      <td>1000</td>\n",
       "      <td>2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2260</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract:</td>\n",
       "      <td>$0.07</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Haven't gotten it yet (as of this reporting)</td>\n",
       "      <td>svg-3</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Kveller</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>NaN</td>\n",
       "      <td>700-word</td>\n",
       "      <td>2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2040</th>\n",
       "      <td>\"A good writing/editing/payment experience.\"</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$2.00</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>Paid in 15 days</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: print</td>\n",
       "      <td>Conde Nast Traveler</td>\n",
       "      <td>Referral (you had a connection who connected y...</td>\n",
       "      <td>Rights: Other / I don't know</td>\n",
       "      <td>opinion, editorial, column or essay</td>\n",
       "      <td>550</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>806</th>\n",
       "      <td>\"for “non-‘magazine’ essay on their website.”\"</td>\n",
       "      <td>Contract:</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>The New Inquiry</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Rights:</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2012</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2345</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: No</td>\n",
       "      <td>$0.03</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 1 month</td>\n",
       "      <td>svg-2</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Los Angeles Review Of Books</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: Other / I don't know</td>\n",
       "      <td>criticism, review, or arts/entertainment coverage</td>\n",
       "      <td>1700</td>\n",
       "      <td>2016</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>952</th>\n",
       "      <td>\"Careful, thoughtful edits and absurdly quick ...</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.33</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 1 month</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Atlas Obscura</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: Other / I don't know</td>\n",
       "      <td>feature</td>\n",
       "      <td>1200</td>\n",
       "      <td>2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>411</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.25</td>\n",
       "      <td>False</td>\n",
       "      <td>Heavy/Investigative reporting</td>\n",
       "      <td>Paid in 15 days</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Scalawag</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>feature</td>\n",
       "      <td>2000</td>\n",
       "      <td>2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2684</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.60</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Longer than 3 months</td>\n",
       "      <td>svg-4</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Nautilus Magazine</td>\n",
       "      <td>Referral (you had a connection who connected y...</td>\n",
       "      <td>Rights: Other / I don't know</td>\n",
       "      <td>fob</td>\n",
       "      <td>581</td>\n",
       "      <td>2016</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2920</th>\n",
       "      <td>\"I have still not been paid for this assignmen...</td>\n",
       "      <td>Contract: Verbal or \"handshake\" agreement</td>\n",
       "      <td>$0.04</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Flaunt Magazine</td>\n",
       "      <td>Assignment (editor came to you)</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>profile or interview</td>\n",
       "      <td>~750</td>\n",
       "      <td>2015</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>855</th>\n",
       "      <td>\"Article was pushed back by 6 months because e...</td>\n",
       "      <td>Contract:</td>\n",
       "      <td>$0.42</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Longer than 3 months</td>\n",
       "      <td>svg-4</td>\n",
       "      <td>Platform: print</td>\n",
       "      <td>Virginia Quarterly Review</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>NaN</td>\n",
       "      <td>6500-word</td>\n",
       "      <td>2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2947</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.30</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 6 weeks</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Tonic (Vice)</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>opinion, editorial, column or essay</td>\n",
       "      <td>1000</td>\n",
       "      <td>2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1399</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Verbal or \"handshake\" agreement</td>\n",
       "      <td>$0.10</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>Paid in 2 months</td>\n",
       "      <td>svg-3</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Salon</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>opinion, editorial, column or essay</td>\n",
       "      <td>1200</td>\n",
       "      <td>2016</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2283</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.00</td>\n",
       "      <td>False</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Paid in 6 weeks</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Mithila Review</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>fiction</td>\n",
       "      <td>2500</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3433</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract:</td>\n",
       "      <td>$1.67</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Paid in 1 month</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: print</td>\n",
       "      <td>Discover</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Rights: Other / I don't know</td>\n",
       "      <td>fob</td>\n",
       "      <td>300</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2338</th>\n",
       "      <td>\"They pay on a bi-monthly schedule.\"</td>\n",
       "      <td>Contract: No</td>\n",
       "      <td>$0.04</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 2 months</td>\n",
       "      <td>svg-2</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Los Angeles Review Of Books</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: Other / I don't know</td>\n",
       "      <td>criticism, review, or arts/entertainment coverage</td>\n",
       "      <td>2500</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>928</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.67</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 15 days</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>The Open Notebook</td>\n",
       "      <td>Assignment (editor came to you)</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>other</td>\n",
       "      <td>1500</td>\n",
       "      <td>2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1782</th>\n",
       "      <td>\"Editor had engaged me for previous online art...</td>\n",
       "      <td>Contract: Verbal or \"handshake\" agreement</td>\n",
       "      <td>$0.00</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>Platform: print</td>\n",
       "      <td>De Magazine (or Design Exchange Magazine)</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights:</td>\n",
       "      <td>feature</td>\n",
       "      <td>~1500</td>\n",
       "      <td>2014</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>975</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.15</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>Paid in 15 days</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>On She Goes</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>opinion, editorial, column or essay</td>\n",
       "      <td>1000</td>\n",
       "      <td>2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>175</th>\n",
       "      <td>\"Editor writes, \"We don't pay,\" so I didn't wr...</td>\n",
       "      <td>Contract: No</td>\n",
       "      <td>$0.00</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>NaN</td>\n",
       "      <td>svg-false</td>\n",
       "      <td>Platform: print</td>\n",
       "      <td>Internet Retailer</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: Other / I don't know</td>\n",
       "      <td>fob</td>\n",
       "      <td>500</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1338</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract:</td>\n",
       "      <td>$0.38</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Paid in 1 month</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>The Cut (New York Magazine)</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>NaN</td>\n",
       "      <td>800-word</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1103</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.20</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Monster.com</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>news story</td>\n",
       "      <td>~750</td>\n",
       "      <td>2015</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1868</th>\n",
       "      <td>\"Very easy to work with, Editor was very respo...</td>\n",
       "      <td>Contract: No</td>\n",
       "      <td>$0.20</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Deep South Magazine</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: Other / I don't know</td>\n",
       "      <td>profile or interview</td>\n",
       "      <td>~750</td>\n",
       "      <td>2015</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1840</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Verbal or \"handshake\" agreement</td>\n",
       "      <td>$0.27</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Impact</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>fob</td>\n",
       "      <td>~750</td>\n",
       "      <td>2014</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2940</th>\n",
       "      <td>\"I had an amazing experience working with this...</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.40</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 15 days</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>National Education Association - Travel Newsle...</td>\n",
       "      <td>Solicited pitch (editor asked you to pitch)</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>feature</td>\n",
       "      <td>750</td>\n",
       "      <td>2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1660</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract:</td>\n",
       "      <td>$0.10</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Paid in 15 days</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>April Magazine</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Rights: Other / I don't know</td>\n",
       "      <td>NaN</td>\n",
       "      <td>800-word</td>\n",
       "      <td>2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1339</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.35</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>Paid in 3 months</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>The Cut (New York Magazine)</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>blog post</td>\n",
       "      <td>1000</td>\n",
       "      <td>2016</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1050</th>\n",
       "      <td>\"FanBread operates a network of influencer and...</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.05</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Fanbread</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>criticism, review, or arts/entertainment conve...</td>\n",
       "      <td>~375</td>\n",
       "      <td>2015</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2855</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract:</td>\n",
       "      <td>$0.03</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Paid in 15 days</td>\n",
       "      <td>svg-3</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>The Billfold</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1100-word</td>\n",
       "      <td>2016</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>490</th>\n",
       "      <td>\"Terribly frustrating experience. Solicited id...</td>\n",
       "      <td>Contract: No</td>\n",
       "      <td>$0.00</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>NaN</td>\n",
       "      <td>svg-false</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Nebraska Life</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: Other / I don't know</td>\n",
       "      <td>fob</td>\n",
       "      <td>500</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>595</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.25</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 1 month</td>\n",
       "      <td>svg-3</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>The Root</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>opinion, editorial, column or essay</td>\n",
       "      <td>800</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1816</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.20</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>Paid in 1 month</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Gq</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>news story</td>\n",
       "      <td>500</td>\n",
       "      <td>2016</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2527</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: No</td>\n",
       "      <td>$0.15</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Haven't gotten it yet (as of this reporting)</td>\n",
       "      <td>svg-2</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Broadly</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>opinion, editorial, column or essay</td>\n",
       "      <td>1395</td>\n",
       "      <td>2016</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>443</th>\n",
       "      <td>\"Accepted this rate before I saw what others a...</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.27</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 15 days</td>\n",
       "      <td>svg-2</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Smithsonian Magazine</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>feature</td>\n",
       "      <td>1500</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>644</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: No</td>\n",
       "      <td>$0.13</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 1 month</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Rewire News</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights: Other / I don't know</td>\n",
       "      <td>feature</td>\n",
       "      <td>1200</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2880</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract:</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Gulf Coast Magazine</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Rights:</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2013</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1360</th>\n",
       "      <td>\"This rate also included travel; the rate for ...</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.77</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>Platform: print</td>\n",
       "      <td>Maryland Life</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>feature</td>\n",
       "      <td>~750</td>\n",
       "      <td>2013</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1376</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract:</td>\n",
       "      <td>$0.04</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>Paid in 2 months</td>\n",
       "      <td>svg-3</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Consequence Of Sound</td>\n",
       "      <td>Solicited pitch (editor asked you to pitch)</td>\n",
       "      <td>Rights: Other / I don't know</td>\n",
       "      <td>criticism, review, or arts/entertainment coverage</td>\n",
       "      <td>600</td>\n",
       "      <td>2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2588</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.20</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 15 days</td>\n",
       "      <td>svg-2</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>The Bridge</td>\n",
       "      <td>Cold pitch (no pre-existing relationship)</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>feature</td>\n",
       "      <td>1500</td>\n",
       "      <td>2018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1068</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$1.00</td>\n",
       "      <td>False</td>\n",
       "      <td>Heavy/Investigative reporting</td>\n",
       "      <td>Paid in 6 weeks</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Crain's Chicago Business</td>\n",
       "      <td>Referral (you had a connection who connected y...</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>feature</td>\n",
       "      <td>1000</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2137</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract:</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Harper's</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Rights:</td>\n",
       "      <td>NaN</td>\n",
       "      <td>criticism, review, or arts/entertainment conv...</td>\n",
       "      <td>2013</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1272</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.01</td>\n",
       "      <td>False</td>\n",
       "      <td>Little to no reporting</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>The Toast</td>\n",
       "      <td>Submission/spec (piece was written prior and t...</td>\n",
       "      <td>Rights: First Serial Rights</td>\n",
       "      <td>opinion, editorial, column or essay</td>\n",
       "      <td>~3000</td>\n",
       "      <td>2015</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2471</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.10</td>\n",
       "      <td>False</td>\n",
       "      <td>Heavy/Investigative reporting</td>\n",
       "      <td>Paid in 6 weeks</td>\n",
       "      <td>svg-1</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Polygon</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>opinion, editorial, column or essay</td>\n",
       "      <td>3000</td>\n",
       "      <td>2017</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2357</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract:</td>\n",
       "      <td>$100</td>\n",
       "      <td>True</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ng-hide</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Los Angeles Review Of Books</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Rights:</td>\n",
       "      <td>NaN</td>\n",
       "      <td>criticism, review, or arts/entertainment conv...</td>\n",
       "      <td>2012</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1067</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Contract: Yes</td>\n",
       "      <td>$0.11</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium reporting</td>\n",
       "      <td>Paid in 1 month</td>\n",
       "      <td>svg-2</td>\n",
       "      <td>Platform: digital</td>\n",
       "      <td>Healthline</td>\n",
       "      <td>Ongoing/pre-existing relationship with editor ...</td>\n",
       "      <td>Rights: All rights</td>\n",
       "      <td>other</td>\n",
       "      <td>1069</td>\n",
       "      <td>2016</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                comment  \\\n",
       "694                                                 NaN   \n",
       "2544                                                NaN   \n",
       "560                                                 NaN   \n",
       "289                                                 NaN   \n",
       "3039  \"Did not ask rate before publication (glad to ...   \n",
       "1506                                                NaN   \n",
       "1802                                                NaN   \n",
       "2260                                                NaN   \n",
       "2040       \"A good writing/editing/payment experience.\"   \n",
       "806      \"for “non-‘magazine’ essay on their website.”\"   \n",
       "2345                                                NaN   \n",
       "952   \"Careful, thoughtful edits and absurdly quick ...   \n",
       "411                                                 NaN   \n",
       "2684                                                NaN   \n",
       "2920  \"I have still not been paid for this assignmen...   \n",
       "855   \"Article was pushed back by 6 months because e...   \n",
       "2947                                                NaN   \n",
       "1399                                                NaN   \n",
       "2283                                                NaN   \n",
       "3433                                                NaN   \n",
       "2338               \"They pay on a bi-monthly schedule.\"   \n",
       "928                                                 NaN   \n",
       "1782  \"Editor had engaged me for previous online art...   \n",
       "975                                                 NaN   \n",
       "175   \"Editor writes, \"We don't pay,\" so I didn't wr...   \n",
       "1338                                                NaN   \n",
       "1103                                                NaN   \n",
       "1868  \"Very easy to work with, Editor was very respo...   \n",
       "1840                                                NaN   \n",
       "2940  \"I had an amazing experience working with this...   \n",
       "1660                                                NaN   \n",
       "1339                                                NaN   \n",
       "1050  \"FanBread operates a network of influencer and...   \n",
       "2855                                                NaN   \n",
       "490   \"Terribly frustrating experience. Solicited id...   \n",
       "595                                                 NaN   \n",
       "1816                                                NaN   \n",
       "2527                                                NaN   \n",
       "443   \"Accepted this rate before I saw what others a...   \n",
       "644                                                 NaN   \n",
       "2880                                                NaN   \n",
       "1360  \"This rate also included travel; the rate for ...   \n",
       "1376                                                NaN   \n",
       "2588                                                NaN   \n",
       "1068                                                NaN   \n",
       "2137                                                NaN   \n",
       "1272                                                NaN   \n",
       "2471                                                NaN   \n",
       "2357                                                NaN   \n",
       "1067                                                NaN   \n",
       "\n",
       "                                       contract dollar flatRate  \\\n",
       "694                                  Contract:   $0.05    False   \n",
       "2544                              Contract: Yes  $0.18    False   \n",
       "560                               Contract: Yes  $0.03    False   \n",
       "289                               Contract: Yes  $0.33    False   \n",
       "3039                               Contract: No  $0.20    False   \n",
       "1506                              Contract: Yes  $0.10    False   \n",
       "1802                              Contract: Yes  $0.05    False   \n",
       "2260                                 Contract:   $0.07    False   \n",
       "2040                              Contract: Yes  $2.00    False   \n",
       "806                                  Contract:     NaN      NaN   \n",
       "2345                               Contract: No  $0.03    False   \n",
       "952                               Contract: Yes  $0.33    False   \n",
       "411                               Contract: Yes  $0.25    False   \n",
       "2684                              Contract: Yes  $0.60    False   \n",
       "2920  Contract: Verbal or \"handshake\" agreement  $0.04    False   \n",
       "855                                  Contract:   $0.42    False   \n",
       "2947                              Contract: Yes  $0.30    False   \n",
       "1399  Contract: Verbal or \"handshake\" agreement  $0.10    False   \n",
       "2283                              Contract: Yes  $0.00    False   \n",
       "3433                                 Contract:   $1.67    False   \n",
       "2338                               Contract: No  $0.04    False   \n",
       "928                               Contract: Yes  $0.67    False   \n",
       "1782  Contract: Verbal or \"handshake\" agreement  $0.00    False   \n",
       "975                               Contract: Yes  $0.15    False   \n",
       "175                                Contract: No  $0.00    False   \n",
       "1338                                 Contract:   $0.38    False   \n",
       "1103                              Contract: Yes  $0.20    False   \n",
       "1868                               Contract: No  $0.20    False   \n",
       "1840  Contract: Verbal or \"handshake\" agreement  $0.27    False   \n",
       "2940                              Contract: Yes  $0.40    False   \n",
       "1660                                 Contract:   $0.10    False   \n",
       "1339                              Contract: Yes  $0.35    False   \n",
       "1050                              Contract: Yes  $0.05    False   \n",
       "2855                                 Contract:   $0.03    False   \n",
       "490                                Contract: No  $0.00    False   \n",
       "595                               Contract: Yes  $0.25    False   \n",
       "1816                              Contract: Yes  $0.20    False   \n",
       "2527                               Contract: No  $0.15    False   \n",
       "443                               Contract: Yes  $0.27    False   \n",
       "644                                Contract: No  $0.13    False   \n",
       "2880                                 Contract:     NaN      NaN   \n",
       "1360                              Contract: Yes  $0.77    False   \n",
       "1376                                 Contract:   $0.04    False   \n",
       "2588                              Contract: Yes  $0.20    False   \n",
       "1068                              Contract: Yes  $1.00    False   \n",
       "2137                                 Contract:     NaN      NaN   \n",
       "1272                              Contract: Yes  $0.01    False   \n",
       "2471                              Contract: Yes  $0.10    False   \n",
       "2357                                 Contract:    $100     True   \n",
       "1067                              Contract: Yes  $0.11    False   \n",
       "\n",
       "                               levelOfReporting  \\\n",
       "694                      Little to no reporting   \n",
       "2544                     Little to no reporting   \n",
       "560                      Little to no reporting   \n",
       "289                            Medium reporting   \n",
       "3039                     Little to no reporting   \n",
       "1506                           Medium reporting   \n",
       "1802                           Medium reporting   \n",
       "2260                                        NaN   \n",
       "2040                     Little to no reporting   \n",
       "806                                         NaN   \n",
       "2345                           Medium reporting   \n",
       "952                            Medium reporting   \n",
       "411               Heavy/Investigative reporting   \n",
       "2684                           Medium reporting   \n",
       "2920                           Medium reporting   \n",
       "855                                         NaN   \n",
       "2947                           Medium reporting   \n",
       "1399                     Little to no reporting   \n",
       "2283  Cold pitch (no pre-existing relationship)   \n",
       "3433                                        NaN   \n",
       "2338                           Medium reporting   \n",
       "928                            Medium reporting   \n",
       "1782                           Medium reporting   \n",
       "975                      Little to no reporting   \n",
       "175                      Little to no reporting   \n",
       "1338                                        NaN   \n",
       "1103                     Little to no reporting   \n",
       "1868                           Medium reporting   \n",
       "1840                           Medium reporting   \n",
       "2940                           Medium reporting   \n",
       "1660                                        NaN   \n",
       "1339                     Little to no reporting   \n",
       "1050                     Little to no reporting   \n",
       "2855                                        NaN   \n",
       "490                            Medium reporting   \n",
       "595                            Medium reporting   \n",
       "1816                     Little to no reporting   \n",
       "2527                           Medium reporting   \n",
       "443                            Medium reporting   \n",
       "644                            Medium reporting   \n",
       "2880                                        NaN   \n",
       "1360                           Medium reporting   \n",
       "1376                     Little to no reporting   \n",
       "2588                           Medium reporting   \n",
       "1068              Heavy/Investigative reporting   \n",
       "2137                                        NaN   \n",
       "1272                     Little to no reporting   \n",
       "2471              Heavy/Investigative reporting   \n",
       "2357                                        NaN   \n",
       "1067                           Medium reporting   \n",
       "\n",
       "                                            paidYet paymentDifficulty  \\\n",
       "694   Haven't gotten it yet (as of this reporting)              svg-3   \n",
       "2544  Haven't gotten it yet (as of this reporting)              svg-1   \n",
       "560                                             NaN           ng-hide   \n",
       "289                                Paid in 1 month              svg-2   \n",
       "3039                                            NaN           ng-hide   \n",
       "1506                               Paid in 15 days              svg-1   \n",
       "1802                               Paid in 15 days              svg-1   \n",
       "2260  Haven't gotten it yet (as of this reporting)              svg-3   \n",
       "2040                               Paid in 15 days              svg-1   \n",
       "806                                             NaN           ng-hide   \n",
       "2345                               Paid in 1 month              svg-2   \n",
       "952                                Paid in 1 month              svg-1   \n",
       "411                                Paid in 15 days              svg-1   \n",
       "2684                          Longer than 3 months              svg-4   \n",
       "2920                                            NaN           ng-hide   \n",
       "855                           Longer than 3 months              svg-4   \n",
       "2947                               Paid in 6 weeks              svg-1   \n",
       "1399                              Paid in 2 months              svg-3   \n",
       "2283                               Paid in 6 weeks              svg-1   \n",
       "3433                               Paid in 1 month              svg-1   \n",
       "2338                              Paid in 2 months              svg-2   \n",
       "928                                Paid in 15 days              svg-1   \n",
       "1782                                            NaN           ng-hide   \n",
       "975                                Paid in 15 days              svg-1   \n",
       "175                                             NaN         svg-false   \n",
       "1338                               Paid in 1 month              svg-1   \n",
       "1103                                            NaN           ng-hide   \n",
       "1868                                            NaN           ng-hide   \n",
       "1840                                            NaN           ng-hide   \n",
       "2940                               Paid in 15 days              svg-1   \n",
       "1660                               Paid in 15 days              svg-1   \n",
       "1339                              Paid in 3 months              svg-1   \n",
       "1050                                            NaN           ng-hide   \n",
       "2855                               Paid in 15 days              svg-3   \n",
       "490                                             NaN         svg-false   \n",
       "595                                Paid in 1 month              svg-3   \n",
       "1816                               Paid in 1 month              svg-1   \n",
       "2527  Haven't gotten it yet (as of this reporting)              svg-2   \n",
       "443                                Paid in 15 days              svg-2   \n",
       "644                                Paid in 1 month              svg-1   \n",
       "2880                                            NaN           ng-hide   \n",
       "1360                                            NaN           ng-hide   \n",
       "1376                              Paid in 2 months              svg-3   \n",
       "2588                               Paid in 15 days              svg-2   \n",
       "1068                               Paid in 6 weeks              svg-1   \n",
       "2137                                            NaN           ng-hide   \n",
       "1272                                            NaN           ng-hide   \n",
       "2471                               Paid in 6 weeks              svg-1   \n",
       "2357                                            NaN           ng-hide   \n",
       "1067                               Paid in 1 month              svg-2   \n",
       "\n",
       "               platform                                        publication  \\\n",
       "694   Platform: digital                             The Brooklyn Quarterly   \n",
       "2544  Platform: digital                                               Into   \n",
       "560   Platform: digital                                 Jackson Free Press   \n",
       "289   Platform: digital                                             Quartz   \n",
       "3039  Platform: digital                                  Los Angeles Times   \n",
       "1506    Platform: print                                           Timeline   \n",
       "1802  Platform: digital                                        Submittable   \n",
       "2260  Platform: digital                                            Kveller   \n",
       "2040    Platform: print                                Conde Nast Traveler   \n",
       "806   Platform: digital                                    The New Inquiry   \n",
       "2345  Platform: digital                        Los Angeles Review Of Books   \n",
       "952   Platform: digital                                      Atlas Obscura   \n",
       "411   Platform: digital                                           Scalawag   \n",
       "2684  Platform: digital                                  Nautilus Magazine   \n",
       "2920  Platform: digital                                    Flaunt Magazine   \n",
       "855     Platform: print                          Virginia Quarterly Review   \n",
       "2947  Platform: digital                                       Tonic (Vice)   \n",
       "1399  Platform: digital                                              Salon   \n",
       "2283  Platform: digital                                     Mithila Review   \n",
       "3433    Platform: print                                           Discover   \n",
       "2338  Platform: digital                        Los Angeles Review Of Books   \n",
       "928   Platform: digital                                  The Open Notebook   \n",
       "1782    Platform: print          De Magazine (or Design Exchange Magazine)   \n",
       "975   Platform: digital                                        On She Goes   \n",
       "175     Platform: print                                  Internet Retailer   \n",
       "1338  Platform: digital                        The Cut (New York Magazine)   \n",
       "1103  Platform: digital                                        Monster.com   \n",
       "1868  Platform: digital                                Deep South Magazine   \n",
       "1840  Platform: digital                                             Impact   \n",
       "2940  Platform: digital  National Education Association - Travel Newsle...   \n",
       "1660  Platform: digital                                     April Magazine   \n",
       "1339  Platform: digital                        The Cut (New York Magazine)   \n",
       "1050  Platform: digital                                           Fanbread   \n",
       "2855  Platform: digital                                       The Billfold   \n",
       "490   Platform: digital                                      Nebraska Life   \n",
       "595   Platform: digital                                           The Root   \n",
       "1816  Platform: digital                                                 Gq   \n",
       "2527  Platform: digital                                            Broadly   \n",
       "443   Platform: digital                               Smithsonian Magazine   \n",
       "644   Platform: digital                                        Rewire News   \n",
       "2880                NaN                                Gulf Coast Magazine   \n",
       "1360    Platform: print                                      Maryland Life   \n",
       "1376  Platform: digital                               Consequence Of Sound   \n",
       "2588  Platform: digital                                         The Bridge   \n",
       "1068  Platform: digital                           Crain's Chicago Business   \n",
       "2137                NaN                                           Harper's   \n",
       "1272  Platform: digital                                          The Toast   \n",
       "2471  Platform: digital                                            Polygon   \n",
       "2357  Platform: digital                        Los Angeles Review Of Books   \n",
       "1067  Platform: digital                                         Healthline   \n",
       "\n",
       "                                           relationship  \\\n",
       "694           Cold pitch (no pre-existing relationship)   \n",
       "2544          Cold pitch (no pre-existing relationship)   \n",
       "560   Ongoing/pre-existing relationship with editor ...   \n",
       "289   Ongoing/pre-existing relationship with editor ...   \n",
       "3039          Cold pitch (no pre-existing relationship)   \n",
       "1506  Ongoing/pre-existing relationship with editor ...   \n",
       "1802          Cold pitch (no pre-existing relationship)   \n",
       "2260                                                NaN   \n",
       "2040  Referral (you had a connection who connected y...   \n",
       "806                                                 NaN   \n",
       "2345          Cold pitch (no pre-existing relationship)   \n",
       "952           Cold pitch (no pre-existing relationship)   \n",
       "411   Ongoing/pre-existing relationship with editor ...   \n",
       "2684  Referral (you had a connection who connected y...   \n",
       "2920                    Assignment (editor came to you)   \n",
       "855                                                 NaN   \n",
       "2947  Ongoing/pre-existing relationship with editor ...   \n",
       "1399          Cold pitch (no pre-existing relationship)   \n",
       "2283                                                NaN   \n",
       "3433                                                NaN   \n",
       "2338          Cold pitch (no pre-existing relationship)   \n",
       "928                     Assignment (editor came to you)   \n",
       "1782  Ongoing/pre-existing relationship with editor ...   \n",
       "975           Cold pitch (no pre-existing relationship)   \n",
       "175           Cold pitch (no pre-existing relationship)   \n",
       "1338                                                NaN   \n",
       "1103  Ongoing/pre-existing relationship with editor ...   \n",
       "1868          Cold pitch (no pre-existing relationship)   \n",
       "1840  Ongoing/pre-existing relationship with editor ...   \n",
       "2940        Solicited pitch (editor asked you to pitch)   \n",
       "1660                                                NaN   \n",
       "1339  Ongoing/pre-existing relationship with editor ...   \n",
       "1050  Ongoing/pre-existing relationship with editor ...   \n",
       "2855                                                NaN   \n",
       "490           Cold pitch (no pre-existing relationship)   \n",
       "595           Cold pitch (no pre-existing relationship)   \n",
       "1816          Cold pitch (no pre-existing relationship)   \n",
       "2527          Cold pitch (no pre-existing relationship)   \n",
       "443   Ongoing/pre-existing relationship with editor ...   \n",
       "644   Ongoing/pre-existing relationship with editor ...   \n",
       "2880                                                NaN   \n",
       "1360          Cold pitch (no pre-existing relationship)   \n",
       "1376        Solicited pitch (editor asked you to pitch)   \n",
       "2588          Cold pitch (no pre-existing relationship)   \n",
       "1068  Referral (you had a connection who connected y...   \n",
       "2137                                                NaN   \n",
       "1272  Submission/spec (piece was written prior and t...   \n",
       "2471  Ongoing/pre-existing relationship with editor ...   \n",
       "2357                                                NaN   \n",
       "1067  Ongoing/pre-existing relationship with editor ...   \n",
       "\n",
       "                                rights  \\\n",
       "694        Rights: First Serial Rights   \n",
       "2544      Rights: Other / I don't know   \n",
       "560        Rights: First Serial Rights   \n",
       "289        Rights: First Serial Rights   \n",
       "3039       Rights: First Serial Rights   \n",
       "1506  Rights: Secondary Rights/Reprint   \n",
       "1802       Rights: First Serial Rights   \n",
       "2260                Rights: All rights   \n",
       "2040      Rights: Other / I don't know   \n",
       "806                           Rights:    \n",
       "2345      Rights: Other / I don't know   \n",
       "952       Rights: Other / I don't know   \n",
       "411                 Rights: All rights   \n",
       "2684      Rights: Other / I don't know   \n",
       "2920                Rights: All rights   \n",
       "855                 Rights: All rights   \n",
       "2947                Rights: All rights   \n",
       "1399       Rights: First Serial Rights   \n",
       "2283       Rights: First Serial Rights   \n",
       "3433      Rights: Other / I don't know   \n",
       "2338      Rights: Other / I don't know   \n",
       "928        Rights: First Serial Rights   \n",
       "1782                          Rights:    \n",
       "975                 Rights: All rights   \n",
       "175       Rights: Other / I don't know   \n",
       "1338       Rights: First Serial Rights   \n",
       "1103                Rights: All rights   \n",
       "1868      Rights: Other / I don't know   \n",
       "1840       Rights: First Serial Rights   \n",
       "2940                Rights: All rights   \n",
       "1660      Rights: Other / I don't know   \n",
       "1339       Rights: First Serial Rights   \n",
       "1050       Rights: First Serial Rights   \n",
       "2855       Rights: First Serial Rights   \n",
       "490       Rights: Other / I don't know   \n",
       "595        Rights: First Serial Rights   \n",
       "1816                Rights: All rights   \n",
       "2527       Rights: First Serial Rights   \n",
       "443                 Rights: All rights   \n",
       "644       Rights: Other / I don't know   \n",
       "2880                          Rights:    \n",
       "1360                Rights: All rights   \n",
       "1376      Rights: Other / I don't know   \n",
       "2588                Rights: All rights   \n",
       "1068       Rights: First Serial Rights   \n",
       "2137                          Rights:    \n",
       "1272       Rights: First Serial Rights   \n",
       "2471                Rights: All rights   \n",
       "2357                          Rights:    \n",
       "1067                Rights: All rights   \n",
       "\n",
       "                                              storyType  \\\n",
       "694                 opinion, editorial, column or essay   \n",
       "2544                opinion, editorial, column or essay   \n",
       "560   criticism, review, or arts/entertainment conve...   \n",
       "289                                          news story   \n",
       "3039                opinion, editorial, column or essay   \n",
       "1506                                            feature   \n",
       "1802                                          blog post   \n",
       "2260                                                NaN   \n",
       "2040                opinion, editorial, column or essay   \n",
       "806                                                 NaN   \n",
       "2345  criticism, review, or arts/entertainment coverage   \n",
       "952                                             feature   \n",
       "411                                             feature   \n",
       "2684                                                fob   \n",
       "2920                               profile or interview   \n",
       "855                                                 NaN   \n",
       "2947                opinion, editorial, column or essay   \n",
       "1399                opinion, editorial, column or essay   \n",
       "2283                                            fiction   \n",
       "3433                                                fob   \n",
       "2338  criticism, review, or arts/entertainment coverage   \n",
       "928                                               other   \n",
       "1782                                            feature   \n",
       "975                 opinion, editorial, column or essay   \n",
       "175                                                 fob   \n",
       "1338                                                NaN   \n",
       "1103                                         news story   \n",
       "1868                               profile or interview   \n",
       "1840                                                fob   \n",
       "2940                                            feature   \n",
       "1660                                                NaN   \n",
       "1339                                          blog post   \n",
       "1050  criticism, review, or arts/entertainment conve...   \n",
       "2855                                                NaN   \n",
       "490                                                 fob   \n",
       "595                 opinion, editorial, column or essay   \n",
       "1816                                         news story   \n",
       "2527                opinion, editorial, column or essay   \n",
       "443                                             feature   \n",
       "644                                             feature   \n",
       "2880                                                NaN   \n",
       "1360                                            feature   \n",
       "1376  criticism, review, or arts/entertainment coverage   \n",
       "2588                                            feature   \n",
       "1068                                            feature   \n",
       "2137                                                NaN   \n",
       "1272                opinion, editorial, column or essay   \n",
       "2471                opinion, editorial, column or essay   \n",
       "2357                                                NaN   \n",
       "1067                                              other   \n",
       "\n",
       "                                              wordCount  year  \n",
       "694                                                2500  2017  \n",
       "2544                                               1400  2018  \n",
       "560                                                ~750  2014  \n",
       "289                                                 750  2016  \n",
       "3039                                               ~750  2015  \n",
       "1506                                               5800  2017  \n",
       "1802                                               1000  2018  \n",
       "2260                                           700-word  2018  \n",
       "2040                                                550  2017  \n",
       "806                                                 NaN  2012  \n",
       "2345                                               1700  2016  \n",
       "952                                                1200  2018  \n",
       "411                                                2000  2018  \n",
       "2684                                                581  2016  \n",
       "2920                                               ~750  2015  \n",
       "855                                           6500-word  2018  \n",
       "2947                                               1000  2018  \n",
       "1399                                               1200  2016  \n",
       "2283                                               2500  2017  \n",
       "3433                                                300  2017  \n",
       "2338                                               2500  2017  \n",
       "928                                                1500  2018  \n",
       "1782                                              ~1500  2014  \n",
       "975                                                1000  2018  \n",
       "175                                                 500  2017  \n",
       "1338                                           800-word  2017  \n",
       "1103                                               ~750  2015  \n",
       "1868                                               ~750  2015  \n",
       "1840                                               ~750  2014  \n",
       "2940                                                750  2018  \n",
       "1660                                           800-word  2018  \n",
       "1339                                               1000  2016  \n",
       "1050                                               ~375  2015  \n",
       "2855                                          1100-word  2016  \n",
       "490                                                 500  2017  \n",
       "595                                                 800  2017  \n",
       "1816                                                500  2016  \n",
       "2527                                               1395  2016  \n",
       "443                                                1500  2017  \n",
       "644                                                1200  2017  \n",
       "2880                                                NaN  2013  \n",
       "1360                                               ~750  2013  \n",
       "1376                                                600  2018  \n",
       "2588                                               1500  2018  \n",
       "1068                                               1000  2017  \n",
       "2137   criticism, review, or arts/entertainment conv...  2013  \n",
       "1272                                              ~3000  2015  \n",
       "2471                                               3000  2017  \n",
       "2357   criticism, review, or arts/entertainment conv...  2012  \n",
       "1067                                               1069  2016  "
      ]
     },
     "execution_count": 1,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import pandas as pd\n",
    "import numpy as np\n",
    "%matplotlib inline\n",
    "df = pd.read_csv('allData_raw.csv')\n",
    "df.sample(50)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Flat rate"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([False, nan, True], dtype=object)"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.flatRate.unique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Contract"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['Contract: Yes', 'Contract: ',\n",
       "       'Contract: Verbal or \"handshake\" agreement', 'Contract: No'],\n",
       "      dtype=object)"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.contract.unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['Yes', nan, 'Verbal', 'No'], dtype=object)"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Let's stardardize these better\n",
    "df['contract'].replace('Contract: ', np.nan, inplace=True)\n",
    "df['contract'].replace('Contract: Yes', 'Yes', inplace=True)\n",
    "df['contract'].replace('Contract: No', 'No', inplace=True)\n",
    "df['contract'].replace('Contract: Verbal or \"handshake\" agreement', 'Verbal', inplace=True)\n",
    "df.contract.unique()\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Level of reporting"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['Little to no reporting', nan, 'Medium reporting',\n",
       "       'Ongoing/pre-existing relationship with editor or publication',\n",
       "       'Heavy/Investigative reporting', 'Other',\n",
       "       'Submission/spec (piece was written prior and then submitted for publication)',\n",
       "       'Cold pitch (no pre-existing relationship)',\n",
       "       'Assignment (editor came to you)',\n",
       "       'Solicited pitch (editor asked you to pitch)'], dtype=object)"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.levelOfReporting.unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['Light', nan, 'Medium', 'Heavy'], dtype=object)"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# mixup with relationship info\n",
    "incorrect = [\n",
    "    'Ongoing/pre-existing relationship with editor or publication', \n",
    "    'Cold pitch (no pre-existing relationship)', \n",
    "    'Assignment (editor came to you)', \n",
    "    'Solicited pitch (editor asked you to pitch)',\n",
    "    'Other',\n",
    "    'Submission/spec (piece was written prior and then submitted for publication)'\n",
    "]\n",
    "\n",
    "for i, r in df.iterrows():\n",
    "    if r['levelOfReporting'] in incorrect:\n",
    "        swap = r['levelOfReporting']\n",
    "        df.at[i, 'levelOfReporting'] = np.nan\n",
    "        df.at[i, 'relationship'] = swap\n",
    "\n",
    "# now shorten\n",
    "translate = {\n",
    "    'Little to no reporting': 'Light',\n",
    "    'Medium reporting': 'Medium',\n",
    "    'Heavy/Investigative reporting': 'Heavy',\n",
    "}\n",
    "\n",
    "\n",
    "for i, r in df.iterrows():\n",
    "    if r['levelOfReporting'] in translate:\n",
    "        df.at[i, 'levelOfReporting'] = translate[r['levelOfReporting']]\n",
    "        \n",
    "df.levelOfReporting.unique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Relationship with editor"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['Cold pitch (no pre-existing relationship)', nan,\n",
       "       'Ongoing/pre-existing relationship with editor or publication',\n",
       "       'Assignment (editor came to you)',\n",
       "       'Referral (you had a connection who connected you to the editor)',\n",
       "       'Solicited pitch (editor asked you to pitch)', 'Other',\n",
       "       'Submission/spec (piece was written prior and then submitted for publication)',\n",
       "       'edito', 'Calls page', 'Reprint request', 'See below'],\n",
       "      dtype=object)"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.relationship.unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['Cold Pitch', nan, 'Ongoing', 'Assignment', 'Referral',\n",
       "       'Solicited Pitch', 'Spec'], dtype=object)"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "translate = {\n",
    "    'Cold pitch (no pre-existing relationship)': 'Cold Pitch',\n",
    "    'Ongoing/pre-existing relationship with editor or publication': 'Ongoing',\n",
    "    'Assignment (editor came to you)': 'Assignment',\n",
    "    'Referral (you had a connection who connected you to the editor)': 'Referral',\n",
    "    'Solicited pitch (editor asked you to pitch)': 'Solicited Pitch',\n",
    "    'Submission/spec (piece was written prior and then submitted for publication)': 'Spec',\n",
    "    # below are items that are one-offs / too small to consider\n",
    "    'Calls page': np.nan, \n",
    "    'Reprint request': np.nan,\n",
    "    'Other': np.nan,\n",
    "    'edito': np.nan,\n",
    "    'See below': np.nan,\n",
    "}\n",
    "\n",
    "for i, r in df.iterrows():\n",
    "    if r['relationship'] in translate:\n",
    "        df.at[i, 'relationship'] = translate[r['relationship']]\n",
    "\n",
    "df.relationship.unique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Amount of time to be paid"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['Paid in 6 weeks ', 'Paid in 2 months ', 'Paid in 1 month ',\n",
       "       \"Haven't gotten it yet (as of this reporting) \",\n",
       "       'Longer than 3 months ', 'Paid in 3 months ', nan, 'N/A ',\n",
       "       'Paid in 15 days '], dtype=object)"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.paidYet.unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([42, 60, 30, 'Not Yet', '>90', 90, nan, 15], dtype=object)"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "translate = {\n",
    "    'N/A': np.nan,\n",
    "    'Paid in 15 days': 15,\n",
    "    'Paid in 1 month': 30,\n",
    "    'Paid in 6 weeks': 42,\n",
    "    'Paid in 2 months': 60,\n",
    "    'Paid in 3 months': 90,\n",
    "    'Longer than 3 months': '>90',\n",
    "    \"Haven't gotten it yet (as of this reporting)\": 'Not Yet'\n",
    "}\n",
    "\n",
    "for i, r in df.iterrows():\n",
    "    if r['paidYet'] is not np.nan:\n",
    "        df.at[i, 'paidYet'] = translate[r['paidYet'].strip()]\n",
    "\n",
    "df = df.rename(index=str, columns={'paidYet': 'daysToBePaid'})\n",
    "df.daysToBePaid.unique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Payment difficulty"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['svg-2', 'svg-4', 'svg-3', 'ng-hide', 'svg-1', 'svg-5',\n",
       "       'svg-false'], dtype=object)"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.paymentDifficulty.unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([ 2.,  4.,  3., nan,  1.,  5.])"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# 1 is great, 5 is bad\n",
    "df.paymentDifficulty.replace('svg-1', 1, inplace=True)\n",
    "df.paymentDifficulty.replace('svg-2', 2, inplace=True)\n",
    "df.paymentDifficulty.replace('svg-3', 3, inplace=True)\n",
    "df.paymentDifficulty.replace('svg-4', 4, inplace=True)\n",
    "df.paymentDifficulty.replace('svg-5', 5, inplace=True)\n",
    "df.paymentDifficulty.replace('svg-false', np.nan, inplace=True)\n",
    "df.paymentDifficulty.replace('ng-hide', np.nan, inplace=True)\n",
    "df.paymentDifficulty.unique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Rights"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['Rights: All rights', \"Rights: Other / I don't know\",\n",
       "       'Rights: First Serial Rights', 'Rights: ',\n",
       "       'Rights: Secondary Rights/Reprint'], dtype=object)"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.rights.unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['All', 'Unknown/Other', 'First', nan, 'Secondary'], dtype=object)"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.rights.replace('Rights: All rights', 'All', inplace=True)\n",
    "df.rights.replace('Rights: First Serial Rights', 'First', inplace=True)\n",
    "df.rights.replace('Rights: Secondary Rights/Reprint', 'Secondary', inplace=True)\n",
    "df.rights.replace(\"Rights: Other / I don't know\", 'Unknown/Other', inplace=True)\n",
    "df.rights.replace('Rights: ', np.nan, inplace=True)\n",
    "df.rights.unique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Platform"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['Platform: digital', 'Platform: print', nan, 'Platform: other'],\n",
       "      dtype=object)"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.platform.unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['Digital', 'Print', nan], dtype=object)"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.platform.replace('Platform: digital', 'Digital', inplace=True)\n",
    "df.platform.replace('Platform: print', 'Print', inplace=True)\n",
    "df.platform.replace('Platform: other', np.nan, inplace=True)\n",
    "df.platform.unique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Word count"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['500', '950-word', '800', '817', '1000', '1300', '1200',\n",
       "       '500-word', '600', '400', '~750', '2500', '5000', '4000-word',\n",
       "       '3500', '2500-word', '1400', '1500-word', '1500', '~1500', '1050',\n",
       "       '1600', '~3000', '2000', '750', '1047', '717', '2300', '990',\n",
       "       '~5000', '4500', '4973', '2200', '750-word', '1333', '1318',\n",
       "       '~375', '1800', '593', '950', '3000', '700', '300', '1020', '1350',\n",
       "       '400.0', nan, '3200', '2314', ' feature', '1566', '4000',\n",
       "       '2000-word', '350', '2900', '700-word', '1000-word', '6000',\n",
       "       '2400', '1234', '6500-word', '~4-word', '1850', '1200-word',\n",
       "       '800-word', '900', '300-word', '1750', '1450.0', '250', '1125',\n",
       "       '600-word', '599',\n",
       "       ' criticism, review, or arts/entertainment converage', '1100',\n",
       "       '1700-word', '6500', ' news story', '~125', '1250', '1400-word',\n",
       "       '760-word', '1700', '1100-word', '~500', ' blog post', '732',\n",
       "       '1000.0', '1300.0', '3000-word', '719', '1400.0', '200', '730',\n",
       "       ' opinion, editorial, column or essay', '~850', '~800', '634',\n",
       "       '160', '2600', '1135', '135', ' fob', '557', '~1050', '~1250',\n",
       "       '1992', '629', '996', '~225-word', '899', ' profile or interview',\n",
       "       '985', '1144', '1156', '1560', '850', '1666', '431', '1150', '650',\n",
       "       '3700', '647', '20', '1593', '250-word', '2100', '8000', '346',\n",
       "       '1688', '827', '5000-word', '980', '961', '3400', '3500-word',\n",
       "       '6300', '934', '1458.0', '2000.0', '3100.0', '1200.0', '2487',\n",
       "       '900-word', '940', '4416', '1827', '~8000', '381', '1184', '1345',\n",
       "       '1679', '995-word', '1238', '~700', '150', '2400-word', '1448',\n",
       "       '780', '3100', '3380', '1900-word', '1900', '910.0', '800.0',\n",
       "       '839.0', '1500.0', '1451', '450', '750.0', '275', '916', '983',\n",
       "       '1186', '1069', '1300-word', '973', '220', '~1750', '1806', '2512',\n",
       "       '550', '2280', '1328', '4322', '5500', '6276', '1353', '914',\n",
       "       '~1150-word', '20000-word', '638', '2200-word', '747', '555-word',\n",
       "       '1228', '1071', '1800-word', '3300', '2150', '1600-word', '984',\n",
       "       '834', '613', '348', '~4500', ' other', '1127', '~900', '4800',\n",
       "       '~230', '~30000', '5800', '1167', '703', '8000-word', '566',\n",
       "       '~1400-word', '1', '334', '100-word', ' fiction', '1275', '1213',\n",
       "       '490', '959', '1024', '614', '713', '902', '1888', '760',\n",
       "       '12000-word', '120000', '2100-word', '869', '1150-word', ' poetry',\n",
       "       '1712', '400-word', '885', '810', '3221', '812', '525', '7195',\n",
       "       '789', '1884', '3706', '200-word', '892', '2800', '2700', '1875',\n",
       "       '1113', '1561', '450-word', '852', '~1550', '100000', '~3500',\n",
       "       '99', '2016', '661', '729', '627', '702', '754', '1950', '1060',\n",
       "       '360', '687', '169', '1253', '1513', '910', '1375', '550-word',\n",
       "       '10000-word', '152', '1224', '113', '1276', '1139', '2160', '3800',\n",
       "       '3600', '4100', '1027', '50000', '620', '540', '3085', '3600-word',\n",
       "       '2041', '955', '2315', '781', '1197', '1338', '1254-word', '1968',\n",
       "       '1395', '1428', '15000', '725', '986', '1012', '715', '615-word',\n",
       "       '1227', '1657', '1130', '813', '1032-word', '1120', '1958', '581',\n",
       "       '1814', '1006', '1136', '1890', '4200', '865', '1759', '1849',\n",
       "       '2500.0', '1275-word', '1.5', '579', '972', '2850', '1980',\n",
       "       '931-word', '974', '598', '1114', '1075', '270', '170', '120',\n",
       "       '~750-word', '520', '850-word', '-700', '350-word', '870', '1616',\n",
       "       '100', '1065', '291', '939', '278', '~250', '7200', '3750',\n",
       "       '2800-word', '2777', '463', '~875', '884', '263', '124', '~1100',\n",
       "       '1203', '1035', '1084', '3000.0', '2800.0', '806', '1423', '1540',\n",
       "       '~1200', '1481', '958', '1329', '2483', '1979', '~1750-word'],\n",
       "      dtype=object)"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.wordCount.unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['NAN', ' feature',\n",
       "       ' criticism, review, or arts/entertainment converage',\n",
       "       ' news story', ' blog post',\n",
       "       ' opinion, editorial, column or essay', ' fob',\n",
       "       ' profile or interview', ' other', ' fiction', ' poetry'],\n",
       "      dtype=object)"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# We had errors / unusual titles load into wordCount.\n",
    "# find all non-numeric entries\n",
    "num = ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9']\n",
    "df_test = df.replace(np.nan, 'NAN')\n",
    "df_r = df_test[~df_test['wordCount'].str.contains('|'.join(num))]\n",
    "df_r['wordCount'].unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0     500.0\n",
       "1     950.0\n",
       "2     800.0\n",
       "3     817.0\n",
       "4    1000.0\n",
       "Name: wordCount, dtype: float64"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# These mistakes are all storyTypes\n",
    "mistakes = [' feature', ' criticism, review, or arts/entertainment converage',\n",
    "       ' news story', ' blog post', ' opinion, editorial, column or essay', ' fob',\n",
    "       ' profile or interview', ' other', ' fiction', ' poetry']\n",
    "\n",
    "for i, r in df.iterrows():\n",
    "    if not isinstance(r['wordCount'], float):\n",
    "        if 'word' in r['wordCount']:\n",
    "            df.at[i, 'wordCount'] = df.at[i, 'wordCount'].strip('word')\n",
    "        if '-' in r['wordCount']:\n",
    "            df.at[i, 'wordCount'] = df.at[i, 'wordCount'].strip('-')\n",
    "        if '~' in r['wordCount']:\n",
    "            df.at[i, 'wordCount'] = df.at[i, 'wordCount'].strip('~')\n",
    "        if r['wordCount'] in mistakes:\n",
    "            df.at[i, 'storyType'] = r['wordCount'].strip()\n",
    "            df.at[i, 'wordCount'] = np.nan\n",
    "df.wordCount = df.wordCount.astype(float)\n",
    "df.wordCount.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Story type"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['news story', nan, 'opinion, editorial, column or essay',\n",
       "       'feature', 'blog post', 'other',\n",
       "       'criticism, review, or arts/entertainment coverage',\n",
       "       'profile or interview', 'fob', 'fiction', 'poetry'], dtype=object)"
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.loc[df['storyType'] == 'criticism, review, or arts/entertainment converage', 'storyType'] = \\\n",
    "    'criticism, review, or arts/entertainment coverage'\n",
    "df.storyType.unique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['News', nan, 'Opinion', 'Feature', 'Blog', 'Criticism', 'Profile',\n",
       "       'FoB', 'fiction', 'poetry'], dtype=object)"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "translate = {\n",
    "    'news story': 'News',\n",
    "    'opinion, editorial, column or essay': 'Opinion',\n",
    "    'feature': 'Feature',\n",
    "    'blog post': 'Blog',\n",
    "    'other': np.nan,\n",
    "    'criticism, review, or arts/entertainment coverage': 'Criticism',\n",
    "    'profile or interview': 'Profile',\n",
    "    'fob': 'FoB'\n",
    "} # dropping fiction and poetry rows later\n",
    "\n",
    "for i, r in df.iterrows():\n",
    "    if r['storyType'] in translate:\n",
    "        df.at[i, 'storyType'] = translate[r['storyType']]\n",
    "df.storyType.unique()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Dollar per word (or per article if flat rate)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "830     $0.17\n",
       "1595    $0.10\n",
       "3447    $0.30\n",
       "1824    $0.50\n",
       "1786    $0.10\n",
       "Name: dollar, dtype: object"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.dollar.sample(5)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1328    0.02\n",
       "2840    0.10\n",
       "456     0.00\n",
       "2527    0.15\n",
       "551     0.06\n",
       "Name: dollar, dtype: float64"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "for i, r in df.iterrows():\n",
    "    if not (r.dollar is None or isinstance(r.dollar, float)):\n",
    "        df.at[i, 'dollar'] = df.at[i, 'dollar'].strip('$')\n",
    "df.dollar = df.dollar.astype(float)\n",
    "df.dollar.sample(5)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Insert `totalPaid` and `wordRate` column. \n",
    "Drop the vague `dollar` column"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [],
   "source": [
    "for i, r in df.iterrows():\n",
    "    if r.flatRate:\n",
    "        df.at[i, 'totalPaid'] = r['dollar']\n",
    "        df.at[i, 'wordRate'] = r['dollar'] / r['wordCount']\n",
    "    else:\n",
    "        df.at[i, 'totalPaid'] = r['wordCount']*r['dollar']\n",
    "        df.at[i, 'wordRate'] = r['dollar']\n",
    "\n",
    "df = df.drop('dollar', axis=1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "***\n",
    "# Search for outliers and potential errors"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### totalPaid"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count    3.368000e+03\n",
       "mean     2.705572e+03\n",
       "std      1.350887e+05\n",
       "min      0.000000e+00\n",
       "25%      7.585000e+01\n",
       "50%      2.000000e+02\n",
       "75%      3.960000e+02\n",
       "max      7.840000e+06\n",
       "Name: totalPaid, dtype: float64"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAZMAAADuCAYAAAD81+rKAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4zLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvIxREBQAAG61JREFUeJzt3X9wXeWd3/H3R5Il+fdP2RjLxIaIJIYk/NCAs0yYFFJjSLtmOmEL3Vlchl13GNJmOzvTkO0fbpMwm0w7ZctMwtQTvDGZbYDSTXC3Zl0v+dEmA8QiEIwBr4UNtmxjy5YtyZb1+9s/7iO4yNfWvfcYX93485rR3HO+53nOc65k8rnn3HPyKCIwMzPLoqbSB2BmZtXPYWJmZpk5TMzMLDOHiZmZZeYwMTOzzBwmZmaWmcPEzMwyc5iYmVlmDhMzM8usrtIHcKEsWLAgli1bVunDMDOrKi+//PLRiGiaqN1FEybLli2jra2t0odhZlZVJL1bTDtf5jIzs8yKChNJ/1bSTkmvS/qRpEZJyyW9JGm3pKck1ae2DWm9PW1flrefr6f6Lkm35dVXp1q7pIfy6iWPYWZmF96EYSJpCfBvgNaIuBqoBe4GvgM8EhEtwHHg/tTlfuB4RHwceCS1Q9KK1O8qYDXwPUm1kmqB7wK3AyuAe1JbSh3DzMwqo9jLXHXAVEl1wDTgEHAL8Ezavgm4My2vSeuk7bdKUqo/GREDEbEXaAduSD/tEbEnIgaBJ4E1qU+pY5iZWQVMGCYRcQD4z8A+ciHSDbwMnIiI4dSsA1iSlpcA+1Pf4dR+fn59XJ+z1eeXMcaHSFonqU1SW2dn50Rv1czMylTMZa655M4ElgOXAtPJXZIab2yWrUJnCHEe6+ca48OFiA0R0RoRrU1NE97ZZmZmZSrmMtcXgb0R0RkRQ8DfAL8HzEmXvQCagYNpuQNYCpC2zwa68uvj+pytfrSMMczMLgoRwehoMFlmyy0mTPYBKyVNS99L3Aq8AfwM+HJqsxZ4Ni1vTuuk7T+N3LvdDNyd7sRaDrQAvwa2Ay3pzq16cl/Sb059Sh3DzOyi8L2fv83lf76FwZHRSh8KUMRDixHxkqRngN8Aw8ArwAbgfwNPSvpWqj2eujwO/FBSO7mzhbvTfnZKeppcEA0DD0bECICkrwBbyd0ptjEidqZ9fa2UMczMrDKKegI+ItYD68eV95C7E2t8237grrPs52Hg4QL1LcCWAvWSxzAzswvPT8CbmVlmDhMzM8vMYWJmZpk5TMzMLDOHiZmZZeYwMTOzzBwmZmaWmcPEzKyKqeD/VeGF5zAxM7PMHCZmZpaZw8TMzDJzmJiZWWYOEzMzy8xhYmZmmTlMzMwsM4eJmVkVmmyTy04YJpI+IenVvJ8eSX8qaZ6kbZJ2p9e5qb0kPSqpXdJrkq7L29fa1H63pLV59esl7Uh9Hk3TA1POGGZmFxNNjmcWJw6TiNgVEddExDXA9UAf8GPgIeD5iGgBnk/rALeTm9+9BVgHPAa5YCA3W+ON5GZPXD8WDqnNurx+q1O9pDHMzKwySr3MdSvwdkS8C6wBNqX6JuDOtLwGeCJyXgTmSFoM3AZsi4iuiDgObANWp22zIuKFyJ23PTFuX6WMYWZmFVBqmNwN/CgtL4qIQwDpdWGqLwH25/XpSLVz1TsK1MsZ40MkrZPUJqmts7OzhLdpZmalKDpMJNUDvw/8j4maFqhFGfVyxvhwIWJDRLRGRGtTU9MEuzQzs3KVcmZyO/CbiDic1g+PXVpKr0dSvQNYmtevGTg4Qb25QL2cMczMrAJKCZN7+OASF8BmYOyOrLXAs3n1e9MdVyuB7nSJaiuwStLc9MX7KmBr2tYraWW6i+vecfsqZQwzM6uAumIaSZoG/GPgX+WVvw08Lel+YB9wV6pvAe4A2snd+XUfQER0SfomsD21+0ZEdKXlB4AfAFOB59JPyWOYmVllFBUmEdEHzB9XO0bu7q7xbQN48Cz72QhsLFBvA64uUC95DDOzi8Eke2bRT8CbmVWzSfLMosPEzMyyc5iYmVlmDhMzM8vMYWJmZpk5TMzMLDOHiZmZZeYwMTOzzBwmZmZVaJI9s+gwMTOrZpokUy06TMzMLDOHiZmZZeYwMTOzzBwmZmaWmcPEzMwyc5iYmVlmRYWJpDmSnpH0lqQ3JX1O0jxJ2yTtTq9zU1tJelRSu6TXJF2Xt5+1qf1uSWvz6tdL2pH6PJqm76WcMczM7MIr9szkvwJ/FxGfBD4LvAk8BDwfES3A82kd4HagJf2sAx6DXDAA64EbgRuA9WPhkNqsy+u3OtVLGsPM7GJRdTMtSpoF3Aw8DhARgxFxAlgDbErNNgF3puU1wBOR8yIwR9Ji4DZgW0R0RcRxYBuwOm2bFREvpOl4nxi3r1LGMDO7qEyORxaLOzO5HOgE/krSK5K+L2k6sCgiDgGk14Wp/RJgf17/jlQ7V72jQJ0yxvgQSesktUlq6+zsLOKtmplZOYoJkzrgOuCxiLgWOMUHl5sKKRSUUUb9XIrqExEbIqI1Ilqbmpom2KWZmZWrmDDpADoi4qW0/gy5cDk8dmkpvR7Ja780r38zcHCCenOBOmWMYWZmFTBhmETEe8B+SZ9IpVuBN4DNwNgdWWuBZ9PyZuDedMfVSqA7XaLaCqySNDd98b4K2Jq29Upame7iunfcvkoZw8zMKqCuyHb/GvhrSfXAHuA+ckH0tKT7gX3AXantFuAOoB3oS22JiC5J3wS2p3bfiIiutPwA8ANgKvBc+gH4diljmJlZZRQVJhHxKtBaYNOtBdoG8OBZ9rMR2Fig3gZcXaB+rNQxzMzswvMT8GZmlpnDxMysCsUkm2vRYWJmVsUmyUSLDhMzM8vOYWJmZpk5TMzMLDOHiZmZZeYwMTOzzBwmZmaWmcPEzMwyc5iYmVWhqptp0czMJi9NkqcWHSZmZpaZw8TMzDJzmJiZWWYOEzMzy6yoMJH0jqQdkl6V1JZq8yRtk7Q7vc5NdUl6VFK7pNckXZe3n7Wp/W5Ja/Pq16f9t6e+KncMMzO78Eo5M/lHEXFNRIzNuPgQ8HxEtADPp3WA24GW9LMOeAxywQCsB24EbgDWj4VDarMur9/qcsYwM7PKyHKZaw2wKS1vAu7Mqz8ROS8CcyQtBm4DtkVEV0QcB7YBq9O2WRHxQpqO94lx+yplDDMzq4BiwySA/yPpZUnrUm1RRBwCSK8LU30JsD+vb0eqnaveUaBezhgfImmdpDZJbZ2dnUW+VTOzyW+SPbNIXZHtboqIg5IWAtskvXWOtoWeoIky6udSVJ+I2ABsAGhtbZ1sv3szs98ZRZ2ZRMTB9HoE+DG57zwOj11aSq9HUvMOYGle92bg4AT15gJ1yhjDzMwqYMIwkTRd0syxZWAV8DqwGRi7I2st8Gxa3gzcm+64Wgl0p0tUW4FVkuamL95XAVvTtl5JK9NdXPeO21cpY5iZWQUUc5lrEfDjdLduHfDfI+LvJG0HnpZ0P7APuCu13wLcAbQDfcB9ABHRJembwPbU7hsR0ZWWHwB+AEwFnks/AN8uZQwzM6uMCcMkIvYAny1QPwbcWqAewINn2ddGYGOBehtw9fkYw8zMLjw/AW9mZpk5TMzMLDOHiZmZZeYwMTOrRpNsqkWHiZlZlZokkywCDhMzMzsPHCZmZpaZw8TMzDJzmJiZWWYOEzMzy8xhYmZmmTlMzMwsM4eJmVkVmlyPLDpMzMyq1iR6ZtFhYmZm2TlMzMwss6LDRFKtpFck/W1aXy7pJUm7JT0lqT7VG9J6e9q+LG8fX0/1XZJuy6uvTrV2SQ/l1Usew8zMLrxSzky+CryZt/4d4JGIaAGOA/en+v3A8Yj4OPBIaoekFcDdwFXAauB7KaBqge8CtwMrgHtS25LHMDOzyigqTCQ1A18Cvp/WBdwCPJOabALuTMtr0jpp+62p/RrgyYgYiIi95OZvvyH9tEfEnogYBJ4E1pQ5hpmZVUCxZyZ/Cfw7YDStzwdORMRwWu8AlqTlJcB+gLS9O7V/vz6uz9nq5YxhZmYVMGGYSPonwJGIeDm/XKBpTLDtfNUnGv99ktZJapPU1tnZWaCLmZmdD8WcmdwE/L6kd8hdgrqF3JnKHEl1qU0zcDAtdwBLAdL22UBXfn1cn7PVj5YxxodExIaIaI2I1qampiLeqplZdZhkEy1OHCYR8fWIaI6IZeS+QP9pRPwh8DPgy6nZWuDZtLw5rZO2/zQiItXvTndiLQdagF8D24GWdOdWfRpjc+pT6hhmZheNyfRVcd3ETc7qa8CTkr4FvAI8nuqPAz+U1E7ubOFugIjYKelp4A1gGHgwIkYAJH0F2ArUAhsjYmc5Y5iZWWWUFCYR8XPg52l5D7k7sca36QfuOkv/h4GHC9S3AFsK1Esew8zMLjw/AW9mZpk5TMzMLDOHiZmZZeYwMTOzzBwmZmaWmcPEzKwKxSSba9FhYmZWpSbPI4sOEzMzOw8cJmZmlpnDxMzMMnOYmJlZZg4TMzPLzGFiZmaZOUzMzCwzh4mZWRWabNMBOkzMzKrUJJpo0WFiZmbZTRgmkhol/VrSbyXtlPQfU325pJck7Zb0VJq/nTTH+1OS2tP2ZXn7+nqq75J0W159daq1S3oor17yGGZmduEVc2YyANwSEZ8FrgFWS1oJfAd4JCJagOPA/an9/cDxiPg48Ehqh6QV5OZqvwpYDXxPUq2kWuC7wO3ACuCe1JZSxzAzs8qYMEwi52RanZJ+ArgFeCbVNwF3puU1aZ20/VZJSvUnI2IgIvYC7eTmd78BaI+IPRExCDwJrEl9Sh3DzMwqoKjvTNIZxKvAEWAb8DZwIiKGU5MOYElaXgLsB0jbu4H5+fVxfc5Wn1/GGOOPe52kNkltnZ2dxbxVMzMrQ1FhEhEjEXEN0EzuTOJThZql10JnCHEe6+ca48OFiA0R0RoRrU1NTQW6mJnZ+VDS3VwRcQL4ObASmCOpLm1qBg6m5Q5gKUDaPhvoyq+P63O2+tEyxjAzswoo5m6uJklz0vJU4IvAm8DPgC+nZmuBZ9Py5rRO2v7TiIhUvzvdibUcaAF+DWwHWtKdW/XkvqTfnPqUOoaZ2UVhsv0PXt3ETVgMbEp3XdUAT0fE30p6A3hS0reAV4DHU/vHgR9Kaid3tnA3QETslPQ08AYwDDwYESMAkr4CbAVqgY0RsTPt62uljGFmdjHRJJprccIwiYjXgGsL1PeQ+/5kfL0fuOss+3oYeLhAfQuw5XyMYWZmF56fgDczs8wcJmZmlpnDxMzMMnOYmJlZZg4TMzPLzGFiZmaZOUzMzKrQZHtM22FiZlatJs8ziw4TMzPLzmFiZmaZOUzMzCwzh4mZmWXmMDEzs8wcJmZmlpnDxMzMMnOYmJlVoZhkcy0WM23vUkk/k/SmpJ2Svprq8yRtk7Q7vc5NdUl6VFK7pNckXZe3r7Wp/W5Ja/Pq10vakfo8KknljmFmdrGYRM8sFnVmMgz8WUR8ClgJPChpBfAQ8HxEtADPp3WA28nN794CrAMeg1wwAOuBG8nNnrh+LBxSm3V5/VanekljmJlZZUwYJhFxKCJ+k5Z7gTeBJcAaYFNqtgm4My2vAZ6InBeBOZIWA7cB2yKiKyKOA9uA1WnbrIh4ISICeGLcvkoZw8zMKqCk70wkLSM3H/xLwKKIOAS5wAEWpmZLgP153TpS7Vz1jgJ1yhhj/PGuk9Qmqa2zs7OUt2pmZiUoOkwkzQD+J/CnEdFzrqYFalFG/ZyHU0yfiNgQEa0R0drU1DTBLs3MrFxFhYmkKeSC5K8j4m9S+fDYpaX0eiTVO4Cled2bgYMT1JsL1MsZw8zMKqCYu7kEPA68GRH/JW/TZmDsjqy1wLN59XvTHVcrge50iWorsErS3PTF+ypga9rWK2llGuvecfsqZQwzM6uAuiLa3AT8EbBD0qup9ufAt4GnJd0P7APuStu2AHcA7UAfcB9ARHRJ+iawPbX7RkR0peUHgB8AU4Hn0g+ljmFmZpUxYZhExC85++3MtxZoH8CDZ9nXRmBjgXobcHWB+rFSxzAzuyhMrmcW/QS8mVm10iR6atFhYmZmmTlMzMwsM4eJmZll5jAxM7PMHCZmZpaZw8TMzDJzmJiZWWYOEzOzKjTJnll0mJiZVStNorkWHSZmZpaZw8TMzDJzmJiZWWYOEzMzy8xhYmZmmTlMzMwss2Km7d0o6Yik1/Nq8yRtk7Q7vc5NdUl6VFK7pNckXZfXZ21qv1vS2rz69ZJ2pD6Ppql7yxrDzMwqo5gzkx8Aq8fVHgKej4gW4Pm0DnA70JJ+1gGPQS4YgPXAjcANwPqxcEht1uX1W13OGGZmF5PchLOTx4RhEhH/F+gaV14DbErLm4A78+pPRM6LwBxJi4HbgG0R0RURx4FtwOq0bVZEvJCm4n1i3L5KGcPM7KLyuzDT4qKIOASQXhem+hJgf167jlQ7V72jQL2cMc4gaZ2kNkltnZ2dJb1BMzMr3vn+Ar5QTkYZ9XLGOLMYsSEiWiOitampaYLdmplZucoNk8Njl5bS65FU7wCW5rVrBg5OUG8uUC9nDDMzq5Byw2QzMHZH1lrg2bz6vemOq5VAd7pEtRVYJWlu+uJ9FbA1beuVtDLdxXXvuH2VMoaZmVVI3UQNJP0I+AKwQFIHubuyvg08Lel+YB9wV2q+BbgDaAf6gPsAIqJL0jeB7andNyJi7Ev9B8jdMTYVeC79UOoYZmZWOROGSUTcc5ZNtxZoG8CDZ9nPRmBjgXobcHWB+rFSxzAzs8rwE/BmZpaZw8TMrApNsmcWHSZmZtVqEj2z6DAxM7PsHCZmZpaZw8TMzDJzmJiZWWYOEzMzy8xhYmZmmTlMzMwsM4eJmVkVmmTPLDpMzMyqlSbRVIsOEzMzy8xhYmZmmTlMzMwsM4eJmZllVrVhImm1pF2S2iU9VOnjMTO7mFVlmEiqBb4L3A6sAO6RtKKyR/W7obd/iIHhkUofhplVmQmn7Z2kbgDaI2IPgKQngTXAG+d7oPYjJ3nrvR4A9nX18YtdndTVij9oXcqOjm5ODQ4zOBw0zWzgSE8/vQPDfHrJbH7xD538QWszjVNqOT04wt+/eYSbr1zA3Gn1BNA/NEKNRENdDa8f6GZgeJRrL5sDwMmBYTp7B9j1Xi9XLprJgROn2XmwhxuXz2Pzbw/yL264jCsvmUlEsPFX71Ar+MMbP8bTbfvp7R/mjz+/nNqaD24ZrEm3DwYQaUadCAiCbW8cZuHMRk70DTJ/RgOP/3IvAH/5z69hx4Funtq+nwe+cAXDI8Ejf/8P/MvfW8bBE6f50mcW89LeLmY1TuGqS2ed8Xs73NPPax3drLpqUcHf66/aj/HKvuO89V4vN318PvOmN9CycAavdXQza2ody+ZPZ+fBbpbOnca7XX0IWDCzgalTarl6ySz2Hu1j54Fu1ly7BAE9/UP8cvdRvvCJJqY35P5Zdxw/zY4D3dx0xQJ+tusIAj61eBYfXzjj/ePYe/QUb3eepFbiioUzaJ47FTjzlsv8tbFNx04OMq2+lvq6D38my//dj/dedz/b3+ni9qsXI+XGETAawcho8Fe/eocdB7q576ZlXHvZXCKC//XbQyyYUc+OA92sWDyLm69sen9/Y88ajP1dB4dHefnd48yaOoVPXjKTLTsOEZF73zU1oqOrj6uWzOaFt49xx6cvoa625v339tT2/ew/3se6my9nVuMUevuHGRoZZdfhXkZHg57+IT53xQLmTpty1veX77nX3+PqS2ezJP1Ox45xYHiU7/+/PTROqeVPPn85QyOjPPNyB7dddQlzp9efsZ+X9hxjZDT47NI59JweYu/RU6y8fD51tbkjPzUwzNadh7n1Uwt5aU8XyxdMp2XRjDP2M+bnuzpZMmfqGW3ePnKK9s6TnB4c5nNXLKB/aIT/tHUX6//pChbMaDhjPz955QBvHOrhM82z+XxLE7sP91JXW8M1S3P/He882EP36UE+d8WC99/74Z5+fr33OHd8+hJGA4709rNwZiMNdTW8su8EdbXimZc7uLllAbd8ahGR/l388MV36ewd4M9WXUln7wDb3znOS3uOcXJgmGdfPUCNhAS/2NXJT149wLL507nz2iVsf6eL+toavvrFFq66dHZRf7dyKSbbdF1FkPRlYHVE/HFa/yPgxoj4yrh264B1AJdddtn17777bslj/bdfvM1fPPdW9oM2M6uQP/n8cv79l8q7eCPp5YhonahdtZ6ZFProd0YqRsQGYANAa2trWal5V+tSbvnkQgBOnB7iRN8Ql85ppKGulkPdp6mVGImgoa6WUwPD1NWKafW1HOkZ4IqFM6itESOjwTtHT3HpnKk0Tsl9ih0NGB4J6uvEkd4BRkfhktmN73/q7R8a4djJQaY31NI3OMLhngEWzWpg13u9XHXpbJpm1hMBb73Xy+mhET7TPJvXD/QQEXymeQ61NblPKrnPCkHE2CfqXF3kPhW/c/QUMxvr6B8aZd70ek70DdLVN8gnL5nFoe7TvHGwh9Zl8xiN4CevHOCfXddMZ+8AlzdN58Dx0zTU1bBw1pmf2nr7hznc088VTYU/Ie4/3sfRk4O8feQkVy+ZzfSGWmY1TuHoyQFqJC6Z3cjhngGm19fS0z8EiMYpNTTU1bJ4diMnB4bpOjXIpXMa0+9rlH1dfXxs/jTqa3O/457+IY70DLB03jQOnDjN6Ggwf0YD86Z/8Mn6RN8QXacGqa0Rc6fXM3vqlALToX5QyN82NBJMqVXu7EIfbD/XB7STA8O8191Py6IZSCIi97epqcmdoby0t4u506YwZ1o9C2Y0UCN491gfdbXiUHc/86bV87H50/jwiVNuZazW2TtAbY2YPXUK7xw9hSTmpLOJ7r4hFs5q4FB3P5cvmP6h4z5xeoi3j5zk082zaairISJ3lnXwRD+jEZw4PcTlC6bTUFfc1fG3O0/SNLOR2VPrzjjGwz39nOgbomXhjPc/oc+dVk/jlNoz9rOv6xRCLJzVQENdLQPDI+//jQEGR0Y5eKKfS+c0cqRngJmNdcyeevazp3eO9TGzsY75486CTpzO/VsQsHj2VIZGR/nV7qPcfGUT0xvOPK43DvXSdXKARbMaWTpvGsf7BomAS+c0EgGdJwcYGB5l6dxp77/3UwPDHOrup2XhDOpqagiCweFRAN7r6adG4q33erl8wXSWzptKjUSNxJuHehgaDVYsnknf4AgHT/SzKP13N3vqFEZGc//mDpw4zW/3d/OZ5tnMaKzjUHc/9bU1XP+xuUX9zbKo1jOTzwH/ISJuS+tfB4iIvzhbn9bW1mhra7tAR2hm9ruh2DOTqvwCHtgOtEhaLqkeuBvYXOFjMjO7aFXlZa6IGJb0FWArUAtsjIidFT4sM7OLVlWGCUBEbAG2VPo4zMysei9zmZnZJOIwMTOzzBwmZmaWmcPEzMwyq8rnTMohqRMo/RH4nAXA0fN4OB81H+9Hy8f70ammY4WL43g/FhFNEzW6aMIkC0ltxTy0M1n4eD9aPt6PTjUdK/h48/kyl5mZZeYwMTOzzBwmxdlQ6QMokY/3o+Xj/ehU07GCj/d9/s7EzMwy85mJmZll5jAxM7PMHCZmZpaZw8TMzDJzmJiZWWb/H8tU6WGU+fYbAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "df['totalPaid'].plot()\n",
    "df['totalPaid'].describe()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>comment</th>\n",
       "      <th>contract</th>\n",
       "      <th>flatRate</th>\n",
       "      <th>levelOfReporting</th>\n",
       "      <th>daysToBePaid</th>\n",
       "      <th>paymentDifficulty</th>\n",
       "      <th>platform</th>\n",
       "      <th>publication</th>\n",
       "      <th>relationship</th>\n",
       "      <th>rights</th>\n",
       "      <th>storyType</th>\n",
       "      <th>wordCount</th>\n",
       "      <th>year</th>\n",
       "      <th>totalPaid</th>\n",
       "      <th>wordRate</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>3367</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Heavy</td>\n",
       "      <td>60</td>\n",
       "      <td>4.0</td>\n",
       "      <td>Print</td>\n",
       "      <td>Red Bulletin</td>\n",
       "      <td>Solicited Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>Feature</td>\n",
       "      <td>2800.0</td>\n",
       "      <td>2016</td>\n",
       "      <td>7840000.0</td>\n",
       "      <td>2800.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     comment contract flatRate levelOfReporting daysToBePaid  \\\n",
       "3367     NaN      Yes    False            Heavy           60   \n",
       "\n",
       "      paymentDifficulty platform   publication     relationship rights  \\\n",
       "3367                4.0    Print  Red Bulletin  Solicited Pitch    All   \n",
       "\n",
       "     storyType  wordCount  year  totalPaid  wordRate  \n",
       "3367   Feature     2800.0  2016  7840000.0    2800.0  "
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df[df['totalPaid'] > 100000]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count     3368.000000\n",
       "mean       378.612374\n",
       "std        919.901719\n",
       "min          0.000000\n",
       "25%         75.850000\n",
       "50%        200.000000\n",
       "75%        396.000000\n",
       "max      33600.000000\n",
       "Name: totalPaid, dtype: float64"
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYcAAADuCAYAAADSkstYAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4zLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvIxREBQAAIABJREFUeJzt3XmcXGWd7/HPr7uzsphAgmKCBDEzbGrADKB4HQdnIODMgHPHuahXouLEcdDr3PHeS8ARUEDFDWUGmGEJCSoGxIVImoQQQBYhpAPZE0iTQNJZO1sn6U5Xd1X97h91qvt01+nae0nV9/169aurnjrn1HOqzjm/ZztPmbsjIiISVjPYGRARkaFHwUFERDIoOIiISAYFBxERyaDgICIiGRQcREQkg4KDiIhkyBkczGykmb1sZivMbI2ZfStIn21mm8xsefA3JUg3M7vdzBrNbKWZnRPa1nQz2xD8TQ+lf8DMVgXr3G5m1h87KyIi+anLY5kYcKG7HzKzYcDzZvZ48Nr/dfdHei1/CTA5+DsPuAs4z8yOA24ApgIOLDOzee6+L1hmBvASUA9MAx5HREQGRc7g4KlbqA8FT4cFf9luq74MeCBY7yUzG2NmJwIfBRa5+14AM1sETDOzZ4Bj3f3FIP0B4HJyBIdx48b5pEmTcmVfRERCli1bttvdx+daLp+aA2ZWCywD3gPc4e5LzOzLwC1mdj2wGJjp7jFgArAltHpTkJYtvSkiPatJkybR0NCQT/ZFRCRgZm/ls1xeHdLunnD3KcBE4FwzOwu4FjgN+DPgOOCa9HtHbaKI9AxmNsPMGsysobm5OZ+si4hIEQoareTu+4FngGnuvt1TYsD9wLnBYk3ASaHVJgLbcqRPjEiPev+73X2qu08dPz5nrUhERIqUz2il8WY2Jng8CvhLYH3Qj0AwsuhyYHWwyjzgymDU0vlAi7tvBxYCF5nZWDMbC1wELAxeO2hm5wfbuhJ4tLy7KSIihcinz+FEYE7Q71ADPOzuj5nZU2Y2nlSz0HLgn4Ll64FLgUagDfg8gLvvNbObgKXBct9Od04DXwZmA6NIdURrpJKIyCCyI/X3HKZOnerqkBYRKYyZLXP3qbmW0x3SIiKSQcFBREQyKDhUsDXbWpg0cz7rth8Y7KyIyBFGwaGCLVi9A4BFa3cOck5E5Eij4CAiIhkUHEREJIOCg4iIZFBwqAJH6K0sIjKIFBwqmH4xSUSKpeAgIiIZFBxERCSDgoOIiGRQcBARkQwKDiIikkHBQUREMig4VAGP/kluEZE+KThUMtOdDiJSHAUHERHJoOAgIiIZFBwqmSZVEpEiKTiIiEiGnMHBzEaa2ctmtsLM1pjZt4L0U8xsiZltMLOHzGx4kD4ieN4YvD4ptK1rg/TXzOziUPq0IK3RzGaWfzerlDqkRaRI+dQcYsCF7v5+YAowzczOB24FbnP3ycA+4Kpg+auAfe7+HuC2YDnM7AzgCuBMYBpwp5nVmlktcAdwCXAG8KlgWRERGSQ5g4OnHAqeDgv+HLgQeCRInwNcHjy+LHhO8PrHzMyC9LnuHnP3TUAjcG7w1+juG929A5gbLCsiIoMkrz6HoIS/HNgFLALeAPa7ezxYpAmYEDyeAGwBCF5vAY4Pp/dap6/0qHzMMLMGM2tobm7OJ+uC+qVFpHB5BQd3T7j7FGAiqZL+6VGLBf+jGrq9iPSofNzt7lPdfer48eNzZ7zKqcdBRIpV0Ggld98PPAOcD4wxs7rgpYnAtuBxE3ASQPD624C94fRe6/SVLiIigySf0UrjzWxM8HgU8JfAOuBp4O+DxaYDjwaP5wXPCV5/yt09SL8iGM10CjAZeBlYCkwORj8NJ9VpPa8cOyciIsWpy70IJwJzglFFNcDD7v6Yma0F5prZzcCrwH3B8vcBPzOzRlI1hisA3H2NmT0MrAXiwNXungAws68AC4FaYJa7rynbHlYxdTWISLFyBgd3XwmcHZG+kVT/Q+/0duCTfWzrFuCWiPR6oD6P/IqIyADQHdIVTB3SIlIsBQcREcmg4CAiIhkUHKqAOqZFpFAKDhVM8+6JSLEUHEREJIOCQwXTnEoiUiwFBxERyaDgUMHU5yAixVJwEBGRDAoOIiKSQcFBREQyKDhUAw1bEpECKThUMNPUeyJSJAUHERHJoOBQwVyzKolIkRQcREQkg4JDBVOfg4gUS8FBREQyKDiIiEiGnMHBzE4ys6fNbJ2ZrTGzrwXpN5rZVjNbHvxdGlrnWjNrNLPXzOziUPq0IK3RzGaG0k8xsyVmtsHMHjKz4eXe0WqmbmkRKVQ+NYc48HV3Px04H7jazM4IXrvN3acEf/UAwWtXAGcC04A7zazWzGqBO4BLgDOAT4W2c2uwrcnAPuCqMu1fVdPEeyJSrJzBwd23u/srweODwDpgQpZVLgPmunvM3TcBjcC5wV+ju2909w5gLnCZmRlwIfBIsP4c4PJid0hEREpXUJ+DmU0CzgaWBElfMbOVZjbLzMYGaROALaHVmoK0vtKPB/a7e7xXetT7zzCzBjNraG5uLiTrVUmzZohIsfIODmZ2NPBr4F/c/QBwF3AqMAXYDvwovWjE6l5Eemai+93uPtXdp44fPz7frFc9tS6JSKHq8lnIzIaRCgy/cPffALj7ztDr9wCPBU+bgJNCq08EtgWPo9J3A2PMrC6oPYSXlzJQBUJECpXPaCUD7gPWufuPQ+knhhb7BLA6eDwPuMLMRpjZKcBk4GVgKTA5GJk0nFSn9Tx3d+Bp4O+D9acDj5a2WwLqkBaR4uVTc7gA+CywysyWB2nXkRptNIVUwfRN4EsA7r7GzB4G1pIa6XS1uycAzOwrwEKgFpjl7muC7V0DzDWzm4FXSQUjEREZJDmDg7s/T3SzdX2WdW4BbolIr49az903khrNJCIiQ4DukK4CGrUkIoVScKhg6nIQkWIpOIiISAYFhwqm1iQRKZaCQxXQkFYRKZSCQxVQh7SIFErBoYKpwiAixVJwEBGRDAoOIiKSQcGhCrjGLYlIgRQcKphGKYlIsRQcKphGKYlIsRQcqoBp3JKIFEjBoQqoz0FECqXgUMHU5yAixVJwEBGRDAoOIiKSQcFBREQyKDhUAQ1pFZFCKThUMFOPtIgUScGhgrmqDCJSpJzBwcxOMrOnzWydma0xs68F6ceZ2SIz2xD8Hxukm5ndbmaNZrbSzM4JbWt6sPwGM5seSv+Ama0K1rndVOQtK32aIlKofGoOceDr7n46cD5wtZmdAcwEFrv7ZGBx8BzgEmBy8DcDuAtSwQS4ATgPOBe4IR1QgmVmhNabVvquSZoqECJSqJzBwd23u/srweODwDpgAnAZMCdYbA5wefD4MuABT3kJGGNmJwIXA4vcfa+77wMWAdOC14519xc91Q7yQGhbUgJVwESkWAX1OZjZJOBsYAnwdnffDqkAApwQLDYB2BJarSlIy5beFJEe9f4zzKzBzBqam5sLybqIiBQg7+BgZkcDvwb+xd0PZFs0Is2LSM9MdL/b3ae6+9Tx48fnyrKIiBQpr+BgZsNIBYZfuPtvguSdQZMQwf9dQXoTcFJo9YnAthzpEyPSRURkkOQzWsmA+4B17v7j0EvzgPSIo+nAo6H0K4NRS+cDLUGz00LgIjMbG3REXwQsDF47aGbnB+91ZWhbUgbqjxaRQtXlscwFwGeBVWa2PEi7Dvge8LCZXQVsBj4ZvFYPXAo0Am3A5wHcfa+Z3QQsDZb7trvvDR5/GZgNjAIeD/5ERGSQ5AwO7v480f0CAB+LWN6Bq/vY1ixgVkR6A3BWrrxIcTRmSUQKpTukRUQkg4JDFVCfg4gUSsFBREQyKDiIiEgGBQcREcmg4FAFNPGeiBRKwaGCad49ESmWgkMFU41BRIql4FAFVIMQkUIpOIiISAYFhyqg5iURKZSCQwVTc5KIFEvBQUREMig4iIhIBgWHKuCaek9ECqTgICIiGRQcqoDp535EpEAKDiIikkHBoQqoz0FECqXgICIiGXIGBzObZWa7zGx1KO1GM9tqZsuDv0tDr11rZo1m9pqZXRxKnxakNZrZzFD6KWa2xMw2mNlDZja8nDtYzdTXICLFyqfmMBuYFpF+m7tPCf7qAczsDOAK4MxgnTvNrNbMaoE7gEuAM4BPBcsC3BpsazKwD7iqlB0SEZHS5QwO7v4ssDfP7V0GzHX3mLtvAhqBc4O/Rnff6O4dwFzgMjMz4ELgkWD9OcDlBe6DiIiUWSl9Dl8xs5VBs9PYIG0CsCW0TFOQ1lf68cB+d4/3So9kZjPMrMHMGpqbm0vIepVRf7SIFKjY4HAXcCowBdgO/ChIj2rk9iLSI7n73e4+1d2njh8/vrAci4hI3uqKWcndd6Yfm9k9wGPB0ybgpNCiE4FtweOo9N3AGDOrC2oP4eWlXNQvLSIFKqrmYGYnhp5+AkiPZJoHXGFmI8zsFGAy8DKwFJgcjEwaTqrTep67O/A08PfB+tOBR4vJk4iIlE/OmoOZ/RL4KDDOzJqAG4CPmtkUUk1AbwJfAnD3NWb2MLAWiANXu3si2M5XgIVALTDL3dcEb3ENMNfMbgZeBe4r295JivocRKRAOYODu38qIrnPC7i73wLcEpFeD9RHpG8kNZpJykw/9iMixdId0iIikkHBQUREMig4iIhIBgUHERHJoOAgIiIZFBxERCSDgoOIiGRQcKgCUffA7T4U44+Nuwc8LyJyZFBwqGDZ7oH7h/98kU/fu2TA8iIiRxYFhyq1cXfrYGdBRIYwBQcREcmg4FAFUpPfigw9//yLZVzzyMrBzoZEUHCocgocMpjqV+3goYYtuReUAafgUAVM07OKSIEUHKqcKg4iEkXBocopNohIFAWHKqB+BelvyaSOsUqj4FDB8ulqUOCQUi1YvZ13X1dP465Dg50VKSMFBxEpyeOrdwCwemvLIOdEyknBocqp3iDl4jqaKkrO4GBms8xsl5mtDqUdZ2aLzGxD8H9skG5mdruZNZrZSjM7J7TO9GD5DWY2PZT+ATNbFaxzu2ncZdllazlSq5KUSidsZcqn5jAbmNYrbSaw2N0nA4uD5wCXAJODvxnAXZAKJsANwHnAucAN6YASLDMjtF7v9xKRI4AKGpUlZ3Bw92eBvb2SLwPmBI/nAJeH0h/wlJeAMWZ2InAxsMjd97r7PmARMC147Vh3f9FTPaMPhLYlZZKtLqamACmVKvuVqdg+h7e7+3aA4P8JQfoEIHwvfFOQli29KSJdBohKeyISpdwd0lFFCC8iPXrjZjPMrMHMGpqbm4vMooj0BxU0KkuxwWFn0CRE8H9XkN4EnBRabiKwLUf6xIj0SO5+t7tPdfep48ePLzLr1UcnrYgUqtjgMA9IjziaDjwaSr8yGLV0PtASNDstBC4ys7FBR/RFwMLgtYNmdn4wSunK0LakRJbHOBIFDhGJUpdrATP7JfBRYJyZNZEadfQ94GEzuwrYDHwyWLweuBRoBNqAzwO4+14zuwlYGiz3bXdPd3J/mdSIqFHA48GfiBwh0kUQlTMqS87g4O6f6uOlj0Us68DVfWxnFjArIr0BOCtXPgbDwfZO2joSvP3YkSVtZ29rB+7O8UePKFPOykejlUQkiu6QzuKi257lvO8sLnk759y0iA/c/GQZclQ+6dGHalYSkSgKDllsb2kf7CyIDH1dBQ2VNCqJgkOV0+kspcpn4IMceRQcqlRXJ6JKeyISQcGhCujyLwNBx1llqfrgsG77AXYdqMy+hbx+7Kf/syEVTlMrVaaqDw6X/PQ5Pvz9pwc7GwMuPVmaWpVEJErVBweAjnhysLMgIjKkKDhUO9UcpFx0LFUUBYcq1T3lgc5oKY26HCqTgoNIFXB3vlu/jlVNLWXf9h9e1/T5AM0HY9z82FoSycoocCk4VDl1SFeHjkSS/3p2I3931wtl3/augzFAtdBv/HYV9z6/iWc3VEawVHCoUhp+WJ36827mai9odCRSA1sq5cZSBYcqkO1YrYzDWPJV7aX7gVAp04koOOShI57knmc30pmovCGvlVLKkez0Nfe/SvuMFRzycP8Lm7ilfh1z/vjmYGelbCqldCOF6c8LWIVdGwvWtf8VcmopOOThUCwOQGssMcg5Kb9qP6GrRaWVaoeyCokNCg75ONLuCbj3uY1s3X84r2V10agO6WNXX3f/qbQmWgWHfBxBQ3u2txzm5vnr+ML9S7MveOTskpRBhV23hjQ7gq4X2Sg4FOBIOMHSN+Ckm8JyOVJqQ9Vqz6EYe1s7St6OvuWBUxmhQcEhL93NShWoIneqcK2xOJ+9bwmb97QNdlZ6+MDNT3LOTYtK3k66yaM/mz6OhMJTf6q0/S8pOJjZm2a2ysyWm1lDkHacmS0ysw3B/7FBupnZ7WbWaGYrzeyc0HamB8tvMLPppe1S+Vn3z6YNaj7KqVJKN+Xy5LqdPLdhN99fuH6ws9IvKufIHbrStfAKaVUqS83hL9x9irtPDZ7PBBa7+2RgcfAc4BJgcvA3A7gLUsEEuAE4DzgXuCEdUIaKI33YZ7amI100Urp+32KQ89Ff0uWa/tw/NVGmHOnXi7T+aFa6DJgTPJ4DXB5Kf8BTXgLGmNmJwMXAInff6+77gEXAtH7IV972t3XwvhsXDmYWyiKfjrFwZehAeydff3gFB9s7+zFXQ1NlnM49PbR0M48u3wpU3kiaoajSPuJSg4MDT5jZMjObEaS93d23AwT/TwjSJwBbQus2BWl9pWcwsxlm1mBmDc3N/Te51U+e3MCB9swO3Ur67qPixr3PbuTXrzQx6/k3Bzw/Q0YFfcnX/HoVX5u7HKi8C9dQlP6MK6VZqa7E9S9w921mdgKwyMyyNdhGfWSeJT0z0f1u4G6AqVOnDtjhnv6yK/EEi2oKqMbmga7vuEL3fSD2qhLPj2JUSGworebg7tuC/7uA35LqM9gZNBcR/N8VLN4EnBRafSKwLUv6kHGk3QRXiB4ndKUUeYpQKe3EfVGzUn7ueuYN7nt+02BnY0goOjiY2VFmdkz6MXARsBqYB6RHHE0HHg0ezwOuDEYtnQ+0BM1OC4GLzGxs0BF9UZA2ZFTiNTPbxbAaryOVXDuE7ppDpe5fudy6YD03Pba2qHUrrfBYSrPS24HfBp2edcCD7r7AzJYCD5vZVcBm4JPB8vXApUAj0AZ8HsDd95rZTUD6lt5vu/veEvLVb46EE6vQPIYXr7HMtGpRgaOVexiI/arQj65qFV1zcPeN7v7+4O9Md78lSN/j7h9z98nB/71Burv71e5+qru/190bQtua5e7vCf7uL323yivXMMdE0pk0cz53PN04cJkq0I+feI0b563JSA83N3TVJir1CpmHI6n099DSzXxxTkPuBRk6+/XMa7u47I4XKuanNMO6TpsKaWnQHdJlkP6dh58u3jDIOem7Cez2pxqZHZpyPFtTWeWdtrkdiU2H1/x6FU+u25nfwkPkS/3Xh1ewYst+Xt95kPU7Dgx2dvpFpfRflTpaqarkLFAPgRMwKo9Zfwku9Fqlt7tnF9QOK3TfB2S38vjw0jXVS376XH/nZsBV2qGjmkMe8i1VDpWqe1qh5ZfKKO8Uxwagv+W5Dc1Mmjmf+Su39+O7RKvUoDekVNh9DgoOBch18R8KJ2C+B2bUYpU+1j8f/fkd3jJ/HQBXP/hK/71JH6r5Ox1oFRIbFByi9B4T3t1R29fyWV8eUOGs55Ofns1Kld20kk33Cd1/Oz+Y8/xrtFL/q7QfVFJwyEOuJoeug6JCrqq99+Kq2Uv5zL0vDUpeBspABMaaAmLD3c++wZ984/GyvXeyjx2bNHM+k2bOL/uxe9Ftf+Da36wqeTsvvrGHSTPn88U5OX68qkDvua6ee57dWNZtdhUSe32UX5i9lM/etyTn+h/87mJ+uPC1suapFAoOech1Tg9UzeHhhi1c88jKrMuEC6f5XIsip88IktZsa2H3oRiL1+/ihcY9BeT0yDMQZfpCKg7fqV9PRzAKrhxyXfvLPbT09Z2H+OXLm0vezsI1OwB4ct2uHEsWJp50bqlfV9ZtpvU+p55av4vnNuzOud72lnb+YwgNh1dwKIOBuvv0/z2ykocatmRdJt88RJWUe1+8Pn7780z7ybOFZPGIV66v8KWNezKmYRioIY7JpOf9S4Bd65Rhx/vj+O+P2nh/1fA940HfYvEEX/3lq7y1pzXnsvvbOmjrKOz7LIeqDA4/XPgak2bOL3i9vg6qUg62fa0dPLeh8BlmJ82cX/YqaPri9Z9/eKMrbfeh0n+isr98be6rnP7NBWXZVvcw3tIuHO5O/artfObeJRnTMIw7enhJ287XD554jbNu6J6B5nP3v8x/+/7TWddZva2lv7NVlP64jJfyFW/df5jDHYk+tpt/n8NLG/fy+xXb+Lffre5KO2p4LVd9+JSMZS/56XO8/1tPMGnmfPa3Ddz5WJXBodCqW67x/6WUuj4/eymfve/lPg+4bMpRBT2S5917dPk2DncW/rlFKddQ1vmrtvPPv3glspnmkrNOBOATZ0fOSN9lVVNpF+rfvNLU4/kzr+UufPzdnX/sejx/5XbeaD5UUh7KJXzO3ff8Jto64ry24yCnffNxtu4/XNw281jm3uc2Eo9o1rvge0/xxQey938UG3yc6H6peNLpTKQ2+uYA/oxtVQaHtD5rAr2ep0vU3tc6JVxRXt95EIBEAUdUMs9olO1in37pUHu86w7vwYoN7l6Wqn5bRzzvz6bvvPSVnl8emw/GejzfeaCd9iCApb+PmhxR+ECBP7ZU7maSqx98hY/96A8Fr9cvTUChk+umx9by3fr1PLjkLdo7kzwR9EcUqq/O+bCb56/jHx+InpokV/9bX9vP9fm4R49oCx/T+eS9XKo6OPQu3f3rQ8sjm5vSpdP7nt/EL1/ObPMvxxjyQi7MhQSSXP7mP57nC7PLOxKkUJ+5dwmnXFtf0jZi8QRnXL+Qm+cX18mYLgD84fXoUvYp19bzpZ8tK3i7531ncVenanc/T+Hf33tv6Hui4t7xcCgNmvvqL18tqgk3rfe+HGjv7Pociy0H5Pv5PN2rxvXK5n3Ztxv8v3LWy5Gvn3JtfVcfw/cXpH76Jp7oeeGPug7EQzs6kCMiqzo4xHsdXb95dWvkcreH5kz61bKI4FCOzrwCli33yJL0SIpyNivFE0lumb+W3YdiXP/oar788+gL67SfPMsf3yh9JFR7R6r2E/X95CWPfX9ibZ7zGPXytbnL+VXDlpJmvT2YpYO5XKXJxet2llTzSq85K9QR//sVpf00S1R2Su0fivq8VmzZz+/6OP/Tnns994ijtLNuWMieQ7GM9FVbU02Ga7al5pXqDDVdOdE1h0SPmkPeWShZVc+tFD5Isl1ww0EkkXT+90PL+YepJ/HBU48Hep7s7Z0JamuMYbWZcbf5YIwRw2o4ZkRdxkFQyIGez8Vg6/7DvLbjYN8LRFwMw6NpSm2eeXz1Du55bhNN+w7z+Oqe1f/DHQmG1Rp1tTWsD+Wx+WCM8ceMKOl9O4sc/lloXFyxZT+X3fECf3n627l3+tSu9L4+tsOdCY4ZWRcsU94zvPf2cgX59LHecrhn89VVcxr4t4+fXlJeWmPxoobgxuIJRtTV9khr70zQEc/cVqGjvmLxBDUWfU6mXXbHCzm301eNvTORJJH0HoXEQ7E4Szbt5dL3npix7L7W7k7lzvAB46nvrjUWZ/Tw2q5rRDzZ/RmUel4WQjWHwKnX5desEetM8ttXt/I/Qze1hC/sp31zARf3Mfzzz255kvfd+ASzXnizK60t6IhObyHbaIi0fGsOrQV2cocvKqU0XbV3pobpAV0daQCrg1LT6dcv4J9+njmFxJ3PpDrYZ7+wiUkz5xc0HDN9ArV3lu/egGzqV6fmR+o9K2pfPxQTT3h331WZz++39rTx9Pru+wByXZs/fOtTnHpdPefctCjjtc17i+/wbNp3mDNvWMjcIu5vOPP67mazzkSSzXvaOO2bC/h1r8715zbs7qqBvdCYX0n+T/9tARf+6Jmu58V+/n1dmP/hv17ktG8uyKgRRr1PZ8J71G5fC81Mm3Rnf1sHZ96wkDuf6R4xGD7fB7LFsKqDQ2dEqQSyHzzpi1C2L2xjc/axy+Ghol3bCLJywfee4vOzo9ss05JZTv5w3msLLA6nL96QPQAdisW56bG1XR2tT6zZwVPruy+SraGLejjgfP3hFV2Po6aargvO+p8vSV1ctu7LfzRKMU1tOw+0s7JpPwCx0LHwx8bdOWsg4bbifPNX6oioRNIjL1AX3fYsn5+9lGeD/pJYPHuhYHtLe5+vZZsUcNHanUyaOZ/dEc0lQNcU3MWMqAkX1K5/dDUf+UH00Nu9rR1s2p06v3r3CWSzZW/3sVRsza13M3Taq5tTx9CKLftzbqP5YKxH7TJcmHGg+WCqVvHo8lQTVzI0UgnUId3v0idpZ4EnOPQ8QNIXkLZYYSX05oMx2jsTPLy0uwQR7tR+aWP2H8Lrq1S/YedBXtzYXZpKj4oJX6x3HUhdGKLixu+Wd7cP93Wx7UwkufCHz3Df85t44MU32XmgnRk/W8YXZjeElulet5D4dM9zm2iNxbtqTntaY121h8Mdibyb/vrSmUiyvSV1kYjFE5z3ncX87X+kmhPCnc2fvncJV973Mt9fsJ54Itmj7bi9M0FLW2ePC/Cbu1tz3qQUDzU7bN7bFjlMsuVwZ9Za4y3z1/Hu6+r50s8a2Hkg8wL/709t6NrPYoWDZO9ANPuPqb6ElzZ29xGFj6187qLPNr9UOrj8IcdFP9ZHoa69M8GvGrZ01eQ7e3136eOn95GS7d6BPYdiXZ9noZ9r1ECVHyx8LeM4XrvtAFfOeplE0jMKn72b6AZysEFV9jnUmJFw73GQhzXu6nuMd7jE+M3frebaS0/vs5STzWm9bt5KOkzvY5RDZh66D5h7n9vItLPewdEj6vir23o2Z6VPxF8t666an/udxVx36WkcaO95Mes9ZryvAPTTJzewKxiuuWTjXr5Tv77H62/tac1oy057befBHk1wUf0s1/12VVdePn3PEmoMNn7345x+/QIum/JOfnrF2ZHbzqfmcMO8NTy4ZDMrb7yIq3/R3awVVRJ+cePfX+IHAAAJJ0lEQVQeXty4hzl/fLNH89zld7zQo58E4KM/fIYPnXo8D/7j+X2+dzyR7LpYrNiyn5vnr+PGvz2zxzLv/9YTTBw7ilv/+/sit5Ee9bRwzU5Oe8exGa93XVD6uHjmoy5U3exIJBlZ090PkG4W+8qDr/LX73snAGd/O7Npqlj721LHTa4mzRF1mWXahWt2dAX4cceM4C/+9AS++bvVzA0VwJZs2sOHTh2XUfqekmUfPnDzk3zi7Anc9j+mZNzxXqzeQffa36xkRXBvS/qelPQisc7BCw5VWXNIt1n+y0PLI19/sY+gAT1LDwvX7Oiz1DFp5ny+v2B9j6aUbH736tY+h1H2Fi5N3Dx/HV+c0xB5J3PjrugO6d4XdIAre00MdufTmU1fAL9f2V27WB5Rjf7zHzzTVRqH7lEZab0793t7qtccOuFFHg3VbML9EZNmzs96B/A1j6zkQ99dzJPBaKOrf/FKj7luet+bENa736Z3YEjLNeLqR4te538/1H0sPLay5yiedI2hKUtTWjiAZwuGpfRZHggF9t6l1nChf/ehGP/nVyvKOv/TFXenJndszVETrwndKZYuYPxr6FxO1+R7N5F11RxCn08+w2x/++rWjILMpJnzmfyN+h5Nsb3le9Ps+yaOyVgmndf2Xk2EalbqZ6VMnbwrdCHZ19bJb7MMf7vzmTcyOtT68u2Ijkx3Z/2OAyST3uMnFXu3d6/fcTCymWFFAXfa7ujVDh3VL7KyaT9vhdqTJ407qsfrUVNZ9K6RhN8n6g7XqCGbP36i5zQhjy7f2mN6iN4SydQUFsmk0xFP8lDDFra1tNMc1BB6T4JWrl8lK2Q6k3Awb2nr5PTruz+7fM7/jbsza7flGMgS3ka2GsjUm5/kkWX5HdthuUbldSaSOQciPBsqRKULVOF8p2NHba9Ot10HYnnlIUr4J3a78+r89b8/3+c6iaSzdlvmT6Gu3d7zvPzZS29lLJM+N3rXHJ5Yu6PHaKf+NGSalcxsGvBToBa4192/11/vVUq1u7efPNl/vxv9ufuXRtYm9kbUVj5zb+4pgbPJZ2RTuEYAsOytnjcF5TOVRbiE/+c/eCavvN3+VPc0ITta2vna3OgaX9qC1Tu4+sFXuOPT53DmO7ubX/q70FXodCb3v7CJEXW1bOw1VUU+I8XqV2XeHRxVkyvFi2/s4SN/Mp63jRoGZAbVQuR7I1w+x1C4z+Fz9y/lnHeN6bHeAy++xSXvPbGrmSrt679awfaWw3zmvJPzzHW3YgJhXy0TC9fkvl8mkXSa9rVlDC74+Uub+flLm3nzex8vOD+FGhLBwcxqgTuAvwKagKVmNs/do8cFluBz9+fXrj/YrnlkZZ/NTOF5cKrNh299Kucy6V9a+8bvVmVcIIaSb/0++vDesDPL/Sk5LH0z+2CGQnz1l69yzrvG8Jt/vqBs28xlw87C53R6ZXPPoJitWfiHT7zOCceOLPg9Wguc5bYcPnxr4X2Z5WRD4QdqzOyDwI3ufnHw/FoAd/9uX+tMnTrVGxqi5z7pi7uXPE2DiAx9Mz7ybu4u84/5DCWl1BzMbJm7T8213FDpc5gAhOc9aArSejCzGWbWYGYNzc2FT3NtZtz4N2dkpM+85LSCt1WIh7/0Qf7Xhe9h1udyfh+DbsZH3s3fnZP66E/p1acQ5QsXZE4xnHbeKcf1eP7u8UfxuQ9Nilx2ykmZnXIA91w5tevO4mLzkY989rWcokbc9KWYLrKjR3R/ZqeO7599O2tC5oipbE4+fnRBv4ZXiBpLHV9p5RpZlM27jhvNe044OiP9gvccn3Pd3p/D8Cx3b0eJ6mMst6FSc/gkcLG7fzF4/lngXHf/al/rFFNzyCUWTxBPOEl3jhk5jPbOBG0dCcaOHsbe1g5GD6+j5XAn444eTmsskZooy1Jt2WOPSs3V35lI0hZL8LbRwyLfIz11RG2N8UZzK4c7Epw8bjQ1Zhw9oo639rSy80CMs981hs5EktZYatqFpDvDams41B5n1PBahtXWUBtxpsUTScyMQ7E4rbE47zh2JDU1RktbJ47zRnMrE8eOosaM8ceM6JoB9JgRqX0bMzr6NwdWNbVw4piR1NUYx45M7VtbZ4KjR9TR3pngUCzO8UcNJ55M5dPduzr+D8XijB5W2zXKJJF0mg/GeMfboqv37k4snmTksJ7TKew80E5djXHcUcN7bHt4bQ3Dg4vtgfZO2jtS39u7jhvdY2TLvtYOxowexsFYnFpLfQdJd0YPT11ID7Z34sCxI4f1yH/Tvjbe+bZRPbZ1oL2TUcNqWbW1hbeNGsbbjx1JayzOyGG1HDOijpoaY/ehGDta2pkwZhSjhtcyoq6GWDyJGYyoq6UjnmRYrRGLJ4P7IJx4wruOJUgdT+mbAw/F4nQmnL2tHZx8/GiG1dYQiydIJmHU8Nquz87M2NfawZ7WDt513GiG1VqPQRjJpLO8aT/Da2s47qjh1NYYJxwzAjOjNRanrSPBuKOHE4snaTncydrtBzh13NG8c8xIDncmaO9Mdq3XEjTbtXXGGT28rqt/ovd33plIUhN85q/vPMgJx4zocay5Owfa4xw7so7OhFNjqZFbE8eOoq62JjW4IJE6JtId1u2dCYbV1nS9Z29vNB9i3FEjGDm8hpa2Tg60dzJ29HCa9h3m/UFhJP2+bxs1jM172nhzTysnHz+ak4/vDjR7DsXY19ZJW0ecCWNGMXb08B7HAtD13afPSXdnzbYDnHz8aI4JzpfDHQnMUoEgvX4y6RzuTHBUKJh3JpJ0JpJdx2U8keRwZ4Itew9z/NHDGVFX0+d5mo98aw5DJTgMSLOSiEi1O9KalZYCk83sFDMbDlwBzBvkPImIVK0hMVrJ3eNm9hVgIamhrLPcfc0gZ0tEpGoNieAA4O71gIYSiYgMAUOlWUlERIYQBQcREcmg4CAiIhkUHEREJMOQuM+hGGbWDGROZ5ifcUDxs4gNPOW3/xxJeQXlt79VQ35PdvfxuRY6YoNDKcysIZ+bQIYK5bf/HEl5BeW3vym/3dSsJCIiGRQcREQkQ7UGh7sHOwMFUn77z5GUV1B++5vyG6jKPgcREcmuWmsOIiKShYKDiIhkUHAQEZEMCg4iIpJBwUFERDL8f9zZ4AhsRUCvAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# I'm going to make the assumption that it was a flatRate\n",
    "# I'm hard-coding this in. Could mistake future outliers!\n",
    "df.loc[df['totalPaid'] > 100000, 'flatRate'] = True\n",
    "df.loc[df['totalPaid'] > 100000, 'wordRate'] = 1\n",
    "df.loc[df['totalPaid'] > 100000, 'totalPaid'] = 2800\n",
    "df['totalPaid'].plot()\n",
    "df['totalPaid'].describe()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### wordRate"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count    3192.000000\n",
       "mean        0.380072\n",
       "std         4.443633\n",
       "min         0.000000\n",
       "25%         0.070000\n",
       "50%         0.190000\n",
       "75%         0.350000\n",
       "max       250.000000\n",
       "Name: wordRate, dtype: float64"
      ]
     },
     "execution_count": 28,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXoAAADuCAYAAAA3IMxxAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4zLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvIxREBQAAFQZJREFUeJzt3XlwXWd5x/Hvc7VatiQvkmzHm0LipnEKOEGEQNIpSweS0JmEaaFJB8hQqPkjmYEpnamTQskUwjLDmjZNayBgUgqYJhDP2EAcExpDSIicGu/BimNbsiVLtqxdd3/6h44VOVas7V5sn/f3mdHce9/7nnMebT8dPeece83dERGR+Eqc7wJERKS4FPQiIjGnoBcRiTkFvYhIzCnoRURiTkEvIhJzCnoRkZhT0IuIxJyCXkQk5krPdwEAdXV13tjYeL7LEBG5qGzfvv2Eu9dPNO+CCPrGxkaam5vPdxkiIhcVMzs8mXlq3YiIxJyCXkQk5hT0IiIxp6AXEYk5Bb2ISMxNGPRmtszMnjSzfWa2x8w+Fo3fa2ZHzWxH9HHzmGXuNrMWM3vBzN5VzE9ARETObTKnV2aBT7j782ZWDWw3sy3Rc1919y+NnWxmq4DbgKuAS4AnzOyP3D1XyMJFRGRyJtyjd/d2d38+ut8P7AOWnGORW4AfuHvK3V8CWoBrC1FsoXzjqYM0rt1EPq+3URSR+JtSj97MGoGrgWejobvMbKeZPWRm86KxJUDrmMXaGOcPg5mtMbNmM2vu6uqacuEz8cWf7Qcgp/fLFZEATDrozWwO8AjwcXfvAx4ELgNWA+3Al09PHWfxsxLV3de5e5O7N9XXT3gFr4iITNOkgt7MyhgJ+e+5+6MA7n7c3XPunge+wcvtmTZg2ZjFlwLHCleyiIhMxWTOujHgW8A+d//KmPHFY6a9B9gd3d8I3GZmFWZ2KbAS+G3hShYRkamYzFk31wMfAHaZ2Y5o7B7gdjNbzUhb5hDwUQB332NmG4C9jJyxc+eFesaNWvQiEoIJg97df8X4fffN51jmPuC+GdRVVDbeZyMiElO6MlZEJOYU9CIiMaegFxGJOQW9iEjMKehFRGJOQS8iEnNBB72f/coMIiKxE2TQ27iXBYiIxFOQQS8iEhIFvYhIzAUZ9OrNi0hIggx6EZGQBBn0OhgrIiEJMuhFREKioBcRibmgg15vPCIiIQgz6NWiF5GAhBn0IiIBUdCLiMRcmEGv3ryIBCTMoBcRCUiYQa+DsSISkDCDXkQkIAp6EZGYCzrodcGUiIQgyKBXi15EQhJk0IuIhERBLyISc0EHvd5pSkRCEHTQi4iEYMKgN7NlZvakme0zsz1m9rFofL6ZbTGzA9HtvGjczOx+M2sxs51mdk2xPwkREXl1k9mjzwKfcPcrgeuAO81sFbAW2OruK4Gt0WOAm4CV0cca4MGCVy0iIpM2YdC7e7u7Px/d7wf2AUuAW4D10bT1wK3R/VuA7/qIZ4C5Zra44JWLiMikTKlHb2aNwNXAs8BCd2+HkT8GQEM0bQnQOmaxtmjsletaY2bNZtbc1dU19coLQBdMiUgIJh30ZjYHeAT4uLv3nWvqOGNnRaq7r3P3Jndvqq+vn2wZBWG6YkpEAjKpoDezMkZC/nvu/mg0fPx0Sya67YzG24BlYxZfChwrTLkiIjJVkznrxoBvAfvc/StjntoI3BHdvwN4bMz4B6Ozb64Dek+3eC4UatmISEhKJzHneuADwC4z2xGN3QN8AdhgZh8GjgDvjZ7bDNwMtABDwIcKWnEBKe9FJAQTBr27/4pXfx2wd4wz34E7Z1hXUalHLyIh0ZWxIiIxp6AXEYm5oIPedVRWRAIQZNCb3npERAISZNCLiIREQS8iEnNBBr3ecEREQhJk0J+muBeREAQZ9DoYKyIhCTLoRURCoqAXEYm5oINe10uJSAiCDHq9qJmIhCTIoBcRCUmQQa+WjYiEJMigFxEJSdhBrz17EQlAkEGvg7EiEpIgg15EJCQKehGRmAs66PUqliISgiCDXi16EQlJkEEvIhKSIINeDRsRCUmQQX+arpAVkRAEGfTq0YtISIIMehGRkCjoRURiTkEvIhJzQQe9jsWKSAiCDHrTq5qJSEAmDHoze8jMOs1s95ixe83sqJntiD5uHvPc3WbWYmYvmNm7ilW4iIhMzmT26L8D3DjO+FfdfXX0sRnAzFYBtwFXRcv8u5mVFKrYQnGdQC8iAZkw6N39KaB7kuu7BfiBu6fc/SWgBbh2BvUVlQJfREIwkx79XWa2M2rtzIvGlgCtY+a0RWNnMbM1ZtZsZs1dXV0zKGPq1KMXkZBMN+gfBC4DVgPtwJej8fESdNzdZndf5+5N7t5UX18/zTJERGQi0wp6dz/u7jl3zwPf4OX2TBuwbMzUpcCxmZUoIiIzMa2gN7PFYx6+Bzh9Rs5G4DYzqzCzS4GVwG9nVqKIiMxE6UQTzOz7wFuBOjNrAz4NvNXMVjPSljkEfBTA3feY2QZgL5AF7nT3XHFKnzkdihWREEwY9O5++zjD3zrH/PuA+2ZSVLHpUKyIhCTIK2O1Jy8iIQky6EVEQhJ00Ot6KREJQZBBrx69iIQkyKAXEQmJgl5EJOaCDnrX+TciEoAwg15NehEJSJhBLyISkDCDXh0bEQlImEEvIhKQsINee/YiEoAwg14HY0UkIGEGvYhIQBT0IiIxF3TQq0UvIiEIMujVoheRkAQZ9NqTF5GQBBn0IiIhCTro9cYjIhKCIINePXoRCUmQQS8iEhIFvYhIzCnoRURiLuig1ztMiUgIggx6Mx2OFZFwBBn0rvMqRSQgQQa9iEhIgg567diLSAiCDHr16EUkJBMGvZk9ZGadZrZ7zNh8M9tiZgei23nRuJnZ/WbWYmY7zeyaYhYvIiITm8we/XeAG18xthbY6u4rga3RY4CbgJXRxxrgwcKUKSIi0zVh0Lv7U0D3K4ZvAdZH99cDt44Z/66PeAaYa2aLC1WsiIhM3XR79AvdvR0gum2IxpcArWPmtUVjZzGzNWbWbGbNXV1d0yxjZnQsVkRCUOiDseMd5Rw3T919nbs3uXtTfX19gcsQEZHTphv0x0+3ZKLbzmi8DVg2Zt5S4Nj0yxMRkZmabtBvBO6I7t8BPDZm/IPR2TfXAb2nWzwiInJ+lE40wcy+D7wVqDOzNuDTwBeADWb2YeAI8N5o+mbgZqAFGAI+VISaC0YvhSAiIZgw6N399ld56h3jzHXgzpkWVWy6XkpEQhLklbEiIiFR0IuIxFzQQa8WvYiEIMigV4teREISZNBrR15EQhJk0IuIhERBLyIScwp6EZGYCzLodTBWREISZNCLiIREQS8iEnNBB70umBKREAQZ9KZXNRORgAQZ9Hp5YhEJSZBBLyISEgW9iEjMBR30rle9EZEABBn0OhgrIiEJMuhFREKioBcRibmgg15nWYpICIIOehGRECjoRURiTkEvIhJzQQe9WvQiEoIgg15n0YtISIIMehGRkCjoRURiTkEvIhJzQQe9XpdeREIQdNCLiISgdCYLm9khoB/IAVl3bzKz+cAPgUbgEPA+dz81szJFRGS6CrFH/zZ3X+3uTdHjtcBWd18JbI0ei4jIeVKM1s0twPro/nrg1iJsoyDUoReREMw06B143My2m9maaGyhu7cDRLcN4y1oZmvMrNnMmru6umZYxtTofUdEJCQz6tED17v7MTNrALaY2f7JLuju64B1AE1NTdq5FhEpkhnt0bv7sei2E/gxcC1w3MwWA0S3nTMtUkREpm/aQW9ms82s+vR94J3AbmAjcEc07Q7gsZkWWSw6jV5EQjCT1s1C4MfRG22XAv/t7j8zs+eADWb2YeAI8N6ZlykiItM17aB394PA68cZPwm8YyZFiYhI4ejKWBGRmFPQi4jEXOBBr6OxIhJ/gQa9rpgSkXAEGvQiIuFQ0IuIxFzQQa8LpkQkBEEHvYhICBT0IiIxp6AXEYk5Bb2ISMwFHfQ6FisiIQgy6PUOUyISkiCDXkQkJAp6EZGYCzrodcGUiIQg6KAXEQmBgl5EJOYU9CIiMRd00LvOpBeRAAQZ9DqNXqQ4ugfT57sEGUeQQS8ihffzPR1c85ktPHvw5PkuRV5BQS8iBfHcS90A7GzrPc+VyCsp6EWkIBKJkaZoXheoXHCCDnr9PIoUzunXkMrr9+qCE3TQi0jhGNqjv1Ap6EWkIBI6ne2CpaAXkYJIRL2bvHo3F5xggr6rP0Xj2k38qLl1dEz/YYoUTkI9+gtWMEH/0olBADY0t160bzzy+J4Otuw9fr7LkJjrGUozkMpOeTkz9egvVEULejO70cxeMLMWM1tbrO38oQ2msnzyJ7voT2b+4Nte8/B2/u67zTNax1A6y6d+spu+AtX/YtcAn9+8T/+u/wHtPdZX1K/36n/Zwp9+8RdTXu70DpRfZEGfzORo6ew/32UUVVGC3sxKgAeAm4BVwO1mtqoY24KRb5S7c+sDv6Zx7SYyuTyd/Ul6htIc6xlmOJ3jWM8wACcH0+SiX5KeoTSZXP5VQ7u1e4jBMXs22Vye7zx9iP965givvfdx3njfEzy5v5N97X1s/N0xOnqT/PC5I7R0DtCXzPC5zfv4yuMvjC6/obmVv/jXbQD0Dme46evbeKGjn96hDP/82G4GUlnae4fPqOHh3xyice0mWjoHRsfyeaft1BC/P95PJpcH4CPrn+Mf/2fn6Bx35+5Hd/H2L/2S4XRudPwHv23l4WcO87UtB+geTPPgL19kMJWlezB9Vni4O6cG0xztGSaZeXkdJwdSZKPt/tOPd/GfTx1k19FeUtkc+zv6uPvRnTy+p4ODXS/X3NLZz8mB1Oh6X+37OF1b9h6nozd5xrqSmRzf/vVLPHeom8a1m7jhi784Y9v9yQzX3vcE2w50vep6U9mR9fQOZzjel+Th3xxi/dOHSGfz3Pi1p9gwphX4ah54soXrPreV19y9KfpevhwqfckM7s43tx3k/d98lmQmRyqbO+MPcSqbYyCVJZnJ8ezBk9x8/zZec89mmj77BO4++lxLZz/3btxD49pNHIr+g+3sT7LhuYlrPP21f/CXLwJwaujl7bs7vUMZjka/Q7m8k87mR2t74MkWfra7Y7RHf/8vWmhcuwmATC4/+jOazORY+8hOGtduYsve4zSu3cTxviTHeobpS2Z4sWuATz+2+4yf9fGksmf+nDy24yjvvn8b7o67M5zO8ZcPPs3+jj6+9+zh0d/3VxpKZ+kdznDPo7v48688Nfo1f6Gjn47eJMPp3Gjtr5TJ5cnm8rg7zx85xevu/TmNazeRyzvbD5/i+SOn2NHaQ38yc8bP9bd//RKNazfxyPY2XuwaGP06FpsV46+vmb0ZuNfd3xU9vhvA3T8/3vympiZvbp76nuq+9j5u+vq2mZQ6LjNYVFNJ+5jgmIm/blrGDycRCCG5evlc/u9ID6sW17C3vW/C+UvnzeLOt13Op36ym+wF/N/DLasv4crFNXzhp/sB+OS7r+Szm/ZNa12rl81lxYIqHttxbMZ1venS+XT2p3jLZQt4w4p5HOwa5N+ebJnxes/lfU1L2dDcNq1l6+aUc2IgTVV5Cf/wzivY197Hj7afva6G6go6+1NTWnd1ZSlXLKym+fCpadU2HX97/aUsqq3gc5v3n/Xcf7z/Ddz4J4umtV4z2+7uTRPOK1LQ/xVwo7t/JHr8AeBN7n7XmDlrgDUAy5cvf8Phw4envJ2nW07wN998tjBFi4icB5c3zOGJv/+zaS072aAvndbaJ7H9ccbO+Ivi7uuAdTCyRz+djbzl8jr2f+ZGkpkc5aUJdrT2cM3yeZhBKpsnk82TzuWZP3tk72DfsT6uWFRNJpfHgTkVpQymspgZ86vK6U9lqCwroaq8hEzOOXpqmDkVpSysrWAgOfJv3omBNAmD1y+bS4kZB08McmndbHa0nuKFjgEW1lTQUF3JyoVzSGXybD/SzaKaWexo7WHFgiquXFxDOpsn505H7zA9QxmuuqSWvmSGA8cHaGqcR0dvkqXzZnFqKE11ZRm9wxlyeWduVRnVlWUcPTXM8b6R/zZS2TyLays5NZRmcW0l6axzWcNs2nuSdPQlaVoxj2zeGUrn6B5MUzurjEwuz//+vosbLq+joixB7ayRbbT3JLlycQ2/a+th7qwyKstK2NHaw2uX1LKotpLykgSD6SwnB9Isn1/FoZODDKSynBhIccWiGvqTGWoqyxhKZ8nmnaXzqhhKZUlm8gyksixfUMXJgRRzZ5WTyefZtLOdG1bWUV6SIJEwjvUMs7C6kkW1lRw6OUhZSYLBVJYXuwZ4Y+N8EmbsOtpLQ3UFyUyO5QuqyOZGvi7ZnLNl73Eaaiq4evk88nmnoixBWUmCbQe6WLW4lobqCpoPn6K+uoLShLFgTjnZ/EhbYiCVZcGccva197Ngdjn11RV0D6apr66gZyjDgtnl5N3pHkyTzTuHTgzy5ssWkM07s8pKSGZyHOgcYMncWcypKKVnOENlWYJszkkkjKqyEjK5PLVVZbhDKpPncPcgQ+kci2sryeTyVJSWcHIwzbyqMubNLmc4neNI9xCzykqom1PB8b4kJwZSvP2PG0hl85hBMjNyu7O1l0QCLqmdRUnCqChLUF6SoO3UMEvmzqIvmaF3OENVeQlguDsvnRhk1SU1ZHLO0nmzyOWdnqEMeXcOnRykprKMZfOrKE0YO1p7mF1RymX1s8nnYX9HH1ctqSVhMJjKMau8BGOkFTWQzNLem+Q19bNJZ/OUJCz6uXNyeae9d5iGmkqqK0vZe6yPFQuqyGSddC5PQ00FFaUJ+pPZkd/JZDZqb420oVYsmI3jDCSz7GzrZcWCKqorS6mbU8HcqnI6+5Ic6R7CzNi67zhvuayO2lll1FdXUJIwyksS/HR3Ow01I9/XGy6vw8zI5Z2G6gp+19ZDwoxFtZXMrigl7055SYK+4QyHTg5RN6echTWVDKayOCOnlFZXjsRoa/cQQ1GbdPn8Kg50DvC6pbUMp3M4I63fbN5HW0TdA2lqq8q4vGHOdOJvSi7q1o2ISMgmu0dfrLNungNWmtmlZlYO3AZsLNK2RETkHIrSunH3rJndBfwcKAEecvc9xdiWiIicW7F69Lj7ZmBzsdYvIiKTE8yVsSIioVLQi4jEnIJeRCTmFPQiIjFXlPPop1yEWRcw9UtjR9QBJwpYTrGp3uJSvcVzMdUKYdS7wt3rJ5p0QQT9TJhZ82QuGLhQqN7iUr3FczHVCqp3LLVuRERiTkEvIhJzcQj6dee7gClSvcWleovnYqoVVO+oi75HLyIi5xaHPXoRETkHBb2ISMwp6EVEYk5BLyIScwp6EZGY+3/GQVyaqDqUIAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "df['wordRate'].plot()\n",
    "df['wordRate'].describe()\n",
    "# Wow. That's a lot of money."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>comment</th>\n",
       "      <th>contract</th>\n",
       "      <th>flatRate</th>\n",
       "      <th>levelOfReporting</th>\n",
       "      <th>daysToBePaid</th>\n",
       "      <th>paymentDifficulty</th>\n",
       "      <th>platform</th>\n",
       "      <th>publication</th>\n",
       "      <th>relationship</th>\n",
       "      <th>rights</th>\n",
       "      <th>storyType</th>\n",
       "      <th>wordCount</th>\n",
       "      <th>year</th>\n",
       "      <th>totalPaid</th>\n",
       "      <th>wordRate</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>158</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Global Post</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>4.0</td>\n",
       "      <td>2013</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>250.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    comment contract flatRate levelOfReporting daysToBePaid  \\\n",
       "158     NaN      NaN    False              NaN          NaN   \n",
       "\n",
       "     paymentDifficulty platform  publication relationship rights storyType  \\\n",
       "158                NaN      NaN  Global Post          NaN    NaN       NaN   \n",
       "\n",
       "     wordCount  year  totalPaid  wordRate  \n",
       "158        4.0  2013     1000.0     250.0  "
      ]
     },
     "execution_count": 29,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df[(df['wordRate'] > 20)]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "count    3191.000000\n",
       "mean        0.301846\n",
       "std         0.461516\n",
       "min         0.000000\n",
       "25%         0.070000\n",
       "50%         0.190000\n",
       "75%         0.350000\n",
       "max        15.000000\n",
       "Name: wordRate, dtype: float64"
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXQAAADuCAYAAAAp6fzCAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4zLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvIxREBQAAIABJREFUeJzt3XmYHFW5BvD3myUJySRAyLAjEwREiCIwoAiiAlEQBfWqgIpcFrngwvV6vZiIElBAroCKoEhugEQIQVYJZIWQkH2Z7MskmUkymQxJZkkms/f09t0/uqunurt6q66e6a68v+fhIdNd3XW6u+qtU6fOOSWqCiIiKnxFA10AIiJyBgOdiMglGOhERC7BQCcicgkGOhGRSzDQiYhcgoFOROQSDHQiIpdgoBMRuURJf65s1KhRWlFR0Z+rJCIqeKtXr25R1fJUy/VroFdUVKCqqqo/V0lEVPBEZHc6y7HJhYjIJRjoREQuwUAnInIJBjoRkUsw0ImIXIKBTkTkEgx0IiKXYKATUUYenbMVH/3VzIEuBlno14FFRFT4/jp/x0AXgRJgDZ2IyCUY6ERELsFAJyJyCQY6EZFLMNCJiFyCgU5E5BIMdCIil2CgExG5BAOdiMglUga6iDwnIk0issniuV+IiIrIqNwUj4iI0pVODX0ygKtiHxSRUwCMBVDvcJmIiMiGlIGuqgsBHLR46k8A7gGgTheKiIgyZ6sNXUSuBfChqq5PY9k7RKRKRKqam5vtrI6IiNKQcaCLyFAA9wK4L53lVXWiqlaqamV5eXmmqyMiojTZqaF/FMBoAOtFpA7AyQDWiMjxThaMiIgyk/F86Kq6EcCxxt/hUK9U1RYHy0VERBlKp9viNADLAHxMRBpE5LbcF4uIiDKVsoauqjemeL7CsdIQEZFtHClKROQSDHQiIpdgoBMRuQQDnYjIJRjoREQuwUAnInIJBjoRkUsw0ImIXIKBTkTkEgx0IiKXYKATEbkEA52IyCUY6ERELsFAJyJyCQY6EZFLMNCJiFyCgU5E5BLp3ILuORFpEpFNpsceFZGtIrJBRN4UkaNyW0wiIkolnRr6ZABXxTz2LoAxqvpJANsBjHe4XERElKGUga6qCwEcjHlsrqr6w38uB3ByDspGREQZcKIN/VYAsxI9KSJ3iEiViFQ1Nzc7sDoiIrKSVaCLyL0A/ACmJlpGVSeqaqWqVpaXl2ezOiIiSqLE7gtF5GYAXwVwhaqqc0UiIiI7bAW6iFwF4JcAPq+q3c4WiYiI7Ein2+I0AMsAfExEGkTkNgBPARgO4F0RWScif89xOYmIKIWUNXRVvdHi4WdzUBYiIsoCR4oSEbkEA52IyCUY6ERELsFAJyJyCQY6EZFLMNCJiFyCgU5E5BIMdCIil2CgExG5BAOdiMglGOhERC7BQCcicgkGOhGRSzDQiYhcgoFOROQSDHQiIpdgoBORLbyVcP5J5xZ0z4lIk4hsMj02UkTeFZGa8P+Pzm0xiYgolXRq6JMBXBXz2DgA81T1DADzwn8TEdEAShnoqroQwMGYh68DMCX87ykAvu5wuYiIKEN229CPU9V9ABD+/7HOFYmICgGb0PNPzi+KisgdIlIlIlXNzc25Xh0R0WHLbqA3isgJABD+f1OiBVV1oqpWqmpleXm5zdUREVEqdgN9OoCbw/++GcBbzhSHiIjsSqfb4jQAywB8TEQaROQ2AI8AGCsiNQDGhv8mosMIm9DzT0mqBVT1xgRPXeFwWYiIKAscKUpE5BIMdCIil2CgExG5BAOdiGzh5Fz5h4FOROQSDHQiIpdgoBMRuQQDnYhsYQt6/mGgExG5BAOdiMglGOhERC7BQCciW9gNPf8w0ImIXIKBTkTkEgx0IiKXYKATEbkEA52IbFEOLco7DHQiIpfIKtBF5L9EZLOIbBKRaSIyxKmCERFRZmwHuoicBOBuAJWqOgZAMYAbnCoYERFlJtsmlxIAR4hICYChAPZmXyQiKgQcWJR/bAe6qn4I4DEA9QD2AWhT1bmxy4nIHSJSJSJVzc3N9ktKRERJZdPkcjSA6wCMBnAigGEi8v3Y5VR1oqpWqmpleXm5/ZISEVFS2TS5XAlgl6o2q6oPwBsAPutMsYiIKFPZBHo9gM+IyFAREQBXAKh2plhERJSpbNrQVwB4DcAaABvD7zXRoXIREVGGSrJ5sapOADDBobIQEVEWOFKUiMglGOhERC7BQCciWziwKP8w0ImIXIKBTkTkEgx0IiKXYKATkS28wUX+YaATEbkEA52IyCUY6ERELsFAJyJyCQY6EdnCgUX5h4FOROQSDHQiIpdgoBMRuQQDnYhsYRN6/mGgExG5RFaBLiJHichrIrJVRKpF5GKnCkZERJnJ6hZ0AJ4AMFtVvyUigwAMdaBMRERkg+0auoiMAHAZgGcBQFW9qnrIqYLZ5fUHsbS2ZaCLQeR6yo7oeSebJpfTADQDeF5E1orIJBEZFruQiNwhIlUiUtXc3JzF6tLz8MxqfHfSCmz6sC3n6yIiyifZBHoJgPMBPK2q5wHoAjAudiFVnaiqlapaWV5ensXq0lPb1AkAaO325nxdRET5JJtAbwDQoKorwn+/hlDAExHRALAd6Kq6H8AeEflY+KErAGxxpFRERJSxbHu5/BTA1HAPl50Absm+SERUCHhJNP9kFeiqug5ApUNlISKiLHCkKBGRSzDQiYhcgoFORLZwXFH+YaATEbkEA52IyCUY6ERELsFAJyJyCQY6EdnDi6J5h4FOROQSDHQiIpdgoBMRuQQDnYhsUTai5x3XBTo3MiI6XLku0ImIDleuC3SBDHQRiIgGhOsCnYj6Byfnyj8MdCIil2Cg5xlVxR/nbsOeg90DXRQiKjBZB7qIFIvIWhF5x4kCHe52tnThL+/X4of/qBroohBRgXGihv6fAKodeB8y8fqDA10EIiowWQW6iJwM4BoAk5wpDhl9dIK84kR5jlto/sm2hv5nAPcASFidFJE7RKRKRKqam5uzXJ37FUko0rmzEFGmbAe6iHwVQJOqrk62nKpOVNVKVa0sLy+3u7rDRjjPWUMnooxlU0O/BMC1IlIH4GUAl4vIi46U6jBmDIxinhNRpmwHuqqOV9WTVbUCwA0A3lfV7ztWssOUUUNnoFMuBYOK38+qRkOr/e6xyo0077Afep4RzlxA/WDLvnY888FO/OSltQNdFHJQiRNvoqoLACxw4r0Od8ZFUbahUy4Zm5cvwO6xbsIaep7hRVHqDzwTdCcGep6JdFtknlM/yGY74yaafxjoeYo7CxFlioGep1hDp/7AzcxdGOh5xghydgmjXGIbujsx0PMU45z6AysO7sJAT+Cfq+px2+RV/b5e4ybX2fZyeWNNA256doUTRQIAPDJrKx58Z4tj70cDy4lbNfJYkH8c6YfuRr98feOArj/bneXnr6x3piBhf/9gBwDg118929H3JSLnsIaeZ9iGTv2BbejuxEDPU4xz6g+sN7gLAz1PcUejXHKihq6sduQdBnqeMXYRDv2n/sBQdhcGep5inh/eev0B7Dlof2rbVJzo5VJoWru8aOnsHehi5JTrAr3QaxzGxVDW0A9v97y2AZ/7w3x0e/05Xc/htJmd97t3UfngewNdjJxyXaC7xWG0n5GFBdtC99/t9eVmelv2cnEn1wV6oZ9KRmpMTPTDmnGmltfBy20077huYFGhN7kYTj+2bKCLEOWCU4/GEaXFA12Mw4axFRd6BYX6l+0auoicIiLzRaRaRDaLyH86WbDD3S2XVAx0EaJwoNMAyXGe81d1l2yaXPwA/ltVPw7gMwB+LCIDPi7cLTUacehc26kgVuT56b/bhH+2jQ1t2N7YEff0lKV1mL1pv+2350/pTrYDXVX3qeqa8L87AFQDOMmpgiVz07MrcP/0zdblcrjO0eHxZfyaV1btwZLaloxeM3XFbizfeSDpMu0eH3728lqsMC2nqnh87jbUH7Du4nY4VaxrGjtQMW4G9rX1RD2+52A3HpuzzdbBraWzFw/N2AJ/GvfenLK0Dk+9X4MfPLcSkxbttFzmxeW7o36/RIySfv/ZFfjSnxbGPT9h+mbc+eLqlO+TyK6WrtB6sthALnp4HmZs2Gf53JPzavA7hydzm7VxH2Zvsl4fhThyUVREKgCcByBuej8RuUNEqkSkqrm52YnVYVFNCyYvrXPkvVJ5an5txq+55/UN+N6kzGY6vPfNTbhh4vKkAbz5w3b8a91erNx1MPJY/cFuPPl+LW6bYj0zpFPdHwvhwDA2HHy3PB/9XfzHC6vx1Pxa7GjuzPg973trE/5v0a5Ir5NkJkzfjMfmbsfC7c14cEa15TK//tcmXD9xecr3ynUT1x0vhA4GTR3Z9cv+8UtrLB9fu+cQVuxKfeDKxF1T1+DOF63XRyFZB7qIlAF4HcDPVLU99nlVnaiqlapaWV5enu3qUpfH4ZPJQCC7HevNtQ2oGDcDHl8go9dZfQpjJ79o9EjTY6H/9/qta5BOxUKoyaUwTtS9Md+FN1y7Dtr4Mrx+l48LyNHHUtXI/XHd5EdTV+OGicsGuhgJZRXoIlKKUJhPVdU3nCmSuzw+dzsAoDnNmlCyJiMjkIqK+nYUY59J9Donc6hQds/Yj2yUu5AyuYCKaimoud9eev0BLNvh7FlAKjM37sfynQdTLzhAsunlIgCeBVCtqn90rkj5ZaB2LKvKjVFLNOV55IwkUVg5dk2hgNIwtrki1UEvH/XXGUGu1qJAzq+iPzyjGjf+33Js2RvXMDDgpq/fi3+uqu/39WZTQ78EwE0ALheRdeH/vuJQufKG1X4VCCrmb23KSTtnsrcMRAabWNTQEwW6Ag2t3ajel91Gn8+9XIzfw1A4sZ29fO1Oqqo5r6FvbwxdE2nt9uZ4TZm7e9raAblJju2BRaq6GIVzFm5bUDW0cZrS7O8f7MCjc7Zh0g8qceXZx5lG9SX/OtJdLrRM4tdn2jZ56f/OBwDUPXJNRq+LK5PFY7HfzUB4ekEtHgs3bQHxB7dUZzHJpf+bOSndsgaCipJi+2XL5QFBJLNt3s77AwV18phzrhv677RpK+sxevxMNHV4Io81tIa6CBo9BMZMmGPZtQyI3th++foGjB4/M+n6km2bwfC1vuIMdo5c9XK56dkVqBg3A6PHz8y4i6b9MijaeuK7kdbFdNmMbVopxB0/3aIay13+2AKc+8DctF7TH13/NNyGPnr8TIwePzPSTdJJxu86/s0NqBg3w/H3d8IDb29GU7sn9YIOYaCnYPQeWbP7UNxzCsXMjfvQ5Q2gpil1l7hXqhrSXq9Vb51gpLZjWi4SVrm9KKqIrokvqukL8fdNzR259OKKepz7wFzsjOl+GPsZc349oT+kWVTjs+5s6bI82FmZsbFvQFLu2tCjt5dNH7Y5vg5jH9lzsCfFkgPn+SV1+NWb/df04rpAN9rTdjY7WyN4an5N5N/GhqoKbN0fP4rPSqZnnD/75zqoKr7zzDLM3RzaASO9XKLa0EP/3tvmQcCiX56TO2yij9BfNd/3qxsBAHUHon/bVEGd6el+h8eHy/4wH69U7cmsgAPAzkHKTuPH4poWfPNvS9IaYNXU4cGS2gP4sLUvaM1niq+vbsBlf5if9gEokWxacbq9flz9xCKs3xNfUUtk9wF7mWK1X+aK6wJ9c/iK99MLdqT9mh5v6j7iAsFLK+rxlScWRd/IOc00Szf0zDVtf1CxctdB3DU1NJgi0svF9KuZt+mDXfEXhxwb+m96G1/MTm2Uq7Hdg9N/NRMbGtLfSbItSzp/p3o8ViCoqD/YjU6PHwN1mShRUPd4A7j5uZV9y2X586b7+v96ZR3W1B/Cz19Zn3LZ6ev2AgD2m5oafKbxHB0eH+oPdmcddOazxExtaGhD9b52PJRgAJiV6n3RlbdefwC3Tl5lOTXDQHFdoBvSPXp/sL0ZH79vNqrqkvctFQnVPLbsa4/qNtgfB18jMI3/J2pDt2ovd2xgkfZ9p5+4f47lMkt3tMAfVDy7eJdDa01P7EEr9nvINJKNl4c+78A00yQK2sW1Lfhge3Yjru3UbI2DuD+YuoZeXBS/gsZ2DyrGzcC7Wxoj4ygGsoeOcZab2RlO9LLr6g/h/a1N+PWbmzJ4VW65ItCX1LbEnb6lu80u3RE6yq+qa026nKAvvPv6Nad/0THd5cxL9Z0JGO9hrF8sl7cMdNNDHl8A87dl094t4fex3qmN6XW70zjjcVLsp44L9AwvihqL5Xqk4+xN+1GToHaXqKixWZnugDUz81ukG2i+8LWkdGrVJRaBbrShT166C0trQ4OB+rElIo7x02ZShsWmi/81jR2RKRys9ruKY4Zi+JD+n528YALdHwjin6vqozao+gPdqBg3A9+btAJ3T1uLq59YFHlORDB3836Mf2MDZm/ah9mb9kf1VDEYO635R3lnw9645dY3tGHh9mYUienorqmPvh8e6gm/f99jFeNmJLwqP2tjXw8Ec5kOdPaaui32Lb+uvq95Y+u++HB4bXXfhdizfjMbtzy/yrJP+gvL6jD+jY2R08cNDYdw+5QqtIabcZL2vonpTpms5tXa5cXb6+O/30wYsww2tnvw9w92xPWyaWyPDjmjGS5RX3xfIIgH39mC5xbvws9eXou/zAtdL3l3S2PaZUr2mWsaO/DWug+jHnt/ayPufHF1ZP4ZAPjdO1swbWU95m9rigvOnc2dWFzTgmkro9v1v/bU4rTLuKulC4trWuK+H0NtUyeWmr7L+VubsCfcNNIVPkj7EkyFMX39XrR1+1Db1IkVu+LPdo1tw+dXzA5fE0p2MKk/0J30TCTdcRWqitunVMWdgRu7kD+oeG7xrrgJ3QxzNu9HU7sHi2ta8OLyvoFCw4eURv5dtbsV417fENX0Yh4pu7imxXb7e6YK5gYXzy3ZhYdnboW5+fayR+dH/h3746tqZAIi804Q2xfbaL4IhnegpnYPfvLSWssyrNtzCCVFff1PgqqO19DnJgiR26ZU4QcXnwoguuZonhzplsmr4j6f1Yx3HZ74+1ROXVGPrfs7MG1lPeoeuQbXPrUEAPCTaWsw9fbPhPubJy97Ohcf7355LRbVtOBTpxyFU0YOTbm8lVdXN2DCtefg+meWxXVZTOae1zfgOxeeEvf4pEW7MMmimWhxbQuu/PixAIDNe9tw2ZmjMLjE+iYfyWp6P/xHFeoOdOO6T/VNRnrr5KqoZRrbPUmbqi5//APLxw91p39h8YuPLYh7zLxZXvnH0Dq+cd5J+NP1n8Itk1dh6KBi3PfVvlmxY6+fAKHwvXvaWnzujFEJ27WNTWOlKViT7RLGvp1o7IS58pbMB9ub8V51I96rjt6vjPJs/rAN6/ccwro9h/CXG8+LWsYfCOI/XliN08qHxXWyOHb44Ki/X161By+v2hMpr0IjTUv+oOLzjy7IehxIOgqmhn6wK7ThOj0qzKjtGqMwfSnOwYpEops8bFzsNLT1+JLehdxvKktDa08kNKzaKDMhAnT1+rG/re+MxWvaUV9YVhf5975Dfcuk28sl2XeyN3zG0uvPvFnG/L13e/3Y0+pMd7UDSX6DnvCkan9+rwYtnYm3Pavf13jMOOgkq8V39ubmZtAeXwC3TV6VsB+4VYmMs0og1Hxmbs60CnRvIPQd7T2U+PewOtjbbUJPVNu1+n7bLSov5vIY+9j09Xvxx3e3Ry1jPNdg0S2yKMU+qJr7JjsrBRPomX43g0rS+2gSaXIJ/Z0qK72BYGTqXtX42m6iua6tjhMXPvhe3F3Izdvka6Zucy2dvWgM9xpwYjv5zjPL8Jnfz4v8bZ6h8Ddv9c01v9MUBInWG1RFU7unbxKsJOs1Dkb72jyofPBdnPnrWfjhP6owr7oR1z61OO2eD76Apvyt0uVJcnBpMB00rNqGDVbFXlXXii5TUCf7aLEzRGYi2bzjS3e0YN7WJvz2bev7B1j9WBsb2nC5qTZv/t33Hopvtozdh6xYfXN2B719weJMAwBaOr3wB4Jo6/Gl7LlmtWqjqS22fN40umpavf9A9I8qmCaXvhnz0tsIvnXByVHDwQ1efzAq7GPbfTM5qiqALXujB0zsNjUBmMtqtfEaG4r5wliPaZrd+9+O3lEfnbMt4zImsjlmQqNkgbKjuTNpbWr17lZc9PA8XHvuiQBCI2lvn7IKd33hdFxw6tFRyxplv+nZvq53725pxMLtzej1B9Hl9WOEqX0SCNVeywbHb6qhIElcMI8vkPTg9/rqBvz6X5uivvNY5u+6s9eP4xIsZ/X7fueZZVh339jI3/5gEMMGFUfao82yCfRsehUZ5TZ3Ne3xBaIO5ObvoP5gfBNXscV1qFjTLa6b2L0mmmg1Fz70Ho48ohRtPT6MHDYIa34z1jIv1tS34ukF1vc5MM6UygaXRJ0hZ15G7ffOAUAB1dDNFyLTkag999vP9M1lvGLnAexsCY06NO4WlElUqmpc80dpiXnOl52mZRO/j/nCWG0aI04nTN+M+95K3lUqGavPmKwWcsXjH2BvW0/CueaNwVWrwu2jXb0BvFfdFDmjAELf1VV/XphwIFai72dJbQvGTJgTd+EzGExdQz/rN7NxySPvJ3z+t+9sSRrmQPR3lewiaaLym7+zb/x1acIQs1MLdIJRnmwOKMaulqzJxUowjcCcEj4bTpfRPHSwy4sDnb3wW1zE/ebflmJ+ghuWjJkwB2MmzMFrqxuyuhfCvnZPym0rFwom0DPtZpTo1H39nkORmfmun7gcb4UHQayqa8XLK+szHh0YG+glplE//zt7a+TfTk6H+u6WRvxj2W7brzf3ELj3zY14cl5NpFtaIh0ef8qmnuj+29G/QSCoSUfVGtcwjJ3I4wtge2NHpAnr8bnb4taVzplKbLv3XS+ujvSySedsz9xW+sisrfD6g9gW/hzLdhxAxbgZaGr3JOyxETCtY8u+9oS1tt4EXUGzdSD8+dclGBFpfAelxYmjINX3HOnBkuXNYKxMmL454W3uUmnq6E14oEzVtDd38368utr+SOGB6mJfcE0ugTS/qdgLHGa3TLa+Xdu4NzKbc8HqNmOJtv1c/MDbEgTkvOrk3e3MbeRTV6Q/Z/OsTfuTjoozBp0Y7c7mg9j+FBMUGTuYcZp7z2sbMH39XnzujFEAgDX10YFk7uFkxZhALdasTfsxa9N+VBwzLOEFM7PYQVx3vbga87Y2YfEvvxhp6rjo4XnY9MCXLV9//TPp3d2mpsmZ0Ya9/kBUT5z/eW0DAKA1QW+YoIa60X4t3FxmJdXEWnaH8Ld2e/G1pxbj2ZsrccGpobtwPTRjC+Zsjt5+f/zSGow9++qM3//J92tw6en27pI2d0tjwh5ngL25afpjZtKCqaEbSdlfM/vZlag2M3Oj8zPcTVwYfyPiinEzcNuUKoulnfFSkgNAbC3zVdNkZMYUvqkETL0OAPvDu2eZJqCykm7/7dia97zw2d2hbl/UqMlEZ2DpTNo2f2uTYxfQXl5pr1aZbGzAC8uTnw2urU8+KC+R8W9sxKFuH/7t6WV44O3NUFV4fEHLdno70wTM3LgfJx99hK2ypfLVJ9Pv/29IdJtIJxVEoK/fcyhyBXr1bnsbT3/50VTrm9j+LYO5ZdK1PsdzplgxJgqz0hHT9W5xbQtuz/DgYtUtbiAZN1GwYi7rJIuDa7qe/mCHYzv7QLTb2r14aL4w//ySOnh8wYRdcjt67Z0FbMzBLI92DSm1HsPgpIII9Ov+umSgi5CWXE9KFSudC6hO29uW2dzO71U3RvV3T8WpqUYfmpn+pEt2LNjWFHUh8bkldbbfq7RYHAv0g11edHiym8UwU07NJuiJ6V1jZh7xnAmjZ1h/8QeCliPS+0tWbegichWAJwAUA5ikqo84UqoCZYyupGjm/u6pLKppSTrYKl/EdonNZmDQktoDUVM4ZGPiwp2YvLQO2x/MvM3ZrgsrRjryPh5/AAsTDPf/w+z+DWa7Tr93Fj5aPmzA1p/NTaKLAfwVwNUAzgZwo4icnfxVRKnFDrY6HFj1TbfL6w/isTnbbE3cZYdTZ9DGHD2FbofD92LIRDZNLhcBqFXVnarqBfAygOucKVa0V++8OBdvm9Qxwwb1+zqzETuAJxv3f62wjsujygrrt0rXOSeOsP3ap+bX4sKHsj8wlhQJ3vrxJVm/TzoeeDvxiFcnvfGjz/bLemKl6n3mhGwC/SQA5kvqDeHHoojIHSJSJSJVzc325nG+sGIk6h65BvN/8QX8/pufwEfLh2H5+Cvw32PPjHRrA4AnbvgULj19VJJ3inb5WcdG/f2dypPx0fJhOPuEEVj0yy/i1TsvRs1DV6O4SHDkEaX40/Xnxr3Hez//PE46yvpK+pFHRI94jL3g85VPHI8zji2zfO3Emy6wfNz8eb95fujrvvWS0Xj9rs/i52PPxF+/ez6+ed5JOOHIIVFdKM8+YUSk/Nd88gTLMo8cNgg7H/4K/v2S0ZHHHvrGGAwbVIzzP3IUAKA8PCnRoOIivPPTS/HAtefEvc/Oh7+CB78+Jm6o/Iy7L0Wp6YbGC//ni7jt0tFRy5x45BDLz21l/NVnAQCuN0249e0LTsYvvnRm5O+ywSVY8Isv4O7LT0/rPf9y43m4Ima7OC18Cr3oni8mfe2Q0r7d6eMnjIj7LLHvu/H+L+Hv3z8/8vc1nzwh6vl3fnopfnvdOZhy60X4SBoTmaUzx88bP/ps3MH/h58bjW9dcHLUY7deMhoXjR6Ji0aPxLmnHIVzThyBJ288D+vuG4ufjz0T6SotFrx0+6fjHq84Ziie//cL8b1PfwTLxl+e9vv949aLcMdlp1k+Vza4BP/68SUJf+vxV5+FlfdegeNGDME3zjsp8poHvz4GV485HlePOT6y7Kp7r8TW312FU48Jfe+jygbj1Tsvjtr/AGDBL76AiTddgKOG9u3r13zyBHz30x+JWu6s44fj3FOOSvtz2iV2J5kXkW8D+LKq3h7++yYAF6nqTxO9prKyUquqnO1Sp6ro6PVDNRSg/kAQ7Z7QUPEebwClJYLOXj+OOmIQenwBFBcJvP4giiS0vIhAVdHZ64+aEtPMGELu9Qexq6ULvkAQ5WVD0OsP4IzjhmN/mwfV+9rx6dNGorjLo/y2AAADHElEQVRI4A+EZiYsLhKoAjWNnRhZNihh8Bs6PD54/UGUDSlBaVERtjd1oFgEO5q7cNbxwzFq+GCUDS5BV68f/oBixBEloQE2CXbk+gPdKC4WDCouwogjSjC4pBgdHh+GDymF1x8Mf+YSy0ElPd4ASool6rnGdg/KywannJjIzJjLZJhp6L4vEIQvEMTQQSWRZQKqaGzz4JSRQyO9Abz+IPa0duO0UaE+40NKi9DhCU0qVjFqGMoGl6Cz14+hpcVRZfIFQoN/Tj+2LKpnQU1jB44eNigy4dhp5cPQ2evHsMElGFxSFPmsgaCiw+NDcZGgbHAJAkGF11Re83o8vgCKRKI+n5nHF4A/qPiwtQcnHX1E5P2M4elmgaBi8942nH5sGYqLQr+bud9yc0cvmjo8GFxShONGDEHZ4BKICPyBIA52eXHsiCGR73Nt/SEcPawU55x4JHq8oe231xfEkUNL4QsE0eMLQIOAFCEy1YLxWdKdBykQVOw+0IWjhg7CyGGDoBq605OxnfsCiiGloc/Q6w/AF1D0+gIoLSnC0NJilFhsd209PgwdVIwiEXh8ARzs8mL4kBLsa/PgzOOGRw5aO5o7MXxwCQaVFKHLG0B3rx+nlZdFnu/2+vFedRPGnDgCx5QNjqtcGZ9XBFH99ncf6EJpcRFODH8GfyCIXn8w7vc19iODVYa0e3xo6/ZBBDj5aHszixpEZLWqVqZcLotAvxjA/ar65fDf4wFAVX+f6DW5CHQiIrdLN9CzaXJZBeAMERktIoMA3ABgehbvR0REWbDdbVFV/SLyEwBzEOq2+JyqJpijk4iIci2rfuiqOhPATIfKQkREWSiIkaJERJQaA52IyCUY6ERELsFAJyJyCdv90G2tTKQZgN1b7YwCkN+ToUdjeXOrkMpbSGUFWN5cs1PeU1U15d06+jXQsyEiVel0rM8XLG9uFVJ5C6msAMuba7ksL5tciIhcgoFOROQShRToEwe6ABlieXOrkMpbSGUFWN5cy1l5C6YNnYiIkiukGjoRESXBQCcicgkGOhGRSzDQiYhcgoFOROQS/w/aHicxD8swZAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# That's probably not right. Let's assume that is spam.\n",
    "df = df[(df['wordRate'] <= 20) | (df['wordRate'].isnull())]\n",
    "\n",
    "df['wordRate'].plot()\n",
    "df['wordRate'].describe()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>comment</th>\n",
       "      <th>contract</th>\n",
       "      <th>flatRate</th>\n",
       "      <th>levelOfReporting</th>\n",
       "      <th>daysToBePaid</th>\n",
       "      <th>paymentDifficulty</th>\n",
       "      <th>platform</th>\n",
       "      <th>publication</th>\n",
       "      <th>relationship</th>\n",
       "      <th>rights</th>\n",
       "      <th>storyType</th>\n",
       "      <th>wordCount</th>\n",
       "      <th>year</th>\n",
       "      <th>totalPaid</th>\n",
       "      <th>wordRate</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>128</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>42</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Print</td>\n",
       "      <td>Science Magazine</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>9000.0</td>\n",
       "      <td>6.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2603</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>15</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Curve Magazine</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>First</td>\n",
       "      <td>Profile</td>\n",
       "      <td>800.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>12000.0</td>\n",
       "      <td>15.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     comment contract flatRate levelOfReporting daysToBePaid  \\\n",
       "128      NaN      NaN    False              NaN           42   \n",
       "2603     NaN      Yes    False           Medium           15   \n",
       "\n",
       "      paymentDifficulty platform       publication relationship  \\\n",
       "128                 1.0    Print  Science Magazine          NaN   \n",
       "2603                1.0  Digital    Curve Magazine      Ongoing   \n",
       "\n",
       "             rights storyType  wordCount  year  totalPaid  wordRate  \n",
       "128   Unknown/Other       NaN     1500.0  2017     9000.0       6.0  \n",
       "2603          First   Profile      800.0  2017    12000.0      15.0  "
      ]
     },
     "execution_count": 31,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Just check that last jump\n",
    "df[df['wordRate'] > 5]\n",
    "# Yeah that looks alright"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### wordCount"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.axes._subplots.AxesSubplot at 0x1176f1438>"
      ]
     },
     "execution_count": 32,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAY0AAADuCAYAAADFsFuRAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMi4zLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvIxREBQAAIABJREFUeJzt3Xt8VOWdx/HPLwkXERGEqBRQqKKItFalqNWuVqxg1y1uq1va3UqVLtVV63bbbXH7arFeulqttrZeyhYEXBURdUFBEJFLEQTC/Q4hBAi3JCSEXMj92T/mzDCZTJKTTCaXyff9euWVmWeec+aZZOZ857mcGXPOISIi4kdSazdARETaD4WGiIj4ptAQERHfFBoiIuKbQkNERHxTaIiIiG8KDRER8U2hISIivik0RETEt5TWbkBz69Onjxs4cGBrN0NEpF1Zt25drnMutaF6CRcaAwcOJC0trbWbISLSrpjZfj/1NDwlIiK+KTRERMQ3hYaIiPim0BAREd8UGiIi4luDoWFmU80s28y2hpU9Y2Y7zWyzmb1nZj3DbnvEzNLNbJeZjQorH+2VpZvZxLDyQWa22sz2mNlbZtbZK+/iXU/3bh/YXA9aRESaxk9PYxowOqJsETDMOfdFYDfwCICZDQXGApd727xkZslmlgy8CNwGDAW+69UFeBp43jk3GMgHxnvl44F859zFwPNePRERaUUNhoZzbjmQF1H2kXOu0rv6GdDfuzwGmOmcK3PO7QPSgRHeT7pzLsM5Vw7MBMaYmQE3A7O97acDd4Tta7p3eTYw0qsv0u445xg4cR5/Wba3tZsiEpPmmNO4F/jQu9wPOBh2W5ZXVld5b+BEWAAFy2vsy7u9wKtfi5lNMLM0M0vLycmJ+QGJNLdqF/j99IKdrdsQkRjFFBpm9kugEng9WBSlmmtCeX37ql3o3GTn3HDn3PDU1AbPghcRkSZq8seImNk44HZgpHMueDDPAgaEVesPHPYuRyvPBXqaWYrXmwivH9xXlpmlAGcTMUwmIiItq0k9DTMbDfwC+KZzriTsprnAWG/l0yBgMLAGWAsM9lZKdSYwWT7XC5slwJ3e9uOAOWH7GuddvhP4JCycRESkFTTY0zCzN4GbgD5mlgVMIrBaqguwyJub/sw5d59zbpuZzQK2Exi2esA5V+Xt50FgIZAMTHXObfPu4hfATDN7AtgATPHKpwCvmVk6gR7G2GZ4vCKtSu96pL1rMDScc9+NUjwlSlmw/pPAk1HK5wPzo5RnEFhdFVleCtzVUPtE2gMt+5NEoTPCRUTEN4WGSAvQsJQkCoWGiIj4ptAQERHfFBoiIuKbQkNERHxTaIiIiG8KDZEWpM80kPZOoSEiIr4pNERagD42TRKFQkOkBelrxKS9U2iItCB1OKS9U2iIiIhvCg0REfFNoSEiIr4pNERExDeFhkgL0Py3JAqFhoiI+KbQEBER3xQaIiLim0JDRER8U2iIiIhvCg0REfFNoSEiIr41GBpmNtXMss1sa1jZOWa2yMz2eL97eeVmZi+YWbqZbTazq8K2GefV32Nm48LKrzazLd42L5gFPge0rvsQaY/0QYWSKPz0NKYBoyPKJgKLnXODgcXedYDbgMHezwTgZQgEADAJuAYYAUwKC4GXvbrB7UY3cB8iItJKGgwN59xyIC+ieAww3bs8HbgjrHyGC/gM6GlmfYFRwCLnXJ5zLh9YBIz2buvhnFvlAt9SMyNiX9HuQ0TqMXfTYQZOnMexk6Wt3RRJQE2d0zjPOXcEwPt9rlfeDzgYVi/LK6uvPCtKeX33UYuZTTCzNDNLy8nJaeJDEkkMs9YGXmq7jxW2ckskETX3RHi07yVzTShvFOfcZOfccOfc8NTU1MZuLiIiPjU1NI55Q0t4v7O98ixgQFi9/sDhBsr7Rymv7z5ERKSVNDU05gLBFVDjgDlh5Xd7q6iuBQq8oaWFwK1m1subAL8VWOjdVmhm13qrpu6O2Fe0+xARkVaS0lAFM3sTuAnoY2ZZBFZBPQXMMrPxwAHgLq/6fOAbQDpQAtwD4JzLM7PHgbVevcecc8HJ9fsJrNA6A/jQ+6Ge+xARkVbSYGg4575bx00jo9R1wAN17GcqMDVKeRowLEr58Wj3IdIeOX2jhiQInREukmAUUBJPCg0REfFNoSGSYCzqSnaR5qHQEBER3xQaIiLim0JDRER8U2iIiIhvCg2RFtCS36ehJbcSTwoNERHxTaEhkmC05FbiSaEhIiK+KTRERMQ3hYaIiPim0BAREd8UGiIi4ptCQ0REfFNoiIiIbwoNERHxTaEhIiK+KTRERMQ3hYaIiPim0BAREd8UGiItQB+NLokiptAws5+Y2TYz22pmb5pZVzMbZGarzWyPmb1lZp29ul286+ne7QPD9vOIV77LzEaFlY/2ytLNbGIsbRURkdg1OTTMrB/wY2C4c24YkAyMBZ4GnnfODQbygfHeJuOBfOfcxcDzXj3MbKi33eXAaOAlM0s2s2TgReA2YCjwXa+uiNRDH40u8RTr8FQKcIaZpQDdgCPAzcBs7/bpwB3e5THedbzbR5qZeeUznXNlzrl9QDowwvtJd85lOOfKgZleXRERaSVNDg3n3CHgWeAAgbAoANYBJ5xzlV61LKCfd7kfcNDbttKr3zu8PGKbuspFRKSVxDI81YvAO/9BwOeAMwkMJUUKzspF6zO7JpRHa8sEM0szs7ScnJyGmi4iIk0Uy/DULcA+51yOc64CeBf4CtDTG64C6A8c9i5nAQMAvNvPBvLCyyO2qau8FufcZOfccOfc8NTU1BgekoiI1CeW0DgAXGtm3by5iZHAdmAJcKdXZxwwx7s817uOd/snzjnnlY/1VlcNAgYDa4C1wGBvNVZnApPlc2Nor0iHoCW3Ek8pDVeJzjm32sxmA+uBSmADMBmYB8w0sye8sineJlOA18wsnUAPY6y3n21mNotA4FQCDzjnqgDM7EFgIYGVWVOdc9ua2l6R1qQDuSSKJocGgHNuEjApojiDwMqnyLqlwF117OdJ4Mko5fOB+bG0UaSj0ZJbiSedES4iIr4pNERExDeFhoiI+KbQEBER3xQaIglGK7UknhQaIiLim0JDpAW05PdpaMmtxJNCQ0REfFNoiIiIbwoNERHxTaEhIiK+KTREEoyW3Eo8KTREEpRWUUk8KDREWkBrvPdXj0PiQaEhkmDUw5B4UmiIiIhvCg0REfFNoSEiIr4pNEQSjCbAJZ4UGiIJShPiEg8KDZEEpR6HxINCQ6QFuBb8bHT1MCSeFBoiIuKbQkNERHyLKTTMrKeZzTaznWa2w8yuM7NzzGyRme3xfvfy6pqZvWBm6Wa22cyuCtvPOK/+HjMbF1Z+tZlt8bZ5wczU7xYRaUWx9jT+CCxwzg0BrgB2ABOBxc65wcBi7zrAbcBg72cC8DKAmZ0DTAKuAUYAk4JB49WZELbd6BjbK5LwNAEu8dTk0DCzHsDfAVMAnHPlzrkTwBhguldtOnCHd3kMMMMFfAb0NLO+wChgkXMuzzmXDywCRnu39XDOrXKBWcQZYfsSkQZoQlziIZaexueBHOBVM9tgZn81szOB85xzRwC83+d69fsBB8O2z/LK6ivPilIuIj6oxyHxEEtopABXAS87564Eijk9FBVNtLc9rgnltXdsNsHM0swsLScnp/5Wi4hIk8USGllAlnNutXd9NoEQOeYNLeH9zg6rPyBs+/7A4QbK+0cpr8U5N9k5N9w5Nzw1NTWGhyQSHy35nl/DUhJPTQ4N59xR4KCZXeoVjQS2A3OB4AqoccAc7/Jc4G5vFdW1QIE3fLUQuNXMenkT4LcCC73bCs3sWm/V1N1h+xIRkVaQEuP2DwGvm1lnIAO4h0AQzTKz8cAB4C6v7nzgG0A6UOLVxTmXZ2aPA2u9eo855/K8y/cD04AzgA+9HxERaSUxhYZzbiMwPMpNI6PUdcADdexnKjA1SnkaMCyWNop0NJoAl3jSGeEiCUpzGxIPCg0REfFNoSGSoDRMJfGg0BBJMBqWknhSaIi0gBb8Og2RuFJoiIiIbwoNkQSjuQyJJ4WGSILS3IbEg0JDRER8U2iIJCgNU0k8KDREEkxrDEtlF5by+AfbqapWUCU6hYZIS0jwY+l/vbuFKSv28bc9+j6bRKfQEJGYVVQFUlHnoyQ+hYZIgmmNuQzTQq0OQ6EhkqC05FbiQaEhIiK+KTREpNlomW/iU2iIJCgdwCUeFBoiCUZzGRJPCg2RFpDo7/oVUx2HQkNEmo3O00h8Cg2RBNM652mor9FRKDREEpTmNiQeFBoi0mw0PJX4Yg4NM0s2sw1m9oF3fZCZrTazPWb2lpl19sq7eNfTvdsHhu3jEa98l5mNCisf7ZWlm9nEWNsq0pEk+uS7tI7m6Gk8DOwIu/408LxzbjCQD4z3yscD+c65i4HnvXqY2VBgLHA5MBp4yQuiZOBF4DZgKPBdr66I1EPDUhJPMYWGmfUH/h74q3fdgJuB2V6V6cAd3uUx3nW820d69ccAM51zZc65fUA6MML7SXfOZTjnyoGZXl0RaWMUUx1HrD2NPwA/B6q9672BE865Su96FtDPu9wPOAjg3V7g1Q+VR2xTV7lIu9NRxvo7yMPs0JocGmZ2O5DtnFsXXhylqmvgtsaWR2vLBDNLM7O0nBx9CYx0bJrLkHiKpadxPfBNM8skMHR0M4GeR08zS/Hq9AcOe5ezgAEA3u1nA3nh5RHb1FVei3NusnNuuHNueGpqagwPSSRxaG5D4qHJoeGce8Q51985N5DARPYnzrl/BpYAd3rVxgFzvMtzvet4t3/inHNe+VhvddUgYDCwBlgLDPZWY3X27mNuU9srIvETPLfPdZRxuA4speEqjfYLYKaZPQFsAKZ45VOA18wsnUAPYyyAc26bmc0CtgOVwAPOuSoAM3sQWAgkA1Odc9vi0F6RhKRhKomHZgkN59xSYKl3OYPAyqfIOqXAXXVs/yTwZJTy+cD85mijSEehYSmJJ50RLiLNQEHVUSg0RFpARxko6iiPsyNTaIgkGM1lSDwpNEQSlOY2JB4UGiISM32dRseh0BAREd8UGiIJqjXmNnRuX+JTaIgkmNaYy9DoVMeh0BCRZqSuRqJTaIi0gJb8TCYtuZV4UmiIhHHO8dSHO9mcdaK1mxKzWIepMnOL+eV7W6iqVgjJaQoNkTDVDl5ZtpcxL37a2k1pdQ++uZ7XVx9g2+GCButqyW3HodAQERHfFBoiCSrWuQ2dUS7RKDREEkxzH+wbM4ev8zQSn0JDJIy+ee60xsxTqFfScSg0RBJMcy+5VYxKOIWGSJh4HSBb48Ab67v/pmytgEl8Cg0RqZefITstue04FBoiYTSlEUZJIFEoNEQSVHPNbShHJZxCQyRMInxuU3OtZGrSnEb7//NJAxQaIlIvBYGEU2iIJJjm6i1pSkOiaXJomNkAM1tiZjvMbJuZPeyVn2Nmi8xsj/e7l1duZvaCmaWb2WYzuypsX+O8+nvMbFxY+dVmtsXb5gUzPY0lvhLpXXXznXDnf/VUIgzvSf1i6WlUAj91zl0GXAs8YGZDgYnAYufcYGCxdx3gNmCw9zMBeBkCIQNMAq4BRgCTgkHj1ZkQtt3oGNor0mraYxg1JnJ0RnjH0eTQcM4dcc6t9y4XAjuAfsAYYLpXbTpwh3d5DDDDBXwG9DSzvsAoYJFzLs85lw8sAkZ7t/Vwzq1ygYXiM8L2JUJJeSWHT5xq7WaIdCjNMqdhZgOBK4HVwHnOuSMQCBbgXK9aP+Bg2GZZXll95VlRyqPd/wQzSzOztJycnFgfjrQT3/nLZ3zlqU9auxkJrz32kiR+Yg4NM+sOvAP8u3PuZH1Vo5S5JpTXLnRusnNuuHNueGpqakNNlgSx5VDDXw7UWIl0gIz5o9GbMIWYSH8/iS6m0DCzTgQC43Xn3Lte8TFvaAnvd7ZXngUMCNu8P3C4gfL+UcpF4q49H/ya/aPRm3Vv0t7FsnrKgCnADufcc2E3zQWCK6DGAXPCyu/2VlFdCxR4w1cLgVvNrJc3AX4rsNC7rdDMrvXu6+6wfYnERSKs/mm2JbfNshdJNCkxbHs98H1gi5lt9Mr+C3gKmGVm44EDwF3ebfOBbwDpQAlwD4BzLs/MHgfWevUec87leZfvB6YBZwAfej8i4kNz9Th89bqUMB1Gk0PDObeCup8qI6PUd8ADdexrKjA1SnkaMKypbRRprHgNS7XHHkxTzopqf49SGktnhItIvXx9NHoLtEPaBoWGiESlE/YkGoWGSJhEGl5pjY9Gj/U71t9dn8XAifPILy6PaT8SPwoNkQTTbD2EVuhoTF+1H4DM48Utf+fii0JDJEys75TbguaedE+AP4k0I4WGSIKKtcfRqA8s1AdQdxgKDWn3mrN3oDfVtbXH5cISPwoNaffaxfBJe2hjBHUeYjdw4jx+9vam1m5Gs1JoSLtX3Zw9jbid3NeOtevGt77Z67IartSOKDSk3WsPx7R20RuKgTolHYdCQ9q9Zj0gx+ng3py9Ib9imYvIPlnKZxl5DVeUDkehIe1eaxyQG6vtt7CmycszQpcbd3Jf87dF2haFhkgLaI3zP1ryY0A0ad5xKDQ6qPc3HeZESdM+qqGwtII5Gw/VKn9vQxbFZZWxNg2ABVuPkFNY5qtuU3oaC7cdJbuwtFZ5tCGdxTuONem7yFfuzSU9uzCw37DdvrX2AFXVjnfWZXGqvKrR+w06drKUj7YdbfL29Qn/K6j3IOEUGh1QVn4JD725gYfe3NCk7X8+ezMPz9zIzqOnv913/YF8fvLWJn41Z2vM7Sspr+S+/13P96es9lW/sQe1iqpqfvTaOr47+TNf9cdPT+Obf17RuDsBvvc/q7nlueVAzTb+4p0t/PjNDfz07U089sG2evdRXFZJWWX0YLnrlVVMeG1dQpzFnujyi8sT5v+k0OiAyiurATiU3/h3zwD7cgOfCxT+LjnYw8g+6a93UJ/ga2v/8RJ/9Ru5/2DP5GBe7cdf1+s6tyi2D9CL7MEcyAs8tob+XpdPWsiYP38a9bbgPqqq43swasyEuk4EjO7Kxxfx0tK9rd2MZqHQiEHBqQoGTpzHHz/eU2edqx9fxH2vreNUeRUFpypasHV1C37kQ7RhndyiMibN2RoKlmh2Hi2MW9vgdLuqItpXWVXNUx/u5HhRWdT6frXGG77I+4xs84mSckorovco6vp7J3nzCJVxDg0/WntKY//xYrYeKmjlVsCP39zAsEkLo962MGIosaKqmrx2+Gm+Co0YXPGbjwB4/uPdddY5XlzOgm1H+frzy0L1W1vwYBPtWPPEB9uZvmp/rSd4Q4KTrs3xTrPay6vI7vyCbUd5ZdleHn1/e43yxoZAfSETfstPZ21qtiGFyPsM/u2DE8hfemwR//xXf8NxQUnexln5p9hzrHawNNtHo7d+JjXojx/v4f7X17V2M5i76TBFdczrRT4H/mPWJq56fFG7G7ZSaISprnZMWbGPkvJKth4q4F9npNUaT35l2V6e+2gX7zTyLM+sKENBzjmmfbovbj2QR+duY8nO7ND1uZsOk5FTxKufZgKBJ3FmbjHvbzocqhM8mDV2yCN48GvM8//ttIMcLSilpLySKSv2Ue3dZ6inEdGGn84KfBzDgePFLNp+LFS+Yk8uj87dVufYf6TQbi3wDr+uF/k767PqfDzp2UU8OncbczYeYsWe3Bq3ZReWMnPNgRplkbuprKrdk1u3P99P80OCoXHLc8v4+vPLQ+X1rZqqrnbcPXUNP59d86Mt3l2fRVb+6eHA7YdPRm7a5ny8/RiPfxB4A2FmoTcbDamoquavf8uotzfdHCLDIHg1p7CMN9ccCL3uGvOaycwt5rfzd9R4Xbe0Jn9HeCL6eEfgSbj/eDEzvM/1v++1dbx6zwggMIb/1Ic7m+3+1mbm8+j720nbn8+fv3dVs+0XAgeHaSsz6dmtE18bci4Q6DqHcw5G/WE5ZZXV/MMVnwPCeyHRn8kfbD4dMLG8Pyo4VcF/zt7MJed15ysX9WHaykz69ezK6GF9Q8NSkblV5r3Ii8oq+dcZaaHyzVknmLYyk4m3DfF138HHVl5ZzZceW0TPbp3Y+OtbA4+pVo+g5vWDeSW8vGwvX7v0XKatzGTaykB55lN/H6ozYcY6Nh48UWO7yD9naVjAVTd1eKmObKivh2EGy3fnAPC7O68AAgH2H7M20ffsrqx6ZCQAqzKOh+3Pv3i+aT5VXsWv52zlkW9cRq9unfih9xz41e1DSU6qvweZlV9C37PPIDnJeGP1AZ6Yt4Pyqmr+7aaL49beyH9rsHkPvLGeNftOnzhZ5RxJPgf4bv/TCorKKpm8PKPGc64lqacRpqIq8F8Nn5xcsisndDlyjD1WwXebx2OcZI0m2NZkM4rKKnn103216jjnQgfioKTQfEf0/T74xung+dZLK8nMbdqX5QQPzsdOlnGyNNDTKiwNvOOPdhANX8obeWu593dM8nmygIt4g3mipO6eXuR9/eztTbyx+gAr9uRErQ9EXSocGUanFxFYqP1+pWXmkV1YGgr4oC8+urDGGHlkj+NgXgmDHplfa3/BM7+PFNReglyf1RnHufnZpRSVVfJ/Gw/Xur28spqs/BJyi8q4/NcL2BQRpJFtu+xXC8jILgqVrdyby5thPbbZ6w7y9rosnlu0i2Nhr9GBE+cBdYfGkYJT3PD0Ep5ZuAuA4vLAc6mgpIL9x4ubFNo/nbWJie9srrdO5P98+5GT7DpaSG7E86Mxvfq6esUtSaER5qyugY7Xgojx/P3Hi9l9rJAXl6TXu/3AifP4p7+sAgIfw1BYWvtglJlbTMGpCpbtzgkNWUV70pSUV4bODcjIKcI5R0ZOUa16kcoqq1i6Kzu0bVKSsTe7iN9EzANAzWD4ND2X2/74N97dEDj/Yvexwhrj5FXVLrRqKtyj729jwdajoYPVyr2Bd6hZ+SVsOniCgRPn8afFe2o8jnCFpRWUlAUOoIt3ZFNaUUV62OPMPllKZm4xfw7725dV1DzIBofbcorKqKyq5mdvb2Lc1DWBx1jteH31frZknZ4kzToRfVXWb97fxtVPfBzxN6rZ3mAuFZXVHApbsSeXEu9gdCjinI5DJ06xbHfNkCkNewzhE9nPLdodej6Ef+XpwbwSyiqrcM5x5yur+Ic/ragVCidLK1m193ho1dm/hC1ZPlVexZQVNd847D9eTHZhaY160Q6g46auCQ0DhXt45kYycot5ct6OWrcB3DttLTc8vYQPtxyhuLyKn7y1kYKSCrJPllJaUcWhE6fILixl6a5s3k47yKmKKgq9g+I/vrSS7/3P6tCBHk6/TpLMOFxQ829cVlnNsZNlbD1UEBp2yi8u53hRWShgVu4NDCMG3xT+ZXkGNz6zlJeWprO3jtfW8aIy1u3P51R5FenZRfxtTw57c4p4Z30WM9ceDL0ug/cVLloUjPrDcjIiXkfOBf6/4cNlecXloddUQUkFB46XsGDrkRrblZRXkp5dyOETp1i6KzvqkGc8aHgqTF1vVG98ZqnvfQS7nSN+u5iunWpn8k3PLuWmS1NZGtaDqYgyGHvvtLV8lpHHWxOu5TuTP+O6z/dmVcZxXr3ny3zt0nPrvP/84gp+8Opafn37UACSk4wxL0Zfsnn05Ol3lpGTsJOXZzB5eQb7/vsbFJZV8sVHo0/iL92VU+OxACzZlc09r64NXf/9ot1k5Z/irbSDPHLbEH5040WhwKp2p0N6wbajHCko5Xv/c7otI367uNZ9Rh6Ug65/6hO2PzYq9KmiLy5JxznHsx8FFirMvu86HvtgO5uzaq+yWbIrOxQ+4SLfvKYkBf6nkScxBg+8mybdWmsfn+zM5omIA2v4SqmKsIPFC4v3MOT8s7iwdzf+/oXT54Z89XdLGH35+Xz1kj4ANd5ph3vgjfU1rg+cOI9Pfnojj7y7hdX7an6WVLTn9Z8+Sef+my6qVT5lxT5uvCSVu6euYeJtQxjat0fo+RPeG6isclRXO5KSjBXpgYP0r+YEzkXJyC3miscCz6PhF/byhmWv5ME3NvDtq/pHfTx5xeU8OncbP7nlktBzJsmMb720ska9j705rtv/tIK7ru7PM3ddwZWPLwLgnfuvAwKvBYBpKzNrbPvsR7t59qPdjLr8PBZuO8aaX47kVHkVH207xpPzA/+3Kwb0jNpTemPNAX75Xu1zk+ZvOcLNQ+p+nYZ7c80BHvtgO9+6qh/P/dOXALjKa/sHD93A7X+Kfo7QD6auZU3m6f/pjZekMv3eEb7uMxYKjTCxTIyt23/6nxd8N11aEX1/kROn0XoawSGD73gnoAXHmHceKeR3C3bxH1+/hFMVVTzyzmbW//rrzNl4mIG9z2TDgcBkaqeUwMEtOcbPd/iv97bWOCj4ER4YQW+lHQQgbX8+Z60+wMA+3aJu+96G2meaN0Z49z38XSrAna+sqnO7aG0GeCziHXaSd+CJ7I0GzYg4IAE1FhoEBXsX2w8XUBKx1LakvKpGYAQt2HaUT3Y1fgL05t8v8113VtpB1h2IPiF/t9d7q29e7+fvbGZtZh7P3HVFvfeT5k36v+bNHa5Ir3u4b9rKTG64uE+o1xd50AcoDjtn6O11WcwJGy779suB//uGAydYmZ5ba9ughdsCwfPqp5kcOF7CvC2n39nXNbT2WJQePMC/vb6esV8eUOd91diH9xx7d/0hvjSgJ79bcPp5W1dgADUCA2DZ7hxKyivp1jm+h3Vr68u9zGw08EcgGfirc+6p+uoPHz7cpaWl1VelTr/6v6289tn+Jm3bXGb96DqG9evB0F9HX+vt123DzufDrfH5iAkRaZs+eOgGhvU7u0nbmtk659zwhuq16Z6GmSUDLwJfB7KAtWY21zkXPd5jMGNVZqsHBhCaE4mVAkOk42mJifK2PhE+Akh3zmU458qBmcCYeNzRJ6247lmkvZoyrsE3ptJEkavj/GjqRwM1RpvuaQD9gINh17OAayIrmdkEYALABRdc0KQ7+tmtl3Jxandyisq45/pB9OiaQq9unXll+V5wsHhnNr3P7MyFvbtxy2Xn0evMzvQ8oxPnnd2VlenHue9/A2ejhk9yP/3tLzDmS/2tpCzBAAAFKUlEQVT4255c/nVGGkt/dhNdOiVxtKCUg/mn+OrFfZiz8RBXDOjJf8/fyfR7R9C1UxK5ReVc89uPa6xueuOH19C9awq9u3fBOcfYyZ/xlYt6c/WFvbjjyn5sPXSSXt06kWTGpqwTPDxzI1PGDadb5xQ6JVtoPH/AOWdwUWp3lu7KoXuXFJ64Yxi5RWUM/VwPenTtxP7jJcxce4CyimpSko3xNwwi9awufLF/TwpKKsjILeKsrp04XlTGh1uPcuvl5/Hy0r2kJBlLduVw9YW9uOHiPvz7LYNZm5nP/C1H+P51F1JYWskd3oT8vB/fwItL0pm/5ShjvzyALw88h493HCMlOYn07CI+fPir5BeX8+6GQ/Tp3pmbh5zLB5uP0Ck5iUvO686yXTnce8MguqQk8d8f7mTEoHP4y7K9rD9wgu9dcwEjh5zL+OlpDOvXg/cfvIHi8iqeXbiL3ccKueqCXtx82bmUVVSTnlNEWmYe3buk8PGOY6HJ5V+MHsItl51L1olTfOWi3qzdlx+a6H7gaxfx4pK93HRpKuec2ZmRQ86jb8+u/PK9rdxy2bmhVXEvjL2SnKJSNh0s4MLe3XAOLuvbgwt6dyO1exfKKqt4ZuEuNmcVhM7p+OChG8grLicl2Xh56V5uvfx88ovLeW7RbsZddyHfv+5C/vDxHtKzi9h5tJC377sOA66+sBcZucVsPHCCPmd14f7/XUdJeRWdU5KY++D1/Hb+Tn4+6lJSz+rC84t2M3PtQS7r24O+Z3flk53Z3Hv9IL51VT+mfrqPVXuP870RF9ApJYmnF+wktXsXssOWiD797S/w9IJdDDn/LB6/YxgXpXZn+2OjWJuZz8lTFTz05gamjBvOjZek8vBbG3l8zDAM+PHMDfTreQa//ccvYBaYyP/Bq2vYebSQkUPO5dFvXs746WvZfez0KqZJ/zCU/9twiFHDzmfap5k12vGjGz/Pt67sz/k9uvLDGWv5Yv+e3HRpKnuOFbEp60RoTmNYvx5Mu2dE6GTcLw86hy4pSTz30W4u69sjtCrvnusHhhZCdOucTEl5Fd8ZPoAn/nEYa/bl8c9/Xc1/jrqUCX/3eSqrHE8v2MmWQ4H/7bvrA/Nw37/2wtBoxRmdkvnB9QMZ1PtM3t2QxSv/cjXTVmZy9YW9yCkso0/3LpRWVNH37DNYvieH5btzWL0vj9/fdQUZuUUM+9zZ3PaFvpwqr2Lk75eSkpzE/Ie/Svcupw/Z723Iome3zhwrKGXiu1sAuPKCno0+9jVWm57TMLO7gFHOuR96178PjHDOPVTXNrHMacQquGqkLaqsqsYBnZLbbufSORf6XKy2priskq6dkkMrcKTtKyip4OxuneqtU1JeSefkJFLCXhfOOZyjzb6W4yUh5jQI9CzClyD0B2ovRWkj2vKTLKUNh0VQWw0MgDO7tPWXikRqKDCAqCuNzExfKlWPtn4kWQsMNrNBZtYZGAvMbeU2iYh0WG367ZNzrtLMHgQWElhyO9U5V/+31oiISNy06dAAcM7NB2p/YI6IiLS4tj48JSIibYhCQ0REfFNoiIiIbwoNERHxrU2f3NcUZpYDNPVDpPoAdX8MZtuj9sZXe2pve2orqL3x1pT2XuicS22oUsKFRizMLM3PGZFthdobX+2pve2praD2xls826vhKRER8U2hISIivik0aprc2g1oJLU3vtpTe9tTW0Htjbe4tVdzGiIi4pt6GiIi4ptCQ0REfFNoiIiIbwoNERHxTaEhIiK+/T9GbY5iWfW/NgAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "df['wordCount'].plot()\n",
    "# Hm that's a lot of words."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>comment</th>\n",
       "      <th>contract</th>\n",
       "      <th>flatRate</th>\n",
       "      <th>levelOfReporting</th>\n",
       "      <th>daysToBePaid</th>\n",
       "      <th>paymentDifficulty</th>\n",
       "      <th>platform</th>\n",
       "      <th>publication</th>\n",
       "      <th>relationship</th>\n",
       "      <th>rights</th>\n",
       "      <th>storyType</th>\n",
       "      <th>wordCount</th>\n",
       "      <th>year</th>\n",
       "      <th>totalPaid</th>\n",
       "      <th>wordRate</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1245</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Atlanta Blackstar</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>NaN</td>\n",
       "      <td>20000.0</td>\n",
       "      <td>2018</td>\n",
       "      <td>400.0</td>\n",
       "      <td>0.02</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1491</th>\n",
       "      <td>\"Pays two months after publication.\"</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Heavy</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Print</td>\n",
       "      <td>The Believer</td>\n",
       "      <td>Solicited Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>Profile</td>\n",
       "      <td>30000.0</td>\n",
       "      <td>2013</td>\n",
       "      <td>300.0</td>\n",
       "      <td>0.01</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1742</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Light</td>\n",
       "      <td>Not Yet</td>\n",
       "      <td>5.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Kpopstarz</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>All</td>\n",
       "      <td>NaN</td>\n",
       "      <td>120000.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>2400.0</td>\n",
       "      <td>0.02</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2046</th>\n",
       "      <td>\"The commission was for a guidebook published ...</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Light</td>\n",
       "      <td>Not Yet</td>\n",
       "      <td>5.0</td>\n",
       "      <td>Print</td>\n",
       "      <td>Highend Media / Gatehouse Publishing</td>\n",
       "      <td>NaN</td>\n",
       "      <td>All</td>\n",
       "      <td>NaN</td>\n",
       "      <td>100000.0</td>\n",
       "      <td>2018</td>\n",
       "      <td>4000.0</td>\n",
       "      <td>0.04</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2251</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Light</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Digital</td>\n",
       "      <td>The American Reader</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>First</td>\n",
       "      <td>fiction</td>\n",
       "      <td>30000.0</td>\n",
       "      <td>2014</td>\n",
       "      <td>900.0</td>\n",
       "      <td>0.03</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2377</th>\n",
       "      <td>\"Books tend to have ongoing royalties: 6% afte...</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Heavy</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Print</td>\n",
       "      <td>Oxford University Press</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>NaN</td>\n",
       "      <td>50000.0</td>\n",
       "      <td>2013</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>0.02</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                comment contract flatRate  \\\n",
       "1245                                                NaN      NaN    False   \n",
       "1491               \"Pays two months after publication.\"      Yes    False   \n",
       "1742                                                NaN      Yes    False   \n",
       "2046  \"The commission was for a guidebook published ...      Yes    False   \n",
       "2251                                                NaN      Yes    False   \n",
       "2377  \"Books tend to have ongoing royalties: 6% afte...      Yes    False   \n",
       "\n",
       "     levelOfReporting daysToBePaid  paymentDifficulty platform  \\\n",
       "1245              NaN          NaN                2.0  Digital   \n",
       "1491            Heavy          NaN                NaN    Print   \n",
       "1742            Light      Not Yet                5.0  Digital   \n",
       "2046            Light      Not Yet                5.0    Print   \n",
       "2251            Light          NaN                NaN  Digital   \n",
       "2377            Heavy          NaN                NaN    Print   \n",
       "\n",
       "                               publication     relationship         rights  \\\n",
       "1245                     Atlanta Blackstar              NaN  Unknown/Other   \n",
       "1491                          The Believer  Solicited Pitch            All   \n",
       "1742                             Kpopstarz          Ongoing            All   \n",
       "2046  Highend Media / Gatehouse Publishing              NaN            All   \n",
       "2251                   The American Reader       Cold Pitch          First   \n",
       "2377               Oxford University Press       Cold Pitch            All   \n",
       "\n",
       "     storyType  wordCount  year  totalPaid  wordRate  \n",
       "1245       NaN    20000.0  2018      400.0      0.02  \n",
       "1491   Profile    30000.0  2013      300.0      0.01  \n",
       "1742       NaN   120000.0  2017     2400.0      0.02  \n",
       "2046       NaN   100000.0  2018     4000.0      0.04  \n",
       "2251   fiction    30000.0  2014      900.0      0.03  \n",
       "2377       NaN    50000.0  2013     1000.0      0.02  "
      ]
     },
     "execution_count": 33,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df[df['wordCount'] > 15000]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "nan\n",
      "\n",
      "\"Pays two months after publication.\"\n",
      "\n",
      "nan\n",
      "\n",
      "\"The commission was for a guidebook published by Gatehouse, which was bought by HighEnd Media in December 2017. HighEnd's MD is non-responsive to emails, except to say there is current a \"funding freeze\" and he has been \"instructed not to expect any additional funds until March.\" HighEnd's other publications include Billionaire Magazine and Crown Magazine.\"\n",
      "\n",
      "nan\n",
      "\n",
      "\"Books tend to have ongoing royalties: 6% after the first 600 paperback copies (0% for the first 600). The initial print run was: 600 copies. (Luckily mine sold out and they did a second printing.) The book was based on my dissertation. I now have a student with a dissertation-based book ms accepted at Oxford University Press who was told they no longer pay *any* royalties for \"books based on dissertations\". \n",
      "\n",
      "Academics also typically get paid zero for chapters they write in edited volumes, for encyclopedia entries, and other smaller pieces (at least in the humanities). I'd love for you to expand your purview to include such writings as well, not just journalism. The for-profit publishers (Mouton, Sage, Elsevier, Springer, and many others) that work in my field make large profits (<5% annually) and pay nothing to the authors, editors, reviewers. (Or pay \"in kind\" = a copy of the book you contributed to, if you're lucky.)\"\n",
      "\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "3474"
      ]
     },
     "execution_count": 34,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Yikes. This isn't straightforward\n",
    "for i in df[df['wordCount'] > 15000]['comment']:\n",
    "    print(i, end='\\n\\n')\n",
    "df.shape[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "3469"
      ]
     },
     "execution_count": 35,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Let's decide to drop books.\n",
    "# The American Reader and The Believer have lengthy reports. Let's believe those.\n",
    "# I can find few Atlanta Black Star and Kpopstarz stories anywhere near these estimates. \n",
    "#     I'm dropping these submissions\n",
    "\n",
    "keepIf = (df['wordCount'] < 15000) | df['wordCount'].isnull() | df['publication'].isin(['The American Reader', 'The Believer'])\n",
    "df = df[keepIf]\n",
    "df[df['wordCount'] > 15000]\n",
    "df.shape[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [],
   "source": [
    "# drop all submissions with especially low word-counts\n",
    "df = df[(df['wordCount'] >= 100) | df['wordCount'].isnull()]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Remove 2019, poetry and fiction"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [],
   "source": [
    "df = df[df['year'] != 2019]\n",
    "df = df[~df['storyType'].isin(['poetry', 'fiction'])]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "***\n",
    "# Check quality, reorder columns, and export"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>comment</th>\n",
       "      <th>contract</th>\n",
       "      <th>flatRate</th>\n",
       "      <th>levelOfReporting</th>\n",
       "      <th>daysToBePaid</th>\n",
       "      <th>paymentDifficulty</th>\n",
       "      <th>platform</th>\n",
       "      <th>publication</th>\n",
       "      <th>relationship</th>\n",
       "      <th>rights</th>\n",
       "      <th>storyType</th>\n",
       "      <th>wordCount</th>\n",
       "      <th>year</th>\n",
       "      <th>totalPaid</th>\n",
       "      <th>wordRate</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>3276</th>\n",
       "      <td>\"Wow, this publication seriously sucks. I foll...</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Digital</td>\n",
       "      <td>International Policy Digest</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Criticism</td>\n",
       "      <td>1600.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.00</td>\n",
       "      <td>0.00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>827</th>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>30</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Alma</td>\n",
       "      <td>Solicited Pitch</td>\n",
       "      <td>First</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>750.0</td>\n",
       "      <td>2018</td>\n",
       "      <td>97.50</td>\n",
       "      <td>0.13</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2517</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>90</td>\n",
       "      <td>3.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>American Theatre</td>\n",
       "      <td>Solicited Pitch</td>\n",
       "      <td>First</td>\n",
       "      <td>Criticism</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>2016</td>\n",
       "      <td>150.00</td>\n",
       "      <td>0.15</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2308</th>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Light</td>\n",
       "      <td>15</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Bitch</td>\n",
       "      <td>Assignment</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Criticism</td>\n",
       "      <td>1139.0</td>\n",
       "      <td>2016</td>\n",
       "      <td>45.56</td>\n",
       "      <td>0.04</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2593</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Grist</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2013</td>\n",
       "      <td>275.00</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>465</th>\n",
       "      <td>\"Signed contract for $50 on publication, sent ...</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Light</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Xojane</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>750.0</td>\n",
       "      <td>2016</td>\n",
       "      <td>0.00</td>\n",
       "      <td>0.00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>663</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>30</td>\n",
       "      <td>2.0</td>\n",
       "      <td>Print</td>\n",
       "      <td>Yourtango</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>First</td>\n",
       "      <td>Feature</td>\n",
       "      <td>600.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>36.00</td>\n",
       "      <td>0.06</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2903</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Digital</td>\n",
       "      <td>The Hairpin</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Profile</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.00</td>\n",
       "      <td>0.00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2098</th>\n",
       "      <td>\"My direct editor was great to work with, but ...</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Light</td>\n",
       "      <td>Not Yet</td>\n",
       "      <td>4.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Paste Magazine</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>NaN</td>\n",
       "      <td>500.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>20.00</td>\n",
       "      <td>0.04</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>239</th>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Light</td>\n",
       "      <td>Not Yet</td>\n",
       "      <td>3.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Vice</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>Feature</td>\n",
       "      <td>1200.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>252.00</td>\n",
       "      <td>0.21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3338</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Not Yet</td>\n",
       "      <td>5.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Crixeo</td>\n",
       "      <td>NaN</td>\n",
       "      <td>First</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1200.0</td>\n",
       "      <td>2018</td>\n",
       "      <td>540.00</td>\n",
       "      <td>0.45</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3307</th>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Vice Canada</td>\n",
       "      <td>Solicited Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>News</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>2014</td>\n",
       "      <td>150.00</td>\n",
       "      <td>0.10</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>200</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>90</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Print</td>\n",
       "      <td>Art In America</td>\n",
       "      <td>NaN</td>\n",
       "      <td>All</td>\n",
       "      <td>NaN</td>\n",
       "      <td>600.0</td>\n",
       "      <td>2018</td>\n",
       "      <td>198.00</td>\n",
       "      <td>0.33</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3033</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>60</td>\n",
       "      <td>2.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Boston Globe</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>First</td>\n",
       "      <td>Feature</td>\n",
       "      <td>1200.0</td>\n",
       "      <td>2016</td>\n",
       "      <td>756.00</td>\n",
       "      <td>0.63</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1400</th>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Light</td>\n",
       "      <td>60</td>\n",
       "      <td>2.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Salon</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>First</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>1300.0</td>\n",
       "      <td>2016</td>\n",
       "      <td>130.00</td>\n",
       "      <td>0.10</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3026</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Light</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Digital</td>\n",
       "      <td>The Morning News</td>\n",
       "      <td>Spec</td>\n",
       "      <td>First</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>2014</td>\n",
       "      <td>45.00</td>\n",
       "      <td>0.03</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1488</th>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>30</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>The National</td>\n",
       "      <td>Solicited Pitch</td>\n",
       "      <td>First</td>\n",
       "      <td>News</td>\n",
       "      <td>700.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>399.00</td>\n",
       "      <td>0.57</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2525</th>\n",
       "      <td>\"There were many rounds of edits. And the publ...</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>30</td>\n",
       "      <td>2.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Broadly</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Feature</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>300.00</td>\n",
       "      <td>0.20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2804</th>\n",
       "      <td>\"Editor was a pleasure to work with!\"</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Light</td>\n",
       "      <td>15</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Ravishly</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Criticism</td>\n",
       "      <td>1136.0</td>\n",
       "      <td>2018</td>\n",
       "      <td>102.24</td>\n",
       "      <td>0.09</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2310</th>\n",
       "      <td>\"While the rate isn't incredible, I would high...</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>15</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Bitch</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>First</td>\n",
       "      <td>Profile</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>2016</td>\n",
       "      <td>45.00</td>\n",
       "      <td>0.03</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2745</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>42</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Autostraddle</td>\n",
       "      <td>NaN</td>\n",
       "      <td>First</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>950.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>47.50</td>\n",
       "      <td>0.05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1880</th>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>&gt;90</td>\n",
       "      <td>4.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Unilad</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Feature</td>\n",
       "      <td>2000.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>100.00</td>\n",
       "      <td>0.05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>938</th>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>30</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Al-jazeera English</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>First</td>\n",
       "      <td>News</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>2016</td>\n",
       "      <td>250.00</td>\n",
       "      <td>0.25</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3320</th>\n",
       "      <td>\"800 word article for \"Ages and Stages\" section\"</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Heavy</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Parents</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>All</td>\n",
       "      <td>FoB</td>\n",
       "      <td>750.0</td>\n",
       "      <td>2014</td>\n",
       "      <td>1402.50</td>\n",
       "      <td>1.87</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>871</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Heavy</td>\n",
       "      <td>30</td>\n",
       "      <td>2.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Curbed</td>\n",
       "      <td>Referral</td>\n",
       "      <td>First</td>\n",
       "      <td>Feature</td>\n",
       "      <td>4000.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>1000.00</td>\n",
       "      <td>0.25</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2193</th>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>15</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Model View Culture</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>1200.0</td>\n",
       "      <td>2016</td>\n",
       "      <td>156.00</td>\n",
       "      <td>0.13</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3013</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Washington Post Express</td>\n",
       "      <td>Spec</td>\n",
       "      <td>First</td>\n",
       "      <td>Profile</td>\n",
       "      <td>750.0</td>\n",
       "      <td>2013</td>\n",
       "      <td>150.00</td>\n",
       "      <td>0.20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1395</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Light</td>\n",
       "      <td>Not Yet</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Salon</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>First</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>150.00</td>\n",
       "      <td>0.10</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2436</th>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Light</td>\n",
       "      <td>30</td>\n",
       "      <td>2.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Playboy</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Feature</td>\n",
       "      <td>800.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>232.00</td>\n",
       "      <td>0.29</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>757</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>Heavy</td>\n",
       "      <td>90</td>\n",
       "      <td>2.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>New York Times Magazine</td>\n",
       "      <td>Referral</td>\n",
       "      <td>First</td>\n",
       "      <td>Feature</td>\n",
       "      <td>6300.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>12600.00</td>\n",
       "      <td>2.00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2244</th>\n",
       "      <td>\"Editor killed article after learning I was no...</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>&gt;90</td>\n",
       "      <td>4.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Cosmopolitan</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>First</td>\n",
       "      <td>Profile</td>\n",
       "      <td>959.0</td>\n",
       "      <td>2018</td>\n",
       "      <td>220.57</td>\n",
       "      <td>0.23</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>328</th>\n",
       "      <td>\"\"Payment recieved 9 months later\"\"</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Capital New York</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>2013</td>\n",
       "      <td>170.00</td>\n",
       "      <td>0.17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1110</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Verbal</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>30</td>\n",
       "      <td>2.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Cafemom The Stir</td>\n",
       "      <td>Referral</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>800.0</td>\n",
       "      <td>2016</td>\n",
       "      <td>200.00</td>\n",
       "      <td>0.25</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1263</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>30</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Washington Post Solo-ish</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>First</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>850.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>204.00</td>\n",
       "      <td>0.24</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>658</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Guernica</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2013</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1464</th>\n",
       "      <td>\"slow to pay\"</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Refinery29</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2013</td>\n",
       "      <td>150.00</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1274</th>\n",
       "      <td>\"$50 for 3000 words. Communication with publis...</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Digital</td>\n",
       "      <td>The Toast</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>3000.0</td>\n",
       "      <td>2014</td>\n",
       "      <td>60.00</td>\n",
       "      <td>0.02</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>534</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>The Daily Beast</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Feature</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2013</td>\n",
       "      <td>300.00</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1318</th>\n",
       "      <td>\"Quick payment. Good editor. \"</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Talking Points Memo</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>2014</td>\n",
       "      <td>105.00</td>\n",
       "      <td>0.07</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>299</th>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Light</td>\n",
       "      <td>Not Yet</td>\n",
       "      <td>5.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Latino Leaders</td>\n",
       "      <td>Assignment</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Feature</td>\n",
       "      <td>1100.0</td>\n",
       "      <td>2018</td>\n",
       "      <td>440.00</td>\n",
       "      <td>0.40</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1639</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>15</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Print</td>\n",
       "      <td>Tin House</td>\n",
       "      <td>NaN</td>\n",
       "      <td>First</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1200.0</td>\n",
       "      <td>2016</td>\n",
       "      <td>252.00</td>\n",
       "      <td>0.21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>15</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>America Magazine</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Feature</td>\n",
       "      <td>2000.0</td>\n",
       "      <td>2018</td>\n",
       "      <td>760.00</td>\n",
       "      <td>0.38</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>618</th>\n",
       "      <td>\"I negotiated the rate up to $150 from $100 of...</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>60</td>\n",
       "      <td>3.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Tablet Magazine</td>\n",
       "      <td>Referral</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Feature</td>\n",
       "      <td>1400.0</td>\n",
       "      <td>2018</td>\n",
       "      <td>154.00</td>\n",
       "      <td>0.11</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>593</th>\n",
       "      <td>\"Editors are extremely easy to work with. Pub ...</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Planning Magazine</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>All</td>\n",
       "      <td>News</td>\n",
       "      <td>375.0</td>\n",
       "      <td>2015</td>\n",
       "      <td>390.00</td>\n",
       "      <td>1.04</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2691</th>\n",
       "      <td>\"Working with the Forge was one of the most gr...</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>15</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Forge Literary Magazine</td>\n",
       "      <td>Spec</td>\n",
       "      <td>First</td>\n",
       "      <td>Feature</td>\n",
       "      <td>3000.0</td>\n",
       "      <td>2017</td>\n",
       "      <td>60.00</td>\n",
       "      <td>0.02</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>391</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "      <td>Heavy</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>The Progressive</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>News</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2013</td>\n",
       "      <td>1000.00</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2452</th>\n",
       "      <td>NaN</td>\n",
       "      <td>Yes</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>30</td>\n",
       "      <td>2.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>In These Times</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>News</td>\n",
       "      <td>700.0</td>\n",
       "      <td>2016</td>\n",
       "      <td>175.00</td>\n",
       "      <td>0.25</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1608</th>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>False</td>\n",
       "      <td>Medium</td>\n",
       "      <td>15</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Go Magazine</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Criticism</td>\n",
       "      <td>800.0</td>\n",
       "      <td>2018</td>\n",
       "      <td>104.00</td>\n",
       "      <td>0.13</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>533</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>The Daily Beast</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2013</td>\n",
       "      <td>50.00</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1752</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>False</td>\n",
       "      <td>NaN</td>\n",
       "      <td>42</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Are We Europe</td>\n",
       "      <td>NaN</td>\n",
       "      <td>First</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1200.0</td>\n",
       "      <td>2018</td>\n",
       "      <td>120.00</td>\n",
       "      <td>0.10</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                                comment contract flatRate  \\\n",
       "3276  \"Wow, this publication seriously sucks. I foll...       No    False   \n",
       "827                                                 NaN       No    False   \n",
       "2517                                                NaN      Yes    False   \n",
       "2308                                                NaN       No    False   \n",
       "2593                                                NaN      NaN     True   \n",
       "465   \"Signed contract for $50 on publication, sent ...      Yes    False   \n",
       "663                                                 NaN      Yes    False   \n",
       "2903                                                NaN      NaN    False   \n",
       "2098  \"My direct editor was great to work with, but ...      Yes    False   \n",
       "239                                                 NaN       No    False   \n",
       "3338                                                NaN      NaN    False   \n",
       "3307                                                NaN       No    False   \n",
       "200                                                 NaN      NaN    False   \n",
       "3033                                                NaN      Yes    False   \n",
       "1400                                                NaN       No    False   \n",
       "3026                                                NaN      Yes    False   \n",
       "1488                                                NaN       No    False   \n",
       "2525  \"There were many rounds of edits. And the publ...       No    False   \n",
       "2804              \"Editor was a pleasure to work with!\"      Yes    False   \n",
       "2310  \"While the rate isn't incredible, I would high...       No    False   \n",
       "2745                                                NaN      Yes    False   \n",
       "1880                                                NaN       No    False   \n",
       "938                                                 NaN       No    False   \n",
       "3320   \"800 word article for \"Ages and Stages\" section\"      Yes    False   \n",
       "871                                                 NaN      Yes    False   \n",
       "2193                                                NaN       No    False   \n",
       "3013                                                NaN      Yes    False   \n",
       "1395                                                NaN      Yes    False   \n",
       "2436                                                NaN       No    False   \n",
       "757                                                 NaN      NaN    False   \n",
       "2244  \"Editor killed article after learning I was no...       No    False   \n",
       "328                 \"\"Payment recieved 9 months later\"\"      NaN    False   \n",
       "1110                                                NaN   Verbal    False   \n",
       "1263                                                NaN      Yes    False   \n",
       "658                                                 NaN      NaN      NaN   \n",
       "1464                                      \"slow to pay\"      NaN     True   \n",
       "1274  \"$50 for 3000 words. Communication with publis...      Yes    False   \n",
       "534                                                 NaN      NaN     True   \n",
       "1318                     \"Quick payment. Good editor. \"      Yes    False   \n",
       "299                                                 NaN       No    False   \n",
       "1639                                                NaN      NaN    False   \n",
       "31                                                  NaN       No    False   \n",
       "618   \"I negotiated the rate up to $150 from $100 of...      Yes    False   \n",
       "593   \"Editors are extremely easy to work with. Pub ...      Yes    False   \n",
       "2691  \"Working with the Forge was one of the most gr...      Yes    False   \n",
       "391                                                 NaN      NaN     True   \n",
       "2452                                                NaN      Yes    False   \n",
       "1608                                                NaN       No    False   \n",
       "533                                                 NaN      NaN     True   \n",
       "1752                                                NaN      NaN    False   \n",
       "\n",
       "     levelOfReporting daysToBePaid  paymentDifficulty platform  \\\n",
       "3276           Medium          NaN                NaN  Digital   \n",
       "827            Medium           30                1.0  Digital   \n",
       "2517           Medium           90                3.0  Digital   \n",
       "2308            Light           15                1.0  Digital   \n",
       "2593              NaN          NaN                NaN      NaN   \n",
       "465             Light          NaN                NaN  Digital   \n",
       "663            Medium           30                2.0    Print   \n",
       "2903           Medium          NaN                NaN  Digital   \n",
       "2098            Light      Not Yet                4.0  Digital   \n",
       "239             Light      Not Yet                3.0  Digital   \n",
       "3338              NaN      Not Yet                5.0  Digital   \n",
       "3307           Medium          NaN                NaN  Digital   \n",
       "200               NaN           90                1.0    Print   \n",
       "3033           Medium           60                2.0  Digital   \n",
       "1400            Light           60                2.0  Digital   \n",
       "3026            Light          NaN                NaN  Digital   \n",
       "1488           Medium           30                1.0  Digital   \n",
       "2525           Medium           30                2.0  Digital   \n",
       "2804            Light           15                1.0  Digital   \n",
       "2310           Medium           15                1.0  Digital   \n",
       "2745              NaN           42                1.0  Digital   \n",
       "1880           Medium          >90                4.0  Digital   \n",
       "938            Medium           30                1.0  Digital   \n",
       "3320            Heavy          NaN                NaN  Digital   \n",
       "871             Heavy           30                2.0  Digital   \n",
       "2193           Medium           15                1.0  Digital   \n",
       "3013           Medium          NaN                NaN  Digital   \n",
       "1395            Light      Not Yet                1.0  Digital   \n",
       "2436            Light           30                2.0  Digital   \n",
       "757             Heavy           90                2.0  Digital   \n",
       "2244           Medium          >90                4.0  Digital   \n",
       "328               NaN          NaN                NaN      NaN   \n",
       "1110           Medium           30                2.0  Digital   \n",
       "1263           Medium           30                1.0  Digital   \n",
       "658               NaN          NaN                NaN      NaN   \n",
       "1464              NaN          NaN                NaN      NaN   \n",
       "1274           Medium          NaN                NaN  Digital   \n",
       "534               NaN          NaN                NaN      NaN   \n",
       "1318           Medium          NaN                NaN  Digital   \n",
       "299             Light      Not Yet                5.0  Digital   \n",
       "1639              NaN           15                1.0    Print   \n",
       "31             Medium           15                1.0  Digital   \n",
       "618            Medium           60                3.0  Digital   \n",
       "593            Medium          NaN                NaN  Digital   \n",
       "2691           Medium           15                1.0  Digital   \n",
       "391             Heavy          NaN                NaN      NaN   \n",
       "2452           Medium           30                2.0  Digital   \n",
       "1608           Medium           15                1.0  Digital   \n",
       "533               NaN          NaN                NaN      NaN   \n",
       "1752              NaN           42                1.0  Digital   \n",
       "\n",
       "                      publication     relationship         rights  storyType  \\\n",
       "3276  International Policy Digest       Cold Pitch  Unknown/Other  Criticism   \n",
       "827                          Alma  Solicited Pitch          First    Opinion   \n",
       "2517             American Theatre  Solicited Pitch          First  Criticism   \n",
       "2308                        Bitch       Assignment  Unknown/Other  Criticism   \n",
       "2593                        Grist              NaN            NaN        NaN   \n",
       "465                        Xojane       Cold Pitch            All    Opinion   \n",
       "663                     Yourtango          Ongoing          First    Feature   \n",
       "2903                  The Hairpin       Cold Pitch  Unknown/Other    Profile   \n",
       "2098               Paste Magazine              NaN  Unknown/Other        NaN   \n",
       "239                          Vice       Cold Pitch            All    Feature   \n",
       "3338                       Crixeo              NaN          First        NaN   \n",
       "3307                  Vice Canada  Solicited Pitch            All       News   \n",
       "200                Art In America              NaN            All        NaN   \n",
       "3033                 Boston Globe       Cold Pitch          First    Feature   \n",
       "1400                        Salon          Ongoing          First    Opinion   \n",
       "3026             The Morning News             Spec          First    Opinion   \n",
       "1488                 The National  Solicited Pitch          First       News   \n",
       "2525                      Broadly       Cold Pitch  Unknown/Other    Feature   \n",
       "2804                     Ravishly       Cold Pitch  Unknown/Other  Criticism   \n",
       "2310                        Bitch       Cold Pitch          First    Profile   \n",
       "2745                 Autostraddle              NaN          First    Opinion   \n",
       "1880                       Unilad       Cold Pitch  Unknown/Other    Feature   \n",
       "938            Al-jazeera English       Cold Pitch          First       News   \n",
       "3320                      Parents          Ongoing            All        FoB   \n",
       "871                        Curbed         Referral          First    Feature   \n",
       "2193           Model View Culture       Cold Pitch            All    Opinion   \n",
       "3013      Washington Post Express             Spec          First    Profile   \n",
       "1395                        Salon          Ongoing          First    Opinion   \n",
       "2436                      Playboy       Cold Pitch  Unknown/Other    Feature   \n",
       "757       New York Times Magazine         Referral          First    Feature   \n",
       "2244                 Cosmopolitan       Cold Pitch          First    Profile   \n",
       "328              Capital New York              NaN            NaN        NaN   \n",
       "1110             Cafemom The Stir         Referral  Unknown/Other    Opinion   \n",
       "1263     Washington Post Solo-ish       Cold Pitch          First    Opinion   \n",
       "658                      Guernica              NaN            NaN        NaN   \n",
       "1464                   Refinery29              NaN            NaN        NaN   \n",
       "1274                    The Toast       Cold Pitch            All    Opinion   \n",
       "534               The Daily Beast              NaN            NaN    Feature   \n",
       "1318          Talking Points Memo       Cold Pitch            All    Opinion   \n",
       "299                Latino Leaders       Assignment  Unknown/Other    Feature   \n",
       "1639                    Tin House              NaN          First        NaN   \n",
       "31               America Magazine       Cold Pitch  Unknown/Other    Feature   \n",
       "618               Tablet Magazine         Referral  Unknown/Other    Feature   \n",
       "593             Planning Magazine          Ongoing            All       News   \n",
       "2691      Forge Literary Magazine             Spec          First    Feature   \n",
       "391               The Progressive              NaN            NaN       News   \n",
       "2452               In These Times       Cold Pitch  Unknown/Other       News   \n",
       "1608                  Go Magazine          Ongoing  Unknown/Other  Criticism   \n",
       "533               The Daily Beast              NaN            NaN        NaN   \n",
       "1752                Are We Europe              NaN          First        NaN   \n",
       "\n",
       "      wordCount  year  totalPaid  wordRate  \n",
       "3276     1600.0  2017       0.00      0.00  \n",
       "827       750.0  2018      97.50      0.13  \n",
       "2517     1000.0  2016     150.00      0.15  \n",
       "2308     1139.0  2016      45.56      0.04  \n",
       "2593        NaN  2013     275.00       NaN  \n",
       "465       750.0  2016       0.00      0.00  \n",
       "663       600.0  2017      36.00      0.06  \n",
       "2903     1000.0  2017       0.00      0.00  \n",
       "2098      500.0  2017      20.00      0.04  \n",
       "239      1200.0  2017     252.00      0.21  \n",
       "3338     1200.0  2018     540.00      0.45  \n",
       "3307     1500.0  2014     150.00      0.10  \n",
       "200       600.0  2018     198.00      0.33  \n",
       "3033     1200.0  2016     756.00      0.63  \n",
       "1400     1300.0  2016     130.00      0.10  \n",
       "3026     1500.0  2014      45.00      0.03  \n",
       "1488      700.0  2017     399.00      0.57  \n",
       "2525     1500.0  2017     300.00      0.20  \n",
       "2804     1136.0  2018     102.24      0.09  \n",
       "2310     1500.0  2016      45.00      0.03  \n",
       "2745      950.0  2017      47.50      0.05  \n",
       "1880     2000.0  2017     100.00      0.05  \n",
       "938      1000.0  2016     250.00      0.25  \n",
       "3320      750.0  2014    1402.50      1.87  \n",
       "871      4000.0  2017    1000.00      0.25  \n",
       "2193     1200.0  2016     156.00      0.13  \n",
       "3013      750.0  2013     150.00      0.20  \n",
       "1395     1500.0  2017     150.00      0.10  \n",
       "2436      800.0  2017     232.00      0.29  \n",
       "757      6300.0  2017   12600.00      2.00  \n",
       "2244      959.0  2018     220.57      0.23  \n",
       "328      1000.0  2013     170.00      0.17  \n",
       "1110      800.0  2016     200.00      0.25  \n",
       "1263      850.0  2017     204.00      0.24  \n",
       "658         NaN  2013        NaN       NaN  \n",
       "1464        NaN  2013     150.00       NaN  \n",
       "1274     3000.0  2014      60.00      0.02  \n",
       "534         NaN  2013     300.00       NaN  \n",
       "1318     1500.0  2014     105.00      0.07  \n",
       "299      1100.0  2018     440.00      0.40  \n",
       "1639     1200.0  2016     252.00      0.21  \n",
       "31       2000.0  2018     760.00      0.38  \n",
       "618      1400.0  2018     154.00      0.11  \n",
       "593       375.0  2015     390.00      1.04  \n",
       "2691     3000.0  2017      60.00      0.02  \n",
       "391         NaN  2013    1000.00       NaN  \n",
       "2452      700.0  2016     175.00      0.25  \n",
       "1608      800.0  2018     104.00      0.13  \n",
       "533         NaN  2013      50.00       NaN  \n",
       "1752     1200.0  2018     120.00      0.10  "
      ]
     },
     "execution_count": 38,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.sample(50)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>publication</th>\n",
       "      <th>year</th>\n",
       "      <th>wordRate</th>\n",
       "      <th>wordCount</th>\n",
       "      <th>flatRate</th>\n",
       "      <th>totalPaid</th>\n",
       "      <th>paymentDifficulty</th>\n",
       "      <th>daysToBePaid</th>\n",
       "      <th>storyType</th>\n",
       "      <th>levelOfReporting</th>\n",
       "      <th>relationship</th>\n",
       "      <th>rights</th>\n",
       "      <th>platform</th>\n",
       "      <th>contract</th>\n",
       "      <th>comment</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1800</th>\n",
       "      <td>Submittable</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.04</td>\n",
       "      <td>1150.0</td>\n",
       "      <td>False</td>\n",
       "      <td>46.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>30</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>First</td>\n",
       "      <td>Digital</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>711</th>\n",
       "      <td>Rolling Stone</td>\n",
       "      <td>2016</td>\n",
       "      <td>0.16</td>\n",
       "      <td>1600.0</td>\n",
       "      <td>False</td>\n",
       "      <td>256.00</td>\n",
       "      <td>4.0</td>\n",
       "      <td>60</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Verbal</td>\n",
       "      <td>\"For some reason they can't do direct deposit.\"</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3332</th>\n",
       "      <td>Waterworld</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.42</td>\n",
       "      <td>1200.0</td>\n",
       "      <td>False</td>\n",
       "      <td>504.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>30</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Assignment</td>\n",
       "      <td>First</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3248</th>\n",
       "      <td>The Iowa Review</td>\n",
       "      <td>2012</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "      <td>200.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Profile</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>428</th>\n",
       "      <td>Extra Crispy</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.50</td>\n",
       "      <td>500.0</td>\n",
       "      <td>False</td>\n",
       "      <td>250.00</td>\n",
       "      <td>4.0</td>\n",
       "      <td>&gt;90</td>\n",
       "      <td>Blog</td>\n",
       "      <td>Light</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>396</th>\n",
       "      <td>Mit Technology Review</td>\n",
       "      <td>2016</td>\n",
       "      <td>0.79</td>\n",
       "      <td>634.0</td>\n",
       "      <td>False</td>\n",
       "      <td>500.86</td>\n",
       "      <td>3.0</td>\n",
       "      <td>30</td>\n",
       "      <td>News</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Verbal</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1493</th>\n",
       "      <td>The Believer</td>\n",
       "      <td>2013</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "      <td>300.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Profile</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1445</th>\n",
       "      <td>Muslim Girl</td>\n",
       "      <td>2016</td>\n",
       "      <td>0.00</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>False</td>\n",
       "      <td>0.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>First</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1945</th>\n",
       "      <td>Mask Magazine</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.05</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>50.00</td>\n",
       "      <td>2.0</td>\n",
       "      <td>30</td>\n",
       "      <td>Profile</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>First</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2864</th>\n",
       "      <td>The Billfold</td>\n",
       "      <td>2013</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1104</th>\n",
       "      <td>Vocally</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.05</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>False</td>\n",
       "      <td>75.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>15</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Light</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2226</th>\n",
       "      <td>Water Efficiency Magazine</td>\n",
       "      <td>2016</td>\n",
       "      <td>0.45</td>\n",
       "      <td>2000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>900.00</td>\n",
       "      <td>2.0</td>\n",
       "      <td>30</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Referral</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Print</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2325</th>\n",
       "      <td>Esglobal</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.07</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>False</td>\n",
       "      <td>105.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>42</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>\"Great webpage and service, thanks! Will submi...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1134</th>\n",
       "      <td>Narratively</td>\n",
       "      <td>2016</td>\n",
       "      <td>0.07</td>\n",
       "      <td>3000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>210.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>30</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>748</th>\n",
       "      <td>The Awl</td>\n",
       "      <td>2015</td>\n",
       "      <td>0.40</td>\n",
       "      <td>750.0</td>\n",
       "      <td>False</td>\n",
       "      <td>300.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1710</th>\n",
       "      <td>Washington Post</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.45</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>450.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>30</td>\n",
       "      <td>Criticism</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>Digital</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1812</th>\n",
       "      <td>Global Canadian</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.13</td>\n",
       "      <td>750.0</td>\n",
       "      <td>False</td>\n",
       "      <td>97.50</td>\n",
       "      <td>1.0</td>\n",
       "      <td>Not Yet</td>\n",
       "      <td>News</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Print</td>\n",
       "      <td>Verbal</td>\n",
       "      <td>\"Very new publication, little ad revenue yet. ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2710</th>\n",
       "      <td>Climbing Business Journal</td>\n",
       "      <td>2015</td>\n",
       "      <td>0.07</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>False</td>\n",
       "      <td>105.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>News</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Verbal</td>\n",
       "      <td>\"Paid immediately upon publication. Has since ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3021</th>\n",
       "      <td>Psychedelic Times</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.08</td>\n",
       "      <td>600.0</td>\n",
       "      <td>False</td>\n",
       "      <td>48.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>15</td>\n",
       "      <td>News</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Solicited Pitch</td>\n",
       "      <td>First</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>787</th>\n",
       "      <td>Art Jewelry Forum</td>\n",
       "      <td>2014</td>\n",
       "      <td>0.13</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>False</td>\n",
       "      <td>195.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>Light</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>First</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1268</th>\n",
       "      <td>Restaurant Nuts</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.03</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>30.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>15</td>\n",
       "      <td>Blog</td>\n",
       "      <td>Light</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Verbal</td>\n",
       "      <td>\"Responded to A CL ad for F&amp;B industry writers...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1538</th>\n",
       "      <td>Foreign Policy</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.38</td>\n",
       "      <td>1800.0</td>\n",
       "      <td>False</td>\n",
       "      <td>684.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>42</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Heavy</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>All</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Verbal</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50</th>\n",
       "      <td>Vice Sports</td>\n",
       "      <td>2016</td>\n",
       "      <td>0.12</td>\n",
       "      <td>4973.0</td>\n",
       "      <td>False</td>\n",
       "      <td>596.76</td>\n",
       "      <td>2.0</td>\n",
       "      <td>Not Yet</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Heavy</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>All</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>\"Publication paid for travel expenses\"</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1105</th>\n",
       "      <td>Redmond Magazine</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.42</td>\n",
       "      <td>1806.0</td>\n",
       "      <td>False</td>\n",
       "      <td>758.52</td>\n",
       "      <td>3.0</td>\n",
       "      <td>&gt;90</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Medium</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>\"Will not work w publication again. Editor is ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1059</th>\n",
       "      <td>The Quietus</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.00</td>\n",
       "      <td>3000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>0.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>First</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>\"Primarily publishes unpaid reviews and featur...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>982</th>\n",
       "      <td>Adoption.com</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.03</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>30.00</td>\n",
       "      <td>2.0</td>\n",
       "      <td>90</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>Light</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>All</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1712</th>\n",
       "      <td>Washington Post</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.33</td>\n",
       "      <td>750.0</td>\n",
       "      <td>False</td>\n",
       "      <td>247.50</td>\n",
       "      <td>2.0</td>\n",
       "      <td>15</td>\n",
       "      <td>News</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Referral</td>\n",
       "      <td>First</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>\"$250 is the Washington Post's day rate; I wor...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2766</th>\n",
       "      <td>Kinoscope</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.04</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>40.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>15</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>First</td>\n",
       "      <td>Digital</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>107</th>\n",
       "      <td>The Baltimore Sun</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.19</td>\n",
       "      <td>400.0</td>\n",
       "      <td>False</td>\n",
       "      <td>76.00</td>\n",
       "      <td>2.0</td>\n",
       "      <td>42</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Referral</td>\n",
       "      <td>All</td>\n",
       "      <td>NaN</td>\n",
       "      <td>No</td>\n",
       "      <td>\"I worked on election night. I wrote two blurb...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3253</th>\n",
       "      <td>Buzzfeed</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.10</td>\n",
       "      <td>6000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>600.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>30</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Heavy</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1482</th>\n",
       "      <td>Prefix Mag</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.03</td>\n",
       "      <td>300.0</td>\n",
       "      <td>False</td>\n",
       "      <td>9.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>15</td>\n",
       "      <td>News</td>\n",
       "      <td>Light</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>NaN</td>\n",
       "      <td>\"prefix has reportedly struggled to pay their ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3371</th>\n",
       "      <td>Pitchfork</td>\n",
       "      <td>2016</td>\n",
       "      <td>0.13</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>130.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>60</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>Light</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>550</th>\n",
       "      <td>The Bold Italic</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.07</td>\n",
       "      <td>700.0</td>\n",
       "      <td>False</td>\n",
       "      <td>49.00</td>\n",
       "      <td>3.0</td>\n",
       "      <td>60</td>\n",
       "      <td>Blog</td>\n",
       "      <td>Light</td>\n",
       "      <td>Assignment</td>\n",
       "      <td>All</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>\"Editor changed their mind a lot about the edi...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>800</th>\n",
       "      <td>The New Inquiry</td>\n",
       "      <td>2016</td>\n",
       "      <td>0.05</td>\n",
       "      <td>2000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>100.00</td>\n",
       "      <td>5.0</td>\n",
       "      <td>Not Yet</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3218</th>\n",
       "      <td>Them</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.23</td>\n",
       "      <td>2000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>460.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>30</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Heavy</td>\n",
       "      <td>Referral</td>\n",
       "      <td>All</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1441</th>\n",
       "      <td>L.a. Weekly</td>\n",
       "      <td>2013</td>\n",
       "      <td>0.17</td>\n",
       "      <td>600.0</td>\n",
       "      <td>False</td>\n",
       "      <td>102.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Criticism</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Print</td>\n",
       "      <td>NaN</td>\n",
       "      <td>\"I've been paid $250 extra for features that i...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>401</th>\n",
       "      <td>The Independent</td>\n",
       "      <td>2015</td>\n",
       "      <td>0.00</td>\n",
       "      <td>750.0</td>\n",
       "      <td>False</td>\n",
       "      <td>0.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>Light</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>\"I wasn't paid. The Independent is one of the ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1745</th>\n",
       "      <td>Jetsett</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.05</td>\n",
       "      <td>500.0</td>\n",
       "      <td>False</td>\n",
       "      <td>25.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>15</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>All</td>\n",
       "      <td>Digital</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1516</th>\n",
       "      <td>Chicago Reader</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.13</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>130.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>&gt;90</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>NaN</td>\n",
       "      <td>\"Took 7 months to receive payment.\"</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2084</th>\n",
       "      <td>Trains Magazine</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.20</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>200.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>15</td>\n",
       "      <td>News</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Print</td>\n",
       "      <td>Yes</td>\n",
       "      <td>\"The article is already paid for and scheduled...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3360</th>\n",
       "      <td>New Statesman</td>\n",
       "      <td>2016</td>\n",
       "      <td>0.09</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>90.00</td>\n",
       "      <td>4.0</td>\n",
       "      <td>60</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>First</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2156</th>\n",
       "      <td>Glamour</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.23</td>\n",
       "      <td>1200.0</td>\n",
       "      <td>False</td>\n",
       "      <td>276.00</td>\n",
       "      <td>3.0</td>\n",
       "      <td>42</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Referral</td>\n",
       "      <td>All</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1393</th>\n",
       "      <td>Salon</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.15</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>False</td>\n",
       "      <td>150.00</td>\n",
       "      <td>4.0</td>\n",
       "      <td>Not Yet</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>Light</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>First</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>\"It has become harder and harder to get paid h...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1111</th>\n",
       "      <td>Cnn</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.00</td>\n",
       "      <td>800.0</td>\n",
       "      <td>False</td>\n",
       "      <td>0.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Not Yet</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1535</th>\n",
       "      <td>Astronomy Magazine</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.33</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>False</td>\n",
       "      <td>495.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>30</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Heavy</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Print</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2022</th>\n",
       "      <td>Ozy</td>\n",
       "      <td>2016</td>\n",
       "      <td>0.63</td>\n",
       "      <td>800.0</td>\n",
       "      <td>False</td>\n",
       "      <td>504.00</td>\n",
       "      <td>2.0</td>\n",
       "      <td>30</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>First</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2504</th>\n",
       "      <td>Matador Network</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.02</td>\n",
       "      <td>1968.0</td>\n",
       "      <td>False</td>\n",
       "      <td>39.36</td>\n",
       "      <td>1.0</td>\n",
       "      <td>30</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Solicited Pitch</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>408</th>\n",
       "      <td>Kerrang!</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.18</td>\n",
       "      <td>500.0</td>\n",
       "      <td>False</td>\n",
       "      <td>90.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>30</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>Light</td>\n",
       "      <td>Assignment</td>\n",
       "      <td>All</td>\n",
       "      <td>Print</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1606</th>\n",
       "      <td>The Plaid Zebra</td>\n",
       "      <td>2015</td>\n",
       "      <td>0.07</td>\n",
       "      <td>750.0</td>\n",
       "      <td>False</td>\n",
       "      <td>52.50</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>News</td>\n",
       "      <td>Light</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3016</th>\n",
       "      <td>Scientific American</td>\n",
       "      <td>2013</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Print</td>\n",
       "      <td>NaN</td>\n",
       "      <td>\"rate \"can rise\"\"</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>480</th>\n",
       "      <td>Xojane</td>\n",
       "      <td>2013</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "      <td>50.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>626</th>\n",
       "      <td>Tablet Magazine</td>\n",
       "      <td>2013</td>\n",
       "      <td>0.27</td>\n",
       "      <td>1500.0</td>\n",
       "      <td>False</td>\n",
       "      <td>405.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>\"An assignment, not a pitch.\"</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1911</th>\n",
       "      <td>Student Parent Society</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.01</td>\n",
       "      <td>600.0</td>\n",
       "      <td>False</td>\n",
       "      <td>6.00</td>\n",
       "      <td>2.0</td>\n",
       "      <td>30</td>\n",
       "      <td>FoB</td>\n",
       "      <td>Heavy</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>All</td>\n",
       "      <td>Print</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1122</th>\n",
       "      <td>Self Magazine</td>\n",
       "      <td>2018</td>\n",
       "      <td>0.31</td>\n",
       "      <td>800.0</td>\n",
       "      <td>False</td>\n",
       "      <td>248.00</td>\n",
       "      <td>2.0</td>\n",
       "      <td>60</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>451</th>\n",
       "      <td>Armenian Weekly</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.09</td>\n",
       "      <td>800.0</td>\n",
       "      <td>False</td>\n",
       "      <td>72.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>30</td>\n",
       "      <td>News</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>All</td>\n",
       "      <td>Print</td>\n",
       "      <td>Verbal</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2282</th>\n",
       "      <td>Happenmag.com</td>\n",
       "      <td>2014</td>\n",
       "      <td>0.80</td>\n",
       "      <td>750.0</td>\n",
       "      <td>False</td>\n",
       "      <td>600.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>Light</td>\n",
       "      <td>Cold Pitch</td>\n",
       "      <td>All</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2289</th>\n",
       "      <td>Reader's Digest</td>\n",
       "      <td>2017</td>\n",
       "      <td>0.06</td>\n",
       "      <td>800.0</td>\n",
       "      <td>False</td>\n",
       "      <td>48.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>30</td>\n",
       "      <td>FoB</td>\n",
       "      <td>Light</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>834</th>\n",
       "      <td>Best Women's Travel Writing</td>\n",
       "      <td>2013</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "      <td>150.00</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Opinion</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Print</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2178</th>\n",
       "      <td>Medium</td>\n",
       "      <td>2018</td>\n",
       "      <td>2.06</td>\n",
       "      <td>3500.0</td>\n",
       "      <td>False</td>\n",
       "      <td>7210.00</td>\n",
       "      <td>1.0</td>\n",
       "      <td>60</td>\n",
       "      <td>Feature</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Assignment</td>\n",
       "      <td>Unknown/Other</td>\n",
       "      <td>Digital</td>\n",
       "      <td>Yes</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>588</th>\n",
       "      <td>New Hampshire Business Review</td>\n",
       "      <td>2016</td>\n",
       "      <td>0.35</td>\n",
       "      <td>431.0</td>\n",
       "      <td>False</td>\n",
       "      <td>150.85</td>\n",
       "      <td>3.0</td>\n",
       "      <td>60</td>\n",
       "      <td>Profile</td>\n",
       "      <td>Medium</td>\n",
       "      <td>Ongoing</td>\n",
       "      <td>All</td>\n",
       "      <td>Digital</td>\n",
       "      <td>No</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                        publication  year  wordRate  wordCount flatRate  \\\n",
       "1800                    Submittable  2018      0.04     1150.0    False   \n",
       "711                   Rolling Stone  2016      0.16     1600.0    False   \n",
       "3332                     Waterworld  2017      0.42     1200.0    False   \n",
       "3248                The Iowa Review  2012       NaN        NaN     True   \n",
       "428                    Extra Crispy  2017      0.50      500.0    False   \n",
       "396           Mit Technology Review  2016      0.79      634.0    False   \n",
       "1493                   The Believer  2013       NaN        NaN     True   \n",
       "1445                    Muslim Girl  2016      0.00     1500.0    False   \n",
       "1945                  Mask Magazine  2017      0.05     1000.0    False   \n",
       "2864                   The Billfold  2013       NaN        NaN      NaN   \n",
       "1104                        Vocally  2018      0.05     1500.0    False   \n",
       "2226      Water Efficiency Magazine  2016      0.45     2000.0    False   \n",
       "2325                       Esglobal  2017      0.07     1500.0    False   \n",
       "1134                    Narratively  2016      0.07     3000.0    False   \n",
       "748                         The Awl  2015      0.40      750.0    False   \n",
       "1710                Washington Post  2018      0.45     1000.0    False   \n",
       "1812                Global Canadian  2018      0.13      750.0    False   \n",
       "2710      Climbing Business Journal  2015      0.07     1500.0    False   \n",
       "3021              Psychedelic Times  2017      0.08      600.0    False   \n",
       "787               Art Jewelry Forum  2014      0.13     1500.0    False   \n",
       "1268                Restaurant Nuts  2017      0.03     1000.0    False   \n",
       "1538                 Foreign Policy  2017      0.38     1800.0    False   \n",
       "50                      Vice Sports  2016      0.12     4973.0    False   \n",
       "1105               Redmond Magazine  2017      0.42     1806.0    False   \n",
       "1059                    The Quietus  2017      0.00     3000.0    False   \n",
       "982                    Adoption.com  2017      0.03     1000.0    False   \n",
       "1712                Washington Post  2018      0.33      750.0    False   \n",
       "2766                      Kinoscope  2017      0.04     1000.0    False   \n",
       "107               The Baltimore Sun  2018      0.19      400.0    False   \n",
       "3253                       Buzzfeed  2017      0.10     6000.0    False   \n",
       "1482                     Prefix Mag  2017      0.03      300.0    False   \n",
       "3371                      Pitchfork  2016      0.13     1000.0    False   \n",
       "550                 The Bold Italic  2018      0.07      700.0    False   \n",
       "800                 The New Inquiry  2016      0.05     2000.0    False   \n",
       "3218                           Them  2018      0.23     2000.0    False   \n",
       "1441                    L.a. Weekly  2013      0.17      600.0    False   \n",
       "401                 The Independent  2015      0.00      750.0    False   \n",
       "1745                        Jetsett  2018      0.05      500.0    False   \n",
       "1516                 Chicago Reader  2018      0.13     1000.0    False   \n",
       "2084                Trains Magazine  2017      0.20     1000.0    False   \n",
       "3360                  New Statesman  2016      0.09     1000.0    False   \n",
       "2156                        Glamour  2017      0.23     1200.0    False   \n",
       "1393                          Salon  2018      0.15     1000.0    False   \n",
       "1111                            Cnn  2018      0.00      800.0    False   \n",
       "1535             Astronomy Magazine  2017      0.33     1500.0    False   \n",
       "2022                            Ozy  2016      0.63      800.0    False   \n",
       "2504                Matador Network  2017      0.02     1968.0    False   \n",
       "408                        Kerrang!  2017      0.18      500.0    False   \n",
       "1606                The Plaid Zebra  2015      0.07      750.0    False   \n",
       "3016            Scientific American  2013       NaN        NaN      NaN   \n",
       "480                          Xojane  2013       NaN        NaN     True   \n",
       "626                 Tablet Magazine  2013      0.27     1500.0    False   \n",
       "1911         Student Parent Society  2018      0.01      600.0    False   \n",
       "1122                  Self Magazine  2018      0.31      800.0    False   \n",
       "451                 Armenian Weekly  2017      0.09      800.0    False   \n",
       "2282                  Happenmag.com  2014      0.80      750.0    False   \n",
       "2289                Reader's Digest  2017      0.06      800.0    False   \n",
       "834     Best Women's Travel Writing  2013       NaN        NaN     True   \n",
       "2178                         Medium  2018      2.06     3500.0    False   \n",
       "588   New Hampshire Business Review  2016      0.35      431.0    False   \n",
       "\n",
       "      totalPaid  paymentDifficulty daysToBePaid  storyType levelOfReporting  \\\n",
       "1800      46.00                1.0           30        NaN              NaN   \n",
       "711      256.00                4.0           60    Opinion           Medium   \n",
       "3332     504.00                1.0           30    Feature           Medium   \n",
       "3248     200.00                NaN          NaN    Profile              NaN   \n",
       "428      250.00                4.0          >90       Blog            Light   \n",
       "396      500.86                3.0           30       News           Medium   \n",
       "1493     300.00                NaN          NaN    Profile              NaN   \n",
       "1445       0.00                NaN          NaN    Opinion              NaN   \n",
       "1945      50.00                2.0           30    Profile           Medium   \n",
       "2864        NaN                NaN          NaN        NaN              NaN   \n",
       "1104      75.00                1.0           15        NaN            Light   \n",
       "2226     900.00                2.0           30    Feature           Medium   \n",
       "2325     105.00                1.0           42    Opinion              NaN   \n",
       "1134     210.00                1.0           30    Feature           Medium   \n",
       "748      300.00                NaN          NaN    Opinion           Medium   \n",
       "1710     450.00                1.0           30  Criticism           Medium   \n",
       "1812      97.50                1.0      Not Yet       News           Medium   \n",
       "2710     105.00                NaN          NaN       News           Medium   \n",
       "3021      48.00                1.0           15       News           Medium   \n",
       "787      195.00                NaN          NaN    Opinion            Light   \n",
       "1268      30.00                1.0           15       Blog            Light   \n",
       "1538     684.00                1.0           42    Feature            Heavy   \n",
       "50       596.76                2.0      Not Yet    Feature            Heavy   \n",
       "1105     758.52                3.0          >90    Feature           Medium   \n",
       "1059       0.00                NaN          NaN    Feature           Medium   \n",
       "982       30.00                2.0           90    Opinion            Light   \n",
       "1712     247.50                2.0           15       News           Medium   \n",
       "2766      40.00                1.0           15        NaN              NaN   \n",
       "107       76.00                2.0           42        NaN           Medium   \n",
       "3253     600.00                1.0           30    Feature            Heavy   \n",
       "1482       9.00                1.0           15       News            Light   \n",
       "3371     130.00                1.0           60    Opinion            Light   \n",
       "550       49.00                3.0           60       Blog            Light   \n",
       "800      100.00                5.0      Not Yet        NaN              NaN   \n",
       "3218     460.00                1.0           30    Feature            Heavy   \n",
       "1441     102.00                NaN          NaN  Criticism              NaN   \n",
       "401        0.00                NaN          NaN    Opinion            Light   \n",
       "1745      25.00                1.0           15        NaN              NaN   \n",
       "1516     130.00                1.0          >90    Feature           Medium   \n",
       "2084     200.00                1.0           15       News           Medium   \n",
       "3360      90.00                4.0           60    Feature           Medium   \n",
       "2156     276.00                3.0           42    Opinion           Medium   \n",
       "1393     150.00                4.0      Not Yet    Opinion            Light   \n",
       "1111       0.00                NaN      Not Yet        NaN              NaN   \n",
       "1535     495.00                1.0           30    Feature            Heavy   \n",
       "2022     504.00                2.0           30    Feature           Medium   \n",
       "2504      39.36                1.0           30    Feature           Medium   \n",
       "408       90.00                1.0           30    Opinion            Light   \n",
       "1606      52.50                NaN          NaN       News            Light   \n",
       "3016        NaN                NaN          NaN        NaN              NaN   \n",
       "480       50.00                NaN          NaN    Opinion              NaN   \n",
       "626      405.00                NaN          NaN    Opinion              NaN   \n",
       "1911       6.00                2.0           30        FoB            Heavy   \n",
       "1122     248.00                2.0           60    Feature           Medium   \n",
       "451       72.00                1.0           30       News           Medium   \n",
       "2282     600.00                NaN          NaN    Opinion            Light   \n",
       "2289      48.00                1.0           30        FoB            Light   \n",
       "834      150.00                NaN          NaN    Opinion              NaN   \n",
       "2178    7210.00                1.0           60    Feature           Medium   \n",
       "588      150.85                3.0           60    Profile           Medium   \n",
       "\n",
       "         relationship         rights platform contract  \\\n",
       "1800              NaN          First  Digital      NaN   \n",
       "711           Ongoing  Unknown/Other  Digital   Verbal   \n",
       "3332       Assignment          First  Digital       No   \n",
       "3248              NaN            NaN      NaN      NaN   \n",
       "428        Cold Pitch  Unknown/Other  Digital       No   \n",
       "396           Ongoing  Unknown/Other  Digital   Verbal   \n",
       "1493              NaN            NaN      NaN      NaN   \n",
       "1445          Ongoing          First  Digital       No   \n",
       "1945       Cold Pitch          First  Digital      Yes   \n",
       "2864              NaN            NaN      NaN      NaN   \n",
       "1104       Cold Pitch  Unknown/Other  Digital      Yes   \n",
       "2226         Referral  Unknown/Other    Print      Yes   \n",
       "2325          Ongoing  Unknown/Other  Digital       No   \n",
       "1134          Ongoing  Unknown/Other  Digital       No   \n",
       "748           Ongoing            NaN  Digital       No   \n",
       "1710       Cold Pitch            All  Digital      NaN   \n",
       "1812          Ongoing  Unknown/Other    Print   Verbal   \n",
       "2710       Cold Pitch            All  Digital   Verbal   \n",
       "3021  Solicited Pitch          First  Digital       No   \n",
       "787           Ongoing          First  Digital      Yes   \n",
       "1268              NaN  Unknown/Other  Digital   Verbal   \n",
       "1538          Ongoing            All  Digital   Verbal   \n",
       "50            Ongoing            All  Digital       No   \n",
       "1105              NaN  Unknown/Other  Digital      Yes   \n",
       "1059       Cold Pitch          First  Digital       No   \n",
       "982           Ongoing            All  Digital      Yes   \n",
       "1712         Referral          First  Digital      Yes   \n",
       "2766              NaN          First  Digital      NaN   \n",
       "107          Referral            All      NaN       No   \n",
       "3253       Cold Pitch  Unknown/Other  Digital      Yes   \n",
       "1482          Ongoing  Unknown/Other  Digital      NaN   \n",
       "3371       Cold Pitch  Unknown/Other  Digital      NaN   \n",
       "550        Assignment            All  Digital      Yes   \n",
       "800               NaN  Unknown/Other  Digital      NaN   \n",
       "3218         Referral            All  Digital      Yes   \n",
       "1441              NaN            NaN    Print      NaN   \n",
       "401           Ongoing  Unknown/Other  Digital       No   \n",
       "1745              NaN            All  Digital      NaN   \n",
       "1516       Cold Pitch  Unknown/Other  Digital      NaN   \n",
       "2084       Cold Pitch  Unknown/Other    Print      Yes   \n",
       "3360          Ongoing          First  Digital       No   \n",
       "2156         Referral            All  Digital      Yes   \n",
       "1393          Ongoing          First  Digital      Yes   \n",
       "1111              NaN  Unknown/Other  Digital      NaN   \n",
       "1535          Ongoing  Unknown/Other    Print      Yes   \n",
       "2022       Cold Pitch          First  Digital      Yes   \n",
       "2504  Solicited Pitch  Unknown/Other  Digital       No   \n",
       "408        Assignment            All    Print       No   \n",
       "1606       Cold Pitch            All  Digital      Yes   \n",
       "3016              NaN            NaN    Print      NaN   \n",
       "480               NaN            NaN      NaN      NaN   \n",
       "626               NaN            NaN      NaN      NaN   \n",
       "1911          Ongoing            All    Print       No   \n",
       "1122       Cold Pitch            All  Digital      Yes   \n",
       "451           Ongoing            All    Print   Verbal   \n",
       "2282       Cold Pitch            All  Digital      Yes   \n",
       "2289          Ongoing  Unknown/Other  Digital       No   \n",
       "834               NaN            NaN    Print      NaN   \n",
       "2178       Assignment  Unknown/Other  Digital      Yes   \n",
       "588           Ongoing            All  Digital       No   \n",
       "\n",
       "                                                comment  \n",
       "1800                                                NaN  \n",
       "711     \"For some reason they can't do direct deposit.\"  \n",
       "3332                                                NaN  \n",
       "3248                                                NaN  \n",
       "428                                                 NaN  \n",
       "396                                                 NaN  \n",
       "1493                                                NaN  \n",
       "1445                                                NaN  \n",
       "1945                                                NaN  \n",
       "2864                                                NaN  \n",
       "1104                                                NaN  \n",
       "2226                                                NaN  \n",
       "2325  \"Great webpage and service, thanks! Will submi...  \n",
       "1134                                                NaN  \n",
       "748                                                 NaN  \n",
       "1710                                                NaN  \n",
       "1812  \"Very new publication, little ad revenue yet. ...  \n",
       "2710  \"Paid immediately upon publication. Has since ...  \n",
       "3021                                                NaN  \n",
       "787                                                 NaN  \n",
       "1268  \"Responded to A CL ad for F&B industry writers...  \n",
       "1538                                                NaN  \n",
       "50               \"Publication paid for travel expenses\"  \n",
       "1105  \"Will not work w publication again. Editor is ...  \n",
       "1059  \"Primarily publishes unpaid reviews and featur...  \n",
       "982                                                 NaN  \n",
       "1712  \"$250 is the Washington Post's day rate; I wor...  \n",
       "2766                                                NaN  \n",
       "107   \"I worked on election night. I wrote two blurb...  \n",
       "3253                                                NaN  \n",
       "1482  \"prefix has reportedly struggled to pay their ...  \n",
       "3371                                                NaN  \n",
       "550   \"Editor changed their mind a lot about the edi...  \n",
       "800                                                 NaN  \n",
       "3218                                                NaN  \n",
       "1441  \"I've been paid $250 extra for features that i...  \n",
       "401   \"I wasn't paid. The Independent is one of the ...  \n",
       "1745                                                NaN  \n",
       "1516                \"Took 7 months to receive payment.\"  \n",
       "2084  \"The article is already paid for and scheduled...  \n",
       "3360                                                NaN  \n",
       "2156                                                NaN  \n",
       "1393  \"It has become harder and harder to get paid h...  \n",
       "1111                                                NaN  \n",
       "1535                                                NaN  \n",
       "2022                                                NaN  \n",
       "2504                                                NaN  \n",
       "408                                                 NaN  \n",
       "1606                                                NaN  \n",
       "3016                                  \"rate \"can rise\"\"  \n",
       "480                                                 NaN  \n",
       "626                       \"An assignment, not a pitch.\"  \n",
       "1911                                                NaN  \n",
       "1122                                                NaN  \n",
       "451                                                 NaN  \n",
       "2282                                                NaN  \n",
       "2289                                                NaN  \n",
       "834                                                 NaN  \n",
       "2178                                                NaN  \n",
       "588                                                 NaN  "
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cols = ['publication', 'year', # meta\n",
    "    'wordRate', 'wordCount', 'flatRate', 'totalPaid', # payment\n",
    "    'paymentDifficulty', 'daysToBePaid', # payment red tape \n",
    "    'storyType', 'levelOfReporting', # effort\n",
    "    'relationship', 'rights', 'platform', 'contract', # business\n",
    "    'comment'] #other\n",
    "df = df[cols]\n",
    "df.sample(60)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [],
   "source": [
    "df.to_csv('allData_clean.csv', index=False)"
   ]
  }
 ],
 "metadata": {
  "kernel_info": {
   "name": "python3"
  },
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.0"
  },
  "nteract": {
   "version": "0.12.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}