Reg-Polynomial-Regression-Co2-py-v1.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<a href=\"https://www.bigdatauniversity.com\"><img src=\"https://ibm.box.com/shared/static/cw2c7r3o20w9zn8gkecaeyjhgw3xdgbj.png\" width=\"400\" align=\"center\"></a>\n",
    "\n",
    "<h1><center>Polynomial Regression</center></h1>\n",
    "\n",
    "<h4>About this Notebook</h4>\n",
    "In this notebook, we learn how to use scikit-learn for Polynomial regression. We download a dataset that is related to fuel consumption and Carbon dioxide emission of cars. Then, we split our data into training and test sets, create a model using training set, evaluate our model using test set, and finally use model to predict unknown value.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h1>Table of contents</h1>\n",
    "\n",
    "<div class=\"alert alert-block alert-info\" style=\"margin-top: 20px\">\n",
    "    <ol>\n",
    "        <li><a href=\"#download_data\">Downloading Data</a></li>\n",
    "        <li><a href=\"#polynomial_regression\">Polynomial regression</a></li>\n",
    "        <li><a href=\"#evaluation\">Evaluation</a></li>\n",
    "        <li><a href=\"#practice\">Practice</a></li>\n",
    "    </ol>\n",
    "</div>\n",
    "<br>\n",
    "<hr>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "### Importing Needed packages\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "import pandas as pd\n",
    "import pylab as pl\n",
    "import numpy as np\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<h2 id=\"download_data\">Downloading Data</h2>\n",
    "To download the data, we will use !wget to download it from IBM Object Storage.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "--2020-08-18 11:09:57--  https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-ML0101EN-Coursera/labs/Data_files/FuelConsumptionCo2.csv\n",
      "Resolving cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud (cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud)... 67.228.254.196\n",
      "Connecting to cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud (cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud)|67.228.254.196|:443... connected.\n",
      "HTTP request sent, awaiting response... 200 OK\n",
      "Length: 72629 (71K) [text/csv]\n",
      "Saving to: ‘FuelConsumption.csv’\n",
      "\n",
      "FuelConsumption.csv 100%[===================>]  70.93K  --.-KB/s    in 0.06s   \n",
      "\n",
      "2020-08-18 11:09:57 (1.25 MB/s) - ‘FuelConsumption.csv’ saved [72629/72629]\n",
      "\n"
     ]
    }
   ],
   "source": [
    "!wget -O FuelConsumption.csv https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-ML0101EN-Coursera/labs/Data_files/FuelConsumptionCo2.csv"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Did you know?** When it comes to Machine Learning, you will likely be working with large datasets. As a business, where can you host your data? IBM is offering a unique opportunity for businesses, with 10 Tb of IBM Cloud Object Storage: [Sign up now for free](http://cocl.us/ML0101EN-IBM-Offer-CC)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "## Understanding the Data\n",
    "\n",
    "### `FuelConsumption.csv`:\n",
    "\n",
    "We have downloaded a fuel consumption dataset, **`FuelConsumption.csv`**, which contains model-specific fuel consumption ratings and estimated carbon dioxide emissions for new light-duty vehicles for retail sale in Canada. [Dataset source](http://open.canada.ca/data/en/dataset/98f1a129-f628-4ce4-b24d-6f16bf24dd64?cm_mmc=Email_Newsletter-_-Developer_Ed%2BTech-_-WW_WW-_-SkillsNetwork-Courses-IBMDeveloperSkillsNetwork-ML0101EN-Coursera-20231514&cm_mmca1=000026UJ&cm_mmca2=10006555&cm_mmca3=M12345678&cvosrc=email.Newsletter.M12345678&cvo_campaign=000026UJ&cm_mmc=Email_Newsletter-_-Developer_Ed%2BTech-_-WW_WW-_-SkillsNetwork-Courses-IBMDeveloperSkillsNetwork-ML0101EN-Coursera-20231514&cm_mmca1=000026UJ&cm_mmca2=10006555&cm_mmca3=M12345678&cvosrc=email.Newsletter.M12345678&cvo_campaign=000026UJ&cm_mmc=Email_Newsletter-_-Developer_Ed%2BTech-_-WW_WW-_-SkillsNetwork-Courses-IBMDeveloperSkillsNetwork-ML0101EN-Coursera-20231514&cm_mmca1=000026UJ&cm_mmca2=10006555&cm_mmca3=M12345678&cvosrc=email.Newsletter.M12345678&cvo_campaign=000026UJ&cm_mmc=Email_Newsletter-_-Developer_Ed%2BTech-_-WW_WW-_-SkillsNetwork-Courses-IBMDeveloperSkillsNetwork-ML0101EN-Coursera-20231514&cm_mmca1=000026UJ&cm_mmca2=10006555&cm_mmca3=M12345678&cvosrc=email.Newsletter.M12345678&cvo_campaign=000026UJ)\n",
    "\n",
    "-   **MODELYEAR** e.g. 2014\n",
    "-   **MAKE** e.g. Acura\n",
    "-   **MODEL** e.g. ILX\n",
    "-   **VEHICLE CLASS** e.g. SUV\n",
    "-   **ENGINE SIZE** e.g. 4.7\n",
    "-   **CYLINDERS** e.g 6\n",
    "-   **TRANSMISSION** e.g. A6\n",
    "-   **FUEL CONSUMPTION in CITY(L/100 km)** e.g. 9.9\n",
    "-   **FUEL CONSUMPTION in HWY (L/100 km)** e.g. 8.9\n",
    "-   **FUEL CONSUMPTION COMB (L/100 km)** e.g. 9.2\n",
    "-   **CO2 EMISSIONS (g/km)** e.g. 182   --> low --> 0\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "## Reading the data in\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MODELYEAR</th>\n",
       "      <th>MAKE</th>\n",
       "      <th>MODEL</th>\n",
       "      <th>VEHICLECLASS</th>\n",
       "      <th>ENGINESIZE</th>\n",
       "      <th>CYLINDERS</th>\n",
       "      <th>TRANSMISSION</th>\n",
       "      <th>FUELTYPE</th>\n",
       "      <th>FUELCONSUMPTION_CITY</th>\n",
       "      <th>FUELCONSUMPTION_HWY</th>\n",
       "      <th>FUELCONSUMPTION_COMB</th>\n",
       "      <th>FUELCONSUMPTION_COMB_MPG</th>\n",
       "      <th>CO2EMISSIONS</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>ILX</td>\n",
       "      <td>COMPACT</td>\n",
       "      <td>2.0</td>\n",
       "      <td>4</td>\n",
       "      <td>AS5</td>\n",
       "      <td>Z</td>\n",
       "      <td>9.9</td>\n",
       "      <td>6.7</td>\n",
       "      <td>8.5</td>\n",
       "      <td>33</td>\n",
       "      <td>196</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>ILX</td>\n",
       "      <td>COMPACT</td>\n",
       "      <td>2.4</td>\n",
       "      <td>4</td>\n",
       "      <td>M6</td>\n",
       "      <td>Z</td>\n",
       "      <td>11.2</td>\n",
       "      <td>7.7</td>\n",
       "      <td>9.6</td>\n",
       "      <td>29</td>\n",
       "      <td>221</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>ILX HYBRID</td>\n",
       "      <td>COMPACT</td>\n",
       "      <td>1.5</td>\n",
       "      <td>4</td>\n",
       "      <td>AV7</td>\n",
       "      <td>Z</td>\n",
       "      <td>6.0</td>\n",
       "      <td>5.8</td>\n",
       "      <td>5.9</td>\n",
       "      <td>48</td>\n",
       "      <td>136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>MDX 4WD</td>\n",
       "      <td>SUV - SMALL</td>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>AS6</td>\n",
       "      <td>Z</td>\n",
       "      <td>12.7</td>\n",
       "      <td>9.1</td>\n",
       "      <td>11.1</td>\n",
       "      <td>25</td>\n",
       "      <td>255</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2014</td>\n",
       "      <td>ACURA</td>\n",
       "      <td>RDX AWD</td>\n",
       "      <td>SUV - SMALL</td>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>AS6</td>\n",
       "      <td>Z</td>\n",
       "      <td>12.1</td>\n",
       "      <td>8.7</td>\n",
       "      <td>10.6</td>\n",
       "      <td>27</td>\n",
       "      <td>244</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   MODELYEAR   MAKE       MODEL VEHICLECLASS  ENGINESIZE  CYLINDERS  \\\n",
       "0       2014  ACURA         ILX      COMPACT         2.0          4   \n",
       "1       2014  ACURA         ILX      COMPACT         2.4          4   \n",
       "2       2014  ACURA  ILX HYBRID      COMPACT         1.5          4   \n",
       "3       2014  ACURA     MDX 4WD  SUV - SMALL         3.5          6   \n",
       "4       2014  ACURA     RDX AWD  SUV - SMALL         3.5          6   \n",
       "\n",
       "  TRANSMISSION FUELTYPE  FUELCONSUMPTION_CITY  FUELCONSUMPTION_HWY  \\\n",
       "0          AS5        Z                   9.9                  6.7   \n",
       "1           M6        Z                  11.2                  7.7   \n",
       "2          AV7        Z                   6.0                  5.8   \n",
       "3          AS6        Z                  12.7                  9.1   \n",
       "4          AS6        Z                  12.1                  8.7   \n",
       "\n",
       "   FUELCONSUMPTION_COMB  FUELCONSUMPTION_COMB_MPG  CO2EMISSIONS  \n",
       "0                   8.5                        33           196  \n",
       "1                   9.6                        29           221  \n",
       "2                   5.9                        48           136  \n",
       "3                  11.1                        25           255  \n",
       "4                  10.6                        27           244  "
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_csv(\"FuelConsumption.csv\")\n",
    "\n",
    "# take a look at the dataset\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Lets select some features that we want to use for regression.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ENGINESIZE</th>\n",
       "      <th>CYLINDERS</th>\n",
       "      <th>FUELCONSUMPTION_COMB</th>\n",
       "      <th>CO2EMISSIONS</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>2.0</td>\n",
       "      <td>4</td>\n",
       "      <td>8.5</td>\n",
       "      <td>196</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2.4</td>\n",
       "      <td>4</td>\n",
       "      <td>9.6</td>\n",
       "      <td>221</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1.5</td>\n",
       "      <td>4</td>\n",
       "      <td>5.9</td>\n",
       "      <td>136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>11.1</td>\n",
       "      <td>255</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>10.6</td>\n",
       "      <td>244</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>10.0</td>\n",
       "      <td>230</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>3.5</td>\n",
       "      <td>6</td>\n",
       "      <td>10.1</td>\n",
       "      <td>232</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>3.7</td>\n",
       "      <td>6</td>\n",
       "      <td>11.1</td>\n",
       "      <td>255</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>3.7</td>\n",
       "      <td>6</td>\n",
       "      <td>11.6</td>\n",
       "      <td>267</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   ENGINESIZE  CYLINDERS  FUELCONSUMPTION_COMB  CO2EMISSIONS\n",
       "0         2.0          4                   8.5           196\n",
       "1         2.4          4                   9.6           221\n",
       "2         1.5          4                   5.9           136\n",
       "3         3.5          6                  11.1           255\n",
       "4         3.5          6                  10.6           244\n",
       "5         3.5          6                  10.0           230\n",
       "6         3.5          6                  10.1           232\n",
       "7         3.7          6                  11.1           255\n",
       "8         3.7          6                  11.6           267"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cdf = df[['ENGINESIZE','CYLINDERS','FUELCONSUMPTION_COMB','CO2EMISSIONS']]\n",
    "cdf.head(9)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Lets plot Emission values with respect to Engine size:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    },
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEHCAYAAABBW1qbAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy86wFpkAAAACXBIWXMAAAsTAAALEwEAmpwYAAAwDElEQVR4nO2df5xddXnn389MJiGTqMAksoGQGUqBdmItypTWTX+gAbHRF2i3unFHzUt9NZjQFu36smazW7XddNnWttLdJjYVJJqpLFvtyotSlERtV0ulAQFJkCUuCQSykIA/QBBI8uwf59yZM3fOuefHPeeeO3c+79fr+7r3fs/5nvPcm8z3Od/neb7PY+6OEEIIAdBXtwBCCCG6BykFIYQQk0gpCCGEmERKQQghxCRSCkIIISaRUhBCCDHJvCovbmYHgKeB48Axdx8zs1OB/wGMAAeAt7n798LzNwHvDc//bXf/UqvrL1myxEdGRqoSXwghepI777zzqLsvjTtWqVIIea27H418/jCw292vNrMPh59/18xGgbXASuB0YJeZnevux5MuPDIywp49e6qUXQgheg4zO5h0rA7z0eXAjvD9DuDNkf4b3P15d38I2A9c2HnxhBBi7lK1UnDgy2Z2p5mtD/tOc/fDAOHry8P+M4BHImMPhX1CCCE6RNXmo1Xu/piZvRy4zcy+0+Jci+mbkYMjVC7rAVasWFGOlEIIIYCKVwru/lj4+gTwtwTmoMfNbBlA+PpEePoh4MzI8OXAYzHX3O7uY+4+tnRprJ9ECCFEQSpTCma2yMxe0ngPvB64D7gJWBeetg74Yvj+JmCtmS0ws7OAc4A7qpJPCCHETKpcKZwGfN3M7iGY3P/O3W8FrgYuMbMHgUvCz7j7XuBGYB9wK3Blq8gjIcTcYmICRkagry94nZioW6LexGZz6uyxsTFXSKoQvc/EBKxfD88+O9U3OAjbt8P4eH1yzVbM7E53H4s7ph3NQoiuZ/Pm6QoBgs+bN9cjTy8jpSCE6HoefjhfvyiOlIIQoutJij5XVHr5SCkIIbqeLVsCH0KUwcGgX5SLlIIQousZHw+cysPDYBa8yslcDZ1IiCeEEG0zPi4l0Am0UhBCCDGJlIIQQohJpBSEEEJMIqUghBBiEikFIYQQk0gpCCGEmERKQQghxCRSCkIIISaRUhBCCDGJlIIQQohJpBSEEEJMUrlSMLN+M/uWmd0cfv6omT1qZneHbU3k3E1mtt/MHjCzS6uWTQghxHQ6kRDvKuB+4KWRvj9z949HTzKzUWAtsBI4HdhlZueqTrMQQnSOSlcKZrYceCPwqQynXw7c4O7Pu/tDwH7gwirlE0IIMZ2qzUefAD4EnGjq/00zu9fMrjOzU8K+M4BHIuccCvuEEEJ0iMqUgpm9CXjC3e9sOrQNOBs4HzgM/EljSMxlPOa6681sj5ntOXLkSIkSCyGEqHKlsAq4zMwOADcArzOzne7+uLsfd/cTwF8xZSI6BJwZGb8ceKz5ou6+3d3H3H1s6dKlFYovhBBzj8qUgrtvcvfl7j5C4ED+iru/w8yWRU57C3Bf+P4mYK2ZLTCzs4BzgDuqkk8IIcRM6ijH+Udmdj6BaegAcAWAu+81sxuBfcAx4EpFHgkhRGfpyOY1d/+au78pfP9Od/8Zd3+lu1/m7ocj521x97Pd/Tx3//tOyCaEmB1MTMDICPT1Ba8TE3VL1JtoR7MQIpWNG2HePDALXjdu7Oz9JyZg/Xo4eBDcg9f166UYqkBKQQjRko0bYds2OB4ac48fDz53UjFs3gzPPju979lng35RLuY+I+pz1jA2NuZ79uypWwwhepq+vuDpvBkzONG8A6mHZeglzOxOdx+LO6aVghCiJUnPjZ18nlyxIl+/KI6UghCi69myBQYHp/cNDgb9olykFIQQXc/4OGzfDsPDgcloeDj4PD5et2S9h5SCEKIlGzbk66+K8XE4cCDwIRw4IIVQFVIKQvQAVcbwb90aKID+/uBzf3/weevW9q6rfQfdiZSCEBVTdYx/XAz/u98NS5aUN+Fu3QrHjgXXP3asHIWgfQfdiUJShaiQRox/M2U8aTcYGQkm1VYMDnaXDT5J5uHhwDQkqqVVSKqUghAVMm/e1KavKP39wRN3GSTF8DfTTROu9h3Ui/YpCFETcQqhVX8RssbqP/xw8XukmcDy+ge076B7kVIQokIsrnRUi/4ixMXwx1F0wk1Lc1HEP6B9B92LlIIQFVLGbuC0p/TmGP6hIZg/f/o57Uy4n/xk6/4ieYm076B7kVIQc5q6s3+mkTUZXTSG/+hReO97p4eQrltXfMJNU2xJZqk0c5X2HXQnUgpiztKJ7J+NiTlrfzPbt+frh8Bss2PH9O+1Y0d14Z7yD/QWUgpizlJkws3L+vX5+psp4qjudJpp+Qd6i8qVgpn1m9m3zOzm8POpZnabmT0Yvp4SOXeTme03swfM7NKqZRNzm05EBrW7G7jISqOoOSeJtDQX4+OBeaosc5Wol06sFK4C7o98/jCw293PAXaHnzGzUWAtsBJ4A7DVzDIusoXIT7umnay0sxu4yEqjbHNOmmLrtLlKVEulSsHMlgNvBD4V6b4c2BG+3wG8OdJ/g7s/7+4PAfuBC6uUT8xt2jXtdIJVqwIHeJR584L+JOLMOQMD8MwzxdNetFJsqorWW1S9UvgE8CEgukfxNHc/DBC+vjzsPwN4JHLeobBPiEqoKtFbmWzePHPn87FjMyfc6OaxzZsD8000RNUMnnyymjxDZZurRL1UphTM7E3AE+5+Z9YhMX0zguHMbL2Z7TGzPUeOHGlLRiHKTvRWNlkm3LjNYzt2BCuGEydg8WJ44YXp48t8klf0UW9R5UphFXCZmR0AbgBeZ2Y7gcfNbBlA+PpEeP4h4MzI+OXAY80Xdfft7j7m7mNLly6tUHwh6ifLhJtmvqn6Sb6q6KOVK4MVTqOtXNne9UQ2KlMK7r7J3Ze7+wiBA/kr7v4O4CZgXXjaOuCL4fubgLVmtsDMzgLOAe6oSj4hZgNZJty0Sb/qJ/kqdievXAn79k3v27dPiqET1LFP4WrgEjN7ELgk/Iy77wVuBPYBtwJXunuJwYFCzD6yTLhpk34n9hGUvTu5WSGk9c8lKt+F7+6ztl1wwQUuRN3s3Ok+POxuFrzu3Nn5+w8OugcehaANDk6Xo24Z8xL9Ls1tLrNhQ/xvsmFDvusAezxhXtWOZiHaoBsqiGVZTTQ/yYNKYc5GOrELX0pBiDaYjTH6VSiysp3Co6P5+ucKndiFL6UgRBvUEaMfnXwbLW2Sj+5jWLcuvyK7+OLp97v44qljVTiF9+6dqQBGR4P+uUwnduFLKQjRBp2O0U8qztNqkm9eGSQ9VSbVeb74Yti9e3rf7t1TiqEqp/DevdMt53NdIUBnduFLKQjRBt2cIbSxWokzccWR9LTZrBDS+kV1dGIXvpSCEG3QzRXEGquVrKasMu3Sojqq3oUvpSBEDxJdrWQ1ZQ0PVyePmD1IKQjRBt0QktogabUSZ+KKY82a+P7Vq/P1i9mNlIIQLYhG7cTF83c6JLVVveSkHcXNJq4k38Ett8T379o1UwGsXh30Q+fqUojOIKUgRAJZVgF1hKTG7WlNS30Q3bx24kTsZVvKvGvX9Ps1FAKUFxFTefoGkY2krc6zoSnNhaiS4eH4lALDw1PnDA3FnzM0VJ1cGza49/cH9+nvdx8dzZf6IMv3ysvq1dOvtXp1/u9URvoGkQ2U5kKI/HRj8ZiNG2HbtumlL5P2A2zbFm/2KjuMdmICbr99et/tt880tbUyxXUifYPISJK2mA1NKwVRJVmeqM3izzErT45oMrtWieJatSoT5CX9TkNDU/cYGnKfPz9ZJiXA6yxopSBEfrI8USeFe/b1lZNsrtmvUZRnnw3SWzRkgtaprlultWgmaSf0k09Oyf3kk62rv8lZ3T1IKQiRQJaNaUnhnsePlxOimnU3chayypSW1qJMGqa4iy6KP57UL6rDvJ3Hj5oZGxvzPXv21C2GmONMTAST98MPB0/icTuDh4enUlbnoa+vvRVCK/r7g5XCihWBcmsou6T8StFx69dP7aRNO78Vjd9lZCR+xVH0dxOtMbM73X0s7phWCkK0Sbvhnq1CMatKrAfTVw7veU/21czx44ETuyFnURNP1BTXjU79uUplSsHMTjKzO8zsHjPba2YfC/s/amaPmtndYVsTGbPJzPab2QNmdmlVsglRFYsW5euPiyaKTrg/+ZPlyxjHCy/AVVflG9OIDDrvvGznDwzA0FC8Ka7T2WZFC5I80O02wIDF4fsB4JvALwAfBT4Yc/4ocA+wADgL+C7Q3+oeij4S3UDW6KA4GvsNmlt/f+vj0Xb66TPLcRZt7jP3HKSd3+p7Z41wylJSVJQHdUQfhfd+Jvw4ELZW1tHLgRvc/Xl3fwjYD1xYlXxClEG70UFplbRaZS5tTJ+PPpotjUV/fzb7f1xai6TrNeRIolWEU5RuzjY716jUp2Bm/WZ2N/AEcJu7fzM89Jtmdq+ZXWdmp4R9ZwCPRIYfCvuE6Bh5Uy20Gx2UFoqZNVTzG9+AQ4eCCfrEiUD2KIODsGNHcGxoKP6a0f5oWosNG+LPL7OwC8ysIy2FUA+VKgV3P+7u5wPLgQvN7BXANuBs4HzgMPAn4elxzzAznkHMbL2Z7TGzPUeOHKlEbjE3SbPvx5EUo5+VJHt8oz9p4j1+fGoPwfz50+V2D/LsL1489dS9bl2gwPrCv/hmpTIwANdcE3+vtMIuJ50UPy6pX3Q3HQtJNbOPAD9y949H+kaAm939FWa2CcDd/0t47EvAR9399rjrgUJSRbnMmxdvrunvDybZPGOaSQpVbYSFtjp/48bAlJK3CE5D7oaJK7qiGRiAl74UnnpqZkhqXpYsCTanNTM0BEePFrumqJZaQlLNbKmZnRy+XwhcDHzHzJZFTnsLcF/4/iZgrZktMLOzgHOAO6qST4hm0uz7eY9FSQpVzdIfrbSVh4ZscSauF18MJnL3wOz0jW/ku3aUp57K1y+6m3nppxRmGbDDzPoJlM+N7n6zmX3WzM4nMA0dAK4AcPe9ZnYjsA84Blzp7ioQKDpGf3/yJN9w0I6OTi8gPzyczYRUR1WzhrknLda/YSaDYqUdk1ZSSlExO6ky+uhed3+Vu7/S3V/h7r8f9r/T3X8m7L/M3Q9Hxmxx97Pd/Tx3//uqZBOiQdSxnOWpf98+WLly6nPWqmad2m8QpeGPyBrrXzQjaZJpLalfdDfa0SwKk1aVrNtlaHYsN0gL24ymqm4OpUzia1/LLlcrTj45vn9gINkRnFVx5fVZiB4laQPDbGjavFYf3bDZqF0Z0jaOFUnnnHdM3vOLFqPJssGu8b3zUuR3EvVCi81rSognCtENCczalaHVk717+vE48kYw5b1HkQipZhorpGaiq4s8FPmdRL20HX0URhL9BzPbHm44u87MritXTDGb6IYEZu3KkLYxbHQ0/nhzf9SEtXBh/JiyNnoViZBqZtWqqf0KDfr6gv4iJG1uS+oX3U1Wn8IXgZcBu4C/izQxR+mGBGZZZGjlc0grOL9370wF0Bx91Jzm4plnZk64q1cnP4EnPWUn9ZdRjGbz5pmhsCdOTBW8iaMb/EeiQyTZlaINuDvLeZ1u8inUx2zwKWSRccOGKd9Cf3/+QvFJpSiz/i6d8ilEyVtCNO13TPPNiO6DFj6FrErhPwNrspzbySalUC/tTqhl0KrWcJYay+1c3z173eSkexaRsSpFVlRGOZpnH62UQlbz0VXAzWb2YzN7Omw/rGTpImYFExNBgrVonqAdO7rLrNCuz6HZNBRXxjKruSzpnlnqQDcT3eF87Fh+5/CaNfn6037HvCYw0eUkaYvZ0LRSqI8ynsLbJc2ssWhRvIyLFmW7fpbvuHOn+/z56SuF/v7k1UanV1x1rRTSVl2ic9Cu+Si4BpcBHw/bm7KOq7JJKdRHXrt0FvJOGlWbNbKM37nTfWAgXSkkKa648QMDrb973Pl5KNunkPV3ar6vmRRDXbStFICrgd3Ae8J2G3B1lrFVNimF+ih7pVDEcZ02uXVCKST9Do2VQZITtvE7DQ3FHx8aipcpSQHlUQxF/u1aKewsv1PSamr+/Oxyi/IoQyncC/RFPvcD92YZW2WTUqiPsqOP0ibXuJVDN6wU2lVMeWVs9zu5x5u85s8v/m+XZeVRhtyiPFophTy5j06OvH9ZYSeG6AnKLp+Y5Mw8fjyYOuKcvEWctGWTtleijH0FVRA82yV/zsP73pevX3Q5Sdoi2oC3AweB64EdwEPA2ixjq2xaKfQOWeL940wc7Zo1WpFlfLv29qpWCq2c11UECaQ5y7VS6C4oydG8jMDZfDnwr7KOq7JJKfQOO3e69/VlUwxZI3WymDVaKZXR0fjxo6MzZS+6VyLvZJnFp5C2wa2KIIE0Vq+Ov+fq1dXdUyRTWCkAPxW+vjqutRrbiSal0DskTWRZWpJiWLw4/vzFi4PjWWzrzYqhWSGkUUbkTjNp0UdJyrWvL9vvUhXNikEKoT7aUQrbw9evxrSvtBrbiSalUC9lxp0nRelkXTnEkTbh5o38yUrz77JhQ3UmrjjSrtlqF7b2EMwNSjEf5W3ASQQ1lu8B9gIfC/tPJQhpfTB8PSUyZhOwH3gAuDTtHlIK9VF29FFRhdBqAq2iXkIaeX+XOpRClt+z03msRGdppRQy1VMws7cCt7r702b2H0Pz0R+4+7dajDFgkbs/Y2YDwNcJ0mX8GvCUu19tZh8OlcLvmtko8DngQuB0goys53qLOs2qp1AfZddTSKoTkIWitQqqqAOQ93epQoa+vvixZkE21Ky/dSdrY4jO0nY9BeA/hQrhF4FLCSKQPtlqQKiQngk/DoTNCRzVO8L+HcCbw/eXAze4+/Pu/hDBiuHCjPKJDpNUrD5LEfs42qk3kDR28eLW/UND8ceT+rOQFFp78GB5aaejdaXnzQs+R0lSJo3+iy7Kdp9O1sYQ3UNWpdB4rngjsM3dvwjMTxtkZv1mdjfwBHCbu38TOM3dDwOEry8PTz8DeCQy/FDYJ7qQsuPv4wq/xLF48fRaxKtXwy23xE+4P/pR/DUa/ddcE9Q2jjIwEPTnITpJt3q6dw+Uw7vfXVwxNNeVPn48+NysGFqxf3+28zpZG0N0EUl2pWgDbgb+EvguwSa2BcA9WcaG408mcE6/Avh+07Hvha9/Abwj0n8t8G9irrUe2APsWbFiRXlGNpGLLLbwPI7orPsUYOqaQ0Mzo4eK5ORpx1leNGqq4cwu20+Sds2sqb7z+hSU7G52QQlpLgYJfAHnhJ+XAa/PMjZyjY8AHyRwIi+LXOeB8P0mYFPk/C8Br2l1TTma6yMtcqdMh2veVmae/4ULp49buHD68VZRU2kTcJbfMc/vVMZvWWRSL5LUT9RLK6WQ1dF8NnDI3Z83s4uAVwKfcffvtxizFHjR3b9vZguBLwP/FfgV4EmfcjSf6u4fMrOVwF8z5WjeHSohOZq7kLQC8mU6XPPScKgWceJu3Bik62jliF24EJ59dupere6Rdnzx4ngz16JFQWnPZrJ8p3Z+ywzTwQyWLIEnn5zZPzQER48Wl0VURxmO5s8Dx83sJwnMOmcRTOCtWAZ81czuBf6FwKdwM0HG1UvM7EHgkvAz7r4XuBHYB9wKXNlKIfQ6ZdfETXNO5iWtgHy7BW7aoagtvNlen8Rzz029b9e3kub3mA3EKYRW/aLLSVpCRBtwV/j6IeC3wvffyjK2ytar5qOy9wCUUde3mTQzRt78OmWZjtrZLZxnA13W3zbtGnllrNp8VISyryeqhxJ8Ct8kSIp3H3BW2HdflrFVtl5VCmUnLKuisHraRNBpn0IZu4WLTp6tksGl+QyqUAp5nPbRVjTtRFU7w0V1tFIKWc1H7wZeA2xx94fM7CxgZ3nrFRGlbNNLmqmnCspOrZ3GiROBr6Kq60dZuHD651WrYPny4HsuXx58blBW2GuDDRvS++NSijdMhxCYtk4/ffrx1ath165iMl1zDcxvClCfP7/4dxQ1k6QtZkPr1ZVC2U9eaQnSilC2yaCd3EdJ98z7O2YJ12z+zbKsiFqFaxbJHpqlpnP0nkNDM6ODyk5joZDU2QVFVwpmdmP4+m0zuzfSvh06kMUsoPnJNq2/DqpYtZx/fr5+9/Rrnjgx3Um/efNUJFKDZ5+FdeumggQgWMXErWbOPTf+Pkn9AFu3BhFe7sHr1q0zzxkfn7rn4sXw4oszZdy8OfkeeYner1MrNlENLUNSzWyZux82s+G44+5eMKlBOfRqSGpa7pq6r9cYm0SWybWZl7wkPgQzK3H3TAubzXp+q/FJv22UwcFk01leGWF62Gx/f5DmI04xNKji31/MbgqHpPpUOoqDoQL4HvB0pIkKSCvxWPf1qqCKEMy8vpSs+Zei47P8hq2eyvPKWCTNRSf+/csOoRY1kmRXijbgCuBx4ABBKc6HgP+bZWyVrVd9CmUXVm/X7h1H2T6FdvwJ0RYtglMk6ipqr09q0fFxv22e3yWvjEW+U9khzp2+vigfSghJfRBYkuXcTrZeVgplpw1oNekXuV8RpVC0nnJRxVBkf0ZUKSQ5npvHR79XFkXSfL88MhZVxlU6gquo+SyqpQylcCswmOXcTrZeVQqd/iMrEu2Ud3JqpyxlkdYgS6RO9NxW10wbX+R3yStjFXtO2qWOms+iPVophay5j14FfJpgE9vzEdPTb5dmxyqAHM3lUMRpnGXMxERgS3/44eA7xdnJG7mQysx9FJUhD2U4z/PmMsrLypWwb9/M/tFR2Lu3/esXoeyCS6J6ysh99JfAV4B/Bu6MNFEBzRuP0vq7kYmJwHF78GAwoSY5TosW5elWmsNT0/rz8sAD+fo7QdxmucHBoF/MPrIqhWPu/jvu/ml339FolUo2h4kmXMvS3y5VVCCLi9+Po2hRnlaMjpZ/zawkrSharTTyRO7UsTs9jU7vXhfVklUpfNXM1pvZMjM7tdEqlWwOk2QiqiqmvIo0BVlXAGVPZu2YUZLMR2WbtqJMTASV2BorqrTKbGVXvCsLbV7rHbIqhX9HUATnn5gyHfWeMb+HaH763Lgx+Wl0fByuu276k95117X3h511kmpnNRKl4d5sVgh5nsLf9758/WVw1VUzdxu/+GLQH0fSXop2alwLMY0kD/RsaL0afVQ07LBBltj5vr72whLTZMwaJZQlW2iWlhRqmzd+Pk8kUJHfpd3zy5CxCpT7aHZB0ZBU4EOR929tOvaHrcZ2okkpxJM1dfKiRdXJmJSEr10lktaim/zqiJ/vhFLoNrR5bfbRSimkmY/WRt5vajr2hpIWK6KJdh2/We35VVb3yuP/6MtqxMzACy9MmV7qqP6W99+uCid/p0lKClhmwj3ROdL+HC3hfdzn6QfNzjSzr5rZ/Wa218yuCvs/amaPmtndYVsTGbPJzPab2QNmdmmub9JDzLX89MHCszwaZSDryPmU99+uF/6t6yy9KiogaQkRrDCCMpzN7+M+x4xdBrw6fP8S4P8Ao8BHgQ/GnD8K3AMsIKgB/V2gv9U9etV85N6ejTarqSVaG6Ds3EdZahNU2RrfqQ6zRt7fcrbb45XmYvZBC/PRvBSd8bNm9kOCVcHC8D3h55NSlM1hoJFl9Wkzux84o8WQy4Eb3P154CEz2w9cCNyeIqMoyBVXBK+NjWYNE8DBg1PRLEUjkMp++i9CQ/bGruoVK4INVVWHS46P57tH3vO7jS1bpv//AW1em9UkaYsyGzACPAy8lGClcAC4F7gOOCU8578D74iMuRb49VbX7dWVws6dM5+0zbI/QaY9RTdHrBR50kt7Sk/Kp9TJlcJcptOrj9m+2plr0G7uo3Yws8XAPxDUd/6CmZ0GHAUc+ANgmbu/x8z+Arjd3XeG464FbnH3zzddbz2wHmDFihUXHOy1PAnAggWBw7SZ+fPh+edn9jeTN4dPkVxLafdYsmTKtl8H3bBSqYvmlR+0LvQj5h5l5D4qeuMB4PPAhLt/AcDdH3f34+5+AvgrAhMRwCHgzMjw5cBjzdd09+3uPubuY0uXLq1S/NqIUwit+tulCofsU08VHyvaQ9FAoh0qUwpmZgQmoPvd/U8j/csip70FuC98fxOw1swWmNlZwDnAHVXJJ6aoIqHZqUqCUhuKBhLtUOVKYRXwTuB1TeGnf2Rm3zaze4HXAh8AcPe9wI3APoL6DVe6e41pvnoTs6AucLR8YycTmvX1VZtLSMyO8quie0mLPiqMu3+d+L0Mt7QYswVQzELFNOr6QuuC76046ST48Y/j+yHZfOQe+CmqVAyzaeNXFSgaSLRDpT4FUQ9ZU0dv3x68TkzAu941PVPnu97VOnncT/xE6/66nlYHBmbXxq8qUCpr0Q5SChWQJzNnFcRV5oqjkbb6iitmRhmdODG1jyHPPRr9a9bEH0/qb4fFi6cmv09/WpMfKJW1KE5l5qO5ShUbwaL09ZW/CSspB1I7uZFuSTASJvW3w3PPVVdrQoi5hlYKJVN1OGDDvLN+ffsrkCrt+p2MgKmz6pgQvYaUQsl0ajIsQ9FUucGrkz6FuquOCdFLSCmUTCcnw26OO0/b+1DmRK6qY0KUh5RCyXTSwdrNcedpETDnnVf82g2F0t8PGzYUD6sVQsyk8txHVTI2NuZ79nRXqeiknD9DQ3D0aLZrZLH1t8plk8dX4F5N7qM05s0r5gvImv9JCJFMbbmP5iJJSeDKSg5XRdx5HQXrizqHf+mXypVDCDEdhaTOMqoIvWyYX7ZvDybr/v7ATl+lWaa/v5hi+NrXShdFCBFBK4Ua2LgxMJ/E5SGqi61b4dixwPRz7Fj1dvqizmGFnwpRLVoplIxZsn0eAgXQyDsE5eQhqoO075lG8+okKwo/FaJatFIoQKs0FklO1kZ/I99QM0n9nSLv6uWnfzpffxzR1cnpp2cbo/BTIapFK4WctJvGIumpuE6zSJHVy/335+tPY2Cg9fFO+DmEEApJzc3ISKAImhkeDhKPpYVqJoVi9vcHT83Qfrhn3pDULDLluUeR/1JlX08IkYxCUkskqSR01lLRF12Ur79KFi4MXrth9ZLkK5APQYjOIqWQk3Ynr7vvztdfJc89F7wW+U6LF+frT6MbFJMQotoazWea2VfN7H4z22tmV4X9p5rZbWb2YPh6SmTMJjPbb2YPmNmlVcnWDu1OXlVvbitCkvO2lVP3k58MzE5R5s0L+oswPJyvXwhRDVWuFI4B/97dfxr4BeBKMxsFPgzsdvdzgN3hZ8Jja4GVwBuArWbWdcaD2TB5nXxyvvO3bg1yCOXJKTQ+DtdfPz230fXXF99l3cmcUUKIZCpTCu5+2N3vCt8/DdwPnAFcDuwIT9sBvDl8fzlwg7s/7+4PAfuBC6uSryizYfL6/vfzjymyea3M6l6dLMojhEimIz4FMxsBXgV8EzjN3Q9DoDiAl4ennQE8Ehl2KOzrKpImqe3bg30LohidLMojhEim8mnMzBYDnwfe7+4/bHVqTN+MYEQzW29me8xsz5EjR8oSMzNJUUbHj3cmdLKuus9V08k6FEKIZCpVCmY2QKAQJtz9C2H342a2LDy+DHgi7D8EnBkZvhx4rPma7r7d3cfcfWzp0qXVCZ9A3SGSZZbj7CbSivIIITpDldFHBlwL3O/ufxo5dBOwLny/DvhipH+tmS0ws7OAc4A7qpKvKN0SIllm3eeitEr3kZfxcVi3brqze9268tKDCyGyUeVKYRXwTuB1ZnZ32NYAVwOXmNmDwCXhZ9x9L3AjsA+4FbjS3btkCu5OkuztixZlG59n53MzjXQfBw+Ws3qZmAjCWRtK9/jx4HMvrYaEmA0ozUVO2plI3bOlc8h6j0ZqjWYuvhh2704fv2gRPPNMtns1k5buIy8nnRRfUW3BAvjxj/NfTwiRjNJc9CCt7O1f+Uq2a/zoR8XvX3a0UFKJTZXeFKKzSCnMMrKU4+zE4k/RQkL0JkqdPcuoohxnEbZsmZ5CHBQtJEQvoJVCD9KO3yMr4+PBaiWa5qLV6iWN1avz9QshqkGO5pzU7Wgus57C0BAcPZrt3E7Q7CBfvRp27apPHiF6FTma5xhZk/O97W3VypGXc8+dvk/h3HPrlUeIuYiUQg8Stzs4js98pnpZstIoCRrdp7BtW3qtaCFEuUgp9CDN9v4k2glJLZvt2/P1CyGqQUqhR4mmtZ4NqPKaEN2BlEKHSUpBEe0vOxInabXQiSglIcTsQkqhQzSqoWWZoPfvjz8nqV8IIcpCSqFDvOxlwWtSrqFof1LNhqT+NJLCWLspGnk2lDkVYi4gpdAhVEGsNaqnIER3IKUQw8aNMG9eYNKZN6+csMhTT23/Gr1M2TukhRDFUO6jJhrx8g0a8fKQrZh9N7J6dXwq7W5LITE+LiUgRN1opdBEWrz80FCx6z71VLFxZbBr10wFoBQSQog4pBSaSIuXL5oaou6U0rt2BY7lRpNCEELEUWWN5uvM7Akzuy/S91Eze7SpPGfj2CYz229mD5jZpVXJBa1rCzdy7zTT6L/llvz3GxiYcphmCUmdPz/+nKR+IYQoiypXCtcDb4jp/zN3Pz9stwCY2SiwFlgZjtlqZgnTc3uk1RZevz5+XKO/SBRRdMLPEh563XUzlYdZ0C+EEFVSmVJw938EslrSLwducPfn3f0hYD9wYRVybd48vTAMBJ83bw7eb90KGzZMz9a5YcOUkznJDNTfH0zccSuNF16Yun6WePzxcfjsZ6dH4nz2s3LCCiGqpw6fwm+a2b2heemUsO8M4JHIOYfCvtLJUlt41SpYvjyYkJcvDz43SIqn37EjyDOUlGuocf2s8fjR3EUHDkghCCE6Q6eVwjbgbOB84DDwJ2F/nKU91tBiZuvNbI+Z7Tly5EhuAZJSSjf608xLcfH069YFK4G+vqDF0VhhZI3Hb+X3yEK744UQcxR3r6wBI8B9aceATcCmyLEvAa9Ju/4FF1zgeenri8bgTLW+vuD48HD88f5+d7Pg+M6dU9fbudN9cDB+TKMNDk4fk0bcNfNcY+dO9/nzp4+fPz+fDEKI3gXY4wnzaqXlOM1sBLjZ3V8Rfl7m7ofD9x8Aft7d15rZSuCvCfwIpwO7gXPcvWXi5CLlONNKXfb1pecEGhycerofGYnPSdTfH5h+VqwITEN5zD9J1xweDkxJaSxZAk8+ObO/28pvCiHqoZZynGb2OeB24DwzO2Rm7wX+yMy+bWb3Aq8FPgDg7nuBG4F9wK3AlWkKoShpIadZ9hNEHdNJPoqGf6GIPyCL36MVcQqh0V9m6g4hRO9RZfTR2919mbsPuPtyd7/W3d/p7j/j7q9098saq4bw/C3ufra7n+fuf1+VXGkhp2vWxB9vpjFBJymRdjarJeVJKit/kkpdCiGSmHM7mtNCTrNuTmtM+klKJKtyqYKsqThU6lII0cycUwoQKIBjxwLfwbFj0xPdZTHRRENIk5RIkZ3PDZLyJGXNn3TNNcEu6jRU6lII0cycVAqtSNuc1hxC2q79P48MWU1S4+Pw6U9Phb0mkeRfEULMXaQUmkjbnNbsOC4ygaftISij4Ex081tSiuyLLsp+PSHE3EBKoYm8xV7yTuBpm+OKyJCGaj4LIbIipRBDnhQTeSfwtNxLVVCFiUsI0ZtIKRSg2fwD2ZVI3Ka05v4sq4k8VBE2K4ToTaQUctLuhJ22eQ7KX02U4aMQQswNpBRy0u6EnVbZDco395TtoxBC9C7z6hZgttHuhD08nJzXqMGKFfHntGPuGR+XEhBCpKOVQk7atc9nMeXI3COEqAsphZy0O2FnMeXI3COEqItKU2dXTZHU2WUwMRH4EB5+uFhqbCGEqJNaUmf3Mu2WysxSFU2V04QQdSClUAJ5JvAsIa1l71MQQoisyHzUJo0JPBqmGq3M1kyWqmrtVl4TQohWtDIfSSm0Sd4JPKncp1lgjsp6jhBCFKWucpzXmdkTZnZfpO9UM7vNzB4MX0+JHNtkZvvN7AEzu7Qqucom776FLCGtSkshhKiLKn0K1wNvaOr7MLDb3c8BdoefMbNRYC2wMhyz1cxmRbb/vBO49ikIIbqZKms0/yPQXCvscmBH+H4H8OZI/w3u/ry7PwTsBy6sSrYyyTuBa5+CEKKb6XSai9Pc/TCAux82s5eH/WcA/xw571DY1/U0Juo8+xaypJxQWgohRB10S+6juKKRsR5wM1sPrAdY0SVGdk3gQoheodP7FB43s2UA4esTYf8h4MzIecuBx+Iu4O7b3X3M3ceWLl1aqbBCCDHX6LRSuAlYF75fB3wx0r/WzBaY2VnAOcAdHZZNCCHmPJWZj8zsc8BFwBIzOwR8BLgauNHM3gs8DLwVwN33mtmNwD7gGHCluydUHhBCCFEVlSkFd397wqHVCedvARR0KYQQNaLcR0IIISaZ1WkuzOwIEJNkIjNLgKMliVMVkrEcJGM5SMZyqFvGYXePjdSZ1UqhXcxsT1L+j25BMpaDZCwHyVgO3SyjzEdCCCEmkVIQQggxyVxXCtvrFiADkrEcJGM5SMZy6FoZ57RPQQghxHTm+kpBCCFEhDmnFOKK/3QbZnammX3VzO43s71mdlXdMjVjZieZ2R1mdk8o48fqlikJM+s3s2+Z2c11y5KEmR0ws2+b2d1mVm85wQTM7GQz+xsz+074f/M1dcsUxczOC3+/Rvuhmb2/brmaMbMPhH8z95nZ58zspLplijLnzEdm9svAM8Bn3P0VdcsTR5gscJm732VmLwHuBN7s7vtqFm0SMzNgkbs/Y2YDwNeBq9z9n1OGdhwz+x1gDHipu7+pbnniMLMDwJi7d218vZntAP63u3/KzOYDg+7+/ZrFiiUs0vUo8PPu3s5eplIxszMI/lZG3f25ML3PLe5+fb2STTHnVgoJxX+6Cnc/7O53he+fBu6ny+pLeMAz4ceBsHXdE4aZLQfeCHyqbllmM2b2UuCXgWsB3P2FblUIIauB73aTQogwD1hoZvOAQRIyQtfFnFMKsw0zGwFeBXyzZlFmEJpl7iZIgX6bu3edjMAngA8BJ2qWIw0Hvmxmd4Y1Q7qNnwCOAJ8OTXGfMrNFdQvVgrXA5+oWohl3fxT4OEFC0MPAD9z9y/VKNR0phS7GzBYDnwfe7+4/rFueZtz9uLufT1D/4kIz6ypznJm9CXjC3e+sW5YMrHL3VwO/ClwZmjm7iXnAq4Ft7v4q4EeENda7jdC0dRnwP+uWpRkzO4Wg/PBZwOnAIjN7R71STUdKoUsJ7fSfBybc/Qt1y9OK0IzwNeAN9Uoyg1XAZaG9/gbgdWa2s16R4nH3x8LXJ4C/pftqlB8CDkVWg39DoCS6kV8F7nL3x+sWJIaLgYfc/Yi7vwh8AfjXNcs0DSmFLiR04l4L3O/uf1q3PHGY2VIzOzl8v5DgP/t3ahWqCXff5O7L3X2EwJzwFXfvqqcyADNbFAYUEJpkXg90VXScu/8/4BEzOy/sWk1Q/6QbeTtdaDoKeRj4BTMbDP/OVxP4DLuGOacUwuI/twPnmdmhsOBPt7EKeCfBk20jvG5N3UI1sQz4qpndC/wLgU+ha0M+u5zTgK+b2T0EFQf/zt1vrVmmOH4LmAj/zc8H/rBecWZiZoPAJQRP4F1HuNL6G+Au4NsEc3BX7W6ecyGpQgghkplzKwUhhBDJSCkIIYSYREpBCCHEJFIKQgghJpFSEEIIMYmUgpgzmNnxpiyahXfkmtk/lSlb07XHzOzPq7q+EK1QSKqYM5jZM+6+uG45hOhmtFIQc56wlsHHzOyusKbBT4X9S83strD/L83soJktCY89E75eZGZfi9QZmAh3qmJmF5jZP4RJ7r4UpkRvvvdbw7z695jZP0aueXP4/pbIyuYHZrYuTET4x2b2L2Z2r5ld0anfSvQ+UgpiLrGwyXz0byPHjoYJ6bYBHwz7PkKQGuPVBPmIViRc91XA+4FRgmyiq8LcVf8N+HV3vwC4DtgSM/b3gEvd/WcJkrhNw93XhEkH3wscBP5X+P4H7v5zwM8Bv2FmZ2X8DYRoyby6BRCigzwXTrBxNNIi3An8Wvj+F4G3ALj7rWb2vYSxd7j7IYAwlfgI8H3gFcBt4cKhnyBVcjPfAK4Pi63EpmYIVyefBd7m7j8ws9cDrzSzXw9PeRlwDvBQgnxCZEZKQYiA58PX40z9XVjOsdHxBux195YlK939fWb28wSFgO42s/Ojx8MKYjcAv+/ujSR5BvyWu38po3xCZEbmIyGS+TrwNoDw6fyUHGMfAJZaWMfYzAbMbGXzSWZ2trt/091/DzgKnNl0ytXAve5+Q6TvS8CG0ESFmZ3b5QVvxCxCKwUxl1gYmnca3OrurcJSPwZ8LvQ9/AOB+efpLDdy9xdC886fm9nLCP7WPgHsbTr1j83sHIKn/93APcCvRI5/ENgbkfv3CEqLjgB3hU7tI8Cbs8glRBoKSRUiATNbABx392PhE/+2Fj4JIXoCrRSESGYFcKOZ9QEvAL9RszxCVI5WCkIIISaRo1kIIcQkUgpCCCEmkVIQQggxiZSCEEKISaQUhBBCTCKlIIQQYpL/D/ZoRF15citXAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.scatter(cdf.ENGINESIZE, cdf.CO2EMISSIONS,  color='blue')\n",
    "plt.xlabel(\"Engine size\")\n",
    "plt.ylabel(\"Emission\")\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "#### Creating train and test dataset\n",
    "\n",
    "Train/Test Split involves splitting the dataset into training and testing sets respectively, which are mutually exclusive. After which, you train with the training set and test with the testing set.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [],
   "source": [
    "msk = np.random.rand(len(df)) < 0.8\n",
    "train = cdf[msk]\n",
    "test = cdf[~msk]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<h2 id=\"polynomial_regression\">Polynomial regression</h2>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "Sometimes, the trend of data is not really linear, and looks curvy. In this case we can use Polynomial regression methods. In fact, many different regressions exist that can be used to fit whatever the dataset looks like, such as quadratic, cubic, and so on, and it can go on and on to infinite degrees.\n",
    "\n",
    "In essence, we can call all of these, polynomial regression, where the relationship between the independent variable x and the dependent variable y is modeled as an nth degree polynomial in x. Lets say you want to have a polynomial regression (let's make 2 degree polynomial):\n",
    "\n",
    "$y = b + \\\\theta_1  x + \\\\theta_2 x^2$\n",
    "\n",
    "Now, the question is: how we can fit our data on this equation while we have only x values, such as **Engine Size**? \n",
    "Well, we can create a few additional features: 1, $x$, and $x^2$.\n",
    "\n",
    "**PloynomialFeatures()** function in Scikit-learn library, drives a new feature sets from the original feature set. That is, a matrix will be generated consisting of all polynomial combinations of the features with degree less than or equal to the specified degree. For example, lets say the original feature set has only one feature, _ENGINESIZE_. Now, if we select the degree of the polynomial to be 2, then it generates 3 features, degree=0, degree=1 and degree=2: \n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[ 1.  ,  2.  ,  4.  ],\n",
       "       [ 1.  ,  2.4 ,  5.76],\n",
       "       [ 1.  ,  1.5 ,  2.25],\n",
       "       ...,\n",
       "       [ 1.  ,  3.  ,  9.  ],\n",
       "       [ 1.  ,  3.2 , 10.24],\n",
       "       [ 1.  ,  3.2 , 10.24]])"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from sklearn.preprocessing import PolynomialFeatures\n",
    "from sklearn import linear_model\n",
    "train_x = np.asanyarray(train[['ENGINESIZE']])\n",
    "train_y = np.asanyarray(train[['CO2EMISSIONS']])\n",
    "\n",
    "test_x = np.asanyarray(test[['ENGINESIZE']])\n",
    "test_y = np.asanyarray(test[['CO2EMISSIONS']])\n",
    "\n",
    "\n",
    "poly = PolynomialFeatures(degree=2)\n",
    "train_x_poly = poly.fit_transform(train_x)\n",
    "train_x_poly"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**fit_transform** takes our x values, and output a list of our data raised from power of 0 to power of 2 (since we set the degree of our polynomial to 2).\n",
    "\n",
    "$\n",
    "\\\\begin{bmatrix}\n",
    "    v_1\\\\\n",
    "    v_2\\\\\n",
    "    \\\\vdots\\\\\n",
    "    v_n\n",
    "\\\\end{bmatrix}\n",
    "$\n",
    "$\\\\longrightarrow$\n",
    "$\n",
    "\\\\begin{bmatrix}\n",
    "    [ 1 & v_1 & v_1^2]\\\\\n",
    "    [ 1 & v_2 & v_2^2]\\\\\n",
    "    \\\\vdots & \\\\vdots & \\\\vdots\\\\\n",
    "    [ 1 & v_n & v_n^2]\n",
    "\\\\end{bmatrix}\n",
    "$\n",
    "\n",
    "in our example\n",
    "\n",
    "$\n",
    "\\\\begin{bmatrix}\n",
    "    2\\.\\\\\n",
    "    2.4\\\\\n",
    "    1.5\\\\\n",
    "    \\\\vdots\n",
    "\\\\end{bmatrix}\n",
    "$\n",
    "$\\\\longrightarrow$\n",
    "$\n",
    "\\\\begin{bmatrix}\n",
    "    [ 1 & 2. & 4.]\\\\\n",
    "    [ 1 & 2.4 & 5.76]\\\\\n",
    "    [ 1 & 1.5 & 2.25]\\\\\n",
    "    \\\\vdots & \\\\vdots & \\\\vdots\\\\\n",
    "\\\\end{bmatrix}\n",
    "$\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "It looks like feature sets for multiple linear regression analysis, right? Yes. It Does. \n",
    "Indeed, Polynomial regression is a special case of linear regression, with the main idea of how do you select your features. Just consider replacing the  $x$ with $x_1$, $x_1^2$ with $x_2$, and so on. Then the degree 2 equation would be turn into:\n",
    "\n",
    "$y = b + \\\\theta_1  x_1 + \\\\theta_2 x_2$\n",
    "\n",
    "Now, we can deal with it as 'linear regression' problem. Therefore, this polynomial regression is considered to be a special case of traditional multiple linear regression. So, you can use the same mechanism as linear regression to solve such a problems. \n",
    "\n",
    "so we can use **LinearRegression()** function to solve it:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Coefficients:  [[ 0.         50.20325383 -1.4951482 ]]\n",
      "Intercept:  [108.61899194]\n"
     ]
    }
   ],
   "source": [
    "clf = linear_model.LinearRegression()\n",
    "train_y_ = clf.fit(train_x_poly, train_y)\n",
    "# The coefficients\n",
    "print ('Coefficients: ', clf.coef_)\n",
    "print ('Intercept: ',clf.intercept_)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As mentioned before, **Coefficient** and **Intercept** , are the parameters of the fit curvy line. \n",
    "Given that it is a typical multiple linear regression, with 3 parameters, and knowing that the parameters are the intercept and coefficients of hyperplane, sklearn has estimated them from our new set of feature sets. Lets plot it:\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Text(0, 0.5, 'Emission')"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAEHCAYAAABBW1qbAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjMuMCwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy86wFpkAAAACXBIWXMAAAsTAAALEwEAmpwYAAA6rklEQVR4nO2deZgU1dW43zPDOuDGgH4oMiBxgyQuzOcSTRRRcSeaRFE0xA0DqGg0ChK3+CPqF6Nxg4hGITJRSTQJQaJxjys6CLK4BBBQxChIVBQFZub8/rjVQ01PVXf1Ut3TM+d9nvt01e1bt26NWKfvWUVVMQzDMAyAsmIvwDAMw2g5mFAwDMMwGjGhYBiGYTRiQsEwDMNoxISCYRiG0YgJBcMwDKORdnFOLiIrgPVAPVCnqtUi0g14COgDrABOVtX/euPHA2d74y9U1cdTzd+9e3ft06dPXMs3DMNolcydO3etqvYI+i5WoeAxSFXX+s7HAU+p6g0iMs47v1xE+gPDgAHAjsCTIrKbqtaHTdynTx9qa2vjXLthGEarQ0RWhn1XDPXRUGCadzwN+L6v/0FV3aiqy4GlwH6FX55hGEbbJW6hoMA/RWSuiIz0+nZQ1Q8BvM/tvf6dgPd9167y+gzDMIwCEbf66CBVXS0i2wNPiMjbKcZKQF+zHByecBkJ0Lt37/ys0jAMwwBi3imo6mrv82PgLzh10Eci0hPA+/zYG74K2Nl3eS9gdcCcU1S1WlWre/QItJMYhmEYWRKbUBCRLiKyVeIYOBJYBMwERnjDRgB/845nAsNEpKOI9AV2BV6Na32GYRhGc+LcKewAvCAib+Be7o+q6mPADcARIrIEOMI7R1UXAzOAN4HHgDGpPI8MwygeNTXQpw+UlbnPmppir8jIF1LKqbOrq6vVXFINo7DU1MDIkbBhw5a+igqYMgWGDy/euozoiMhcVa0O+s4img3DyIgJE5oKBHDnEyYUZz1GfjGhYBhGRrz3Xmb9RmlhQsEwjIwI8wQ3D/HWgQkFwzAyYuJEZ0PwU1Hh+o3Sx4SCYRgZMXy4MypXVYGI+zQjc+uhEAnxDMNoZQwfbkKgtWI7BcMwDKMREwqGYRhGIyYUDMMwjEZMKBiGYRiNmFAwDMMwGjGhYBiGYTRiQsEwDMNoxISCYRiG0YgJBcMwDKMREwqGYRilxJdfwgMPwOzZsUxvQsEwDKOls3kzPPqoyy2y/fZw2mlw992x3Cp2oSAi5SIyT0RmeefXiMgHIjLfa8f4xo4XkaUi8o6IDIl7bYZhGC0WVXj5ZRgzBnbcEY47Dh57DM44A557Dh5+OJbbFiIh3ljgLWBrX98tqnqTf5CI9AeGAQOAHYEnRWQ3q9NsGEabYulSmD7dtWXLoFMnOOEEOP10GDIEOnSI9faxCgUR6QUcC0wEfpZm+FDgQVXdCCwXkaXAfsDLca7RMAyj6KxbBzNmwB/+4HYHIjBoEPziF3DSSbD11unnyBNx7xR+C1wGbJXUf76I/BioBS5R1f8COwGv+Mas8voMwzBaH5s3w+OPw7RpMHMmbNoEAwbADTc420GvXkVZVmw2BRE5DvhYVecmfTUZ6AfsDXwI/CZxScA0GjDvSBGpFZHaNWvW5HHFhmEYBWDRIrj0Uth5Zzj+eHj2WRg1Cl5/HRYuhMsvL5pAgHh3CgcBJ3iG5E7A1iIyXVVPTwwQkbuBWd7pKmBn3/W9gNXJk6rqFGAKQHV1dTOhYRiG0eL473+dG+l990FtLbRr5wzHP/kJHH107HaCTIhtp6Cq41W1l6r2wRmQn1bV00Wkp2/YicAi73gmMExEOopIX2BX4NW41mcYhhErDQ3w5JPOfbRnT+dFtGkT/Pa3sHo1/OUvMHRoixIIUJxynP8nInvjVEMrgPMAVHWxiMwA3gTqgDHmeWQYRsnx/vtuR3DffbBiBWy7LZxzDpx1FuyzjzMit2BEtXQ1MNXV1VpbW1vsZRhGm6OmBiZMgPfeg969YeLENl6zefNmmDUL7rnHxRI0NMDgwXD22XDiic6ttAUhInNVtTroO4toNoxWxujRTmUt4j5Hj87v/DU1MHIkrFzp4qtWrnTnNTX5vU9J8O67cMUVzmh80kkwf747X7bMqY5OPbXFCYR02E7BMFoRo0fD5MnN+0eNgkmT8nOPPn2cIEimqsppS1o9mzc7F9K77oInnoCyMjj2WDj3XGc0blcMrXxmpNopmFAwjFZEWZn79Z6MiNNolMo9WiQrV7p8Q7//PfznP253kLAVFNGFNBtSCYWWL9IMw4hM2G+8fP726907eKfQu3f+7tFiqK+Hf/wDfvc7l5VUBI45Bs47z+0KysuLvcK8YzYFwzAyYuJEqKho2ldR4fpbDR9/7CKL+/VzAWavv+5STixfDn//u4sxaIUCAWynYBhGhiS8jFqd95EqvPIK3Hkn/OlPLqZg0CC46SYXT9C+fbFXWBBMKBhGK2LUqHBDcz4ZPrwVCIEEX33loo3vvNPtCLbe2qmHRo2CPfcs9uoKjqmPDKOFUFPjPHvKytxnNi6ekya5d1lCs1FenpnnUT7WUDKsXLklz9DZZ7udweTJ8MEHcNttbVIgAKCqJdsGDhyohlFMpk9XrapSFXGf06dnP09FharTYbgm4j5zmTfXNVRUFObeBaOhQfWZZ1RPPFG1rEy1vFz1pJNcX0NDsVdXMIBaDXmvmkuqYWRJIohrw4YtfRUVMGVK5qqVMN//XOfNxxpaRfzBV1/BH//odgALFkBlpfuPN2qUcy1tY1icgmHEQD5fomG+/7nOm481lHT8werVTnf2u9/BJ5/At78NY8e6SOPOnYu9uqJhaS4MIwbeey+z/lRE8fGPOm+YXSCdvSBsDSUZf1Bb68pXVlXBr34FBx8Mzzzj0lCcdVabFghpCdMrlUIzm4JRTCorm+rfE62yMvO5gvT5ya2qKto8HTo0va5DB9VRo9LbC0replBXp/rII6oHH+wWv9VWqhddpLpsWbFX1uIghU2h6C/2XJoJBaOYZCMUUhmmE9/5jcyZvpzD1lRWFk3Q5MtwXlDWr1e9/XbVfv3cQ/Xpo3rzzaqffVbslbVYTCgYRhKjRjnHE3Cfo0ZlPkfyi9vvNRREJr/Es305p9ppZLLWkmD1atXx41W32849zAEHqP7pT6qbNxd7ZS2eVELBDM1GmyNfmUQzNTQXwrsn0/otJelZ9OabLsq4psZlLD3xRFfz+MADi72yksEMzYbhY8qUzPrDyDQHUD4N02FUVgb3d+lS4vmKVOG551zOoQED4MEHXarqJUvg4YdNIOSR2IWCiJSLyDwRmeWddxORJ0Rkife5nW/seBFZKiLviMiQuNdmtE3qQ4q8hvWHMXy4EyRVVe4XelVV6liCQnj33Hpr8xQ97du71P8jRjSNdB4xogRSVdTXwyOPuJf+oYfCnDlw7bVOkt5xh0tYZ+SVQuwUxgJv+c7HAU+p6q7AU945ItIfGAYMAI4CJolI60xDaBSVsOSW2SS9HD7cqV8aGtxnqpfsxInBL+x8/lofPtyVBvYLqvvuc99Nm7ZF8NXXu/MWm8Zi40ZX2rJ/f/jBD2DNGpebaOVKuOoq6N692CtstcQqFESkF3AscI+veygwzTueBnzf1/+gqm5U1eXAUmC/ONdntE1GjsysP58k6/zjqOEeJKgmTGgaeQ3ufMKE/N8/Jz7/3NkL+vZ16qGuXeGhh+Df/3bGoGQdmJF34t4p/Ba4DPDHQ+6gqh8CeJ/be/07Ae/7xq3y+gwjr+SaNC5bJkxwOdf8bNq05cUcZzK6QtgzcmLNGrjySre1+fnP3Q7hiSdcENrJJ7fa2gUtkdhSZ4vIccDHqjpXRA6NcklAXzPXKBEZCYwE6F2SoZZGS2DSpPiFQDKpXszJeZRWrtyyc8mH3r/FVkt7/334zW+cMebrr50n0bhx8L//W+SFtV3i3CkcBJwgIiuAB4HDRGQ68JGI9ATwPj/2xq8C/JmpegGrkydV1SmqWq2q1T169Ihx+YaRX1IZmuNW7+SjWtqAAU7dlWgDBuSwoCVLXH3jfv2creDkk52r6cMPm0AoNmEBDPlswKHALO/418A473gc8H/e8QDgDaAj0Bd4FyhPNa8FrxmlRKrgtUwD4bK9f7bRyv37B6+vf/8MF7Fwoeqpp7oQ606dVM8/X3XFigwnMXKFYkc0JwmFSpzX0RLvs5tv3ARgGfAOcHS6eU0oGKVG2Is5kd4im3xHhSBVVHQk5s51NQxAtUsX1csuU/3ww1jXnI58RLWXKkUXCnE1EwpGoYg7J1BLT0aXtVB45RXVY491A7fZRvXKK1XXri3EklMyalTws7QVwWBCwTByoFAv7CiCp1gJ6zIWCi++qHrkkW5At26q112n+umnhVlsBBI7hORWXl7slRWGVELB0lwYRhpaio9/wkNp5Ur3Ckt4KEV1Xc3FUNy/f8T+F16AI46Agw6CefPgxhtdsMQvfgHbbBP9hjGTr6j2VkmYtCiFZjsFoxAUygicbjeSi90hH4bi5DmaXPv886qDB7svtt9e9aabVL/4IvrkBcZ2CrZTMIysiStnUYcOW361n356+G4kEdQWVsM5Of7h8MOb7ggOP9x5ewYR1h/E4sVNX6GLFwMvvuhu8N3vwqJFcPPNsHw5XHKJy8LXQilmVHtLx4SCYaQhHz7+yXTo4LI+pyOhIgoTCADdum05PvxweOqppt8nn+eFl1+GI490ZS4XLnQBaO++CxdfXBKpKIoV1V4KWD0Fw4hATY371f7ee26HMHFibpHGUXMelZen13NXVsLatZnN6yejV8Brr8HVV8M//gE9esBll7m3aQveFRjNSVVPIbY0F4Zh5EZFRXOVUhDr1sW/Ft54w2UnnTnTbU1uuAHGjHEJ64xWhamPDCMNuXr9ZIq/NkNVVfrxfvVRpqSd/+234ZRTYO+9XZGb665zNoPLLzeB0EoxoWAYPoIylcbhkppcV8Hf7095HWTPSMXgwcH9/ftnaBdZvhx+8hPntzp7tnMpXb7cfW69dfQFGaVHmFtSKTRzSTXySZhbaFxF79u3D3aJTE67kAhYi7qOhGdoog0e3HSelIFvH3zgbty+vW4s76S/kUu0Ox+3uTQQrR1SuKSaTcEwPMJ2BCLBxthc1DbgkoROmdLUkOyvjDZ5sjueNMntGsLcUpNdY598MovFfPKJCzS7/Xaoq+Nfu53DqW/+gtWJkiZJ6zFaMWHSohSa7RSMfBIWpBbWKiuzv1dY7p2w4LTp03NLtxF27YP3rHcpKLbe2v0BzjhDddmyNh/c1drBgtcMIz2ZBqPl4vUzZUr0sf6COwnjs98YHcU1NnkX1J5NnLnhDg49px9ceSXv7zoIFiyAP/wBdtnF0kC0YUwoGIZHWJBaZWXweNXsy2Zm+nJNGLaD6i9DcBSzn4TaSWjgNGp4mz24gwt4iz05gJfZ462/UvPGNxvHh1W/tKqYrR8TCobhMXx48C/xW28N9wCK2z3VT1g5z7Ao5qaCQRnCY7zOvtRwOp+xDUN4jEE8wxwOaOZNdeihwfcK6zdaEWF6pVJoZlMwCkU6D6BMi+FkYrtIti0kexCluqa8XPWGH7yqTzFIFXQZffVUalSoT+nF1NKL/hi5gdkUDCM3EmqbsDQSyb/iR4+Gdu3c+Hbt3Lm/Pxu+8Q0466ymQXRnnRU+fheWUVN/Cpc/vB/fYiEXcBt78DYPcBpB/+v7bSphu5KwfqP1EJtQEJFOIvKqiLwhIotF5Fqv/xoR+UBE5nvtGN8140VkqYi8IyJD4lqbYWRLlIypo0c7981k99IBA5r2Z8ozz8CmTU37ks8BKlnLbxnLW+zJcczil1xJP5ZxBxewmQ6BcycHssWVGdYoAcK2ELk2QICu3nF7YA5wAHANcGnA+P7AG0BHoC+uVnN5qnuY+sgoFOnUR/7ArjB3zlStrCy76/ytExv0cq7XT9la6yjTuzhX/4fVkdVSyc/bksuDGrlBMdRH3r2/8E7bey0gBKiRocCDqrpRVZcDS4H94lqfYUTFn/sojBkzthxnsxOor4dp06LlOkpGaOD6/vfzDrtzA+N5jkP4Jos4jyn8h55pr/d7MSUIM7rnkhnWKA1itSmISLmIzAc+Bp5Q1TneV+eLyAIRuVdEtvP6dgLe912+yuszjFgJ0/8nCIp0TuaTT7YcZ+q2mRj/4ouwalXwmIqK4OzUg3ia+eXVjHvzx/Su3oFbhj7LUGbyNns2GRdmC0m11jD3V6N1E6tQUNV6Vd0b6AXsJyLfBCYD/YC9gQ+B33jDg/7ZNttZiMhIEakVkdo1a9bEsm6j7RCm//cLhlQ7hCDC3DZ33DG4v77evbTD7A2VldC5M3z55Za+3XmbmRzP0wym37afuO3MnDlc/NdDAovHHHZYZms12i4F8T5S1U+BZ4GjVPUjT1g0AHezRUW0CtjZd1kvYHXAXFNUtVpVq3v06BHvwo1WT1hksb8/yi//Mt//SfPnB4/ZuLFpta8olJXBV19t2YlUspY7OJ9FfJND5F/MO+UGuqx6B047rXERkyZBXZ2zBNTVufOlS4PnD+s32i5xeh/1EJFtvePOwOHA2yLiV3KeCCzyjmcCw0Sko4j0BXYFXo1rfYYB4fr/oCR1qWho2HLsVyX5+eSTLS/sqDQ0ONVVBzbyM37DUr7BefyOKYzk0J2W8ubxl0OnTmnnMRdTIypxZkntCUwTkXKc8JmhqrNE5H4R2RunGloBnAegqotFZAbwJlAHjFFVy7RixEqqcpcirg5BVVV6FVI2BuJoKN/nr/yan/MNljGbo7mUm3iL/rBqS06kdPr+jh3h66+D+w3Dj9VoNtokieI5UewFO+4In36a2tg8ePCWlNWp6iQn/neLUkt5L+ZzW9nFfK/hWRbTn59xM/+kefhOVZUzBKciypqMtkOqGs0W0WzETlA1s2LOH8XF1M/q1elLYz77bMTFeoQZnQG25yPulnN5nX3Zr2IhF7W/k714I1AggKmAjDwTFsBQCs2C11o+cQdBZTN/qiC0sJYgX2OC6im0Z6M+fOCvVbfaSrVdO9WLL1Zdty4veZeirMloO5AieM3UR0ashFULi6LyiGv+srLMVSaJ8e3aBdsgysu3GJCjqGqazqMcy6PczM/YjSVw7LHwm9/A7rs3ubamxuU68qe26NAB7r03vU3B1EeGn5zVR54n0RUiMsULOLtXRO7N7zKN1kjcXi/ZzB+WvyfMVbR//y0qqjCjdMLgG5XEPLvzNrM5hlkcTwNlHM1smDWrmUBIkPwCj/pCHzUqs36j7RLVpvA3YBvgSeBRXzOMlMSdWC3d/EH2hrBiOtOmOQHgp39/uOKK1DaIwYOb1i0O+1Xu79+u7DN+zaUs5Ft8h5e4mJv5Fgt5ovzosEdlwgTYvLlp3+bNTesgQPAzH3RQc6FXXu76DaMJYXolfwPmRxlX6GY2hZZPMW0K6b5LrksQRjobRPLzpNTf19er3nuvftZ5e61HdArnaA8+avzen1gvmbAa0v46CGHPXFmZvT3CaH2QwqYQVSj8P+CYKGML2UwolAajRm3JAFpenvrFlw1hL/hsCsUEzRX2Mg6bM+y+x//Pq6r77+9ODjxQf/XD2oz+LlGeJ1Mjul+gGG2HfAiF9UAD8LV3vB74PMq1cTYTCi2fYqZgjvLLOspaw35lR/213p2P9d7yc7RBRHWHHVT/8AfVhoaMnyfK3zKKAPO3rl0zXobRCshZKLTUZkKh5VPMso5dugTfu0uXzNZaWdn8ZRz2TIkX9PTpqn171+kY7tBPy7bV+vJ2qj/7mepnn+X0TOnUXtm422aiSjNaB3kRCsAJwE1eOy7qdXE2Ewotn0x/rSeTywsr1Ysw0/H+WIFUv8YTv9wfu+pFXdR+b1XQFzodpjNvXNzsfp07N722c+fozxZG2G4i1bO1b9/83ARD6yYf6qMbgKeAs7z2BHBDlGvjbCYUWj657BRyVT3lUygkryvsuXrwkU7veKYq6PvspD/iIYWGRsGSIFkg5FswJAvSTHcPlZW5r8NoueRDKCwAynzn5cCCKNfG2UwotHxyebGni+JNN0dcQiFofBl1Ooo7dR3b6iba6fVcrl1Y32RMeXn290qQ7c4pTJWW7TqM0iZfQqGb77ybCQUjKtm+yNIZTdMJl7iFQsJzqJpX9TUGqoI+yWG6B2+mnSebl3EuAnb6dFcHuokgK8tuHUbpkw+hcCqwEpgKTAOWA8OiXBtnM6HQuoliNE2lhopbKGzLOp3ET7Ue0Q/oqafwgCZURbkKhSA33lyN9kHCOcyzytRHrZt8GZp7esbmocD/RL0uzmZCoXUT9Os2qIX5+Kcycge9IAcPDh4/eHDSxA0NqlOn6pqyHlpHmd7MRboVn6Vdp18opLIpBCXLS9VyiTWYPl21Q4em83XoYIbm1k7WQgHYw/vcN6ilurYQzYRC6ybTl2OyYOjaNXhcp07haphkwdBMICxerHrIIaqgH3/jAD2g07xm84QJo3btmk4V5n0URRD6W66xBuaS2vbIRShM8T6fCWhPp7q2EM2EQmmQ7UsnoT6J2vyGXNXMrk2rhvnyS9Xx492bfbvtVKdMUa2vz9jTJwqZrjuxdnuZG1EpSvAa0AlXY/kNYDFwrdffzXNpXeJ9bue7ZjywFHgHGJLuHiYUWj65GEezeTn6yVSohKphZs9W7dvXDRoxQvXjj7NedxSyee5M/q6GkUooRE2d/SMR2co7/oWIPCIi+6S5bCNwmKruBewNHCUiBwDjgKdUdVdc7MM4b97+wDBgAHAUMMmr72yUMBMmNC9juWFD88yeQYSlso46PizNdRjNMq6uXg0nnwzHHOOKGT/7LEydCj16ZDZxhkQp1RlE1L+rYaQiaursK1V1vYgcDAzBeSD9LtUFnkD6wjtt7zXFGaqnef3TgO97x0OBB1V1o6oux+0Y9ov6IEbLJCzddJRSmJnWKEge37Vr8LhOnYJTZ0+c6J00NLhc2HvuCTNnwnXXwfz5cMghzebKpdTo6NGu2I6I+xw92vW7TXN2WGlOI2fCthD+BszzPq8HTvP3pbmuHJgPfAHc6PV9mjTmv97nHcDpvv7fAz9MNb+pj1o+YSqcZP1/EFG9j0ScsTXZZpGp95Gqqi5YoHrAAW7g4MGqS5Y0riV5/PTpwSkioqiPwozomRrXM7KLGIYHeYhTmAXcBSwDtgU6Am9Euda7fluccfqbKYTCnQFC4QcBc40EaoHa3r17x/uXM3Im1QssX8ndkl/+Cd16Rrr9DRtUx41zhuTu3VXvv78xk2mYXSSXKOFUwjIum4J5GRkJ8iEUKoCTgF29857AkVGu9c1xNXApzojc0zfPO97xeGC8b/zjwIGp5rSdQssnLDiqS5f0BuhcfzFHFgpPPKHar58q6PQOP9FurG0ct+222WUeDWr+gLB8zJf8vOkEgiW+MxKkEgrivk+NiPQDVqnqRhE5FPg28AdV/TTFNT2Azar6qYh0Bv4J3AgcAnyiqjeIyDhc+ozLRGQA8EecHWFHnBF6V1UNNRdWV1drbW1t2vUbxaNjx6aF5tNRVQUrVrjjbA2uiWtT/dNWBT75BC65BKZNY3m7b3B23V08w2HZ3zQNlZWwdu2W9eWLsrL0RvXu3d3jplqT0XYQkbmqWh30XVRD88NAvYh8A6fW6Yt7gaeiJ/CMiCwAXgOeUNVZuIyrR4jIEuAI7xxVXQzMAN4EHgPGpBIIRmbEYRCNQiYCAfJnKE1dA1rhj3+EPfekYXoNN7abQP+6BbEKBAh+KeeDhobs7x3XmowSJmwL4W/A697nZcAF3vG8KNfG2Ux9FI1cYgVSGUSjkI0aJNtrk58t6LverNBHOdqd7L+/HtlzQeQ5U51Hbbk+W1CLYrSPsiaj7UAebApzcEnxFgF9vb5FUa6Ns5lQiEYuidRy8R5SzfxF6xdUyTl5ogqVxBz+/jLq9Hxu0/V00fV0Ub31VtW6usjlKzNJJperUMjUhhFFQFviO8NPKqEQVX10JnAgMFFVl4tIX2B6/vYrRpyEqWSiqGrCdNVRA8M6dQrvnzLF2RBE3OeUKTB8+JYx994b7R5+VqxoOgfAnrzJ83yX27mQFziYASyGCy+E8vJm8QpBbLttcP+tt0L79k37ks/DmB7yf8/06S5eImxdfltEeTmMGuVCKtJx663QoUPTvg4dXL9hNCFMWpRCs51CNHL5lRgWJ1BWFu3euaotUlU5SzfnDt026QSu06/poGvppsO5X6GhyXOni4NIeOiE7WpyybaaykU0VfnPbNNZmEuqkYBsvY9EZIaqniwiCwH/QHHyRL8ds8xKiXkfRSMXz5OuXeHLL5v3d+kCX3zRvD+ZVF42Kf7pZTRP4Jxz57Ls0LPo98UCHuQULuQ21rA9AIMHw5NPRp+3a9fgZ/V7SiWz004uS0aCHXeEDz6I9gx++vQJjv5OdW/DSEcu3kdjvc/jgON9LXFulADr1mXW7yc5b1G6/nyT8HyKzNdfw7hxsP/+dP5iDSfwN07lwUaBAC6FUYIo+ZXChN/KlcGeXKNHNxUI4M6TvbaieHXlovozjKwI20IENWBrXJbTbvjKcxarmfooGrkYmnOt9pWL+ijTlA/f4QXV3Xd3J2edpdvw37T3zjWthF/FlCCKcT6qV1euf38/pj4yEpAH76PzgI+AFbhSnMuBd6NcG2czoRCNXKpr5eLOqpqbUIjqGVTBF3oLY7Ue0eVU6c/3/qeqRvec8pe+DGoi6V1Qo0YrJ4i6tlz//vmex2gd5EMoLAG6RxlbyGZCIRq5pjjI5RdmLkIhikA4hGd0Kbuogt7OGO3CegVn1M00xiLV+CgG7wRRXviZ/F3y8Qs/nzsOo/TJh1B4DKiIMraQzYRCNIr5QohLKHRhvd7OGFXQJfTT7/Fs4Pz+XUBYLWf/GP/uJGh8lOeJIoxyjf/IlFQZY422Rz6Ewj64FNh3AbclWpRr42wmFKJRzBdCVKGQSVnLQ3lal9FX6xG9hbFawRdZCR3VzHcTHTsGj+/Ysfm8qYRRVLfVfGE7BcNPKqEQNSHeq8ALwEKgMdOKqk4LvagAmEtqNIqZDC2KS2pNjSuQ4/doqqho7uHUhS+4gXGcz50s4Rucxb28wHfTzp+Kdu2CA/HKy6GuLrg/KNdQlKR0fgrtahr2N04OGDTaBqlcUqPuFF6KMq7QzXYK0ShmioNUwW+ZBKZ9j2eb7A4682XK8VF/cWeq3spl5+OnGLs38z4yEpCHncJEYCXwd1zt5YRAieDpHh+2U4hGvgLI8n3voN1AMp3ZwPWMZyy3sZR+nMl9KXcH0DQ4LR1x7BRqauDMM2Hz5i3ft28P99235Ve5BaUZxSQfqbNPwxXBeQmY6zV7G5cIYQFaqQK3/Km2u3d3LZu022Up/oWlEwgH8hLz2Zux3MbtnM9evJFWIKg2FQjpUoaH1YEO6+/cOX3/2LFNBQK487Fjt5wH5TdqUifaMIpF2BaiFJqpj6KRqYokyKfd3zJxZ42iGmpmtOUrvYHLtI4yXU6VHsrTka/1q0Wi+uZH8VBKEEXtky8VU74x9ZGRgGy9j4DLfMc/SvruV6muLUQzoRCNTD1Pouj5o9ojMhUI+zBXFzJAFfQuztWufJ7xHIkXfxweN1HmzFQIFwILXjP8pBIK6dRHw3zH45O+OypPmxUjZjJVVUTJq5Pvil3t2MyV/JI57E831nE0szmPKXzBVhnPtWEDTJgQT96gKH/Lysrga8P6C8GECc3VdYm/k2H4SScUJOQ46LzplyI7i8gzIvKWiCwWkbFe/zUi8oGIzPfaMb5rxovIUhF5R0SGZPQkRijDh6evXeAnSpK4fLI7b/MS3+GXXM0MTuabLOIxjs5pzpUrw0typi7VmZoof8uWWLvAEusZkQnbQrgdhivDmXwcdB5wbU9gX+94K+DfQH/gGuDSgPH9gTeAjrga0MuA8lT3MPVRPERR0STUR+n01KnmEOr1Qn6rG+ika6jUH/CnjFVFoXNLcVUmLU1/b8Frhh9ysCnUA58D64E67zhxvjnVtQFz/Q04IoVQGA+M950/DhyYak4TCvGQ7oWbSKYX5aUbNsfOrNQnOUwVdCbH6Q58mDeB4Nfft7SXc7Ewm4LhJ2uhkK8G9AHew6XevgaXbXUBcC+wnTfmDuB03zW/B36Yal4TCtFJTquQKrgr1YvW/2LNzujaoMO5Xz9la/2crno2dys05F0gJISCsQUTkEaCVEIhUvBaLohIV+A5XH3nR0RkB2AtoMB1QE9VPUtE7gReVtXp3nW/B2ar6sNJ840ERgL07t174MqgCCCjCYcfDk891bw/LMgrarBbWVnTc//1iQAv/1zd+ITJjOJk/sQLHMSP+QPL2SXaQ2RBzP+0DaNkyUfwWrY3bg88DNSo6iMAqvqRqtaragNwN7CfN3wVsLPv8l5AUv0qUNUpqlqtqtU9evSIc/mthiCBkKo/KpkYco/kcRbyLb7PXxnH9RzCc7EKBMMwsiM2oSAiglMBvaWqN/v6e/qGnQgs8o5nAsNEpKOI9AV2BV6Na31G7kRxz+zEV9zGBTzOUfyX7difOdzIOBoosIuTYRiRiHOncBBwBnBYkvvp/4nIQhFZAAwCLgZQ1cXADOBNXP2GMaqaQd5JoxD4awmndc+cN4+5DOQC7uC3jKWaWuazT0HW2bVrQW5jGK2O2G0KcWIJ8aKRaUK8MFuBn1GjYNKkkC/r6+Gmm+DKK1m9uQcjmMqTHBF5vbnSrh1MnWopoQ0jjKLZFIzSZM8904+ZMiXki/fecxbsceNg6FDO/96CQIHQqVNuawyjqsoEgmHkQrtiL8Boebz1VvoxgQVlHnoIfvpTl3P6vvtgxAj+Wh68Tfn669zWGETK3YthGJGwnUKJki4ldC5E0Sg2SYXx+ecwYgQMGwZ77AHz58NPfgIiBXULDd29GIYRGRMKJUiitOLKle4FvnKlO89GMGQrUA491Dt45RXYZx+YPh2uvhqefx769ct8wjyQSTlMwzCCMaFQguQz42W2AuXdJfVw3XVw8MEuUu1f/4JrrnFW3iJR6ER+htEaMaFQguQ742WmAmVn3mPqe4PgqqvglFOcuuiggzK+b1CMQy6EVUszDCM6JhRKkDhSQkcVKD/kTyzg2+zNfLj/frfF2GabrO4ZFOOQDeXlZmQ2jHxhQqEEOeaYzPqjkE6gVPAl93A2f+Jk3mF39mEenH569jfEuY2uWOG0TytWuPNUMRVh1NWZQDCMfGFCoQSZMSOz/nSkKxi/F/OZy0DO5D5+xXgO5gXeJR5jcqbeSv37x7IMw2izmFAoQcJKYWZTIjN1FTblAm5jDvuzFesZzFNM4FfU0T7zG0UkU2Pxl1/Gsw7DaKuYUGhljB7tHIBEmuYpCiOhtkmmkrXM5ARuYyyPM4S9eINnGRTLmv1kaiy2cpKGkV9MKJQgZSn+q02evMVfv77enWfKITzLG+zFkfyTC7mVofyNT+ie1VrDbARh/ZMmOaNx1B1DLsZ1wzCaY0KhBEkUsMk7dXVw9dU8zWF8QVcO4BVu50Ig3Pqbbmfy058GXxfWD04w1NWltxeks4UYhpE5lvuoBCkvjyF6d9UqOO00eP557ufHjOFOviR1/unRo5vuRPw7k3x4A6WyF1RVOYFgie8MI79Y6uwSJBu3zTBUgVmzXO6ijRth8mTkx2dEujZMOJWXu1/64HYP6caEEaXcp2EYmWOps0uYoMR3lZXBYzt0yGzu9myCn/0Mjj/eKedffx3OiCYQBg8O3634+6OMCaNbt8z6DcPIHRMKLZiwxHdhrqebNjU3QocZpfuwnBc4GG65Bc4/H15+GXbbLaP1hRmD/f1RxhiG0XIwodCCCUt8l4pktUqQmuVEHmEe+7Ab/4Y//xluvz3jqjdPPRXuPurvjzImjHXrMus3DCN3YhMKIrKziDwjIm+JyGIRGev1dxORJ0Rkife5ne+a8SKyVETeEZEhca2tVMi3D34HNnIbF/AIP+Df7OZSVfzgB1nPl+w+GpSDKMqYMEx9ZBiFJzZDs4j0BHqq6usishUwF/g+8BNgnareICLjgO1U9XIR6Q88AOwH7Ag8CeymqqHa59ZuaO7ePbso5SB2YRkPcQrVzOVmLmYcN7CZDqGG3CjE7aMQ9vyVlbB2bbz3NozWTFEMzar6oaq+7h2vB94CdgKGAtO8YdNwggKv/0FV3aiqy4GlOAFh5MhJPMzr7Es/ljGUv3IJN7OZDK3SRcDUR4ZReApiUxCRPsA+wBxgB1X9EJzgALb3hu0EvO+7bJXXlzzXSBGpFZHaNWvWxLruYpPrLqEDG7mVC3mYH/I2e7AP85jJ0CZj8l3KM5/EkSLcMIzUxC4URKQr8DBwkap+nmpoQF8zBYWqTlHValWt7tGjR76W2SLJxUOnihU8z3e5kNu5hYv4Ls+zkj7NxuVSyjNuJk4MLsRjUcyGER+xCgURaY8TCDWq+ojX/ZFnb0jYHT72+lcBO/su7wWsjnN9LZ1so5aP4++N3kUn8gg/45aU6qJsS3lGJSjWIgrDh7uYOr+ResQIi2I2jDiJ0/tIgN8Db6nqzb6vZgIjvOMRwN98/cNEpKOI9AV2BV6Na32lQKrEd0GUU8cNXM7fOYF32YWBzOWvnBjpWr+nU5cuEe4VcRcTFmsRRTDU1MDddzdN8Hf33S1zV2MYrYU4vY8OBp4HFgIJb/krcHaFGUBv4D3gR6q6zrtmAnAWUIdTN/0j1T1au/dRJukserKaBxnG93ieyfyUi7mFjUSPPaiqcmm0wb10R4xIvVPp0gW++CL9vH36OEGQ6n5hbLVV8D26doX169Pf2zCMYFJ5H1nuoxZMVKEwiKd5gFPpwpeMZAoPcFpG96moaF5oZ/Ro15dKMET5p5NL/qJUz1/C/2wNo+hY7qMSJZ0aR2hgPL/iCY7gEyrZj1czFghBlddqamDatPxkYjUPIsMoLUwotGBSZZ7YjnXM5AR+xQQe4hT241XeIvOCxUGV14LSayQT1d6RiwdRpgV6DMPIHRMKLZiwOIV9mctcBnIk/2Q0dzKcmrS1DzIhSnqNqKmrhw93O5GqKvcyT10TuinZFOgxDCM3rMhOSaGcwz3cwfn8h//hYF7gtRiCvnv3DjYO+6mqij7f8OHZuZEm8iMlbBvl5c5zKR8FfAzDCMZ2CiVCJ77iXs7ibkbyDIMYyNxYBAIEq3ySOeaYWG5tGEaRMaFQAvTlXV7iO5zJVK7lKo7lUT6he2z386t8wpg9O7bbN5Io9+mPU5g8uXkdaMMw8oe5pLZgROAYHmU6pwMwnBr+QX5/oqf7z1/Mkpi5lPI0DCMcc0ktRerruYareZTjWEEfBjI37wIhCsV0Kc2llKdhGNlhQqElsm4dHH88V/NLpjKC7/ASy9kl6+nCXDgHD05/7cSJzVNalJdbUjrDaK2YUGhpzJ8P1dXw5JNc0e13nMl9fE3nSJdm6r+/dGn6MS++2PyXeX296zcMo/VhQqElMX06HHggbNoEzz/PgNvOo6Ii2pt+xx3D7QNh/encTsEZnDPpzydhhu5M3GENw8gMEwotgc2b4cIL4YwzYP/9Ye5c2H//Zqmjw1CFDz6IZ2nF1OtbPQXDKDwmFIrNf/7jlPu33w4XXQRPPAE77ABEz0EUZ/W0MIGUSwGgqOQSDW0YRnaYUCgmc+bAwIHUzanlwu41lN16C312bd/4go+Sgwi21CiIg7B547pfMsOHu/xMDQ3BeZoMw8gvluaiWNxzD4wZw/ptduKIspeZs3YvoOkLPkoOogRRhEc2WKoJw2hbWPBaodm0ydkP7roLhgxhr8V/ZMGqbs2GVVW5AjNhSfHyQVmZ+fwbRlvEgtdaCA/f8SG1Ww+Cu+5i0tbj+OPwR1n4QXOBAJntErLlvPPiv4dhGKVFnDWa7xWRj0Vkka/vGhH5QETme+0Y33fjRWSpiLwjIkPiWlexeOzaV/jOhQPZc+N8fsQMxnx+Pef+tJxuwTKB3r1dDFtUKirC6y907QqjRm0xDpeXu3NTARmGkUycO4WpwFEB/beo6t5emw0gIv2BYcAA75pJIlIA/5YC8fvfM+iaQ/hKO3EAr/BnfgRssQOEuV2mSyWRCFZLeOXcc4/LF+SnXTv43e+cAKirc+6rdXUmEAzDCCY2oaCq/wKi/tYdCjyoqhtVdTmwFGLKC11INm+G88+Hc87hOQ6hmloW8a0mQ9ataxqLUF7uzocPD/bT9wuC++93L/mEV87w4TB1alMXzqlTzWPHMIzoFMOmcL6ILPDUS9t5fTsB7/vGrPL6miEiI0WkVkRq16xZE/das2fNGjjiCLjzTrj0Un5UMZv/0lxX1L5901iE+np3XlMT7KefLAiSMRdOwzByodBCYTLQD9gb+BD4jdcflMsh0C1KVaeoarWqVvfo0SOWRebMvHkuf9GcOS51xa9/zRdfB3v/btrU3J10wwa3Wygrc7EKEycW/iVfU+OC4srK4g2OMwyjZVHQOAVV/ShxLCJ3A7O801XAzr6hvYDVBVxa/njoITjzTKishBdegIEDgcxrDyR2Dv64hUIKhJEjtwirYqzBMIziUNCdgoj09J2eCCQ8k2YCw0Sko4j0BXYFXi3k2nKmoQGuuAKGDYN994Xa2kaBALmlhdiwwe0YCkVQJHWh12AYRnGI0yX1AeBlYHcRWSUiZwP/JyILRWQBMAi4GEBVFwMzgDeBx4Axqlo6YVWffw5Dh8L118O558LTTzfmL0oQlhZi8OD09ZAh97iFTNRBYfdaudJUSYbR6lHVkm0DBw7UorNkieqee6qWl6vecYdqQ0Po0FGj3DBwn6NGuf7p01WrqlRFtnyf3Kqqmo5LnEdh+nTVioqm81VUhF9fVRW8hijXGobR8gFqNeS9WvQXey6t6ELhySdVt9tOtbJS9emn8zJl2At81KjMXux+wl7yVVXR1xD1WsMwWj6phIKlucgGVZfqesgQ2GknePVVGDQoL1OHpYuePTt7PX+YOiis37+GTOc0DKO0MaGQKZs2uaRBF14Ixx4LL70Eu2RfPzmIoFiDqC/2INtBWGR0qojpxBoqK4O/D0vPYRhGaWNCIRPWrnUBaXff7TyN/vIX2Gqrgtw6yos94Uq6cqXbzCRcSY85xiqYGYYRDRMKUVm0CPbbzwWk1dS4N2pZ4f58UUpThrmSzp4dnkojHWFJ+TJJ1mcYRulgQiEKs2bBgQfCV1/Bv/4Fp51WsFsn1EFnnAGdOzt1TlhpypUrg+dYuTI8lUY6slE9GYZRuphQSIUq3HQTnHAC7LYbvPaa2y0UiGR10CefOLl0//3BKS9SBchla6SOskMxDKP1YEIhjI0b4eyz4ec/hx/+EJ5/Hnr1KugSMo0szrSKWhQPojBvKEt3YRitE6vRHMTatXDSSU4QXHUVXH11Qe0HCTJ1Ja2qClYhlZcHC4yoKqBEWm7DMFo/tlNI5s03nYrotdfggQfg2muLIhAgc31+mKpn5EhTARmGEQ0TCn4ee8wZlDdsgGefdcntikim+vwwVc+kSaYCMgwjGuIinkuT6upqra2tzc9kd9wBY8fCt74Ff/877Lxz+msKQE2NsyG8957bIUycaC9zwzByQ0Tmqmp10He2U6ircyUzL7gAjjvO1UBoIQIBMq+kFpYN1YrmGIYRhbZtaP7sMzjlFHj8cbjkErjxxtwKHxSZsOI4L77o4hKsaI5hGOlou+qjFStc7qJ//xsmT4Zzzsnr2opBnz6ZeR9VVbk/g2EYbYtU6qO2uVOYNw+OOsolt3vsMVfpphUQ5qoaFr9gmU4Nw0imbdoUevWCvfaCl19uNQIBwl1VwzRilqrCMIxk4izHea+IfCwii3x93UTkCRFZ4n1u5/tuvIgsFZF3RGRIXOsCoEcP+Oc/YY89Yr1NobE4BcMwciXOncJU4KikvnHAU6q6K/CUd46I9AeGAQO8ayaJSOlafIuExSkYhpErsRqaRaQPMEtVv+mdvwMcqqofikhP4FlV3V1ExgOo6vXeuMeBa1T15VTz5zVOwTAMo43QkuIUdlDVDwG8z+29/p2A933jVnl9zRCRkSJSKyK1a9asiXWxhmEYbY2WYmiWgL7ALYyqTlHValWt7tGjR8zLMgzDaFsUWih85KmN8D4/9vpXAf4w4l7A6gKvzTAMo81TaKEwExjhHY8A/ubrHyYiHUWkL7Ar8GqB12YYhtHmiS14TUQeAA4FuovIKuBq4AZghoicDbwH/AhAVReLyAzgTaAOGKOqGZaMMQzDMHIlNqGgqqeGfBUYLaaqEwHznDcMwygiJZ37SETWACHl6iPRHVibp+WUCm3xmaFtPrc9c9sh0+euUtVAT52SFgq5IiK1Yb66rZW2+MzQNp/bnrntkM/nbikuqYZhGEYLwISCYRiG0UhbFwpTir2AItAWnxna5nPbM7cd8vbcbdqmYBiGYTSlre8UDMMwDB9tUiiIyFFe3YalIjKu2OspBCKys4g8IyJvichiERlb7DUVChEpF5F5IjKr2GspFCKyrYj8WUTe9v6bH1jsNcWNiFzs/dteJCIPiEinYq8pDjKtVZMpbU4oeHUa7gSOBvoDp3r1HFo7dcAlqroncAAwpo08N8BY4K1iL6LA3Ao8pqp7AHvRyp9fRHYCLgSqvVT95bgaLa2RqUSsVZMNbU4oAPsBS1X1XVXdBDwIDC3ymmJHVT9U1de94/W4l0RgevLWhIj0Ao4F7in2WgqFiGwNfA/4PYCqblLVT4u6qMLQDugsIu2AClppUk1V/RewLql7KDDNO54GfD/b+duiUIhcu6G14hU/2geYU+SlFILfApcBDUVeRyHZBVgD3Oepze4RkS7FXlScqOoHwE24nGofAp+p6j+Lu6qCElarJmPaolCIXLuhNSIiXYGHgYtU9fNirydOROQ44GNVnVvstRSYdsC+wGRV3Qf4khzUCaWAp0MfCvQFdgS6iMjpxV1VadIWhUKbrd0gIu1xAqFGVR8p9noKwEHACSKyAqcmPExEphd3SQVhFbBKVRM7wT/jhERr5nBguaquUdXNwCPAd4q8pkISVqsmY9qiUHgN2FVE+opIB5wxamaR1xQ7IiI4HfNbqnpzsddTCFR1vKr2UtU+uP/OT6tqq//1qKr/Ad4Xkd29rsG4tPStmfeAA0Skwvu3PphWblxPIqxWTcbEljq7paKqdSJyPvA4zkPhXlVdXORlFYKDgDOAhSIy3+u7QlVnF29JRoxcANR4P3zeBc4s8npiRVXniMifgddxnnbzaKXRzZnUqslqfotoNgzDMBK0RfWRYRiGEYIJBcMwDKMREwqGYRhGIyYUDMMwjEZMKBiGYRiNmFAw2gwiUi8i830t6yhfEXkpn2tLmrtaRG6La37DSIW5pBptBhH5QlW7FnsdhtGSsZ2C0eYRkRUicq2IvC4iC0VkD6+/h5eb/nURuUtEVopId++7L7zPQ0XkWV/tghovohYRGSgiz4nIXBF5PJGGIOneP/Ly/78hIv/yzTnLO57t29l8JiIjvPoQvxaR10RkgYicV6i/ldH6MaFgtCU6J6mPTvF9t1ZV9wUmA5d6fVfjUmPsC/wF6B0y7z7ARbj6HLsAB3l5pm4HfqiqA4F7gYkB114FDFHVvYATkr9U1WNUdW/gbGAl8Ffv+DNV/V/gf4FzRaRvxL+BYaSkzaW5MNo0X3kv2CASCQLnAid5xwcDJwKo6mMi8t+Qa19V1VUAXgqRPsCnwDeBJ7yNQzkupXMyLwJTRWSGbw1N8HYn9wMnq+pnInIk8G0R+aE3ZBtgV2B5yPoMIzImFAzDsdH7rGfL/xdBadZTXeu/XoDFqpqyDKaq/lRE9scVApovInv7v/cqBT4I/FJVE+UXBbhAVR+PuD7DiIypjwwjnBeAkwG8X+eZ1L19B+iRqI0sIu1FZEDyIBHpp6pzVPUqYC1N07qDS3S2QFUf9PU9DozyVFSIyG6tvYiOUThsp2C0JTr7MsSCq2Gcyi31WuABz/bwHE79sz7KjVR1k6feuU1EtsH9v/ZbIDkj769FZFfcr/+ngDeAQ3zfXwos9q37Klxp0T7A655Rew05lF80DD/mkmoYIYhIR6DeS7d+IK6S2d5FXpZhxIrtFAwjnN64HPVlwCbg3CKvxzBix3YKhmEYRiNmaDYMwzAaMaFgGIZhNGJCwTAMw2jEhIJhGIbRiAkFwzAMoxETCoZhGEYj/x+nldfCwu9gZwAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.scatter(train.ENGINESIZE, train.CO2EMISSIONS,  color='blue')\n",
    "XX = np.arange(0.0, 10.0, 0.1)\n",
    "yy = clf.intercept_[0]+ clf.coef_[0][1]*XX+ clf.coef_[0][2]*np.power(XX, 2)\n",
    "plt.plot(XX, yy, '-r' )\n",
    "plt.xlabel(\"Engine size\")\n",
    "plt.ylabel(\"Emission\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<h2 id=\"evaluation\">Evaluation</h2>\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Mean absolute error: 24.01\n",
      "Residual sum of squares (MSE): 976.08\n",
      "R2-score: 0.64\n"
     ]
    }
   ],
   "source": [
    "from sklearn.metrics import r2_score\n",
    "\n",
    "test_x_poly = poly.fit_transform(test_x)\n",
    "test_y_ = clf.predict(test_x_poly)\n",
    "\n",
    "print(\"Mean absolute error: %.2f\" % np.mean(np.absolute(test_y_ - test_y)))\n",
    "print(\"Residual sum of squares (MSE): %.2f\" % np.mean((test_y_ - test_y) ** 2))\n",
    "print(\"R2-score: %.2f\" % r2_score(test_y_ , test_y) )"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h2 id=\"practice\">Practice</h2>\n",
    "Try to use a polynomial regression with the dataset but this time with degree three (cubic). Does it result in better accuracy?\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "# write your code here\n",
    "poly = PolynomialFeatures(degree=3)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "train_x_poly = poly.fit_transform(train_x)\n",
    "test_x_poly = poly.fit_transform(test_x)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[ 0.         31.49433418  3.60112596 -0.41797878]] [128.67892471]\n"
     ]
    }
   ],
   "source": [
    "from sklearn.linear_model import LinearRegression\n",
    "regr = LinearRegression()\n",
    "regr.fit(train_x_poly, train_y)\n",
    "print(regr.coef_, regr.intercept_)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "mean absolute error 24.00\n",
      "means square error 970.28\n",
      "R2-score: 0.64\n"
     ]
    }
   ],
   "source": [
    "yhat = regr.predict(test_x_poly)\n",
    "\n",
    "print(\"mean absolute error %.2f\"% np.mean(np.absolute(yhat-test_y)))\n",
    "print(\"means square error %.2f\"% np.mean((yhat-test_y) ** 2))\n",
    "print(\"R2-score: %.2f\" %r2_score(yhat,test_y))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Double-click **here** for the solution.\n",
    "\n",
    "<!-- Your answer is below:\n",
    "\n",
    "poly3 = PolynomialFeatures(degree=3)\n",
    "train_x_poly3 = poly3.fit_transform(train_x)\n",
    "clf3 = linear_model.LinearRegression()\n",
    "train_y3_ = clf3.fit(train_x_poly3, train_y)\n",
    "# The coefficients\n",
    "print ('Coefficients: ', clf3.coef_)\n",
    "print ('Intercept: ',clf3.intercept_)\n",
    "plt.scatter(train.ENGINESIZE, train.CO2EMISSIONS,  color='blue')\n",
    "XX = np.arange(0.0, 10.0, 0.1)\n",
    "yy = clf3.intercept_[0]+ clf3.coef_[0][1]*XX + clf3.coef_[0][2]*np.power(XX, 2) + clf3.coef_[0][3]*np.power(XX, 3)\n",
    "plt.plot(XX, yy, '-r' )\n",
    "plt.xlabel(\"Engine size\")\n",
    "plt.ylabel(\"Emission\")\n",
    "test_x_poly3 = poly3.fit_transform(test_x)\n",
    "test_y3_ = clf3.predict(test_x_poly3)\n",
    "print(\"Mean absolute error: %.2f\" % np.mean(np.absolute(test_y3_ - test_y)))\n",
    "print(\"Residual sum of squares (MSE): %.2f\" % np.mean((test_y3_ - test_y) ** 2))\n",
    "print(\"R2-score: %.2f\" % r2_score(test_y3_ , test_y) )\n",
    "\n",
    "\n",
    "-->\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "button": false,
    "new_sheet": false,
    "run_control": {
     "read_only": false
    }
   },
   "source": [
    "<h2>Want to learn more?</h2>\n",
    "\n",
    "IBM SPSS Modeler is a comprehensive analytics platform that has many machine learning algorithms. It has been designed to bring predictive intelligence to decisions made by individuals, by groups, by systems – by your enterprise as a whole. A free trial is available through this course, available here: <a href=\"http://cocl.us/ML0101EN-SPSSModeler\">SPSS Modeler</a>\n",
    "\n",
    "Also, you can use Watson Studio to run these notebooks faster with bigger datasets. Watson Studio is IBM's leading cloud solution for data scientists, built by data scientists. With Jupyter notebooks, RStudio, Apache Spark and popular libraries pre-packaged in the cloud, Watson Studio enables data scientists to collaborate on their projects without having to install anything. Join the fast-growing community of Watson Studio users today with a free account at <a href=\"https://cocl.us/ML0101EN_DSX\">Watson Studio</a>\n",
    "\n",
    "<h3>Thanks for completing this lesson!</h3>\n",
    "\n",
    "<h4>Author:  <a href=\"https://ca.linkedin.com/in/saeedaghabozorgi\">Saeed Aghabozorgi</a></h4>\n",
    "<p><a href=\"https://ca.linkedin.com/in/saeedaghabozorgi\">Saeed Aghabozorgi</a>, PhD is a Data Scientist in IBM with a track record of developing enterprise level applications that substantially increases clients’ ability to turn data into actionable knowledge. He is a researcher in data mining field and expert in developing advanced analytic methods like machine learning and statistical modelling on large datasets.</p>\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "| Date (YYYY-MM-DD) | Version | Changed By | Change Description    |\n",
    "| ----------------- | ------- | ---------- | --------------------- |\n",
    "| 2020-08-04        | 0       | Nayef      | Upload file to Gitlab |\n",
    "|                   |         |            |                       |\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<hr>\n",
    "\n",
    "<p>Copyright &copy; 2018 <a href=\"https://cocl.us/DX0108EN_CC\">Cognitive Class</a>. This notebook and its source code are released under the terms of the <a href=\"https://bigdatauniversity.com/mit-license/\">MIT License</a>.</p>\n"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python",
   "language": "python",
   "name": "conda-env-python-py"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.11"
  },
  "widgets": {
   "state": {},
   "version": "1.1.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}