3. Adult Census Income - Evaluation Metrics and Feature Importance.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Evaluating tuned machine classifier\n",
    "\n",
    "Using Cross Validitation we will check the following evaluation metrics:\n",
    "\n",
    "\n",
    "* ROC curve and AUC\n",
    "* Confusion Matrix\n",
    "* Classification Report\n",
    "* Precision, Recall and F1 scores\n",
    "\n",
    "First of all to make comparison and evaluate our trained model, we need to make predictions."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 72,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(6513,)"
      ]
     },
     "execution_count": 72,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Make predictions with best tuned model\n",
    "y_preds = rs_cat.predict(X_test)\n",
    "y_preds.shape"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### ROC curve: comparing the true positive rates to false positive\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 73,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<sklearn.metrics._plot.roc_curve.RocCurveDisplay at 0x2154dfc64c0>"
      ]
     },
     "execution_count": 73,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEGCAYAAABo25JHAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjMsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+AADFEAAAgAElEQVR4nO3deXwUVbbA8d/JQhaWIAGU1QREWcKiBAR3BhlABdwBlVFnhKeCzLg9dZxBRHzjuM1zYdxGB/EhuI0IMyig4IayhH1REFkkoIAQwpaEEM77ozptJ+kkHZLqTnef7+eTj11Vt6tOJVKn6t5b94qqYowxJnrFhDoAY4wxoWWJwBhjopwlAmOMiXKWCIwxJspZIjDGmCgXF+oAqqpx48aalpYW6jCMMSasLFu27GdVbeJvW9glgrS0NLKyskIdhjHGhBUR2VbeNqsaMsaYKGeJwBhjopwlAmOMiXKWCIwxJspZIjDGmCjnWiIQkddEZLeIrC1nu4jIsyKySURWi8hZbsVijDGmfG4+EUwGBlSwfSDQzvMzCnjBxViMMcaUw7X3CFT1cxFJq6DIEGCKOuNgLxKRhiLSTFV/dCsmY0zgyhuift/hoxw5WlRi3YH8QnKPFIIEI7Kqyy8sYkdOHgnxsaEOpVJrd+TSMCne77a+HU6ma6uGNX7MUL5Q1gLY7rOc7VlXJhGIyCicpwZat24dlOCMCQd7DhawY38eeaUuzPsOH+VQQSEx4lyZt+49TGxMjPc6raqs2L6fpvUTATh2/Dgrt+/nlAaJ5BcWsSo7N5inYfwQP0m1aYPEiEsE/u4d/N6CqOrLwMsAmZmZNpOOiUi7D+az7/BRlm7ZR1KdONbuyGXe+l20OCmJGIGV2/dzXOHoseM1etwWDZNQVQqOHSe7KI+WJyWR0aIBMSL0TGtEvcSSl4mD+cdIS00mqU7J9apKq0bJNRpbTYqNEZqlJIY6jErFx8ZwcoPgxhnKRJANtPJZbgnsDFEsxpSgquw+WEB2zhE27jpEYnzJ5rS1Ow6QUurx/UBeIdtzjnjXr87OpVHdOmX2/e1PB0mMiyEu1tnnD/uOVBjLjv159ExvRJcWDck5cpTmDZNof0p9EuJjyTl8lI7NG1AvIY7G9RJKfC8hPoYmPuua1E8gMQyqRkzwhTIRzATGiMh04Gwg19oHTCjlHD7KXz/6lt0HC5j/7e4T3k+9hDjqJ8ZRdFzZ/PNhurZMKbG9TeO67DqYT/dTTwKg+6knsf/IUVqclETnFikUHYfzTmtMfJxwcv1EYmJqacW7iRiuJQIRmQZcBDQWkWzgISAeQFVfBGYDlwCbgCPAzW7FYkxpqsqrX25hyZZ9zF2/q8z22Bih1UlJ/KZ3Gi1PSqJNk3rE+VyQY2OE5g2TynxPwC7cJuy42WtoeCXbFRjt1vGN2X0wn8827CExPpaHZ62nQ7P6LN26j/xC/3Xsl3ZuRpsmdbnlvDakJPvvtWFMJAq7YaiN8fXD3iPkHDkKwONzvmXLnsPszM33W/aL7wrIaNGAY0VKar06NEtJ4pbz02l/SoNghmxMrWOJwISN/UeO8u6ybFZu38+cdT9RWOS/A1lynVjOTm9E84ZJpNZLYHDXZsTGxJCWmoz465NnTJSzRGBCTlX5MTefvYeOsvtgPt/+dJD1Ow/QuF4dXv96GzECcbExfrtN9kxvxNDMVpxUN57CIuXs9EY0TC7bU8cYUz5LBCbojhUdZ9bqncz/dg9J8TG8nZVdbtmk+FjyCosY0etUjh47zskNEvjteekk17H/dY2pKfavyQRFwbEiXv9qK0/M2VCmSidGoG6dOP7Q73RaN0qmcb06dGjWwPq8GxMklgiMK1Zt38/yH3J4eNZ6v9t7tWnEhCEZtG1Sj1jrbmlMSFkiMDVm76ECuk/82O+29qfUp1ebVEZe0IYWfvrfG2NCxxKBqZb8wiL+b9E2np63scSIlBd3OJmBGafQu22q3xevjDG1hyUCc0KKjitt/zi7zPrLuzXnb0O7WTdNY8KIJQJzQnyTwEVnNOGxK7twShiM7GiMKcsSgamSpVv3cc2LX3uXv3t0IPGxNvW1MeHMEoEp195DBWzde4TNew4xYdZ6DhYc826LixGWj+tnScCYCGCJwJSx4aeD9P/fz/1u65nWiGE9W3HlWS2DHJUxxi2WCIzXc598x1PzNpZYN+6yjpzcIJHTmtbj9JPrWSOwMRHIEoHhnndW8e6yksM8/G1oVy7v1sIu/MZEAUsEUWrx5r188+MBxvu8+Xvuaak8PLgTpzWtH8LIjDHBZokgynz1/c9c98riMuvf+F1Pzm/XJAQRGWNCzRJBFCg6rryTtZ37/7WmxPrnhp9J77apZSY9N8ZEF0sEEe6jtT9y6/8t9y4nxccyfnBHhvZoHcKojDG1iSWCCPXdroP0+9svXUDrxMXw5X/3oWkDe/vXGFOSJYII1O/pz/hu9yHv8ug+bbm3f/sQRmSMqc0sEUSQfy3P5q63V3mXH7k8gxvObm1dQI0xFbJEEAH2HCygx6Ml5wGYd+cFtDvZuoEaYypniSDMrc7ez+DnF3qXX7spk1+1PzmEERljwo0lgjBV+n2Ak5LjWTHu1yGMyBgTriwRhKG8o0XeJHBScjx/ubIL/TvZU4Ax5sRYIggzuXmFdH14LgD9Op7MK7/JDHFExphwZ4PJh5HsnCPeJADw8ojuIYzGGBMpLBGEiVmrdnLeXxcA0LR+Alsfu9S6hRpjaoQlgjBxx7QVAPRt35QlD14c4miMMZHEEkEtt2TLPtLu/w8A8bHCqzf1CHFExphI42oiEJEBIrJBRDaJyP1+trcWkQUiskJEVovIJW7GE27mrvuJa1/6ZaL4GaPPDWE0xphI5VqvIRGJBSYB/YBsYKmIzFTV9T7F/gS8raoviEhHYDaQ5lZM4WTEq4v54rufARia2Yq/Xt0lxBEZYyKVm91HewKbVHUzgIhMB4YAvolAgQaezynAThfjCRtTvt7qTQITL8/ghl6nhjYgY0xEczMRtAC2+yxnA2eXKjMemCsidwB1Ab+toCIyChgF0Lp1ZI+jX3RcGffBOgBe+U0m/Trai2LGGHe52Ubgr2+jlloeDkxW1ZbAJcAbIlImJlV9WVUzVTWzSZPInE5xy8+H+e93V9H2j7MBSEmKtyRgjAkKN58IsoFWPsstKVv18ztgAICqfi0iiUBjYLeLcdU6OYeP0ufJT73LIpD1J+siaowJDjcTwVKgnYikAzuAYcB1pcr8APQFJotIByAR2ONiTLXSWRPnAdAwOZ7P7ulDSnJ8iCMyxkQT1xKBqh4TkTHAHCAWeE1V14nIBCBLVWcCdwOviMidONVGN6lq6eqjiKWqXPDEAorPePmf+hETY28LG2OCy9VB51R1Nk6XUN9143w+rweisnP8tr2HufCJT73L79za25KAMSYkbPTREPh+zyH6PvWZd/mbCQNIqhMbwoiMMdHMhpgIsvzCIm8SuLhDUzZMtCRgjAkteyIIsg7jPgKgfmIcr/wm00YQNcaEnD0RBNE5f/nE2zC8atyvLQkYY2oFeyIIgo/W/sit/7fcu/z+7edYw7AxptawROCyDn/+iLzCIu/y+gn9Sa5jv3ZjTO1hVyQX/eOLzd4kMH5QR246Nz3EERljTFmWCFzyX29kMWfdLgBmjz2fjs0bVPINY4wJDUsELrji7wtZ8cN+AEb3aWtJwBhTqwWUCESkDtBaVTe5HE/YW7/zgDcJTL3lbM49rXGIIzLGmIpV2n1URC4F1gDzPMvdROR9twMLV5c8+wUA9/Y/w5KAMSYsBPIewQScCWX2A6jqSuA0N4MKVw++v8b7eXQf+xUZY8JDIImgUFX3l1oXNSOEBmrznkNMXfwDAIv/2DfE0RhjTOACaSP4RkSuBWI8cwv8Hljkbljhp+/TzvhBt17YlpMbJIY4GmOMCVwgTwRjgO7AceBfQD5OMjAeby7+wTt0xH0DzghtMMYYU0WBPBH0V9X7gPuKV4jIlThJIeqpKg/NXAvAgnsusvGDjDFhJ5Angj/5WfdgTQcSrk578EMKi5TmKYmkN64b6nCMMabKyn0iEJH+OBPLtxCRp302NcCpJop6l09aSNFxp07owz9cEOJojDHmxFRUNbQbWIvTJrDOZ/1B4H43gwoHWVv3sXK705nqmWHdSEmyCeeNMeGp3ESgqiuAFSIyVVXzgxhTWJi0wHnJ+q1RvTi7TWqIozHGmBMXSGNxCxF5FOgIePtFqurprkVVy2XnHGHBhj0AlgSMMWEvkMbiycA/AQEGAm8D012MqdYbP3M9AGP7tgtxJMYYU32BJIJkVZ0DoKrfq+qfgD7uhlV7qSoff+MML/0HSwTGmAgQSNVQgTid478XkVuBHUBTd8OqvT7+ZjcATesn2HSTxpiIEEgiuBOoB4wFHgVSgN+6GVRtNnJKFgD/uDEzxJEYY0zNqDQRqOpiz8eDwAgAEWnpZlC11RuLtnk/d26REsJIjDGm5lTYRiAiPUTkchFp7FnuJCJTiMJB59Zk5/LnGc5QEp/aUBLGmAhSbiIQkb8AU4HrgY9E5EFgAbAKiLquo4Oe/xKA685uTZoNJWGMiSAVVQ0NAbqqap6INAJ2epY3BCe02mPH/jzv5/+5onMIIzHGmJpXUdVQvqrmAajqPuDbaEwCAH/98FsAHhrUMcSRGGNMzavoiaCNiBQPNS1Ams8yqnplZTsXkQHAM0As8A9VfcxPmWuB8Tiznq1S1esCDz849h0+CsBN56SFNhBjjHFBRYngqlLLz1dlxyISC0wC+gHZwFIRmamq633KtAMeAM5V1RwRqXXvJyzblsOXm34mJSneGoiNMRGpokHnPqnmvnsCm1R1M4CITMdpd1jvU2YkMElVczzH3F3NY9a4615xOkiN7tM2xJEYY4w7Ahli4kS1ALb7LGd71vk6HThdRBaKyCJPVVIZIjJKRLJEJGvPnj0uhVuWqlJwzJl6YdQFlgiMMZHJzUTgrx5FSy3HAe2Ai4DhwD9EpGGZL6m+rKqZqprZpEmTGg+0PPe/twaA4T1bB+2YxhgTbAEnAhFJqOK+s4FWPsstcbqgli7zgaoWquoWYANOYgi5/MIi3spyHmjuH9g+xNEYY4x7Kk0EItJTRNYA33mWu4rIcwHseynQTkTSRaQOMAyYWarMDDwjmXreXj4d2FyF+F1T3FPo3NNSbfYxY0xEC+SJ4FngMmAvgKquIoBhqFX1GDAGmAN8A7ytqutEZIKIDPYUmwPsFZH1OG8t36uqe6t+GjXvpwPOpGwDMpqFOBJjjHFXIKOPxqjqtlJdJ4sC2bmqzgZml1o3zuezAnd5fmqVxzwvkZ3WpF6IIzHGGHcFkgi2i0hPQD3vBtwBbHQ3rNA6flxZsmUfAGe2LtN2bYwxESWQqqHbcO7YWwO7gF6edRFrw66DAJyamkxifGyIozHGGHcF8kRwTFWHuR5JLbJos9NM8cDADiGOxBhj3BfIE8FSEZktIjeKSH3XI6oFVmfnAtC7bWqIIzHGGPdVmghUtS0wEegOrBGRGSIS0U8I3+12qoas26gxJhoE9EKZqn6lqmOBs4ADOBPWRKy1Ow7QPCUx1GEYY0xQBPJCWT0RuV5EZgFLgD3AOa5HFiLb9h4GoGkDSwTGmOgQSGPxWmAW8LiqfuFyPCHX7+nPAfivC9qEOBJjjAmOQBJBG1U97noktcCGnw5ytMg51QEZp4Q4GmOMCY5yE4GIPKWqdwPviUjpUUMDmqEs3Hz8zS7AmZLSJqExxkSLip4I3vL8t0ozk4WzpVudt4mHdCs9bYIxxkSuimYoW+L52EFVSyQDERkDVHcGs1ol72gRn25wJr1pVLdOiKMxxpjgCaT76G/9rPtdTQcSSnsOFtBh3EcApDeuG+JojDEmuCpqIxiKM4dAuoj8y2dTfWC/24EF05uLfwCgfmIc8+++MMTRGGNMcFXURrAEZw6ClsAkn/UHgRVuBhVs2/Y57w6s+HM/ayQ2xkSditoItgBbgI+DF05o/Gv5DhLiYoiLdXMKZ2OMqZ0qqhr6TFUvFJEcSk46LzhzyjRyPbog2OQZV6jgWFS8KmGMMWVUVDVUPB1l42AEEipffPczAH+9qnOIIzHGmNAoty7E523iVkCsqhYBvYH/AiKma82rX24B4LIuzUMciTHGhEYgleIzcKapbAtMAToAb7oaVZCs33mA7Jw8AOomBDLahjHGRJ5AEsFxVS0ErgT+V1XvACLi1dv//diZenlMn9NCHIkxxoROIIngmIhcA4wA/u1ZFxEztsxd74wtdE//M0IciTHGhE6gbxb3wRmGerOIpAPT3A3LffmFRQA0qZ8Q4kiMMSa0Kq0YV9W1IjIWOE1E2gObVPVR90NzV3Fvocu6NAtxJMYYE1qVJgIROR94A9iB8w7BKSIyQlUXuh2cm7798QAAV53VMsSRGGNMaAXSVeZvwCWquh5ARDrgJIZMNwNzW25eIQBpNsicMSbKBdJGUKc4CQCo6jdA2I/TvPlnZ3yhhDgbVsIYE90CeSJYLiIv4TwFAFxPBAw6t3N/HknxscTb+ELGmCgXSCK4FRgL/DdOG8HnwHNuBhUM2/cdoUOz+qEOwxhjQq7CRCAinYG2wPuq+nhwQnLf4YJjHD5aRGJ8bKhDMcaYkCu3XkRE/ogzvMT1wDwR8TdTWVhati0HgD5nNA1xJMYYE3oVVZBfD3RR1WuAHsBtVd25iAwQkQ0isklE7q+g3NUioiISlJ5I87/dDUCvNqnBOJwxxtRqFSWCAlU9DKCqeyopW4aIxOLMbDYQ6AgMF5GOfsrVx2mDWFyV/VfHkaPHAOjUvEGwDmmMMbVWRW0EbXzmKhagre/cxap6ZSX77onzFvJmABGZDgwB1pcq9wjwOHBPVQKvjrezsqlbJ5aYGJuW0hhjKkoEV5Vafr6K+24BbPdZzgbO9i0gImcCrVT13yJSbiIQkVHAKIDWrVtXMYySjhU50ywUqVZS0hhjokNFcxZ/Us19+7vd9l59RSQG563lmyrbkaq+DLwMkJmZWa0r+M79+QDcdE56dXZjjDERw823qbJxZjcr1hLY6bNcH8gAPhWRrUAvYKbbDcaHPe0DHa19wBhjAHcTwVKgnYiki0gdYBgws3ijquaqamNVTVPVNGARMFhVs1yMid0HC9zcvTHGhJ2AE4GIVGngflU9BowB5gDfAG+r6joRmSAig6sWZs1ZvHkvAOmpNticMcZAYMNQ9wReBVKA1iLSFbjFM2VlhVR1NjC71Lpx5ZS9KJCAq2vf4aMAtLfhJYwxBgjsieBZ4DJgL4CqrsKZsSwsFY86aoPNGWOMI5CrYYyqbiu1rsiNYIJCoX5CIGPtGWNMdAjkirjdUz2knreF7wA2uhuWe7758QCdW6aEOgxjjKk1AnkiuA24C2gN7MLp5lnlcYdqi4MFx9h/pDDUYRhjTK0RyOT1u3G6foa94reK259iDcXGGFMskF5Dr+DzRnAxVR3lSkQuWrxlHwAtT0oKcSTGGFN7BNJG8LHP50TgCkqOIRQ29nheJrPhp40x5heBVA295bssIm8A81yLyEVHPVVDrVOTQxyJMcbUHifSmT4dOLWmAwmGtTtyAXuHwBhjfAXSRpDDL20EMcA+oNzZxmqzJZ42gtS6dUIciTHG1B6VTV4vQFdgh2fVcdXwHci/YXI8AHH2RGCMMV4VXhE9F/33VbXI8xO2SaBYz7RGoQ7BGGNqlUBujZeIyFmuRxIE+w4fJS7Wpqc0xhhf5VYNiUicZyjp84CRIvI9cBhn5jFV1bBKDoVFx9m46xAnJVv7gDHG+KqojWAJcBZweZBicdXmPc6oow2S4kMciTHG1C4VJQIBUNXvgxSLq3bm5gFwxZktQhyJMcbULhUlgiYicld5G1X1aRficU1xy4B1HTXGmJIqSgSxQD1+uYaGteL+TgnxsaENxBhjapmKEsGPqjohaJG47LgnE0REVjPGmBpUUffRiLpmFj8RxEhEnZYxxlRbRYmgb9CiCALvE4HlAWOMKaHcRKCq+4IZiNuO2xOBMcb4FTWD7hSPjhETNWdsjDGBiZrL4q4D+QBIZDV9GGNMtUVNIoiPc041IS5qTtkYYwISNVfF4ieBpDr2HoExxviKmkRgjDHGv6hJBErYT6VgjDGuiJpEUMyaio0xpqSoSwTGGGNKcjURiMgAEdkgIptEpMyE9yJyl4isF5HVIvKJiJzqVizhP8mmMca4w7VEICKxwCRgINARGC4iHUsVWwFkqmoX4F3gcbfi+SUw149gjDFhxc0ngp7AJlXdrKpHgenAEN8CqrpAVY94FhcBLV2MxxhjjB9uJoIWwHaf5WzPuvL8DvjQ3wYRGSUiWSKStWfPnhMKxmqGjDHGPzcTgb9KGL/XYxG5AcgEnvC3XVVfVtVMVc1s0qRJNYOyuiFjjPFV0cQ01ZUNtPJZbgnsLF1IRC4GHgQuVNUCF+Mxxhjjh5tPBEuBdiKSLiJ1gGHATN8CInIm8BIwWFV3uxiLdRsyxphyuJYIVPUYMAaYA3wDvK2q60RkgogM9hR7Amde5HdEZKWIzCxndzXGpiMwxpiS3KwaQlVnA7NLrRvn8/liN49vjDGmclHzZrFVDBljjH9RkwiKWc2QMcaUFHWJwBhjTElRkwis05AxxvgXNYmgmFi3IWOMKSHqEoExxpiSoiYRqNUNGWOMX1GTCIpZxZAxxpQUdYnAGGNMSVGTCKxiyBhj/IuaRFDMOg0ZY0xJUZcIjDHGlBQ1icA6DRljjH9RkwiK2QxlxhhTUtQlAmOMMSVZIjDGmCgXNYnAmgiMMca/qEkEXtZEYIwxJURfIjDGGFNC1CQCG3TOGGP8i5pEUMzeLDbGmJLiQh2AiV6FhYVkZ2eTn58f6lCMiRiJiYm0bNmS+Pj4gL9jicCETHZ2NvXr1yctLc1mjjOmBqgqe/fuJTs7m/T09IC/F31VQ6EOwHjl5+eTmppqScCYGiIipKamVvkpO+oSgaldLAkYU7NO5N9U1CQC6zRkjDH+RU0iKGZ3oMZXbGws3bp1IyMjg0GDBrF///4a2e/WrVvJyMiokX2NGzeOjz/+uNr7qVevHgDHjx9n7NixZGRk0LlzZ3r06MGWLVuqvf/yVPa7ePLJJ2nfvj0ZGRl07dqVKVOmMH78eB544IES5VauXEmHDh387uPqq69m8+bN3uUVK1YgIsyZM6fCOMaPH8+TTz5ZYSzV9frrr9OuXTvatWvH66+/7rfMqlWr6N27N507d2bQoEEcOHAAgHnz5tG9e3c6d+5M9+7dmT9/vvc7F198MTk5OdWOD6IwERjjKykpiZUrV7J27VoaNWrEpEmTQh1SGRMmTODiiy+usf299dZb7Ny5k9WrV7NmzRref/99GjZsWO39Hjt2rMrfefHFF5k3bx5Llixh7dq1fP7556gqw4cP56233ipRdvr06Vx33XVl9rFu3TqKiopo06aNd920adM477zzmDZtWrVjqY59+/bx8MMPs3jxYpYsWcLDDz/s9+J9yy238Nhjj7FmzRquuOIKnnjiCQAaN27MrFmzWLNmDa+//jojRozwfmfEiBH8/e9/r1Z8xaKm15DaaEO12sOz1rF+54Ea3WfH5g14aFCngMv37t2b1atXA3Do0CGGDBlCTk4OhYWFTJw4kSFDhrB161YGDhzIeeedx1dffUWLFi344IMPSEpKYtmyZfz2t78lOTmZ8847z7vf/Px8brvtNrKysoiLi+Ppp5+mT58+TJ48mRkzZlBUVMTatWu5++67OXr0KG+88QYJCQnMnj2bRo0acdNNN3HZZZeRlpbGLbfcAuD9jqry/fffM3r0aPbs2UNycjKvvPIK7du3Z8uWLVx33XUcO3aMAQMGeOP58ccfadasGTExzn1gy5Ytvdvmzp3LQw89REFBAW3btuWf//wn9erVY8KECcyaNYu8vDzOOeccXnrpJUSEiy66iHPOOYeFCxcyePBgbrjhBm699Vbv3fkLL7xA8+bNKSoqYuTIkWV+Z//zP//DggULaNCgAQApKSnceOONADRs2JDFixdz9tlnA/D222+XuMMvNnXqVIYMGeJdVlXeffdd5s2bx/nnn09+fj6JiYmV/v0riuVEzZkzh379+tGoUSMA+vXrx0cffcTw4cNLlNuwYQMXXHCBt0z//v155JFHOPPMM71lOnXqRH5+PgUFBSQkJDB48GDOP/98HnzwwWrFCFH4RGAVQ8afoqIiPvnkEwYPHgw4fbHff/99li9fzoIFC7j77ru9d4ffffcdo0ePZt26dTRs2JD33nsPgJtvvplnn32Wr7/+usS+i58y1qxZw7Rp07jxxhu9vTrWrl3Lm2++yZIlS3jwwQdJTk5mxYoV9O7du0y1RGZmJitXrmTlypUMGDCAe+65B4BRo0bx3HPPsWzZMp588kluv/12AH7/+99z2223sXTpUk455RTvfq699lpmzZpFt27duPvuu1mxYgUAP//8MxMnTuTjjz9m+fLlZGZm8vTTTwMwZswYli5dytq1a8nLy+Pf//63d3/79+/ns88+4+6772bs2LFceOGFrFq1iuXLl9OpU6dyf2cHDx7k4MGDtG3b1u/fZPjw4UyfPh2ARYsWkZqaSrt27cqUW7hwId27dy+xnJ6eTtu2bbnooouYPXu23/37qiwWX0888QTdunUr8zN27NgyZXfs2EGrVq28yy1btmTHjh1lymVkZDBz5kwA3nnnHbZv316mzHvvvceZZ55JQkICACeddBIFBQXs3bu30pgrEzVPBKZ2q8qde03Ky8ujW7dubN26le7du9OvXz/Auav84x//yOeff05MTAw7duxg165dAKSnp9OtWzcAunfvztatW8nNzWX//v1ceOGFgPPY/uGHHwLw5ZdfcscddwDQvn17Tj31VDZu3AhAnz59qF+/PvXr1yclJYVBgwYB0LlzZ+/TSWlvv/02y5cvZ+7cuRw6dIivvvqKa665xru9oKAAcC6IxUlqxIgR3HfffYBzMdqwYQPz589n/vz59O3bl3feeYe8vDzWr1/PueeeC8DRo0fp3bs3AAsWLODxxx/nyJEj7Nu3j+TsZQQAAA4MSURBVE6dOnljHTp0qPfY8+fP9yaw2NhYUlJSyMnJ8fs7U9UK2+yGDRvGOeecw1NPPcX06dPL3EUX+/HHH2nSpIl3edq0aQwbNsy7jzfeeIMrr7yy3GOJSKWx+Lr33nu59957Ayrrr2rJ33Fee+01xo4dy4QJExg8eDB16tQpsX3dunXcd999zJ07t8T6pk2bsnPnTlJTUwOKpzyuJgIRGQA8A8QC/1DVx0ptTwCmAN2BvcBQVd3qRizWa8j4U9xGkJuby2WXXcakSZMYO3YsU6dOZc+ePSxbtoz4+HjS0tK8d/HFd2TgXOzy8vIqvJBUVM/su6+YmBjvckxMjN8693Xr1vHQQw/x+eefExsby/Hjx2nYsCErV670u//yYkpISGDgwIEMHDiQk08+mRkzZvDrX/+afv36lalXz8/P5/bbbycrK4tWrVoxfvz4Ev3U69atW+75+TvP4t9ZgwYNqFu3Lps3by5Rv1+sVatWpKWl8dlnn/Hee++VedIqlpSU5I2nqKiI9957j5kzZ/Loo496X7A6ePAgqampZern9+3bR3p6eqWx+HriiSeYOnVqmfUXXHABzz77bIl1LVu25NNPP/UuZ2dnc9FFF5X5bvv27b0X+Y0bN/Kf//ynxHeuuOIKpkyZUuaJJT8/n6SkpArjDYRrVUMiEgtMAgYCHYHhItKxVLHfATmqehrwN+CvbsXzS1xuH8GEo5SUFJ599lmefPJJCgsLyc3NpWnTpsTHx7NgwQK2bdtW4fcbNmxISkoKX375JUCJC8UFF1zgXd64cSM//PADZ5xxRpVjzM3NZdiwYUyZMsV7B9ygQQPS09N55513ACfprFq1CoBzzz3XW7XiG8/y5cvZuXMn4PQgWr16Naeeeiq9evVi4cKFbNq0CYAjR46wceNG70W2cePGHDp0iHfffbfcGPv27csLL7wAOBfl4t4v5XnggQcYPXq0t9yBAwd4+eWXvduHDx/OnXfeSdu2bUu0Zfjq0KGDN+aPP/6Yrl27sn37drZu3cq2bdu46qqrmDFjBvXq1aNZs2Z88skngJMEPvroI297TmWxFLv33nu9VXS+P6WTAED//v2ZO3cuOTk55OTkMHfuXPr371+m3O7duwHn7zFx4kRuvfVWwKl2u/TSS/nLX/7ifVIrpqr89NNPpKWllf8LDpCbbQQ9gU2qullVjwLTgSGlygwBivtTvQv0FevfaULkzDPPpGvXrkyfPp3rr7+erKwsMjMzmTp1Ku3bt6/0+//85z8ZPXo0vXv3LnGXdvvtt1NUVETnzp0ZOnQokydPLnGHHKgZM2awbds2Ro4c6a2XBuci/+qrr9K1a1c6derEBx98AMAzzzzDpEmT6NGjB7m5ud797N69m0GDBpGRkUGXLl2Ii4tjzJgxNGnShMmTJzN8+HC6dOlCr169+Pbbb2nYsCEjR46kc+fOXH755fTo0aPcGJ955hkWLFjg7e64bt26Cs/ptttuo0+fPvTo0YOMjAwuvPBCkpOTvduvueYa1q1b563q8efSSy/13nVPmzaNK664osT2q666ijfffBOAKVOmMHHiRLp168avfvUrHnroIe9ddmWxnIhGjRrx5z//mR49etCjRw/GjRvnbTi+5ZZbyMrK8sZ9+umn0759e5o3b87NN98MwPPPP8+mTZt45JFHvH/z4qSxbNkyevXqRVxc9St2xK3hmUXkamCAqt7iWR4BnK2qY3zKrPWUyfYsf+8p83OpfY0CRgG0bt26e2V3Z/7MW7+LGSt28NS1XUmMjz3R0zI16Jtvvim3X7gxgcrLy6NPnz4sXLiQ2Njo+bf9+9//nsGDB9O3b98y2/z92xKRZaqa6W9fbj4R+LuzL511AimDqr6sqpmqmunbKFQV/TqezKTrz7IkYEyESUpK4uGHH/bbGyeSZWRk+E0CJ8LNxuJsoJXPcktgZzllskUkDkgB9rkYkzEmAvmrd490I0eOrLF9uflEsBRoJyLpIlIHGAbMLFVmJlD8xsbVwHy1qcSiiv25jalZJ/JvyrVEoKrHgDHAHOAb4G1VXSciE0RksKfYq0CqiGwC7gLudyseU/skJiayd+9eSwbG1JDi7rKBvEnty7XGYrdkZmZqcUu7CW82Q5kxNa+8Gcoqaiy2N4tNyMTHx1dpFiVjjDuibqwhY4wxJVkiMMaYKGeJwBhjolzYNRaLyB6g6q8WOxoDP1daKrLYOUcHO+foUJ1zPlVV/b6RG3aJoDpEJKu8VvNIZeccHeyco4Nb52xVQ8YYE+UsERhjTJSLtkRQdnDxyGfnHB3snKODK+ccVW0Exhhjyoq2JwJjjDGlWCIwxpgoF5GJQEQGiMgGEdkkImVGNBWRBBF5y7N9sYikBT/KmhXAOd8lIutFZLWIfCIip4YizppU2Tn7lLtaRFREwr6rYSDnLCLXev7W60TkzWDHWNMC+H+7tYgsEJEVnv+/LwlFnDVFRF4Tkd2eGRz9bRcRedbz+1gtImdV+6CqGlE/QCzwPdAGqAOsAjqWKnM78KLn8zDgrVDHHYRz7gMkez7fFg3n7ClXH/gcWARkhjruIPyd2wErgJM8y01DHXcQzvll4DbP547A1lDHXc1zvgA4C1hbzvZLgA9xZnjsBSyu7jEj8YmgJ7BJVTer6lFgOjCkVJkhwOuez+8CfUXE37SZ4aLSc1bVBap6xLO4CGfGuHAWyN8Z4BHgcSASxroO5JxHApNUNQdAVXcHOcaaFsg5K9DA8zmFsjMhhhVV/ZyKZ2ocAkxRxyKgoYg0q84xIzERtAC2+yxne9b5LaPOBDq5QGpQonNHIOfs63c4dxThrNJzFpEzgVaq+u9gBuaiQP7OpwOni8hCEVkkIgOCFp07Ajnn8cANIpINzAbuCE5oIVPVf++VisT5CPzd2ZfuIxtImXAS8PmIyA1AJnChqxG5r8JzFpEY4G/ATcEKKAgC+TvH4VQPXYTz1PeFiGSo6n6XY3NLIOc8HJisqk+JSG/gDc85H3c/vJCo8etXJD4RZAOtfJZbUvZR0VtGROJwHicrehSr7QI5Z0TkYuBBYLCqFgQpNrdUds71gQzgUxHZilOXOjPMG4wD/X/7A1UtVNUtwAacxBCuAjnn3wFvA6jq10AizuBskSqgf+9VEYmJYCnQTkTSRaQOTmPwzFJlZgI3ej5fDcxXTytMmKr0nD3VJC/hJIFwrzeGSs5ZVXNVtbGqpqlqGk67yGBVDed5TgP5f3sGTscARKQxTlXR5qBGWbMCOecfgL4AItIBJxHsCWqUwTUT+I2n91AvIFdVf6zODiOuakhVj4nIGGAOTo+D11R1nYhMALJUdSbwKs7j4yacJ4FhoYu4+gI85yeAesA7nnbxH1R1cMiCrqYAzzmiBHjOc4Bfi8h6oAi4V1X3hi7q6gnwnO8GXhGRO3GqSG4K5xs7EZmGU7XX2NPu8RAQD6CqL+K0g1wCbAKOADdX+5hh/PsyxhhTAyKxasgYY0wVWCIwxpgoZ4nAGGOinCUCY4yJcpYIjDEmylkiMLWOiBSJyEqfn7QKyqaVN0pjFY/5qWeEy1We4RnOOIF93Coiv/F8vklEmvts+4eIdKzhOJeKSLcAvvMHEUmu7rFN5LJEYGqjPFXt5vOzNUjHvV5Vu+IMSPhEVb+sqi+q6hTP4k1Ac59tt6jq+hqJ8pc4/05gcf4BsERgymWJwIQFz53/FyKy3PNzjp8ynURkiecpYrWItPOsv8Fn/UsiElvJ4T4HTvN8t69nnPs1nnHiEzzrH5Nf5nd40rNuvIjcIyJX44znNNVzzCTPnXymiNwmIo/7xHyTiDx3gnF+jc9gYyLygohkiTMPwcOedWNxEtICEVngWfdrEfna83t8R0TqVXIcE+EsEZjaKMmnWuh9z7rdQD9VPQsYCjzr53u3As+oajecC3G2Z8iBocC5nvVFwPWVHH8QsEZEEoHJwFBV7YzzJv5tItIIuALopKpdgIm+X1bVd4EsnDv3bqqa57P5XeBKn+WhwFsnGOcAnCElij2oqplAF+BCEemiqs/ijEPTR1X7eIad+BNwsed3mQXcVclxTISLuCEmTETI81wMfcUDz3vqxItwxtAp7WvgQRFpCfxLVb8Tkb5Ad2CpZ2iNJJyk4s9UEckDtuIMZXwGsEVVN3q2vw6MBp7Hmd/gHyLyHyDgYa5VdY+IbPaMEfOd5xgLPfutSpx1cYZc8J2d6loRGYXz77oZziQtq0t9t5dn/ULPcerg/N5MFLNEYMLFncAuoCvOk2yZiWZU9U0RWQxcCswRkVtwhux9XVUfCOAY1/sOSicifueo8Ix/0xNnoLNhwBjgV1U4l7eAa4FvgfdVVcW5KgccJ85MXY8Bk4ArRSQduAfooao5IjIZZ/C10gSYp6rDqxCviXBWNWTCRQrwo2eM+RE4d8MliEgbYLOnOmQmThXJJ8DVItLUU6aRBD5f87dAmoic5lkeAXzmqVNPUdXZOA2x/nruHMQZCtuffwGX44yj/5ZnXZXiVNVCnCqeXp5qpQbAYSBXRE4GBpYTyyLg3OJzEpFkEfH3dGWiiCUCEy7+DtwoIotwqoUO+ykzFFgrIiuB9jjT+a3HuWDOFZHVwDycapNKqWo+zsiO74jIGuA48CLORfXfnv19hvO0Utpk4MXixuJS+80B1gOnquoSz7oqx+lpe3gKuEdVV+HMVbwOeA2nuqnYy8CHIrJAVffg9Gia5jnOIpzflYliNvqoMcZEOXsiMMaYKGeJwBhjopwlAmOMiXKWCIwxJspZIjDGmChnicAYY6KcJQJjjIly/w8A5uzw3s9FKgAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Plot ROC curve and calculate AUC metric\n",
    "plot_roc_curve(rs_cat,\n",
    "              X_test,\n",
    "              y_test)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Confusion matrix:\n",
    "\n",
    "Will give us a performance measurement for the machine learning classification problem we are analysing. Let's create now a function to plot this matrix using Seaborn Heatmap."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 74,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAOQAAADzCAYAAACWhLquAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjMsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+AADFEAAAgAElEQVR4nO3dd1gU1xrA4d+C0hUlYgPEChYQsSuiIipi1wBW7IklVqIGjS323jWxBDsWxIq9YWKNvXeIIiAWikoVmPsHsslmQXdh0fV63ufJc++ead+sfDvnnDlzRiZJkoQgCFpB53MHIAjCP0RCCoIWEQkpCFpEJKQgaBGRkIKgRURCCoIWEQmpgrdv3+Ln50fHjh2pUaMG1apVw8PDg61bt5Kenp6nx5YkiTlz5lCnTh2qVavGpk2bNLp/X19fbG1tNbrPj9mxYwe2trbY2tpy+PDhbNebOnUqtra2NGnSJEfHSUlJISoqSuV4zp8/n6PjaJJIyI8ICQnh22+/Zf78+dja2uLj48PQoUPR19dnwoQJjB49mry8lRscHMzq1aupVq0aP//8M/Xq1dPo/jt16sTs2bM1uk91HDt2LNtlx48fz/F+w8PDadOmDadPn/7ourVq1WL27NmUK1cux8fTlHyfOwBtlpyczKBBg4iNjWX79u1UrFhRvqxPnz788ssv+Pv7U7VqVXr06JEnMdy7dw8AHx+fPLmSOTo64ujoqPH9qsLS0pLg4GDS0tLQ1dVVWHbr1i3Cw8MxMzPL0b6fPn3K33//rdK6VlZWWFlZ5eg4miaukB/g7+9PaGgoY8aMUUjGTD/99BOmpqZs2bIlz2J49+4dAMbGxnl2jM/F1dWV2NhYLl26pLTsyJEjlCpVivLly3+GyD4fkZAfsG/fPoyMjGjVqlWWyw0MDNi2bRu7du1SKL948SK9evWSX3169OjBhQsXFNZp0qQJEyZMYPfu3bRq1Qp7e3uaN2+u0EZs0qQJS5cuBTL+eDPbUk2aNMHb21spnv+Wx8XF4evrS+PGjbGzs6Np06bMmzeP5ORk+TpZtSHDw8MZNWoUdevWxd7enrZt27Jt2zaFdXx9fWnRogXXr1+ne/fuODg4UL9+faZOnUpSUlK23+m/OTk5YWhomGXV9OjRozRr1izL7c6ePUu/fv2oU6cOVapUwdnZmQkTJvD69Wsgo02YWWMZM2aM/PyWLFmCvb09R44cwcnJCUdHRwICAhTakOnp6XTu3JkqVapw9+5d+TEfP35MtWrV6NKlS572G4iEzIYkSdy5cwc7Ozvy58+f7XqlS5dGT09P/vnYsWN4e3sTGRnJwIEDGThwIJGRkfTq1UupvfTnn38ybdo03NzcGDNmDIaGhkyePJmTJ08CMHbsWPkf5ZgxYxg7dqxa5zB8+HBOnDiBp6cnEydOpHbt2qxcuZKpU6dmu01YWBgeHh4cO3YMLy8vRo8ejampKePHj1dqa0ZHR9O3b1/Kli3Lzz//TPXq1dmwYQOLFy9WKT4DAwOcnJyUvpe///6bBw8eZJmQp06dok+fPiQmJjJ06FB+/vlnqlatytatW5kxYwaQ0SYcMGAAoNxGTk1NZdy4cfTs2ZO+fftSo0YNhf3r6Ogwffp0dHV1mTRpEpIkkZ6eztixY5HJZMyaNQsdnTxMG0nI0qtXryQbGxtpxIgRKm/z7t07qWHDhlKjRo2kN2/eyMvj4uIkZ2dnydnZWUpJSZEkSZJcXFwkW1tb6c6dO/L1nj9/Ltna2ko+Pj7yssWLF0s2NjZSWFiYvMzFxUXq3r270vH/Xf7y5UvJxsZGWr16tcI6vr6+Us+ePeWff/rpJ8nGxkb+efjw4VLFihWlmzdvysvS0tKk/v37S7a2ttL9+/cVtlu/fr3C/t3d3aUGDRp88HsKDAyUbGxspHPnzkk7duyQbGxs5PuVJElauXKl5OTkJKWnp0vdu3eXXFxc5Mv69u0rubi4SMnJyQr79PLykhwdHeWfz507J9nY2EiBgYHysszvcvHixdnGk2nFihWSjY2NFBAQIK1bt06ysbGRNm/e/MHz0gRxhcxG5q9gWlqaytvcvn2bZ8+e0a1bN0xMTOTlBQsWpHv37kRFRXHz5k15eZkyZRTapubm5hQpUoSXL1/mOv4CBQpgZGSEv78/hw4dIiEhAYAZM2awdu3aLLdJS0sjODiYBg0aUKVKFXm5jo4OAwYMQJIkpeqlu7u7wueKFSvy6tUrleNs3Lgxurq6ClfJo0eP0rRpU2QymdL6K1asIDAwUKFWEhMTg4mJifwcP6ZBgwYfXadv377Y2dkxb948FixYgLOzM507d1Zp/7khEjIbpqam5M+fn+joaJW3efr0KZCRaP9VtmxZACIiIuRlWfUg6unpaaSNoqenx+TJk3n16hVDhw6lTp069O3bl61btyq0If8tJiaGhISELOPPvCUQHh6uUP7fc9DT01PrR6xw4cLUqFFDnujPnz/n2rVrNG/ePMv1dXV1CQsLY9KkSXTv3p2GDRtSt25dTp06pfLtp2+++eaj6+jq6jJt2jSio6NJSUlh2rRpKp9TboiEzIZMJsPR0ZGbN2+Smpqa7XoLFizAx8eHFy9efPAPInPZv9ujmm6L/DcR2rRpQ3BwMNOmTaNx48ZcvXqVCRMm4OXlRUpKSrYxZiXzR+LfVybQzDm4urpy/fp1nj9/ztGjRylYsCC1a9fOct0tW7bg6enJuXPnKF26NP369WPbtm20adNG5eOpGnNm729qauoH75dqkkjID2jWrBkJCQns378/y+VJSUls376dM2fOUKhQISwsLICMwQT/FRoaCkDx4sVzHZeOjo5SQqWmphITEyP/HB8fz8WLF5HJZHh4eLBkyRLOnj1Ljx49uHv3LqdOnVLar5mZGUZGRnke/381bdoUSZIIDg7m2LFjuLi4kC+f8i3y5ORkZs6cSZ06dQgKCmLq1Kn06NEDBwcHtWoyqoiIiGDevHk4OzvToEED5syZo1Q7yAsiIT+gU6dOWFhYMGvWLO7fv6+wLC0tjUmTJvHy5Uu+++478ufPT5UqVTA3N2fz5s28fftWvu7bt2/x9/fH3NwcOzu7XMdVpEgRQkNDFW4vHD9+XKEq+uDBA7p168b27dvlZXp6elSuXBlA6UZ8ZpmzszOnT5/m1q1b8nJJkli1ahUymYzGjRvnOv7/srS0pGLFigQFBXH+/Plsb3ckJSWRmJhI6dKlFRL2zp07/PXXXwDy2kzm+eW0+j9+/HjS0tKYOHEiEyZMIDU1lQkTJuRoX+oQI3U+QF9fn6VLl9KnTx88PDxo06YN9vb2xMbGcvDgQe7cuUOLFi3o3bs3kFEdHT9+PMOHD+fbb7/Fw8MDgO3bt/P8+XMWL16skSpe69atmTJlCv369aNt27Y8fvyYbdu2ya/QAA4ODtSsWZMFCxYQGRmJra0tkZGRbNy4kbJly2Y7BG/kyJGcP38eb29vvL29MTc358iRI5w7d47evXvn2Y36pk2bsnTpUoyMjLLtdDE1NcXBwYEdO3ZgYmJCmTJlePDgAQEBAfLvNT4+HlNTUwoXLgzAnj17kCSJDh06qBxLYGAgp06dwsfHRz6Cp3///ixZsoSAgAA8PT1zebbZEwn5EZUrV2b37t2sXbuWP/74g/379yNJEra2tkyfPp2OHTsq9Aa6ubnh5+fH8uXLWbZsGfny5cPBwYFp06ZRs2ZNjcTUtWtX+XC+KVOmULFiRZYuXYqfn5+8p1Emk7Fs2TKWLl3KiRMn2Lp1K6ampjRv3pxhw4YptQUzlSpVim3btrFw4UK2bNlCUlIS5cqVY9q0afIfmLyQmZDOzs4YGBhku96iRYuYMWMGgYGBpKSkYGFhwffff0+5cuUYMmQI586dw83NjXLlyuHt7c2OHTu4ceMGderUUSmO58+fM3PmTMqXL0+fPn3k5d9//z179+5l1qxZNGzYkGLFiuX6nLMik1TtmhIEIc+JNqQgaBGRkIKgRURCCoIWEQkpCFrk/7aX9d1L5ZvbQs4YlnT+3CH8X0lNyX6AgbhCCoIWEQkpCFpEJKQgaBGRkIKgRURCCoIWEQkpCFpEJKQgaBGRkIKgRURCCoIWEQkpCFpEJKQgaBGRkIKgRURCCoIWEQkpCFpEJKQgaBGRkIKgRURCCoIWEQkpCFpEJKQgaBG15tSRJImnT5/Kp1cPDQ1l27Zt5MuXj44dO2b5GjNBEFSn8szlz549o2/fvujp6bFz505evnxJy5Yt5e91NzQ0ZNOmTfKXuXxuYpIrzRGTXGmWRia5mj9/PpGRkXTp0gWAbdu28fr1axYuXMixY8coUaKEyu+WFwQhayon5OnTp+nZsydeXl5AxuvPSpQoQYsWLbCwsMDLy4vLly/nWaCC8DVQOSHfvHmDpaUlAK9eveLWrVs4O/9TlTE0NPzgm4YFQfg4lROyZMmS8peW7tu3DwAXFxf58j///FOesIIg5IzKvaytW7dm+fLlPH78mPPnz1OiRAmcnZ158uQJ06dP5+TJk/j6+uZlrILwf0/lhBw8eDC6uroEBQVRvXp1Ro8eTb58+Xj79i0XL15k4MCB9OzZMy9jFYT/e7l+YWt6ejppaWnkz59fUzFphLjtoTnitodmfei2R65ftqOjoyN/v7sgCLmTbUJWrFgRmUym1s5kMhm3b9/OdVCC8LXKNiHbt2+vdkIKgpA7uW5DaivRhtQc0YbULI2+HzI6OpqgoCBWrlzJ06dPiY6O5tGjR7kKUJvcexhKtUZtWPb7xmzXCY+Mws7J/YP//XX5ep7GefjEn3zb8wdqNmlPy0592RSwW2mdd+/e8dsaf1p17kfNJu3x7D2Y/UeC8zQugObNGhF8fAevYx8SG32fQwe2UKd29Y9u51S/FieOBfI69iGPQy+yeNE0vvmmcJ7HC9D/+x7cvHGSN3EPuXL5KF5ebZXWKVDAhPnzfuHvkIskvA3l4f1zTJn8k0Y7NNXq1PHz82PRokUkJycjk8mwt7cnPj6eIUOG0LlzZyZMmPBFV3NTU9MYN23eR0ccFS5kyowJo5TKk5OTmb7gV8wKF8K2fN49+XLo+J/8OH469Wo54tnencvXbjFj4W8kJSfTt7uXfL1fZi9hz8FjdGzdnEo25Qk+dY7Rk2bxNj4Br/Yt8yS2hs51Cdq7kVu37zF+wizy5dNlQP+eHD+2ncYuHblw8WqW2zVqWI/9+zYRG/uambOWkJaWxtAh/XBxccK5YTtiY+PyJF4AnxH9mT1rAgHb97Jo0Srat2uB/8ZfkSQICNgjX2/7ttU0alSPVas3cePGHerWrcFPowdTqVIFPDz7aSQWlause/fuZdSoUbRu3ZpmzZoxbNgw1qxZQ+nSpZkxYwZHjhxhzJgx9OjRQyOB5VZOqqy/rfFnxbrNvHuXysA+3fihb3e1tp+58Df8A/eyZsksalSzU/v4qkhLS8Pdqw8lihXFb8lMdHV1Afjpl9kc//MsR3esx7RgAe4/CqVjj0H06eaBz6C+QMbjc12/H0Fk1HNO7N6k8o+nOlXWC38dwqxwIeyqNiIxMQmAokWLcPN6MJcv36BFyy5Zbnfl8lHKlS1NtequhIQ8BsDWthxXLh1l6VI/RvtOUTkGdZiaFuRx6EX27D1Ej55DgIzOyeNHt2NtbUV5m7qkp6fTpk1zdgauYcjQsfz62zr59lMm/8QY36E0bNSOM2cvqnRMjVRZ/fz8cHJyYu7cudSuXVtenvmUR6NGjQgICFB1d1rn/qNQVqzbzIBeXXO8vX/gXtq1bJrrZNy17wh2Tu6ER0YpLbt64w4Rz57j0c5dnowAXb9tQ2JiEifP/AXAi5fRVLatQPtWzeXryGQyajjY8fJVDK9iYnMVY1YKFTLFoWpltm/fK09GgOfPX/LHn+eoV69mlttZW1tib1eJjZsC5ckIcO/eI4L2HcHb2zNXcU0Y75NtErRu3QwTE2NWrFgvL5MkiV9XrKNUKQvqv4+5ccP6AKzfoPg3HrB9L0C256YulRPy0aNHNGnSJNvlLi4uhIWFqR1AeHg4p06d4uDBgxw+fJizZ8/y7NkztfeTGxlV1QXUrelIa7fsz/FDFq9Yh76+HkO/Ux6t9Cj0MUPHTKaemwc1m7Sn+4AfOX3+Uo6Oc+vuAwAq25ZXKK9kU05huVOdGmzzW0xZayuF9e49DMHI0BDTggVydPwPef36DZXtGrJw8SqlZUW+Mcu2KWBRsjgAN2/eUVr26NHfmJt/g6VlSXlZ3To1OLh/MzGv7hHz6h4H9vlTq2a1HMVco3pVAC5fuaFQfuXKzYzlNRwAmDp9ITVqNSc+PkHpvCDjb0gTVG5DGhsb8+bNm2yXR0REYGRkpPKBDx8+zKJFiwgJCeG/tWaZTIa1tTXDhw+nRYsWKu8zp37ftI0nT8NZPHM8aWnpam9/72EowafP07NLR8yLmCksu/8olB4DR1LErDDf9ehEPt187D8azMCRE5g1cTTuTRupdayoly8BKGb+jUK5np4epgULEBn1XGmb5OQUnoRH4L99L2cvXGHI9z3Iny/XY0KUpKen8/BhqFK5vX0l6tevxeHDwVluF5+QCGR0mvyXmVlGp07xYuY8fRpBU1dn9uxez7Vrt5g4aQ76+nr07NmJE8cDaeHehVOn/1IrZguLEkRHxyhc0QEi39dOSllZABATE0tMFrWK/v0zmmhnVayufozK/yrOzs74+/vj6empNDLn7t27bNq0icaNG6u0r127duHr64u7uztDhgzB2toaY2NjJEkiPj6ex48fc+jQIUaMGMG7d+9o06aNWieljochj/ltjT8/+wyieFHzLKuJH7N1ZxC6ujp081DumZu+4FcKFzJl25qlGBkaANDVoy19h/oyc9EKmjaqT/78+Yl7/Yb09Iwfg4TEjD/Q12/eyLfR19PDyMiQhPd/vAb6BkrHMtDXU/rDAtiyM4g5SzKuWo5VK9O5Q2u1zzGnjI2NWOO3CIDZc5Zluc7t2/eJi3tNhw4tmTV7qbxcX1+f5s0aA2BgoI9MJmPZ0plcuHAVF9dv5d/XsuVruHThCAsWTKFWbTcAhd5ZIyNDpbKEhEQSE5MoYGJMQoLyd5b5PRoZG2Z7bt26fcu3HVtx4sRp/rpw5aPfhSpUTsgff/wRDw8PWrVqRa1atZDJZGzdupVNmzYRHByMiYkJw4YNU2lfK1eupEuXLkycODHL5ZUrV8bd3Z1JkyaxYsWKPEvItLQ0xk2fT/WqVfBo656jfSQlJxN06ASNnepSsngxhWWxca+5eOUGXT3akpycTHJysnyZa8P6zF6ykht37lO9ahU8ew8m4pni1c2z9xD5/2/n3pRp434kPT2jNpFdf0xWwxgd7SuzeOYEHoU+4feN2+jy3XA2rZhP4UKmOTpnVRkaGrBrx1qqOVRh5qwl/PHnuSzXe/fuHQsXrWTihJFsWL+UWbOXoqury+RJozF+nxCpqWk4VrOjXLnSrFi5nsKFFWPft+8Iw4d/j4VFCcLDI4mKvKl0nH+XTZ4yj8lT5qOjo6NUQwPkZZnf93+1bt2MVSvmEhkZRZ9+w1X7QlSgckIWK1aMwMBA5s+fz7Fjx5AkiYMHD2JoaIirqysjR46UT371MeHh4TRt2vSj67m6urJz505VQ1TbGv9A7j0MYf2vc4l5363++n21PCkpmZjYOEwLFvjgWN2/Ll0jITERtybKPZFh4ZEA+G/fg//2PUrLAZ5FvQBg5sTRJCenAHDmr8us8d/OzAmj+OZ9la3o+6qw8ftf++TkFPkvf6ak5BT58n+rWqUiAE2c61HZtjz9fcaxKWA3g7/Lux5xU9OC7Nm1Dien2vit2cy48TM/uP7UaQspZGrK4MF96NK5AwB7gw4zZ+5yZkz/meiYWKpWzZivafasCcyeNSHL/VhZliQ8PBK3Fp3lZd27e+Dd3UOhLCQ0o/Pozdu3GBoq1zYyv9u3b94qLevUqR1rfl/ImzfxtG7rTVhYxAfPTR1qNSSKFi3KzJkzkSSJmJgY0tLSMDMzU+jtU4WVlRWnTp3Cycnpg+sFBwdTvHhxtfatjlPnL/LuXSpdsviFW+O/nTX+2zm0fS0WJYplsXWGP89eJH/+fDSsX0tpWdr7KlWXjm1o0rBeltuXL2MNQPWqVeRlUc8z2omOVasoHbtEMXMAXryKxtrIQl6ekpJC3Os3FC2i2Lb8L6c6NShgYszt+3k3mMPc/Bv27/PHsZodK1dtZNAPP310G0mS+HHUJGbNWUqF8mUIexrBkyfhTJn8E6mpqTx+/BRHx4ze6wkTZ3P+fNbTxdy99xCAY8f/lJc5OdVSKsv05EkEZmaF0NPTIyUlRV5e8n1HU3iEYgfjd/26s3TJdKKjY3Fz78z165odu612yz4uLo7Tp08THh6Orq4upUqVom7dupiYKDfIszNgwABGjRrF8+fPad68OWXKlMHExASZTMbbt2/lbcigoCB++eUXdUNU2ajB3/H6P7+Ar6Jj8J08hzYtXGnbwpUiZh8eKXLlxi3sKtlgYmystMzifRVWV1eHerUcFZY9Cn3M08goDAz01Yq50vve1dv3HmJt9U9C3nmfYHaVbAD4feM21m3ZyV7/lQo9qqmpaSQlJ2Ogr6fWcVVlYmIsT8aFC1cycrRq/36dOrXjWeRzTv5xlufvf5AAnBvU4fLl6yQnJ/P476cAvH0br5RcNWs4YGZWKMs29IdcuXoDHR0dqjlUUWgHVquW8QN58V8DGbp39+DX5bMyrsDunbl796Fax1KFWgm5dOlSVq1apdAWgowe2NGjR9OpUyeV9tO6dWt0dXVZsGAB+/btU7pBLUkSlpaWTJ8+nQ4dOqgTolqqVKygVJbZqWNZsrhSEv3Xu9RUHv39BM9s2p/mRcyoUrECuw8cpU83T4q+7xl9l5rK+OkLuPcwlGO7NqgVs6N9ZYp8U5itO4Nwa+Isr077B+7F0NCARk51ALCyKEF0TCwBuw/Qz/uf0Tv+2/fw7l0qjerXznL/ubVk8XQcq9mxaPFqlZMRYPjQ7zA0MqRGzeakpWXcQmjp7kqDBnXo1Sejb+LipWtERDxj8A99+N3PX34LokABEzb7/4a+vh5lyql3Xvv3HyMxMZEffujNX70yElImkzGwf0/+/juMc++vxBUrlue35bN4/vwlrs08s+xN1gSVE3LdunUsXbqUunXr0r17d6ysrJAkidDQUNatW8ekSZMwMTGhVatWKu3P3d0dd3d3wsLCCAkJ4e3bt0iSRIECBShTpgylSpXK8UlpWlh4JFdv3qGaXSWsLErIyyOfPefdu1SKFyua7bZjRgyk7xBfvPoOoXOH1hQyLcj+I8Fcv32P4QN6U8i0oNI27Vs1o32rZlnuT1dXlxEDevPztPkMHDmBZo0bcOHyNfYdCWbk4H4UMMm4Ujdr3IB6tRxZsmod4ZFRVLIpx7Wbd9hz8Bj1a1fP8f3WD6lYsTze3T2IjY3j2rVbdO3aUWkdf/8dlClTinr1anL27EVCQ58AMHvucgK2rmLPrnXs3HWA0qWtGD7sOw4dOoG//w4AUlNTGTZiPFv8f+PCX4fw8/MnKSmZvn27Ym1tiXfPwfJk/rfJU+Yzecr8LGOOjo5h9pxlTJwwEh0dHU6cOE3HDi1xdq5Lpy795T25E8b/iIGBAQHbg6hd25HatRV/rG/cuMONG8r3UdWl8tA5Nzc3LC0t+f3335WWpaWl0aNHD16/fs3evXtzHZQm5PRpj/DIKNw8eikMndu17wjjps9n6lgfhUS5cfseXb4bzoRRQz44NvT2vYcs+30Dl6/dIjU1ldKlLOnu2Y52LbNOOlXs3n+E3zcF8DTiGSWLFaV7p/ZKtzMSEpNYumo9B4/9QXRsHMWLFqFNC1e+79FJrQHRqg6d+/47b5Yv+3DnTT49C3p4e+H3+wL69B3B+g3b5Mu8vNoyetRgKpQvQ1TUCzZv2cnMWUuUqqFNXBowxncoNWs6kJ6ezq1b95g1eyn79h9V+Zz+y2dEfwYO6EXx4ubcfxDKtOkL2bFjn3z50ydXKF48+x/ezF5bVXxo6JzKCVm1alV8fX3p2jXroWX+/v7MnDmT69fz9ikHVYnHrzRHPH6lWRoZy1qhQgWuXbuW7fInT55QunRptQITBEGRygk5fvx4Dh8+zLx584iN/WcIUUJCAuvXr2f79u2MHTs2T4IUhK9FtlXWrObUkSRJXlaoUCFkMhlxcXGkp6djYGBAoUKFOHHiRN5HrQJRZdUcUWXVrBzNOifm1BGET0/MqSN8lLhCapZG59TJSnp6Om/evOHIkSOa2J0gfLVUHhjw5s0bZsyYweHDh0lISMhyhDzAnTu5vzkqCF8rla+Qc+bMYceOHZQvX5569eohSRKtW7emXr165MuXD319fZYsWZKXsQrC/z2Vr5DBwcE0a9aMJUuWEBMTQ7169fD29qZq1arcuXOHbt26ERIi2m2CkBsqXyGjo6Plj0sVLlyYYsWKyUflVKpUCQ8PD60ZNicIXyqVE9LY2Fg+0BagVKlS8he4AtjY2BARobkHNQXha6RyQlatWpUDBw7IR9OXL1+eixcvyjt3QkND0dPLm2fsBOFroXJC9unTh0uXLuHm5kZcXBwdOnQgJCSEPn36MGnSJNavX0+dOnXyMlZB+L+nckLWq1ePlStXUqZMGQoWLEjVqlWZNGkSV69eZcuWLVSuXJkxY8bkZayC8H8v1yN1UlJSSEpKomBB5QdtPycxUkdzxEgdzcrTNyjr6emJtqMgaIh4g7IgaBHxtIcgaBHxtIfwUaINqVl5/rSHIAiaIRJSELSISEhB0CIiIQVBi4iEFAQtIhJSELSIRgcGgJjCQxByQ62BAUePHiU5OZkGDRpQtmxZ0tPTCQsL4+TJk5iYmODp6ZnnAQvC/7NsE3LmTMWXpmzYsIETJ06we/duypQpo7Ds6dOndO3aVYzsEYRcUrkNuXr1anr16qWUjACWlpZ0796dgIAAjQYnCF8blRPyzZs3H3yqIz09XeGV0IIgqE/lhKxWrRobNmwgKipKadnDhw9Zu3YttWvnzVt5BeFrofLg8ps3b+Lt7Y2Ojg6NGjXCysqKlJQUQkNDOXXqFAUKFNC0wbwAABwLSURBVGDLli1YW1vndcwqEYPLNUcMLtcsjbywFTKuhIsXL+bUqVMkJGS8393ExIRmzZoxbNgwihcvnvtoNUQkpOaIhNQsjSVkJkmSiImJQSaTUbhw4VwFl1dKFKr8uUP4v2FrUvJzh/B/Jfhp9q9eV3sKj+joaM6cOUNERAQtW7aUJ2e5cuVyFaQgCGompJ+fH4sWLSI5ORmZTIa9vT3x8fEMGTKEzp07M2HCBHEvUhByQeVe1r179zJ79myaNWvGokWL5BMkV6lShWbNmrFlyxY2bNiQZ4EKwtdA5YT08/PDycmJuXPnKtzeKFGiBIsXL6ZRo0ZiYIAg5JLKCfno0SOaNGmS7XIXFxfCwsI0EpQgfK3UetnOmzdvsl0eERGBkZGRRoIShK+Vygnp7OyMv78/r169Ulp29+5dNm3aRP369TUanCB8bVS+DxkVFYWHhwfv3r2jVq1aHD16FDc3N1JTUwkODsbExISAgACsrKzyOmaViPuQmiPuQ2rWh+5DqnyFLFasGIGBgTRu3Jhz584hSRIHDx7k9OnTuLq6alUyCsKXKlcjddLS0jAzM0NXVxfIePGOtrznQ1whNUdcITVLI1dIV1dXjh07BmS8w8PMzAxzc3N5MgYFBeHsLMY8CkJuZDtSJzo6mkePHsk/h4eHc+PGjSxfO5eens6RI0fE85CCkEvZVlnj4+Nxd3fnxYsXKu1IkiRatmzJ/PnzNRpgTokqq+aIKqtm5WhwubGxMb/++iv3799HkiTGjh2Ll5cXjo6OSuvq6OhgZmZGvXr1NBOxIHylPji4vEqVKlSpUgXIuPHfvHlzbGxsPklggvA1UrlTZ/DgwaSkpDBixAiFwQGzZs1i6NChCu1NQRByRuWEvHjxIl27duX06dPExMTIy83Nzbl06RIeHh7cvXs3T4IUhK+Fyvchvb29ef36NevWraNQoUIKy+Li4vD29qZYsWKsWrUqTwJVl+jU0RzRqaNZGrkPeefOHTp16qSUjACmpqZ4eXlx/fr1nEUoCAKgRkLmy5dPoar6X2/fviU9PV0jQQnC10rlhKxTpw4bN27M8pnHqKgoNm7cKOZlFYRcUrkNGRISgqenJ+np6TRs2JDSpUsjk8l48uQJJ0+eRCaTsXXrVq2Z7Eq0ITVHtCE160NtSLUGlz9+/JgFCxbwxx9/yOdlNTAwwMnJCR8fH61JRhAJqUkiITVLYwmZKfNpj/T0dAoXLiwfYK5NREJqjkhIzdLovKzwz9MegiBoVrYJ6erqytixY3F1dZV//hiZTMbRo9lnvyAIH5ZtQpYsWVJh0qqSJUW1RRDyWo7akF8C0YbUHNGG1CyNjNQRBCHvZVtl7dGjR452uH79+hwHIwhfu2wT8unTp0plr169Ijk5GVNTU6ytrUlPTyc8PJyYmBgKFSqkVfchBeFLlG1CHj9+XOHz+fPnGTBgADNnzqRt27bo6PxT2w0KCmLcuHF069Yt7yIVhK+Aym3IqVOn4uHhQfv27RWSEaB169Z07dqVRYsWaTxAQfiaqJyQT548oXTp0tkuL168OM+fP9dETJ/F/mNbiIy9rfTfqnULPrjdN98UZu6iX7h+/w/uP/mLwKC1VK9Z9ZPE3KNPJ/78K4iQyMscP72Ldh3dldYxKWDMlJljuHTrOI+fX+Ov60fwHTeM/Pnzf5IYP2bkbB8WBsz7JMdq692G9cF+HHq4D7+jq2jStrHSOobGhvwwcSBbzm7kwP29LNm5kJoNa3yS+ECNkTplypRh3759dO7cWWmoXHJyMoGBgdja2mo8wE+lgk05DgQdZd+eIwrlT8Mist3G2MSInfvXU6x4UVb+up642Dh6f9eN7XvW4O7aiXt3HuZZvAMG92bi1FHs2XmQlcvX497ald/85iFJEnt2HpSv9/uGxdRvUIuNawO4c+s+NWo7MMTnO2wqlqNP96F5Fp8qWnZuQeuuLbl69lqeH6tTf08Gju/Pib0nCVgViLN7AyYsH4ckwYm9wUDGwJapq3/BvrYdO9fsIuLJM5p1dGX2xhn49viZv4Iv5HmcKt+H3L9/Pz4+Pjg4ONCxY0esrKxITk7m77//ZvPmzURERLBixQqcnJzyOmaVqHMf0sragr+uHWHYoLFs89+l8na+44YxxOc7vm3dk3NnLgFgXrQI568eImjPYYYOGKN23KooaFqAy7dOcGj/cX74fjSQ8ce0Y986rKwsqO3QjPT0dNxaNmGt/1LGjJzC2tWbFeIeNrI/bd26ceH8lY8eT9P3IXV0dOg+tCu9fHqgo6PD1bPXGO75o0aP8W8mBY0JuLCFU4fPMG3IDCDj+1oYMI/iVsXpUq876enp1GtalxlrpzJ/zCL2bNgLgJ5+ftafXEv0i2gGtRmikXg0ch+yZcuWTJ8+nadPnzJx4kT69u3LoEGDmDVrFmlpaSxdulRrklFdthXLA/DgXoha23l2acfRwyflyQjw4vlLfhk/h/P/KsuJH31/IDL2dpbLmrdojLGJEev8tsjLJEli7erNWFiVoFadjKk66zeoBcC2zbsVtt+zK+MKWrO28pSeeU1PPz8rD/5Kn5G9OBx4lBeRqs37+zG9fHpk+4der1k9DI0N2bN+r7xMkiR2r99DMYuiVKmZ8eNdwLQAD2895MiOf/aTkvyOu1fvUrZiGY3E+TFqDS7v2LEj7du359atW4SHhyOTybCysqJy5S97VIw8Ie9nzJxnaGRIYkLiB7exsragpEVxli/2k5cZGRuREJ/Aut+3KK1fo5YDo8YOoUZNBwAuXbjKzKmLuXr5htrxOjjaAXDjmmLCZn52cKzC+bOXWDD7N7Zt3k1CfILCemZmhQFIS0tV+9i5paevh7GJEZMGTCE46CRbzm7Mcr3K1SvRZ2QvKlevBMCtS7f5fc4a7l69p/YxbatmTF16/8YDhfLMz7ZVbbnx100OBx7hcKBik0VHR4cytqV5HqGZH46PUXukjo6ODkWLFqVEiRLUr1+f8uXLf/FTd1SsXIE3r98yadpPPAi7QEjEJc5eOZhlJ0mmsmWtAXj54hXjJ4/k3uPzPAq/yJnLB2nWorHCug0b12PHvvUULGjC7OmLWTj3NywsS7Bz/3rq1FO/w6B4iaLExMSRmJikUB4VlfFHY2FZAoDY2Dhu3VCeCbBn304AXDh/Ve1j51b8mwS6O/ckOOhktuvUcK7Oou3zMS5ojN+ctWxYvIliFkVZvH0B9rXt1D6mefEivI59TXJSskL5q+fRABSzKKq0jYGhAbZVbZj423isK1izYVHWPxyaptYV8tKlS0ybNo07d+4A4OfnR1paGmPHjsXX15eWLVvmSZB5zbZieQoUNMHUtABDB/pS0LQg/QZ485vfPPLnz8f2rXuVtilomvGOk9E/DyX1XSrjx8wgPS2NgUP7sGbTErp0/J4/T55FJpMxa8FErl66TodWPeU/Xn6r/Dn65w6mzBpL84bfAmBm9s8EYoaGBkpliYlJJCYmYWJinOUVPCkx4w/OyMgw23P16NSG1u3cOPXHOa5c+vSTkkmSRFpa9t0WMpkMnxnDuXv1HsM8fOTf1841u1l9+DeGTh7Mdy0GAGBa+J/3zOgb6iuVJSUmk5yUjKGxEcmJiskIkPI+QQ2MDJSWfTemL9/26QBAcNBJ/th/St1TzRGVE/L69ev07t2bEiVK0LNnT9auXQtkzDiXL18+Ro4cibGxMY0aNVJpf1FRUWoFWqxYMbXWV8fGtQHo6OoodHzsDtzPibO7GT95FDsC9inVAvT1M24bmJoWwKlGS+LiXgNw+GAwZ68cYuzE4bg3OYt91UqULlOKdb9vpVAhxRcVHTl4gv4/9KJEyWJERkRxK+SMUmz/Lps7cxnzZi5DpqNDVn1xmWXp6Vn/wTd3d2HekqlEPXvB8EE/q/LVfHIV7MpjUbokezbspYCpicKyM0fO4fW9B+YlivAi8iW7b+xQ2v7fZWvnr2ft/PXo6Miy+b7e/28WNbxTB09z+dQVKlevhOd337IgYC7DvvXhXcq7XJ7hh6mckIsWLcLS0pIdO3aQkJAgT0h7e3v27NlDly5dWLFihcoJ6erqSlpamsqBZl6V88L6NVuVypKSktm+dS8jfX/ApmI57t5WbH8kvL9C7d97VJ6MAK/j3nD4wAm8urTDyNgI6zKlAJg4dRQTp47K8vglLYoTGRGFV7u+8jLPLm3x7NxOoezx3xkTjMW/jZdfQf/N8P0v/du38UrL2n/bkkW/zuDt23i6efYn/Glk1l/GZ1bSOqNHd+D4/gwc3z/LdcxLmPMi8iU/dh4tL2vu0Qw3j2YKZRFPMs4xIT4BfQN9pf1kXlUT4pVrG1fOZFTnTx8+w7OwZ/w4awRNO7hyYOtBpXU1SeWEvHLlCoMGDcLAwIDERMUTMDExwcvLi8WLF6t84ICAAPr3709KSgo//vgj+fLlaPKCPPXyRcYrE4yNjZSWRUZkDIJ4+fKV0rKXL16ho6ODsbERuroZzfRZUxdx6ULWVcSH90MB+PPkWXlZ7XrVlcoyhT+NpFBhU/T08pPyr1/s4sUz2kLPIhVrH969vJgxbzyxMXF4te/L7Zvqd4x8Kjrvv6/fZ6/h9uWsf4SfPMr4Ybp06rK8LLNt+e+yTM/Dn1OgUAHy6+VXuMIVKfYNAC8jX34wphNBJ/lx1ghs7MtzQPm3W6PUyoIPvR05OTlZrc6dSpUqsXbtWjw9PXnx4gWDBg1SJxSNKV6iKFt2rGb3zgMsmP2rwrLyNmUBePI4XGm7u3cekJSULO+h/bdS1pYkJibx6mU0YU8yto2PT1BKLgdHOwoXNiUpKUlpHx9y49ptdHR0qGJfSaEdaFc1o0fy6uWb8jLPzm2ZvXASkRFRdGrflwf31bu186k9C3sGQGJ8olJy2TrYUrBQAXnbT1X3bzxER0eH8lXKcefKP51cFewy/u3uXsv4gRo6ZTB1XGrR3bmXQhXX6P0PcnJS3r//VOVeVgcHB4KCgrJclpCQQEBAAPb29modvGzZsvj4+LB69Wqio6PV2lZTnkU+p0BBE7r18MCkgLG8vKRFcTp1ac+pP87x4rnyL2hiQiKHD5ygqVtjbP6VlFbWFjR3d+HQ/uOkp6dz7cotnkU+p2//7vJ/WMgY0rZy7XwWLJtGaqrqVXeAo4dOkpiYRN/v/xnML5PJ6NWvC2FPwrl0IWPkSwWbssxe+AsvX7zi29a9tD4ZAe5dv8/LZy/p2KeDvAoOYGRixKRfx/HTvJGkqfl9nTt2nuSkZDr2bi8vk8lktOvRlmdhz+RX4qinUViUtsCljWKzy6u/BwBnj57L6WmpTHfSpEmTVFnR2tqalStXcubMGVJSUjhz5gxlypTh9u3bjBkzhvDwcKZMmYKlpaVaAVSpUoUaNWpgZmaGoWH2vYPqmjdzmcrrPnn8FO/eXjRv4UL+/Plo2LgecxdPQaYj47sew4l+FUMpa0uaujUi/m2CvM149coNPDu1pVPX9ujp6VG9pgOzF0xCpiOjf+8fiYt7TXp6Ok/DwunWw4M27VtgYKBP1WpVmDFnPGXLWTN6xCTu3LqvFNPZUxeyPYekpGR08+nSb4A3ZctZU6hQQXzHDcO5cT1GDp3IvbsZQ/amzxmHnX1F9u09QkpyCpWr2Cr8B/9Uyz+kiF4Blb9LdXn068jb1/EcDDgMgJQu8expFK26utO4TWP0DfSwqVqB4dOGYlnGgnm+Cwm5E6q0n6tnr7F2ftbP4iYnJaOrq8u3fTtiWdaSAqYm9B3dmxrO1Zkzej5/3/8bgAc3H+Dk5kQLLzdMTE0oaV0S76HdaOHlxr7N+9mxRvVRXB/Syyf7Z43VmsLj9OnTTJw4UelZSXNzc8aPH0/z5s1zHqWGqTuFh1vLJgz1+Z7KdrYkJSVx9tQFpv+ygIcPMv7xvbq2Z9Hy6UrD60pZWzLulx9p6FIPGTLOn73ElAlzla5GDRrWZdjI76nmaE96ejp37zxgyYJVHD2U/f24jxkwuDe9v+uCedEihDz6mwWzf2PfnsPy5dfu/UHRYkWy3T6z1/Zj8nIKjy1nN/LsaZTS0LnqTo50H9qVig62pKdLhN4LxX/pZs4eO5/jY3Xq70n7nm0xK2pGWMhTNizayMl9fyqsY2pmyvdj+1G/aV1MCpoQ/ncEezbuZYefZpIRNDQva0xMDIULF0aSJG7fvs2TJ09IT0/HwsICOzs7reuUEXPqaI6YU0ezNDIva4cOHfD09OSHH35QeLOyIAiao3KnTnR0NObm5nkZiyB89VROyDZt2rB169Ys59oRBEEzVK6y6ujoEBISgpubG6VKleKbb75RmspDJpOxbt06jQcpCF8LlRPy9OnTFC6c8dhOcnIyERHZP0kvCELOqJyQ/52FThAEzftoQr57946HDx+SmppK+fLlNXrzXhAERR9MyLVr17Js2TLevn0LZIxl7dq1q9YOBheEL122WbVr1y5mzpyJhYUF7dq1Q0dHh/Pnz7N27Vr5Q8mCIGhWtiN1vLy80NHRYd26dejrZzw3JkkSI0aM4MSJE1y4cOGDT398bmKkjuaIkTqalaNZ5x49ekSbNm3kyQjvnyjo1YuUlBRCQrT/yQFB+NJkm5CJiYkUKKA8yt/S0hJJknj9+nUWWwmCkBvZJmR6ejoymUypPHPWcnWm3xAEQTXiha2CoEU+eO8iNjZWaUROXFwckDHYPKvROiVLig4AQcipbHtZK1asmGWVFTJ6W7NaJpPJuH076+nvPzXRy6o5opdVs3L0PGSHDh3yJBhBELKn1hQeXxJxhdQccYXULI28/UoQhLwnElIQtIhISEHQIiIhBUGLiIQUBC0iElIQtIhISEHQIiIhBUGLiIQUBC0iElIQtIhISEHQIiIhBUGLiIQUBC0iElIQtIhISEHQIv+3z0MKwpdIXCEFQYuIhBQELSISUhC0iEhIQdAiIiEFQYuIhBQELSISUhC0iEhIQdAiIiEFQYuIhBQELSIS8jMJCgqiVatWVK1aFXd3d3bt2vW5Q/ri3blzhypVqvDs2bPPHUqOiYT8DA4cOMDIkSNxcnJi2bJl1K5dm59++omDBw9+7tC+WCEhIfTv35/U1NTPHUquiMHln0GzZs2ws7NjwYIF8rLhw4dz7949Dhw48Bkj+/KkpqaydetW5s2bR/78+YmNjeXkyZMUL178c4eWI+IK+YmFhYXx5MkTmjdvrlDu5uZGSEgIYWFhnymyL9OlS5eYO3cuffr0YeTIkZ87nFwTCfmJhYSEAFCmTBmFcmtrawBCQ0M/eUxfsnLlynH06FEGDx6Mrq7u5w4n1z74SnNB8968eQOAiYmJQrmxsTEAb9++/eQxfcmKFCnyuUPQKHGF/MQym+z/fSV8ZrmOjvgn+ZqJf/1PrECBAoDylTA+Pl5hufB1Egn5iWW2HZ88eaJQ/vjxY4XlwtdJJOQnZm1tjaWlpdI9x8OHD1O6dGlKliz5mSITtIHo1PkMfvjhB8aMGYOpqSmNGzfm+PHjHDhwQOG+pPB1Egn5GXTs2JGUlBT8/PwICAjAysqKWbNm0bJly88dmvCZiZE6gqBFRBtSELSISEhB0CIiIQVBi4iEFAQtIhJSELSISEhB0CLiPuRn4Ovry86dOz+6XocOHZg5c+YniCh7TZo0wcLCgg0bNnyS7T7V/rSVSMjPoFOnTtSrV0/++dKlS2zdupVOnTpRo0YNeXmpUqU+R3jCZyQS8jNwdHTE0dFR/jktLY2tW7dSrVo12rVr9xkjEz430YYUBC0iEvIL0KRJE8aNG8fYsWOxt7enYcOGREdH06RJE7y9vbNc/7/lV65coXfv3vKrc58+fbh+/brasUiSxObNm/Hw8MDR0RF7e3tatGjBypUryWoUZkBAAK6urtjb2+Pp6cmff/6ptE5OYouLi8PX15fGjRtjZ2dH06ZNmTdvHsnJyWqfkzYRCfmF2LdvH3fv3uXnn3/Gy8sLMzMzlbc9ffo03t7evHnzhmHDhjFw4EAiIiLo1q0bFy9eVCuOhQsXMmnSJMqXL8+YMWPw8fFBX1+fefPmKc0te/PmTaZOnUrLli3x8fHh9evX9O/fnzNnzuQ6tuHDh3PixAk8PT2ZOHEitWvXZuXKlUydOlWt89E6kvDZBQYGSjY2NlJgYGCWy11cXKSKFStKjx8/Virv3r17lutnlqelpUmurq5S586dpdTUVPk68fHxUrNmzaR27dp9MLZ/7yslJUWqXr26NGLECIV13rx5I9nZ2Un9+/dX2M7GxkYKDg6Wl8XExEi1a9eWOnTooHZs/47j5cuXko2NjbR69WqFOHx9faWePXt+8Hy0nejU+UKUKlUqR72ut2/fJiwsjC5duhAXF6ewzMXFhbVr1/Ls2TOV5jHNnz8/Z86c4d27dwrlMTExmJiYkJCQoFBeoUIFGjVqJP9cqFAh2rRpw4YNG3jx4gVRUVE5iq1AgQIYGRnh7++PpaUlzs7OGBkZMWPGDJW+E20mEvIL8c033+Rou8ypQmbPns3s2bOzXCcyMlLliYXz589PcHAwx44dIzQ0lMePH8uTSfpPG7Js2bJK22f+qISHhxMREZGj2PT09Jg8eTLjx49n6NCh6OnpUbt2bZo3b0779u3R19dX6Vy0kUjIL4Q6c46mpaXJ/396ejoAw4YNo1q1almun1XiZEWSJEaNGkVQUBA1atTA0dGRTp06UatWLXr27KnSPjLj0dHRyVVsbdq0wdnZmaNHj3Ly5EnOnDnDqVOn8Pf3JyAgAD09PZXi0TYiIb9gOjo6pKSkKJSlpqYSExMjvxJZWFgAYGRkRP369RXWvX79OnFxcRgYGKh0vIsXLxIUFMSgQYMYNmyYwjFjY2OxsrJSWD88PFxpH5mTeVlZWcl/ONSNLT4+njt37lChQgU8PDzw8PAgJSWFOXPmsH79ek6dOkWTJk1UOidtI3pZv2BFihQhNDSUpKQkednx48cVuv7t7OwwNzdnw4YN8qkmIWMayuHDhzNmzBiVr76xsbEAlC9fXqF827ZtJCYmKr3o5tatW9y+fVv++eXLl+zZs4eaNWtSuHDhHMf24MEDunXrxvbt2+Vlenp6VK5cGVCvNqFtxBXyC9a6dWumTJlCv379aNu2LY8fP2bbtm3yqyJktPnGjx/P8OHD6dixIx4eHujr6xMQEEBERARz584lXz7V/gwcHR0xMTFhxowZREREULBgQc6fP8/+/fvR19dXSCoAU1NT+vbtS+/evdHV1WXTpk2kpqYyZsyYXMXm4OBAzZo1WbBgAZGRkdja2hIZGcnGjRspW7aswrDEL41IyC9Y165diY2NZfv27UyZMoWKFSuydOlS/Pz8FHo83dzc8PPz49dff2X58uXo6OhQoUIFfv31V1xcXFQ+XpEiRVi5ciVz585l+fLl6OnpUaZMGebPn8/169dZv349L1++lE/v7+zsjL29Pb///juxsbE4ODiwcOFC7OzschWbTCZj2bJlLF26lBMnTrB161ZMTU1p3rw5w4YN+2LbjyAmuRIErSLakIKgRURCCoIWEQkpCFpEJKQgaBGRkIKgRURCCoIWEQkpCFpEJKQgaBGRkIKgRf4H6SY1qcZ6CPMAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 216x216 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "sns.set(font_scale=1.5)\n",
    "\n",
    "# Create a function to plot a nice looking confusion matrix\n",
    "def plot_conf_mat(y_tes, y_preds):\n",
    "    \"\"\"\n",
    "    Plots a nice looking confusion matrix\n",
    "    \n",
    "    y_test: true data labels\n",
    "    y_preds: predicted labels on X_test set\n",
    "    \n",
    "    \"\"\"\n",
    "    fig, ax = plt.subplots(figsize=(3,3))\n",
    "    ax = sns.heatmap(confusion_matrix(y_test, y_preds),\n",
    "                    annot=True,\n",
    "                    cbar=False)\n",
    "    plt.xlabel('True labels')\n",
    "    plt.ylabel('Predicted labels')\n",
    "    plt.title('Confusion Matrix')\n",
    "\n",
    "plot_conf_mat(y_test, y_preds)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now that Confusion Matrix, ROC curve and AUC analysis are completed, the evaluation process can move on to Classification report. Precision, recall and F1 will be one by one examined  "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Classification Report"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 75,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "              precision    recall  f1-score   support\n",
      "\n",
      "           1       0.89      0.94      0.92      4942\n",
      "           2       0.78      0.64      0.70      1571\n",
      "\n",
      "    accuracy                           0.87      6513\n",
      "   macro avg       0.84      0.79      0.81      6513\n",
      "weighted avg       0.86      0.87      0.87      6513\n",
      "\n"
     ]
    }
   ],
   "source": [
    "print(classification_report(y_test, y_preds))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "* This classificationreport has been done only on 1 data test split \n",
    "* Therefore next step will be to consider each parameter individually on a multiple set of data (Cross VAlidation on 5 folds) "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Calculate evaluation metrics using Cross Validation\n",
    "\n",
    "* Calculate Precision, Recall and F1 score on a cross validate data set (using scoring parameter with 5 folds)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 76,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'max_leaves': 40,\n",
       " 'learning_rate': 0.3,\n",
       " 'iterations': 200,\n",
       " 'grow_policy': 'Lossguide',\n",
       " 'depth': 4}"
      ]
     },
     "execution_count": 76,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "rs_cat.best_params_"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 77,
   "metadata": {},
   "outputs": [],
   "source": [
    "best_model = CatBoostClassifier(max_leaves=40,\n",
    "                                learning_rate=0.3,\n",
    "                               iterations=200,\n",
    "                                grow_policy='Lossguide',\n",
    "                                depth=4)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 78,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0:\tlearn: 0.4910390\ttotal: 38.4ms\tremaining: 7.63s\n",
      "1:\tlearn: 0.4094957\ttotal: 79ms\tremaining: 7.82s\n",
      "2:\tlearn: 0.3694131\ttotal: 116ms\tremaining: 7.65s\n",
      "3:\tlearn: 0.3505391\ttotal: 154ms\tremaining: 7.54s\n",
      "4:\tlearn: 0.3391372\ttotal: 192ms\tremaining: 7.47s\n",
      "5:\tlearn: 0.3327239\ttotal: 231ms\tremaining: 7.46s\n",
      "6:\tlearn: 0.3262649\ttotal: 307ms\tremaining: 8.46s\n",
      "7:\tlearn: 0.3187783\ttotal: 354ms\tremaining: 8.48s\n",
      "8:\tlearn: 0.3136945\ttotal: 394ms\tremaining: 8.35s\n",
      "9:\tlearn: 0.3113021\ttotal: 437ms\tremaining: 8.31s\n",
      "10:\tlearn: 0.3081480\ttotal: 514ms\tremaining: 8.84s\n",
      "11:\tlearn: 0.3056354\ttotal: 563ms\tremaining: 8.82s\n",
      "12:\tlearn: 0.3020594\ttotal: 605ms\tremaining: 8.71s\n",
      "13:\tlearn: 0.2993112\ttotal: 644ms\tremaining: 8.55s\n",
      "14:\tlearn: 0.2973829\ttotal: 701ms\tremaining: 8.65s\n",
      "15:\tlearn: 0.2934693\ttotal: 763ms\tremaining: 8.77s\n",
      "16:\tlearn: 0.2924421\ttotal: 806ms\tremaining: 8.67s\n",
      "17:\tlearn: 0.2915134\ttotal: 854ms\tremaining: 8.63s\n",
      "18:\tlearn: 0.2903485\ttotal: 927ms\tremaining: 8.83s\n",
      "19:\tlearn: 0.2896061\ttotal: 988ms\tremaining: 8.9s\n",
      "20:\tlearn: 0.2890050\ttotal: 1.06s\tremaining: 9.08s\n",
      "21:\tlearn: 0.2882568\ttotal: 1.18s\tremaining: 9.57s\n",
      "22:\tlearn: 0.2875332\ttotal: 1.24s\tremaining: 9.56s\n",
      "23:\tlearn: 0.2857290\ttotal: 1.32s\tremaining: 9.68s\n",
      "24:\tlearn: 0.2850522\ttotal: 1.38s\tremaining: 9.67s\n",
      "25:\tlearn: 0.2838251\ttotal: 1.44s\tremaining: 9.63s\n",
      "26:\tlearn: 0.2818143\ttotal: 1.49s\tremaining: 9.52s\n",
      "27:\tlearn: 0.2810609\ttotal: 1.54s\tremaining: 9.45s\n",
      "28:\tlearn: 0.2805953\ttotal: 1.6s\tremaining: 9.47s\n",
      "29:\tlearn: 0.2795593\ttotal: 1.72s\tremaining: 9.73s\n",
      "30:\tlearn: 0.2785583\ttotal: 1.9s\tremaining: 10.4s\n",
      "31:\tlearn: 0.2775374\ttotal: 2.01s\tremaining: 10.6s\n",
      "32:\tlearn: 0.2769544\ttotal: 2.09s\tremaining: 10.6s\n",
      "33:\tlearn: 0.2762143\ttotal: 2.18s\tremaining: 10.6s\n",
      "34:\tlearn: 0.2757283\ttotal: 2.25s\tremaining: 10.6s\n",
      "35:\tlearn: 0.2751014\ttotal: 2.29s\tremaining: 10.4s\n",
      "36:\tlearn: 0.2742580\ttotal: 2.35s\tremaining: 10.3s\n",
      "37:\tlearn: 0.2735819\ttotal: 2.39s\tremaining: 10.2s\n",
      "38:\tlearn: 0.2725745\ttotal: 2.46s\tremaining: 10.2s\n",
      "39:\tlearn: 0.2717464\ttotal: 2.53s\tremaining: 10.1s\n",
      "40:\tlearn: 0.2712371\ttotal: 2.6s\tremaining: 10.1s\n",
      "41:\tlearn: 0.2708447\ttotal: 2.66s\tremaining: 9.99s\n",
      "42:\tlearn: 0.2703224\ttotal: 2.72s\tremaining: 9.94s\n",
      "43:\tlearn: 0.2696397\ttotal: 2.82s\tremaining: 10s\n",
      "44:\tlearn: 0.2690909\ttotal: 2.9s\tremaining: 9.99s\n",
      "45:\tlearn: 0.2682967\ttotal: 2.94s\tremaining: 9.86s\n",
      "46:\tlearn: 0.2679382\ttotal: 3.02s\tremaining: 9.82s\n",
      "47:\tlearn: 0.2677047\ttotal: 3.06s\tremaining: 9.69s\n",
      "48:\tlearn: 0.2673390\ttotal: 3.1s\tremaining: 9.57s\n",
      "49:\tlearn: 0.2667281\ttotal: 3.14s\tremaining: 9.43s\n",
      "50:\tlearn: 0.2660764\ttotal: 3.23s\tremaining: 9.43s\n",
      "51:\tlearn: 0.2653754\ttotal: 3.3s\tremaining: 9.39s\n",
      "52:\tlearn: 0.2650464\ttotal: 3.41s\tremaining: 9.46s\n",
      "53:\tlearn: 0.2648876\ttotal: 3.46s\tremaining: 9.36s\n",
      "54:\tlearn: 0.2644577\ttotal: 3.52s\tremaining: 9.28s\n",
      "55:\tlearn: 0.2639544\ttotal: 3.6s\tremaining: 9.27s\n",
      "56:\tlearn: 0.2635208\ttotal: 3.66s\tremaining: 9.18s\n",
      "57:\tlearn: 0.2630010\ttotal: 3.74s\tremaining: 9.16s\n",
      "58:\tlearn: 0.2623645\ttotal: 3.83s\tremaining: 9.17s\n",
      "59:\tlearn: 0.2618230\ttotal: 4s\tremaining: 9.32s\n",
      "60:\tlearn: 0.2615054\ttotal: 4.14s\tremaining: 9.45s\n",
      "61:\tlearn: 0.2613269\ttotal: 4.21s\tremaining: 9.38s\n",
      "62:\tlearn: 0.2608481\ttotal: 4.28s\tremaining: 9.3s\n",
      "63:\tlearn: 0.2606736\ttotal: 4.37s\tremaining: 9.3s\n",
      "64:\tlearn: 0.2601501\ttotal: 4.49s\tremaining: 9.32s\n",
      "65:\tlearn: 0.2599332\ttotal: 4.54s\tremaining: 9.21s\n",
      "66:\tlearn: 0.2594212\ttotal: 4.58s\tremaining: 9.08s\n",
      "67:\tlearn: 0.2592048\ttotal: 4.63s\tremaining: 8.99s\n",
      "68:\tlearn: 0.2585311\ttotal: 4.69s\tremaining: 8.91s\n",
      "69:\tlearn: 0.2581389\ttotal: 4.73s\tremaining: 8.79s\n",
      "70:\tlearn: 0.2576641\ttotal: 4.78s\tremaining: 8.68s\n",
      "71:\tlearn: 0.2571270\ttotal: 4.86s\tremaining: 8.64s\n",
      "72:\tlearn: 0.2569060\ttotal: 4.9s\tremaining: 8.53s\n",
      "73:\tlearn: 0.2563899\ttotal: 4.94s\tremaining: 8.41s\n",
      "74:\tlearn: 0.2559528\ttotal: 4.99s\tremaining: 8.32s\n",
      "75:\tlearn: 0.2554732\ttotal: 5.04s\tremaining: 8.22s\n",
      "76:\tlearn: 0.2550620\ttotal: 5.09s\tremaining: 8.13s\n",
      "77:\tlearn: 0.2544463\ttotal: 5.15s\tremaining: 8.06s\n",
      "78:\tlearn: 0.2541464\ttotal: 5.19s\tremaining: 7.95s\n",
      "79:\tlearn: 0.2536836\ttotal: 5.25s\tremaining: 7.88s\n",
      "80:\tlearn: 0.2533178\ttotal: 5.31s\tremaining: 7.8s\n",
      "81:\tlearn: 0.2528747\ttotal: 5.35s\tremaining: 7.7s\n",
      "82:\tlearn: 0.2526583\ttotal: 5.39s\tremaining: 7.6s\n",
      "83:\tlearn: 0.2524395\ttotal: 5.46s\tremaining: 7.53s\n",
      "84:\tlearn: 0.2520651\ttotal: 5.52s\tremaining: 7.46s\n",
      "85:\tlearn: 0.2516639\ttotal: 5.58s\tremaining: 7.39s\n",
      "86:\tlearn: 0.2514801\ttotal: 5.64s\tremaining: 7.33s\n",
      "87:\tlearn: 0.2513549\ttotal: 5.69s\tremaining: 7.24s\n",
      "88:\tlearn: 0.2508232\ttotal: 5.75s\tremaining: 7.17s\n",
      "89:\tlearn: 0.2506792\ttotal: 5.81s\tremaining: 7.1s\n",
      "90:\tlearn: 0.2502898\ttotal: 5.86s\tremaining: 7.02s\n",
      "91:\tlearn: 0.2501274\ttotal: 5.93s\tremaining: 6.96s\n",
      "92:\tlearn: 0.2498113\ttotal: 6s\tremaining: 6.91s\n",
      "93:\tlearn: 0.2494608\ttotal: 6.08s\tremaining: 6.85s\n",
      "94:\tlearn: 0.2490959\ttotal: 6.35s\tremaining: 7.02s\n",
      "95:\tlearn: 0.2489713\ttotal: 6.45s\tremaining: 6.99s\n",
      "96:\tlearn: 0.2485235\ttotal: 6.54s\tremaining: 6.94s\n",
      "97:\tlearn: 0.2480601\ttotal: 6.61s\tremaining: 6.88s\n",
      "98:\tlearn: 0.2475354\ttotal: 6.67s\tremaining: 6.81s\n",
      "99:\tlearn: 0.2470517\ttotal: 6.72s\tremaining: 6.72s\n",
      "100:\tlearn: 0.2465217\ttotal: 6.77s\tremaining: 6.63s\n",
      "101:\tlearn: 0.2462395\ttotal: 6.83s\tremaining: 6.56s\n",
      "102:\tlearn: 0.2458358\ttotal: 6.9s\tremaining: 6.5s\n",
      "103:\tlearn: 0.2455335\ttotal: 6.97s\tremaining: 6.44s\n",
      "104:\tlearn: 0.2451756\ttotal: 7.05s\tremaining: 6.38s\n",
      "105:\tlearn: 0.2448174\ttotal: 7.11s\tremaining: 6.31s\n",
      "106:\tlearn: 0.2445567\ttotal: 7.17s\tremaining: 6.23s\n",
      "107:\tlearn: 0.2443596\ttotal: 7.22s\tremaining: 6.15s\n",
      "108:\tlearn: 0.2439081\ttotal: 7.3s\tremaining: 6.09s\n",
      "109:\tlearn: 0.2434848\ttotal: 7.36s\tremaining: 6.02s\n",
      "110:\tlearn: 0.2432248\ttotal: 7.43s\tremaining: 5.96s\n",
      "111:\tlearn: 0.2430648\ttotal: 7.52s\tremaining: 5.91s\n",
      "112:\tlearn: 0.2429844\ttotal: 7.58s\tremaining: 5.84s\n",
      "113:\tlearn: 0.2426978\ttotal: 7.65s\tremaining: 5.77s\n",
      "114:\tlearn: 0.2425858\ttotal: 7.7s\tremaining: 5.69s\n",
      "115:\tlearn: 0.2422130\ttotal: 7.75s\tremaining: 5.61s\n",
      "116:\tlearn: 0.2417006\ttotal: 7.8s\tremaining: 5.53s\n",
      "117:\tlearn: 0.2414430\ttotal: 7.89s\tremaining: 5.48s\n",
      "118:\tlearn: 0.2411022\ttotal: 7.96s\tremaining: 5.42s\n",
      "119:\tlearn: 0.2403800\ttotal: 8.05s\tremaining: 5.36s\n",
      "120:\tlearn: 0.2400258\ttotal: 8.1s\tremaining: 5.29s\n",
      "121:\tlearn: 0.2396878\ttotal: 8.16s\tremaining: 5.21s\n",
      "122:\tlearn: 0.2394415\ttotal: 8.23s\tremaining: 5.15s\n",
      "123:\tlearn: 0.2390072\ttotal: 8.34s\tremaining: 5.11s\n",
      "124:\tlearn: 0.2387689\ttotal: 8.4s\tremaining: 5.04s\n",
      "125:\tlearn: 0.2384445\ttotal: 8.47s\tremaining: 4.97s\n",
      "126:\tlearn: 0.2381465\ttotal: 8.67s\tremaining: 4.98s\n",
      "127:\tlearn: 0.2378007\ttotal: 8.73s\tremaining: 4.91s\n",
      "128:\tlearn: 0.2374913\ttotal: 8.77s\tremaining: 4.83s\n",
      "129:\tlearn: 0.2372241\ttotal: 8.81s\tremaining: 4.74s\n",
      "130:\tlearn: 0.2369136\ttotal: 8.85s\tremaining: 4.66s\n",
      "131:\tlearn: 0.2367420\ttotal: 8.91s\tremaining: 4.59s\n",
      "132:\tlearn: 0.2364224\ttotal: 8.96s\tremaining: 4.51s\n",
      "133:\tlearn: 0.2362696\ttotal: 9s\tremaining: 4.43s\n",
      "134:\tlearn: 0.2358998\ttotal: 9.04s\tremaining: 4.35s\n",
      "135:\tlearn: 0.2355574\ttotal: 9.12s\tremaining: 4.29s\n",
      "136:\tlearn: 0.2351997\ttotal: 9.15s\tremaining: 4.21s\n",
      "137:\tlearn: 0.2349023\ttotal: 9.19s\tremaining: 4.13s\n",
      "138:\tlearn: 0.2345666\ttotal: 9.23s\tremaining: 4.05s\n",
      "139:\tlearn: 0.2344306\ttotal: 9.3s\tremaining: 3.98s\n",
      "140:\tlearn: 0.2341253\ttotal: 9.34s\tremaining: 3.91s\n",
      "141:\tlearn: 0.2339600\ttotal: 9.38s\tremaining: 3.83s\n",
      "142:\tlearn: 0.2336109\ttotal: 9.41s\tremaining: 3.75s\n",
      "143:\tlearn: 0.2335354\ttotal: 9.48s\tremaining: 3.69s\n",
      "144:\tlearn: 0.2332019\ttotal: 9.53s\tremaining: 3.61s\n",
      "145:\tlearn: 0.2330839\ttotal: 9.57s\tremaining: 3.54s\n",
      "146:\tlearn: 0.2328308\ttotal: 9.61s\tremaining: 3.46s\n",
      "147:\tlearn: 0.2327493\ttotal: 9.65s\tremaining: 3.39s\n",
      "148:\tlearn: 0.2324452\ttotal: 9.69s\tremaining: 3.31s\n",
      "149:\tlearn: 0.2323056\ttotal: 9.77s\tremaining: 3.25s\n",
      "150:\tlearn: 0.2320540\ttotal: 9.8s\tremaining: 3.18s\n",
      "151:\tlearn: 0.2317048\ttotal: 9.85s\tremaining: 3.11s\n",
      "152:\tlearn: 0.2314122\ttotal: 9.89s\tremaining: 3.04s\n",
      "153:\tlearn: 0.2309981\ttotal: 9.95s\tremaining: 2.97s\n",
      "154:\tlearn: 0.2306700\ttotal: 10s\tremaining: 2.9s\n",
      "155:\tlearn: 0.2302911\ttotal: 10s\tremaining: 2.83s\n",
      "156:\tlearn: 0.2301412\ttotal: 10.1s\tremaining: 2.76s\n",
      "157:\tlearn: 0.2298899\ttotal: 10.1s\tremaining: 2.69s\n",
      "158:\tlearn: 0.2295007\ttotal: 10.2s\tremaining: 2.63s\n",
      "159:\tlearn: 0.2293104\ttotal: 10.2s\tremaining: 2.56s\n",
      "160:\tlearn: 0.2292694\ttotal: 10.3s\tremaining: 2.48s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "161:\tlearn: 0.2290253\ttotal: 10.3s\tremaining: 2.42s\n",
      "162:\tlearn: 0.2288107\ttotal: 10.4s\tremaining: 2.35s\n",
      "163:\tlearn: 0.2285343\ttotal: 10.4s\tremaining: 2.29s\n",
      "164:\tlearn: 0.2284223\ttotal: 10.5s\tremaining: 2.23s\n",
      "165:\tlearn: 0.2281667\ttotal: 10.6s\tremaining: 2.17s\n",
      "166:\tlearn: 0.2278998\ttotal: 10.6s\tremaining: 2.1s\n",
      "167:\tlearn: 0.2275107\ttotal: 10.7s\tremaining: 2.05s\n",
      "168:\tlearn: 0.2272013\ttotal: 10.8s\tremaining: 1.99s\n",
      "169:\tlearn: 0.2270592\ttotal: 10.9s\tremaining: 1.92s\n",
      "170:\tlearn: 0.2269358\ttotal: 10.9s\tremaining: 1.85s\n",
      "171:\tlearn: 0.2266104\ttotal: 11s\tremaining: 1.79s\n",
      "172:\tlearn: 0.2263648\ttotal: 11s\tremaining: 1.72s\n",
      "173:\tlearn: 0.2261102\ttotal: 11.1s\tremaining: 1.65s\n",
      "174:\tlearn: 0.2258385\ttotal: 11.1s\tremaining: 1.59s\n",
      "175:\tlearn: 0.2255843\ttotal: 11.2s\tremaining: 1.52s\n",
      "176:\tlearn: 0.2252919\ttotal: 11.2s\tremaining: 1.46s\n",
      "177:\tlearn: 0.2250407\ttotal: 11.2s\tremaining: 1.39s\n",
      "178:\tlearn: 0.2247510\ttotal: 11.3s\tremaining: 1.32s\n",
      "179:\tlearn: 0.2244622\ttotal: 11.3s\tremaining: 1.26s\n",
      "180:\tlearn: 0.2243807\ttotal: 11.4s\tremaining: 1.2s\n",
      "181:\tlearn: 0.2243464\ttotal: 11.5s\tremaining: 1.13s\n",
      "182:\tlearn: 0.2242004\ttotal: 11.5s\tremaining: 1.07s\n",
      "183:\tlearn: 0.2239257\ttotal: 11.6s\tremaining: 1.01s\n",
      "184:\tlearn: 0.2238702\ttotal: 11.7s\tremaining: 947ms\n",
      "185:\tlearn: 0.2235913\ttotal: 11.7s\tremaining: 883ms\n",
      "186:\tlearn: 0.2233530\ttotal: 11.8s\tremaining: 820ms\n",
      "187:\tlearn: 0.2231426\ttotal: 11.9s\tremaining: 757ms\n",
      "188:\tlearn: 0.2231138\ttotal: 11.9s\tremaining: 693ms\n",
      "189:\tlearn: 0.2227511\ttotal: 12s\tremaining: 630ms\n",
      "190:\tlearn: 0.2223536\ttotal: 12.1s\tremaining: 570ms\n",
      "191:\tlearn: 0.2221296\ttotal: 12.2s\tremaining: 506ms\n",
      "192:\tlearn: 0.2219507\ttotal: 12.2s\tremaining: 443ms\n",
      "193:\tlearn: 0.2217029\ttotal: 12.3s\tremaining: 381ms\n",
      "194:\tlearn: 0.2214195\ttotal: 12.5s\tremaining: 321ms\n",
      "195:\tlearn: 0.2211347\ttotal: 12.6s\tremaining: 258ms\n",
      "196:\tlearn: 0.2210406\ttotal: 12.7s\tremaining: 194ms\n",
      "197:\tlearn: 0.2208029\ttotal: 12.9s\tremaining: 130ms\n",
      "198:\tlearn: 0.2205557\ttotal: 12.9s\tremaining: 65.1ms\n",
      "199:\tlearn: 0.2204761\ttotal: 13.2s\tremaining: 0us\n",
      "0:\tlearn: 0.4890502\ttotal: 40.2ms\tremaining: 8s\n",
      "1:\tlearn: 0.4065357\ttotal: 82.4ms\tremaining: 8.15s\n",
      "2:\tlearn: 0.3695467\ttotal: 121ms\tremaining: 7.95s\n",
      "3:\tlearn: 0.3539389\ttotal: 163ms\tremaining: 7.99s\n",
      "4:\tlearn: 0.3424754\ttotal: 212ms\tremaining: 8.29s\n",
      "5:\tlearn: 0.3330650\ttotal: 264ms\tremaining: 8.53s\n",
      "6:\tlearn: 0.3237089\ttotal: 330ms\tremaining: 9.11s\n",
      "7:\tlearn: 0.3182396\ttotal: 389ms\tremaining: 9.32s\n",
      "8:\tlearn: 0.3143113\ttotal: 448ms\tremaining: 9.5s\n",
      "9:\tlearn: 0.3074310\ttotal: 487ms\tremaining: 9.25s\n",
      "10:\tlearn: 0.3052278\ttotal: 558ms\tremaining: 9.59s\n",
      "11:\tlearn: 0.3019601\ttotal: 616ms\tremaining: 9.66s\n",
      "12:\tlearn: 0.2995476\ttotal: 668ms\tremaining: 9.61s\n",
      "13:\tlearn: 0.2982782\ttotal: 729ms\tremaining: 9.68s\n",
      "14:\tlearn: 0.2971409\ttotal: 778ms\tremaining: 9.6s\n",
      "15:\tlearn: 0.2958994\ttotal: 819ms\tremaining: 9.42s\n",
      "16:\tlearn: 0.2941196\ttotal: 868ms\tremaining: 9.34s\n",
      "17:\tlearn: 0.2925659\ttotal: 908ms\tremaining: 9.18s\n",
      "18:\tlearn: 0.2884236\ttotal: 1.02s\tremaining: 9.72s\n",
      "19:\tlearn: 0.2873662\ttotal: 1.08s\tremaining: 9.72s\n",
      "20:\tlearn: 0.2867908\ttotal: 1.14s\tremaining: 9.76s\n",
      "21:\tlearn: 0.2859630\ttotal: 1.19s\tremaining: 9.67s\n",
      "22:\tlearn: 0.2844540\ttotal: 1.25s\tremaining: 9.66s\n",
      "23:\tlearn: 0.2833664\ttotal: 1.31s\tremaining: 9.6s\n",
      "24:\tlearn: 0.2829578\ttotal: 1.37s\tremaining: 9.6s\n",
      "25:\tlearn: 0.2820594\ttotal: 1.48s\tremaining: 9.89s\n",
      "26:\tlearn: 0.2813476\ttotal: 1.55s\tremaining: 9.94s\n",
      "27:\tlearn: 0.2804058\ttotal: 1.61s\tremaining: 9.88s\n",
      "28:\tlearn: 0.2800862\ttotal: 1.66s\tremaining: 9.77s\n",
      "29:\tlearn: 0.2790213\ttotal: 1.72s\tremaining: 9.76s\n",
      "30:\tlearn: 0.2784915\ttotal: 1.95s\tremaining: 10.6s\n",
      "31:\tlearn: 0.2781184\ttotal: 2.02s\tremaining: 10.6s\n",
      "32:\tlearn: 0.2774706\ttotal: 2.07s\tremaining: 10.5s\n",
      "33:\tlearn: 0.2769830\ttotal: 2.11s\tremaining: 10.3s\n",
      "34:\tlearn: 0.2765610\ttotal: 2.16s\tremaining: 10.2s\n",
      "35:\tlearn: 0.2759578\ttotal: 2.22s\tremaining: 10.1s\n",
      "36:\tlearn: 0.2753296\ttotal: 2.27s\tremaining: 10s\n",
      "37:\tlearn: 0.2745335\ttotal: 2.32s\tremaining: 9.89s\n",
      "38:\tlearn: 0.2739600\ttotal: 2.37s\tremaining: 9.8s\n",
      "39:\tlearn: 0.2735087\ttotal: 2.44s\tremaining: 9.75s\n",
      "40:\tlearn: 0.2724216\ttotal: 2.48s\tremaining: 9.62s\n",
      "41:\tlearn: 0.2723521\ttotal: 2.52s\tremaining: 9.48s\n",
      "42:\tlearn: 0.2715928\ttotal: 2.57s\tremaining: 9.38s\n",
      "43:\tlearn: 0.2709497\ttotal: 2.63s\tremaining: 9.34s\n",
      "44:\tlearn: 0.2703100\ttotal: 2.68s\tremaining: 9.23s\n",
      "45:\tlearn: 0.2695307\ttotal: 2.72s\tremaining: 9.1s\n",
      "46:\tlearn: 0.2688942\ttotal: 2.76s\tremaining: 8.98s\n",
      "47:\tlearn: 0.2681200\ttotal: 2.84s\tremaining: 8.99s\n",
      "48:\tlearn: 0.2676686\ttotal: 2.95s\tremaining: 9.1s\n",
      "49:\tlearn: 0.2669230\ttotal: 3.05s\tremaining: 9.15s\n",
      "50:\tlearn: 0.2663142\ttotal: 3.1s\tremaining: 9.07s\n",
      "51:\tlearn: 0.2658611\ttotal: 3.15s\tremaining: 8.96s\n",
      "52:\tlearn: 0.2655697\ttotal: 3.19s\tremaining: 8.84s\n",
      "53:\tlearn: 0.2652779\ttotal: 3.23s\tremaining: 8.73s\n",
      "54:\tlearn: 0.2650319\ttotal: 3.3s\tremaining: 8.71s\n",
      "55:\tlearn: 0.2645317\ttotal: 3.35s\tremaining: 8.61s\n",
      "56:\tlearn: 0.2642273\ttotal: 3.4s\tremaining: 8.53s\n",
      "57:\tlearn: 0.2637379\ttotal: 3.46s\tremaining: 8.47s\n",
      "58:\tlearn: 0.2631261\ttotal: 3.52s\tremaining: 8.41s\n",
      "59:\tlearn: 0.2624877\ttotal: 3.56s\tremaining: 8.31s\n",
      "60:\tlearn: 0.2620016\ttotal: 3.6s\tremaining: 8.21s\n",
      "61:\tlearn: 0.2615522\ttotal: 3.65s\tremaining: 8.11s\n",
      "62:\tlearn: 0.2612598\ttotal: 3.71s\tremaining: 8.07s\n",
      "63:\tlearn: 0.2609154\ttotal: 3.76s\tremaining: 7.98s\n",
      "64:\tlearn: 0.2605782\ttotal: 3.8s\tremaining: 7.89s\n",
      "65:\tlearn: 0.2602267\ttotal: 3.84s\tremaining: 7.79s\n",
      "66:\tlearn: 0.2601397\ttotal: 3.92s\tremaining: 7.78s\n",
      "67:\tlearn: 0.2590525\ttotal: 3.96s\tremaining: 7.69s\n",
      "68:\tlearn: 0.2586171\ttotal: 4.11s\tremaining: 7.81s\n",
      "69:\tlearn: 0.2579246\ttotal: 4.2s\tremaining: 7.79s\n",
      "70:\tlearn: 0.2575056\ttotal: 4.24s\tremaining: 7.71s\n",
      "71:\tlearn: 0.2570127\ttotal: 4.28s\tremaining: 7.61s\n",
      "72:\tlearn: 0.2566638\ttotal: 4.34s\tremaining: 7.55s\n",
      "73:\tlearn: 0.2565051\ttotal: 4.39s\tremaining: 7.48s\n",
      "74:\tlearn: 0.2561494\ttotal: 4.45s\tremaining: 7.42s\n",
      "75:\tlearn: 0.2558822\ttotal: 4.49s\tremaining: 7.33s\n",
      "76:\tlearn: 0.2555268\ttotal: 4.54s\tremaining: 7.25s\n",
      "77:\tlearn: 0.2551042\ttotal: 4.62s\tremaining: 7.22s\n",
      "78:\tlearn: 0.2548623\ttotal: 4.66s\tremaining: 7.14s\n",
      "79:\tlearn: 0.2546431\ttotal: 4.71s\tremaining: 7.07s\n",
      "80:\tlearn: 0.2544248\ttotal: 4.78s\tremaining: 7.03s\n",
      "81:\tlearn: 0.2538896\ttotal: 4.86s\tremaining: 6.99s\n",
      "82:\tlearn: 0.2536727\ttotal: 4.92s\tremaining: 6.93s\n",
      "83:\tlearn: 0.2532410\ttotal: 4.99s\tremaining: 6.89s\n",
      "84:\tlearn: 0.2527357\ttotal: 5.05s\tremaining: 6.83s\n",
      "85:\tlearn: 0.2525648\ttotal: 5.11s\tremaining: 6.77s\n",
      "86:\tlearn: 0.2522336\ttotal: 5.15s\tremaining: 6.69s\n",
      "87:\tlearn: 0.2518509\ttotal: 5.2s\tremaining: 6.62s\n",
      "88:\tlearn: 0.2513285\ttotal: 5.26s\tremaining: 6.57s\n",
      "89:\tlearn: 0.2507566\ttotal: 5.32s\tremaining: 6.51s\n",
      "90:\tlearn: 0.2504325\ttotal: 5.39s\tremaining: 6.45s\n",
      "91:\tlearn: 0.2502066\ttotal: 5.47s\tremaining: 6.42s\n",
      "92:\tlearn: 0.2500442\ttotal: 5.53s\tremaining: 6.36s\n",
      "93:\tlearn: 0.2495353\ttotal: 5.57s\tremaining: 6.28s\n",
      "94:\tlearn: 0.2493301\ttotal: 5.63s\tremaining: 6.22s\n",
      "95:\tlearn: 0.2488095\ttotal: 5.68s\tremaining: 6.15s\n",
      "96:\tlearn: 0.2484419\ttotal: 5.75s\tremaining: 6.1s\n",
      "97:\tlearn: 0.2480089\ttotal: 5.8s\tremaining: 6.04s\n",
      "98:\tlearn: 0.2477222\ttotal: 5.88s\tremaining: 6s\n",
      "99:\tlearn: 0.2475948\ttotal: 5.92s\tremaining: 5.92s\n",
      "100:\tlearn: 0.2473987\ttotal: 5.97s\tremaining: 5.85s\n",
      "101:\tlearn: 0.2471946\ttotal: 6.02s\tremaining: 5.79s\n",
      "102:\tlearn: 0.2470436\ttotal: 6.08s\tremaining: 5.73s\n",
      "103:\tlearn: 0.2467856\ttotal: 6.15s\tremaining: 5.68s\n",
      "104:\tlearn: 0.2465686\ttotal: 6.26s\tremaining: 5.66s\n",
      "105:\tlearn: 0.2462952\ttotal: 6.39s\tremaining: 5.66s\n",
      "106:\tlearn: 0.2459949\ttotal: 6.5s\tremaining: 5.65s\n",
      "107:\tlearn: 0.2455428\ttotal: 6.58s\tremaining: 5.61s\n",
      "108:\tlearn: 0.2452547\ttotal: 6.64s\tremaining: 5.54s\n",
      "109:\tlearn: 0.2448829\ttotal: 6.68s\tremaining: 5.47s\n",
      "110:\tlearn: 0.2444251\ttotal: 6.75s\tremaining: 5.41s\n",
      "111:\tlearn: 0.2442843\ttotal: 6.81s\tremaining: 5.35s\n",
      "112:\tlearn: 0.2437936\ttotal: 6.87s\tremaining: 5.29s\n",
      "113:\tlearn: 0.2434952\ttotal: 6.96s\tremaining: 5.25s\n",
      "114:\tlearn: 0.2433109\ttotal: 7.03s\tremaining: 5.19s\n",
      "115:\tlearn: 0.2431769\ttotal: 7.1s\tremaining: 5.14s\n",
      "116:\tlearn: 0.2429923\ttotal: 7.15s\tremaining: 5.07s\n",
      "117:\tlearn: 0.2428818\ttotal: 7.2s\tremaining: 5s\n",
      "118:\tlearn: 0.2425887\ttotal: 7.25s\tremaining: 4.94s\n",
      "119:\tlearn: 0.2421810\ttotal: 7.29s\tremaining: 4.86s\n",
      "120:\tlearn: 0.2418144\ttotal: 7.37s\tremaining: 4.81s\n",
      "121:\tlearn: 0.2415742\ttotal: 7.43s\tremaining: 4.75s\n",
      "122:\tlearn: 0.2414818\ttotal: 7.49s\tremaining: 4.69s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "123:\tlearn: 0.2411942\ttotal: 7.56s\tremaining: 4.63s\n",
      "124:\tlearn: 0.2408634\ttotal: 7.61s\tremaining: 4.57s\n",
      "125:\tlearn: 0.2407461\ttotal: 7.71s\tremaining: 4.53s\n",
      "126:\tlearn: 0.2404338\ttotal: 7.76s\tremaining: 4.46s\n",
      "127:\tlearn: 0.2400488\ttotal: 7.83s\tremaining: 4.41s\n",
      "128:\tlearn: 0.2396984\ttotal: 7.97s\tremaining: 4.39s\n",
      "129:\tlearn: 0.2393968\ttotal: 8.03s\tremaining: 4.32s\n",
      "130:\tlearn: 0.2392224\ttotal: 8.09s\tremaining: 4.26s\n",
      "131:\tlearn: 0.2389273\ttotal: 8.14s\tremaining: 4.19s\n",
      "132:\tlearn: 0.2388540\ttotal: 8.2s\tremaining: 4.13s\n",
      "133:\tlearn: 0.2387392\ttotal: 8.25s\tremaining: 4.06s\n",
      "134:\tlearn: 0.2385877\ttotal: 8.29s\tremaining: 3.99s\n",
      "135:\tlearn: 0.2384826\ttotal: 8.33s\tremaining: 3.92s\n",
      "136:\tlearn: 0.2383555\ttotal: 8.38s\tremaining: 3.85s\n",
      "137:\tlearn: 0.2382372\ttotal: 8.51s\tremaining: 3.82s\n",
      "138:\tlearn: 0.2381184\ttotal: 8.66s\tremaining: 3.8s\n",
      "139:\tlearn: 0.2378536\ttotal: 8.73s\tremaining: 3.74s\n",
      "140:\tlearn: 0.2375947\ttotal: 8.8s\tremaining: 3.68s\n",
      "141:\tlearn: 0.2374298\ttotal: 8.86s\tremaining: 3.62s\n",
      "142:\tlearn: 0.2371343\ttotal: 8.95s\tremaining: 3.57s\n",
      "143:\tlearn: 0.2369157\ttotal: 9.03s\tremaining: 3.51s\n",
      "144:\tlearn: 0.2365334\ttotal: 9.09s\tremaining: 3.45s\n",
      "145:\tlearn: 0.2363154\ttotal: 9.13s\tremaining: 3.38s\n",
      "146:\tlearn: 0.2360043\ttotal: 9.18s\tremaining: 3.31s\n",
      "147:\tlearn: 0.2358559\ttotal: 9.23s\tremaining: 3.24s\n",
      "148:\tlearn: 0.2357459\ttotal: 9.28s\tremaining: 3.17s\n",
      "149:\tlearn: 0.2354444\ttotal: 9.32s\tremaining: 3.11s\n",
      "150:\tlearn: 0.2351939\ttotal: 9.37s\tremaining: 3.04s\n",
      "151:\tlearn: 0.2349027\ttotal: 9.46s\tremaining: 2.99s\n",
      "152:\tlearn: 0.2347561\ttotal: 9.51s\tremaining: 2.92s\n",
      "153:\tlearn: 0.2345881\ttotal: 9.55s\tremaining: 2.85s\n",
      "154:\tlearn: 0.2344919\ttotal: 9.61s\tremaining: 2.79s\n",
      "155:\tlearn: 0.2343039\ttotal: 9.65s\tremaining: 2.72s\n",
      "156:\tlearn: 0.2341722\ttotal: 9.69s\tremaining: 2.65s\n",
      "157:\tlearn: 0.2339119\ttotal: 9.72s\tremaining: 2.58s\n",
      "158:\tlearn: 0.2336555\ttotal: 9.77s\tremaining: 2.52s\n",
      "159:\tlearn: 0.2333917\ttotal: 9.83s\tremaining: 2.46s\n",
      "160:\tlearn: 0.2332115\ttotal: 9.86s\tremaining: 2.39s\n",
      "161:\tlearn: 0.2329097\ttotal: 9.92s\tremaining: 2.33s\n",
      "162:\tlearn: 0.2327672\ttotal: 9.96s\tremaining: 2.26s\n",
      "163:\tlearn: 0.2324471\ttotal: 10s\tremaining: 2.2s\n",
      "164:\tlearn: 0.2321162\ttotal: 10.1s\tremaining: 2.13s\n",
      "165:\tlearn: 0.2318249\ttotal: 10.1s\tremaining: 2.07s\n",
      "166:\tlearn: 0.2314577\ttotal: 10.1s\tremaining: 2s\n",
      "167:\tlearn: 0.2310676\ttotal: 10.2s\tremaining: 1.94s\n",
      "168:\tlearn: 0.2307966\ttotal: 10.2s\tremaining: 1.88s\n",
      "169:\tlearn: 0.2303878\ttotal: 10.3s\tremaining: 1.81s\n",
      "170:\tlearn: 0.2302720\ttotal: 10.3s\tremaining: 1.75s\n",
      "171:\tlearn: 0.2302258\ttotal: 10.4s\tremaining: 1.69s\n",
      "172:\tlearn: 0.2299792\ttotal: 10.4s\tremaining: 1.63s\n",
      "173:\tlearn: 0.2295774\ttotal: 10.5s\tremaining: 1.57s\n",
      "174:\tlearn: 0.2295170\ttotal: 10.5s\tremaining: 1.5s\n",
      "175:\tlearn: 0.2292344\ttotal: 10.6s\tremaining: 1.44s\n",
      "176:\tlearn: 0.2291135\ttotal: 10.7s\tremaining: 1.39s\n",
      "177:\tlearn: 0.2290077\ttotal: 10.8s\tremaining: 1.34s\n",
      "178:\tlearn: 0.2289985\ttotal: 10.9s\tremaining: 1.27s\n",
      "179:\tlearn: 0.2286697\ttotal: 10.9s\tremaining: 1.21s\n",
      "180:\tlearn: 0.2284767\ttotal: 11s\tremaining: 1.16s\n",
      "181:\tlearn: 0.2283670\ttotal: 11.1s\tremaining: 1.1s\n",
      "182:\tlearn: 0.2283317\ttotal: 11.2s\tremaining: 1.04s\n",
      "183:\tlearn: 0.2282459\ttotal: 11.2s\tremaining: 977ms\n",
      "184:\tlearn: 0.2279832\ttotal: 11.3s\tremaining: 915ms\n",
      "185:\tlearn: 0.2278340\ttotal: 11.4s\tremaining: 855ms\n",
      "186:\tlearn: 0.2277636\ttotal: 11.4s\tremaining: 794ms\n",
      "187:\tlearn: 0.2274997\ttotal: 11.5s\tremaining: 733ms\n",
      "188:\tlearn: 0.2272182\ttotal: 11.5s\tremaining: 671ms\n",
      "189:\tlearn: 0.2272009\ttotal: 11.6s\tremaining: 612ms\n",
      "190:\tlearn: 0.2269597\ttotal: 11.7s\tremaining: 551ms\n",
      "191:\tlearn: 0.2266441\ttotal: 11.7s\tremaining: 489ms\n",
      "192:\tlearn: 0.2263687\ttotal: 11.8s\tremaining: 427ms\n",
      "193:\tlearn: 0.2261245\ttotal: 11.8s\tremaining: 366ms\n",
      "194:\tlearn: 0.2258398\ttotal: 11.9s\tremaining: 305ms\n",
      "195:\tlearn: 0.2255128\ttotal: 11.9s\tremaining: 243ms\n",
      "196:\tlearn: 0.2253228\ttotal: 12s\tremaining: 183ms\n",
      "197:\tlearn: 0.2250837\ttotal: 12s\tremaining: 121ms\n",
      "198:\tlearn: 0.2249329\ttotal: 12.1s\tremaining: 60.8ms\n",
      "199:\tlearn: 0.2246559\ttotal: 12.1s\tremaining: 0us\n",
      "0:\tlearn: 0.4884659\ttotal: 42.4ms\tremaining: 8.43s\n",
      "1:\tlearn: 0.4081357\ttotal: 79.5ms\tremaining: 7.87s\n",
      "2:\tlearn: 0.3744098\ttotal: 125ms\tremaining: 8.2s\n",
      "3:\tlearn: 0.3574307\ttotal: 166ms\tremaining: 8.16s\n",
      "4:\tlearn: 0.3450571\ttotal: 213ms\tremaining: 8.3s\n",
      "5:\tlearn: 0.3357138\ttotal: 273ms\tremaining: 8.82s\n",
      "6:\tlearn: 0.3270779\ttotal: 330ms\tremaining: 9.11s\n",
      "7:\tlearn: 0.3206461\ttotal: 369ms\tremaining: 8.85s\n",
      "8:\tlearn: 0.3153183\ttotal: 407ms\tremaining: 8.63s\n",
      "9:\tlearn: 0.3124480\ttotal: 446ms\tremaining: 8.47s\n",
      "10:\tlearn: 0.3097381\ttotal: 497ms\tremaining: 8.54s\n",
      "11:\tlearn: 0.3064184\ttotal: 642ms\tremaining: 10.1s\n",
      "12:\tlearn: 0.3028931\ttotal: 781ms\tremaining: 11.2s\n",
      "13:\tlearn: 0.3009571\ttotal: 983ms\tremaining: 13.1s\n",
      "14:\tlearn: 0.2994812\ttotal: 1.05s\tremaining: 12.9s\n",
      "15:\tlearn: 0.2971076\ttotal: 1.16s\tremaining: 13.3s\n",
      "16:\tlearn: 0.2962274\ttotal: 1.22s\tremaining: 13.1s\n",
      "17:\tlearn: 0.2953282\ttotal: 1.27s\tremaining: 12.9s\n",
      "18:\tlearn: 0.2936366\ttotal: 1.31s\tremaining: 12.5s\n",
      "19:\tlearn: 0.2923238\ttotal: 1.35s\tremaining: 12.1s\n",
      "20:\tlearn: 0.2914909\ttotal: 1.39s\tremaining: 11.8s\n",
      "21:\tlearn: 0.2903283\ttotal: 1.44s\tremaining: 11.7s\n",
      "22:\tlearn: 0.2891810\ttotal: 1.49s\tremaining: 11.5s\n",
      "23:\tlearn: 0.2882041\ttotal: 1.53s\tremaining: 11.3s\n",
      "24:\tlearn: 0.2877538\ttotal: 1.57s\tremaining: 11s\n",
      "25:\tlearn: 0.2873292\ttotal: 1.62s\tremaining: 10.8s\n",
      "26:\tlearn: 0.2868595\ttotal: 1.68s\tremaining: 10.8s\n",
      "27:\tlearn: 0.2853838\ttotal: 1.74s\tremaining: 10.7s\n",
      "28:\tlearn: 0.2849605\ttotal: 1.78s\tremaining: 10.5s\n",
      "29:\tlearn: 0.2836869\ttotal: 1.82s\tremaining: 10.3s\n",
      "30:\tlearn: 0.2831392\ttotal: 1.86s\tremaining: 10.1s\n",
      "31:\tlearn: 0.2825578\ttotal: 1.93s\tremaining: 10.1s\n",
      "32:\tlearn: 0.2819614\ttotal: 1.97s\tremaining: 9.98s\n",
      "33:\tlearn: 0.2810398\ttotal: 2.01s\tremaining: 9.82s\n",
      "34:\tlearn: 0.2772979\ttotal: 2.05s\tremaining: 9.67s\n",
      "35:\tlearn: 0.2761708\ttotal: 2.09s\tremaining: 9.53s\n",
      "36:\tlearn: 0.2755190\ttotal: 2.13s\tremaining: 9.41s\n",
      "37:\tlearn: 0.2749496\ttotal: 2.23s\tremaining: 9.49s\n",
      "38:\tlearn: 0.2743249\ttotal: 2.26s\tremaining: 9.35s\n",
      "39:\tlearn: 0.2733811\ttotal: 2.3s\tremaining: 9.21s\n",
      "40:\tlearn: 0.2730010\ttotal: 2.35s\tremaining: 9.11s\n",
      "41:\tlearn: 0.2724098\ttotal: 2.42s\tremaining: 9.11s\n",
      "42:\tlearn: 0.2718207\ttotal: 2.49s\tremaining: 9.1s\n",
      "43:\tlearn: 0.2711741\ttotal: 2.54s\tremaining: 9s\n",
      "44:\tlearn: 0.2700980\ttotal: 2.6s\tremaining: 8.97s\n",
      "45:\tlearn: 0.2695197\ttotal: 2.65s\tremaining: 8.87s\n",
      "46:\tlearn: 0.2691774\ttotal: 2.69s\tremaining: 8.77s\n",
      "47:\tlearn: 0.2683061\ttotal: 2.81s\tremaining: 8.88s\n",
      "48:\tlearn: 0.2675424\ttotal: 2.91s\tremaining: 8.98s\n",
      "49:\tlearn: 0.2671479\ttotal: 2.98s\tremaining: 8.93s\n",
      "50:\tlearn: 0.2668149\ttotal: 3.04s\tremaining: 8.89s\n",
      "51:\tlearn: 0.2664718\ttotal: 3.12s\tremaining: 8.89s\n",
      "52:\tlearn: 0.2654729\ttotal: 3.18s\tremaining: 8.83s\n",
      "53:\tlearn: 0.2651965\ttotal: 3.23s\tremaining: 8.72s\n",
      "54:\tlearn: 0.2649209\ttotal: 3.27s\tremaining: 8.63s\n",
      "55:\tlearn: 0.2643448\ttotal: 3.33s\tremaining: 8.57s\n",
      "56:\tlearn: 0.2639125\ttotal: 3.37s\tremaining: 8.46s\n",
      "57:\tlearn: 0.2632846\ttotal: 3.41s\tremaining: 8.36s\n",
      "58:\tlearn: 0.2628201\ttotal: 3.45s\tremaining: 8.25s\n",
      "59:\tlearn: 0.2624109\ttotal: 3.5s\tremaining: 8.16s\n",
      "60:\tlearn: 0.2620855\ttotal: 3.56s\tremaining: 8.12s\n",
      "61:\tlearn: 0.2615069\ttotal: 3.62s\tremaining: 8.06s\n",
      "62:\tlearn: 0.2610773\ttotal: 3.69s\tremaining: 8.03s\n",
      "63:\tlearn: 0.2607377\ttotal: 3.79s\tremaining: 8.05s\n",
      "64:\tlearn: 0.2605772\ttotal: 3.85s\tremaining: 7.99s\n",
      "65:\tlearn: 0.2599661\ttotal: 3.92s\tremaining: 7.96s\n",
      "66:\tlearn: 0.2594736\ttotal: 3.98s\tremaining: 7.89s\n",
      "67:\tlearn: 0.2588857\ttotal: 4.02s\tremaining: 7.81s\n",
      "68:\tlearn: 0.2586601\ttotal: 4.08s\tremaining: 7.75s\n",
      "69:\tlearn: 0.2583609\ttotal: 4.13s\tremaining: 7.67s\n",
      "70:\tlearn: 0.2581312\ttotal: 4.2s\tremaining: 7.63s\n",
      "71:\tlearn: 0.2577099\ttotal: 4.24s\tremaining: 7.53s\n",
      "72:\tlearn: 0.2572858\ttotal: 4.28s\tremaining: 7.44s\n",
      "73:\tlearn: 0.2568230\ttotal: 4.31s\tremaining: 7.34s\n",
      "74:\tlearn: 0.2563117\ttotal: 4.37s\tremaining: 7.28s\n",
      "75:\tlearn: 0.2558346\ttotal: 4.44s\tremaining: 7.24s\n",
      "76:\tlearn: 0.2553333\ttotal: 4.49s\tremaining: 7.17s\n",
      "77:\tlearn: 0.2544442\ttotal: 4.56s\tremaining: 7.13s\n",
      "78:\tlearn: 0.2538222\ttotal: 4.63s\tremaining: 7.09s\n",
      "79:\tlearn: 0.2537445\ttotal: 4.68s\tremaining: 7.02s\n",
      "80:\tlearn: 0.2534349\ttotal: 4.75s\tremaining: 6.98s\n",
      "81:\tlearn: 0.2531215\ttotal: 4.81s\tremaining: 6.92s\n",
      "82:\tlearn: 0.2527374\ttotal: 4.9s\tremaining: 6.9s\n",
      "83:\tlearn: 0.2525875\ttotal: 5.02s\tremaining: 6.94s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "84:\tlearn: 0.2522913\ttotal: 5.18s\tremaining: 7s\n",
      "85:\tlearn: 0.2519001\ttotal: 5.25s\tremaining: 6.96s\n",
      "86:\tlearn: 0.2513308\ttotal: 5.33s\tremaining: 6.92s\n",
      "87:\tlearn: 0.2508407\ttotal: 5.39s\tremaining: 6.86s\n",
      "88:\tlearn: 0.2506509\ttotal: 5.45s\tremaining: 6.8s\n",
      "89:\tlearn: 0.2501783\ttotal: 5.51s\tremaining: 6.74s\n",
      "90:\tlearn: 0.2500411\ttotal: 5.56s\tremaining: 6.66s\n",
      "91:\tlearn: 0.2495824\ttotal: 5.6s\tremaining: 6.58s\n",
      "92:\tlearn: 0.2490950\ttotal: 5.66s\tremaining: 6.51s\n",
      "93:\tlearn: 0.2488926\ttotal: 5.71s\tremaining: 6.43s\n",
      "94:\tlearn: 0.2484046\ttotal: 5.75s\tremaining: 6.35s\n",
      "95:\tlearn: 0.2481794\ttotal: 5.79s\tremaining: 6.27s\n",
      "96:\tlearn: 0.2479094\ttotal: 5.83s\tremaining: 6.19s\n",
      "97:\tlearn: 0.2474333\ttotal: 5.9s\tremaining: 6.14s\n",
      "98:\tlearn: 0.2472361\ttotal: 5.95s\tremaining: 6.07s\n",
      "99:\tlearn: 0.2471621\ttotal: 5.99s\tremaining: 5.99s\n",
      "100:\tlearn: 0.2467285\ttotal: 6.05s\tremaining: 5.93s\n",
      "101:\tlearn: 0.2464162\ttotal: 6.14s\tremaining: 5.89s\n",
      "102:\tlearn: 0.2463307\ttotal: 6.21s\tremaining: 5.85s\n",
      "103:\tlearn: 0.2461855\ttotal: 6.27s\tremaining: 5.79s\n",
      "104:\tlearn: 0.2459343\ttotal: 6.37s\tremaining: 5.76s\n",
      "105:\tlearn: 0.2456722\ttotal: 6.43s\tremaining: 5.71s\n",
      "106:\tlearn: 0.2453904\ttotal: 6.49s\tremaining: 5.64s\n",
      "107:\tlearn: 0.2450109\ttotal: 6.58s\tremaining: 5.6s\n",
      "108:\tlearn: 0.2446274\ttotal: 6.64s\tremaining: 5.54s\n",
      "109:\tlearn: 0.2444840\ttotal: 6.68s\tremaining: 5.46s\n",
      "110:\tlearn: 0.2441018\ttotal: 6.75s\tremaining: 5.41s\n",
      "111:\tlearn: 0.2437408\ttotal: 6.81s\tremaining: 5.35s\n",
      "112:\tlearn: 0.2434843\ttotal: 6.85s\tremaining: 5.27s\n",
      "113:\tlearn: 0.2432032\ttotal: 6.9s\tremaining: 5.21s\n",
      "114:\tlearn: 0.2430427\ttotal: 6.96s\tremaining: 5.14s\n",
      "115:\tlearn: 0.2426406\ttotal: 7.03s\tremaining: 5.09s\n",
      "116:\tlearn: 0.2424035\ttotal: 7.09s\tremaining: 5.03s\n",
      "117:\tlearn: 0.2421204\ttotal: 7.14s\tremaining: 4.96s\n",
      "118:\tlearn: 0.2417192\ttotal: 7.2s\tremaining: 4.9s\n",
      "119:\tlearn: 0.2413040\ttotal: 7.33s\tremaining: 4.89s\n",
      "120:\tlearn: 0.2410454\ttotal: 7.42s\tremaining: 4.84s\n",
      "121:\tlearn: 0.2407491\ttotal: 7.46s\tremaining: 4.77s\n",
      "122:\tlearn: 0.2403673\ttotal: 7.5s\tremaining: 4.69s\n",
      "123:\tlearn: 0.2401332\ttotal: 7.54s\tremaining: 4.62s\n",
      "124:\tlearn: 0.2397060\ttotal: 7.63s\tremaining: 4.58s\n",
      "125:\tlearn: 0.2394986\ttotal: 7.71s\tremaining: 4.53s\n",
      "126:\tlearn: 0.2390124\ttotal: 7.78s\tremaining: 4.47s\n",
      "127:\tlearn: 0.2387007\ttotal: 7.84s\tremaining: 4.41s\n",
      "128:\tlearn: 0.2384749\ttotal: 7.9s\tremaining: 4.35s\n",
      "129:\tlearn: 0.2380753\ttotal: 7.94s\tremaining: 4.27s\n",
      "130:\tlearn: 0.2378170\ttotal: 8s\tremaining: 4.21s\n",
      "131:\tlearn: 0.2375372\ttotal: 8.08s\tremaining: 4.16s\n",
      "132:\tlearn: 0.2372601\ttotal: 8.15s\tremaining: 4.1s\n",
      "133:\tlearn: 0.2368860\ttotal: 8.22s\tremaining: 4.05s\n",
      "134:\tlearn: 0.2365697\ttotal: 8.26s\tremaining: 3.98s\n",
      "135:\tlearn: 0.2363524\ttotal: 8.32s\tremaining: 3.92s\n",
      "136:\tlearn: 0.2360234\ttotal: 8.4s\tremaining: 3.87s\n",
      "137:\tlearn: 0.2357628\ttotal: 8.46s\tremaining: 3.8s\n",
      "138:\tlearn: 0.2354255\ttotal: 8.52s\tremaining: 3.74s\n",
      "139:\tlearn: 0.2349524\ttotal: 8.57s\tremaining: 3.67s\n",
      "140:\tlearn: 0.2346763\ttotal: 8.61s\tremaining: 3.6s\n",
      "141:\tlearn: 0.2346136\ttotal: 8.64s\tremaining: 3.53s\n",
      "142:\tlearn: 0.2343162\ttotal: 8.7s\tremaining: 3.47s\n",
      "143:\tlearn: 0.2340251\ttotal: 8.75s\tremaining: 3.4s\n",
      "144:\tlearn: 0.2339311\ttotal: 8.79s\tremaining: 3.33s\n",
      "145:\tlearn: 0.2336207\ttotal: 8.82s\tremaining: 3.26s\n",
      "146:\tlearn: 0.2332967\ttotal: 8.86s\tremaining: 3.19s\n",
      "147:\tlearn: 0.2328957\ttotal: 8.9s\tremaining: 3.13s\n",
      "148:\tlearn: 0.2326389\ttotal: 8.98s\tremaining: 3.07s\n",
      "149:\tlearn: 0.2324441\ttotal: 9.02s\tremaining: 3s\n",
      "150:\tlearn: 0.2320716\ttotal: 9.05s\tremaining: 2.94s\n",
      "151:\tlearn: 0.2319136\ttotal: 9.1s\tremaining: 2.87s\n",
      "152:\tlearn: 0.2317923\ttotal: 9.16s\tremaining: 2.81s\n",
      "153:\tlearn: 0.2317794\ttotal: 9.19s\tremaining: 2.75s\n",
      "154:\tlearn: 0.2315852\ttotal: 9.23s\tremaining: 2.68s\n",
      "155:\tlearn: 0.2315210\ttotal: 9.27s\tremaining: 2.61s\n",
      "156:\tlearn: 0.2311333\ttotal: 9.34s\tremaining: 2.56s\n",
      "157:\tlearn: 0.2306947\ttotal: 9.39s\tremaining: 2.5s\n",
      "158:\tlearn: 0.2303265\ttotal: 9.58s\tremaining: 2.47s\n",
      "159:\tlearn: 0.2300096\ttotal: 9.63s\tremaining: 2.41s\n",
      "160:\tlearn: 0.2297845\ttotal: 9.67s\tremaining: 2.34s\n",
      "161:\tlearn: 0.2296905\ttotal: 9.71s\tremaining: 2.28s\n",
      "162:\tlearn: 0.2295913\ttotal: 9.75s\tremaining: 2.21s\n",
      "163:\tlearn: 0.2292160\ttotal: 9.81s\tremaining: 2.15s\n",
      "164:\tlearn: 0.2289030\ttotal: 9.86s\tremaining: 2.09s\n",
      "165:\tlearn: 0.2285491\ttotal: 9.9s\tremaining: 2.03s\n",
      "166:\tlearn: 0.2282429\ttotal: 9.94s\tremaining: 1.96s\n",
      "167:\tlearn: 0.2279679\ttotal: 9.97s\tremaining: 1.9s\n",
      "168:\tlearn: 0.2276615\ttotal: 10.1s\tremaining: 1.84s\n",
      "169:\tlearn: 0.2273632\ttotal: 10.1s\tremaining: 1.78s\n",
      "170:\tlearn: 0.2271091\ttotal: 10.2s\tremaining: 1.72s\n",
      "171:\tlearn: 0.2270608\ttotal: 10.2s\tremaining: 1.66s\n",
      "172:\tlearn: 0.2270117\ttotal: 10.2s\tremaining: 1.6s\n",
      "173:\tlearn: 0.2266012\ttotal: 10.3s\tremaining: 1.53s\n",
      "174:\tlearn: 0.2262926\ttotal: 10.3s\tremaining: 1.48s\n",
      "175:\tlearn: 0.2261053\ttotal: 10.4s\tremaining: 1.41s\n",
      "176:\tlearn: 0.2258464\ttotal: 10.4s\tremaining: 1.35s\n",
      "177:\tlearn: 0.2256669\ttotal: 10.4s\tremaining: 1.29s\n",
      "178:\tlearn: 0.2255390\ttotal: 10.5s\tremaining: 1.23s\n",
      "179:\tlearn: 0.2251964\ttotal: 10.6s\tremaining: 1.17s\n",
      "180:\tlearn: 0.2249162\ttotal: 10.6s\tremaining: 1.11s\n",
      "181:\tlearn: 0.2247379\ttotal: 10.6s\tremaining: 1.05s\n",
      "182:\tlearn: 0.2244589\ttotal: 10.7s\tremaining: 993ms\n",
      "183:\tlearn: 0.2242187\ttotal: 10.8s\tremaining: 935ms\n",
      "184:\tlearn: 0.2241389\ttotal: 10.8s\tremaining: 875ms\n",
      "185:\tlearn: 0.2240266\ttotal: 10.8s\tremaining: 815ms\n",
      "186:\tlearn: 0.2237841\ttotal: 10.9s\tremaining: 756ms\n",
      "187:\tlearn: 0.2235374\ttotal: 10.9s\tremaining: 698ms\n",
      "188:\tlearn: 0.2234114\ttotal: 11s\tremaining: 640ms\n",
      "189:\tlearn: 0.2231306\ttotal: 11.1s\tremaining: 583ms\n",
      "190:\tlearn: 0.2230279\ttotal: 11.2s\tremaining: 529ms\n",
      "191:\tlearn: 0.2229991\ttotal: 11.3s\tremaining: 469ms\n",
      "192:\tlearn: 0.2228452\ttotal: 11.3s\tremaining: 411ms\n",
      "193:\tlearn: 0.2224884\ttotal: 11.4s\tremaining: 352ms\n",
      "194:\tlearn: 0.2224450\ttotal: 11.4s\tremaining: 293ms\n",
      "195:\tlearn: 0.2220808\ttotal: 11.5s\tremaining: 234ms\n",
      "196:\tlearn: 0.2218511\ttotal: 11.5s\tremaining: 175ms\n",
      "197:\tlearn: 0.2213896\ttotal: 11.6s\tremaining: 117ms\n",
      "198:\tlearn: 0.2211368\ttotal: 11.7s\tremaining: 58.9ms\n",
      "199:\tlearn: 0.2209491\ttotal: 11.9s\tremaining: 0us\n",
      "0:\tlearn: 0.4887360\ttotal: 54ms\tremaining: 10.7s\n",
      "1:\tlearn: 0.4110202\ttotal: 96.4ms\tremaining: 9.55s\n",
      "2:\tlearn: 0.3773557\ttotal: 143ms\tremaining: 9.42s\n",
      "3:\tlearn: 0.3532264\ttotal: 182ms\tremaining: 8.91s\n",
      "4:\tlearn: 0.3401859\ttotal: 220ms\tremaining: 8.56s\n",
      "5:\tlearn: 0.3335600\ttotal: 266ms\tremaining: 8.59s\n",
      "6:\tlearn: 0.3284012\ttotal: 315ms\tremaining: 8.69s\n",
      "7:\tlearn: 0.3238258\ttotal: 371ms\tremaining: 8.9s\n",
      "8:\tlearn: 0.3179218\ttotal: 430ms\tremaining: 9.13s\n",
      "9:\tlearn: 0.3152325\ttotal: 485ms\tremaining: 9.21s\n",
      "10:\tlearn: 0.3090469\ttotal: 556ms\tremaining: 9.55s\n",
      "11:\tlearn: 0.3062557\ttotal: 616ms\tremaining: 9.64s\n",
      "12:\tlearn: 0.3046518\ttotal: 672ms\tremaining: 9.67s\n",
      "13:\tlearn: 0.3032956\ttotal: 739ms\tremaining: 9.82s\n",
      "14:\tlearn: 0.3014581\ttotal: 780ms\tremaining: 9.62s\n",
      "15:\tlearn: 0.2992295\ttotal: 820ms\tremaining: 9.43s\n",
      "16:\tlearn: 0.2964421\ttotal: 872ms\tremaining: 9.39s\n",
      "17:\tlearn: 0.2955067\ttotal: 936ms\tremaining: 9.46s\n",
      "18:\tlearn: 0.2943390\ttotal: 976ms\tremaining: 9.3s\n",
      "19:\tlearn: 0.2935424\ttotal: 1.01s\tremaining: 9.14s\n",
      "20:\tlearn: 0.2928080\ttotal: 1.06s\tremaining: 9.03s\n",
      "21:\tlearn: 0.2918887\ttotal: 1.1s\tremaining: 8.93s\n",
      "22:\tlearn: 0.2911962\ttotal: 1.17s\tremaining: 8.98s\n",
      "23:\tlearn: 0.2899137\ttotal: 1.24s\tremaining: 9.06s\n",
      "24:\tlearn: 0.2883546\ttotal: 1.29s\tremaining: 9s\n",
      "25:\tlearn: 0.2843291\ttotal: 1.34s\tremaining: 8.99s\n",
      "26:\tlearn: 0.2838125\ttotal: 1.4s\tremaining: 8.94s\n",
      "27:\tlearn: 0.2832594\ttotal: 1.43s\tremaining: 8.81s\n",
      "28:\tlearn: 0.2826272\ttotal: 1.47s\tremaining: 8.69s\n",
      "29:\tlearn: 0.2808890\ttotal: 1.54s\tremaining: 8.71s\n",
      "30:\tlearn: 0.2803085\ttotal: 1.58s\tremaining: 8.64s\n",
      "31:\tlearn: 0.2798536\ttotal: 1.62s\tremaining: 8.53s\n",
      "32:\tlearn: 0.2776381\ttotal: 1.67s\tremaining: 8.47s\n",
      "33:\tlearn: 0.2771029\ttotal: 1.76s\tremaining: 8.6s\n",
      "34:\tlearn: 0.2768198\ttotal: 1.84s\tremaining: 8.69s\n",
      "35:\tlearn: 0.2764894\ttotal: 1.96s\tremaining: 8.94s\n",
      "36:\tlearn: 0.2758915\ttotal: 2.03s\tremaining: 8.95s\n",
      "37:\tlearn: 0.2751363\ttotal: 2.09s\tremaining: 8.9s\n",
      "38:\tlearn: 0.2744130\ttotal: 2.14s\tremaining: 8.83s\n",
      "39:\tlearn: 0.2739829\ttotal: 2.22s\tremaining: 8.87s\n",
      "40:\tlearn: 0.2731363\ttotal: 2.29s\tremaining: 8.88s\n",
      "41:\tlearn: 0.2719138\ttotal: 2.34s\tremaining: 8.81s\n",
      "42:\tlearn: 0.2712089\ttotal: 2.4s\tremaining: 8.77s\n",
      "43:\tlearn: 0.2704257\ttotal: 2.48s\tremaining: 8.78s\n",
      "44:\tlearn: 0.2699935\ttotal: 2.53s\tremaining: 8.72s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "45:\tlearn: 0.2695278\ttotal: 2.6s\tremaining: 8.71s\n",
      "46:\tlearn: 0.2688921\ttotal: 2.67s\tremaining: 8.68s\n",
      "47:\tlearn: 0.2683755\ttotal: 2.71s\tremaining: 8.59s\n",
      "48:\tlearn: 0.2677664\ttotal: 2.75s\tremaining: 8.48s\n",
      "49:\tlearn: 0.2667065\ttotal: 2.8s\tremaining: 8.39s\n",
      "50:\tlearn: 0.2662464\ttotal: 2.87s\tremaining: 8.38s\n",
      "51:\tlearn: 0.2654807\ttotal: 2.91s\tremaining: 8.28s\n",
      "52:\tlearn: 0.2648874\ttotal: 2.98s\tremaining: 8.26s\n",
      "53:\tlearn: 0.2641305\ttotal: 3.04s\tremaining: 8.22s\n",
      "54:\tlearn: 0.2639816\ttotal: 3.1s\tremaining: 8.16s\n",
      "55:\tlearn: 0.2633510\ttotal: 3.13s\tremaining: 8.06s\n",
      "56:\tlearn: 0.2627696\ttotal: 3.17s\tremaining: 7.96s\n",
      "57:\tlearn: 0.2623309\ttotal: 3.21s\tremaining: 7.86s\n",
      "58:\tlearn: 0.2621535\ttotal: 3.28s\tremaining: 7.83s\n",
      "59:\tlearn: 0.2616692\ttotal: 3.34s\tremaining: 7.8s\n",
      "60:\tlearn: 0.2614644\ttotal: 3.39s\tremaining: 7.72s\n",
      "61:\tlearn: 0.2608377\ttotal: 3.44s\tremaining: 7.66s\n",
      "62:\tlearn: 0.2603753\ttotal: 3.49s\tremaining: 7.59s\n",
      "63:\tlearn: 0.2600076\ttotal: 3.57s\tremaining: 7.58s\n",
      "64:\tlearn: 0.2598489\ttotal: 3.63s\tremaining: 7.53s\n",
      "65:\tlearn: 0.2593307\ttotal: 3.69s\tremaining: 7.5s\n",
      "66:\tlearn: 0.2591688\ttotal: 3.77s\tremaining: 7.49s\n",
      "67:\tlearn: 0.2586332\ttotal: 3.86s\tremaining: 7.5s\n",
      "68:\tlearn: 0.2584462\ttotal: 3.97s\tremaining: 7.53s\n",
      "69:\tlearn: 0.2580773\ttotal: 4.07s\tremaining: 7.57s\n",
      "70:\tlearn: 0.2577061\ttotal: 4.22s\tremaining: 7.67s\n",
      "71:\tlearn: 0.2575960\ttotal: 4.27s\tremaining: 7.59s\n",
      "72:\tlearn: 0.2571141\ttotal: 4.31s\tremaining: 7.49s\n",
      "73:\tlearn: 0.2566048\ttotal: 4.37s\tremaining: 7.44s\n",
      "74:\tlearn: 0.2560280\ttotal: 4.46s\tremaining: 7.43s\n",
      "75:\tlearn: 0.2558752\ttotal: 4.51s\tremaining: 7.35s\n",
      "76:\tlearn: 0.2554363\ttotal: 4.55s\tremaining: 7.27s\n",
      "77:\tlearn: 0.2553840\ttotal: 4.59s\tremaining: 7.17s\n",
      "78:\tlearn: 0.2548642\ttotal: 4.63s\tremaining: 7.09s\n",
      "79:\tlearn: 0.2546713\ttotal: 4.67s\tremaining: 7.01s\n",
      "80:\tlearn: 0.2541619\ttotal: 4.73s\tremaining: 6.95s\n",
      "81:\tlearn: 0.2536991\ttotal: 4.79s\tremaining: 6.9s\n",
      "82:\tlearn: 0.2533659\ttotal: 4.85s\tremaining: 6.84s\n",
      "83:\tlearn: 0.2531699\ttotal: 4.92s\tremaining: 6.79s\n",
      "84:\tlearn: 0.2528609\ttotal: 4.96s\tremaining: 6.71s\n",
      "85:\tlearn: 0.2524328\ttotal: 5.01s\tremaining: 6.64s\n",
      "86:\tlearn: 0.2521599\ttotal: 5.05s\tremaining: 6.56s\n",
      "87:\tlearn: 0.2514190\ttotal: 5.12s\tremaining: 6.51s\n",
      "88:\tlearn: 0.2511753\ttotal: 5.16s\tremaining: 6.43s\n",
      "89:\tlearn: 0.2506722\ttotal: 5.2s\tremaining: 6.35s\n",
      "90:\tlearn: 0.2502349\ttotal: 5.26s\tremaining: 6.3s\n",
      "91:\tlearn: 0.2498023\ttotal: 5.35s\tremaining: 6.28s\n",
      "92:\tlearn: 0.2493501\ttotal: 5.4s\tremaining: 6.21s\n",
      "93:\tlearn: 0.2490531\ttotal: 5.46s\tremaining: 6.16s\n",
      "94:\tlearn: 0.2486765\ttotal: 5.55s\tremaining: 6.14s\n",
      "95:\tlearn: 0.2483292\ttotal: 5.64s\tremaining: 6.11s\n",
      "96:\tlearn: 0.2479998\ttotal: 5.71s\tremaining: 6.06s\n",
      "97:\tlearn: 0.2476491\ttotal: 5.75s\tremaining: 5.99s\n",
      "98:\tlearn: 0.2472594\ttotal: 5.81s\tremaining: 5.93s\n",
      "99:\tlearn: 0.2470101\ttotal: 5.86s\tremaining: 5.86s\n",
      "100:\tlearn: 0.2469478\ttotal: 5.9s\tremaining: 5.78s\n",
      "101:\tlearn: 0.2467391\ttotal: 5.93s\tremaining: 5.7s\n",
      "102:\tlearn: 0.2462023\ttotal: 6.01s\tremaining: 5.66s\n",
      "103:\tlearn: 0.2461236\ttotal: 6.1s\tremaining: 5.63s\n",
      "104:\tlearn: 0.2458182\ttotal: 6.19s\tremaining: 5.6s\n",
      "105:\tlearn: 0.2456329\ttotal: 6.38s\tremaining: 5.66s\n",
      "106:\tlearn: 0.2452334\ttotal: 6.47s\tremaining: 5.62s\n",
      "107:\tlearn: 0.2449398\ttotal: 6.52s\tremaining: 5.55s\n",
      "108:\tlearn: 0.2447201\ttotal: 6.57s\tremaining: 5.49s\n",
      "109:\tlearn: 0.2443484\ttotal: 6.62s\tremaining: 5.42s\n",
      "110:\tlearn: 0.2439214\ttotal: 6.68s\tremaining: 5.35s\n",
      "111:\tlearn: 0.2433963\ttotal: 6.72s\tremaining: 5.28s\n",
      "112:\tlearn: 0.2432693\ttotal: 6.76s\tremaining: 5.2s\n",
      "113:\tlearn: 0.2431357\ttotal: 6.79s\tremaining: 5.12s\n",
      "114:\tlearn: 0.2427103\ttotal: 6.84s\tremaining: 5.05s\n",
      "115:\tlearn: 0.2426400\ttotal: 6.91s\tremaining: 5s\n",
      "116:\tlearn: 0.2423108\ttotal: 6.96s\tremaining: 4.94s\n",
      "117:\tlearn: 0.2418913\ttotal: 7s\tremaining: 4.87s\n",
      "118:\tlearn: 0.2418482\ttotal: 7.04s\tremaining: 4.79s\n",
      "119:\tlearn: 0.2415859\ttotal: 7.11s\tremaining: 4.74s\n",
      "120:\tlearn: 0.2412065\ttotal: 7.15s\tremaining: 4.67s\n",
      "121:\tlearn: 0.2409234\ttotal: 7.19s\tremaining: 4.59s\n",
      "122:\tlearn: 0.2406851\ttotal: 7.23s\tremaining: 4.52s\n",
      "123:\tlearn: 0.2404390\ttotal: 7.29s\tremaining: 4.47s\n",
      "124:\tlearn: 0.2402061\ttotal: 7.33s\tremaining: 4.4s\n",
      "125:\tlearn: 0.2400016\ttotal: 7.37s\tremaining: 4.33s\n",
      "126:\tlearn: 0.2398620\ttotal: 7.41s\tremaining: 4.26s\n",
      "127:\tlearn: 0.2395259\ttotal: 7.47s\tremaining: 4.2s\n",
      "128:\tlearn: 0.2391237\ttotal: 7.54s\tremaining: 4.15s\n",
      "129:\tlearn: 0.2389789\ttotal: 7.58s\tremaining: 4.08s\n",
      "130:\tlearn: 0.2385930\ttotal: 7.62s\tremaining: 4.01s\n",
      "131:\tlearn: 0.2384536\ttotal: 7.66s\tremaining: 3.94s\n",
      "132:\tlearn: 0.2381896\ttotal: 7.7s\tremaining: 3.88s\n",
      "133:\tlearn: 0.2378676\ttotal: 7.76s\tremaining: 3.82s\n",
      "134:\tlearn: 0.2378279\ttotal: 7.79s\tremaining: 3.75s\n",
      "135:\tlearn: 0.2377031\ttotal: 7.83s\tremaining: 3.69s\n",
      "136:\tlearn: 0.2375446\ttotal: 7.87s\tremaining: 3.62s\n",
      "137:\tlearn: 0.2371841\ttotal: 7.91s\tremaining: 3.55s\n",
      "138:\tlearn: 0.2367872\ttotal: 7.99s\tremaining: 3.51s\n",
      "139:\tlearn: 0.2365500\ttotal: 8.03s\tremaining: 3.44s\n",
      "140:\tlearn: 0.2363907\ttotal: 8.07s\tremaining: 3.38s\n",
      "141:\tlearn: 0.2362619\ttotal: 8.11s\tremaining: 3.31s\n",
      "142:\tlearn: 0.2358673\ttotal: 8.17s\tremaining: 3.26s\n",
      "143:\tlearn: 0.2355923\ttotal: 8.21s\tremaining: 3.19s\n",
      "144:\tlearn: 0.2352874\ttotal: 8.25s\tremaining: 3.13s\n",
      "145:\tlearn: 0.2351892\ttotal: 8.29s\tremaining: 3.06s\n",
      "146:\tlearn: 0.2348712\ttotal: 8.33s\tremaining: 3s\n",
      "147:\tlearn: 0.2346623\ttotal: 8.39s\tremaining: 2.95s\n",
      "148:\tlearn: 0.2343108\ttotal: 8.48s\tremaining: 2.9s\n",
      "149:\tlearn: 0.2341190\ttotal: 8.59s\tremaining: 2.86s\n",
      "150:\tlearn: 0.2335386\ttotal: 8.67s\tremaining: 2.81s\n",
      "151:\tlearn: 0.2333558\ttotal: 8.72s\tremaining: 2.75s\n",
      "152:\tlearn: 0.2330696\ttotal: 8.77s\tremaining: 2.69s\n",
      "153:\tlearn: 0.2326996\ttotal: 8.83s\tremaining: 2.64s\n",
      "154:\tlearn: 0.2324433\ttotal: 8.87s\tremaining: 2.58s\n",
      "155:\tlearn: 0.2321544\ttotal: 8.91s\tremaining: 2.51s\n",
      "156:\tlearn: 0.2320724\ttotal: 8.96s\tremaining: 2.45s\n",
      "157:\tlearn: 0.2319271\ttotal: 9.03s\tremaining: 2.4s\n",
      "158:\tlearn: 0.2314977\ttotal: 9.24s\tremaining: 2.38s\n",
      "159:\tlearn: 0.2312079\ttotal: 9.33s\tremaining: 2.33s\n",
      "160:\tlearn: 0.2308757\ttotal: 9.42s\tremaining: 2.28s\n",
      "161:\tlearn: 0.2307744\ttotal: 9.48s\tremaining: 2.22s\n",
      "162:\tlearn: 0.2304983\ttotal: 9.53s\tremaining: 2.16s\n",
      "163:\tlearn: 0.2303841\ttotal: 9.57s\tremaining: 2.1s\n",
      "164:\tlearn: 0.2300761\ttotal: 9.61s\tremaining: 2.04s\n",
      "165:\tlearn: 0.2296782\ttotal: 9.65s\tremaining: 1.98s\n",
      "166:\tlearn: 0.2294719\ttotal: 9.69s\tremaining: 1.92s\n",
      "167:\tlearn: 0.2293105\ttotal: 9.76s\tremaining: 1.86s\n",
      "168:\tlearn: 0.2291357\ttotal: 9.82s\tremaining: 1.8s\n",
      "169:\tlearn: 0.2287170\ttotal: 9.88s\tremaining: 1.74s\n",
      "170:\tlearn: 0.2284937\ttotal: 9.94s\tremaining: 1.69s\n",
      "171:\tlearn: 0.2283678\ttotal: 10s\tremaining: 1.63s\n",
      "172:\tlearn: 0.2282134\ttotal: 10s\tremaining: 1.57s\n",
      "173:\tlearn: 0.2278286\ttotal: 10.1s\tremaining: 1.5s\n",
      "174:\tlearn: 0.2277263\ttotal: 10.1s\tremaining: 1.45s\n",
      "175:\tlearn: 0.2275403\ttotal: 10.2s\tremaining: 1.39s\n",
      "176:\tlearn: 0.2271400\ttotal: 10.2s\tremaining: 1.33s\n",
      "177:\tlearn: 0.2268774\ttotal: 10.3s\tremaining: 1.27s\n",
      "178:\tlearn: 0.2265708\ttotal: 10.3s\tremaining: 1.21s\n",
      "179:\tlearn: 0.2262290\ttotal: 10.4s\tremaining: 1.15s\n",
      "180:\tlearn: 0.2259083\ttotal: 10.4s\tremaining: 1.09s\n",
      "181:\tlearn: 0.2256612\ttotal: 10.5s\tremaining: 1.03s\n",
      "182:\tlearn: 0.2254334\ttotal: 10.5s\tremaining: 978ms\n",
      "183:\tlearn: 0.2251381\ttotal: 10.6s\tremaining: 919ms\n",
      "184:\tlearn: 0.2248683\ttotal: 10.6s\tremaining: 860ms\n",
      "185:\tlearn: 0.2246531\ttotal: 10.6s\tremaining: 801ms\n",
      "186:\tlearn: 0.2243623\ttotal: 10.7s\tremaining: 744ms\n",
      "187:\tlearn: 0.2242871\ttotal: 10.8s\tremaining: 689ms\n",
      "188:\tlearn: 0.2240584\ttotal: 10.9s\tremaining: 635ms\n",
      "189:\tlearn: 0.2238450\ttotal: 11s\tremaining: 578ms\n",
      "190:\tlearn: 0.2237094\ttotal: 11s\tremaining: 520ms\n",
      "191:\tlearn: 0.2233784\ttotal: 11.1s\tremaining: 462ms\n",
      "192:\tlearn: 0.2230560\ttotal: 11.1s\tremaining: 403ms\n",
      "193:\tlearn: 0.2227906\ttotal: 11.2s\tremaining: 346ms\n",
      "194:\tlearn: 0.2225174\ttotal: 11.2s\tremaining: 288ms\n",
      "195:\tlearn: 0.2222137\ttotal: 11.3s\tremaining: 230ms\n",
      "196:\tlearn: 0.2217799\ttotal: 11.3s\tremaining: 172ms\n",
      "197:\tlearn: 0.2217171\ttotal: 11.3s\tremaining: 115ms\n",
      "198:\tlearn: 0.2213964\ttotal: 11.4s\tremaining: 57.3ms\n",
      "199:\tlearn: 0.2212671\ttotal: 11.5s\tremaining: 0us\n",
      "0:\tlearn: 0.4917298\ttotal: 37.4ms\tremaining: 7.44s\n",
      "1:\tlearn: 0.4102328\ttotal: 72.3ms\tremaining: 7.16s\n",
      "2:\tlearn: 0.3703447\ttotal: 111ms\tremaining: 7.28s\n",
      "3:\tlearn: 0.3568417\ttotal: 146ms\tremaining: 7.18s\n",
      "4:\tlearn: 0.3414381\ttotal: 230ms\tremaining: 8.97s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "5:\tlearn: 0.3311381\ttotal: 305ms\tremaining: 9.86s\n",
      "6:\tlearn: 0.3264056\ttotal: 351ms\tremaining: 9.67s\n",
      "7:\tlearn: 0.3226739\ttotal: 389ms\tremaining: 9.33s\n",
      "8:\tlearn: 0.3180068\ttotal: 428ms\tremaining: 9.08s\n",
      "9:\tlearn: 0.3148788\ttotal: 500ms\tremaining: 9.49s\n",
      "10:\tlearn: 0.3091801\ttotal: 538ms\tremaining: 9.24s\n",
      "11:\tlearn: 0.3064734\ttotal: 577ms\tremaining: 9.03s\n",
      "12:\tlearn: 0.3023545\ttotal: 614ms\tremaining: 8.84s\n",
      "13:\tlearn: 0.3001431\ttotal: 665ms\tremaining: 8.84s\n",
      "14:\tlearn: 0.2985010\ttotal: 705ms\tremaining: 8.7s\n",
      "15:\tlearn: 0.2971947\ttotal: 751ms\tremaining: 8.64s\n",
      "16:\tlearn: 0.2958124\ttotal: 797ms\tremaining: 8.58s\n",
      "17:\tlearn: 0.2948482\ttotal: 851ms\tremaining: 8.61s\n",
      "18:\tlearn: 0.2941997\ttotal: 903ms\tremaining: 8.61s\n",
      "19:\tlearn: 0.2923554\ttotal: 945ms\tremaining: 8.5s\n",
      "20:\tlearn: 0.2916510\ttotal: 992ms\tremaining: 8.45s\n",
      "21:\tlearn: 0.2881631\ttotal: 1.07s\tremaining: 8.64s\n",
      "22:\tlearn: 0.2866951\ttotal: 1.13s\tremaining: 8.68s\n",
      "23:\tlearn: 0.2860071\ttotal: 1.18s\tremaining: 8.68s\n",
      "24:\tlearn: 0.2852350\ttotal: 1.25s\tremaining: 8.79s\n",
      "25:\tlearn: 0.2848705\ttotal: 1.49s\tremaining: 9.95s\n",
      "26:\tlearn: 0.2844211\ttotal: 1.6s\tremaining: 10.3s\n",
      "27:\tlearn: 0.2837306\ttotal: 1.68s\tremaining: 10.3s\n",
      "28:\tlearn: 0.2819126\ttotal: 1.73s\tremaining: 10.2s\n",
      "29:\tlearn: 0.2814082\ttotal: 1.78s\tremaining: 10.1s\n",
      "30:\tlearn: 0.2808261\ttotal: 1.82s\tremaining: 9.9s\n",
      "31:\tlearn: 0.2804243\ttotal: 1.85s\tremaining: 9.73s\n",
      "32:\tlearn: 0.2795664\ttotal: 1.9s\tremaining: 9.63s\n",
      "33:\tlearn: 0.2790536\ttotal: 1.95s\tremaining: 9.54s\n",
      "34:\tlearn: 0.2784352\ttotal: 2.03s\tremaining: 9.56s\n",
      "35:\tlearn: 0.2774499\ttotal: 2.09s\tremaining: 9.51s\n",
      "36:\tlearn: 0.2766988\ttotal: 2.15s\tremaining: 9.47s\n",
      "37:\tlearn: 0.2761929\ttotal: 2.22s\tremaining: 9.48s\n",
      "38:\tlearn: 0.2756270\ttotal: 2.28s\tremaining: 9.43s\n",
      "39:\tlearn: 0.2750112\ttotal: 2.32s\tremaining: 9.29s\n",
      "40:\tlearn: 0.2746511\ttotal: 2.37s\tremaining: 9.18s\n",
      "41:\tlearn: 0.2740925\ttotal: 2.42s\tremaining: 9.11s\n",
      "42:\tlearn: 0.2729611\ttotal: 2.46s\tremaining: 8.98s\n",
      "43:\tlearn: 0.2716126\ttotal: 2.5s\tremaining: 8.85s\n",
      "44:\tlearn: 0.2710329\ttotal: 2.53s\tremaining: 8.73s\n",
      "45:\tlearn: 0.2701628\ttotal: 2.58s\tremaining: 8.65s\n",
      "46:\tlearn: 0.2698632\ttotal: 2.64s\tremaining: 8.58s\n",
      "47:\tlearn: 0.2693771\ttotal: 2.71s\tremaining: 8.57s\n",
      "48:\tlearn: 0.2689556\ttotal: 2.77s\tremaining: 8.55s\n",
      "49:\tlearn: 0.2675861\ttotal: 2.83s\tremaining: 8.5s\n",
      "50:\tlearn: 0.2669533\ttotal: 2.87s\tremaining: 8.39s\n",
      "51:\tlearn: 0.2662241\ttotal: 2.91s\tremaining: 8.29s\n",
      "52:\tlearn: 0.2654497\ttotal: 2.95s\tremaining: 8.18s\n",
      "53:\tlearn: 0.2652958\ttotal: 2.99s\tremaining: 8.07s\n",
      "54:\tlearn: 0.2642633\ttotal: 3.05s\tremaining: 8.03s\n",
      "55:\tlearn: 0.2637185\ttotal: 3.08s\tremaining: 7.93s\n",
      "56:\tlearn: 0.2631288\ttotal: 3.12s\tremaining: 7.83s\n",
      "57:\tlearn: 0.2627680\ttotal: 3.16s\tremaining: 7.74s\n",
      "58:\tlearn: 0.2621118\ttotal: 3.21s\tremaining: 7.68s\n",
      "59:\tlearn: 0.2615837\ttotal: 3.27s\tremaining: 7.62s\n",
      "60:\tlearn: 0.2611661\ttotal: 3.32s\tremaining: 7.56s\n",
      "61:\tlearn: 0.2606551\ttotal: 3.36s\tremaining: 7.48s\n",
      "62:\tlearn: 0.2602628\ttotal: 3.4s\tremaining: 7.4s\n",
      "63:\tlearn: 0.2598930\ttotal: 3.47s\tremaining: 7.37s\n",
      "64:\tlearn: 0.2594921\ttotal: 3.52s\tremaining: 7.3s\n",
      "65:\tlearn: 0.2590351\ttotal: 3.59s\tremaining: 7.29s\n",
      "66:\tlearn: 0.2585508\ttotal: 3.74s\tremaining: 7.43s\n",
      "67:\tlearn: 0.2579718\ttotal: 3.81s\tremaining: 7.39s\n",
      "68:\tlearn: 0.2574965\ttotal: 3.88s\tremaining: 7.36s\n",
      "69:\tlearn: 0.2573424\ttotal: 3.99s\tremaining: 7.41s\n",
      "70:\tlearn: 0.2570091\ttotal: 4.03s\tremaining: 7.32s\n",
      "71:\tlearn: 0.2563930\ttotal: 4.07s\tremaining: 7.23s\n",
      "72:\tlearn: 0.2559537\ttotal: 4.13s\tremaining: 7.19s\n",
      "73:\tlearn: 0.2556624\ttotal: 4.17s\tremaining: 7.1s\n",
      "74:\tlearn: 0.2553902\ttotal: 4.21s\tremaining: 7.02s\n",
      "75:\tlearn: 0.2548164\ttotal: 4.25s\tremaining: 6.93s\n",
      "76:\tlearn: 0.2544096\ttotal: 4.32s\tremaining: 6.89s\n",
      "77:\tlearn: 0.2538656\ttotal: 4.38s\tremaining: 6.85s\n",
      "78:\tlearn: 0.2536637\ttotal: 4.43s\tremaining: 6.79s\n",
      "79:\tlearn: 0.2534411\ttotal: 4.49s\tremaining: 6.73s\n",
      "80:\tlearn: 0.2530843\ttotal: 4.54s\tremaining: 6.67s\n",
      "81:\tlearn: 0.2528182\ttotal: 4.6s\tremaining: 6.62s\n",
      "82:\tlearn: 0.2525085\ttotal: 4.66s\tremaining: 6.57s\n",
      "83:\tlearn: 0.2521208\ttotal: 4.72s\tremaining: 6.52s\n",
      "84:\tlearn: 0.2518083\ttotal: 4.79s\tremaining: 6.49s\n",
      "85:\tlearn: 0.2514521\ttotal: 4.94s\tremaining: 6.54s\n",
      "86:\tlearn: 0.2511111\ttotal: 4.99s\tremaining: 6.48s\n",
      "87:\tlearn: 0.2508856\ttotal: 5.07s\tremaining: 6.46s\n",
      "88:\tlearn: 0.2505500\ttotal: 5.13s\tremaining: 6.39s\n",
      "89:\tlearn: 0.2502756\ttotal: 5.23s\tremaining: 6.39s\n",
      "90:\tlearn: 0.2501553\ttotal: 5.3s\tremaining: 6.35s\n",
      "91:\tlearn: 0.2496378\ttotal: 5.36s\tremaining: 6.29s\n",
      "92:\tlearn: 0.2492223\ttotal: 5.47s\tremaining: 6.29s\n",
      "93:\tlearn: 0.2487867\ttotal: 5.52s\tremaining: 6.23s\n",
      "94:\tlearn: 0.2484129\ttotal: 5.59s\tremaining: 6.18s\n",
      "95:\tlearn: 0.2480758\ttotal: 5.65s\tremaining: 6.12s\n",
      "96:\tlearn: 0.2477856\ttotal: 5.69s\tremaining: 6.04s\n",
      "97:\tlearn: 0.2474058\ttotal: 5.79s\tremaining: 6.03s\n",
      "98:\tlearn: 0.2471347\ttotal: 5.92s\tremaining: 6.03s\n",
      "99:\tlearn: 0.2466663\ttotal: 5.97s\tremaining: 5.97s\n",
      "100:\tlearn: 0.2463100\ttotal: 6.02s\tremaining: 5.9s\n",
      "101:\tlearn: 0.2462087\ttotal: 6.07s\tremaining: 5.83s\n",
      "102:\tlearn: 0.2458403\ttotal: 6.2s\tremaining: 5.84s\n",
      "103:\tlearn: 0.2455179\ttotal: 6.29s\tremaining: 5.81s\n",
      "104:\tlearn: 0.2451997\ttotal: 6.41s\tremaining: 5.8s\n",
      "105:\tlearn: 0.2450510\ttotal: 6.54s\tremaining: 5.8s\n",
      "106:\tlearn: 0.2448445\ttotal: 6.63s\tremaining: 5.76s\n",
      "107:\tlearn: 0.2443664\ttotal: 6.69s\tremaining: 5.7s\n",
      "108:\tlearn: 0.2440019\ttotal: 6.73s\tremaining: 5.62s\n",
      "109:\tlearn: 0.2436825\ttotal: 6.8s\tremaining: 5.56s\n",
      "110:\tlearn: 0.2433396\ttotal: 6.84s\tremaining: 5.48s\n",
      "111:\tlearn: 0.2430178\ttotal: 6.88s\tremaining: 5.4s\n",
      "112:\tlearn: 0.2428235\ttotal: 6.94s\tremaining: 5.34s\n",
      "113:\tlearn: 0.2425991\ttotal: 7.02s\tremaining: 5.3s\n",
      "114:\tlearn: 0.2424463\ttotal: 7.09s\tremaining: 5.24s\n",
      "115:\tlearn: 0.2421903\ttotal: 7.14s\tremaining: 5.17s\n",
      "116:\tlearn: 0.2418328\ttotal: 7.21s\tremaining: 5.12s\n",
      "117:\tlearn: 0.2415361\ttotal: 7.27s\tremaining: 5.05s\n",
      "118:\tlearn: 0.2412653\ttotal: 7.33s\tremaining: 4.99s\n",
      "119:\tlearn: 0.2410728\ttotal: 7.4s\tremaining: 4.94s\n",
      "120:\tlearn: 0.2407275\ttotal: 7.45s\tremaining: 4.86s\n",
      "121:\tlearn: 0.2403147\ttotal: 7.49s\tremaining: 4.79s\n",
      "122:\tlearn: 0.2399327\ttotal: 7.53s\tremaining: 4.71s\n",
      "123:\tlearn: 0.2396511\ttotal: 7.66s\tremaining: 4.69s\n",
      "124:\tlearn: 0.2394711\ttotal: 7.8s\tremaining: 4.68s\n",
      "125:\tlearn: 0.2392890\ttotal: 7.86s\tremaining: 4.61s\n",
      "126:\tlearn: 0.2389691\ttotal: 8.11s\tremaining: 4.66s\n",
      "127:\tlearn: 0.2388578\ttotal: 8.19s\tremaining: 4.61s\n",
      "128:\tlearn: 0.2385003\ttotal: 8.28s\tremaining: 4.55s\n",
      "129:\tlearn: 0.2383136\ttotal: 8.38s\tremaining: 4.51s\n",
      "130:\tlearn: 0.2381316\ttotal: 8.45s\tremaining: 4.45s\n",
      "131:\tlearn: 0.2378707\ttotal: 8.51s\tremaining: 4.38s\n",
      "132:\tlearn: 0.2376067\ttotal: 8.55s\tremaining: 4.31s\n",
      "133:\tlearn: 0.2372990\ttotal: 8.62s\tremaining: 4.24s\n",
      "134:\tlearn: 0.2370381\ttotal: 8.68s\tremaining: 4.18s\n",
      "135:\tlearn: 0.2369765\ttotal: 8.74s\tremaining: 4.11s\n",
      "136:\tlearn: 0.2368484\ttotal: 8.8s\tremaining: 4.05s\n",
      "137:\tlearn: 0.2366106\ttotal: 8.88s\tremaining: 3.99s\n",
      "138:\tlearn: 0.2362015\ttotal: 8.94s\tremaining: 3.92s\n",
      "139:\tlearn: 0.2358647\ttotal: 8.99s\tremaining: 3.85s\n",
      "140:\tlearn: 0.2355421\ttotal: 9.08s\tremaining: 3.8s\n",
      "141:\tlearn: 0.2353069\ttotal: 9.15s\tremaining: 3.74s\n",
      "142:\tlearn: 0.2350554\ttotal: 9.22s\tremaining: 3.67s\n",
      "143:\tlearn: 0.2347753\ttotal: 9.29s\tremaining: 3.61s\n",
      "144:\tlearn: 0.2347130\ttotal: 9.33s\tremaining: 3.54s\n",
      "145:\tlearn: 0.2344032\ttotal: 9.37s\tremaining: 3.47s\n",
      "146:\tlearn: 0.2342883\ttotal: 9.41s\tremaining: 3.39s\n",
      "147:\tlearn: 0.2341884\ttotal: 9.47s\tremaining: 3.33s\n",
      "148:\tlearn: 0.2339513\ttotal: 9.52s\tremaining: 3.26s\n",
      "149:\tlearn: 0.2335816\ttotal: 9.62s\tremaining: 3.21s\n",
      "150:\tlearn: 0.2332367\ttotal: 9.69s\tremaining: 3.14s\n",
      "151:\tlearn: 0.2330758\ttotal: 9.76s\tremaining: 3.08s\n",
      "152:\tlearn: 0.2327874\ttotal: 9.88s\tremaining: 3.03s\n",
      "153:\tlearn: 0.2324529\ttotal: 9.95s\tremaining: 2.97s\n",
      "154:\tlearn: 0.2322266\ttotal: 10s\tremaining: 2.92s\n",
      "155:\tlearn: 0.2319653\ttotal: 10.1s\tremaining: 2.85s\n",
      "156:\tlearn: 0.2315521\ttotal: 10.2s\tremaining: 2.79s\n",
      "157:\tlearn: 0.2312866\ttotal: 10.5s\tremaining: 2.78s\n",
      "158:\tlearn: 0.2311561\ttotal: 10.6s\tremaining: 2.72s\n",
      "159:\tlearn: 0.2307979\ttotal: 10.6s\tremaining: 2.65s\n",
      "160:\tlearn: 0.2305032\ttotal: 10.7s\tremaining: 2.59s\n",
      "161:\tlearn: 0.2303924\ttotal: 10.8s\tremaining: 2.53s\n",
      "162:\tlearn: 0.2302347\ttotal: 10.8s\tremaining: 2.46s\n",
      "163:\tlearn: 0.2301459\ttotal: 10.9s\tremaining: 2.39s\n",
      "164:\tlearn: 0.2301388\ttotal: 10.9s\tremaining: 2.32s\n",
      "165:\tlearn: 0.2301320\ttotal: 11s\tremaining: 2.25s\n",
      "166:\tlearn: 0.2297158\ttotal: 11s\tremaining: 2.18s\n",
      "167:\tlearn: 0.2295384\ttotal: 11.1s\tremaining: 2.11s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "168:\tlearn: 0.2293266\ttotal: 11.2s\tremaining: 2.05s\n",
      "169:\tlearn: 0.2290105\ttotal: 11.2s\tremaining: 1.98s\n",
      "170:\tlearn: 0.2285586\ttotal: 11.3s\tremaining: 1.91s\n",
      "171:\tlearn: 0.2281991\ttotal: 11.3s\tremaining: 1.84s\n",
      "172:\tlearn: 0.2279406\ttotal: 11.4s\tremaining: 1.77s\n",
      "173:\tlearn: 0.2276911\ttotal: 11.4s\tremaining: 1.71s\n",
      "174:\tlearn: 0.2275774\ttotal: 11.4s\tremaining: 1.64s\n",
      "175:\tlearn: 0.2273200\ttotal: 11.5s\tremaining: 1.57s\n",
      "176:\tlearn: 0.2270139\ttotal: 11.5s\tremaining: 1.5s\n",
      "177:\tlearn: 0.2267032\ttotal: 11.6s\tremaining: 1.43s\n",
      "178:\tlearn: 0.2264038\ttotal: 11.6s\tremaining: 1.36s\n",
      "179:\tlearn: 0.2261705\ttotal: 11.7s\tremaining: 1.3s\n",
      "180:\tlearn: 0.2259577\ttotal: 11.7s\tremaining: 1.23s\n",
      "181:\tlearn: 0.2256149\ttotal: 11.7s\tremaining: 1.16s\n",
      "182:\tlearn: 0.2254915\ttotal: 11.8s\tremaining: 1.1s\n",
      "183:\tlearn: 0.2253312\ttotal: 11.8s\tremaining: 1.03s\n",
      "184:\tlearn: 0.2251864\ttotal: 11.9s\tremaining: 964ms\n",
      "185:\tlearn: 0.2250303\ttotal: 11.9s\tremaining: 898ms\n",
      "186:\tlearn: 0.2248906\ttotal: 12s\tremaining: 833ms\n",
      "187:\tlearn: 0.2246735\ttotal: 12s\tremaining: 768ms\n",
      "188:\tlearn: 0.2244055\ttotal: 12.1s\tremaining: 702ms\n",
      "189:\tlearn: 0.2241687\ttotal: 12.1s\tremaining: 637ms\n",
      "190:\tlearn: 0.2240734\ttotal: 12.1s\tremaining: 572ms\n",
      "191:\tlearn: 0.2237139\ttotal: 12.2s\tremaining: 507ms\n",
      "192:\tlearn: 0.2235032\ttotal: 12.2s\tremaining: 444ms\n",
      "193:\tlearn: 0.2233232\ttotal: 12.3s\tremaining: 380ms\n",
      "194:\tlearn: 0.2232085\ttotal: 12.3s\tremaining: 316ms\n",
      "195:\tlearn: 0.2228916\ttotal: 12.4s\tremaining: 252ms\n",
      "196:\tlearn: 0.2227447\ttotal: 12.4s\tremaining: 189ms\n",
      "197:\tlearn: 0.2224800\ttotal: 12.5s\tremaining: 126ms\n",
      "198:\tlearn: 0.2224030\ttotal: 12.6s\tremaining: 63.5ms\n",
      "199:\tlearn: 0.2221522\ttotal: 12.7s\tremaining: 0us\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "0.8683702383552683"
      ]
     },
     "execution_count": 78,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Cross Validated accuracy\n",
    "cv_acc = cross_val_score(best_model,\n",
    "                        X,\n",
    "                        y,\n",
    "                        cv=5,\n",
    "                        scoring='accuracy')\n",
    "cv_acc_mean = np.mean(cv_acc)\n",
    "cv_acc_mean"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 79,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0:\tlearn: 0.4910390\ttotal: 44ms\tremaining: 8.75s\n",
      "1:\tlearn: 0.4094957\ttotal: 89.2ms\tremaining: 8.83s\n",
      "2:\tlearn: 0.3694131\ttotal: 141ms\tremaining: 9.27s\n",
      "3:\tlearn: 0.3505391\ttotal: 182ms\tremaining: 8.9s\n",
      "4:\tlearn: 0.3391372\ttotal: 220ms\tremaining: 8.57s\n",
      "5:\tlearn: 0.3327239\ttotal: 287ms\tremaining: 9.28s\n",
      "6:\tlearn: 0.3262649\ttotal: 348ms\tremaining: 9.6s\n",
      "7:\tlearn: 0.3187783\ttotal: 387ms\tremaining: 9.28s\n",
      "8:\tlearn: 0.3136945\ttotal: 429ms\tremaining: 9.11s\n",
      "9:\tlearn: 0.3113021\ttotal: 503ms\tremaining: 9.56s\n",
      "10:\tlearn: 0.3081480\ttotal: 545ms\tremaining: 9.36s\n",
      "11:\tlearn: 0.3056354\ttotal: 580ms\tremaining: 9.08s\n",
      "12:\tlearn: 0.3020594\ttotal: 617ms\tremaining: 8.87s\n",
      "13:\tlearn: 0.2993112\ttotal: 678ms\tremaining: 9.01s\n",
      "14:\tlearn: 0.2973829\ttotal: 734ms\tremaining: 9.06s\n",
      "15:\tlearn: 0.2934693\ttotal: 777ms\tremaining: 8.94s\n",
      "16:\tlearn: 0.2924421\ttotal: 825ms\tremaining: 8.88s\n",
      "17:\tlearn: 0.2915134\ttotal: 879ms\tremaining: 8.89s\n",
      "18:\tlearn: 0.2903485\ttotal: 937ms\tremaining: 8.93s\n",
      "19:\tlearn: 0.2896061\ttotal: 996ms\tremaining: 8.96s\n",
      "20:\tlearn: 0.2890050\ttotal: 1.04s\tremaining: 8.9s\n",
      "21:\tlearn: 0.2882568\ttotal: 1.11s\tremaining: 8.99s\n",
      "22:\tlearn: 0.2875332\ttotal: 1.16s\tremaining: 8.94s\n",
      "23:\tlearn: 0.2857290\ttotal: 1.21s\tremaining: 8.87s\n",
      "24:\tlearn: 0.2850522\ttotal: 1.25s\tremaining: 8.73s\n",
      "25:\tlearn: 0.2838251\ttotal: 1.32s\tremaining: 8.87s\n",
      "26:\tlearn: 0.2818143\ttotal: 1.37s\tremaining: 8.78s\n",
      "27:\tlearn: 0.2810609\ttotal: 1.41s\tremaining: 8.67s\n",
      "28:\tlearn: 0.2805953\ttotal: 1.45s\tremaining: 8.56s\n",
      "29:\tlearn: 0.2795593\ttotal: 1.51s\tremaining: 8.55s\n",
      "30:\tlearn: 0.2785583\ttotal: 1.56s\tremaining: 8.52s\n",
      "31:\tlearn: 0.2775374\ttotal: 1.62s\tremaining: 8.49s\n",
      "32:\tlearn: 0.2769544\ttotal: 1.67s\tremaining: 8.44s\n",
      "33:\tlearn: 0.2762143\ttotal: 1.83s\tremaining: 8.94s\n",
      "34:\tlearn: 0.2757283\ttotal: 1.93s\tremaining: 9.09s\n",
      "35:\tlearn: 0.2751014\ttotal: 1.99s\tremaining: 9.04s\n",
      "36:\tlearn: 0.2742580\ttotal: 2.03s\tremaining: 8.95s\n",
      "37:\tlearn: 0.2735819\ttotal: 2.07s\tremaining: 8.82s\n",
      "38:\tlearn: 0.2725745\ttotal: 2.11s\tremaining: 8.7s\n",
      "39:\tlearn: 0.2717464\ttotal: 2.17s\tremaining: 8.66s\n",
      "40:\tlearn: 0.2712371\ttotal: 2.22s\tremaining: 8.62s\n",
      "41:\tlearn: 0.2708447\ttotal: 2.27s\tremaining: 8.53s\n",
      "42:\tlearn: 0.2703224\ttotal: 2.31s\tremaining: 8.42s\n",
      "43:\tlearn: 0.2696397\ttotal: 2.37s\tremaining: 8.39s\n",
      "44:\tlearn: 0.2690909\ttotal: 2.43s\tremaining: 8.36s\n",
      "45:\tlearn: 0.2682967\ttotal: 2.46s\tremaining: 8.24s\n",
      "46:\tlearn: 0.2679382\ttotal: 2.5s\tremaining: 8.14s\n",
      "47:\tlearn: 0.2677047\ttotal: 2.56s\tremaining: 8.12s\n",
      "48:\tlearn: 0.2673390\ttotal: 2.62s\tremaining: 8.07s\n",
      "49:\tlearn: 0.2667281\ttotal: 2.66s\tremaining: 7.98s\n",
      "50:\tlearn: 0.2660764\ttotal: 2.71s\tremaining: 7.92s\n",
      "51:\tlearn: 0.2653754\ttotal: 2.79s\tremaining: 7.95s\n",
      "52:\tlearn: 0.2650464\ttotal: 2.84s\tremaining: 7.87s\n",
      "53:\tlearn: 0.2648876\ttotal: 2.88s\tremaining: 7.77s\n",
      "54:\tlearn: 0.2644577\ttotal: 2.91s\tremaining: 7.68s\n",
      "55:\tlearn: 0.2639544\ttotal: 2.97s\tremaining: 7.64s\n",
      "56:\tlearn: 0.2635208\ttotal: 3.03s\tremaining: 7.59s\n",
      "57:\tlearn: 0.2630010\ttotal: 3.07s\tremaining: 7.51s\n",
      "58:\tlearn: 0.2623645\ttotal: 3.11s\tremaining: 7.42s\n",
      "59:\tlearn: 0.2618230\ttotal: 3.18s\tremaining: 7.43s\n",
      "60:\tlearn: 0.2615054\ttotal: 3.22s\tremaining: 7.34s\n",
      "61:\tlearn: 0.2613269\ttotal: 3.26s\tremaining: 7.26s\n",
      "62:\tlearn: 0.2608481\ttotal: 3.31s\tremaining: 7.2s\n",
      "63:\tlearn: 0.2606736\ttotal: 3.37s\tremaining: 7.16s\n",
      "64:\tlearn: 0.2601501\ttotal: 3.44s\tremaining: 7.13s\n",
      "65:\tlearn: 0.2599332\ttotal: 3.47s\tremaining: 7.05s\n",
      "66:\tlearn: 0.2594212\ttotal: 3.51s\tremaining: 6.97s\n",
      "67:\tlearn: 0.2592048\ttotal: 3.57s\tremaining: 6.93s\n",
      "68:\tlearn: 0.2585311\ttotal: 3.63s\tremaining: 6.89s\n",
      "69:\tlearn: 0.2581389\ttotal: 3.67s\tremaining: 6.81s\n",
      "70:\tlearn: 0.2576641\ttotal: 3.71s\tremaining: 6.74s\n",
      "71:\tlearn: 0.2571270\ttotal: 3.77s\tremaining: 6.7s\n",
      "72:\tlearn: 0.2569060\ttotal: 3.83s\tremaining: 6.67s\n",
      "73:\tlearn: 0.2563899\ttotal: 3.87s\tremaining: 6.59s\n",
      "74:\tlearn: 0.2559528\ttotal: 3.98s\tremaining: 6.63s\n",
      "75:\tlearn: 0.2554732\ttotal: 4.12s\tremaining: 6.71s\n",
      "76:\tlearn: 0.2550620\ttotal: 4.16s\tremaining: 6.64s\n",
      "77:\tlearn: 0.2544463\ttotal: 4.21s\tremaining: 6.58s\n",
      "78:\tlearn: 0.2541464\ttotal: 4.27s\tremaining: 6.54s\n",
      "79:\tlearn: 0.2536836\ttotal: 4.32s\tremaining: 6.49s\n",
      "80:\tlearn: 0.2533178\ttotal: 4.37s\tremaining: 6.42s\n",
      "81:\tlearn: 0.2528747\ttotal: 4.41s\tremaining: 6.34s\n",
      "82:\tlearn: 0.2526583\ttotal: 4.47s\tremaining: 6.31s\n",
      "83:\tlearn: 0.2524395\ttotal: 4.53s\tremaining: 6.26s\n",
      "84:\tlearn: 0.2520651\ttotal: 4.57s\tremaining: 6.18s\n",
      "85:\tlearn: 0.2516639\ttotal: 4.61s\tremaining: 6.11s\n",
      "86:\tlearn: 0.2514801\ttotal: 4.67s\tremaining: 6.07s\n",
      "87:\tlearn: 0.2513549\ttotal: 4.72s\tremaining: 6.01s\n",
      "88:\tlearn: 0.2508232\ttotal: 4.76s\tremaining: 5.94s\n",
      "89:\tlearn: 0.2506792\ttotal: 4.87s\tremaining: 5.95s\n",
      "90:\tlearn: 0.2502898\ttotal: 4.96s\tremaining: 5.95s\n",
      "91:\tlearn: 0.2501274\ttotal: 5.02s\tremaining: 5.89s\n",
      "92:\tlearn: 0.2498113\ttotal: 5.06s\tremaining: 5.82s\n",
      "93:\tlearn: 0.2494608\ttotal: 5.12s\tremaining: 5.77s\n",
      "94:\tlearn: 0.2490959\ttotal: 5.18s\tremaining: 5.73s\n",
      "95:\tlearn: 0.2489713\ttotal: 5.22s\tremaining: 5.66s\n",
      "96:\tlearn: 0.2485235\ttotal: 5.26s\tremaining: 5.59s\n",
      "97:\tlearn: 0.2480601\ttotal: 5.35s\tremaining: 5.57s\n",
      "98:\tlearn: 0.2475354\ttotal: 5.4s\tremaining: 5.5s\n",
      "99:\tlearn: 0.2470517\ttotal: 5.45s\tremaining: 5.45s\n",
      "100:\tlearn: 0.2465217\ttotal: 5.51s\tremaining: 5.4s\n",
      "101:\tlearn: 0.2462395\ttotal: 5.58s\tremaining: 5.36s\n",
      "102:\tlearn: 0.2458358\ttotal: 5.65s\tremaining: 5.32s\n",
      "103:\tlearn: 0.2455335\ttotal: 5.7s\tremaining: 5.27s\n",
      "104:\tlearn: 0.2451756\ttotal: 5.78s\tremaining: 5.23s\n",
      "105:\tlearn: 0.2448174\ttotal: 5.85s\tremaining: 5.19s\n",
      "106:\tlearn: 0.2445567\ttotal: 5.9s\tremaining: 5.13s\n",
      "107:\tlearn: 0.2443596\ttotal: 5.98s\tremaining: 5.1s\n",
      "108:\tlearn: 0.2439081\ttotal: 6.06s\tremaining: 5.06s\n",
      "109:\tlearn: 0.2434848\ttotal: 6.12s\tremaining: 5.01s\n",
      "110:\tlearn: 0.2432248\ttotal: 6.25s\tremaining: 5.01s\n",
      "111:\tlearn: 0.2430648\ttotal: 6.34s\tremaining: 4.98s\n",
      "112:\tlearn: 0.2429844\ttotal: 6.48s\tremaining: 4.99s\n",
      "113:\tlearn: 0.2426978\ttotal: 6.58s\tremaining: 4.96s\n",
      "114:\tlearn: 0.2425858\ttotal: 6.67s\tremaining: 4.93s\n",
      "115:\tlearn: 0.2422130\ttotal: 6.72s\tremaining: 4.86s\n",
      "116:\tlearn: 0.2417006\ttotal: 6.77s\tremaining: 4.8s\n",
      "117:\tlearn: 0.2414430\ttotal: 6.84s\tremaining: 4.75s\n",
      "118:\tlearn: 0.2411022\ttotal: 6.88s\tremaining: 4.68s\n",
      "119:\tlearn: 0.2403800\ttotal: 6.92s\tremaining: 4.62s\n",
      "120:\tlearn: 0.2400258\ttotal: 6.97s\tremaining: 4.55s\n",
      "121:\tlearn: 0.2396878\ttotal: 7.03s\tremaining: 4.49s\n",
      "122:\tlearn: 0.2394415\ttotal: 7.07s\tremaining: 4.43s\n",
      "123:\tlearn: 0.2390072\ttotal: 7.11s\tremaining: 4.36s\n",
      "124:\tlearn: 0.2387689\ttotal: 7.15s\tremaining: 4.29s\n",
      "125:\tlearn: 0.2384445\ttotal: 7.22s\tremaining: 4.24s\n",
      "126:\tlearn: 0.2381465\ttotal: 7.26s\tremaining: 4.17s\n",
      "127:\tlearn: 0.2378007\ttotal: 7.31s\tremaining: 4.11s\n",
      "128:\tlearn: 0.2374913\ttotal: 7.35s\tremaining: 4.04s\n",
      "129:\tlearn: 0.2372241\ttotal: 7.41s\tremaining: 3.99s\n",
      "130:\tlearn: 0.2369136\ttotal: 7.45s\tremaining: 3.93s\n",
      "131:\tlearn: 0.2367420\ttotal: 7.49s\tremaining: 3.86s\n",
      "132:\tlearn: 0.2364224\ttotal: 7.53s\tremaining: 3.79s\n",
      "133:\tlearn: 0.2362696\ttotal: 7.58s\tremaining: 3.73s\n",
      "134:\tlearn: 0.2358998\ttotal: 7.64s\tremaining: 3.68s\n",
      "135:\tlearn: 0.2355574\ttotal: 7.68s\tremaining: 3.61s\n",
      "136:\tlearn: 0.2351997\ttotal: 7.72s\tremaining: 3.55s\n",
      "137:\tlearn: 0.2349023\ttotal: 7.76s\tremaining: 3.48s\n",
      "138:\tlearn: 0.2345666\ttotal: 7.82s\tremaining: 3.43s\n",
      "139:\tlearn: 0.2344306\ttotal: 7.87s\tremaining: 3.37s\n",
      "140:\tlearn: 0.2341253\ttotal: 7.91s\tremaining: 3.31s\n",
      "141:\tlearn: 0.2339600\ttotal: 7.94s\tremaining: 3.24s\n",
      "142:\tlearn: 0.2336109\ttotal: 8s\tremaining: 3.19s\n",
      "143:\tlearn: 0.2335354\ttotal: 8.05s\tremaining: 3.13s\n",
      "144:\tlearn: 0.2332019\ttotal: 8.09s\tremaining: 3.07s\n",
      "145:\tlearn: 0.2330839\ttotal: 8.13s\tremaining: 3.01s\n",
      "146:\tlearn: 0.2328308\ttotal: 8.2s\tremaining: 2.96s\n",
      "147:\tlearn: 0.2327493\ttotal: 8.27s\tremaining: 2.9s\n",
      "148:\tlearn: 0.2324452\ttotal: 8.32s\tremaining: 2.85s\n",
      "149:\tlearn: 0.2323056\ttotal: 8.39s\tremaining: 2.8s\n",
      "150:\tlearn: 0.2320540\ttotal: 8.45s\tremaining: 2.74s\n",
      "151:\tlearn: 0.2317048\ttotal: 8.5s\tremaining: 2.68s\n",
      "152:\tlearn: 0.2314122\ttotal: 8.62s\tremaining: 2.65s\n",
      "153:\tlearn: 0.2309981\ttotal: 8.7s\tremaining: 2.6s\n",
      "154:\tlearn: 0.2306700\ttotal: 8.74s\tremaining: 2.54s\n",
      "155:\tlearn: 0.2302911\ttotal: 8.78s\tremaining: 2.48s\n",
      "156:\tlearn: 0.2301412\ttotal: 8.82s\tremaining: 2.42s\n",
      "157:\tlearn: 0.2298899\ttotal: 8.88s\tremaining: 2.36s\n",
      "158:\tlearn: 0.2295007\ttotal: 8.93s\tremaining: 2.3s\n",
      "159:\tlearn: 0.2293104\ttotal: 8.97s\tremaining: 2.24s\n",
      "160:\tlearn: 0.2292694\ttotal: 9.01s\tremaining: 2.18s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "161:\tlearn: 0.2290253\ttotal: 9.08s\tremaining: 2.13s\n",
      "162:\tlearn: 0.2288107\ttotal: 9.12s\tremaining: 2.07s\n",
      "163:\tlearn: 0.2285343\ttotal: 9.15s\tremaining: 2.01s\n",
      "164:\tlearn: 0.2284223\ttotal: 9.19s\tremaining: 1.95s\n",
      "165:\tlearn: 0.2281667\ttotal: 9.27s\tremaining: 1.9s\n",
      "166:\tlearn: 0.2278998\ttotal: 9.31s\tremaining: 1.84s\n",
      "167:\tlearn: 0.2275107\ttotal: 9.35s\tremaining: 1.78s\n",
      "168:\tlearn: 0.2272013\ttotal: 9.39s\tremaining: 1.72s\n",
      "169:\tlearn: 0.2270592\ttotal: 9.45s\tremaining: 1.67s\n",
      "170:\tlearn: 0.2269358\ttotal: 9.48s\tremaining: 1.61s\n",
      "171:\tlearn: 0.2266104\ttotal: 9.52s\tremaining: 1.55s\n",
      "172:\tlearn: 0.2263648\ttotal: 9.56s\tremaining: 1.49s\n",
      "173:\tlearn: 0.2261102\ttotal: 9.63s\tremaining: 1.44s\n",
      "174:\tlearn: 0.2258385\ttotal: 9.67s\tremaining: 1.38s\n",
      "175:\tlearn: 0.2255843\ttotal: 9.71s\tremaining: 1.32s\n",
      "176:\tlearn: 0.2252919\ttotal: 9.74s\tremaining: 1.27s\n",
      "177:\tlearn: 0.2250407\ttotal: 9.79s\tremaining: 1.21s\n",
      "178:\tlearn: 0.2247510\ttotal: 9.84s\tremaining: 1.15s\n",
      "179:\tlearn: 0.2244622\ttotal: 9.89s\tremaining: 1.1s\n",
      "180:\tlearn: 0.2243807\ttotal: 9.93s\tremaining: 1.04s\n",
      "181:\tlearn: 0.2243464\ttotal: 9.97s\tremaining: 986ms\n",
      "182:\tlearn: 0.2242004\ttotal: 10s\tremaining: 932ms\n",
      "183:\tlearn: 0.2239257\ttotal: 10.1s\tremaining: 876ms\n",
      "184:\tlearn: 0.2238702\ttotal: 10.1s\tremaining: 820ms\n",
      "185:\tlearn: 0.2235913\ttotal: 10.2s\tremaining: 765ms\n",
      "186:\tlearn: 0.2233530\ttotal: 10.2s\tremaining: 712ms\n",
      "187:\tlearn: 0.2231426\ttotal: 10.3s\tremaining: 656ms\n",
      "188:\tlearn: 0.2231138\ttotal: 10.3s\tremaining: 601ms\n",
      "189:\tlearn: 0.2227511\ttotal: 10.4s\tremaining: 545ms\n",
      "190:\tlearn: 0.2223536\ttotal: 10.4s\tremaining: 492ms\n",
      "191:\tlearn: 0.2221296\ttotal: 10.5s\tremaining: 436ms\n",
      "192:\tlearn: 0.2219507\ttotal: 10.5s\tremaining: 381ms\n",
      "193:\tlearn: 0.2217029\ttotal: 10.5s\tremaining: 326ms\n",
      "194:\tlearn: 0.2214195\ttotal: 10.6s\tremaining: 272ms\n",
      "195:\tlearn: 0.2211347\ttotal: 10.6s\tremaining: 217ms\n",
      "196:\tlearn: 0.2210406\ttotal: 10.7s\tremaining: 163ms\n",
      "197:\tlearn: 0.2208029\ttotal: 10.9s\tremaining: 110ms\n",
      "198:\tlearn: 0.2205557\ttotal: 10.9s\tremaining: 54.9ms\n",
      "199:\tlearn: 0.2204761\ttotal: 11s\tremaining: 0us\n",
      "0:\tlearn: 0.4890502\ttotal: 54.9ms\tremaining: 10.9s\n",
      "1:\tlearn: 0.4065357\ttotal: 138ms\tremaining: 13.6s\n",
      "2:\tlearn: 0.3695467\ttotal: 198ms\tremaining: 13s\n",
      "3:\tlearn: 0.3539389\ttotal: 309ms\tremaining: 15.1s\n",
      "4:\tlearn: 0.3424754\ttotal: 377ms\tremaining: 14.7s\n",
      "5:\tlearn: 0.3330650\ttotal: 442ms\tremaining: 14.3s\n",
      "6:\tlearn: 0.3237089\ttotal: 515ms\tremaining: 14.2s\n",
      "7:\tlearn: 0.3182396\ttotal: 594ms\tremaining: 14.3s\n",
      "8:\tlearn: 0.3143113\ttotal: 638ms\tremaining: 13.5s\n",
      "9:\tlearn: 0.3074310\ttotal: 675ms\tremaining: 12.8s\n",
      "10:\tlearn: 0.3052278\ttotal: 717ms\tremaining: 12.3s\n",
      "11:\tlearn: 0.3019601\ttotal: 779ms\tremaining: 12.2s\n",
      "12:\tlearn: 0.2995476\ttotal: 820ms\tremaining: 11.8s\n",
      "13:\tlearn: 0.2982782\ttotal: 859ms\tremaining: 11.4s\n",
      "14:\tlearn: 0.2971409\ttotal: 898ms\tremaining: 11.1s\n",
      "15:\tlearn: 0.2958994\ttotal: 945ms\tremaining: 10.9s\n",
      "16:\tlearn: 0.2941196\ttotal: 1.01s\tremaining: 10.8s\n",
      "17:\tlearn: 0.2925659\ttotal: 1.04s\tremaining: 10.6s\n",
      "18:\tlearn: 0.2884236\ttotal: 1.08s\tremaining: 10.3s\n",
      "19:\tlearn: 0.2873662\ttotal: 1.12s\tremaining: 10.1s\n",
      "20:\tlearn: 0.2867908\ttotal: 1.19s\tremaining: 10.1s\n",
      "21:\tlearn: 0.2859630\ttotal: 1.23s\tremaining: 9.93s\n",
      "22:\tlearn: 0.2844540\ttotal: 1.27s\tremaining: 9.74s\n",
      "23:\tlearn: 0.2833664\ttotal: 1.3s\tremaining: 9.57s\n",
      "24:\tlearn: 0.2829578\ttotal: 1.36s\tremaining: 9.54s\n",
      "25:\tlearn: 0.2820594\ttotal: 1.41s\tremaining: 9.43s\n",
      "26:\tlearn: 0.2813476\ttotal: 1.45s\tremaining: 9.3s\n",
      "27:\tlearn: 0.2804058\ttotal: 1.49s\tremaining: 9.18s\n",
      "28:\tlearn: 0.2800862\ttotal: 1.54s\tremaining: 9.08s\n",
      "29:\tlearn: 0.2790213\ttotal: 1.64s\tremaining: 9.28s\n",
      "30:\tlearn: 0.2784915\ttotal: 1.77s\tremaining: 9.65s\n",
      "31:\tlearn: 0.2781184\ttotal: 1.83s\tremaining: 9.63s\n",
      "32:\tlearn: 0.2774706\ttotal: 1.88s\tremaining: 9.51s\n",
      "33:\tlearn: 0.2769830\ttotal: 1.92s\tremaining: 9.38s\n",
      "34:\tlearn: 0.2765610\ttotal: 1.96s\tremaining: 9.25s\n",
      "35:\tlearn: 0.2759578\ttotal: 2.03s\tremaining: 9.24s\n",
      "36:\tlearn: 0.2753296\ttotal: 2.07s\tremaining: 9.11s\n",
      "37:\tlearn: 0.2745335\ttotal: 2.11s\tremaining: 9s\n",
      "38:\tlearn: 0.2739600\ttotal: 2.15s\tremaining: 8.87s\n",
      "39:\tlearn: 0.2735087\ttotal: 2.2s\tremaining: 8.81s\n",
      "40:\tlearn: 0.2724216\ttotal: 2.26s\tremaining: 8.78s\n",
      "41:\tlearn: 0.2723521\ttotal: 2.3s\tremaining: 8.65s\n",
      "42:\tlearn: 0.2715928\ttotal: 2.34s\tremaining: 8.54s\n",
      "43:\tlearn: 0.2709497\ttotal: 2.38s\tremaining: 8.43s\n",
      "44:\tlearn: 0.2703100\ttotal: 2.43s\tremaining: 8.36s\n",
      "45:\tlearn: 0.2695307\ttotal: 2.48s\tremaining: 8.31s\n",
      "46:\tlearn: 0.2688942\ttotal: 2.52s\tremaining: 8.21s\n",
      "47:\tlearn: 0.2681200\ttotal: 2.56s\tremaining: 8.11s\n",
      "48:\tlearn: 0.2676686\ttotal: 2.6s\tremaining: 8.01s\n",
      "49:\tlearn: 0.2669230\ttotal: 2.63s\tremaining: 7.91s\n",
      "50:\tlearn: 0.2663142\ttotal: 2.7s\tremaining: 7.89s\n",
      "51:\tlearn: 0.2658611\ttotal: 2.74s\tremaining: 7.8s\n",
      "52:\tlearn: 0.2655697\ttotal: 2.78s\tremaining: 7.71s\n",
      "53:\tlearn: 0.2652779\ttotal: 2.82s\tremaining: 7.63s\n",
      "54:\tlearn: 0.2650319\ttotal: 2.88s\tremaining: 7.58s\n",
      "55:\tlearn: 0.2645317\ttotal: 2.92s\tremaining: 7.52s\n",
      "56:\tlearn: 0.2642273\ttotal: 2.97s\tremaining: 7.45s\n",
      "57:\tlearn: 0.2637379\ttotal: 3.01s\tremaining: 7.37s\n",
      "58:\tlearn: 0.2631261\ttotal: 3.1s\tremaining: 7.4s\n",
      "59:\tlearn: 0.2624877\ttotal: 3.14s\tremaining: 7.32s\n",
      "60:\tlearn: 0.2620016\ttotal: 3.17s\tremaining: 7.23s\n",
      "61:\tlearn: 0.2615522\ttotal: 3.21s\tremaining: 7.14s\n",
      "62:\tlearn: 0.2612598\ttotal: 3.27s\tremaining: 7.12s\n",
      "63:\tlearn: 0.2609154\ttotal: 3.31s\tremaining: 7.04s\n",
      "64:\tlearn: 0.2605782\ttotal: 3.35s\tremaining: 6.96s\n",
      "65:\tlearn: 0.2602267\ttotal: 3.39s\tremaining: 6.88s\n",
      "66:\tlearn: 0.2601397\ttotal: 3.43s\tremaining: 6.81s\n",
      "67:\tlearn: 0.2590525\ttotal: 3.51s\tremaining: 6.8s\n",
      "68:\tlearn: 0.2586171\ttotal: 3.55s\tremaining: 6.74s\n",
      "69:\tlearn: 0.2579246\ttotal: 3.59s\tremaining: 6.66s\n",
      "70:\tlearn: 0.2575056\ttotal: 3.63s\tremaining: 6.59s\n",
      "71:\tlearn: 0.2570127\ttotal: 3.69s\tremaining: 6.55s\n",
      "72:\tlearn: 0.2566638\ttotal: 3.84s\tremaining: 6.68s\n",
      "73:\tlearn: 0.2565051\ttotal: 3.96s\tremaining: 6.74s\n",
      "74:\tlearn: 0.2561494\ttotal: 4.06s\tremaining: 6.77s\n",
      "75:\tlearn: 0.2558822\ttotal: 4.11s\tremaining: 6.71s\n",
      "76:\tlearn: 0.2555268\ttotal: 4.15s\tremaining: 6.64s\n",
      "77:\tlearn: 0.2551042\ttotal: 4.2s\tremaining: 6.56s\n",
      "78:\tlearn: 0.2548623\ttotal: 4.24s\tremaining: 6.49s\n",
      "79:\tlearn: 0.2546431\ttotal: 4.29s\tremaining: 6.43s\n",
      "80:\tlearn: 0.2544248\ttotal: 4.35s\tremaining: 6.39s\n",
      "81:\tlearn: 0.2538896\ttotal: 4.39s\tremaining: 6.32s\n",
      "82:\tlearn: 0.2536727\ttotal: 4.43s\tremaining: 6.25s\n",
      "83:\tlearn: 0.2532410\ttotal: 4.47s\tremaining: 6.18s\n",
      "84:\tlearn: 0.2527357\ttotal: 4.52s\tremaining: 6.12s\n",
      "85:\tlearn: 0.2525648\ttotal: 4.58s\tremaining: 6.08s\n",
      "86:\tlearn: 0.2522336\ttotal: 4.62s\tremaining: 6.01s\n",
      "87:\tlearn: 0.2518509\ttotal: 4.66s\tremaining: 5.93s\n",
      "88:\tlearn: 0.2513285\ttotal: 4.7s\tremaining: 5.86s\n",
      "89:\tlearn: 0.2507566\ttotal: 4.75s\tremaining: 5.81s\n",
      "90:\tlearn: 0.2504325\ttotal: 4.81s\tremaining: 5.76s\n",
      "91:\tlearn: 0.2502066\ttotal: 4.85s\tremaining: 5.7s\n",
      "92:\tlearn: 0.2500442\ttotal: 4.89s\tremaining: 5.63s\n",
      "93:\tlearn: 0.2495353\ttotal: 4.93s\tremaining: 5.56s\n",
      "94:\tlearn: 0.2493301\ttotal: 5.01s\tremaining: 5.54s\n",
      "95:\tlearn: 0.2488095\ttotal: 5.05s\tremaining: 5.47s\n",
      "96:\tlearn: 0.2484419\ttotal: 5.09s\tremaining: 5.4s\n",
      "97:\tlearn: 0.2480089\ttotal: 5.12s\tremaining: 5.33s\n",
      "98:\tlearn: 0.2477222\ttotal: 5.19s\tremaining: 5.3s\n",
      "99:\tlearn: 0.2475948\ttotal: 5.23s\tremaining: 5.23s\n",
      "100:\tlearn: 0.2473987\ttotal: 5.27s\tremaining: 5.17s\n",
      "101:\tlearn: 0.2471946\ttotal: 5.31s\tremaining: 5.1s\n",
      "102:\tlearn: 0.2470436\ttotal: 5.35s\tremaining: 5.04s\n",
      "103:\tlearn: 0.2467856\ttotal: 5.39s\tremaining: 4.97s\n",
      "104:\tlearn: 0.2465686\ttotal: 5.45s\tremaining: 4.93s\n",
      "105:\tlearn: 0.2462952\ttotal: 5.49s\tremaining: 4.87s\n",
      "106:\tlearn: 0.2459949\ttotal: 5.53s\tremaining: 4.81s\n",
      "107:\tlearn: 0.2455428\ttotal: 5.57s\tremaining: 4.75s\n",
      "108:\tlearn: 0.2452547\ttotal: 5.61s\tremaining: 4.68s\n",
      "109:\tlearn: 0.2448829\ttotal: 5.65s\tremaining: 4.62s\n",
      "110:\tlearn: 0.2444251\ttotal: 5.72s\tremaining: 4.58s\n",
      "111:\tlearn: 0.2442843\ttotal: 5.76s\tremaining: 4.53s\n",
      "112:\tlearn: 0.2437936\ttotal: 5.8s\tremaining: 4.47s\n",
      "113:\tlearn: 0.2434952\ttotal: 5.84s\tremaining: 4.41s\n",
      "114:\tlearn: 0.2433109\ttotal: 5.9s\tremaining: 4.36s\n",
      "115:\tlearn: 0.2431769\ttotal: 5.95s\tremaining: 4.31s\n",
      "116:\tlearn: 0.2429923\ttotal: 5.99s\tremaining: 4.25s\n",
      "117:\tlearn: 0.2428818\ttotal: 6.03s\tremaining: 4.19s\n",
      "118:\tlearn: 0.2425887\ttotal: 6.15s\tremaining: 4.18s\n",
      "119:\tlearn: 0.2421810\ttotal: 6.19s\tremaining: 4.13s\n",
      "120:\tlearn: 0.2418144\ttotal: 6.23s\tremaining: 4.07s\n",
      "121:\tlearn: 0.2415742\ttotal: 6.3s\tremaining: 4.03s\n",
      "122:\tlearn: 0.2414818\ttotal: 6.34s\tremaining: 3.97s\n",
      "123:\tlearn: 0.2411942\ttotal: 6.38s\tremaining: 3.91s\n",
      "124:\tlearn: 0.2408634\ttotal: 6.41s\tremaining: 3.85s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "125:\tlearn: 0.2407461\ttotal: 6.46s\tremaining: 3.79s\n",
      "126:\tlearn: 0.2404338\ttotal: 6.52s\tremaining: 3.75s\n",
      "127:\tlearn: 0.2400488\ttotal: 6.56s\tremaining: 3.69s\n",
      "128:\tlearn: 0.2396984\ttotal: 6.6s\tremaining: 3.63s\n",
      "129:\tlearn: 0.2393968\ttotal: 6.64s\tremaining: 3.58s\n",
      "130:\tlearn: 0.2392224\ttotal: 6.71s\tremaining: 3.53s\n",
      "131:\tlearn: 0.2389273\ttotal: 6.74s\tremaining: 3.47s\n",
      "132:\tlearn: 0.2388540\ttotal: 6.79s\tremaining: 3.42s\n",
      "133:\tlearn: 0.2387392\ttotal: 6.85s\tremaining: 3.37s\n",
      "134:\tlearn: 0.2385877\ttotal: 6.93s\tremaining: 3.34s\n",
      "135:\tlearn: 0.2384826\ttotal: 6.97s\tremaining: 3.28s\n",
      "136:\tlearn: 0.2383555\ttotal: 7.01s\tremaining: 3.22s\n",
      "137:\tlearn: 0.2382372\ttotal: 7.04s\tremaining: 3.17s\n",
      "138:\tlearn: 0.2381184\ttotal: 7.11s\tremaining: 3.12s\n",
      "139:\tlearn: 0.2378536\ttotal: 7.15s\tremaining: 3.06s\n",
      "140:\tlearn: 0.2375947\ttotal: 7.18s\tremaining: 3s\n",
      "141:\tlearn: 0.2374298\ttotal: 7.22s\tremaining: 2.95s\n",
      "142:\tlearn: 0.2371343\ttotal: 7.27s\tremaining: 2.9s\n",
      "143:\tlearn: 0.2369157\ttotal: 7.33s\tremaining: 2.85s\n",
      "144:\tlearn: 0.2365334\ttotal: 7.37s\tremaining: 2.79s\n",
      "145:\tlearn: 0.2363154\ttotal: 7.41s\tremaining: 2.74s\n",
      "146:\tlearn: 0.2360043\ttotal: 7.45s\tremaining: 2.69s\n",
      "147:\tlearn: 0.2358559\ttotal: 7.5s\tremaining: 2.63s\n",
      "148:\tlearn: 0.2357459\ttotal: 7.55s\tremaining: 2.58s\n",
      "149:\tlearn: 0.2354444\ttotal: 7.59s\tremaining: 2.53s\n",
      "150:\tlearn: 0.2351939\ttotal: 7.63s\tremaining: 2.48s\n",
      "151:\tlearn: 0.2349027\ttotal: 7.67s\tremaining: 2.42s\n",
      "152:\tlearn: 0.2347561\ttotal: 7.7s\tremaining: 2.37s\n",
      "153:\tlearn: 0.2345881\ttotal: 7.76s\tremaining: 2.32s\n",
      "154:\tlearn: 0.2344919\ttotal: 7.8s\tremaining: 2.27s\n",
      "155:\tlearn: 0.2343039\ttotal: 7.84s\tremaining: 2.21s\n",
      "156:\tlearn: 0.2341722\ttotal: 7.88s\tremaining: 2.16s\n",
      "157:\tlearn: 0.2339119\ttotal: 7.93s\tremaining: 2.11s\n",
      "158:\tlearn: 0.2336555\ttotal: 7.98s\tremaining: 2.06s\n",
      "159:\tlearn: 0.2333917\ttotal: 8.02s\tremaining: 2s\n",
      "160:\tlearn: 0.2332115\ttotal: 8.06s\tremaining: 1.95s\n",
      "161:\tlearn: 0.2329097\ttotal: 8.1s\tremaining: 1.9s\n",
      "162:\tlearn: 0.2327672\ttotal: 8.13s\tremaining: 1.85s\n",
      "163:\tlearn: 0.2324471\ttotal: 8.23s\tremaining: 1.81s\n",
      "164:\tlearn: 0.2321162\ttotal: 8.36s\tremaining: 1.77s\n",
      "165:\tlearn: 0.2318249\ttotal: 8.45s\tremaining: 1.73s\n",
      "166:\tlearn: 0.2314577\ttotal: 8.5s\tremaining: 1.68s\n",
      "167:\tlearn: 0.2310676\ttotal: 8.54s\tremaining: 1.63s\n",
      "168:\tlearn: 0.2307966\ttotal: 8.6s\tremaining: 1.58s\n",
      "169:\tlearn: 0.2303878\ttotal: 8.65s\tremaining: 1.53s\n",
      "170:\tlearn: 0.2302720\ttotal: 8.69s\tremaining: 1.47s\n",
      "171:\tlearn: 0.2302258\ttotal: 8.72s\tremaining: 1.42s\n",
      "172:\tlearn: 0.2299792\ttotal: 8.76s\tremaining: 1.37s\n",
      "173:\tlearn: 0.2295774\ttotal: 8.81s\tremaining: 1.32s\n",
      "174:\tlearn: 0.2295170\ttotal: 8.87s\tremaining: 1.27s\n",
      "175:\tlearn: 0.2292344\ttotal: 8.91s\tremaining: 1.21s\n",
      "176:\tlearn: 0.2291135\ttotal: 8.94s\tremaining: 1.16s\n",
      "177:\tlearn: 0.2290077\ttotal: 8.98s\tremaining: 1.11s\n",
      "178:\tlearn: 0.2289985\ttotal: 9.03s\tremaining: 1.06s\n",
      "179:\tlearn: 0.2286697\ttotal: 9.08s\tremaining: 1.01s\n",
      "180:\tlearn: 0.2284767\ttotal: 9.13s\tremaining: 959ms\n",
      "181:\tlearn: 0.2283670\ttotal: 9.17s\tremaining: 907ms\n",
      "182:\tlearn: 0.2283317\ttotal: 9.21s\tremaining: 855ms\n",
      "183:\tlearn: 0.2282459\ttotal: 9.26s\tremaining: 805ms\n",
      "184:\tlearn: 0.2279832\ttotal: 9.31s\tremaining: 755ms\n",
      "185:\tlearn: 0.2278340\ttotal: 9.35s\tremaining: 704ms\n",
      "186:\tlearn: 0.2277636\ttotal: 9.39s\tremaining: 653ms\n",
      "187:\tlearn: 0.2274997\ttotal: 9.43s\tremaining: 602ms\n",
      "188:\tlearn: 0.2272182\ttotal: 9.47s\tremaining: 551ms\n",
      "189:\tlearn: 0.2272009\ttotal: 9.53s\tremaining: 501ms\n",
      "190:\tlearn: 0.2269597\ttotal: 9.56s\tremaining: 451ms\n",
      "191:\tlearn: 0.2266441\ttotal: 9.6s\tremaining: 400ms\n",
      "192:\tlearn: 0.2263687\ttotal: 9.64s\tremaining: 350ms\n",
      "193:\tlearn: 0.2261245\ttotal: 9.71s\tremaining: 300ms\n",
      "194:\tlearn: 0.2258398\ttotal: 9.77s\tremaining: 251ms\n",
      "195:\tlearn: 0.2255128\ttotal: 9.81s\tremaining: 200ms\n",
      "196:\tlearn: 0.2253228\ttotal: 9.85s\tremaining: 150ms\n",
      "197:\tlearn: 0.2250837\ttotal: 9.9s\tremaining: 100ms\n",
      "198:\tlearn: 0.2249329\ttotal: 9.96s\tremaining: 50ms\n",
      "199:\tlearn: 0.2246559\ttotal: 10s\tremaining: 0us\n",
      "0:\tlearn: 0.4884659\ttotal: 52ms\tremaining: 10.3s\n",
      "1:\tlearn: 0.4081357\ttotal: 98.7ms\tremaining: 9.77s\n",
      "2:\tlearn: 0.3744098\ttotal: 138ms\tremaining: 9.04s\n",
      "3:\tlearn: 0.3574307\ttotal: 178ms\tremaining: 8.71s\n",
      "4:\tlearn: 0.3450571\ttotal: 216ms\tremaining: 8.43s\n",
      "5:\tlearn: 0.3357138\ttotal: 254ms\tremaining: 8.2s\n",
      "6:\tlearn: 0.3270779\ttotal: 416ms\tremaining: 11.5s\n",
      "7:\tlearn: 0.3206461\ttotal: 537ms\tremaining: 12.9s\n",
      "8:\tlearn: 0.3153183\ttotal: 579ms\tremaining: 12.3s\n",
      "9:\tlearn: 0.3124480\ttotal: 621ms\tremaining: 11.8s\n",
      "10:\tlearn: 0.3097381\ttotal: 663ms\tremaining: 11.4s\n",
      "11:\tlearn: 0.3064184\ttotal: 700ms\tremaining: 11s\n",
      "12:\tlearn: 0.3028931\ttotal: 747ms\tremaining: 10.7s\n",
      "13:\tlearn: 0.3009571\ttotal: 816ms\tremaining: 10.8s\n",
      "14:\tlearn: 0.2994812\ttotal: 855ms\tremaining: 10.6s\n",
      "15:\tlearn: 0.2971076\ttotal: 894ms\tremaining: 10.3s\n",
      "16:\tlearn: 0.2962274\ttotal: 933ms\tremaining: 10s\n",
      "17:\tlearn: 0.2953282\ttotal: 996ms\tremaining: 10.1s\n",
      "18:\tlearn: 0.2936366\ttotal: 1.03s\tremaining: 9.86s\n",
      "19:\tlearn: 0.2923238\ttotal: 1.07s\tremaining: 9.66s\n",
      "20:\tlearn: 0.2914909\ttotal: 1.11s\tremaining: 9.48s\n",
      "21:\tlearn: 0.2903283\ttotal: 1.16s\tremaining: 9.39s\n",
      "22:\tlearn: 0.2891810\ttotal: 1.22s\tremaining: 9.37s\n",
      "23:\tlearn: 0.2882041\ttotal: 1.26s\tremaining: 9.24s\n",
      "24:\tlearn: 0.2877538\ttotal: 1.3s\tremaining: 9.1s\n",
      "25:\tlearn: 0.2873292\ttotal: 1.34s\tremaining: 8.95s\n",
      "26:\tlearn: 0.2868595\ttotal: 1.4s\tremaining: 8.98s\n",
      "27:\tlearn: 0.2853838\ttotal: 1.44s\tremaining: 8.86s\n",
      "28:\tlearn: 0.2849605\ttotal: 1.49s\tremaining: 8.78s\n",
      "29:\tlearn: 0.2836869\ttotal: 1.54s\tremaining: 8.71s\n",
      "30:\tlearn: 0.2831392\ttotal: 1.6s\tremaining: 8.73s\n",
      "31:\tlearn: 0.2825578\ttotal: 1.64s\tremaining: 8.61s\n",
      "32:\tlearn: 0.2819614\ttotal: 1.68s\tremaining: 8.5s\n",
      "33:\tlearn: 0.2810398\ttotal: 1.72s\tremaining: 8.38s\n",
      "34:\tlearn: 0.2772979\ttotal: 1.78s\tremaining: 8.37s\n",
      "35:\tlearn: 0.2761708\ttotal: 1.83s\tremaining: 8.34s\n",
      "36:\tlearn: 0.2755190\ttotal: 1.87s\tremaining: 8.24s\n",
      "37:\tlearn: 0.2749496\ttotal: 1.91s\tremaining: 8.14s\n",
      "38:\tlearn: 0.2743249\ttotal: 1.95s\tremaining: 8.05s\n",
      "39:\tlearn: 0.2733811\ttotal: 2s\tremaining: 8.02s\n",
      "40:\tlearn: 0.2730010\ttotal: 2.06s\tremaining: 7.99s\n",
      "41:\tlearn: 0.2724098\ttotal: 2.1s\tremaining: 7.89s\n",
      "42:\tlearn: 0.2718207\ttotal: 2.14s\tremaining: 7.8s\n",
      "43:\tlearn: 0.2711741\ttotal: 2.17s\tremaining: 7.71s\n",
      "44:\tlearn: 0.2700980\ttotal: 2.22s\tremaining: 7.65s\n",
      "45:\tlearn: 0.2695197\ttotal: 2.29s\tremaining: 7.65s\n",
      "46:\tlearn: 0.2691774\ttotal: 2.33s\tremaining: 7.59s\n",
      "47:\tlearn: 0.2683061\ttotal: 2.37s\tremaining: 7.51s\n",
      "48:\tlearn: 0.2675424\ttotal: 2.41s\tremaining: 7.43s\n",
      "49:\tlearn: 0.2671479\ttotal: 2.48s\tremaining: 7.43s\n",
      "50:\tlearn: 0.2668149\ttotal: 2.57s\tremaining: 7.5s\n",
      "51:\tlearn: 0.2664718\ttotal: 2.71s\tremaining: 7.7s\n",
      "52:\tlearn: 0.2654729\ttotal: 2.75s\tremaining: 7.63s\n",
      "53:\tlearn: 0.2651965\ttotal: 2.79s\tremaining: 7.53s\n",
      "54:\tlearn: 0.2649209\ttotal: 2.82s\tremaining: 7.45s\n",
      "55:\tlearn: 0.2643448\ttotal: 2.86s\tremaining: 7.36s\n",
      "56:\tlearn: 0.2639125\ttotal: 2.9s\tremaining: 7.28s\n",
      "57:\tlearn: 0.2632846\ttotal: 2.97s\tremaining: 7.26s\n",
      "58:\tlearn: 0.2628201\ttotal: 3.01s\tremaining: 7.2s\n",
      "59:\tlearn: 0.2624109\ttotal: 3.05s\tremaining: 7.12s\n",
      "60:\tlearn: 0.2620855\ttotal: 3.09s\tremaining: 7.04s\n",
      "61:\tlearn: 0.2615069\ttotal: 3.15s\tremaining: 7.02s\n",
      "62:\tlearn: 0.2610773\ttotal: 3.19s\tremaining: 6.95s\n",
      "63:\tlearn: 0.2607377\ttotal: 3.23s\tremaining: 6.88s\n",
      "64:\tlearn: 0.2605772\ttotal: 3.27s\tremaining: 6.8s\n",
      "65:\tlearn: 0.2599661\ttotal: 3.34s\tremaining: 6.79s\n",
      "66:\tlearn: 0.2594736\ttotal: 3.38s\tremaining: 6.72s\n",
      "67:\tlearn: 0.2588857\ttotal: 3.42s\tremaining: 6.65s\n",
      "68:\tlearn: 0.2586601\ttotal: 3.46s\tremaining: 6.57s\n",
      "69:\tlearn: 0.2583609\ttotal: 3.52s\tremaining: 6.53s\n",
      "70:\tlearn: 0.2581312\ttotal: 3.57s\tremaining: 6.48s\n",
      "71:\tlearn: 0.2577099\ttotal: 3.6s\tremaining: 6.41s\n",
      "72:\tlearn: 0.2572858\ttotal: 3.64s\tremaining: 6.34s\n",
      "73:\tlearn: 0.2568230\ttotal: 3.72s\tremaining: 6.33s\n",
      "74:\tlearn: 0.2563117\ttotal: 3.77s\tremaining: 6.28s\n",
      "75:\tlearn: 0.2558346\ttotal: 3.9s\tremaining: 6.36s\n",
      "76:\tlearn: 0.2553333\ttotal: 4s\tremaining: 6.39s\n",
      "77:\tlearn: 0.2544442\ttotal: 4.05s\tremaining: 6.33s\n",
      "78:\tlearn: 0.2538222\ttotal: 4.08s\tremaining: 6.25s\n",
      "79:\tlearn: 0.2537445\ttotal: 4.14s\tremaining: 6.21s\n",
      "80:\tlearn: 0.2534349\ttotal: 4.19s\tremaining: 6.16s\n",
      "81:\tlearn: 0.2531215\ttotal: 4.23s\tremaining: 6.09s\n",
      "82:\tlearn: 0.2527374\ttotal: 4.27s\tremaining: 6.02s\n",
      "83:\tlearn: 0.2525875\ttotal: 4.33s\tremaining: 5.98s\n",
      "84:\tlearn: 0.2522913\ttotal: 4.38s\tremaining: 5.92s\n",
      "85:\tlearn: 0.2519001\ttotal: 4.42s\tremaining: 5.86s\n",
      "86:\tlearn: 0.2513308\ttotal: 4.45s\tremaining: 5.79s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "87:\tlearn: 0.2508407\ttotal: 4.53s\tremaining: 5.76s\n",
      "88:\tlearn: 0.2506509\ttotal: 4.57s\tremaining: 5.69s\n",
      "89:\tlearn: 0.2501783\ttotal: 4.6s\tremaining: 5.63s\n",
      "90:\tlearn: 0.2500411\ttotal: 4.64s\tremaining: 5.56s\n",
      "91:\tlearn: 0.2495824\ttotal: 4.78s\tremaining: 5.61s\n",
      "92:\tlearn: 0.2490950\ttotal: 4.89s\tremaining: 5.63s\n",
      "93:\tlearn: 0.2488926\ttotal: 4.93s\tremaining: 5.56s\n",
      "94:\tlearn: 0.2484046\ttotal: 4.97s\tremaining: 5.49s\n",
      "95:\tlearn: 0.2481794\ttotal: 5.03s\tremaining: 5.45s\n",
      "96:\tlearn: 0.2479094\ttotal: 5.07s\tremaining: 5.38s\n",
      "97:\tlearn: 0.2474333\ttotal: 5.11s\tremaining: 5.32s\n",
      "98:\tlearn: 0.2472361\ttotal: 5.15s\tremaining: 5.25s\n",
      "99:\tlearn: 0.2471621\ttotal: 5.2s\tremaining: 5.2s\n",
      "100:\tlearn: 0.2467285\ttotal: 5.25s\tremaining: 5.15s\n",
      "101:\tlearn: 0.2464162\ttotal: 5.29s\tremaining: 5.08s\n",
      "102:\tlearn: 0.2463307\ttotal: 5.33s\tremaining: 5.02s\n",
      "103:\tlearn: 0.2461855\ttotal: 5.37s\tremaining: 4.96s\n",
      "104:\tlearn: 0.2459343\ttotal: 5.43s\tremaining: 4.91s\n",
      "105:\tlearn: 0.2456722\ttotal: 5.48s\tremaining: 4.86s\n",
      "106:\tlearn: 0.2453904\ttotal: 5.52s\tremaining: 4.8s\n",
      "107:\tlearn: 0.2450109\ttotal: 5.56s\tremaining: 4.74s\n",
      "108:\tlearn: 0.2446274\ttotal: 5.6s\tremaining: 4.67s\n",
      "109:\tlearn: 0.2444840\ttotal: 5.65s\tremaining: 4.62s\n",
      "110:\tlearn: 0.2441018\ttotal: 5.7s\tremaining: 4.57s\n",
      "111:\tlearn: 0.2437408\ttotal: 5.74s\tremaining: 4.51s\n",
      "112:\tlearn: 0.2434843\ttotal: 5.79s\tremaining: 4.46s\n",
      "113:\tlearn: 0.2432032\ttotal: 5.83s\tremaining: 4.39s\n",
      "114:\tlearn: 0.2430427\ttotal: 5.88s\tremaining: 4.34s\n",
      "115:\tlearn: 0.2426406\ttotal: 5.93s\tremaining: 4.29s\n",
      "116:\tlearn: 0.2424035\ttotal: 5.97s\tremaining: 4.23s\n",
      "117:\tlearn: 0.2421204\ttotal: 6.01s\tremaining: 4.17s\n",
      "118:\tlearn: 0.2417192\ttotal: 6.05s\tremaining: 4.12s\n",
      "119:\tlearn: 0.2413040\ttotal: 6.1s\tremaining: 4.07s\n",
      "120:\tlearn: 0.2410454\ttotal: 6.16s\tremaining: 4.02s\n",
      "121:\tlearn: 0.2407491\ttotal: 6.2s\tremaining: 3.96s\n",
      "122:\tlearn: 0.2403673\ttotal: 6.24s\tremaining: 3.9s\n",
      "123:\tlearn: 0.2401332\ttotal: 6.28s\tremaining: 3.85s\n",
      "124:\tlearn: 0.2397060\ttotal: 6.33s\tremaining: 3.8s\n",
      "125:\tlearn: 0.2394986\ttotal: 6.38s\tremaining: 3.75s\n",
      "126:\tlearn: 0.2390124\ttotal: 6.42s\tremaining: 3.69s\n",
      "127:\tlearn: 0.2387007\ttotal: 6.46s\tremaining: 3.63s\n",
      "128:\tlearn: 0.2384749\ttotal: 6.49s\tremaining: 3.57s\n",
      "129:\tlearn: 0.2380753\ttotal: 6.53s\tremaining: 3.52s\n",
      "130:\tlearn: 0.2378170\ttotal: 6.59s\tremaining: 3.47s\n",
      "131:\tlearn: 0.2375372\ttotal: 6.63s\tremaining: 3.42s\n",
      "132:\tlearn: 0.2372601\ttotal: 6.67s\tremaining: 3.36s\n",
      "133:\tlearn: 0.2368860\ttotal: 6.71s\tremaining: 3.3s\n",
      "134:\tlearn: 0.2365697\ttotal: 6.78s\tremaining: 3.26s\n",
      "135:\tlearn: 0.2363524\ttotal: 6.81s\tremaining: 3.21s\n",
      "136:\tlearn: 0.2360234\ttotal: 6.85s\tremaining: 3.15s\n",
      "137:\tlearn: 0.2357628\ttotal: 6.89s\tremaining: 3.1s\n",
      "138:\tlearn: 0.2354255\ttotal: 7.06s\tremaining: 3.1s\n",
      "139:\tlearn: 0.2349524\ttotal: 7.11s\tremaining: 3.04s\n",
      "140:\tlearn: 0.2346763\ttotal: 7.14s\tremaining: 2.99s\n",
      "141:\tlearn: 0.2346136\ttotal: 7.18s\tremaining: 2.93s\n",
      "142:\tlearn: 0.2343162\ttotal: 7.23s\tremaining: 2.88s\n",
      "143:\tlearn: 0.2340251\ttotal: 7.29s\tremaining: 2.83s\n",
      "144:\tlearn: 0.2339311\ttotal: 7.33s\tremaining: 2.78s\n",
      "145:\tlearn: 0.2336207\ttotal: 7.37s\tremaining: 2.73s\n",
      "146:\tlearn: 0.2332967\ttotal: 7.41s\tremaining: 2.67s\n",
      "147:\tlearn: 0.2328957\ttotal: 7.48s\tremaining: 2.63s\n",
      "148:\tlearn: 0.2326389\ttotal: 7.52s\tremaining: 2.57s\n",
      "149:\tlearn: 0.2324441\ttotal: 7.56s\tremaining: 2.52s\n",
      "150:\tlearn: 0.2320716\ttotal: 7.6s\tremaining: 2.46s\n",
      "151:\tlearn: 0.2319136\ttotal: 7.66s\tremaining: 2.42s\n",
      "152:\tlearn: 0.2317923\ttotal: 7.7s\tremaining: 2.36s\n",
      "153:\tlearn: 0.2317794\ttotal: 7.74s\tremaining: 2.31s\n",
      "154:\tlearn: 0.2315852\ttotal: 7.78s\tremaining: 2.26s\n",
      "155:\tlearn: 0.2315210\ttotal: 7.83s\tremaining: 2.21s\n",
      "156:\tlearn: 0.2311333\ttotal: 7.88s\tremaining: 2.16s\n",
      "157:\tlearn: 0.2306947\ttotal: 7.92s\tremaining: 2.1s\n",
      "158:\tlearn: 0.2303265\ttotal: 7.96s\tremaining: 2.05s\n",
      "159:\tlearn: 0.2300096\ttotal: 8s\tremaining: 2s\n",
      "160:\tlearn: 0.2297845\ttotal: 8.07s\tremaining: 1.95s\n",
      "161:\tlearn: 0.2296905\ttotal: 8.11s\tremaining: 1.9s\n",
      "162:\tlearn: 0.2295913\ttotal: 8.15s\tremaining: 1.85s\n",
      "163:\tlearn: 0.2292160\ttotal: 8.19s\tremaining: 1.8s\n",
      "164:\tlearn: 0.2289030\ttotal: 8.23s\tremaining: 1.75s\n",
      "165:\tlearn: 0.2285491\ttotal: 8.29s\tremaining: 1.7s\n",
      "166:\tlearn: 0.2282429\ttotal: 8.33s\tremaining: 1.65s\n",
      "167:\tlearn: 0.2279679\ttotal: 8.37s\tremaining: 1.59s\n",
      "168:\tlearn: 0.2276615\ttotal: 8.41s\tremaining: 1.54s\n",
      "169:\tlearn: 0.2273632\ttotal: 8.48s\tremaining: 1.5s\n",
      "170:\tlearn: 0.2271091\ttotal: 8.52s\tremaining: 1.45s\n",
      "171:\tlearn: 0.2270608\ttotal: 8.56s\tremaining: 1.39s\n",
      "172:\tlearn: 0.2270117\ttotal: 8.6s\tremaining: 1.34s\n",
      "173:\tlearn: 0.2266012\ttotal: 8.67s\tremaining: 1.29s\n",
      "174:\tlearn: 0.2262926\ttotal: 8.71s\tremaining: 1.24s\n",
      "175:\tlearn: 0.2261053\ttotal: 8.75s\tremaining: 1.19s\n",
      "176:\tlearn: 0.2258464\ttotal: 8.79s\tremaining: 1.14s\n",
      "177:\tlearn: 0.2256669\ttotal: 8.86s\tremaining: 1.09s\n",
      "178:\tlearn: 0.2255390\ttotal: 8.9s\tremaining: 1.04s\n",
      "179:\tlearn: 0.2251964\ttotal: 8.93s\tremaining: 993ms\n",
      "180:\tlearn: 0.2249162\ttotal: 8.97s\tremaining: 942ms\n",
      "181:\tlearn: 0.2247379\ttotal: 9.04s\tremaining: 894ms\n",
      "182:\tlearn: 0.2244589\ttotal: 9.1s\tremaining: 845ms\n",
      "183:\tlearn: 0.2242187\ttotal: 9.25s\tremaining: 804ms\n",
      "184:\tlearn: 0.2241389\ttotal: 9.3s\tremaining: 754ms\n",
      "185:\tlearn: 0.2240266\ttotal: 9.34s\tremaining: 703ms\n",
      "186:\tlearn: 0.2237841\ttotal: 9.38s\tremaining: 652ms\n",
      "187:\tlearn: 0.2235374\ttotal: 9.42s\tremaining: 601ms\n",
      "188:\tlearn: 0.2234114\ttotal: 9.45s\tremaining: 550ms\n",
      "189:\tlearn: 0.2231306\ttotal: 9.53s\tremaining: 501ms\n",
      "190:\tlearn: 0.2230279\ttotal: 9.56s\tremaining: 451ms\n",
      "191:\tlearn: 0.2229991\ttotal: 9.6s\tremaining: 400ms\n",
      "192:\tlearn: 0.2228452\ttotal: 9.64s\tremaining: 350ms\n",
      "193:\tlearn: 0.2224884\ttotal: 9.68s\tremaining: 300ms\n",
      "194:\tlearn: 0.2224450\ttotal: 9.75s\tremaining: 250ms\n",
      "195:\tlearn: 0.2220808\ttotal: 9.79s\tremaining: 200ms\n",
      "196:\tlearn: 0.2218511\ttotal: 9.82s\tremaining: 150ms\n",
      "197:\tlearn: 0.2213896\ttotal: 9.87s\tremaining: 99.7ms\n",
      "198:\tlearn: 0.2211368\ttotal: 9.92s\tremaining: 49.8ms\n",
      "199:\tlearn: 0.2209491\ttotal: 9.98s\tremaining: 0us\n",
      "0:\tlearn: 0.4887360\ttotal: 57.3ms\tremaining: 11.4s\n",
      "1:\tlearn: 0.4110202\ttotal: 95.8ms\tremaining: 9.49s\n",
      "2:\tlearn: 0.3773557\ttotal: 133ms\tremaining: 8.77s\n",
      "3:\tlearn: 0.3532264\ttotal: 172ms\tremaining: 8.44s\n",
      "4:\tlearn: 0.3401859\ttotal: 211ms\tremaining: 8.21s\n",
      "5:\tlearn: 0.3335600\ttotal: 248ms\tremaining: 8.03s\n",
      "6:\tlearn: 0.3284012\ttotal: 314ms\tremaining: 8.65s\n",
      "7:\tlearn: 0.3238258\ttotal: 354ms\tremaining: 8.49s\n",
      "8:\tlearn: 0.3179218\ttotal: 391ms\tremaining: 8.3s\n",
      "9:\tlearn: 0.3152325\ttotal: 426ms\tremaining: 8.09s\n",
      "10:\tlearn: 0.3090469\ttotal: 472ms\tremaining: 8.11s\n",
      "11:\tlearn: 0.3062557\ttotal: 534ms\tremaining: 8.37s\n",
      "12:\tlearn: 0.3046518\ttotal: 576ms\tremaining: 8.29s\n",
      "13:\tlearn: 0.3032956\ttotal: 617ms\tremaining: 8.2s\n",
      "14:\tlearn: 0.3014581\ttotal: 655ms\tremaining: 8.08s\n",
      "15:\tlearn: 0.2992295\ttotal: 719ms\tremaining: 8.27s\n",
      "16:\tlearn: 0.2964421\ttotal: 762ms\tremaining: 8.2s\n",
      "17:\tlearn: 0.2955067\ttotal: 799ms\tremaining: 8.08s\n",
      "18:\tlearn: 0.2943390\ttotal: 840ms\tremaining: 8.01s\n",
      "19:\tlearn: 0.2935424\ttotal: 910ms\tremaining: 8.19s\n",
      "20:\tlearn: 0.2928080\ttotal: 957ms\tremaining: 8.15s\n",
      "21:\tlearn: 0.2918887\ttotal: 998ms\tremaining: 8.07s\n",
      "22:\tlearn: 0.2911962\ttotal: 1.04s\tremaining: 8.02s\n",
      "23:\tlearn: 0.2899137\ttotal: 1.1s\tremaining: 8.08s\n",
      "24:\tlearn: 0.2883546\ttotal: 1.24s\tremaining: 8.65s\n",
      "25:\tlearn: 0.2843291\ttotal: 1.37s\tremaining: 9.16s\n",
      "26:\tlearn: 0.2838125\ttotal: 1.43s\tremaining: 9.15s\n",
      "27:\tlearn: 0.2832594\ttotal: 1.47s\tremaining: 9.03s\n",
      "28:\tlearn: 0.2826272\ttotal: 1.53s\tremaining: 9.05s\n",
      "29:\tlearn: 0.2808890\ttotal: 1.58s\tremaining: 8.94s\n",
      "30:\tlearn: 0.2803085\ttotal: 1.62s\tremaining: 8.82s\n",
      "31:\tlearn: 0.2798536\ttotal: 1.66s\tremaining: 8.71s\n",
      "32:\tlearn: 0.2776381\ttotal: 1.73s\tremaining: 8.74s\n",
      "33:\tlearn: 0.2771029\ttotal: 1.77s\tremaining: 8.65s\n",
      "34:\tlearn: 0.2768198\ttotal: 1.81s\tremaining: 8.52s\n",
      "35:\tlearn: 0.2764894\ttotal: 1.84s\tremaining: 8.41s\n",
      "36:\tlearn: 0.2758915\ttotal: 1.92s\tremaining: 8.44s\n",
      "37:\tlearn: 0.2751363\ttotal: 1.96s\tremaining: 8.34s\n",
      "38:\tlearn: 0.2744130\ttotal: 2s\tremaining: 8.24s\n",
      "39:\tlearn: 0.2739829\ttotal: 2.03s\tremaining: 8.13s\n",
      "40:\tlearn: 0.2731363\ttotal: 2.1s\tremaining: 8.14s\n",
      "41:\tlearn: 0.2719138\ttotal: 2.14s\tremaining: 8.04s\n",
      "42:\tlearn: 0.2712089\ttotal: 2.18s\tremaining: 7.95s\n",
      "43:\tlearn: 0.2704257\ttotal: 2.21s\tremaining: 7.85s\n",
      "44:\tlearn: 0.2699935\ttotal: 2.28s\tremaining: 7.86s\n",
      "45:\tlearn: 0.2695278\ttotal: 2.32s\tremaining: 7.77s\n",
      "46:\tlearn: 0.2688921\ttotal: 2.37s\tremaining: 7.71s\n",
      "47:\tlearn: 0.2683755\ttotal: 2.4s\tremaining: 7.61s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "48:\tlearn: 0.2677664\ttotal: 2.47s\tremaining: 7.62s\n",
      "49:\tlearn: 0.2667065\ttotal: 2.51s\tremaining: 7.54s\n",
      "50:\tlearn: 0.2662464\ttotal: 2.56s\tremaining: 7.47s\n",
      "51:\tlearn: 0.2654807\ttotal: 2.59s\tremaining: 7.38s\n",
      "52:\tlearn: 0.2648874\ttotal: 2.67s\tremaining: 7.4s\n",
      "53:\tlearn: 0.2641305\ttotal: 2.71s\tremaining: 7.31s\n",
      "54:\tlearn: 0.2639816\ttotal: 2.74s\tremaining: 7.23s\n",
      "55:\tlearn: 0.2633510\ttotal: 2.79s\tremaining: 7.16s\n",
      "56:\tlearn: 0.2627696\ttotal: 2.84s\tremaining: 7.13s\n",
      "57:\tlearn: 0.2623309\ttotal: 2.88s\tremaining: 7.06s\n",
      "58:\tlearn: 0.2621535\ttotal: 2.93s\tremaining: 6.99s\n",
      "59:\tlearn: 0.2616692\ttotal: 2.97s\tremaining: 6.93s\n",
      "60:\tlearn: 0.2614644\ttotal: 3.04s\tremaining: 6.92s\n",
      "61:\tlearn: 0.2608377\ttotal: 3.07s\tremaining: 6.84s\n",
      "62:\tlearn: 0.2603753\ttotal: 3.12s\tremaining: 6.78s\n",
      "63:\tlearn: 0.2600076\ttotal: 3.16s\tremaining: 6.71s\n",
      "64:\tlearn: 0.2598489\ttotal: 3.21s\tremaining: 6.67s\n",
      "65:\tlearn: 0.2593307\ttotal: 3.25s\tremaining: 6.61s\n",
      "66:\tlearn: 0.2591688\ttotal: 3.29s\tremaining: 6.54s\n",
      "67:\tlearn: 0.2586332\ttotal: 3.33s\tremaining: 6.47s\n",
      "68:\tlearn: 0.2584462\ttotal: 3.46s\tremaining: 6.57s\n",
      "69:\tlearn: 0.2580773\ttotal: 3.55s\tremaining: 6.59s\n",
      "70:\tlearn: 0.2577061\ttotal: 3.59s\tremaining: 6.52s\n",
      "71:\tlearn: 0.2575960\ttotal: 3.63s\tremaining: 6.45s\n",
      "72:\tlearn: 0.2571141\ttotal: 3.68s\tremaining: 6.39s\n",
      "73:\tlearn: 0.2566048\ttotal: 3.73s\tremaining: 6.35s\n",
      "74:\tlearn: 0.2560280\ttotal: 3.77s\tremaining: 6.28s\n",
      "75:\tlearn: 0.2558752\ttotal: 3.81s\tremaining: 6.22s\n",
      "76:\tlearn: 0.2554363\ttotal: 3.85s\tremaining: 6.15s\n",
      "77:\tlearn: 0.2553840\ttotal: 3.9s\tremaining: 6.1s\n",
      "78:\tlearn: 0.2548642\ttotal: 4s\tremaining: 6.13s\n",
      "79:\tlearn: 0.2546713\ttotal: 4.11s\tremaining: 6.17s\n",
      "80:\tlearn: 0.2541619\ttotal: 4.19s\tremaining: 6.15s\n",
      "81:\tlearn: 0.2536991\ttotal: 4.25s\tremaining: 6.11s\n",
      "82:\tlearn: 0.2533659\ttotal: 4.3s\tremaining: 6.07s\n",
      "83:\tlearn: 0.2531699\ttotal: 4.37s\tremaining: 6.03s\n",
      "84:\tlearn: 0.2528609\ttotal: 4.42s\tremaining: 5.98s\n",
      "85:\tlearn: 0.2524328\ttotal: 4.46s\tremaining: 5.91s\n",
      "86:\tlearn: 0.2521599\ttotal: 4.5s\tremaining: 5.84s\n",
      "87:\tlearn: 0.2514190\ttotal: 4.56s\tremaining: 5.81s\n",
      "88:\tlearn: 0.2511753\ttotal: 4.6s\tremaining: 5.74s\n",
      "89:\tlearn: 0.2506722\ttotal: 4.65s\tremaining: 5.69s\n",
      "90:\tlearn: 0.2502349\ttotal: 4.69s\tremaining: 5.62s\n",
      "91:\tlearn: 0.2498023\ttotal: 4.76s\tremaining: 5.58s\n",
      "92:\tlearn: 0.2493501\ttotal: 4.8s\tremaining: 5.52s\n",
      "93:\tlearn: 0.2490531\ttotal: 4.84s\tremaining: 5.46s\n",
      "94:\tlearn: 0.2486765\ttotal: 4.88s\tremaining: 5.4s\n",
      "95:\tlearn: 0.2483292\ttotal: 4.95s\tremaining: 5.37s\n",
      "96:\tlearn: 0.2479998\ttotal: 4.99s\tremaining: 5.3s\n",
      "97:\tlearn: 0.2476491\ttotal: 5.03s\tremaining: 5.23s\n",
      "98:\tlearn: 0.2472594\ttotal: 5.07s\tremaining: 5.17s\n",
      "99:\tlearn: 0.2470101\ttotal: 5.13s\tremaining: 5.13s\n",
      "100:\tlearn: 0.2469478\ttotal: 5.17s\tremaining: 5.07s\n",
      "101:\tlearn: 0.2467391\ttotal: 5.21s\tremaining: 5s\n",
      "102:\tlearn: 0.2462023\ttotal: 5.25s\tremaining: 4.94s\n",
      "103:\tlearn: 0.2461236\ttotal: 5.31s\tremaining: 4.9s\n",
      "104:\tlearn: 0.2458182\ttotal: 5.35s\tremaining: 4.84s\n",
      "105:\tlearn: 0.2456329\ttotal: 5.39s\tremaining: 4.78s\n",
      "106:\tlearn: 0.2452334\ttotal: 5.43s\tremaining: 4.72s\n",
      "107:\tlearn: 0.2449398\ttotal: 5.48s\tremaining: 4.67s\n",
      "108:\tlearn: 0.2447201\ttotal: 5.53s\tremaining: 4.62s\n",
      "109:\tlearn: 0.2443484\ttotal: 5.72s\tremaining: 4.68s\n",
      "110:\tlearn: 0.2439214\ttotal: 5.77s\tremaining: 4.63s\n",
      "111:\tlearn: 0.2433963\ttotal: 5.81s\tremaining: 4.56s\n",
      "112:\tlearn: 0.2432693\ttotal: 5.85s\tremaining: 4.5s\n",
      "113:\tlearn: 0.2431357\ttotal: 5.89s\tremaining: 4.44s\n",
      "114:\tlearn: 0.2427103\ttotal: 5.92s\tremaining: 4.38s\n",
      "115:\tlearn: 0.2426400\ttotal: 5.99s\tremaining: 4.34s\n",
      "116:\tlearn: 0.2423108\ttotal: 6.03s\tremaining: 4.28s\n",
      "117:\tlearn: 0.2418913\ttotal: 6.07s\tremaining: 4.22s\n",
      "118:\tlearn: 0.2418482\ttotal: 6.11s\tremaining: 4.16s\n",
      "119:\tlearn: 0.2415859\ttotal: 6.17s\tremaining: 4.11s\n",
      "120:\tlearn: 0.2412065\ttotal: 6.21s\tremaining: 4.06s\n",
      "121:\tlearn: 0.2409234\ttotal: 6.25s\tremaining: 4s\n",
      "122:\tlearn: 0.2406851\ttotal: 6.29s\tremaining: 3.94s\n",
      "123:\tlearn: 0.2404390\ttotal: 6.33s\tremaining: 3.88s\n",
      "124:\tlearn: 0.2402061\ttotal: 6.38s\tremaining: 3.83s\n",
      "125:\tlearn: 0.2400016\ttotal: 6.44s\tremaining: 3.78s\n",
      "126:\tlearn: 0.2398620\ttotal: 6.48s\tremaining: 3.72s\n",
      "127:\tlearn: 0.2395259\ttotal: 6.52s\tremaining: 3.67s\n",
      "128:\tlearn: 0.2391237\ttotal: 6.56s\tremaining: 3.61s\n",
      "129:\tlearn: 0.2389789\ttotal: 6.6s\tremaining: 3.56s\n",
      "130:\tlearn: 0.2385930\ttotal: 6.67s\tremaining: 3.51s\n",
      "131:\tlearn: 0.2384536\ttotal: 6.71s\tremaining: 3.45s\n",
      "132:\tlearn: 0.2381896\ttotal: 6.74s\tremaining: 3.4s\n",
      "133:\tlearn: 0.2378676\ttotal: 6.78s\tremaining: 3.34s\n",
      "134:\tlearn: 0.2378279\ttotal: 6.85s\tremaining: 3.3s\n",
      "135:\tlearn: 0.2377031\ttotal: 6.89s\tremaining: 3.24s\n",
      "136:\tlearn: 0.2375446\ttotal: 6.93s\tremaining: 3.19s\n",
      "137:\tlearn: 0.2371841\ttotal: 6.97s\tremaining: 3.13s\n",
      "138:\tlearn: 0.2367872\ttotal: 7.03s\tremaining: 3.08s\n",
      "139:\tlearn: 0.2365500\ttotal: 7.08s\tremaining: 3.03s\n",
      "140:\tlearn: 0.2363907\ttotal: 7.12s\tremaining: 2.98s\n",
      "141:\tlearn: 0.2362619\ttotal: 7.16s\tremaining: 2.92s\n",
      "142:\tlearn: 0.2358673\ttotal: 7.2s\tremaining: 2.87s\n",
      "143:\tlearn: 0.2355923\ttotal: 7.24s\tremaining: 2.82s\n",
      "144:\tlearn: 0.2352874\ttotal: 7.31s\tremaining: 2.77s\n",
      "145:\tlearn: 0.2351892\ttotal: 7.35s\tremaining: 2.72s\n",
      "146:\tlearn: 0.2348712\ttotal: 7.38s\tremaining: 2.66s\n",
      "147:\tlearn: 0.2346623\ttotal: 7.43s\tremaining: 2.61s\n",
      "148:\tlearn: 0.2343108\ttotal: 7.49s\tremaining: 2.56s\n",
      "149:\tlearn: 0.2341190\ttotal: 7.53s\tremaining: 2.51s\n",
      "150:\tlearn: 0.2335386\ttotal: 7.57s\tremaining: 2.46s\n",
      "151:\tlearn: 0.2333558\ttotal: 7.61s\tremaining: 2.4s\n",
      "152:\tlearn: 0.2330696\ttotal: 7.68s\tremaining: 2.36s\n",
      "153:\tlearn: 0.2326996\ttotal: 7.71s\tremaining: 2.3s\n",
      "154:\tlearn: 0.2324433\ttotal: 7.78s\tremaining: 2.26s\n",
      "155:\tlearn: 0.2321544\ttotal: 7.92s\tremaining: 2.23s\n",
      "156:\tlearn: 0.2320724\ttotal: 7.99s\tremaining: 2.19s\n",
      "157:\tlearn: 0.2319271\ttotal: 8.03s\tremaining: 2.13s\n",
      "158:\tlearn: 0.2314977\ttotal: 8.07s\tremaining: 2.08s\n",
      "159:\tlearn: 0.2312079\ttotal: 8.11s\tremaining: 2.03s\n",
      "160:\tlearn: 0.2308757\ttotal: 8.18s\tremaining: 1.98s\n",
      "161:\tlearn: 0.2307744\ttotal: 8.21s\tremaining: 1.93s\n",
      "162:\tlearn: 0.2304983\ttotal: 8.25s\tremaining: 1.87s\n",
      "163:\tlearn: 0.2303841\ttotal: 8.29s\tremaining: 1.82s\n",
      "164:\tlearn: 0.2300761\ttotal: 8.34s\tremaining: 1.77s\n",
      "165:\tlearn: 0.2296782\ttotal: 8.41s\tremaining: 1.72s\n",
      "166:\tlearn: 0.2294719\ttotal: 8.45s\tremaining: 1.67s\n",
      "167:\tlearn: 0.2293105\ttotal: 8.49s\tremaining: 1.62s\n",
      "168:\tlearn: 0.2291357\ttotal: 8.53s\tremaining: 1.56s\n",
      "169:\tlearn: 0.2287170\ttotal: 8.58s\tremaining: 1.51s\n",
      "170:\tlearn: 0.2284937\ttotal: 8.64s\tremaining: 1.47s\n",
      "171:\tlearn: 0.2283678\ttotal: 8.68s\tremaining: 1.41s\n",
      "172:\tlearn: 0.2282134\ttotal: 8.72s\tremaining: 1.36s\n",
      "173:\tlearn: 0.2278286\ttotal: 8.76s\tremaining: 1.31s\n",
      "174:\tlearn: 0.2277263\ttotal: 8.8s\tremaining: 1.26s\n",
      "175:\tlearn: 0.2275403\ttotal: 8.86s\tremaining: 1.21s\n",
      "176:\tlearn: 0.2271400\ttotal: 8.9s\tremaining: 1.16s\n",
      "177:\tlearn: 0.2268774\ttotal: 8.94s\tremaining: 1.1s\n",
      "178:\tlearn: 0.2265708\ttotal: 8.98s\tremaining: 1.05s\n",
      "179:\tlearn: 0.2262290\ttotal: 9.04s\tremaining: 1s\n",
      "180:\tlearn: 0.2259083\ttotal: 9.08s\tremaining: 954ms\n",
      "181:\tlearn: 0.2256612\ttotal: 9.12s\tremaining: 902ms\n",
      "182:\tlearn: 0.2254334\ttotal: 9.16s\tremaining: 851ms\n",
      "183:\tlearn: 0.2251381\ttotal: 9.21s\tremaining: 801ms\n",
      "184:\tlearn: 0.2248683\ttotal: 9.27s\tremaining: 751ms\n",
      "185:\tlearn: 0.2246531\ttotal: 9.32s\tremaining: 702ms\n",
      "186:\tlearn: 0.2243623\ttotal: 9.39s\tremaining: 653ms\n",
      "187:\tlearn: 0.2242871\ttotal: 9.46s\tremaining: 604ms\n",
      "188:\tlearn: 0.2240584\ttotal: 9.5s\tremaining: 553ms\n",
      "189:\tlearn: 0.2238450\ttotal: 9.54s\tremaining: 502ms\n",
      "190:\tlearn: 0.2237094\ttotal: 9.58s\tremaining: 451ms\n",
      "191:\tlearn: 0.2233784\ttotal: 9.65s\tremaining: 402ms\n",
      "192:\tlearn: 0.2230560\ttotal: 9.69s\tremaining: 351ms\n",
      "193:\tlearn: 0.2227906\ttotal: 9.74s\tremaining: 301ms\n",
      "194:\tlearn: 0.2225174\ttotal: 9.85s\tremaining: 252ms\n",
      "195:\tlearn: 0.2222137\ttotal: 9.93s\tremaining: 203ms\n",
      "196:\tlearn: 0.2217799\ttotal: 10.2s\tremaining: 155ms\n",
      "197:\tlearn: 0.2217171\ttotal: 10.3s\tremaining: 104ms\n",
      "198:\tlearn: 0.2213964\ttotal: 10.3s\tremaining: 51.9ms\n",
      "199:\tlearn: 0.2212671\ttotal: 10.4s\tremaining: 0us\n",
      "0:\tlearn: 0.4917298\ttotal: 74.3ms\tremaining: 14.8s\n",
      "1:\tlearn: 0.4102328\ttotal: 109ms\tremaining: 10.8s\n",
      "2:\tlearn: 0.3703447\ttotal: 148ms\tremaining: 9.71s\n",
      "3:\tlearn: 0.3568417\ttotal: 184ms\tremaining: 9.02s\n",
      "4:\tlearn: 0.3414381\ttotal: 235ms\tremaining: 9.15s\n",
      "5:\tlearn: 0.3311381\ttotal: 288ms\tremaining: 9.3s\n",
      "6:\tlearn: 0.3264056\ttotal: 369ms\tremaining: 10.2s\n",
      "7:\tlearn: 0.3226739\ttotal: 443ms\tremaining: 10.6s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "8:\tlearn: 0.3180068\ttotal: 535ms\tremaining: 11.4s\n",
      "9:\tlearn: 0.3148788\ttotal: 651ms\tremaining: 12.4s\n",
      "10:\tlearn: 0.3091801\ttotal: 740ms\tremaining: 12.7s\n",
      "11:\tlearn: 0.3064734\ttotal: 820ms\tremaining: 12.9s\n",
      "12:\tlearn: 0.3023545\ttotal: 903ms\tremaining: 13s\n",
      "13:\tlearn: 0.3001431\ttotal: 977ms\tremaining: 13s\n",
      "14:\tlearn: 0.2985010\ttotal: 1.03s\tremaining: 12.8s\n",
      "15:\tlearn: 0.2971947\ttotal: 1.09s\tremaining: 12.5s\n",
      "16:\tlearn: 0.2958124\ttotal: 1.19s\tremaining: 12.8s\n",
      "17:\tlearn: 0.2948482\ttotal: 1.25s\tremaining: 12.7s\n",
      "18:\tlearn: 0.2941997\ttotal: 1.33s\tremaining: 12.7s\n",
      "19:\tlearn: 0.2923554\ttotal: 1.43s\tremaining: 12.8s\n",
      "20:\tlearn: 0.2916510\ttotal: 1.49s\tremaining: 12.7s\n",
      "21:\tlearn: 0.2881631\ttotal: 1.54s\tremaining: 12.4s\n",
      "22:\tlearn: 0.2866951\ttotal: 1.58s\tremaining: 12.2s\n",
      "23:\tlearn: 0.2860071\ttotal: 1.74s\tremaining: 12.8s\n",
      "24:\tlearn: 0.2852350\ttotal: 1.87s\tremaining: 13.1s\n",
      "25:\tlearn: 0.2848705\ttotal: 1.94s\tremaining: 13s\n",
      "26:\tlearn: 0.2844211\ttotal: 2.03s\tremaining: 13s\n",
      "27:\tlearn: 0.2837306\ttotal: 2.1s\tremaining: 12.9s\n",
      "28:\tlearn: 0.2819126\ttotal: 2.2s\tremaining: 13s\n",
      "29:\tlearn: 0.2814082\ttotal: 2.28s\tremaining: 12.9s\n",
      "30:\tlearn: 0.2808261\ttotal: 2.35s\tremaining: 12.8s\n",
      "31:\tlearn: 0.2804243\ttotal: 2.42s\tremaining: 12.7s\n",
      "32:\tlearn: 0.2795664\ttotal: 2.56s\tremaining: 12.9s\n",
      "33:\tlearn: 0.2790536\ttotal: 2.66s\tremaining: 13s\n",
      "34:\tlearn: 0.2784352\ttotal: 2.72s\tremaining: 12.8s\n",
      "35:\tlearn: 0.2774499\ttotal: 2.82s\tremaining: 12.9s\n",
      "36:\tlearn: 0.2766988\ttotal: 2.9s\tremaining: 12.8s\n",
      "37:\tlearn: 0.2761929\ttotal: 2.95s\tremaining: 12.6s\n",
      "38:\tlearn: 0.2756270\ttotal: 3.04s\tremaining: 12.5s\n",
      "39:\tlearn: 0.2750112\ttotal: 3.13s\tremaining: 12.5s\n",
      "40:\tlearn: 0.2746511\ttotal: 3.23s\tremaining: 12.5s\n",
      "41:\tlearn: 0.2740925\ttotal: 3.31s\tremaining: 12.5s\n",
      "42:\tlearn: 0.2729611\ttotal: 3.39s\tremaining: 12.4s\n",
      "43:\tlearn: 0.2716126\ttotal: 3.48s\tremaining: 12.4s\n",
      "44:\tlearn: 0.2710329\ttotal: 3.62s\tremaining: 12.5s\n",
      "45:\tlearn: 0.2701628\ttotal: 3.75s\tremaining: 12.6s\n",
      "46:\tlearn: 0.2698632\ttotal: 3.88s\tremaining: 12.6s\n",
      "47:\tlearn: 0.2693771\ttotal: 4.08s\tremaining: 12.9s\n",
      "48:\tlearn: 0.2689556\ttotal: 4.16s\tremaining: 12.8s\n",
      "49:\tlearn: 0.2675861\ttotal: 4.2s\tremaining: 12.6s\n",
      "50:\tlearn: 0.2669533\ttotal: 4.25s\tremaining: 12.4s\n",
      "51:\tlearn: 0.2662241\ttotal: 4.3s\tremaining: 12.2s\n",
      "52:\tlearn: 0.2654497\ttotal: 4.36s\tremaining: 12.1s\n",
      "53:\tlearn: 0.2652958\ttotal: 4.39s\tremaining: 11.9s\n",
      "54:\tlearn: 0.2642633\ttotal: 4.44s\tremaining: 11.7s\n",
      "55:\tlearn: 0.2637185\ttotal: 4.48s\tremaining: 11.5s\n",
      "56:\tlearn: 0.2631288\ttotal: 4.54s\tremaining: 11.4s\n",
      "57:\tlearn: 0.2627680\ttotal: 4.6s\tremaining: 11.3s\n",
      "58:\tlearn: 0.2621118\ttotal: 4.71s\tremaining: 11.2s\n",
      "59:\tlearn: 0.2615837\ttotal: 4.82s\tremaining: 11.3s\n",
      "60:\tlearn: 0.2611661\ttotal: 4.89s\tremaining: 11.1s\n",
      "61:\tlearn: 0.2606551\ttotal: 4.95s\tremaining: 11s\n",
      "62:\tlearn: 0.2602628\ttotal: 5.04s\tremaining: 11s\n",
      "63:\tlearn: 0.2598930\ttotal: 5.12s\tremaining: 10.9s\n",
      "64:\tlearn: 0.2594921\ttotal: 5.19s\tremaining: 10.8s\n",
      "65:\tlearn: 0.2590351\ttotal: 5.26s\tremaining: 10.7s\n",
      "66:\tlearn: 0.2585508\ttotal: 5.3s\tremaining: 10.5s\n",
      "67:\tlearn: 0.2579718\ttotal: 5.35s\tremaining: 10.4s\n",
      "68:\tlearn: 0.2574965\ttotal: 5.41s\tremaining: 10.3s\n",
      "69:\tlearn: 0.2573424\ttotal: 5.45s\tremaining: 10.1s\n",
      "70:\tlearn: 0.2570091\ttotal: 5.49s\tremaining: 9.97s\n",
      "71:\tlearn: 0.2563930\ttotal: 5.54s\tremaining: 9.84s\n",
      "72:\tlearn: 0.2559537\ttotal: 5.61s\tremaining: 9.75s\n",
      "73:\tlearn: 0.2556624\ttotal: 5.65s\tremaining: 9.62s\n",
      "74:\tlearn: 0.2553902\ttotal: 5.69s\tremaining: 9.48s\n",
      "75:\tlearn: 0.2548164\ttotal: 5.74s\tremaining: 9.37s\n",
      "76:\tlearn: 0.2544096\ttotal: 5.81s\tremaining: 9.28s\n",
      "77:\tlearn: 0.2538656\ttotal: 5.88s\tremaining: 9.2s\n",
      "78:\tlearn: 0.2536637\ttotal: 5.96s\tremaining: 9.14s\n",
      "79:\tlearn: 0.2534411\ttotal: 6.03s\tremaining: 9.05s\n",
      "80:\tlearn: 0.2530843\ttotal: 6.08s\tremaining: 8.93s\n",
      "81:\tlearn: 0.2528182\ttotal: 6.18s\tremaining: 8.89s\n",
      "82:\tlearn: 0.2525085\ttotal: 6.33s\tremaining: 8.92s\n",
      "83:\tlearn: 0.2521208\ttotal: 6.37s\tremaining: 8.79s\n",
      "84:\tlearn: 0.2518083\ttotal: 6.44s\tremaining: 8.71s\n",
      "85:\tlearn: 0.2514521\ttotal: 6.49s\tremaining: 8.6s\n",
      "86:\tlearn: 0.2511111\ttotal: 6.53s\tremaining: 8.48s\n",
      "87:\tlearn: 0.2508856\ttotal: 6.57s\tremaining: 8.37s\n",
      "88:\tlearn: 0.2505500\ttotal: 6.64s\tremaining: 8.29s\n",
      "89:\tlearn: 0.2502756\ttotal: 6.68s\tremaining: 8.17s\n",
      "90:\tlearn: 0.2501553\ttotal: 6.73s\tremaining: 8.06s\n",
      "91:\tlearn: 0.2496378\ttotal: 6.79s\tremaining: 7.97s\n",
      "92:\tlearn: 0.2492223\ttotal: 6.87s\tremaining: 7.91s\n",
      "93:\tlearn: 0.2487867\ttotal: 6.96s\tremaining: 7.85s\n",
      "94:\tlearn: 0.2484129\ttotal: 7.03s\tremaining: 7.77s\n",
      "95:\tlearn: 0.2480758\ttotal: 7.11s\tremaining: 7.7s\n",
      "96:\tlearn: 0.2477856\ttotal: 7.2s\tremaining: 7.65s\n",
      "97:\tlearn: 0.2474058\ttotal: 7.26s\tremaining: 7.56s\n",
      "98:\tlearn: 0.2471347\ttotal: 7.32s\tremaining: 7.47s\n",
      "99:\tlearn: 0.2466663\ttotal: 7.37s\tremaining: 7.37s\n",
      "100:\tlearn: 0.2463100\ttotal: 7.45s\tremaining: 7.3s\n",
      "101:\tlearn: 0.2462087\ttotal: 7.52s\tremaining: 7.22s\n",
      "102:\tlearn: 0.2458403\ttotal: 7.59s\tremaining: 7.15s\n",
      "103:\tlearn: 0.2455179\ttotal: 7.69s\tremaining: 7.1s\n",
      "104:\tlearn: 0.2451997\ttotal: 7.77s\tremaining: 7.03s\n",
      "105:\tlearn: 0.2450510\ttotal: 7.83s\tremaining: 6.95s\n",
      "106:\tlearn: 0.2448445\ttotal: 7.88s\tremaining: 6.85s\n",
      "107:\tlearn: 0.2443664\ttotal: 7.96s\tremaining: 6.78s\n",
      "108:\tlearn: 0.2440019\ttotal: 8.01s\tremaining: 6.69s\n",
      "109:\tlearn: 0.2436825\ttotal: 8.05s\tremaining: 6.59s\n",
      "110:\tlearn: 0.2433396\ttotal: 8.1s\tremaining: 6.5s\n",
      "111:\tlearn: 0.2430178\ttotal: 8.17s\tremaining: 6.42s\n",
      "112:\tlearn: 0.2428235\ttotal: 8.21s\tremaining: 6.32s\n",
      "113:\tlearn: 0.2425991\ttotal: 8.25s\tremaining: 6.22s\n",
      "114:\tlearn: 0.2424463\ttotal: 8.3s\tremaining: 6.13s\n",
      "115:\tlearn: 0.2421903\ttotal: 8.47s\tremaining: 6.13s\n",
      "116:\tlearn: 0.2418328\ttotal: 8.56s\tremaining: 6.08s\n",
      "117:\tlearn: 0.2415361\ttotal: 8.66s\tremaining: 6.01s\n",
      "118:\tlearn: 0.2412653\ttotal: 8.73s\tremaining: 5.94s\n",
      "119:\tlearn: 0.2410728\ttotal: 8.83s\tremaining: 5.89s\n",
      "120:\tlearn: 0.2407275\ttotal: 8.9s\tremaining: 5.81s\n",
      "121:\tlearn: 0.2403147\ttotal: 8.96s\tremaining: 5.73s\n",
      "122:\tlearn: 0.2399327\ttotal: 9.01s\tremaining: 5.64s\n",
      "123:\tlearn: 0.2396511\ttotal: 9.06s\tremaining: 5.55s\n",
      "124:\tlearn: 0.2394711\ttotal: 9.13s\tremaining: 5.47s\n",
      "125:\tlearn: 0.2392890\ttotal: 9.17s\tremaining: 5.38s\n",
      "126:\tlearn: 0.2389691\ttotal: 9.21s\tremaining: 5.29s\n",
      "127:\tlearn: 0.2388578\ttotal: 9.25s\tremaining: 5.2s\n",
      "128:\tlearn: 0.2385003\ttotal: 9.34s\tremaining: 5.14s\n",
      "129:\tlearn: 0.2383136\ttotal: 9.38s\tremaining: 5.05s\n",
      "130:\tlearn: 0.2381316\ttotal: 9.41s\tremaining: 4.96s\n",
      "131:\tlearn: 0.2378707\ttotal: 9.45s\tremaining: 4.87s\n",
      "132:\tlearn: 0.2376067\ttotal: 9.54s\tremaining: 4.81s\n",
      "133:\tlearn: 0.2372990\ttotal: 9.59s\tremaining: 4.72s\n",
      "134:\tlearn: 0.2370381\ttotal: 9.65s\tremaining: 4.64s\n",
      "135:\tlearn: 0.2369765\ttotal: 9.72s\tremaining: 4.57s\n",
      "136:\tlearn: 0.2368484\ttotal: 9.78s\tremaining: 4.5s\n",
      "137:\tlearn: 0.2366106\ttotal: 9.82s\tremaining: 4.41s\n",
      "138:\tlearn: 0.2362015\ttotal: 9.86s\tremaining: 4.33s\n",
      "139:\tlearn: 0.2358647\ttotal: 9.93s\tremaining: 4.25s\n",
      "140:\tlearn: 0.2355421\ttotal: 9.97s\tremaining: 4.17s\n",
      "141:\tlearn: 0.2353069\ttotal: 10s\tremaining: 4.1s\n",
      "142:\tlearn: 0.2350554\ttotal: 10.1s\tremaining: 4.02s\n",
      "143:\tlearn: 0.2347753\ttotal: 10.2s\tremaining: 3.98s\n",
      "144:\tlearn: 0.2347130\ttotal: 10.3s\tremaining: 3.9s\n",
      "145:\tlearn: 0.2344032\ttotal: 10.3s\tremaining: 3.83s\n",
      "146:\tlearn: 0.2342883\ttotal: 10.4s\tremaining: 3.75s\n",
      "147:\tlearn: 0.2341884\ttotal: 10.4s\tremaining: 3.67s\n",
      "148:\tlearn: 0.2339513\ttotal: 10.5s\tremaining: 3.59s\n",
      "149:\tlearn: 0.2335816\ttotal: 10.6s\tremaining: 3.52s\n",
      "150:\tlearn: 0.2332367\ttotal: 10.8s\tremaining: 3.5s\n",
      "151:\tlearn: 0.2330758\ttotal: 10.9s\tremaining: 3.43s\n",
      "152:\tlearn: 0.2327874\ttotal: 10.9s\tremaining: 3.35s\n",
      "153:\tlearn: 0.2324529\ttotal: 11s\tremaining: 3.28s\n",
      "154:\tlearn: 0.2322266\ttotal: 11.1s\tremaining: 3.21s\n",
      "155:\tlearn: 0.2319653\ttotal: 11.1s\tremaining: 3.14s\n",
      "156:\tlearn: 0.2315521\ttotal: 11.2s\tremaining: 3.06s\n",
      "157:\tlearn: 0.2312866\ttotal: 11.3s\tremaining: 2.99s\n",
      "158:\tlearn: 0.2311561\ttotal: 11.3s\tremaining: 2.91s\n",
      "159:\tlearn: 0.2307979\ttotal: 11.3s\tremaining: 2.83s\n",
      "160:\tlearn: 0.2305032\ttotal: 11.4s\tremaining: 2.75s\n",
      "161:\tlearn: 0.2303924\ttotal: 11.5s\tremaining: 2.69s\n",
      "162:\tlearn: 0.2302347\ttotal: 11.5s\tremaining: 2.61s\n",
      "163:\tlearn: 0.2301459\ttotal: 11.5s\tremaining: 2.53s\n",
      "164:\tlearn: 0.2301388\ttotal: 11.6s\tremaining: 2.46s\n",
      "165:\tlearn: 0.2301320\ttotal: 11.7s\tremaining: 2.4s\n",
      "166:\tlearn: 0.2297158\ttotal: 11.8s\tremaining: 2.33s\n",
      "167:\tlearn: 0.2295384\ttotal: 11.9s\tremaining: 2.26s\n",
      "168:\tlearn: 0.2293266\ttotal: 12s\tremaining: 2.2s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "169:\tlearn: 0.2290105\ttotal: 12.1s\tremaining: 2.14s\n",
      "170:\tlearn: 0.2285586\ttotal: 12.2s\tremaining: 2.08s\n",
      "171:\tlearn: 0.2281991\ttotal: 12.4s\tremaining: 2.02s\n",
      "172:\tlearn: 0.2279406\ttotal: 12.5s\tremaining: 1.95s\n",
      "173:\tlearn: 0.2276911\ttotal: 12.6s\tremaining: 1.89s\n",
      "174:\tlearn: 0.2275774\ttotal: 12.7s\tremaining: 1.82s\n",
      "175:\tlearn: 0.2273200\ttotal: 12.8s\tremaining: 1.75s\n",
      "176:\tlearn: 0.2270139\ttotal: 13s\tremaining: 1.69s\n",
      "177:\tlearn: 0.2267032\ttotal: 13.1s\tremaining: 1.62s\n",
      "178:\tlearn: 0.2264038\ttotal: 13.2s\tremaining: 1.55s\n",
      "179:\tlearn: 0.2261705\ttotal: 13.3s\tremaining: 1.48s\n",
      "180:\tlearn: 0.2259577\ttotal: 13.4s\tremaining: 1.4s\n",
      "181:\tlearn: 0.2256149\ttotal: 13.4s\tremaining: 1.32s\n",
      "182:\tlearn: 0.2254915\ttotal: 13.5s\tremaining: 1.25s\n",
      "183:\tlearn: 0.2253312\ttotal: 13.5s\tremaining: 1.18s\n",
      "184:\tlearn: 0.2251864\ttotal: 13.6s\tremaining: 1.1s\n",
      "185:\tlearn: 0.2250303\ttotal: 13.7s\tremaining: 1.03s\n",
      "186:\tlearn: 0.2248906\ttotal: 13.7s\tremaining: 955ms\n",
      "187:\tlearn: 0.2246735\ttotal: 13.9s\tremaining: 886ms\n",
      "188:\tlearn: 0.2244055\ttotal: 14s\tremaining: 814ms\n",
      "189:\tlearn: 0.2241687\ttotal: 14s\tremaining: 739ms\n",
      "190:\tlearn: 0.2240734\ttotal: 14.1s\tremaining: 665ms\n",
      "191:\tlearn: 0.2237139\ttotal: 14.2s\tremaining: 591ms\n",
      "192:\tlearn: 0.2235032\ttotal: 14.2s\tremaining: 516ms\n",
      "193:\tlearn: 0.2233232\ttotal: 14.3s\tremaining: 442ms\n",
      "194:\tlearn: 0.2232085\ttotal: 14.4s\tremaining: 368ms\n",
      "195:\tlearn: 0.2228916\ttotal: 14.4s\tremaining: 294ms\n",
      "196:\tlearn: 0.2227447\ttotal: 14.5s\tremaining: 220ms\n",
      "197:\tlearn: 0.2224800\ttotal: 14.5s\tremaining: 147ms\n",
      "198:\tlearn: 0.2224030\ttotal: 14.6s\tremaining: 73.2ms\n",
      "199:\tlearn: 0.2221522\ttotal: 14.6s\tremaining: 0us\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "0.896072019379617"
      ]
     },
     "execution_count": 79,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Cross Validated precision\n",
    "cv_prec = cross_val_score(best_model,\n",
    "                        X,\n",
    "                        y,\n",
    "                        cv=5,\n",
    "                        scoring='precision')\n",
    "cv_prec_mean = np.mean(cv_prec)\n",
    "cv_prec_mean"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 80,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0:\tlearn: 0.4910390\ttotal: 70.4ms\tremaining: 14s\n",
      "1:\tlearn: 0.4094957\ttotal: 423ms\tremaining: 41.9s\n",
      "2:\tlearn: 0.3694131\ttotal: 597ms\tremaining: 39.2s\n",
      "3:\tlearn: 0.3505391\ttotal: 689ms\tremaining: 33.8s\n",
      "4:\tlearn: 0.3391372\ttotal: 758ms\tremaining: 29.6s\n",
      "5:\tlearn: 0.3327239\ttotal: 871ms\tremaining: 28.2s\n",
      "6:\tlearn: 0.3262649\ttotal: 929ms\tremaining: 25.6s\n",
      "7:\tlearn: 0.3187783\ttotal: 1.01s\tremaining: 24.2s\n",
      "8:\tlearn: 0.3136945\ttotal: 1.06s\tremaining: 22.5s\n",
      "9:\tlearn: 0.3113021\ttotal: 1.11s\tremaining: 21s\n",
      "10:\tlearn: 0.3081480\ttotal: 1.16s\tremaining: 19.9s\n",
      "11:\tlearn: 0.3056354\ttotal: 1.24s\tremaining: 19.4s\n",
      "12:\tlearn: 0.3020594\ttotal: 1.28s\tremaining: 18.4s\n",
      "13:\tlearn: 0.2993112\ttotal: 1.32s\tremaining: 17.5s\n",
      "14:\tlearn: 0.2973829\ttotal: 1.35s\tremaining: 16.7s\n",
      "15:\tlearn: 0.2934693\ttotal: 1.43s\tremaining: 16.5s\n",
      "16:\tlearn: 0.2924421\ttotal: 1.48s\tremaining: 15.9s\n",
      "17:\tlearn: 0.2915134\ttotal: 1.52s\tremaining: 15.3s\n",
      "18:\tlearn: 0.2903485\ttotal: 1.56s\tremaining: 14.8s\n",
      "19:\tlearn: 0.2896061\ttotal: 1.63s\tremaining: 14.6s\n",
      "20:\tlearn: 0.2890050\ttotal: 1.67s\tremaining: 14.3s\n",
      "21:\tlearn: 0.2882568\ttotal: 1.71s\tremaining: 13.8s\n",
      "22:\tlearn: 0.2875332\ttotal: 1.75s\tremaining: 13.5s\n",
      "23:\tlearn: 0.2857290\ttotal: 1.82s\tremaining: 13.3s\n",
      "24:\tlearn: 0.2850522\ttotal: 1.86s\tremaining: 13.1s\n",
      "25:\tlearn: 0.2838251\ttotal: 1.9s\tremaining: 12.7s\n",
      "26:\tlearn: 0.2818143\ttotal: 1.94s\tremaining: 12.4s\n",
      "27:\tlearn: 0.2810609\ttotal: 2.03s\tremaining: 12.5s\n",
      "28:\tlearn: 0.2805953\ttotal: 2.07s\tremaining: 12.2s\n",
      "29:\tlearn: 0.2795593\ttotal: 2.11s\tremaining: 12s\n",
      "30:\tlearn: 0.2785583\ttotal: 2.19s\tremaining: 11.9s\n",
      "31:\tlearn: 0.2775374\ttotal: 2.28s\tremaining: 12s\n",
      "32:\tlearn: 0.2769544\ttotal: 2.32s\tremaining: 11.7s\n",
      "33:\tlearn: 0.2762143\ttotal: 2.37s\tremaining: 11.6s\n",
      "34:\tlearn: 0.2757283\ttotal: 2.53s\tremaining: 11.9s\n",
      "35:\tlearn: 0.2751014\ttotal: 2.58s\tremaining: 11.8s\n",
      "36:\tlearn: 0.2742580\ttotal: 2.66s\tremaining: 11.7s\n",
      "37:\tlearn: 0.2735819\ttotal: 2.7s\tremaining: 11.5s\n",
      "38:\tlearn: 0.2725745\ttotal: 2.75s\tremaining: 11.3s\n",
      "39:\tlearn: 0.2717464\ttotal: 2.81s\tremaining: 11.2s\n",
      "40:\tlearn: 0.2712371\ttotal: 2.88s\tremaining: 11.2s\n",
      "41:\tlearn: 0.2708447\ttotal: 2.99s\tremaining: 11.3s\n",
      "42:\tlearn: 0.2703224\ttotal: 3.07s\tremaining: 11.2s\n",
      "43:\tlearn: 0.2696397\ttotal: 3.15s\tremaining: 11.2s\n",
      "44:\tlearn: 0.2690909\ttotal: 3.3s\tremaining: 11.4s\n",
      "45:\tlearn: 0.2682967\ttotal: 3.35s\tremaining: 11.2s\n",
      "46:\tlearn: 0.2679382\ttotal: 3.42s\tremaining: 11.1s\n",
      "47:\tlearn: 0.2677047\ttotal: 3.53s\tremaining: 11.2s\n",
      "48:\tlearn: 0.2673390\ttotal: 3.58s\tremaining: 11s\n",
      "49:\tlearn: 0.2667281\ttotal: 3.65s\tremaining: 11s\n",
      "50:\tlearn: 0.2660764\ttotal: 3.72s\tremaining: 10.9s\n",
      "51:\tlearn: 0.2653754\ttotal: 3.79s\tremaining: 10.8s\n",
      "52:\tlearn: 0.2650464\ttotal: 3.87s\tremaining: 10.7s\n",
      "53:\tlearn: 0.2648876\ttotal: 3.95s\tremaining: 10.7s\n",
      "54:\tlearn: 0.2644577\ttotal: 4.02s\tremaining: 10.6s\n",
      "55:\tlearn: 0.2639544\ttotal: 4.08s\tremaining: 10.5s\n",
      "56:\tlearn: 0.2635208\ttotal: 4.14s\tremaining: 10.4s\n",
      "57:\tlearn: 0.2630010\ttotal: 4.23s\tremaining: 10.3s\n",
      "58:\tlearn: 0.2623645\ttotal: 4.32s\tremaining: 10.3s\n",
      "59:\tlearn: 0.2618230\ttotal: 4.41s\tremaining: 10.3s\n",
      "60:\tlearn: 0.2615054\ttotal: 4.5s\tremaining: 10.2s\n",
      "61:\tlearn: 0.2613269\ttotal: 4.75s\tremaining: 10.6s\n",
      "62:\tlearn: 0.2608481\ttotal: 4.85s\tremaining: 10.6s\n",
      "63:\tlearn: 0.2606736\ttotal: 4.97s\tremaining: 10.6s\n",
      "64:\tlearn: 0.2601501\ttotal: 5.04s\tremaining: 10.5s\n",
      "65:\tlearn: 0.2599332\ttotal: 5.09s\tremaining: 10.3s\n",
      "66:\tlearn: 0.2594212\ttotal: 5.15s\tremaining: 10.2s\n",
      "67:\tlearn: 0.2592048\ttotal: 5.23s\tremaining: 10.1s\n",
      "68:\tlearn: 0.2585311\ttotal: 5.29s\tremaining: 10s\n",
      "69:\tlearn: 0.2581389\ttotal: 5.4s\tremaining: 10s\n",
      "70:\tlearn: 0.2576641\ttotal: 5.49s\tremaining: 9.98s\n",
      "71:\tlearn: 0.2571270\ttotal: 5.59s\tremaining: 9.94s\n",
      "72:\tlearn: 0.2569060\ttotal: 5.67s\tremaining: 9.87s\n",
      "73:\tlearn: 0.2563899\ttotal: 5.73s\tremaining: 9.76s\n",
      "74:\tlearn: 0.2559528\ttotal: 5.78s\tremaining: 9.63s\n",
      "75:\tlearn: 0.2554732\ttotal: 5.85s\tremaining: 9.54s\n",
      "76:\tlearn: 0.2550620\ttotal: 5.92s\tremaining: 9.45s\n",
      "77:\tlearn: 0.2544463\ttotal: 5.97s\tremaining: 9.34s\n",
      "78:\tlearn: 0.2541464\ttotal: 6.08s\tremaining: 9.31s\n",
      "79:\tlearn: 0.2536836\ttotal: 6.21s\tremaining: 9.31s\n",
      "80:\tlearn: 0.2533178\ttotal: 6.27s\tremaining: 9.22s\n",
      "81:\tlearn: 0.2528747\ttotal: 6.35s\tremaining: 9.13s\n",
      "82:\tlearn: 0.2526583\ttotal: 6.43s\tremaining: 9.06s\n",
      "83:\tlearn: 0.2524395\ttotal: 6.49s\tremaining: 8.96s\n",
      "84:\tlearn: 0.2520651\ttotal: 6.57s\tremaining: 8.88s\n",
      "85:\tlearn: 0.2516639\ttotal: 6.62s\tremaining: 8.77s\n",
      "86:\tlearn: 0.2514801\ttotal: 6.68s\tremaining: 8.68s\n",
      "87:\tlearn: 0.2513549\ttotal: 6.76s\tremaining: 8.6s\n",
      "88:\tlearn: 0.2508232\ttotal: 6.95s\tremaining: 8.66s\n",
      "89:\tlearn: 0.2506792\ttotal: 7.03s\tremaining: 8.6s\n",
      "90:\tlearn: 0.2502898\ttotal: 7.13s\tremaining: 8.54s\n",
      "91:\tlearn: 0.2501274\ttotal: 7.21s\tremaining: 8.46s\n",
      "92:\tlearn: 0.2498113\ttotal: 7.29s\tremaining: 8.38s\n",
      "93:\tlearn: 0.2494608\ttotal: 7.36s\tremaining: 8.29s\n",
      "94:\tlearn: 0.2490959\ttotal: 7.43s\tremaining: 8.21s\n",
      "95:\tlearn: 0.2489713\ttotal: 7.49s\tremaining: 8.11s\n",
      "96:\tlearn: 0.2485235\ttotal: 7.54s\tremaining: 8.01s\n",
      "97:\tlearn: 0.2480601\ttotal: 7.63s\tremaining: 7.94s\n",
      "98:\tlearn: 0.2475354\ttotal: 7.7s\tremaining: 7.86s\n",
      "99:\tlearn: 0.2470517\ttotal: 7.81s\tremaining: 7.81s\n",
      "100:\tlearn: 0.2465217\ttotal: 7.89s\tremaining: 7.73s\n",
      "101:\tlearn: 0.2462395\ttotal: 7.95s\tremaining: 7.64s\n",
      "102:\tlearn: 0.2458358\ttotal: 8.02s\tremaining: 7.55s\n",
      "103:\tlearn: 0.2455335\ttotal: 8.11s\tremaining: 7.48s\n",
      "104:\tlearn: 0.2451756\ttotal: 8.16s\tremaining: 7.38s\n",
      "105:\tlearn: 0.2448174\ttotal: 8.22s\tremaining: 7.29s\n",
      "106:\tlearn: 0.2445567\ttotal: 8.3s\tremaining: 7.21s\n",
      "107:\tlearn: 0.2443596\ttotal: 8.35s\tremaining: 7.12s\n",
      "108:\tlearn: 0.2439081\ttotal: 8.39s\tremaining: 7.01s\n",
      "109:\tlearn: 0.2434848\ttotal: 8.44s\tremaining: 6.91s\n",
      "110:\tlearn: 0.2432248\ttotal: 8.51s\tremaining: 6.83s\n",
      "111:\tlearn: 0.2430648\ttotal: 8.57s\tremaining: 6.73s\n",
      "112:\tlearn: 0.2429844\ttotal: 8.65s\tremaining: 6.66s\n",
      "113:\tlearn: 0.2426978\ttotal: 8.72s\tremaining: 6.58s\n",
      "114:\tlearn: 0.2425858\ttotal: 8.78s\tremaining: 6.49s\n",
      "115:\tlearn: 0.2422130\ttotal: 8.84s\tremaining: 6.4s\n",
      "116:\tlearn: 0.2417006\ttotal: 8.91s\tremaining: 6.32s\n",
      "117:\tlearn: 0.2414430\ttotal: 8.98s\tremaining: 6.24s\n",
      "118:\tlearn: 0.2411022\ttotal: 9.21s\tremaining: 6.26s\n",
      "119:\tlearn: 0.2403800\ttotal: 9.29s\tremaining: 6.2s\n",
      "120:\tlearn: 0.2400258\ttotal: 9.33s\tremaining: 6.09s\n",
      "121:\tlearn: 0.2396878\ttotal: 9.37s\tremaining: 5.99s\n",
      "122:\tlearn: 0.2394415\ttotal: 9.41s\tremaining: 5.89s\n",
      "123:\tlearn: 0.2390072\ttotal: 9.48s\tremaining: 5.81s\n",
      "124:\tlearn: 0.2387689\ttotal: 9.52s\tremaining: 5.71s\n",
      "125:\tlearn: 0.2384445\ttotal: 9.56s\tremaining: 5.62s\n",
      "126:\tlearn: 0.2381465\ttotal: 9.6s\tremaining: 5.52s\n",
      "127:\tlearn: 0.2378007\ttotal: 9.67s\tremaining: 5.44s\n",
      "128:\tlearn: 0.2374913\ttotal: 9.71s\tremaining: 5.34s\n",
      "129:\tlearn: 0.2372241\ttotal: 9.75s\tremaining: 5.25s\n",
      "130:\tlearn: 0.2369136\ttotal: 9.79s\tremaining: 5.15s\n",
      "131:\tlearn: 0.2367420\ttotal: 9.85s\tremaining: 5.07s\n",
      "132:\tlearn: 0.2364224\ttotal: 9.89s\tremaining: 4.98s\n",
      "133:\tlearn: 0.2362696\ttotal: 9.94s\tremaining: 4.89s\n",
      "134:\tlearn: 0.2358998\ttotal: 9.98s\tremaining: 4.8s\n",
      "135:\tlearn: 0.2355574\ttotal: 10.1s\tremaining: 4.73s\n",
      "136:\tlearn: 0.2351997\ttotal: 10.1s\tremaining: 4.64s\n",
      "137:\tlearn: 0.2349023\ttotal: 10.1s\tremaining: 4.55s\n",
      "138:\tlearn: 0.2345666\ttotal: 10.2s\tremaining: 4.46s\n",
      "139:\tlearn: 0.2344306\ttotal: 10.2s\tremaining: 4.39s\n",
      "140:\tlearn: 0.2341253\ttotal: 10.3s\tremaining: 4.3s\n",
      "141:\tlearn: 0.2339600\ttotal: 10.3s\tremaining: 4.22s\n",
      "142:\tlearn: 0.2336109\ttotal: 10.4s\tremaining: 4.13s\n",
      "143:\tlearn: 0.2335354\ttotal: 10.4s\tremaining: 4.05s\n",
      "144:\tlearn: 0.2332019\ttotal: 10.5s\tremaining: 3.97s\n",
      "145:\tlearn: 0.2330839\ttotal: 10.5s\tremaining: 3.89s\n",
      "146:\tlearn: 0.2328308\ttotal: 10.5s\tremaining: 3.8s\n",
      "147:\tlearn: 0.2327493\ttotal: 10.6s\tremaining: 3.73s\n",
      "148:\tlearn: 0.2324452\ttotal: 10.7s\tremaining: 3.65s\n",
      "149:\tlearn: 0.2323056\ttotal: 10.7s\tremaining: 3.56s\n",
      "150:\tlearn: 0.2320540\ttotal: 10.7s\tremaining: 3.48s\n",
      "151:\tlearn: 0.2317048\ttotal: 10.8s\tremaining: 3.41s\n",
      "152:\tlearn: 0.2314122\ttotal: 10.8s\tremaining: 3.33s\n",
      "153:\tlearn: 0.2309981\ttotal: 10.9s\tremaining: 3.25s\n",
      "154:\tlearn: 0.2306700\ttotal: 11s\tremaining: 3.19s\n",
      "155:\tlearn: 0.2302911\ttotal: 11.1s\tremaining: 3.12s\n",
      "156:\tlearn: 0.2301412\ttotal: 11.1s\tremaining: 3.05s\n",
      "157:\tlearn: 0.2298899\ttotal: 11.4s\tremaining: 3.02s\n",
      "158:\tlearn: 0.2295007\ttotal: 11.5s\tremaining: 2.97s\n",
      "159:\tlearn: 0.2293104\ttotal: 11.6s\tremaining: 2.91s\n",
      "160:\tlearn: 0.2292694\ttotal: 11.8s\tremaining: 2.85s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "161:\tlearn: 0.2290253\ttotal: 11.9s\tremaining: 2.79s\n",
      "162:\tlearn: 0.2288107\ttotal: 12s\tremaining: 2.72s\n",
      "163:\tlearn: 0.2285343\ttotal: 12.1s\tremaining: 2.65s\n",
      "164:\tlearn: 0.2284223\ttotal: 12.2s\tremaining: 2.58s\n",
      "165:\tlearn: 0.2281667\ttotal: 12.2s\tremaining: 2.51s\n",
      "166:\tlearn: 0.2278998\ttotal: 12.4s\tremaining: 2.45s\n",
      "167:\tlearn: 0.2275107\ttotal: 12.5s\tremaining: 2.38s\n",
      "168:\tlearn: 0.2272013\ttotal: 12.5s\tremaining: 2.3s\n",
      "169:\tlearn: 0.2270592\ttotal: 12.6s\tremaining: 2.22s\n",
      "170:\tlearn: 0.2269358\ttotal: 12.7s\tremaining: 2.15s\n",
      "171:\tlearn: 0.2266104\ttotal: 12.7s\tremaining: 2.08s\n",
      "172:\tlearn: 0.2263648\ttotal: 12.8s\tremaining: 2s\n",
      "173:\tlearn: 0.2261102\ttotal: 12.8s\tremaining: 1.92s\n",
      "174:\tlearn: 0.2258385\ttotal: 12.9s\tremaining: 1.84s\n",
      "175:\tlearn: 0.2255843\ttotal: 13s\tremaining: 1.77s\n",
      "176:\tlearn: 0.2252919\ttotal: 13s\tremaining: 1.69s\n",
      "177:\tlearn: 0.2250407\ttotal: 13s\tremaining: 1.61s\n",
      "178:\tlearn: 0.2247510\ttotal: 13.1s\tremaining: 1.53s\n",
      "179:\tlearn: 0.2244622\ttotal: 13.2s\tremaining: 1.46s\n",
      "180:\tlearn: 0.2243807\ttotal: 13.2s\tremaining: 1.39s\n",
      "181:\tlearn: 0.2243464\ttotal: 13.2s\tremaining: 1.31s\n",
      "182:\tlearn: 0.2242004\ttotal: 13.3s\tremaining: 1.23s\n",
      "183:\tlearn: 0.2239257\ttotal: 13.3s\tremaining: 1.16s\n",
      "184:\tlearn: 0.2238702\ttotal: 13.4s\tremaining: 1.08s\n",
      "185:\tlearn: 0.2235913\ttotal: 13.4s\tremaining: 1.01s\n",
      "186:\tlearn: 0.2233530\ttotal: 13.5s\tremaining: 936ms\n",
      "187:\tlearn: 0.2231426\ttotal: 13.5s\tremaining: 864ms\n",
      "188:\tlearn: 0.2231138\ttotal: 13.7s\tremaining: 794ms\n",
      "189:\tlearn: 0.2227511\ttotal: 13.8s\tremaining: 724ms\n",
      "190:\tlearn: 0.2223536\ttotal: 13.8s\tremaining: 651ms\n",
      "191:\tlearn: 0.2221296\ttotal: 13.9s\tremaining: 578ms\n",
      "192:\tlearn: 0.2219507\ttotal: 13.9s\tremaining: 504ms\n",
      "193:\tlearn: 0.2217029\ttotal: 13.9s\tremaining: 431ms\n",
      "194:\tlearn: 0.2214195\ttotal: 14s\tremaining: 359ms\n",
      "195:\tlearn: 0.2211347\ttotal: 14.1s\tremaining: 287ms\n",
      "196:\tlearn: 0.2210406\ttotal: 14.1s\tremaining: 215ms\n",
      "197:\tlearn: 0.2208029\ttotal: 14.1s\tremaining: 143ms\n",
      "198:\tlearn: 0.2205557\ttotal: 14.2s\tremaining: 71.3ms\n",
      "199:\tlearn: 0.2204761\ttotal: 14.2s\tremaining: 0us\n",
      "0:\tlearn: 0.4890502\ttotal: 56.5ms\tremaining: 11.2s\n",
      "1:\tlearn: 0.4065357\ttotal: 153ms\tremaining: 15.2s\n",
      "2:\tlearn: 0.3695467\ttotal: 241ms\tremaining: 15.8s\n",
      "3:\tlearn: 0.3539389\ttotal: 319ms\tremaining: 15.6s\n",
      "4:\tlearn: 0.3424754\ttotal: 383ms\tremaining: 14.9s\n",
      "5:\tlearn: 0.3330650\ttotal: 439ms\tremaining: 14.2s\n",
      "6:\tlearn: 0.3237089\ttotal: 509ms\tremaining: 14s\n",
      "7:\tlearn: 0.3182396\ttotal: 553ms\tremaining: 13.3s\n",
      "8:\tlearn: 0.3143113\ttotal: 603ms\tremaining: 12.8s\n",
      "9:\tlearn: 0.3074310\ttotal: 674ms\tremaining: 12.8s\n",
      "10:\tlearn: 0.3052278\ttotal: 734ms\tremaining: 12.6s\n",
      "11:\tlearn: 0.3019601\ttotal: 794ms\tremaining: 12.4s\n",
      "12:\tlearn: 0.2995476\ttotal: 843ms\tremaining: 12.1s\n",
      "13:\tlearn: 0.2982782\ttotal: 890ms\tremaining: 11.8s\n",
      "14:\tlearn: 0.2971409\ttotal: 967ms\tremaining: 11.9s\n",
      "15:\tlearn: 0.2958994\ttotal: 1.06s\tremaining: 12.2s\n",
      "16:\tlearn: 0.2941196\ttotal: 1.12s\tremaining: 12.1s\n",
      "17:\tlearn: 0.2925659\ttotal: 1.32s\tremaining: 13.4s\n",
      "18:\tlearn: 0.2884236\ttotal: 1.4s\tremaining: 13.3s\n",
      "19:\tlearn: 0.2873662\ttotal: 1.47s\tremaining: 13.2s\n",
      "20:\tlearn: 0.2867908\ttotal: 1.52s\tremaining: 12.9s\n",
      "21:\tlearn: 0.2859630\ttotal: 1.59s\tremaining: 12.9s\n",
      "22:\tlearn: 0.2844540\ttotal: 1.65s\tremaining: 12.7s\n",
      "23:\tlearn: 0.2833664\ttotal: 1.7s\tremaining: 12.5s\n",
      "24:\tlearn: 0.2829578\ttotal: 1.79s\tremaining: 12.5s\n",
      "25:\tlearn: 0.2820594\ttotal: 1.87s\tremaining: 12.5s\n",
      "26:\tlearn: 0.2813476\ttotal: 1.93s\tremaining: 12.3s\n",
      "27:\tlearn: 0.2804058\ttotal: 1.99s\tremaining: 12.2s\n",
      "28:\tlearn: 0.2800862\ttotal: 2.08s\tremaining: 12.3s\n",
      "29:\tlearn: 0.2790213\ttotal: 2.15s\tremaining: 12.2s\n",
      "30:\tlearn: 0.2784915\ttotal: 2.23s\tremaining: 12.2s\n",
      "31:\tlearn: 0.2781184\ttotal: 2.29s\tremaining: 12s\n",
      "32:\tlearn: 0.2774706\ttotal: 2.41s\tremaining: 12.2s\n",
      "33:\tlearn: 0.2769830\ttotal: 2.53s\tremaining: 12.4s\n",
      "34:\tlearn: 0.2765610\ttotal: 2.58s\tremaining: 12.2s\n",
      "35:\tlearn: 0.2759578\ttotal: 2.65s\tremaining: 12.1s\n",
      "36:\tlearn: 0.2753296\ttotal: 2.7s\tremaining: 11.9s\n",
      "37:\tlearn: 0.2745335\ttotal: 2.76s\tremaining: 11.8s\n",
      "38:\tlearn: 0.2739600\ttotal: 2.83s\tremaining: 11.7s\n",
      "39:\tlearn: 0.2735087\ttotal: 2.87s\tremaining: 11.5s\n",
      "40:\tlearn: 0.2724216\ttotal: 2.93s\tremaining: 11.4s\n",
      "41:\tlearn: 0.2723521\ttotal: 3s\tremaining: 11.3s\n",
      "42:\tlearn: 0.2715928\ttotal: 3.06s\tremaining: 11.2s\n",
      "43:\tlearn: 0.2709497\ttotal: 3.11s\tremaining: 11s\n",
      "44:\tlearn: 0.2703100\ttotal: 3.15s\tremaining: 10.8s\n",
      "45:\tlearn: 0.2695307\ttotal: 3.19s\tremaining: 10.7s\n",
      "46:\tlearn: 0.2688942\ttotal: 3.25s\tremaining: 10.6s\n",
      "47:\tlearn: 0.2681200\ttotal: 3.29s\tremaining: 10.4s\n",
      "48:\tlearn: 0.2676686\ttotal: 3.35s\tremaining: 10.3s\n",
      "49:\tlearn: 0.2669230\ttotal: 3.41s\tremaining: 10.2s\n",
      "50:\tlearn: 0.2663142\ttotal: 3.6s\tremaining: 10.5s\n",
      "51:\tlearn: 0.2658611\ttotal: 3.66s\tremaining: 10.4s\n",
      "52:\tlearn: 0.2655697\ttotal: 3.71s\tremaining: 10.3s\n",
      "53:\tlearn: 0.2652779\ttotal: 3.76s\tremaining: 10.2s\n",
      "54:\tlearn: 0.2650319\ttotal: 3.8s\tremaining: 10s\n",
      "55:\tlearn: 0.2645317\ttotal: 3.84s\tremaining: 9.88s\n",
      "56:\tlearn: 0.2642273\ttotal: 3.92s\tremaining: 9.84s\n",
      "57:\tlearn: 0.2637379\ttotal: 3.97s\tremaining: 9.72s\n",
      "58:\tlearn: 0.2631261\ttotal: 4.04s\tremaining: 9.66s\n",
      "59:\tlearn: 0.2624877\ttotal: 4.11s\tremaining: 9.59s\n",
      "60:\tlearn: 0.2620016\ttotal: 4.17s\tremaining: 9.49s\n",
      "61:\tlearn: 0.2615522\ttotal: 4.21s\tremaining: 9.36s\n",
      "62:\tlearn: 0.2612598\ttotal: 4.25s\tremaining: 9.24s\n",
      "63:\tlearn: 0.2609154\ttotal: 4.32s\tremaining: 9.17s\n",
      "64:\tlearn: 0.2605782\ttotal: 4.36s\tremaining: 9.05s\n",
      "65:\tlearn: 0.2602267\ttotal: 4.4s\tremaining: 8.93s\n",
      "66:\tlearn: 0.2601397\ttotal: 4.45s\tremaining: 8.83s\n",
      "67:\tlearn: 0.2590525\ttotal: 4.53s\tremaining: 8.8s\n",
      "68:\tlearn: 0.2586171\ttotal: 4.63s\tremaining: 8.79s\n",
      "69:\tlearn: 0.2579246\ttotal: 4.74s\tremaining: 8.81s\n",
      "70:\tlearn: 0.2575056\ttotal: 4.79s\tremaining: 8.71s\n",
      "71:\tlearn: 0.2570127\ttotal: 4.83s\tremaining: 8.59s\n",
      "72:\tlearn: 0.2566638\ttotal: 4.87s\tremaining: 8.47s\n",
      "73:\tlearn: 0.2565051\ttotal: 4.91s\tremaining: 8.36s\n",
      "74:\tlearn: 0.2561494\ttotal: 4.95s\tremaining: 8.26s\n",
      "75:\tlearn: 0.2558822\ttotal: 5.01s\tremaining: 8.17s\n",
      "76:\tlearn: 0.2555268\ttotal: 5.06s\tremaining: 8.09s\n",
      "77:\tlearn: 0.2551042\ttotal: 5.11s\tremaining: 7.99s\n",
      "78:\tlearn: 0.2548623\ttotal: 5.15s\tremaining: 7.89s\n",
      "79:\tlearn: 0.2546431\ttotal: 5.22s\tremaining: 7.83s\n",
      "80:\tlearn: 0.2544248\ttotal: 5.26s\tremaining: 7.72s\n",
      "81:\tlearn: 0.2538896\ttotal: 5.3s\tremaining: 7.62s\n",
      "82:\tlearn: 0.2536727\ttotal: 5.34s\tremaining: 7.53s\n",
      "83:\tlearn: 0.2532410\ttotal: 5.42s\tremaining: 7.48s\n",
      "84:\tlearn: 0.2527357\ttotal: 5.46s\tremaining: 7.38s\n",
      "85:\tlearn: 0.2525648\ttotal: 5.51s\tremaining: 7.3s\n",
      "86:\tlearn: 0.2522336\ttotal: 5.56s\tremaining: 7.22s\n",
      "87:\tlearn: 0.2518509\ttotal: 5.68s\tremaining: 7.23s\n",
      "88:\tlearn: 0.2513285\ttotal: 5.82s\tremaining: 7.26s\n",
      "89:\tlearn: 0.2507566\ttotal: 5.87s\tremaining: 7.17s\n",
      "90:\tlearn: 0.2504325\ttotal: 5.92s\tremaining: 7.09s\n",
      "91:\tlearn: 0.2502066\ttotal: 5.96s\tremaining: 7s\n",
      "92:\tlearn: 0.2500442\ttotal: 6.01s\tremaining: 6.92s\n",
      "93:\tlearn: 0.2495353\ttotal: 6.07s\tremaining: 6.85s\n",
      "94:\tlearn: 0.2493301\ttotal: 6.12s\tremaining: 6.76s\n",
      "95:\tlearn: 0.2488095\ttotal: 6.17s\tremaining: 6.69s\n",
      "96:\tlearn: 0.2484419\ttotal: 6.21s\tremaining: 6.6s\n",
      "97:\tlearn: 0.2480089\ttotal: 6.28s\tremaining: 6.54s\n",
      "98:\tlearn: 0.2477222\ttotal: 6.32s\tremaining: 6.45s\n",
      "99:\tlearn: 0.2475948\ttotal: 6.36s\tremaining: 6.36s\n",
      "100:\tlearn: 0.2473987\ttotal: 6.4s\tremaining: 6.28s\n",
      "101:\tlearn: 0.2471946\ttotal: 6.47s\tremaining: 6.22s\n",
      "102:\tlearn: 0.2470436\ttotal: 6.52s\tremaining: 6.14s\n",
      "103:\tlearn: 0.2467856\ttotal: 6.57s\tremaining: 6.06s\n",
      "104:\tlearn: 0.2465686\ttotal: 6.62s\tremaining: 5.99s\n",
      "105:\tlearn: 0.2462952\ttotal: 6.68s\tremaining: 5.92s\n",
      "106:\tlearn: 0.2459949\ttotal: 6.72s\tremaining: 5.84s\n",
      "107:\tlearn: 0.2455428\ttotal: 6.76s\tremaining: 5.76s\n",
      "108:\tlearn: 0.2452547\ttotal: 6.8s\tremaining: 5.67s\n",
      "109:\tlearn: 0.2448829\ttotal: 6.85s\tremaining: 5.6s\n",
      "110:\tlearn: 0.2444251\ttotal: 6.9s\tremaining: 5.53s\n",
      "111:\tlearn: 0.2442843\ttotal: 6.94s\tremaining: 5.45s\n",
      "112:\tlearn: 0.2437936\ttotal: 6.98s\tremaining: 5.38s\n",
      "113:\tlearn: 0.2434952\ttotal: 7.03s\tremaining: 5.3s\n",
      "114:\tlearn: 0.2433109\ttotal: 7.09s\tremaining: 5.24s\n",
      "115:\tlearn: 0.2431769\ttotal: 7.14s\tremaining: 5.17s\n",
      "116:\tlearn: 0.2429923\ttotal: 7.18s\tremaining: 5.09s\n",
      "117:\tlearn: 0.2428818\ttotal: 7.23s\tremaining: 5.02s\n",
      "118:\tlearn: 0.2425887\ttotal: 7.29s\tremaining: 4.97s\n",
      "119:\tlearn: 0.2421810\ttotal: 7.33s\tremaining: 4.89s\n",
      "120:\tlearn: 0.2418144\ttotal: 7.37s\tremaining: 4.81s\n",
      "121:\tlearn: 0.2415742\ttotal: 7.42s\tremaining: 4.74s\n",
      "122:\tlearn: 0.2414818\ttotal: 7.46s\tremaining: 4.67s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "123:\tlearn: 0.2411942\ttotal: 7.56s\tremaining: 4.63s\n",
      "124:\tlearn: 0.2408634\ttotal: 7.64s\tremaining: 4.58s\n",
      "125:\tlearn: 0.2407461\ttotal: 7.7s\tremaining: 4.52s\n",
      "126:\tlearn: 0.2404338\ttotal: 7.75s\tremaining: 4.45s\n",
      "127:\tlearn: 0.2400488\ttotal: 7.81s\tremaining: 4.39s\n",
      "128:\tlearn: 0.2396984\ttotal: 8s\tremaining: 4.4s\n",
      "129:\tlearn: 0.2393968\ttotal: 8.06s\tremaining: 4.34s\n",
      "130:\tlearn: 0.2392224\ttotal: 8.09s\tremaining: 4.26s\n",
      "131:\tlearn: 0.2389273\ttotal: 8.14s\tremaining: 4.19s\n",
      "132:\tlearn: 0.2388540\ttotal: 8.18s\tremaining: 4.12s\n",
      "133:\tlearn: 0.2387392\ttotal: 8.23s\tremaining: 4.05s\n",
      "134:\tlearn: 0.2385877\ttotal: 8.29s\tremaining: 3.99s\n",
      "135:\tlearn: 0.2384826\ttotal: 8.32s\tremaining: 3.92s\n",
      "136:\tlearn: 0.2383555\ttotal: 8.36s\tremaining: 3.85s\n",
      "137:\tlearn: 0.2382372\ttotal: 8.4s\tremaining: 3.77s\n",
      "138:\tlearn: 0.2381184\ttotal: 8.44s\tremaining: 3.7s\n",
      "139:\tlearn: 0.2378536\ttotal: 8.5s\tremaining: 3.64s\n",
      "140:\tlearn: 0.2375947\ttotal: 8.55s\tremaining: 3.58s\n",
      "141:\tlearn: 0.2374298\ttotal: 8.59s\tremaining: 3.51s\n",
      "142:\tlearn: 0.2371343\ttotal: 8.62s\tremaining: 3.44s\n",
      "143:\tlearn: 0.2369157\ttotal: 8.69s\tremaining: 3.38s\n",
      "144:\tlearn: 0.2365334\ttotal: 8.74s\tremaining: 3.31s\n",
      "145:\tlearn: 0.2363154\ttotal: 8.78s\tremaining: 3.25s\n",
      "146:\tlearn: 0.2360043\ttotal: 8.82s\tremaining: 3.18s\n",
      "147:\tlearn: 0.2358559\ttotal: 8.88s\tremaining: 3.12s\n",
      "148:\tlearn: 0.2357459\ttotal: 8.92s\tremaining: 3.05s\n",
      "149:\tlearn: 0.2354444\ttotal: 8.96s\tremaining: 2.99s\n",
      "150:\tlearn: 0.2351939\ttotal: 9s\tremaining: 2.92s\n",
      "151:\tlearn: 0.2349027\ttotal: 9.06s\tremaining: 2.86s\n",
      "152:\tlearn: 0.2347561\ttotal: 9.11s\tremaining: 2.8s\n",
      "153:\tlearn: 0.2345881\ttotal: 9.15s\tremaining: 2.73s\n",
      "154:\tlearn: 0.2344919\ttotal: 9.2s\tremaining: 2.67s\n",
      "155:\tlearn: 0.2343039\ttotal: 9.24s\tremaining: 2.6s\n",
      "156:\tlearn: 0.2341722\ttotal: 9.29s\tremaining: 2.54s\n",
      "157:\tlearn: 0.2339119\ttotal: 9.36s\tremaining: 2.49s\n",
      "158:\tlearn: 0.2336555\ttotal: 9.4s\tremaining: 2.42s\n",
      "159:\tlearn: 0.2333917\ttotal: 9.45s\tremaining: 2.36s\n",
      "160:\tlearn: 0.2332115\ttotal: 9.5s\tremaining: 2.3s\n",
      "161:\tlearn: 0.2329097\ttotal: 9.55s\tremaining: 2.24s\n",
      "162:\tlearn: 0.2327672\ttotal: 9.59s\tremaining: 2.18s\n",
      "163:\tlearn: 0.2324471\ttotal: 9.68s\tremaining: 2.12s\n",
      "164:\tlearn: 0.2321162\ttotal: 9.75s\tremaining: 2.07s\n",
      "165:\tlearn: 0.2318249\ttotal: 9.83s\tremaining: 2.01s\n",
      "166:\tlearn: 0.2314577\ttotal: 9.89s\tremaining: 1.95s\n",
      "167:\tlearn: 0.2310676\ttotal: 9.93s\tremaining: 1.89s\n",
      "168:\tlearn: 0.2307966\ttotal: 10s\tremaining: 1.84s\n",
      "169:\tlearn: 0.2303878\ttotal: 10.1s\tremaining: 1.78s\n",
      "170:\tlearn: 0.2302720\ttotal: 10.3s\tremaining: 1.74s\n",
      "171:\tlearn: 0.2302258\ttotal: 10.4s\tremaining: 1.69s\n",
      "172:\tlearn: 0.2299792\ttotal: 10.4s\tremaining: 1.62s\n",
      "173:\tlearn: 0.2295774\ttotal: 10.4s\tremaining: 1.56s\n",
      "174:\tlearn: 0.2295170\ttotal: 10.5s\tremaining: 1.5s\n",
      "175:\tlearn: 0.2292344\ttotal: 10.6s\tremaining: 1.44s\n",
      "176:\tlearn: 0.2291135\ttotal: 10.6s\tremaining: 1.38s\n",
      "177:\tlearn: 0.2290077\ttotal: 10.7s\tremaining: 1.32s\n",
      "178:\tlearn: 0.2289985\ttotal: 10.7s\tremaining: 1.25s\n",
      "179:\tlearn: 0.2286697\ttotal: 10.8s\tremaining: 1.2s\n",
      "180:\tlearn: 0.2284767\ttotal: 10.8s\tremaining: 1.13s\n",
      "181:\tlearn: 0.2283670\ttotal: 10.9s\tremaining: 1.07s\n",
      "182:\tlearn: 0.2283317\ttotal: 10.9s\tremaining: 1.02s\n",
      "183:\tlearn: 0.2282459\ttotal: 11s\tremaining: 955ms\n",
      "184:\tlearn: 0.2279832\ttotal: 11.1s\tremaining: 897ms\n",
      "185:\tlearn: 0.2278340\ttotal: 11.1s\tremaining: 837ms\n",
      "186:\tlearn: 0.2277636\ttotal: 11.2s\tremaining: 778ms\n",
      "187:\tlearn: 0.2274997\ttotal: 11.2s\tremaining: 718ms\n",
      "188:\tlearn: 0.2272182\ttotal: 11.3s\tremaining: 658ms\n",
      "189:\tlearn: 0.2272009\ttotal: 11.4s\tremaining: 598ms\n",
      "190:\tlearn: 0.2269597\ttotal: 11.4s\tremaining: 538ms\n",
      "191:\tlearn: 0.2266441\ttotal: 11.5s\tremaining: 478ms\n",
      "192:\tlearn: 0.2263687\ttotal: 11.5s\tremaining: 417ms\n",
      "193:\tlearn: 0.2261245\ttotal: 11.6s\tremaining: 358ms\n",
      "194:\tlearn: 0.2258398\ttotal: 11.6s\tremaining: 298ms\n",
      "195:\tlearn: 0.2255128\ttotal: 11.6s\tremaining: 238ms\n",
      "196:\tlearn: 0.2253228\ttotal: 11.7s\tremaining: 178ms\n",
      "197:\tlearn: 0.2250837\ttotal: 11.8s\tremaining: 119ms\n",
      "198:\tlearn: 0.2249329\ttotal: 11.8s\tremaining: 59.3ms\n",
      "199:\tlearn: 0.2246559\ttotal: 11.8s\tremaining: 0us\n",
      "0:\tlearn: 0.4884659\ttotal: 39.7ms\tremaining: 7.89s\n",
      "1:\tlearn: 0.4081357\ttotal: 76.6ms\tremaining: 7.58s\n",
      "2:\tlearn: 0.3744098\ttotal: 115ms\tremaining: 7.55s\n",
      "3:\tlearn: 0.3574307\ttotal: 152ms\tremaining: 7.47s\n",
      "4:\tlearn: 0.3450571\ttotal: 193ms\tremaining: 7.51s\n",
      "5:\tlearn: 0.3357138\ttotal: 232ms\tremaining: 7.49s\n",
      "6:\tlearn: 0.3270779\ttotal: 327ms\tremaining: 9.03s\n",
      "7:\tlearn: 0.3206461\ttotal: 482ms\tremaining: 11.6s\n",
      "8:\tlearn: 0.3153183\ttotal: 543ms\tremaining: 11.5s\n",
      "9:\tlearn: 0.3124480\ttotal: 752ms\tremaining: 14.3s\n",
      "10:\tlearn: 0.3097381\ttotal: 814ms\tremaining: 14s\n",
      "11:\tlearn: 0.3064184\ttotal: 853ms\tremaining: 13.4s\n",
      "12:\tlearn: 0.3028931\ttotal: 896ms\tremaining: 12.9s\n",
      "13:\tlearn: 0.3009571\ttotal: 950ms\tremaining: 12.6s\n",
      "14:\tlearn: 0.2994812\ttotal: 1.03s\tremaining: 12.7s\n",
      "15:\tlearn: 0.2971076\ttotal: 1.07s\tremaining: 12.4s\n",
      "16:\tlearn: 0.2962274\ttotal: 1.12s\tremaining: 12s\n",
      "17:\tlearn: 0.2953282\ttotal: 1.16s\tremaining: 11.7s\n",
      "18:\tlearn: 0.2936366\ttotal: 1.23s\tremaining: 11.7s\n",
      "19:\tlearn: 0.2923238\ttotal: 1.27s\tremaining: 11.4s\n",
      "20:\tlearn: 0.2914909\ttotal: 1.31s\tremaining: 11.2s\n",
      "21:\tlearn: 0.2903283\ttotal: 1.35s\tremaining: 10.9s\n",
      "22:\tlearn: 0.2891810\ttotal: 1.41s\tremaining: 10.9s\n",
      "23:\tlearn: 0.2882041\ttotal: 1.47s\tremaining: 10.8s\n",
      "24:\tlearn: 0.2877538\ttotal: 1.52s\tremaining: 10.6s\n",
      "25:\tlearn: 0.2873292\ttotal: 1.57s\tremaining: 10.5s\n",
      "26:\tlearn: 0.2868595\ttotal: 1.63s\tremaining: 10.5s\n",
      "27:\tlearn: 0.2853838\ttotal: 1.67s\tremaining: 10.3s\n",
      "28:\tlearn: 0.2849605\ttotal: 1.71s\tremaining: 10.1s\n",
      "29:\tlearn: 0.2836869\ttotal: 1.75s\tremaining: 9.9s\n",
      "30:\tlearn: 0.2831392\ttotal: 1.81s\tremaining: 9.86s\n",
      "31:\tlearn: 0.2825578\ttotal: 1.85s\tremaining: 9.72s\n",
      "32:\tlearn: 0.2819614\ttotal: 1.89s\tremaining: 9.56s\n",
      "33:\tlearn: 0.2810398\ttotal: 1.93s\tremaining: 9.42s\n",
      "34:\tlearn: 0.2772979\ttotal: 2.02s\tremaining: 9.51s\n",
      "35:\tlearn: 0.2761708\ttotal: 2.06s\tremaining: 9.4s\n",
      "36:\tlearn: 0.2755190\ttotal: 2.11s\tremaining: 9.29s\n",
      "37:\tlearn: 0.2749496\ttotal: 2.15s\tremaining: 9.19s\n",
      "38:\tlearn: 0.2743249\ttotal: 2.2s\tremaining: 9.07s\n",
      "39:\tlearn: 0.2733811\ttotal: 2.25s\tremaining: 8.98s\n",
      "40:\tlearn: 0.2730010\ttotal: 2.31s\tremaining: 8.95s\n",
      "41:\tlearn: 0.2724098\ttotal: 2.35s\tremaining: 8.84s\n",
      "42:\tlearn: 0.2718207\ttotal: 2.39s\tremaining: 8.72s\n",
      "43:\tlearn: 0.2711741\ttotal: 2.43s\tremaining: 8.61s\n",
      "44:\tlearn: 0.2700980\ttotal: 2.49s\tremaining: 8.57s\n",
      "45:\tlearn: 0.2695197\ttotal: 2.6s\tremaining: 8.71s\n",
      "46:\tlearn: 0.2691774\ttotal: 2.73s\tremaining: 8.88s\n",
      "47:\tlearn: 0.2683061\ttotal: 2.77s\tremaining: 8.77s\n",
      "48:\tlearn: 0.2675424\ttotal: 2.81s\tremaining: 8.66s\n",
      "49:\tlearn: 0.2671479\ttotal: 2.85s\tremaining: 8.55s\n",
      "50:\tlearn: 0.2668149\ttotal: 2.89s\tremaining: 8.43s\n",
      "51:\tlearn: 0.2664718\ttotal: 2.92s\tremaining: 8.33s\n",
      "52:\tlearn: 0.2654729\ttotal: 3s\tremaining: 8.31s\n",
      "53:\tlearn: 0.2651965\ttotal: 3.06s\tremaining: 8.26s\n",
      "54:\tlearn: 0.2649209\ttotal: 3.09s\tremaining: 8.16s\n",
      "55:\tlearn: 0.2643448\ttotal: 3.14s\tremaining: 8.08s\n",
      "56:\tlearn: 0.2639125\ttotal: 3.2s\tremaining: 8.03s\n",
      "57:\tlearn: 0.2632846\ttotal: 3.24s\tremaining: 7.93s\n",
      "58:\tlearn: 0.2628201\ttotal: 3.28s\tremaining: 7.83s\n",
      "59:\tlearn: 0.2624109\ttotal: 3.32s\tremaining: 7.74s\n",
      "60:\tlearn: 0.2620855\ttotal: 3.36s\tremaining: 7.66s\n",
      "61:\tlearn: 0.2615069\ttotal: 3.43s\tremaining: 7.63s\n",
      "62:\tlearn: 0.2610773\ttotal: 3.46s\tremaining: 7.54s\n",
      "63:\tlearn: 0.2607377\ttotal: 3.5s\tremaining: 7.44s\n",
      "64:\tlearn: 0.2605772\ttotal: 3.55s\tremaining: 7.37s\n",
      "65:\tlearn: 0.2599661\ttotal: 3.6s\tremaining: 7.32s\n",
      "66:\tlearn: 0.2594736\ttotal: 3.66s\tremaining: 7.26s\n",
      "67:\tlearn: 0.2588857\ttotal: 3.7s\tremaining: 7.19s\n",
      "68:\tlearn: 0.2586601\ttotal: 3.74s\tremaining: 7.11s\n",
      "69:\tlearn: 0.2583609\ttotal: 3.82s\tremaining: 7.09s\n",
      "70:\tlearn: 0.2581312\ttotal: 3.86s\tremaining: 7.01s\n",
      "71:\tlearn: 0.2577099\ttotal: 3.9s\tremaining: 6.94s\n",
      "72:\tlearn: 0.2572858\ttotal: 3.94s\tremaining: 6.86s\n",
      "73:\tlearn: 0.2568230\ttotal: 4.02s\tremaining: 6.84s\n",
      "74:\tlearn: 0.2563117\ttotal: 4.06s\tremaining: 6.77s\n",
      "75:\tlearn: 0.2558346\ttotal: 4.13s\tremaining: 6.73s\n",
      "76:\tlearn: 0.2553333\ttotal: 4.19s\tremaining: 6.69s\n",
      "77:\tlearn: 0.2544442\ttotal: 4.24s\tremaining: 6.63s\n",
      "78:\tlearn: 0.2538222\ttotal: 4.28s\tremaining: 6.56s\n",
      "79:\tlearn: 0.2537445\ttotal: 4.33s\tremaining: 6.49s\n",
      "80:\tlearn: 0.2534349\ttotal: 4.38s\tremaining: 6.44s\n",
      "81:\tlearn: 0.2531215\ttotal: 4.44s\tremaining: 6.38s\n",
      "82:\tlearn: 0.2527374\ttotal: 4.48s\tremaining: 6.31s\n",
      "83:\tlearn: 0.2525875\ttotal: 4.52s\tremaining: 6.24s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "84:\tlearn: 0.2522913\ttotal: 4.58s\tremaining: 6.19s\n",
      "85:\tlearn: 0.2519001\ttotal: 4.64s\tremaining: 6.15s\n",
      "86:\tlearn: 0.2513308\ttotal: 4.68s\tremaining: 6.08s\n",
      "87:\tlearn: 0.2508407\ttotal: 4.8s\tremaining: 6.12s\n",
      "88:\tlearn: 0.2506509\ttotal: 4.89s\tremaining: 6.09s\n",
      "89:\tlearn: 0.2501783\ttotal: 4.93s\tremaining: 6.02s\n",
      "90:\tlearn: 0.2500411\ttotal: 4.97s\tremaining: 5.96s\n",
      "91:\tlearn: 0.2495824\ttotal: 5.02s\tremaining: 5.89s\n",
      "92:\tlearn: 0.2490950\ttotal: 5.08s\tremaining: 5.85s\n",
      "93:\tlearn: 0.2488926\ttotal: 5.12s\tremaining: 5.78s\n",
      "94:\tlearn: 0.2484046\ttotal: 5.18s\tremaining: 5.73s\n",
      "95:\tlearn: 0.2481794\ttotal: 5.24s\tremaining: 5.67s\n",
      "96:\tlearn: 0.2479094\ttotal: 5.28s\tremaining: 5.61s\n",
      "97:\tlearn: 0.2474333\ttotal: 5.32s\tremaining: 5.54s\n",
      "98:\tlearn: 0.2472361\ttotal: 5.36s\tremaining: 5.47s\n",
      "99:\tlearn: 0.2471621\ttotal: 5.4s\tremaining: 5.4s\n",
      "100:\tlearn: 0.2467285\ttotal: 5.45s\tremaining: 5.34s\n",
      "101:\tlearn: 0.2464162\ttotal: 5.5s\tremaining: 5.29s\n",
      "102:\tlearn: 0.2463307\ttotal: 5.54s\tremaining: 5.22s\n",
      "103:\tlearn: 0.2461855\ttotal: 5.58s\tremaining: 5.15s\n",
      "104:\tlearn: 0.2459343\ttotal: 5.62s\tremaining: 5.08s\n",
      "105:\tlearn: 0.2456722\ttotal: 5.66s\tremaining: 5.02s\n",
      "106:\tlearn: 0.2453904\ttotal: 5.72s\tremaining: 4.97s\n",
      "107:\tlearn: 0.2450109\ttotal: 5.78s\tremaining: 4.92s\n",
      "108:\tlearn: 0.2446274\ttotal: 5.81s\tremaining: 4.85s\n",
      "109:\tlearn: 0.2444840\ttotal: 5.85s\tremaining: 4.79s\n",
      "110:\tlearn: 0.2441018\ttotal: 5.91s\tremaining: 4.74s\n",
      "111:\tlearn: 0.2437408\ttotal: 5.95s\tremaining: 4.67s\n",
      "112:\tlearn: 0.2434843\ttotal: 5.99s\tremaining: 4.61s\n",
      "113:\tlearn: 0.2432032\ttotal: 6.03s\tremaining: 4.55s\n",
      "114:\tlearn: 0.2430427\ttotal: 6.11s\tremaining: 4.51s\n",
      "115:\tlearn: 0.2426406\ttotal: 6.15s\tremaining: 4.45s\n",
      "116:\tlearn: 0.2424035\ttotal: 6.19s\tremaining: 4.39s\n",
      "117:\tlearn: 0.2421204\ttotal: 6.25s\tremaining: 4.34s\n",
      "118:\tlearn: 0.2417192\ttotal: 6.31s\tremaining: 4.29s\n",
      "119:\tlearn: 0.2413040\ttotal: 6.35s\tremaining: 4.23s\n",
      "120:\tlearn: 0.2410454\ttotal: 6.39s\tremaining: 4.17s\n",
      "121:\tlearn: 0.2407491\ttotal: 6.43s\tremaining: 4.11s\n",
      "122:\tlearn: 0.2403673\ttotal: 6.48s\tremaining: 4.05s\n",
      "123:\tlearn: 0.2401332\ttotal: 6.53s\tremaining: 4s\n",
      "124:\tlearn: 0.2397060\ttotal: 6.58s\tremaining: 3.94s\n",
      "125:\tlearn: 0.2394986\ttotal: 6.62s\tremaining: 3.89s\n",
      "126:\tlearn: 0.2390124\ttotal: 6.66s\tremaining: 3.83s\n",
      "127:\tlearn: 0.2387007\ttotal: 6.73s\tremaining: 3.79s\n",
      "128:\tlearn: 0.2384749\ttotal: 6.79s\tremaining: 3.73s\n",
      "129:\tlearn: 0.2380753\ttotal: 6.83s\tremaining: 3.68s\n",
      "130:\tlearn: 0.2378170\ttotal: 6.87s\tremaining: 3.62s\n",
      "131:\tlearn: 0.2375372\ttotal: 6.99s\tremaining: 3.6s\n",
      "132:\tlearn: 0.2372601\ttotal: 7.12s\tremaining: 3.59s\n",
      "133:\tlearn: 0.2368860\ttotal: 7.19s\tremaining: 3.54s\n",
      "134:\tlearn: 0.2365697\ttotal: 7.23s\tremaining: 3.48s\n",
      "135:\tlearn: 0.2363524\ttotal: 7.28s\tremaining: 3.43s\n",
      "136:\tlearn: 0.2360234\ttotal: 7.33s\tremaining: 3.37s\n",
      "137:\tlearn: 0.2357628\ttotal: 7.38s\tremaining: 3.32s\n",
      "138:\tlearn: 0.2354255\ttotal: 7.43s\tremaining: 3.26s\n",
      "139:\tlearn: 0.2349524\ttotal: 7.47s\tremaining: 3.2s\n",
      "140:\tlearn: 0.2346763\ttotal: 7.51s\tremaining: 3.14s\n",
      "141:\tlearn: 0.2346136\ttotal: 7.56s\tremaining: 3.09s\n",
      "142:\tlearn: 0.2343162\ttotal: 7.62s\tremaining: 3.04s\n",
      "143:\tlearn: 0.2340251\ttotal: 7.66s\tremaining: 2.98s\n",
      "144:\tlearn: 0.2339311\ttotal: 7.7s\tremaining: 2.92s\n",
      "145:\tlearn: 0.2336207\ttotal: 7.74s\tremaining: 2.86s\n",
      "146:\tlearn: 0.2332967\ttotal: 7.79s\tremaining: 2.81s\n",
      "147:\tlearn: 0.2328957\ttotal: 7.85s\tremaining: 2.76s\n",
      "148:\tlearn: 0.2326389\ttotal: 7.91s\tremaining: 2.71s\n",
      "149:\tlearn: 0.2324441\ttotal: 7.95s\tremaining: 2.65s\n",
      "150:\tlearn: 0.2320716\ttotal: 8.02s\tremaining: 2.6s\n",
      "151:\tlearn: 0.2319136\ttotal: 8.09s\tremaining: 2.55s\n",
      "152:\tlearn: 0.2317923\ttotal: 8.13s\tremaining: 2.5s\n",
      "153:\tlearn: 0.2317794\ttotal: 8.16s\tremaining: 2.44s\n",
      "154:\tlearn: 0.2315852\ttotal: 8.21s\tremaining: 2.38s\n",
      "155:\tlearn: 0.2315210\ttotal: 8.27s\tremaining: 2.33s\n",
      "156:\tlearn: 0.2311333\ttotal: 8.31s\tremaining: 2.28s\n",
      "157:\tlearn: 0.2306947\ttotal: 8.37s\tremaining: 2.22s\n",
      "158:\tlearn: 0.2303265\ttotal: 8.41s\tremaining: 2.17s\n",
      "159:\tlearn: 0.2300096\ttotal: 8.47s\tremaining: 2.12s\n",
      "160:\tlearn: 0.2297845\ttotal: 8.52s\tremaining: 2.06s\n",
      "161:\tlearn: 0.2296905\ttotal: 8.55s\tremaining: 2.01s\n",
      "162:\tlearn: 0.2295913\ttotal: 8.59s\tremaining: 1.95s\n",
      "163:\tlearn: 0.2292160\ttotal: 8.64s\tremaining: 1.9s\n",
      "164:\tlearn: 0.2289030\ttotal: 8.69s\tremaining: 1.84s\n",
      "165:\tlearn: 0.2285491\ttotal: 8.73s\tremaining: 1.79s\n",
      "166:\tlearn: 0.2282429\ttotal: 8.77s\tremaining: 1.73s\n",
      "167:\tlearn: 0.2279679\ttotal: 8.81s\tremaining: 1.68s\n",
      "168:\tlearn: 0.2276615\ttotal: 8.87s\tremaining: 1.63s\n",
      "169:\tlearn: 0.2273632\ttotal: 8.93s\tremaining: 1.57s\n",
      "170:\tlearn: 0.2271091\ttotal: 8.97s\tremaining: 1.52s\n",
      "171:\tlearn: 0.2270608\ttotal: 9.01s\tremaining: 1.47s\n",
      "172:\tlearn: 0.2270117\ttotal: 9.05s\tremaining: 1.41s\n",
      "173:\tlearn: 0.2266012\ttotal: 9.09s\tremaining: 1.36s\n",
      "174:\tlearn: 0.2262926\ttotal: 9.21s\tremaining: 1.31s\n",
      "175:\tlearn: 0.2261053\ttotal: 9.35s\tremaining: 1.27s\n",
      "176:\tlearn: 0.2258464\ttotal: 9.41s\tremaining: 1.22s\n",
      "177:\tlearn: 0.2256669\ttotal: 9.45s\tremaining: 1.17s\n",
      "178:\tlearn: 0.2255390\ttotal: 9.49s\tremaining: 1.11s\n",
      "179:\tlearn: 0.2251964\ttotal: 9.54s\tremaining: 1.06s\n",
      "180:\tlearn: 0.2249162\ttotal: 9.6s\tremaining: 1.01s\n",
      "181:\tlearn: 0.2247379\ttotal: 9.64s\tremaining: 954ms\n",
      "182:\tlearn: 0.2244589\ttotal: 9.68s\tremaining: 899ms\n",
      "183:\tlearn: 0.2242187\ttotal: 9.72s\tremaining: 845ms\n",
      "184:\tlearn: 0.2241389\ttotal: 9.77s\tremaining: 793ms\n",
      "185:\tlearn: 0.2240266\ttotal: 9.83s\tremaining: 740ms\n",
      "186:\tlearn: 0.2237841\ttotal: 9.87s\tremaining: 686ms\n",
      "187:\tlearn: 0.2235374\ttotal: 9.91s\tremaining: 633ms\n",
      "188:\tlearn: 0.2234114\ttotal: 10s\tremaining: 582ms\n",
      "189:\tlearn: 0.2231306\ttotal: 10s\tremaining: 529ms\n",
      "190:\tlearn: 0.2230279\ttotal: 10.1s\tremaining: 475ms\n",
      "191:\tlearn: 0.2229991\ttotal: 10.1s\tremaining: 423ms\n",
      "192:\tlearn: 0.2228452\ttotal: 10.2s\tremaining: 370ms\n",
      "193:\tlearn: 0.2224884\ttotal: 10.2s\tremaining: 317ms\n",
      "194:\tlearn: 0.2224450\ttotal: 10.3s\tremaining: 264ms\n",
      "195:\tlearn: 0.2220808\ttotal: 10.3s\tremaining: 211ms\n",
      "196:\tlearn: 0.2218511\ttotal: 10.4s\tremaining: 158ms\n",
      "197:\tlearn: 0.2213896\ttotal: 10.4s\tremaining: 105ms\n",
      "198:\tlearn: 0.2211368\ttotal: 10.5s\tremaining: 52.7ms\n",
      "199:\tlearn: 0.2209491\ttotal: 10.5s\tremaining: 0us\n",
      "0:\tlearn: 0.4887360\ttotal: 97.3ms\tremaining: 19.4s\n",
      "1:\tlearn: 0.4110202\ttotal: 226ms\tremaining: 22.3s\n",
      "2:\tlearn: 0.3773557\ttotal: 269ms\tremaining: 17.6s\n",
      "3:\tlearn: 0.3532264\ttotal: 339ms\tremaining: 16.6s\n",
      "4:\tlearn: 0.3401859\ttotal: 396ms\tremaining: 15.5s\n",
      "5:\tlearn: 0.3335600\ttotal: 438ms\tremaining: 14.2s\n",
      "6:\tlearn: 0.3284012\ttotal: 478ms\tremaining: 13.2s\n",
      "7:\tlearn: 0.3238258\ttotal: 517ms\tremaining: 12.4s\n",
      "8:\tlearn: 0.3179218\ttotal: 564ms\tremaining: 12s\n",
      "9:\tlearn: 0.3152325\ttotal: 632ms\tremaining: 12s\n",
      "10:\tlearn: 0.3090469\ttotal: 802ms\tremaining: 13.8s\n",
      "11:\tlearn: 0.3062557\ttotal: 854ms\tremaining: 13.4s\n",
      "12:\tlearn: 0.3046518\ttotal: 906ms\tremaining: 13s\n",
      "13:\tlearn: 0.3032956\ttotal: 945ms\tremaining: 12.6s\n",
      "14:\tlearn: 0.3014581\ttotal: 984ms\tremaining: 12.1s\n",
      "15:\tlearn: 0.2992295\ttotal: 1.06s\tremaining: 12.2s\n",
      "16:\tlearn: 0.2964421\ttotal: 1.1s\tremaining: 11.8s\n",
      "17:\tlearn: 0.2955067\ttotal: 1.14s\tremaining: 11.5s\n",
      "18:\tlearn: 0.2943390\ttotal: 1.18s\tremaining: 11.2s\n",
      "19:\tlearn: 0.2935424\ttotal: 1.24s\tremaining: 11.2s\n",
      "20:\tlearn: 0.2928080\ttotal: 1.29s\tremaining: 11s\n",
      "21:\tlearn: 0.2918887\ttotal: 1.34s\tremaining: 10.9s\n",
      "22:\tlearn: 0.2911962\ttotal: 1.42s\tremaining: 10.9s\n",
      "23:\tlearn: 0.2899137\ttotal: 1.47s\tremaining: 10.8s\n",
      "24:\tlearn: 0.2883546\ttotal: 1.51s\tremaining: 10.6s\n",
      "25:\tlearn: 0.2843291\ttotal: 1.56s\tremaining: 10.4s\n",
      "26:\tlearn: 0.2838125\ttotal: 1.61s\tremaining: 10.3s\n",
      "27:\tlearn: 0.2832594\ttotal: 1.68s\tremaining: 10.3s\n",
      "28:\tlearn: 0.2826272\ttotal: 1.74s\tremaining: 10.2s\n",
      "29:\tlearn: 0.2808890\ttotal: 1.78s\tremaining: 10.1s\n",
      "30:\tlearn: 0.2803085\ttotal: 1.82s\tremaining: 9.93s\n",
      "31:\tlearn: 0.2798536\ttotal: 1.89s\tremaining: 9.91s\n",
      "32:\tlearn: 0.2776381\ttotal: 1.95s\tremaining: 9.86s\n",
      "33:\tlearn: 0.2771029\ttotal: 1.99s\tremaining: 9.72s\n",
      "34:\tlearn: 0.2768198\ttotal: 2.04s\tremaining: 9.61s\n",
      "35:\tlearn: 0.2764894\ttotal: 2.1s\tremaining: 9.59s\n",
      "36:\tlearn: 0.2758915\ttotal: 2.14s\tremaining: 9.45s\n",
      "37:\tlearn: 0.2751363\ttotal: 2.18s\tremaining: 9.31s\n",
      "38:\tlearn: 0.2744130\ttotal: 2.22s\tremaining: 9.18s\n",
      "39:\tlearn: 0.2739829\ttotal: 2.3s\tremaining: 9.2s\n",
      "40:\tlearn: 0.2731363\ttotal: 2.34s\tremaining: 9.08s\n",
      "41:\tlearn: 0.2719138\ttotal: 2.38s\tremaining: 8.96s\n",
      "42:\tlearn: 0.2712089\ttotal: 2.44s\tremaining: 8.91s\n",
      "43:\tlearn: 0.2704257\ttotal: 2.5s\tremaining: 8.88s\n",
      "44:\tlearn: 0.2699935\ttotal: 2.57s\tremaining: 8.86s\n",
      "45:\tlearn: 0.2695278\ttotal: 2.61s\tremaining: 8.75s\n",
      "46:\tlearn: 0.2688921\ttotal: 2.65s\tremaining: 8.64s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "47:\tlearn: 0.2683755\ttotal: 2.72s\tremaining: 8.63s\n",
      "48:\tlearn: 0.2677664\ttotal: 2.76s\tremaining: 8.52s\n",
      "49:\tlearn: 0.2667065\ttotal: 2.81s\tremaining: 8.42s\n",
      "50:\tlearn: 0.2662464\ttotal: 2.98s\tremaining: 8.71s\n",
      "51:\tlearn: 0.2654807\ttotal: 3.06s\tremaining: 8.71s\n",
      "52:\tlearn: 0.2648874\ttotal: 3.1s\tremaining: 8.61s\n",
      "53:\tlearn: 0.2641305\ttotal: 3.14s\tremaining: 8.49s\n",
      "54:\tlearn: 0.2639816\ttotal: 3.18s\tremaining: 8.38s\n",
      "55:\tlearn: 0.2633510\ttotal: 3.24s\tremaining: 8.34s\n",
      "56:\tlearn: 0.2627696\ttotal: 3.29s\tremaining: 8.24s\n",
      "57:\tlearn: 0.2623309\ttotal: 3.32s\tremaining: 8.14s\n",
      "58:\tlearn: 0.2621535\ttotal: 3.36s\tremaining: 8.04s\n",
      "59:\tlearn: 0.2616692\ttotal: 3.41s\tremaining: 7.95s\n",
      "60:\tlearn: 0.2614644\ttotal: 3.48s\tremaining: 7.92s\n",
      "61:\tlearn: 0.2608377\ttotal: 3.52s\tremaining: 7.83s\n",
      "62:\tlearn: 0.2603753\ttotal: 3.56s\tremaining: 7.74s\n",
      "63:\tlearn: 0.2600076\ttotal: 3.61s\tremaining: 7.67s\n",
      "64:\tlearn: 0.2598489\ttotal: 3.67s\tremaining: 7.63s\n",
      "65:\tlearn: 0.2593307\ttotal: 3.73s\tremaining: 7.57s\n",
      "66:\tlearn: 0.2591688\ttotal: 3.77s\tremaining: 7.48s\n",
      "67:\tlearn: 0.2586332\ttotal: 3.81s\tremaining: 7.39s\n",
      "68:\tlearn: 0.2584462\ttotal: 3.87s\tremaining: 7.34s\n",
      "69:\tlearn: 0.2580773\ttotal: 3.91s\tremaining: 7.26s\n",
      "70:\tlearn: 0.2577061\ttotal: 3.95s\tremaining: 7.18s\n",
      "71:\tlearn: 0.2575960\ttotal: 4.01s\tremaining: 7.13s\n",
      "72:\tlearn: 0.2571141\ttotal: 4.07s\tremaining: 7.08s\n",
      "73:\tlearn: 0.2566048\ttotal: 4.11s\tremaining: 7s\n",
      "74:\tlearn: 0.2560280\ttotal: 4.15s\tremaining: 6.92s\n",
      "75:\tlearn: 0.2558752\ttotal: 4.19s\tremaining: 6.84s\n",
      "76:\tlearn: 0.2554363\ttotal: 4.26s\tremaining: 6.8s\n",
      "77:\tlearn: 0.2553840\ttotal: 4.3s\tremaining: 6.72s\n",
      "78:\tlearn: 0.2548642\ttotal: 4.34s\tremaining: 6.64s\n",
      "79:\tlearn: 0.2546713\ttotal: 4.37s\tremaining: 6.56s\n",
      "80:\tlearn: 0.2541619\ttotal: 4.42s\tremaining: 6.5s\n",
      "81:\tlearn: 0.2536991\ttotal: 4.48s\tremaining: 6.45s\n",
      "82:\tlearn: 0.2533659\ttotal: 4.55s\tremaining: 6.41s\n",
      "83:\tlearn: 0.2531699\ttotal: 4.61s\tremaining: 6.37s\n",
      "84:\tlearn: 0.2528609\ttotal: 4.68s\tremaining: 6.34s\n",
      "85:\tlearn: 0.2524328\ttotal: 4.74s\tremaining: 6.29s\n",
      "86:\tlearn: 0.2521599\ttotal: 4.8s\tremaining: 6.23s\n",
      "87:\tlearn: 0.2514190\ttotal: 4.86s\tremaining: 6.19s\n",
      "88:\tlearn: 0.2511753\ttotal: 4.92s\tremaining: 6.13s\n",
      "89:\tlearn: 0.2506722\ttotal: 4.97s\tremaining: 6.08s\n",
      "90:\tlearn: 0.2502349\ttotal: 5.12s\tremaining: 6.13s\n",
      "91:\tlearn: 0.2498023\ttotal: 5.23s\tremaining: 6.14s\n",
      "92:\tlearn: 0.2493501\ttotal: 5.31s\tremaining: 6.11s\n",
      "93:\tlearn: 0.2490531\ttotal: 5.38s\tremaining: 6.06s\n",
      "94:\tlearn: 0.2486765\ttotal: 5.42s\tremaining: 5.99s\n",
      "95:\tlearn: 0.2483292\ttotal: 5.46s\tremaining: 5.91s\n",
      "96:\tlearn: 0.2479998\ttotal: 5.51s\tremaining: 5.85s\n",
      "97:\tlearn: 0.2476491\ttotal: 5.57s\tremaining: 5.79s\n",
      "98:\tlearn: 0.2472594\ttotal: 5.63s\tremaining: 5.75s\n",
      "99:\tlearn: 0.2470101\ttotal: 5.68s\tremaining: 5.68s\n",
      "100:\tlearn: 0.2469478\ttotal: 5.72s\tremaining: 5.61s\n",
      "101:\tlearn: 0.2467391\ttotal: 5.79s\tremaining: 5.56s\n",
      "102:\tlearn: 0.2462023\ttotal: 5.83s\tremaining: 5.49s\n",
      "103:\tlearn: 0.2461236\ttotal: 5.87s\tremaining: 5.42s\n",
      "104:\tlearn: 0.2458182\ttotal: 5.91s\tremaining: 5.35s\n",
      "105:\tlearn: 0.2456329\ttotal: 5.98s\tremaining: 5.3s\n",
      "106:\tlearn: 0.2452334\ttotal: 6.04s\tremaining: 5.25s\n",
      "107:\tlearn: 0.2449398\ttotal: 6.12s\tremaining: 5.21s\n",
      "108:\tlearn: 0.2447201\ttotal: 6.18s\tremaining: 5.16s\n",
      "109:\tlearn: 0.2443484\ttotal: 6.25s\tremaining: 5.11s\n",
      "110:\tlearn: 0.2439214\ttotal: 6.29s\tremaining: 5.05s\n",
      "111:\tlearn: 0.2433963\ttotal: 6.36s\tremaining: 5s\n",
      "112:\tlearn: 0.2432693\ttotal: 6.4s\tremaining: 4.93s\n",
      "113:\tlearn: 0.2431357\ttotal: 6.44s\tremaining: 4.86s\n",
      "114:\tlearn: 0.2427103\ttotal: 6.48s\tremaining: 4.79s\n",
      "115:\tlearn: 0.2426400\ttotal: 6.54s\tremaining: 4.74s\n",
      "116:\tlearn: 0.2423108\ttotal: 6.62s\tremaining: 4.7s\n",
      "117:\tlearn: 0.2418913\ttotal: 6.67s\tremaining: 4.64s\n",
      "118:\tlearn: 0.2418482\ttotal: 6.74s\tremaining: 4.58s\n",
      "119:\tlearn: 0.2415859\ttotal: 6.81s\tremaining: 4.54s\n",
      "120:\tlearn: 0.2412065\ttotal: 6.89s\tremaining: 4.5s\n",
      "121:\tlearn: 0.2409234\ttotal: 6.95s\tremaining: 4.45s\n",
      "122:\tlearn: 0.2406851\ttotal: 7.01s\tremaining: 4.39s\n",
      "123:\tlearn: 0.2404390\ttotal: 7.05s\tremaining: 4.32s\n",
      "124:\tlearn: 0.2402061\ttotal: 7.12s\tremaining: 4.27s\n",
      "125:\tlearn: 0.2400016\ttotal: 7.18s\tremaining: 4.22s\n",
      "126:\tlearn: 0.2398620\ttotal: 7.24s\tremaining: 4.16s\n",
      "127:\tlearn: 0.2395259\ttotal: 7.34s\tremaining: 4.13s\n",
      "128:\tlearn: 0.2391237\ttotal: 7.47s\tremaining: 4.11s\n",
      "129:\tlearn: 0.2389789\ttotal: 7.66s\tremaining: 4.13s\n",
      "130:\tlearn: 0.2385930\ttotal: 7.73s\tremaining: 4.07s\n",
      "131:\tlearn: 0.2384536\ttotal: 7.79s\tremaining: 4.01s\n",
      "132:\tlearn: 0.2381896\ttotal: 7.85s\tremaining: 3.95s\n",
      "133:\tlearn: 0.2378676\ttotal: 7.93s\tremaining: 3.91s\n",
      "134:\tlearn: 0.2378279\ttotal: 8.02s\tremaining: 3.86s\n",
      "135:\tlearn: 0.2377031\ttotal: 8.07s\tremaining: 3.8s\n",
      "136:\tlearn: 0.2375446\ttotal: 8.13s\tremaining: 3.74s\n",
      "137:\tlearn: 0.2371841\ttotal: 8.2s\tremaining: 3.68s\n",
      "138:\tlearn: 0.2367872\ttotal: 8.28s\tremaining: 3.63s\n",
      "139:\tlearn: 0.2365500\ttotal: 8.34s\tremaining: 3.58s\n",
      "140:\tlearn: 0.2363907\ttotal: 8.39s\tremaining: 3.51s\n",
      "141:\tlearn: 0.2362619\ttotal: 8.43s\tremaining: 3.44s\n",
      "142:\tlearn: 0.2358673\ttotal: 8.46s\tremaining: 3.37s\n",
      "143:\tlearn: 0.2355923\ttotal: 8.54s\tremaining: 3.32s\n",
      "144:\tlearn: 0.2352874\ttotal: 8.58s\tremaining: 3.25s\n",
      "145:\tlearn: 0.2351892\ttotal: 8.62s\tremaining: 3.19s\n",
      "146:\tlearn: 0.2348712\ttotal: 8.66s\tremaining: 3.12s\n",
      "147:\tlearn: 0.2346623\ttotal: 8.74s\tremaining: 3.07s\n",
      "148:\tlearn: 0.2343108\ttotal: 8.79s\tremaining: 3.01s\n",
      "149:\tlearn: 0.2341190\ttotal: 8.82s\tremaining: 2.94s\n",
      "150:\tlearn: 0.2335386\ttotal: 8.91s\tremaining: 2.89s\n",
      "151:\tlearn: 0.2333558\ttotal: 8.96s\tremaining: 2.83s\n",
      "152:\tlearn: 0.2330696\ttotal: 9.03s\tremaining: 2.77s\n",
      "153:\tlearn: 0.2326996\ttotal: 9.09s\tremaining: 2.72s\n",
      "154:\tlearn: 0.2324433\ttotal: 9.15s\tremaining: 2.66s\n",
      "155:\tlearn: 0.2321544\ttotal: 9.2s\tremaining: 2.6s\n",
      "156:\tlearn: 0.2320724\ttotal: 9.31s\tremaining: 2.55s\n",
      "157:\tlearn: 0.2319271\ttotal: 9.36s\tremaining: 2.49s\n",
      "158:\tlearn: 0.2314977\ttotal: 9.42s\tremaining: 2.43s\n",
      "159:\tlearn: 0.2312079\ttotal: 9.46s\tremaining: 2.36s\n",
      "160:\tlearn: 0.2308757\ttotal: 9.5s\tremaining: 2.3s\n",
      "161:\tlearn: 0.2307744\ttotal: 9.56s\tremaining: 2.24s\n",
      "162:\tlearn: 0.2304983\ttotal: 9.61s\tremaining: 2.18s\n",
      "163:\tlearn: 0.2303841\ttotal: 9.66s\tremaining: 2.12s\n",
      "164:\tlearn: 0.2300761\ttotal: 9.82s\tremaining: 2.08s\n",
      "165:\tlearn: 0.2296782\ttotal: 9.89s\tremaining: 2.02s\n",
      "166:\tlearn: 0.2294719\ttotal: 9.99s\tremaining: 1.97s\n",
      "167:\tlearn: 0.2293105\ttotal: 10s\tremaining: 1.91s\n",
      "168:\tlearn: 0.2291357\ttotal: 10.1s\tremaining: 1.85s\n",
      "169:\tlearn: 0.2287170\ttotal: 10.1s\tremaining: 1.79s\n",
      "170:\tlearn: 0.2284937\ttotal: 10.2s\tremaining: 1.73s\n",
      "171:\tlearn: 0.2283678\ttotal: 10.3s\tremaining: 1.68s\n",
      "172:\tlearn: 0.2282134\ttotal: 10.5s\tremaining: 1.63s\n",
      "173:\tlearn: 0.2278286\ttotal: 10.5s\tremaining: 1.57s\n",
      "174:\tlearn: 0.2277263\ttotal: 10.6s\tremaining: 1.52s\n",
      "175:\tlearn: 0.2275403\ttotal: 10.7s\tremaining: 1.46s\n",
      "176:\tlearn: 0.2271400\ttotal: 10.8s\tremaining: 1.4s\n",
      "177:\tlearn: 0.2268774\ttotal: 10.8s\tremaining: 1.34s\n",
      "178:\tlearn: 0.2265708\ttotal: 10.9s\tremaining: 1.27s\n",
      "179:\tlearn: 0.2262290\ttotal: 10.9s\tremaining: 1.21s\n",
      "180:\tlearn: 0.2259083\ttotal: 11s\tremaining: 1.15s\n",
      "181:\tlearn: 0.2256612\ttotal: 11s\tremaining: 1.09s\n",
      "182:\tlearn: 0.2254334\ttotal: 11.1s\tremaining: 1.03s\n",
      "183:\tlearn: 0.2251381\ttotal: 11.1s\tremaining: 965ms\n",
      "184:\tlearn: 0.2248683\ttotal: 11.1s\tremaining: 903ms\n",
      "185:\tlearn: 0.2246531\ttotal: 11.2s\tremaining: 843ms\n",
      "186:\tlearn: 0.2243623\ttotal: 11.3s\tremaining: 783ms\n",
      "187:\tlearn: 0.2242871\ttotal: 11.3s\tremaining: 722ms\n",
      "188:\tlearn: 0.2240584\ttotal: 11.4s\tremaining: 661ms\n",
      "189:\tlearn: 0.2238450\ttotal: 11.5s\tremaining: 603ms\n",
      "190:\tlearn: 0.2237094\ttotal: 11.5s\tremaining: 543ms\n",
      "191:\tlearn: 0.2233784\ttotal: 11.6s\tremaining: 483ms\n",
      "192:\tlearn: 0.2230560\ttotal: 11.6s\tremaining: 422ms\n",
      "193:\tlearn: 0.2227906\ttotal: 11.7s\tremaining: 362ms\n",
      "194:\tlearn: 0.2225174\ttotal: 11.8s\tremaining: 302ms\n",
      "195:\tlearn: 0.2222137\ttotal: 11.8s\tremaining: 242ms\n",
      "196:\tlearn: 0.2217799\ttotal: 11.9s\tremaining: 182ms\n",
      "197:\tlearn: 0.2217171\ttotal: 12.1s\tremaining: 122ms\n",
      "198:\tlearn: 0.2213964\ttotal: 12.1s\tremaining: 60.9ms\n",
      "199:\tlearn: 0.2212671\ttotal: 12.2s\tremaining: 0us\n",
      "0:\tlearn: 0.4917298\ttotal: 37.9ms\tremaining: 7.54s\n",
      "1:\tlearn: 0.4102328\ttotal: 73.3ms\tremaining: 7.25s\n",
      "2:\tlearn: 0.3703447\ttotal: 114ms\tremaining: 7.46s\n",
      "3:\tlearn: 0.3568417\ttotal: 159ms\tremaining: 7.79s\n",
      "4:\tlearn: 0.3414381\ttotal: 213ms\tremaining: 8.31s\n",
      "5:\tlearn: 0.3311381\ttotal: 275ms\tremaining: 8.89s\n",
      "6:\tlearn: 0.3264056\ttotal: 356ms\tremaining: 9.83s\n",
      "7:\tlearn: 0.3226739\ttotal: 412ms\tremaining: 9.9s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "8:\tlearn: 0.3180068\ttotal: 499ms\tremaining: 10.6s\n",
      "9:\tlearn: 0.3148788\ttotal: 580ms\tremaining: 11s\n",
      "10:\tlearn: 0.3091801\ttotal: 644ms\tremaining: 11.1s\n",
      "11:\tlearn: 0.3064734\ttotal: 684ms\tremaining: 10.7s\n",
      "12:\tlearn: 0.3023545\ttotal: 750ms\tremaining: 10.8s\n",
      "13:\tlearn: 0.3001431\ttotal: 787ms\tremaining: 10.5s\n",
      "14:\tlearn: 0.2985010\ttotal: 848ms\tremaining: 10.5s\n",
      "15:\tlearn: 0.2971947\ttotal: 930ms\tremaining: 10.7s\n",
      "16:\tlearn: 0.2958124\ttotal: 990ms\tremaining: 10.7s\n",
      "17:\tlearn: 0.2948482\ttotal: 1.03s\tremaining: 10.4s\n",
      "18:\tlearn: 0.2941997\ttotal: 1.09s\tremaining: 10.4s\n",
      "19:\tlearn: 0.2923554\ttotal: 1.18s\tremaining: 10.6s\n",
      "20:\tlearn: 0.2916510\ttotal: 1.25s\tremaining: 10.7s\n",
      "21:\tlearn: 0.2881631\ttotal: 1.32s\tremaining: 10.7s\n",
      "22:\tlearn: 0.2866951\ttotal: 1.37s\tremaining: 10.6s\n",
      "23:\tlearn: 0.2860071\ttotal: 1.44s\tremaining: 10.5s\n",
      "24:\tlearn: 0.2852350\ttotal: 1.49s\tremaining: 10.4s\n",
      "25:\tlearn: 0.2848705\ttotal: 1.53s\tremaining: 10.2s\n",
      "26:\tlearn: 0.2844211\ttotal: 1.57s\tremaining: 10s\n",
      "27:\tlearn: 0.2837306\ttotal: 1.63s\tremaining: 10s\n",
      "28:\tlearn: 0.2819126\ttotal: 1.67s\tremaining: 9.83s\n",
      "29:\tlearn: 0.2814082\ttotal: 1.74s\tremaining: 9.85s\n",
      "30:\tlearn: 0.2808261\ttotal: 1.85s\tremaining: 10.1s\n",
      "31:\tlearn: 0.2804243\ttotal: 2.01s\tremaining: 10.6s\n",
      "32:\tlearn: 0.2795664\ttotal: 2.08s\tremaining: 10.5s\n",
      "33:\tlearn: 0.2790536\ttotal: 2.15s\tremaining: 10.5s\n",
      "34:\tlearn: 0.2784352\ttotal: 2.19s\tremaining: 10.3s\n",
      "35:\tlearn: 0.2774499\ttotal: 2.23s\tremaining: 10.1s\n",
      "36:\tlearn: 0.2766988\ttotal: 2.26s\tremaining: 9.97s\n",
      "37:\tlearn: 0.2761929\ttotal: 2.33s\tremaining: 9.93s\n",
      "38:\tlearn: 0.2756270\ttotal: 2.37s\tremaining: 9.79s\n",
      "39:\tlearn: 0.2750112\ttotal: 2.41s\tremaining: 9.64s\n",
      "40:\tlearn: 0.2746511\ttotal: 2.45s\tremaining: 9.49s\n",
      "41:\tlearn: 0.2740925\ttotal: 2.55s\tremaining: 9.59s\n",
      "42:\tlearn: 0.2729611\ttotal: 2.59s\tremaining: 9.45s\n",
      "43:\tlearn: 0.2716126\ttotal: 2.63s\tremaining: 9.31s\n",
      "44:\tlearn: 0.2710329\ttotal: 2.67s\tremaining: 9.18s\n",
      "45:\tlearn: 0.2701628\ttotal: 2.72s\tremaining: 9.11s\n",
      "46:\tlearn: 0.2698632\ttotal: 2.8s\tremaining: 9.12s\n",
      "47:\tlearn: 0.2693771\ttotal: 2.88s\tremaining: 9.12s\n",
      "48:\tlearn: 0.2689556\ttotal: 3.02s\tremaining: 9.31s\n",
      "49:\tlearn: 0.2675861\ttotal: 3.11s\tremaining: 9.33s\n",
      "50:\tlearn: 0.2669533\ttotal: 3.16s\tremaining: 9.22s\n",
      "51:\tlearn: 0.2662241\ttotal: 3.22s\tremaining: 9.15s\n",
      "52:\tlearn: 0.2654497\ttotal: 3.35s\tremaining: 9.3s\n",
      "53:\tlearn: 0.2652958\ttotal: 3.44s\tremaining: 9.3s\n",
      "54:\tlearn: 0.2642633\ttotal: 3.54s\tremaining: 9.33s\n",
      "55:\tlearn: 0.2637185\ttotal: 3.61s\tremaining: 9.29s\n",
      "56:\tlearn: 0.2631288\ttotal: 3.66s\tremaining: 9.19s\n",
      "57:\tlearn: 0.2627680\ttotal: 3.74s\tremaining: 9.16s\n",
      "58:\tlearn: 0.2621118\ttotal: 3.8s\tremaining: 9.09s\n",
      "59:\tlearn: 0.2615837\ttotal: 3.86s\tremaining: 9.01s\n",
      "60:\tlearn: 0.2611661\ttotal: 3.97s\tremaining: 9.04s\n",
      "61:\tlearn: 0.2606551\ttotal: 4.17s\tremaining: 9.29s\n",
      "62:\tlearn: 0.2602628\ttotal: 4.27s\tremaining: 9.28s\n",
      "63:\tlearn: 0.2598930\ttotal: 4.33s\tremaining: 9.19s\n",
      "64:\tlearn: 0.2594921\ttotal: 4.39s\tremaining: 9.11s\n",
      "65:\tlearn: 0.2590351\ttotal: 4.47s\tremaining: 9.07s\n",
      "66:\tlearn: 0.2585508\ttotal: 4.52s\tremaining: 8.97s\n",
      "67:\tlearn: 0.2579718\ttotal: 4.58s\tremaining: 8.88s\n",
      "68:\tlearn: 0.2574965\ttotal: 4.66s\tremaining: 8.84s\n",
      "69:\tlearn: 0.2573424\ttotal: 4.7s\tremaining: 8.72s\n",
      "70:\tlearn: 0.2570091\ttotal: 4.74s\tremaining: 8.61s\n",
      "71:\tlearn: 0.2563930\ttotal: 4.78s\tremaining: 8.49s\n",
      "72:\tlearn: 0.2559537\ttotal: 4.85s\tremaining: 8.44s\n",
      "73:\tlearn: 0.2556624\ttotal: 4.93s\tremaining: 8.39s\n",
      "74:\tlearn: 0.2553902\ttotal: 4.99s\tremaining: 8.32s\n",
      "75:\tlearn: 0.2548164\ttotal: 5.06s\tremaining: 8.25s\n",
      "76:\tlearn: 0.2544096\ttotal: 5.1s\tremaining: 8.15s\n",
      "77:\tlearn: 0.2538656\ttotal: 5.14s\tremaining: 8.04s\n",
      "78:\tlearn: 0.2536637\ttotal: 5.18s\tremaining: 7.94s\n",
      "79:\tlearn: 0.2534411\ttotal: 5.25s\tremaining: 7.87s\n",
      "80:\tlearn: 0.2530843\ttotal: 5.29s\tremaining: 7.77s\n",
      "81:\tlearn: 0.2528182\ttotal: 5.34s\tremaining: 7.68s\n",
      "82:\tlearn: 0.2525085\ttotal: 5.38s\tremaining: 7.58s\n",
      "83:\tlearn: 0.2521208\ttotal: 5.45s\tremaining: 7.53s\n",
      "84:\tlearn: 0.2518083\ttotal: 5.51s\tremaining: 7.45s\n",
      "85:\tlearn: 0.2514521\ttotal: 5.55s\tremaining: 7.36s\n",
      "86:\tlearn: 0.2511111\ttotal: 5.61s\tremaining: 7.28s\n",
      "87:\tlearn: 0.2508856\ttotal: 5.66s\tremaining: 7.21s\n",
      "88:\tlearn: 0.2505500\ttotal: 5.7s\tremaining: 7.11s\n",
      "89:\tlearn: 0.2502756\ttotal: 5.74s\tremaining: 7.02s\n",
      "90:\tlearn: 0.2501553\ttotal: 5.78s\tremaining: 6.93s\n",
      "91:\tlearn: 0.2496378\ttotal: 5.84s\tremaining: 6.85s\n",
      "92:\tlearn: 0.2492223\ttotal: 5.94s\tremaining: 6.84s\n",
      "93:\tlearn: 0.2487867\ttotal: 5.99s\tremaining: 6.75s\n",
      "94:\tlearn: 0.2484129\ttotal: 6.03s\tremaining: 6.67s\n",
      "95:\tlearn: 0.2480758\ttotal: 6.11s\tremaining: 6.61s\n",
      "96:\tlearn: 0.2477856\ttotal: 6.15s\tremaining: 6.53s\n",
      "97:\tlearn: 0.2474058\ttotal: 6.19s\tremaining: 6.44s\n",
      "98:\tlearn: 0.2471347\ttotal: 6.23s\tremaining: 6.35s\n",
      "99:\tlearn: 0.2466663\ttotal: 6.31s\tremaining: 6.31s\n",
      "100:\tlearn: 0.2463100\ttotal: 6.47s\tremaining: 6.34s\n",
      "101:\tlearn: 0.2462087\ttotal: 6.53s\tremaining: 6.27s\n",
      "102:\tlearn: 0.2458403\ttotal: 6.59s\tremaining: 6.2s\n",
      "103:\tlearn: 0.2455179\ttotal: 6.66s\tremaining: 6.15s\n",
      "104:\tlearn: 0.2451997\ttotal: 6.73s\tremaining: 6.09s\n",
      "105:\tlearn: 0.2450510\ttotal: 6.8s\tremaining: 6.03s\n",
      "106:\tlearn: 0.2448445\ttotal: 6.85s\tremaining: 5.96s\n",
      "107:\tlearn: 0.2443664\ttotal: 6.92s\tremaining: 5.9s\n",
      "108:\tlearn: 0.2440019\ttotal: 6.98s\tremaining: 5.83s\n",
      "109:\tlearn: 0.2436825\ttotal: 7.05s\tremaining: 5.76s\n",
      "110:\tlearn: 0.2433396\ttotal: 7.1s\tremaining: 5.69s\n",
      "111:\tlearn: 0.2430178\ttotal: 7.16s\tremaining: 5.62s\n",
      "112:\tlearn: 0.2428235\ttotal: 7.2s\tremaining: 5.54s\n",
      "113:\tlearn: 0.2425991\ttotal: 7.23s\tremaining: 5.46s\n",
      "114:\tlearn: 0.2424463\ttotal: 7.28s\tremaining: 5.38s\n",
      "115:\tlearn: 0.2421903\ttotal: 7.35s\tremaining: 5.32s\n",
      "116:\tlearn: 0.2418328\ttotal: 7.42s\tremaining: 5.26s\n",
      "117:\tlearn: 0.2415361\ttotal: 7.46s\tremaining: 5.19s\n",
      "118:\tlearn: 0.2412653\ttotal: 7.51s\tremaining: 5.11s\n",
      "119:\tlearn: 0.2410728\ttotal: 7.58s\tremaining: 5.05s\n",
      "120:\tlearn: 0.2407275\ttotal: 7.66s\tremaining: 5s\n",
      "121:\tlearn: 0.2403147\ttotal: 7.74s\tremaining: 4.95s\n",
      "122:\tlearn: 0.2399327\ttotal: 7.81s\tremaining: 4.89s\n",
      "123:\tlearn: 0.2396511\ttotal: 7.86s\tremaining: 4.82s\n",
      "124:\tlearn: 0.2394711\ttotal: 7.92s\tremaining: 4.75s\n",
      "125:\tlearn: 0.2392890\ttotal: 7.98s\tremaining: 4.68s\n",
      "126:\tlearn: 0.2389691\ttotal: 8.05s\tremaining: 4.63s\n",
      "127:\tlearn: 0.2388578\ttotal: 8.18s\tremaining: 4.6s\n",
      "128:\tlearn: 0.2385003\ttotal: 8.33s\tremaining: 4.58s\n",
      "129:\tlearn: 0.2383136\ttotal: 8.38s\tremaining: 4.51s\n",
      "130:\tlearn: 0.2381316\ttotal: 8.43s\tremaining: 4.44s\n",
      "131:\tlearn: 0.2378707\ttotal: 8.48s\tremaining: 4.37s\n",
      "132:\tlearn: 0.2376067\ttotal: 8.61s\tremaining: 4.34s\n",
      "133:\tlearn: 0.2372990\ttotal: 8.71s\tremaining: 4.29s\n",
      "134:\tlearn: 0.2370381\ttotal: 8.78s\tremaining: 4.23s\n",
      "135:\tlearn: 0.2369765\ttotal: 8.83s\tremaining: 4.15s\n",
      "136:\tlearn: 0.2368484\ttotal: 8.89s\tremaining: 4.09s\n",
      "137:\tlearn: 0.2366106\ttotal: 8.95s\tremaining: 4.02s\n",
      "138:\tlearn: 0.2362015\ttotal: 9s\tremaining: 3.95s\n",
      "139:\tlearn: 0.2358647\ttotal: 9.04s\tremaining: 3.88s\n",
      "140:\tlearn: 0.2355421\ttotal: 9.08s\tremaining: 3.8s\n",
      "141:\tlearn: 0.2353069\ttotal: 9.17s\tremaining: 3.74s\n",
      "142:\tlearn: 0.2350554\ttotal: 9.25s\tremaining: 3.69s\n",
      "143:\tlearn: 0.2347753\ttotal: 9.37s\tremaining: 3.64s\n",
      "144:\tlearn: 0.2347130\ttotal: 9.43s\tremaining: 3.58s\n",
      "145:\tlearn: 0.2344032\ttotal: 9.47s\tremaining: 3.5s\n",
      "146:\tlearn: 0.2342883\ttotal: 9.52s\tremaining: 3.43s\n",
      "147:\tlearn: 0.2341884\ttotal: 9.58s\tremaining: 3.37s\n",
      "148:\tlearn: 0.2339513\ttotal: 9.64s\tremaining: 3.3s\n",
      "149:\tlearn: 0.2335816\ttotal: 9.69s\tremaining: 3.23s\n",
      "150:\tlearn: 0.2332367\ttotal: 9.73s\tremaining: 3.16s\n",
      "151:\tlearn: 0.2330758\ttotal: 9.77s\tremaining: 3.08s\n",
      "152:\tlearn: 0.2327874\ttotal: 9.84s\tremaining: 3.02s\n",
      "153:\tlearn: 0.2324529\ttotal: 9.9s\tremaining: 2.96s\n",
      "154:\tlearn: 0.2322266\ttotal: 9.94s\tremaining: 2.88s\n",
      "155:\tlearn: 0.2319653\ttotal: 9.99s\tremaining: 2.82s\n",
      "156:\tlearn: 0.2315521\ttotal: 10s\tremaining: 2.75s\n",
      "157:\tlearn: 0.2312866\ttotal: 10.1s\tremaining: 2.68s\n",
      "158:\tlearn: 0.2311561\ttotal: 10.1s\tremaining: 2.61s\n",
      "159:\tlearn: 0.2307979\ttotal: 10.2s\tremaining: 2.54s\n",
      "160:\tlearn: 0.2305032\ttotal: 10.2s\tremaining: 2.47s\n",
      "161:\tlearn: 0.2303924\ttotal: 10.3s\tremaining: 2.41s\n",
      "162:\tlearn: 0.2302347\ttotal: 10.3s\tremaining: 2.34s\n",
      "163:\tlearn: 0.2301459\ttotal: 10.4s\tremaining: 2.28s\n",
      "164:\tlearn: 0.2301388\ttotal: 10.4s\tremaining: 2.21s\n",
      "165:\tlearn: 0.2301320\ttotal: 10.5s\tremaining: 2.15s\n",
      "166:\tlearn: 0.2297158\ttotal: 10.5s\tremaining: 2.08s\n",
      "167:\tlearn: 0.2295384\ttotal: 10.6s\tremaining: 2.01s\n",
      "168:\tlearn: 0.2293266\ttotal: 10.6s\tremaining: 1.95s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "169:\tlearn: 0.2290105\ttotal: 10.7s\tremaining: 1.88s\n",
      "170:\tlearn: 0.2285586\ttotal: 10.7s\tremaining: 1.82s\n",
      "171:\tlearn: 0.2281991\ttotal: 10.9s\tremaining: 1.77s\n",
      "172:\tlearn: 0.2279406\ttotal: 10.9s\tremaining: 1.71s\n",
      "173:\tlearn: 0.2276911\ttotal: 11s\tremaining: 1.64s\n",
      "174:\tlearn: 0.2275774\ttotal: 11s\tremaining: 1.58s\n",
      "175:\tlearn: 0.2273200\ttotal: 11.1s\tremaining: 1.51s\n",
      "176:\tlearn: 0.2270139\ttotal: 11.1s\tremaining: 1.45s\n",
      "177:\tlearn: 0.2267032\ttotal: 11.2s\tremaining: 1.38s\n",
      "178:\tlearn: 0.2264038\ttotal: 11.2s\tremaining: 1.32s\n",
      "179:\tlearn: 0.2261705\ttotal: 11.3s\tremaining: 1.25s\n",
      "180:\tlearn: 0.2259577\ttotal: 11.3s\tremaining: 1.19s\n",
      "181:\tlearn: 0.2256149\ttotal: 11.4s\tremaining: 1.13s\n",
      "182:\tlearn: 0.2254915\ttotal: 11.5s\tremaining: 1.07s\n",
      "183:\tlearn: 0.2253312\ttotal: 11.6s\tremaining: 1.01s\n",
      "184:\tlearn: 0.2251864\ttotal: 11.6s\tremaining: 943ms\n",
      "185:\tlearn: 0.2250303\ttotal: 11.7s\tremaining: 880ms\n",
      "186:\tlearn: 0.2248906\ttotal: 11.8s\tremaining: 817ms\n",
      "187:\tlearn: 0.2246735\ttotal: 11.8s\tremaining: 753ms\n",
      "188:\tlearn: 0.2244055\ttotal: 11.8s\tremaining: 689ms\n",
      "189:\tlearn: 0.2241687\ttotal: 11.9s\tremaining: 625ms\n",
      "190:\tlearn: 0.2240734\ttotal: 11.9s\tremaining: 563ms\n",
      "191:\tlearn: 0.2237139\ttotal: 12s\tremaining: 500ms\n",
      "192:\tlearn: 0.2235032\ttotal: 12.1s\tremaining: 437ms\n",
      "193:\tlearn: 0.2233232\ttotal: 12.1s\tremaining: 375ms\n",
      "194:\tlearn: 0.2232085\ttotal: 12.2s\tremaining: 313ms\n",
      "195:\tlearn: 0.2228916\ttotal: 12.3s\tremaining: 251ms\n",
      "196:\tlearn: 0.2227447\ttotal: 12.4s\tremaining: 188ms\n",
      "197:\tlearn: 0.2224800\ttotal: 12.4s\tremaining: 126ms\n",
      "198:\tlearn: 0.2224030\ttotal: 12.5s\tremaining: 62.8ms\n",
      "199:\tlearn: 0.2221522\ttotal: 12.5s\tremaining: 0us\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "0.9350728155339805"
      ]
     },
     "execution_count": 80,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Cross validated recall\n",
    "cv_recall = cross_val_score(best_model,\n",
    "                        X,\n",
    "                        y,\n",
    "                        cv=5,\n",
    "                        scoring='recall')\n",
    "cv_recall_mean = np.mean(cv_recall)\n",
    "cv_recall_mean"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 81,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0:\tlearn: 0.4910390\ttotal: 43.3ms\tremaining: 8.61s\n",
      "1:\tlearn: 0.4094957\ttotal: 135ms\tremaining: 13.3s\n",
      "2:\tlearn: 0.3694131\ttotal: 291ms\tremaining: 19.1s\n",
      "3:\tlearn: 0.3505391\ttotal: 410ms\tremaining: 20.1s\n",
      "4:\tlearn: 0.3391372\ttotal: 477ms\tremaining: 18.6s\n",
      "5:\tlearn: 0.3327239\ttotal: 546ms\tremaining: 17.7s\n",
      "6:\tlearn: 0.3262649\ttotal: 613ms\tremaining: 16.9s\n",
      "7:\tlearn: 0.3187783\ttotal: 684ms\tremaining: 16.4s\n",
      "8:\tlearn: 0.3136945\ttotal: 758ms\tremaining: 16.1s\n",
      "9:\tlearn: 0.3113021\ttotal: 831ms\tremaining: 15.8s\n",
      "10:\tlearn: 0.3081480\ttotal: 880ms\tremaining: 15.1s\n",
      "11:\tlearn: 0.3056354\ttotal: 918ms\tremaining: 14.4s\n",
      "12:\tlearn: 0.3020594\ttotal: 989ms\tremaining: 14.2s\n",
      "13:\tlearn: 0.2993112\ttotal: 1.06s\tremaining: 14s\n",
      "14:\tlearn: 0.2973829\ttotal: 1.11s\tremaining: 13.7s\n",
      "15:\tlearn: 0.2934693\ttotal: 1.21s\tremaining: 13.9s\n",
      "16:\tlearn: 0.2924421\ttotal: 1.27s\tremaining: 13.7s\n",
      "17:\tlearn: 0.2915134\ttotal: 1.33s\tremaining: 13.5s\n",
      "18:\tlearn: 0.2903485\ttotal: 1.38s\tremaining: 13.1s\n",
      "19:\tlearn: 0.2896061\ttotal: 1.44s\tremaining: 13s\n",
      "20:\tlearn: 0.2890050\ttotal: 1.49s\tremaining: 12.7s\n",
      "21:\tlearn: 0.2882568\ttotal: 1.56s\tremaining: 12.6s\n",
      "22:\tlearn: 0.2875332\ttotal: 1.61s\tremaining: 12.4s\n",
      "23:\tlearn: 0.2857290\ttotal: 1.68s\tremaining: 12.3s\n",
      "24:\tlearn: 0.2850522\ttotal: 1.74s\tremaining: 12.2s\n",
      "25:\tlearn: 0.2838251\ttotal: 1.8s\tremaining: 12.1s\n",
      "26:\tlearn: 0.2818143\ttotal: 1.9s\tremaining: 12.1s\n",
      "27:\tlearn: 0.2810609\ttotal: 1.97s\tremaining: 12.1s\n",
      "28:\tlearn: 0.2805953\ttotal: 2.04s\tremaining: 12s\n",
      "29:\tlearn: 0.2795593\ttotal: 2.09s\tremaining: 11.9s\n",
      "30:\tlearn: 0.2785583\ttotal: 2.18s\tremaining: 11.9s\n",
      "31:\tlearn: 0.2775374\ttotal: 2.23s\tremaining: 11.7s\n",
      "32:\tlearn: 0.2769544\ttotal: 2.31s\tremaining: 11.7s\n",
      "33:\tlearn: 0.2762143\ttotal: 2.56s\tremaining: 12.5s\n",
      "34:\tlearn: 0.2757283\ttotal: 2.62s\tremaining: 12.4s\n",
      "35:\tlearn: 0.2751014\ttotal: 2.67s\tremaining: 12.2s\n",
      "36:\tlearn: 0.2742580\ttotal: 2.74s\tremaining: 12.1s\n",
      "37:\tlearn: 0.2735819\ttotal: 2.81s\tremaining: 12s\n",
      "38:\tlearn: 0.2725745\ttotal: 2.88s\tremaining: 11.9s\n",
      "39:\tlearn: 0.2717464\ttotal: 2.94s\tremaining: 11.7s\n",
      "40:\tlearn: 0.2712371\ttotal: 3s\tremaining: 11.6s\n",
      "41:\tlearn: 0.2708447\ttotal: 3.07s\tremaining: 11.6s\n",
      "42:\tlearn: 0.2703224\ttotal: 3.12s\tremaining: 11.4s\n",
      "43:\tlearn: 0.2696397\ttotal: 3.19s\tremaining: 11.3s\n",
      "44:\tlearn: 0.2690909\ttotal: 3.24s\tremaining: 11.2s\n",
      "45:\tlearn: 0.2682967\ttotal: 3.28s\tremaining: 11s\n",
      "46:\tlearn: 0.2679382\ttotal: 3.33s\tremaining: 10.8s\n",
      "47:\tlearn: 0.2677047\ttotal: 3.39s\tremaining: 10.7s\n",
      "48:\tlearn: 0.2673390\ttotal: 3.44s\tremaining: 10.6s\n",
      "49:\tlearn: 0.2667281\ttotal: 3.48s\tremaining: 10.4s\n",
      "50:\tlearn: 0.2660764\ttotal: 3.52s\tremaining: 10.3s\n",
      "51:\tlearn: 0.2653754\ttotal: 3.58s\tremaining: 10.2s\n",
      "52:\tlearn: 0.2650464\ttotal: 3.64s\tremaining: 10.1s\n",
      "53:\tlearn: 0.2648876\ttotal: 3.68s\tremaining: 9.96s\n",
      "54:\tlearn: 0.2644577\ttotal: 3.73s\tremaining: 9.83s\n",
      "55:\tlearn: 0.2639544\ttotal: 3.79s\tremaining: 9.73s\n",
      "56:\tlearn: 0.2635208\ttotal: 3.84s\tremaining: 9.64s\n",
      "57:\tlearn: 0.2630010\ttotal: 3.88s\tremaining: 9.5s\n",
      "58:\tlearn: 0.2623645\ttotal: 3.93s\tremaining: 9.38s\n",
      "59:\tlearn: 0.2618230\ttotal: 4.01s\tremaining: 9.36s\n",
      "60:\tlearn: 0.2615054\ttotal: 4.07s\tremaining: 9.27s\n",
      "61:\tlearn: 0.2613269\ttotal: 4.1s\tremaining: 9.14s\n",
      "62:\tlearn: 0.2608481\ttotal: 4.17s\tremaining: 9.07s\n",
      "63:\tlearn: 0.2606736\ttotal: 4.22s\tremaining: 8.96s\n",
      "64:\tlearn: 0.2601501\ttotal: 4.28s\tremaining: 8.89s\n",
      "65:\tlearn: 0.2599332\ttotal: 4.32s\tremaining: 8.77s\n",
      "66:\tlearn: 0.2594212\ttotal: 4.36s\tremaining: 8.65s\n",
      "67:\tlearn: 0.2592048\ttotal: 4.42s\tremaining: 8.58s\n",
      "68:\tlearn: 0.2585311\ttotal: 4.48s\tremaining: 8.51s\n",
      "69:\tlearn: 0.2581389\ttotal: 4.53s\tremaining: 8.4s\n",
      "70:\tlearn: 0.2576641\ttotal: 4.63s\tremaining: 8.42s\n",
      "71:\tlearn: 0.2571270\ttotal: 4.79s\tremaining: 8.51s\n",
      "72:\tlearn: 0.2569060\ttotal: 4.85s\tremaining: 8.44s\n",
      "73:\tlearn: 0.2563899\ttotal: 4.93s\tremaining: 8.4s\n",
      "74:\tlearn: 0.2559528\ttotal: 4.97s\tremaining: 8.29s\n",
      "75:\tlearn: 0.2554732\ttotal: 5.01s\tremaining: 8.18s\n",
      "76:\tlearn: 0.2550620\ttotal: 5.06s\tremaining: 8.09s\n",
      "77:\tlearn: 0.2544463\ttotal: 5.14s\tremaining: 8.04s\n",
      "78:\tlearn: 0.2541464\ttotal: 5.19s\tremaining: 7.95s\n",
      "79:\tlearn: 0.2536836\ttotal: 5.24s\tremaining: 7.86s\n",
      "80:\tlearn: 0.2533178\ttotal: 5.31s\tremaining: 7.8s\n",
      "81:\tlearn: 0.2528747\ttotal: 5.36s\tremaining: 7.72s\n",
      "82:\tlearn: 0.2526583\ttotal: 5.41s\tremaining: 7.62s\n",
      "83:\tlearn: 0.2524395\ttotal: 5.45s\tremaining: 7.53s\n",
      "84:\tlearn: 0.2520651\ttotal: 5.64s\tremaining: 7.63s\n",
      "85:\tlearn: 0.2516639\ttotal: 5.74s\tremaining: 7.61s\n",
      "86:\tlearn: 0.2514801\ttotal: 5.81s\tremaining: 7.55s\n",
      "87:\tlearn: 0.2513549\ttotal: 5.87s\tremaining: 7.47s\n",
      "88:\tlearn: 0.2508232\ttotal: 5.92s\tremaining: 7.38s\n",
      "89:\tlearn: 0.2506792\ttotal: 5.96s\tremaining: 7.29s\n",
      "90:\tlearn: 0.2502898\ttotal: 6.04s\tremaining: 7.23s\n",
      "91:\tlearn: 0.2501274\ttotal: 6.08s\tremaining: 7.13s\n",
      "92:\tlearn: 0.2498113\ttotal: 6.11s\tremaining: 7.03s\n",
      "93:\tlearn: 0.2494608\ttotal: 6.16s\tremaining: 6.94s\n",
      "94:\tlearn: 0.2490959\ttotal: 6.22s\tremaining: 6.88s\n",
      "95:\tlearn: 0.2489713\ttotal: 6.3s\tremaining: 6.82s\n",
      "96:\tlearn: 0.2485235\ttotal: 6.34s\tremaining: 6.73s\n",
      "97:\tlearn: 0.2480601\ttotal: 6.41s\tremaining: 6.67s\n",
      "98:\tlearn: 0.2475354\ttotal: 6.47s\tremaining: 6.6s\n",
      "99:\tlearn: 0.2470517\ttotal: 6.51s\tremaining: 6.51s\n",
      "100:\tlearn: 0.2465217\ttotal: 6.56s\tremaining: 6.43s\n",
      "101:\tlearn: 0.2462395\ttotal: 6.63s\tremaining: 6.38s\n",
      "102:\tlearn: 0.2458358\ttotal: 6.68s\tremaining: 6.29s\n",
      "103:\tlearn: 0.2455335\ttotal: 6.72s\tremaining: 6.2s\n",
      "104:\tlearn: 0.2451756\ttotal: 6.78s\tremaining: 6.14s\n",
      "105:\tlearn: 0.2448174\ttotal: 6.96s\tremaining: 6.17s\n",
      "106:\tlearn: 0.2445567\ttotal: 7.04s\tremaining: 6.12s\n",
      "107:\tlearn: 0.2443596\ttotal: 7.09s\tremaining: 6.04s\n",
      "108:\tlearn: 0.2439081\ttotal: 7.15s\tremaining: 5.97s\n",
      "109:\tlearn: 0.2434848\ttotal: 7.21s\tremaining: 5.89s\n",
      "110:\tlearn: 0.2432248\ttotal: 7.25s\tremaining: 5.81s\n",
      "111:\tlearn: 0.2430648\ttotal: 7.31s\tremaining: 5.75s\n",
      "112:\tlearn: 0.2429844\ttotal: 7.39s\tremaining: 5.69s\n",
      "113:\tlearn: 0.2426978\ttotal: 7.48s\tremaining: 5.64s\n",
      "114:\tlearn: 0.2425858\ttotal: 7.54s\tremaining: 5.58s\n",
      "115:\tlearn: 0.2422130\ttotal: 7.59s\tremaining: 5.49s\n",
      "116:\tlearn: 0.2417006\ttotal: 7.63s\tremaining: 5.41s\n",
      "117:\tlearn: 0.2414430\ttotal: 7.67s\tremaining: 5.33s\n",
      "118:\tlearn: 0.2411022\ttotal: 7.74s\tremaining: 5.26s\n",
      "119:\tlearn: 0.2403800\ttotal: 7.81s\tremaining: 5.2s\n",
      "120:\tlearn: 0.2400258\ttotal: 7.86s\tremaining: 5.13s\n",
      "121:\tlearn: 0.2396878\ttotal: 7.93s\tremaining: 5.07s\n",
      "122:\tlearn: 0.2394415\ttotal: 7.96s\tremaining: 4.99s\n",
      "123:\tlearn: 0.2390072\ttotal: 8.01s\tremaining: 4.91s\n",
      "124:\tlearn: 0.2387689\ttotal: 8.08s\tremaining: 4.85s\n",
      "125:\tlearn: 0.2384445\ttotal: 8.15s\tremaining: 4.78s\n",
      "126:\tlearn: 0.2381465\ttotal: 8.21s\tremaining: 4.72s\n",
      "127:\tlearn: 0.2378007\ttotal: 8.25s\tremaining: 4.64s\n",
      "128:\tlearn: 0.2374913\ttotal: 8.29s\tremaining: 4.56s\n",
      "129:\tlearn: 0.2372241\ttotal: 8.36s\tremaining: 4.5s\n",
      "130:\tlearn: 0.2369136\ttotal: 8.4s\tremaining: 4.42s\n",
      "131:\tlearn: 0.2367420\ttotal: 8.44s\tremaining: 4.34s\n",
      "132:\tlearn: 0.2364224\ttotal: 8.47s\tremaining: 4.27s\n",
      "133:\tlearn: 0.2362696\ttotal: 8.56s\tremaining: 4.22s\n",
      "134:\tlearn: 0.2358998\ttotal: 8.61s\tremaining: 4.14s\n",
      "135:\tlearn: 0.2355574\ttotal: 8.69s\tremaining: 4.09s\n",
      "136:\tlearn: 0.2351997\ttotal: 8.76s\tremaining: 4.03s\n",
      "137:\tlearn: 0.2349023\ttotal: 8.81s\tremaining: 3.96s\n",
      "138:\tlearn: 0.2345666\ttotal: 8.89s\tremaining: 3.9s\n",
      "139:\tlearn: 0.2344306\ttotal: 8.99s\tremaining: 3.85s\n",
      "140:\tlearn: 0.2341253\ttotal: 9.08s\tremaining: 3.8s\n",
      "141:\tlearn: 0.2339600\ttotal: 9.24s\tremaining: 3.77s\n",
      "142:\tlearn: 0.2336109\ttotal: 9.29s\tremaining: 3.7s\n",
      "143:\tlearn: 0.2335354\ttotal: 9.34s\tremaining: 3.63s\n",
      "144:\tlearn: 0.2332019\ttotal: 9.4s\tremaining: 3.57s\n",
      "145:\tlearn: 0.2330839\ttotal: 9.44s\tremaining: 3.49s\n",
      "146:\tlearn: 0.2328308\ttotal: 9.48s\tremaining: 3.42s\n",
      "147:\tlearn: 0.2327493\ttotal: 9.55s\tremaining: 3.35s\n",
      "148:\tlearn: 0.2324452\ttotal: 9.59s\tremaining: 3.28s\n",
      "149:\tlearn: 0.2323056\ttotal: 9.63s\tremaining: 3.21s\n",
      "150:\tlearn: 0.2320540\ttotal: 9.67s\tremaining: 3.14s\n",
      "151:\tlearn: 0.2317048\ttotal: 9.74s\tremaining: 3.08s\n",
      "152:\tlearn: 0.2314122\ttotal: 9.79s\tremaining: 3.01s\n",
      "153:\tlearn: 0.2309981\ttotal: 9.83s\tremaining: 2.94s\n",
      "154:\tlearn: 0.2306700\ttotal: 9.87s\tremaining: 2.87s\n",
      "155:\tlearn: 0.2302911\ttotal: 9.92s\tremaining: 2.8s\n",
      "156:\tlearn: 0.2301412\ttotal: 10s\tremaining: 2.74s\n",
      "157:\tlearn: 0.2298899\ttotal: 10.1s\tremaining: 2.67s\n",
      "158:\tlearn: 0.2295007\ttotal: 10.2s\tremaining: 2.62s\n",
      "159:\tlearn: 0.2293104\ttotal: 10.2s\tremaining: 2.55s\n",
      "160:\tlearn: 0.2292694\ttotal: 10.3s\tremaining: 2.49s\n",
      "161:\tlearn: 0.2290253\ttotal: 10.3s\tremaining: 2.43s\n",
      "162:\tlearn: 0.2288107\ttotal: 10.4s\tremaining: 2.36s\n",
      "163:\tlearn: 0.2285343\ttotal: 10.5s\tremaining: 2.3s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "164:\tlearn: 0.2284223\ttotal: 10.5s\tremaining: 2.23s\n",
      "165:\tlearn: 0.2281667\ttotal: 10.6s\tremaining: 2.17s\n",
      "166:\tlearn: 0.2278998\ttotal: 10.6s\tremaining: 2.1s\n",
      "167:\tlearn: 0.2275107\ttotal: 10.7s\tremaining: 2.03s\n",
      "168:\tlearn: 0.2272013\ttotal: 10.7s\tremaining: 1.97s\n",
      "169:\tlearn: 0.2270592\ttotal: 10.8s\tremaining: 1.9s\n",
      "170:\tlearn: 0.2269358\ttotal: 10.8s\tremaining: 1.83s\n",
      "171:\tlearn: 0.2266104\ttotal: 10.8s\tremaining: 1.77s\n",
      "172:\tlearn: 0.2263648\ttotal: 10.9s\tremaining: 1.71s\n",
      "173:\tlearn: 0.2261102\ttotal: 11s\tremaining: 1.64s\n",
      "174:\tlearn: 0.2258385\ttotal: 11.1s\tremaining: 1.58s\n",
      "175:\tlearn: 0.2255843\ttotal: 11.2s\tremaining: 1.52s\n",
      "176:\tlearn: 0.2252919\ttotal: 11.2s\tremaining: 1.46s\n",
      "177:\tlearn: 0.2250407\ttotal: 11.4s\tremaining: 1.41s\n",
      "178:\tlearn: 0.2247510\ttotal: 11.5s\tremaining: 1.35s\n",
      "179:\tlearn: 0.2244622\ttotal: 11.6s\tremaining: 1.29s\n",
      "180:\tlearn: 0.2243807\ttotal: 11.7s\tremaining: 1.23s\n",
      "181:\tlearn: 0.2243464\ttotal: 11.8s\tremaining: 1.17s\n",
      "182:\tlearn: 0.2242004\ttotal: 11.9s\tremaining: 1.11s\n",
      "183:\tlearn: 0.2239257\ttotal: 12s\tremaining: 1.04s\n",
      "184:\tlearn: 0.2238702\ttotal: 12.1s\tremaining: 981ms\n",
      "185:\tlearn: 0.2235913\ttotal: 12.2s\tremaining: 915ms\n",
      "186:\tlearn: 0.2233530\ttotal: 12.2s\tremaining: 850ms\n",
      "187:\tlearn: 0.2231426\ttotal: 12.3s\tremaining: 784ms\n",
      "188:\tlearn: 0.2231138\ttotal: 12.4s\tremaining: 719ms\n",
      "189:\tlearn: 0.2227511\ttotal: 12.4s\tremaining: 654ms\n",
      "190:\tlearn: 0.2223536\ttotal: 12.5s\tremaining: 588ms\n",
      "191:\tlearn: 0.2221296\ttotal: 12.6s\tremaining: 523ms\n",
      "192:\tlearn: 0.2219507\ttotal: 12.6s\tremaining: 458ms\n",
      "193:\tlearn: 0.2217029\ttotal: 12.7s\tremaining: 392ms\n",
      "194:\tlearn: 0.2214195\ttotal: 12.7s\tremaining: 326ms\n",
      "195:\tlearn: 0.2211347\ttotal: 12.8s\tremaining: 261ms\n",
      "196:\tlearn: 0.2210406\ttotal: 12.8s\tremaining: 196ms\n",
      "197:\tlearn: 0.2208029\ttotal: 12.9s\tremaining: 130ms\n",
      "198:\tlearn: 0.2205557\ttotal: 12.9s\tremaining: 65ms\n",
      "199:\tlearn: 0.2204761\ttotal: 13s\tremaining: 0us\n",
      "0:\tlearn: 0.4890502\ttotal: 55.1ms\tremaining: 11s\n",
      "1:\tlearn: 0.4065357\ttotal: 97.4ms\tremaining: 9.64s\n",
      "2:\tlearn: 0.3695467\ttotal: 136ms\tremaining: 8.96s\n",
      "3:\tlearn: 0.3539389\ttotal: 175ms\tremaining: 8.58s\n",
      "4:\tlearn: 0.3424754\ttotal: 225ms\tremaining: 8.78s\n",
      "5:\tlearn: 0.3330650\ttotal: 393ms\tremaining: 12.7s\n",
      "6:\tlearn: 0.3237089\ttotal: 485ms\tremaining: 13.4s\n",
      "7:\tlearn: 0.3182396\ttotal: 554ms\tremaining: 13.3s\n",
      "8:\tlearn: 0.3143113\ttotal: 623ms\tremaining: 13.2s\n",
      "9:\tlearn: 0.3074310\ttotal: 676ms\tremaining: 12.8s\n",
      "10:\tlearn: 0.3052278\ttotal: 718ms\tremaining: 12.3s\n",
      "11:\tlearn: 0.3019601\ttotal: 764ms\tremaining: 12s\n",
      "12:\tlearn: 0.2995476\ttotal: 803ms\tremaining: 11.5s\n",
      "13:\tlearn: 0.2982782\ttotal: 877ms\tremaining: 11.7s\n",
      "14:\tlearn: 0.2971409\ttotal: 922ms\tremaining: 11.4s\n",
      "15:\tlearn: 0.2958994\ttotal: 965ms\tremaining: 11.1s\n",
      "16:\tlearn: 0.2941196\ttotal: 1.01s\tremaining: 10.9s\n",
      "17:\tlearn: 0.2925659\ttotal: 1.08s\tremaining: 10.9s\n",
      "18:\tlearn: 0.2884236\ttotal: 1.13s\tremaining: 10.8s\n",
      "19:\tlearn: 0.2873662\ttotal: 1.17s\tremaining: 10.5s\n",
      "20:\tlearn: 0.2867908\ttotal: 1.21s\tremaining: 10.3s\n",
      "21:\tlearn: 0.2859630\ttotal: 1.28s\tremaining: 10.4s\n",
      "22:\tlearn: 0.2844540\ttotal: 1.32s\tremaining: 10.2s\n",
      "23:\tlearn: 0.2833664\ttotal: 1.36s\tremaining: 9.99s\n",
      "24:\tlearn: 0.2829578\ttotal: 1.4s\tremaining: 9.8s\n",
      "25:\tlearn: 0.2820594\ttotal: 1.48s\tremaining: 9.89s\n",
      "26:\tlearn: 0.2813476\ttotal: 1.54s\tremaining: 9.87s\n",
      "27:\tlearn: 0.2804058\ttotal: 1.59s\tremaining: 9.79s\n",
      "28:\tlearn: 0.2800862\ttotal: 1.65s\tremaining: 9.76s\n",
      "29:\tlearn: 0.2790213\ttotal: 1.71s\tremaining: 9.68s\n",
      "30:\tlearn: 0.2784915\ttotal: 1.75s\tremaining: 9.54s\n",
      "31:\tlearn: 0.2781184\ttotal: 1.79s\tremaining: 9.42s\n",
      "32:\tlearn: 0.2774706\ttotal: 1.86s\tremaining: 9.41s\n",
      "33:\tlearn: 0.2769830\ttotal: 1.9s\tremaining: 9.29s\n",
      "34:\tlearn: 0.2765610\ttotal: 1.94s\tremaining: 9.17s\n",
      "35:\tlearn: 0.2759578\ttotal: 2.02s\tremaining: 9.19s\n",
      "36:\tlearn: 0.2753296\ttotal: 2.09s\tremaining: 9.19s\n",
      "37:\tlearn: 0.2745335\ttotal: 2.13s\tremaining: 9.07s\n",
      "38:\tlearn: 0.2739600\ttotal: 2.2s\tremaining: 9.08s\n",
      "39:\tlearn: 0.2735087\ttotal: 2.27s\tremaining: 9.06s\n",
      "40:\tlearn: 0.2724216\ttotal: 2.37s\tremaining: 9.19s\n",
      "41:\tlearn: 0.2723521\ttotal: 2.47s\tremaining: 9.3s\n",
      "42:\tlearn: 0.2715928\ttotal: 2.71s\tremaining: 9.88s\n",
      "43:\tlearn: 0.2709497\ttotal: 2.9s\tremaining: 10.3s\n",
      "44:\tlearn: 0.2703100\ttotal: 2.96s\tremaining: 10.2s\n",
      "45:\tlearn: 0.2695307\ttotal: 3.07s\tremaining: 10.3s\n",
      "46:\tlearn: 0.2688942\ttotal: 3.13s\tremaining: 10.2s\n",
      "47:\tlearn: 0.2681200\ttotal: 3.19s\tremaining: 10.1s\n",
      "48:\tlearn: 0.2676686\ttotal: 3.27s\tremaining: 10.1s\n",
      "49:\tlearn: 0.2669230\ttotal: 3.34s\tremaining: 10s\n",
      "50:\tlearn: 0.2663142\ttotal: 3.4s\tremaining: 9.94s\n",
      "51:\tlearn: 0.2658611\ttotal: 3.45s\tremaining: 9.83s\n",
      "52:\tlearn: 0.2655697\ttotal: 3.5s\tremaining: 9.71s\n",
      "53:\tlearn: 0.2652779\ttotal: 3.54s\tremaining: 9.57s\n",
      "54:\tlearn: 0.2650319\ttotal: 3.62s\tremaining: 9.54s\n",
      "55:\tlearn: 0.2645317\ttotal: 3.68s\tremaining: 9.46s\n",
      "56:\tlearn: 0.2642273\ttotal: 3.76s\tremaining: 9.45s\n",
      "57:\tlearn: 0.2637379\ttotal: 3.82s\tremaining: 9.35s\n",
      "58:\tlearn: 0.2631261\ttotal: 3.87s\tremaining: 9.26s\n",
      "59:\tlearn: 0.2624877\ttotal: 3.95s\tremaining: 9.21s\n",
      "60:\tlearn: 0.2620016\ttotal: 4s\tremaining: 9.12s\n",
      "61:\tlearn: 0.2615522\ttotal: 4.06s\tremaining: 9.04s\n",
      "62:\tlearn: 0.2612598\ttotal: 4.12s\tremaining: 8.96s\n",
      "63:\tlearn: 0.2609154\ttotal: 4.17s\tremaining: 8.86s\n",
      "64:\tlearn: 0.2605782\ttotal: 4.23s\tremaining: 8.79s\n",
      "65:\tlearn: 0.2602267\ttotal: 4.27s\tremaining: 8.67s\n",
      "66:\tlearn: 0.2601397\ttotal: 4.31s\tremaining: 8.56s\n",
      "67:\tlearn: 0.2590525\ttotal: 4.35s\tremaining: 8.44s\n",
      "68:\tlearn: 0.2586171\ttotal: 4.4s\tremaining: 8.35s\n",
      "69:\tlearn: 0.2579246\ttotal: 4.46s\tremaining: 8.28s\n",
      "70:\tlearn: 0.2575056\ttotal: 4.51s\tremaining: 8.2s\n",
      "71:\tlearn: 0.2570127\ttotal: 4.55s\tremaining: 8.09s\n",
      "72:\tlearn: 0.2566638\ttotal: 4.59s\tremaining: 7.99s\n",
      "73:\tlearn: 0.2565051\ttotal: 4.66s\tremaining: 7.94s\n",
      "74:\tlearn: 0.2561494\ttotal: 4.72s\tremaining: 7.87s\n",
      "75:\tlearn: 0.2558822\ttotal: 4.78s\tremaining: 7.81s\n",
      "76:\tlearn: 0.2555268\ttotal: 4.85s\tremaining: 7.75s\n",
      "77:\tlearn: 0.2551042\ttotal: 4.91s\tremaining: 7.68s\n",
      "78:\tlearn: 0.2548623\ttotal: 5.07s\tremaining: 7.76s\n",
      "79:\tlearn: 0.2546431\ttotal: 5.19s\tremaining: 7.78s\n",
      "80:\tlearn: 0.2544248\ttotal: 5.3s\tremaining: 7.79s\n",
      "81:\tlearn: 0.2538896\ttotal: 5.36s\tremaining: 7.72s\n",
      "82:\tlearn: 0.2536727\ttotal: 5.42s\tremaining: 7.63s\n",
      "83:\tlearn: 0.2532410\ttotal: 5.51s\tremaining: 7.61s\n",
      "84:\tlearn: 0.2527357\ttotal: 5.6s\tremaining: 7.57s\n",
      "85:\tlearn: 0.2525648\ttotal: 5.67s\tremaining: 7.51s\n",
      "86:\tlearn: 0.2522336\ttotal: 5.73s\tremaining: 7.44s\n",
      "87:\tlearn: 0.2518509\ttotal: 5.81s\tremaining: 7.39s\n",
      "88:\tlearn: 0.2513285\ttotal: 5.88s\tremaining: 7.33s\n",
      "89:\tlearn: 0.2507566\ttotal: 5.97s\tremaining: 7.3s\n",
      "90:\tlearn: 0.2504325\ttotal: 6.07s\tremaining: 7.26s\n",
      "91:\tlearn: 0.2502066\ttotal: 6.11s\tremaining: 7.18s\n",
      "92:\tlearn: 0.2500442\ttotal: 6.16s\tremaining: 7.08s\n",
      "93:\tlearn: 0.2495353\ttotal: 6.21s\tremaining: 7s\n",
      "94:\tlearn: 0.2493301\ttotal: 6.26s\tremaining: 6.92s\n",
      "95:\tlearn: 0.2488095\ttotal: 6.31s\tremaining: 6.84s\n",
      "96:\tlearn: 0.2484419\ttotal: 6.38s\tremaining: 6.77s\n",
      "97:\tlearn: 0.2480089\ttotal: 6.45s\tremaining: 6.71s\n",
      "98:\tlearn: 0.2477222\ttotal: 6.52s\tremaining: 6.65s\n",
      "99:\tlearn: 0.2475948\ttotal: 6.56s\tremaining: 6.56s\n",
      "100:\tlearn: 0.2473987\ttotal: 6.63s\tremaining: 6.5s\n",
      "101:\tlearn: 0.2471946\ttotal: 6.68s\tremaining: 6.42s\n",
      "102:\tlearn: 0.2470436\ttotal: 6.72s\tremaining: 6.33s\n",
      "103:\tlearn: 0.2467856\ttotal: 6.79s\tremaining: 6.26s\n",
      "104:\tlearn: 0.2465686\ttotal: 6.86s\tremaining: 6.21s\n",
      "105:\tlearn: 0.2462952\ttotal: 6.93s\tremaining: 6.15s\n",
      "106:\tlearn: 0.2459949\ttotal: 7.02s\tremaining: 6.1s\n",
      "107:\tlearn: 0.2455428\ttotal: 7.08s\tremaining: 6.03s\n",
      "108:\tlearn: 0.2452547\ttotal: 7.2s\tremaining: 6.01s\n",
      "109:\tlearn: 0.2448829\ttotal: 7.34s\tremaining: 6s\n",
      "110:\tlearn: 0.2444251\ttotal: 7.52s\tremaining: 6.03s\n",
      "111:\tlearn: 0.2442843\ttotal: 7.58s\tremaining: 5.96s\n",
      "112:\tlearn: 0.2437936\ttotal: 7.65s\tremaining: 5.89s\n",
      "113:\tlearn: 0.2434952\ttotal: 7.71s\tremaining: 5.81s\n",
      "114:\tlearn: 0.2433109\ttotal: 7.75s\tremaining: 5.73s\n",
      "115:\tlearn: 0.2431769\ttotal: 7.82s\tremaining: 5.66s\n",
      "116:\tlearn: 0.2429923\ttotal: 7.89s\tremaining: 5.6s\n",
      "117:\tlearn: 0.2428818\ttotal: 7.95s\tremaining: 5.53s\n",
      "118:\tlearn: 0.2425887\ttotal: 8s\tremaining: 5.44s\n",
      "119:\tlearn: 0.2421810\ttotal: 8.06s\tremaining: 5.38s\n",
      "120:\tlearn: 0.2418144\ttotal: 8.12s\tremaining: 5.3s\n",
      "121:\tlearn: 0.2415742\ttotal: 8.21s\tremaining: 5.25s\n",
      "122:\tlearn: 0.2414818\ttotal: 8.28s\tremaining: 5.18s\n",
      "123:\tlearn: 0.2411942\ttotal: 8.32s\tremaining: 5.1s\n",
      "124:\tlearn: 0.2408634\ttotal: 8.37s\tremaining: 5.02s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "125:\tlearn: 0.2407461\ttotal: 8.42s\tremaining: 4.94s\n",
      "126:\tlearn: 0.2404338\ttotal: 8.5s\tremaining: 4.88s\n",
      "127:\tlearn: 0.2400488\ttotal: 8.54s\tremaining: 4.8s\n",
      "128:\tlearn: 0.2396984\ttotal: 8.63s\tremaining: 4.75s\n",
      "129:\tlearn: 0.2393968\ttotal: 8.7s\tremaining: 4.68s\n",
      "130:\tlearn: 0.2392224\ttotal: 8.75s\tremaining: 4.61s\n",
      "131:\tlearn: 0.2389273\ttotal: 8.82s\tremaining: 4.54s\n",
      "132:\tlearn: 0.2388540\ttotal: 8.88s\tremaining: 4.47s\n",
      "133:\tlearn: 0.2387392\ttotal: 8.95s\tremaining: 4.41s\n",
      "134:\tlearn: 0.2385877\ttotal: 9.01s\tremaining: 4.34s\n",
      "135:\tlearn: 0.2384826\ttotal: 9.08s\tremaining: 4.27s\n",
      "136:\tlearn: 0.2383555\ttotal: 9.16s\tremaining: 4.21s\n",
      "137:\tlearn: 0.2382372\ttotal: 9.2s\tremaining: 4.13s\n",
      "138:\tlearn: 0.2381184\ttotal: 9.29s\tremaining: 4.08s\n",
      "139:\tlearn: 0.2378536\ttotal: 9.37s\tremaining: 4.02s\n",
      "140:\tlearn: 0.2375947\ttotal: 9.44s\tremaining: 3.95s\n",
      "141:\tlearn: 0.2374298\ttotal: 9.5s\tremaining: 3.88s\n",
      "142:\tlearn: 0.2371343\ttotal: 9.62s\tremaining: 3.83s\n",
      "143:\tlearn: 0.2369157\ttotal: 9.81s\tremaining: 3.81s\n",
      "144:\tlearn: 0.2365334\ttotal: 9.86s\tremaining: 3.74s\n",
      "145:\tlearn: 0.2363154\ttotal: 9.93s\tremaining: 3.67s\n",
      "146:\tlearn: 0.2360043\ttotal: 9.99s\tremaining: 3.6s\n",
      "147:\tlearn: 0.2358559\ttotal: 10.1s\tremaining: 3.54s\n",
      "148:\tlearn: 0.2357459\ttotal: 10.2s\tremaining: 3.47s\n",
      "149:\tlearn: 0.2354444\ttotal: 10.2s\tremaining: 3.4s\n",
      "150:\tlearn: 0.2351939\ttotal: 10.3s\tremaining: 3.34s\n",
      "151:\tlearn: 0.2349027\ttotal: 10.4s\tremaining: 3.27s\n",
      "152:\tlearn: 0.2347561\ttotal: 10.4s\tremaining: 3.21s\n",
      "153:\tlearn: 0.2345881\ttotal: 10.5s\tremaining: 3.13s\n",
      "154:\tlearn: 0.2344919\ttotal: 10.5s\tremaining: 3.05s\n",
      "155:\tlearn: 0.2343039\ttotal: 10.6s\tremaining: 2.99s\n",
      "156:\tlearn: 0.2341722\ttotal: 10.7s\tremaining: 2.92s\n",
      "157:\tlearn: 0.2339119\ttotal: 10.7s\tremaining: 2.85s\n",
      "158:\tlearn: 0.2336555\ttotal: 10.8s\tremaining: 2.77s\n",
      "159:\tlearn: 0.2333917\ttotal: 10.8s\tremaining: 2.7s\n",
      "160:\tlearn: 0.2332115\ttotal: 10.9s\tremaining: 2.63s\n",
      "161:\tlearn: 0.2329097\ttotal: 10.9s\tremaining: 2.57s\n",
      "162:\tlearn: 0.2327672\ttotal: 11s\tremaining: 2.5s\n",
      "163:\tlearn: 0.2324471\ttotal: 11.1s\tremaining: 2.43s\n",
      "164:\tlearn: 0.2321162\ttotal: 11.1s\tremaining: 2.36s\n",
      "165:\tlearn: 0.2318249\ttotal: 11.2s\tremaining: 2.29s\n",
      "166:\tlearn: 0.2314577\ttotal: 11.2s\tremaining: 2.22s\n",
      "167:\tlearn: 0.2310676\ttotal: 11.3s\tremaining: 2.15s\n",
      "168:\tlearn: 0.2307966\ttotal: 11.4s\tremaining: 2.08s\n",
      "169:\tlearn: 0.2303878\ttotal: 11.4s\tremaining: 2.02s\n",
      "170:\tlearn: 0.2302720\ttotal: 11.5s\tremaining: 1.95s\n",
      "171:\tlearn: 0.2302258\ttotal: 11.7s\tremaining: 1.9s\n",
      "172:\tlearn: 0.2299792\ttotal: 11.7s\tremaining: 1.83s\n",
      "173:\tlearn: 0.2295774\ttotal: 11.8s\tremaining: 1.76s\n",
      "174:\tlearn: 0.2295170\ttotal: 12s\tremaining: 1.71s\n",
      "175:\tlearn: 0.2292344\ttotal: 12s\tremaining: 1.64s\n",
      "176:\tlearn: 0.2291135\ttotal: 12.1s\tremaining: 1.57s\n",
      "177:\tlearn: 0.2290077\ttotal: 12.2s\tremaining: 1.5s\n",
      "178:\tlearn: 0.2289985\ttotal: 12.3s\tremaining: 1.44s\n",
      "179:\tlearn: 0.2286697\ttotal: 12.3s\tremaining: 1.37s\n",
      "180:\tlearn: 0.2284767\ttotal: 12.4s\tremaining: 1.3s\n",
      "181:\tlearn: 0.2283670\ttotal: 12.5s\tremaining: 1.24s\n",
      "182:\tlearn: 0.2283317\ttotal: 12.6s\tremaining: 1.17s\n",
      "183:\tlearn: 0.2282459\ttotal: 12.6s\tremaining: 1.1s\n",
      "184:\tlearn: 0.2279832\ttotal: 12.8s\tremaining: 1.04s\n",
      "185:\tlearn: 0.2278340\ttotal: 12.9s\tremaining: 970ms\n",
      "186:\tlearn: 0.2277636\ttotal: 13s\tremaining: 902ms\n",
      "187:\tlearn: 0.2274997\ttotal: 13.1s\tremaining: 833ms\n",
      "188:\tlearn: 0.2272182\ttotal: 13.2s\tremaining: 766ms\n",
      "189:\tlearn: 0.2272009\ttotal: 13.2s\tremaining: 697ms\n",
      "190:\tlearn: 0.2269597\ttotal: 13.3s\tremaining: 628ms\n",
      "191:\tlearn: 0.2266441\ttotal: 13.5s\tremaining: 561ms\n",
      "192:\tlearn: 0.2263687\ttotal: 13.5s\tremaining: 491ms\n",
      "193:\tlearn: 0.2261245\ttotal: 13.6s\tremaining: 421ms\n",
      "194:\tlearn: 0.2258398\ttotal: 13.7s\tremaining: 350ms\n",
      "195:\tlearn: 0.2255128\ttotal: 13.7s\tremaining: 280ms\n",
      "196:\tlearn: 0.2253228\ttotal: 13.8s\tremaining: 210ms\n",
      "197:\tlearn: 0.2250837\ttotal: 13.8s\tremaining: 140ms\n",
      "198:\tlearn: 0.2249329\ttotal: 13.9s\tremaining: 69.7ms\n",
      "199:\tlearn: 0.2246559\ttotal: 14s\tremaining: 0us\n",
      "0:\tlearn: 0.4884659\ttotal: 40.4ms\tremaining: 8.04s\n",
      "1:\tlearn: 0.4081357\ttotal: 84.6ms\tremaining: 8.37s\n",
      "2:\tlearn: 0.3744098\ttotal: 123ms\tremaining: 8.09s\n",
      "3:\tlearn: 0.3574307\ttotal: 178ms\tremaining: 8.72s\n",
      "4:\tlearn: 0.3450571\ttotal: 224ms\tremaining: 8.73s\n",
      "5:\tlearn: 0.3357138\ttotal: 289ms\tremaining: 9.33s\n",
      "6:\tlearn: 0.3270779\ttotal: 329ms\tremaining: 9.07s\n",
      "7:\tlearn: 0.3206461\ttotal: 403ms\tremaining: 9.67s\n",
      "8:\tlearn: 0.3153183\ttotal: 466ms\tremaining: 9.88s\n",
      "9:\tlearn: 0.3124480\ttotal: 527ms\tremaining: 10s\n",
      "10:\tlearn: 0.3097381\ttotal: 593ms\tremaining: 10.2s\n",
      "11:\tlearn: 0.3064184\ttotal: 647ms\tremaining: 10.1s\n",
      "12:\tlearn: 0.3028931\ttotal: 708ms\tremaining: 10.2s\n",
      "13:\tlearn: 0.3009571\ttotal: 786ms\tremaining: 10.4s\n",
      "14:\tlearn: 0.2994812\ttotal: 843ms\tremaining: 10.4s\n",
      "15:\tlearn: 0.2971076\ttotal: 910ms\tremaining: 10.5s\n",
      "16:\tlearn: 0.2962274\ttotal: 961ms\tremaining: 10.3s\n",
      "17:\tlearn: 0.2953282\ttotal: 1.02s\tremaining: 10.3s\n",
      "18:\tlearn: 0.2936366\ttotal: 1.08s\tremaining: 10.3s\n",
      "19:\tlearn: 0.2923238\ttotal: 1.14s\tremaining: 10.3s\n",
      "20:\tlearn: 0.2914909\ttotal: 1.19s\tremaining: 10.1s\n",
      "21:\tlearn: 0.2903283\ttotal: 1.24s\tremaining: 10s\n",
      "22:\tlearn: 0.2891810\ttotal: 1.3s\tremaining: 10s\n",
      "23:\tlearn: 0.2882041\ttotal: 1.34s\tremaining: 9.86s\n",
      "24:\tlearn: 0.2877538\ttotal: 1.39s\tremaining: 9.73s\n",
      "25:\tlearn: 0.2873292\ttotal: 1.44s\tremaining: 9.63s\n",
      "26:\tlearn: 0.2868595\ttotal: 1.51s\tremaining: 9.67s\n",
      "27:\tlearn: 0.2853838\ttotal: 1.55s\tremaining: 9.53s\n",
      "28:\tlearn: 0.2849605\ttotal: 1.59s\tremaining: 9.37s\n",
      "29:\tlearn: 0.2836869\ttotal: 1.63s\tremaining: 9.24s\n",
      "30:\tlearn: 0.2831392\ttotal: 1.7s\tremaining: 9.24s\n",
      "31:\tlearn: 0.2825578\ttotal: 1.75s\tremaining: 9.17s\n",
      "32:\tlearn: 0.2819614\ttotal: 1.79s\tremaining: 9.05s\n",
      "33:\tlearn: 0.2810398\ttotal: 1.83s\tremaining: 8.94s\n",
      "34:\tlearn: 0.2772979\ttotal: 1.89s\tremaining: 8.91s\n",
      "35:\tlearn: 0.2761708\ttotal: 1.95s\tremaining: 8.9s\n",
      "36:\tlearn: 0.2755190\ttotal: 2.12s\tremaining: 9.35s\n",
      "37:\tlearn: 0.2749496\ttotal: 2.17s\tremaining: 9.23s\n",
      "38:\tlearn: 0.2743249\ttotal: 2.23s\tremaining: 9.19s\n",
      "39:\tlearn: 0.2733811\ttotal: 2.27s\tremaining: 9.08s\n",
      "40:\tlearn: 0.2730010\ttotal: 2.31s\tremaining: 8.95s\n",
      "41:\tlearn: 0.2724098\ttotal: 2.35s\tremaining: 8.86s\n",
      "42:\tlearn: 0.2718207\ttotal: 2.44s\tremaining: 8.93s\n",
      "43:\tlearn: 0.2711741\ttotal: 2.5s\tremaining: 8.87s\n",
      "44:\tlearn: 0.2700980\ttotal: 2.56s\tremaining: 8.83s\n",
      "45:\tlearn: 0.2695197\ttotal: 2.67s\tremaining: 8.93s\n",
      "46:\tlearn: 0.2691774\ttotal: 2.71s\tremaining: 8.81s\n",
      "47:\tlearn: 0.2683061\ttotal: 2.75s\tremaining: 8.7s\n",
      "48:\tlearn: 0.2675424\ttotal: 2.79s\tremaining: 8.61s\n",
      "49:\tlearn: 0.2671479\ttotal: 2.85s\tremaining: 8.57s\n",
      "50:\tlearn: 0.2668149\ttotal: 2.89s\tremaining: 8.45s\n",
      "51:\tlearn: 0.2664718\ttotal: 2.95s\tremaining: 8.39s\n",
      "52:\tlearn: 0.2654729\ttotal: 3.08s\tremaining: 8.54s\n",
      "53:\tlearn: 0.2651965\ttotal: 3.17s\tremaining: 8.57s\n",
      "54:\tlearn: 0.2649209\ttotal: 3.24s\tremaining: 8.53s\n",
      "55:\tlearn: 0.2643448\ttotal: 3.32s\tremaining: 8.54s\n",
      "56:\tlearn: 0.2639125\ttotal: 3.4s\tremaining: 8.53s\n",
      "57:\tlearn: 0.2632846\ttotal: 3.49s\tremaining: 8.54s\n",
      "58:\tlearn: 0.2628201\ttotal: 3.62s\tremaining: 8.66s\n",
      "59:\tlearn: 0.2624109\ttotal: 3.7s\tremaining: 8.63s\n",
      "60:\tlearn: 0.2620855\ttotal: 3.76s\tremaining: 8.57s\n",
      "61:\tlearn: 0.2615069\ttotal: 3.81s\tremaining: 8.48s\n",
      "62:\tlearn: 0.2610773\ttotal: 3.91s\tremaining: 8.5s\n",
      "63:\tlearn: 0.2607377\ttotal: 3.96s\tremaining: 8.43s\n",
      "64:\tlearn: 0.2605772\ttotal: 4.01s\tremaining: 8.33s\n",
      "65:\tlearn: 0.2599661\ttotal: 4.06s\tremaining: 8.25s\n",
      "66:\tlearn: 0.2594736\ttotal: 4.15s\tremaining: 8.25s\n",
      "67:\tlearn: 0.2588857\ttotal: 4.28s\tremaining: 8.3s\n",
      "68:\tlearn: 0.2586601\ttotal: 4.35s\tremaining: 8.26s\n",
      "69:\tlearn: 0.2583609\ttotal: 4.4s\tremaining: 8.17s\n",
      "70:\tlearn: 0.2581312\ttotal: 4.45s\tremaining: 8.09s\n",
      "71:\tlearn: 0.2577099\ttotal: 4.52s\tremaining: 8.04s\n",
      "72:\tlearn: 0.2572858\ttotal: 4.59s\tremaining: 7.99s\n",
      "73:\tlearn: 0.2568230\ttotal: 4.73s\tremaining: 8.06s\n",
      "74:\tlearn: 0.2563117\ttotal: 4.85s\tremaining: 8.08s\n",
      "75:\tlearn: 0.2558346\ttotal: 5.01s\tremaining: 8.17s\n",
      "76:\tlearn: 0.2553333\ttotal: 5.12s\tremaining: 8.18s\n",
      "77:\tlearn: 0.2544442\ttotal: 5.21s\tremaining: 8.14s\n",
      "78:\tlearn: 0.2538222\ttotal: 5.32s\tremaining: 8.14s\n",
      "79:\tlearn: 0.2537445\ttotal: 5.37s\tremaining: 8.06s\n",
      "80:\tlearn: 0.2534349\ttotal: 5.42s\tremaining: 7.96s\n",
      "81:\tlearn: 0.2531215\ttotal: 5.5s\tremaining: 7.91s\n",
      "82:\tlearn: 0.2527374\ttotal: 5.54s\tremaining: 7.8s\n",
      "83:\tlearn: 0.2525875\ttotal: 5.58s\tremaining: 7.7s\n",
      "84:\tlearn: 0.2522913\ttotal: 5.62s\tremaining: 7.6s\n",
      "85:\tlearn: 0.2519001\ttotal: 5.7s\tremaining: 7.55s\n",
      "86:\tlearn: 0.2513308\ttotal: 5.75s\tremaining: 7.47s\n",
      "87:\tlearn: 0.2508407\ttotal: 5.79s\tremaining: 7.37s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "88:\tlearn: 0.2506509\ttotal: 5.85s\tremaining: 7.3s\n",
      "89:\tlearn: 0.2501783\ttotal: 5.9s\tremaining: 7.22s\n",
      "90:\tlearn: 0.2500411\ttotal: 5.94s\tremaining: 7.12s\n",
      "91:\tlearn: 0.2495824\ttotal: 5.99s\tremaining: 7.03s\n",
      "92:\tlearn: 0.2490950\ttotal: 6.02s\tremaining: 6.93s\n",
      "93:\tlearn: 0.2488926\ttotal: 6.06s\tremaining: 6.84s\n",
      "94:\tlearn: 0.2484046\ttotal: 6.13s\tremaining: 6.78s\n",
      "95:\tlearn: 0.2481794\ttotal: 6.17s\tremaining: 6.69s\n",
      "96:\tlearn: 0.2479094\ttotal: 6.22s\tremaining: 6.61s\n",
      "97:\tlearn: 0.2474333\ttotal: 6.28s\tremaining: 6.53s\n",
      "98:\tlearn: 0.2472361\ttotal: 6.33s\tremaining: 6.46s\n",
      "99:\tlearn: 0.2471621\ttotal: 6.52s\tremaining: 6.52s\n",
      "100:\tlearn: 0.2467285\ttotal: 6.57s\tremaining: 6.44s\n",
      "101:\tlearn: 0.2464162\ttotal: 6.61s\tremaining: 6.35s\n",
      "102:\tlearn: 0.2463307\ttotal: 6.65s\tremaining: 6.26s\n",
      "103:\tlearn: 0.2461855\ttotal: 6.69s\tremaining: 6.18s\n",
      "104:\tlearn: 0.2459343\ttotal: 6.76s\tremaining: 6.12s\n",
      "105:\tlearn: 0.2456722\ttotal: 6.82s\tremaining: 6.05s\n",
      "106:\tlearn: 0.2453904\ttotal: 6.86s\tremaining: 5.96s\n",
      "107:\tlearn: 0.2450109\ttotal: 6.91s\tremaining: 5.88s\n",
      "108:\tlearn: 0.2446274\ttotal: 6.95s\tremaining: 5.8s\n",
      "109:\tlearn: 0.2444840\ttotal: 7.03s\tremaining: 5.75s\n",
      "110:\tlearn: 0.2441018\ttotal: 7.09s\tremaining: 5.68s\n",
      "111:\tlearn: 0.2437408\ttotal: 7.14s\tremaining: 5.61s\n",
      "112:\tlearn: 0.2434843\ttotal: 7.21s\tremaining: 5.55s\n",
      "113:\tlearn: 0.2432032\ttotal: 7.25s\tremaining: 5.47s\n",
      "114:\tlearn: 0.2430427\ttotal: 7.33s\tremaining: 5.42s\n",
      "115:\tlearn: 0.2426406\ttotal: 7.42s\tremaining: 5.38s\n",
      "116:\tlearn: 0.2424035\ttotal: 7.47s\tremaining: 5.3s\n",
      "117:\tlearn: 0.2421204\ttotal: 7.51s\tremaining: 5.22s\n",
      "118:\tlearn: 0.2417192\ttotal: 7.59s\tremaining: 5.17s\n",
      "119:\tlearn: 0.2413040\ttotal: 7.65s\tremaining: 5.1s\n",
      "120:\tlearn: 0.2410454\ttotal: 7.71s\tremaining: 5.03s\n",
      "121:\tlearn: 0.2407491\ttotal: 7.76s\tremaining: 4.96s\n",
      "122:\tlearn: 0.2403673\ttotal: 7.82s\tremaining: 4.89s\n",
      "123:\tlearn: 0.2401332\ttotal: 7.89s\tremaining: 4.83s\n",
      "124:\tlearn: 0.2397060\ttotal: 7.96s\tremaining: 4.77s\n",
      "125:\tlearn: 0.2394986\ttotal: 8.02s\tremaining: 4.71s\n",
      "126:\tlearn: 0.2390124\ttotal: 8.09s\tremaining: 4.65s\n",
      "127:\tlearn: 0.2387007\ttotal: 8.14s\tremaining: 4.58s\n",
      "128:\tlearn: 0.2384749\ttotal: 8.18s\tremaining: 4.5s\n",
      "129:\tlearn: 0.2380753\ttotal: 8.22s\tremaining: 4.42s\n",
      "130:\tlearn: 0.2378170\ttotal: 8.41s\tremaining: 4.43s\n",
      "131:\tlearn: 0.2375372\ttotal: 8.6s\tremaining: 4.43s\n",
      "132:\tlearn: 0.2372601\ttotal: 8.9s\tremaining: 4.48s\n",
      "133:\tlearn: 0.2368860\ttotal: 9.2s\tremaining: 4.53s\n",
      "134:\tlearn: 0.2365697\ttotal: 9.56s\tremaining: 4.6s\n",
      "135:\tlearn: 0.2363524\ttotal: 9.73s\tremaining: 4.58s\n",
      "136:\tlearn: 0.2360234\ttotal: 9.85s\tremaining: 4.53s\n",
      "137:\tlearn: 0.2357628\ttotal: 9.91s\tremaining: 4.45s\n",
      "138:\tlearn: 0.2354255\ttotal: 9.98s\tremaining: 4.38s\n",
      "139:\tlearn: 0.2349524\ttotal: 10s\tremaining: 4.3s\n",
      "140:\tlearn: 0.2346763\ttotal: 10.1s\tremaining: 4.24s\n",
      "141:\tlearn: 0.2346136\ttotal: 10.2s\tremaining: 4.16s\n",
      "142:\tlearn: 0.2343162\ttotal: 10.2s\tremaining: 4.08s\n",
      "143:\tlearn: 0.2340251\ttotal: 10.3s\tremaining: 4.01s\n",
      "144:\tlearn: 0.2339311\ttotal: 10.4s\tremaining: 3.94s\n",
      "145:\tlearn: 0.2336207\ttotal: 10.5s\tremaining: 3.87s\n",
      "146:\tlearn: 0.2332967\ttotal: 10.5s\tremaining: 3.8s\n",
      "147:\tlearn: 0.2328957\ttotal: 10.6s\tremaining: 3.73s\n",
      "148:\tlearn: 0.2326389\ttotal: 10.7s\tremaining: 3.66s\n",
      "149:\tlearn: 0.2324441\ttotal: 10.8s\tremaining: 3.6s\n",
      "150:\tlearn: 0.2320716\ttotal: 10.9s\tremaining: 3.53s\n",
      "151:\tlearn: 0.2319136\ttotal: 10.9s\tremaining: 3.45s\n",
      "152:\tlearn: 0.2317923\ttotal: 11s\tremaining: 3.38s\n",
      "153:\tlearn: 0.2317794\ttotal: 11.1s\tremaining: 3.32s\n",
      "154:\tlearn: 0.2315852\ttotal: 11.3s\tremaining: 3.27s\n",
      "155:\tlearn: 0.2315210\ttotal: 11.5s\tremaining: 3.24s\n",
      "156:\tlearn: 0.2311333\ttotal: 11.6s\tremaining: 3.17s\n",
      "157:\tlearn: 0.2306947\ttotal: 11.6s\tremaining: 3.1s\n",
      "158:\tlearn: 0.2303265\ttotal: 11.8s\tremaining: 3.03s\n",
      "159:\tlearn: 0.2300096\ttotal: 11.8s\tremaining: 2.95s\n",
      "160:\tlearn: 0.2297845\ttotal: 11.9s\tremaining: 2.88s\n",
      "161:\tlearn: 0.2296905\ttotal: 11.9s\tremaining: 2.8s\n",
      "162:\tlearn: 0.2295913\ttotal: 12s\tremaining: 2.72s\n",
      "163:\tlearn: 0.2292160\ttotal: 12.1s\tremaining: 2.65s\n",
      "164:\tlearn: 0.2289030\ttotal: 12.1s\tremaining: 2.57s\n",
      "165:\tlearn: 0.2285491\ttotal: 12.2s\tremaining: 2.49s\n",
      "166:\tlearn: 0.2282429\ttotal: 12.2s\tremaining: 2.42s\n",
      "167:\tlearn: 0.2279679\ttotal: 12.3s\tremaining: 2.34s\n",
      "168:\tlearn: 0.2276615\ttotal: 12.4s\tremaining: 2.27s\n",
      "169:\tlearn: 0.2273632\ttotal: 12.4s\tremaining: 2.19s\n",
      "170:\tlearn: 0.2271091\ttotal: 12.5s\tremaining: 2.12s\n",
      "171:\tlearn: 0.2270608\ttotal: 12.5s\tremaining: 2.04s\n",
      "172:\tlearn: 0.2270117\ttotal: 12.6s\tremaining: 1.96s\n",
      "173:\tlearn: 0.2266012\ttotal: 12.7s\tremaining: 1.89s\n",
      "174:\tlearn: 0.2262926\ttotal: 12.7s\tremaining: 1.81s\n",
      "175:\tlearn: 0.2261053\ttotal: 12.7s\tremaining: 1.74s\n",
      "176:\tlearn: 0.2258464\ttotal: 12.8s\tremaining: 1.66s\n",
      "177:\tlearn: 0.2256669\ttotal: 12.9s\tremaining: 1.59s\n",
      "178:\tlearn: 0.2255390\ttotal: 12.9s\tremaining: 1.51s\n",
      "179:\tlearn: 0.2251964\ttotal: 13s\tremaining: 1.44s\n",
      "180:\tlearn: 0.2249162\ttotal: 13s\tremaining: 1.36s\n",
      "181:\tlearn: 0.2247379\ttotal: 13.1s\tremaining: 1.29s\n",
      "182:\tlearn: 0.2244589\ttotal: 13.1s\tremaining: 1.22s\n",
      "183:\tlearn: 0.2242187\ttotal: 13.2s\tremaining: 1.15s\n",
      "184:\tlearn: 0.2241389\ttotal: 13.3s\tremaining: 1.07s\n",
      "185:\tlearn: 0.2240266\ttotal: 13.3s\tremaining: 1s\n",
      "186:\tlearn: 0.2237841\ttotal: 13.3s\tremaining: 927ms\n",
      "187:\tlearn: 0.2235374\ttotal: 13.4s\tremaining: 855ms\n",
      "188:\tlearn: 0.2234114\ttotal: 13.5s\tremaining: 784ms\n",
      "189:\tlearn: 0.2231306\ttotal: 13.6s\tremaining: 718ms\n",
      "190:\tlearn: 0.2230279\ttotal: 13.7s\tremaining: 647ms\n",
      "191:\tlearn: 0.2229991\ttotal: 13.8s\tremaining: 574ms\n",
      "192:\tlearn: 0.2228452\ttotal: 13.8s\tremaining: 501ms\n",
      "193:\tlearn: 0.2224884\ttotal: 13.9s\tremaining: 431ms\n",
      "194:\tlearn: 0.2224450\ttotal: 14s\tremaining: 359ms\n",
      "195:\tlearn: 0.2220808\ttotal: 14s\tremaining: 286ms\n",
      "196:\tlearn: 0.2218511\ttotal: 14.1s\tremaining: 214ms\n",
      "197:\tlearn: 0.2213896\ttotal: 14.1s\tremaining: 143ms\n",
      "198:\tlearn: 0.2211368\ttotal: 14.2s\tremaining: 71.3ms\n",
      "199:\tlearn: 0.2209491\ttotal: 14.2s\tremaining: 0us\n",
      "0:\tlearn: 0.4887360\ttotal: 77.9ms\tremaining: 15.5s\n",
      "1:\tlearn: 0.4110202\ttotal: 120ms\tremaining: 11.9s\n",
      "2:\tlearn: 0.3773557\ttotal: 161ms\tremaining: 10.6s\n",
      "3:\tlearn: 0.3532264\ttotal: 201ms\tremaining: 9.87s\n",
      "4:\tlearn: 0.3401859\ttotal: 242ms\tremaining: 9.44s\n",
      "5:\tlearn: 0.3335600\ttotal: 357ms\tremaining: 11.5s\n",
      "6:\tlearn: 0.3284012\ttotal: 407ms\tremaining: 11.2s\n",
      "7:\tlearn: 0.3238258\ttotal: 451ms\tremaining: 10.8s\n",
      "8:\tlearn: 0.3179218\ttotal: 501ms\tremaining: 10.6s\n",
      "9:\tlearn: 0.3152325\ttotal: 557ms\tremaining: 10.6s\n",
      "10:\tlearn: 0.3090469\ttotal: 635ms\tremaining: 10.9s\n",
      "11:\tlearn: 0.3062557\ttotal: 680ms\tremaining: 10.7s\n",
      "12:\tlearn: 0.3046518\ttotal: 721ms\tremaining: 10.4s\n",
      "13:\tlearn: 0.3032956\ttotal: 761ms\tremaining: 10.1s\n",
      "14:\tlearn: 0.3014581\ttotal: 836ms\tremaining: 10.3s\n",
      "15:\tlearn: 0.2992295\ttotal: 885ms\tremaining: 10.2s\n",
      "16:\tlearn: 0.2964421\ttotal: 928ms\tremaining: 9.99s\n",
      "17:\tlearn: 0.2955067\ttotal: 1.02s\tremaining: 10.3s\n",
      "18:\tlearn: 0.2943390\ttotal: 1.13s\tremaining: 10.8s\n",
      "19:\tlearn: 0.2935424\ttotal: 1.23s\tremaining: 11s\n",
      "20:\tlearn: 0.2928080\ttotal: 1.4s\tremaining: 12s\n",
      "21:\tlearn: 0.2918887\ttotal: 1.51s\tremaining: 12.2s\n",
      "22:\tlearn: 0.2911962\ttotal: 1.58s\tremaining: 12.2s\n",
      "23:\tlearn: 0.2899137\ttotal: 1.66s\tremaining: 12.2s\n",
      "24:\tlearn: 0.2883546\ttotal: 1.95s\tremaining: 13.6s\n",
      "25:\tlearn: 0.2843291\ttotal: 2.03s\tremaining: 13.6s\n",
      "26:\tlearn: 0.2838125\ttotal: 2.1s\tremaining: 13.4s\n",
      "27:\tlearn: 0.2832594\ttotal: 2.16s\tremaining: 13.3s\n",
      "28:\tlearn: 0.2826272\ttotal: 2.23s\tremaining: 13.1s\n",
      "29:\tlearn: 0.2808890\ttotal: 2.27s\tremaining: 12.9s\n",
      "30:\tlearn: 0.2803085\ttotal: 2.31s\tremaining: 12.6s\n",
      "31:\tlearn: 0.2798536\ttotal: 2.36s\tremaining: 12.4s\n",
      "32:\tlearn: 0.2776381\ttotal: 2.43s\tremaining: 12.3s\n",
      "33:\tlearn: 0.2771029\ttotal: 2.48s\tremaining: 12.1s\n",
      "34:\tlearn: 0.2768198\ttotal: 2.53s\tremaining: 11.9s\n",
      "35:\tlearn: 0.2764894\ttotal: 2.63s\tremaining: 12s\n",
      "36:\tlearn: 0.2758915\ttotal: 2.81s\tremaining: 12.4s\n",
      "37:\tlearn: 0.2751363\ttotal: 2.96s\tremaining: 12.6s\n",
      "38:\tlearn: 0.2744130\ttotal: 3.1s\tremaining: 12.8s\n",
      "39:\tlearn: 0.2739829\ttotal: 3.19s\tremaining: 12.7s\n",
      "40:\tlearn: 0.2731363\ttotal: 3.28s\tremaining: 12.7s\n",
      "41:\tlearn: 0.2719138\ttotal: 3.42s\tremaining: 12.8s\n",
      "42:\tlearn: 0.2712089\ttotal: 3.54s\tremaining: 12.9s\n",
      "43:\tlearn: 0.2704257\ttotal: 4.05s\tremaining: 14.4s\n",
      "44:\tlearn: 0.2699935\ttotal: 4.38s\tremaining: 15.1s\n",
      "45:\tlearn: 0.2695278\ttotal: 4.74s\tremaining: 15.9s\n",
      "46:\tlearn: 0.2688921\ttotal: 5.1s\tremaining: 16.6s\n",
      "47:\tlearn: 0.2683755\ttotal: 5.57s\tremaining: 17.6s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "48:\tlearn: 0.2677664\ttotal: 6.03s\tremaining: 18.6s\n",
      "49:\tlearn: 0.2667065\ttotal: 6.21s\tremaining: 18.6s\n",
      "50:\tlearn: 0.2662464\ttotal: 6.39s\tremaining: 18.7s\n",
      "51:\tlearn: 0.2654807\ttotal: 6.49s\tremaining: 18.5s\n",
      "52:\tlearn: 0.2648874\ttotal: 6.62s\tremaining: 18.4s\n",
      "53:\tlearn: 0.2641305\ttotal: 6.69s\tremaining: 18.1s\n",
      "54:\tlearn: 0.2639816\ttotal: 6.74s\tremaining: 17.8s\n",
      "55:\tlearn: 0.2633510\ttotal: 6.8s\tremaining: 17.5s\n",
      "56:\tlearn: 0.2627696\ttotal: 7s\tremaining: 17.6s\n",
      "57:\tlearn: 0.2623309\ttotal: 7.12s\tremaining: 17.4s\n",
      "58:\tlearn: 0.2621535\ttotal: 7.18s\tremaining: 17.2s\n",
      "59:\tlearn: 0.2616692\ttotal: 7.28s\tremaining: 17s\n",
      "60:\tlearn: 0.2614644\ttotal: 7.34s\tremaining: 16.7s\n",
      "61:\tlearn: 0.2608377\ttotal: 7.44s\tremaining: 16.6s\n",
      "62:\tlearn: 0.2603753\ttotal: 7.52s\tremaining: 16.3s\n",
      "63:\tlearn: 0.2600076\ttotal: 7.58s\tremaining: 16.1s\n",
      "64:\tlearn: 0.2598489\ttotal: 7.66s\tremaining: 15.9s\n",
      "65:\tlearn: 0.2593307\ttotal: 7.75s\tremaining: 15.7s\n",
      "66:\tlearn: 0.2591688\ttotal: 7.81s\tremaining: 15.5s\n",
      "67:\tlearn: 0.2586332\ttotal: 7.89s\tremaining: 15.3s\n",
      "68:\tlearn: 0.2584462\ttotal: 7.97s\tremaining: 15.1s\n",
      "69:\tlearn: 0.2580773\ttotal: 8.06s\tremaining: 15s\n",
      "70:\tlearn: 0.2577061\ttotal: 8.16s\tremaining: 14.8s\n",
      "71:\tlearn: 0.2575960\ttotal: 8.22s\tremaining: 14.6s\n",
      "72:\tlearn: 0.2571141\ttotal: 8.3s\tremaining: 14.4s\n",
      "73:\tlearn: 0.2566048\ttotal: 8.38s\tremaining: 14.3s\n",
      "74:\tlearn: 0.2560280\ttotal: 8.45s\tremaining: 14.1s\n",
      "75:\tlearn: 0.2558752\ttotal: 8.51s\tremaining: 13.9s\n",
      "76:\tlearn: 0.2554363\ttotal: 8.57s\tremaining: 13.7s\n",
      "77:\tlearn: 0.2553840\ttotal: 8.64s\tremaining: 13.5s\n",
      "78:\tlearn: 0.2548642\ttotal: 8.7s\tremaining: 13.3s\n",
      "79:\tlearn: 0.2546713\ttotal: 8.75s\tremaining: 13.1s\n",
      "80:\tlearn: 0.2541619\ttotal: 8.82s\tremaining: 13s\n",
      "81:\tlearn: 0.2536991\ttotal: 8.89s\tremaining: 12.8s\n",
      "82:\tlearn: 0.2533659\ttotal: 8.96s\tremaining: 12.6s\n",
      "83:\tlearn: 0.2531699\ttotal: 9.01s\tremaining: 12.4s\n",
      "84:\tlearn: 0.2528609\ttotal: 9.1s\tremaining: 12.3s\n",
      "85:\tlearn: 0.2524328\ttotal: 9.28s\tremaining: 12.3s\n",
      "86:\tlearn: 0.2521599\ttotal: 9.36s\tremaining: 12.2s\n",
      "87:\tlearn: 0.2514190\ttotal: 9.43s\tremaining: 12s\n",
      "88:\tlearn: 0.2511753\ttotal: 9.51s\tremaining: 11.9s\n",
      "89:\tlearn: 0.2506722\ttotal: 9.59s\tremaining: 11.7s\n",
      "90:\tlearn: 0.2502349\ttotal: 9.64s\tremaining: 11.5s\n",
      "91:\tlearn: 0.2498023\ttotal: 9.71s\tremaining: 11.4s\n",
      "92:\tlearn: 0.2493501\ttotal: 9.79s\tremaining: 11.3s\n",
      "93:\tlearn: 0.2490531\ttotal: 9.85s\tremaining: 11.1s\n",
      "94:\tlearn: 0.2486765\ttotal: 9.92s\tremaining: 11s\n",
      "95:\tlearn: 0.2483292\ttotal: 9.99s\tremaining: 10.8s\n",
      "96:\tlearn: 0.2479998\ttotal: 10.1s\tremaining: 10.7s\n",
      "97:\tlearn: 0.2476491\ttotal: 10.1s\tremaining: 10.6s\n",
      "98:\tlearn: 0.2472594\ttotal: 10.2s\tremaining: 10.4s\n",
      "99:\tlearn: 0.2470101\ttotal: 10.3s\tremaining: 10.3s\n",
      "100:\tlearn: 0.2469478\ttotal: 10.4s\tremaining: 10.2s\n",
      "101:\tlearn: 0.2467391\ttotal: 10.5s\tremaining: 10.1s\n",
      "102:\tlearn: 0.2462023\ttotal: 10.5s\tremaining: 9.91s\n",
      "103:\tlearn: 0.2461236\ttotal: 10.6s\tremaining: 9.77s\n",
      "104:\tlearn: 0.2458182\ttotal: 10.7s\tremaining: 9.65s\n",
      "105:\tlearn: 0.2456329\ttotal: 10.7s\tremaining: 9.5s\n",
      "106:\tlearn: 0.2452334\ttotal: 10.8s\tremaining: 9.38s\n",
      "107:\tlearn: 0.2449398\ttotal: 10.9s\tremaining: 9.26s\n",
      "108:\tlearn: 0.2447201\ttotal: 10.9s\tremaining: 9.12s\n",
      "109:\tlearn: 0.2443484\ttotal: 11s\tremaining: 8.98s\n",
      "110:\tlearn: 0.2439214\ttotal: 11s\tremaining: 8.85s\n",
      "111:\tlearn: 0.2433963\ttotal: 11.1s\tremaining: 8.73s\n",
      "112:\tlearn: 0.2432693\ttotal: 11.2s\tremaining: 8.61s\n",
      "113:\tlearn: 0.2431357\ttotal: 11.2s\tremaining: 8.47s\n",
      "114:\tlearn: 0.2427103\ttotal: 11.4s\tremaining: 8.43s\n",
      "115:\tlearn: 0.2426400\ttotal: 11.5s\tremaining: 8.35s\n",
      "116:\tlearn: 0.2423108\ttotal: 11.6s\tremaining: 8.23s\n",
      "117:\tlearn: 0.2418913\ttotal: 11.7s\tremaining: 8.1s\n",
      "118:\tlearn: 0.2418482\ttotal: 11.7s\tremaining: 7.97s\n",
      "119:\tlearn: 0.2415859\ttotal: 11.8s\tremaining: 7.85s\n",
      "120:\tlearn: 0.2412065\ttotal: 11.8s\tremaining: 7.73s\n",
      "121:\tlearn: 0.2409234\ttotal: 11.9s\tremaining: 7.61s\n",
      "122:\tlearn: 0.2406851\ttotal: 12s\tremaining: 7.5s\n",
      "123:\tlearn: 0.2404390\ttotal: 12s\tremaining: 7.38s\n",
      "124:\tlearn: 0.2402061\ttotal: 12.1s\tremaining: 7.26s\n",
      "125:\tlearn: 0.2400016\ttotal: 12.2s\tremaining: 7.14s\n",
      "126:\tlearn: 0.2398620\ttotal: 12.2s\tremaining: 7.03s\n",
      "127:\tlearn: 0.2395259\ttotal: 12.3s\tremaining: 6.91s\n",
      "128:\tlearn: 0.2391237\ttotal: 12.3s\tremaining: 6.79s\n",
      "129:\tlearn: 0.2389789\ttotal: 12.4s\tremaining: 6.7s\n",
      "130:\tlearn: 0.2385930\ttotal: 12.5s\tremaining: 6.6s\n",
      "131:\tlearn: 0.2384536\ttotal: 12.6s\tremaining: 6.48s\n",
      "132:\tlearn: 0.2381896\ttotal: 12.6s\tremaining: 6.37s\n",
      "133:\tlearn: 0.2378676\ttotal: 12.7s\tremaining: 6.26s\n",
      "134:\tlearn: 0.2378279\ttotal: 12.8s\tremaining: 6.14s\n",
      "135:\tlearn: 0.2377031\ttotal: 12.8s\tremaining: 6.04s\n",
      "136:\tlearn: 0.2375446\ttotal: 12.9s\tremaining: 5.94s\n",
      "137:\tlearn: 0.2371841\ttotal: 13s\tremaining: 5.84s\n",
      "138:\tlearn: 0.2367872\ttotal: 13.1s\tremaining: 5.73s\n",
      "139:\tlearn: 0.2365500\ttotal: 13.2s\tremaining: 5.63s\n",
      "140:\tlearn: 0.2363907\ttotal: 13.2s\tremaining: 5.53s\n",
      "141:\tlearn: 0.2362619\ttotal: 13.3s\tremaining: 5.42s\n",
      "142:\tlearn: 0.2358673\ttotal: 13.3s\tremaining: 5.32s\n",
      "143:\tlearn: 0.2355923\ttotal: 13.4s\tremaining: 5.22s\n",
      "144:\tlearn: 0.2352874\ttotal: 13.5s\tremaining: 5.11s\n",
      "145:\tlearn: 0.2351892\ttotal: 13.6s\tremaining: 5.01s\n",
      "146:\tlearn: 0.2348712\ttotal: 13.8s\tremaining: 4.98s\n",
      "147:\tlearn: 0.2346623\ttotal: 13.9s\tremaining: 4.88s\n",
      "148:\tlearn: 0.2343108\ttotal: 14s\tremaining: 4.78s\n",
      "149:\tlearn: 0.2341190\ttotal: 14s\tremaining: 4.68s\n",
      "150:\tlearn: 0.2335386\ttotal: 14.1s\tremaining: 4.58s\n",
      "151:\tlearn: 0.2333558\ttotal: 14.2s\tremaining: 4.47s\n",
      "152:\tlearn: 0.2330696\ttotal: 14.2s\tremaining: 4.36s\n",
      "153:\tlearn: 0.2326996\ttotal: 14.3s\tremaining: 4.27s\n",
      "154:\tlearn: 0.2324433\ttotal: 14.4s\tremaining: 4.17s\n",
      "155:\tlearn: 0.2321544\ttotal: 14.4s\tremaining: 4.07s\n",
      "156:\tlearn: 0.2320724\ttotal: 14.5s\tremaining: 3.96s\n",
      "157:\tlearn: 0.2319271\ttotal: 14.6s\tremaining: 3.87s\n",
      "158:\tlearn: 0.2314977\ttotal: 14.6s\tremaining: 3.77s\n",
      "159:\tlearn: 0.2312079\ttotal: 14.7s\tremaining: 3.67s\n",
      "160:\tlearn: 0.2308757\ttotal: 14.7s\tremaining: 3.57s\n",
      "161:\tlearn: 0.2307744\ttotal: 14.8s\tremaining: 3.48s\n",
      "162:\tlearn: 0.2304983\ttotal: 14.9s\tremaining: 3.38s\n",
      "163:\tlearn: 0.2303841\ttotal: 15s\tremaining: 3.28s\n",
      "164:\tlearn: 0.2300761\ttotal: 15s\tremaining: 3.19s\n",
      "165:\tlearn: 0.2296782\ttotal: 15.1s\tremaining: 3.09s\n",
      "166:\tlearn: 0.2294719\ttotal: 15.1s\tremaining: 2.99s\n",
      "167:\tlearn: 0.2293105\ttotal: 15.2s\tremaining: 2.89s\n",
      "168:\tlearn: 0.2291357\ttotal: 15.2s\tremaining: 2.79s\n",
      "169:\tlearn: 0.2287170\ttotal: 15.3s\tremaining: 2.7s\n",
      "170:\tlearn: 0.2284937\ttotal: 15.3s\tremaining: 2.6s\n",
      "171:\tlearn: 0.2283678\ttotal: 15.4s\tremaining: 2.5s\n",
      "172:\tlearn: 0.2282134\ttotal: 15.4s\tremaining: 2.4s\n",
      "173:\tlearn: 0.2278286\ttotal: 15.5s\tremaining: 2.31s\n",
      "174:\tlearn: 0.2277263\ttotal: 15.5s\tremaining: 2.22s\n",
      "175:\tlearn: 0.2275403\ttotal: 15.6s\tremaining: 2.12s\n",
      "176:\tlearn: 0.2271400\ttotal: 15.6s\tremaining: 2.03s\n",
      "177:\tlearn: 0.2268774\ttotal: 15.7s\tremaining: 1.94s\n",
      "178:\tlearn: 0.2265708\ttotal: 15.7s\tremaining: 1.84s\n",
      "179:\tlearn: 0.2262290\ttotal: 15.8s\tremaining: 1.75s\n",
      "180:\tlearn: 0.2259083\ttotal: 15.8s\tremaining: 1.66s\n",
      "181:\tlearn: 0.2256612\ttotal: 16s\tremaining: 1.58s\n",
      "182:\tlearn: 0.2254334\ttotal: 16.1s\tremaining: 1.5s\n",
      "183:\tlearn: 0.2251381\ttotal: 16.2s\tremaining: 1.41s\n",
      "184:\tlearn: 0.2248683\ttotal: 16.3s\tremaining: 1.32s\n",
      "185:\tlearn: 0.2246531\ttotal: 16.3s\tremaining: 1.23s\n",
      "186:\tlearn: 0.2243623\ttotal: 16.4s\tremaining: 1.14s\n",
      "187:\tlearn: 0.2242871\ttotal: 16.4s\tremaining: 1.05s\n",
      "188:\tlearn: 0.2240584\ttotal: 16.5s\tremaining: 959ms\n",
      "189:\tlearn: 0.2238450\ttotal: 16.5s\tremaining: 869ms\n",
      "190:\tlearn: 0.2237094\ttotal: 16.6s\tremaining: 781ms\n",
      "191:\tlearn: 0.2233784\ttotal: 16.6s\tremaining: 692ms\n",
      "192:\tlearn: 0.2230560\ttotal: 16.7s\tremaining: 605ms\n",
      "193:\tlearn: 0.2227906\ttotal: 16.7s\tremaining: 517ms\n",
      "194:\tlearn: 0.2225174\ttotal: 16.8s\tremaining: 430ms\n",
      "195:\tlearn: 0.2222137\ttotal: 16.8s\tremaining: 343ms\n",
      "196:\tlearn: 0.2217799\ttotal: 17s\tremaining: 258ms\n",
      "197:\tlearn: 0.2217171\ttotal: 17s\tremaining: 172ms\n",
      "198:\tlearn: 0.2213964\ttotal: 17.1s\tremaining: 85.8ms\n",
      "199:\tlearn: 0.2212671\ttotal: 17.2s\tremaining: 0us\n",
      "0:\tlearn: 0.4917298\ttotal: 41.6ms\tremaining: 8.29s\n",
      "1:\tlearn: 0.4102328\ttotal: 83.7ms\tremaining: 8.29s\n",
      "2:\tlearn: 0.3703447\ttotal: 127ms\tremaining: 8.32s\n",
      "3:\tlearn: 0.3568417\ttotal: 193ms\tremaining: 9.45s\n",
      "4:\tlearn: 0.3414381\ttotal: 275ms\tremaining: 10.7s\n",
      "5:\tlearn: 0.3311381\ttotal: 341ms\tremaining: 11s\n",
      "6:\tlearn: 0.3264056\ttotal: 394ms\tremaining: 10.9s\n",
      "7:\tlearn: 0.3226739\ttotal: 437ms\tremaining: 10.5s\n",
      "8:\tlearn: 0.3180068\ttotal: 479ms\tremaining: 10.2s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "9:\tlearn: 0.3148788\ttotal: 536ms\tremaining: 10.2s\n",
      "10:\tlearn: 0.3091801\ttotal: 605ms\tremaining: 10.4s\n",
      "11:\tlearn: 0.3064734\ttotal: 792ms\tremaining: 12.4s\n",
      "12:\tlearn: 0.3023545\ttotal: 877ms\tremaining: 12.6s\n",
      "13:\tlearn: 0.3001431\ttotal: 926ms\tremaining: 12.3s\n",
      "14:\tlearn: 0.2985010\ttotal: 977ms\tremaining: 12.1s\n",
      "15:\tlearn: 0.2971947\ttotal: 1.03s\tremaining: 11.9s\n",
      "16:\tlearn: 0.2958124\ttotal: 1.08s\tremaining: 11.6s\n",
      "17:\tlearn: 0.2948482\ttotal: 1.12s\tremaining: 11.4s\n",
      "18:\tlearn: 0.2941997\ttotal: 1.17s\tremaining: 11.1s\n",
      "19:\tlearn: 0.2923554\ttotal: 1.26s\tremaining: 11.4s\n",
      "20:\tlearn: 0.2916510\ttotal: 1.31s\tremaining: 11.2s\n",
      "21:\tlearn: 0.2881631\ttotal: 1.37s\tremaining: 11.1s\n",
      "22:\tlearn: 0.2866951\ttotal: 1.45s\tremaining: 11.2s\n",
      "23:\tlearn: 0.2860071\ttotal: 1.54s\tremaining: 11.3s\n",
      "24:\tlearn: 0.2852350\ttotal: 1.6s\tremaining: 11.2s\n",
      "25:\tlearn: 0.2848705\ttotal: 1.67s\tremaining: 11.2s\n",
      "26:\tlearn: 0.2844211\ttotal: 1.71s\tremaining: 10.9s\n",
      "27:\tlearn: 0.2837306\ttotal: 1.76s\tremaining: 10.8s\n",
      "28:\tlearn: 0.2819126\ttotal: 1.84s\tremaining: 10.8s\n",
      "29:\tlearn: 0.2814082\ttotal: 1.94s\tremaining: 11s\n",
      "30:\tlearn: 0.2808261\ttotal: 2.02s\tremaining: 11s\n",
      "31:\tlearn: 0.2804243\ttotal: 2.12s\tremaining: 11.1s\n",
      "32:\tlearn: 0.2795664\ttotal: 2.19s\tremaining: 11.1s\n",
      "33:\tlearn: 0.2790536\ttotal: 2.26s\tremaining: 11s\n",
      "34:\tlearn: 0.2784352\ttotal: 2.4s\tremaining: 11.3s\n",
      "35:\tlearn: 0.2774499\ttotal: 2.49s\tremaining: 11.3s\n",
      "36:\tlearn: 0.2766988\ttotal: 2.61s\tremaining: 11.5s\n",
      "37:\tlearn: 0.2761929\ttotal: 2.7s\tremaining: 11.5s\n",
      "38:\tlearn: 0.2756270\ttotal: 2.78s\tremaining: 11.5s\n",
      "39:\tlearn: 0.2750112\ttotal: 2.9s\tremaining: 11.6s\n",
      "40:\tlearn: 0.2746511\ttotal: 3.08s\tremaining: 11.9s\n",
      "41:\tlearn: 0.2740925\ttotal: 3.14s\tremaining: 11.8s\n",
      "42:\tlearn: 0.2729611\ttotal: 3.24s\tremaining: 11.8s\n",
      "43:\tlearn: 0.2716126\ttotal: 3.29s\tremaining: 11.7s\n",
      "44:\tlearn: 0.2710329\ttotal: 3.36s\tremaining: 11.6s\n",
      "45:\tlearn: 0.2701628\ttotal: 3.43s\tremaining: 11.5s\n",
      "46:\tlearn: 0.2698632\ttotal: 3.55s\tremaining: 11.6s\n",
      "47:\tlearn: 0.2693771\ttotal: 3.62s\tremaining: 11.5s\n",
      "48:\tlearn: 0.2689556\ttotal: 3.66s\tremaining: 11.3s\n",
      "49:\tlearn: 0.2675861\ttotal: 3.71s\tremaining: 11.1s\n",
      "50:\tlearn: 0.2669533\ttotal: 3.76s\tremaining: 11s\n",
      "51:\tlearn: 0.2662241\ttotal: 3.83s\tremaining: 10.9s\n",
      "52:\tlearn: 0.2654497\ttotal: 3.89s\tremaining: 10.8s\n",
      "53:\tlearn: 0.2652958\ttotal: 4.02s\tremaining: 10.9s\n",
      "54:\tlearn: 0.2642633\ttotal: 4.09s\tremaining: 10.8s\n",
      "55:\tlearn: 0.2637185\ttotal: 4.18s\tremaining: 10.7s\n",
      "56:\tlearn: 0.2631288\ttotal: 4.27s\tremaining: 10.7s\n",
      "57:\tlearn: 0.2627680\ttotal: 4.32s\tremaining: 10.6s\n",
      "58:\tlearn: 0.2621118\ttotal: 4.36s\tremaining: 10.4s\n",
      "59:\tlearn: 0.2615837\ttotal: 4.42s\tremaining: 10.3s\n",
      "60:\tlearn: 0.2611661\ttotal: 4.47s\tremaining: 10.2s\n",
      "61:\tlearn: 0.2606551\ttotal: 4.52s\tremaining: 10.1s\n",
      "62:\tlearn: 0.2602628\ttotal: 4.59s\tremaining: 9.97s\n",
      "63:\tlearn: 0.2598930\ttotal: 4.63s\tremaining: 9.84s\n",
      "64:\tlearn: 0.2594921\ttotal: 4.74s\tremaining: 9.84s\n",
      "65:\tlearn: 0.2590351\ttotal: 4.79s\tremaining: 9.73s\n",
      "66:\tlearn: 0.2585508\ttotal: 4.86s\tremaining: 9.64s\n",
      "67:\tlearn: 0.2579718\ttotal: 4.94s\tremaining: 9.59s\n",
      "68:\tlearn: 0.2574965\ttotal: 5.02s\tremaining: 9.53s\n",
      "69:\tlearn: 0.2573424\ttotal: 5.09s\tremaining: 9.45s\n",
      "70:\tlearn: 0.2570091\ttotal: 5.2s\tremaining: 9.45s\n",
      "71:\tlearn: 0.2563930\ttotal: 5.36s\tremaining: 9.53s\n",
      "72:\tlearn: 0.2559537\ttotal: 5.41s\tremaining: 9.41s\n",
      "73:\tlearn: 0.2556624\ttotal: 5.48s\tremaining: 9.34s\n",
      "74:\tlearn: 0.2553902\ttotal: 5.53s\tremaining: 9.22s\n",
      "75:\tlearn: 0.2548164\ttotal: 5.57s\tremaining: 9.09s\n",
      "76:\tlearn: 0.2544096\ttotal: 5.62s\tremaining: 8.97s\n",
      "77:\tlearn: 0.2538656\ttotal: 5.7s\tremaining: 8.91s\n",
      "78:\tlearn: 0.2536637\ttotal: 5.74s\tremaining: 8.79s\n",
      "79:\tlearn: 0.2534411\ttotal: 5.79s\tremaining: 8.68s\n",
      "80:\tlearn: 0.2530843\ttotal: 5.84s\tremaining: 8.58s\n",
      "81:\tlearn: 0.2528182\ttotal: 5.9s\tremaining: 8.49s\n",
      "82:\tlearn: 0.2525085\ttotal: 5.94s\tremaining: 8.38s\n",
      "83:\tlearn: 0.2521208\ttotal: 5.99s\tremaining: 8.27s\n",
      "84:\tlearn: 0.2518083\ttotal: 6.04s\tremaining: 8.17s\n",
      "85:\tlearn: 0.2514521\ttotal: 6.11s\tremaining: 8.09s\n",
      "86:\tlearn: 0.2511111\ttotal: 6.15s\tremaining: 7.99s\n",
      "87:\tlearn: 0.2508856\ttotal: 6.19s\tremaining: 7.88s\n",
      "88:\tlearn: 0.2505500\ttotal: 6.23s\tremaining: 7.77s\n",
      "89:\tlearn: 0.2502756\ttotal: 6.31s\tremaining: 7.71s\n",
      "90:\tlearn: 0.2501553\ttotal: 6.35s\tremaining: 7.61s\n",
      "91:\tlearn: 0.2496378\ttotal: 6.39s\tremaining: 7.5s\n",
      "92:\tlearn: 0.2492223\ttotal: 6.43s\tremaining: 7.4s\n",
      "93:\tlearn: 0.2487867\ttotal: 6.5s\tremaining: 7.33s\n",
      "94:\tlearn: 0.2484129\ttotal: 6.56s\tremaining: 7.25s\n",
      "95:\tlearn: 0.2480758\ttotal: 6.61s\tremaining: 7.16s\n",
      "96:\tlearn: 0.2477856\ttotal: 6.65s\tremaining: 7.06s\n",
      "97:\tlearn: 0.2474058\ttotal: 6.71s\tremaining: 6.99s\n",
      "98:\tlearn: 0.2471347\ttotal: 6.76s\tremaining: 6.9s\n",
      "99:\tlearn: 0.2466663\ttotal: 6.8s\tremaining: 6.8s\n",
      "100:\tlearn: 0.2463100\ttotal: 6.84s\tremaining: 6.7s\n",
      "101:\tlearn: 0.2462087\ttotal: 6.91s\tremaining: 6.64s\n",
      "102:\tlearn: 0.2458403\ttotal: 6.96s\tremaining: 6.55s\n",
      "103:\tlearn: 0.2455179\ttotal: 7s\tremaining: 6.46s\n",
      "104:\tlearn: 0.2451997\ttotal: 7.05s\tremaining: 6.38s\n",
      "105:\tlearn: 0.2450510\ttotal: 7.11s\tremaining: 6.31s\n",
      "106:\tlearn: 0.2448445\ttotal: 7.17s\tremaining: 6.23s\n",
      "107:\tlearn: 0.2443664\ttotal: 7.21s\tremaining: 6.15s\n",
      "108:\tlearn: 0.2440019\ttotal: 7.26s\tremaining: 6.06s\n",
      "109:\tlearn: 0.2436825\ttotal: 7.33s\tremaining: 6s\n",
      "110:\tlearn: 0.2433396\ttotal: 7.4s\tremaining: 5.94s\n",
      "111:\tlearn: 0.2430178\ttotal: 7.56s\tremaining: 5.94s\n",
      "112:\tlearn: 0.2428235\ttotal: 7.62s\tremaining: 5.87s\n",
      "113:\tlearn: 0.2425991\ttotal: 7.67s\tremaining: 5.78s\n",
      "114:\tlearn: 0.2424463\ttotal: 7.71s\tremaining: 5.7s\n",
      "115:\tlearn: 0.2421903\ttotal: 7.75s\tremaining: 5.61s\n",
      "116:\tlearn: 0.2418328\ttotal: 7.81s\tremaining: 5.54s\n",
      "117:\tlearn: 0.2415361\ttotal: 7.87s\tremaining: 5.47s\n",
      "118:\tlearn: 0.2412653\ttotal: 7.91s\tremaining: 5.38s\n",
      "119:\tlearn: 0.2410728\ttotal: 7.96s\tremaining: 5.3s\n",
      "120:\tlearn: 0.2407275\ttotal: 8s\tremaining: 5.22s\n",
      "121:\tlearn: 0.2403147\ttotal: 8.09s\tremaining: 5.17s\n",
      "122:\tlearn: 0.2399327\ttotal: 8.14s\tremaining: 5.1s\n",
      "123:\tlearn: 0.2396511\ttotal: 8.19s\tremaining: 5.02s\n",
      "124:\tlearn: 0.2394711\ttotal: 8.25s\tremaining: 4.95s\n",
      "125:\tlearn: 0.2392890\ttotal: 8.3s\tremaining: 4.87s\n",
      "126:\tlearn: 0.2389691\ttotal: 8.34s\tremaining: 4.79s\n",
      "127:\tlearn: 0.2388578\ttotal: 8.38s\tremaining: 4.71s\n",
      "128:\tlearn: 0.2385003\ttotal: 8.45s\tremaining: 4.65s\n",
      "129:\tlearn: 0.2383136\ttotal: 8.5s\tremaining: 4.58s\n",
      "130:\tlearn: 0.2381316\ttotal: 8.54s\tremaining: 4.5s\n",
      "131:\tlearn: 0.2378707\ttotal: 8.59s\tremaining: 4.43s\n",
      "132:\tlearn: 0.2376067\ttotal: 8.68s\tremaining: 4.37s\n",
      "133:\tlearn: 0.2372990\ttotal: 8.75s\tremaining: 4.31s\n",
      "134:\tlearn: 0.2370381\ttotal: 8.9s\tremaining: 4.29s\n",
      "135:\tlearn: 0.2369765\ttotal: 8.98s\tremaining: 4.23s\n",
      "136:\tlearn: 0.2368484\ttotal: 9.04s\tremaining: 4.16s\n",
      "137:\tlearn: 0.2366106\ttotal: 9.08s\tremaining: 4.08s\n",
      "138:\tlearn: 0.2362015\ttotal: 9.14s\tremaining: 4.01s\n",
      "139:\tlearn: 0.2358647\ttotal: 9.22s\tremaining: 3.95s\n",
      "140:\tlearn: 0.2355421\ttotal: 9.26s\tremaining: 3.88s\n",
      "141:\tlearn: 0.2353069\ttotal: 9.3s\tremaining: 3.8s\n",
      "142:\tlearn: 0.2350554\ttotal: 9.37s\tremaining: 3.73s\n",
      "143:\tlearn: 0.2347753\ttotal: 9.43s\tremaining: 3.67s\n",
      "144:\tlearn: 0.2347130\ttotal: 9.47s\tremaining: 3.59s\n",
      "145:\tlearn: 0.2344032\ttotal: 9.51s\tremaining: 3.52s\n",
      "146:\tlearn: 0.2342883\ttotal: 9.61s\tremaining: 3.46s\n",
      "147:\tlearn: 0.2341884\ttotal: 9.76s\tremaining: 3.43s\n",
      "148:\tlearn: 0.2339513\ttotal: 9.8s\tremaining: 3.35s\n",
      "149:\tlearn: 0.2335816\ttotal: 9.88s\tremaining: 3.29s\n",
      "150:\tlearn: 0.2332367\ttotal: 9.94s\tremaining: 3.23s\n",
      "151:\tlearn: 0.2330758\ttotal: 9.98s\tremaining: 3.15s\n",
      "152:\tlearn: 0.2327874\ttotal: 10s\tremaining: 3.08s\n",
      "153:\tlearn: 0.2324529\ttotal: 10.1s\tremaining: 3.02s\n",
      "154:\tlearn: 0.2322266\ttotal: 10.1s\tremaining: 2.94s\n",
      "155:\tlearn: 0.2319653\ttotal: 10.2s\tremaining: 2.87s\n",
      "156:\tlearn: 0.2315521\ttotal: 10.2s\tremaining: 2.8s\n",
      "157:\tlearn: 0.2312866\ttotal: 10.3s\tremaining: 2.74s\n",
      "158:\tlearn: 0.2311561\ttotal: 10.3s\tremaining: 2.67s\n",
      "159:\tlearn: 0.2307979\ttotal: 10.4s\tremaining: 2.6s\n",
      "160:\tlearn: 0.2305032\ttotal: 10.5s\tremaining: 2.54s\n",
      "161:\tlearn: 0.2303924\ttotal: 10.5s\tremaining: 2.47s\n",
      "162:\tlearn: 0.2302347\ttotal: 10.6s\tremaining: 2.42s\n",
      "163:\tlearn: 0.2301459\ttotal: 10.7s\tremaining: 2.36s\n",
      "164:\tlearn: 0.2301388\ttotal: 10.8s\tremaining: 2.29s\n",
      "165:\tlearn: 0.2301320\ttotal: 10.9s\tremaining: 2.23s\n",
      "166:\tlearn: 0.2297158\ttotal: 10.9s\tremaining: 2.16s\n",
      "167:\tlearn: 0.2295384\ttotal: 11s\tremaining: 2.1s\n",
      "168:\tlearn: 0.2293266\ttotal: 11.1s\tremaining: 2.03s\n",
      "169:\tlearn: 0.2290105\ttotal: 11.2s\tremaining: 1.97s\n",
      "170:\tlearn: 0.2285586\ttotal: 11.2s\tremaining: 1.9s\n",
      "171:\tlearn: 0.2281991\ttotal: 11.3s\tremaining: 1.83s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "172:\tlearn: 0.2279406\ttotal: 11.3s\tremaining: 1.77s\n",
      "173:\tlearn: 0.2276911\ttotal: 11.4s\tremaining: 1.7s\n",
      "174:\tlearn: 0.2275774\ttotal: 11.4s\tremaining: 1.63s\n",
      "175:\tlearn: 0.2273200\ttotal: 11.5s\tremaining: 1.56s\n",
      "176:\tlearn: 0.2270139\ttotal: 11.5s\tremaining: 1.5s\n",
      "177:\tlearn: 0.2267032\ttotal: 11.6s\tremaining: 1.43s\n",
      "178:\tlearn: 0.2264038\ttotal: 11.6s\tremaining: 1.36s\n",
      "179:\tlearn: 0.2261705\ttotal: 11.7s\tremaining: 1.3s\n",
      "180:\tlearn: 0.2259577\ttotal: 11.8s\tremaining: 1.24s\n",
      "181:\tlearn: 0.2256149\ttotal: 12s\tremaining: 1.18s\n",
      "182:\tlearn: 0.2254915\ttotal: 12s\tremaining: 1.12s\n",
      "183:\tlearn: 0.2253312\ttotal: 12.1s\tremaining: 1.05s\n",
      "184:\tlearn: 0.2251864\ttotal: 12.1s\tremaining: 982ms\n",
      "185:\tlearn: 0.2250303\ttotal: 12.2s\tremaining: 915ms\n",
      "186:\tlearn: 0.2248906\ttotal: 12.2s\tremaining: 850ms\n",
      "187:\tlearn: 0.2246735\ttotal: 12.3s\tremaining: 783ms\n",
      "188:\tlearn: 0.2244055\ttotal: 12.3s\tremaining: 717ms\n",
      "189:\tlearn: 0.2241687\ttotal: 12.4s\tremaining: 651ms\n",
      "190:\tlearn: 0.2240734\ttotal: 12.4s\tremaining: 586ms\n",
      "191:\tlearn: 0.2237139\ttotal: 12.5s\tremaining: 522ms\n",
      "192:\tlearn: 0.2235032\ttotal: 12.6s\tremaining: 458ms\n",
      "193:\tlearn: 0.2233232\ttotal: 12.7s\tremaining: 392ms\n",
      "194:\tlearn: 0.2232085\ttotal: 12.8s\tremaining: 327ms\n",
      "195:\tlearn: 0.2228916\ttotal: 12.8s\tremaining: 262ms\n",
      "196:\tlearn: 0.2227447\ttotal: 12.9s\tremaining: 196ms\n",
      "197:\tlearn: 0.2224800\ttotal: 13s\tremaining: 131ms\n",
      "198:\tlearn: 0.2224030\ttotal: 13s\tremaining: 65.3ms\n",
      "199:\tlearn: 0.2221522\ttotal: 13.1s\tremaining: 0us\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "0.9151547436751372"
      ]
     },
     "execution_count": 81,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Cross Validated f1\n",
    "cv_f1 = cross_val_score(best_model,\n",
    "                        X,\n",
    "                        y,\n",
    "                        cv=5,\n",
    "                        scoring='f1')\n",
    "cv_f1_mean = np.mean(cv_f1)\n",
    "cv_f1_mean"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 82,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "   Accuracy  Precision    Recall        F1\n",
      "0   0.86837   0.896072  0.935073  0.915155\n"
     ]
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX0AAAFJCAYAAAB3kv3qAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjMsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+AADFEAAAgAElEQVR4nO3deVyN6f8/8NeJspSt7CRZToZKKWu7JZVlKNQMsjTC5GP/TIqZIT6fkT37mvkgIRKDrE0MxtjHMMYgOdnTNmWpdK7fH36dr6O0iaPu1/Px8Hjouq/73O9zn9Or+1z3dd9HJoQQICIiSdDSdAFERPTxMPSJiCSEoU9EJCEMfSIiCWHoExFJCEOfiEhCJBv6GRkZCA0Nhbu7O6ysrGBhYYEBAwZg+/btUCqVmi5PY5YtWwYTExPcu3cPABAZGQkTExP89ttvBa5X1H7vkpCQUKL18vPbb7/BxMQEkZGRn8TjvI+uXbti6NChqp+FEJg/fz46duwICwsLhIWFYejQoejatesHqyEjIwPJycmqn99+j5QnWVlZePz4caH93vf9rkkVNV2AJsTFxWHs2LG4f/8++vTpAw8PD2RmZuLYsWP47rvvcO7cOcyfPx8ymUzTpWpc+/btMW/ePDRv3vyDbcPHxwd16tTB3LlzP9g2yqrAwEBUqVJF9XNsbCzWr18PR0dHdO/eHVZWVmjatClevHjxQbZ/9epVjB07FgsWLEDHjh0BAD169ECTJk2gr6//QbapKffv38fIkSMxevRouLu7F9j3Y/xefCiSC/3MzEx8/fXXSE1Nxc6dO9GqVSvVspEjR2LWrFnYunUrzM3N4e3trcFKPw2GhoYwNDT8oNs4efIk+vfv/0G3UVZ1795d7ecbN24AACZPngwTExMAQLNmzT7Y9v/++288efJEra1Vq1Zqvzflxb179xAfH1+kvh/j9+JDkdzwztatW3Hnzh0EBATk+8b19/dHjRo1sG3bNg1UR1Sw7OxsAICurq6GK6GySnKhv3//flStWhW9evXKd3nlypWxY8cOREVFqdq6du2KGTNmIDAwEGZmZrC3t1eNcZ4/fx7Dhw+HpaUlLC0t4e3tjXPnzqk9ZlpaGqZNmwZHR0eYmpqie/fuWLhwITIzM1V9srKy8J///AfdunWDqakpHBwcMGvWLKSlpRX4fH7//XeYmJhg48aNeZZNmzYNlpaWqo/+165dw7/+9S906dIFbdq0QefOnTFlyhQ8evTonY+f39hlUlISAgIC0KlTJ1hZWeG7775DVlZWnnXv3r0Lf39/2Nvbw9TUFB06dMCYMWNw8+ZNAK+PrHKPVnfv3q22HaVSidDQULi4uMDU1BR2dnaYM2cOMjIy1Lbx/Plz/Oc//4GtrS0sLCwwfvx4pKenF7jPcgkhsGnTJvTu3Rvm5ubo2rUrFixYUOBQSWJiIoKCglSvk5WVFby9vXHhwgW1fmfPnsXgwYNhbW0NS0tLeHl5ISYmRq3PjRs34OPjg06dOqFt27bo378/du7cqdbnzTH9rl27Yvny5QCAbt26qcbx8xvTv337NiZMmICOHTvCysoKQ4cOxfnz59X6HDx4EEOGDIGVlRVMTU3RtWtXzJs3T/VaLlu2DAEBAQAAb29v1TbyG9NPSUnBzJkzYWdnB1NTU/Ts2RNr165FTk6Oqs+yZctgZmaG+Ph4jB49GpaWlmjfvj38/f2RkpLyzn2eu66lpSVu3bqFESNGwMLCAnZ2dli3bh2EENiwYQOcnJzQrl07+Pj45Dnf8OjRI3zzzTfo1KkTzMzM0K9fP+zdu1e1PDIyUvXJPiAgQPW+zK35yJEjsLGxgaWlJSIiIvL9vcjKysKyZcvg7OwMc3PzfPfBoUOH4OHhAUtLS1hZWWHEiBF53jsfmqSGd4QQuH79Otq1awdtbe139mvatGmetv3798PY2BjTp0/H06dPoa+vj2PHjmHcuHFo0qQJxo4dCwCIiIjA8OHDsXTpUnTr1g0AMHHiRPz555/w9vZG3bp1cenSJaxduxapqamYPXs2ACAoKAj79u2Dt7c3DA0NcfPmTYSFheHu3bsIDQ19Z61t27aFkZERoqOjMWLECFV7VlYWjh49iu7du6NKlSq4ceMGvvzySxgZGcHX1xdVqlTBxYsXsWfPHjx58gSbN28u0j7MzMzEkCFDcO/ePXh7e6NOnTrYvXs3Dhw4oNbv6dOnGDRoEPT09DBkyBDUqlUL169fx44dO3D79m0cOnQI+vr6mDdvHr755htYW1tj0KBBqjHS6dOnIyoqCv3798fw4cNx+/ZthIeH4+LFiwgPD0elSpUghMCYMWNw7tw5DBo0CC1btsTBgwcxbdq0Ij2XWbNmITw8HE5OTvjiiy9w584dhIaGIj4+XhWub3r58iUGDx6M9PR0DB48GPXq1UN8fDzCw8Ph6+uL48ePQ09PD3FxcRg9ejQ+++wzTJo0CQCwY8cOfP3119iyZQusra2RnJwMHx8f1KpVC2PHjkWlSpWwf/9+TJ8+HZUqVUKfPn3ybD8wMBBRUVE4cuQIAgIC0Lhx43yfV3x8PAYNGoSKFStiyJAh0NfXx7Zt2zBixAiEhYXB3NwcERERmDFjBrp27YqpU6ciOzsbR44cwYYNG1C1alWMGzcOPXr0QGJiIrZv344xY8bAzMws3+2lpaXBy8sL9+/fh5eXF4yNjXHq1CksXLgQf/75J5YsWaLqq1Qq4e3tDWtra/j7++OPP/7Azp078fLlS4SEhBT4emVnZ2PYsGHo3r07nJ2dsWvXLixYsABnzpzB/fv3MWzYMKSkpGD9+vUICAhQvacfP36MgQMHQgiBoUOHokaNGjh27Bj+/e9/48mTJ/jqq6/Qvn17jBkzBqtXr4anpyesrKxU23316hVmzJgBHx8fZGVlwcrKCpcvX85Tn5+fH06cOIE+ffpgxIgRuHLlChYuXKg6SDp79iwmTZoEe3t7DBw4EC9evMCWLVswYsQI7N+//+MNFwkJSUpKEnK5XEyaNKlY6zk5OYlWrVqJu3fvqtqys7OFvb29cHBwEOnp6ar2tLQ0YWdnJ+zs7ERWVpZ4+vSpkMvlYv369WqPOW3aNDFs2DDVz+bm5mLWrFlqfRYvXizc3d1FRkZGgfWFhIQIuVwu7t+/r2o7evSokMvl4vjx40IIIb777jvRtm1bkZKSorbupEmThFwuV7UvXbpUyOVykZCQIIQQYteuXUIul4szZ84IIYTYvHmzkMvl4siRI6rHePbsmXBzc1Prt2bNGiGXy8WtW7fUtrdgwQIhl8vF1atXVW1yuVz4+/urfj5z5oyQy+UiPDxcbd1ffvlFyOVy8eOPPwohhIiJiRFyuVxs3LhR1Sc7O1sMGzZMyOVysWvXrnfus5s3bwoTExMxY8YMtfZFixYJuVwubt68qaoj93H2798v5HK5OHHihNo64eHhQi6Xi0OHDgkhhFi7dq2Qy+UiKSlJ1Sc5OVk4OzuLTZs2qT3WlStXVH0yMzNF//79xYIFC1RtTk5OYsiQIaqf3359hBBiyJAhwsnJSfXzhAkThLm5uYiPj1fbvpWVlRg/frwQQggXFxfh6ekplEql2r6zt7cXvXv3VrW9/frnV8P8+fPzvCeEEGLmzJlCLpeL2NhYtfV++OEHtX4+Pj6idevW4vnz5+JdctedO3euqu3mzZtCLpcLS0tLtX09ZcoUYWJiIjIzM4UQQvj7+4sOHTqIx48fqz3m5MmThampqXj69KkQQuR5vd/c7tKlS9XWfXu/xMbGCrlcLlatWqXWb8qUKaJNmzYiNTVVfP/998LS0lJtn//111/C2dlZREdHv/O5lzZJDe9oab1+um9+3CqqJk2aoEmTJqqf//zzTzx69AiDBw+Gnp6eqr169eoYMmQIHj9+jKtXr6JatWqoWrUqtm7dikOHDuH58+cAgB9++AE//vijar369evjwIEDiIyMxD///APg9SeEXbt2FTp+m3tUePDgQVXbgQMHYGBggC5dugAAZs6ciZiYGNSsWVPVJyMjA5UqVQIAVV2FOXHiBGrXrq12grFq1aoYOHCgWj9fX1+cPn1abXbDy5cvVa9BQds7fPgwZDIZHBwckJycrPrXunVr1KlTB7GxsapatLS01LZdsWJFDB48uNDnERsbqzrye5OPjw/27t2r9lrncnNzw6+//gpbW1tV25vDWrnPqX79+gCA2bNn4+rVqwCAWrVq4dChQ6rt5fZZuHAhzp8/j5ycHOjo6CAyMhJTpkwptP53USqVOH78OBwcHGBkZKRqr1WrFrZu3YoZM2YAAPbu3Yu1a9eqzVBLSkpC9erVi/xeyBUTE4PmzZvnOen89ddfAwCOHTum1u7q6qr282effYZXr14hNTW10G29uY3cT+Tt2rVTm0nUuHFjCCHw9OlTKJVKHD16FNbW1qhYsaLa+8nZ2RlZWVk4depUodt98zXPT2xsLLS0tDBkyBC1dn9/f+zZswd6enqoX78+nj17hjlz5uD27dsAABMTExw6dAguLi6F1lBaJDW8U6NGDWhra6vNOS4qAwMDtZ9zxwyNjY3z9M2dTfHgwQNYWloiKCgI3377LcaPHw8dHR106NABzs7O6Nevnyp0Z86ciYkTJyIgIADffvstLCws0KNHD3h4eKBatWrIycnJU7e2tjZq1qwJY2NjtGnTBgcPHsTIkSPx8uVLxMTEwMPDAxUrvn6JZTIZUlJSsGbNGty4cQMKhQIPHjyA+P931i7qtQn379/P92NofvshOzsbixcvxrVr16BQKHDv3j3VH9yCtqdQKCCEgKOjY77Lc/8I3r9/HwYGBnn+KBZlNsv9+/cB5B3Kq169OqpXr/7O9WQyGdauXYtLly5BoVBAoVCoTq7mPicXFxccOXIEBw4cwIEDB1CnTh04ODigf//+sLa2BvA6qIYOHYotW7bg119/Rc2aNWFra4s+ffq883kXRWpqKp4/f64W+Lnkcrnq/9ra2jh37hz27duHuLg4KBQKJCUlAQAaNWpUrG3eu3cPdnZ2edrr1KmD6tWrq/Z1rreneuro6AAo2sFY7dq1Vf/PfW+//btZoUIFAK9fj5SUFKSnp+Po0aM4evRovo/58OHDQrf79jbelvtefPMAEHi9D+rUqQMAGDJkCE6ePIktW7Zgy5YtaNy4MZycnDBgwICPOhtKUqEvk8lgaWmJq1ev4tWrV6o3zdsWL16MhIQEBAQEqF6w3DdSLlHA1xDkLss9b9CnTx/Y2dnh6NGjOH78OE6fPo2TJ09i69atiIiIgI6ODjp37oyff/5Z9e/UqVOqTwORkZF4/vy56hxBrg4dOqjGLfv27YsffvgB9+/fxx9//IHnz5+jd+/eqr6xsbH4+uuvUbduXXTq1El1cvXkyZNYs2ZNsfbhmyeg37U/rl69iqFDh6Jy5cro0qULPDw80Lp1aygUCgQFBRW4DaVSCV1d3XzH1QGo/lDKZLJ8TyAX5Q9YST7t3b9/H56ennj+/DlsbW3h5uaGzz77DEII+Pn5qfppa2tj6dKluHHjBo4cOYITJ04gMjISO3fuxJQpU+Dr6wsAmDFjBry9vXHo0CGcOHEChw4dwr59++Dp6VnoPirseeV+onqXhQsXYu3atWjdujUsLCzw+eefw9LSErNnzy5SCL6poN8FpVKZ5/zZ+1z/8vbvYWGPl7s/evbsCS8vr3z7FGUsvbD9mZOTU+jz0tPTw5YtW3D58mUcPXoUJ06cwObNmxEWFoZ58+blex7nQ5BU6AOvLyw5e/YsDhw4gL59++ZZ/vLlS+zcuRM5OTlqQyFvyz0aiouLy7Pszp07AKD6OHf9+nW0bNkSAwYMwIABA5CVlYX58+dj06ZNOHnyJGxtbXH9+nXUr18fvXr1Qq9evaBUKrFx40bMmzcP+/fvx6BBg/LM0HnziNTNzQ3BwcE4duwYLly4AENDQ1hYWKiWz549G0ZGRti1axeqVq2qav/pp5+KuOdea9y4Mc6fP5/nj+bbV9TOmzcPOjo62L9/v9qR3erVqwvdRqNGjXDy5EmYmprmOeo+dOiQ6nUxNDREbGwskpOT1bZRlKt7GzZsqOr75hDU48eP8cMPP+T5mA4Ay5cvR1JSEqKjo9U+Iby9Dx88eIAHDx7A2toaJiYmGDduHB49eoRhw4Zhw4YN8PX1xdOnT3Hz5k107twZo0aNwqhRo5CSkgI/Pz/s2LED//73v1GtWrVCn8fbatWqhcqVK+Pu3bt5lm3YsAFPnz7FkCFDsHbtWnz++eeYN2+eWp+nT58We5uNGjXK9/cgMTERGRkZaNCgQbEfs7To6+ujSpUqePXqlWqoM9eDBw/w559/ql38VlINGzbE6dOn8ezZM7VPnteuXUNoaCjGjh2LChUqID09HRYWFrCwsMDUqVNx69YtDB48GBs3bvxooS+pMX0A8PT0RKNGjRAcHIy///5bbVlOTg5mzpyJp0+fYtSoUQXO8GnTpg3q1KmD8PBwtWmEGRkZ2Lp1K+rUqQNTU1PcvHkTgwcPVpuKp6Ojg9atWwN4feSSmpoKT09PtSNuLS0t1WwJLS0tVKpUCV26dFH7Z2pqquqfewSfe2T59hsoNTUVDRs2VAv8hw8f4vDhw6rnXhTOzs5IT09HRESEqi07Oxs7duzIsz19fX21ME5PT8fu3bvzbE9LS0vt6Dx3auCqVavUHjMmJgbjx49XhWyPHj0AQG12kxACW7duLfR5ODg4AADCw8PV2iMjIxEdHZ3nY3ruc6pSpYrqDwbwekw/95qO3Oe0evVqDB8+XO1y/vr166NevXqqI8bIyEgMHz4cf/zxh6pPrVq1YGRkBJlMVuiR5btUrFgRNjY2OH78uNoRe1paGjZs2ACFQqGaBtyiRQu1dY8fP474+Hi8evVK1ZZbR0GfnpycnBAXF5dn+GTt2rUA8F7DVe+rYsWKsLe3x/Hjx/HXX3+pLZs7dy78/PxU00XfHBYqLgcHByiVSrXfC+D1+ys6Ohq1a9fGnDlz8PXXX+PZs2eq5c2aNUP16tVL/HqXhOSO9CtVqoTly5dj5MiRGDBgAPr06QMzMzOkpqbi4MGDuH79OlxcXNSmP+ZHW1sb3377LSZOnAgPDw8MGDAAALBz5048efIES5cuhZaWFtq2bQtra2ssXrwYDx8+hImJCR4+fIgtW7agWbNm6Ny5M3R0dNCnTx9s3boVL168gKWlJVJTU7FlyxbUrl07z4mvd+nTp49qXvWbQzsAYG9vjwMHDuC7776DmZkZ7t27hx07dqjmpL/5RizI559/jh07dmD27Nm4ffs2mjZtir179yIxMTHP9tatW4cJEybA1tYWiYmJ2Llzp+pI8s3t6evr4+zZs9ixYwdsbW3h4OCAbt26ITQ0FPfu3UOXLl1w//59hIWFoWHDhvDx8QEAdOzYEa6urli3bh0SExNhbm6OmJgYXLt2rdDn8dlnn2HgwIHYvHkznjx5gs6dO+PWrVvYtm0b+vXrh1atWuW5r4q9vT1iYmIwevRouLi4ID09HVFRUVAoFGrPafDgwdizZw8GDx4MT09P1KhRA2fOnMFvv/2G8ePHAwD69euHjRs3YsyYMfjiiy9Qr149XL16VTVN9X0uvpoyZQoGDhyIgQMHqiYa7NixA8+fP8fEiRNhZGSEhg0bYvXq1cjMzET9+vVx5coV7N69G5UqVcrz2gCvw+vp06f5Ho2OHj0ahw8fxsSJE/HFF1+gadOmOHPmDA4fPgxnZ2fVH1hNmTp1Kn777TcMHjwYgwcPRsOGDREbG4uff/4Znp6eaNmyJYDXf3SB1ye5hRDFukq8a9eusLGxwdy5c3Hz5k2YmZnh0qVLiIqKgp+fH2rWrIkRI0Zg1KhRGDx4sOp83tGjR6FQKBAcHPxBnnu+Pto8oU/Mo0ePxNy5c4Wbm5uwsLAQbdu2FYMGDRI7d+5Um1IlRN5pc286ffq0GDJkiGjbtq2wsrISI0eOFOfOnVPrk5KSImbPni26du0qTE1NhY2NjZg+fbp48uSJqs+LFy9ESEiIcHZ2FmZmZqJDhw5iwoQJatPuCpOeni7MzMxE//798yxLTU0VgYGBwsbGRpibmwtnZ2cxd+5cceHCBSGXy8WGDRuEEIVP2czdTlBQkOjSpYuwsLAQ48ePV01BzO338uVLMXfuXGFvby/MzMxEt27dxPTp08Xt27dFq1atRFBQkOrxIiMjhY2NjTA1NRW7d+8WQgiRlZUlVq5cKZydnUWbNm2EnZ2d+Oabb9Smpeb2W7JkiXBwcBBmZmZixIgR4tSpU4VO2RRCiJycHLFu3TrVNnr06CFWrFihmur39hQ+pVIpVq9eLbp16yZMTU2Fo6OjmDhxorhz547o2LGjGD16tOqxL1y4IEaOHCk6deokTE1NRe/evcXmzZvV3lt///23GDdunLCxsRFt2rQRzs7OYvny5artC1GyKZu5jz1mzBjRrl07YW1tLUaOHCmuXbumtnzkyJHC2tpaWFlZif79+4uwsDDxv//9T8jlcvHHH3+o9m/uFND27duLly9f5ltDYmKimD59uujSpYswNTUVrq6uYv369eLVq1cF1l5Qe1H6vD3d91194+PjxeTJk0XHjh2FmZmZcHNzExs3blSrTwghZs+eLSwtLYWFhYW4e/fuO7eb3+/FixcvxMKFC4Wjo6MwNTUVbm5uYsuWLSInJ0fV5+effxZeXl6iffv2wtzcXHh4eIh9+/a983l/CDIh+MXoRERSIbkxfSIiKWPoExFJCEOfiEhCGPpERBLC0CcikhCGPhGRhJSJi7NSUp5Bqfx0Z5YaGOghKSmj8I5UJNyfpYv7s3R96vtTS0uGWrXefXFfmQh9pVJ80qEP4JOvr6zh/ixd3J+lqyzvTw7vEBFJCEOfiEhCGPpERBLC0CcikhCGPhGRhDD0iYgkhKFPRCQhZWKePpFUVKteBZUrlf6vZZ06xf++3YK8zHyF9H9elOpj0sfB0Cf6hFSuVBF9puzRdBmF+mnh50jXdBFUIhzeISKSEIY+EZGEcHiHiMqtsnCO5GOfH2HoE1G5VRbOkXzs8yMc3iEikhCGPhGRhDD0iYgkhGP69F7KwokygBcTEeVi6NN7KQsnygBeTESUi8M7REQSwtAnIpIQhj4RkYQw9ImIJESSJ3I/xIwTzjYhorJAkqFfFmaccLYJEX0IHN4hIpIQhj4RkYQw9ImIJIShT0QkIQx9IiIJYegTEUkIQ5+ISEKKHPr79u1Dr169YG5uDldXV0RFRRXYPzk5GQEBAbC1tUWHDh0wevRoxMfHv2+9RET0HooU+tHR0Zg6dSpsbGywYsUKdOjQAf7+/jh48GC+/YUQ8PPzw4kTJzB16lTMmzcPiYmJ8Pb2RlpaWqk+ASIiKroiXZG7aNEiuLq6IjAwEABgZ2eHtLQ0hISEwMXFJU//+Ph4XLx4EcHBwejXrx8AoHnz5ujevTtiYmLQv3//UnwKRERUVIUe6SckJEChUMDZ2VmtvWfPnoiLi0NCQkKedTIzMwEAurq6qrYaNWoAAFJTU9+rYCIiKrlCQz8uLg4AYGxsrNZuZGQEALhz506edVq1aoWOHTtixYoVuH37NpKTkzFnzhxUrVoV3bt3L426iYioBAod3klPf33bLz09PbX23KP4jIyMfNebOXMmvvrqK7i5uQEAdHR0sGLFChgaGr5XwUREVHKFhr4QAgAgk8nybdfSyvth4fbt2/Dy8kKTJk0QGBiIypUrY8eOHRg/fjzWr18Pa2vrYhVpYKBXeKdyqLRv1yx13J+li/uz9HzMfVlo6Fer9rqYt4/onz17prb8TT/++CMAIDQ0VDWWb2Njgy+//BL//e9/ERkZWawik5IyoFSKYq1TkLLyZk1M/PRvrlxW9iXA/VnauD9LT2nuSy0tWYEHyoWO6eeO5SsUCrX2u3fvqi1/04MHD9C8eXNV4AOvPylYWVnh1q1bRauciIhKXaGhb2RkhMaNG+eZk3/48GE0bdoUDRs2zLOOsbExbt68mWdO/u+//45GjRq9Z8lERFRSRZqn7+fnh4CAANSoUQOOjo6IiYlBdHQ0Fi9eDOD11bcKhQItWrSAnp4ehg8fjr1798LHxwe+vr6oXLky9uzZg7Nnz6rWISKij69Ioe/u7o6srCyEhoYiIiIChoaGCA4OVs3MiY2NRUBAADZt2oSOHTuicePGCA8Px/z58zFt2jRoaWlBLpdj48aN6NKlywd9QkRE9G5F/o5cLy8veHl55bvM3d0d7u7uam3NmzfH6tWr3686IiIqVbzLJhGRhDD0iYgkhKFPRCQhDH0iIglh6BMRSQhDn4hIQhj6REQSwtAnIpIQhj4RkYQw9ImIJIShT0QkIQx9IiIJYegTEUkIQ5+ISEIY+kREEsLQJyKSEIY+EZGEMPSJiCSEoU9EJCEMfSIiCWHoExFJCEOfiEhCGPpERBLC0CcikhCGPhGRhDD0iYgkhKFPRCQhDH0iIglh6BMRSQhDn4hIQhj6REQSwtAnIpKQIof+vn370KtXL5ibm8PV1RVRUVEF9lcqlVi1ahW6desGc3Nz9OnTB/v373/vgomIqOQqFqVTdHQ0pk6dCm9vb9jZ2eHo0aPw9/dH5cqV4eLiku86//3vf7F9+3ZMnjwZrVq1wv79+zFlyhTo6enBwcGhVJ8EEREVTZFCf9GiRXB1dUVgYCAAwM7ODmlpaQgJCck39BUKBcLCwhAUFISBAwcCADp37oz4+Hj88ssvDH0iIg0pNPQTEhKgUCgwefJktfaePXsiOjoaCQkJMDQ0VFt29OhRVK5cGf369VNr37JlSymUTEREJVXomH5cXBwAwNjYWK3dyMgIAHDnzp0869y4cQPGxsY4ffo0+vbti9atW8PZ2RkHDhwojZqJiKiECj3ST09PBwDo6emptevq6gIAMjIy8qyTnJyMhw8fIjAwEBMmTEDjxo0RERGBSZMmQV9fH506dSpWkQYGeoV3Kofq1Kmm6RLKFe7P0sX9WXo+5r4sNPSFEAAAmUyWb7uWVt4PC9nZ2UhOTsbq1avh5OQE4PWYflxcHJYvX17s0E9KyoBSKYq1TkHKyps1MTFd0yUUqqzsSxc2GRQAAB5kSURBVID7s7Rxf5ae0tyXWlqyAg+UCx3eqVbt9U57+4j+2bNnasvfpKuriwoVKsDGxkbVJpPJ0KVLF9y4caNolRMRUakrNPRzx/IVCoVa+927d9WWv8nIyAhKpRKvXr1Sa8/Ozs7ziYGIiD6eQkPfyMgIjRs3xsGDB9XaDx8+jKZNm6Jhw4Z51rGzs4MQAtHR0aq2V69e4ZdffoGVlVUplE1ERCVRpHn6fn5+CAgIQI0aNeDo6IiYmBhER0dj8eLFAF6fuFUoFGjRogX09PTQuXNnODg4YM6cOXj+/DmaNm2KrVu34v79+1i4cOEHfUJERPRuRQp9d3d3ZGVlITQ0FBERETA0NERwcDDc3NwAALGxsQgICMCmTZvQsWNHAMDSpUsREhKCtWvXIi0tDa1bt0ZoaChMTU0/3LMhIqICFSn0AcDLywteXl75LnN3d4e7u7taW+XKleHv7w9/f//3q5CIiEoN77JJRCQhDH0iIglh6BMRSQhDn4hIQhj6REQSwtAnIpIQhj4RkYQw9ImIJIShT0QkIQx9IiIJYegTEUkIQ5+ISEIY+kREEsLQJyKSEIY+EZGEMPSJiCSEoU9EJCEMfSIiCWHoExFJCEOfiEhCGPpERBLC0CcikhCGPhGRhDD0iYgkhKFPRCQhDH0iIglh6BMRSQhDn4hIQhj6REQSwtAnIpIQhj4RkYQUOfT37duHXr16wdzcHK6uroiKiiryRh4+fAgrKyusXLmyREUSEVHpKFLoR0dHY+rUqbCxscGKFSvQoUMH+Pv74+DBg4WuK4RAYGAgMjIy3rtYIiJ6PxWL0mnRokVwdXVFYGAgAMDOzg5paWkICQmBi4tLgetu3boVcXFx718pERG9t0KP9BMSEqBQKODs7KzW3rNnT8TFxSEhIaHAdRcsWIDZs2e/f6VERPTeCg393KN0Y2NjtXYjIyMAwJ07d/JdT6lUYtq0aXB1dYW9vf371klERKWg0OGd9PR0AICenp5au66uLgC8c6z+f//7HxISErB69er3rREGBnqFdyqH6tSppukSyhXuz9LF/Vl6Pua+LDT0hRAAAJlMlm+7llbeDwtxcXFYsmQJli5dimrV3v/JJCVlQKkU7/04ucrKmzUxMV3TJRSqrOxLgPuztHF/lp7S3JdaWrICD5QLHd7JDe23j+ifPXumtjxXTk4Opk2bBhcXF9jY2ODVq1d49eoVgNdDPrn/JyKij6/Q0M8dy1coFGrtd+/eVVue6+HDh/j9998RFRWFNm3aqP4BwLJly1T/JyKij6/Q4R0jIyM0btwYBw8eRI8ePVTthw8fRtOmTdGwYUO1/nXr1sXOnTvzPM6AAQPwxRdfwMPDoxTKJiKikijSPH0/Pz8EBASgRo0acHR0RExMDKKjo7F48WIAQHJyMhQKBVq0aAE9PT2YmZnl+zh169Z95zIiIvrwinRFrru7O2bNmoWTJ0/Cz88PZ8+eRXBwMNzc3AAAsbGx8PT0xLVr1z5osURE9H6KdKQPAF5eXvDy8sp3mbu7O9zd3Qtc/8aNG8WrjIiISh3vsklEJCEMfSIiCWHoExFJCEOfiEhCGPpERBLC0CcikhCGPhGRhDD0iYgkhKFPRCQhDH0iIglh6BMRSQhDn4hIQhj6REQSwtAnIpIQhj4RkYQw9ImIJIShT0QkIQx9IiIJYegTEUkIQ5+ISEIY+kREEsLQJyKSEIY+EZGEMPSJiCSEoU9EJCEMfSIiCWHoExFJCEOfiEhCGPpERBLC0CcikhCGPhGRhBQ59Pft24devXrB3Nwcrq6uiIqKKrB/YmIiZsyYAScnJ1haWsLd3R3R0dHvXTAREZVcxaJ0io6OxtSpU+Ht7Q07OzscPXoU/v7+qFy5MlxcXPL0z8rKwldffYX09HSMHz8edevWxaFDhzBx4kTk5OSgd+/epf5EiIiocEUK/UWLFsHV1RWBgYEAADs7O6SlpSEkJCTf0D9x4gT++usvREREwNzcHABgY2ODBw8eYN26dQx9IiINKXR4JyEhAQqFAs7OzmrtPXv2RFxcHBISEvKso6urC09PT5iZmam1N2vWDAqF4j1LJiKikir0SD8uLg4AYGxsrNZuZGQEALhz5w4MDQ3VlnXu3BmdO3dWa8vOzsbx48fRsmXL9yqYiIhKrtAj/fT0dACAnp6eWruuri4AICMjo0gbWrBgAeLj4+Hr61vcGomIqJQUeqQvhAAAyGSyfNu1tAr+uyGEwPz58/Hjjz/Cx8cH3bt3L3aRBgZ6hXcqh+rUqabpEsoV7s/Sxf1Zej7mviw09KtVe13M20f0z549U1uen6ysLEybNg379++Hj48PvvnmmxIVmZSUAaVSlGjd/JSVN2tiYrqmSyhUWdmXAPdnaeP+LD2luS+1tGQFHigXGvq5Y/kKhQImJiaq9rt376otf1tGRgZGjx6NixcvIjAwEMOGDStW4UREVPoKHdM3MjJC48aNcfDgQbX2w4cPo2nTpmjYsGGedXJycjB27Fj8/vvvWLRoEQOfiOgTUaR5+n5+fggICECNGjXg6OiImJgYREdHY/HixQCA5ORkKBQKtGjRAnp6eti2bRvOnj0LT09PNGjQAJcvX1Y9lkwmQ9u2bT/MsyEiogIVKfTd3d2RlZWF0NBQREREwNDQEMHBwXBzcwMAxMbGIiAgAJs2bULHjh1x6NAhAMD27duxfft2tceqUKEC/vzzz1J+GkREVBRFCn0A8PLygpeXV77L3N3d4e7urvp506ZN718ZERGVOt5lk4hIQhj6REQSwtAnIpIQhj4RkYQw9ImIJIShT0QkIQx9IiIJYegTEUkIQ5+ISEIY+kREEsLQJyKSEIY+EZGEMPSJiCSEoU9EJCEMfSIiCWHoExFJCEOfiEhCGPpERBLC0CcikhCGPhGRhDD0iYgkhKFPRCQhDH0iIglh6BMRSQhDn4hIQhj6REQSwtAnIpIQhj4RkYQw9ImIJIShT0QkIQx9IiIJYegTEUlIkUN/37596NWrF8zNzeHq6oqoqKgC+z979gyzZs2CjY0NLC0tMWrUKMTHx79vvURE9B6KFPrR0dGYOnUqbGxssGLFCnTo0AH+/v44ePDgO9eZNGkSDh48iKlTpyI4OBiPHz+Gt7c30tPTS614IiIqnopF6bRo0SK4uroiMDAQAGBnZ4e0tDSEhITAxcUlT//z58/j+PHjWLduHezt7QEA1tbW6NatG8LDw+Hr61uKT4GIiIqq0CP9hIQEKBQKODs7q7X37NkTcXFxSEhIyLPOqVOnoKurCxsbG1Wbvr4+2rdvjxMnTpRC2UREVBKFHunHxcUBAIyNjdXajYyMAAB37tyBoaFhnnWMjIxQoUIFtfYmTZogOjq62EVqacmKvU5h6taqUuqPWdo+xPP+EMrCvgS4P0sb92fpKc19WdhjFRr6uWPwenp6au26uroAgIyMjDzrZGRk5Omfu05+/QtTq5ZusdcpzIYZzoV30jADg7z78FNUFvYlwP1Z2rg/S8/H3JeFDu8IIQAAMpks33YtrbwPkbss3w3m05+IiD6OQhO4WrVqAPIe0T979kxt+Zv09PRUy99eJ79PAERE9HEUGvq5Y/kKhUKt/e7du2rL314nISEhzxH/3bt38+1PREQfR6Ghb2RkhMaNG+eZk3/48GE0bdoUDRs2zLOOra0t/vnnH5w+fVrVlpycjPPnz6NLly6lUDYREZVEhZkzZ84srFO1atWwatUqpKSkQCaTYePGjdi9eze+//57tGzZEsnJybhx4wb09PSgo6ODRo0a4ezZs9i6dStq1qyJBw8eIDAwEEII/Pe//0XlypU/wlMjIqK3yURBZ13fsG3bNoSGhuLhw4cwNDSEr68v+vXrBwCIjIxEQEAANm3ahI4dOwIA0tLSMHfuXBw9ehRKpRJWVlaYNm0amjVr9uGeDRERFajIoU9ERGUf508SEUkIQ5+ISEIY+kREEsLQL6aJEyfixIkTBV51TET0qWLoF9ODBw/g6+sLe3t7LFiwALdv39Z0SURERcbZOyVw584dREVF4aeffsLDhw9hZmaG/v37o3fv3vneloKKJiMjAy9evIBSqcyzrF69ehqoiKj8Yei/pzNnzuDgwYOIjY1FSkoKunfvjgEDBqBz586aLq3MUCgUCAwMxIULF97Z5/r16x+xorJn5MiRRe4rk8mwYcOGD1gNfcqK9M1Z9G7VqlWDrq4udHR0kJWVhb///hs+Pj5o1aoV5s+fj+bNm2u6xE9eUFAQbt26hXHjxqF+/fq8E2sJZGdna7qEcuPx48fF6l/WPoXySL8EHjx4gJ9++gl79+5FXFwcGjRogP79+6N///5o3Lgx7t27hzFjxkBLSwt79+7VdLmfPAsLC8yZMwe9e/fWdClEMDU1RU5OTpH7l7VPoTzSL6ahQ4fiwoUL0NbWRvfu3TF9+nR07txZ7fsGGjduDBcXF2zcuFGDlZYdurq6qFGjhqbLKNPK+9HpxxQREYHRo0cjKysLU6ZMQcWK5SsmeaRfTB4eHvDw8ECfPn0KPGl7/fp1ZGZmwsLC4iNWVzYFBwfjzp07WLVqVZ4v66GiadWqVbH2XVk7Ov3Y4uLiMHDgQPj4+ODrr7/WdDmliqFfAi9fvsS1a9dgZWUFAHj06BHOnj0LZ2dn3kG0BFasWIEff/wRtWrVgrm5OapUUf9OU5lMhqCgIA1VVzZERkYWK/T79+//AaspH8LCwrBw4UIcPXoU+vr6mi6n1DD0iykhIQEjRoyAUqlETEwMAODUqVP46quv0KJFC6xfv54fnYupa9euBS6XyWQ4duzYR6qG6LWcnBxcuHABLVq0YOhLmZ+fH+7du4eQkBA0bdpU1X7//n2MGzcOzZs3x4IFCzRXIBGAP/74A+fOnUN2drbq6nGlUokXL17g/PnzCA8P13CFn65ff/0V5ubm0NXV1XQpH0T5OkPxEZw/fx7BwcFqgQ8AjRo1gp+fH7777jvNFFYOpKWl4fLly8jIyIC+vj7MzMz4ncolEB4ejqCgoHxvFaKlpQVbW1sNVFV2jBw5Etu3b4e5ubmqbfv27XB2dkatWrU0WFnpYOgXkxACWVlZ71z+8uXLj1hN+bFq1SqsXr0amZmZqjYdHR34+vpi3LhxGqys7Nm8eTPs7e0xb948rFmzBhkZGQgMDMTx48cxbdo09O3bV9MlftLe/mOZk5ODmTNnwtTUtFyEPq+CKab27dtj5cqVSE1NVWv/559/sGbNGnTo0EFDlZVdO3bswNKlS+Hu7o6tW7fi8OHD2LJlC9zd3bFy5UpERERousQyJSEhAV9++SVq1KgBU1NTXLhwAZUrV0bPnj3h6+uLTZs2abrEMqc8jYLzSL+Ypk6dikGDBqFr165o164dDAwMkJycjIsXL6JixYqYO3eupkssc/73v/9h6NChCAwMVLU1adIE1tbW0NHRwebNmzFw4EANVli2aGtrq2aRGRkZ4e7du8jOzoa2tjasrKx4/YjE8Ui/mIyNjbFv3z54enoiPT0dly9fRnJyMjw8PBAVFcXbLpRAQkICHB0d813m6OiIu3fvftyCyrhWrVohNjYWwOv3q1KpxO+//w6g+BdxUfnDI/0SqFevHvz9/TVdRrnRoEED3L59G126dMmz7ObNm7xat5iGDRuGCRMmID09HXPmzEG3bt3wzTffwNXVFXv27FFdX0LFU14uHGTol8CTJ09w6dKld06H45TN4nFzc0NISAjq16+PHj16qNoPHz6M5cuXw93dXYPVlT09e/bEihUrEBcXB+D1De2mTJmCsLAwmJmZcYZZEUyYMAE6OjpqbX5+fnnaAODQoUMfq6xSwXn6xXT48GFMmTIF2dnZqr/8QgjV/5s1a4b9+/drssQyJzMzE1999RXOnTsHHR0dGBgYICkpCdnZ2bC2tsbatWvzXKVLxZM74yy/0CJ1AQEBxer/ww8/fKBKPgyGfjG5u7tDW1sb33//PcLCwpCTk4NRo0bh+PHjWLx4MVavXg0bGxtNl1kmxcbG4ty5c/jnn39QvXp1dOjQAfb29uXmY/XHolQqsWjRIly6dAlhYWEAXl9w5Ofnh5EjR3IKrMRxeKeYbt++jYULF6J169bo2LEjQkND0bx5czRv3hxPnz5l6L8HR0fHd57QpaJbsWIFNm3ahNGjR6va5HI5fHx8sG7dOujp6WH48OGaK5A0iqFfTFpaWqoTi0ZGRoiLi4NSqYSWlhbs7Oywe/duDVdYNowcORIzZsxAs2bNCv3WJ37TU/Hs3r0b33zzDYYMGaJqMzAwgJ+fH3R1dREeHs7QlzBO2SwmY2NjXLp0CcDr8fusrCz89ddfAIBnz54VeLUu/Z83T4JnZ2cX+I/7tHiSk5PRrFmzfJeZmJjg4cOHH7ki+pTwSL+YPD09ERQUhOfPn2PixIno1KkTpk+fjoEDB2Lz5s1o06aNpkssEzZv3pzv/+n9GRsb48iRI/lOgY2JiUGTJk00UBV9KirMnDlzpqaLKEtMTU1RrVo1JCcnw87ODlZWVoiMjMSePXugq6uL4OBg1K5dW9NllknPnz+HtrY2AODIkSM4ffo09PX1OU+/mCpXrowlS5YgLi4OOTk5SEpKwpUrV7B27Vrs2rULU6ZMwWeffabpMklDOHunmC5evAgzMzNVOAGvp2ympKSUq3tuf0xxcXEYM2YM3NzcMHHiRCxZsgSrV68G8DrAQkND0a5dOw1XWbaEhYVh5cqVSEpKUrXVrFkT48aNUxvrJ+lh6BeTnZ0dpkyZgn79+mm6lHLDz88PcXFxmDdvHkxMTGBrawtbW1sEBQVh2rRpSEtL4xBQCQghcOfOHaSmpqJatWpo1qwZKlSooOmySMN4IreYKlasyHu8l7Jz585h8uTJMDMzw9mzZ5Geng5PT0/o6enBy8sLV69e1XSJZVJWVhaSkpLw8OFD1K1bF4mJiZouiT4BPJFbTGPHjsV3332HGzduQC6Xw8DAIE8fDkUUT3Z2tmrc/sSJE6hSpYrq/jA5OTmoWJFv0+IKCwtDSEgI/vnnH8hkMuzcuRMhISHIysrCypUrUbVqVU2XSBrC36Ziyr1vybJlywCo34Qp93YM169f10htZZVcLsfhw4dhbGyMgwcPwtbWFhUrVkR2djbCwsIgl8s1XWKZsnPnTsyZMwfe3t5wcnJSzckfMGAAAgICsGzZMt4wUMIY+sXEL6AofePHj4efnx/CwsKgo6ODUaNGAXh947CkpCTVSV0qmg0bNmDEiBH45ptvkJOTo2p3dnbGkydPEBoaytCXMIZ+MfGbsUqfjY0NfvrpJ/zxxx9o27YtGjVqBOD1VbudOnVCixYtNFxh2XLv3r13fg9uy5YtObYvcQz9YirKUeeYMWM+QiXli6GhIQwNDdXaOLWwZOrXr48rV67ke3HW9evXUb9+fQ1URZ8Khn4xLVmy5J3L9PT0ULduXYZ+EfDeOx+Oh4cHVq5cicqVK8PJyQkA8PLlSxw7dgyrVq3C0KFDNVwhaRJDv5hy77PzpufPn+P8+fOYOXMmvv32Ww1UVfa8fe8dKj2jR4/GgwcPEBwcjODgYACvPzUJIdCrVy+MHTtWwxWSJvHirFK0a9cubNmyhXfapE9CfHw8zpw5o7o4y9raGi1btkR4eDgGDx6s6fJIQ3ikX4oaNmyI27dva7qMMun48eM4c+aMalbJlStXsHjxYowePRqdOnXScHVlw4kTJ7B7927IZDJ8/vnncHBwQNOmTVXLz58/D3d3d9y4cYOhL2G8IreUPH78GOvXr1fNPKGiO3DgAMaMGaP2B7NKlSpQKpXw8fHBiRMnNFhd2bB37174+vri2LFjOH78OMaMGYMjR44AAFJTUzF16lQMHToUt27dwogRIzRcLWkSh3eKqU2bNnm+vk+pVEIIASEE5s2bh759+2qourKpb9++6NChA2bMmJFn2ezZs/H7779j586dGqis7PDw8IC2tjbWr18PHR0dBAQEIC4uDosXL8bIkSPx4MED2NnZITAwEMbGxpoulzSIwzvFNGbMmHy/s1VPTw+Ojo5qH6epaBQKBQIDA/Nd1r17d0RGRn7kisqe+Ph4zJkzR3VfKD8/P/Tq1Qt+fn7IzMxESEgIevbsqeEq6VPA0C+mf/3rXwBez9jJvX9JRkYGMjIyOP+5hAwMDHDt2rV8x+5v3LjB++kXwfPnz9GgQQPVz40bN4YQAhUqVMDevXvzvUcUSRPH9IvpxYsXmDRpEgYNGqRqu3z5MhwdHREQEMCv9iuBPn36YPny5di2bRuePn0KIQSSkpIQERGBZcuWoU+fPpou8ZMnhICW1v/9OufeQnnixIkMfFLD0C+mhQsX4vTp02onwywtLTF37lzExsZi5cqVGqyubPLz84OdnR1mzpwJOzs7tG7dGra2tvj2229hY2OD8ePHa7rEMqtevXqaLoE+MRzeKabDhw9j2rRp6N+/v6pNV1cX/fr1Q3Z2NlatWoWJEydqsMKyR1tbG0uXLsXff/+NCxcuIC0tDdWqVYOVlRVatWql6fLKtPzOP5G0MfSLKT09/Z0flxs0aKD29XRUPHK5HM2aNUNKSgpq1arF++gX05sncnMn5c2aNQu6urpq/XhbC2nj8E4xmZiYvPOK2z179qBly5YfuaLy4erVq/Dx8YGlpSUcHBxw48YNTJs2DStWrNB0aWVC+/btUalSJWRnZyM7OxuvXr1C+/btoaOjo2rL/cfzTtLGQ6liGjt2LMaMGYMHDx6gW7duMDAwQHJyMn7++WdcvnyZY/olcPHiRQwfPhwtW7aEr6+vah/Wr18fy5cvR61atfDll19quMpPG79DmIqKF2eVwM8//4xly5bh+vXrqo/RrVq1wvjx49G1a1cNV1f2fPnll6hevTpWr16NV69ewdTUFLt27UKbNm0wd+5cnDp1Cj/99JOmyyQqF3ikXwJOTk5wcnJCZmYmUlNToauryy9Lfw/Xrl3D0qVLAeQ98ejk5IRt27Zpoiyicolj+iUQHh6OyZMno1KlSqhXrx6uX78OZ2dn3l2zhHR1dd95Avzx48d5TkQSUckx9Itpy5YtCAoKUjuyr1+/PqytrTFjxgzs2bNHg9WVTV27dsWSJUvw559/qtpkMhkSExOxZs0aODg4aLA6ovKFY/rF1LNnT/Tt2xd+fn55li1fvhyHDh3i+HMxpaamYtiwYbh58ybq1auHhw8fokWLFrh//z7q1q2L8PBw6Ovra7pMonKBY/rF9OjRI7Rr1y7fZVZWVli3bt1Hrqjsq1mzJiIiIhAVFYUzZ87A2NgYenp68PLygru7u+oeR0T0/hj6xdSwYUP89ttv6Ny5c55lFy5c4GXvJRAcHAw3NzcMGjRI7Z5GRFT6GPrF5OnpiQULFiAnJwfdu3eHvr4+UlJSEBMTgw0bNmDChAmaLrHM2bFjB2xtbTVdBpEkMPSLafjw4Xj8+DE2btyI9evXA3h9yXvFihUxdOhQfPXVVxqusOxp06YNTp8+DRsbG02XQlTu8URuCaWnp+PSpUuqm4OZm5sjOjoaO3bs4AyeYgoODsbmzZvRoEEDtGjRArVr11ZbLpPJEBQUpKHqiMoXhv57unLlCrZv344DBw7gxYsX0NfXx+nTpzVdVplS2FXMMpkMx44d+0jVEJVvDP0SePbsGX766Sds374df/31F7S1teHk5IR+/frB3t5e9QUWVLinT5/iwYMHaNKkCWrWrKnpcojKPY7pF8O1a9ewfft27Nu3Dy9evEDr1q0BAGvWrMl3Ng+9W2ZmJgIDAxEdHa26f5Grqyu+//57fj0i0QfE0C+CiIgIbNu2DdeuXUPdunUxePBguLu7w8DAAB06dOB930tgyZIliI6OhoeHB1q3bo07d+5g+/btUCqVWLJkiabLIyq3mFZF8O2338LExATr1q2Dra2t6qZg6enpGq6s7Dpy5Aj8/PzUrmw2MTHB999/j8zMTFSqVEmD1RGVX7z3ThH06NEDcXFxmDx5MiZPnozY2FgolUpNl1WmPX78GB06dFBrc3BwwKtXr3Dv3j0NVUVU/vFIvwiWLVuGlJQU7N27F7t378aYMWNQu3Zt9OjRAzKZjN9DWgLZ2dl5juZr1aoF4PV4PxF9GDzSL6JatWph2LBhiIqKwu7du+Hi4qI6CTljxgwsX74cd+7c0XSZ5QInlBF9OAz9Evjss88wY8YM/PLLL1iyZAmMjIywatUquLm5wd3dXdPllXn85ET04XCefilJTEzE7t27ERUVhQMHDmi6nE9eq1atYG5urva9BEII/Prrr2jbtq3aF6fIZDJs2LBBE2USlTsMfdKIoUOHFqs/v/ibqHQw9ImIJIRj+kREEsLQJyKSEIY+EZGEMPSJiCSEoU9EJCH/D2cWd+PkSuSSAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Print and visualize cross-validated metrics\n",
    "cv_metrics = pd.DataFrame({'Accuracy': cv_acc_mean,\n",
    "                           'Precision': cv_prec_mean,\n",
    "                           'Recall': cv_recall_mean,\n",
    "                           'F1': cv_f1_mean},\n",
    "                     index=[0])\n",
    "print(cv_metrics)\n",
    "\n",
    "cv_metrics.T.plot(kind='bar',\n",
    "                  title='Cross-validated classification metrics',\n",
    "                 legend=False);"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Feature importance\n",
    "\n",
    "Feature importance means asking 'which feature contributes the most to the outcomes of the model and how did they contribute?'. Let's have a look to the `best_model` feature importance:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 80,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0:\tlearn: 0.4908682\ttotal: 67.3ms\tremaining: 13.4s\n",
      "1:\tlearn: 0.4194458\ttotal: 124ms\tremaining: 12.3s\n",
      "2:\tlearn: 0.3751819\ttotal: 179ms\tremaining: 11.8s\n",
      "3:\tlearn: 0.3589593\ttotal: 232ms\tremaining: 11.4s\n",
      "4:\tlearn: 0.3434688\ttotal: 293ms\tremaining: 11.4s\n",
      "5:\tlearn: 0.3350108\ttotal: 367ms\tremaining: 11.9s\n",
      "6:\tlearn: 0.3269599\ttotal: 448ms\tremaining: 12.4s\n",
      "7:\tlearn: 0.3216840\ttotal: 531ms\tremaining: 12.7s\n",
      "8:\tlearn: 0.3173441\ttotal: 593ms\tremaining: 12.6s\n",
      "9:\tlearn: 0.3108165\ttotal: 632ms\tremaining: 12s\n",
      "10:\tlearn: 0.3077728\ttotal: 668ms\tremaining: 11.5s\n",
      "11:\tlearn: 0.3052361\ttotal: 733ms\tremaining: 11.5s\n",
      "12:\tlearn: 0.3031423\ttotal: 894ms\tremaining: 12.9s\n",
      "13:\tlearn: 0.3019613\ttotal: 959ms\tremaining: 12.7s\n",
      "14:\tlearn: 0.3006387\ttotal: 1.03s\tremaining: 12.7s\n",
      "15:\tlearn: 0.2996452\ttotal: 1.11s\tremaining: 12.8s\n",
      "16:\tlearn: 0.2977942\ttotal: 1.17s\tremaining: 12.6s\n",
      "17:\tlearn: 0.2967146\ttotal: 1.22s\tremaining: 12.3s\n",
      "18:\tlearn: 0.2957479\ttotal: 1.29s\tremaining: 12.3s\n",
      "19:\tlearn: 0.2947436\ttotal: 1.38s\tremaining: 12.4s\n",
      "20:\tlearn: 0.2924427\ttotal: 1.47s\tremaining: 12.5s\n",
      "21:\tlearn: 0.2915009\ttotal: 1.52s\tremaining: 12.3s\n",
      "22:\tlearn: 0.2907962\ttotal: 1.57s\tremaining: 12.1s\n",
      "23:\tlearn: 0.2903345\ttotal: 1.64s\tremaining: 12.1s\n",
      "24:\tlearn: 0.2893767\ttotal: 1.69s\tremaining: 11.8s\n",
      "25:\tlearn: 0.2887703\ttotal: 1.74s\tremaining: 11.6s\n",
      "26:\tlearn: 0.2878701\ttotal: 1.8s\tremaining: 11.5s\n",
      "27:\tlearn: 0.2870882\ttotal: 1.86s\tremaining: 11.4s\n",
      "28:\tlearn: 0.2868303\ttotal: 1.9s\tremaining: 11.2s\n",
      "29:\tlearn: 0.2851565\ttotal: 1.96s\tremaining: 11.1s\n",
      "30:\tlearn: 0.2846835\ttotal: 2.02s\tremaining: 11s\n",
      "31:\tlearn: 0.2840050\ttotal: 2.08s\tremaining: 10.9s\n",
      "32:\tlearn: 0.2833664\ttotal: 2.13s\tremaining: 10.8s\n",
      "33:\tlearn: 0.2813651\ttotal: 2.17s\tremaining: 10.6s\n",
      "34:\tlearn: 0.2811943\ttotal: 2.2s\tremaining: 10.4s\n",
      "35:\tlearn: 0.2793825\ttotal: 2.27s\tremaining: 10.4s\n",
      "36:\tlearn: 0.2785369\ttotal: 2.33s\tremaining: 10.3s\n",
      "37:\tlearn: 0.2777375\ttotal: 2.37s\tremaining: 10.1s\n",
      "38:\tlearn: 0.2760220\ttotal: 2.42s\tremaining: 9.99s\n",
      "39:\tlearn: 0.2753894\ttotal: 2.48s\tremaining: 9.91s\n",
      "40:\tlearn: 0.2738775\ttotal: 2.51s\tremaining: 9.75s\n",
      "41:\tlearn: 0.2734465\ttotal: 2.55s\tremaining: 9.59s\n",
      "42:\tlearn: 0.2728203\ttotal: 2.59s\tremaining: 9.45s\n",
      "43:\tlearn: 0.2719009\ttotal: 2.63s\tremaining: 9.32s\n",
      "44:\tlearn: 0.2712620\ttotal: 2.69s\tremaining: 9.27s\n",
      "45:\tlearn: 0.2710751\ttotal: 2.74s\tremaining: 9.17s\n",
      "46:\tlearn: 0.2706171\ttotal: 2.77s\tremaining: 9.03s\n",
      "47:\tlearn: 0.2699575\ttotal: 2.81s\tremaining: 8.9s\n",
      "48:\tlearn: 0.2693956\ttotal: 2.99s\tremaining: 9.22s\n",
      "49:\tlearn: 0.2688527\ttotal: 3.07s\tremaining: 9.21s\n",
      "50:\tlearn: 0.2682841\ttotal: 3.12s\tremaining: 9.1s\n",
      "51:\tlearn: 0.2678216\ttotal: 3.15s\tremaining: 8.97s\n",
      "52:\tlearn: 0.2667017\ttotal: 3.2s\tremaining: 8.87s\n",
      "53:\tlearn: 0.2661752\ttotal: 3.26s\tremaining: 8.81s\n",
      "54:\tlearn: 0.2660654\ttotal: 3.3s\tremaining: 8.7s\n",
      "55:\tlearn: 0.2655379\ttotal: 3.34s\tremaining: 8.58s\n",
      "56:\tlearn: 0.2652340\ttotal: 3.39s\tremaining: 8.51s\n",
      "57:\tlearn: 0.2650206\ttotal: 3.45s\tremaining: 8.45s\n",
      "58:\tlearn: 0.2645868\ttotal: 3.5s\tremaining: 8.36s\n",
      "59:\tlearn: 0.2637614\ttotal: 3.54s\tremaining: 8.25s\n",
      "60:\tlearn: 0.2634214\ttotal: 3.57s\tremaining: 8.14s\n",
      "61:\tlearn: 0.2627555\ttotal: 3.65s\tremaining: 8.12s\n",
      "62:\tlearn: 0.2623667\ttotal: 3.69s\tremaining: 8.03s\n",
      "63:\tlearn: 0.2620370\ttotal: 3.73s\tremaining: 7.92s\n",
      "64:\tlearn: 0.2615938\ttotal: 3.77s\tremaining: 7.83s\n",
      "65:\tlearn: 0.2610006\ttotal: 3.84s\tremaining: 7.79s\n",
      "66:\tlearn: 0.2606389\ttotal: 3.9s\tremaining: 7.73s\n",
      "67:\tlearn: 0.2603066\ttotal: 3.94s\tremaining: 7.65s\n",
      "68:\tlearn: 0.2601362\ttotal: 4s\tremaining: 7.59s\n",
      "69:\tlearn: 0.2597794\ttotal: 4.05s\tremaining: 7.53s\n",
      "70:\tlearn: 0.2594506\ttotal: 4.09s\tremaining: 7.43s\n",
      "71:\tlearn: 0.2591262\ttotal: 4.12s\tremaining: 7.33s\n",
      "72:\tlearn: 0.2583458\ttotal: 4.16s\tremaining: 7.24s\n",
      "73:\tlearn: 0.2581309\ttotal: 4.2s\tremaining: 7.16s\n",
      "74:\tlearn: 0.2575654\ttotal: 4.27s\tremaining: 7.12s\n",
      "75:\tlearn: 0.2570338\ttotal: 4.31s\tremaining: 7.03s\n",
      "76:\tlearn: 0.2566051\ttotal: 4.34s\tremaining: 6.94s\n",
      "77:\tlearn: 0.2561067\ttotal: 4.38s\tremaining: 6.85s\n",
      "78:\tlearn: 0.2556132\ttotal: 4.43s\tremaining: 6.79s\n",
      "79:\tlearn: 0.2552730\ttotal: 4.48s\tremaining: 6.72s\n",
      "80:\tlearn: 0.2547524\ttotal: 4.54s\tremaining: 6.66s\n",
      "81:\tlearn: 0.2542290\ttotal: 4.71s\tremaining: 6.78s\n",
      "82:\tlearn: 0.2537321\ttotal: 4.76s\tremaining: 6.71s\n",
      "83:\tlearn: 0.2535879\ttotal: 4.79s\tremaining: 6.62s\n",
      "84:\tlearn: 0.2532275\ttotal: 4.83s\tremaining: 6.54s\n",
      "85:\tlearn: 0.2529223\ttotal: 4.87s\tremaining: 6.45s\n",
      "86:\tlearn: 0.2525854\ttotal: 4.9s\tremaining: 6.37s\n",
      "87:\tlearn: 0.2521402\ttotal: 4.96s\tremaining: 6.32s\n",
      "88:\tlearn: 0.2517646\ttotal: 5.08s\tremaining: 6.33s\n",
      "89:\tlearn: 0.2513449\ttotal: 5.19s\tremaining: 6.34s\n",
      "90:\tlearn: 0.2508334\ttotal: 5.24s\tremaining: 6.28s\n",
      "91:\tlearn: 0.2503955\ttotal: 5.29s\tremaining: 6.2s\n",
      "92:\tlearn: 0.2501494\ttotal: 5.33s\tremaining: 6.14s\n",
      "93:\tlearn: 0.2498513\ttotal: 5.4s\tremaining: 6.09s\n",
      "94:\tlearn: 0.2493098\ttotal: 5.45s\tremaining: 6.02s\n",
      "95:\tlearn: 0.2490242\ttotal: 5.5s\tremaining: 5.96s\n",
      "96:\tlearn: 0.2486774\ttotal: 5.56s\tremaining: 5.9s\n",
      "97:\tlearn: 0.2483984\ttotal: 5.61s\tremaining: 5.84s\n",
      "98:\tlearn: 0.2480883\ttotal: 5.67s\tremaining: 5.78s\n",
      "99:\tlearn: 0.2476862\ttotal: 5.71s\tremaining: 5.71s\n",
      "100:\tlearn: 0.2473358\ttotal: 5.75s\tremaining: 5.64s\n",
      "101:\tlearn: 0.2471740\ttotal: 5.79s\tremaining: 5.56s\n",
      "102:\tlearn: 0.2469111\ttotal: 5.84s\tremaining: 5.5s\n",
      "103:\tlearn: 0.2465364\ttotal: 5.91s\tremaining: 5.45s\n",
      "104:\tlearn: 0.2461757\ttotal: 5.94s\tremaining: 5.38s\n",
      "105:\tlearn: 0.2460094\ttotal: 5.98s\tremaining: 5.3s\n",
      "106:\tlearn: 0.2457984\ttotal: 6.04s\tremaining: 5.25s\n",
      "107:\tlearn: 0.2454235\ttotal: 6.08s\tremaining: 5.18s\n",
      "108:\tlearn: 0.2453635\ttotal: 6.14s\tremaining: 5.13s\n",
      "109:\tlearn: 0.2451042\ttotal: 6.21s\tremaining: 5.08s\n",
      "110:\tlearn: 0.2446415\ttotal: 6.28s\tremaining: 5.03s\n",
      "111:\tlearn: 0.2445391\ttotal: 6.32s\tremaining: 4.96s\n",
      "112:\tlearn: 0.2442519\ttotal: 6.35s\tremaining: 4.89s\n",
      "113:\tlearn: 0.2439339\ttotal: 6.39s\tremaining: 4.82s\n",
      "114:\tlearn: 0.2436323\ttotal: 6.45s\tremaining: 4.77s\n",
      "115:\tlearn: 0.2433580\ttotal: 6.51s\tremaining: 4.71s\n",
      "116:\tlearn: 0.2429652\ttotal: 6.58s\tremaining: 4.67s\n",
      "117:\tlearn: 0.2428816\ttotal: 6.65s\tremaining: 4.62s\n",
      "118:\tlearn: 0.2425902\ttotal: 6.74s\tremaining: 4.59s\n",
      "119:\tlearn: 0.2425076\ttotal: 6.92s\tremaining: 4.62s\n",
      "120:\tlearn: 0.2422554\ttotal: 6.97s\tremaining: 4.55s\n",
      "121:\tlearn: 0.2418910\ttotal: 7.01s\tremaining: 4.48s\n",
      "122:\tlearn: 0.2414850\ttotal: 7.04s\tremaining: 4.41s\n",
      "123:\tlearn: 0.2411052\ttotal: 7.08s\tremaining: 4.34s\n",
      "124:\tlearn: 0.2407426\ttotal: 7.12s\tremaining: 4.27s\n",
      "125:\tlearn: 0.2403701\ttotal: 7.18s\tremaining: 4.22s\n",
      "126:\tlearn: 0.2400156\ttotal: 7.33s\tremaining: 4.21s\n",
      "127:\tlearn: 0.2397220\ttotal: 7.4s\tremaining: 4.16s\n",
      "128:\tlearn: 0.2393455\ttotal: 7.44s\tremaining: 4.1s\n",
      "129:\tlearn: 0.2393125\ttotal: 7.48s\tremaining: 4.03s\n",
      "130:\tlearn: 0.2392900\ttotal: 7.51s\tremaining: 3.96s\n",
      "131:\tlearn: 0.2390228\ttotal: 7.56s\tremaining: 3.89s\n",
      "132:\tlearn: 0.2386051\ttotal: 7.62s\tremaining: 3.84s\n",
      "133:\tlearn: 0.2385365\ttotal: 7.66s\tremaining: 3.77s\n",
      "134:\tlearn: 0.2382865\ttotal: 7.69s\tremaining: 3.7s\n",
      "135:\tlearn: 0.2381867\ttotal: 7.74s\tremaining: 3.64s\n",
      "136:\tlearn: 0.2378905\ttotal: 7.79s\tremaining: 3.58s\n",
      "137:\tlearn: 0.2375443\ttotal: 7.85s\tremaining: 3.53s\n",
      "138:\tlearn: 0.2373808\ttotal: 7.89s\tremaining: 3.46s\n",
      "139:\tlearn: 0.2369896\ttotal: 7.92s\tremaining: 3.4s\n",
      "140:\tlearn: 0.2369313\ttotal: 7.99s\tremaining: 3.34s\n",
      "141:\tlearn: 0.2365896\ttotal: 8.03s\tremaining: 3.28s\n",
      "142:\tlearn: 0.2362886\ttotal: 8.06s\tremaining: 3.21s\n",
      "143:\tlearn: 0.2361306\ttotal: 8.1s\tremaining: 3.15s\n",
      "144:\tlearn: 0.2356969\ttotal: 8.18s\tremaining: 3.1s\n",
      "145:\tlearn: 0.2353846\ttotal: 8.22s\tremaining: 3.04s\n",
      "146:\tlearn: 0.2350539\ttotal: 8.27s\tremaining: 2.98s\n",
      "147:\tlearn: 0.2349887\ttotal: 8.31s\tremaining: 2.92s\n",
      "148:\tlearn: 0.2348342\ttotal: 8.38s\tremaining: 2.87s\n",
      "149:\tlearn: 0.2345571\ttotal: 8.42s\tremaining: 2.81s\n",
      "150:\tlearn: 0.2343070\ttotal: 8.45s\tremaining: 2.74s\n",
      "151:\tlearn: 0.2339252\ttotal: 8.49s\tremaining: 2.68s\n",
      "152:\tlearn: 0.2337977\ttotal: 8.55s\tremaining: 2.63s\n",
      "153:\tlearn: 0.2335020\ttotal: 8.58s\tremaining: 2.56s\n",
      "154:\tlearn: 0.2333910\ttotal: 8.62s\tremaining: 2.5s\n",
      "155:\tlearn: 0.2332230\ttotal: 8.66s\tremaining: 2.44s\n",
      "156:\tlearn: 0.2331877\ttotal: 8.7s\tremaining: 2.38s\n",
      "157:\tlearn: 0.2328006\ttotal: 8.78s\tremaining: 2.33s\n",
      "158:\tlearn: 0.2326882\ttotal: 8.82s\tremaining: 2.27s\n",
      "159:\tlearn: 0.2321960\ttotal: 8.86s\tremaining: 2.21s\n",
      "160:\tlearn: 0.2318909\ttotal: 8.89s\tremaining: 2.15s\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "161:\tlearn: 0.2316377\ttotal: 8.95s\tremaining: 2.1s\n",
      "162:\tlearn: 0.2314334\ttotal: 8.99s\tremaining: 2.04s\n",
      "163:\tlearn: 0.2313030\ttotal: 9.02s\tremaining: 1.98s\n",
      "164:\tlearn: 0.2311225\ttotal: 9.06s\tremaining: 1.92s\n",
      "165:\tlearn: 0.2309912\ttotal: 9.1s\tremaining: 1.86s\n",
      "166:\tlearn: 0.2308625\ttotal: 9.15s\tremaining: 1.81s\n",
      "167:\tlearn: 0.2305396\ttotal: 9.19s\tremaining: 1.75s\n",
      "168:\tlearn: 0.2302674\ttotal: 9.23s\tremaining: 1.69s\n",
      "169:\tlearn: 0.2300108\ttotal: 9.26s\tremaining: 1.63s\n",
      "170:\tlearn: 0.2297815\ttotal: 9.32s\tremaining: 1.58s\n",
      "171:\tlearn: 0.2296689\ttotal: 9.4s\tremaining: 1.53s\n",
      "172:\tlearn: 0.2294944\ttotal: 9.51s\tremaining: 1.48s\n",
      "173:\tlearn: 0.2292393\ttotal: 9.58s\tremaining: 1.43s\n",
      "174:\tlearn: 0.2288646\ttotal: 9.62s\tremaining: 1.37s\n",
      "175:\tlearn: 0.2287578\ttotal: 9.66s\tremaining: 1.32s\n",
      "176:\tlearn: 0.2283487\ttotal: 9.73s\tremaining: 1.26s\n",
      "177:\tlearn: 0.2282617\ttotal: 9.79s\tremaining: 1.21s\n",
      "178:\tlearn: 0.2279401\ttotal: 9.83s\tremaining: 1.15s\n",
      "179:\tlearn: 0.2276728\ttotal: 9.88s\tremaining: 1.1s\n",
      "180:\tlearn: 0.2273571\ttotal: 9.95s\tremaining: 1.04s\n",
      "181:\tlearn: 0.2271960\ttotal: 10s\tremaining: 989ms\n",
      "182:\tlearn: 0.2268108\ttotal: 10.1s\tremaining: 935ms\n",
      "183:\tlearn: 0.2267710\ttotal: 10.1s\tremaining: 879ms\n",
      "184:\tlearn: 0.2264325\ttotal: 10.1s\tremaining: 822ms\n",
      "185:\tlearn: 0.2262055\ttotal: 10.2s\tremaining: 769ms\n",
      "186:\tlearn: 0.2258985\ttotal: 10.3s\tremaining: 713ms\n",
      "187:\tlearn: 0.2258210\ttotal: 10.3s\tremaining: 657ms\n",
      "188:\tlearn: 0.2256061\ttotal: 10.3s\tremaining: 601ms\n",
      "189:\tlearn: 0.2251952\ttotal: 10.4s\tremaining: 547ms\n",
      "190:\tlearn: 0.2250079\ttotal: 10.5s\tremaining: 493ms\n",
      "191:\tlearn: 0.2247227\ttotal: 10.5s\tremaining: 439ms\n",
      "192:\tlearn: 0.2245924\ttotal: 10.6s\tremaining: 386ms\n",
      "193:\tlearn: 0.2243439\ttotal: 10.7s\tremaining: 331ms\n",
      "194:\tlearn: 0.2240694\ttotal: 10.7s\tremaining: 276ms\n",
      "195:\tlearn: 0.2238840\ttotal: 10.8s\tremaining: 221ms\n",
      "196:\tlearn: 0.2236520\ttotal: 10.8s\tremaining: 165ms\n",
      "197:\tlearn: 0.2235510\ttotal: 10.9s\tremaining: 110ms\n",
      "198:\tlearn: 0.2235149\ttotal: 10.9s\tremaining: 54.8ms\n",
      "199:\tlearn: 0.2233077\ttotal: 11s\tremaining: 0us\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "<catboost.core.CatBoostClassifier at 0x17e5d391ac0>"
      ]
     },
     "execution_count": 80,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Use the model that gave use best results in term of accuracy: Catboost RandomizedSearchCV\n",
    "best_model.fit(X_train, y_train)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 88,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([12.77346334,  1.26775709,  3.03356217,  1.60932448,  9.1973369 ,\n",
       "        6.29882262,  4.28403262, 20.63580089,  0.51955146,  1.93768995,\n",
       "       24.05957824,  6.98890236,  6.23397512,  1.16020277,  0.        ,\n",
       "        0.        ,  0.        ,  0.        ,  0.        ,  0.        ,\n",
       "        0.        ,  0.        ,  0.        ])"
      ]
     },
     "execution_count": 88,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Check best_model feature importance\n",
    "best_model_feat = best_model.get_feature_importance()\n",
    "best_model_feat"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 87,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'age': 12.773463343340515,\n",
       " 'workclass': 1.2677570866024819,\n",
       " 'fnlwgt': 3.0335621686238783,\n",
       " 'education': 1.6093244759602983,\n",
       " 'education_num': 9.197336901375511,\n",
       " 'marital_status': 6.298822620267535,\n",
       " 'occupation': 4.284032615564992,\n",
       " 'relationship': 20.635800887267987,\n",
       " 'race': 0.5195514618713597,\n",
       " 'sex': 1.937689951593869,\n",
       " 'capital_gain': 24.059578238300766,\n",
       " 'capital_loss': 6.98890235877965,\n",
       " 'hours_per_week': 6.233975119875873,\n",
       " 'native_country': 1.1602027705752926,\n",
       " 'class': 0.0,\n",
       " 'workclass_is_missing': 0.0,\n",
       " 'education_is_missing': 0.0,\n",
       " 'marital_status_is_missing': 0.0,\n",
       " 'occupation_is_missing': 0.0,\n",
       " 'relationship_is_missing': 0.0,\n",
       " 'race_is_missing': 0.0,\n",
       " 'sex_is_missing': 0.0,\n",
       " 'native_country_is_missing': 0.0}"
      ]
     },
     "execution_count": 87,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "feature_dict = dict(zip(df1.columns, list(best_model_feat)))\n",
    "feature_dict"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 90,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<Figure size 720x432 with 0 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXkAAAHHCAYAAABawyg4AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjMsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+AADFEAAAgAElEQVR4nOzdeVxN+f8H8NetVCgk4YuxZXQl7WUNlX0ZZMlI9hQpkX2JMRgipSxNdsqMZSaEsSSyp8g23+JrLUuWjLSvn98ffp3pds+9dRdq7ryfj0ePB+ecz/l87rnnvj/nfM7ncz4CxhgDIYQQlaRW1QUghBDy5VCQJ4QQFUZBnhBCVBgFeUIIUWEU5AkhRIVRkCeEEBVGQf5fKCQkBEZGRlL/kpKSvlj+6enpyMnJ+WL7l0VcXByMjIwQEhJS1UWRWXU6jqT60qjqApCq4+HhgdatW/Oua9KkyRfJMzY2FnPmzEFkZCRq1ar1RfL4N6DjSCqLgvy/WJcuXdCxY8evmufdu3fx6dOnr5qnKqLjSCqLmmsIIUSF0ZU8qVBiYiKCg4Nx+/ZtAICFhQV8fHxgamrKbcMYw6+//orffvsNjx8/RlFREZo2bQonJye4ublBIBBgwYIFiIyMBAA4OjrC1tYW+/btg6urK16+fImYmBiRfMsvd3V1haamJkxMTLB3715oa2tj9+7dMDIywqNHjxAYGIi4uDgUFhaiXbt28PT0hJ2dncyf19XVFbVq1cLIkSMRHByMp0+fonnz5pg3bx6srKzg7++PU6dOQV1dHb1798aiRYugra0NAHBwcEDnzp1hbm6O0NBQpKenQygUwsfHB506dRLJJyEhAZs2bcKdO3cAAB06dICXlxdsbGy4bRwcHNClSxeUlJQgKioKenp6EAqFiI2NFTuOAHDq1CmEh4cjKSkJ+fn5aNiwIfr16wcfHx9oamqKHMfx48cjKCgI//vf/6Cvr4/hw4fD09MTamp/X/s9fvwYwcHBuH79OoqKimBsbIyZM2fC2tqa20aZx54oHwX5f7HMzEx8+PBBbLmuri5q1KgBALhy5Qrc3d0hFAoxc+ZMFBQU4Pfff4eLiwt27drF/diDgoIQGhqKYcOGYdSoUcjOzsaRI0cQEBAAAwMDDBs2DM7OzsjKysLZs2excOFCfPvttzKX+datW3j+/Dnmzp2LFy9eoE2bNnjw4AHGjBmDBg0awN3dHTVq1MDx48cxdepUBAQEYMCAATLn8+effyIxMRHjxo2Drq4ufv75Z/j4+KBdu3aoWbMmZs2ahYSEBBw4cAANGzbEjBkzuLRXr17FsWPH4OrqCgMDA/zyyy+YMmUKdu7cCVtbWwDAuXPnMGPGDDRv3hzTpk0DABw6dAgTJkxAcHAwHB0duf2dOHECrVq1wuLFi/H+/Xt07doVmpqaYsfx0KFDWLJkCRwcHDBnzhwUFhbi7Nmz2LFjB2rVqiVSxocPH8LHxwfOzs5wdnbG8ePHsWnTJtSvXx8uLi4AgGfPnmHUqFHQ0NDA2LFjUb9+ffz666+YOHEiIiIiYGpq+kWOPVEyRv51goODWdu2bSX+Xb9+nTHGWHFxMXN0dGSjR49mRUVFXPrs7GzWu3dvNmTIEMYYYwUFBczS0pLNmjVLJJ/MzExmYmLC3N3dxfJOTU3llo0dO5bZ29uLlbP88rFjx4qUr+zyXr16sezsbG5ZYWEhGzNmDOvSpQvLz8+XeCyuX7/O2rZty4KDg8XyiYmJ4ZaFh4eztm3bslGjRnHLSkpKWPfu3ZmzszO3zN7enrVt25adPXuWW5aens6sra25tIWFhax79+6sR48eLDMzk9suIyOD2dnZMTs7O1ZQUMDtTygUsufPn4uUm+849uvXjzk7O7OSkhKR49C9e3c2aNAgsc937tw5blleXh6zsbER+SwzZ85kpqam7NmzZ9yyDx8+MCsrK+bt7c3tS95jT74OupL/F5s/fz6EQqHY8tJl//3vf5Gamorvv/8eGRkZItvY29tj9+7dSEtLQ+PGjXH16lUUFhaKbPPXX39BR0dHqd38tLW1RZoz/vrrL9y4cQOurq7Iy8tDXl4et65379746aefcO/ePVhZWcmUj5aWlkhzQ6tWrQBA5ApbIBCgadOmePPmjUja1q1bo1evXtz/69evjyFDhiA8PBzp6el4+fIl0tLSMGfOHOjo6HDb1alTB2PHjkVAQADu378PCwsLAEDz5s3RvHnzCst87Ngx5ObmQiAQcMvS09NRp04dse+gZs2a6Nmzp8jnbdWqFd6/fw8AKCkpQWxsLHr06IEWLVpw2+np6WH//v3Q09P7YseeKBcF+X+x9u3bS+1dk5KSAgDw9/eHv78/7zavX79G48aNUaNGDVy4cAHnzp3D06dP8fz5c65iYEp8m3W9evVE2oxTU1MBAPv27ePapfnKKE8+Ghp//zzU1dUBAPr6+iLbqauri32+Nm3aiO2vRYsWYIzh5cuXePHiBYC/K46ySru0vnr1igvy5fOUpEaNGoiPj8fx48fx5MkTpKSkID09HQDQtGlTsc9X9jgCgKamJkpKSgAAHz9+RE5OjkiAL9W2bVsAn3v4AMo/9kS5KMgTiUp/8DNnzoS5uTnvNq1btwZjDHPnzsXx48dhZWUFCwsLODs7w8bGBuPHj5c7/+LiYrFlpcG2/DYuLi4iV89l8QXdipQN8GWVvUqWpPR5Rlml5eSrFMoqXVd2H+U/syQBAQEICwuDsbExzM3NMWTIEFhYWODHH38UC7blA7yk8krb7ksde6JcFOSJRKVXf7Vq1UKXLl1E1t29excZGRnQ1tZGQkICjh8/junTp2PmzJncNkVFRfj48SO++eYbqfmoqamhoKBAbHlp00Flyqiuri5WxkePHuHFixeoWbNmhftRptI7oLKeP38OdXV1NGvWjGvWevLkidh2T58+BQA0btxYpjxfvnyJsLAwDBkyROyuqzLHsTw9PT1oa2vj+fPnYut27NiB9+/fY+LEiQCq17En4qifPJHIxMQEBgYG2LdvH7Kzs7nlWVlZ8PHxwcKFC6Guro6PHz8CEL9qO3jwIHJzc1FUVMQtK70yLHs126BBA6Snp4u0bd+/f583wJTXsGFDmJiYIDIyUiR9YWEhFi1aBG9vb5H8v4Z79+5x3U2Bz0H22LFj6NSpE+rWrYv27dtzvW6ysrK47bKysrB//34YGBjAxMREah7lj2Np01j57yA2NhbPnj2T+RhoaGiga9euiI2NFbkLyMjIwI4dO5CSklItjz0RR1fyRKIaNWpg6dKl8PHxgZOTE0aMGAEtLS0cOnQIr169wvr166GhoQELCwvo6Ojgp59+wqtXr1CnTh3ExcXh5MmT0NLSEqkg6tevDwDYvn07unfvDkdHRwwaNAjHjx+Hm5sbvv/+e6Snp2Pfvn1o2bKl2MNcPkuWLMH48eMxfPhwfP/996hXrx5OnDiBO3fuwNfXF3p6el/sGPHR1NSEm5sbxo8fD21tbezfvx8lJSWYN28eANHjOnz4cIwYMQIAcPjwYbx9+xbBwcEVNqeUP452dnZo0qQJQkNDkZ+fj8aNG+Pu3buIjIwU+w4qy9fXFyNHjsTIkSPh4uICHR0dHDx4EDk5OfDx8QFQ/Y49EUdBnkjVt29f7Ny5E1u3bsWWLVugpqaGb7/9Flu3boW9vT2Az1fiYWFhWL9+PbZs2QJNTU20atUKGzZswN27d7F37168f/8eDRo0wMCBA3HmzBn8/vvvuHHjBhwdHWFvbw8/Pz/s3bsXq1atQqtWrbB8+XLEx8fjwoULFZbRwsICv/zyC0JCQrBr1y4UFRWhVatWWLNmDYYNG/aFj5A4c3NzDBw4EFu2bEFmZiasra3h6+sr0pOp9Lhu2bIFmzdvhoaGBszMzLBq1SqRgUaS8B3HsLAwrFmzBnv37gVjDM2bN8eiRYtQVFSEVatW4f79+xXeIZRlaGiIAwcOYMOGDdi+fTvU1NRgamqKtWvXcn3zq9uxJ+IETJldHwj5l3NwcEDTpk0l9jYh5GujNnlCCFFhlWquKSkpwYEDB7B//368ePEC+vr6cHR0hJeXFzeYY8KECbh27ZpY2sOHD6NDhw7KLTUhhJBKqVSQ3759O4KCgjB58mR07twZT58+RXBwMB49eoQdO3YAAJKTkzFu3DgMHDhQJK2hoaHyS00IIaRSKgzyjDFs374dzs7O8PX1BfD5PeR6enqYNWsWkpKSUL9+ffz111+ws7OTOGiGkH+D8m/SJKSqVRjks7Oz8d1336F///4iy0uHX6ekpODt27cAACMjoy9QREIIIfKqMMjr6OhgyZIlYsujo6MBfB58ER0dDU1NTQQHByM6Oho5OTno1KkTFi1axPt+Dmn++isbJSXiHX709XWQnp7Fk6Ji8qatijwVSUt5qlaeiqSlPFUrT2lp1dQE0NOrLTGdXP3k79y5g7CwMPTq1QuGhobYtGkTCgoKoK2tjU2bNuH169fYvHkzXFxccPToURgYGFR63yUljDfIl66Tl7xpqyJPRdJSnqqVpyJpKU/VylPetDL3k7958yY8PDxgYGCAiIgI6Onp4eHDh/jw4YPIzDepqano378/Jk+ejFmzZslcMEIIIYqT6Ur+5MmTWLBgAVq2bInt27dzQ5ZLXz1a1jfffANDQ0MkJyfLVKD09Cze2srAQBfv3mXKtC9F01ZFnoqkpTxVK09F0lKeqpWntLRqagLo6+vwpPj/9ZXNYNeuXZg9ezbMzc0RERGBhg0bAvjc++bIkSNISEgQS5OXl0fvriCEkCpUqSB/6NAhrFmzBv3798f27duhq6vLrRMIBNixYwdWr17NvX8c+DxHZkpKCjenJSGEkK+vwuaa9PR0rFq1Ck2bNoWLiwv++9//iqxv3rw5vLy84OXlhTlz5mD48OF49eoVNm7ciHbt2mHIkCFfrPCEEEKkqzDIX7p0Cbm5uXj58iU3i3tZ/v7+GDJkCDZv3ozQ0FDMmDED2tra6N27N2bPnl3pWW0IIYQoX4VBfujQoRg6dGiFO+rVq5fEKcAIIYRUDXoLJSGEqDCaNISoNN06NaGtJXqaGxj83XEgL78ImZ9yv3axCPlqKMgTlaatpYHBvkclro8KGAL5ei0T8s9AzTWEEKLCKMgTQogKoyBPCCEqjII8IYSoMAryhBCiwijIE0KICqMgTwghKoyCPCGEqDAK8oQQosIoyBNCiAqjIE8IISqMgjwhhKgwCvKEEKLCKMgTQogKoyBPCCEqjII8IYSoMAryhBCiwijIE0KICqMgTwghKoyCPCGEqDAK8oQQosIoyBNCiAqjIE8IISqMgjwhhKgwCvKEEKLCKMgTQogKoyBPCCEqTKMyG5WUlODAgQPYv38/Xrx4AX19fTg6OsLLyws6OjoAgHv37sHf3x/3799H7dq14eTkBC8vL9SoUeOLfgDy9enWqQltrb9PHQMDXe7feflFyPyUWxXFIoTwqFSQ3759O4KCgjB58mR07twZT58+RXBwMB49eoQdO3bg+fPnmDBhAiwsLBAUFITHjx8jMDAQWVlZ8PPz+9KfgXxl2loaGOx7lHddVMAQZH7l8hBCJKswyDPGsH37djg7O8PX1xcA0KVLF+jp6WHWrFlISkpCeHg4dHV1sWXLFmhqaqJHjx7Q1tbGypUr4e7ujkaNGn3xD0IIIURchW3y2dnZ+O677zBo0CCR5a1btwYApKSk4MqVK7C3t4empia3vl+/figuLsbly5eVXGRCCCGVVeGVvI6ODpYsWSK2PDo6GgBgaGiI169fo1WrViLr69evDx0dHTx9+lRJRSWEECIruXrX3LlzB2FhYejVqxfq1KkDANwD2LJq166NrKwsxUpICCFEbpV68FrWzZs34eHhgWbNmmHlypUoKCgAAAgEArFtGWNQU5OtHtHXF68sSpXtxSEredNWRZ6KpK2q8sq7n6r4nPLui84FyrMq85Q3rUxB/uTJk1iwYAFatmyJ7du3Q09PD9nZ2QDAe8Wek5MDXV3ZCpWenoWSEia23MBAF+/eyddvQ960VZGnImm/Vp4VnWiy7OdLf87K/Cgqsy86FyjPqsxTWlo1NYHUi+NKX2bv2rULs2fPhrm5OSIiItCwYUMAn5tkGjVqhOfPn4tsn56ejqysLLG2ekIIIV9PpYL8oUOHsGbNGvTv3x/bt28Xuzrv2rUrzp8/zzXdAMDp06ehrq4OW1tb5ZaYEEJIpVXYXJOeno5Vq1ahadOmcHFxwX//+1+R9c2bN8eUKVNw4sQJTJ06FePHj8ezZ8+wYcMGjBo1Ck2aNPlihSeEECJdhUH+0qVLyM3NxcuXL+Hi4iK23t/fH0OGDMHOnTvh7+8Pb29v6OnpYeLEifDy8voihSaEEFI5FQb5oUOHYujQoRXuyNraGgcPHlRKoQghhCgHvYWSEEJUGAV5QghRYRTkCSFEhVGQJ4QQFUZBnhBCVBgFeUIIUWEU5AkhRIVRkCeEEBVGQZ4QQlQYBXlCCFFhFOQJIUSFUZAnhBAVRkGeEEJUGAV5QghRYRTkCSFEhVGQJ4QQFUZBnhBCVBgFeUIIUWEU5AkhRIVRkCeEEBVGQZ4QQlQYBXlCCFFhFOQJIUSFUZAnhBAVRkGeEEJUGAV5QghRYRTkCSFEhVGQJ4QQFUZBnhBCVBgFeUIIUWEU5AkhRIXJHOSTkpLQvn17pKWliSzv3bs3jIyMxP4+fPigtMISQgiRjYYsGz958gTu7u4oKioSWZ6dnY3U1FT4+vrC1tZWZF2dOnUULyUhhBC5VCrIFxUV4cCBAwgICECNGjXE1j948ACMMTg6OsLQ0FDphSSEECKfSjXX3Lx5E+vXr8ekSZMwZ84csfVJSUnQ0tJCy5YtlV0+QgghCqhUkDc0NER0dDRmzJgBdXV1sfUPHjxAvXr1MHv2bFhbW8PCwgKzZs3Cu3fvlF5gQgghlVep5poGDRpIXZ+cnIz379/j22+/haurK548eYLg4GCMGzcOkZGR0NbWrnSB9PV1JK4zMNCt9H6UlbYq8lQkbVWVV979VMXnlHdfdC5QnlWZp7xpZXrwKsmSJUvAGIOZmRkAwNraGoaGhhgzZgyOHTuGUaNGVXpf6elZKClhYssNDHTx7l2mXOWTN21V5KlI2q+VZ0Unmiz7+dKfszI/isrsi84FyrMq85SWVk1NIPXiWClB3tTUVGyZlZUVdHV1kZycrIwsCCGEyEHhwVA5OTn47bffxII5YwyFhYXQ09NTNAtCCCFyUjjIa2lpYe3atdi0aZPI8nPnziEvL0+s3zwhhJCvR+HmGnV1dUybNg1r1qzBypUr4eDggIcPHyIkJASOjo7o2LGjMspJCCFEDkppk584cSJ0dHSwd+9eHDp0CHXr1sXo0aPh5eWljN0TQgiRk8xB3snJCU5OTmLLR44ciZEjRyqlUIQQQpSD3kJJCCEqjII8IYSoMAryhBCiwijIE0KICqMgTwghKoyCPCGEqDAK8oQQosIoyBNCiAqjIE8IISqMgjwhhKgwCvKEEKLClPKCsi9Ft05NaGv9XcSys/zk5Rch81NuVRSLEEL+Map1kNfW0sBg36O866IChkC+SbQIIeTfg5prCCFEhVGQJ4QQFUZBnhBCVBgFeUIIUWEU5AkhRIVRkCeEEBVGQZ4QQlQYBXlCCFFhFOQJIUSFUZAnhBAVRkGeEEJUGAV5QghRYRTkCSFEhVGQJ4QQFUZBnhBCVBgFeUIIUWEU5AkhRIXJHOSTkpLQvn17pKWliSy/fPkyhg8fDjMzMzg4OGDnzp1KKyQhhBD5yBTknzx5And3dxQVFYksv3XrFjw8PNC6dWuEhIRg8ODB8Pf3x44dO5RaWEIIIbKp1ByvRUVFOHDgAAICAlCjRg2x9cHBwTA2Nsa6desAAN27d0dRURFCQ0Ph6uoKTU1N5ZaaEEJIpVTqSv7mzZtYv349Jk2ahDlz5oisy8/PR0JCAvr06SOyvG/fvvj06RNu3bqlvNISQgiRSaWCvKGhIaKjozFjxgyoq6uLrEtNTUVhYSFatWolsrxFixYAgKdPnyqpqIQQQmRVqeaaBg0aSFyXmZkJANDR0RFZXrt2bQBAVlaWTAXS19epeKP/Z2Cg+0W2VUa6qkpbVeWVdz9V8Tnl3RedC5RnVeYpb9pKBXlpGGMAAIFAwLteTU22Djzp6VkoKfm8z4o+0Lt3mZXap4GBbqW3VUa6qkr7tfL8J30vlflRVGZfdC5QnlWZp7S0amoCqRfHCveT19X9/CMqf8Ve+v/S9YQQQr4+hYN88+bNoa6ujpSUFJHlpf8v31ZPCCHk61E4yGtpacHa2hpnzpzhmm4A4PTp09DV1YWJiYmiWRBCCJGTUl5rMG3aNNy6dQuzZs1CbGwsgoKCsGPHDri7u6NmzZrKyIIQQogclBLkO3fujJCQEDx+/Bienp6IiorCvHnz4ObmpozdE0IIkZPMvWucnJzg5OQktrx3797o3bu3Ugr1b6Nbpya0tUS/itJeIXn5Rcj8lFsVxSKEqACFu1ASxWlraWCw71HedVEBQyBfhytCCKFXDRNCiEqjIE8IISqMgjwhhKgwCvKEEKLCKMgTQogKoyBPCCEqjII8IYSoMAryhBCiwijIE0KICqMgTwghKoyCPCGEqDAK8oQQosIoyBNCiAqjIE8IISqMgjwhhKgwCvKEEKLCKMgTQogKo5mhCJGg/LSMpVMyAjQtI/nnoCBPiAQ0LSNRBdRcQwghKoyCPCGEqDAK8oQQosIoyBNCiAqjB6//YOV7fwDUA6Q6oO+FVCcU5P/BpPX+AKgHSFWh74VUJ9RcQwghKoyCPCGEqDAK8oQQosIoyBNCiApT2oPXoqIiWFpaIj8/X2R5rVq1kJiYqKxsCCGEyEBpQf7p06fIz8/H2rVr0bJlS265mhrdLBBCSFVRWpBPTk6Gmpoa+vbti5o1ayprt4QQQhSgtMvspKQkNG/enAI8IYRUI0oL8g8ePICmpiYmT54MCwsL2NjYwM/PD1lZWcrKghBCiIyU2lyTlZWFkSNHwsPDA/fv30dISAiePn2KvXv3QiAQVGo/+vo6lc6z7FBxZW6rjHSKpq2KMlRFeavie6kOZajux4jyrH55yptWaUE+MDAQdevWhZGREQDAxsYG+vr6mDt3Lq5evYquXbtWaj/p6VkoKWEAKv5A795VbnC4gYFupbdVRjpZ08r7OSvzhX+JY/RP+l4UOUb/tO9FGekoz+qZp7S0amoCqRfHSmuusbW15QJ8qZ49ewL4fJVPCCHk61NKkE9PT8ehQ4eQmpoqsjwvLw8AoKenp4xsCCGEyEgpQV4gEMDPzw/h4eEiy0+ePAl1dXVYWVkpIxtCCCEyUkqbfP369eHi4oJ9+/ZBR0cH1tbWuHnzJkJDQ+Hi4oIWLVooIxtCCCEyUtqD1/nz56NRo0b47bffEBYWhkaNGsHb2xtTpkxRVhZEiaRNbEGTWhCiOpQW5GvUqAE3Nze4ubkpa5fkC5I2sQVNakGI6qAXyxBCiAqjIE8IISqMgjwhhKgwCvKEEKLCKMgTQogKoyBPCCEqjII8IYSoMAryhBCiwijIE0KIClPaiFdVUX64f9l3g9Nwf0LIPw0F+XJouD8hRJVQcw0hhKgwCvKEEKLCKMgTQogKoyBPCCEqjII8IYSoMAryhBCiwijIE0KICqN+8uQfgQapESIfCvLkH4EGqREiH2quIYQQFUZX8kpSvjkBoCYFQkjVoyCvJNKaEwBqUiCEVA1qriGEEBWmklfy1HRCCCGfqWSQp6YT8k8l7QKFLk6IPFQyyBPyT0VdRYmyUZs8IYSoMAryhBCiwijIE0KIClNqkD9+/DgGDhwIU1NT9O/fH0eOHFHm7sk/nG6dmjAw0OX+AHD/1q1Ts4pLR4hqUtqD1z/++ANz5szBuHHjYGdnh+joaMyfPx/a2tro16+fsrIh/2D0UJGQr09pQX7Dhg3o378/Fi1aBACws7NDRkYGNm7cSEGeEEKqiFKaa1JTU5GSkoI+ffqILO/bty+ePHmC1NRUZWRDCCFERkq5kn/y5AkAoFWrViLLW7RoAQB4+vQpvvnmm0rtS01NIPL/hnqS22rLb1vZdIqkpTwVS1vd8lQkbXXLU5FtlZWW8vz6aSvan4AxxuTO8f8dP34cvr6+OHfuHJo1a8Ytf/78Ofr06YPAwEAMGDBA0WwIIYTISCnNNaX1hEAg4F2upkY9NQkhpCooJfrq6n7uDpeVlSWyPDs7W2Q9IYSQr0spQb60LT4lJUVk+fPnz0XWE0II+bqUEuRbtGiBZs2a4dSpUyLLz5w5g5YtW6JJkybKyIYQQoiMlNZP3tPTEwsXLkTdunXRs2dPxMTE4I8//kBgYKCysiCEECIjpfSuKfXrr79i586deP36Nb755htMnToVQ4cOVdbuCSGEyEipQZ4QQkj1Qn0bCSFEhVGQJ4QQFUZBnhBCVBgFeUIIUWE0kff/GzduHJYtWwZDQ0OxdcnJyZg/fz6OHuV/F7qiCgoKkJKSgk+fPvGut7S0/CL5/hOkpaWhcePGEtfHxsaiR48eX7FEquPVq1cS16mpqaFWrVqoU6fOVywR+RKqbZDPyspCREQErly5gnfv3iE4OBgXL16EsbExOnfuLDHdkSNHoKenhx49eiA5ORnz5s1DWloa+vXrhyVLlkBTU5PbNiEhgXu/zo0bNxAfH48PHz6I7fP8+fPc6F0+jDH8/vvvuHDhAnJyclC+w5JAIMCOHTt40167dg1z5szhzZcxBoFAgKSkJIl5Z2dnIzs7Gw0bNkRhYSEiIiLw+vVr9OnTB1ZWVkovb1lPnz7Fp0+fUL9+/Uq/ZVRW3333HZYtW4aBAweKLM/KysKqVatw5MgRqccnKysLN27cQG5uLkpKSsTWDx48WGLa1NRUFBQUwNDQEJmZmdi4cSN3Lg0aNEhiutLvTZKkpCS0a9dObPm6devg5OTEe6FREVnO+1IODg5SywkAdevWhaurKzw9PXnzlEQgEKB27dpo3rw52rZtK/PnkaQq8pRXfHy8xHWlZf3mm2+go6PzRctRLYP8mzdvMHbsWLx79w6mpqZ49uwZCgoKcMJ3d8gAACAASURBVPv2bQQGBmLbtm28gX7nzp1Yt24dvL290aNHDyxfvhwfPnzAsGHDEBkZiTp16mDOnDnc9r/99hsiIyMhEAggEAjwww8/iO2zNACOGDFCYnk3bNiAbdu2oVmzZmjcuHGFP5yyVq9ejXr16mHZsmWoV69epdMBwJ07d+Dm5gZnZ2f4+vpi5cqVOHDgAOrUqYPw8HCEhITAwcFBqeUFgPDwcISGhiI9PZ1b1qRJE8yePVssGJeXmJiIK1eu4O3bt/Dw8MDjx49hbGwMfX193u07d+4MX19fxMTEYNmyZahTpw5iY2Ph5+eHjIwMzJo1S2Jely9fhre3N3Jzc8UqMuDzD01SkI+NjYWnpydcXV0xf/58+Pn54cyZM2jbti3mzp2LvLw8iefErFmzsGHDBrEX8+Xn52Pjxo3Yu3cv7t+/L5YuKioKO3fuhImJCZycnDBw4MBKXUnLet6XWrNmDfz8/NCpUycMGDAADRo0QHp6OqKjoxETE4Np06YhJycHYWFhqFevHlxcXETSL168mKs4yx7f0vOptLLr2LEjtmzZglq1anHbuLq6SjzvSu8iWrRogZEjR6J169ZKyVPeCkJaZVi2rGPHjoWtra3Ez8hX+aupqWHIkCH48ccfoa6urnBZebFqaObMmax///7s/fv3rLCwkBkZGbH79++z4uJiNmXKFObi4sKbrl+/fmz9+vWMMcZSU1OZkZERi4iIYIwx9uuvv7KePXuKbJ+ZmckSEhJYfHw8MzIyYgcOHGAJCQkif4mJiezRo0dSy9u1a1e2Zs0auT6rqakpO3funFxpJ0yYwJydnVlKSgrLyclhZmZm7IcffmCMMbZ06VI2YsQIpZd3z549zMjIiHl5ebHjx4+zq1evsqioKObp6cmEQiE7efIkb7r8/Hzm5eXFhEIhMzExYUKhkN2/f5+NHz+ede3alT1//lxinsePH2cdO3ZkPXr0YD4+PkwoFLLJkyezlJQUqWUdMmQIc3JyYvHx8SwlJYW9ePFC7E8SZ2dn5u7uzjIzM1lGRgZr3749CwoKYowxtmHDBjZo0CCJac3NzZmXlxcrLCzkll25coX16tWLtWvXji1btow3XUlJCbt06RLz9fVl5ubmzNTUlPn4+LDY2FhWUlIiMT9Zz/tSkyZNYosXL+Zdt2LFCjZ16lTGGGM///wzGzhwoNg2V65cYZaWlmzbtm3s5cuXLD8/n71+/Zrt3buXWVpassOHD7MLFy4we3t7tnr1apG0CxYsYB06dGAmJibM1dWVzZ49m40fP56ZmZkxY2Nj5uzszLp168bMzMzY/fv3lZKnsbExEwqFTCgUMiMjI+6v7DKhUMjGjx/PsrOzuXQbNmxgHTp0YJ07d2YLFixgAQEBbNGiRczOzo4ZGxszb29vNmLECNauXTt25coVLt25c+eYmZkZW758Obtx4wZ78uQJi4+PZz/99BMzMTFhu3fvZuHh4czW1pZt2rRJKWXlUy2DvJWVFRcsioqKuCDPGGMXLlxgVlZWvOlMTEzYjRs3GGOMhYeHM6FQyF6/fs0YY+zGjRusQ4cOEvOMi4tjWVlZcpXXzMyMxcXFyZV2xIgR7NChQ3KltbCwYBcuXGCMMXb27FkmFArZ7du3GWOMXbt2jZmZmSm9vI6OjmzlypW863744QeJwW/t2rXM0tKSnTt3juXl5XHfaWpqKuvXrx/z8fGRmu+5c+dYu3btmJGRERs2bBjLzMyssKwmJibs4sWLFX8oHmZmZuzq1auMMcaioqKYUChkSUlJjLHP54q0cykxMZHZ2toyDw8PlpaWxubOncuV+86dO5XKPysrix0+fJhNmTKFmZqaMjs7OxYQEMCePXsmtq28572pqSm7fPky77orV64wU1NTbh+l/y5r8ODB7Oeff+ZNv2vXLjZkyBDGGGO///67WEUTEBDABgwYwNLS0kSWv3//ng0bNoyFhISwoqIiNn36dDZ58mSl5ClvBbF06VI2ZswYlpOTI7K//Px8NnHiRLZixQrGGGOLFy9mY8aM4dY7OztzlW95wcHB3LYRERGsd+/eSikrn2rZu6a4uBhaWloS1zEJg3Tr16/PNSHExsaidevW3EO7Bw8eoEGDBhLzfPXqFc6ePYsjR46I/R09ehTR0dF4+PAhb1oLCwvcunVLlo/IWbx4MUJDQxEZGYnHjx/j1atXYn+SqKmpccfp0qVLqFOnDkxNTQF8bovW1tZWennfv38v8UGno6OjxKkeo6KiMHv2bDg4OEBD4+9WwmbNmsHLyws3btzgTZeZmQk/Pz/MmDED7du3x8KFC/Hy5UsMHDgQ0dHRUsvapEkTsddfV5aWlhaKi4sBfG720dfXh1AoBPD5GEhrRjE3N8eePXtw9+5dODg44Pz581i8eDEOHz7MfT8VqV27Nnr27Al7e3u0a9cOb9++RUREBPr164cZM2bg3bt33Lbynvf6+vpITEzkXXfr1i2u+fDTp0+87cbPnz+HsbExb/o2bdpwM8Z98803Ik17AHD48GHMnDkTjRo1EivT9OnT8csvv0BdXR2jRo3CnTt3lJLnmjVr4O7ujilTpqBJkybQ1NRE48aN4erqCi8vL+zbtw89evSAl5cXzpw5w6X7448/4Obmhpo1RWfs0tTUxLhx4xAVFQUA6N+/v8jzoaSkJHTq1Im3rFZWVrh37x4AoG3btkhLS1NKWflUyzZ5a2trhIWFoUuXLqhRowaAv9vcDh48KLG3ib29PdavX4+rV6/i4sWLXHvtrl27sHnzZqnt6oq09Xl4eMDX1xdFRUWwtLTkDa6SyswYQ0FBATcBOh9JDxZNTExw6NAhaGtr49SpU+jZsycEAgHS09Oxbds2mJiY8KZTpLw2NjY4deoUunXrJrbu6tWrMDc3502XkZHBTQdZXr169SQG4379+iEzMxM+Pj6YMmUK1NTU0L9/f/j5+cHLywuOjo7YtGkTb1o3Nzds3rwZZmZmMr8J1dLSEjt27EBGRgZOnz6NYcOGAQDu37+PTZs2SXyoXUooFGL//v2YOHEimjZtilGjRlVq8pz8/HycPXsWx44dw9WrV1GjRg307dsXs2fPhq2tLeLj4zF37lx4e3vjl19+ASD/ee/s7IyQkBDk5eWhT58+0NPTw4cPH3Du3Dns3LkTHh4eePfuHcLCwmBtbS2WvlWrVoiMjOQ9F44cOYLmzZsDAF68eCFW0RQWFqKoqIi3XAUFBcjJyQEAaGtrc5WtonnKW0Goq6uLVRil3r9/LzI5Utl29f/85z84f/48unbtKpbu/PnzXAX37t07sedxilRm5VXLID9nzhyMGTMGffr0QadOnSAQCLBnzx48evQIjx8/RkREBG+6hQsXYtWqVYiPj8fo0aMxadIkAJ8rBgcHB/j4+EjMc9u2bfDy8sK0adO4h1AfPnzA2bNnERQUhEWLFqFBgwb44YcfsHHjRixcuJBLO378eADggg3fwxZJgXrZsmXQ0tLCvHnzJD58lGTu3LmYMmUKTpw4gfr162PatGkAgEGDBoExhp07d/KmU6S8Tk5OWL58Od69e4eBAweiYcOG+PjxIy5cuIDjx49j5syZ3JUN8HfvlTZt2uDEiRO8P86LFy9K7FHyn//8B3v27EGbNm24ZQ0bNuTufn766SeJx+fUqVN48+YNHB0dYWBgIHYlBgCnT5/mTbto0SJMnToVvr6+aNOmDXds3d3dUatWLbEHmX369OF9OJebm4uEhAQ4Ojqidu3aUvNduHAhzpw5g+zsbJibm2PZsmUYMGCASDobGxs4OTlh9+7dIunkOe/d3d2Rn5+PnTt3ivSmql27NqZNm4bp06fj6NGj+PTpE9avXy+WfsaMGfD29kZqaip69+7N3VHExMTg7t27CAwMRHJyMtavXy82/WenTp2wYcMGtG3bVuS7ffz4MYKCgriOFRcuXBB58KpInvJWEKWVqIGBAbp3784tv3z5MgIDA+Hg4IDCwkIcOXIERkZG3PrJkydj6dKlSE9P58paWomePHkSS5cuRUpKCjZu3ChWJkUqs/Kq7QvKnj59ik2bNiEuLg4fP36Ejo4ObG1tMX36dO62ubIKCgp4u5CV9d1332HQoEGYOnWq2Lrdu3dzTTeRkZEIDg7G+fPnufWSmhrKKvvUvSxTU1OEhITI3dc7KysLjx8/xrfffsvdXURHR8PS0hL169fnTaNIeWU59mUri7Nnz8LLywsODg6wt7eHn58fFi1ahBcvXiAiIgL+/v688wCXlJRIvQJ++/YtGjZsyLuubEUsibRKgjGG9PR0kR/R3bt30a5dO+4Os9SCBQtk6qXEl2+3bt0wZMgQDB8+XCSwlRcXF4e//voL/fr1k5pHZc574HNFlJiYiL/++guNGjWCUCjkmmeKiopEmtfKu3r1KjZv3ozbt2+juLgYGhoasLCwgJeXF2xtbRETE4PY2FgsWrRIpAk2LS0N48ePR2pqKlq2bMkF6+fPn6N58+bYtWsX/vzzT3h5eSEgIEDk3JA3z+joaHh7e8PExERiBdGiRQtMmTIFAwYM4O6us7KyMG3aNMTHx0NbW5u74ykoKICtrS02btyIq1evYsGCBfj5559Fev799ttv2Lx5s0iza7NmzTBjxgwMHToUJ06cQGRkJPz9/UV+r/KWlU+1DfLyKtu3+dOnTwgODq5U32YzMzNs3ryZt+a8fPkypk+fjrt37yIhIQGTJk3C3bt3lVJeJycnjB8/HkOGDFHK/r60ly9fyrR906ZNuX9HRUUhICBApP2xfv368PHxwahRoyTuo6SkBCdPnuTGTCxZsgS3b9+GiYmJyFXgl5CTk8NVnmfPnsXr169hb2//RcYFrFmzBgMHDkSHDh1kTivvea8sBQUFyMjIgL6+fqXndC4oKMCxY8cQFxeHDx8+oFGjRrCxscHgwYOhoaGBR48eISsrS2IToDx5yltBAJ/HtFy/fp2rDG1sbLiLodIgLqlZMCUlhfuM//nPf754WcuqlkFe3kEE5fs2z5o1i+vbnJycjB9//FFi++TQoUNhaGiIgIAAsXVz5sxBcnIyjh8/jiNHjiA4OBgxMTEi2zx+/BghISG4ceMGMjMzoaenB2tra3h6ekod3HLjxg0sWLAA3t7eMDU1Fbk1L1X+4VQpSU0EZUlqjpC3vMrw5MkTfPz4Ebq6ujA0NJT6A83MzMSUKVNw9+5dNGnSBK9evcLhw4exYcMGJCYmIjw8XKTt8s2bN9DX14eGhgbevHlTYVkkHdsnT57Aw8MDAwYMgI+PD4KCgvDzzz+DMQZtbW3s3LmzwpHIaWlpuH79Ot6+fYthw4bh3bt3aNOmjcSra2tra2zcuJG3DVcaec/7Dx8+YO3atRIHxQHg7c9f3oMHDyQONvtSo7UVzVOeCkJeWVlZEssq6fwrS9GyVssgLxQKRR54liob0PgGEYwePRr16tXD+vXrUVJSgi5dusDNzQ0zZ85EYGAgYmJiRNqLy1Lk9ujBgwf4/vvvUbNmTTg4OEBfXx/v3r3D+fPnkZubi19//VWkra4sCwsLFBQUoLi4WGLAltQ+ztdEkJ2djXv37iE/Px/jx4+Hu7u7WDpZy7t06VK4u7ujWbNmWLp0KW9ZSgkEAqxYsYJ3XWxsLK5fv4758+cDAHdc3d3dJfZCWLp0KS5cuIBt27ahTZs2MDExwW+//YYWLVpg8uTJqFu3LsLCwrjt27VrhwMHDsDU1FTkPJJE0rH19PTEkydP4O/vDyMjI3Tr1g3dunXDihUrsGDBAmRkZGDfvn0S97t27Vrs27cPRUVFEAgEXMX05s0b7Nmzh/f5y7hx42BiYoJ58+ZJLXN58p73Pj4+OH/+PAYOHIjGjRvzBpAZM2ZIzPf+/fuYOXOmSFNE6TOdip7tAMD169eljrrmO48UzROQvYJgco4QT0lJwaJFi3Dz5k2JZVF2WflUywevW7ZswezZszFs2DCxkXgRERGYM2cONDQ0EBwcjKZNm3JDrpOTk7F161bo6Ojg+PHjKC4uRt++fQEAXbt2xa5duyTm2atXL2zfvh2bN29GUFCQyO3R7t27udsjR0dH+Pr6iqRdv349Wrdujb1794r0usnJycGECRMQFBSErVu38ua7dOlSmUecllqzZg3v8sLCQkyfPh25ubm862Ut75UrV7jRjleuXJFaJkmf5eTJk/D19YWdnR23rGbNmigpKcHkyZOxdetWkYdapc6ePYv58+dDKBSK9LLQ0dGBm5sbFi9eLLL96tWruaaU1atXy31s4+PjsWrVKnTo0AGXL19GZmYmnJ2doaOjg9GjR8PLy0ti2rCwMOzbtw/z5s2Dvb09evfuDeDvh4aBgYFYuXKlWLr27dtj7969OHv2LNq0aSP2QE1S4JP3vL948SIWLlyI0aNHV/q4lLVq1Sqoqanhp59+klhJSLJr1y6sXbsWWlpaqF+/vtj3JOl7UyRPeSsIeUeIr1ixAo8ePcKMGTO+Wln5VMsgHxYWBldXV5Fg2qpVK1hbW6N27do4c+YMIiIiIBAIsHv3bi7IK9K3+eXLl+jSpQu6dOki8fbIwcGB9zUBCQkJWLdunUjABIBatWphypQpYoGoLCcnp0ocEdnUqFED48aNw8KFC3l7Vsha3rJNU+WbqSorNDQULi4uWLJkCbfs22+/xZ49e/Djjz8iODiYN8jn5eVJfICspaWFgoICkWWlXR0BxY5tYWEh6tatC+BzMKxZsybXbbL0AkCSAwcOwMvLC+PGjROpmCwsLODj44ONGzfypjt9+jQaNmyI4uJiPHjwAA8ePBBZLym4yHvea2hoSOzWWhl//vknNmzYgF69esmcdt++fRg8eDBWrVpVqYfDyshT3goiMjISEydO5O5AKyshIQErV66U65mIIpVZedUyyCclJUm8UrKyssK2bdsAiA8iUKRvs6OjI7799lvY29ujZ8+esLCwqHSNzdc1r5SamprID708Sc1HZUl7iZYkGRkZyM7O5l2nSHnlVXrryqdXr174/fffedeZmJjgl19+4e19dPLkSYl9iUu9ffsWiYmJKCws5G6zS0pKuK6NfF0Dgc/n1pkzZ9CqVStuXICGhgb3Ejhp7wx5+/atxIenTZs2xcePH3nXyVuBynve9+rVC1FRUVJf+CdN/fr1RfqFy+L9+/cYOXKkTAFe0TzlrSCysrJgb28vc361a9fmLhRkpUhlVl61DPLyDiKQtW9zWTt27MDly5cRExPDvZDJzs4O9vb2sLOzg66ursS05ubm2LZtG+zs7ESecufl5WHbtm2wsLCQmHbu3Lm8ywUCAdTV1aGuri4xyPNVEMXFxUhLS8OePXt4B7AoWt7c3Fxs3boV169fx6dPn3gf1vE97NXX18eff/7J2/b+4MEDiT+GmTNnYuLEiXByckKPHj0gEAjwxx9/YOvWrYiJiZH6tswzZ87A19cXhYWFYoPaAEjtpujt7Q1PT09ERERAU1MTbm5uAIC+ffsiPT0doaGhEtM2b94cly5dQpcuXcTWJSQkSOyZs3DhQkyfPp13/ZMnT7Bu3TreZj95z3szMzMEBATgxYsXsLCwEKv8BQIB7zOdUmPGjEFYWBg6deok9cKBj1AoxP/+9z+JXXW/RJ7yVhClI8RlLet3332HiIgIdOvWTeZmQ0Uqs/Kq5YPXQ4cOYenSpejfv7/YIIITJ07Az88P3bp1w9SpU2FpaYnVq1dzaWXp2yzJ69evcenSJVy6dAlxcXHIycmBpaUl9u7dy7v948ePMWLECNSuXRsODg5o0KAB3r9/j5iYGGRnZyMiIkLiFSdfl8ScnBwkJCRg27Zt2Lx5M+9raQHpfdYtLCywZs0a3ttxRcq7bNkyHDhwAFZWVmjWrBnvbSRfH/CgoCDs2bMH8+fPR69evaCvr48PHz4gJiYGa9aswZgxY8SedZSKj49HQEAA7t69i5KSEggEAhgbG2PmzJm8TTylnJycUKNGDSxbtgwREREoLi6Gm5sbYmNjERgYiNDQUKk9WVJTU3Hv3j2YmZlxXUHDw8PRqVMnqV03Dx48iGXLlmHs2LFwcHDApEmTEBgYiLdv3yIwMBBz5szhnnGUbXN1cHCQ+H2fOXMGGzZskNh1V57zvqIxDxW1+/r5+eGPP/5ASUkJ2rZty1tJSKqEExMT4evrC29vb1hYWPCOuubreaJInmFhYTh//jx27twpUwURFxcHX19fjB49WqYR4ps3b8bu3buhp6cHU1NT3rJK6qQgb1n5VMsgD8g/iECSgoICJCQk8F5dlffx40ckJCQgLi4O169fx//+9z9oampK7Rv/4MEDbN68GTdv3kRGRgbq1KkDGxsbeHp6yv1u67179+LUqVPYv38/73q+CkIgEEBHR6fCV9TKW96OHTtiwoQJ3NViZRUWFsLX1xdnzpwRG2Hbp08fBAQESAxG2dnZyMrKQt26dfHhwwf8/vvvyMzMRO/evSXerQB/X6n26tULx44dw86dO7lXuPr7++PevXtSe8iUlu/JkydcN9PKtmH//PPPCA0NRV5eHne3U6NGDUyaNEnk9cgeHh6IjY2tcH+MMdjb20t8gC+JLOe9rFxdXSvcRtLxNTU1RVFREVdp8+GrYBTJU94KonxlWNkR4nzP78rv59y5c0otK28+1TXIA5/78T5+/BgCgQDNmjUDYwy5ubm4efMmRo4cKbb9q1ev8MMPP+DGjRsoLCzklpeUlHA/NElXJqdOnUJ8fDxu3LiBR48eQV1dHSYmJujYsSM6duwosQb/kuLi4jB16lSRFzSVtWnTJowcOZL3iufly5fYtWuXyINOZbCwsEBoaCg6duwoV/qHDx9yFYuuri6srKykXlGWf2f+smXLcPDgQejq6iI7O1viO/NLyxoWFgYbGxvcuXMHrq6uuH37NtTU1HDt2jXMnj0b165dk5j30aNHsW7dOpF3gzRo0ACzZs2q1EPdrKwsJCYmcmMCzMzMoKenJ7LNmzdvEBcXB8YY5s+fjxkzZnBD1kupq6tDV1cXnTp14m3DVuS8ryq///57hU0YZR+iK4O8FYQiI8TlpUhlVl61bJN/8OAB5syZg0ePHvGuFwgEvEF+zZo1SEhIwPDhw3Hr1i3UrFkT5ubmuHLlCh4+fIiQkBCJefr4+HDNABs2bEDPnj2l3iZFRUXBzs4O9erV+yIPTwsLC3H48GGp77PZvHkzunfvzhvkb9++jQMHDnBBXlnltbOzw4ULF+QO8m3btuW9U8jOzuYdCBYUFITWrVtj1KhRyM3NxdGjR/H999/Dz88Pfn5+2Lp1q8Qg36pVKyQmJsLGxgatW7dGQUEBkpOTYWxsjOzsbLGeOWWVdt3s3r07Bg8ejAYNGuDt27c4fvw4Fi9ejDp16lT4UExHRweGhoZ4+/Yt2rZtyxvUGjVqhO+++w7A56Dco0ePSt2ZliXLeT9p0iQsWbIErVu35t5xI4ksV4uy+hK9yipS2aBYnrIDeGXIW1Y+1fJKfvLkyXj48CEmT56M8+fPQ1NTE/b29rh48SJiY2Oxb98+3tv0jh07wsvLC2PHjkV4eDhiYmKwc+dOFBcXY9KkSWjatKlI+31ZERERiIuLQ3x8PDIyMmBkZARbW1vY2trCxsZGrPlDKBTi4MGD3KAbaaS1bfKNWi0uLkZ6ejry8vIwf/58TJgwgVv3/fff4/bt2wAqnmbO3Nyce1OhIuUtWymkpaVh48aNGDhwIKysrHgrQr4KoqCgAPv27UN8fDxvT5cHDx5wn6ssS0tLBAYGokePHoiOjoaXlxd+/fVXmJmZ4fr16/Dw8OBNB3zuyrhixQq4ubnBx8cHEyZMQEZGBkaOHIl9+/bBwMBA4nMWJycntGnTBv7+/mLr5s2bh2fPnuHgwYO8aYHPPWX8/f3x/PlzCAQCHDp0CFu2bEHdunXFZgEqT9YBMLKc966urli+fDkMDQ3lulo0MTHB/v37YWpqivbt21d4NV52xKwsFxoCgYDreqhInvIKDQ2Fk5MT9zK8ispa+oC6b9++2LhxI4RCoUIj0pWpWl7J3759GwsXLsSIESNQs2ZNREVFYcyYMRgzZgy8vb0lBvns7GxupGbr1q25tyyqq6tjzJgxWLt2rcQ8XVxcuIdhSUlJiIuLQ1xcHPcWPqFQKNLN79y5czAwMOD+LS9LS0veE0FHRwf29vZibakrV67EmTNnwBhDcHAwRo0aJTbRdentfdkXWClSXr4eQEePHuWd2FzSlHrr16/H3r170bZtW3z48IEbBPPw4UMUFhZKHFkp7zvzgc+v0s3Pz+eeXaxYsQJTp07FihUr0LRpU6njFx49eiRxasHBgwdLHQwVExMDT09PODo6igzY6tKlC3766Sc0a9YM06dPF0vHNwCmlLS2X1nO+7JBW56rRQ8PD+7O0cPDQ6ZeI3PnzsXBgwdRr149ib3KSpUN8orkKW8FERQUhC5duqBhw4YICgqqsKylQd7S0pK7I5X021Z2WStSLYN8QUEBWrZsCQBo2bIlkpOTuXVOTk5YtmwZb7qGDRvi/fv3AIAWLVogIyMD7969g4GBAerVq1fhe5dLGRkZce+0zszMREJCgthE3mVfvBUfH48ePXqItbcCn7t5RkVFSbw1ljRqVRJDQ0PuoWdJSYnENvnyFCmvIpVYqdOnT3MDSkJDQ5GUlISNGzdy8/nyXbUC8r8zv9S4ceO4fzdv3hx//PEH/vrrrwqbRAwMDPD27VvedWlpaVKb8kJCQjBs2DCsXr0axcXFXJB3cXHBp0+fcOTIEd4gL+8AGEXP+/IvYUtLS0PPnj15u3KWrYylVXR85L3QUCRPeSuIsjGn7L8rUrZnmay/bUUqM6mkzhtVRfr06cMiIyMZY4ylpaUxIyMjbj7Oq1evSpzWzs/Pj/Xr14+bAq9nz55s7dq1LCcnhy1YsEBsiq2yHj58yPbs2cM8PDyY4IJknwAAIABJREFUlZUVEwqFrE+fPmz16tXs6tWrrKCgQGJaoVAocVq32NhYZmJiUuFnTk5OZomJiezmzZtifxX58OEDe/PmDUtLS2NpaWns9evX7PHjx+zgwYNfrLxlFRUVVTgdX/v27bnp9M6dO8fs7e25dQcPHmT9+/fnTXf//n3WqVMnZmRkxDp37syePn3KGGOsU6dOrGPHjuzPP/+UmOfLly8l/r1+/ZplZGRITLtixQrWrVs3kflFGWPs3r17rFu3bmzhwoUS03bo0IFdunSJMSY+faW0qQM7dOjAzp49K3G/ksh73j9+/Jj17t2bBQYGMsYYCwwM5OYSNTMzq9S5l5KSws2B/OnTJ/bjjz8yT09PFhUVJfPnqMx5pOw85ZWens6SkpJYcXGx1O2ysrLYmzdvGGOMFRQUsF27drHVq1ezhISEr1FMxlg1nePV39+fde3alZ05c4Yxxlj//v3Z3Llz2aNHj9jUqVMlziOanp7Ohg0bxsaNG8cYY+zo0aOsXbt23OS3+/fvl5inkZER69ChA5s0aRLbs2eP1ImlGWNs6tSpzMHBgTk4ODAjIyPWrVs37v9l/8zMzKRO+nzv3j3m4ODAlbHsX+lkvZIkJyezQYMG8aYVCoWsXbt2Si9vYWEh27RpEzt27BhjjLHr168zW1tbJhQK2aRJkyQGzk6dOrHY2FjGGGOPHj1iQqGQ+0HfuHGDmZubS8wzMzOT3b59W2TC4rNnz7L09HSJaRhjIhMfS/rr2LGj2CTKjDH28eNH1r9/f66yd3FxYX369GFCoZD169dPat7du3dn+/btY4yJB/kDBw6w7t2786br0aMHi4mJkfqZ+Mh73k+fPp3169eP3b17l+Xn5zMbGxs2a9YslpmZyTw9PdnYsWOl5nvhwgXWvn17blJ4Hx8fZmxszIYOHcqEQqHUuYvlPY8UyZMx+SqIzMxMtnDhQhYeHs4YY+zkyZOsffv2TCgUsgEDBnDz6ZZ3+/ZtZmNjw83z6ufnx4yMjJiNjQ0zNjZm586dU3pZ+VTLIJ+Tk8M8PT3ZlClTGGOMXbx4kZmamjKhUMjat2/PTp8+LTV92cmB4+Pj2bZt2yqcuDo6Olpsol5pEhMT2eLFi9nixYuZkZERmzZtGvf/0r+lS5eydevWsZSUFIn7GT16NOvVqxeLjIxk165dY3FxcWJ/kkyaNIl169aN7dq1i40bN45NmTKFRUREMHd3d9auXTsWHx+v9PJu2LCBGRsbcyf8oEGDWJ8+fdiePXtYz549mZ+fH2+66dOnMzc3N5abm8sKCwuZhYUFd7e2bds21q1bN6nHWx6RkZGsQ4cOzM3NjUVGRrJLly6xI0eOsBkzZjBjY2MWEhLC1q5dy0xNTbnPU1Zubi4LDw9nPj4+bOLEiWzmzJksPDy8wvNkzZo1zNramp09e5bl5uYyIyMj9ueff7KkpCTWo0cPiRMv//zzz2z06NEynYdlyXre29jYcBdSly5dYkKhkF2/fp37v7SKl7HPE1W7u7uzzMxMlpGRwdq3b8+CgoIYY5/PE2kXC/KeR4rkKW8FsXz5cmZhYcEFVwcHBzZ8+HAWHR3NBg0axGbPns2bbsKECczZ2ZmlpKSwnJwcZmZmxn744QfG2OfJwUeMGKH0svKplkG+VH5+PvfvlJQUdvLkyQqvsGVx7Ngxmf4kWbBggdTAKI28t+iMMWZpacl92b/++itzcXHh1nl5eTFvb2/edIqU18HBgW3fvp0x9vmK3MjIiAvWR48eZV27duVNl5SUxCwtLbmrw3Xr1rEOHTqwESNGMGNjY/bjjz/KVR5pJk2axBYvXsy7bsWKFWzq1KmMsc/BdeDAgUrLNy8vj02ePJkZGRmx9u3bc1dvQqGQff/99yJ3JGUtXbqUWVtbM0tLSzZ69Gg2ceJEkb9JkyYprYyMMWZubs5VAqtWrWIWFhassLCQMfY5yFhbW0tNb2ZmxjXBRUVFMaFQyJKSkhhj0pulGJP/PFIkT3krCDs7O3bgwAHG2Oc7byMjI3bq1CnGGGOnTp1iHTt25E1nYWHBLly4wBj7fOcpFAq5JrVr165JbHZWpKx8quWD11JlB3588803vA+CKurrW1b5fr8VPeEvn1ZS33FpU8hVNOJQkXdUyPuAWpHyvn37FmZmZgA+z7+ppqbGvVqgcePGyMzM5E139OhRbgQoAPj6+kJHRwe3bt3CtGnTeKddVFRCQgK2bNnCu87R0ZF7gG1hYYHNmzdX+K78sqQNSdfS0sL27dtx5coVXLt2DRkZGdz0laUPjvk8ffpUpHtr2YFN5Sly3pdS5CVsgGJvfZX3PFIkT3lfyfzx40fuPUexsbHQ0NDgXodRt25d5Ofn86ZTpGeYIq9NL69aB/nKkPZDqIgyeo0An991s3z5crlGHCrywqUmTZrgxYsXsLa2RsuWLZGVlYWXL1+iadOm0NLSQkZGhtLL27BhQy7PmJgYtGvXjuupkpiYKNads9TBgwfRrVs37n3yAoEAHh4eMn1eWenr6yMxMZH3/TS3bt3iXm736dMn6OjoVPiu/LKk9XzYtGkT7O3t0bVrV5lmeZKlS2NF5z2rYAwFoNhL2ADF3voq73mkSJ7yVhBNmzbFgwcP8H/snXk8len//1+Hpj5Fy9CYmZap0eLYqVBJQjXKNGlViZRC1jYZM4OmlSyFRAuy1JQWFW2WRFE5QtuUJvkMbSoKUeS4fn/4nftjue/DWaT6ej4e5zHmvs91v69zus/7uu7rer9f7zFjxiAlJQUaGhpUVbr09HQMGjSItp0okWGiDGataPec/zOloaGhw204OTmRUaNGkU2bNpFZs2aRRYsWke3bt5OZM2cSRUVFkpKSwthWlEd0YTeoRelvQEAA0dbWJsuWLSMKCgrk4MGDhBBCNm/eTJSVlWk3MQkhxMLCgvj4+DBetyMICwsjysrKxNfXl9y8eZMUFxeT/Px84u/vT5SVlUlwcDB58eIFmT9/PuPSVnvIzs5utgSjp6dH2Gw2mTBhAvn9998F3u8RhoMHD5LVq1c369PkyZPJ8ePH+bYrLi4mZ86coaLXCCEkJiaG/PPPP23aLC4uJsbGxkRBQYGYmJiQFy9eEEIIGT9+PJk8eXKbezvC3Eei2LSzsyNWVlYkMTGRaGhoUOvjt2/fJtOmTWO8Bw4cOEBUVFTItGnTiIKCAjlz5gwhhBBHR0fCZrOpvrdElMgwYftKxyeZ8SoKf/31FzgcDgICAgA0xoT//vvvWLlyJV8tDCJkiS9AtExbUTQq3r17B1dXV9TW1mLfvn24fPkyHB0dUVdXB0lJSQQEBGDq1Kli7S8hBHv37gWHw4GOjg41+zM3N4e2tjacnJxo47t55fC+//57gaoeiUpQUBAiIiKaPVJLSUlh6dKlsLe3x6lTp7Bnzx7s3btXqOLcXC4XKioqOHbsGJSVlanjBQUFlJJpbm4uWCwWtLW1qXoFTfMWeAibABMbG4utW7di7ty51HdYUlKC0NBQnDp1Clu3bm13ofjy8nJKhqE9cfpESNXXtu4jZ2dnxu9CWJslJSWwsbFBUVERhg8fjsjISHzzzTfQ1dVFr169EBERwXgPJCYmUn2dPn06gMYlx3HjxjHWjQYal2UKCwsxYsQIKhchJSUFo0aN4purIUpfW/JFOfnY2Fhs2bIF8+bNE/hm9/f3b7PEF5OzVVFRQWRkJLS0tJCVlYU1a9bg2rVrABqTgHx8fIQuCNEUDocDZWXlVhWd6urqqP2LkpIS3LlzB8rKyq2Erj52f5siiiKfqLx79w75+fkoLy/Ht99+CzabTT1u19fXo1u3bozfbVtwuVwoKyvj+PHjzZx8U2pqapCVlYXw8HDk5+eDxWLh77//bvW+4OBg2pq9ubm5KC4uxrp16zBnzpxW7X766Sf88ssvVIW0puzatQsXLlyglRF4+/Yttm7dCmVlZZibm+PcuXNwdXUFl8uFvLw8wsPDGZdNWn6+pslUz549g4GBgVCDZnsR1qawA4S4+Pvvv/Hs2TPo6OhQ9yATYutru+f8nwFTp05lfMwLDg7muyOtq6tLhSsJioGBATl79iwhhJDHjx8TNptNPUZeu3aNqKmpCXXdptTX1xM2m90sOYdflExhYSGxs7PrkP5WVVWR1NRUkpiYKFAU0qcK3XcrSNumcfA8GhoayJ07d0hkZCRZuXIl0dbWJgoKCmTixIlk3bp1AttxdXUlGzZsoD2npqZGRZy0JCsri/HfU9jQQB50yVS8/I72JFNlZ2eTvLw8Qkhj4pqdnR0xNTUlYWFhHWaTENJsaS0pKYlERUW1GW0WHx9PRcrcu3ePzJgxg2hpaREPD49mUYBNKS0tJZaWliQkJIQQ0rgMxuvruHHj2rUkJkxfW/JFOXlhb3ZCGkOz2oqlZ0KUTNv2wnMmaWlpVNYmm80mKSkptBmdkZGRjOFkovT38uXLRFNTk8qMbPnil7z1qcLkqIVta2NjQ2VNT5w4kaxZs4YcOXKEWpMVhqysLKKtrU17ztjYmHJ6LQkODmb89xQ2NJCHKMlU8fHxhM1mU/s01tbWRENDgzg4OBAVFRWyd+9esdsUdoAIDw8nbDab7N69mxDSGN6oq6tLtm7dSrS0tIivry9tu3Xr1hFdXV2SkZFBuFwu0dXVJcuWLSP37t0j5ubmxNbWVux9peOLcvLC3uyENCYuhIaGCmVXlEzb9sJzJosWLWozi5N3MzDN5EXp78yZM8ns2bMJh8MhxcXF5PHjx61enxvidvJKSkpEQUGBzJo1i0RFRVFx3KJw+PBhMmrUKNpzkZGRRFlZmfj5+ZH8/HxSXFxMbt68SXbs2EFUVFTIvn37aNupqqpSCXO7du0iysrKVBby1atX20yGEiWZaubMmZQ0xIsXL4iioiIVNx8eHk6mTp0qdpvCDhDGxsZU1mpJSUmzjeLDhw+TSZMm0bYbN24c9WTL4XCIgoIC9TSQlpZGRo8eLfa+0vHZh1A2xczMDH5+fuByuZg8eTJkZGTw+vVrqhaoi4sLY1s7OzusXbsW9fX1ApX4Ahpj3U+cOIHS0lIAjbUdBw4ciLy8PKipqYlVj9rOzg6vX79ud5GJ9vZ3wIAByM/Pb7O/hYWF2L17N9+KTP/Xyc7OBofDwbVr13DixAls27aNqrzFk6+mk3umC1nk1exNSEhgLCZtZWWF0tJSREZGYv/+/dRxSUlJWFhYYPny5bTthA0N5PHhwweqNm9GRgZ69uxJhTByuVx068bsXoqKiqjC7unp6SCEwMjICACgqqrKqPwoik0Oh4MtW7ZAVVUVV65cQVVVFczMzCAtLY0FCxYwip89fvyYiuFPT08Hi8Wi9pjk5eUZBeCqq6vx/fffU33t3r079Zvs3r07bX1kUftKxxfl5Nu62a2trZu9v+mG5ZIlSwCAkmltb4kvHqWlpcjNzcW0adMANFYQ+vDhA99i0cIgIyNDxZo3NDRg0qRJtGqS7eHbb79FUVERKisr8e233zI6g6YMGDAAb9++Fcre/xWkpKQwadIkTJo0CUBjMg2Hw8GpU6eoRDS6e4nJsUlLS2Py5Mlwd3dntOnm5gZ7e3vk5+dTlajU1NT4RnAsWLAA3t7eOHjwIB49ekRFpDk5OSElJaXN5DBRkql69+5N3UeXL1/GgAEDqMS+4uJixntaFJvCDhAyMjKUI09PT4e8vDy1IV1QUNAqUozH0KFDweFwoK6ujgsXLkBbW5tKjjp9+jT1ecXZVzq+KCcPCHazGxoaYteuXdDQ0ICWlhbmzZvXrmiClvz9999YunQp+vbtSzn5ly9fIiIiAocOHUJUVJTYnT3QWB6tpKQE5eXlGDZsGKqqqhAYGIjnz5/D2NiY0uOmIzY2FmFhYc1mIQMGDMCaNWtgYmLC2G7FihUICQmBuro6BgwYINbP86Xx+vVrXL9+HVevXsXVq1dRXFyM7777jrH4uCCStnT07t2bmgC0hyVLlkBWVhYcDgeOjo5UaGD37t2xadMmvqGBgGjJVDo6Oti1axcePnyI1NRULF26FEBjdFdgYCDj5xDFprADhIGBAfz8/JCVlYWMjAyqzkBkZCRCQkIYv6cVK1bAzc0N4eHhqKmpgaenJwBg3rx5uHv3Lvz9/cXeV1ravbDzGcBvY+vdu3etomdUVVWpjSZ+8rttsWTJEmJhYdFKJvXt27fE0tKS7wZLe6Fb+xVWxCgqKoooKCgQJycnkpiYSLKyskhCQgJxcHAgbDabiryhw9ramowZM4aw2Wyip6dHpk6d2ur1uSHuNXlvb29iampKFBUViZKSElm4cCEJCwtr99r8mzdvyKVLl6h/m/bI73YWwiZTlZWVkWXLlhFVVVWyfPly6jPq6+uTRYsW8VX5FNbmlStXiLq6OmGz2URNTY3cunWLENIYbcYvaOP9+/fEw8ODGBsbEy8vL0p23NjYmLi6upJ3794x2szJySF79uyhoogIadRtyszM7JC+0vFFxcnr6enRzpovX76MDRs24NmzZ83iky0sLJCXlwc5OTk8ffoU33zzDW2hZKBx+SYlJYX23OjRoxEUFESbwp6RkYF169a1qxgwP+jisRcsWIB+/frBz88PDQ0NGD9+PFasWAEXFxfs2LEDFy9epI2Pnjx5MgwMDGgrI23cuBEcDoexPBu/JQMe/LRxPkXaE+vOj/j4eBgaGlKP12PHjoWenh709fWhp6dHHW8PoaGhCAsLa5a81b17d9jY2DBWzxIEYcvafSxKS0vbVQRHWEpKSnD79m2oq6tTCWmxsbEYO3Yshg8fLtC1mi73dgTi6usXtVzzww8/wMLCAgcOHMCIESNQXl6OrVu34syZM1BQUKDWHHn4+/sjJiYGb968wdGjR6GqqipwEWWg8UfItPlSWVkpvgovLRBWxOjVq1fQ19enPWdkZNSszGFLPjcHLgh//vlnmwkqPJpmQLfMpL569Wq7/s1bZsvGxcUhKCgICxYsaFU8fPfu3fj2229pC9gLgrBl7XiIUgi8tLQUsrKy6NatG7XpTwfvHM/Zi7P4OJ3Q4eLFi1u9Lzc3F2w2G7169UJubi5fm8D/gjI8PDxga2uLQYMGtbmn0VaWd3v72hZflJOPiIiAo6MjLC0tsXTpUoSHh6O+vh5ubm6wtLRslaYtJyeHtWvXAgAyMzPh7OzcZpFrOvT09BAYGAhlZWUMGzaMOl5UVITg4GBMmDBBtA+Gxs1jXn1QHsKKGGlpaVHrfC3JysqChoZGm/1JT09HdnY2qqqq8PXXX2PMmDECrQd/SvC+27i4OJEE73gIMqg3fZCOioqChYUFFXUCNE5cxowZg+7duyMmJkZkJy9sWTseTYuwC/pdTZo0CUeOHIGamhr09fXb/J54m9Oi2BR2gFi0aBFV+H7RokVgsVi0om+kRVBGZmYmVSu6LcG7ltcS52DWlC/Kyffo0QOhoaFYu3YtduzYgTFjxsDPz69dj3+ipPG7urpSs68hQ4ZAVlYW5eXl+Pfff/H9999j/fr1jG2JAJo5LWeMwiryzZ49Gxs2bMDLly9hYmICOTk5vHnzBpcuXUJiYiJcXFyaLdc0lViura3FypUrkZWVha+++oqKPNi7dy+0tbWxd+9eKoKgMxBWgnfWrFl8tY0+BiUlJVRETkt4DrKzEaUQ+NatW6mZ6datW9s9GIpiU9gBIjo6mpqwRUdHt7tdUz8iqE8RZTDjx2e/Jk/3KNXQ0IBt27ahuLgYW7duhaysLHWOKdZdVGpqanDixAnk5ubizZs3kJaWxujRozFnzhy+SwCiaObwEzGSkpJCeHg4rZaHIE8rLUNHfXx8cOTIEWzZsgXGxsbUDOfcuXPw9PTEwoULqaejzqA9gm9NactpvH79utmPjxCCmpoa3LhxQ+RZdcu9gJ9++gmLFy+m/QxRUVEIDw9HRkaGSDabUlFRgeDgYOTn5zPqt1+4cKHN67x79w6VlZW05zpqfb0zbH6ufPZOns1mU46R91F4jodH00ctfrHuncGECRMwY8YMuLm5CdWetFPEqKkA15MnTwSy0VQxUV9fH0uXLoWVlVWr9x04cADR0dFiFzfrDAoKCrBu3To8fPiQ9jyTyJggtHTygYGBiImJwbZt2zBlyhTqfUlJSfj9998xe/bsdm18txdnZ2ekpqZCT0+PMS6d3x7M/fv3sX79evzzzz+M7+H3e7t79y7jAMO06SuqTUC4ASI5ORl5eXmMfaVbW3/y5Ak2b97MdxClUxUVta8t+eyXawR5lOoo2opSAMBYIOPt27eMmYztgcVitUrG4FWf4cHlcmFpaUlt8NHJ3LaXyspKxhjdkSNH4tWrV0Jfu6MQZja+fft2vHnzBm5ubkhLS0P37t1hYGCAjIwMZGRkdMh9Z2dnh5ycHDg5OaF79+6QlZVFWVkZ6urqoKWlhVWrVonVXlZWFtavX08lAgqKl5cXysvLsX79eqoAS3uJioqCt7c3Y9Ynk5MXxaawA4Sfnx/2798PaWlp2n0upmWnP/74A/n5+ZgzZ85H6ysdn72Tb5qC7+Pjg+nTp0NVVfWj9oFflIK0tDTk5OQYnbympiZyc3PFKn1AR9MfU3vK3G3atIn2+I8//ojLly/TlgdsTyr8x6Q9s3EmJ5+fnw93d3fMnTsXPXv2REJCAhYtWoRFixbB2dkZMTExYpd26NGjB2JiYpCeng4Oh4OKigr06dMH2tramDhxotijtHr16oUff/xR6PYFBQXw9vaGsbGxwG0jIyNhZGSEzZs3C+QARbEp7ABx8uRJzJ8/X+B6B/n5+fDw8MDs2bMF7apIg1lLPnsn3xReibmPDV2UQk1NDXJycrBhwwa+TlUUzRxhodv1r6mpwZs3b9CvXz++g6SlpSXc3d3x4cMHmJiYoH///nj16hXOnDmDQ4cO0cbedxaizMaFrZ8rKqWlpaipqcG6desAAP/++y/Onj0LFRWVZntL4mDx4sWIiIjA6NGjISUlJXD7wYMHo6GhQSjbFRUVWLhwocAOTBSbwg4Q79+/F2pQ6d+/v9AOWpTBrCVflJNXVlZGZmamQHU1O4pevXph4sSJcHBwwPbt2xEfH0/7PlE1c4SBac380aNHcHBwgKmpKWNbU1NTFBcXY//+/Th48CB1/KuvvoKtrS0VPvYpIMpsXNj6uaLATx7j4MGDiI6OFqs8hrm5OeLj46Gvrw95eflWEwwWi4WoqCjG9mvWrIG3tzf69+8PdXV1gaKqJkyYgNzcXIF/q6LYFHaAmDJlCi5evMhY3J4JW1tbBAcHQ0FBQeAlUlEGs5Z8cU4+OjoaycnJH7XEHD8GDBiAwsJCxvOfwp4CD3l5eTg5OSE4OJivfo2zszOWLFmC/Px8VFZWok+fPtDQ0BAos/NjIMpsfPLkyfDz84OUlBSmTJkCeXl5BAYGwtbWFgcOHOBbgai9y4YSEhKYNWsWtem5fft2KCgoYPfu3dR7xowZg0uXLsHe3h7bt29v1/5Pe/Hw8EBRURFGjBgh1Ex+6NChIIQwrunz25z29PSEpaUlnj59CjU1Ndoi9nSTDVFsCjtA/P7775g3bx4sLCygrq5OOxjSVeWaNGkSwsPDKUVcunZMWfSiDGYt+aKc/IULFyAnJwcul4uCggIUFBQ0O99RmadMlJaWYv/+/XxH8Y5eixeU3r17tyv6pm/fvoxZs58KoszGHR0d8e+//yIuLg5TpkyBu7s7HB0dkZCQQNXPZaK9y4YsFqtZ9Mrt27cRFBTUKuRWSkoK1tbW1BKOuEhLS8Ovv/5KGynVHtzd3VFZWQlzc3OBl5LS0tJQXFyMoqIi2qdcFotF6+RFsSnsABEVFYWioiIUFRXRhmwzOXk3Nzc8efIE+vr6jEqV4u4rHV+Uk++s0D26AswNDQ0gjUVZsH37dr7tCwsLERwc3CqD1MHBoVkGrbigSylvaGjAs2fPEBgY2MqmiooKDh06BDU1NaGLTXcGoszGe/bsiV27dqGurg5AY1ZzYmJim/Vzgcb7ISsrS+CliI8tjyElJSWYmmEL/v77b/j5+dEWi2+LkJAQ6OnpwcnJSSAHKIpNYQeI2NhYzJ49W+BN0Bs3buDPP/8UKslOlMGsJV+Uk+dRUVGB/Px8vH37FjIyMlBVVW23Jokw2NnZ0f4ApaWlMWnSJL660QUFBVi4cCF69uwJIyMjyMrK4uXLl0hLS0NaWhoOHz4MBQUFsfaXKaWcEIKePXsiODi42XE7OzsqJpfps36KiDIbd3d3h729fbOBgKcl8ujRI6xcuRKhoaG0bZWVlREVFYWkpCSBlg0/hjxGUxYsWIDw8HBoamrSLpe0hSihuBUVFbCyshJYEE4Um8IOELW1tZg5c6bAm6gyMjJCaWEBog1mLfninHxHq/jRIUiVlpb4+flBXl4e0dHRVPV5oDHaxcrKCjt37mR0JsJCl1LOYrEgLS2NsWPHthoQm35vbX1WfsJTHxtBZ+NPnz6l/j558iQmT54MSUnJVtfNyMjgq0si7LKhKPIYwlBWVob8/HxMmDABw4cPb7Uu35Y+iouLCwICAiAjIwM1NTWBFBl1dHSQn5/PWL2sI2wKO0AYGRnh4sWL0NHREaidtbU1goODMWLECIFrL4gymLXks894bUpcXBy8vLxoVfzi4uLw559/ipyKzoNJipeJpvovTdHU1ISvry8mT57c6hwv05HD4QjVx6a0lMMFGmUReDPV8vJyFBUVMerd8FBUVKREplqSk5ODFStWIC8vT+T+igO62TiPR48ewdfXt9kAamdnh/T09DavSwiBgYGB2AdfQHh5DGFojwQEP9mHGTNm4PHjx3j//j0A0A6ITEt3ycnJ+OOPP2BkZAQ1NTXajV+634woNs+fP4+dO3di8+bNAg0QcXFx2L59O5SVlWn7ypS4ZWdnBw6Hg5qaGsjKytJ+RibZCGH7SscX5eRNTEygq6vbTMW2VS62AAAgAElEQVSPx9atW3Ht2jWcPn1aLLZa6r+0lFZoegxgzk4bP348Nm7cSOvkU1JSsH79+mabPcIKcDWlvLwcdnZ2ePPmDZKSkgA0JjLZ2tpi7NixCA4ORu/evan3R0REoKamBkBjqOe8efNoU6rz8vJw584dXL9+vd19FDdNZ+NGRkbYtWsXFBUVW70vKSkJAQEBuHXrFnWstLQU169fb3f93Pb88J4+fYoXL15g5MiRYLFYQi2LtKShoQFWVlbYuHEj36VAcdJUFoMHL+yXH0xPz23pJzGFDotiU9gBQti+ilJ7QZTBrCVf1HLNx1TxS01Npf6+d+8eXF1dYW9vj2nTpkFOTo4qIB4cHMxX/0NDQwP79u2Dnp5eszCp9+/fY9++fdDU1Gz2fnGo0/n4+ODVq1fYsmULdWzixImIjY3Fr7/+ioCAgGbhhfX19dSslcVi0erNS0hIoE+fPlizZo3I/ROFjRs3NpuNM/3gebPxpnz77bf45ZdfAIheP/fixYvYvn07/v33X7BYLBw9ehS7d+9G3759sWnTJtofbXshhCA7OxvV1dVCX0MQWspi8Gjv8ichBCEhITAzM8M333wDoPnvRxBEscmrtSAowpZlFKT2wsmTJ2FgYEA9aQvbV1raXUPqM2Dq1KkkOjqa9tyBAweInp5eh9idNWsW2bt3L+25yMhIYmJiwtj24cOHRENDg+jq6hIPDw8SGBhIPDw8iK6uLtHQ0CB3794Ve3/HjRtHzp07R3suMTGRTJgwgbGtgoKC0GUSPwbPnz8np06dIidPniQKCgokODiYnDp1qtkrMTGRpKenk9ra2mZtb9y4Qaqrq6m/23oxkZqaSthsNnFwcCDHjh2jygPGxsYSZWVlEhISItJnFKVcYWfYq6+vJ2w2W6j2XC6XGBoakgcPHnw0mw0NDSQ4OJi8ePHio9js6L5+UTP56dOnIzAwEN99910rFb9du3YJpSHRHgoLC6GkpER7btiwYXj8+DFj22HDhuHw4cMICQlBamoqpVeipaUFBweHdoW4CSrAVVtby5hcISUlxaiYB4hebLqjEWU2Tlcogg7SRiZycHAwZs2aha1bt4LL5VJSD+bm5qisrMTJkydhb28vxKf7fCFCrgoTQvDkyRNq8/xj2GxoaEBISAgMDAyop4COttmRff2inDyTit+HDx8wZswYsav48Rg6dCgSEhJo46KPHj3apqNWUFBAUFCQwHaFFeBSV1dHdHQ09PT00K3b/24BLpeL2NjYNjM1z58/Dw6H02xgaWhowLt375CXl4e0tDSBP4u4aFq2bciQIVQSCxNNdYGELRTRksLCQkZN/dGjR3fIhm0X4kVYp9sZtNXXL8rJb9iwAYsXL4aVlRXy8vI6XMWPh4ODA1xcXPDf//4XRkZGVLWk8+fP48GDB9i3b1+z9yckJEBPTw/9+vVrV5QOU2SOsAJczs7OsLCwwJQpUzBx4kQqVO/y5ct4+fIlX72SkJAQamO2vr4eX331Fbp164by8nJISEiILXpJWESZjTfNPhYlE/nrr7/Gf//7X9q49v/+979Cr/N30YUwfFFOvqioCKdPn4aEhATGjBmDSZMmwcDAgG92ojiYOnUqQkJCEBISgoCAABBCICEhAU1NTRw4cKCVCJarqyvi4uLQr18/uLq68r02i8VidPLCCnBpaGjgyJEjCAsLQ2pqarNQvaCgIL4JKvHx8TA1NcW2bdsQGBiIZ8+ewcfHB3fu3IGNjQ1GjBjRjm+s4xDXbBxoTEjZu3cvcnJyUFlZCVlZWYwdOxZ2dnYYMmQIY7umy4Y8R89isXD//n3s3r1bLMqCXXTRXr4oJ3/48GFUVVXhypUruHz5MsLDw+Ht7Y2hQ4dSDr+jtGIMDQ2hqKiIS5cuoaqqCqampnj16hWGDx/e6r2pqakiRxkAoglwKSkpNVsi4q15thUW+Pz5c8yYMQMsFgvKyso4e/YsgEbpAzs7Oxw9elSoivLiQlyz8aysLNjY2EBWVhaGhobU0l9aWhouXLiAQ4cOMYbWrVq1Cv/88w8cHR2p5TArKytUVVVBU1MTLi4uQveriy4E5Yty8kCjwNa0adMoqdbr169j586diIyMxIEDBzqs/J+Pjw9iYmJQX18PCQkJ6OrqIiAgAKWlpYiKimqmP9E0m43D4UBfX5/2Ef7ly5dISEhgjI0XVoCroaEBAQEByMvLo+SCb9y4AQcHByxbtoxvmFqvXr0gISEBAPjhhx+oWN7//Oc/UFRU5LvJ3BkIOxv39/eHjo4OQkNDmw18tbW1sLW1hbe3Nw4cOEDbtkePHti/fz8yMzNx9epVVFRUQFpaGtra2pg0adJnIwvRxZeBRGd3QNyUl5cjKSkJmzdvxsyZM7F06VLcvn0bmpqatFlp4mDv3r2IiYnB+vXrkZycTOlAOzo6oqKiAjt27GBs6+7ujpKSEtpz9+7d49uWJ8CVnJyMb7/9lhLgKiws5CvAFRISgujo6Gb62CNHjoS1tTX279/P6LwAQFVVFadOnQLQWCVKUlIS165dA9C4XCZKZp64ycrKwvz585GXlwdDQ0NYW1tDT08PV65cwaxZs/hGCj18+BBLlixp9Xl69OiBpUuX4ubNm23a19XVhZOTE1xcXLBmzRoYGBiIxcGzWCwMGDDgk/quu/h0+aJm8j///DMKCwvRo0cPKCkpQV9fH+vXr8eoUaPEkmnIxJEjR+Dk5ARLS0twuVzquKamJlatWoXAwMBm77e1taUiYgghcHBwoP3BlpWV8c1oFFaAKz4+HuvXr2+2rCIrKwsHBwdISUnhr7/+YpSftbGxgbW1NSoqKhAaGopffvkFbm5uGDduHNLT02kzdzsLUWbjQ4YMwYMHDzBx4sRW5548eYLvvvuOr+2LFy8iNDQUd+/eBSEEkpKSGDVqFJydndssG5iXl4fMzEy8ePECdnZ2VIgu72lQQkKiwxRXy8vLqQxd3hObpKQktm3b9kmVduyi/XxRTv7169cghGDQoEFQVVWFuro6VFVVO9TBA8CLFy8Yww4HDhyIN2/eNDu2cuVKHDt2DABw7NgxqKqqtlKr42WQmpmZMdoVVg63vLycscKQgoICnj17xmhTR0cHR44coQoMe3p6QkJCArm5uTA2Nsavv/7K2PZj8/DhQwQHBzPOxvmF1G7YsAGOjo5gsVj4+eef8c033+DNmze4dOkSAgMD4eHh0UyMranMw5kzZ7B27VooKytj1apVkJGRwatXr5CUlAQrKyvs37+fVpirrq4O69atQ3JyMrp164b6+nqYmZkhPDwcDx8+xKFDh8QaRPD27Vts3boVysrKMDc3x7lz5+Dq6goulwt5eXmEh4dTgxk/udyamhpK7iA5ORnPnj2DgYEB9SQpKSmJ1NRUyMnJCdxHFosFLS2tVrovHWlTWFoWgaHj77//xrNnz6Cjo0NpEUlKSiI6Olqkert8ETjF6hPnwYMHJDo6mtjb2xMtLS2iqKhITE1NydatW0lKSkqH2Jw+fTrx9vYmhLTODgwODibTp09nbPvrr7+S4uJioezya1tYWEjs7Oxoz5mampINGzbQntu8eTPfDN3PiRkzZpB9+/bRnjt48CAxNjZmbKukpETYbDZRUFAgbDabeikoKLQ6xmazm7WdPn06Wbt2Le11XVxcyLx582jP+fj4kFGjRpHU1FTy/v176j4qKSkhxsbGZNWqVe385O1jw4YNRFNTkyQkJBBCCDE0NCRz5swhKSkp5OeffyZr1qzh276wsJBMmTKF7NixgxBCyI4dO6jvSF1dnW9WMCGEZGdnk7y8PEIIIU+ePCF2dnbE1NSUhIWFdZhNQgiV1UwIIUlJSSQqKqrV7+jx48ekrq6O+v/4+Hhy6dIlQggh9+7dIzNmzCBaWlrEw8OjVeY0j9LSUmJpaUllOMfExFB9HTduHPnnn386pK8t+eKcfFMaGhpIXl4ecXBwoH6YHcGRI0cIm80mmzdvJllZWYTNZpNz586RqKgooqGhQWJjY4W6bm1tLcnMzGx27MmTJ9SLzWaTlJSUZsd4r8jISKKqqkp73fj4eKKgoEBWr15Nzpw5Q65evUrOnDlD1q1bRxQVFcnx48ebvf/06dMCvT4Vbty4QcaNG0f2799Pnj9/TrhcLikrKyPHjx8n2traJCEhgTx//px6NeXEiRMCvZqipqZGLl++TNuny5cvE3V1ddpzEyZMoO6VlpOFM2fOkPHjx4v6lTRDT0+PHDlyhBBCyO3bt4mCggI5f/48IYSQ8+fPEx0dHb7t7e3tibGxMbl16xapra0lWlpaZPXq1aSqqoo4ODiQxYsXM7aNj48nbDab+Pj4EEIIsba2JhoaGsTBwYGoqKgwyoSIYlPYASI8PJyw2Wyye/duQgghZmZmRFdXl2zdupVoaWkRX19f2nbr1q0jurq6JCMjg3C5XKKrq0uWLVtG7t27R8zNzYmtra3Y+0rHF+nk7969S/bv30/dOEpKSmThwoVkz549HWYzLCyMaGhoNJvtqaiokICAAL7tnj59SmxsbIiGhgZRVlamXoqKirSzRFtb21azSLqXgoIC40yeEEJiY2PJ+PHjqcFPQUGB6OjokJiYmFbv5X2e9rw6aiAVBlFm46JgZmZG/Pz8aM/t2bOHzJo1i/acqqoqNTi0dPKZmZlETU1NbH3k2eNwOIQQQnbt2kWUlZVJVVUVIYSQq1evEg0NDb7ttbS0SFJSEiGkcfBis9nk2rVr1P/zaz9z5kzi7u5OCCHkxYsXRFFRkezfv58Q0uhUp06dKnabwg4QxsbG1L9nSUkJUVBQIAcPHiSEEHL48GEyadIk2nbjxo2jJj0cDocoKChQTwNpaWlk9OjRYu8rHV/UmryzszOuX7+OyspK9O3bF3p6eti0aRP09PQ6vMi0ra0tzM3NkZeXhzdv3qB3795QV1dvM7tx27ZtyMnJwZw5c5Cbm4uePXtCQ0MDmZmZePDgQasqTX/++adAcrhMmJubY8yYMcjJyUFVVRUV4kcnwSBKLH9nsnnzZpHav3jxAnl5ebTyDTk5OfDz86Nt5+zsjNWrV6O6uhomJiaQk5Oj1vPDw8Ph7u7eTD6aJ60wfPhwnDlzhjZTNiMjQ+ylIAcOHIiCggKMGTMGKSkp0NDQoNaJ09PT29xo/fDhA/W7ysjIQM+ePal6BFwut5lkRkuKioooSfD09HQQQmBkZASgMYJr586dYrfJ4XCwZcsWqKqq4sqVK6iqqoKZmRmkpaWxYMECxoI4jx8/pjbg09PTwWKxYGhoCACQl5dnLNlYXV2N77//nupr9+7dqd9k9+7d+coRCNtXOr4oJ19SUoKFCxdCX18fGhoaHz0eWVpaGnp6egK1uX79OlavXo3FixcjNjYWFy9ehKurK9asWYNly5YhNTWVuvkB8cjhNjQ0wNPTE8ePHwfwP+0LXvHklpWjmKrU1NfX4/Xr1/j666/5/rg6C2Fqa/JISkrC2rVr8eHDh2a1Anh/M21cA//T/D906BD++usv6jjve96wYUOz6/FyN1auXAknJydUVFRQ4Za5ubk4ffo0Dh482GatYEFZsGABvL29cfDgQTx69IiKxnJyckJKSgo8PDz4th85ciSSkpLw448/4vz585gwYQK6deuGDx8+4ODBg3w1m3r37o23b98CAC5fvowBAwZQkWTFxcWM97QoNoUdIHgyJUCjk5eXl6c2pAsKChhr1A4dOhQcDgfq6uq4cOECtLW1KWHA06dP842cE2Uwa8mn98sUAbqq75861dXVVA1XeXl5qiiCpKQkFi1aBB8fn2bvF0WAi8fevXtx8uRJrF27lqqgxUu8CgoKgry8PFasWMF4zTt37mDHjh3Izs4Gl8vF0aNHERMTg8GDB9NWre9MhJ2Nh4WFQUlJCV5eXjh48CC4XC5WrFiB9PR07Nixg7YwDQ9h5RSmTJkCX19f+Pv7UyGSW7ZsgYyMDDw9PTF9+nShrsvEkiVLICsrCw6HA0dHR+r63bt3x6ZNmzB37ly+7Z2dneHg4ICDBw+ie/fu1D3z008/oaysDGFhYYxtdXR0sGvXLjx8+BCpqalYunQpgMZKSYGBgYyTJVFsCjtAGBgYwM/PD1lZWcjIyMDq1asBAJGRkQgJCWH8nlasWAE3NzeEh4ejpqYGnp6eAIB58+bh7t278Pf3F3tfaWn3wk4XHYKBgQE5e/YsIaRxl5zNZlPa0NeuXWu1DttUz51uXbnpujPTOrORkREJDg6mPRccHMy4HkpI42amqqoqmT17NgkKCqJ0sHkbQ7y1yk+BCxcuEBUVlWbfU9O/+UU9qampkeTkZEIIIadOnSIzZ86kzvn4+Ai0JsoEl8slFhYWpKioqNW5wsJCcuPGDfLgwQPC5XJFttVRFBcXkzNnzpDHjx9Tx2JiYtqMHCkrKyPLli0jqqqqZPny5dRegL6+Plm0aBEpKysTu80rV64QdXV1wmaziZqaGrl16xYhpPE3qKamRrKysmjbvX//nnh4eBBjY2Pi5eVFRbIYGxsTV1dX8u7dO0abOTk5ZM+ePVQUESGE+Pr6tgqoEFdf6fiiyv99jnh5eSE7Oxve3t5QV1eHgYEBpk2bBicnJ2zcuBE3btygSvQBQHZ2NpSVlSElJYXs7Ow2r0+n36Kuro6wsDCMGzeu1bmsrCzY2dk1K4vXlEWLFqFPnz4ICwtDfX09VFRUcPz4cSgrK8Pb2xuZmZkC17/tKGbPno2vvvqKcTYeFhZGKw8NNCay7d27F1paWrh58yYsLCyQn58PCQkJXL16FWvWrMHVq1dF6h+Xy4WysjL1/VlYWGDmzJkwNjYWez1XHmFhYZg9ezbk5OT4znoB5tqlHUlpaSltaUlxUVJSgtu3b0NdXZ1ahoyNjcXYsWNpdab4UVdX16FZx+Lq6xe1XPM54uLiguXLlyMgIABRUVFYvXo1fv31V0RGRgIA9YjHo6nTTktLw/Tp09vUf2/J4MGDkZeXR+vk8/Ly+BZKuHv3LiVs1nLPw8DAAIcPHxaoLx1JYWEh/P39oaSkBB0dHURERGDYsGEYNmwYXr16xdfJ//jjj8jLy4OWlhbk5eVRV1eH+/fvQ0lJCdXV1UIVsWgLCQkJeHl5YdOmTZg0aRJMTU1baf6Lys6dOzF+/HjIyckxbm7yoHPyy5Ytwx9//AF5efk26w23rDFcWloKWVlZdOvWrVkiWUt453jOXhSbLRk8eHAruQ86Qb2my6JNN8mZ4C2Lenh4wNbWFoMGDWpzT4PFYmHjxo0i97Utupx8JyMjI4MTJ05QN/Yvv/yCgQMHIi8vD2pqanyVFOPi4mgjMdpi7ty5CAgIQK9evTB9+nT0798fr169wpkzZ7Bnzx6+szcpKSnGaILS0lLaivSdhYSEBLV5NWTIEDx69AgNDQ2QkJCAnp4e3z0cMzMzbNy4ETU1NVi1ahXGjh2L33//HfPmzUNMTAxfOWZhiYqKQllZGc6ePYuzZ8/C3t4effv2xfTp0/HLL79AQ0NDZBtN9XqEqfLVdG9D0HrDvDrLampq0NfXbzMwgrchLYpNYQcIuroEpMnGOw/SYvM8MzMT5ubm1N9t2RNHX9uiy8l/ApSWliI3N5dSzuzfvz8+fPjAN4IDAJSVlZGZmck4G2XCwsIC9+7dg7e3d7ONXUIIfvnlF6xcuZKxraGhIXbu3Ak2m01tGLNYLLx8+RJ79uyBvr6+QH3pSESZjZuZmaGurg5PnjwB0FggfMWKFdi0aRMGDhxIlfQTN7KysrCwsICFhQWePXuGs2fP4vz58zh8+DAGDx6MCxcudIhdfnC5XKioqODYsWOIiYmhjjf9uy04HA68vLyomWnLCC5+iGKztrZWqAFC2LoETTWFBNEXevr0Kerq6oQezPjR5eQ7mb///htLly5F3759KSf/8uVLRERE4NChQ4iKimJ09srKyoiOjkZycjKGDx/eKpSL6XFQUlISPj4+WLFiBTgcTrMKWm2t9a1btw63b9/G3Llzqcfp9evX48mTJ5CTk8O6deuE+Ro6BFFn45KSknjx4gWARlnlTZs2wd3dHfb29tQA15HU1tZSIZyEkE4NUxVl647L5cLS0hLHjh2jQiPbW2+ZEILffvsNTk5OGDBggFA2ec5akAGCxWJRg1B76xI0NDTAysoKGzdu5BseSddXIyMjofvK4XCgrKxMafm0pMvJdzLbt2+HgoICdu/eTR0bM2YMLl26BHt7e2zfvp1xg+zChQuQk5MDl8tFQUEBCgoKmp1va6Y0fPhwgTeb9uzZAw8PDzx69AjXrl3Djz/+SCVozJ49m/FG6wxEmY3HxsZiy5YtzcoZfv/999DR0YGHhwckJSUxc+ZMsff56dOn1HLNvXv3ICMjAxMTE3h5eXXIEtHHQthBoqGhASdPnsTixYsFcvKi2Gw6QAjynRNCkJ2djerqaoFtdmRfu5x8J3P79m0EBQW1iqaQkpKCtbU135lxR8nN8oO3DzB//nzMnz//o9sXFGFn4zExMXB0dGwW9z948GBs3boVAwYMwP79+8Xu5BcsWICbN2+iR48eMDIygouLCyZMmABJSUmx2vnc6IwAwM8p6LCtvn5xRUM+N7p37864kVlZWSlS1u6///4rdFsmePsAnwOxsbHYtGlTswG06WycV/yEjufPn9MmkgHA6NGjUVxcLPb+9ujRA1u2bEFmZib8/f2hr6//f97BdyE6XTP5TkZPTw+BgYFQVlZupk1SVFSE4OBgvtEzlZWV2LlzJzgcTrNNRF5GZ1lZmdjLHQq7D9AZiDIbHzBgAK5fv04bZnrjxg2xxHK3rPAUFRUl8jW76KIlXU6+k3F1dcWCBQswY8YMDBkyBLKysigvL8e///6L77//HuvXr2dsu23bNiQkJEBPTw+PHj1Cz549MXToUNy4cQPl5eUd4mxF3Qf4mLQ1G9+3bx9jWzMzM/j5+YHL5WLy5MmQkZHB69evcfHiRYSHh7dZjLukpAR1dXUYNmwYqqqqEBgYiOfPn8PY2Bg///wzgMYQz6FDh1KzdXGGzXXRBY8uJ9/JfPPNN0hISMCJEyeQm5uLN2/eYPjw4TAzM8OcOXP4Zj5mZGTAyckJtra2iIiIQHZ2Nnbu3Inq6mosXryYKjEoTjpjH0BYRJmNW1lZobS0FJGRkdi/fz91XFJSEhYWFli+fDlj2/T0dDg4OMDCwgJubm7w9PREUlISRo4cCVdXV7x//57SOxElBryLLtpDl5P/BOjVqxcWL14scDZbRUUFNDU1ATRGykRERABo3LRdunQpQkJC4O7uLvb+fi6IOht3c3ODvb098vPzKfloNTW1VqUaWxIaGooJEybAwcEBlZWVSE5Oho2NDVxcXLBjxw5ERUVRTl7YGPAuumgvXU6+k2lLPwQA7OzsaI/369ePkmsdMmQIysrK8ObNG/Tr1w/ff/8939Tx/wuIMhvn0bt3b4Hlo+/fv4/Q0FBIS0sjMTERXC4XP/30EwBAV1eXkqxoiaWlJby8vGh14+/fvw83Nze+m8UdRXtql3Ykn9IS4OdIl5PvZPjph0hLS0NOTo7RyY8bNw579uyBoqIifvjhB/Tt2xcnT56ElZUVLl261Gk/yk8JYWfjotCjRw9wuVwAwJUrVyArKws2mw0AePXqFfr06UO9Nycnh1quyc7OBofDQXl5eatrpqWldUi01MmTJ/H1119DX18f9+/fx/r166m9gz/++APdu3cHi8XCtm3bhLYhKSmJbdu2tVmEhAlhwhlFtSkMLTfSnz9/TunO05Geng59fX1ISEjA0dGxw4qOd6lQfoLU1NQgJycHGzZswJYtW2jXlIHGzb3Fixdj8ODBiI2NRWRkJHx8fCAjI4Py8nI4OjrC0dHxI/e+Czs7O9TW1mLu3Ln4448/MGvWLHh6euLOnTtYv349RowYgcDAQACAu7s74uPj+c5WeT/RuXPnilztqikRERHw9fWFs7MzVq5ciQULFuDx48cwMTFBfHw85s+fzzdPgxCCEydO4NKlS6ipqWnljNvaKK6urkZ1dTXk5OQonfRnz55h6tSpVIEMcdvkUVRUhMrKSsjIyLQSAQMaa1MYGho2qyiXl5eHzMxMvHjxAnZ2digsLISSkhJkZWVpbWhra8PLywsmJibNjr99+xZbtmzByZMnGaPffH19MXv27HZVA6Pra1O6nPwnzPHjxxEbG8tXSOv9+/d49OgRlJSUAACJiYm4ceMG1NXVYWpq+rG62kUTSkpKYGNjg6KiIgwfPhyRkZH45ptvoKurCykpKYSHh1OO5e3btygoKAAhBIsXL8bGjRtb/bB55RzFXf5v2rRpmDx5MtauXYvHjx9j8uTJ8PT0xKJFi3DkyBGEhYUhLS2Nsb2/vz/27duHQYMG4bvvvqMdqJj2GW7evIkVK1bAzMwMa9euhZeXF44cOYI+ffqguroawcHBVIk9cdkEGnMnwsLCmuWmDBgwAGvWrGnljHnU1dVh3bp1SE5ORrdu3VBfX49jx47B19cXDx8+xKFDh1qV4AQaFWYvXLhAZSz36dMH6enp8PT0REVFBezt7WFjY0Nrc+LEiXj58iVUVFQwe/ZsmJiYNHsCFIh2K8938dHJysoiqqqqjOdra2tJZGQkcXZ2JkuXLm31WrZs2UfsbRc8SkpKSENDA3n58mWz4zdv3qQKTtBx/fp18vbt247uHoWKigrJzs4mhDQWdmez2eTZs2eEEEKys7P53nuEEKKrq0u8vb2Fsm1lZUXMzMxIcXExqampIerq6uTPP/8khBDi4eFB5s6dK3abUVFRREFBgTg5OZHExESSlZVFEhISiIODA2Gz2VTxnpb4+PiQUaNGkdTUVPL+/XuqwHpJSQkxNjYmq1atYrSZmJhIdHR0iL6+Plm1ahVhs9nE2tqaFBcX8+1rQ0MDuXz5Mlm7di3R0NAgampqZNWqVSYaEgQAACAASURBVCQ9PZ00NDQI9Lm71uQ/UUpLS7F//37G+qpAoxbLsWPHMGLECPTr1+8j9q4LflhaWsLFxaVVopWamhrfdtra2njx4gWuXLkicLlCYRC2dimPt2/fwsDAQCjbN2/exI4dOzB48GCkpKSgtraW+r6mT5+O06dPi91mdHQ0LCwsWmkW/fzzz9i4cSN2795NiQQ2JSEhAWvWrIGhoSG11wIAgwYNgpOTE7Zs2cJo08TEBD179oSjoyPOnTsHJSUl7Ny5s82iMCwWCxMmTMCECRNQXV2N8+fP4/z583ByckLfvn1hamqKOXPmYMiQIW1+7i4n38koKyu3euRsaGgAIQSEEL7Fm5OTk2FnZ4dVq1Z1dDe7EIDa2lqhNr1FKR4uDMLWLuWhqamJ3Nzcdqs0NkVCQoIqan358mX06dOHGgTfvn2L//znP2K3+erVK0YpbCMjI5w4cYL2XEVFBaMzbRrh1pKqqir4+vpS4mE///wzdu/eDRMTE3h4eGDy5Mnt6reUlBQmTZqE2tpaVFVVIT8/HwcPHsS+fftgZGQELy8vvoV+upx8J2NnZ0e7rigtLY1JkybxlSxlsVjQ0tLqwN51IQzOzs7YvHkz7O3tMXLkSNqNObpELFGKhwuDu7s7tmzZAg6HgwULFlAZt3FxcTA0NGxz8mBnZ4e1a9eivr4eo0aNonXMTBnHKioqOHr0KP7zn//g/PnzmDRpElgsFsrKyrBv3z6oqKiI3aaWlhZVFLslWVlZjEVZhg8fjjNnztC2y8jIYNwrMTY2RlVVFVatWoXly5dDQkIC06ZNg6enJ5ycnGBkZIRdu3bRtgUaJwvJyck4ffo0srKy8NVXX+Gnn37CmjVroK2tDQ6HA1dXVzg7O+Ovv/5ivE7XxutnjI+PD0pLS+Hn5wcJiS6tuU8FNTW1NrNX6aIq1NXV4e/vj8mTJ+P06dOIiIjAyZMnATRKUt++ffujJEy1t3YpLyyUR9PJCmlRMakld+/exfLly/H69WvIyMjg0KFDGDp0KMaNGwdCCCIiIqhgAnHZPHfuHDZs2AANDQ2YmJhATk4Ob968waVLl5CYmAgXF5dmIY8zZswA0PjE7OTkBENDQxgYGMDT0xO//fYbHj9+jIMHD2L79u2YPn16K3tz586Ft7c3rZx3fHw8tm3bxlin2d3dHUlJSaiuroaGhgbmzJmD6dOnt6q8FhQUhAMHDvAtUdjl5DsBQQtd8262lrx//x6zZs2iCmq3nNWwWCxs3bpV6H52IRz8oqF4zJo1q9Wxj1E8vCVNNXYqKysRFBTUSmOHCWELyfN4+/YtCgsLMWLECKoOQUpKCkaNGsWYxyCKzZYDBD9aDhYJCQnw9/fH8+fPqWMyMjJYtWoVo+Q2r9QkEy9evGCMjZ8wYQJmzpyJOXPm8F2mu379Ol6/fg1jY2Pmz9Ll5D8+TLORpv8UTWcoTDOTzZs3IzY2Fr1796ZdA2axWJ1SLq4L4Zg9ezaMjY1hY2ODqqoqaGlp4cSJE1BSUkJKSgrc3Nxw48YNsdlrqbGzevVqSmPn/v372LRpU5vr8p8TvOIx7YUu6OHRo0dUUt2wYcPafIJuaGjA2bNnkZmZiZcvX+KPP/5Afn4+VFRU+Bbs8fb2homJCVRVVQXqMx1da/KdQGpqKvX3vXv34OrqCnt7e0ybNg1ycnKUvkpwcDDfTMNTp05hxYoVWLNmTVfq9ydEe57U6J7OPnbxcEE0dpgoLCxEcHAwsrOzUVVVha+//hpjxoyBg4MD37j+qVOntnnPMk1QhLXJL1KtLdLT03Ht2jW4ubkBAG7dugVra2vY2tpi7NixtG2qqqqwfPly3Lp1CwMGDMDTp09RXV2NhIQEbNy4EbGxsbRLUgBw7NgxgeU0mOhy8p1A05vNyckJ9vb2WLFiBXXs22+/xcKFC1FbWwtfX1/GiAAJCQno6up2OfhPDFdXV9rjLBYLkpKSkJSUZHTytbW1zcoV2tjYYOPGjR1SPFxYjR0eBQUFWLhwIXr27AkjIyPIysri5cuXSEtLQ1paGg4fPsxYfWvUqFGt7tvq6mrcvn0btbW1WLJkiVhsenh4wNbWFoMGDYKHhwffz8NUC+Hs2bNYu3ZtM6fbs2dPNDQ0wNraGqGhoZg4cWKrdtu3b8fTp08RHx+P4cOHU5vJgYGBsLa2xs6dO7F3717avigpKSEzMxO6urp8+9weupx8J8NLjaZj2LBhePz4MWPbGTNm4NixY4wziS46h6ZPajx4UhX79u1DSEgIY1tLS0u8ffsWL1++RI8ePXDgwAEQQjpkY10QjR06/Pz8IC8vj+jo6Ga1fWtqamBlZYWdO3ciNDSUtq23tzft8Q8fPsDe3h7v3r0Ti83MzEyYm5tTf/ODabIUFhYGc3Nz/PHHH9SxESNGICoqCps2bUJQUBCtk09OToabmxvYbHaz+HppaWmsWLGC76AtzuI8XU6+kxk6dCgSEhJoR+yjR49i5MiRjG1lZWURHx+PKVOmQFVVtdXO+6dUpen/EkzLAiNGjMCHDx+wadMmHDp0qNX54uJi/Pbbb3zX3cVZ6WvUqFEIDw9HRUUFLly4QG0G37lzB7t27WLUj+GRk5MDX1/fVsXbe/XqheXLlwv15PHVV1/B0tIS7u7utCGcgtpsWv9A2FoIvH8XOiZPnswYX//+/XvGDeQePXo0q+bWEnEW5+ly8p2Mg4MDXFxc8N///hdGRkZUFuL58+fx4MEDvtWLjh49ir59+4LL5SI/P7/V+a5lnE8PBQUF+Pv7057buHEjHj58CEdHR3z33XcdHhb722+/wcbGBmvXrsXw4cOxcuVKAICtrS169erFV5wMaFyyYEJCQqLZ7FUQKioqUF1d/VFt8kNWVhZ3796lfWIuKChgFAZTUVHBX3/9RbvcevbsWcYneEC8xXm6nHwnM3XqVISEhCAkJAQBAQHUo7mmpiYOHDiAMWPGMLb9nKo0ddG4FHHs2DFG1cKcnBxs3ry5zdBFcTF48GCcPXsWZWVlzZYDQkNDoaioiK+++opvew0NDezbtw96enpU9irQOIPdt28fVdCGDrrNaS6Xi+fPnyMqKorxvhfF5rt37xAaGopr166hsrKSVsKYbrN3xowZ2LVrF6SkpDB58mSqRCcvOGLRokW09lxcXLB06VLMnj0b+vr6YLFYOHfuHEJDQ6nCNUy4u7vD3t6eViHz0aNH8PX1ZVwKa0lXCOUnwrNnz3Dp0iVUVVXB1NQUr169wvDhw9uVlNLFpwVd5AiXy0VZWRnev38PNzc3WFlZtWqnq6sLb29vsUVViEJdXR1ycnIwfvx4xvcUFhZi7ty5kJKSgqGhIfr3749Xr17h4sWLqK6uxsGDBxlnq/xi1jU1NeHt7U0rJSCKTZ7S5ejRozFo0CDaJyW6aLYPHz5g7dq1SEpKapV8NXXqVPj7+zMOiBwOB/7+/rh16xYaGhrAYrGgpKQEFxeXVuv4T58+pf42NDRESEgIFBUVW10zKSkJAQEBuHXrFq3NlnQ5+U8AHx8fxMTEoL6+HhISEjh69CgCAgJQWlqKqKgoxplfF58mv/76K6NUhYGBAaPj9PHxQVFREUJDQz/KUtvTp0/x559/Ijs7u1mGLk87CWh7D6CgoAAhISG4ceMGKioq0KdPH2hpacHBwYHvfhJdzDqLxYK0tHSbG77C2tTR0YGVlRW1LCUoDx48oGz27t0bo0ePbjPBqrq6Gm/fvkXfvn1RXl6OEydOoKqqClOmTGn1tGJnZ4f09PQ2+0EIgYGBQddM/nNh7969CAoKwvr162FgYIApU6bg+PHjqKurg7OzM/T19cVaKKKLT5eQkBAcOHAAX3/9NdTU1FqtP4t7I93Z2RmZmZmYNWsWcnNz0bNnT2hoaCAzMxMPHjxAcHAwjIyMxGavKbt27cK8efNoNXyePHmCyMjIZtEs4kBTUxNhYWHQ0dER63Wrq6tbBT0A9Jr5cXFx6N27N61mfmlpKa5fvw5CCNzc3ODo6NhKp55XW2Ds2LHtfsrvcvKdjJGREebPnw9bW1twuVwoKyvj+PHj1H8DAwORkZHR2d3sQkBqa2tx/PjxVgk7pqamjAqLdEUymsJisWjDM4VFR0cHTk5OWLx4MWJjY3Hx4kVERESAy+Vi2bJlGDhwYCtZjISEBOjp6aFfv35CJ30BgKKiIo4cOUIrv3zmzBn8+uuvuH37tlhtOjs7Y+DAgVRCU3upq6tDTEwMOBwOrQR0QUEBbeDD0qVL8e7dO/j6+qJ///4YN24cZs+eDU9PT3h6euLevXs4evQorc34+Hjo6+uLpUxl18ZrJ/PixQvG1OWBAwfizZs3H7lHXYjKmzdvYGlpiQcPHmDIkCGQlZVFcXExEhMTERMTg0OHDtFGZHzsjfTq6moqcUheXp5SRJSUlMSiRYvg4+PTqo2rqyvi4uLQr18/xqQvHiwWq5nDXbhwIeUMCSEwMzNjbNtUEVIUm00HBVVVVQQGBqK8vByjR4+mjdShGyD8/PwQHR2NkSNHory8HD169ICMjAwePHiADx8+MJbYFFYzH/iftlFBQQHevXuHhoaGVu9hUttsSZeT72R++OEHXL58mXadNicnh3Z3vYtPG39/f5SXlyMuLq7ZTPXWrVuwt7fHjh07sGHDhs7r4P9HTk4Or169AgAMGTIEFRUVePnyJb755hv069evWYk8HqmpqZR2uaBPFZs3b0ZSUhIIIQgKCsL8+fNbFbrmLUc0FdwSxSbdoHDq1CmcOnWq1fGWAwSPCxcuYOnSpXBzc0NYWBju3buHwMBAlJaWYvHixbQOGBBeMx9ozFVwcXFpthnLoy21zZZ0OflOZsmSJfDy8kJ9fT0MDQ3BYrFQUlKCGzduIDw8vM1Y5S4+PVJTU7F69epWSxFqampwcXFBYGDgJ+Hk9fT0EBQUhAEDBkBdXR3fffcdIiMj4eTkhJMnT9KulzdN9OJwONDX16cVx3v58iUSEhIojXqgMYObt+nZ0NDAuCYvTpviWN4qKyujImFGjhyJuLg4AI3yIzY2NoiMjKSdzQurmQ8AW7ZsgYSEBLZt2yZ6zoRAxQK76BDCwsKIhoYGYbPZREFBgSgoKBAVFRUSEBDQ2V3rQgg0NTXJ5cuXac9lZGS0WTv1Y1FWVkZmzZpFLC0tCSGEnDp1iigqKhI2m03YbDY5dOgQ3/ZsNpvcvHmT9lx6ejpRUVFpsw/l5eWktLSUPH/+nDx//pw8e/aMFBYWkri4uA6z2ZT6+npSVVXF9z1jx44l6enphBBCHj58SNhsNtUmOzubaGho0La7c+cOGTt2LFFQUCDjxo0jRUVF1PV0dHTI3bt3GW2qqqqS5ORkgT4LE10z+U8AW1tbmJubIy8vj5IxVVdXF6qEXBedz8iRIxkrCSUmJvKVmP2YyMjI4MSJEygtLQUA/PLLLxgwYADy8/OhpqZGq8tua2uLhw8fAmhcNnBwcKCN8igrK+Nb1aygoADr1q2jrtUSFouFefPmidVmfX099uzZgx9++AEzZszA9evX4ezsjMrKSowfPx47duygDd8cNWoUYmNjoa2tjSFDhqBnz55ISUmBqakpbt68yVivVVlZGcnJya008zdt2sRXMx9o/LeRlJRkPC8IXdE1XXQhZtLT02FrawsDAwOYmJhQCTuJiYlIT0+Hv78/bSWhz4H8/HwcO3YMQKMcrqGhYStnJSEhgT59+sDMzIxxT8na2hoPHjyAtbU10tLS0L17dxgYGCAjIwMZGRmIjo6m4sjFZXPHjh3Yv38/fvvtN5ibm2PGjBmoq6uDubk5IiMjMXHiRPz555+t2t2/fx/m5uZQUlJCTEwMtRGroKCAv//+GwsXLhR7uOfevXuRlpaGiIgIvlIO7aHLyXfRRQdw/Phx7Nixg9rYBID+/ftj1apVnVqIo+l6dVuwWCyhU+/bYvTo0XB3d8fcuXNx5MgRJCQkIDY2FkBjqCOLxUJgYKBYbRoZGWHRokWwtrZGYWEhTExM4O3tDVNTU5w+fRrbt2/HlStXWrXz8fGBoaEh3r9/Dz09PRBCsGfPHuTm5kJNTQ02NjZiz0z39PTEuXPn0NDQgJEjR9LmTPD7t2lK13JNF110ALyanPfu3QOXywWLxcKgQYPAYrFQWlrarg3HjqCt2rOCwK+gTVuyCHV1ddTSytChQ3H//n3q3OzZs+Hl5SV2my9evIC6ujoA4NKlS5CQkKA2VL/77jtUVVXRtouLi8OECRMouQkWiwU7OzvGfoiDoqKiZtm0/6+9e4+rKd3/AP7Z2yXdJkIdmdwJmxglt4kiQk5yG+ZQkwZJoXEv4xZy8upENxLRDcc1dHE7U2MX0m1j0uSgEJKUUkK39fujX/uUvVbttO0afd9/sZ71POvZ5jXfvfaznvX9Nua/GwV5QmQsKysLa9euxZ07dzjPkWXK4IaorxA48//b86SRnZ2NrVu3flZaBC0tLTx79gz6+vro0aMHiouL8fz5c3Tt2hUKCgooLCyU+TU1NDTE14yOjsaAAQPEyz4ikUhiO2c1gUAgswIe0pJlwXYK8oTI2NatW5GZmYmlS5dyJsJqLo4fP47ExER4eHgAqHo3Y+PGjbCzs2MtNl7Trl27kJSUhFmzZnGmReBiYmICd3d3KCsrY+LEiejVqxc8PT1ha2uLwMBAzuWYxlxz2rRp2LVrF8LDw5GcnIzNmzcDqNquePz4cc6cNrIs4NEUaE2eEBn77rvvsGXLFlhYWDT1VOoUGhqKnTt3Ys6cOeIglZWVhf379+P8+fNwdXUVv6HJ5nPSIlR7//491q5di48fP+LgwYOIjY2Fg4MDSktL0apVK3h4eGDSpEkyvSbDMPD390diYiJGjBghLrk5f/58GBgYYPny5axfyPJONwFUfbHU94sqNTVVqrHoTp4QGVNSUhK/odmchYSEwMHBAfb29uJj2tracHV1hZaWFg4dOlRnkP+ctAjVFBUV4ePjI66OZGhoiIiICKSmpkIgEEgk5pLFNXk8HmxtbWFra1vr+NGjRzn7AE1Tt2Hp0qWsNXBTUlLw9OnTBr0kSUGeEBkzNzdHSEgIRo4cKbO9zl/Cy5cvOfOf6Onp1VmVDPi8tAjV2HbJaGtrQ1tbGxkZGbCzs2NNpduYawJV6QQSEhI488FwJTeTt+XLl3O2rVu3DqmpqZg1a5ZUY1GQJ0QGNm3aJP5zWVkZhEIhTE1NMWTIEIl6pM1lDVdLSwu3bt3CqFGjJNqSk5Pr3QHU0LQINfOwnDt3DiYmJqxfgkKhkLPo9uekYqgWFxeHFStWoKSkhLWdK3dNczNjxgw4Ojpy7kD6FK3JEyID9a3b1vQl1nA/R2BgINzd3bFw4UKYmJhAXV0db968EZemW7lyJRYtWsTZPz8/H4sWLYKqqiqCgoJw4cIFbNiwQbzLZfPmzfjxxx/F58uiKEZDr1mThYUFWrVqBScnJ2hqarKuv3MVYW9OTpw4gd27d9dZ8L0mCvKEtGDVVclqFsBu1aoVLC0tsW7dOqm2U9bc95+cnAyRSMSaFkGWRTFqXjMpKanOVAzVBg8ejH379jWL8or18fPzkzhWXQM3PDwcxsbG2LNnj1RjUZAnpIUrKirC7du3xXmTdHV1pS5WkZOTg5SUFEyZMgUA8OTJE0RFRWHOnDkSWw1rCgsLg5GRUaPyM2VmZuLt27dQV1eX6g1YU1NTODo6iufanHGVFVRRUYGRkRGcnJykLgtKQZ6QFurx48ecCb0+fPgAT0/POqsopaWlYeHChVBTU8OVK1cAVN1V29nZoV27dggKCkKvXr04+2dlZaG0tBS9e/dGUVERPD098fLlS0yePBnTpk3j7BcaGgo/P79aD1m1tLSwatUqmJmZcfY7ffo0AgMD4e/vDy0tLc7zvjYU5AlpoQwNDVkDcWxsLLZu3Yrs7GykpaVx9re2tkZlZSX27dtXKxPju3fvsGzZMigqKrIuOwBVSdzs7e1haWmJ9evX45dffsGVK1fQr18/pKenY/v27aw5foKDg+Hq6opJkybB1NQU6urqyMvLw6VLl/Dbb7/Bw8OD80590aJFuHPnDoqLi9G5c2fWxF+XL1/m/LxNobCwELdv30ZxcTHU1dUxePBgzqyXXCjIE9JCzZ8/H48fP0ZgYCD69u2L/Px8uLq6IjIyEjo6Oti2bZs41wsbPT09eHl5sb7uLxQKsWbNGiQkJLD2nTdvHtq3bw93d3dUVlZi9OjRWLx4MVauXIk9e/YgOjqatZ6riYkJjI2NsXHjRok2FxcXJCYmctaBdXJy4vws1erKjSNv+/fvh5+fHz5+/Cg+1rZtWyxZsoSz5CAb2kJJSAt1+PBhODg4wMrKCgsXLkRAQADKy8uxfv16WFlZ1ZuOoW3btpz70t++fVvnQ9v09HTs378fKioqiIiIQEVFBUxNTQEAY8aMwZEjR1j7vX79GuPGjWNtmzBhAs6ePct5zeYUwOtz8uRJeHl5Yd68efj73/+OTp064dWrV4iIiMC+ffugqakpzrdfHwryhLRQCgoK2L9/P1avXo09e/ZAX18f7u7uUmfINDQ0hKenJwQCAXr37i0+npmZCW9vb9aiKTWvXb2jJy4uDh07dhQ/bHz9+jVr8Q4AGD58OC5dusQ69o0bN2oVAOdy7do1JCQkoKioCB06dIC+vn6z23ETFBQES0tLODs7i49169YN+vr6aNu2LUJCQijIE0IkpaSkSByztLTEs2fPkJ6ejrt379batcH1RixQVSS7+k6ze/fu6NixI/Lz8/HkyRN06dIF69at4+w7bNgwBAQEoLCwEJcvXxYnQ0tNTYWPjw/09PRY+82cORNbt25Fbm4uzMzMoKGhgYKCAvz++++IiIjAypUray3X1Hy56ePHj7Czs8ONGzfQpk0b8Xq+v78/DAwM4O/vLy683dSysrJgZGTE2mZkZIQTJ05IPRatyRPSgvTv31+8jFL9vz6Px0PNMFD9dx6PV29K5JKSEpw9exYpKSkoKCiAiooK9PT0MGvWrDofEGZlZWHJkiXIzMxEnz59cOTIEXTu3BljxoyBsrIyAgICWLdFcm0tZPPp/N3c3HDixAns3LkTkydPFn/Oixcvil+iWr16tdTjf0mmpqZYsGABLC0tJdqCgoIQEBAAoVAo1VgU5AlpQbgehHKp6+WixmIYBnl5ebX209+9excDBgxAmzZtxMcSExMhEAigpKSE58+fN+gaNd9gHTduHBYuXAhra2uJ8wIDAxEcHNwkycjYeHp6IiQkBLt27cLEiRPFx69cuYKNGzdi5syZUj1IBmi5hpAWpWbQdnNzw9SpUzF48ODPGotre2RNdVVQ4vF4Ei9M6erq1vp7RUUFrKyscPr0aQgEgkalHXj79i369evH2tavX79apRqb2tKlS5GUlITly5ejbdu26NixI/Ly8lBaWorhw4fD0dFR6rEoyBPSQlWXtftce/fu5WxTUVGBhoaGTMrk1VxsqJkIjsv27dtZj/fs2ROxsbGs5QGvXbuGb7/99vMnKWMKCgoICQnBtWvXkJiYiMLCQnzzzTcwMDDA2LFjpa7eBVCQJ6TFamxZu5p1WauVlJQgKSkJW7dulSogNxRbdsqSkhIUFBSgffv2df4qsbKygpOTE8rKymBmZoZOnTrh9evXiIyMxLFjx1j33jelnJwclJSUiHPHV6eMGDRokNQpDQAK8oS0WF+irJ2SkhLGjh0Le3t77N69G2FhYbKcMueaeUZGBuzt7eusxmVhYYGnT5/i0KFDtQqFtGnTBra2tpg/f75M59oYNVNGVL/Bm5ubi8OHD+Po0aMIDg6uM2VETfTglZAW6kuWtbt58yZsbW1x9+7dz+pfraKiAgKBAGfOnIFAIKjz3KioKHh7e+PixYt1nledKuDt27f45ptvMHToUKipqTVqnrLWmJQRn6I7eUJaqC+1kyQnJweHDh2Se252VVVVqXbfqKmpcb4121z88ccf8PLyktiGqqysjJ9//pnK/xFCpPe5SbDYik1XVlaCYRgwDIPdu3fLfK45OTkSxyorK5GdnQ1PT89ab94CwKBBg3Ds2DHo6urKtDj2l9aYlBGfoiBPSAvWmCRYbMWmgf/lPOdKY9wY48aNY70mwzBQVFSEt7e3xByr0zRwzbc5akzKiE/RmjwhLdTJkyexZcsW1iRYJ0+exLZt26TOj/KlfLomf/bsWYlAzePxoKKigpEjRzY4DW9NNatNNbXc3FzMmzcP2dnZrCkjjh49KvVcKcgT0kKZmZlhzJgxtZJgVXN1dUV8fDwuXLhQ6zhXGl8usiiMHRYWhvHjx9d6OJqVlSVOe5Cfn4/MzEzOfDfVBgwYgBMnTki8cAVUFTtZvHgxRCJRo+crK5+bMuJTFOQJaaF0dXXh5+fH+nLQjRs3YGdnhzt37tQ6/mnumE/z4NQ8BqBW7hgbGxup58bj8RAQECBxPD8/H0uXLkVBQYG4GtW1a9dga2uLkSNHwtvbG6qqquLzDx8+jJKSEgCAj48P5syZw3oHLBKJkJqailu3bkk9x+agsrIS1tbWcHFx4VweozV5QlqoLl264NGjR6xB/sGDB6zbCmtuqfzzzz+xdu1aLFu2DFOmTIGGhgbevHmD6OhoeHt7S+RvLysra/Sc3dzc8Pr1a+zcuVN8bOzYsQgNDcWGDRvg4eGBLVu2iNvKy8uxf/9+AFVfHGz55vl8Pr755husWrWq0fOTN4ZhkJCQgHfv3tV5EiGkBdq7dy+jp6fHXLlypdbxy5cvM/r6+oyrq2ud/WfMmMH4+/uzth05coQxMzOT2VyrjRo1irl48SJrW0REBPP9999z9tXR0WHu3Lkj8zk1pfLyckZHR4dJTU3lPIfu5AlpobiSYJWVlUFfX7/eJFiPHj3CwIEDWdt69+6NZ8+e1TuHN2/eoKysTLzcwzAMSkpKkJyczPrQKTddJAAAD2pJREFU9+PHj5w535WVlVFUVMR5LbY0DC0BBXlCWqitW7diwYIFsLa2hkgkanASrB49eiA8PJw1982pU6c4Mz4CwP3797FmzRo8fPiQtZ3H47EG+SFDhiA4OBiGhoZo3fp/4auiogKhoaH1ZtS8dOkSEhMTa32xVFZW4v379xCJRIiJiamz/18RBXlCWqjMzExcuHABfD4f+vr6MDIygrGxMbp16yZVf3t7e6xcuRKPHz/GhAkTxJWWLl26hP/+9784ePAgZ9/du3ejoKAA69evR0xMDNq2bQtjY2MIhUIIhUIEBwez9luxYgUsLS0xceJEjB07Vry1MDY2Frm5uQgKCuK8pq+vr/jBbHl5Odq0aYPWrVsjPz8ffD6/ybeLfim0u4aQFqyoqAhxcXGIjY1FXFwccnNz0aNHD3HAr69oSHR0NHx9fZGWlgaGYcDn8/Hdd9/hl19+gb6+Pmc/PT09ODk5Yfbs2Thx4gTCw8MRGhoKoCqQ83g8eHp6svZNS0uDn5+fxNbCZcuW1ZnfxsTEBPr6+ti1axc8PT2RnZ0NNzc3pKamYsmSJVi2bBkWLFggxb9a8yFVbh+5PB0ghPwlxMfHM/PmzWN0dHSY/v37S9XnxYsXzLFjx5gDBw4wOTk5zL1795iPHz/W2WfQoEFMYmKi+Jp6enritpiYGGbs2LFSz/njx4/1Xo9hGEYgEDBxcXEMwzDMlStXmIkTJ4rbgoKCGHNzc6mv2VzQg1dCSJ3y8/ORlJSEhIQEJCYm4sGDB+K78REjRtTb383NDSEhISgvLwefz8eYMWPg4eGBnJwcBAUFceY919LSwrNnz6Cvr48ePXqguLgYz58/R9euXaGgoIDCwkLWfpWVlfDw8IBIJBKnC05OToa9vT1sbGzqTMWgpKQEPp8PAOjWrRuePXuGDx8+oF27dhgwYIBUD4r/ivhNPQFCSNOYNm0axowZg3Xr1iEtLQ3jxo3DwYMHkZiYiOPHj9e7u8bf3x8hISFYt24drl69isrKSgCAg4MDCgsLsWfPHs6+JiYmcHd3x9WrV6GpqYlevXrB09MTjx49QmBgIGsRb6BqXT04OLjW3v5+/frh559/xqFDhxAYGMh5zcGDB+P8+fMAqqpEtWrVCvHx8QCqnk+0bdu2zs/bHPF4PGhpadU9dzn+siCENCOjR49mdHR0GDMzM8bV1ZX5z3/+wxQWFkrdf/z48Yyfnx/DMJLLBqdPn2YMDQ05+5aUlDD29vbMokWLGIZhGKFQyOjq6jL9+/dnBAIBc/nyZdZ+xsbGTEhICGvbkSNHmEmTJnFeMz4+nhEIBMzSpUsZhmEYZ2dnxsDAgFm5ciUzdOhQZs2aNfV/aDlLSUlhvL29mU2bNjHPnz9nhEIh8/r16waNQcs1hLRQ169fx4MHDxAfH4/4+HiEhYWhuLgYOjo6MDAwgIGBASZMmMDZ/9WrV5xbFrt27YqCggLOvoqKivDx8UFpaSmAqqyLERERSE1NhUAg4Nzhk5+fz1kRSUdHB9nZ2ZzXHDFiBE6cOIEHDx4AADZv3gw+n4+UlBRMnjwZGzZs4Owrb6WlpVizZg2uXr2K1q1bo7y8HHPnzkVAQAAePnyIY8eOSb0LipZrCGnB+vbtC0tLS/j6+uLWrVs4duwYunbtiqCgoHpTDXfr1g2xsbGsbUlJSZxLLgDg5OSErKysWssM2tramDJlCsrLy2FnZ8far2fPnrh69SprW3R0dL2BTyAQiEsEKigoYPv27YiMjMSuXbuaVXWovXv34vr16/D19UVSUpJ4T/+OHTugqqpa51LYp+hOnpAWLi0tDTdv3sTNmzeRnJyM0tJSDBs2DEZGRnX2++mnn7BlyxaUl5dj/Pjx4PF4yMrKQnJyMgICAiSqF7148UL853PnzsHExAStWrWSGFcoFLIW7K6+5oYNG1BYWAgTExOoq6sjPz8fMTExiIyMxI4dO2qd3xRZM2UhPDwcq1atwvjx41FRUSE+/u2332L58uW1cvfUh4I8IS3UihUrcOvWLbx9+xZqamowNDTE9u3bYWhoKNVd7Q8//IA3b97Az88PoaGhYBgGjo6OaNOmDWxsbCQKY7u4uODatWviv3P9UmAYBsbGxqxtFhYWePfuHfbt24eoqCjweDwwDIP27dvD2dkZM2fOrHX+2rVr6/0c1Xg8XrMJ8oWFhejevTtrW/v27VFcXCz1WBTkCWmhsrKy8OOPP2LcuHEYOnToZ1VNsrW1xfz58yESiVBQUABVVVUMGTIEHTp0kDh327ZtuHXrFhiGwfr16+Hg4CCxvNKqVSuoqqpi5MiRnNecP38+9PX1kZSUhKKiIqioqMDAwIA1jcLnFiJvan369EFkZCRrBSihUChR5rAuFOQJaaHCwsJkMo6KigoMDQ3rPU9TUxPm5uYAqva7GxkZsX4Z1KWyshKbN2/GmTNnAPwvjz2Px4OFhQVcXV1rfVlxFRMvLy/Hmzdv0KFDh1o5cJoLOzs7LF++HIWFhTA2NgaPx0NKSgouXLiAo0ePNqh+LqU1IITIRUpKCvr37w8lJSWkpKTUe/6wYcMkjvn5+cHHxweOjo7ikoW5ubkIDw+Hl5cXVqxYgcWLF3OOmZqaij179iAhIQEVFRU4deoUQkJCoK2tDXt7+0Z9PlkLDw/Hv/71L7x8+VJ8TF1dHY6Ojvjhhx+kHoeCPCFELvr374+TJ09CV1cX/fv351weYhgGPB6vVlWpaiYmJrCwsGBdz/fx8UF4eDguX77MOm5KSgqsra3Rt29fGBkZYd++fTh9+jSuXr2KAwcOYNOmTfjHP/7RuA/5BWRkZIiXwnr37i1+a1daze93CiHkqxQcHCxeS+bKMlmf3Nxczlquw4YNg7+/P2dfd3d3jB49Gn5+figvL4evry8AwNHRER8+fMDx48ebTZC3tLTE9OnTMXnyZM73AqRFQZ4QIhc1M1rGxMRg6tSp9eZ//5S2tjZEIhFGjRol0SYSidC5c2fOvvfu3YOXlxcASPyKMDY2xr///e8GzeVL4vP52LJlC7Zv3w4jIyNYWFhI5NCXFgV5QojcnTx5knXnSH1mz54NDw8PKCkpYerUqejUqRNev36NyMhIHDhwALa2tpx9lZWVkZeXx9qWk5MDZWXlBs/nSwkKCkJeXh6ioqIQFRWFZcuWQU1NDVOnToW5uTmGDh0q9Vi0Jk8IkTsrKysMGjQI69ata1C/iooKODs74/z587XuxhmGgbm5Of75z39yrln/+uuvEAqF8PPzg46ODgQCAc6ePYvOnTvD2toaQ4YMgaura6M+15eSnZ2NqKgoXLp0Cffu3YO2tjbns4dPUZAnhMhddYriLl26oE+fPujUqVOtdh6PBxcXF87+Dx8+RGJiYq2ShX369KnzmgUFBfjpp5/w4MEDaGpqIjs7G3369MHz58+hoaGB48ePQ11dXSafT9YeP36MS5cuITo6Gn/88Qd69eqFyMhIqfpSkCeEyN348ePrbOfxeDJ/kcnNzQ0TJkxARkYG4uPjxVWlDAwMMHPmTCgpKcn0eo314sUL8XLNn3/+CXV1dZiZmWH69Ol1VsD6FAV5QkiLoKenBy8vL9bC483NvHnzcOfOHSgoKGDChAkwNzfH999/z5rrpz704JUQ0uw8efKEM3fL5xIIBLh+/fpfIsgrKChg586dMDU1bfQDYbqTJ4TI3du3b7F3714kJiaKc8oDVWkL3r9/j7y8PNaXoRqjsc8B/qroTp4QIne7du1CeHg4DA0NkZGRAUVFRfTo0QPJycnIz8//IsH28uXL0NDQQEVFBe7fv4/79+/Xav+cBG2yZGNjg19//RW9evWCjY1NnefyeDwEBARINS4FeUKI3AmFQixfvhy2trY4fPgwEhISsHfvXrx79w4LFizAw4cPZX7N6OhomY8pS2VlZeKEa2VlZTIbl5ZrCCFyN2jQIBw+fBgGBgYQCoVwdnZGXFwcAODChQvw9fWVeh84qRuV/yOEyF3Nwhfdu3dHXl6euCZsly5dkJOT05TTa3JWVlZ49OgRa1t6ejqmT58u9Vi0XEMIkbtRo0bhwIEDGDBgALp16wY1NTWcO3cO1tbW+P333xucZ/5rULOWa0JCAhITE5Gfny9xXkxMDJ48eSL1uLRcQwiRu6ysLCxYsADa2toIDQ3FkSNH4ObmJq7Z6uDgUG8h8a+Nk5MTwsLC6nwAXB2uZ8+eLVHPlgsFeUJIk/jw4QMyMjIwcOBAAEBERASSk5MxZMgQWFhYNPHs5K+4uBj3798HwzBYsGABXFxcJMr8VZdHbEj5PwryhBC5Ky0txbFjxyASiVBUVCTR3pAtgl+jhIQECAQCmWTGpDV5Qojcubi44PTp0+jbty/at2/f1NNpdgwMDPDq1SvExcXV2lpZ/bJYUlIS3N3dpRqLgjwhRO6uXr2KpUuXwtHRsamn0ixduXIFq1evRllZmXiNvrosIoAGVYuiLZSEELnj8XgYPnx4U0+j2fLz88PAgQNx9uxZzJw5E9OnT0dkZCTWrl2L1q1bw9nZWeqxKMgTQuRuxowZOHPmDCorK5t6Ks3So0ePsHjxYgwcOBAjRoxAeno6evfuDRsbG1haWsLPz0/qsWi5hhAidytXrsSMGTNgamqKQYMGoV27drXaeTxes63SJA98Ph9qamoAql4Wy8jIQGVlJfh8PgwNDREWFib1WBTkCSFy5+7ujszMTKiqquLevXsS7U2dLKyp9ezZEyKRCMOHD0evXr1QWlqK9PR0DBw4EO/evauVubM+FOQJIXJ3/vx5LF68GKtWrWrxAZ3N3Llz4eLigpKSEjg6OmLkyJHYuHEj5syZg5CQkAZVhqI1eUKI3PH5fIwZM4YCPIe5c+di/fr1eP/+PYCqLafv37+Hi4sLSktLsXHjRqnHopehCCFyt2PHDhQUFEi917ulKi4uxvv371FZWQmGYcAwDPj8qntzTU1Nqcag5RpCiNx17NgRYWFhmDhxIgYPHizxZufXWqVJWk+fPoWzszOSk5M5z5G2chYFeUKI3J06dQpqamqoqKjA7du3Jdpb+jKOi4sLHj58CAcHB/ztb38T371/DlquIYSQZmbo0KHYsWMHpk2b1uix6MErIYQ0M8rKyuJ98o1FQZ4QQpoZc3NzHD16FLJYaKE1eUIIaWZUVFSQnJwMU1NT6OrqQlFRsVZ7Qx5M05o8IYQ0M+PHj6+zncfj4bfffpNqLAryhBDyFaM1eUII+YpRkCeEkK8YBXlCCPmKUZAnhJCv2P8Bz2rJ63QsIG8AAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Plot the feature importance on a barplot\n",
    "plt.figure(figsize=(10,6))\n",
    "feat_df = pd.DataFrame(feature_dict, index=[0])\n",
    "feat_df.T.plot(kind='bar', title='Feature Importance', legend=False);"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Conclusions\n",
    "\n",
    "* We achieved the initial goal of 90% Accuracy with the CatBoost Classifier tuned with RandomizedSearchCV\n",
    "\n",
    "\n",
    "* From the classification report we got extremely good results in terms of Recall and F1 (both over 90%); good the Precision too with a score of almost 90%; slightly negative note comes from the Accuracy which decrased when calculated on 5 different CV folds.\n",
    "\n",
    "\n",
    "* From the Feature Importance analysis we can infer that most influencing features to predict whether a person might belong to the `>50K` or `<50K` classes are: `capital_gain`, `relationship`, `age` and `education_num`. \n",
    "\n"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}