Data_Gathering.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Table of contents\n",
    "* [Introduction: Business Trends of Sports Market in Istanbul and Predicting the Next Trend](#introduction)\n",
    "* [Collecting the Data](#data)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Trends of Sports Market in Istanbul and Predicting the Next Trend <a name=\"introduction\"></a>\n",
    "\n",
    "Individual sports become more and more popular all over the globe due to raise of the self awareness and well-being philosophy is spreading among people.\n",
    "\n",
    "#### The Problem\n",
    "As a result, many disciplines of sports become more and more popular. However, **not all of them become more popular and almost none of them can keep itself as the most preferred one.**\n",
    "\n",
    "In this report, you will find an analysis of sports market in Istanbul, more specifically, Kadikoy and Besiktas Towns and an prediction for an upcoming trend if possible.\n",
    "\n",
    "#### The Interest\n",
    "\n",
    "The results of this report may give a deeper insight to the investors planning to found a business targeting the sports market around the Istanbul and in other regions."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "***"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h1>1- Collecting the Data</h1> <a name=\"data\"></a>\n",
    "\n",
    "- **Kadikoy** and **Besiktas** are one of the towns in Istanbul and Turkey that is one of the highest cultural and financial levels in Turkey. This makes them a great candidate to inpect the trends as these regions are generally flag carriers for such trends. The neighborhoods of these towns will be used. The data of this collected from https://postakodu.ptt.gov.tr/ \n",
    "\n",
    "- We will also need the longitude and latitude values for these neighborhoods, This will be obtained using Google Maps API geocoding\n",
    "- We will also need the venue information and its details. This will be obtained using Foursquare Places API\n",
    "\n",
    "- The data that is obtained and processed will be saved to csv files due to limited API use."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {},
   "outputs": [],
   "source": [
    "#importing essential libraries\n",
    "\n",
    "import requests\n",
    "import pandas as pd\n",
    "import json\n",
    "import numpy as np # library to handle data in a vectorized manner\n",
    "\n",
    "pd.set_option('display.max_columns', None)\n",
    "pd.set_option('display.max_rows', None)\n",
    "\n",
    "from pandas import json_normalize # tranform JSON file into a pandas dataframe\n",
    "\n",
    "# Matplotlib and associated plotting modules\n",
    "import matplotlib.cm as cm\n",
    "import matplotlib.colors as colors\n",
    "\n",
    "# import k-means from clustering stage\n",
    "from sklearn.cluster import KMeans"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## The neighborhood data\n",
    "\n",
    "The regional data is taken from Turkish Postal Office. [Google Geocoding API](https://developers.google.com/maps/documentation/geocoding/start?hl=tr&utm_source=google&utm_medium=cpc&utm_campaign=FY18-Q2-global-demandgen-paidsearchonnetworkhouseads-cs-maps_contactsal_saf&utm_content=text-ad-none-none-DEV_c-CRE_379539525578-ADGP_Hybrid+%7C+AW+SEM+%7C+SKWS+~+Places+%7C+EXA+%7C+Geocoding+API-KWID_43700047426639958-aud-599078372864:kwd-724659181873-userloc_1012782&utm_term=KW_geocoding%20api-ST_geocoding+API&gclid=Cj0KCQjwpNr4BRDYARIsAADIx9yNpFvxe1C-hcil81jviNGd5c8lE-jqKjrnpIiYYvG7ddGcJWxa7vYaApVYEALw_wcB) is used to get the coordinates for each borough."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {},
   "outputs": [],
   "source": [
    "#this location data is taken from Turkish Postal Office\n",
    "\n",
    "df= pd.read_csv('bjk_kdky.csv',delimiter=\";\",encoding=\"utf-8-sig\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## The data itself is missing lat, lon values\n",
    "\n",
    "Geocoding API is needed to define the coordinates"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>City</th>\n",
       "      <th>Town</th>\n",
       "      <th>Neighborhood</th>\n",
       "      <th>Borough</th>\n",
       "      <th>Post Code</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>ABBASAĞA</td>\n",
       "      <td>ABBASAĞA MAH                                  ...</td>\n",
       "      <td>34022</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>ABBASAĞA</td>\n",
       "      <td>CİHANNÜMA MAH                                 ...</td>\n",
       "      <td>34022</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>ABBASAĞA</td>\n",
       "      <td>SİNANPAŞA MAH                                 ...</td>\n",
       "      <td>34022</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>AKATLAR</td>\n",
       "      <td>AKAT MAH                                      ...</td>\n",
       "      <td>34335</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>ARNAVUTKÖY</td>\n",
       "      <td>ARNAVUTKÖY MAH                                ...</td>\n",
       "      <td>34345</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                             City                            Town  \\\n",
       "0  İSTANBUL                        BEŞİKTAŞ                         \n",
       "1  İSTANBUL                        BEŞİKTAŞ                         \n",
       "2  İSTANBUL                        BEŞİKTAŞ                         \n",
       "3  İSTANBUL                        BEŞİKTAŞ                         \n",
       "4  İSTANBUL                        BEŞİKTAŞ                         \n",
       "\n",
       "                     Neighborhood  \\\n",
       "0  ABBASAĞA                         \n",
       "1  ABBASAĞA                         \n",
       "2  ABBASAĞA                         \n",
       "3  AKATLAR                          \n",
       "4  ARNAVUTKÖY                       \n",
       "\n",
       "                                             Borough  Post Code  \n",
       "0  ABBASAĞA MAH                                  ...      34022  \n",
       "1  CİHANNÜMA MAH                                 ...      34022  \n",
       "2  SİNANPAŞA MAH                                 ...      34022  \n",
       "3  AKAT MAH                                      ...      34335  \n",
       "4  ARNAVUTKÖY MAH                                ...      34345  "
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Google Geocode API is used to retrieve the latitude and longtitude"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 57,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>City</th>\n",
       "      <th>Town</th>\n",
       "      <th>Neighborhood</th>\n",
       "      <th>Borough</th>\n",
       "      <th>Post Code</th>\n",
       "      <th>lat</th>\n",
       "      <th>lng</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>ABBASAĞA</td>\n",
       "      <td>ABBASAĞA MAH                                  ...</td>\n",
       "      <td>34022</td>\n",
       "      <td>41.048010</td>\n",
       "      <td>29.004528</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>ABBASAĞA</td>\n",
       "      <td>CİHANNÜMA MAH                                 ...</td>\n",
       "      <td>34022</td>\n",
       "      <td>41.047211</td>\n",
       "      <td>29.007439</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>ABBASAĞA</td>\n",
       "      <td>SİNANPAŞA MAH                                 ...</td>\n",
       "      <td>34022</td>\n",
       "      <td>41.041866</td>\n",
       "      <td>29.005112</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>AKATLAR</td>\n",
       "      <td>AKAT MAH                                      ...</td>\n",
       "      <td>34335</td>\n",
       "      <td>41.085614</td>\n",
       "      <td>29.025626</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>ARNAVUTKÖY</td>\n",
       "      <td>ARNAVUTKÖY MAH                                ...</td>\n",
       "      <td>34345</td>\n",
       "      <td>41.068488</td>\n",
       "      <td>29.041629</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>ARNAVUTKÖY</td>\n",
       "      <td>KURUÇEŞME MAH                                 ...</td>\n",
       "      <td>34345</td>\n",
       "      <td>41.061630</td>\n",
       "      <td>29.032900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>BEBEK</td>\n",
       "      <td>BEBEK MAH                                     ...</td>\n",
       "      <td>34342</td>\n",
       "      <td>41.077744</td>\n",
       "      <td>29.041629</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>ETİLER</td>\n",
       "      <td>ETİLER MAH                                    ...</td>\n",
       "      <td>34337</td>\n",
       "      <td>41.087042</td>\n",
       "      <td>29.037264</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>GAYRETTEPE</td>\n",
       "      <td>BALMUMCU MAH                                  ...</td>\n",
       "      <td>34349</td>\n",
       "      <td>41.059105</td>\n",
       "      <td>29.014714</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>GAYRETTEPE</td>\n",
       "      <td>DİKİLİTAŞ MAH                                 ...</td>\n",
       "      <td>34349</td>\n",
       "      <td>41.055735</td>\n",
       "      <td>29.003801</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>GAYRETTEPE</td>\n",
       "      <td>GAYRETTEPE MAH                                ...</td>\n",
       "      <td>34349</td>\n",
       "      <td>41.064196</td>\n",
       "      <td>29.006711</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>GAYRETTEPE</td>\n",
       "      <td>YILDIZ MAH                                    ...</td>\n",
       "      <td>34349</td>\n",
       "      <td>41.047150</td>\n",
       "      <td>29.013986</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>LEVAZIM</td>\n",
       "      <td>KÜLTÜR MAH                                    ...</td>\n",
       "      <td>34340</td>\n",
       "      <td>41.073202</td>\n",
       "      <td>29.032900</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>LEVAZIM</td>\n",
       "      <td>LEVAZIM MAH                                   ...</td>\n",
       "      <td>34340</td>\n",
       "      <td>41.063314</td>\n",
       "      <td>29.018351</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>İSTANBUL</td>\n",
       "      <td>BEŞİKTAŞ</td>\n",
       "      <td>LEVAZIM</td>\n",
       "      <td>NİSBETİYE MAH                                 ...</td>\n",
       "      <td>34340</td>\n",
       "      <td>41.071772</td>\n",
       "      <td>29.021261</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                              City                            Town  \\\n",
       "0   İSTANBUL                        BEŞİKTAŞ                         \n",
       "1   İSTANBUL                        BEŞİKTAŞ                         \n",
       "2   İSTANBUL                        BEŞİKTAŞ                         \n",
       "3   İSTANBUL                        BEŞİKTAŞ                         \n",
       "4   İSTANBUL                        BEŞİKTAŞ                         \n",
       "5   İSTANBUL                        BEŞİKTAŞ                         \n",
       "6   İSTANBUL                        BEŞİKTAŞ                         \n",
       "7   İSTANBUL                        BEŞİKTAŞ                         \n",
       "8   İSTANBUL                        BEŞİKTAŞ                         \n",
       "9   İSTANBUL                        BEŞİKTAŞ                         \n",
       "10  İSTANBUL                        BEŞİKTAŞ                         \n",
       "11  İSTANBUL                        BEŞİKTAŞ                         \n",
       "12  İSTANBUL                        BEŞİKTAŞ                         \n",
       "13  İSTANBUL                        BEŞİKTAŞ                         \n",
       "14  İSTANBUL                        BEŞİKTAŞ                         \n",
       "\n",
       "                      Neighborhood  \\\n",
       "0   ABBASAĞA                         \n",
       "1   ABBASAĞA                         \n",
       "2   ABBASAĞA                         \n",
       "3   AKATLAR                          \n",
       "4   ARNAVUTKÖY                       \n",
       "5   ARNAVUTKÖY                       \n",
       "6   BEBEK                            \n",
       "7   ETİLER                           \n",
       "8   GAYRETTEPE                       \n",
       "9   GAYRETTEPE                       \n",
       "10  GAYRETTEPE                       \n",
       "11  GAYRETTEPE                       \n",
       "12  LEVAZIM                          \n",
       "13  LEVAZIM                          \n",
       "14  LEVAZIM                          \n",
       "\n",
       "                                              Borough  Post Code        lat  \\\n",
       "0   ABBASAĞA MAH                                  ...      34022  41.048010   \n",
       "1   CİHANNÜMA MAH                                 ...      34022  41.047211   \n",
       "2   SİNANPAŞA MAH                                 ...      34022  41.041866   \n",
       "3   AKAT MAH                                      ...      34335  41.085614   \n",
       "4   ARNAVUTKÖY MAH                                ...      34345  41.068488   \n",
       "5   KURUÇEŞME MAH                                 ...      34345  41.061630   \n",
       "6   BEBEK MAH                                     ...      34342  41.077744   \n",
       "7   ETİLER MAH                                    ...      34337  41.087042   \n",
       "8   BALMUMCU MAH                                  ...      34349  41.059105   \n",
       "9   DİKİLİTAŞ MAH                                 ...      34349  41.055735   \n",
       "10  GAYRETTEPE MAH                                ...      34349  41.064196   \n",
       "11  YILDIZ MAH                                    ...      34349  41.047150   \n",
       "12  KÜLTÜR MAH                                    ...      34340  41.073202   \n",
       "13  LEVAZIM MAH                                   ...      34340  41.063314   \n",
       "14  NİSBETİYE MAH                                 ...      34340  41.071772   \n",
       "\n",
       "          lng  \n",
       "0   29.004528  \n",
       "1   29.007439  \n",
       "2   29.005112  \n",
       "3   29.025626  \n",
       "4   29.041629  \n",
       "5   29.032900  \n",
       "6   29.041629  \n",
       "7   29.037264  \n",
       "8   29.014714  \n",
       "9   29.003801  \n",
       "10  29.006711  \n",
       "11  29.013986  \n",
       "12  29.032900  \n",
       "13  29.018351  \n",
       "14  29.021261  "
      ]
     },
     "execution_count": 57,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "lat_l,long_l=[],[]\n",
    "for borough in df['Borough']:\n",
    "    #api key will be removed\n",
    "    url='https://maps.googleapis.com/maps/api/geocode/json?address={}, {} , Istanbul, Turkey&key=[removed]'.format(borough,df.loc[df['Borough'] == borough]['Town'])\n",
    "    api_call = requests.get(url).json()\n",
    "    lat_l.append(api_call['results'][0]['geometry'][\"location\"][\"lat\"])\n",
    "    long_l.append(api_call['results'][0]['geometry'][\"location\"][\"lng\"])\n",
    "\n",
    "df['lat']=lat_l\n",
    "df['lng']=long_l\n",
    "\n",
    "df.head(15)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Preprocessing the neighborhood data\n",
    "\n",
    "Turkish Characters are causing problems, therefore the following code is essential to have a better dataframe."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 58,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>City</th>\n",
       "      <th>Town</th>\n",
       "      <th>Neighborhood</th>\n",
       "      <th>Borough</th>\n",
       "      <th>Post Code</th>\n",
       "      <th>lat</th>\n",
       "      <th>lng</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>İstanbul</td>\n",
       "      <td>Besi̇ktas</td>\n",
       "      <td>Abbasaga</td>\n",
       "      <td>Abbasaga mah</td>\n",
       "      <td>34022</td>\n",
       "      <td>41.048010</td>\n",
       "      <td>29.004528</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>İstanbul</td>\n",
       "      <td>Besi̇ktas</td>\n",
       "      <td>Abbasaga</td>\n",
       "      <td>Ci̇hannuma mah</td>\n",
       "      <td>34022</td>\n",
       "      <td>41.047211</td>\n",
       "      <td>29.007439</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>İstanbul</td>\n",
       "      <td>Besi̇ktas</td>\n",
       "      <td>Abbasaga</td>\n",
       "      <td>Si̇nanpasa mah</td>\n",
       "      <td>34022</td>\n",
       "      <td>41.041866</td>\n",
       "      <td>29.005112</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>İstanbul</td>\n",
       "      <td>Besi̇ktas</td>\n",
       "      <td>Akatlar</td>\n",
       "      <td>Akat mah</td>\n",
       "      <td>34335</td>\n",
       "      <td>41.085614</td>\n",
       "      <td>29.025626</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>İstanbul</td>\n",
       "      <td>Besi̇ktas</td>\n",
       "      <td>Arnavutkoy</td>\n",
       "      <td>Arnavutkoy mah</td>\n",
       "      <td>34345</td>\n",
       "      <td>41.068488</td>\n",
       "      <td>29.041629</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "       City       Town Neighborhood         Borough  Post Code        lat  \\\n",
       "0  İstanbul  Besi̇ktas     Abbasaga    Abbasaga mah      34022  41.048010   \n",
       "1  İstanbul  Besi̇ktas     Abbasaga  Ci̇hannuma mah      34022  41.047211   \n",
       "2  İstanbul  Besi̇ktas     Abbasaga  Si̇nanpasa mah      34022  41.041866   \n",
       "3  İstanbul  Besi̇ktas      Akatlar        Akat mah      34335  41.085614   \n",
       "4  İstanbul  Besi̇ktas   Arnavutkoy  Arnavutkoy mah      34345  41.068488   \n",
       "\n",
       "         lng  \n",
       "0  29.004528  \n",
       "1  29.007439  \n",
       "2  29.005112  \n",
       "3  29.025626  \n",
       "4  29.041629  "
      ]
     },
     "execution_count": 58,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Tr2Eng = str.maketrans(\"ÇĞIÖŞÜ\", \"CGIOSU\")\n",
    "for Borough in df['Borough']:\n",
    "    df.loc[df['Borough'] == Borough, 'Borough'] = Borough.translate(Tr2Eng).capitalize().strip()\n",
    "for Neighborhood in df['Neighborhood']:\n",
    "    df.loc[df['Neighborhood'] == Neighborhood, 'Neighborhood'] = Neighborhood.translate(Tr2Eng).capitalize().strip()\n",
    "for Town in df['Town']:\n",
    "    df.loc[df['Town'] == Town, 'Town'] = Town.translate(Tr2Eng).capitalize().strip()\n",
    "for City in df['City']:\n",
    "    df.loc[df['City'] == City, 'City'] = City.translate(Tr2Eng).capitalize().strip()\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Saving to a csv file not to spend API calls repeatedly\n",
    "\n",
    "free API calls are limited. Therefore, the dataframe is exported to a CSV for future uses"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "df.to_csv(\"bjk_kdky_LL.csv\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Generating the map with borough centers\n",
    "\n",
    "For a simple overview"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 59,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div style=\"width:100%;\"><div style=\"position:relative;width:100%;height:0;padding-bottom:60%;\"><span style=\"color:#565656\">Make this Notebook Trusted to load map: File -> Trust Notebook</span><iframe src=\"about:blank\" style=\"position:absolute;width:100%;height:100%;left:0;top:0;border:none !important;\" data-html=PCFET0NUWVBFIGh0bWw+CjxoZWFkPiAgICAKICAgIDxtZXRhIGh0dHAtZXF1aXY9ImNvbnRlbnQtdHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PVVURi04IiAvPgogICAgPHNjcmlwdD5MX1BSRUZFUl9DQU5WQVMgPSBmYWxzZTsgTF9OT19UT1VDSCA9IGZhbHNlOyBMX0RJU0FCTEVfM0QgPSBmYWxzZTs8L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2Nkbi5qc2RlbGl2ci5uZXQvbnBtL2xlYWZsZXRAMS4yLjAvZGlzdC9sZWFmbGV0LmpzIj48L3NjcmlwdD4KICAgIDxzY3JpcHQgc3JjPSJodHRwczovL2FqYXguZ29vZ2xlYXBpcy5jb20vYWpheC9saWJzL2pxdWVyeS8xLjExLjEvanF1ZXJ5Lm1pbi5qcyI+PC9zY3JpcHQ+CiAgICA8c2NyaXB0IHNyYz0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9ib290c3RyYXAvMy4yLjAvanMvYm9vdHN0cmFwLm1pbi5qcyI+PC9zY3JpcHQ+CiAgICA8c2NyaXB0IHNyYz0iaHR0cHM6Ly9jZG5qcy5jbG91ZGZsYXJlLmNvbS9hamF4L2xpYnMvTGVhZmxldC5hd2Vzb21lLW1hcmtlcnMvMi4wLjIvbGVhZmxldC5hd2Vzb21lLW1hcmtlcnMuanMiPjwvc2NyaXB0PgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL2Nkbi5qc2RlbGl2ci5uZXQvbnBtL2xlYWZsZXRAMS4yLjAvZGlzdC9sZWFmbGV0LmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL21heGNkbi5ib290c3RyYXBjZG4uY29tL2Jvb3RzdHJhcC8zLjIuMC9jc3MvYm9vdHN0cmFwLm1pbi5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9tYXhjZG4uYm9vdHN0cmFwY2RuLmNvbS9ib290c3RyYXAvMy4yLjAvY3NzL2Jvb3RzdHJhcC10aGVtZS5taW4uY3NzIi8+CiAgICA8bGluayByZWw9InN0eWxlc2hlZXQiIGhyZWY9Imh0dHBzOi8vbWF4Y2RuLmJvb3RzdHJhcGNkbi5jb20vZm9udC1hd2Vzb21lLzQuNi4zL2Nzcy9mb250LWF3ZXNvbWUubWluLmNzcyIvPgogICAgPGxpbmsgcmVsPSJzdHlsZXNoZWV0IiBocmVmPSJodHRwczovL2NkbmpzLmNsb3VkZmxhcmUuY29tL2FqYXgvbGlicy9MZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy8yLjAuMi9sZWFmbGV0LmF3ZXNvbWUtbWFya2Vycy5jc3MiLz4KICAgIDxsaW5rIHJlbD0ic3R5bGVzaGVldCIgaHJlZj0iaHR0cHM6Ly9yYXdnaXQuY29tL3B5dGhvbi12aXN1YWxpemF0aW9uL2ZvbGl1bS9tYXN0ZXIvZm9saXVtL3RlbXBsYXRlcy9sZWFmbGV0LmF3ZXNvbWUucm90YXRlLmNzcyIvPgogICAgPHN0eWxlPmh0bWwsIGJvZHkge3dpZHRoOiAxMDAlO2hlaWdodDogMTAwJTttYXJnaW46IDA7cGFkZGluZzogMDt9PC9zdHlsZT4KICAgIDxzdHlsZT4jbWFwIHtwb3NpdGlvbjphYnNvbHV0ZTt0b3A6MDtib3R0b206MDtyaWdodDowO2xlZnQ6MDt9PC9zdHlsZT4KICAgIAogICAgICAgICAgICA8c3R5bGU+ICNtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQgewogICAgICAgICAgICAgICAgcG9zaXRpb24gOiByZWxhdGl2ZTsKICAgICAgICAgICAgICAgIHdpZHRoIDogMTAwLjAlOwogICAgICAgICAgICAgICAgaGVpZ2h0OiAxMDAuMCU7CiAgICAgICAgICAgICAgICBsZWZ0OiAwLjAlOwogICAgICAgICAgICAgICAgdG9wOiAwLjAlOwogICAgICAgICAgICAgICAgfQogICAgICAgICAgICA8L3N0eWxlPgogICAgICAgIAo8L2hlYWQ+Cjxib2R5PiAgICAKICAgIAogICAgICAgICAgICA8ZGl2IGNsYXNzPSJmb2xpdW0tbWFwIiBpZD0ibWFwXzliNDI0OTVlZDBhNTRlNWQ4ODYwMzkzOTRkNGM5MzRkIiA+PC9kaXY+CiAgICAgICAgCjwvYm9keT4KPHNjcmlwdD4gICAgCiAgICAKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGJvdW5kcyA9IG51bGw7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgdmFyIG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCA9IEwubWFwKAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJ21hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCcsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB7Y2VudGVyOiBbNDEuMDQ4MDEwMiwyOS4wMDQ1Mjg1XSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHpvb206IDEyLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWF4Qm91bmRzOiBib3VuZHMsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBsYXllcnM6IFtdLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgd29ybGRDb3B5SnVtcDogZmFsc2UsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBjcnM6IEwuQ1JTLkVQU0czODU3CiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIH0pOwogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgdGlsZV9sYXllcl8yYjMzOGUzZTFiNWM0YTdmYTdjYjdlYTQ3M2NjNmU5OCA9IEwudGlsZUxheWVyKAogICAgICAgICAgICAgICAgJ2h0dHBzOi8ve3N9LnRpbGUub3BlbnN0cmVldG1hcC5vcmcve3p9L3t4fS97eX0ucG5nJywKICAgICAgICAgICAgICAgIHsKICAiYXR0cmlidXRpb24iOiBudWxsLAogICJkZXRlY3RSZXRpbmEiOiBmYWxzZSwKICAibWF4Wm9vbSI6IDE4LAogICJtaW5ab29tIjogMSwKICAibm9XcmFwIjogZmFsc2UsCiAgInN1YmRvbWFpbnMiOiAiYWJjIgp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfMDAxZDdjNzA4NWNlNDIxZWEwN2NlMDdjNjI4MDY2MWEgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MS4wNDgwMTAyLDI5LjAwNDUyODVdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfODc4MDM1ZmRiMTZiNDQ5MThhYjQ5OWQxZmM5ZDMxNjQgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfOTU1YjhmYWYzZWQ1NDgyZmJmZjUxM2Y1MjdlMTAyY2IgPSAkKCc8ZGl2IGlkPSJodG1sXzk1NWI4ZmFmM2VkNTQ4MmZiZmY1MTNmNTI3ZTEwMmNiIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgQWJiYXNhZ2EgbWFoPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF84NzgwMzVmZGIxNmI0NDkxOGFiNDk5ZDFmYzlkMzE2NC5zZXRDb250ZW50KGh0bWxfOTU1YjhmYWYzZWQ1NDgyZmJmZjUxM2Y1MjdlMTAyY2IpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfMDAxZDdjNzA4NWNlNDIxZWEwN2NlMDdjNjI4MDY2MWEuYmluZFBvcHVwKHBvcHVwXzg3ODAzNWZkYjE2YjQ0OTE4YWI0OTlkMWZjOWQzMTY0KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyX2I1NzRiMTVlMDYyZjRiYjk4NDZmMTczNDMyN2JlNzEzID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDEuMDQ3MjExMSwyOS4wMDc0Mzg3XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICIjMzE4NmNjIiwKICAiZmlsbE9wYWNpdHkiOiAwLjcsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzliNDI0OTVlZDBhNTRlNWQ4ODYwMzkzOTRkNGM5MzRkKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2I3NjMyNWZhMjE5YTQ0MDZiMGMwOWY1ZjNiNmRjMWZmID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2EwMDg3NGMzMzY0MDQ0MGI5NjgwNzgxMGQ0MjkxOTExID0gJCgnPGRpdiBpZD0iaHRtbF9hMDA4NzRjMzM2NDA0NDBiOTY4MDc4MTBkNDI5MTkxMSIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+SXN0YW5idWwsIENpzIdoYW5udW1hIG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfYjc2MzI1ZmEyMTlhNDQwNmIwYzA5ZjVmM2I2ZGMxZmYuc2V0Q29udGVudChodG1sX2EwMDg3NGMzMzY0MDQ0MGI5NjgwNzgxMGQ0MjkxOTExKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyX2I1NzRiMTVlMDYyZjRiYjk4NDZmMTczNDMyN2JlNzEzLmJpbmRQb3B1cChwb3B1cF9iNzYzMjVmYTIxOWE0NDA2YjBjMDlmNWYzYjZkYzFmZik7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9lYjRiNTU5NTU0ZWI0YzliODc1MTJmYjFlNmU3NTM4YyA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQxLjA0MTg2NTcsMjkuMDA1MTExNl0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF83ZGY1YmNiNzQyNTk0M2Y2YjBiY2E0YmZmN2M5ZWViNSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF9iYTRhN2ExNGM4OTA0ZTc3YmMzMmVjZGRlMzFhMjMyZCA9ICQoJzxkaXYgaWQ9Imh0bWxfYmE0YTdhMTRjODkwNGU3N2JjMzJlY2RkZTMxYTIzMmQiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBTacyHbmFucGFzYSBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzdkZjViY2I3NDI1OTQzZjZiMGJjYTRiZmY3YzllZWI1LnNldENvbnRlbnQoaHRtbF9iYTRhN2ExNGM4OTA0ZTc3YmMzMmVjZGRlMzFhMjMyZCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9lYjRiNTU5NTU0ZWI0YzliODc1MTJmYjFlNmU3NTM4Yy5iaW5kUG9wdXAocG9wdXBfN2RmNWJjYjc0MjU5NDNmNmIwYmNhNGJmZjdjOWVlYjUpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfYzlmMDcwMDgyZDU1NDg0YWFjZTA4ZThlNGY0ZTdkN2QgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MS4wODU2MTQzLDI5LjAyNTYyNTddLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfYTQzZTgzYmE3YTgzNGIyYmIwMWIxMGEzNmE4ZWIwZDQgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfNGEyM2FlYzg2ZjVkNDQxZWIyNzgwYTBhZjRlMGFlODkgPSAkKCc8ZGl2IGlkPSJodG1sXzRhMjNhZWM4NmY1ZDQ0MWViMjc4MGEwYWY0ZTBhZTg5IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgQWthdCBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2E0M2U4M2JhN2E4MzRiMmJiMDFiMTBhMzZhOGViMGQ0LnNldENvbnRlbnQoaHRtbF80YTIzYWVjODZmNWQ0NDFlYjI3ODBhMGFmNGUwYWU4OSk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9jOWYwNzAwODJkNTU0ODRhYWNlMDhlOGU0ZjRlN2Q3ZC5iaW5kUG9wdXAocG9wdXBfYTQzZTgzYmE3YTgzNGIyYmIwMWIxMGEzNmE4ZWIwZDQpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfYWY1NzU4NWQzNGQ0NDA3NGFlM2E5MzhkNWMxMzU1ZWEgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MS4wNjg0ODc1LDI5LjA0MTYyODZdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfYjkzYWYwYmRmNTJlNGFhOTk5Mjc5NmQwZmVjYzljZGIgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfOTAxOTM0YTczMGVkNDkwYzk2ODAwMjFlYzM4MzE2NmQgPSAkKCc8ZGl2IGlkPSJodG1sXzkwMTkzNGE3MzBlZDQ5MGM5NjgwMDIxZWMzODMxNjZkIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgQXJuYXZ1dGtveSBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2I5M2FmMGJkZjUyZTRhYTk5OTI3OTZkMGZlY2M5Y2RiLnNldENvbnRlbnQoaHRtbF85MDE5MzRhNzMwZWQ0OTBjOTY4MDAyMWVjMzgzMTY2ZCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9hZjU3NTg1ZDM0ZDQ0MDc0YWUzYTkzOGQ1YzEzNTVlYS5iaW5kUG9wdXAocG9wdXBfYjkzYWYwYmRmNTJlNGFhOTk5Mjc5NmQwZmVjYzljZGIpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfNDI4ZGM1OTA1MzhkNGVkZTg3ZDFkYzUxMzhiNTllY2UgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MS4wNjE2Mjk5LDI5LjAzMjldLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfMTQ0ZDkwZWYwZjY3NDMyOGJhOWQ4MWM1N2RlZWVmMzkgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfNTZhYzc4YWNjZDJjNGRiOGEzMDZkM2JlYWU5MGU0NzAgPSAkKCc8ZGl2IGlkPSJodG1sXzU2YWM3OGFjY2QyYzRkYjhhMzA2ZDNiZWFlOTBlNDcwIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgS3VydWNlc21lIG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMTQ0ZDkwZWYwZjY3NDMyOGJhOWQ4MWM1N2RlZWVmMzkuc2V0Q29udGVudChodG1sXzU2YWM3OGFjY2QyYzRkYjhhMzA2ZDNiZWFlOTBlNDcwKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzQyOGRjNTkwNTM4ZDRlZGU4N2QxZGM1MTM4YjU5ZWNlLmJpbmRQb3B1cChwb3B1cF8xNDRkOTBlZjBmNjc0MzI4YmE5ZDgxYzU3ZGVlZWYzOSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9jNGUzOWMyY2FmMDM0MzUyYWUyYjk0NzJjY2I5ZThkMCA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQxLjA3Nzc0MzcsMjkuMDQxNjI4Nl0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF8yNWY1NzIxODQzNmM0M2NmYTlkMmY0YWNlMTViM2ZmNSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF9lZTYxYmRkZDZlOWI0MmNkYWQzMTJlYmE4OTg1OTI1YiA9ICQoJzxkaXYgaWQ9Imh0bWxfZWU2MWJkZGQ2ZTliNDJjZGFkMzEyZWJhODk4NTkyNWIiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBCZWJlayBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzI1ZjU3MjE4NDM2YzQzY2ZhOWQyZjRhY2UxNWIzZmY1LnNldENvbnRlbnQoaHRtbF9lZTYxYmRkZDZlOWI0MmNkYWQzMTJlYmE4OTg1OTI1Yik7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9jNGUzOWMyY2FmMDM0MzUyYWUyYjk0NzJjY2I5ZThkMC5iaW5kUG9wdXAocG9wdXBfMjVmNTcyMTg0MzZjNDNjZmE5ZDJmNGFjZTE1YjNmZjUpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfMDNkOGU3YTlmZmIzNDgwYThjMmQ5MzZlMmRiZTVlYWYgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MS4wODcwNDE5LDI5LjAzNzI2NDNdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfNTY5NTVmZWJmMDg5NDkzNWE4Zjk2NWZiNDkzYWIwZjQgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMmM4MDc0NjFkMGYxNGNlYjk2NjNkOThlMTg5OGI3NzYgPSAkKCc8ZGl2IGlkPSJodG1sXzJjODA3NDYxZDBmMTRjZWI5NjYzZDk4ZTE4OThiNzc2IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgRXRpzIdsZXIgbWFoPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF81Njk1NWZlYmYwODk0OTM1YThmOTY1ZmI0OTNhYjBmNC5zZXRDb250ZW50KGh0bWxfMmM4MDc0NjFkMGYxNGNlYjk2NjNkOThlMTg5OGI3NzYpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfMDNkOGU3YTlmZmIzNDgwYThjMmQ5MzZlMmRiZTVlYWYuYmluZFBvcHVwKHBvcHVwXzU2OTU1ZmViZjA4OTQ5MzVhOGY5NjVmYjQ5M2FiMGY0KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzNmODYyNzkzYWE4ZTQxMGVhMjYxNDAzZDQyNGEwYTI0ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDEuMDU5MTA0NiwyOS4wMTQ3MTM3XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICIjMzE4NmNjIiwKICAiZmlsbE9wYWNpdHkiOiAwLjcsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzliNDI0OTVlZDBhNTRlNWQ4ODYwMzkzOTRkNGM5MzRkKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzMzYmMyOWUxMjZjZjQ3ZjhhMTQ5YmM5OTlhZWNjYzE1ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2Q2MmU5OWZjZjIxMjRmMTViMTU1MDdlODQ5NWM4ODZhID0gJCgnPGRpdiBpZD0iaHRtbF9kNjJlOTlmY2YyMTI0ZjE1YjE1NTA3ZTg0OTVjODg2YSIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+SXN0YW5idWwsIEJhbG11bWN1IG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMzNiYzI5ZTEyNmNmNDdmOGExNDliYzk5OWFlY2NjMTUuc2V0Q29udGVudChodG1sX2Q2MmU5OWZjZjIxMjRmMTViMTU1MDdlODQ5NWM4ODZhKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzNmODYyNzkzYWE4ZTQxMGVhMjYxNDAzZDQyNGEwYTI0LmJpbmRQb3B1cChwb3B1cF8zM2JjMjllMTI2Y2Y0N2Y4YTE0OWJjOTk5YWVjY2MxNSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl8xNGZlNTRmZTNkZmU0MTc1YThlMGFkNTMzZGIxZDEwYyA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQxLjA1NTczNTEsMjkuMDAzODAxXSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICIjMzE4NmNjIiwKICAiZmlsbE9wYWNpdHkiOiAwLjcsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzliNDI0OTVlZDBhNTRlNWQ4ODYwMzkzOTRkNGM5MzRkKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2FhNTZjNjQ5MmUxZjQxOTQ4MWYzNjE0NTFkYjMyMzA0ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2IwOGFkYTNjYzUyMTQ2NzVhNzAwNTIzZGNkM2E3ZTQ4ID0gJCgnPGRpdiBpZD0iaHRtbF9iMDhhZGEzY2M1MjE0Njc1YTcwMDUyM2RjZDNhN2U0OCIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+SXN0YW5idWwsIERpzIdracyHbGnMh3RhcyBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2FhNTZjNjQ5MmUxZjQxOTQ4MWYzNjE0NTFkYjMyMzA0LnNldENvbnRlbnQoaHRtbF9iMDhhZGEzY2M1MjE0Njc1YTcwMDUyM2RjZDNhN2U0OCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl8xNGZlNTRmZTNkZmU0MTc1YThlMGFkNTMzZGIxZDEwYy5iaW5kUG9wdXAocG9wdXBfYWE1NmM2NDkyZTFmNDE5NDgxZjM2MTQ1MWRiMzIzMDQpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfNzY1OWI2ZWU5YmQwNGE3ODkxNmQ2M2Q1MWY3YzI3OWEgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MS4wNjQxOTYyLDI5LjAwNjcxMTFdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfYjRjYjlkNjVlOGU0NDI5MmE0OTNiNDE5YWQ5ZmFiYjUgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfYjkxNWNlNjE3M2UzNDQ2YWFiNjkxMzgwNTdjZTQ1ZTAgPSAkKCc8ZGl2IGlkPSJodG1sX2I5MTVjZTYxNzNlMzQ0NmFhYjY5MTM4MDU3Y2U0NWUwIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgR2F5cmV0dGVwZSBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2I0Y2I5ZDY1ZThlNDQyOTJhNDkzYjQxOWFkOWZhYmI1LnNldENvbnRlbnQoaHRtbF9iOTE1Y2U2MTczZTM0NDZhYWI2OTEzODA1N2NlNDVlMCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl83NjU5YjZlZTliZDA0YTc4OTE2ZDYzZDUxZjdjMjc5YS5iaW5kUG9wdXAocG9wdXBfYjRjYjlkNjVlOGU0NDI5MmE0OTNiNDE5YWQ5ZmFiYjUpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfZWQwNjRhNWRkOWEyNGEwYzhhYWRlMjFlMzA2MmY1NzcgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MS4wNDcxNDk1LDI5LjAxMzk4NjNdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfNjFkNGVlMzBiMjA0NDI4Mzk3MWJhOGU3YjkyOWZkOTEgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMDQ2M2Q4MjE0YWQ4NDUwOWI0ZjRiZGFmOTBkNTU2MWIgPSAkKCc8ZGl2IGlkPSJodG1sXzA0NjNkODIxNGFkODQ1MDliNGY0YmRhZjkwZDU1NjFiIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgWWlsZGl6IG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfNjFkNGVlMzBiMjA0NDI4Mzk3MWJhOGU3YjkyOWZkOTEuc2V0Q29udGVudChodG1sXzA0NjNkODIxNGFkODQ1MDliNGY0YmRhZjkwZDU1NjFiKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyX2VkMDY0YTVkZDlhMjRhMGM4YWFkZTIxZTMwNjJmNTc3LmJpbmRQb3B1cChwb3B1cF82MWQ0ZWUzMGIyMDQ0MjgzOTcxYmE4ZTdiOTI5ZmQ5MSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl8yYWYwOWE2YmMyMGE0OWNhYWFiOWY3YjdmNjQ3Y2E4YiA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQxLjA3MzIwMTksMjkuMDMyOV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF82YzEwZmFiYWMzNmM0OGRmYTIxZGZkYmE4MDRmNTc3MyA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8wODQxNWI1MjIyZmU0ZTUwYTc0MGQ1YjVlN2YzMjY1ZCA9ICQoJzxkaXYgaWQ9Imh0bWxfMDg0MTViNTIyMmZlNGU1MGE3NDBkNWI1ZTdmMzI2NWQiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBLdWx0dXIgbWFoPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF82YzEwZmFiYWMzNmM0OGRmYTIxZGZkYmE4MDRmNTc3My5zZXRDb250ZW50KGh0bWxfMDg0MTViNTIyMmZlNGU1MGE3NDBkNWI1ZTdmMzI2NWQpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfMmFmMDlhNmJjMjBhNDljYWFhYjlmN2I3ZjY0N2NhOGIuYmluZFBvcHVwKHBvcHVwXzZjMTBmYWJhYzM2YzQ4ZGZhMjFkZmRiYTgwNGY1NzczKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyX2QzYzc3MWI5YzhmMzRjY2I4ZGVlMmY0OTUwNDA4Y2YzID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDEuMDYzMzEzNjk5OTk5OTksMjkuMDE4MzUxMl0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF8wYmIxMTNmNDI0MGM0NTI2YTc2MjgxZjg4ODc3MjVmOSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF80YzU5ZGY1ODdhZjg0NjU2YmFmYTIxZTZjNjZmNDgzYiA9ICQoJzxkaXYgaWQ9Imh0bWxfNGM1OWRmNTg3YWY4NDY1NmJhZmEyMWU2YzY2ZjQ4M2IiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBMZXZhemltIG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMGJiMTEzZjQyNDBjNDUyNmE3NjI4MWY4ODg3NzI1Zjkuc2V0Q29udGVudChodG1sXzRjNTlkZjU4N2FmODQ2NTZiYWZhMjFlNmM2NmY0ODNiKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyX2QzYzc3MWI5YzhmMzRjY2I4ZGVlMmY0OTUwNDA4Y2YzLmJpbmRQb3B1cChwb3B1cF8wYmIxMTNmNDI0MGM0NTI2YTc2MjgxZjg4ODc3MjVmOSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9jNjY3NTcwOGE3MjQ0OTBlOGM5NmMwNWFmNWQzMGIyNiA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQxLjA3MTc3MjQsMjkuMDIxMjYxXSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICIjMzE4NmNjIiwKICAiZmlsbE9wYWNpdHkiOiAwLjcsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzliNDI0OTVlZDBhNTRlNWQ4ODYwMzkzOTRkNGM5MzRkKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2YzMGRiNzYzN2ZkNjQ5ZjJhNTkzMzI4MGFhZGYwMGE2ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2VmNDMwZDAxZWUzMjRkYjQ5NWI5NjYwZGE5ODBiZjA3ID0gJCgnPGRpdiBpZD0iaHRtbF9lZjQzMGQwMWVlMzI0ZGI0OTViOTY2MGRhOTgwYmYwNyIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+SXN0YW5idWwsIE5pzIdzYmV0acyHeWUgbWFoPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9mMzBkYjc2MzdmZDY0OWYyYTU5MzMyODBhYWRmMDBhNi5zZXRDb250ZW50KGh0bWxfZWY0MzBkMDFlZTMyNGRiNDk1Yjk2NjBkYTk4MGJmMDcpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfYzY2NzU3MDhhNzI0NDkwZThjOTZjMDVhZjVkMzBiMjYuYmluZFBvcHVwKHBvcHVwX2YzMGRiNzYzN2ZkNjQ5ZjJhNTkzMzI4MGFhZGYwMGE2KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzIzMTQ1MGM5YTU2MTRkNTdiOGY3NzE4NDZhYjQ1NDQ0ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDEuMDYzMjI5NiwyOS4wMjcwODA2XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICIjMzE4NmNjIiwKICAiZmlsbE9wYWNpdHkiOiAwLjcsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzliNDI0OTVlZDBhNTRlNWQ4ODYwMzkzOTRkNGM5MzRkKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2I3ZmY1OTg2NTBhZDRiOTg5MGU1ODBiODY3YjQyZTY4ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzYxODc5ZjJkZWFhZTQ4Zjk4Y2RhNjE4NjU1MmM5ZTJkID0gJCgnPGRpdiBpZD0iaHRtbF82MTg3OWYyZGVhYWU0OGY5OGNkYTYxODY1NTJjOWUyZCIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+SXN0YW5idWwsIFVsdXMgbWFoPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9iN2ZmNTk4NjUwYWQ0Yjk4OTBlNTgwYjg2N2I0MmU2OC5zZXRDb250ZW50KGh0bWxfNjE4NzlmMmRlYWFlNDhmOThjZGE2MTg2NTUyYzllMmQpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfMjMxNDUwYzlhNTYxNGQ1N2I4Zjc3MTg0NmFiNDU0NDQuYmluZFBvcHVwKHBvcHVwX2I3ZmY1OTg2NTBhZDRiOTg5MGU1ODBiODY3YjQyZTY4KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyX2FjYjNkYzJiNzUzZjRkYjBhNjNmODc2ZTlkNjlmMDk0ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDEuMDkzNDQwMiwyOS4wMTM5ODYzXSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICIjMzE4NmNjIiwKICAiZmlsbE9wYWNpdHkiOiAwLjcsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzliNDI0OTVlZDBhNTRlNWQ4ODYwMzkzOTRkNGM5MzRkKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwXzIzNDdmODA3YzA2OTQzOWU4ZTI1YmVjMzM4ZTk1MWVlID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2U3NmZkMTUzYzVhMTQ4ZGU5M2VhYTM5NjljOGJkYzgzID0gJCgnPGRpdiBpZD0iaHRtbF9lNzZmZDE1M2M1YTE0OGRlOTNlYWEzOTY5YzhiZGM4MyIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+SXN0YW5idWwsIEtvbmFrbGFyIG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMjM0N2Y4MDdjMDY5NDM5ZThlMjViZWMzMzhlOTUxZWUuc2V0Q29udGVudChodG1sX2U3NmZkMTUzYzVhMTQ4ZGU5M2VhYTM5NjljOGJkYzgzKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyX2FjYjNkYzJiNzUzZjRkYjBhNjNmODc2ZTlkNjlmMDk0LmJpbmRQb3B1cChwb3B1cF8yMzQ3ZjgwN2MwNjk0MzllOGUyNWJlYzMzOGU5NTFlZSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl82MTJjMTBlNjkwOGM0Zjk4YWFhOWE4YWY1MjYxMDI5OSA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQxLjA4MTgyODgsMjkuMDE4MzUxMl0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9hMDdjNmJmZGVkZjI0NjU0YjA2MzA2OWEzOGNiYzUyNSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8zNWE1ZDcxN2E4MDQ0MDA2YTY5ZmU5NWFmZDAwZGRkZCA9ICQoJzxkaXYgaWQ9Imh0bWxfMzVhNWQ3MTdhODA0NDAwNmE2OWZlOTVhZmQwMGRkZGQiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBMZXZlbnQgbWFoPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9hMDdjNmJmZGVkZjI0NjU0YjA2MzA2OWEzOGNiYzUyNS5zZXRDb250ZW50KGh0bWxfMzVhNWQ3MTdhODA0NDAwNmE2OWZlOTVhZmQwMGRkZGQpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfNjEyYzEwZTY5MDhjNGY5OGFhYTlhOGFmNTI2MTAyOTkuYmluZFBvcHVwKHBvcHVwX2EwN2M2YmZkZWRmMjQ2NTRiMDYzMDY5YTM4Y2JjNTI1KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzQzMzZhY2Y0MGM5MDQ5Yzg5NDAxMjMxNzdhN2ZkNDMzID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDEuMDUwOTM5MywyOS4wMjEyNjFdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfOTYzMTYyY2UyYjQ4NDkyOWJkZDk1Nzc0OWQ0MWI0MmYgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfYzczM2E5NjQ1NjdiNDBhMThkYzA5NDNhM2M2NWE4ZGQgPSAkKCc8ZGl2IGlkPSJodG1sX2M3MzNhOTY0NTY3YjQwYTE4ZGMwOTQzYTNjNjVhOGRkIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgTWVjacyHZGnMh3llIG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfOTYzMTYyY2UyYjQ4NDkyOWJkZDk1Nzc0OWQ0MWI0MmYuc2V0Q29udGVudChodG1sX2M3MzNhOTY0NTY3YjQwYTE4ZGMwOTQzYTNjNjVhOGRkKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzQzMzZhY2Y0MGM5MDQ5Yzg5NDAxMjMxNzdhN2ZkNDMzLmJpbmRQb3B1cChwb3B1cF85NjMxNjJjZTJiNDg0OTI5YmRkOTU3NzQ5ZDQxYjQyZik7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl8zNGNlZWU4Y2E1NzQ0MTUyOTFlMGJkYmMxMWM2OGNlNyA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQxLjA1Mzk3MDMsMjkuMDI3MDgwNl0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9mZWI0MDc0NTU1YzA0ZTljOWM1Y2RhMGQ1NWU5NTQ2YyA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF84Mzg2ZDJhYTM3YzE0MzA1YWI1YjBhZjllOTJmNDk0MCA9ICQoJzxkaXYgaWQ9Imh0bWxfODM4NmQyYWEzN2MxNDMwNWFiNWIwYWY5ZTkyZjQ5NDAiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBPcnRha295IG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfZmViNDA3NDU1NWMwNGU5YzljNWNkYTBkNTVlOTU0NmMuc2V0Q29udGVudChodG1sXzgzODZkMmFhMzdjMTQzMDVhYjViMGFmOWU5MmY0OTQwKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzM0Y2VlZThjYTU3NDQxNTI5MWUwYmRiYzExYzY4Y2U3LmJpbmRQb3B1cChwb3B1cF9mZWI0MDc0NTU1YzA0ZTljOWM1Y2RhMGQ1NWU5NTQ2Yyk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl81MGMwYjllNTYzOGE0ZmY2YjNlZTEzNmI5Y2I5ODQwNiA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQxLjA0ODQ1MDQsMjguOTk4NzA4MV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF8zMmIwYzVjODkzYjQ0YTM2OGY0ODBlNDgyYWUyOTI1MCA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF80MDI2YWZhY2QwZDk0ZDgxOTE4ZmMzNGM5YTA1OGQzNSA9ICQoJzxkaXYgaWQ9Imh0bWxfNDAyNmFmYWNkMGQ5NGQ4MTkxOGZjMzRjOWEwNThkMzUiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBNdXJhZGnMh3llIG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMzJiMGM1Yzg5M2I0NGEzNjhmNDgwZTQ4MmFlMjkyNTAuc2V0Q29udGVudChodG1sXzQwMjZhZmFjZDBkOTRkODE5MThmYzM0YzlhMDU4ZDM1KTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzUwYzBiOWU1NjM4YTRmZjZiM2VlMTM2YjljYjk4NDA2LmJpbmRQb3B1cChwb3B1cF8zMmIwYzVjODkzYjQ0YTM2OGY0ODBlNDgyYWUyOTI1MCk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl8wNjc2YThhYTliMDg0MDZjOWY4MTUzMTBjMjMwZmMxNCA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQxLjA0NzY1MTUsMjkuMDAxNjE4Mjk5OTk5OTldLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfNDhkZjZmMWQ4NjYxNGZjM2EwNGQ5OGUyM2QyNjFkOWUgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfY2JkNDEzN2NmZDA3NGNmZGI3OWE5ZjBmODIyZTYyZTQgPSAkKCc8ZGl2IGlkPSJodG1sX2NiZDQxMzdjZmQwNzRjZmRiNzlhOWYwZjgyMmU2MmU0IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgVHVya2FsacyHIG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfNDhkZjZmMWQ4NjYxNGZjM2EwNGQ5OGUyM2QyNjFkOWUuc2V0Q29udGVudChodG1sX2NiZDQxMzdjZmQwNzRjZmRiNzlhOWYwZjgyMmU2MmU0KTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzA2NzZhOGFhOWIwODQwNmM5ZjgxNTMxMGMyMzBmYzE0LmJpbmRQb3B1cChwb3B1cF80OGRmNmYxZDg2NjE0ZmMzYTA0ZDk4ZTIzZDI2MWQ5ZSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9hY2UzNWZkYjM2NDQ0NjZhYTY3NWI2NWZjNmVlYjY5ZiA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQxLjA0MTUwMzEsMjguOTk4NzA4MV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF9lNWRhNjQ0Yjc3ODE0ZWE0YTQ0MjQ0ODVjYzIwZmQwNiA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF80NDU4ZTRlZmE2NWM0YWE1ODIxNjNlYzIzZWEzOTA0MCA9ICQoJzxkaXYgaWQ9Imh0bWxfNDQ1OGU0ZWZhNjVjNGFhNTgyMTYzZWMyM2VhMzkwNDAiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBWacyHc25lemFkZSBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2U1ZGE2NDRiNzc4MTRlYTRhNDQyNDQ4NWNjMjBmZDA2LnNldENvbnRlbnQoaHRtbF80NDU4ZTRlZmE2NWM0YWE1ODIxNjNlYzIzZWEzOTA0MCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9hY2UzNWZkYjM2NDQ0NjZhYTY3NWI2NWZjNmVlYjY5Zi5iaW5kUG9wdXAocG9wdXBfZTVkYTY0NGI3NzgxNGVhNGE0NDI0NDg1Y2MyMGZkMDYpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfNTQxZTU0ZDliN2Q4NDEyZGI1YWIwN2Q0NmJiNDI3ZGIgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC45NTgzMTcyLDI5LjA5Njg5ODJdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfNTNmM2U2YWU2MDQ4NDk4OThlZDliYTA5OGI2OWZkMmYgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMTNiMWE0MzNiNzgzNDc0Y2JhNmJkYTA4NGJiNWFhODkgPSAkKCc8ZGl2IGlkPSJodG1sXzEzYjFhNDMzYjc4MzQ3NGNiYTZiZGEwODRiYjVhYTg5IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgQm9zdGFuY2kgbWFoPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF81M2YzZTZhZTYwNDg0OTg5OGVkOWJhMDk4YjY5ZmQyZi5zZXRDb250ZW50KGh0bWxfMTNiMWE0MzNiNzgzNDc0Y2JhNmJkYTA4NGJiNWFhODkpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfNTQxZTU0ZDliN2Q4NDEyZGI1YWIwN2Q0NmJiNDI3ZGIuYmluZFBvcHVwKHBvcHVwXzUzZjNlNmFlNjA0ODQ5ODk4ZWQ5YmEwOThiNjlmZDJmKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzE0ZGI4ODBiN2MyOTQyODdhN2I3NjgwNzQ5MzM2MGI1ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuOTY3OTI2NywyOS4wNjE5OTM0XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICIjMzE4NmNjIiwKICAiZmlsbE9wYWNpdHkiOiAwLjcsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzliNDI0OTVlZDBhNTRlNWQ4ODYwMzkzOTRkNGM5MzRkKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2NhM2YwNTkzYjMyNjRhOGE4MzY3MTc2MzI1YTM5MzZiID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2JhN2ZiMzAwYjhjYTRhNmI5MTM4MDEyYjBiZTQxZGEzID0gJCgnPGRpdiBpZD0iaHRtbF9iYTdmYjMwMGI4Y2E0YTZiOTEzODAxMmIwYmU0MWRhMyIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+SXN0YW5idWwsIENhZGRlYm9zdGFuIG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfY2EzZjA1OTNiMzI2NGE4YTgzNjcxNzYzMjVhMzkzNmIuc2V0Q29udGVudChodG1sX2JhN2ZiMzAwYjhjYTRhNmI5MTM4MDEyYjBiZTQxZGEzKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzE0ZGI4ODBiN2MyOTQyODdhN2I3NjgwNzQ5MzM2MGI1LmJpbmRQb3B1cChwb3B1cF9jYTNmMDU5M2IzMjY0YThhODM2NzE3NjMyNWEzOTM2Yik7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9jYjY5YmQxZTI2MDA0NjQ2YTU4OGM2ZjkyNDY4NTUyMiA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjk4MzcxOTYsMjkuMDI1NjI1N10sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF84ZWExYWUxMzMzYjg0MmRhYjZlODVhM2MxYjA5OWZlOSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8zMmZiYmRjZjVjMjk0ZjlhODFhMDEyNDBmYzk2NGNiMSA9ICQoJzxkaXYgaWQ9Imh0bWxfMzJmYmJkY2Y1YzI5NGY5YTgxYTAxMjQwZmM5NjRjYjEiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBDYWZlcmFnYSBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzhlYTFhZTEzMzNiODQyZGFiNmU4NWEzYzFiMDk5ZmU5LnNldENvbnRlbnQoaHRtbF8zMmZiYmRjZjVjMjk0ZjlhODFhMDEyNDBmYzk2NGNiMSk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9jYjY5YmQxZTI2MDA0NjQ2YTU4OGM2ZjkyNDY4NTUyMi5iaW5kUG9wdXAocG9wdXBfOGVhMWFlMTMzM2I4NDJkYWI2ZTg1YTNjMWIwOTlmZTkpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfZGQ1OWM3OTBiZTZhNDQwOGE1ZGIwYmY3NmM2MjEwNDcgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC45ODk2NjgyLDI5LjA1MDM1NjddLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfZjg0M2Q0YzAzNzZlNDBlMDgxZmVmN2JjYWI0MzNlY2EgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMDdjMWZjOTgzYWE2NDFlYjkzOGNlYzllN2FkMzczYzggPSAkKCc8ZGl2IGlkPSJodG1sXzA3YzFmYzk4M2FhNjQxZWI5MzhjZWM5ZTdhZDM3M2M4IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgRWdpzId0acyHbSBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2Y4NDNkNGMwMzc2ZTQwZTA4MWZlZjdiY2FiNDMzZWNhLnNldENvbnRlbnQoaHRtbF8wN2MxZmM5ODNhYTY0MWViOTM4Y2VjOWU3YWQzNzNjOCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9kZDU5Yzc5MGJlNmE0NDA4YTVkYjBiZjc2YzYyMTA0Ny5iaW5kUG9wdXAocG9wdXBfZjg0M2Q0YzAzNzZlNDBlMDgxZmVmN2JjYWI0MzNlY2EpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfNjMyODQ2NzJmZDc2NGQ1Zjk3ZGZkNzZjMjQzOGJiMDkgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC45OTY2ODE4LDI5LjA0MzgxMDddLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfMjM1ZTEyMjZmYWYwNDkwZGEyMmE0NmNkYjU3MWIzMDQgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMzdiNDJlOGUyYWJjNGMwNDgwNDllZDE1ODY1MDZlYzcgPSAkKCc8ZGl2IGlkPSJodG1sXzM3YjQyZThlMmFiYzRjMDQ4MDQ5ZWQxNTg2NTA2ZWM3IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgSGFzYW5wYXNhIG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMjM1ZTEyMjZmYWYwNDkwZGEyMmE0NmNkYjU3MWIzMDQuc2V0Q29udGVudChodG1sXzM3YjQyZThlMmFiYzRjMDQ4MDQ5ZWQxNTg2NTA2ZWM3KTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzYzMjg0NjcyZmQ3NjRkNWY5N2RmZDc2YzI0MzhiYjA5LmJpbmRQb3B1cChwb3B1cF8yMzVlMTIyNmZhZjA0OTBkYTIyYTQ2Y2RiNTcxYjMwNCk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl82YTEyYTliMzk3YTY0NTY5YTMwODM3NDZhMzA3M2UwYiA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjk3MzE5NDksMjkuMDc2NTM4MV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF8xNTlhYzg0MjQ4NmU0ZThjYTczMTYxZjZhZTQwMGQyZCA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8xYWZjZGMwYmYyZjY0Y2Y2YjlmZTU5ZDM2MTgwZWVlMiA9ICQoJzxkaXYgaWQ9Imh0bWxfMWFmY2RjMGJmMmY2NGNmNmI5ZmU1OWQzNjE4MGVlZTIiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBFcmVua295IG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMTU5YWM4NDI0ODZlNGU4Y2E3MzE2MWY2YWU0MDBkMmQuc2V0Q29udGVudChodG1sXzFhZmNkYzBiZjJmNjRjZjZiOWZlNTlkMzYxODBlZWUyKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzZhMTJhOWIzOTdhNjQ1NjlhMzA4Mzc0NmEzMDczZTBiLmJpbmRQb3B1cChwb3B1cF8xNTlhYzg0MjQ4NmU0ZThjYTczMTYxZjZhZTQwMGQyZCk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl8yNTQ0YTIxMWM0YzU0MzY4OWMyYWE2M2MzZDc2MzRlYyA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjk3NDI4NjIwMDAwMDAxLDI5LjA0MzA4MzNdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfNjNjZmZkNTViNjQwNGRkODlkZTJlZTVmZmZkOWM2NDAgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMTVkYjQzYzY5MWVlNGQ3ZmIwOGY0M2JkNzY3NTU2ZTAgPSAkKCc8ZGl2IGlkPSJodG1sXzE1ZGI0M2M2OTFlZTRkN2ZiMDhmNDNiZDc2NzU1NmUwIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgRmVuZXJiYWhjZSBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzYzY2ZmZDU1YjY0MDRkZDg5ZGUyZWU1ZmZmZDljNjQwLnNldENvbnRlbnQoaHRtbF8xNWRiNDNjNjkxZWU0ZDdmYjA4ZjQzYmQ3Njc1NTZlMCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl8yNTQ0YTIxMWM0YzU0MzY4OWMyYWE2M2MzZDc2MzRlYy5iaW5kUG9wdXAocG9wdXBfNjNjZmZkNTViNjQwNGRkODlkZTJlZTVmZmZkOWM2NDApOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfOTQ3NTZkNTEyOWU4NGQ5ZWJkNjNkYWVhOTczY2EwMjEgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC45ODE5NTczLDI5LjA0ODkwMTk5OTk5OTk5XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICIjMzE4NmNjIiwKICAiZmlsbE9wYWNpdHkiOiAwLjcsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzliNDI0OTVlZDBhNTRlNWQ4ODYwMzkzOTRkNGM5MzRkKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2M0YzJlMGU1NGQyZTQyZWJiNzZhM2FjMTQ0MDA0NTNiID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2Q3YjRjMjQzZTE1ODQ2YTA4OTdmY2VhMmJhNzRiODk1ID0gJCgnPGRpdiBpZD0iaHRtbF9kN2I0YzI0M2UxNTg0NmEwODk3ZmNlYTJiYTc0Yjg5NSIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+SXN0YW5idWwsIEZlbmVyeW9sdSBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2M0YzJlMGU1NGQyZTQyZWJiNzZhM2FjMTQ0MDA0NTNiLnNldENvbnRlbnQoaHRtbF9kN2I0YzI0M2UxNTg0NmEwODk3ZmNlYTJiYTc0Yjg5NSk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl85NDc1NmQ1MTI5ZTg0ZDllYmQ2M2RhZWE5NzNjYTAyMS5iaW5kUG9wdXAocG9wdXBfYzRjMmUwZTU0ZDJlNDJlYmI3NmEzYWMxNDQwMDQ1M2IpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfNzc3MDgwZDA0NmQxNDRhZmIwNTkzYzdmZWVmNWZkYzYgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC45ODU5MTU3LDI5LjAzODcxOTFdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfMDYxZDlkNGQyYjdiNDBhZTg4YmJkN2E4YWE1MTQ4OGUgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMzY5MDRkZGNmZTFhNGNhYjljMjU2NTA4YTdjNWMyOTUgPSAkKCc8ZGl2IGlkPSJodG1sXzM2OTA0ZGRjZmUxYTRjYWI5YzI1NjUwOGE3YzVjMjk1IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgWnVodHVwYXNhIG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMDYxZDlkNGQyYjdiNDBhZTg4YmJkN2E4YWE1MTQ4OGUuc2V0Q29udGVudChodG1sXzM2OTA0ZGRjZmUxYTRjYWI5YzI1NjUwOGE3YzVjMjk1KTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzc3NzA4MGQwNDZkMTQ0YWZiMDU5M2M3ZmVlZjVmZGM2LmJpbmRQb3B1cChwb3B1cF8wNjFkOWQ0ZDJiN2I0MGFlODhiYmQ3YThhYTUxNDg4ZSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl81MzdjN2RhYWI0NDk0ZGIwYTc0MDVkOTk5OWU2OGZiNCA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjk5NDIxODgsMjkuMDU5MDg0Mjk5OTk5OTldLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfYzQ0ZjJmNDZmOTI1NDM1Nzk2MDQ1ODVhMjBjZDhjNDYgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfOGRlYTE3Nzc3NjdjNDQ0OWE2ODBiMTM1ODllNWY3YWYgPSAkKCc8ZGl2IGlkPSJodG1sXzhkZWExNzc3NzY3YzQ0NDlhNjgwYjEzNTg5ZTVmN2FmIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgRHVtbHVwaW5hciBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2M0NGYyZjQ2ZjkyNTQzNTc5NjA0NTg1YTIwY2Q4YzQ2LnNldENvbnRlbnQoaHRtbF84ZGVhMTc3Nzc2N2M0NDQ5YTY4MGIxMzU4OWU1ZjdhZik7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl81MzdjN2RhYWI0NDk0ZGIwYTc0MDVkOTk5OWU2OGZiNC5iaW5kUG9wdXAocG9wdXBfYzQ0ZjJmNDZmOTI1NDM1Nzk2MDQ1ODVhMjBjZDhjNDYpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfMWY0ZDVhN2VjMWIxNGQ3OTk3NDliZTcwMGZhZTUyNzQgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC45OTQzMDI1LDI5LjA1MDM1NjddLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfYWJiZWNhMjI5OGM2NDA5NWIxZTYyM2ZiMzhhNWVmMjkgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfNDIyMDcyNjg4Yjg2NDYxODgyMTE4MjgxMWEzNjNjNDcgPSAkKCc8ZGl2IGlkPSJodG1sXzQyMjA3MjY4OGI4NjQ2MTg4MjExODI4MTFhMzYzYzQ3IiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgRmnMh2tpzIdydGVwZSBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwX2FiYmVjYTIyOThjNjQwOTViMWU2MjNmYjM4YTVlZjI5LnNldENvbnRlbnQoaHRtbF80MjIwNzI2ODhiODY0NjE4ODIxMTgyODExYTM2M2M0Nyk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl8xZjRkNWE3ZWMxYjE0ZDc5OTc0OWJlNzAwZmFlNTI3NC5iaW5kUG9wdXAocG9wdXBfYWJiZWNhMjI5OGM2NDA5NWIxZTYyM2ZiMzhhNWVmMjkpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfNTE0YTkwYWVhMWVjNDZlMWI0YTBlNTYyYTcwNzM5NTEgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC45NzcxNTU4LDI5LjA2NjM1N10sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF8zOTAzMThhNWM4MmQ0ODI1YjA2Zjk2OWY1MDdjZDUxZSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8zOTRlYjM3MzU3NGQ0OThmYjIxNDZmYTllZWI4NTAxNiA9ICQoJzxkaXYgaWQ9Imh0bWxfMzk0ZWIzNzM1NzRkNDk4ZmIyMTQ2ZmE5ZWViODUwMTYiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBHb3p0ZXBlIG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfMzkwMzE4YTVjODJkNDgyNWIwNmY5NjlmNTA3Y2Q1MWUuc2V0Q29udGVudChodG1sXzM5NGViMzczNTc0ZDQ5OGZiMjE0NmZhOWVlYjg1MDE2KTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzUxNGE5MGFlYTFlYzQ2ZTFiNGEwZTU2MmE3MDczOTUxLmJpbmRQb3B1cChwb3B1cF8zOTAzMThhNWM4MmQ0ODI1YjA2Zjk2OWY1MDdjZDUxZSk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl80ODIyNDM4ZjA4NzU0N2I4YmZjZDRjYTVmMDhkMGRlYSA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQxLjAwMjEzNjMsMjkuMDM4NzE5MV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF81ZTY2ZjRiNTNmMGQ0ZTg1YmEzN2RhMzI2NTA0NTliNSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF84ZjRkOWU5ZjZjZGU0MzQ0YTE1YjllYzk0MDM2ZDI5NSA9ICQoJzxkaXYgaWQ9Imh0bWxfOGY0ZDllOWY2Y2RlNDM0NGExNWI5ZWM5NDAzNmQyOTUiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBBY2liYWRlbSBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzVlNjZmNGI1M2YwZDRlODViYTM3ZGEzMjY1MDQ1OWI1LnNldENvbnRlbnQoaHRtbF84ZjRkOWU5ZjZjZGU0MzQ0YTE1YjllYzk0MDM2ZDI5NSk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl80ODIyNDM4ZjA4NzU0N2I4YmZjZDRjYTVmMDhkMGRlYS5iaW5kUG9wdXAocG9wdXBfNWU2NmY0YjUzZjBkNGU4NWJhMzdkYTMyNjUwNDU5YjUpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfYjYyZWVlMjY3MDlhNDU4ZDhlOTljMDYxZWZjMDc1MGYgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MS4wMDkwODY2LDI5LjAzODcxOTFdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfNzFkMGQzMzAwZTE4NDdjNWJkNmQ3ZjY1ZTE0Y2Y3ODkgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfODgwMzlmNGMzYzdkNDI5NTlhMTBlZDAzYjlmNzg1NzIgPSAkKCc8ZGl2IGlkPSJodG1sXzg4MDM5ZjRjM2M3ZDQyOTU5YTEwZWQwM2I5Zjc4NTcyIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgS29zdXlvbHUgbWFoPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF83MWQwZDMzMDBlMTg0N2M1YmQ2ZDdmNjVlMTRjZjc4OS5zZXRDb250ZW50KGh0bWxfODgwMzlmNGMzYzdkNDI5NTlhMTBlZDAzYjlmNzg1NzIpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfYjYyZWVlMjY3MDlhNDU4ZDhlOTljMDYxZWZjMDc1MGYuYmluZFBvcHVwKHBvcHVwXzcxZDBkMzMwMGUxODQ3YzViZDZkN2Y2NWUxNGNmNzg5KTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzZlODU4YjIyNjIxNTQ1YmFhNDg2NjU0YzNhYTVlOTQ1ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuOTY5MTQ3MSwyOS4wOTU0NDRdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfYTUyYzIxYmYzMzU4NDkyOWFhOWQ2MzkxZWZiMWJkMGMgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfNWVjMzc2ZDcyZmU1NGEzNGI0MzRiN2Q4NDdjMzY5MGIgPSAkKCc8ZGl2IGlkPSJodG1sXzVlYzM3NmQ3MmZlNTRhMzRiNDM0YjdkODQ3YzM2OTBiIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgS296eWF0YWdpIG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfYTUyYzIxYmYzMzU4NDkyOWFhOWQ2MzkxZWZiMWJkMGMuc2V0Q29udGVudChodG1sXzVlYzM3NmQ3MmZlNTRhMzRiNDM0YjdkODQ3YzM2OTBiKTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzZlODU4YjIyNjIxNTQ1YmFhNDg2NjU0YzNhYTVlOTQ1LmJpbmRQb3B1cChwb3B1cF9hNTJjMjFiZjMzNTg0OTI5YWE5ZDYzOTFlZmIxYmQwYyk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl82MmI4ODBiOGNiN2M0ZjYwOGEyMWRmMmJlNWJhYWIwNCA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjk4NjQyNTEsMjkuMDY2MzU3XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICIjMzE4NmNjIiwKICAiZmlsbE9wYWNpdHkiOiAwLjcsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzliNDI0OTVlZDBhNTRlNWQ4ODYwMzkzOTRkNGM5MzRkKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2IxNzFmZDU0ZmJjNDQzZTZhMmRmZTkwMjhjMTc3NGEwID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sX2YzMTBjZjQ5MjgwMDRkMTBiOTZjZGNmOThiOWNmN2UxID0gJCgnPGRpdiBpZD0iaHRtbF9mMzEwY2Y0OTI4MDA0ZDEwYjk2Y2RjZjk4YjljZjdlMSIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+SXN0YW5idWwsIE1lcmRpzId2ZW5rb3kgbWFoPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF9iMTcxZmQ1NGZiYzQ0M2U2YTJkZmU5MDI4YzE3NzRhMC5zZXRDb250ZW50KGh0bWxfZjMxMGNmNDkyODAwNGQxMGI5NmNkY2Y5OGI5Y2Y3ZTEpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfNjJiODgwYjhjYjdjNGY2MDhhMjFkZjJiZTViYWFiMDQuYmluZFBvcHVwKHBvcHVwX2IxNzFmZDU0ZmJjNDQzZTZhMmRmZTkwMjhjMTc3NGEwKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyX2RhYjVlMmYyZTYwZTQ0NzE5MDdjMjgxYWQ3YmQzN2EwID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuOTc0NjI2MDk5OTk5OTksMjkuMDg4MTcyOF0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF8yZDFlMzNiZTRkNTA0MGE4YTBmYmQ5M2QzNmNiOWZjMSA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF84NTRlNjE4ZDBiZmQ0NTNiOWNhYTJhYzQyZWE5M2Y2MCA9ICQoJzxkaXYgaWQ9Imh0bWxfODU0ZTYxOGQwYmZkNDUzYjljYWEyYWM0MmVhOTNmNjAiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCAxOSBtYXlpcyBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzJkMWUzM2JlNGQ1MDQwYThhMGZiZDkzZDM2Y2I5ZmMxLnNldENvbnRlbnQoaHRtbF84NTRlNjE4ZDBiZmQ0NTNiOWNhYTJhYzQyZWE5M2Y2MCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9kYWI1ZTJmMmU2MGU0NDcxOTA3YzI4MWFkN2JkMzdhMC5iaW5kUG9wdXAocG9wdXBfMmQxZTMzYmU0ZDUwNDBhOGEwZmJkOTNkMzZjYjlmYzEpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfZTgyZDI5NmYxYTM4NGNhYjkyYWVhNjI2NWFkMTRmYmIgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC45OTE0MzE3LDI5LjAyNzA4MDZdLAogICAgICAgICAgICAgICAgewogICJidWJibGluZ01vdXNlRXZlbnRzIjogdHJ1ZSwKICAiY29sb3IiOiAiYmx1ZSIsCiAgImRhc2hBcnJheSI6IG51bGwsCiAgImRhc2hPZmZzZXQiOiBudWxsLAogICJmaWxsIjogdHJ1ZSwKICAiZmlsbENvbG9yIjogIiMzMTg2Y2MiLAogICJmaWxsT3BhY2l0eSI6IDAuNywKICAiZmlsbFJ1bGUiOiAiZXZlbm9kZCIsCiAgImxpbmVDYXAiOiAicm91bmQiLAogICJsaW5lSm9pbiI6ICJyb3VuZCIsCiAgIm9wYWNpdHkiOiAxLjAsCiAgInJhZGl1cyI6IDUsCiAgInN0cm9rZSI6IHRydWUsCiAgIndlaWdodCI6IDMKfQogICAgICAgICAgICAgICAgKS5hZGRUbyhtYXBfOWI0MjQ5NWVkMGE1NGU1ZDg4NjAzOTM5NGQ0YzkzNGQpOwogICAgICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgcG9wdXBfOTE4YTQ5OTM3Zjg4NDg2ZGFlMDM2MTgwNWNiOWVhNzMgPSBMLnBvcHVwKHttYXhXaWR0aDogJzMwMCd9KTsKCiAgICAgICAgICAgIAogICAgICAgICAgICAgICAgdmFyIGh0bWxfMjg5ODc4NjZkNjRjNDY3ZmFkMmYyZGIzNGQ5MzhlNzIgPSAkKCc8ZGl2IGlkPSJodG1sXzI4OTg3ODY2ZDY0YzQ2N2ZhZDJmMmRiMzRkOTM4ZTcyIiBzdHlsZT0id2lkdGg6IDEwMC4wJTsgaGVpZ2h0OiAxMDAuMCU7Ij5Jc3RhbmJ1bCwgT3NtYW5hZ2EgbWFoPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF85MThhNDk5MzdmODg0ODZkYWUwMzYxODA1Y2I5ZWE3My5zZXRDb250ZW50KGh0bWxfMjg5ODc4NjZkNjRjNDY3ZmFkMmYyZGIzNGQ5MzhlNzIpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfZTgyZDI5NmYxYTM4NGNhYjkyYWVhNjI2NWFkMTRmYmIuYmluZFBvcHVwKHBvcHVwXzkxOGE0OTkzN2Y4ODQ4NmRhZTAzNjE4MDVjYjllYTczKTsKCiAgICAgICAgICAgIAogICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBjaXJjbGVfbWFya2VyXzc0Y2RlOWFmOTM0NTRhM2ZiYzI0M2ViYzRkMzI1YTI0ID0gTC5jaXJjbGVNYXJrZXIoCiAgICAgICAgICAgICAgICBbNDAuOTk2MDY2NSwyOS4wMjcwODA2XSwKICAgICAgICAgICAgICAgIHsKICAiYnViYmxpbmdNb3VzZUV2ZW50cyI6IHRydWUsCiAgImNvbG9yIjogImJsdWUiLAogICJkYXNoQXJyYXkiOiBudWxsLAogICJkYXNoT2Zmc2V0IjogbnVsbCwKICAiZmlsbCI6IHRydWUsCiAgImZpbGxDb2xvciI6ICIjMzE4NmNjIiwKICAiZmlsbE9wYWNpdHkiOiAwLjcsCiAgImZpbGxSdWxlIjogImV2ZW5vZGQiLAogICJsaW5lQ2FwIjogInJvdW5kIiwKICAibGluZUpvaW4iOiAicm91bmQiLAogICJvcGFjaXR5IjogMS4wLAogICJyYWRpdXMiOiA1LAogICJzdHJva2UiOiB0cnVlLAogICJ3ZWlnaHQiOiAzCn0KICAgICAgICAgICAgICAgICkuYWRkVG8obWFwXzliNDI0OTVlZDBhNTRlNWQ4ODYwMzkzOTRkNGM5MzRkKTsKICAgICAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIHBvcHVwX2ZjNTM4NzQxNDI4ODQ2NGJhYmNlYjExM2Q5MjZjNjg4ID0gTC5wb3B1cCh7bWF4V2lkdGg6ICczMDAnfSk7CgogICAgICAgICAgICAKICAgICAgICAgICAgICAgIHZhciBodG1sXzMyOTdhODZiNTdkYTRjMjk5ZjMzNTAwOThmYjE3YzY4ID0gJCgnPGRpdiBpZD0iaHRtbF8zMjk3YTg2YjU3ZGE0YzI5OWYzMzUwMDk4ZmIxN2M2OCIgc3R5bGU9IndpZHRoOiAxMDAuMCU7IGhlaWdodDogMTAwLjAlOyI+SXN0YW5idWwsIFJhc2nMh21wYXNhIG1haDwvZGl2PicpWzBdOwogICAgICAgICAgICAgICAgcG9wdXBfZmM1Mzg3NDE0Mjg4NDY0YmFiY2ViMTEzZDkyNmM2ODguc2V0Q29udGVudChodG1sXzMyOTdhODZiNTdkYTRjMjk5ZjMzNTAwOThmYjE3YzY4KTsKICAgICAgICAgICAgCgogICAgICAgICAgICBjaXJjbGVfbWFya2VyXzc0Y2RlOWFmOTM0NTRhM2ZiYzI0M2ViYzRkMzI1YTI0LmJpbmRQb3B1cChwb3B1cF9mYzUzODc0MTQyODg0NjRiYWJjZWIxMTNkOTI2YzY4OCk7CgogICAgICAgICAgICAKICAgICAgICAKICAgIAogICAgICAgICAgICB2YXIgY2lyY2xlX21hcmtlcl9jYWFiNzVhMDYwZDc0ODRlYTBiZTEzYjYyOWQxZGMzZSA9IEwuY2lyY2xlTWFya2VyKAogICAgICAgICAgICAgICAgWzQwLjk4OTQsMjkuMDc5OF0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF8zOGMwMDM3YzE4YWQ0NjQyYmY3MDc4NWQzYWQ4ODE0NCA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF8yZDFmOTVkYjc3ZTU0Y2QxODYxNzZiM2ZjYmRkZTZjOCA9ICQoJzxkaXYgaWQ9Imh0bWxfMmQxZjk1ZGI3N2U1NGNkMTg2MTc2YjNmY2JkZGU2YzgiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBTYWhyYXlpY2VkacyHdCBtYWg8L2Rpdj4nKVswXTsKICAgICAgICAgICAgICAgIHBvcHVwXzM4YzAwMzdjMThhZDQ2NDJiZjcwNzg1ZDNhZDg4MTQ0LnNldENvbnRlbnQoaHRtbF8yZDFmOTVkYjc3ZTU0Y2QxODYxNzZiM2ZjYmRkZTZjOCk7CiAgICAgICAgICAgIAoKICAgICAgICAgICAgY2lyY2xlX21hcmtlcl9jYWFiNzVhMDYwZDc0ODRlYTBiZTEzYjYyOWQxZGMzZS5iaW5kUG9wdXAocG9wdXBfMzhjMDAzN2MxOGFkNDY0MmJmNzA3ODVkM2FkODgxNDQpOwoKICAgICAgICAgICAgCiAgICAgICAgCiAgICAKICAgICAgICAgICAgdmFyIGNpcmNsZV9tYXJrZXJfMTM4ZjA5N2VlYjI4NDY2N2I3ZjE3N2E1Y2RmMjYzYTYgPSBMLmNpcmNsZU1hcmtlcigKICAgICAgICAgICAgICAgIFs0MC45NjMwODEsMjkuMDgzODA5OV0sCiAgICAgICAgICAgICAgICB7CiAgImJ1YmJsaW5nTW91c2VFdmVudHMiOiB0cnVlLAogICJjb2xvciI6ICJibHVlIiwKICAiZGFzaEFycmF5IjogbnVsbCwKICAiZGFzaE9mZnNldCI6IG51bGwsCiAgImZpbGwiOiB0cnVlLAogICJmaWxsQ29sb3IiOiAiIzMxODZjYyIsCiAgImZpbGxPcGFjaXR5IjogMC43LAogICJmaWxsUnVsZSI6ICJldmVub2RkIiwKICAibGluZUNhcCI6ICJyb3VuZCIsCiAgImxpbmVKb2luIjogInJvdW5kIiwKICAib3BhY2l0eSI6IDEuMCwKICAicmFkaXVzIjogNSwKICAic3Ryb2tlIjogdHJ1ZSwKICAid2VpZ2h0IjogMwp9CiAgICAgICAgICAgICAgICApLmFkZFRvKG1hcF85YjQyNDk1ZWQwYTU0ZTVkODg2MDM5Mzk0ZDRjOTM0ZCk7CiAgICAgICAgICAgIAogICAgCiAgICAgICAgICAgIHZhciBwb3B1cF81MzAzODliNGQxODY0Zjc2YTk5ZTk3OTcxZDMzZTBjYyA9IEwucG9wdXAoe21heFdpZHRoOiAnMzAwJ30pOwoKICAgICAgICAgICAgCiAgICAgICAgICAgICAgICB2YXIgaHRtbF80MGY0Mjk2YzFiN2Y0NTRiYjIzMGI4M2E4NmQyNjA1ZiA9ICQoJzxkaXYgaWQ9Imh0bWxfNDBmNDI5NmMxYjdmNDU0YmIyMzBiODNhODZkMjYwNWYiIHN0eWxlPSJ3aWR0aDogMTAwLjAlOyBoZWlnaHQ6IDEwMC4wJTsiPklzdGFuYnVsLCBTdWFkacyHeWUgbWFoPC9kaXY+JylbMF07CiAgICAgICAgICAgICAgICBwb3B1cF81MzAzODliNGQxODY0Zjc2YTk5ZTk3OTcxZDMzZTBjYy5zZXRDb250ZW50KGh0bWxfNDBmNDI5NmMxYjdmNDU0YmIyMzBiODNhODZkMjYwNWYpOwogICAgICAgICAgICAKCiAgICAgICAgICAgIGNpcmNsZV9tYXJrZXJfMTM4ZjA5N2VlYjI4NDY2N2I3ZjE3N2E1Y2RmMjYzYTYuYmluZFBvcHVwKHBvcHVwXzUzMDM4OWI0ZDE4NjRmNzZhOTllOTc5NzFkMzNlMGNjKTsKCiAgICAgICAgICAgIAogICAgICAgIAo8L3NjcmlwdD4= onload=\"this.contentDocument.open();this.contentDocument.write(atob(this.getAttribute('data-html')));this.contentDocument.close();\" allowfullscreen webkitallowfullscreen mozallowfullscreen></iframe></div></div>"
      ],
      "text/plain": [
       "<folium.folium.Map at 0x7f7932000f28>"
      ]
     },
     "execution_count": 59,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import folium\n",
    "\n",
    "#Show an initial map of the neighborhoods in Kadıköy and Beşiktaş\n",
    "# create map of Kadıköy and Beşiktaş using first entries latitude and longitude values\n",
    "map_ist = folium.Map(location=[df[\"lat\"][0], df[\"lng\"][0]], zoom_start=12)\n",
    "\n",
    "# add markers to map\n",
    "for lat, lng, borough in zip(df['lat'], df['lng'], df['Borough']):\n",
    "    label = 'Istanbul, {}'.format(borough)\n",
    "\n",
    "    label = folium.Popup(label, parse_html=True)\n",
    "    folium.CircleMarker(\n",
    "        [lat, lng],\n",
    "        radius=5,\n",
    "        popup=label,\n",
    "        color='blue',\n",
    "        fill=True,\n",
    "        fill_color='#3186cc',\n",
    "        fill_opacity=0.7,\n",
    "        parse_html=False).add_to(map_ist)  \n",
    "    \n",
    "map_ist"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h1>Getting more information about Neighborhoods</h1>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Splitting Kadıköy and Beşiktaş\n",
    "\n",
    "We need to split the data to find out the pioneer town for the purpose. We will check the creation dates of the venues to find out which has the venues first"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(21, 7)\n",
      "(23, 7)\n"
     ]
    }
   ],
   "source": [
    "#Filter Kadikoy data to only use boroughs in Kadikoy\n",
    "kadikoy_df = df[df['Town'].str.contains('Kadikoy')]\n",
    "print(kadikoy_df.shape)\n",
    "#Filter Kadikoy data to only use boroughs in Kadikoy\n",
    "besiktas_df = df[df['Town'].str.contains('Besi̇ktas')]\n",
    "print(besiktas_df.shape)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<h3>Use Four Square API to Explore</h3>\n",
    "Using the Foursquare API to explore the neighborhoods and segment them"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "CLIENT_ID = '[RESETTED]' \n",
    "CLIENT_SECRET = '[RESETTED]' # WILL BE RESETTED AFTER RUN\n",
    "VERSION = '20180605' # Foursquare API version"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### The Foursquare API call\n",
    "\n",
    "First endpoint will be the Venue - Search of Foursquare\n",
    "\n",
    "We will use :\n",
    "\n",
    "- **100 Venues limit**\n",
    "- **500 m radius around the coordinates of neighborhood**\n",
    "- **_Gym / Fitness Center_ category on Foursquare**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Let's create a function to find venue information around the given coordinates"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "\n",
    "def getNearbyVenues(names, latitudes, longitudes, radius=500):\n",
    "    LIMIT = 100 #max numbers of venues\n",
    "    venues_list=[]\n",
    "    for name, lat, lng in zip(names, latitudes, longitudes):\n",
    "        print(name)\n",
    "            \n",
    "        # create the API request URL\n",
    "        url = 'https://api.foursquare.com/v2/venues/search?client_id={}&client_secret={}&ll={},{}&v={}&radius={}&limit={}&categoryId=4bf58dd8d48988d175941735'.format(\n",
    "            CLIENT_ID,\n",
    "            CLIENT_SECRET,\n",
    "            lat,\n",
    "            lng,\n",
    "            VERSION,\n",
    "            radius,\n",
    "            LIMIT\n",
    "        )\n",
    "            \n",
    "        # make the GET request\n",
    "        results = requests.get(url).json()['response']['venues']\n",
    "\n",
    "        # return only relevant information for each nearby venue\n",
    "        for v in results:\n",
    "            venues_list.append([(\n",
    "                name, \n",
    "                lat, \n",
    "                lng,\n",
    "                v['id'],\n",
    "                v['name'], \n",
    "                v['location']['lat'], \n",
    "                v['location']['lng'],\n",
    "                v['location']['distance'],\n",
    "                v['categories'][0]['name'])])\n",
    "\n",
    "        nearby_venues = pd.DataFrame([item for venue_list in venues_list for item in venue_list])\n",
    "        nearby_venues.columns = ['Neighborhood', \n",
    "                                  'Neighborhood Latitude', \n",
    "                                  'Neighborhood Longitude', \n",
    "                                  'Venue ID',\n",
    "                                  'Venue', \n",
    "                                  'Venue Latitude', \n",
    "                                  'Venue Longitude',\n",
    "                                  'Venue Distance',\n",
    "                                  'Venue Category']\n",
    "    \n",
    "    return(nearby_venues)\n",
    "    "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Now write the code to run the above function on each neighborhood and create 2 new dataframse called *kadikoy_venues_df* and *besiktas_venues_df*."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Bostanci mah\n",
      "Caddebostan mah\n",
      "Caferaga mah\n",
      "Egi̇ti̇m mah\n",
      "Hasanpasa mah\n",
      "Erenkoy mah\n",
      "Fenerbahce mah\n",
      "Feneryolu mah\n",
      "Zuhtupasa mah\n",
      "Dumlupinar mah\n",
      "Fi̇ki̇rtepe mah\n",
      "Goztepe mah\n",
      "Acibadem mah\n",
      "Kosuyolu mah\n",
      "Kozyatagi mah\n",
      "Merdi̇venkoy mah\n",
      "19 mayis mah\n",
      "Osmanaga mah\n",
      "Rasi̇mpasa mah\n",
      "Sahrayicedi̇t mah\n",
      "Suadi̇ye mah\n"
     ]
    }
   ],
   "source": [
    "#Get all kadikoy gym/studio venues\n",
    "kadikoy_venues_df = getNearbyVenues(names=kadikoy_df['Borough'],\n",
    "                                   latitudes=kadikoy_df['lat'],\n",
    "                                   longitudes=kadikoy_df['lng']\n",
    "                                  )"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Abbasaga mah\n",
      "Ci̇hannuma mah\n",
      "Si̇nanpasa mah\n",
      "Akat mah\n",
      "Arnavutkoy mah\n",
      "Kurucesme mah\n",
      "Bebek mah\n",
      "Eti̇ler mah\n",
      "Balmumcu mah\n",
      "Di̇ki̇li̇tas mah\n",
      "Gayrettepe mah\n",
      "Yildiz mah\n",
      "Kultur mah\n",
      "Levazim mah\n",
      "Ni̇sbeti̇ye mah\n",
      "Ulus mah\n",
      "Konaklar mah\n",
      "Levent mah\n",
      "Meci̇di̇ye mah\n",
      "Ortakoy mah\n",
      "Muradi̇ye mah\n",
      "Turkali̇ mah\n",
      "Vi̇snezade mah\n"
     ]
    }
   ],
   "source": [
    "#Get all besiktas gym/studio venues\n",
    "besiktas_venues_df = getNearbyVenues(names=besiktas_df['Borough'],\n",
    "                                   latitudes=besiktas_df['lat'],\n",
    "                                   longitudes=besiktas_df['lng']\n",
    "                                  )"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Let's check the size of the resulting dataframes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "758 venues are returned from API call\n",
      "658 venues are returned from API call\n",
      "504 unique venues are returned from API call\n",
      "572 unique venues are returned from API call\n"
     ]
    }
   ],
   "source": [
    "print('{} venues are returned from API call'.format(len(besiktas_venues_df.index)))\n",
    "print('{} venues are returned from API call'.format(len(kadikoy_venues_df.index)))\n",
    "print('{} unique venues are returned from API call'.format(len(besiktas_venues_df['Venue ID'].unique())))\n",
    "print('{} unique venues are returned from API call'.format(len(kadikoy_venues_df['Venue ID'].unique())))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### As it can be seen above, there are duplicate venues for different neighborhoods \n",
    "\n",
    "With the following preprocessing, the duplicate venues will be dropped according to venue distance to the borough center. Only the closest one will be kept."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "besiktas_venues_df=besiktas_venues_df.loc[besiktas_venues_df.groupby('Venue ID')['Venue Distance'].idxmin()]\n",
    "kadikoy_venues_df=kadikoy_venues_df.loc[kadikoy_venues_df.groupby('Venue ID')['Venue Distance'].idxmin()]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "504 venues listed in the besiktas_venues_df after the process\n",
      "572 venues listed in the kadikoy_venues_df after the process\n"
     ]
    }
   ],
   "source": [
    "print('{} venues listed in the besiktas_venues_df after the process'.format(len(besiktas_venues_df.index)))\n",
    "print('{} venues listed in the kadikoy_venues_df after the process'.format(len(kadikoy_venues_df.index)))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Perfect, this matches with the unique venue check above"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Let's check the category accuracy"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "['Basketball Court' 'Gym' 'Gym / Fitness Center' 'Hotel' 'Track'\n",
      " 'Sports Club' 'Yoga Studio' 'Daycare' 'Martial Arts Dojo' 'Gym Pool'\n",
      " 'General Entertainment' 'College Gym' 'Mobile Phone Shop'\n",
      " 'Athletics & Sports' 'Animal Shelter' 'Track Stadium' \"Doctor's Office\"\n",
      " 'Pilates Studio' 'Gymnastics Gym' 'Cycle Studio' 'Housing Development'\n",
      " 'Boxing Gym' 'Sporting Goods Shop' 'Social Club' 'Outdoor Gym'\n",
      " 'Concert Hall' 'Restaurant' 'Weight Loss Center']\n",
      "['Gym' 'Gym / Fitness Center' 'Gym Pool' 'Spa' 'Yoga Studio' 'Pool'\n",
      " 'Martial Arts Dojo' 'Shopping Mall' 'Track' 'Climbing Gym' 'Building'\n",
      " 'Athletics & Sports' 'Gymnastics Gym' 'Cycle Studio' 'Boxing Gym'\n",
      " 'Pilates Studio' 'Social Club' 'Miscellaneous Shop' 'Weight Loss Center'\n",
      " 'Event Service']\n"
     ]
    }
   ],
   "source": [
    "print(kadikoy_venues_df['Venue Category'].unique())\n",
    "print(besiktas_venues_df['Venue Category'].unique())"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Unfortunately, we do have unwanted categories\n",
    "\n",
    "[According to the documentation of Foursquare](https://developer.foursquare.com/docs/build-with-foursquare/categories/), the category ID for **Gym / Fitness Center** is  _4bf58dd8d48988d175941735_ and it should return \n",
    "\n",
    "- Gym / Fitness Center\n",
    "- Boxing Gym\n",
    "- Climbing Gym\n",
    "- Cycle Studio\n",
    "- Gym Pool\n",
    "- Gymnastics Gym\n",
    "- Gym\n",
    "- Martial Arts Dojo\n",
    "- Outdoor Gym\n",
    "- Pilates Studio\n",
    "- Track\n",
    "- Weight Loss Center\n",
    "- Yoga Studio\n",
    "\n",
    "We will remove the redundant categories"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "['Gym' 'Gym / Fitness Center' 'Track' 'Yoga Studio' 'Martial Arts Dojo'\n",
      " 'Gym Pool' 'Pilates Studio' 'Gymnastics Gym' 'Cycle Studio' 'Boxing Gym'\n",
      " 'Outdoor Gym' 'Weight Loss Center']\n",
      "['Gym' 'Gym / Fitness Center' 'Gym Pool' 'Yoga Studio' 'Martial Arts Dojo'\n",
      " 'Track' 'Climbing Gym' 'Gymnastics Gym' 'Cycle Studio' 'Boxing Gym'\n",
      " 'Pilates Studio' 'Weight Loss Center']\n"
     ]
    }
   ],
   "source": [
    "Category_list=['Gym / Fitness Center','Boxing Gym','Climbing Gym','Cycle Studio','Gym Pool','Gymnastics Gym','Gym','Martial Arts Dojo','Outdoor Gym','Pilates Studio','Track','Weight Loss Center','Yoga Studio']\n",
    "kadikoy_venues_df=kadikoy_venues_df[kadikoy_venues_df['Venue Category'].isin(Category_list)]\n",
    "besiktas_venues_df=besiktas_venues_df[besiktas_venues_df['Venue Category'].isin(Category_list)]\n",
    "print(kadikoy_venues_df['Venue Category'].unique())\n",
    "print(besiktas_venues_df['Venue Category'].unique())\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Let's check how many venues were returned for each neighborhood"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Venue</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Neighborhood</th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>Abbasaga mah</th>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Akat mah</th>\n",
       "      <td>28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Arnavutkoy mah</th>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Balmumcu mah</th>\n",
       "      <td>16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Bebek mah</th>\n",
       "      <td>25</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Ci̇hannuma mah</th>\n",
       "      <td>17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Di̇ki̇li̇tas mah</th>\n",
       "      <td>42</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Eti̇ler mah</th>\n",
       "      <td>24</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Gayrettepe mah</th>\n",
       "      <td>43</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Konaklar mah</th>\n",
       "      <td>10</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Kultur mah</th>\n",
       "      <td>33</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Kurucesme mah</th>\n",
       "      <td>14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Levazim mah</th>\n",
       "      <td>14</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Levent mah</th>\n",
       "      <td>34</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Meci̇di̇ye mah</th>\n",
       "      <td>16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Muradi̇ye mah</th>\n",
       "      <td>35</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Ni̇sbeti̇ye mah</th>\n",
       "      <td>39</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Ortakoy mah</th>\n",
       "      <td>8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Si̇nanpasa mah</th>\n",
       "      <td>20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Turkali̇ mah</th>\n",
       "      <td>21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Ulus mah</th>\n",
       "      <td>16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Vi̇snezade mah</th>\n",
       "      <td>18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Yildiz mah</th>\n",
       "      <td>10</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                  Venue\n",
       "Neighborhood           \n",
       "Abbasaga mah          4\n",
       "Akat mah             28\n",
       "Arnavutkoy mah        5\n",
       "Balmumcu mah         16\n",
       "Bebek mah            25\n",
       "Ci̇hannuma mah       17\n",
       "Di̇ki̇li̇tas mah     42\n",
       "Eti̇ler mah          24\n",
       "Gayrettepe mah       43\n",
       "Konaklar mah         10\n",
       "Kultur mah           33\n",
       "Kurucesme mah        14\n",
       "Levazim mah          14\n",
       "Levent mah           34\n",
       "Meci̇di̇ye mah       16\n",
       "Muradi̇ye mah        35\n",
       "Ni̇sbeti̇ye mah      39\n",
       "Ortakoy mah           8\n",
       "Si̇nanpasa mah       20\n",
       "Turkali̇ mah         21\n",
       "Ulus mah             16\n",
       "Vi̇snezade mah       18\n",
       "Yildiz mah           10"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "besiktas_venues_df.groupby('Neighborhood').count().loc[:,['Venue']]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Venue</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Neighborhood</th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>19 mayis mah</th>\n",
       "      <td>36</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Acibadem mah</th>\n",
       "      <td>20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Bostanci mah</th>\n",
       "      <td>30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Caddebostan mah</th>\n",
       "      <td>47</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Caferaga mah</th>\n",
       "      <td>42</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Dumlupinar mah</th>\n",
       "      <td>21</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Egi̇ti̇m mah</th>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Erenkoy mah</th>\n",
       "      <td>27</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Fenerbahce mah</th>\n",
       "      <td>31</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Feneryolu mah</th>\n",
       "      <td>24</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Fi̇ki̇rtepe mah</th>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Goztepe mah</th>\n",
       "      <td>15</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Hasanpasa mah</th>\n",
       "      <td>16</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Kosuyolu mah</th>\n",
       "      <td>38</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Kozyatagi mah</th>\n",
       "      <td>28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Merdi̇venkoy mah</th>\n",
       "      <td>18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Osmanaga mah</th>\n",
       "      <td>30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Rasi̇mpasa mah</th>\n",
       "      <td>26</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Sahrayicedi̇t mah</th>\n",
       "      <td>18</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Suadi̇ye mah</th>\n",
       "      <td>44</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Zuhtupasa mah</th>\n",
       "      <td>34</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                   Venue\n",
       "Neighborhood            \n",
       "19 mayis mah          36\n",
       "Acibadem mah          20\n",
       "Bostanci mah          30\n",
       "Caddebostan mah       47\n",
       "Caferaga mah          42\n",
       "Dumlupinar mah        21\n",
       "Egi̇ti̇m mah           7\n",
       "Erenkoy mah           27\n",
       "Fenerbahce mah        31\n",
       "Feneryolu mah         24\n",
       "Fi̇ki̇rtepe mah        1\n",
       "Goztepe mah           15\n",
       "Hasanpasa mah         16\n",
       "Kosuyolu mah          38\n",
       "Kozyatagi mah         28\n",
       "Merdi̇venkoy mah      18\n",
       "Osmanaga mah          30\n",
       "Rasi̇mpasa mah        26\n",
       "Sahrayicedi̇t mah     18\n",
       "Suadi̇ye mah          44\n",
       "Zuhtupasa mah         34"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "kadikoy_venues_df.groupby('Neighborhood').count().loc[:,['Venue']]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Let's store the information and use it from CSV from now on\n",
    "\n",
    "- besiktas_venues_df will be stored as *\"besiktas_venues_df.csv\"*\n",
    "- kadikoy_venues_df will be stored as *\"kadikoy_venues_df.csv\"*"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [],
   "source": [
    "besiktas_venues_df.to_csv(\"besiktas_venues_df.csv\")\n",
    "kadikoy_venues_df.to_csv(\"kadikoy_venues_df.csv\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "# to read the csv again\n",
    "# besiktas_venues_df= pd.read_csv(\"besiktas_venues_df.csv\")\n",
    "# kadikoy_venues_df= pd.read_csv(\"kadikoy_venues_df.csv\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Now it is time to get details for each venue\n",
    "\n",
    "We need to define a function to run the API for each venue and get the details."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "492 venues exist in Besiktas\n",
      "553 venues exist in Kadıkoy\n"
     ]
    }
   ],
   "source": [
    "print('{} venues exist in Besiktas'.format(len(besiktas_venues_df.index)))\n",
    "print('{} venues exist in Kadıkoy'.format(len(kadikoy_venues_df.index)))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This is a Premium call, which is limited to 500 per day, therefore we will split the data collection into three days as there are *1045 Unique Venues* listed.\n",
    "\n",
    "The function below needs to be run as long as the venue details are done. The results will be recorded to CSVs merged afterwards."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "def getVenueDetails(venueId,start_index=0):\n",
    "    \n",
    "    venue_details=[]\n",
    "    #needed for tracking purposes\n",
    "    iter_number=start_index\n",
    "    \n",
    "    for vid in venueId[start_index:]:\n",
    "            \n",
    "        # create the API request URL\n",
    "        url = 'https://api.foursquare.com/v2/venues/{}?client_id={}&client_secret={}&v={}'.format(\n",
    "            vid,\n",
    "            CLIENT_ID,\n",
    "            CLIENT_SECRET,\n",
    "            VERSION\n",
    "        )\n",
    "            \n",
    "        # make the GET request\n",
    "        v = requests.get(url).json()\n",
    "        \n",
    "        # if the quote is reached return the dataframe and give the information\n",
    "        if (v['meta']['code'] != 200):\n",
    "            print('error occured on index {}. Use this number as start index for next batch'.format(iter_number))\n",
    "            print(v['meta']['errorDetail']) if 'errorDetail' in v['meta'] else print('no error details')\n",
    "            print('{} number of venues returned. The start index is {}'.format(start_index,iter_number))\n",
    "            return(venue_details_df)\n",
    "        \n",
    "        # retur venue details\n",
    "        venue_details.append([(\n",
    "            vid, \n",
    "            v['response']['venue']['stats']['checkinsCount'] if ('checkinsCount' in v['response']['venue']['stats'] and 'stats' in v['response']['venue']) else 0,\n",
    "            v['response']['venue']['stats']['usersCount'] if 'usersCount' in v['response']['venue']['stats'] and 'stats' in v['response']['venue'] else 0, #total users checked in\n",
    "            v['response']['venue']['url'] if 'url' in v['response']['venue'] else \"\",\n",
    "            v['response']['venue']['contact']['twitter'] if 'twitter' in v['response']['venue']['contact'] else \"\",\n",
    "            v['response']['venue']['contact']['instagram'] if 'url' in v['response']['venue']['contact'] else \"\",\n",
    "            v['response']['venue']['contact']['phone'] if 'phone' in v['response']['venue']['contact'] else \"\",\n",
    "            v['response']['venue']['contact']['formattedPhone'] if 'formattedPhone' in v['response']['venue']['contact'] else \"\",\n",
    "            v['response']['venue']['rating'] if 'rating' in v['response']['venue'] else 0,\n",
    "            v['response']['venue']['description']if 'description' in v['response']['venue'] else \"\",\n",
    "            v['response']['venue']['createdAt'],\n",
    "            v['response']['venue']['tips']['count'] if 'count' in v['response']['venue']['tips'] and 'tips' in v['response']['venue'] else 0,\n",
    "            v['response']['venue']['likes']['count'] if 'count' in v['response']['venue']['likes'] and 'likes' in v['response']['venue'] else 0)])\n",
    "\n",
    "        venue_details_df = pd.DataFrame([item for venue_details in venue_details for item in venue_details])\n",
    "        venue_details_df.columns = ['Venue Id',\n",
    "                                 'Venue Checkins Count',\n",
    "                                 'Venue Checkin User Count',\n",
    "                                 'Venue Url',\n",
    "                                 'Venue Twitter',\n",
    "                                 'Venue Instagram',\n",
    "                                 'Venue Phone',\n",
    "                                 'Venue Formatted Phone',\n",
    "                                 'Venue Rating',\n",
    "                                 'Venue Description',\n",
    "                                 'Venue Created',\n",
    "                                 'Venue Tips Count',\n",
    "                                 'Venue Likes Count'\n",
    "                                 ]\n",
    "        iter_number=iter_number+1\n",
    "    \n",
    "    print('last index {}'.format(iter_number))\n",
    "    return(venue_details_df)\n",
    "    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "last index 553\n"
     ]
    }
   ],
   "source": [
    "kadikoy_venue_details = getVenueDetails(kadikoy_venues_df['Venue ID'],start_index=0)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Recording the details to temporary dbase\n",
    "\n",
    "These will be run as long as it is necessary"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "besiktas_venue_details.to_csv(\"besiktas_venue_details.csv\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [],
   "source": [
    "kadikoy_venue_details.to_csv(\"kadikoy_venue_details.csv\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Merging all the Venue details into kadikoy_venues_df and besiktas_venues_df"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Unnamed: 0</th>\n",
       "      <th>Neighborhood</th>\n",
       "      <th>Neighborhood Latitude</th>\n",
       "      <th>Neighborhood Longitude</th>\n",
       "      <th>Venue ID</th>\n",
       "      <th>Venue</th>\n",
       "      <th>Venue Latitude</th>\n",
       "      <th>Venue Longitude</th>\n",
       "      <th>Venue Distance</th>\n",
       "      <th>Venue Category</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>36</td>\n",
       "      <td>Caddebostan mah</td>\n",
       "      <td>40.967927</td>\n",
       "      <td>29.061993</td>\n",
       "      <td>4bdfd536be5120a15ec2fe70</td>\n",
       "      <td>Powerfull Atlethic Club</td>\n",
       "      <td>40.967527</td>\n",
       "      <td>29.064940</td>\n",
       "      <td>251</td>\n",
       "      <td>Gym</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>588</td>\n",
       "      <td>Rasi̇mpasa mah</td>\n",
       "      <td>40.996066</td>\n",
       "      <td>29.027081</td>\n",
       "      <td>4be31013660ec9287609cb3b</td>\n",
       "      <td>Sports</td>\n",
       "      <td>41.000300</td>\n",
       "      <td>29.031012</td>\n",
       "      <td>575</td>\n",
       "      <td>Gym</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>254</td>\n",
       "      <td>Feneryolu mah</td>\n",
       "      <td>40.981957</td>\n",
       "      <td>29.048902</td>\n",
       "      <td>4be4544d2468c928419dfe42</td>\n",
       "      <td>Eaglestar Fitness and Body Form Club</td>\n",
       "      <td>40.978751</td>\n",
       "      <td>29.047985</td>\n",
       "      <td>365</td>\n",
       "      <td>Gym</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>504</td>\n",
       "      <td>Osmanaga mah</td>\n",
       "      <td>40.991432</td>\n",
       "      <td>29.027081</td>\n",
       "      <td>4bf78371bb5176b0c3385bb2</td>\n",
       "      <td>Sports Universe</td>\n",
       "      <td>40.988533</td>\n",
       "      <td>29.024474</td>\n",
       "      <td>390</td>\n",
       "      <td>Gym</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>89</td>\n",
       "      <td>Caferaga mah</td>\n",
       "      <td>40.983720</td>\n",
       "      <td>29.025626</td>\n",
       "      <td>4c62e4dbfa7bc928cc380f27</td>\n",
       "      <td>Airport Form Center</td>\n",
       "      <td>40.985363</td>\n",
       "      <td>29.021208</td>\n",
       "      <td>413</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Unnamed: 0     Neighborhood  Neighborhood Latitude  Neighborhood Longitude  \\\n",
       "0          36  Caddebostan mah              40.967927               29.061993   \n",
       "1         588   Rasi̇mpasa mah              40.996066               29.027081   \n",
       "2         254    Feneryolu mah              40.981957               29.048902   \n",
       "3         504     Osmanaga mah              40.991432               29.027081   \n",
       "4          89     Caferaga mah              40.983720               29.025626   \n",
       "\n",
       "                   Venue ID                                 Venue  \\\n",
       "0  4bdfd536be5120a15ec2fe70               Powerfull Atlethic Club   \n",
       "1  4be31013660ec9287609cb3b                                Sports   \n",
       "2  4be4544d2468c928419dfe42  Eaglestar Fitness and Body Form Club   \n",
       "3  4bf78371bb5176b0c3385bb2                       Sports Universe   \n",
       "4  4c62e4dbfa7bc928cc380f27                   Airport Form Center   \n",
       "\n",
       "   Venue Latitude  Venue Longitude  Venue Distance        Venue Category  \n",
       "0       40.967527        29.064940             251                   Gym  \n",
       "1       41.000300        29.031012             575                   Gym  \n",
       "2       40.978751        29.047985             365                   Gym  \n",
       "3       40.988533        29.024474             390                   Gym  \n",
       "4       40.985363        29.021208             413  Gym / Fitness Center  "
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "kadikoy_venues_df.rename(columns={'Venue ID':'Venue Id'})\n",
    "kadikoy_venues_df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "kadikoy_venue_details = pd.concat([pd.read_csv(\"kadikoy_venue_details_v1.csv\"),pd.read_csv(\"kadikoy_venue_details_v2.csv\"),pd.read_csv(\"kadikoy_venue_details_v3.csv\")],  ignore_index=True)\n",
    "kadikoy_venue_details.set_index('Venue Id')\n",
    "kadikoy_venues_df.rename(columns={'Venue ID':'Venue Id'},inplace=True)\n",
    "kadikoy_venues_df = pd.merge(kadikoy_venues_df, kadikoy_venue_details, on='Venue Id')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {},
   "outputs": [],
   "source": [
    "besiktas_venue_details = pd.concat([pd.read_csv(\"besiktas_venue_details_v1.csv\"),pd.read_csv(\"besiktas_venue_details_v2.csv\")],  ignore_index=True)\n",
    "besiktas_venue_details.set_index('Venue Id')\n",
    "besiktas_venues_df.rename(columns={'Venue ID':'Venue Id'},inplace=True)\n",
    "besiktas_venues_df = pd.merge(besiktas_venues_df, besiktas_venue_details, on='Venue Id')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Let's check the shape and content"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(492, 23)\n",
      "(553, 23)\n"
     ]
    }
   ],
   "source": [
    "print(besiktas_venues_df.shape)\n",
    "print(kadikoy_venues_df.shape)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Unnamed: 0_x</th>\n",
       "      <th>Neighborhood</th>\n",
       "      <th>Neighborhood Latitude</th>\n",
       "      <th>Neighborhood Longitude</th>\n",
       "      <th>Venue Id</th>\n",
       "      <th>Venue</th>\n",
       "      <th>Venue Latitude</th>\n",
       "      <th>Venue Longitude</th>\n",
       "      <th>Venue Distance</th>\n",
       "      <th>Venue Category</th>\n",
       "      <th>Unnamed: 0_y</th>\n",
       "      <th>Venue Checkins Count</th>\n",
       "      <th>Venue Checkin User Count</th>\n",
       "      <th>Venue Url</th>\n",
       "      <th>Venue Twitter</th>\n",
       "      <th>Venue Instagram</th>\n",
       "      <th>Venue Phone</th>\n",
       "      <th>Venue Formatted Phone</th>\n",
       "      <th>Venue Rating</th>\n",
       "      <th>Venue Description</th>\n",
       "      <th>Venue Created</th>\n",
       "      <th>Venue Tips Count</th>\n",
       "      <th>Venue Likes Count</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>64</td>\n",
       "      <td>Ci̇hannuma mah</td>\n",
       "      <td>41.047211</td>\n",
       "      <td>29.007439</td>\n",
       "      <td>4b66f145f964a52075312be3</td>\n",
       "      <td>Turkcell Plaza Fitness Center</td>\n",
       "      <td>41.048224</td>\n",
       "      <td>29.008715</td>\n",
       "      <td>155</td>\n",
       "      <td>Gym</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1265037637</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>197</td>\n",
       "      <td>Bebek mah</td>\n",
       "      <td>41.077744</td>\n",
       "      <td>29.041629</td>\n",
       "      <td>4b703459f964a520830b2de3</td>\n",
       "      <td>Mars Athletic Club</td>\n",
       "      <td>41.075919</td>\n",
       "      <td>29.038232</td>\n",
       "      <td>350</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>http://www.marsathletic.com</td>\n",
       "      <td>mars_athletic</td>\n",
       "      <td>NaN</td>\n",
       "      <td>9.021226e+11</td>\n",
       "      <td>+90 212 263 86 96</td>\n",
       "      <td>8.8</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1265644633</td>\n",
       "      <td>52</td>\n",
       "      <td>317</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>223</td>\n",
       "      <td>Eti̇ler mah</td>\n",
       "      <td>41.087042</td>\n",
       "      <td>29.037264</td>\n",
       "      <td>4b7aed0ef964a52089462fe3</td>\n",
       "      <td>Hillside City Club</td>\n",
       "      <td>41.087993</td>\n",
       "      <td>29.031091</td>\n",
       "      <td>528</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>https://www.hillside.com.tr</td>\n",
       "      <td>hillsideleisure</td>\n",
       "      <td>NaN</td>\n",
       "      <td>9.021235e+11</td>\n",
       "      <td>+90 212 352 23 33</td>\n",
       "      <td>8.9</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1266347278</td>\n",
       "      <td>129</td>\n",
       "      <td>1088</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>200</td>\n",
       "      <td>Bebek mah</td>\n",
       "      <td>41.077744</td>\n",
       "      <td>29.041629</td>\n",
       "      <td>4ba67962f964a520265639e3</td>\n",
       "      <td>Celebrity Fitness</td>\n",
       "      <td>41.081342</td>\n",
       "      <td>29.035980</td>\n",
       "      <td>620</td>\n",
       "      <td>Gym</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1269201250</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>413</td>\n",
       "      <td>Kultur mah</td>\n",
       "      <td>41.073202</td>\n",
       "      <td>29.032900</td>\n",
       "      <td>4bc89f2192b376b0bdcb513a</td>\n",
       "      <td>Maya sports center</td>\n",
       "      <td>41.076425</td>\n",
       "      <td>29.029158</td>\n",
       "      <td>476</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1271439137</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>137</td>\n",
       "      <td>Akat mah</td>\n",
       "      <td>41.085614</td>\n",
       "      <td>29.025626</td>\n",
       "      <td>4be97d20c5220f478ee2aaca</td>\n",
       "      <td>Club Sporium</td>\n",
       "      <td>41.086891</td>\n",
       "      <td>29.024003</td>\n",
       "      <td>196</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>http://akatlar.clubsporium.com.tr</td>\n",
       "      <td>clubsporium</td>\n",
       "      <td>NaN</td>\n",
       "      <td>9.021239e+11</td>\n",
       "      <td>+90 212 385 49 10</td>\n",
       "      <td>8.4</td>\n",
       "      <td>Sporla dolu yaşam merkezi</td>\n",
       "      <td>1273593120</td>\n",
       "      <td>236</td>\n",
       "      <td>1135</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>401</td>\n",
       "      <td>Kultur mah</td>\n",
       "      <td>41.073202</td>\n",
       "      <td>29.032900</td>\n",
       "      <td>4c14c74682a3c9b66bbcfdf8</td>\n",
       "      <td>Mayadrom Sports Center(MSC)</td>\n",
       "      <td>41.077281</td>\n",
       "      <td>29.032698</td>\n",
       "      <td>454</td>\n",
       "      <td>Gym</td>\n",
       "      <td>6</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>6.3</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1276430150</td>\n",
       "      <td>24</td>\n",
       "      <td>12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>739</td>\n",
       "      <td>Vi̇snezade mah</td>\n",
       "      <td>41.041503</td>\n",
       "      <td>28.998708</td>\n",
       "      <td>4c37666c93db0f4737b51f92</td>\n",
       "      <td>Mars Athletic Club</td>\n",
       "      <td>41.043765</td>\n",
       "      <td>28.992381</td>\n",
       "      <td>587</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>7</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>http://www.marsathletic.com</td>\n",
       "      <td>mars_athletic</td>\n",
       "      <td>NaN</td>\n",
       "      <td>9.021223e+11</td>\n",
       "      <td>+90 212 232 44 40</td>\n",
       "      <td>8.6</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1278699116</td>\n",
       "      <td>151</td>\n",
       "      <td>786</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>628</td>\n",
       "      <td>Muradi̇ye mah</td>\n",
       "      <td>41.048450</td>\n",
       "      <td>28.998708</td>\n",
       "      <td>4c4ae6c79c8d2d7fe10e316a</td>\n",
       "      <td>İTÜ Havuz</td>\n",
       "      <td>41.046354</td>\n",
       "      <td>28.995922</td>\n",
       "      <td>330</td>\n",
       "      <td>Gym Pool</td>\n",
       "      <td>8</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>http://www.itu.edu.tr</td>\n",
       "      <td>itu1773</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>7.9</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1279977159</td>\n",
       "      <td>6</td>\n",
       "      <td>37</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>48</td>\n",
       "      <td>Ci̇hannuma mah</td>\n",
       "      <td>41.047211</td>\n",
       "      <td>29.007439</td>\n",
       "      <td>4c51ab6b1c67ef3be50f1bb9</td>\n",
       "      <td>The Alaaddin Club</td>\n",
       "      <td>41.047260</td>\n",
       "      <td>29.007811</td>\n",
       "      <td>31</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>9.021233e+11</td>\n",
       "      <td>+90 212 327 63 93</td>\n",
       "      <td>7.3</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1280420715</td>\n",
       "      <td>6</td>\n",
       "      <td>44</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>161</td>\n",
       "      <td>Akat mah</td>\n",
       "      <td>41.085614</td>\n",
       "      <td>29.025626</td>\n",
       "      <td>4c585cd0d12a20a1a2d768bd</td>\n",
       "      <td>Şişli Terakki Spor Salonu</td>\n",
       "      <td>41.081946</td>\n",
       "      <td>29.024032</td>\n",
       "      <td>429</td>\n",
       "      <td>Gym</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>7.1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1280859344</td>\n",
       "      <td>6</td>\n",
       "      <td>57</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>352</td>\n",
       "      <td>Gayrettepe mah</td>\n",
       "      <td>41.064196</td>\n",
       "      <td>29.006711</td>\n",
       "      <td>4c6667d6e75ac9280676f7da</td>\n",
       "      <td>Essporto Health &amp; Fitness Club</td>\n",
       "      <td>41.065585</td>\n",
       "      <td>29.010558</td>\n",
       "      <td>357</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>11</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>http://www.essporto.com</td>\n",
       "      <td>essporto</td>\n",
       "      <td>NaN</td>\n",
       "      <td>9.021234e+11</td>\n",
       "      <td>+90 212 344 06 66</td>\n",
       "      <td>6.8</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1281779670</td>\n",
       "      <td>344</td>\n",
       "      <td>941</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>434</td>\n",
       "      <td>Levazim mah</td>\n",
       "      <td>41.063314</td>\n",
       "      <td>29.018351</td>\n",
       "      <td>4c6fc3e79c6d6dcba464d07a</td>\n",
       "      <td>Korukent Gym</td>\n",
       "      <td>41.060259</td>\n",
       "      <td>29.020800</td>\n",
       "      <td>397</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>12</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>7.5</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1282393063</td>\n",
       "      <td>23</td>\n",
       "      <td>103</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>719</td>\n",
       "      <td>Vi̇snezade mah</td>\n",
       "      <td>41.041503</td>\n",
       "      <td>28.998708</td>\n",
       "      <td>4c96571203413704ac9483ef</td>\n",
       "      <td>Swiss Otel Gym</td>\n",
       "      <td>41.040821</td>\n",
       "      <td>28.997064</td>\n",
       "      <td>157</td>\n",
       "      <td>Gym</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>7.5</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1284921106</td>\n",
       "      <td>7</td>\n",
       "      <td>35</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>659</td>\n",
       "      <td>Muradi̇ye mah</td>\n",
       "      <td>41.048450</td>\n",
       "      <td>28.998708</td>\n",
       "      <td>4c990c719c663704c5bf4cfd</td>\n",
       "      <td>Action gym</td>\n",
       "      <td>41.052083</td>\n",
       "      <td>28.995858</td>\n",
       "      <td>469</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>14</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1285098609</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    Unnamed: 0_x    Neighborhood  Neighborhood Latitude  \\\n",
       "0             64  Ci̇hannuma mah              41.047211   \n",
       "1            197       Bebek mah              41.077744   \n",
       "2            223     Eti̇ler mah              41.087042   \n",
       "3            200       Bebek mah              41.077744   \n",
       "4            413      Kultur mah              41.073202   \n",
       "5            137        Akat mah              41.085614   \n",
       "6            401      Kultur mah              41.073202   \n",
       "7            739  Vi̇snezade mah              41.041503   \n",
       "8            628   Muradi̇ye mah              41.048450   \n",
       "9             48  Ci̇hannuma mah              41.047211   \n",
       "10           161        Akat mah              41.085614   \n",
       "11           352  Gayrettepe mah              41.064196   \n",
       "12           434     Levazim mah              41.063314   \n",
       "13           719  Vi̇snezade mah              41.041503   \n",
       "14           659   Muradi̇ye mah              41.048450   \n",
       "\n",
       "    Neighborhood Longitude                  Venue Id  \\\n",
       "0                29.007439  4b66f145f964a52075312be3   \n",
       "1                29.041629  4b703459f964a520830b2de3   \n",
       "2                29.037264  4b7aed0ef964a52089462fe3   \n",
       "3                29.041629  4ba67962f964a520265639e3   \n",
       "4                29.032900  4bc89f2192b376b0bdcb513a   \n",
       "5                29.025626  4be97d20c5220f478ee2aaca   \n",
       "6                29.032900  4c14c74682a3c9b66bbcfdf8   \n",
       "7                28.998708  4c37666c93db0f4737b51f92   \n",
       "8                28.998708  4c4ae6c79c8d2d7fe10e316a   \n",
       "9                29.007439  4c51ab6b1c67ef3be50f1bb9   \n",
       "10               29.025626  4c585cd0d12a20a1a2d768bd   \n",
       "11               29.006711  4c6667d6e75ac9280676f7da   \n",
       "12               29.018351  4c6fc3e79c6d6dcba464d07a   \n",
       "13               28.998708  4c96571203413704ac9483ef   \n",
       "14               28.998708  4c990c719c663704c5bf4cfd   \n",
       "\n",
       "                             Venue  Venue Latitude  Venue Longitude  \\\n",
       "0    Turkcell Plaza Fitness Center       41.048224        29.008715   \n",
       "1               Mars Athletic Club       41.075919        29.038232   \n",
       "2               Hillside City Club       41.087993        29.031091   \n",
       "3                Celebrity Fitness       41.081342        29.035980   \n",
       "4               Maya sports center       41.076425        29.029158   \n",
       "5                     Club Sporium       41.086891        29.024003   \n",
       "6      Mayadrom Sports Center(MSC)       41.077281        29.032698   \n",
       "7               Mars Athletic Club       41.043765        28.992381   \n",
       "8                        İTÜ Havuz       41.046354        28.995922   \n",
       "9                The Alaaddin Club       41.047260        29.007811   \n",
       "10       Şişli Terakki Spor Salonu       41.081946        29.024032   \n",
       "11  Essporto Health & Fitness Club       41.065585        29.010558   \n",
       "12                    Korukent Gym       41.060259        29.020800   \n",
       "13                  Swiss Otel Gym       41.040821        28.997064   \n",
       "14                      Action gym       41.052083        28.995858   \n",
       "\n",
       "    Venue Distance        Venue Category  Unnamed: 0_y  Venue Checkins Count  \\\n",
       "0              155                   Gym             0                     0   \n",
       "1              350  Gym / Fitness Center             1                     0   \n",
       "2              528  Gym / Fitness Center             2                     0   \n",
       "3              620                   Gym             3                     0   \n",
       "4              476  Gym / Fitness Center             4                     0   \n",
       "5              196  Gym / Fitness Center             5                     0   \n",
       "6              454                   Gym             6                     0   \n",
       "7              587  Gym / Fitness Center             7                     0   \n",
       "8              330              Gym Pool             8                     0   \n",
       "9               31  Gym / Fitness Center             9                     0   \n",
       "10             429                   Gym            10                     0   \n",
       "11             357  Gym / Fitness Center            11                     0   \n",
       "12             397  Gym / Fitness Center            12                     0   \n",
       "13             157                   Gym            13                     0   \n",
       "14             469  Gym / Fitness Center            14                     0   \n",
       "\n",
       "    Venue Checkin User Count                          Venue Url  \\\n",
       "0                          0                                NaN   \n",
       "1                          0        http://www.marsathletic.com   \n",
       "2                          0        https://www.hillside.com.tr   \n",
       "3                          0                                NaN   \n",
       "4                          0                                NaN   \n",
       "5                          0  http://akatlar.clubsporium.com.tr   \n",
       "6                          0                                NaN   \n",
       "7                          0        http://www.marsathletic.com   \n",
       "8                          0              http://www.itu.edu.tr   \n",
       "9                          0                                NaN   \n",
       "10                         0                                NaN   \n",
       "11                         0            http://www.essporto.com   \n",
       "12                         0                                NaN   \n",
       "13                         0                                NaN   \n",
       "14                         0                                NaN   \n",
       "\n",
       "      Venue Twitter  Venue Instagram   Venue Phone Venue Formatted Phone  \\\n",
       "0               NaN              NaN           NaN                   NaN   \n",
       "1     mars_athletic              NaN  9.021226e+11     +90 212 263 86 96   \n",
       "2   hillsideleisure              NaN  9.021235e+11     +90 212 352 23 33   \n",
       "3               NaN              NaN           NaN                   NaN   \n",
       "4               NaN              NaN           NaN                   NaN   \n",
       "5       clubsporium              NaN  9.021239e+11     +90 212 385 49 10   \n",
       "6               NaN              NaN           NaN                   NaN   \n",
       "7     mars_athletic              NaN  9.021223e+11     +90 212 232 44 40   \n",
       "8           itu1773              NaN           NaN                   NaN   \n",
       "9               NaN              NaN  9.021233e+11     +90 212 327 63 93   \n",
       "10              NaN              NaN           NaN                   NaN   \n",
       "11         essporto              NaN  9.021234e+11     +90 212 344 06 66   \n",
       "12              NaN              NaN           NaN                   NaN   \n",
       "13              NaN              NaN           NaN                   NaN   \n",
       "14              NaN              NaN           NaN                   NaN   \n",
       "\n",
       "    Venue Rating          Venue Description  Venue Created  Venue Tips Count  \\\n",
       "0            0.0                        NaN     1265037637                 0   \n",
       "1            8.8                        NaN     1265644633                52   \n",
       "2            8.9                        NaN     1266347278               129   \n",
       "3            0.0                        NaN     1269201250                 0   \n",
       "4            0.0                        NaN     1271439137                 1   \n",
       "5            8.4  Sporla dolu yaşam merkezi     1273593120               236   \n",
       "6            6.3                        NaN     1276430150                24   \n",
       "7            8.6                        NaN     1278699116               151   \n",
       "8            7.9                        NaN     1279977159                 6   \n",
       "9            7.3                        NaN     1280420715                 6   \n",
       "10           7.1                        NaN     1280859344                 6   \n",
       "11           6.8                        NaN     1281779670               344   \n",
       "12           7.5                        NaN     1282393063                23   \n",
       "13           7.5                        NaN     1284921106                 7   \n",
       "14           0.0                        NaN     1285098609                 1   \n",
       "\n",
       "    Venue Likes Count  \n",
       "0                   0  \n",
       "1                 317  \n",
       "2                1088  \n",
       "3                   0  \n",
       "4                   0  \n",
       "5                1135  \n",
       "6                  12  \n",
       "7                 786  \n",
       "8                  37  \n",
       "9                  44  \n",
       "10                 57  \n",
       "11                941  \n",
       "12                103  \n",
       "13                 35  \n",
       "14                  1  "
      ]
     },
     "execution_count": 45,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "besiktas_venues_df.head(15)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Unnamed: 0_x</th>\n",
       "      <th>Neighborhood</th>\n",
       "      <th>Neighborhood Latitude</th>\n",
       "      <th>Neighborhood Longitude</th>\n",
       "      <th>Venue Id</th>\n",
       "      <th>Venue</th>\n",
       "      <th>Venue Latitude</th>\n",
       "      <th>Venue Longitude</th>\n",
       "      <th>Venue Distance</th>\n",
       "      <th>Venue Category</th>\n",
       "      <th>Unnamed: 0_y</th>\n",
       "      <th>Venue Checkins Count</th>\n",
       "      <th>Venue Checkin User Count</th>\n",
       "      <th>Venue Url</th>\n",
       "      <th>Venue Twitter</th>\n",
       "      <th>Venue Instagram</th>\n",
       "      <th>Venue Phone</th>\n",
       "      <th>Venue Formatted Phone</th>\n",
       "      <th>Venue Rating</th>\n",
       "      <th>Venue Description</th>\n",
       "      <th>Venue Created</th>\n",
       "      <th>Venue Tips Count</th>\n",
       "      <th>Venue Likes Count</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>36</td>\n",
       "      <td>Caddebostan mah</td>\n",
       "      <td>40.967927</td>\n",
       "      <td>29.061993</td>\n",
       "      <td>4bdfd536be5120a15ec2fe70</td>\n",
       "      <td>Powerfull Atlethic Club</td>\n",
       "      <td>40.967527</td>\n",
       "      <td>29.064940</td>\n",
       "      <td>251</td>\n",
       "      <td>Gym</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>http://caddebostan.powerfullclub.com</td>\n",
       "      <td>powerfullclub</td>\n",
       "      <td>NaN</td>\n",
       "      <td>9.021636e+11</td>\n",
       "      <td>+90 216 356 71 71</td>\n",
       "      <td>7.8</td>\n",
       "      <td>Caddebostan Kültür Merkezi’nde hizmet veren te...</td>\n",
       "      <td>1272960310</td>\n",
       "      <td>52</td>\n",
       "      <td>209</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>588</td>\n",
       "      <td>Rasi̇mpasa mah</td>\n",
       "      <td>40.996066</td>\n",
       "      <td>29.027081</td>\n",
       "      <td>4be31013660ec9287609cb3b</td>\n",
       "      <td>Sports</td>\n",
       "      <td>41.000300</td>\n",
       "      <td>29.031012</td>\n",
       "      <td>575</td>\n",
       "      <td>Gym</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1273171987</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>254</td>\n",
       "      <td>Feneryolu mah</td>\n",
       "      <td>40.981957</td>\n",
       "      <td>29.048902</td>\n",
       "      <td>4be4544d2468c928419dfe42</td>\n",
       "      <td>Eaglestar Fitness and Body Form Club</td>\n",
       "      <td>40.978751</td>\n",
       "      <td>29.047985</td>\n",
       "      <td>365</td>\n",
       "      <td>Gym</td>\n",
       "      <td>2</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>8.1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1273254989</td>\n",
       "      <td>11</td>\n",
       "      <td>57</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>504</td>\n",
       "      <td>Osmanaga mah</td>\n",
       "      <td>40.991432</td>\n",
       "      <td>29.027081</td>\n",
       "      <td>4bf78371bb5176b0c3385bb2</td>\n",
       "      <td>Sports Universe</td>\n",
       "      <td>40.988533</td>\n",
       "      <td>29.024474</td>\n",
       "      <td>390</td>\n",
       "      <td>Gym</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>8.7</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1274512241</td>\n",
       "      <td>62</td>\n",
       "      <td>264</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>89</td>\n",
       "      <td>Caferaga mah</td>\n",
       "      <td>40.983720</td>\n",
       "      <td>29.025626</td>\n",
       "      <td>4c62e4dbfa7bc928cc380f27</td>\n",
       "      <td>Airport Form Center</td>\n",
       "      <td>40.985363</td>\n",
       "      <td>29.021208</td>\n",
       "      <td>413</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>http://www.airportmoda.com</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>9.021635e+11</td>\n",
       "      <td>+90 216 345 58 46</td>\n",
       "      <td>8.1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1281549531</td>\n",
       "      <td>22</td>\n",
       "      <td>78</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>67</td>\n",
       "      <td>Caddebostan mah</td>\n",
       "      <td>40.967927</td>\n",
       "      <td>29.061993</td>\n",
       "      <td>4caf3964562d224b092c0c88</td>\n",
       "      <td>Sports Time</td>\n",
       "      <td>40.964574</td>\n",
       "      <td>29.065999</td>\n",
       "      <td>502</td>\n",
       "      <td>Gym</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1286551908</td>\n",
       "      <td>3</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>462</td>\n",
       "      <td>19 mayis mah</td>\n",
       "      <td>40.974626</td>\n",
       "      <td>29.088173</td>\n",
       "      <td>4cc444b382388cfae5b46d35</td>\n",
       "      <td>Gengym Health &amp; Fitness</td>\n",
       "      <td>40.974221</td>\n",
       "      <td>29.090556</td>\n",
       "      <td>205</td>\n",
       "      <td>Gym</td>\n",
       "      <td>6</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>http://www.gengym.com</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>9.021645e+11</td>\n",
       "      <td>+90 216 445 19 00</td>\n",
       "      <td>8.6</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1287931059</td>\n",
       "      <td>21</td>\n",
       "      <td>147</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>407</td>\n",
       "      <td>Kozyatagi mah</td>\n",
       "      <td>40.969147</td>\n",
       "      <td>29.095444</td>\n",
       "      <td>4cd7fdd2a99d370447c402ce</td>\n",
       "      <td>Max Gym Fitness Studio</td>\n",
       "      <td>40.971370</td>\n",
       "      <td>29.094729</td>\n",
       "      <td>254</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>7</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>8.4</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1289223634</td>\n",
       "      <td>27</td>\n",
       "      <td>149</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>215</td>\n",
       "      <td>Fenerbahce mah</td>\n",
       "      <td>40.974286</td>\n",
       "      <td>29.043083</td>\n",
       "      <td>4cdad42f6ad1a0931883e856</td>\n",
       "      <td>Anantara Spa</td>\n",
       "      <td>40.972723</td>\n",
       "      <td>29.043529</td>\n",
       "      <td>178</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>8</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1289409583</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>369</td>\n",
       "      <td>Kosuyolu mah</td>\n",
       "      <td>41.009087</td>\n",
       "      <td>29.038719</td>\n",
       "      <td>4ceeaeff13aea14357206f9f</td>\n",
       "      <td>Fashion Sports Club</td>\n",
       "      <td>41.010069</td>\n",
       "      <td>29.042069</td>\n",
       "      <td>301</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>http://www.fashionsports.com.tr</td>\n",
       "      <td>sportsfashionn</td>\n",
       "      <td>NaN</td>\n",
       "      <td>9.021634e+11</td>\n",
       "      <td>+90 216 340 71 71</td>\n",
       "      <td>8.6</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1290710783</td>\n",
       "      <td>151</td>\n",
       "      <td>617</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>648</td>\n",
       "      <td>Suadi̇ye mah</td>\n",
       "      <td>40.963081</td>\n",
       "      <td>29.083810</td>\n",
       "      <td>4cfbbfacdccef04dd5d2bc9c</td>\n",
       "      <td>Büyükhanli GYM</td>\n",
       "      <td>40.959488</td>\n",
       "      <td>29.085418</td>\n",
       "      <td>422</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1291567020</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>642</td>\n",
       "      <td>Suadi̇ye mah</td>\n",
       "      <td>40.963081</td>\n",
       "      <td>29.083810</td>\n",
       "      <td>4d09086c43b36ea8260e30ef</td>\n",
       "      <td>Miltaş Spor Külübü</td>\n",
       "      <td>40.959466</td>\n",
       "      <td>29.087121</td>\n",
       "      <td>489</td>\n",
       "      <td>Gym</td>\n",
       "      <td>11</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>6.9</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1292437612</td>\n",
       "      <td>13</td>\n",
       "      <td>79</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>232</td>\n",
       "      <td>Feneryolu mah</td>\n",
       "      <td>40.981957</td>\n",
       "      <td>29.048902</td>\n",
       "      <td>4d0c8f483bbaa14369d336da</td>\n",
       "      <td>Power Fitness Center</td>\n",
       "      <td>40.978389</td>\n",
       "      <td>29.051757</td>\n",
       "      <td>464</td>\n",
       "      <td>Gym</td>\n",
       "      <td>12</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1292668744</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>245</td>\n",
       "      <td>Feneryolu mah</td>\n",
       "      <td>40.981957</td>\n",
       "      <td>29.048902</td>\n",
       "      <td>4d0f90e3d467236a82ddbe4a</td>\n",
       "      <td>Kempinski Spa Cadde</td>\n",
       "      <td>40.982818</td>\n",
       "      <td>29.045389</td>\n",
       "      <td>310</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>0.0</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1292865763</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>3</td>\n",
       "      <td>Bostanci mah</td>\n",
       "      <td>40.958317</td>\n",
       "      <td>29.096898</td>\n",
       "      <td>4d12179db64da090e96634e7</td>\n",
       "      <td>Champion Gym Health &amp; Fitness Club</td>\n",
       "      <td>40.959768</td>\n",
       "      <td>29.092140</td>\n",
       "      <td>431</td>\n",
       "      <td>Gym / Fitness Center</td>\n",
       "      <td>14</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>http://www.championgym.net</td>\n",
       "      <td>champion_gym</td>\n",
       "      <td>NaN</td>\n",
       "      <td>9.021645e+11</td>\n",
       "      <td>+90 216 445 45 43</td>\n",
       "      <td>7.9</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1293031325</td>\n",
       "      <td>36</td>\n",
       "      <td>126</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    Unnamed: 0_x     Neighborhood  Neighborhood Latitude  \\\n",
       "0             36  Caddebostan mah              40.967927   \n",
       "1            588   Rasi̇mpasa mah              40.996066   \n",
       "2            254    Feneryolu mah              40.981957   \n",
       "3            504     Osmanaga mah              40.991432   \n",
       "4             89     Caferaga mah              40.983720   \n",
       "5             67  Caddebostan mah              40.967927   \n",
       "6            462     19 mayis mah              40.974626   \n",
       "7            407    Kozyatagi mah              40.969147   \n",
       "8            215   Fenerbahce mah              40.974286   \n",
       "9            369     Kosuyolu mah              41.009087   \n",
       "10           648     Suadi̇ye mah              40.963081   \n",
       "11           642     Suadi̇ye mah              40.963081   \n",
       "12           232    Feneryolu mah              40.981957   \n",
       "13           245    Feneryolu mah              40.981957   \n",
       "14             3     Bostanci mah              40.958317   \n",
       "\n",
       "    Neighborhood Longitude                  Venue Id  \\\n",
       "0                29.061993  4bdfd536be5120a15ec2fe70   \n",
       "1                29.027081  4be31013660ec9287609cb3b   \n",
       "2                29.048902  4be4544d2468c928419dfe42   \n",
       "3                29.027081  4bf78371bb5176b0c3385bb2   \n",
       "4                29.025626  4c62e4dbfa7bc928cc380f27   \n",
       "5                29.061993  4caf3964562d224b092c0c88   \n",
       "6                29.088173  4cc444b382388cfae5b46d35   \n",
       "7                29.095444  4cd7fdd2a99d370447c402ce   \n",
       "8                29.043083  4cdad42f6ad1a0931883e856   \n",
       "9                29.038719  4ceeaeff13aea14357206f9f   \n",
       "10               29.083810  4cfbbfacdccef04dd5d2bc9c   \n",
       "11               29.083810  4d09086c43b36ea8260e30ef   \n",
       "12               29.048902  4d0c8f483bbaa14369d336da   \n",
       "13               29.048902  4d0f90e3d467236a82ddbe4a   \n",
       "14               29.096898  4d12179db64da090e96634e7   \n",
       "\n",
       "                                   Venue  Venue Latitude  Venue Longitude  \\\n",
       "0                Powerfull Atlethic Club       40.967527        29.064940   \n",
       "1                                 Sports       41.000300        29.031012   \n",
       "2   Eaglestar Fitness and Body Form Club       40.978751        29.047985   \n",
       "3                        Sports Universe       40.988533        29.024474   \n",
       "4                    Airport Form Center       40.985363        29.021208   \n",
       "5                            Sports Time       40.964574        29.065999   \n",
       "6                Gengym Health & Fitness       40.974221        29.090556   \n",
       "7                 Max Gym Fitness Studio       40.971370        29.094729   \n",
       "8                           Anantara Spa       40.972723        29.043529   \n",
       "9                    Fashion Sports Club       41.010069        29.042069   \n",
       "10                        Büyükhanli GYM       40.959488        29.085418   \n",
       "11                    Miltaş Spor Külübü       40.959466        29.087121   \n",
       "12                  Power Fitness Center       40.978389        29.051757   \n",
       "13                   Kempinski Spa Cadde       40.982818        29.045389   \n",
       "14    Champion Gym Health & Fitness Club       40.959768        29.092140   \n",
       "\n",
       "    Venue Distance        Venue Category  Unnamed: 0_y  Venue Checkins Count  \\\n",
       "0              251                   Gym             0                     0   \n",
       "1              575                   Gym             1                     0   \n",
       "2              365                   Gym             2                     0   \n",
       "3              390                   Gym             3                     0   \n",
       "4              413  Gym / Fitness Center             4                     0   \n",
       "5              502                   Gym             5                     0   \n",
       "6              205                   Gym             6                     0   \n",
       "7              254  Gym / Fitness Center             7                     0   \n",
       "8              178  Gym / Fitness Center             8                     0   \n",
       "9              301  Gym / Fitness Center             9                     0   \n",
       "10             422  Gym / Fitness Center            10                     0   \n",
       "11             489                   Gym            11                     0   \n",
       "12             464                   Gym            12                     0   \n",
       "13             310  Gym / Fitness Center            13                     0   \n",
       "14             431  Gym / Fitness Center            14                     0   \n",
       "\n",
       "    Venue Checkin User Count                             Venue Url  \\\n",
       "0                          0  http://caddebostan.powerfullclub.com   \n",
       "1                          0                                   NaN   \n",
       "2                          0                                   NaN   \n",
       "3                          0                                   NaN   \n",
       "4                          0            http://www.airportmoda.com   \n",
       "5                          0                                   NaN   \n",
       "6                          0                 http://www.gengym.com   \n",
       "7                          0                                   NaN   \n",
       "8                          0                                   NaN   \n",
       "9                          0       http://www.fashionsports.com.tr   \n",
       "10                         0                                   NaN   \n",
       "11                         0                                   NaN   \n",
       "12                         0                                   NaN   \n",
       "13                         0                                   NaN   \n",
       "14                         0            http://www.championgym.net   \n",
       "\n",
       "     Venue Twitter  Venue Instagram   Venue Phone Venue Formatted Phone  \\\n",
       "0    powerfullclub              NaN  9.021636e+11     +90 216 356 71 71   \n",
       "1              NaN              NaN           NaN                   NaN   \n",
       "2              NaN              NaN           NaN                   NaN   \n",
       "3              NaN              NaN           NaN                   NaN   \n",
       "4              NaN              NaN  9.021635e+11     +90 216 345 58 46   \n",
       "5              NaN              NaN           NaN                   NaN   \n",
       "6              NaN              NaN  9.021645e+11     +90 216 445 19 00   \n",
       "7              NaN              NaN           NaN                   NaN   \n",
       "8              NaN              NaN           NaN                   NaN   \n",
       "9   sportsfashionn              NaN  9.021634e+11     +90 216 340 71 71   \n",
       "10             NaN              NaN           NaN                   NaN   \n",
       "11             NaN              NaN           NaN                   NaN   \n",
       "12             NaN              NaN           NaN                   NaN   \n",
       "13             NaN              NaN           NaN                   NaN   \n",
       "14    champion_gym              NaN  9.021645e+11     +90 216 445 45 43   \n",
       "\n",
       "    Venue Rating                                  Venue Description  \\\n",
       "0            7.8  Caddebostan Kültür Merkezi’nde hizmet veren te...   \n",
       "1            0.0                                                NaN   \n",
       "2            8.1                                                NaN   \n",
       "3            8.7                                                NaN   \n",
       "4            8.1                                                NaN   \n",
       "5            0.0                                                NaN   \n",
       "6            8.6                                                NaN   \n",
       "7            8.4                                                NaN   \n",
       "8            0.0                                                NaN   \n",
       "9            8.6                                                NaN   \n",
       "10           0.0                                                NaN   \n",
       "11           6.9                                                NaN   \n",
       "12           0.0                                                NaN   \n",
       "13           0.0                                                NaN   \n",
       "14           7.9                                                NaN   \n",
       "\n",
       "    Venue Created  Venue Tips Count  Venue Likes Count  \n",
       "0      1272960310                52                209  \n",
       "1      1273171987                 0                  0  \n",
       "2      1273254989                11                 57  \n",
       "3      1274512241                62                264  \n",
       "4      1281549531                22                 78  \n",
       "5      1286551908                 3                  3  \n",
       "6      1287931059                21                147  \n",
       "7      1289223634                27                149  \n",
       "8      1289409583                 1                  0  \n",
       "9      1290710783               151                617  \n",
       "10     1291567020                 3                  0  \n",
       "11     1292437612                13                 79  \n",
       "12     1292668744                 0                  0  \n",
       "13     1292865763                 0                  0  \n",
       "14     1293031325                36                126  "
      ]
     },
     "execution_count": 46,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "kadikoy_venues_df.head(15)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Let's drop the unnecessary columns and set the index as *Venue Id*\n",
    "\n",
    "**Unnamed: 0_x, Venue Checkins Count, Venue Checkin User Count, Venue Phone** are redundant."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [],
   "source": [
    "kadikoy_venues_df.drop(['Unnamed: 0_x', 'Venue Checkins Count', 'Venue Checkin User Count', 'Venue Phone'], axis=1, inplace=True)\n",
    "besiktas_venues_df.drop(['Unnamed: 0_x', 'Venue Checkins Count', 'Venue Checkin User Count', 'Venue Phone'], axis=1, inplace=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {},
   "outputs": [],
   "source": [
    "kadikoy_venues_df.set_index('Venue Id', inplace=True)\n",
    "besiktas_venues_df.set_index('Venue Id', inplace=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Let's record the last version for the data analysis"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 51,
   "metadata": {},
   "outputs": [],
   "source": [
    "kadikoy_venues_df.to_csv('kadikoy_venues.csv')\n",
    "besiktas_venues_df.to_csv('besiktas_venues.csv')"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python",
   "language": "python",
   "name": "conda-env-python-py"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.10"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}