Notebooks/tratamento_dados.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "Projeto_Modulo_3.ipynb",
      "provenance": [],
      "mount_file_id": "https://github.com/EltonGS/bootcamp_datascience_projeto_3/blob/main/Notebooks/tratamento_dados.ipynb",
      "authorship_tag": "ABX9TyP8J9EUXVfHAokKP7VckBff",
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "language_info": {
      "name": "python"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/EltonGS/bootcamp_datascience_projeto_3/blob/main/Notebooks/tratamento_dados.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "FDKe8aHZKeYN"
      },
      "source": [
        "## Informações sobre a base de dados\n",
        "\n",
        "Ao verificar a página de onde os dados foram extraídos, [Brasil.IO](https://brasil.io/dataset/covid19/caso_full/), temos a informaçãos que alguns dados podem ser repetidos no dataset quando os dados não foram divulgados pela **SES - Secretarias Estaduais de Saúde**.\n",
        "\n",
        "No dataset temos as colunas **is_last** e **is_repeated** que identificam quando um dado é a **última atualização disponível** e quando o **dado é repetido**, respectivamente.\n",
        "\n",
        "**Dados extraídos no dia 28/06/2021**.\n",
        "\n",
        "O repositório desse projeto pode ser encontrado [aqui](https://github.com/EltonGS/bootcamp_datascience_projeto_3)."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "uFF940TN5GFG"
      },
      "source": [
        "# importando as bibliotecas que serão usadas\n",
        "import pandas as pd\n",
        "import numpy as np"
      ],
      "execution_count": 1,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "-SrbkDaK5M1K"
      },
      "source": [
        "# caminho de onde estão os dados utilizados\n",
        "url = '/content/drive/MyDrive/Colab Notebooks/Bootcamp Data Science/Módulo 3/Arquivos/dados_crus/caso_full.zip'\n",
        "\n",
        "# lendo o arquivo com os dados que estão comprimidos no padrão zip\n",
        "dados_totais = pd.read_csv(url, compression='zip')"
      ],
      "execution_count": 2,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 213
        },
        "id": "Wnfgc4a89AzJ",
        "outputId": "a37468a1-7a64-4448-b76c-6a6821f20f3a"
      },
      "source": [
        "# visualizando os dados\n",
        "dados_totais.head(3)"
      ],
      "execution_count": 3,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>Rio Branco</td>\n",
              "      <td>1200401.0</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>202012</td>\n",
              "      <td>413418.0</td>\n",
              "      <td>407319.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3</td>\n",
              "      <td>0.72566</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>city</td>\n",
              "      <td>AC</td>\n",
              "      <td>3</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>NaN</td>\n",
              "      <td>12.0</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>202012</td>\n",
              "      <td>894470.0</td>\n",
              "      <td>881935.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3</td>\n",
              "      <td>0.33539</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>state</td>\n",
              "      <td>AC</td>\n",
              "      <td>3</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Rio Branco</td>\n",
              "      <td>1200401.0</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>202012</td>\n",
              "      <td>413418.0</td>\n",
              "      <td>407319.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3</td>\n",
              "      <td>0.72566</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>2</td>\n",
              "      <td>city</td>\n",
              "      <td>AC</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "         city  city_ibge_code        date  ...  state  new_confirmed  new_deaths\n",
              "0  Rio Branco       1200401.0  2020-03-17  ...     AC              3           0\n",
              "1         NaN            12.0  2020-03-17  ...     AC              3           0\n",
              "2  Rio Branco       1200401.0  2020-03-18  ...     AC              0           0\n",
              "\n",
              "[3 rows x 18 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 3
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "lIgnF_qCE2rd"
      },
      "source": [
        "### É possível perceber uma linha abaixo dos dados da cidade de Rio Branco que parece repetir o dado da linha acima, ao repararmos na coluna place_type vemos que essa segunda linha se refere ao estado onde a cidade está. Para a cidade de Rio Branco temos os dados do estado do Acre."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "kicFYsfLFW-z"
      },
      "source": [
        "### Para esse trabalho focaremos na cidade de Santo André no estado de São Paulo, onde resido."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "SJ2ETIolEUuF",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 609
        },
        "outputId": "ddfa7e0d-720b-4a8f-ddb7-04f79b0b2631"
      },
      "source": [
        "# verificando os dados que são da cidade (city) santo andré E do estado (state) SP\n",
        "dados_sa = dados_totais.query(\"city == 'Santo André' & state == 'SP'\")\n",
        "dados_sa"
      ],
      "execution_count": 4,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>1995526</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-16</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.13863</td>\n",
              "      <td>2020-03-16</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995536</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.13863</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>2</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995551</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>6</td>\n",
              "      <td>0.83175</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995569</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-19</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>2</td>\n",
              "      <td>0.27725</td>\n",
              "      <td>2020-03-19</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>4</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>-4</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995592</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-20</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3</td>\n",
              "      <td>0.41588</td>\n",
              "      <td>2020-03-20</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>5</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2265700</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-24</td>\n",
              "      <td>202125</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>57186</td>\n",
              "      <td>7927.43787</td>\n",
              "      <td>2021-06-24</td>\n",
              "      <td>0.0478</td>\n",
              "      <td>2731</td>\n",
              "      <td>466</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>211</td>\n",
              "      <td>10</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2266347</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-25</td>\n",
              "      <td>202125</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>57517</td>\n",
              "      <td>7973.32291</td>\n",
              "      <td>2021-06-25</td>\n",
              "      <td>0.0476</td>\n",
              "      <td>2739</td>\n",
              "      <td>467</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>331</td>\n",
              "      <td>8</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2266994</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-26</td>\n",
              "      <td>202125</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>57718</td>\n",
              "      <td>8001.18663</td>\n",
              "      <td>2021-06-26</td>\n",
              "      <td>0.0475</td>\n",
              "      <td>2744</td>\n",
              "      <td>468</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>201</td>\n",
              "      <td>5</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2267641</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>202126</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>True</td>\n",
              "      <td>False</td>\n",
              "      <td>57811</td>\n",
              "      <td>8014.07881</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>0.0476</td>\n",
              "      <td>2750</td>\n",
              "      <td>469</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>93</td>\n",
              "      <td>6</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2268288</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-28</td>\n",
              "      <td>202126</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>57811</td>\n",
              "      <td>8014.07881</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>0.0476</td>\n",
              "      <td>2750</td>\n",
              "      <td>470</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>470 rows × 18 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "                city  city_ibge_code  ... new_confirmed  new_deaths\n",
              "1995526  Santo André       3547809.0  ...             1           0\n",
              "1995536  Santo André       3547809.0  ...             0           0\n",
              "1995551  Santo André       3547809.0  ...             5           0\n",
              "1995569  Santo André       3547809.0  ...            -4           0\n",
              "1995592  Santo André       3547809.0  ...             1           0\n",
              "...              ...             ...  ...           ...         ...\n",
              "2265700  Santo André       3547809.0  ...           211          10\n",
              "2266347  Santo André       3547809.0  ...           331           8\n",
              "2266994  Santo André       3547809.0  ...           201           5\n",
              "2267641  Santo André       3547809.0  ...            93           6\n",
              "2268288  Santo André       3547809.0  ...             0           0\n",
              "\n",
              "[470 rows x 18 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 4
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "IyeK_T-iHfvx"
      },
      "source": [
        "Nos dados mostrados acima temos 470 linhas para a cidade Santo André em SP, e temos também o código IBGE da cidade: **3547809.0**\n",
        "\n",
        "Assim podemos verificar se temos todos os dados referente a essa cidade."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "Mp53-V4jHdob",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 609
        },
        "outputId": "e247ebc0-84cd-4bf5-d5e6-c549ef3e1c62"
      },
      "source": [
        "# extração dos dados pelo código da cidade\n",
        "dados_sa2 = dados_totais.query(\"city_ibge_code == 3547809.0\")\n",
        "dados_sa2"
      ],
      "execution_count": 5,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>1995526</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-16</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.13863</td>\n",
              "      <td>2020-03-16</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995536</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.13863</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>2</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995551</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>6</td>\n",
              "      <td>0.83175</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995569</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-19</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>2</td>\n",
              "      <td>0.27725</td>\n",
              "      <td>2020-03-19</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>4</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>-4</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995592</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-20</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3</td>\n",
              "      <td>0.41588</td>\n",
              "      <td>2020-03-20</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>5</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2265700</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-24</td>\n",
              "      <td>202125</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>57186</td>\n",
              "      <td>7927.43787</td>\n",
              "      <td>2021-06-24</td>\n",
              "      <td>0.0478</td>\n",
              "      <td>2731</td>\n",
              "      <td>466</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>211</td>\n",
              "      <td>10</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2266347</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-25</td>\n",
              "      <td>202125</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>57517</td>\n",
              "      <td>7973.32291</td>\n",
              "      <td>2021-06-25</td>\n",
              "      <td>0.0476</td>\n",
              "      <td>2739</td>\n",
              "      <td>467</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>331</td>\n",
              "      <td>8</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2266994</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-26</td>\n",
              "      <td>202125</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>57718</td>\n",
              "      <td>8001.18663</td>\n",
              "      <td>2021-06-26</td>\n",
              "      <td>0.0475</td>\n",
              "      <td>2744</td>\n",
              "      <td>468</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>201</td>\n",
              "      <td>5</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2267641</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>202126</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>True</td>\n",
              "      <td>False</td>\n",
              "      <td>57811</td>\n",
              "      <td>8014.07881</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>0.0476</td>\n",
              "      <td>2750</td>\n",
              "      <td>469</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>93</td>\n",
              "      <td>6</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2268288</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-28</td>\n",
              "      <td>202126</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>57811</td>\n",
              "      <td>8014.07881</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>0.0476</td>\n",
              "      <td>2750</td>\n",
              "      <td>470</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>470 rows × 18 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "                city  city_ibge_code  ... new_confirmed  new_deaths\n",
              "1995526  Santo André       3547809.0  ...             1           0\n",
              "1995536  Santo André       3547809.0  ...             0           0\n",
              "1995551  Santo André       3547809.0  ...             5           0\n",
              "1995569  Santo André       3547809.0  ...            -4           0\n",
              "1995592  Santo André       3547809.0  ...             1           0\n",
              "...              ...             ...  ...           ...         ...\n",
              "2265700  Santo André       3547809.0  ...           211          10\n",
              "2266347  Santo André       3547809.0  ...           331           8\n",
              "2266994  Santo André       3547809.0  ...           201           5\n",
              "2267641  Santo André       3547809.0  ...            93           6\n",
              "2268288  Santo André       3547809.0  ...             0           0\n",
              "\n",
              "[470 rows x 18 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 5
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "uOTlfHaFIMsD"
      },
      "source": [
        "Os dados extraídos das duas maneiras são os mesmos. Continuaremos com os dados do dataframe **dados_sa**."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "jqSYNpAWFcrU",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "fe0ae079-a262-4f5b-d09a-4fe50b40cf0b"
      },
      "source": [
        "# verificação se há alguma dado NaN em nosso dataframe\n",
        "dados_sa.isna().value_counts()"
      ],
      "execution_count": 6,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "city   city_ibge_code  date   epidemiological_week  estimated_population  estimated_population_2019  is_last  is_repeated  last_available_confirmed  last_available_confirmed_per_100k_inhabitants  last_available_date  last_available_death_rate  last_available_deaths  order_for_place  place_type  state  new_confirmed  new_deaths\n",
              "False  False           False  False                 False                 False                      False    False        False                     False                                          False                False                      False                  False            False       False  False          False         470\n",
              "dtype: int64"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 6
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "rLEgySo7GAqF",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 213
        },
        "outputId": "be6c06d6-0244-4950-d9ed-9ef70c93f39a"
      },
      "source": [
        "# redefinindo o index para facilitar o trabalho com os dados\n",
        "dados_sa = dados_sa.reset_index()\n",
        "\n",
        "# dados com o index resetado\n",
        "dados_sa.head(3)"
      ],
      "execution_count": 7,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>index</th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>1995526</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-16</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.13863</td>\n",
              "      <td>2020-03-16</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>1995536</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.13863</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>2</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>1995551</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>6</td>\n",
              "      <td>0.83175</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "     index         city  city_ibge_code  ... state  new_confirmed  new_deaths\n",
              "0  1995526  Santo André       3547809.0  ...    SP              1           0\n",
              "1  1995536  Santo André       3547809.0  ...    SP              0           0\n",
              "2  1995551  Santo André       3547809.0  ...    SP              5           0\n",
              "\n",
              "[3 rows x 19 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 7
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "owMFDgtKHWSH",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "44c2fe99-64df-4ba1-c8d3-701b5642429e"
      },
      "source": [
        "# verificando se temos alguma informação True na coluna is_last\n",
        "dados_sa['is_last'].value_counts()"
      ],
      "execution_count": 8,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "False    469\n",
              "True       1\n",
              "Name: is_last, dtype: int64"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 8
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "mFvDp3D5IwtM",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 117
        },
        "outputId": "4a975e14-a6e1-4590-dfae-b8b8e6df20d8"
      },
      "source": [
        "# verificando onde está o dado True identificado acima\n",
        "dados_sa.query(\"is_last == True\")"
      ],
      "execution_count": 9,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>index</th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>468</th>\n",
              "      <td>2267641</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>202126</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>True</td>\n",
              "      <td>False</td>\n",
              "      <td>57811</td>\n",
              "      <td>8014.07881</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>0.0476</td>\n",
              "      <td>2750</td>\n",
              "      <td>469</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>93</td>\n",
              "      <td>6</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "       index         city  city_ibge_code  ... state  new_confirmed  new_deaths\n",
              "468  2267641  Santo André       3547809.0  ...    SP             93           6\n",
              "\n",
              "[1 rows x 19 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 9
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "qX8st4coI5gv",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "76bf5de4-851d-4971-8511-35880de58b5a"
      },
      "source": [
        "# verificando os dados da linha 468 do index\n",
        "dados_sa.loc[468]"
      ],
      "execution_count": 10,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "index                                                2267641\n",
              "city                                             Santo André\n",
              "city_ibge_code                                   3.54781e+06\n",
              "date                                              2021-06-27\n",
              "epidemiological_week                                  202126\n",
              "estimated_population                                  721368\n",
              "estimated_population_2019                             718773\n",
              "is_last                                                 True\n",
              "is_repeated                                            False\n",
              "last_available_confirmed                               57811\n",
              "last_available_confirmed_per_100k_inhabitants        8014.08\n",
              "last_available_date                               2021-06-27\n",
              "last_available_death_rate                             0.0476\n",
              "last_available_deaths                                   2750\n",
              "order_for_place                                          469\n",
              "place_type                                              city\n",
              "state                                                     SP\n",
              "new_confirmed                                             93\n",
              "new_deaths                                                 6\n",
              "Name: 468, dtype: object"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 10
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "gF1H67xdMkRX"
      },
      "source": [
        "Podemos ver na informação acima que a **última atualização disponível** para **Santo André / SP** é da data **27/06/2021**.\n",
        "\n",
        "Agora vamos verificar se em nosso dataframe temos algum dado repetido."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "arwrGhLmMTCT",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "84eb0830-e857-4c41-b63a-4fb50c5b096e"
      },
      "source": [
        "# verificando se temos alguma informação True na coluna is_repeated\n",
        "dados_sa['is_repeated'].value_counts()"
      ],
      "execution_count": 11,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "False    442\n",
              "True      28\n",
              "Name: is_repeated, dtype: int64"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 11
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "nLbGz6umNH_d",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "outputId": "1d029a6d-acbc-482f-85ca-d5a40ad81d5c"
      },
      "source": [
        "# verificando quais são os dados repetidos que temos no datafarme\n",
        "dados_repetidos = dados_sa.query(\"is_repeated == True\")\n",
        "dados_repetidos"
      ],
      "execution_count": 12,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>index</th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>5</th>\n",
              "      <td>1995615</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-21</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>3</td>\n",
              "      <td>0.41588</td>\n",
              "      <td>2020-03-20</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>6</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>6</th>\n",
              "      <td>1995638</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-22</td>\n",
              "      <td>202013</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>3</td>\n",
              "      <td>0.41588</td>\n",
              "      <td>2020-03-20</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>7</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>7</th>\n",
              "      <td>1995661</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-23</td>\n",
              "      <td>202013</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>3</td>\n",
              "      <td>0.41588</td>\n",
              "      <td>2020-03-20</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>8</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>8</th>\n",
              "      <td>1995684</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-24</td>\n",
              "      <td>202013</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>3</td>\n",
              "      <td>0.41588</td>\n",
              "      <td>2020-03-20</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>9</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>12</th>\n",
              "      <td>1995830</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-28</td>\n",
              "      <td>202013</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>17</td>\n",
              "      <td>2.35663</td>\n",
              "      <td>2020-03-27</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>13</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>13</th>\n",
              "      <td>1995870</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-29</td>\n",
              "      <td>202014</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>17</td>\n",
              "      <td>2.35663</td>\n",
              "      <td>2020-03-27</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>14</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>166</th>\n",
              "      <td>2072247</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-08-29</td>\n",
              "      <td>202035</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>14405</td>\n",
              "      <td>1996.90033</td>\n",
              "      <td>2020-08-28</td>\n",
              "      <td>0.0353</td>\n",
              "      <td>509</td>\n",
              "      <td>167</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>175</th>\n",
              "      <td>2078070</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-09-07</td>\n",
              "      <td>202037</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>15181</td>\n",
              "      <td>2104.47372</td>\n",
              "      <td>2020-09-06</td>\n",
              "      <td>0.0364</td>\n",
              "      <td>553</td>\n",
              "      <td>176</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>202</th>\n",
              "      <td>2095539</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-10-04</td>\n",
              "      <td>202041</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>17526</td>\n",
              "      <td>2429.55052</td>\n",
              "      <td>2020-10-03</td>\n",
              "      <td>0.0350</td>\n",
              "      <td>613</td>\n",
              "      <td>203</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>203</th>\n",
              "      <td>2096186</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-10-05</td>\n",
              "      <td>202041</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>17526</td>\n",
              "      <td>2429.55052</td>\n",
              "      <td>2020-10-03</td>\n",
              "      <td>0.0350</td>\n",
              "      <td>613</td>\n",
              "      <td>204</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>205</th>\n",
              "      <td>2097480</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-10-07</td>\n",
              "      <td>202041</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>17621</td>\n",
              "      <td>2442.71994</td>\n",
              "      <td>2020-10-06</td>\n",
              "      <td>0.0348</td>\n",
              "      <td>613</td>\n",
              "      <td>206</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>214</th>\n",
              "      <td>2103303</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-10-16</td>\n",
              "      <td>202042</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>18237</td>\n",
              "      <td>2528.11325</td>\n",
              "      <td>2020-10-15</td>\n",
              "      <td>0.0344</td>\n",
              "      <td>627</td>\n",
              "      <td>215</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>230</th>\n",
              "      <td>2113655</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-11-01</td>\n",
              "      <td>202045</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>19398</td>\n",
              "      <td>2689.05746</td>\n",
              "      <td>2020-10-31</td>\n",
              "      <td>0.0333</td>\n",
              "      <td>646</td>\n",
              "      <td>231</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>235</th>\n",
              "      <td>2116890</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-11-06</td>\n",
              "      <td>202045</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>19610</td>\n",
              "      <td>2718.44606</td>\n",
              "      <td>2020-11-05</td>\n",
              "      <td>0.0328</td>\n",
              "      <td>644</td>\n",
              "      <td>236</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>236</th>\n",
              "      <td>2117537</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-11-07</td>\n",
              "      <td>202045</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>19610</td>\n",
              "      <td>2718.44606</td>\n",
              "      <td>2020-11-05</td>\n",
              "      <td>0.0328</td>\n",
              "      <td>644</td>\n",
              "      <td>237</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>237</th>\n",
              "      <td>2118184</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-11-08</td>\n",
              "      <td>202046</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>19610</td>\n",
              "      <td>2718.44606</td>\n",
              "      <td>2020-11-05</td>\n",
              "      <td>0.0328</td>\n",
              "      <td>644</td>\n",
              "      <td>238</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>238</th>\n",
              "      <td>2118831</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-11-09</td>\n",
              "      <td>202046</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>19610</td>\n",
              "      <td>2718.44606</td>\n",
              "      <td>2020-11-05</td>\n",
              "      <td>0.0328</td>\n",
              "      <td>644</td>\n",
              "      <td>239</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>249</th>\n",
              "      <td>2125948</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-11-20</td>\n",
              "      <td>202047</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>21377</td>\n",
              "      <td>2963.39732</td>\n",
              "      <td>2020-11-19</td>\n",
              "      <td>0.0311</td>\n",
              "      <td>665</td>\n",
              "      <td>250</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>275</th>\n",
              "      <td>2142770</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-12-16</td>\n",
              "      <td>202051</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>25275</td>\n",
              "      <td>3503.75952</td>\n",
              "      <td>2020-12-15</td>\n",
              "      <td>0.0294</td>\n",
              "      <td>742</td>\n",
              "      <td>276</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>289</th>\n",
              "      <td>2151828</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-12-30</td>\n",
              "      <td>202053</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>27483</td>\n",
              "      <td>3809.84463</td>\n",
              "      <td>2020-12-29</td>\n",
              "      <td>0.0294</td>\n",
              "      <td>808</td>\n",
              "      <td>290</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>291</th>\n",
              "      <td>2153122</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-01-01</td>\n",
              "      <td>202053</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>27983</td>\n",
              "      <td>3879.15738</td>\n",
              "      <td>2020-12-31</td>\n",
              "      <td>0.0306</td>\n",
              "      <td>855</td>\n",
              "      <td>292</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>404</th>\n",
              "      <td>2226233</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-04-24</td>\n",
              "      <td>202116</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>47982</td>\n",
              "      <td>6651.52876</td>\n",
              "      <td>2021-04-23</td>\n",
              "      <td>0.0408</td>\n",
              "      <td>1957</td>\n",
              "      <td>405</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>411</th>\n",
              "      <td>2230762</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-05-01</td>\n",
              "      <td>202117</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>49130</td>\n",
              "      <td>6810.67084</td>\n",
              "      <td>2021-04-30</td>\n",
              "      <td>0.0420</td>\n",
              "      <td>2064</td>\n",
              "      <td>412</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>426</th>\n",
              "      <td>2240467</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-05-16</td>\n",
              "      <td>202120</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>51248</td>\n",
              "      <td>7104.27965</td>\n",
              "      <td>2021-05-15</td>\n",
              "      <td>0.0440</td>\n",
              "      <td>2257</td>\n",
              "      <td>427</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>442</th>\n",
              "      <td>2250819</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-01</td>\n",
              "      <td>202122</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>53395</td>\n",
              "      <td>7401.90860</td>\n",
              "      <td>2021-05-31</td>\n",
              "      <td>0.0470</td>\n",
              "      <td>2507</td>\n",
              "      <td>443</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>455</th>\n",
              "      <td>2259230</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-14</td>\n",
              "      <td>202124</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>55217</td>\n",
              "      <td>7654.48426</td>\n",
              "      <td>2021-06-13</td>\n",
              "      <td>0.0475</td>\n",
              "      <td>2625</td>\n",
              "      <td>456</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>458</th>\n",
              "      <td>2261171</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-17</td>\n",
              "      <td>202124</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>55797</td>\n",
              "      <td>7734.88705</td>\n",
              "      <td>2021-06-16</td>\n",
              "      <td>0.0476</td>\n",
              "      <td>2657</td>\n",
              "      <td>459</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>469</th>\n",
              "      <td>2268288</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2021-06-28</td>\n",
              "      <td>202126</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>57811</td>\n",
              "      <td>8014.07881</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>0.0476</td>\n",
              "      <td>2750</td>\n",
              "      <td>470</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "       index         city  city_ibge_code  ... state  new_confirmed  new_deaths\n",
              "5    1995615  Santo André       3547809.0  ...    SP              0           0\n",
              "6    1995638  Santo André       3547809.0  ...    SP              0           0\n",
              "7    1995661  Santo André       3547809.0  ...    SP              0           0\n",
              "8    1995684  Santo André       3547809.0  ...    SP              0           0\n",
              "12   1995830  Santo André       3547809.0  ...    SP              0           0\n",
              "13   1995870  Santo André       3547809.0  ...    SP              0           0\n",
              "166  2072247  Santo André       3547809.0  ...    SP              0           0\n",
              "175  2078070  Santo André       3547809.0  ...    SP              0           0\n",
              "202  2095539  Santo André       3547809.0  ...    SP              0           0\n",
              "203  2096186  Santo André       3547809.0  ...    SP              0           0\n",
              "205  2097480  Santo André       3547809.0  ...    SP              0           0\n",
              "214  2103303  Santo André       3547809.0  ...    SP              0           0\n",
              "230  2113655  Santo André       3547809.0  ...    SP              0           0\n",
              "235  2116890  Santo André       3547809.0  ...    SP              0           0\n",
              "236  2117537  Santo André       3547809.0  ...    SP              0           0\n",
              "237  2118184  Santo André       3547809.0  ...    SP              0           0\n",
              "238  2118831  Santo André       3547809.0  ...    SP              0           0\n",
              "249  2125948  Santo André       3547809.0  ...    SP              0           0\n",
              "275  2142770  Santo André       3547809.0  ...    SP              0           0\n",
              "289  2151828  Santo André       3547809.0  ...    SP              0           0\n",
              "291  2153122  Santo André       3547809.0  ...    SP              0           0\n",
              "404  2226233  Santo André       3547809.0  ...    SP              0           0\n",
              "411  2230762  Santo André       3547809.0  ...    SP              0           0\n",
              "426  2240467  Santo André       3547809.0  ...    SP              0           0\n",
              "442  2250819  Santo André       3547809.0  ...    SP              0           0\n",
              "455  2259230  Santo André       3547809.0  ...    SP              0           0\n",
              "458  2261171  Santo André       3547809.0  ...    SP              0           0\n",
              "469  2268288  Santo André       3547809.0  ...    SP              0           0\n",
              "\n",
              "[28 rows x 19 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 12
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "19-o835iN_R7"
      },
      "source": [
        "No dataframe acima (**dados_repetidos**) temos as datas em que os dados foram repetidos por não ter informação divulgada pelo boletime das Secretarias Estaduais de Saúde.\n",
        "\n",
        "Temos um total de **28** datas."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "fnr55RotNcop",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 309
        },
        "outputId": "2b314fb5-f2d5-466c-f2fb-b6eb1b0f52f8"
      },
      "source": [
        "dados_sa.head(5)"
      ],
      "execution_count": 13,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>index</th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>1995526</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-16</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.13863</td>\n",
              "      <td>2020-03-16</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>1995536</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.13863</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>2</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>1995551</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>6</td>\n",
              "      <td>0.83175</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>1995569</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-19</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>2</td>\n",
              "      <td>0.27725</td>\n",
              "      <td>2020-03-19</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>4</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>-4</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>1995592</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-20</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3</td>\n",
              "      <td>0.41588</td>\n",
              "      <td>2020-03-20</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>5</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "     index         city  city_ibge_code  ... state  new_confirmed  new_deaths\n",
              "0  1995526  Santo André       3547809.0  ...    SP              1           0\n",
              "1  1995536  Santo André       3547809.0  ...    SP              0           0\n",
              "2  1995551  Santo André       3547809.0  ...    SP              5           0\n",
              "3  1995569  Santo André       3547809.0  ...    SP             -4           0\n",
              "4  1995592  Santo André       3547809.0  ...    SP              1           0\n",
              "\n",
              "[5 rows x 19 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 13
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "_xmfQmObOZrS"
      },
      "source": [
        "# renomeando as colunas para facilitar o trabalho com os dados\n",
        "dados_sa.rename(columns={\n",
        "    'city' : 'cidade',\n",
        "    'city_ibge_code' : 'codigo_cidade',\n",
        "    'date' : 'data',\n",
        "    'epidemiological_week' : 'semana_epidem',\n",
        "    'estimated_population' : 'populacao',\n",
        "    'estimated_population_2019' : 'populacao_2019',\n",
        "    'last_available_confirmed' : 'casos_confirmados',\n",
        "    'last_available_confirmed_per_100k_inhabitants' : 'casos_por_100k_habitantes',\n",
        "    'last_available_date' : 'data_atualizacao',\n",
        "    'last_available_death_rate' : 'taxa_mortalidade',\n",
        "    'last_available_deaths' : 'obitos',\n",
        "    'state' : 'estado',\n",
        "    'new_confirmed' : 'casos_novos',\n",
        "    'new_deaths' : 'obitos_novos'}, inplace=True)"
      ],
      "execution_count": 14,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "f9ioDJtWRw1k",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 213
        },
        "outputId": "ea162c12-9b6a-40f2-a3cb-32ddee2abb57"
      },
      "source": [
        "# visualizando os novos nomes das colunas\n",
        "dados_sa.head(3)"
      ],
      "execution_count": 15,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>index</th>\n",
              "      <th>cidade</th>\n",
              "      <th>codigo_cidade</th>\n",
              "      <th>data</th>\n",
              "      <th>semana_epidem</th>\n",
              "      <th>populacao</th>\n",
              "      <th>populacao_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>casos_confirmados</th>\n",
              "      <th>casos_por_100k_habitantes</th>\n",
              "      <th>data_atualizacao</th>\n",
              "      <th>taxa_mortalidade</th>\n",
              "      <th>obitos</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>estado</th>\n",
              "      <th>casos_novos</th>\n",
              "      <th>obitos_novos</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>1995526</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-16</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.13863</td>\n",
              "      <td>2020-03-16</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>1995536</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.13863</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>2</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>1995551</td>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>6</td>\n",
              "      <td>0.83175</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>city</td>\n",
              "      <td>SP</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "     index       cidade  codigo_cidade  ... estado  casos_novos  obitos_novos\n",
              "0  1995526  Santo André      3547809.0  ...     SP            1             0\n",
              "1  1995536  Santo André      3547809.0  ...     SP            0             0\n",
              "2  1995551  Santo André      3547809.0  ...     SP            5             0\n",
              "\n",
              "[3 rows x 19 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 15
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "79trHiGhSO9U"
      },
      "source": [
        "# removendo as colunas que não interessam para o projeto\n",
        "dados_sa.drop(['index', 'order_for_place', 'place_type'], axis=1, inplace=True)"
      ],
      "execution_count": 16,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "0qGTMVb1TT6q",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 213
        },
        "outputId": "23c4709f-85c7-4280-8dc8-d0e6b6d8a604"
      },
      "source": [
        "dados_sa.head(3)"
      ],
      "execution_count": 17,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>cidade</th>\n",
              "      <th>codigo_cidade</th>\n",
              "      <th>data</th>\n",
              "      <th>semana_epidem</th>\n",
              "      <th>populacao</th>\n",
              "      <th>populacao_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>casos_confirmados</th>\n",
              "      <th>casos_por_100k_habitantes</th>\n",
              "      <th>data_atualizacao</th>\n",
              "      <th>taxa_mortalidade</th>\n",
              "      <th>obitos</th>\n",
              "      <th>estado</th>\n",
              "      <th>casos_novos</th>\n",
              "      <th>obitos_novos</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-16</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.13863</td>\n",
              "      <td>2020-03-16</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.13863</td>\n",
              "      <td>2020-03-17</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>Santo André</td>\n",
              "      <td>3547809.0</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>202012</td>\n",
              "      <td>721368.0</td>\n",
              "      <td>718773.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>6</td>\n",
              "      <td>0.83175</td>\n",
              "      <td>2020-03-18</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>SP</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "        cidade  codigo_cidade        data  ...  estado  casos_novos  obitos_novos\n",
              "0  Santo André      3547809.0  2020-03-16  ...      SP            1             0\n",
              "1  Santo André      3547809.0  2020-03-17  ...      SP            0             0\n",
              "2  Santo André      3547809.0  2020-03-18  ...      SP            5             0\n",
              "\n",
              "[3 rows x 16 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 17
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "E02wGD2aU0EQ"
      },
      "source": [
        "Agora temos os dados para **Santo André / SP** tratados.\n",
        "\n",
        "Foram identificadas as linhas com dados repetidos, se haviam dados NaN, o index foi resetados, as colunas foram renomeadas e as colunas que não interessam para essa análise foram removidas.\n",
        "\n",
        "Para efeito de comparação com os dados de Santo André, também serão extraídos os dados do estado de São Paulo.\n"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "tc80Xu5kUkE2"
      },
      "source": [
        "# extraindo a informação para o estado de SP\n",
        "dados_estadual_sp = dados_totais.query(\"state == 'SP' & place_type == 'state'\")"
      ],
      "execution_count": 18,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "rM2kw6q9VoY8",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 609
        },
        "outputId": "7de67995-2e40-4e56-9fd0-276c2b5bd730"
      },
      "source": [
        "# visualizando os dados para o estado de SP\n",
        "dados_estadual_sp"
      ],
      "execution_count": 19,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>1995468</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-25</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-25</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995470</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-26</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-26</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>2</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995472</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-27</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-27</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995474</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-28</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>2</td>\n",
              "      <td>0.00432</td>\n",
              "      <td>2020-02-28</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>4</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995476</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-29</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>2</td>\n",
              "      <td>0.00432</td>\n",
              "      <td>2020-02-29</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>5</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2265817</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-24</td>\n",
              "      <td>202125</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3648202</td>\n",
              "      <td>7881.30172</td>\n",
              "      <td>2021-06-24</td>\n",
              "      <td>0.0342</td>\n",
              "      <td>124606</td>\n",
              "      <td>486</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>17951</td>\n",
              "      <td>781</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2266464</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-25</td>\n",
              "      <td>202125</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3669196</td>\n",
              "      <td>7926.65559</td>\n",
              "      <td>2021-06-25</td>\n",
              "      <td>0.0342</td>\n",
              "      <td>125378</td>\n",
              "      <td>487</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>20994</td>\n",
              "      <td>772</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2267111</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-26</td>\n",
              "      <td>202125</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3688128</td>\n",
              "      <td>7967.55486</td>\n",
              "      <td>2021-06-26</td>\n",
              "      <td>0.0341</td>\n",
              "      <td>125916</td>\n",
              "      <td>488</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>18932</td>\n",
              "      <td>538</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2267758</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>202126</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3696093</td>\n",
              "      <td>7984.76185</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>0.0341</td>\n",
              "      <td>126050</td>\n",
              "      <td>489</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>7965</td>\n",
              "      <td>134</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2268405</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-28</td>\n",
              "      <td>202126</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>True</td>\n",
              "      <td>False</td>\n",
              "      <td>3700378</td>\n",
              "      <td>7994.01884</td>\n",
              "      <td>2021-06-28</td>\n",
              "      <td>0.0341</td>\n",
              "      <td>126112</td>\n",
              "      <td>490</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>4285</td>\n",
              "      <td>62</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>490 rows × 18 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "        city  city_ibge_code        date  ...  state  new_confirmed  new_deaths\n",
              "1995468  NaN            35.0  2020-02-25  ...     SP              1           0\n",
              "1995470  NaN            35.0  2020-02-26  ...     SP              0           0\n",
              "1995472  NaN            35.0  2020-02-27  ...     SP              0           0\n",
              "1995474  NaN            35.0  2020-02-28  ...     SP              1           0\n",
              "1995476  NaN            35.0  2020-02-29  ...     SP              0           0\n",
              "...      ...             ...         ...  ...    ...            ...         ...\n",
              "2265817  NaN            35.0  2021-06-24  ...     SP          17951         781\n",
              "2266464  NaN            35.0  2021-06-25  ...     SP          20994         772\n",
              "2267111  NaN            35.0  2021-06-26  ...     SP          18932         538\n",
              "2267758  NaN            35.0  2021-06-27  ...     SP           7965         134\n",
              "2268405  NaN            35.0  2021-06-28  ...     SP           4285          62\n",
              "\n",
              "[490 rows x 18 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 19
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "h2gc9TrmWWU0"
      },
      "source": [
        "Temos um dataframe com **490 linhas** e **18 colunas**."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "9irZHYbGWI9Z",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 609
        },
        "outputId": "2342f58c-76c0-45f5-a24a-6b88eaf59605"
      },
      "source": [
        "# extraindo os dados pelo código do IBGE para comparar\n",
        "dados_estadual_sp2 = dados_totais.query(\"city_ibge_code == 35.0\")\n",
        "\n",
        "# visualizando os dados extraídos\n",
        "dados_estadual_sp2"
      ],
      "execution_count": 20,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>1995468</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-25</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-25</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995470</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-26</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-26</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>2</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995472</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-27</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-27</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995474</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-28</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>2</td>\n",
              "      <td>0.00432</td>\n",
              "      <td>2020-02-28</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>4</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995476</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-29</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>2</td>\n",
              "      <td>0.00432</td>\n",
              "      <td>2020-02-29</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>5</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2265817</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-24</td>\n",
              "      <td>202125</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3648202</td>\n",
              "      <td>7881.30172</td>\n",
              "      <td>2021-06-24</td>\n",
              "      <td>0.0342</td>\n",
              "      <td>124606</td>\n",
              "      <td>486</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>17951</td>\n",
              "      <td>781</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2266464</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-25</td>\n",
              "      <td>202125</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3669196</td>\n",
              "      <td>7926.65559</td>\n",
              "      <td>2021-06-25</td>\n",
              "      <td>0.0342</td>\n",
              "      <td>125378</td>\n",
              "      <td>487</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>20994</td>\n",
              "      <td>772</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2267111</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-26</td>\n",
              "      <td>202125</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3688128</td>\n",
              "      <td>7967.55486</td>\n",
              "      <td>2021-06-26</td>\n",
              "      <td>0.0341</td>\n",
              "      <td>125916</td>\n",
              "      <td>488</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>18932</td>\n",
              "      <td>538</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2267758</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>202126</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3696093</td>\n",
              "      <td>7984.76185</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>0.0341</td>\n",
              "      <td>126050</td>\n",
              "      <td>489</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>7965</td>\n",
              "      <td>134</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2268405</th>\n",
              "      <td>NaN</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-28</td>\n",
              "      <td>202126</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>True</td>\n",
              "      <td>False</td>\n",
              "      <td>3700378</td>\n",
              "      <td>7994.01884</td>\n",
              "      <td>2021-06-28</td>\n",
              "      <td>0.0341</td>\n",
              "      <td>126112</td>\n",
              "      <td>490</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>4285</td>\n",
              "      <td>62</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>490 rows × 18 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "        city  city_ibge_code        date  ...  state  new_confirmed  new_deaths\n",
              "1995468  NaN            35.0  2020-02-25  ...     SP              1           0\n",
              "1995470  NaN            35.0  2020-02-26  ...     SP              0           0\n",
              "1995472  NaN            35.0  2020-02-27  ...     SP              0           0\n",
              "1995474  NaN            35.0  2020-02-28  ...     SP              1           0\n",
              "1995476  NaN            35.0  2020-02-29  ...     SP              0           0\n",
              "...      ...             ...         ...  ...    ...            ...         ...\n",
              "2265817  NaN            35.0  2021-06-24  ...     SP          17951         781\n",
              "2266464  NaN            35.0  2021-06-25  ...     SP          20994         772\n",
              "2267111  NaN            35.0  2021-06-26  ...     SP          18932         538\n",
              "2267758  NaN            35.0  2021-06-27  ...     SP           7965         134\n",
              "2268405  NaN            35.0  2021-06-28  ...     SP           4285          62\n",
              "\n",
              "[490 rows x 18 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 20
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "IfmA3i8kWxcK"
      },
      "source": [
        "A informação é igual a que foi extraída anteriormente. A partir daqui continuaremos com o dataframe **dados_estadual_sp**."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "prTzkkF5Wv1s",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "66c73fbc-ce2c-4c66-ae66-ba219bc912f1"
      },
      "source": [
        "# verificando se temos dados NaN em nosso dataframe\n",
        "dados_estadual_sp.isna().value_counts()"
      ],
      "execution_count": 21,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "city  city_ibge_code  date   epidemiological_week  estimated_population  estimated_population_2019  is_last  is_repeated  last_available_confirmed  last_available_confirmed_per_100k_inhabitants  last_available_date  last_available_death_rate  last_available_deaths  order_for_place  place_type  state  new_confirmed  new_deaths\n",
              "True  False           False  False                 False                 False                      False    False        False                     False                                          False                False                      False                  False            False       False  False          False         490\n",
              "dtype: int64"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 21
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "gaxCpMLuXZmD"
      },
      "source": [
        "Na coluna **city** temos dados NaN pois os dados não são referentes a nenhuma cidade mas sim ao estado de São Paulo.\n",
        "\n",
        "Para tornar o trabalho com os dados mais intuitivo e simples, substituiremos a informação NaN pelo nome do estado São Paulo."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "z4j_mlhzXORg",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 298
        },
        "outputId": "bc9b99fa-5c04-4638-db4d-6e180596d6b3"
      },
      "source": [
        "# substituindo a informação NaN na coluna city pelo nome do estado São Paulo\n",
        "dados_estadual_sp['city'].replace(np.nan, 'São Paulo', inplace=True)\n",
        "\n",
        "# visualizando os dados com a alteração na coluna city\n",
        "dados_estadual_sp.head(3)"
      ],
      "execution_count": 22,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "/usr/local/lib/python3.7/dist-packages/pandas/core/series.py:4582: SettingWithCopyWarning: \n",
            "A value is trying to be set on a copy of a slice from a DataFrame\n",
            "\n",
            "See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy\n",
            "  method=method,\n"
          ],
          "name": "stderr"
        },
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>1995468</th>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-25</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-25</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995470</th>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-26</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-26</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>2</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1995472</th>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-27</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-27</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "              city  city_ibge_code        date  ...  state  new_confirmed  new_deaths\n",
              "1995468  São Paulo            35.0  2020-02-25  ...     SP              1           0\n",
              "1995470  São Paulo            35.0  2020-02-26  ...     SP              0           0\n",
              "1995472  São Paulo            35.0  2020-02-27  ...     SP              0           0\n",
              "\n",
              "[3 rows x 18 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 22
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "mgMb5fAcZHe6",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "f81cfc39-1bd7-40d6-811c-4562a0a79913"
      },
      "source": [
        "# verificando se há mais algum dados NaN no dataframe\n",
        "dados_estadual_sp.isna().value_counts()"
      ],
      "execution_count": 23,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "city   city_ibge_code  date   epidemiological_week  estimated_population  estimated_population_2019  is_last  is_repeated  last_available_confirmed  last_available_confirmed_per_100k_inhabitants  last_available_date  last_available_death_rate  last_available_deaths  order_for_place  place_type  state  new_confirmed  new_deaths\n",
              "False  False           False  False                 False                 False                      False    False        False                     False                                          False                False                      False                  False            False       False  False          False         490\n",
              "dtype: int64"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 23
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "T675Pp5OYrFO",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 213
        },
        "outputId": "677073b9-286b-4bc7-88ab-7f1e7346e3fa"
      },
      "source": [
        "# resetando o index para facilitar o trabalho com os dados\n",
        "dados_estadual_sp = dados_estadual_sp.reset_index()\n",
        "\n",
        "# visualizando os dados com o novo index\n",
        "dados_estadual_sp.head(3)"
      ],
      "execution_count": 24,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>index</th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>1995468</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-25</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-25</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>1995470</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-26</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-26</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>2</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>1995472</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-27</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-27</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "     index       city  city_ibge_code  ... state  new_confirmed  new_deaths\n",
              "0  1995468  São Paulo            35.0  ...    SP              1           0\n",
              "1  1995470  São Paulo            35.0  ...    SP              0           0\n",
              "2  1995472  São Paulo            35.0  ...    SP              0           0\n",
              "\n",
              "[3 rows x 19 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 24
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "tYIbVxMEZDRe",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 117
        },
        "outputId": "28686f08-ee2d-46d4-e214-a17375156398"
      },
      "source": [
        "# verificando a coluna is_last se temos algum dado True\n",
        "dados_estadual_sp.query(\"is_last == True\")"
      ],
      "execution_count": 25,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>index</th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>489</th>\n",
              "      <td>2268405</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-28</td>\n",
              "      <td>202126</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>True</td>\n",
              "      <td>False</td>\n",
              "      <td>3700378</td>\n",
              "      <td>7994.01884</td>\n",
              "      <td>2021-06-28</td>\n",
              "      <td>0.0341</td>\n",
              "      <td>126112</td>\n",
              "      <td>490</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>4285</td>\n",
              "      <td>62</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "       index       city  city_ibge_code  ... state  new_confirmed  new_deaths\n",
              "489  2268405  São Paulo            35.0  ...    SP           4285          62\n",
              "\n",
              "[1 rows x 19 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 25
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "AOno617QZwC3",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 213
        },
        "outputId": "b9674b23-fc82-4f65-8087-eba9762a2891"
      },
      "source": [
        "dados_estadual_sp.tail(3)"
      ],
      "execution_count": 26,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>index</th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>487</th>\n",
              "      <td>2267111</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-26</td>\n",
              "      <td>202125</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3688128</td>\n",
              "      <td>7967.55486</td>\n",
              "      <td>2021-06-26</td>\n",
              "      <td>0.0341</td>\n",
              "      <td>125916</td>\n",
              "      <td>488</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>18932</td>\n",
              "      <td>538</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>488</th>\n",
              "      <td>2267758</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>202126</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>3696093</td>\n",
              "      <td>7984.76185</td>\n",
              "      <td>2021-06-27</td>\n",
              "      <td>0.0341</td>\n",
              "      <td>126050</td>\n",
              "      <td>489</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>7965</td>\n",
              "      <td>134</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>489</th>\n",
              "      <td>2268405</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2021-06-28</td>\n",
              "      <td>202126</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>True</td>\n",
              "      <td>False</td>\n",
              "      <td>3700378</td>\n",
              "      <td>7994.01884</td>\n",
              "      <td>2021-06-28</td>\n",
              "      <td>0.0341</td>\n",
              "      <td>126112</td>\n",
              "      <td>490</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>4285</td>\n",
              "      <td>62</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "       index       city  city_ibge_code  ... state  new_confirmed  new_deaths\n",
              "487  2267111  São Paulo            35.0  ...    SP          18932         538\n",
              "488  2267758  São Paulo            35.0  ...    SP           7965         134\n",
              "489  2268405  São Paulo            35.0  ...    SP           4285          62\n",
              "\n",
              "[3 rows x 19 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 26
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "wiNJG_vaZ4Zu"
      },
      "source": [
        "Podemos ver que a informação disponibilizada para o dia 28/06/2021 é a última disponibilizada para o estado de SP e é a última linha no dataframe."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "_KPRq1VfZ0wl"
      },
      "source": [
        "# verificando a coluna is_repeated se temos algum dado True\n",
        "dados_repetidos_sp = dados_estadual_sp.query(\"is_repeated == True\")"
      ],
      "execution_count": 27,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "ZffH-uhraiZW",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 405
        },
        "outputId": "8e23ba9a-9f58-4db7-c6a3-899381666c44"
      },
      "source": [
        "# visualizando os dados com True na coluna is_repeated\n",
        "dados_repetidos_sp"
      ],
      "execution_count": 28,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>index</th>\n",
              "      <th>city</th>\n",
              "      <th>city_ibge_code</th>\n",
              "      <th>date</th>\n",
              "      <th>epidemiological_week</th>\n",
              "      <th>estimated_population</th>\n",
              "      <th>estimated_population_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>last_available_confirmed</th>\n",
              "      <th>last_available_confirmed_per_100k_inhabitants</th>\n",
              "      <th>last_available_date</th>\n",
              "      <th>last_available_death_rate</th>\n",
              "      <th>last_available_deaths</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>state</th>\n",
              "      <th>new_confirmed</th>\n",
              "      <th>new_deaths</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>17</th>\n",
              "      <td>1995511</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-03-13</td>\n",
              "      <td>202011</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>46</td>\n",
              "      <td>0.09937</td>\n",
              "      <td>2020-03-12</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>18</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>19</th>\n",
              "      <td>1995521</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-03-15</td>\n",
              "      <td>202012</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>65</td>\n",
              "      <td>0.14042</td>\n",
              "      <td>2020-03-14</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0</td>\n",
              "      <td>20</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>255</th>\n",
              "      <td>2117007</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-11-06</td>\n",
              "      <td>202045</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>1125936</td>\n",
              "      <td>2432.38761</td>\n",
              "      <td>2020-11-05</td>\n",
              "      <td>0.0353</td>\n",
              "      <td>39717</td>\n",
              "      <td>256</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>256</th>\n",
              "      <td>2117654</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-11-07</td>\n",
              "      <td>202045</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>1125936</td>\n",
              "      <td>2432.38761</td>\n",
              "      <td>2020-11-05</td>\n",
              "      <td>0.0353</td>\n",
              "      <td>39717</td>\n",
              "      <td>257</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>257</th>\n",
              "      <td>2118301</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-11-08</td>\n",
              "      <td>202046</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>1125936</td>\n",
              "      <td>2432.38761</td>\n",
              "      <td>2020-11-05</td>\n",
              "      <td>0.0353</td>\n",
              "      <td>39717</td>\n",
              "      <td>258</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>258</th>\n",
              "      <td>2118948</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-11-09</td>\n",
              "      <td>202046</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>1125936</td>\n",
              "      <td>2432.38761</td>\n",
              "      <td>2020-11-05</td>\n",
              "      <td>0.0353</td>\n",
              "      <td>39717</td>\n",
              "      <td>259</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>295</th>\n",
              "      <td>2142887</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-12-16</td>\n",
              "      <td>202051</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>True</td>\n",
              "      <td>1341428</td>\n",
              "      <td>2897.92035</td>\n",
              "      <td>2020-12-15</td>\n",
              "      <td>0.0330</td>\n",
              "      <td>44282</td>\n",
              "      <td>296</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "       index       city  city_ibge_code  ... state  new_confirmed  new_deaths\n",
              "17   1995511  São Paulo            35.0  ...    SP              0           0\n",
              "19   1995521  São Paulo            35.0  ...    SP              0           0\n",
              "255  2117007  São Paulo            35.0  ...    SP              0           0\n",
              "256  2117654  São Paulo            35.0  ...    SP              0           0\n",
              "257  2118301  São Paulo            35.0  ...    SP              0           0\n",
              "258  2118948  São Paulo            35.0  ...    SP              0           0\n",
              "295  2142887  São Paulo            35.0  ...    SP              0           0\n",
              "\n",
              "[7 rows x 19 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 28
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "JXP9YRVra3hi"
      },
      "source": [
        "No dataframe acima (**dados_repetidos_sp**) temos as datas em que os dados foram repetidos por não ter informação divulgada pelo boletim das Secretarias Estaduais de Saúde.\n",
        "\n",
        "Temos um total de **7** datas."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "9_XVMdPWaucv"
      },
      "source": [
        "# renomeando as colunas para facilitar o trabalho com os dados\n",
        "dados_estadual_sp.rename(columns={\n",
        "    'city' : 'estado',\n",
        "    'city_ibge_code' : 'codigo_estado',\n",
        "    'date' : 'data',\n",
        "    'epidemiological_week' : 'semana_epidem',\n",
        "    'estimated_population' : 'populacao',\n",
        "    'estimated_population_2019' : 'populacao_2019',\n",
        "    'last_available_confirmed' : 'casos_confirmados',\n",
        "    'last_available_confirmed_per_100k_inhabitants' : 'casos_por_100k_habitantes',\n",
        "    'last_available_date' : 'data_atualizacao',\n",
        "    'last_available_death_rate' : 'taxa_mortalidade',\n",
        "    'last_available_deaths' : 'obitos',\n",
        "    'state' : 'estado',\n",
        "    'new_confirmed' : 'casos_novos',\n",
        "    'new_deaths' : 'obitos_novos'}, inplace=True)"
      ],
      "execution_count": 29,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "btKPr7g0berW",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 213
        },
        "outputId": "22f7e239-0070-4f56-a001-b90a162af33d"
      },
      "source": [
        "# visualizando as colunas renomeadas\n",
        "dados_estadual_sp.head(3)"
      ],
      "execution_count": 30,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>index</th>\n",
              "      <th>estado</th>\n",
              "      <th>codigo_estado</th>\n",
              "      <th>data</th>\n",
              "      <th>semana_epidem</th>\n",
              "      <th>populacao</th>\n",
              "      <th>populacao_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>casos_confirmados</th>\n",
              "      <th>casos_por_100k_habitantes</th>\n",
              "      <th>data_atualizacao</th>\n",
              "      <th>taxa_mortalidade</th>\n",
              "      <th>obitos</th>\n",
              "      <th>order_for_place</th>\n",
              "      <th>place_type</th>\n",
              "      <th>estado</th>\n",
              "      <th>casos_novos</th>\n",
              "      <th>obitos_novos</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>1995468</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-25</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-25</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>1995470</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-26</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-26</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>2</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>1995472</td>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-27</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-27</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>state</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "     index     estado  codigo_estado  ... estado  casos_novos  obitos_novos\n",
              "0  1995468  São Paulo           35.0  ...     SP            1             0\n",
              "1  1995470  São Paulo           35.0  ...     SP            0             0\n",
              "2  1995472  São Paulo           35.0  ...     SP            0             0\n",
              "\n",
              "[3 rows x 19 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 30
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "QpR-ZzV4bi71"
      },
      "source": [
        "# removendo as colunas que não interessam para o projeto\n",
        "dados_estadual_sp.drop(['index', 'order_for_place', 'place_type'], axis=1, inplace=True)"
      ],
      "execution_count": 31,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "wrNiuogObtxy",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 213
        },
        "outputId": "860e5170-104d-4f9f-f19f-861522b74f42"
      },
      "source": [
        "# visualizando o dataframe com as colunas que interessam para o projeto\n",
        "dados_estadual_sp.head(3)"
      ],
      "execution_count": 32,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>estado</th>\n",
              "      <th>codigo_estado</th>\n",
              "      <th>data</th>\n",
              "      <th>semana_epidem</th>\n",
              "      <th>populacao</th>\n",
              "      <th>populacao_2019</th>\n",
              "      <th>is_last</th>\n",
              "      <th>is_repeated</th>\n",
              "      <th>casos_confirmados</th>\n",
              "      <th>casos_por_100k_habitantes</th>\n",
              "      <th>data_atualizacao</th>\n",
              "      <th>taxa_mortalidade</th>\n",
              "      <th>obitos</th>\n",
              "      <th>estado</th>\n",
              "      <th>casos_novos</th>\n",
              "      <th>obitos_novos</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-25</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-25</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>SP</td>\n",
              "      <td>1</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-26</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-26</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>São Paulo</td>\n",
              "      <td>35.0</td>\n",
              "      <td>2020-02-27</td>\n",
              "      <td>202009</td>\n",
              "      <td>46289333.0</td>\n",
              "      <td>45919049.0</td>\n",
              "      <td>False</td>\n",
              "      <td>False</td>\n",
              "      <td>1</td>\n",
              "      <td>0.00216</td>\n",
              "      <td>2020-02-27</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0</td>\n",
              "      <td>SP</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "</div>"
            ],
            "text/plain": [
              "      estado  codigo_estado        data  ...  estado  casos_novos  obitos_novos\n",
              "0  São Paulo           35.0  2020-02-25  ...      SP            1             0\n",
              "1  São Paulo           35.0  2020-02-26  ...      SP            0             0\n",
              "2  São Paulo           35.0  2020-02-27  ...      SP            0             0\n",
              "\n",
              "[3 rows x 16 columns]"
            ]
          },
          "metadata": {
            "tags": []
          },
          "execution_count": 32
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "4H9JZ-qhcSAW"
      },
      "source": [
        "Agora temos os dados para o estado de **São Paulo** tratados.\n",
        "\n",
        "Foram identificadas as linhas com dados repetidos, se haviam dados NaN, os dados NaN identificados foram substituídos por São Paulo, o index foi resetado, as colunas foram renomeadas e as colunas que não interessam para essa análise foram removidas.\n",
        "\n",
        "Agora os dataframes que serão utilizados na análise explaratória serão exportados como arquivos CSV."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "fbk1Jj_-clZE"
      },
      "source": [
        "# exportando o dataframe com os dados de Santo André como arquivo CSV\n",
        "dados_sa.to_csv('dados_sa.csv', index=False)\n",
        "\n",
        "# exportando o dataframe com os dados do estado de São Paulo como arquivo CSV\n",
        "dados_estadual_sp.to_csv('dados_estadual_sp.csv', index=False)\n",
        "\n",
        "# exportando o dataframe com os dados repetidos de Santo André como arquivo CSV\n",
        "dados_repetidos.to_csv('dados_repetidos_sa.csv', index=False)\n",
        "\n",
        "# exportando o dataframe com os dados repetidos do estado de SP como arquivo CSV\n",
        "dados_repetidos_sp.to_csv('dados_repetidos_sp.csv', index=False)"
      ],
      "execution_count": 33,
      "outputs": []
    }
  ]
}