Notebooks/1_tratamento_dados.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "1_tratamento_dados.ipynb",
      "provenance": [],
      "collapsed_sections": [],
      "authorship_tag": "ABX9TyPCiPH1nJizBnSFNpWELyjR",
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "language_info": {
      "name": "python"
    }
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/EltonGS/covid-19_previsao_leito_UTI/blob/main/Notebooks/1_tratamento_dados.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "UOaeLOtIh27D"
      },
      "source": [
        "# Introdução\n",
        "\n",
        "Em dezembro de 2019 foi relatado o primeiro caso oficial de **Covid-19** causado pelo vírus SARS-CoV-2. No Brasil, em 26 de fevereiro de 2020 foi registrado o primeiro caso de Covid-19. Essa nova doença causou um estresse enorme sobre os sistemas de saúde dos países por não existir um tratamento com eficácia cientificamente comprovada. Para um parcela das pessoas infectadas os sintomas evoluem e se tornam severos ou críticos e assim necessitam de maiores cuidados. Esses pacientes precisam ser transferidos para a UTI e receber oxigênio.\n",
        "\n",
        "Com o movimento desses pacientes para a UTI, ocorreu um **colapso do sistema de saúde** de diversos países ao redor do mundo, incluindo o **Brasil**.\n",
        "\n",
        "Medidas foram tomadas para **aumentar o número de leitos de UTI** nos hospitais brasileiros, e também hospitais de campanha foram criados para atender um número maior de pacientes.\n",
        "\n",
        "Para utilizar os leitos de UTI da melhor maneira possível, o Hospital Sírio-Libanês disponibilizou uma base de dados no Kaggle (pode ser verificada [aqui](https://www.kaggle.com/S%C3%ADrio-Libanes/covid19)) para incentivar a criação de Modelo de Machine Learning (Aprendizado de Máquina) que possam prever se um paciente necessitará ou não de um leito de UTI com base nos exames médicos realizados quando o paciente está no hospital.\n",
        "\n",
        "Dessa maneira os pacientes que necessitam de um leito de UTI podem ser acomodados rapidamente em um leito livre, ou que possa ser buscado um leito em outro local, e os pacientes que não necessitarão de um leito podem ser acompanhados remotamente.\n",
        "\n",
        "**Esse projeto explorará a base de dados fornecida pelo Hospital Sírio-Libanês e criará modelos de Machine Learning que façam a previsão da necessidade, ou não, de um leito de UTI.**"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "0rQVJJ9VkRZV"
      },
      "source": [
        "# Informações do Projeto\n",
        "\n",
        "Esse projeto está dividido em 3 notebooks, conforme a descrição a seguir:\n",
        "\n",
        "* **Tratamento dos dados**: onde os dados serão tratados e manipulados.\n",
        "\n",
        "* **Análise Exploratória e Visualização dos Dados**: onde os dados serão analisados e visualizados buscando o entendimento da base de dados.\n",
        "\n",
        "* **Modelo de Machine Learning**: onde serão criados os modelos de Machine Learning para previsão da necessidade de um leito de UTI para os pacientes com Covid-19.\n",
        "\n",
        "\n",
        "\n",
        "**Bibliotecas Utilizadas**\n",
        "\n",
        "As bibliotecas utilizadas nesse projeto são importadas na célula abaixo.\n",
        "\n",
        "\n",
        "\n"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "T2NGdFfCO2tu"
      },
      "source": [
        "# bibliotecas para manipulação e tratamento dos dados\n",
        "import pandas as pd\n",
        "import numpy as np\n",
        "\n",
        "# bibliotecas para visualização dos dados\n",
        "import matplotlib.pyplot as plt\n",
        "import seaborn as sns\n",
        "\n",
        "# módulo para pré-processamento dos dados\n",
        "from sklearn import preprocessing"
      ],
      "execution_count": 1,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "FOZzc0jQe5dH"
      },
      "source": [
        "# Funções\n",
        "\n",
        "As funções abaixo foram criadas para tornar o manuseio dos dados mais fácil de ser compreendido."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "kd0kYFPsj7az"
      },
      "source": [
        "def dimensao_dados (dados):\n",
        "  # verifica as dimensões do dataframe\n",
        "  linha, coluna = dados.shape\n",
        "\n",
        "  # imprime as dimensões do dataframe\n",
        "  return print(f'O dataframe possui {linha} linhas e {coluna} colunas.')"
      ],
      "execution_count": 2,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "8GB6hLL4e7kt"
      },
      "source": [
        "def preenche_ausente (dados_originais):\n",
        "  \"\"\"\n",
        "  Essa função preenche valores ausentes com os valores anteriores e posteriores\n",
        "  \"\"\"\n",
        "  # seleciona o nome das colunas com dados contínuos\n",
        "  colunas_dados_continuos = dados_originais.iloc[:, 13:-2].columns\n",
        "\n",
        "  # preenche os dados ausentes nas colunas com dados contínuos\n",
        "  dados_continuos = dados_originais.groupby(by='patient_visit_identifier', as_index=False)[colunas_dados_continuos].fillna(method='ffill').fillna(method='bfill')\n",
        "\n",
        "  # seleciona as colunas com dados categóricos\n",
        "  dados_categoricos = dados_originais.iloc[:, :13]\n",
        "\n",
        "  # seleciona as colunas WINDOW e ICU\n",
        "  saida = dados_originais.iloc[:, -2:]\n",
        "\n",
        "  # contatena os dados após o preenchimento dos dados ausentes\n",
        "  dados_finais = pd.concat([dados_categoricos, dados_continuos, saida], ignore_index = True, axis=1)\n",
        "  \n",
        "  dados_finais.columns = dados_originais.columns\n",
        "\n",
        "  return dados_finais"
      ],
      "execution_count": 3,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "L3HA-Wakiw39"
      },
      "source": [
        "def prepare_window(rows):\n",
        "  \"\"\"\n",
        "  Essa função identifica se o paciente em algum momento foi para a UTI,\n",
        "  e preenche essa informação na coluna ICU da janela 0-2.\n",
        "  Retorna somente a linha da janela 0-2\n",
        "  \"\"\"\n",
        "  if (np.any(rows['icu'])):\n",
        "    rows.loc[rows['window'] == '0-2', 'icu'] = 1\n",
        "  return rows.loc[rows['window'] == '0-2']"
      ],
      "execution_count": 4,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "Qb42ru-mt-fd"
      },
      "source": [
        "def remove_corr_var(dados, valor_corte):\n",
        "  \"\"\"\n",
        "  Essa função verificar a correlação entre as features (colunas) do dataframe\n",
        "  E exclui as colunas do dataframe que será utilizado no modelo de Machine Learning\n",
        "  \"\"\"\n",
        "  # calcula a matriz de correlação\n",
        "  matriz_corr = dados.iloc[:, 4:-2].corr().abs()\n",
        "\n",
        "  # separa os valores com base no triângulo superior da matriz e atribue valor bool\n",
        "  matriz_superior = matriz_corr.where(np.triu(np.ones(matriz_corr.shape), k=1).astype(np.bool))\n",
        "\n",
        "  # verifica as colunas acima do valor informado como alta correlação\n",
        "  excluir = [coluna for coluna in matriz_superior.columns if any(matriz_superior[coluna] > valor_corte)]\n",
        "\n",
        "  return dados.drop(excluir, axis=1)"
      ],
      "execution_count": 5,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "s-zXPM-A5wlC"
      },
      "source": [
        "# Carregando os Dados"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 473
        },
        "id": "KU0ZywvTmqUZ",
        "outputId": "f6f57b0e-7472-4380-e9c0-86da8e1c2cc1"
      },
      "source": [
        "# endereço dos dados\n",
        "url = 'https://github.com/EltonGS/covid_ML_previsao_UTI/blob/main/Dados/Dados%20Originais/Kaggle_Sirio_Libanes_ICU_Prediction.xlsx?raw=true'\n",
        "\n",
        "# carrega os dados\n",
        "dados = pd.read_excel(url)\n",
        "\n",
        "# visualiza os dados\n",
        "dados"
      ],
      "execution_count": 6,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>PATIENT_VISIT_IDENTIFIER</th>\n",
              "      <th>AGE_ABOVE65</th>\n",
              "      <th>AGE_PERCENTIL</th>\n",
              "      <th>GENDER</th>\n",
              "      <th>DISEASE GROUPING 1</th>\n",
              "      <th>DISEASE GROUPING 2</th>\n",
              "      <th>DISEASE GROUPING 3</th>\n",
              "      <th>DISEASE GROUPING 4</th>\n",
              "      <th>DISEASE GROUPING 5</th>\n",
              "      <th>DISEASE GROUPING 6</th>\n",
              "      <th>HTN</th>\n",
              "      <th>IMMUNOCOMPROMISED</th>\n",
              "      <th>OTHER</th>\n",
              "      <th>ALBUMIN_MEDIAN</th>\n",
              "      <th>ALBUMIN_MEAN</th>\n",
              "      <th>ALBUMIN_MIN</th>\n",
              "      <th>ALBUMIN_MAX</th>\n",
              "      <th>ALBUMIN_DIFF</th>\n",
              "      <th>BE_ARTERIAL_MEDIAN</th>\n",
              "      <th>BE_ARTERIAL_MEAN</th>\n",
              "      <th>BE_ARTERIAL_MIN</th>\n",
              "      <th>BE_ARTERIAL_MAX</th>\n",
              "      <th>BE_ARTERIAL_DIFF</th>\n",
              "      <th>BE_VENOUS_MEDIAN</th>\n",
              "      <th>BE_VENOUS_MEAN</th>\n",
              "      <th>BE_VENOUS_MIN</th>\n",
              "      <th>BE_VENOUS_MAX</th>\n",
              "      <th>BE_VENOUS_DIFF</th>\n",
              "      <th>BIC_ARTERIAL_MEDIAN</th>\n",
              "      <th>BIC_ARTERIAL_MEAN</th>\n",
              "      <th>BIC_ARTERIAL_MIN</th>\n",
              "      <th>BIC_ARTERIAL_MAX</th>\n",
              "      <th>BIC_ARTERIAL_DIFF</th>\n",
              "      <th>BIC_VENOUS_MEDIAN</th>\n",
              "      <th>BIC_VENOUS_MEAN</th>\n",
              "      <th>BIC_VENOUS_MIN</th>\n",
              "      <th>BIC_VENOUS_MAX</th>\n",
              "      <th>BIC_VENOUS_DIFF</th>\n",
              "      <th>BILLIRUBIN_MEDIAN</th>\n",
              "      <th>BILLIRUBIN_MEAN</th>\n",
              "      <th>...</th>\n",
              "      <th>DIMER_MAX</th>\n",
              "      <th>DIMER_DIFF</th>\n",
              "      <th>BLOODPRESSURE_DIASTOLIC_MEAN</th>\n",
              "      <th>BLOODPRESSURE_SISTOLIC_MEAN</th>\n",
              "      <th>HEART_RATE_MEAN</th>\n",
              "      <th>RESPIRATORY_RATE_MEAN</th>\n",
              "      <th>TEMPERATURE_MEAN</th>\n",
              "      <th>OXYGEN_SATURATION_MEAN</th>\n",
              "      <th>BLOODPRESSURE_DIASTOLIC_MEDIAN</th>\n",
              "      <th>BLOODPRESSURE_SISTOLIC_MEDIAN</th>\n",
              "      <th>HEART_RATE_MEDIAN</th>\n",
              "      <th>RESPIRATORY_RATE_MEDIAN</th>\n",
              "      <th>TEMPERATURE_MEDIAN</th>\n",
              "      <th>OXYGEN_SATURATION_MEDIAN</th>\n",
              "      <th>BLOODPRESSURE_DIASTOLIC_MIN</th>\n",
              "      <th>BLOODPRESSURE_SISTOLIC_MIN</th>\n",
              "      <th>HEART_RATE_MIN</th>\n",
              "      <th>RESPIRATORY_RATE_MIN</th>\n",
              "      <th>TEMPERATURE_MIN</th>\n",
              "      <th>OXYGEN_SATURATION_MIN</th>\n",
              "      <th>BLOODPRESSURE_DIASTOLIC_MAX</th>\n",
              "      <th>BLOODPRESSURE_SISTOLIC_MAX</th>\n",
              "      <th>HEART_RATE_MAX</th>\n",
              "      <th>RESPIRATORY_RATE_MAX</th>\n",
              "      <th>TEMPERATURE_MAX</th>\n",
              "      <th>OXYGEN_SATURATION_MAX</th>\n",
              "      <th>BLOODPRESSURE_DIASTOLIC_DIFF</th>\n",
              "      <th>BLOODPRESSURE_SISTOLIC_DIFF</th>\n",
              "      <th>HEART_RATE_DIFF</th>\n",
              "      <th>RESPIRATORY_RATE_DIFF</th>\n",
              "      <th>TEMPERATURE_DIFF</th>\n",
              "      <th>OXYGEN_SATURATION_DIFF</th>\n",
              "      <th>BLOODPRESSURE_DIASTOLIC_DIFF_REL</th>\n",
              "      <th>BLOODPRESSURE_SISTOLIC_DIFF_REL</th>\n",
              "      <th>HEART_RATE_DIFF_REL</th>\n",
              "      <th>RESPIRATORY_RATE_DIFF_REL</th>\n",
              "      <th>TEMPERATURE_DIFF_REL</th>\n",
              "      <th>OXYGEN_SATURATION_DIFF_REL</th>\n",
              "      <th>WINDOW</th>\n",
              "      <th>ICU</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>60th</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.283019</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>-0.285714</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.283019</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>-0.285714</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.237113</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>-0.162393</td>\n",
              "      <td>-0.500000</td>\n",
              "      <td>0.208791</td>\n",
              "      <td>0.898990</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.459459</td>\n",
              "      <td>-0.432836</td>\n",
              "      <td>-0.636364</td>\n",
              "      <td>-0.420290</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>60th</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.333333</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.132075</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>0.535714</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>0.333333</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.132075</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>0.535714</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>0.443299</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>-0.025641</td>\n",
              "      <td>-0.500000</td>\n",
              "      <td>0.714286</td>\n",
              "      <td>0.838384</td>\n",
              "      <td>-0.076923</td>\n",
              "      <td>-0.459459</td>\n",
              "      <td>-0.313433</td>\n",
              "      <td>-0.636364</td>\n",
              "      <td>0.246377</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>2-4</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>60th</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.994912</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>4-6</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>60th</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>-0.107143</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>-0.107143</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.318681</td>\n",
              "      <td>0.898990</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>-0.275362</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>6-12</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>60th</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.871658</td>\n",
              "      <td>-0.871658</td>\n",
              "      <td>-0.871658</td>\n",
              "      <td>-0.871658</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.863874</td>\n",
              "      <td>-0.863874</td>\n",
              "      <td>-0.863874</td>\n",
              "      <td>-0.863874</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.414634</td>\n",
              "      <td>-0.414634</td>\n",
              "      <td>-0.414634</td>\n",
              "      <td>-0.414634</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.979069</td>\n",
              "      <td>-0.979069</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.996762</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.243021</td>\n",
              "      <td>-0.338537</td>\n",
              "      <td>-0.213031</td>\n",
              "      <td>-0.317859</td>\n",
              "      <td>0.033779</td>\n",
              "      <td>0.665932</td>\n",
              "      <td>-0.283951</td>\n",
              "      <td>-0.376923</td>\n",
              "      <td>-0.188679</td>\n",
              "      <td>-0.379310</td>\n",
              "      <td>0.035714</td>\n",
              "      <td>0.631579</td>\n",
              "      <td>-0.340206</td>\n",
              "      <td>-0.4875</td>\n",
              "      <td>-0.572650</td>\n",
              "      <td>-0.857143</td>\n",
              "      <td>0.098901</td>\n",
              "      <td>0.797980</td>\n",
              "      <td>-0.076923</td>\n",
              "      <td>0.286486</td>\n",
              "      <td>0.298507</td>\n",
              "      <td>0.272727</td>\n",
              "      <td>0.362319</td>\n",
              "      <td>0.947368</td>\n",
              "      <td>-0.339130</td>\n",
              "      <td>0.325153</td>\n",
              "      <td>0.114504</td>\n",
              "      <td>0.176471</td>\n",
              "      <td>-0.238095</td>\n",
              "      <td>-0.818182</td>\n",
              "      <td>-0.389967</td>\n",
              "      <td>0.407558</td>\n",
              "      <td>-0.230462</td>\n",
              "      <td>0.096774</td>\n",
              "      <td>-0.242282</td>\n",
              "      <td>-0.814433</td>\n",
              "      <td>ABOVE_12</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1920</th>\n",
              "      <td>384</td>\n",
              "      <td>0</td>\n",
              "      <td>50th</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.012346</td>\n",
              "      <td>-0.292308</td>\n",
              "      <td>0.056604</td>\n",
              "      <td>-0.525424</td>\n",
              "      <td>0.535714</td>\n",
              "      <td>0.789474</td>\n",
              "      <td>0.012346</td>\n",
              "      <td>-0.292308</td>\n",
              "      <td>0.056604</td>\n",
              "      <td>-0.517241</td>\n",
              "      <td>0.535714</td>\n",
              "      <td>0.789474</td>\n",
              "      <td>0.175258</td>\n",
              "      <td>-0.0500</td>\n",
              "      <td>0.145299</td>\n",
              "      <td>-0.428571</td>\n",
              "      <td>0.714286</td>\n",
              "      <td>0.919192</td>\n",
              "      <td>-0.299145</td>\n",
              "      <td>-0.502703</td>\n",
              "      <td>-0.164179</td>\n",
              "      <td>-0.575758</td>\n",
              "      <td>0.246377</td>\n",
              "      <td>0.789474</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1921</th>\n",
              "      <td>384</td>\n",
              "      <td>0</td>\n",
              "      <td>50th</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.982208</td>\n",
              "      <td>-0.982208</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.979571</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.384615</td>\n",
              "      <td>-0.113208</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>0.142857</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.384615</td>\n",
              "      <td>-0.113208</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>0.142857</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>0.237113</td>\n",
              "      <td>-0.1250</td>\n",
              "      <td>-0.008547</td>\n",
              "      <td>-0.500000</td>\n",
              "      <td>0.472527</td>\n",
              "      <td>0.838384</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.567568</td>\n",
              "      <td>-0.298507</td>\n",
              "      <td>-0.636364</td>\n",
              "      <td>-0.072464</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>2-4</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1922</th>\n",
              "      <td>384</td>\n",
              "      <td>0</td>\n",
              "      <td>50th</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.169811</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>0.142857</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.169811</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>0.142857</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.237113</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>-0.059829</td>\n",
              "      <td>-0.500000</td>\n",
              "      <td>0.472527</td>\n",
              "      <td>0.898990</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.459459</td>\n",
              "      <td>-0.343284</td>\n",
              "      <td>-0.636364</td>\n",
              "      <td>-0.072464</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>4-6</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1923</th>\n",
              "      <td>384</td>\n",
              "      <td>0</td>\n",
              "      <td>50th</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>...</td>\n",
              "      <td>NaN</td>\n",
              "      <td>NaN</td>\n",
              "      <td>0.209877</td>\n",
              "      <td>-0.384615</td>\n",
              "      <td>-0.188679</td>\n",
              "      <td>-0.661017</td>\n",
              "      <td>0.285714</td>\n",
              "      <td>0.473684</td>\n",
              "      <td>0.209877</td>\n",
              "      <td>-0.384615</td>\n",
              "      <td>-0.188679</td>\n",
              "      <td>-0.655172</td>\n",
              "      <td>0.285714</td>\n",
              "      <td>0.473684</td>\n",
              "      <td>0.340206</td>\n",
              "      <td>-0.1250</td>\n",
              "      <td>-0.076923</td>\n",
              "      <td>-0.571429</td>\n",
              "      <td>0.560440</td>\n",
              "      <td>0.797980</td>\n",
              "      <td>-0.162393</td>\n",
              "      <td>-0.567568</td>\n",
              "      <td>-0.358209</td>\n",
              "      <td>-0.696970</td>\n",
              "      <td>0.043478</td>\n",
              "      <td>0.473684</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>6-12</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1924</th>\n",
              "      <td>384</td>\n",
              "      <td>0</td>\n",
              "      <td>50th</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.983255</td>\n",
              "      <td>-0.983255</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.888448</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.185185</td>\n",
              "      <td>-0.539103</td>\n",
              "      <td>-0.107704</td>\n",
              "      <td>-0.610169</td>\n",
              "      <td>0.050595</td>\n",
              "      <td>0.662281</td>\n",
              "      <td>-0.160494</td>\n",
              "      <td>-0.538462</td>\n",
              "      <td>-0.075472</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>0.071429</td>\n",
              "      <td>0.631579</td>\n",
              "      <td>-0.175258</td>\n",
              "      <td>-0.3750</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.785714</td>\n",
              "      <td>0.186813</td>\n",
              "      <td>0.777778</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.470270</td>\n",
              "      <td>-0.149254</td>\n",
              "      <td>-0.515152</td>\n",
              "      <td>0.101449</td>\n",
              "      <td>0.842105</td>\n",
              "      <td>-0.652174</td>\n",
              "      <td>-0.644172</td>\n",
              "      <td>-0.633588</td>\n",
              "      <td>-0.647059</td>\n",
              "      <td>-0.547619</td>\n",
              "      <td>-0.838384</td>\n",
              "      <td>-0.701863</td>\n",
              "      <td>-0.585967</td>\n",
              "      <td>-0.763868</td>\n",
              "      <td>-0.612903</td>\n",
              "      <td>-0.551337</td>\n",
              "      <td>-0.835052</td>\n",
              "      <td>ABOVE_12</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>1925 rows × 231 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "      PATIENT_VISIT_IDENTIFIER  AGE_ABOVE65  ...    WINDOW  ICU\n",
              "0                            0            1  ...       0-2    0\n",
              "1                            0            1  ...       2-4    0\n",
              "2                            0            1  ...       4-6    0\n",
              "3                            0            1  ...      6-12    0\n",
              "4                            0            1  ...  ABOVE_12    1\n",
              "...                        ...          ...  ...       ...  ...\n",
              "1920                       384            0  ...       0-2    0\n",
              "1921                       384            0  ...       2-4    0\n",
              "1922                       384            0  ...       4-6    0\n",
              "1923                       384            0  ...      6-12    0\n",
              "1924                       384            0  ...  ABOVE_12    0\n",
              "\n",
              "[1925 rows x 231 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 6
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "UZyxNnVYCU7b"
      },
      "source": [
        "## Informações Sobre os Dados\n",
        "\n",
        "## Informações compartilhadas pelo Sírio Libanês\n",
        "\n",
        "O **Hospital Sírio Libanês** compartilhou algumas informações sobre os dados:\n",
        "\n",
        "- A coluna **ICU** é a que deve ser prevista utilizando um modelo de Machine Learning.\n",
        "\n",
        "- A partir do momento que o valor na coluna ICU é 1 os dados não devem ser utilizados para a o modelo de previsão pois não é possível dizer se os exames foram feitos antes ou depois do paciente ser admitido na UTI.\n",
        "\n",
        "- Os dados são anonimizados e foram coletados nas unidades de São Paulo e Brasília. Os dados foram anonimizados utilizando as melhores práticas internacionais.\n",
        "\n",
        "- Os dados foram tratados e colocados em escala utilizando o método **Min Max Scaler** para estarem entre -1 e 1.\n",
        "\n",
        "- Os dados disponíveis nessa base são:\n",
        "> * Informação demográfica do paciente (03 colunas);\n",
        "> * Agrupamento de doenças já existentes no paciente (09 colunas);\n",
        "> * Resultados de exame de sangue (36 colunas);\n",
        "> * Sinais vitais (06 colunas);\n",
        "\n",
        "A equipe do Sírio Libanês também adicionou colunas com valores matemáticos e estatistícos dos exames de sangue e sinais vitais. Estes estão representados nas colunas com o nomes terminando em MEAN (média), MEDIAN (mediana), MAX (valor máximo), MIN (valor mínimo), DIFF (diferença entre o MAX e o MIN) e o DIFF_REL (A razão entre o DIFF e o MEDIAN).\n",
        "\n",
        "**Dados Ausentes** - Os dados da tabela são provenientes de exames que são realizados com frequências diferentes. Por exemplo, medição dos sinais vitais são feitas a cada hora e exames laboratoriais de sangue são feitos semanalmente.\n",
        "\n",
        "É razoável assumir que se os dados estão faltando para uma janela de tempo para um paciente é porque o paciente se manteve estável e apresentou resultados similares aos que já estavam registrados nas janelas anteriores ou posteriores. Assim os valores das janelas vizinhas podem ser utilizados para preencher os dados ausentes."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "fY2WuhvXSfQH"
      },
      "source": [
        "## Análise Primária da Base de Dados\n",
        "\n",
        "Com os dados importados é possível verificar algumas informações.\n",
        "\n",
        "Por exemplo, quais as dimensões dessa base de dados? Quantas linhas e colunas?"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "BvMd73pX9GPb",
        "outputId": "4ae45f90-fe62-4fb3-fe0a-2f49fba034bc"
      },
      "source": [
        "# visualiza a dimensão da base de dados\n",
        "dimensao_dados(dados)"
      ],
      "execution_count": 7,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "O dataframe possui 1925 linhas e 231 colunas.\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "IbHDzM_XG0gn"
      },
      "source": [
        "A primeira coluna nos dados é a **PATIENT_VISIT_IDENTIFIER**, primeiramente parece ser uma linha para cada paciente. Assim teríamos informações sobre 1925 pacientes.\n",
        "\n",
        "Será que isso é o correto?"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 363
        },
        "id": "C7_jPAeB9Tmw",
        "outputId": "1c50bcf4-2ba8-4491-d154-e1213a0cef3e"
      },
      "source": [
        "# descreve os dados\n",
        "dados.describe()"
      ],
      "execution_count": 8,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>PATIENT_VISIT_IDENTIFIER</th>\n",
              "      <th>AGE_ABOVE65</th>\n",
              "      <th>GENDER</th>\n",
              "      <th>DISEASE GROUPING 1</th>\n",
              "      <th>DISEASE GROUPING 2</th>\n",
              "      <th>DISEASE GROUPING 3</th>\n",
              "      <th>DISEASE GROUPING 4</th>\n",
              "      <th>DISEASE GROUPING 5</th>\n",
              "      <th>DISEASE GROUPING 6</th>\n",
              "      <th>HTN</th>\n",
              "      <th>IMMUNOCOMPROMISED</th>\n",
              "      <th>OTHER</th>\n",
              "      <th>ALBUMIN_MEDIAN</th>\n",
              "      <th>ALBUMIN_MEAN</th>\n",
              "      <th>ALBUMIN_MIN</th>\n",
              "      <th>ALBUMIN_MAX</th>\n",
              "      <th>ALBUMIN_DIFF</th>\n",
              "      <th>BE_ARTERIAL_MEDIAN</th>\n",
              "      <th>BE_ARTERIAL_MEAN</th>\n",
              "      <th>BE_ARTERIAL_MIN</th>\n",
              "      <th>BE_ARTERIAL_MAX</th>\n",
              "      <th>BE_ARTERIAL_DIFF</th>\n",
              "      <th>BE_VENOUS_MEDIAN</th>\n",
              "      <th>BE_VENOUS_MEAN</th>\n",
              "      <th>BE_VENOUS_MIN</th>\n",
              "      <th>BE_VENOUS_MAX</th>\n",
              "      <th>BE_VENOUS_DIFF</th>\n",
              "      <th>BIC_ARTERIAL_MEDIAN</th>\n",
              "      <th>BIC_ARTERIAL_MEAN</th>\n",
              "      <th>BIC_ARTERIAL_MIN</th>\n",
              "      <th>BIC_ARTERIAL_MAX</th>\n",
              "      <th>BIC_ARTERIAL_DIFF</th>\n",
              "      <th>BIC_VENOUS_MEDIAN</th>\n",
              "      <th>BIC_VENOUS_MEAN</th>\n",
              "      <th>BIC_VENOUS_MIN</th>\n",
              "      <th>BIC_VENOUS_MAX</th>\n",
              "      <th>BIC_VENOUS_DIFF</th>\n",
              "      <th>BILLIRUBIN_MEDIAN</th>\n",
              "      <th>BILLIRUBIN_MEAN</th>\n",
              "      <th>BILLIRUBIN_MIN</th>\n",
              "      <th>...</th>\n",
              "      <th>DIMER_MIN</th>\n",
              "      <th>DIMER_MAX</th>\n",
              "      <th>DIMER_DIFF</th>\n",
              "      <th>BLOODPRESSURE_DIASTOLIC_MEAN</th>\n",
              "      <th>BLOODPRESSURE_SISTOLIC_MEAN</th>\n",
              "      <th>HEART_RATE_MEAN</th>\n",
              "      <th>RESPIRATORY_RATE_MEAN</th>\n",
              "      <th>TEMPERATURE_MEAN</th>\n",
              "      <th>OXYGEN_SATURATION_MEAN</th>\n",
              "      <th>BLOODPRESSURE_DIASTOLIC_MEDIAN</th>\n",
              "      <th>BLOODPRESSURE_SISTOLIC_MEDIAN</th>\n",
              "      <th>HEART_RATE_MEDIAN</th>\n",
              "      <th>RESPIRATORY_RATE_MEDIAN</th>\n",
              "      <th>TEMPERATURE_MEDIAN</th>\n",
              "      <th>OXYGEN_SATURATION_MEDIAN</th>\n",
              "      <th>BLOODPRESSURE_DIASTOLIC_MIN</th>\n",
              "      <th>BLOODPRESSURE_SISTOLIC_MIN</th>\n",
              "      <th>HEART_RATE_MIN</th>\n",
              "      <th>RESPIRATORY_RATE_MIN</th>\n",
              "      <th>TEMPERATURE_MIN</th>\n",
              "      <th>OXYGEN_SATURATION_MIN</th>\n",
              "      <th>BLOODPRESSURE_DIASTOLIC_MAX</th>\n",
              "      <th>BLOODPRESSURE_SISTOLIC_MAX</th>\n",
              "      <th>HEART_RATE_MAX</th>\n",
              "      <th>RESPIRATORY_RATE_MAX</th>\n",
              "      <th>TEMPERATURE_MAX</th>\n",
              "      <th>OXYGEN_SATURATION_MAX</th>\n",
              "      <th>BLOODPRESSURE_DIASTOLIC_DIFF</th>\n",
              "      <th>BLOODPRESSURE_SISTOLIC_DIFF</th>\n",
              "      <th>HEART_RATE_DIFF</th>\n",
              "      <th>RESPIRATORY_RATE_DIFF</th>\n",
              "      <th>TEMPERATURE_DIFF</th>\n",
              "      <th>OXYGEN_SATURATION_DIFF</th>\n",
              "      <th>BLOODPRESSURE_DIASTOLIC_DIFF_REL</th>\n",
              "      <th>BLOODPRESSURE_SISTOLIC_DIFF_REL</th>\n",
              "      <th>HEART_RATE_DIFF_REL</th>\n",
              "      <th>RESPIRATORY_RATE_DIFF_REL</th>\n",
              "      <th>TEMPERATURE_DIFF_REL</th>\n",
              "      <th>OXYGEN_SATURATION_DIFF_REL</th>\n",
              "      <th>ICU</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>count</th>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.0</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.0</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.0</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.0</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.0</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>...</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.000000</td>\n",
              "      <td>821.0</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1177.000000</td>\n",
              "      <td>1231.000000</td>\n",
              "      <td>1239.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1177.000000</td>\n",
              "      <td>1231.000000</td>\n",
              "      <td>1239.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1177.000000</td>\n",
              "      <td>1231.000000</td>\n",
              "      <td>1239.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1177.000000</td>\n",
              "      <td>1231.000000</td>\n",
              "      <td>1239.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1177.000000</td>\n",
              "      <td>1231.000000</td>\n",
              "      <td>1239.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1240.000000</td>\n",
              "      <td>1177.000000</td>\n",
              "      <td>1231.000000</td>\n",
              "      <td>1239.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>mean</th>\n",
              "      <td>192.000000</td>\n",
              "      <td>0.467532</td>\n",
              "      <td>0.368831</td>\n",
              "      <td>0.108333</td>\n",
              "      <td>0.028125</td>\n",
              "      <td>0.097917</td>\n",
              "      <td>0.019792</td>\n",
              "      <td>0.128125</td>\n",
              "      <td>0.046875</td>\n",
              "      <td>0.213021</td>\n",
              "      <td>0.158333</td>\n",
              "      <td>0.809896</td>\n",
              "      <td>0.528527</td>\n",
              "      <td>0.528527</td>\n",
              "      <td>0.528527</td>\n",
              "      <td>0.528527</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.963433</td>\n",
              "      <td>-0.963433</td>\n",
              "      <td>-0.963433</td>\n",
              "      <td>-0.963433</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.931121</td>\n",
              "      <td>-0.931121</td>\n",
              "      <td>-0.931121</td>\n",
              "      <td>-0.931121</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.310924</td>\n",
              "      <td>-0.310924</td>\n",
              "      <td>-0.310924</td>\n",
              "      <td>-0.310924</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.311845</td>\n",
              "      <td>-0.311845</td>\n",
              "      <td>-0.311845</td>\n",
              "      <td>-0.311845</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.945928</td>\n",
              "      <td>-0.945928</td>\n",
              "      <td>-0.945928</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.954177</td>\n",
              "      <td>-0.954177</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.093631</td>\n",
              "      <td>-0.332600</td>\n",
              "      <td>-0.264701</td>\n",
              "      <td>-0.438754</td>\n",
              "      <td>0.066893</td>\n",
              "      <td>0.743077</td>\n",
              "      <td>-0.097790</td>\n",
              "      <td>-0.338468</td>\n",
              "      <td>-0.268632</td>\n",
              "      <td>-0.435121</td>\n",
              "      <td>0.063798</td>\n",
              "      <td>0.748588</td>\n",
              "      <td>-0.040855</td>\n",
              "      <td>-0.207812</td>\n",
              "      <td>-0.264999</td>\n",
              "      <td>-0.483129</td>\n",
              "      <td>0.326823</td>\n",
              "      <td>0.817565</td>\n",
              "      <td>-0.235001</td>\n",
              "      <td>-0.399582</td>\n",
              "      <td>-0.282029</td>\n",
              "      <td>-0.316753</td>\n",
              "      <td>0.014964</td>\n",
              "      <td>0.818593</td>\n",
              "      <td>-0.752454</td>\n",
              "      <td>-0.728053</td>\n",
              "      <td>-0.754100</td>\n",
              "      <td>-0.703683</td>\n",
              "      <td>-0.770338</td>\n",
              "      <td>-0.887196</td>\n",
              "      <td>-0.786997</td>\n",
              "      <td>-0.715950</td>\n",
              "      <td>-0.817800</td>\n",
              "      <td>-0.719147</td>\n",
              "      <td>-0.771327</td>\n",
              "      <td>-0.886982</td>\n",
              "      <td>0.267532</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>std</th>\n",
              "      <td>111.168431</td>\n",
              "      <td>0.499074</td>\n",
              "      <td>0.482613</td>\n",
              "      <td>0.310882</td>\n",
              "      <td>0.165373</td>\n",
              "      <td>0.297279</td>\n",
              "      <td>0.139320</td>\n",
              "      <td>0.334316</td>\n",
              "      <td>0.211426</td>\n",
              "      <td>0.409549</td>\n",
              "      <td>0.365148</td>\n",
              "      <td>0.392485</td>\n",
              "      <td>0.224100</td>\n",
              "      <td>0.224100</td>\n",
              "      <td>0.224100</td>\n",
              "      <td>0.224100</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.160870</td>\n",
              "      <td>0.160870</td>\n",
              "      <td>0.160870</td>\n",
              "      <td>0.160870</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.169509</td>\n",
              "      <td>0.169509</td>\n",
              "      <td>0.169509</td>\n",
              "      <td>0.169509</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.100256</td>\n",
              "      <td>0.100256</td>\n",
              "      <td>0.100256</td>\n",
              "      <td>0.100256</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.118812</td>\n",
              "      <td>0.118812</td>\n",
              "      <td>0.118812</td>\n",
              "      <td>0.118812</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.076610</td>\n",
              "      <td>0.076610</td>\n",
              "      <td>0.076610</td>\n",
              "      <td>...</td>\n",
              "      <td>0.123582</td>\n",
              "      <td>0.123582</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.252064</td>\n",
              "      <td>0.274102</td>\n",
              "      <td>0.246760</td>\n",
              "      <td>0.217113</td>\n",
              "      <td>0.242858</td>\n",
              "      <td>0.132635</td>\n",
              "      <td>0.257733</td>\n",
              "      <td>0.277952</td>\n",
              "      <td>0.252709</td>\n",
              "      <td>0.225554</td>\n",
              "      <td>0.249208</td>\n",
              "      <td>0.125994</td>\n",
              "      <td>0.281304</td>\n",
              "      <td>0.277802</td>\n",
              "      <td>0.272725</td>\n",
              "      <td>0.278239</td>\n",
              "      <td>0.216198</td>\n",
              "      <td>0.283453</td>\n",
              "      <td>0.271123</td>\n",
              "      <td>0.287580</td>\n",
              "      <td>0.296247</td>\n",
              "      <td>0.402675</td>\n",
              "      <td>0.276163</td>\n",
              "      <td>0.141316</td>\n",
              "      <td>0.364001</td>\n",
              "      <td>0.408677</td>\n",
              "      <td>0.366349</td>\n",
              "      <td>0.482097</td>\n",
              "      <td>0.319001</td>\n",
              "      <td>0.296147</td>\n",
              "      <td>0.324754</td>\n",
              "      <td>0.419103</td>\n",
              "      <td>0.270217</td>\n",
              "      <td>0.446600</td>\n",
              "      <td>0.317694</td>\n",
              "      <td>0.296772</td>\n",
              "      <td>0.442787</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>min</th>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>...</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>25%</th>\n",
              "      <td>96.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.966510</td>\n",
              "      <td>-0.966510</td>\n",
              "      <td>-0.966510</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.978877</td>\n",
              "      <td>-0.978877</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.262708</td>\n",
              "      <td>-0.523077</td>\n",
              "      <td>-0.420791</td>\n",
              "      <td>-0.552542</td>\n",
              "      <td>-0.102991</td>\n",
              "      <td>0.684211</td>\n",
              "      <td>-0.283951</td>\n",
              "      <td>-0.538462</td>\n",
              "      <td>-0.433962</td>\n",
              "      <td>-0.517241</td>\n",
              "      <td>-0.107143</td>\n",
              "      <td>0.684211</td>\n",
              "      <td>-0.195876</td>\n",
              "      <td>-0.375000</td>\n",
              "      <td>-0.452991</td>\n",
              "      <td>-0.642857</td>\n",
              "      <td>0.186813</td>\n",
              "      <td>0.818182</td>\n",
              "      <td>-0.418803</td>\n",
              "      <td>-0.578378</td>\n",
              "      <td>-0.477612</td>\n",
              "      <td>-0.575758</td>\n",
              "      <td>-0.188406</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>50%</th>\n",
              "      <td>192.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.978029</td>\n",
              "      <td>-0.978029</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.100172</td>\n",
              "      <td>-0.374405</td>\n",
              "      <td>-0.283019</td>\n",
              "      <td>-0.502825</td>\n",
              "      <td>0.035714</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>-0.135802</td>\n",
              "      <td>-0.384615</td>\n",
              "      <td>-0.283019</td>\n",
              "      <td>-0.517241</td>\n",
              "      <td>0.035714</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>-0.030928</td>\n",
              "      <td>-0.250000</td>\n",
              "      <td>-0.282051</td>\n",
              "      <td>-0.500000</td>\n",
              "      <td>0.318681</td>\n",
              "      <td>0.878788</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.459459</td>\n",
              "      <td>-0.328358</td>\n",
              "      <td>-0.454545</td>\n",
              "      <td>-0.014493</td>\n",
              "      <td>0.842105</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-0.987730</td>\n",
              "      <td>-0.984733</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-0.976190</td>\n",
              "      <td>-0.979798</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-0.984944</td>\n",
              "      <td>-0.989822</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-0.975924</td>\n",
              "      <td>-0.980333</td>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>75%</th>\n",
              "      <td>288.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.958115</td>\n",
              "      <td>-0.958115</td>\n",
              "      <td>-0.958115</td>\n",
              "      <td>-0.958115</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.968315</td>\n",
              "      <td>-0.968315</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.184615</td>\n",
              "      <td>-0.132075</td>\n",
              "      <td>-0.383289</td>\n",
              "      <td>0.205890</td>\n",
              "      <td>0.823995</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.200000</td>\n",
              "      <td>-0.132075</td>\n",
              "      <td>-0.379310</td>\n",
              "      <td>0.196429</td>\n",
              "      <td>0.842105</td>\n",
              "      <td>0.175258</td>\n",
              "      <td>-0.050000</td>\n",
              "      <td>-0.094017</td>\n",
              "      <td>-0.357143</td>\n",
              "      <td>0.472527</td>\n",
              "      <td>0.919192</td>\n",
              "      <td>-0.076923</td>\n",
              "      <td>-0.243243</td>\n",
              "      <td>-0.119403</td>\n",
              "      <td>-0.212121</td>\n",
              "      <td>0.217391</td>\n",
              "      <td>0.894737</td>\n",
              "      <td>-0.565217</td>\n",
              "      <td>-0.558282</td>\n",
              "      <td>-0.541985</td>\n",
              "      <td>-0.647059</td>\n",
              "      <td>-0.595238</td>\n",
              "      <td>-0.878788</td>\n",
              "      <td>-0.645482</td>\n",
              "      <td>-0.522176</td>\n",
              "      <td>-0.662529</td>\n",
              "      <td>-0.634409</td>\n",
              "      <td>-0.594677</td>\n",
              "      <td>-0.880155</td>\n",
              "      <td>1.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>max</th>\n",
              "      <td>384.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>...</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>8 rows × 229 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "       PATIENT_VISIT_IDENTIFIER  ...          ICU\n",
              "count               1925.000000  ...  1925.000000\n",
              "mean                 192.000000  ...     0.267532\n",
              "std                  111.168431  ...     0.442787\n",
              "min                    0.000000  ...     0.000000\n",
              "25%                   96.000000  ...     0.000000\n",
              "50%                  192.000000  ...     0.000000\n",
              "75%                  288.000000  ...     1.000000\n",
              "max                  384.000000  ...     1.000000\n",
              "\n",
              "[8 rows x 229 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 8
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "9gInapgw-8Zq"
      },
      "source": [
        "Na imagem acima é possível identificar colunas que possuem dados categóricos (são 1 ou 0) como a **AGE_ABOVE65, GENDER e ICU**, e colunas com dados contínuos (variam entre -1 e 1) como **ALBUMIN_MEAN e ALBUMIN_MIN**. As colunas com dados contínuos foram normalizadas pelo Hospital Sírio Libanês.\n",
        "\n",
        "Com essa verificação é possível extrair outras informações:\n",
        "\n",
        "- A coluna **PATIENT_VISIT_IDENTIFIER** possui valores que vão de 0 a 384. Com essa informação é possível identificar que cada linha não representa um paciente, são 385 pacientes. Cada paciente tem 5 linhas de informação nos dados.\n",
        "\n",
        "- A coluna **ICU** tem os valores 0 e 1:\n",
        "> * **0** - Paciente não está na UTI;\n",
        "> * **1** - Paciente está na UTI;\n",
        "\n",
        "- A coluna **GENDER** tem os valores 0 e 1:\n",
        "> * **0** - Paciente do sexo masculino;\n",
        "> * **1** - Paciente do sexo feminino;\n",
        "\n",
        "- A coluna **WINDOW** possui valores para identificar o momento que os exames foram feitos em cada paciente, as janelas para os exames são:\n",
        "> * **0-2** - Exames feitos entre o momento que o paciente chegou ao hospital e 2 horas após a entrada.\n",
        "> * **2-4** - Exames feitos entre 2 e 4 horas da entrada do paciente no hospital.\n",
        "> * **4-6** - Exames feitos entre 4 e 6 horas da entrada do paciente no hospital.\n",
        "> * **6-12** - Exames feitos entre 6 e 12 horas da entrada do paciente no hospital.\n",
        "> * **Above-12** - Exames feitos após 12 horas da entrada do paciente no hospital.\n",
        "\n",
        "A equipe do Hospital Sírio Libanês compartilhou explicação para algumas das colunas, essas informações também foram utilizadas na explicação acima. Essas informações podem ser conferidas no [Kaggle](https://www.kaggle.com/S%C3%ADrio-Libanes/covid19).\n",
        "\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "rqsxsvdeWs7m"
      },
      "source": [
        "# Tratamento dos Dados\n",
        "\n",
        "Conforme informado pela equipe do Sírio Libanês, existem dados ausentes na base de dados e esses dados podem ser preenchidos utilizando os valores presentes nas janelas anteriores ou posteriores.\n",
        "\n",
        "Esses valores ausentes estão nas colunas com valores contínuos com as medições dos exames, a equipe do Sírio Libanês informou que essas informações iniciam na 13ª coluna e seguem até a antepenúltima.\n",
        "\n",
        "Para maior praticidade os nomes das colunas serão alterados para letras minúsculas."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "LESajLZsgN8z",
        "outputId": "7c274831-3666-413a-f6fa-133e30b32385"
      },
      "source": [
        "# renomea os nomes das colunas para letras minúsculas\n",
        "dados.columns = dados.columns.str.lower()\n",
        "dados.columns"
      ],
      "execution_count": 9,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "Index(['patient_visit_identifier', 'age_above65', 'age_percentil', 'gender',\n",
              "       'disease grouping 1', 'disease grouping 2', 'disease grouping 3',\n",
              "       'disease grouping 4', 'disease grouping 5', 'disease grouping 6',\n",
              "       ...\n",
              "       'temperature_diff', 'oxygen_saturation_diff',\n",
              "       'bloodpressure_diastolic_diff_rel', 'bloodpressure_sistolic_diff_rel',\n",
              "       'heart_rate_diff_rel', 'respiratory_rate_diff_rel',\n",
              "       'temperature_diff_rel', 'oxygen_saturation_diff_rel', 'window', 'icu'],\n",
              "      dtype='object', length=231)"
            ]
          },
          "metadata": {},
          "execution_count": 9
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "qYtkX6eq-7Nu",
        "outputId": "a91be05d-aafa-4ad6-e208-cceea48faeba"
      },
      "source": [
        "# verifica a quantidade de valores ausentes\n",
        "dados_ausentes = dados.isna().sum().sum()\n",
        "print(f'O total de dados ausentes é: {dados_ausentes} valores')"
      ],
      "execution_count": 10,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "O total de dados ausentes é: 223863 valores\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "DsCkAIHljPVY"
      },
      "source": [
        "Para realizar o preenchimento dos dados ausentes será usada a função **preenche_ausente**."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "EXYW1Kjem5fG"
      },
      "source": [
        "dados_limpos = preenche_ausente(dados)"
      ],
      "execution_count": 11,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "VGycEAqTm6BC",
        "outputId": "e50fe554-cb6c-4299-82cb-3d999da6ee08"
      },
      "source": [
        "# verifica a quantidade de dados ausentes.\n",
        "ausente_depois_preenchido = dados_limpos.isna().sum().sum()\n",
        "print(f'O total de dados ausentes é: {ausente_depois_preenchido} valores')"
      ],
      "execution_count": 12,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "O total de dados ausentes é: 45 valores\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "HC2z0x8OUQRu"
      },
      "source": [
        "Ainda existem dados ausentes após o preenchimento ser realizado nos dados com valores contínuos."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "aYY4AMBlqrtu",
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 363
        },
        "outputId": "b76143eb-bf97-42ba-b45e-5b389fded3c7"
      },
      "source": [
        "# descreve os dados\n",
        "dados_limpos.describe()"
      ],
      "execution_count": 13,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>patient_visit_identifier</th>\n",
              "      <th>age_above65</th>\n",
              "      <th>gender</th>\n",
              "      <th>disease grouping 1</th>\n",
              "      <th>disease grouping 2</th>\n",
              "      <th>disease grouping 3</th>\n",
              "      <th>disease grouping 4</th>\n",
              "      <th>disease grouping 5</th>\n",
              "      <th>disease grouping 6</th>\n",
              "      <th>htn</th>\n",
              "      <th>immunocompromised</th>\n",
              "      <th>other</th>\n",
              "      <th>albumin_median</th>\n",
              "      <th>albumin_mean</th>\n",
              "      <th>albumin_min</th>\n",
              "      <th>albumin_max</th>\n",
              "      <th>albumin_diff</th>\n",
              "      <th>be_arterial_median</th>\n",
              "      <th>be_arterial_mean</th>\n",
              "      <th>be_arterial_min</th>\n",
              "      <th>be_arterial_max</th>\n",
              "      <th>be_arterial_diff</th>\n",
              "      <th>be_venous_median</th>\n",
              "      <th>be_venous_mean</th>\n",
              "      <th>be_venous_min</th>\n",
              "      <th>be_venous_max</th>\n",
              "      <th>be_venous_diff</th>\n",
              "      <th>bic_arterial_median</th>\n",
              "      <th>bic_arterial_mean</th>\n",
              "      <th>bic_arterial_min</th>\n",
              "      <th>bic_arterial_max</th>\n",
              "      <th>bic_arterial_diff</th>\n",
              "      <th>bic_venous_median</th>\n",
              "      <th>bic_venous_mean</th>\n",
              "      <th>bic_venous_min</th>\n",
              "      <th>bic_venous_max</th>\n",
              "      <th>bic_venous_diff</th>\n",
              "      <th>billirubin_median</th>\n",
              "      <th>billirubin_mean</th>\n",
              "      <th>billirubin_min</th>\n",
              "      <th>...</th>\n",
              "      <th>dimer_min</th>\n",
              "      <th>dimer_max</th>\n",
              "      <th>dimer_diff</th>\n",
              "      <th>bloodpressure_diastolic_mean</th>\n",
              "      <th>bloodpressure_sistolic_mean</th>\n",
              "      <th>heart_rate_mean</th>\n",
              "      <th>respiratory_rate_mean</th>\n",
              "      <th>temperature_mean</th>\n",
              "      <th>oxygen_saturation_mean</th>\n",
              "      <th>bloodpressure_diastolic_median</th>\n",
              "      <th>bloodpressure_sistolic_median</th>\n",
              "      <th>heart_rate_median</th>\n",
              "      <th>respiratory_rate_median</th>\n",
              "      <th>temperature_median</th>\n",
              "      <th>oxygen_saturation_median</th>\n",
              "      <th>bloodpressure_diastolic_min</th>\n",
              "      <th>bloodpressure_sistolic_min</th>\n",
              "      <th>heart_rate_min</th>\n",
              "      <th>respiratory_rate_min</th>\n",
              "      <th>temperature_min</th>\n",
              "      <th>oxygen_saturation_min</th>\n",
              "      <th>bloodpressure_diastolic_max</th>\n",
              "      <th>bloodpressure_sistolic_max</th>\n",
              "      <th>heart_rate_max</th>\n",
              "      <th>respiratory_rate_max</th>\n",
              "      <th>temperature_max</th>\n",
              "      <th>oxygen_saturation_max</th>\n",
              "      <th>bloodpressure_diastolic_diff</th>\n",
              "      <th>bloodpressure_sistolic_diff</th>\n",
              "      <th>heart_rate_diff</th>\n",
              "      <th>respiratory_rate_diff</th>\n",
              "      <th>temperature_diff</th>\n",
              "      <th>oxygen_saturation_diff</th>\n",
              "      <th>bloodpressure_diastolic_diff_rel</th>\n",
              "      <th>bloodpressure_sistolic_diff_rel</th>\n",
              "      <th>heart_rate_diff_rel</th>\n",
              "      <th>respiratory_rate_diff_rel</th>\n",
              "      <th>temperature_diff_rel</th>\n",
              "      <th>oxygen_saturation_diff_rel</th>\n",
              "      <th>icu</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>count</th>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.0</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.0</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.0</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.0</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.0</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>...</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.0</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "      <td>1925.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>mean</th>\n",
              "      <td>192.000000</td>\n",
              "      <td>0.467532</td>\n",
              "      <td>0.368831</td>\n",
              "      <td>0.108333</td>\n",
              "      <td>0.028125</td>\n",
              "      <td>0.097917</td>\n",
              "      <td>0.019792</td>\n",
              "      <td>0.128125</td>\n",
              "      <td>0.046875</td>\n",
              "      <td>0.213021</td>\n",
              "      <td>0.158333</td>\n",
              "      <td>0.809896</td>\n",
              "      <td>0.550349</td>\n",
              "      <td>0.550349</td>\n",
              "      <td>0.550349</td>\n",
              "      <td>0.550349</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.981793</td>\n",
              "      <td>-0.981793</td>\n",
              "      <td>-0.981793</td>\n",
              "      <td>-0.981793</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.946031</td>\n",
              "      <td>-0.946031</td>\n",
              "      <td>-0.946031</td>\n",
              "      <td>-0.946031</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.314653</td>\n",
              "      <td>-0.314653</td>\n",
              "      <td>-0.314653</td>\n",
              "      <td>-0.314653</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.318061</td>\n",
              "      <td>-0.318061</td>\n",
              "      <td>-0.318061</td>\n",
              "      <td>-0.318061</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.946194</td>\n",
              "      <td>-0.946194</td>\n",
              "      <td>-0.946194</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.954252</td>\n",
              "      <td>-0.954252</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.072529</td>\n",
              "      <td>-0.328239</td>\n",
              "      <td>-0.261038</td>\n",
              "      <td>-0.446696</td>\n",
              "      <td>0.072480</td>\n",
              "      <td>0.748537</td>\n",
              "      <td>-0.076075</td>\n",
              "      <td>-0.332671</td>\n",
              "      <td>-0.263690</td>\n",
              "      <td>-0.439785</td>\n",
              "      <td>0.069267</td>\n",
              "      <td>0.752796</td>\n",
              "      <td>0.009399</td>\n",
              "      <td>-0.169805</td>\n",
              "      <td>-0.229606</td>\n",
              "      <td>-0.448757</td>\n",
              "      <td>0.355901</td>\n",
              "      <td>0.844893</td>\n",
              "      <td>-0.258253</td>\n",
              "      <td>-0.434771</td>\n",
              "      <td>-0.318550</td>\n",
              "      <td>-0.382920</td>\n",
              "      <td>-0.021645</td>\n",
              "      <td>0.805126</td>\n",
              "      <td>-0.818498</td>\n",
              "      <td>-0.805300</td>\n",
              "      <td>-0.823067</td>\n",
              "      <td>-0.796211</td>\n",
              "      <td>-0.831911</td>\n",
              "      <td>-0.919693</td>\n",
              "      <td>-0.843716</td>\n",
              "      <td>-0.796734</td>\n",
              "      <td>-0.869248</td>\n",
              "      <td>-0.807560</td>\n",
              "      <td>-0.832776</td>\n",
              "      <td>-0.919584</td>\n",
              "      <td>0.267532</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>std</th>\n",
              "      <td>111.168431</td>\n",
              "      <td>0.499074</td>\n",
              "      <td>0.482613</td>\n",
              "      <td>0.310882</td>\n",
              "      <td>0.165373</td>\n",
              "      <td>0.297279</td>\n",
              "      <td>0.139320</td>\n",
              "      <td>0.334316</td>\n",
              "      <td>0.211426</td>\n",
              "      <td>0.409549</td>\n",
              "      <td>0.365148</td>\n",
              "      <td>0.392485</td>\n",
              "      <td>0.187898</td>\n",
              "      <td>0.187898</td>\n",
              "      <td>0.187898</td>\n",
              "      <td>0.187898</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.109844</td>\n",
              "      <td>0.109844</td>\n",
              "      <td>0.109844</td>\n",
              "      <td>0.109844</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.141756</td>\n",
              "      <td>0.141756</td>\n",
              "      <td>0.141756</td>\n",
              "      <td>0.141756</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.067938</td>\n",
              "      <td>0.067938</td>\n",
              "      <td>0.067938</td>\n",
              "      <td>0.067938</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.105340</td>\n",
              "      <td>0.105340</td>\n",
              "      <td>0.105340</td>\n",
              "      <td>0.105340</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.059767</td>\n",
              "      <td>0.059767</td>\n",
              "      <td>0.059767</td>\n",
              "      <td>...</td>\n",
              "      <td>0.134259</td>\n",
              "      <td>0.134259</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.256547</td>\n",
              "      <td>0.275713</td>\n",
              "      <td>0.247852</td>\n",
              "      <td>0.216000</td>\n",
              "      <td>0.248730</td>\n",
              "      <td>0.134322</td>\n",
              "      <td>0.261753</td>\n",
              "      <td>0.278592</td>\n",
              "      <td>0.253902</td>\n",
              "      <td>0.226178</td>\n",
              "      <td>0.255550</td>\n",
              "      <td>0.131652</td>\n",
              "      <td>0.275071</td>\n",
              "      <td>0.269218</td>\n",
              "      <td>0.265246</td>\n",
              "      <td>0.262153</td>\n",
              "      <td>0.210648</td>\n",
              "      <td>0.233901</td>\n",
              "      <td>0.246646</td>\n",
              "      <td>0.265763</td>\n",
              "      <td>0.273801</td>\n",
              "      <td>0.353062</td>\n",
              "      <td>0.265408</td>\n",
              "      <td>0.142677</td>\n",
              "      <td>0.316782</td>\n",
              "      <td>0.354669</td>\n",
              "      <td>0.321999</td>\n",
              "      <td>0.406496</td>\n",
              "      <td>0.287052</td>\n",
              "      <td>0.243907</td>\n",
              "      <td>0.282808</td>\n",
              "      <td>0.364214</td>\n",
              "      <td>0.235885</td>\n",
              "      <td>0.375520</td>\n",
              "      <td>0.285875</td>\n",
              "      <td>0.244444</td>\n",
              "      <td>0.442787</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>min</th>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>...</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>25%</th>\n",
              "      <td>96.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.966510</td>\n",
              "      <td>-0.966510</td>\n",
              "      <td>-0.966510</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.983194</td>\n",
              "      <td>-0.983194</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.234568</td>\n",
              "      <td>-0.525275</td>\n",
              "      <td>-0.421787</td>\n",
              "      <td>-0.568567</td>\n",
              "      <td>-0.107143</td>\n",
              "      <td>0.684211</td>\n",
              "      <td>-0.234568</td>\n",
              "      <td>-0.538462</td>\n",
              "      <td>-0.433962</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>-0.107143</td>\n",
              "      <td>0.684211</td>\n",
              "      <td>-0.175258</td>\n",
              "      <td>-0.375000</td>\n",
              "      <td>-0.401709</td>\n",
              "      <td>-0.571429</td>\n",
              "      <td>0.230769</td>\n",
              "      <td>0.838384</td>\n",
              "      <td>-0.418803</td>\n",
              "      <td>-0.610811</td>\n",
              "      <td>-0.507463</td>\n",
              "      <td>-0.575758</td>\n",
              "      <td>-0.217391</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>50%</th>\n",
              "      <td>192.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.978029</td>\n",
              "      <td>-0.978029</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.078189</td>\n",
              "      <td>-0.376923</td>\n",
              "      <td>-0.283019</td>\n",
              "      <td>-0.518134</td>\n",
              "      <td>0.035714</td>\n",
              "      <td>0.753289</td>\n",
              "      <td>-0.111111</td>\n",
              "      <td>-0.384615</td>\n",
              "      <td>-0.283019</td>\n",
              "      <td>-0.517241</td>\n",
              "      <td>0.035714</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.030928</td>\n",
              "      <td>-0.187500</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.428571</td>\n",
              "      <td>0.340659</td>\n",
              "      <td>0.878788</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.459459</td>\n",
              "      <td>-0.358209</td>\n",
              "      <td>-0.515152</td>\n",
              "      <td>-0.072464</td>\n",
              "      <td>0.842105</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>75%</th>\n",
              "      <td>288.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.967930</td>\n",
              "      <td>-0.967930</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.179487</td>\n",
              "      <td>-0.125786</td>\n",
              "      <td>-0.389831</td>\n",
              "      <td>0.214286</td>\n",
              "      <td>0.842105</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.200000</td>\n",
              "      <td>-0.113208</td>\n",
              "      <td>-0.379310</td>\n",
              "      <td>0.214286</td>\n",
              "      <td>0.842105</td>\n",
              "      <td>0.237113</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.059829</td>\n",
              "      <td>-0.357143</td>\n",
              "      <td>0.494505</td>\n",
              "      <td>0.919192</td>\n",
              "      <td>-0.094017</td>\n",
              "      <td>-0.297297</td>\n",
              "      <td>-0.179104</td>\n",
              "      <td>-0.333333</td>\n",
              "      <td>0.159420</td>\n",
              "      <td>0.894737</td>\n",
              "      <td>-0.739130</td>\n",
              "      <td>-0.754601</td>\n",
              "      <td>-0.770992</td>\n",
              "      <td>-0.764706</td>\n",
              "      <td>-0.761905</td>\n",
              "      <td>-0.919192</td>\n",
              "      <td>-0.778261</td>\n",
              "      <td>-0.734033</td>\n",
              "      <td>-0.836524</td>\n",
              "      <td>-0.794355</td>\n",
              "      <td>-0.768926</td>\n",
              "      <td>-0.923299</td>\n",
              "      <td>1.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>max</th>\n",
              "      <td>384.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>...</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>8 rows × 229 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "       patient_visit_identifier  ...          icu\n",
              "count               1925.000000  ...  1925.000000\n",
              "mean                 192.000000  ...     0.267532\n",
              "std                  111.168431  ...     0.442787\n",
              "min                    0.000000  ...     0.000000\n",
              "25%                   96.000000  ...     0.000000\n",
              "50%                  192.000000  ...     0.000000\n",
              "75%                  288.000000  ...     1.000000\n",
              "max                  384.000000  ...     1.000000\n",
              "\n",
              "[8 rows x 229 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 13
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "lcQ98fs5Uo9r"
      },
      "source": [
        "Na descrição dos dados acima é visto que existem 1925 valores para a coluna **patient_visit_identifier** mas para as colunas com os dados sobre as doenças já existentes no paciente há 1920 valores. Como cada paciente possui 5 linhas com informações, um paciente não possui essas informações preenchidas nos dados. Como não há como saber quais as informações desse paciente, essas linhas podem ser excluídas."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "eirxBaWFUgjG"
      },
      "source": [
        "# exclui as linhas com informação ausente\n",
        "dados_limpos = dados_limpos.dropna()"
      ],
      "execution_count": 14,
      "outputs": []
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "WPGFowitVSLY",
        "outputId": "4fac7eb1-9663-4f21-c3d6-c24880dbe9f9"
      },
      "source": [
        "# verifica a quantidade de dados ausentes.\n",
        "ausente_depois_preenchido = dados_limpos.isna().sum().sum()\n",
        "print(f'O total de dados ausentes é: {ausente_depois_preenchido}')"
      ],
      "execution_count": 15,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "O total de dados ausentes é: 0\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 363
        },
        "id": "V8Sbr1TNVpzI",
        "outputId": "1f5a9563-3b97-4d89-dd17-0ddd59cccf05"
      },
      "source": [
        "# descreve os dados\n",
        "dados_limpos.describe()"
      ],
      "execution_count": 16,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>patient_visit_identifier</th>\n",
              "      <th>age_above65</th>\n",
              "      <th>gender</th>\n",
              "      <th>disease grouping 1</th>\n",
              "      <th>disease grouping 2</th>\n",
              "      <th>disease grouping 3</th>\n",
              "      <th>disease grouping 4</th>\n",
              "      <th>disease grouping 5</th>\n",
              "      <th>disease grouping 6</th>\n",
              "      <th>htn</th>\n",
              "      <th>immunocompromised</th>\n",
              "      <th>other</th>\n",
              "      <th>albumin_median</th>\n",
              "      <th>albumin_mean</th>\n",
              "      <th>albumin_min</th>\n",
              "      <th>albumin_max</th>\n",
              "      <th>albumin_diff</th>\n",
              "      <th>be_arterial_median</th>\n",
              "      <th>be_arterial_mean</th>\n",
              "      <th>be_arterial_min</th>\n",
              "      <th>be_arterial_max</th>\n",
              "      <th>be_arterial_diff</th>\n",
              "      <th>be_venous_median</th>\n",
              "      <th>be_venous_mean</th>\n",
              "      <th>be_venous_min</th>\n",
              "      <th>be_venous_max</th>\n",
              "      <th>be_venous_diff</th>\n",
              "      <th>bic_arterial_median</th>\n",
              "      <th>bic_arterial_mean</th>\n",
              "      <th>bic_arterial_min</th>\n",
              "      <th>bic_arterial_max</th>\n",
              "      <th>bic_arterial_diff</th>\n",
              "      <th>bic_venous_median</th>\n",
              "      <th>bic_venous_mean</th>\n",
              "      <th>bic_venous_min</th>\n",
              "      <th>bic_venous_max</th>\n",
              "      <th>bic_venous_diff</th>\n",
              "      <th>billirubin_median</th>\n",
              "      <th>billirubin_mean</th>\n",
              "      <th>billirubin_min</th>\n",
              "      <th>...</th>\n",
              "      <th>dimer_min</th>\n",
              "      <th>dimer_max</th>\n",
              "      <th>dimer_diff</th>\n",
              "      <th>bloodpressure_diastolic_mean</th>\n",
              "      <th>bloodpressure_sistolic_mean</th>\n",
              "      <th>heart_rate_mean</th>\n",
              "      <th>respiratory_rate_mean</th>\n",
              "      <th>temperature_mean</th>\n",
              "      <th>oxygen_saturation_mean</th>\n",
              "      <th>bloodpressure_diastolic_median</th>\n",
              "      <th>bloodpressure_sistolic_median</th>\n",
              "      <th>heart_rate_median</th>\n",
              "      <th>respiratory_rate_median</th>\n",
              "      <th>temperature_median</th>\n",
              "      <th>oxygen_saturation_median</th>\n",
              "      <th>bloodpressure_diastolic_min</th>\n",
              "      <th>bloodpressure_sistolic_min</th>\n",
              "      <th>heart_rate_min</th>\n",
              "      <th>respiratory_rate_min</th>\n",
              "      <th>temperature_min</th>\n",
              "      <th>oxygen_saturation_min</th>\n",
              "      <th>bloodpressure_diastolic_max</th>\n",
              "      <th>bloodpressure_sistolic_max</th>\n",
              "      <th>heart_rate_max</th>\n",
              "      <th>respiratory_rate_max</th>\n",
              "      <th>temperature_max</th>\n",
              "      <th>oxygen_saturation_max</th>\n",
              "      <th>bloodpressure_diastolic_diff</th>\n",
              "      <th>bloodpressure_sistolic_diff</th>\n",
              "      <th>heart_rate_diff</th>\n",
              "      <th>respiratory_rate_diff</th>\n",
              "      <th>temperature_diff</th>\n",
              "      <th>oxygen_saturation_diff</th>\n",
              "      <th>bloodpressure_diastolic_diff_rel</th>\n",
              "      <th>bloodpressure_sistolic_diff_rel</th>\n",
              "      <th>heart_rate_diff_rel</th>\n",
              "      <th>respiratory_rate_diff_rel</th>\n",
              "      <th>temperature_diff_rel</th>\n",
              "      <th>oxygen_saturation_diff_rel</th>\n",
              "      <th>icu</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>count</th>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.0</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.0</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.0</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.0</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.0</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>...</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.0</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "      <td>1920.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>mean</th>\n",
              "      <td>191.981771</td>\n",
              "      <td>0.468750</td>\n",
              "      <td>0.369792</td>\n",
              "      <td>0.108333</td>\n",
              "      <td>0.028125</td>\n",
              "      <td>0.097917</td>\n",
              "      <td>0.019792</td>\n",
              "      <td>0.128125</td>\n",
              "      <td>0.046875</td>\n",
              "      <td>0.213021</td>\n",
              "      <td>0.158333</td>\n",
              "      <td>0.809896</td>\n",
              "      <td>0.550206</td>\n",
              "      <td>0.550206</td>\n",
              "      <td>0.550206</td>\n",
              "      <td>0.550206</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.981746</td>\n",
              "      <td>-0.981746</td>\n",
              "      <td>-0.981746</td>\n",
              "      <td>-0.981746</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.945891</td>\n",
              "      <td>-0.945891</td>\n",
              "      <td>-0.945891</td>\n",
              "      <td>-0.945891</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.314647</td>\n",
              "      <td>-0.314647</td>\n",
              "      <td>-0.314647</td>\n",
              "      <td>-0.314647</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.318064</td>\n",
              "      <td>-0.318064</td>\n",
              "      <td>-0.318064</td>\n",
              "      <td>-0.318064</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.946213</td>\n",
              "      <td>-0.946213</td>\n",
              "      <td>-0.946213</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.954190</td>\n",
              "      <td>-0.954190</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.073586</td>\n",
              "      <td>-0.328894</td>\n",
              "      <td>-0.260981</td>\n",
              "      <td>-0.446491</td>\n",
              "      <td>0.072576</td>\n",
              "      <td>0.748705</td>\n",
              "      <td>-0.077141</td>\n",
              "      <td>-0.333337</td>\n",
              "      <td>-0.263640</td>\n",
              "      <td>-0.439583</td>\n",
              "      <td>0.069355</td>\n",
              "      <td>0.752974</td>\n",
              "      <td>0.008269</td>\n",
              "      <td>-0.170573</td>\n",
              "      <td>-0.229781</td>\n",
              "      <td>-0.448810</td>\n",
              "      <td>0.355769</td>\n",
              "      <td>0.844804</td>\n",
              "      <td>-0.258725</td>\n",
              "      <td>-0.434989</td>\n",
              "      <td>-0.318252</td>\n",
              "      <td>-0.382418</td>\n",
              "      <td>-0.021286</td>\n",
              "      <td>0.805441</td>\n",
              "      <td>-0.818025</td>\n",
              "      <td>-0.804793</td>\n",
              "      <td>-0.822607</td>\n",
              "      <td>-0.795680</td>\n",
              "      <td>-0.831473</td>\n",
              "      <td>-0.919483</td>\n",
              "      <td>-0.843309</td>\n",
              "      <td>-0.796205</td>\n",
              "      <td>-0.868908</td>\n",
              "      <td>-0.807059</td>\n",
              "      <td>-0.832341</td>\n",
              "      <td>-0.919374</td>\n",
              "      <td>0.268229</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>std</th>\n",
              "      <td>111.312587</td>\n",
              "      <td>0.499152</td>\n",
              "      <td>0.482874</td>\n",
              "      <td>0.310882</td>\n",
              "      <td>0.165373</td>\n",
              "      <td>0.297279</td>\n",
              "      <td>0.139320</td>\n",
              "      <td>0.334316</td>\n",
              "      <td>0.211426</td>\n",
              "      <td>0.409549</td>\n",
              "      <td>0.365148</td>\n",
              "      <td>0.392485</td>\n",
              "      <td>0.188122</td>\n",
              "      <td>0.188122</td>\n",
              "      <td>0.188122</td>\n",
              "      <td>0.188122</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.109984</td>\n",
              "      <td>0.109984</td>\n",
              "      <td>0.109984</td>\n",
              "      <td>0.109984</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.141914</td>\n",
              "      <td>0.141914</td>\n",
              "      <td>0.141914</td>\n",
              "      <td>0.141914</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.068027</td>\n",
              "      <td>0.068027</td>\n",
              "      <td>0.068027</td>\n",
              "      <td>0.068027</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.105477</td>\n",
              "      <td>0.105477</td>\n",
              "      <td>0.105477</td>\n",
              "      <td>0.105477</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.059843</td>\n",
              "      <td>0.059843</td>\n",
              "      <td>0.059843</td>\n",
              "      <td>...</td>\n",
              "      <td>0.134428</td>\n",
              "      <td>0.134428</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.256042</td>\n",
              "      <td>0.275773</td>\n",
              "      <td>0.248172</td>\n",
              "      <td>0.216244</td>\n",
              "      <td>0.249047</td>\n",
              "      <td>0.134457</td>\n",
              "      <td>0.261257</td>\n",
              "      <td>0.278649</td>\n",
              "      <td>0.254230</td>\n",
              "      <td>0.226438</td>\n",
              "      <td>0.255877</td>\n",
              "      <td>0.131777</td>\n",
              "      <td>0.274535</td>\n",
              "      <td>0.269147</td>\n",
              "      <td>0.265569</td>\n",
              "      <td>0.262493</td>\n",
              "      <td>0.210906</td>\n",
              "      <td>0.234200</td>\n",
              "      <td>0.246793</td>\n",
              "      <td>0.266075</td>\n",
              "      <td>0.274095</td>\n",
              "      <td>0.353385</td>\n",
              "      <td>0.265660</td>\n",
              "      <td>0.142729</td>\n",
              "      <td>0.317059</td>\n",
              "      <td>0.354992</td>\n",
              "      <td>0.322291</td>\n",
              "      <td>0.406892</td>\n",
              "      <td>0.287297</td>\n",
              "      <td>0.244190</td>\n",
              "      <td>0.283063</td>\n",
              "      <td>0.364540</td>\n",
              "      <td>0.236097</td>\n",
              "      <td>0.375880</td>\n",
              "      <td>0.286119</td>\n",
              "      <td>0.244728</td>\n",
              "      <td>0.443153</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>min</th>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>...</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>25%</th>\n",
              "      <td>95.750000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.966510</td>\n",
              "      <td>-0.966510</td>\n",
              "      <td>-0.966510</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.983194</td>\n",
              "      <td>-0.983194</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.234568</td>\n",
              "      <td>-0.528428</td>\n",
              "      <td>-0.424038</td>\n",
              "      <td>-0.570621</td>\n",
              "      <td>-0.107143</td>\n",
              "      <td>0.684211</td>\n",
              "      <td>-0.234568</td>\n",
              "      <td>-0.538462</td>\n",
              "      <td>-0.433962</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>-0.107143</td>\n",
              "      <td>0.684211</td>\n",
              "      <td>-0.175258</td>\n",
              "      <td>-0.375000</td>\n",
              "      <td>-0.401709</td>\n",
              "      <td>-0.571429</td>\n",
              "      <td>0.230769</td>\n",
              "      <td>0.838384</td>\n",
              "      <td>-0.418803</td>\n",
              "      <td>-0.610811</td>\n",
              "      <td>-0.507463</td>\n",
              "      <td>-0.575758</td>\n",
              "      <td>-0.217391</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>50%</th>\n",
              "      <td>191.500000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.978029</td>\n",
              "      <td>-0.978029</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.078189</td>\n",
              "      <td>-0.376923</td>\n",
              "      <td>-0.283019</td>\n",
              "      <td>-0.517049</td>\n",
              "      <td>0.035714</td>\n",
              "      <td>0.753838</td>\n",
              "      <td>-0.111111</td>\n",
              "      <td>-0.384615</td>\n",
              "      <td>-0.283019</td>\n",
              "      <td>-0.517241</td>\n",
              "      <td>0.035714</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.030928</td>\n",
              "      <td>-0.187500</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.428571</td>\n",
              "      <td>0.340659</td>\n",
              "      <td>0.878788</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.459459</td>\n",
              "      <td>-0.358209</td>\n",
              "      <td>-0.515152</td>\n",
              "      <td>-0.057971</td>\n",
              "      <td>0.842105</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>75%</th>\n",
              "      <td>288.250000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.967698</td>\n",
              "      <td>-0.967698</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.181995</td>\n",
              "      <td>-0.125786</td>\n",
              "      <td>-0.389831</td>\n",
              "      <td>0.214286</td>\n",
              "      <td>0.842105</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.200000</td>\n",
              "      <td>-0.113208</td>\n",
              "      <td>-0.379310</td>\n",
              "      <td>0.214286</td>\n",
              "      <td>0.842105</td>\n",
              "      <td>0.237113</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.059829</td>\n",
              "      <td>-0.357143</td>\n",
              "      <td>0.494505</td>\n",
              "      <td>0.919192</td>\n",
              "      <td>-0.094017</td>\n",
              "      <td>-0.297297</td>\n",
              "      <td>-0.179104</td>\n",
              "      <td>-0.333333</td>\n",
              "      <td>0.159420</td>\n",
              "      <td>0.894737</td>\n",
              "      <td>-0.739130</td>\n",
              "      <td>-0.754601</td>\n",
              "      <td>-0.770992</td>\n",
              "      <td>-0.764706</td>\n",
              "      <td>-0.761905</td>\n",
              "      <td>-0.919192</td>\n",
              "      <td>-0.773547</td>\n",
              "      <td>-0.731211</td>\n",
              "      <td>-0.835332</td>\n",
              "      <td>-0.787721</td>\n",
              "      <td>-0.767681</td>\n",
              "      <td>-0.923299</td>\n",
              "      <td>1.000000</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>max</th>\n",
              "      <td>384.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>...</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>1.000000</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>8 rows × 229 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "       patient_visit_identifier  ...          icu\n",
              "count               1920.000000  ...  1920.000000\n",
              "mean                 191.981771  ...     0.268229\n",
              "std                  111.312587  ...     0.443153\n",
              "min                    0.000000  ...     0.000000\n",
              "25%                   95.750000  ...     0.000000\n",
              "50%                  191.500000  ...     0.000000\n",
              "75%                  288.250000  ...     1.000000\n",
              "max                  384.000000  ...     1.000000\n",
              "\n",
              "[8 rows x 229 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 16
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "HrWWFQopVb8n"
      },
      "source": [
        "Agora não existem dados ausentes na base de dados. E todas as colunas tem uma contagem de 1920 valores.\n",
        "\n",
        "Esses serão os dados utilizados para a **Análise Exploratória dos Dados (EDA)**."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "s3rqIclHVYhh"
      },
      "source": [
        "# exporta os dados em um arquivo csv\n",
        "dados_limpos.to_csv('dados_eda.csv', index=False)"
      ],
      "execution_count": 17,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "9aphB9n0cuhA"
      },
      "source": [
        "## Tratamento dos dados para Machine Learning\n",
        "\n",
        "Ainda são necessárias alterações nos dados para que possam ser utilizados para o modelo de Machine Learning.\n",
        "\n",
        "É possível verificar quais os tipos dos dados que existem na base de dados."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "Gt1aB35sX0tJ",
        "outputId": "0c7d32d4-d00a-4850-8a33-2e86676f6bcf"
      },
      "source": [
        "# informações sobre os dados\n",
        "dados_limpos.info()"
      ],
      "execution_count": 18,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "<class 'pandas.core.frame.DataFrame'>\n",
            "Int64Index: 1920 entries, 0 to 1924\n",
            "Columns: 231 entries, patient_visit_identifier to icu\n",
            "dtypes: float64(225), int64(4), object(2)\n",
            "memory usage: 3.4+ MB\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "rrM_RBtWawqq"
      },
      "source": [
        "Na informação acima é identificado que a base de dados possui:\n",
        "- 225 colunas com dados do tipo **float64**;\n",
        "- 4 colunas com dados do tipo **int64**;\n",
        "- 2 colunas com dados do tipo **object**;\n",
        "\n",
        "As colunas com dados do tipo **int64** são referente aos valores categóricos e os dados do tipo **float64** são dos valores contínuos.\n",
        "\n",
        "As colunas com os dados do tipo **object** são as **age_percentil** e **window**. Pois possuem dados do tipo **string**.\n",
        "\n",
        "A coluna **age_percentil** pode ser transformada em dados categóricos, assim se tornando um dado numérico. Para isso será utilizada a função **LabelEncoder()** presente no módulo PreProcessing da biblioteca **SciKit Learn**."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "T9igRxVeeL00",
        "outputId": "3f7ad32d-19a0-46e6-af62-89d4ff3ac0b2"
      },
      "source": [
        "# visualiza os valores únicas da coluna age_percentil\n",
        "dados_limpos['age_percentil'].unique()"
      ],
      "execution_count": 19,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "array(['60th', '90th', '10th', '40th', '70th', '20th', '50th', '80th',\n",
              "       '30th', 'Above 90th'], dtype=object)"
            ]
          },
          "metadata": {},
          "execution_count": 19
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "qEnoguZVc8pH",
        "outputId": "d763e054-ebe0-4f04-bfde-571ae16a132c"
      },
      "source": [
        "# define o LabelEncoder na variável le\n",
        "le = preprocessing.LabelEncoder()\n",
        "\n",
        "# transforma os dados string em dados categóricos\n",
        "dados_limpos['age_percentil'] = le.fit_transform(dados_limpos['age_percentil'])\n",
        "\n",
        "# visualiza os valores da coluna age_percentil após a transformação\n",
        "dados_limpos['age_percentil'].unique()"
      ],
      "execution_count": 20,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/plain": [
              "array([5, 8, 0, 3, 6, 1, 4, 7, 2, 9])"
            ]
          },
          "metadata": {},
          "execution_count": 20
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "tXzKJu0IfiGe"
      },
      "source": [
        "Após a transformação essa coluna também poderá ser utilizada na criação do modelo de Machine Learning, a coluna window continuará sendo do tipo objeto.\n",
        "\n",
        "Como informado pelo Sírio Libanês, a partir do momento que o paciente foi para a UTI os dados não devem ser utilizado para o modelo. E também o melhor é identificar a necessidade de um leito de UTI para o paciente o mais rapidamente possível, para isso será selecionada somente a primeira janela (**0-2**) para o modelo de Machine Learning desse projeto.\n",
        "\n",
        "Primeiramente serão identificados os dados onde o paciente entrou diretamente para a UTI logo na primeira janela."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 473
        },
        "id": "9c75upNFen1Q",
        "outputId": "ed44d02a-ebd3-420c-eeb0-24c795c35e20"
      },
      "source": [
        "# identifica os dados de pacientes que chegaram ao hospital e foram para a UTI\n",
        "a_remover = dados_limpos.query(\"window == '0-2' and icu==1\")['patient_visit_identifier'].values\n",
        "\n",
        "# remove os paciente que foram diretamente para a UTI\n",
        "dados_limpos = dados_limpos.query(\"patient_visit_identifier not in @a_remover\")\n",
        "\n",
        "# visualiza os dados após a remoção\n",
        "dados_limpos"
      ],
      "execution_count": 21,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th>patient_visit_identifier</th>\n",
              "      <th>age_above65</th>\n",
              "      <th>age_percentil</th>\n",
              "      <th>gender</th>\n",
              "      <th>disease grouping 1</th>\n",
              "      <th>disease grouping 2</th>\n",
              "      <th>disease grouping 3</th>\n",
              "      <th>disease grouping 4</th>\n",
              "      <th>disease grouping 5</th>\n",
              "      <th>disease grouping 6</th>\n",
              "      <th>htn</th>\n",
              "      <th>immunocompromised</th>\n",
              "      <th>other</th>\n",
              "      <th>albumin_median</th>\n",
              "      <th>albumin_mean</th>\n",
              "      <th>albumin_min</th>\n",
              "      <th>albumin_max</th>\n",
              "      <th>albumin_diff</th>\n",
              "      <th>be_arterial_median</th>\n",
              "      <th>be_arterial_mean</th>\n",
              "      <th>be_arterial_min</th>\n",
              "      <th>be_arterial_max</th>\n",
              "      <th>be_arterial_diff</th>\n",
              "      <th>be_venous_median</th>\n",
              "      <th>be_venous_mean</th>\n",
              "      <th>be_venous_min</th>\n",
              "      <th>be_venous_max</th>\n",
              "      <th>be_venous_diff</th>\n",
              "      <th>bic_arterial_median</th>\n",
              "      <th>bic_arterial_mean</th>\n",
              "      <th>bic_arterial_min</th>\n",
              "      <th>bic_arterial_max</th>\n",
              "      <th>bic_arterial_diff</th>\n",
              "      <th>bic_venous_median</th>\n",
              "      <th>bic_venous_mean</th>\n",
              "      <th>bic_venous_min</th>\n",
              "      <th>bic_venous_max</th>\n",
              "      <th>bic_venous_diff</th>\n",
              "      <th>billirubin_median</th>\n",
              "      <th>billirubin_mean</th>\n",
              "      <th>...</th>\n",
              "      <th>dimer_max</th>\n",
              "      <th>dimer_diff</th>\n",
              "      <th>bloodpressure_diastolic_mean</th>\n",
              "      <th>bloodpressure_sistolic_mean</th>\n",
              "      <th>heart_rate_mean</th>\n",
              "      <th>respiratory_rate_mean</th>\n",
              "      <th>temperature_mean</th>\n",
              "      <th>oxygen_saturation_mean</th>\n",
              "      <th>bloodpressure_diastolic_median</th>\n",
              "      <th>bloodpressure_sistolic_median</th>\n",
              "      <th>heart_rate_median</th>\n",
              "      <th>respiratory_rate_median</th>\n",
              "      <th>temperature_median</th>\n",
              "      <th>oxygen_saturation_median</th>\n",
              "      <th>bloodpressure_diastolic_min</th>\n",
              "      <th>bloodpressure_sistolic_min</th>\n",
              "      <th>heart_rate_min</th>\n",
              "      <th>respiratory_rate_min</th>\n",
              "      <th>temperature_min</th>\n",
              "      <th>oxygen_saturation_min</th>\n",
              "      <th>bloodpressure_diastolic_max</th>\n",
              "      <th>bloodpressure_sistolic_max</th>\n",
              "      <th>heart_rate_max</th>\n",
              "      <th>respiratory_rate_max</th>\n",
              "      <th>temperature_max</th>\n",
              "      <th>oxygen_saturation_max</th>\n",
              "      <th>bloodpressure_diastolic_diff</th>\n",
              "      <th>bloodpressure_sistolic_diff</th>\n",
              "      <th>heart_rate_diff</th>\n",
              "      <th>respiratory_rate_diff</th>\n",
              "      <th>temperature_diff</th>\n",
              "      <th>oxygen_saturation_diff</th>\n",
              "      <th>bloodpressure_diastolic_diff_rel</th>\n",
              "      <th>bloodpressure_sistolic_diff_rel</th>\n",
              "      <th>heart_rate_diff_rel</th>\n",
              "      <th>respiratory_rate_diff_rel</th>\n",
              "      <th>temperature_diff_rel</th>\n",
              "      <th>oxygen_saturation_diff_rel</th>\n",
              "      <th>window</th>\n",
              "      <th>icu</th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.994912</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.283019</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>-0.285714</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.283019</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>-0.285714</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.237113</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>-0.162393</td>\n",
              "      <td>-0.500000</td>\n",
              "      <td>0.208791</td>\n",
              "      <td>0.898990</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.459459</td>\n",
              "      <td>-0.432836</td>\n",
              "      <td>-0.636364</td>\n",
              "      <td>-0.420290</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1</th>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.994912</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.333333</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.132075</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>0.535714</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>0.333333</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.132075</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>0.535714</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>0.443299</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>-0.025641</td>\n",
              "      <td>-0.500000</td>\n",
              "      <td>0.714286</td>\n",
              "      <td>0.838384</td>\n",
              "      <td>-0.076923</td>\n",
              "      <td>-0.459459</td>\n",
              "      <td>-0.313433</td>\n",
              "      <td>-0.636364</td>\n",
              "      <td>0.246377</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>2-4</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.994912</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.333333</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.132075</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>0.535714</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>0.333333</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.132075</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>0.535714</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>0.443299</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>-0.025641</td>\n",
              "      <td>-0.500000</td>\n",
              "      <td>0.714286</td>\n",
              "      <td>0.838384</td>\n",
              "      <td>-0.076923</td>\n",
              "      <td>-0.459459</td>\n",
              "      <td>-0.313433</td>\n",
              "      <td>-0.636364</td>\n",
              "      <td>0.246377</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>4-6</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.994912</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.333333</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.132075</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>-0.107143</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.333333</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.132075</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>-0.107143</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.443299</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>-0.025641</td>\n",
              "      <td>-0.500000</td>\n",
              "      <td>0.318681</td>\n",
              "      <td>0.898990</td>\n",
              "      <td>-0.076923</td>\n",
              "      <td>-0.459459</td>\n",
              "      <td>-0.313433</td>\n",
              "      <td>-0.636364</td>\n",
              "      <td>-0.275362</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>6-12</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.871658</td>\n",
              "      <td>-0.871658</td>\n",
              "      <td>-0.871658</td>\n",
              "      <td>-0.871658</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.863874</td>\n",
              "      <td>-0.863874</td>\n",
              "      <td>-0.863874</td>\n",
              "      <td>-0.863874</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.414634</td>\n",
              "      <td>-0.414634</td>\n",
              "      <td>-0.414634</td>\n",
              "      <td>-0.414634</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.979069</td>\n",
              "      <td>-0.979069</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.996762</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.243021</td>\n",
              "      <td>-0.338537</td>\n",
              "      <td>-0.213031</td>\n",
              "      <td>-0.317859</td>\n",
              "      <td>0.033779</td>\n",
              "      <td>0.665932</td>\n",
              "      <td>-0.283951</td>\n",
              "      <td>-0.376923</td>\n",
              "      <td>-0.188679</td>\n",
              "      <td>-0.379310</td>\n",
              "      <td>0.035714</td>\n",
              "      <td>0.631579</td>\n",
              "      <td>-0.340206</td>\n",
              "      <td>-0.4875</td>\n",
              "      <td>-0.572650</td>\n",
              "      <td>-0.857143</td>\n",
              "      <td>0.098901</td>\n",
              "      <td>0.797980</td>\n",
              "      <td>-0.076923</td>\n",
              "      <td>0.286486</td>\n",
              "      <td>0.298507</td>\n",
              "      <td>0.272727</td>\n",
              "      <td>0.362319</td>\n",
              "      <td>0.947368</td>\n",
              "      <td>-0.339130</td>\n",
              "      <td>0.325153</td>\n",
              "      <td>0.114504</td>\n",
              "      <td>0.176471</td>\n",
              "      <td>-0.238095</td>\n",
              "      <td>-0.818182</td>\n",
              "      <td>-0.389967</td>\n",
              "      <td>0.407558</td>\n",
              "      <td>-0.230462</td>\n",
              "      <td>0.096774</td>\n",
              "      <td>-0.242282</td>\n",
              "      <td>-0.814433</td>\n",
              "      <td>ABOVE_12</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1920</th>\n",
              "      <td>384</td>\n",
              "      <td>0</td>\n",
              "      <td>4</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.982208</td>\n",
              "      <td>-0.982208</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.979571</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.012346</td>\n",
              "      <td>-0.292308</td>\n",
              "      <td>0.056604</td>\n",
              "      <td>-0.525424</td>\n",
              "      <td>0.535714</td>\n",
              "      <td>0.789474</td>\n",
              "      <td>0.012346</td>\n",
              "      <td>-0.292308</td>\n",
              "      <td>0.056604</td>\n",
              "      <td>-0.517241</td>\n",
              "      <td>0.535714</td>\n",
              "      <td>0.789474</td>\n",
              "      <td>0.175258</td>\n",
              "      <td>-0.0500</td>\n",
              "      <td>0.145299</td>\n",
              "      <td>-0.428571</td>\n",
              "      <td>0.714286</td>\n",
              "      <td>0.919192</td>\n",
              "      <td>-0.299145</td>\n",
              "      <td>-0.502703</td>\n",
              "      <td>-0.164179</td>\n",
              "      <td>-0.575758</td>\n",
              "      <td>0.246377</td>\n",
              "      <td>0.789474</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1921</th>\n",
              "      <td>384</td>\n",
              "      <td>0</td>\n",
              "      <td>4</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.982208</td>\n",
              "      <td>-0.982208</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.979571</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.384615</td>\n",
              "      <td>-0.113208</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>0.142857</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.384615</td>\n",
              "      <td>-0.113208</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>0.142857</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>0.237113</td>\n",
              "      <td>-0.1250</td>\n",
              "      <td>-0.008547</td>\n",
              "      <td>-0.500000</td>\n",
              "      <td>0.472527</td>\n",
              "      <td>0.838384</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.567568</td>\n",
              "      <td>-0.298507</td>\n",
              "      <td>-0.636364</td>\n",
              "      <td>-0.072464</td>\n",
              "      <td>0.578947</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>2-4</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1922</th>\n",
              "      <td>384</td>\n",
              "      <td>0</td>\n",
              "      <td>4</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.982208</td>\n",
              "      <td>-0.982208</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.979571</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.169811</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>0.142857</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.169811</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>0.142857</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.237113</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>-0.059829</td>\n",
              "      <td>-0.500000</td>\n",
              "      <td>0.472527</td>\n",
              "      <td>0.898990</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.459459</td>\n",
              "      <td>-0.343284</td>\n",
              "      <td>-0.636364</td>\n",
              "      <td>-0.072464</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>4-6</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1923</th>\n",
              "      <td>384</td>\n",
              "      <td>0</td>\n",
              "      <td>4</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-0.717277</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-0.170732</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.982208</td>\n",
              "      <td>-0.982208</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.979571</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.209877</td>\n",
              "      <td>-0.384615</td>\n",
              "      <td>-0.188679</td>\n",
              "      <td>-0.661017</td>\n",
              "      <td>0.285714</td>\n",
              "      <td>0.473684</td>\n",
              "      <td>0.209877</td>\n",
              "      <td>-0.384615</td>\n",
              "      <td>-0.188679</td>\n",
              "      <td>-0.655172</td>\n",
              "      <td>0.285714</td>\n",
              "      <td>0.473684</td>\n",
              "      <td>0.340206</td>\n",
              "      <td>-0.1250</td>\n",
              "      <td>-0.076923</td>\n",
              "      <td>-0.571429</td>\n",
              "      <td>0.560440</td>\n",
              "      <td>0.797980</td>\n",
              "      <td>-0.162393</td>\n",
              "      <td>-0.567568</td>\n",
              "      <td>-0.358209</td>\n",
              "      <td>-0.696970</td>\n",
              "      <td>0.043478</td>\n",
              "      <td>0.473684</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>6-12</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>1924</th>\n",
              "      <td>384</td>\n",
              "      <td>0</td>\n",
              "      <td>4</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.983255</td>\n",
              "      <td>-0.983255</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.888448</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.185185</td>\n",
              "      <td>-0.539103</td>\n",
              "      <td>-0.107704</td>\n",
              "      <td>-0.610169</td>\n",
              "      <td>0.050595</td>\n",
              "      <td>0.662281</td>\n",
              "      <td>-0.160494</td>\n",
              "      <td>-0.538462</td>\n",
              "      <td>-0.075472</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>0.071429</td>\n",
              "      <td>0.631579</td>\n",
              "      <td>-0.175258</td>\n",
              "      <td>-0.3750</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.785714</td>\n",
              "      <td>0.186813</td>\n",
              "      <td>0.777778</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.470270</td>\n",
              "      <td>-0.149254</td>\n",
              "      <td>-0.515152</td>\n",
              "      <td>0.101449</td>\n",
              "      <td>0.842105</td>\n",
              "      <td>-0.652174</td>\n",
              "      <td>-0.644172</td>\n",
              "      <td>-0.633588</td>\n",
              "      <td>-0.647059</td>\n",
              "      <td>-0.547619</td>\n",
              "      <td>-0.838384</td>\n",
              "      <td>-0.701863</td>\n",
              "      <td>-0.585967</td>\n",
              "      <td>-0.763868</td>\n",
              "      <td>-0.612903</td>\n",
              "      <td>-0.551337</td>\n",
              "      <td>-0.835052</td>\n",
              "      <td>ABOVE_12</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>1760 rows × 231 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "      patient_visit_identifier  age_above65  ...    window  icu\n",
              "0                            0            1  ...       0-2    0\n",
              "1                            0            1  ...       2-4    0\n",
              "2                            0            1  ...       4-6    0\n",
              "3                            0            1  ...      6-12    0\n",
              "4                            0            1  ...  ABOVE_12    1\n",
              "...                        ...          ...  ...       ...  ...\n",
              "1920                       384            0  ...       0-2    0\n",
              "1921                       384            0  ...       2-4    0\n",
              "1922                       384            0  ...       4-6    0\n",
              "1923                       384            0  ...      6-12    0\n",
              "1924                       384            0  ...  ABOVE_12    0\n",
              "\n",
              "[1760 rows x 231 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 21
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "G8Ol3UEBiNfM"
      },
      "source": [
        "Após a remoção dos paciente que foram diretamente para a UTI temos 1760 linhas na base de dados.\n",
        "\n",
        "A função **prepare_window** será usada para identificar se um paciente foi para a UTI em algum momento e selecionar somente a primeira janela nos dados."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 318
        },
        "id": "wiQJgs48iI3U",
        "outputId": "bbefa0c6-a571-4d47-d244-e53b45e56ad1"
      },
      "source": [
        "# aplica a função após agrupar os dados pelo identificador de paciente\n",
        "dados_limpos = dados_limpos.groupby(by='patient_visit_identifier').apply(prepare_window)\n",
        "\n",
        "# visualiza os dados\n",
        "dados_limpos.head()"
      ],
      "execution_count": 22,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th>patient_visit_identifier</th>\n",
              "      <th>age_above65</th>\n",
              "      <th>age_percentil</th>\n",
              "      <th>gender</th>\n",
              "      <th>disease grouping 1</th>\n",
              "      <th>disease grouping 2</th>\n",
              "      <th>disease grouping 3</th>\n",
              "      <th>disease grouping 4</th>\n",
              "      <th>disease grouping 5</th>\n",
              "      <th>disease grouping 6</th>\n",
              "      <th>htn</th>\n",
              "      <th>immunocompromised</th>\n",
              "      <th>other</th>\n",
              "      <th>albumin_median</th>\n",
              "      <th>albumin_mean</th>\n",
              "      <th>albumin_min</th>\n",
              "      <th>albumin_max</th>\n",
              "      <th>albumin_diff</th>\n",
              "      <th>be_arterial_median</th>\n",
              "      <th>be_arterial_mean</th>\n",
              "      <th>be_arterial_min</th>\n",
              "      <th>be_arterial_max</th>\n",
              "      <th>be_arterial_diff</th>\n",
              "      <th>be_venous_median</th>\n",
              "      <th>be_venous_mean</th>\n",
              "      <th>be_venous_min</th>\n",
              "      <th>be_venous_max</th>\n",
              "      <th>be_venous_diff</th>\n",
              "      <th>bic_arterial_median</th>\n",
              "      <th>bic_arterial_mean</th>\n",
              "      <th>bic_arterial_min</th>\n",
              "      <th>bic_arterial_max</th>\n",
              "      <th>bic_arterial_diff</th>\n",
              "      <th>bic_venous_median</th>\n",
              "      <th>bic_venous_mean</th>\n",
              "      <th>bic_venous_min</th>\n",
              "      <th>bic_venous_max</th>\n",
              "      <th>bic_venous_diff</th>\n",
              "      <th>billirubin_median</th>\n",
              "      <th>billirubin_mean</th>\n",
              "      <th>...</th>\n",
              "      <th>dimer_max</th>\n",
              "      <th>dimer_diff</th>\n",
              "      <th>bloodpressure_diastolic_mean</th>\n",
              "      <th>bloodpressure_sistolic_mean</th>\n",
              "      <th>heart_rate_mean</th>\n",
              "      <th>respiratory_rate_mean</th>\n",
              "      <th>temperature_mean</th>\n",
              "      <th>oxygen_saturation_mean</th>\n",
              "      <th>bloodpressure_diastolic_median</th>\n",
              "      <th>bloodpressure_sistolic_median</th>\n",
              "      <th>heart_rate_median</th>\n",
              "      <th>respiratory_rate_median</th>\n",
              "      <th>temperature_median</th>\n",
              "      <th>oxygen_saturation_median</th>\n",
              "      <th>bloodpressure_diastolic_min</th>\n",
              "      <th>bloodpressure_sistolic_min</th>\n",
              "      <th>heart_rate_min</th>\n",
              "      <th>respiratory_rate_min</th>\n",
              "      <th>temperature_min</th>\n",
              "      <th>oxygen_saturation_min</th>\n",
              "      <th>bloodpressure_diastolic_max</th>\n",
              "      <th>bloodpressure_sistolic_max</th>\n",
              "      <th>heart_rate_max</th>\n",
              "      <th>respiratory_rate_max</th>\n",
              "      <th>temperature_max</th>\n",
              "      <th>oxygen_saturation_max</th>\n",
              "      <th>bloodpressure_diastolic_diff</th>\n",
              "      <th>bloodpressure_sistolic_diff</th>\n",
              "      <th>heart_rate_diff</th>\n",
              "      <th>respiratory_rate_diff</th>\n",
              "      <th>temperature_diff</th>\n",
              "      <th>oxygen_saturation_diff</th>\n",
              "      <th>bloodpressure_diastolic_diff_rel</th>\n",
              "      <th>bloodpressure_sistolic_diff_rel</th>\n",
              "      <th>heart_rate_diff_rel</th>\n",
              "      <th>respiratory_rate_diff_rel</th>\n",
              "      <th>temperature_diff_rel</th>\n",
              "      <th>oxygen_saturation_diff_rel</th>\n",
              "      <th>window</th>\n",
              "      <th>icu</th>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>patient_visit_identifier</th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <th>0</th>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.994912</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.283019</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>-0.285714</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.283019</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>-0.285714</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>0.237113</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>-0.162393</td>\n",
              "      <td>-0.500000</td>\n",
              "      <td>0.208791</td>\n",
              "      <td>0.898990</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.459459</td>\n",
              "      <td>-0.432836</td>\n",
              "      <td>-0.636364</td>\n",
              "      <td>-0.420290</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0-2</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <th>10</th>\n",
              "      <td>2</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.978029</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.489712</td>\n",
              "      <td>-0.685470</td>\n",
              "      <td>-0.048218</td>\n",
              "      <td>-0.645951</td>\n",
              "      <td>0.357143</td>\n",
              "      <td>0.935673</td>\n",
              "      <td>-0.506173</td>\n",
              "      <td>-0.815385</td>\n",
              "      <td>-0.056604</td>\n",
              "      <td>-0.517241</td>\n",
              "      <td>0.357143</td>\n",
              "      <td>0.947368</td>\n",
              "      <td>-0.525773</td>\n",
              "      <td>-0.5125</td>\n",
              "      <td>-0.111111</td>\n",
              "      <td>-0.714286</td>\n",
              "      <td>0.604396</td>\n",
              "      <td>0.959596</td>\n",
              "      <td>-0.435897</td>\n",
              "      <td>-0.491892</td>\n",
              "      <td>0.000000</td>\n",
              "      <td>-0.575758</td>\n",
              "      <td>0.101449</td>\n",
              "      <td>1.000000</td>\n",
              "      <td>-0.547826</td>\n",
              "      <td>-0.533742</td>\n",
              "      <td>-0.603053</td>\n",
              "      <td>-0.764706</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-0.959596</td>\n",
              "      <td>-0.515528</td>\n",
              "      <td>-0.351328</td>\n",
              "      <td>-0.747001</td>\n",
              "      <td>-0.756272</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-0.961262</td>\n",
              "      <td>0-2</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <th>15</th>\n",
              "      <td>3</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>-0.263158</td>\n",
              "      <td>-0.263158</td>\n",
              "      <td>-0.263158</td>\n",
              "      <td>-0.263158</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.972789</td>\n",
              "      <td>-0.972789</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.978029</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.012346</td>\n",
              "      <td>-0.369231</td>\n",
              "      <td>-0.528302</td>\n",
              "      <td>-0.457627</td>\n",
              "      <td>-0.285714</td>\n",
              "      <td>0.684211</td>\n",
              "      <td>0.012346</td>\n",
              "      <td>-0.369231</td>\n",
              "      <td>-0.528302</td>\n",
              "      <td>-0.448276</td>\n",
              "      <td>-0.285714</td>\n",
              "      <td>0.684211</td>\n",
              "      <td>0.175258</td>\n",
              "      <td>-0.1125</td>\n",
              "      <td>-0.384615</td>\n",
              "      <td>-0.357143</td>\n",
              "      <td>0.208791</td>\n",
              "      <td>0.878788</td>\n",
              "      <td>-0.299145</td>\n",
              "      <td>-0.556757</td>\n",
              "      <td>-0.626866</td>\n",
              "      <td>-0.515152</td>\n",
              "      <td>-0.420290</td>\n",
              "      <td>0.684211</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <th>20</th>\n",
              "      <td>4</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.935113</td>\n",
              "      <td>-0.935113</td>\n",
              "      <td>...</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.333333</td>\n",
              "      <td>-0.153846</td>\n",
              "      <td>0.160377</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>0.285714</td>\n",
              "      <td>0.868421</td>\n",
              "      <td>0.333333</td>\n",
              "      <td>-0.153846</td>\n",
              "      <td>0.160377</td>\n",
              "      <td>-0.586207</td>\n",
              "      <td>0.285714</td>\n",
              "      <td>0.868421</td>\n",
              "      <td>0.443299</td>\n",
              "      <td>0.0000</td>\n",
              "      <td>0.196581</td>\n",
              "      <td>-0.571429</td>\n",
              "      <td>0.538462</td>\n",
              "      <td>0.939394</td>\n",
              "      <td>-0.076923</td>\n",
              "      <td>-0.351351</td>\n",
              "      <td>-0.044776</td>\n",
              "      <td>-0.575758</td>\n",
              "      <td>0.072464</td>\n",
              "      <td>0.894737</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-0.877301</td>\n",
              "      <td>-0.923664</td>\n",
              "      <td>-0.882353</td>\n",
              "      <td>-0.952381</td>\n",
              "      <td>-0.979798</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-0.883669</td>\n",
              "      <td>-0.956805</td>\n",
              "      <td>-0.870968</td>\n",
              "      <td>-0.953536</td>\n",
              "      <td>-0.980333</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>5</th>\n",
              "      <th>25</th>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>...</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.037037</td>\n",
              "      <td>-0.538462</td>\n",
              "      <td>-0.537736</td>\n",
              "      <td>-0.525424</td>\n",
              "      <td>-0.196429</td>\n",
              "      <td>0.815789</td>\n",
              "      <td>-0.037037</td>\n",
              "      <td>-0.538462</td>\n",
              "      <td>-0.537736</td>\n",
              "      <td>-0.517241</td>\n",
              "      <td>-0.196429</td>\n",
              "      <td>0.815789</td>\n",
              "      <td>0.030928</td>\n",
              "      <td>-0.3750</td>\n",
              "      <td>-0.401709</td>\n",
              "      <td>-0.428571</td>\n",
              "      <td>0.252747</td>\n",
              "      <td>0.919192</td>\n",
              "      <td>-0.247863</td>\n",
              "      <td>-0.567568</td>\n",
              "      <td>-0.626866</td>\n",
              "      <td>-0.575758</td>\n",
              "      <td>-0.333333</td>\n",
              "      <td>0.842105</td>\n",
              "      <td>-0.826087</td>\n",
              "      <td>-0.754601</td>\n",
              "      <td>-0.984733</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-0.976190</td>\n",
              "      <td>-0.979798</td>\n",
              "      <td>-0.860870</td>\n",
              "      <td>-0.714460</td>\n",
              "      <td>-0.986481</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-0.975891</td>\n",
              "      <td>-0.980129</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>5 rows × 231 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "                             patient_visit_identifier  age_above65  ...  window  icu\n",
              "patient_visit_identifier                                            ...             \n",
              "0                        0                          0            1  ...     0-2    1\n",
              "2                        10                         2            0  ...     0-2    1\n",
              "3                        15                         3            0  ...     0-2    0\n",
              "4                        20                         4            0  ...     0-2    0\n",
              "5                        25                         5            0  ...     0-2    0\n",
              "\n",
              "[5 rows x 231 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 22
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "IO7OcTZWj0ap",
        "outputId": "ffcfae11-46fc-46d6-de74-4a82335aaad3"
      },
      "source": [
        "# verifica as dimensões do dataframe\n",
        "dimensao_dados(dados_limpos)"
      ],
      "execution_count": 23,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "O dataframe possui 352 linhas e 231 colunas.\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "TOWF6Q-zlRJE"
      },
      "source": [
        "Após a verificação se os pacientes foram para a UTI, ou não, e a seleção somente da primeira janela na coluna window temos um dataframe com **352 linhas**, agora com **cada linha sendo um paciente**.\n",
        "\n",
        "Outros conceitos importante ao trabalhar com um modelo de Machine Learning são **underfitting** e **overfitting**. Esses conceitos podem ser definidos como:\n",
        "\n",
        "- **underfitting**: o modelo não consegue aprender o suficiente com os dados. Erros altos tanto nos dados de treino como nos dados de teste.\n",
        "\n",
        "- **overfitting**: quando o modelo aprende demais com os dados de treino e não consegue generalizar. Grande performance com os dados de treino mas falha com os dados de teste.\n",
        "\n",
        "Uma maneira de evitar o **overfitting** é verificar se existem features (colunas) com **alta correlação nos dados** e remover. Quanto mais próximo de 1 ou -1 o valor maior é a correlação entre as variáveis. Uma maneira de verificar isso é através de uma **matriz de correlação**.\n",
        "\n",
        "O dataframe possui colunas com dados categóricos e esses não faz sentido verificar correlação."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "bqdK0BImklQM",
        "outputId": "395bef9a-200f-4618-9e0d-b3873efd3f30"
      },
      "source": [
        "dados_limpos.info()"
      ],
      "execution_count": 24,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "<class 'pandas.core.frame.DataFrame'>\n",
            "MultiIndex: 352 entries, (0, 0) to (384, 1920)\n",
            "Columns: 231 entries, patient_visit_identifier to icu\n",
            "dtypes: float64(225), int64(5), object(1)\n",
            "memory usage: 652.2+ KB\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "5b9j8WhypUM-"
      },
      "source": [
        "É necessário verificar a **correlação** entre os dados do tipo **float64**. As colunas com os valores dos exames realizados nos pacientes."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 450
        },
        "id": "VGB9TTWaowlT",
        "outputId": "ffaff205-80f7-4d77-c4d7-cbe8e48f66e6"
      },
      "source": [
        "# seleciona todos os tipos de dados exceto os float64\n",
        "dados_limpos.select_dtypes(exclude='float64')"
      ],
      "execution_count": 25,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th>patient_visit_identifier</th>\n",
              "      <th>age_above65</th>\n",
              "      <th>age_percentil</th>\n",
              "      <th>gender</th>\n",
              "      <th>window</th>\n",
              "      <th>icu</th>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>patient_visit_identifier</th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <th>0</th>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "      <td>0-2</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <th>10</th>\n",
              "      <td>2</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0-2</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <th>15</th>\n",
              "      <td>3</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>1</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <th>20</th>\n",
              "      <td>4</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>5</th>\n",
              "      <th>25</th>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>...</th>\n",
              "      <th>...</th>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "      <td>...</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>380</th>\n",
              "      <th>1900</th>\n",
              "      <td>380</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>1</td>\n",
              "      <td>0-2</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>381</th>\n",
              "      <th>1905</th>\n",
              "      <td>381</td>\n",
              "      <td>1</td>\n",
              "      <td>9</td>\n",
              "      <td>0</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>382</th>\n",
              "      <th>1910</th>\n",
              "      <td>382</td>\n",
              "      <td>0</td>\n",
              "      <td>4</td>\n",
              "      <td>0</td>\n",
              "      <td>0-2</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>383</th>\n",
              "      <th>1915</th>\n",
              "      <td>383</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>1</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>384</th>\n",
              "      <th>1920</th>\n",
              "      <td>384</td>\n",
              "      <td>0</td>\n",
              "      <td>4</td>\n",
              "      <td>1</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>352 rows × 6 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "                               patient_visit_identifier  ...  icu\n",
              "patient_visit_identifier                                 ...     \n",
              "0                        0                            0  ...    1\n",
              "2                        10                           2  ...    1\n",
              "3                        15                           3  ...    0\n",
              "4                        20                           4  ...    0\n",
              "5                        25                           5  ...    0\n",
              "...                                                 ...  ...  ...\n",
              "380                      1900                       380  ...    1\n",
              "381                      1905                       381  ...    0\n",
              "382                      1910                       382  ...    1\n",
              "383                      1915                       383  ...    0\n",
              "384                      1920                       384  ...    0\n",
              "\n",
              "[352 rows x 6 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 25
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "ZUfcfE5vq0I3"
      },
      "source": [
        "Acima temos as colunas que possuem dados categóricos ou object. São as 4 primeiras e as 2 últimas colunas da base de dados. Essas colunas podem ser removidas ao chamar a função da matriz de correlação."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 318
        },
        "id": "GK34nvjbqNOw",
        "outputId": "3b02228d-10fe-48b0-fe83-0009105758fe"
      },
      "source": [
        "# função para calcular a correlação e excluir as features com alta correlação\n",
        "dados_ml = remove_corr_var(dados_limpos, 0.9)\n",
        "dados_ml.head()"
      ],
      "execution_count": 26,
      "outputs": [
        {
          "output_type": "execute_result",
          "data": {
            "text/html": [
              "<div>\n",
              "<style scoped>\n",
              "    .dataframe tbody tr th:only-of-type {\n",
              "        vertical-align: middle;\n",
              "    }\n",
              "\n",
              "    .dataframe tbody tr th {\n",
              "        vertical-align: top;\n",
              "    }\n",
              "\n",
              "    .dataframe thead th {\n",
              "        text-align: right;\n",
              "    }\n",
              "</style>\n",
              "<table border=\"1\" class=\"dataframe\">\n",
              "  <thead>\n",
              "    <tr style=\"text-align: right;\">\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th>patient_visit_identifier</th>\n",
              "      <th>age_above65</th>\n",
              "      <th>age_percentil</th>\n",
              "      <th>gender</th>\n",
              "      <th>disease grouping 1</th>\n",
              "      <th>disease grouping 2</th>\n",
              "      <th>disease grouping 3</th>\n",
              "      <th>disease grouping 4</th>\n",
              "      <th>disease grouping 5</th>\n",
              "      <th>disease grouping 6</th>\n",
              "      <th>htn</th>\n",
              "      <th>immunocompromised</th>\n",
              "      <th>other</th>\n",
              "      <th>albumin_median</th>\n",
              "      <th>albumin_diff</th>\n",
              "      <th>be_arterial_median</th>\n",
              "      <th>be_arterial_diff</th>\n",
              "      <th>be_venous_median</th>\n",
              "      <th>be_venous_diff</th>\n",
              "      <th>bic_arterial_median</th>\n",
              "      <th>bic_arterial_diff</th>\n",
              "      <th>bic_venous_median</th>\n",
              "      <th>bic_venous_diff</th>\n",
              "      <th>billirubin_median</th>\n",
              "      <th>billirubin_diff</th>\n",
              "      <th>blast_median</th>\n",
              "      <th>blast_diff</th>\n",
              "      <th>calcium_median</th>\n",
              "      <th>calcium_diff</th>\n",
              "      <th>creatinin_median</th>\n",
              "      <th>creatinin_diff</th>\n",
              "      <th>ffa_median</th>\n",
              "      <th>ffa_diff</th>\n",
              "      <th>ggt_median</th>\n",
              "      <th>ggt_diff</th>\n",
              "      <th>glucose_median</th>\n",
              "      <th>glucose_diff</th>\n",
              "      <th>hematocrite_median</th>\n",
              "      <th>hematocrite_diff</th>\n",
              "      <th>hemoglobin_diff</th>\n",
              "      <th>...</th>\n",
              "      <th>pcr_median</th>\n",
              "      <th>pcr_diff</th>\n",
              "      <th>ph_arterial_median</th>\n",
              "      <th>ph_arterial_diff</th>\n",
              "      <th>ph_venous_median</th>\n",
              "      <th>ph_venous_diff</th>\n",
              "      <th>platelets_median</th>\n",
              "      <th>platelets_diff</th>\n",
              "      <th>potassium_median</th>\n",
              "      <th>potassium_diff</th>\n",
              "      <th>sat02_arterial_median</th>\n",
              "      <th>sat02_arterial_diff</th>\n",
              "      <th>sat02_venous_median</th>\n",
              "      <th>sat02_venous_diff</th>\n",
              "      <th>sodium_median</th>\n",
              "      <th>sodium_diff</th>\n",
              "      <th>tgo_median</th>\n",
              "      <th>tgo_diff</th>\n",
              "      <th>tgp_median</th>\n",
              "      <th>tgp_diff</th>\n",
              "      <th>ttpa_median</th>\n",
              "      <th>ttpa_diff</th>\n",
              "      <th>urea_median</th>\n",
              "      <th>urea_diff</th>\n",
              "      <th>dimer_median</th>\n",
              "      <th>dimer_diff</th>\n",
              "      <th>bloodpressure_diastolic_mean</th>\n",
              "      <th>bloodpressure_sistolic_mean</th>\n",
              "      <th>heart_rate_mean</th>\n",
              "      <th>respiratory_rate_mean</th>\n",
              "      <th>temperature_mean</th>\n",
              "      <th>oxygen_saturation_mean</th>\n",
              "      <th>bloodpressure_diastolic_diff</th>\n",
              "      <th>bloodpressure_sistolic_diff</th>\n",
              "      <th>heart_rate_diff</th>\n",
              "      <th>respiratory_rate_diff</th>\n",
              "      <th>temperature_diff</th>\n",
              "      <th>oxygen_saturation_diff</th>\n",
              "      <th>window</th>\n",
              "      <th>icu</th>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>patient_visit_identifier</th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "      <th></th>\n",
              "    </tr>\n",
              "  </thead>\n",
              "  <tbody>\n",
              "    <tr>\n",
              "      <th>0</th>\n",
              "      <th>0</th>\n",
              "      <td>0</td>\n",
              "      <td>1</td>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.183673</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.868365</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.742004</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.945093</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.891993</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.090147</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.875236</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.234043</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.363636</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.540721</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.518519</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.939394</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.345679</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.028571</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.997201</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.990854</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.825613</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.836145</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.994912</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.086420</td>\n",
              "      <td>-0.230769</td>\n",
              "      <td>-0.283019</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>-0.285714</td>\n",
              "      <td>0.736842</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0-2</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>2</th>\n",
              "      <th>10</th>\n",
              "      <td>2</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.357143</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.912243</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.742004</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.958528</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.780261</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.144654</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.939887</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.234043</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.363636</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.399199</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.703704</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.939394</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.345679</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.085714</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.995428</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.986662</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.846633</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.836145</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.978029</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.489712</td>\n",
              "      <td>-0.685470</td>\n",
              "      <td>-0.048218</td>\n",
              "      <td>-0.645951</td>\n",
              "      <td>0.357143</td>\n",
              "      <td>0.935673</td>\n",
              "      <td>-0.547826</td>\n",
              "      <td>-0.533742</td>\n",
              "      <td>-0.603053</td>\n",
              "      <td>-0.764706</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-0.959596</td>\n",
              "      <td>0-2</td>\n",
              "      <td>1</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>3</th>\n",
              "      <th>15</th>\n",
              "      <td>3</td>\n",
              "      <td>0</td>\n",
              "      <td>3</td>\n",
              "      <td>1</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>-0.263158</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.972789</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.326531</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.968861</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.194030</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.316589</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.891993</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.203354</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.503592</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.234043</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.363636</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.564753</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.777778</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.939394</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.580247</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.200000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.989549</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.956555</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.846633</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.937349</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.978029</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.012346</td>\n",
              "      <td>-0.369231</td>\n",
              "      <td>-0.528302</td>\n",
              "      <td>-0.457627</td>\n",
              "      <td>-0.285714</td>\n",
              "      <td>0.684211</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>4</th>\n",
              "      <th>20</th>\n",
              "      <td>4</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.935113</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.357143</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.913659</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.829424</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938084</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.851024</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.358491</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.990926</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.234043</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.363636</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.457944</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.592593</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.939394</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.345679</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.142857</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.998507</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.991235</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.846633</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.903614</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.333333</td>\n",
              "      <td>-0.153846</td>\n",
              "      <td>0.160377</td>\n",
              "      <td>-0.593220</td>\n",
              "      <td>0.285714</td>\n",
              "      <td>0.868421</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-0.877301</td>\n",
              "      <td>-0.923664</td>\n",
              "      <td>-0.882353</td>\n",
              "      <td>-0.952381</td>\n",
              "      <td>-0.979798</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "    <tr>\n",
              "      <th>5</th>\n",
              "      <th>25</th>\n",
              "      <td>5</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>0.0</td>\n",
              "      <td>1.0</td>\n",
              "      <td>0.605263</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.317073</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.938950</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.357143</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.891012</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.742004</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.958528</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.891993</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.291405</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>...</td>\n",
              "      <td>-0.997732</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.234043</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.363636</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.292390</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.666667</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.939394</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.345679</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>0.085714</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.997947</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.988948</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.846633</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.884337</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-1.0</td>\n",
              "      <td>-0.037037</td>\n",
              "      <td>-0.538462</td>\n",
              "      <td>-0.537736</td>\n",
              "      <td>-0.525424</td>\n",
              "      <td>-0.196429</td>\n",
              "      <td>0.815789</td>\n",
              "      <td>-0.826087</td>\n",
              "      <td>-0.754601</td>\n",
              "      <td>-0.984733</td>\n",
              "      <td>-1.000000</td>\n",
              "      <td>-0.976190</td>\n",
              "      <td>-0.979798</td>\n",
              "      <td>0-2</td>\n",
              "      <td>0</td>\n",
              "    </tr>\n",
              "  </tbody>\n",
              "</table>\n",
              "<p>5 rows × 97 columns</p>\n",
              "</div>"
            ],
            "text/plain": [
              "                             patient_visit_identifier  age_above65  ...  window  icu\n",
              "patient_visit_identifier                                            ...             \n",
              "0                        0                          0            1  ...     0-2    1\n",
              "2                        10                         2            0  ...     0-2    1\n",
              "3                        15                         3            0  ...     0-2    0\n",
              "4                        20                         4            0  ...     0-2    0\n",
              "5                        25                         5            0  ...     0-2    0\n",
              "\n",
              "[5 rows x 97 columns]"
            ]
          },
          "metadata": {},
          "execution_count": 26
        }
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "FuiIjLAPtlBf",
        "outputId": "675a9e17-4fbd-4cbf-9c3b-975978f3a903"
      },
      "source": [
        "# verifica o tamando do dataset após a remoção das features com alta correlação\n",
        "dimensao_dados(dados_ml)"
      ],
      "execution_count": 27,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "O dataframe possui 352 linhas e 97 colunas.\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "9Um78DiqvrWv"
      },
      "source": [
        "Após a remoção dos dados com alta correlação o dataframe está com 97 colunas.\n",
        "\n",
        "Esses são os tratamentos que será realizados aos dados nesse notebook."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "DsQnKJX8wv29"
      },
      "source": [
        "# exporta a base de dados em um arquivo csv\n",
        "dados_ml.to_csv('dados_ml.csv', index=False)"
      ],
      "execution_count": 28,
      "outputs": []
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "mNyPME1kwXES"
      },
      "source": [
        "# Conclusão\n",
        "\n",
        "Ao final desse notebook 2 bases de dados são exportadas.\n",
        "\n",
        "A base de dados dados_limpos será utilizada para a análise exploratória e visualização dos dados no notebook analise_dos_dados.\n",
        "\n",
        "A base de dados dados_ml será utilizada para a criação dos modelos de machine learning no notebook modelos_machine_learning."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Qm-PEGI5reK7"
      },
      "source": [
        "## Referências utilizadas durante o projeto\n",
        "\n",
        "1. [Página do Kaggle com informações sobre a base de dados](https://www.kaggle.com/S%C3%ADrio-Libanes/covid19)\n",
        "\n",
        "2. [Text classification with extremely small datasets](https://towardsdatascience.com/text-classification-with-extremely-small-datasets-333d322caee2)\n",
        "\n",
        "3. [5 Feature Selection Method From SciKit Learn You Should Know](https://towardsdatascience.com/5-feature-selection-method-from-scikit-learn-you-should-know-ed4d116e4172)\n",
        "\n",
        "4. [Como Selecionar As Melhores Features Para Seu Modelo de Machine Learning](https://paulovasconcellos.com.br/como-selecionar-as-melhores-features-para-seu-modelo-de-machine-learning-2e9df83d062a)\n",
        "\n",
        "5. [Machine Learning Map](https://scikit-learn.org/stable/tutorial/machine_learning_map/)\n",
        "\n",
        "6. [Primeiro caso de Covid-19 pode ter atingindo a Chine em outubro](https://www.cnnbrasil.com.br/saude/primeiro-caso-covid-19-pode-ter-atingido-a-china-em-outubro-de-2019-diz-estudo/)\n",
        "\n",
        "7. [Evolução dos Sintomas do Covid-19](https://saude.abril.com.br/medicina/casos-sem-sintomas-evolucoes-coronavirus/)\n",
        "\n",
        "8. [Covid Impact to Global Healthcare](https://edition.cnn.com/videos/world/2021/04/14/covid-impact-global-healthcare-lon-orig.cnn)\n",
        "\n",
        "9. [Observatório Covid-19 aponta maior colapso sanitário e hospitalar da história do Brasil](https://portal.fiocruz.br/noticia/observatorio-covid-19-aponta-maior-colapso-sanitario-e-hospitalar-da-historia-do-brasil)\n",
        "\n",
        "10. [Primeiro caso Covid-19 no Brasil](https://saude.abril.com.br/medicina/coronavirus-primeiro-caso-brasil/)\n",
        "\n",
        "11. [Overfitting e Underfitting em Machine Learning](https://abracd.org/overfitting-e-underfitting-em-machine-learning/#:~:text=Underfitting%20%C3%A9%20uma%20tradu%C3%A7%C3%A3o%20para,Overfitting%20%C3%A9%20o%20oposto)\n",
        "\n",
        "12. [WHO delivers advice and support for older people during Covid-19](https://www.who.int/news-room/feature-stories/detail/who-delivers-advice-and-support-for-older-people-during-covid-19#:~:text=The%20COVID%2D19%20pandemic,potential%20underlying%20health%20conditions)\n",
        "\n",
        "13. [Machine Learning in Healthcare](https://healthinformatics.uic.edu/blog/machine-learning-in-healthcare/)\n",
        "\n",
        "14. [Machine Learning](https://www.ibm.com/cloud/learn/machine-learning)\n",
        "\n",
        "15. [Hiperparameter Tuning](https://towardsdatascience.com/hyperparameter-tuning-c5619e7e6624)\n",
        "\n",
        "16. [SKLearn Model Selection - RandomizedSearchCV](https://scikit-learn.org/stable/modules/generated/sklearn.model_selection.RandomizedSearchCV.html)\n",
        "\n",
        "17. [Entenda o que é AUC e ROC nos modelos de Machine Learning](https://medium.com/bio-data-blog/entenda-o-que-%C3%A9-auc-e-roc-nos-modelos-de-machine-learning-8191fb4df772)\n",
        "\n",
        "18. [Understanding Confusion Matrix](https://towardsdatascience.com/understanding-confusion-matrix-a9ad42dcfd62)\n",
        "\n",
        "19. [Understanding a Classification Report For Your Machine Learning Model](https://medium.com/@kohlishivam5522/understanding-a-classification-report-for-your-machine-learning-model-88815e2ce397)\n",
        "\n",
        "20. [Understanding AUC ROC Curve](https://towardsdatascience.com/understanding-auc-roc-curve-68b2303cc9c5)\n",
        "\n",
        "21. [Regressão Logística](https://pt.wikipedia.org/wiki/Regress%C3%A3o_log%C3%ADstica)\n",
        "\n",
        "22. [SciKit Learn - RandomForestClassifier](http://scikit-learn.org/stable/modules/generated/sklearn.ensemble.RandomForestClassifier.html)\n",
        "\n",
        "23. [SciKit Learn - Logistic Regression](http://scikit-learn.org/stable/modules/generated/sklearn.linear_model.LogisticRegression.html)\n",
        "\n",
        "24. [SciKit Learn - SVC](http://scikit-learn.org/stable/modules/generated/sklearn.svm.SVC.html)\n",
        "\n",
        "25. [SciKit Learn - LinearSVC](https://scikit-learn.org/stable/modules/generated/sklearn.svm.LinearSVC.html)"
      ]
    }
  ]
}