Skip to content

Latest commit

 

History

History
76 lines (51 loc) · 7.9 KB

README.md

File metadata and controls

76 lines (51 loc) · 7.9 KB

Data Analysis Using Python: A Beginner’s Guide Featuring NYC Open Data

Mark Bauer
YouTube Video Views

Table of Contents

1. Introduction

NYC Open Data provides a treasure-trove of information - all publicly available with a click of a button. While having access to data is great, its analysis is often a difficult process for beginners, potentially creating barriers in one's open data journey. Additionally, performing data analysis in a reproducible way is often limited or even discarded altogether.

Data Analysis Using Python: A Beginner’s Guide Featuring NYC Open Data is a four-part series as listed in the sections below. These collection of notebooks serve as references/user guides for how to apply Python to real-world Data Analysis projects. The repository features notebooks that will utilize the Python programming language and datasets from NYC Open Data. This series exemplifies how data analytics can be used for discovering useful information and supporting decision-making.

Sections include:

Part 1: Reading and Writing Files in Python.

Part 2: Data Inspection, Cleaning, and Wrangling in Python.

Part 3: Plotting and Data Visualization in Python.

Part 4: Geospatial Data and Mapping.

You can run an interactive example on MyBinder through your browser - no installation required: click here Binder. Loading MyBinder is a bit slow and takes ~5 minutes, but it will load eventually.

2. Notebooks

You can view these notebooks through your browser by clicking View under the Static Webpage column.

File Name Description Static Webpage
1_reading_writing_files.ipynb Reading and Writing Files. View
2_data_inspection_cleaning_wrangling.ipynb Data Inspection, Cleaning, and Wrangling. View
3_plotting_visualizations.ipynb Plotting and Data Visualization. View
4_geospatial_data_mapping.ipynb Geospatial Data and Mapping. View

3. Data

Dataset Description
Building Footprints Shapefile of footprint outlines of buildings in New York City.
MapPLUTO MapPLUTO merges PLUTO tax lot data with tax lot features from the Department of Finance’s Digital Tax Map (DTM) and is available as shoreline clipped and water included. It contains extensive land use and geographic data at the tax lot level in ESRI shapefile and File Geodatabase formats.
Schools This is an ESRI shape file of school point locations based on the official address. It includes some additional basic and pertinent information needed to link to other data sources. It also includes some basic school information such as Name, Address, Principal, and Principal’s contact information.
Streets The NYC Street Centerline (CSCL) is a road-bed representation of New York City streets containing address ranges and other information such as traffic directions, road types, segment types.
Neighborhood Tabulation Areas (NTA) Boundaries of Neighborhood Tabulation Areas as created by the NYC Department of City Planning using whole census tracts from the 2010 Census as building blocks. These aggregations of census tracts are subsets of New York City's 55 Public Use Microdata Areas (PUMAs).
NYC Boroughs GIS data: Boundaries of Boroughs (water areas excluded).

4. Open Source Applications Used in Project

  • Anaconda: A distribution of the Python and R programming languages for scientific computing (data science, machine learning applications, large-scale data processing, predictive analytics, etc.), that aims to simplify package management and deployment.
  • Project Jupyter: Project Jupyter is a non-profit, open-source project, born out of the IPython Project in 2014 as it evolved to support interactive data science and scientific computing across all programming languages.
    • Jupyter Notebook: The Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text.
    • nbviewer: A web application that lets you enter the URL of a Jupyter Notebook file, renders that notebook as a static HTML web page, and gives you a stable link to that page which you can share with others.
    • Binder: The Binder Project is an open community that makes it possible to create sharable, interactive, reproducible environments.

5. Additional Resources

Say Hello!

I can be reached at:

Twitter: markbauerwater
LinkedIn: markebauer
GitHub: mebauer