Collecting data from the Barcelona City Hall Open Data Service's on socioeconomic indicators of the territorial division of the city of Barcelona.
Here we are going to do:
- webscraping
- download cvs and pdf files
- Extracting information from pdf files using regular expressions
- and create a database with the information obtained.
Barcelona city council offers an open data service. The website is accessible to any user and the website also offers the possibility of downloading data or accessing the data through an API
For this project we are interested in having access to the data of socioeconomic indicators of the neighborhood territorial division of the city of Barcelona.
This website is an initiative in favor of open data, but it has notable limitations.
The official portal provides a poor interface for accessing the data, which, however, has great value for open and free access to the data.
- Access through a URL: To obtain the socio-economic information of the neighborhoods, we have to go one by one by clicking on the link provided on the website. This link allows us to download a pdf file with the information we need.
- Data cannot be compared: As the data for each neighborhood are in pdf files there is no way to compare each of the neighborhoods. Besides, there is no table that gathers all this information.
please note that 2008 data are not available.
can we get the information, collect it and organize it in a better way?
So that we can then make comparisons and analysis about the different neighborhoods of the city of Barcelona using these socio-economic indicators.
- Webscraping to get the urls
- obtain the pdf files for each of the neighborhoods
- Extract indicators from pdf files
- Create a database with the extracted information
- Use the database to analyze the socio-economic indicators of the neighborhoods of the city of Barcelona.