Skip to content
This repository has been archived by the owner on Apr 6, 2021. It is now read-only.

Fix data scraping code #11

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

MoazMansour
Copy link

Scrape the right table and get the data from the right positions to update the tables

@MoazMansour
Copy link
Author

The old code with pointing at the wrong table id so it was basically collecting nothing. The API is producing the same set of figures on daily basis. The links list was always empty and the stately list actually included all the states and case data.
I fixed the code to collect from the right table and parse the data correctly into the pandas df. I left the CSV and SQL storage lines as is.

@Mastersam07 Mastersam07 self-assigned this Jul 6, 2020
@Mastersam07 Mastersam07 added the bug-fix fixes bugs label Jul 6, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug-fix fixes bugs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants