Skip to content

jacknormand/TFRRS-TopQualifer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

21 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Overview

A python program that grabs select data from TFRRS.com (online track & field database) and stores in a PostgresSQL database. A database.ini file is used to read in credentials. Collects the top 100 marks for each event for a given range of indoor/outdoor seasons (startyear-endyear). Ranges from 2012 to current marks. Formats and stores rows in a very functional format. BeauitfulSoup and PostgreSQL used. Loading animation and progress bar shown below. Also has several mechanisms for preventing invalid rows (runs queries to remove errors and skips over bad data).

running

Usage

'python3 scrape.py 2012 2024'
Supports scraping just one year also, just make startyear = endyear
ONLY WORKS FROM 2012-ON

Disclaimer

This project is for educational purposes only. Please do not use irresponsibly.

About

A data collection program for college track

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages