GitHub - slovak-egov/CRZ-scraper: Web scraping and filtering code for slovak contract database - crz.gov.sk. The code downloads XML databases, creates a CSV database of contracts, filters them, downloads the files, extracts and cleans up tables with MD rates.

slovak-egov / CRZ-scraper Public

Notifications You must be signed in to change notification settings
Fork 2
Star 5

Web scraping and filtering code for slovak contract database - crz.gov.sk. The code downloads XML databases, creates a CSV database of contracts, filters them, downloads the files, extracts and cleans up tables with MD rates.

5 stars 2 forks Branches Tags Activity

Star

Notifications

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 12 Commits
Dicts		Dicts
00_download_CRZ_DB.py		00_download_CRZ_DB.py
01_build_supplements_DB.py		01_build_supplements_DB.py
01_crawl_supplemental_agreements.py		01_crawl_supplemental_agreements.py
01_parse_xml.py		01_parse_xml.py
01_update_DB.py		01_update_DB.py
02_filter_by_CIN.py		02_filter_by_CIN.py
03_build_unrolled_DB.py		03_build_unrolled_DB.py
03_download_contracts.py		03_download_contracts.py
04_convert_contracts_to_text.py		04_convert_contracts_to_text.py
04_tag_text_contracts.py		04_tag_text_contracts.py
05_build_special_dictionary.py		05_build_special_dictionary.py
05_move_relevant.py		05_move_relevant.py
06_extract_tables.py		06_extract_tables.py
07_keyword_tag&filter_tables.py		07_keyword_tag&filter_tables.py
08_extract_subject.py		08_extract_subject.py
09_clean_tables.py		09_clean_tables.py
companies.csv		companies.csv
keywords.txt		keywords.txt
proxyhandler.py		proxyhandler.py
suggested_keywords.txt		suggested_keywords.txt