Skip to content

This is the source code for the Metacritic scraper developed on my YouTube channel.

Notifications You must be signed in to change notification settings

Benjamixs/scraper

 
 

Repository files navigation

Metacritic Scraper

This is the source code for the Metacritic scraper developed on my YouTube channel.

The scraper scrapes the data of all the video games listed on metacritic.com until February 2024 (more than 13k games), it gets the name, description, developer, genre, users score, users reviews, critics score, and critics review of every game and exports them in a CSV file.

Instructions to run the scraper

  1. Make sure you have at least the Python 3.8 version installed in your computer.
  2. Clone this repo.
  3. Got to the folder and create a Python virtual environment by using:
  • Windows and Linux: python -m venv venv
  • MacOS: python3 -m venv venv
  1. Activate the venv by using:
  • Windows: .\venv\Scripts\activate
  • Linux and MacOS: source venv/bin/activate
  1. Install the packages by using pip install -r requirements.txt.
  2. If you want you can run the script scrape-links.py by using python scrape-links.py to get the most updated links from Metacritic.
  3. Then you can tun the Jupyter Notebook metacritic_scraper.ipynb by opening it on a Jupyter server or by using the venv you created and Visual Studio Code.
  4. Enjoy!

About

This is the source code for the Metacritic scraper developed on my YouTube channel.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 90.4%
  • Python 9.6%