Skip to content

Serverless web scraper that get reviews data from a registered place by using Puppeteer and intercepting requests to google reviews endpoint.

Notifications You must be signed in to change notification settings

gabrielforster/google-maps-reviews-scraping

Repository files navigation

Google maps reviews scraping

A simple project that scraps google maps reviews from registered places.

It uses webscraping with puppeteer to get to the reviews tab and intercept reviews requests. After intercept the reviews requests it sends the url and headers data to a endpoint that will fetch the reviews data and map to domain data and register on a postgres database.

System design

This system implements microservice architechture and uses serverless framework to deploy the infrastrcture by using AWS Cloudformation.

System architeture design

About

Serverless web scraper that get reviews data from a registered place by using Puppeteer and intercepting requests to google reviews endpoint.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published