1. Change the default values inside 'settings.py'.
2. Run the crawler using ant of these 2 command line options:
* Scheduled Job:
python crawler_job.py --s #This option will run the crawler as an "scheduled" job. The crawler will wait for the right schedule time set on the 'settings.py' everyday before it begin crawling.
* Unscheduled Job:
python crawler_job.py --u #This option will run the crawler as an "unscheduled" job. The crawler will immediately run after entering the command.
forked from popstick/facebook-page-post-scraper
-
Notifications
You must be signed in to change notification settings - Fork 0
ezaratemx/facebook-page-post-scraper
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
Data scraper for Facebook Pages, and also code accompanying the blog post How to Scrape Data From Facebook Page Posts for Statistical Analysis. Added MySQL support
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published
Languages
- Python 100.0%