Skip to content

TweetScraper is a Scrapy crawler/spider for Twitter Search without using API

License

Notifications You must be signed in to change notification settings

tobecwb/TweetScraper

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

45 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Introduction

This is a fork of TweetScraper, with some aditional features, like:

  • Possibility to save all tweets on a single file (.ji format);
  • Save datetime of tweet as datetime field when using MongoDB Pipeline;
  • Additional Index on MongoDB;
  • Option to ignore or update existing data when using MongoDB Pipeline;

Future features

  • Get extra info about the Twitter User (like total retweets, followers, etc);
  • Get extra info about Tweet (like if used emoticons);
  • Download media files (gifs, images, videos);

Read the TweetScraper official documentation to know how to install and use this;

About

TweetScraper is a Scrapy crawler/spider for Twitter Search without using API

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%