Skip to content

carloalbe/pytipeee

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Pytipeee

Pytipeee is an unofficial scraper for tipeee.com using python. Codes are hosted in this repository, Thanks to Pytipeee you are able to:

  • Collect large amounts of creators by category
  • see infromation for each creator
  • read comments
  • see news
  • get tipper and tips

Installation

To install you can use pip by terminal:

pip install pytipeee

Usage

Import

import pytipeee as pt

Categories

Different categories are available.

pt.show_categories()
other
bd-illustration
movies
food
geek
video-game
humour
journalism
books
fashion
music
photography
science-technology
performing-arts
sports
vlog
streaming

Creators Collection

You can collect a defined number of creators filtering by category... by default the class Creators collect all creator of all categories.

creators = pt.Creators()          #Initialize the class
creators.scrape(100,'vlog')       #scrape the site using a limit of creatros to collect ans a category 
                                  #transform each scraped in a Creator element
df = creators.to_dataframe()      #return a pandas dataframe
df.head()
username lang categories tipperAmount tipperNumber newsNumber num_comments num_goals num_rewards subsciption
id
258359 theoloji en {vlog, podcast} 185 5 False None None None 2020-09-24 23:13:20
234038 mountainsandcoconuts en {vlog, nature} 15 2 False None None None 2020-01-05 19:49:18
136967 antoine-le-guen en {vlog} 150 1 8 None None None False
249220 1upcrew en {art-culture, vlog} 0 1 False None None None 2020-06-02 11:19:38
150377 partager-cest-sympa fr {vlog, humour} 10204 1607 56 None None None 2017-10-31 15:00:03

Some attributes are missing in the data collect for the moment... you can fill those field creator by creator...

creator = creators.creators[3]
creator.more_info()
df = creators.to_dataframe()      
df.head()
username lang categories tipperAmount tipperNumber newsNumber num_comments num_goals num_rewards subsciption
id
258359 theoloji en {vlog, podcast} 185 5 False None None None 2020-09-24 23:13:20
234038 mountainsandcoconuts en {vlog, nature} 15 2 False None None None 2020-01-05 19:49:18
136967 antoine-le-guen en {vlog} 150 1 8 None None None False
249220 1upcrew en {art-culture, vlog} 0 1 False 11 0 1 2020-06-02 11:19:38
150377 partager-cest-sympa fr {vlog, humour} 10204 1607 56 None None None 2017-10-31 15:00:03

Comments

You can display in a fancy way comments that a creator received

creator = creators.creators[50]
for comment in creator.get_comments()[:5]: print(comment)
 1mvictoria-9
_____________________________________
Merci Laeticia!


 1mteddy-11
_____________________________________
❤️❤️ merci pour tes vidéos et courage à toi et aux brésiliens pour ces temps difficiles


 1mstephanie-henrionn
_____________________________________
Merci d'avoir organisé cette collecte et surtout de monter tout en haut de Rocinha pour distribuer de quoi manger à ceux et celles qui en ont le plus besoin. Merci et bravo


 1mcyn-3
_____________________________________
J’envoie mon aide et tout mon amour au Brésil


 1msarah-226
_____________________________________
Un petit geste pour moi, qui fait la différence pour ces familles brésiliennes.... Avec beaucoup d`amour

News

Collect the title for all the news / projects updated by a creator

creator.get_news()
['Un cadeau un peu Spécial',
 'VIDEO SURPRISE (qui parle de poils et de mounette!)',
 'Une vidéo juste pour vous!',
 'Une Vidéos avant sa Sortie',
 'La Vidéo :)',
 'Vidéo Juste pour Vous',
 'Mille Merci!']

Tippers

Access to the users that donate tips to the author...

creator.get_tippers()
[debris-58cd,
 romane-11,
 g111826957486368441236,
 f-florence-5a9d0c,
 sarah-110,
 f-marion-591595,
 ryalou-ros,
 shany,
 carole-amelin,
 f10153713871571985,
 claire-aline,
 flore-5b70,
 g114412240751960374835,
 steph-gr,
 tropical-piou,
 masset-3]

N.B. Only Signed users appears in the search

Scrape a single creator

If you want information about a specific creator you noly need to set up the Creator class using the username.

rm = pt.Creator('roberto-mercadini')
rm.visit()  #visit the tipeee page of the creator
rm.to_dict()
{'id': 268882,
 'username': 'roberto-mercadini',
 'lang': 'it',
 'tipperAmount': 0,
 'tipperNumber': '613',
 'newsNumber': '1',
 'subsciption': '2021-02-11 09:52:40',
 'categories': {'art-culture'},
 'num_comments': 129,
 'num_goals': 0,
 'num_rewards': 6}

LICENSE

Copyright (c) 2021 Carlo Alberto Carrucciu

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

About

Python scraper for tipeee

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages