Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add some requested sites #96

Merged
merged 5 commits into from
May 24, 2024
Merged

Add some requested sites #96

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
89b15ee
feat(scrapper): add joinef posts scrapper
ricardofelgueiras May 24, 2024
76f02dd
feat(scrapper): add joinef portfolio scrapper
ricardofelgueiras May 24, 2024
5915b53
feat(scrapper): add notion templates
ricardofelgueiras May 24, 2024
b5b1743
feat(scraper): add milanuncios scraper
ricardofelgueiras May 24, 2024
0a29027
feat(scraper): add vrbo.com scraper
ricardofelgueiras May 24, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 19 additions & 0 deletions src/scrappers/joinef-portfolio.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
url: 'https://www.joinef.com/portfolio/*'
header: Portfolio
listElementsQuery: .tile--company--row
elementParser:
- title: Name
query: .tile__name
type: text

- title: Description
query: .tile__description
type: text

- title: Tags
query: .tile__tags
type: text

- title: Link
query: .tile__link
type: link
15 changes: 15 additions & 0 deletions src/scrappers/joinef-posts.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
url: 'https://www.joinef.com/posts/'
header: Posts
listElementsQuery: article
elementParser:
- title: Title
query: .tile__link
type: text

- title: Categories
query: .tile__categories
type: text

- title: Link
query: .tile__link
type: link
22 changes: 22 additions & 0 deletions src/scrappers/milanuncios.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
url: https://www.milanuncios.com/*
listElementsQuery: article
elementParser:
- title: Title
query: .ma-AdCardListingV2-TitleLink
type: text

- title: Price
query: .ma-AdPrice-value
type: text

- titlte: Address
query: .ma-AdLocation-text
type: text

- title: Details
query: .ma-AdCardV2-description
type: text

- title: Link
query: .ma-AdCardListingV2-TitleLink
type: link
15 changes: 15 additions & 0 deletions src/scrappers/notion.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
url: https://www.notion.so*
header: Templates
listElementsQuery: .template-grid > section
elementParser:
- title: Title
query: '[class*="UserBaseInfo_textInfoContainer"]'
type: text

- title: Userbase rights
query: '[class*="templatePreview_userBaseRight"]'
type: text

- title: Link
query: '[class*="DynamicModal_trigger"]'
type: link
18 changes: 18 additions & 0 deletions src/scrappers/vrbo.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
url: https://www.vrbo.com*
listElementsQuery: '[data-stid="lodging-card-responsive"]'
elementParser:
- title: Title
query: h3.uitk-heading
type: text

- title: Description
query: .uitk-text
type: text

- title: Price information
query: '[data-test-id="price-summary"]'
type: text

- title: Link
query: '[data-stid="open-hotel-information"]'
type: link
Loading