Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Github Pages Connector #2282

Open
Weves opened this issue Aug 31, 2024 · 14 comments · May be fixed by #3411
Open

Github Pages Connector #2282

Weves opened this issue Aug 31, 2024 · 14 comments · May be fixed by #3411
Labels
💎 Bounty maintainer approved Maintainer has approved this feature/fix/request. Contributors feel free to take it up.

Comments

@Weves
Copy link
Contributor

Weves commented Aug 31, 2024

Indexes all pages that are part of a Github Pages-based website. Should use the Github APIs directly, as we want to be able to index sites that are behind authentication / internal firewalls. Where possible, we should re-use functionality / common utilities present in the existing Github / Web connectors.

Checkout the connector creation README here for more details on the best way to add new connectors: https://github.com/danswer-ai/danswer/blob/main/backend/danswer/connectors/README.md.
@Weves Weves added the maintainer approved Maintainer has approved this feature/fix/request. Contributors feel free to take it up. label Aug 31, 2024
@Weves
Copy link
Contributor Author

Weves commented Aug 31, 2024

/bounty 250

@algora-pbc Algora PBC
Copy link

algora-pbc bot commented Aug 31, 2024 •
edited
Loading

💎 $250 bounty • Onyx (YC W24)

Steps to solve:

  1. Start working: Comment /attempt #2282 with your implementation plan
  2. Submit work: Create a pull request including /claim #2282 in the PR body to claim the bounty
  3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

Thank you for contributing to onyx-dot-app/onyx!

Add a bounty • Share on socials

Attempt Started (GMT+0) Solution
🟢 @Myestery Aug 31, 2024, 12:32:30 AM WIP
🟢 @PlanetKumbhaj Aug 31, 2024, 9:11:36 AM WIP
🟢 @webbdays Sep 1, 2024, 1:32:37 PM WIP
🔴 @ashish111333 Sep 7, 2024, 9:47:18 AM WIP
🟢 @techsouvik Sep 10, 2024, 7:18:57 PM WIP
🔴 @Rutik7066 Oct 26, 2024, 12:14:23 PM WIP
🟢 @Haroldg1020 Dec 13, 2024, 3:57:55 PM WIP
🟢 @akhilender-bongirwar #3411

@Weves
Copy link
Contributor Author

Weves commented Aug 31, 2024

Note on the above: please check the Before opening PR section in the Connector README for additional requirements (testing + style)!

@Myestery
Copy link

Myestery commented Aug 31, 2024 •
edited by algora-pbc bot
Loading

/attempt #2282

Algora profile Completed bounties Tech Active attempts Options
@Myestery 1 bounty from 1 project
MDX, TypeScript,
CSS
Cancel attempt

@thekumbhaj
Copy link

thekumbhaj commented Aug 31, 2024 •
edited by algora-pbc bot
Loading

/attempt #2282

Options

@webbdays
Copy link

webbdays commented Sep 1, 2024 •
edited by algora-pbc bot
Loading

/attempt #2282

Algora profile Completed bounties Tech Active attempts Options
@webbdays 4 bounties from 1 project
Python, Rust,
HTML & more
Cancel attempt

@webbdays
Copy link

webbdays commented Sep 1, 2024

@Weves
After some research.
found this => https://github.com/orgs/community/discussions/59659

@webbdays
Copy link

webbdays commented Sep 1, 2024

But if the user can provide the github pages repo.
we can get the repo content (i.e page contents)via github api.

@ashish111333
Copy link

@Weves ok how do we start ,do you need to be assigned to work on this or we can just submit our PR?

@ashish111333
Copy link

ashish111333 commented Sep 7, 2024 •
edited by algora-pbc bot
Loading

/attempt #2282

Options

1 similar comment
@techsouvik
Copy link

techsouvik commented Sep 10, 2024 •
edited by algora-pbc bot
Loading

/attempt #2282

Options

techsouvik added a commit to techsouvik/danswer that referenced this issue Sep 11, 2024
@techsouvik
onyx-dot-app#2282 fixed
fab0bd9
@techsouvik techsouvik mentioned this issue Sep 11, 2024
Closed
techsouvik added a commit to techsouvik/danswer that referenced this issue Sep 12, 2024
@techsouvik
onyx-dot-app#2282 fixed New Connector Added
5e7274c
@techsouvik techsouvik mentioned this issue Sep 12, 2024
Closed
@aadarsh-nagrath
Copy link

status ?

@Rutik7066
Copy link
Contributor

Rutik7066 commented Oct 26, 2024 •
edited by algora-pbc bot
Loading

/attempt #2282

Algora profile Completed bounties Tech Active attempts Options
@Rutik7066    2 danswer-ai bounties
+ 8 bounties from 6 projects
Go, Rust,
Python & more
Cancel attempt

Closed
1 task
@akhilender-bongirwar akhilender-bongirwar linked a pull request Dec 10, 2024 that will close this issue
Open
1 task
@Haroldg1020
Copy link

Haroldg1020 commented Dec 13, 2024 •
edited by algora-pbc bot
Loading

/attempt #2282

Options

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
💎 Bounty maintainer approved Maintainer has approved this feature/fix/request. Contributors feel free to take it up.
Projects
None yet
Milestone
No milestone
9 participants
@Weves @Myestery @webbdays @Rutik7066 @techsouvik @aadarsh-nagrath @thekumbhaj @ashish111333 @Haroldg1020