danswer-ai / danswer

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.
https://danswer.ai
Other
10.83k stars 1.36k forks source link

Github Pages Connector #2282

Open Weves opened 3 months ago

Weves commented 3 months ago

Indexes all pages that are part of a Github Pages-based website. Should use the Github APIs directly, as we want to be able to index sites that are behind authentication / internal firewalls. Where possible, we should re-use functionality / common utilities present in the existing Github / Web connectors.

Checkout the connector creation README here for more details on the best way to add new connectors: https://github.com/danswer-ai/danswer/blob/main/backend/danswer/connectors/README.md.

Weves commented 3 months ago

/bounty 250

algora-pbc[bot] commented 3 months ago

💎 $250 bounty • Danswer AI (YC W24)

Steps to solve:

  1. Start working: Comment /attempt #2282 with your implementation plan
  2. Submit work: Create a pull request including /claim #2282 in the PR body to claim the bounty
  3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

Thank you for contributing to danswer-ai/danswer!

Add a bounty • Share on socials

Attempt Started (GMT+0) Solution
🟢 @Myestery Aug 31, 2024, 12:32:30 AM WIP
🟢 @PlanetKumbhaj Aug 31, 2024, 9:11:36 AM WIP
🟢 @webbdays Sep 1, 2024, 1:32:37 PM WIP
🔴 @ashish111333 Sep 7, 2024, 9:47:18 AM WIP
🟢 @techsouvik Sep 10, 2024, 7:18:57 PM #2412
🔴 @Rutik7066 Oct 26, 2024, 12:14:23 PM WIP
🟢 @akhilender-bongirwar #3009
Weves commented 3 months ago

Note on the above: please check the Before opening PR section in the Connector README for additional requirements (testing + style)!

Myestery commented 3 months ago

/attempt #2282

Algora profile Completed bounties Tech Active attempts Options
@Myestery 1 bounty from 1 project
MDX, TypeScript,
CSS
Cancel attempt
thekumbhaj commented 3 months ago

/attempt #2282

webbdays commented 3 months ago

/attempt #2282

Algora profile Completed bounties Tech Active attempts Options
@webbdays 4 bounties from 1 project
Python, Rust,
HTML & more
Cancel attempt
webbdays commented 3 months ago

@Weves After some research. found this => https://github.com/orgs/community/discussions/59659

webbdays commented 3 months ago

But if the user can provide the github pages repo. we can get the repo content (i.e page contents)via github api.

ashish111333 commented 2 months ago

@Weves ok how do we start ,do you need to be assigned to work on this or we can just submit our PR?

ashish111333 commented 2 months ago

/attempt #2282

techsouvik commented 2 months ago

/attempt #2282

algora-pbc[bot] commented 2 months ago

💡 @techsouvik submitted a pull request that claims the bounty. You can visit your bounty board to reward.

aadarsh-nagrath commented 1 month ago

status ?

Rutik7066 commented 1 month ago

/attempt #2282

Algora profile Completed bounties Tech Active attempts Options
@Rutik7066    2 danswer-ai bounties
+ 8 bounties from 6 projects
Go, Rust,
Python & more
Cancel attempt