Add Ragatouille Retriever API

ChakshuGautam commented 9 months ago

Description

Need to be able to deploy Colbert on a server such that one can update index in it using an API call.

Current State

We are able to deploy ColBERT locally using RAGAtoullie in our local systems. Our current vector DB setup is PGvector.

Implementation Details

We want to be able to setup RAGAtoullie/COLBERT on a server such that content can be retrieved quickly.
It should be able to do the following :

Be able to contain multiple indexes (I want to index the headings separately and content separately etc)
Be able to update any index through an API
Be able to run search on any of the index and get retrieved doc, index and , index-number through an API
Contributors can raise PRs such that it works as an API service, can add as a separate folder COLBERT to ai-tools/src/search/...

Product Name

AI Tools

Organization Name

SamagraX

Domain

NA

Tech Skills Needed

Pytorch/ Python, ML

Mentor(s)

@ChakshuGautam

Complexity

Low

c4gt-community-support[bot] commented 9 months ago

Hi! Important Details - These following details are helpful for contributors to effectively identify and contribute to tickets.

Sub-Category - Please mention the sub-category if any for the ticket

Please update the ticket

J0SAL commented 9 months ago

I would like to work on this issue @ChakshuGautam

Shruti3004 commented 9 months ago

Hey @J0SAL, yes sure. Assigning the ticket to you.

Ayushmaan06 commented 9 months ago

I would love to work on the issue.

kartikf4 commented 9 months ago

by server you meant cloud server right?

ChakshuGautam commented 9 months ago

@kartikf4 see the other modules in ai-tools. Example - https://github.com/Samagra-Development/ai-tools/tree/restructure/src/llm/openai/chatgpt3. It's an independent module that we add.

J0SAL commented 9 months ago

Hi @Shruti3004, can you assign it to someone else, as i won't be able to make it

masterismail commented 9 months ago

hey ! the link mentioned (https://llamahub.ai/l/llama_packs-ragatouille_retriever?from=llama_packs) gives a 404.

Gautam-Rajeev commented 9 months ago

hey ! the link mentioned (https://llamahub.ai/l/llama_packs-ragatouille_retriever?from=llama_packs) gives a 404.

You can use any implementation of RAGAToullie or ColBERT directly

vandit98 commented 8 months ago

hi @Shruti3004 @ChakshuGautam @GautamR-Samagra I am interested in this project. I have experience in building API endpoints via Fastapi , RAG pipelines, and vector databases. Can you assign this ticket to me. Also, details on the current state of the project will be appreciated. I have also gone through the RAGatouille, i will soon share the project implementation plan. Thank you.

Sanika-k-1317 commented 8 months ago

Hello @ChakshuGautam @Shruti3004 @GautamR-Samagra I am interested to contribute in this project. I have experience working with Pytorch. Please let me know how to connect with you for further discussion. Also could you please assign the ticket to me?

Gautam-Rajeev commented 8 months ago

Have also added COlbert to ai-tools myself here to allow to run on a collab through that.

Has a few issues :

unable to setup on Azure yet because of cuda issues. If it can be setup within Docker by someone, that would be immensely useful.
updating the created index with new sentence
set up fine-tuning the model based on new question-answer pairs

Sohajawdekar commented 8 months ago

Hey @ChakshuGautam @Shruti3004 @GautamR-Samagra ! I am interested in contributing to this project, and working on the prerequisites. Could you please assign this issue to me ?

Gautam-Rajeev commented 8 months ago

Hi @Sohajawdekar , this has been picked up and completed by @takshpanchal

Gautam-Rajeev commented 8 months ago

@takshpanchal do tag the pr raised finally here

Samagra-Development / ai-tools