search

Josephrp / scitonic

👩🏻‍🔬🧪SciTonic is a highly adaptive technical operator of agents that can produce complexe analyses on technical data with high performance & on-the-fly . You can ask it what you want and it will respond with quality everytime.
https://www.tonic-ai.com
MIT License
49 stars 5 forks source link

test embeddings models using tonic-ai #1

Closed Josephrp closed 10 months ago

Josephrp commented 10 months ago

this issue should produce src/rag , standalone rag retrieval app used for evaluation by tonic-ai .

the embeddings model is hosted here : https://huggingface.co/tonic1/e5 and https://huggingface.co/tonic1/e5

we can change everything about this app to simplify it for example directly using gradio api calls with a simply tonic ai thing...

Josephrp commented 10 months ago 
        'ArguAna': 'Given a claim, find documents that refute the claim',
        'ClimateFEVER': 'Given a claim about climate change, retrieve documents that support or refute the claim',
        'DBPedia': 'Given a query, retrieve relevant entity descriptions from DBPedia',
        'FEVER': 'Given a claim, retrieve documents that support or refute the claim',
        'FiQA2018': 'Given a financial question, retrieve user replies that best answer the question',
        'HotpotQA': 'Given a multi-hop question, retrieve documents that can help answer the question',
        'MSMARCO': 'Given a web search query, retrieve relevant passages that answer the query',
        'NFCorpus': 'Given a question, retrieve relevant documents that best answer the question',
        'NQ': 'Given a question, retrieve Wikipedia passages that answer the question',
        'QuoraRetrieval': 'Given a question, retrieve questions that are semantically equivalent to the given question',
        'SCIDOCS': 'Given a scientific paper title, retrieve paper abstracts that are cited by the given paper',
        'SciFact': 'Given a scientific claim, retrieve documents that support or refute the claim',
        'Touche2020': 'Given a question, retrieve detailed and persuasive arguments that answer the question',
        'TRECCOVID': 'Given a query on COVID-19, retrieve documents that answer the query',