Research how to use different models from hugging face to perform question answering task

aaroosh-07 / bons.ai

0 stars 0 forks source link

Research how to use different models from hugging face to perform question answering task #1

Closed aaroosh-07 closed 2 months ago

aaroosh-07 commented 2 months ago

Description

The app needs to use AI models to power the interactions. Since we will be unable to host any models we should utilise prehosted models. One option is HuggingFace or OpenAI.

Coversations to resolve

[x] Which models are available on HuggingFace as hosted and ready for inference?
[x] Which platform would be cheaper?

Acceptance criteria

[ ] Model provider is selected
[ ] Prototype small script demonstrating communication with the model provider to prompt a model

aaroosh-07 commented 2 months ago

I found these models on hugging face which are ready for inference via HTTP API call and will not be billed till 10K requests.

distilbert/distilbert-base-cased-distilled-squad
deepset/roberta-base-squad2
google-bert/bert-large-uncased-whole-word-masking-finetuned-squad
ahotrod/electra_large_discriminator_squad2_512