search

aaroosh-07 / bons.ai

0 stars 0 forks source link

Creates API endpoint to prompt LLM models #10

Closed aaroosh-07 closed 2 months ago

aaroosh-07 commented 2 months ago

This PR creates API endpoint using FastAPI to prompt LLM models. the endpoint is /prompt and following json data needs to be sent as request body.

{
    "context": text
    "question": text
    "model": text
}

model can have these 4 possible vaules distilbert-base-cased roberta-base-squad2 google-bert electra_large_discriminator