can I use open source model like llama, mistral from huggingface ecosystem

[nps798]

as title. thanks

[2282588541a]

Hello, I attempt to solve this by using https://github.com/xusenlinzy/api-for-open-llm this project,but this project use openai.completion api and this response contains completion.choices[0].logprobs.I think most open LLM don't have api to give the answer for this parameter,So using the openllm project will return null for the logprobs.which will make mistake . So ,I think most open llm will not work well