Update LocalLLM class to fetch params from running server

joachim-gassen / botex

Use LLMs as participants in oTree experiments

MIT License

7 stars 1 forks source link

Update LocalLLM class to fetch params from running server #11

Closed fedossa closed 2 months ago

fedossa commented 2 months ago

The LocalLLM class is updated to fetch the different params of the LLM from a running llama cpp server. The corresponding test is also updated to reflect this.