search

jay-joshy / question_cli

0 stars 0 forks source link

Finalize models used LLM - J #2

Open jay-joshy opened 3 months ago

jay-joshy commented 3 months ago

OpenAI 3.5 and 4o are included. However, many open-source alternative LLMs exist too.

TODO: decide which open-source alternatives to use.

jay-joshy commented 2 months ago

Re: open source, based on the Huggingface LLM benchmarks: phi3:medium gemma2:latest qwen2:latest mistral-nemo:latest llama3.1:latest

Are all fine options. Based on preliminary testing would likely prefer: mistral-nemo, llama3, phi3 If we include a lot of open source models data generation may take quite long