Looking both at foundation and instruction tuning models. For this project, the latter is probably going to be the only target, as it would probably work better.
Falcon: https://huggingface.co/tiiuae/falcon-40b (both base model and instruction tuned). Note that there is also a 7b instruction-tuned and a 7b version (on HuggingFace)
see #51: at the end of the whole process, we might want to:
update this with the models we are actually using
reconsider our current choices (e.g., is using LLaMaChat & Mistral Instruct fair? do we want to include more models?) on the basis of an updated picture of the LLM landscape.
This should be done at the end of the project though, not before - too many new models all the time!
Looking both at foundation and instruction tuning models. For this project, the latter is probably going to be the only target, as it would probably work better.
Available
Maybe for later Not open-source