Closed kekePower closed 3 hours ago
@kekePower Could you kindly add these Hugging Face models to the constants file? Place them below the Qwen-32B-Instruct model. The models to add are:
Tested ,works
@kekePower Could you kindly add these Hugging Face models to the constants file? Place them below the Qwen-32B-Instruct model. The models to add are:
- Qwen/Qwen2.5-72B-Instruct
- meta-llama/Llama-3.1-70B-Instruct
- meta-llama/Llama-3.1-405B
We can do another PR for that. Honestly I wanted to invest in to dynamic loading of models better for number of reasons, so that we do not need to make such PRs at all
Sure, that sounds good. Yes, a dynamic approach is much better, especially with so many models and new places offering attractive pricing or even free options.
@kekePower Could you kindly add these Hugging Face models to the constants file? Place them below the Qwen-32B-Instruct model. The models to add are:
* Qwen/Qwen2.5-72B-Instruct * meta-llama/Llama-3.1-70B-Instruct * meta-llama/Llama-3.1-405B
Just saw that Google has updated their experimental model so I had to update it here as well.