search

dusty-nv / jetson-containers

Machine Learning Containers for NVIDIA Jetson and JetPack-L4T
MIT License
2.36k stars 481 forks source link

New Sota Open Source model LLM #619

Closed johnnynunez closed 2 months ago

johnnynunez commented 2 months ago

https://huggingface.co/mattshumer/Reflection-70B https://x.com/mattshumer_/status/1831767014341538166

johnnynunez commented 2 months ago

new link: https://huggingface.co/mattshumer/Reflection-Llama-3.1-70B

dusty-nv commented 2 months ago

@johnnynunez this is a fine-tune of Llama-70B and should work though the existing quantization tools for deployment 👍