feat: llama3.1 (TensorRT-LLM) - Githubissues

janhq / models

Models support in Jan and Cortex

MIT License

5 stars 2 forks source link

feat: llama3.1 (TensorRT-LLM) #27

Open 0xSage opened 2 months ago

0xSage commented 2 months ago

Goal

[ ] Support llama3.1 in main TensorRT-LLM engine formats
[ ] Upload to HF

User Requests

Desmond819 commented 1 month ago

any update on this?