MeetKai / functionary

Chat language model that can use tools and interpret the results
MIT License
1.43k stars 110 forks source link

GPU requirements for Deployement for all the models #261

Closed mayankopkey closed 2 months ago

mayankopkey commented 2 months ago

Hi It would be great if you cans hare the vram required for infrencing for each of the models you released.

QwertyJack commented 2 months ago

Does this help?

https://github.com/MeetKai/functionary?tab=readme-ov-file#models-available

jeffreymeetkai commented 2 months ago

Thanks @QwertyJack ! I will be closing this now.