search

MeetKai / functionary

Chat language model that can use tools and interpret the results
MIT License
1.37k stars 107 forks source link

GPU requirements for Deployement for all the models #261

Closed mayankopkey closed 1 month ago

mayankopkey commented 1 month ago

Hi It would be great if you cans hare the vram required for infrencing for each of the models you released.

QwertyJack commented 1 month ago

Does this help?

https://github.com/MeetKai/functionary?tab=readme-ov-file#models-available

jeffreymeetkai commented 1 month ago

Thanks @QwertyJack ! I will be closing this now.