search

randaller / llama-chat

Chat with Meta's LLaMA models at home made easy
GNU General Public License v3.0
833 stars 118 forks source link

OOM with 64G ram and 13B model #10

Closed dunkean closed 1 year ago

dunkean commented 1 year ago

Is this memory print normal ? I hoped at least the 13B model could work ?

randaller commented 1 year ago

@dunkean try to increase swap file size a bit

dunkean commented 1 year ago

Thank you ! problem solved.