search

hltcoe / sandle

Run a large language modeling SANDbox in your Local Environment
Other
7 stars 1 forks source link

LLaMA backend OOM after idling for a while, then trying to allocate >1 EB #86

Closed ccmaymay closed 1 year ago

ccmaymay commented 1 year ago

https://ccmaymay.sentry.io/issues/3989159114/?project=6619116&query=is%3Aunresolved&referrer=issue-stream um

ccmaymay commented 1 year ago

looks to be an issue with the broadcast

ccmaymay commented 1 year ago

Likely a special case of #87, closing.