su77ungr / CASALIOY

♾️ toolkit for air-gapped LLMs on consumer-grade hardware
Apache License 2.0
230 stars 31 forks source link

Fix docker #92

Closed hippalectryon-0 closed 1 year ago

hippalectryon-0 commented 1 year ago

Note: the GPU docker image "works", but doesn't have gpu support yet, so no need to use it Note 2: as written in the readme we need to set --shm-size; a priori this only works on linux.