search

lyogavin / airllm

AirLLM 70B inference with single 4GB GPU
Apache License 2.0
5.09k stars 408 forks source link

CUDA Out of memory RTX 4060TI 16G #175

Open 1272870698 opened 2 months ago

1272870698 commented 2 months ago

image