kevinyaobytedance / llm_unlearn

LLM Unlearning
MIT License
99 stars 13 forks source link

OOM on larger models #1

Open fuzzall opened 8 months ago

fuzzall commented 8 months ago

Hi Authors,

Thank you for sharing your code! However, I run into an OOM error on larger models (such as Llama-7b or Vicuna-7b). I am using 80G A-100 GPUs. Could you share your configurations on these models? Thank you!

JaiDoshi commented 5 months ago

Were you able to resolve this?