yaojin17 Unlearning_LLM issues - Githubissues

yaojin17 / Unlearning_LLM

[ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"

MIT License

47 stars 2 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

How much video memory is needed for this experiment？

#9 carbonatedbeverages opened 2 weeks ago
1
Cannot import name 'UnencryptedCookieSessionFactoryConfig' from 'pyramid.session' (unknown location) when run “run_unlearn.py --target_model_name_or_path ../../models/Yi-6B --per_device_train_batch_size 1 --do_unlearn --output_dir ./output --overwrite_output_dir --num_train_epochs 1 --logging_steps 1 --learning_rate 2e-5 --warmup_ratio 0.03 --overwrite_cache --save_total_limit 1 --fsdp "full_shard auto_wrap" --fsdp_transformer_layer_cls_to_wrap 'LlamaDecoderLayer' --bf16 True --tf32 True --weight_decay 0. --lr_scheduler_type "cosine" --domain github --gradient_accumulation_steps 85 --unlearn_method gradient_ascent “

#8 IMoonKeyBoy opened 1 month ago
6
The new version of Pytorch needs to specify the tensor location

#7 qzc438 opened 3 months ago
3
Question about the performance on downstream tasks.

#6 tbozhong closed 6 months ago
4
Question about train/val split.

#5 tbozhong closed 7 months ago
2
License detail missing

#4 rggithub7 closed 7 months ago
1
Is unlearned model weights available?

#3 zjysteven closed 7 months ago
4
when the full codel will be released?

#2 FightingFighting closed 7 months ago
1
When will the full code be released?

#1 skykiseki closed 7 months ago
3