Update ppl_dataset.py with trust_remote_code

horseee / LLM-Pruner

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

https://arxiv.org/abs/2305.11627

Apache License 2.0

880 stars 106 forks source link

Update ppl_dataset.py with trust_remote_code #70

Closed manickavela29 closed 1 month ago

manickavela29 commented 3 months ago

-- Convenient use while downloading dataset

manickavela29 commented 2 months ago

@VainF @horseee