horseee / LLM-Pruner

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.
https://arxiv.org/abs/2305.11627
Apache License 2.0
880 stars 106 forks source link

在加载bookcorpus的过程中,builder_cls为None #85

Open Charlly-D opened 1 week ago

Charlly-D commented 1 week ago

在 traindata = load_dataset( 'bookcorpus', split='train' ) 的这一步中, builder_cls = get_dataset_builder_class(dataset_module, dataset_name=dataset_name)得到的builder_cls为None, 所以报错 builder_instance: DatasetBuilder = builder_cls( TypeError: 'NoneType' object is not callable