search

microsoft / DeepSpeedExamples

Example models using DeepSpeed
Apache License 2.0
5.83k stars 990 forks source link

can not run the test-gpt.sh because of assertionError #902

Open leachee99 opened 1 month ago

leachee99 commented 1 month ago

hi, I meet a problem when I run the DeepSpeedExamples/inference/huggingface/text-generation/run-generation-script/test-gpt.sh.

The error is :

assert not config.replace_with_kernel_inject, "Cannot use both user specified injection policy and kernel injection"
AssertionError: Cannot use both user specified injection policy and kernel injection

How can I solve this problem? Thanks