search

microsoft / DeepSpeedExamples

Example models using DeepSpeed
Apache License 2.0
6.1k stars 1.04k forks source link

can not run the test-gpt.sh because of assertionError #902

Open leachee99 opened 6 months ago

leachee99 commented 6 months ago

hi, I meet a problem when I run the DeepSpeedExamples/inference/huggingface/text-generation/run-generation-script/test-gpt.sh.

The error is :

assert not config.replace_with_kernel_inject, "Cannot use both user specified injection policy and kernel injection"
AssertionError: Cannot use both user specified injection policy and kernel injection

How can I solve this problem? Thanks