search

microsoft / DeepSpeedExamples

Example models using DeepSpeed
Apache License 2.0
5.83k stars 990 forks source link

Improve robustness of infernece AML benchmark #875

Closed HeyangQin closed 3 months ago

HeyangQin commented 3 months ago
  1. handle all sorts of responses from AML
  2. using while loop instead of recursion to avoid hanging and max recursion depth error