search

microsoft / DeepSpeedExamples

Example models using DeepSpeed
Apache License 2.0
6.02k stars 1.02k forks source link

Update tokens_per_sec calculation to work w/ stream and non-stream cases #897

Closed lekurile closed 5 months ago

lekurile commented 5 months ago

This PR updates the tokens_per_sec calculation in the MII benchmark to account for both the streaming and non-streaming modes.