search

microsoft / DeepSpeedExamples

Example models using DeepSpeed
Apache License 2.0
6.1k stars 1.04k forks source link

Update tokens_per_sec calculation to work w/ stream and non-stream cases #897

Closed lekurile closed 6 months ago

lekurile commented 6 months ago

This PR updates the tokens_per_sec calculation in the MII benchmark to account for both the streaming and non-streaming modes.