pytorch / torcheval

A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to facilitate metric computation in distributed training and tools for PyTorch model evaluations.
https://pytorch.org/torcheval
Other
211 stars 46 forks source link

update throughput metric to use float state #157

Closed JKSenthil closed 1 year ago

JKSenthil commented 1 year ago

Summary: using float variables can reduce latency of moving these variables onto gpu

Reviewed By: ananthsub

Differential Revision: D46861285

facebook-github-bot commented 1 year ago

This pull request was exported from Phabricator. Differential Revision: D46861285

codecov[bot] commented 1 year ago

Codecov Report

Merging #157 (8f5f340) into main (76ea267) will increase coverage by 0.00%. The diff coverage is 7.31%.

@@           Coverage Diff           @@
##             main     #157   +/-   ##
=======================================
  Coverage   24.45%   24.45%           
=======================================
  Files         176      176           
  Lines       10359    10349   -10     
=======================================
- Hits         2533     2531    -2     
+ Misses       7826     7818    -8     
Impacted Files Coverage Δ
tests/metrics/aggregation/test_cat.py 35.89% <ø> (ø)
tests/metrics/aggregation/test_throughput.py 33.33% <0.00%> (-2.16%) :arrow_down:
tests/metrics/test_metric.py 11.85% <0.00%> (-0.09%) :arrow_down:
tests/metrics/test_toolkit.py 39.50% <ø> (ø)
tests/metrics/window/test_auroc.py 16.43% <ø> (ø)
tests/metrics/window/test_click_through_rate.py 20.68% <ø> (ø)
tests/metrics/window/test_mean_squared_error.py 11.57% <ø> (ø)
tests/metrics/window/test_weighted_calibration.py 21.42% <ø> (ø)
torcheval/metrics/aggregation/cat.py 50.00% <0.00%> (ø)
torcheval/metrics/toolkit.py 37.64% <0.00%> (+4.65%) :arrow_up:
... and 7 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

facebook-github-bot commented 1 year ago

This pull request was exported from Phabricator. Differential Revision: D46861285