nod-ai / serve

Serve, optimize and scale PyTorch models in production
https://pytorch.org/serve/
Apache License 2.0
1 stars 0 forks source link

extend serve.ModelServerTest.testMetricManager #25

Closed eppane closed 1 week ago

eppane commented 1 week ago

closes #9

Earlier the test checked only for three system-level metrics (one was outdated too, DiskUsed -> DiskUsage), but now all seven system-level metrics are checked. Also the tests were not strict meaning that checks were done only if target metric merely existed. Now, according to configuration files, a data structure can be defined against which the assertions are then done automatically.

Metrics:

ts/metrics/system_metrics.py ts/metrics/unit.py ts/configs/metrics.yaml servingsdk/metrics/InbuiltMetricsRegistry.java