search

boxkite-ml / boxkite

Concept drift monitoring for HA model servers.
Apache License 2.0
101 stars 14 forks source link

Always use dynamic bins for inference histogram #24

Closed sweatybridge closed 3 years ago

sweatybridge commented 3 years ago

In preparation of OOD metric for image classification where model confidence can be concentrated in a small range.

codecov[bot] commented 3 years ago

Codecov Report

Merging #24 (53ae61a) into master (8028591) will increase coverage by 0.03%. The diff coverage is 100.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master      #24      +/-   ##
==========================================
+ Coverage   93.52%   93.56%   +0.03%     
==========================================
  Files          16       16              
  Lines         417      404      -13     
==========================================
- Hits          390      378      -12     
+ Misses         27       26       -1
Impacted Files Coverage Δ
boxkite/monitoring/collector/inference.py 97.29% <100.00%> (+1.29%) :arrow_up: