Open pkarw opened 2 months ago
We can add a stats record save it's id and when passed with the next request simply replace the estimate with the real usage
The other option which is probably better bc it's not exposing any delete operations is to store the estimated values in additional columns
Right now we are storing stats just for the AI request that ended, but when the request is interrupted, we simply lose usage for this one. Maybe we should store it before the request is being executed or maybe Sztor estimated versus real usage that way we won't lose anything.