Closed ryanbogan closed 2 months ago
Quantization Cache Class Looks good , but we need to improve on unit tests for following test cases
Let's have all these tests added.
The most recent commits should address @navneet1v 's comments 1-5. Will add to stats in follow up PR. I also still need to add more unit testing for the new functionality.
There's one flaky test I'm still trying to fix. (edit: should be fixed now)
Description
Adds a cache for storing quantization states. This PR contains the cache and tests without integration. In a later PR, this cache will be integrated with a quantization state reader and the query flow.
Check List
--signoff
.By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check here.