Closed bushshrub closed 2 years ago
Describe the solution you'd like
Adds support for a public API function, approx.auto_quantize(model, pretrained: bool)
approx.auto_quantize(model, pretrained: bool)
This accepts some model and automatically quantizes it
Additional context
This replaces #3 temporarily for a nicer user-facing API
Additional improvements could include supporting an @auto_quantize annotation over some given model
@auto_quantize
Describe the solution you'd like
Adds support for a public API function,
approx.auto_quantize(model, pretrained: bool)This accepts some model and automatically quantizes it
Additional context
This replaces #3 temporarily for a nicer user-facing API
Additional improvements could include supporting an
@auto_quantizeannotation over some given model