Interpreter support for quantized type

openxla / stablehlo

Backward compatible ML compute opset inspired by HLO/MHLO

Apache License 2.0

357 stars 100 forks source link

Interpreter support for quantized type #2373

Closed sdasgup3 closed 2 weeks ago

sdasgup3 commented 1 month ago

The interpreter in its current form does not support quantized type and operations on that type. The issue is to (1) explore the use-cases and (2) enable support for the same.

Re (2): One option could be to decompose uisng mhlo-quant-legalize-to-int the quantized type to primitive math using before doing interpreter evaluation.

sdasgup3 commented 1 month ago

[x] Port mhlo-quant-legalize-to-int pass to StableHLO (#2383)
[x] Lower shape.cstr_broadcastable op in ShapeLegalizeToHLO (#2384)
[x] Add a pass-pileline line to convert quantized StableHLO program to math equivalent before evaluation (https://github.com/openxla/stablehlo/pull/2388)