microsoft / microxcaling

PyTorch emulation library for Microscaling (MX)-compatible data formats
MIT License
123 stars 14 forks source link

MXINT8 elements: MX spec: 2's complement vs. README: sign-magnitude #3

Closed grayresearch closed 8 months ago

grayresearch commented 8 months ago

MX spec 5.3.4 INT8: "... Integer data types use a 2’s complement encoding, but ..." disagrees with README.md: “MXINT uses sign-magnitude representation, not 2's complement. ...."

rizhao-msft commented 8 months ago

Fixed in commit bd54bb6b5cc10d60e892729cf847f01e2f37256c.