Pass round interval param to model load

microsoft / TransformerCompression

For releasing code related to compression methods for transformers, accompanying our publications

MIT License

356 stars 31 forks source link

Pass round interval param to model load #83

Closed myshkov closed 7 months ago

myshkov commented 7 months ago

Pass the round interval parameter to the slice model loader. Otherwise the loading can fail with shapes mismatch based on whether the rounding was applied.