search

microsoft / TransformerCompression

For releasing code related to compression methods for transformers, accompanying our publications
MIT License
354 stars 31 forks source link

Support sliced local model loading from path #125

Closed pashminacameron closed 5 months ago

pashminacameron commented 5 months ago

AML doesn't support directory walking (required for finding config and other files for sliced local models) in RO MOUNT mode and we wouldn't want to download the models unnecessarily, which necessitates this change. It's also more consistent with the model-path and sliced-model-path naming of the arguments. Now both the path arguments take a folder as input and the sliced model name is inferred exactly as it is when saving the sliced model.

nailimixaM commented 5 months ago

fyi build is complaining about black formatting

pashminacameron commented 5 months ago

fyi build is complaining about black formatting

Sorry, I forgot black. Have run it now.