Closed PCIHD closed 10 months ago
Since there is no non fast version of gptneox dolly fails to load in 8 bit compression mode.
There needs to be a different way of handling the parameters, perhaps a method in the adapters that initializes the tokenizers differently.
cc @andy-yang-1
@merrymercy @PCIHD The problem is fixed. See #1438
This is fixed since june. Closing this one.
Since there is no non fast version of gptneox dolly fails to load in 8 bit compression mode.
There needs to be a different way of handling the parameters, perhaps a method in the adapters that initializes the tokenizers differently.