TParcollet
commented
1 month ago Hey Peter, this goes beyond just this recipe imho. Because we are not simply using an adapter from peft, but also another function preparing the model. I suspect that it might be hard to make it generic. A first step would be to externalise the call to peft as an interface from SB.
Describe the bug
The MultiWOZ + llama recipe currently uses QLoRA which isn't supported yet with our adapters. Let's add QLoRA support and then harmonize the recipe with our adapters implementation.
Expected behaviour
Being one with the universe
To Reproduce
No response
Environment Details
No response
Relevant Log Output
No response
Additional Context
No response