Open DavidAdamczyk opened 1 year ago
Hi David,
Cool that you're planning to use diagnnose! During the development of diagnnose a few years back I never really focused on seq2seq models, mainly on Causal LMs. But it shouldn't be hard to incorporate that, what diagnnose utility were you planning to use?
If you only intend to use the activation extraction utility you may want to look into minicons
as well: https://github.com/kanishkamisra/minicons
Thank you for the response @jumelet 👍🏻
I decided to use llama model instead of flan-t5. May I ask how I can determine what llama model from HF transformers is supported by diagNNose? Or can you suggest a particular llama model? Or maybe this is question for @dieuwkehupkes or @LorianColtof ?
I would like to ask you how I can use model from HF:
I installed the latest diagNNose from git (version 1.20) and this is unclear to me how I can use that model:
I read the diagnnose/models/huggingface_lm.py and this seems to me that models are not supported. Can you suggest how it is possible to load these model?
The error message is: