search

jalammar / ecco

Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
https://ecco.readthedocs.io
BSD 3-Clause "New" or "Revised" License
1.96k stars 167 forks source link

llama support #89

Open srikanthmalla opened 1 year ago

srikanthmalla commented 1 year ago

Hi, I am trying to use llama (https://huggingface.co/docs/transformers/main/model_doc/llama) with ecco. It shows not supported yet. Could you please let me know how I can make it work?

Best Regards, Srikanth

jalammar commented 1 year ago

That is a great idea. Could you go over the configs here: https://github.com/jalammar/ecco/blob/main/notebooks/Identifying%20model%20configuration.ipynb

BiEchi commented 1 year ago

Hey @srikanthmalla , do you have any update on this? I can also help with it.

LAKan233 commented 11 months ago

Hey @srikanthmalla , do you have any update on this? I can also help with it.

Hi, I'm also intrested in using GLM2 with ecco, do you have any advice in the config setting? Thanks

BiEchi commented 11 months ago

@LAKan233 @srikanthmalla : use this lib instead: https://github.com/inseq-team/inseq It's a more recent and maintained one.