search

jalammar / ecco

Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of Transformer-based language models (like GPT2, BERT, RoBERTA, T5, and T0).
https://ecco.readthedocs.io
BSD 3-Clause "New" or "Revised" License
1.96k stars 167 forks source link

Update model-config.yaml #90

Closed LeonardRanaldi closed 1 year ago

LeonardRanaldi commented 1 year ago

LLaMA configuration

Dongximing commented 1 year ago

Hi, your tool is very good, I just wondering if this tool can use such as the vicuna bloom or Llama model? thanks

LeonardRanaldi commented 1 year ago

Hi, My tool can use Llama model. Best, Leonardo.

Il lun 26 giu 2023, 16:43 Dongximing @.***> ha scritto:

Hi, your tool is very good, I just wondering if this tool can use such as the vicuna bloom or Llama model? thanks

— Reply to this email directly, view it on GitHub https://github.com/jalammar/ecco/pull/90#issuecomment-1607637564, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANXGAVDTT7X4GDIR5F4S44DXNGNYLANCNFSM6AAAAAAYZ73H6U . You are receiving this because you modified the open/close state.Message ID: @.***>

Dongximing commented 1 year ago

Hi Leonard Thank for you your reply me, and I saw your branch and see you just add :

decapoda-research/llama-7b-hf:

    embedding: "transformer.embed_tokens.weight"
    type: 'causal'
    activations:
    - 'mlp\.up_proj'
    token_prefix: '▁'
    partial_token_prefix: ''

in the ymal file,

I just wondering is that all you modified?

Thanks Ximing

LeonardRanaldi commented 1 year ago

Hi, Yes, it is.

Il lun 26 giu 2023, 21:07 Dongximing @.***> ha scritto:

Hi Leonard Thank for you your reply me, and I saw your branch and see you just add :

decapoda-research/llama-7b-hf:

embedding: "transformer.embed_tokens.weight"
type: 'causal'
activations:
- 'mlp\.up_proj'
token_prefix: '▁'
partial_token_prefix: ''

in the ymal file,

I just wondering is that all you modified?

Thanks Ximing

— Reply to this email directly, view it on GitHub https://github.com/jalammar/ecco/pull/90#issuecomment-1608077434, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANXGAVD3TFUV2TFWOZDDRSTXNHMX5ANCNFSM6AAAAAAYZ73H6U . You are receiving this because you modified the open/close state.Message ID: @.***>

jalammar commented 1 year ago

Does the library work with the model after this addition? Should we merge?