Closed LeonardRanaldi closed 1 year ago
Hi, your tool is very good, I just wondering if this tool can use such as the vicuna bloom or Llama model? thanks
Hi, My tool can use Llama model. Best, Leonardo.
Il lun 26 giu 2023, 16:43 Dongximing @.***> ha scritto:
Hi, your tool is very good, I just wondering if this tool can use such as the vicuna bloom or Llama model? thanks
— Reply to this email directly, view it on GitHub https://github.com/jalammar/ecco/pull/90#issuecomment-1607637564, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANXGAVDTT7X4GDIR5F4S44DXNGNYLANCNFSM6AAAAAAYZ73H6U . You are receiving this because you modified the open/close state.Message ID: @.***>
Hi Leonard Thank for you your reply me, and I saw your branch and see you just add :
decapoda-research/llama-7b-hf:
embedding: "transformer.embed_tokens.weight"
type: 'causal'
activations:
- 'mlp\.up_proj'
token_prefix: '▁'
partial_token_prefix: ''
in the ymal file,
I just wondering is that all you modified?
Thanks Ximing
Hi, Yes, it is.
Il lun 26 giu 2023, 21:07 Dongximing @.***> ha scritto:
Hi Leonard Thank for you your reply me, and I saw your branch and see you just add :
decapoda-research/llama-7b-hf:
embedding: "transformer.embed_tokens.weight" type: 'causal' activations: - 'mlp\.up_proj' token_prefix: '▁' partial_token_prefix: ''
in the ymal file,
I just wondering is that all you modified?
Thanks Ximing
— Reply to this email directly, view it on GitHub https://github.com/jalammar/ecco/pull/90#issuecomment-1608077434, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANXGAVD3TFUV2TFWOZDDRSTXNHMX5ANCNFSM6AAAAAAYZ73H6U . You are receiving this because you modified the open/close state.Message ID: @.***>
Does the library work with the model after this addition? Should we merge?
LLaMA configuration