search

LargeWorldModel / LWM

Apache License 2.0
7.08k stars 549 forks source link

Weight conversion scripts #65

Open fmmoret opened 5 months ago

fmmoret commented 5 months ago

Would anyone be able to point me to pytorch -> jax llama weights conversion and jax -> pytorch llama weights conversion scripts?

fmmoret commented 5 months ago

@lhao499 & do you have any compatible w num_key_value_heads !== num_attention_heads?