None of the examples scripts works, that used to work earlier. Please test your examples again and update docs

erfanzar / EasyDeL

Accelerate, Optimize performance with streamlined training and serving options with JAX.

https://easydel.readthedocs.io/en/latest/

Apache License 2.0

209 stars 24 forks source link

None of the examples scripts works, that used to work earlier. Please test your examples again and update docs #109

Closed jchauhan closed 9 months ago

jchauhan commented 9 months ago

Describe the bug

while trying to run tinyllama

  File "/home/**/research/easydel/.venv/lib/python3.10/site-packages/EasyDel/modules/llama/modelling_llama_flax.py", line 933, in __call__
    assert sequence_length <= self.config.max_position_embeddings, "Maximum Position Embedding Reached !"
AssertionError: Maximum Position Embedding Reached !

erfanzar commented 9 months ago

tiny llama has max position embedding of 2048 and you are applying 4096 for max position embedding for that.