google / maxtext

A simple, performant and scalable Jax LLM!
Apache License 2.0
1.39k stars 247 forks source link

Explicitly specify tokenizer_path for pipeline tests #710

Closed gobbleturk closed 1 month ago

gobbleturk commented 1 month ago

Not sure how these tests passed before (maybe caching), the tests are run from MaxText directory so need the path ../assets/llama2.tokenizer