search

fixie-ai / ultravox

A fast multimodal LLM for real-time voice
https://ultravox.ai
MIT License
871 stars 47 forks source link

Local tokenizer and processor for more consistent CI #16

Closed farzadab closed 3 months ago

juberti commented 3 months ago

Still seeing failures here even with local tokenizer/processor. I think something is getting wedged during test shutdown, kind of frustrating to debug since everything works fine locally 🙁

juberti commented 3 months ago

OK, so the issue here was ddp_utils_test.py, not infer_test.py. That said, I think this is worth keeping since it allows external PRs to access the Llama 3 tokenizer, which would otherwise fail due to not having the HF_TOKEN set.