search

NVIDIA / RULER

This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?
Apache License 2.0
743 stars 48 forks source link

Add multi-thread for process_batch #42

Closed Ying1123 closed 4 months ago

hsiehjackson commented 4 months ago

Thanks for your contribution!