fix: correct batch output list shape when using pipeline

NVIDIA / RULER

This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?

Apache License 2.0

743 stars 48 forks source link

fix: correct batch output list shape when using pipeline #45

Closed Wangmerlyn closed 3 months ago

Wangmerlyn commented 4 months ago

The batch output list shape was incorrect in the pipeline process. This fix ensures the correct shape is applied, improving the overall process stability.

Before fixing: QQ_1722491231511

hsiehjackson commented 3 months ago

Thanks!