search

TideDra / VL-RLHF

A RLHF Infrastructure for Vision-Language Models
Apache License 2.0
100 stars 6 forks source link

strip may break chat template #2

Closed TideDra closed 7 months ago

TideDra commented 7 months ago

in process_batch, raw_text.strip() can drop special token like \n or , which can be a part of chat template.