search

TideDra / VL-RLHF

A RLHF Infrastructure for Vision-Language Models
Apache License 2.0
85 stars 5 forks source link

strip may break chat template #2

Closed TideDra closed 5 months ago

TideDra commented 5 months ago

in process_batch, raw_text.strip() can drop special token like \n or , which can be a part of chat template.