search

xfactlab / orpo

Official repository for ORPO
Apache License 2.0
412 stars 38 forks source link

Added quantization options #19

Open javafa opened 5 months ago

javafa commented 5 months ago

Added quantization options when use quantization, selected_indexs in compute_logps() could be negative values

javafa commented 5 months ago

loss calculation is wrong.

jiwooya1000 commented 5 months ago

Thank you @javafa for adding the quantization options! I will check it soon and merge it if it is good to go👍

javafa commented 5 months ago

calculation nagative values should be changed ... selected_index[selected_index < 0] += filtered_logits.size(1) ...