Closed yzh119 closed 3 months ago
add the case of logits_soft_case=1.0 for correctness tests. add batch decode/prefill tests.
logits_soft_case=1.0
add the case of
logits_soft_case=1.0
for correctness tests. add batch decode/prefill tests.