Closed yufengzh closed 2 months ago
This CR deduplicates the target computation in generation.py for computing the token log probability with cross_entropy.
target
generation.py
cross_entropy
This CR deduplicates the
target
computation ingeneration.py
for computing the token log probability withcross_entropy
.