Does Lade support topp/topk/temperature sampleing?

hao-ai-lab / LookaheadDecoding

Apache License 2.0

1.04k stars 63 forks source link

Open AlvL1225 opened 7 months ago

AlvL1225 commented 7 months ago

Amazing work! Does this support sampling decoding?

Viol2000 commented 7 months ago

Hi, thanks for your interest! Currently, we do not support sampling, but we will do it later!

shermansiu commented 6 months ago

See #6.