hltcoe / sandle

Run a large language modeling SANDbox in your Local Environment
Other
7 stars 1 forks source link

Check whether we should be using greedy decoding or sampling and adjust accordingly #7

Closed ccmaymay closed 2 years ago

ccmaymay commented 2 years ago

Looks like sampling, by default:

Screen Shot 2022-07-13 at 3 18 24 PM