LLM sample with temperature parameters

wangzhaode / mnn-llm

llm deploy project based mnn.

Apache License 2.0

1.46k stars 159 forks source link

Open Ma-Dan opened 1 month ago

Ma-Dan commented 1 month ago

Sample with temperature will create more randomness and diversity in the generated text.