mybigday / llama.rn

React Native binding of llama.cpp
MIT License
300 stars 24 forks source link

[Android] Seed value does not create deterministic outputs. #41

Closed Vali-98 closed 9 months ago

Vali-98 commented 9 months ago

As mentioned in the title, setting a seed value does not make an output deterministic on Android.

Params used:

{
  "frequency_penalty": 0, 
  "grammar": "", 
  "min_p": 0.07, 
  "mirostat": 0, 
  "mirostat_eta": 0.1, 
  "mirostat_tau": 5, 
  "n_predict": 288, 
  "n_threads": 5, 
  "presence_penalty": 0, 
  "prompt": "", 
  "repeat_penalty": 1, 
  "seed": 2, 
  "stop": ["User:", "### Response: "], 
  "temperature": 1, 
  "tfs_z": 1, 
  "top_k": 0, 
  "top_p": 1, 
  "typical_p": 1
}