Random Seed

[pharringtonp19]

OpenAI has a way to set the seed. Is there a way to do this with gemini models?

[holtskinner]

@pharringtonp19 You can set the seed in the Vertex AI API as illustrated here for PaLM Text Generation

And here for Image Captioning

It doesn't look like Gemini currently supports providing a seed.

• https://cloud.google.com/vertex-ai/docs/generative-ai/model-reference/gemini

• https://cloud.google.com/vertex-ai/docs/reference/rest/v1/projects.locations.publishers.models/streamGenerateContent

[andrewssobral]

any news on that?

[boxabirds]

Yeah Google Gemini isn't a viable software engineering API if you can't fix the seed to get deterministic output.

[taurit]

I think it's possible now. Tested with gemini-1.5-flash and older gemini-1.0-pro. Both seem to respond deterministically with this parameter set:

// POST https://generativelanguage.googleapis.com/v1beta/models/gemini-1.5-flash:generateContent

{
  "contents": [ { "parts": [ { "text": "What are the capitals of France, Spain, Poland?" } ] } ],
  "generationConfig": {
    "seed": 123456
  }
}

API Reference here.