Use different questions when retrying AI use cases.

[sobolk]

Problem

It seems that retrying same question in the narrow time window makes model return pretty much same hallucination.

Changes

In attempt to solve this problem, and array of similar yet different questions is created and each retry attempt will use slightly different question. This should make LLM evaluate it differently, hoping that one of attempts yields satisfactory response.

Validation

PR checks

Checklist

• [ ] If this PR includes a functional change to the runtime behavior of the code, I have added or updated automated test coverage for this change.
• [ ] If this PR requires a change to the Project Architecture README, I have included that update in this PR.
• [ ] If this PR requires a docs update, I have linked to that docs PR above.
• [ ] If this PR modifies E2E tests, makes changes to resource provisioning, or makes SDK calls, I have run the PR checks with the run-e2e label set.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

[changeset-bot[bot]]

🦋 Changeset detected

Latest commit: 10949be6ab82246870170039530421cb9722be97

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 0 packages

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR