search

FormulaMonks / kurt

A wrapper for AI SDKs, for building LLM-agnostic structured AI applications in Typescript
MIT License
2 stars 0 forks source link

feat: add `KurtSamplingOptions`, for tweaking output sampling details #24

Closed jemc closed 1 month ago

jemc commented 1 month ago

This commit adds a KurtSamplingOptions type with various tweakable values and a KurtSamplingOptionsDefault constant with the default values to use when not given.

The sampling key can be used to specify sampling options on creation, and/or on individual generate calls. See the docs and tests for more details on what settings are possible and how they behave.

A future PR will update the adapter libraries to start making use of these values.

github-actions[bot] commented 1 month ago

:tada: This PR is included in version @formula-monks/kurt-v1.1.0 :tada:

The release is available on:

Your semantic-release bot :package::rocket: