Assistant prefill and stop_sequences async - Githubissues

simonw / llm-claude-3

LLM plugin for interacting with the Claude 3 family of models

Apache License 2.0

254 stars 23 forks source link

Assistant prefill and stop_sequences async #27

Open irthomasthomas opened 2 days ago

irthomasthomas commented 2 days ago

Changes

Updated model implementation to support stop_sequences parameter
Added prefill option to prefill Claude's response
Updated README with documentation for new features

Testing

Verified functionality with claude-3-opus
Tested stop sequences and prefill behavior

Notes

Neither the prefill, nor the stop_sequence are included in the response.

llm -m claude-3-opus  "List files sorted by modification time (be brief)" \
-o prefill "<code>" \
-o stop_sequences "</code>,\n"

ls -lt

response_json

"stop_reason": "stop_sequence", "stop_sequence": "</code>"