Open nkkko opened 1 month ago
/bounty $20
/attempt #28
with your implementation plan/claim #28
in the PR body to claim the bountyIf no one is assigned to the issue, feel free to tackle it, without confirmation from us, after registering your attempt. In the event that multiple PRs are made from different people, we will generally accept those with the cleanest code.
Please respect others by working on PRs that you are allowed to submit attempts to.
e.g. If you reached the limit of active attempts, please wait for the ability to do so before submitting a new PR.
If you can not submit an attempt, you will not receive your payout.
Thank you for contributing to daytonaio/devcontainer-generator!
Add a bounty • Share on socials
Attempt | Started (GMT+0) | Solution |
---|---|---|
🟢 @madman024 | Oct 10, 2024, 7:51:22 PM | WIP |
/attempt #28 Hey, I've got a plan for implementing prefill support across our LLM providers, focusing on Anthropic's Claude models initially. Here's how we can tackle this: Prefill Support Implementation Plan
Adding prefill support will give us way more control over our devcontainer.json generation. It'll help us: Get more consistent, structured outputs Skip unnecessary preambles Guide the model to follow our exact formatting needs
When using models that enable pre-filling, like Anthropic, we should try pre-filling the outputs: https://docs.anthropic.com/en/docs/build-with-claude/prompt-engineering/prefill-claudes-response
This needs #10 to be solved first.