daytonaio / devcontainer-generator

devcontainer.ai - AI generated standardized dev environments
https://devcontainer.ai/
Apache License 2.0
15 stars 12 forks source link

Test prefill prompt with Anthropic models #28

Open nkkko opened 1 month ago

nkkko commented 1 month ago

When using models that enable pre-filling, like Anthropic, we should try pre-filling the outputs: https://docs.anthropic.com/en/docs/build-with-claude/prompt-engineering/prefill-claudes-response

This needs #10 to be solved first.

nkkko commented 1 month ago

/bounty $20

algora-pbc[bot] commented 1 month ago

💎 $20 bounty • Daytona

Steps to solve:

  1. Start working: Comment /attempt #28 with your implementation plan
  2. Submit work: Create a pull request including /claim #28 in the PR body to claim the bounty
  3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

If no one is assigned to the issue, feel free to tackle it, without confirmation from us, after registering your attempt. In the event that multiple PRs are made from different people, we will generally accept those with the cleanest code.

Please respect others by working on PRs that you are allowed to submit attempts to.

e.g. If you reached the limit of active attempts, please wait for the ability to do so before submitting a new PR.

If you can not submit an attempt, you will not receive your payout.

Thank you for contributing to daytonaio/devcontainer-generator!

Add a bounty • Share on socials

Attempt Started (GMT+0) Solution
🟢 @madman024 Oct 10, 2024, 7:51:22 PM WIP
madman024 commented 1 month ago

/attempt #28 Hey, I've got a plan for implementing prefill support across our LLM providers, focusing on Anthropic's Claude models initially. Here's how we can tackle this: Prefill Support Implementation Plan

Adding prefill support will give us way more control over our devcontainer.json generation. It'll help us: Get more consistent, structured outputs Skip unnecessary preambles Guide the model to follow our exact formatting needs