tailcallhq / tailcall

High Performance GraphQL Runtime
https://tailcall.run
Apache License 2.0
1.29k stars 254 forks source link

Update `wizard` to programatically control the LLM adapter and model #2658

Closed tusharmath closed 3 months ago

tusharmath commented 3 months ago

Currently based on environment variables the GenAI library uses a particular Adapter and Model. We wish to change that and provide a type-safe way to integrate it.

Example

let model = Adapter::Groq::Llama3_8b_8192;
let wiz = Wizard::new(model);

Technical Requirements

tusharmath commented 3 months ago

/bounty 50$

algora-pbc[bot] commented 3 months ago

💎 $50 bounty â€ĸ Tailcall Inc.

Steps to solve:

  1. Start working: Comment /attempt #2658 with your implementation plan
  2. Submit work: Create a pull request including /claim #2658 in the PR body to claim the bounty
  3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

🙏 Thank you for contributing to tailcallhq/tailcall! 🧐 Checkout our guidelines before you get started. đŸ’ĩ More about our bounty program.

Attempt Started (GMT+0) Solution
đŸŸĸ @ssddOnTop Aug 11, 2024, 9:05:39 AM #2659
đŸŸĸ @dekkku Aug 11, 2024, 9:53:07 AM #2660
🟡 @palak2002 Aug 11, 2024, 2:52:55 PM WIP
ssddOnTop commented 3 months ago

/attempt #2658

Algora profile Completed bounties Tech Active attempts Options
@ssddOnTop 71 tailcallhq bounties
Rust, Java,
C & more
īšŸ2652
Cancel attempt
algora-pbc[bot] commented 3 months ago

💡 @ssddOnTop submitted a pull request that claims the bounty. You can visit your bounty board to reward.

dekkku commented 3 months ago

/attempt #2658

Algora profile Completed bounties Tech Active attempts Options
@dekkku 2 tailcallhq bounties
Rust
Cancel attempt
algora-pbc[bot] commented 3 months ago

[!NOTE] The user @ssddOnTop is already attempting to complete issue #2658 and claim the bounty. We recommend checking in on @ssddOnTop's progress, and potentially collaborating, before starting a new solution.

palak2002 commented 3 months ago

💎 $50 bounty â€ĸ Tailcall Inc.

Steps to solve:

  1. Start working: Comment /attempt #2658 with your implementation plan
  2. Submit work: Create a pull request including /claim #2658 in the PR body to claim the bounty
  3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

🙏 Thank you for contributing to tailcallhq/tailcall! 🧐 Checkout our guidelines before you get started. đŸ’ĩ More about our bounty program.

Attempt Started (GMT+0) Solution đŸŸĸ @ssddOnTop Aug 11, 2024, 9:05:39 AM #2659 đŸŸĸ @dekkku Aug 11, 2024, 9:53:07 AM #2660

/attempt #2658 I plan to implement a type-safe Adapter and integrate it with the Wizard struct, replacing the current environment variable-based configuration. I'll define the Adapter enum in llm/adapter.rs and modify the Wizard struct to accept an adapter instance. Secrets will be read from the environment as TAILCALL_SECRET and securely passed to the library.

algora-pbc[bot] commented 3 months ago

@palak2002: Reminder that in 1 days the bounty will become up for grabs, so please submit a pull request before then 🙏

algora-pbc[bot] commented 3 months ago

🎉🎈 @ssddOnTop has been awarded $50! 🎈🎊