search

n4ze3m / page-assist

Use your locally running AI models to assist you in your web browsing
https://chromewebstore.google.com/detail/page-assist-a-web-ui-for/jfgfiigpkhlkbnfnbobbkinehhfdhndo
MIT License
1.55k stars 146 forks source link

Request for Batches API Integration to Reduce Claude API Costs #248

Open vasi26ro opened 4 days ago

vasi26ro commented 4 days ago

Hello,

Thank you for creating and maintaining the Page Assist extension! I’d like to suggest a new feature that could optimize the extension’s API usage costs when using Anthropic’s Claude model.

Feature Request:

Integrate the Batches API to reduce the cost of API calls. As Anthropic offers a 50% discount on prompt processing with Batches API, this would significantly reduce costs and make the extension more sustainable.

Benefits of the Batches API:

  1. Cost-effective: Reduces prompt processing costs by 50%.
  2. Scalable: Allows multiple requests to be bundled, improving API efficiency.

Let me know if I can provide any further information. Thank you for considering this suggestion!

n4ze3m commented 2 days ago

Hey, thank you for the feedback! Are you using the Claude API directly?

vasi26ro commented 2 days ago

I have tried, without success, I received a 404 error. After that I have found something about the https://github.com/open-webui/pipelines. I did not try yet.

How should I use Claude API?

n4ze3m commented 2 days ago

Page Assist is currently not supported for the Anthropic API format. It will be added in an upcoming version. 😊