search

ahyatt / llm

A package abstracting llm capabilities for emacs.
GNU General Public License v3.0
178 stars 24 forks source link

[feature] Anthropic / Claude2 Support #22

Closed robertmeta closed 6 months ago

robertmeta commented 7 months ago

Anthropic is a close peer to OpenAI in text generation terms, and has a larger available context window that is compatible with its newest model, at 200k tokens. The API feels very similar in terms of tokens and the conversation back and forth.

I personally often favor the output of Anthropic over both Gemini and GPT-4.

ahyatt commented 7 months ago

I think the Claude 2 API is a closed beta, so most people (including me) cannot use it. It's good in theory, though, since Claude 2 is supposed to be good, as you point out. Let me know, though, if I'm misunderstanding the API access story, though.

robertmeta commented 7 months ago

Oh, you are correct, the web version went general availability while the API has stayed as a closed beta. I will ping here when it comes out.

ahyatt commented 6 months ago

Good news, I've implemented Claude (which has opened up its API) and released it in the latest llm release! Please let me know if you find any issues with it.

robertmeta commented 6 months ago

Awesome, look forward to trying it with Ellama.