search

longy2k / obsidian-bmo-chatbot

Generate and brainstorm ideas while creating your notes using Large Language Models (LLMs) from Ollama, LM Studio, Anthropic, OpenAI, Mistral AI, and more for Obsidian.
https://ko-fi.com/longy2k
MIT License
261 stars 32 forks source link

Possible bug: User message truncated from the beginning by one word. Anthropic #55

Closed twalderman closed 3 months ago

twalderman commented 4 months ago

When I am using the Anthropic API, when I enter a User message and hit enter, the first word is lost in the chat window.

twalderman commented 4 months ago

So annoying this one. I prepend every prompt with a dash to keep the first word in context

longy2k commented 4 months ago

Is it only at the beginning of the conversation or after every bot response?

twalderman commented 4 months ago

It is at the beginning of every User entry. When I type it in it is visable. Hitting enter eliminates the first word in the chat window. This is only with Anthropic API. OpenRoute, OAI, Mistral, Ollama are fine. oh yeah, google is fine too.

longy2k commented 4 months ago

v.1.8.9

Anthropic API is now available to the public! 😁

twalderman commented 4 months ago

Yes I’m using it now. It takes a lot of steering and editing bot responses to get it to behave but it’s working great. 3.0 is here too. I have not tried it yet.

On Mon, Mar 4, 2024 at 1:02 PM, Long Huynh @.***(mailto:On Mon, Mar 4, 2024 at 1:02 PM, Long Huynh < wrote:

v.1.8.9

Anthropic API is now available to the public! 😁

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

twalderman commented 4 months ago

This seems to be fixed. If at all possible, can you expose Claude-v1? It is deprecated but I believe its still being served. I would like to evaluate the fiction output across the versions.

twalderman commented 3 months ago

Try using this system template when experimenting with Anthropic. It works very well. If you are curious about the settings, ask Claude to explain them.

T.

PS Thanks for all your work. I love it.

longy2k commented 3 months ago

I tried finding all the Claude models here, but it looks like the earliest model available is claude-instant-1.2. I also manually tried fetching from Anthropic using claude-v1, claude-1, and claude-1.0. None of these models work.

EDIT: I can see that openrouter has version 1 claude models available. However, it does not seem to be fetching via https://api.anthropic.com/v1/messages. Perhaps openrouter is fetching these models from a different endpoint. I will look around to see if I can expose these models.

longy2k commented 3 months ago

Thank you for the system template for Anthropic! I will definitely be experimenting with it :)

twalderman commented 3 months ago

move to close.