danny-avila / LibreChat

Enhanced ChatGPT Clone: Features Anthropic, OpenAI, Assistants API, Azure, Groq, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. Actively in public development.
https://librechat.ai/
MIT License
17.21k stars 2.86k forks source link

Enhancement: Playground interface for text completion #658

Closed elinorgodzilla closed 1 year ago

elinorgodzilla commented 1 year ago

Contact Details

No response

What features would you like to see added?

Hi! I would like to request a feature that gives a text completion feature like it is on on OpenAI Playground and Claude console. This way we could continuously generate text, it would be tremendous help for writers and gives opportunity for more creative ways of text generation. I would like to request that it should continue text from the last character as it is available on Anthropic's Claude console. That way we could edit the full conversation and force the AI to continue from where it left off or make it produce longer responses or steer the responses in way we want.

Are you familiar with Claude Console? That way we can edit or have the conversation in a text format instead of just on the chat interface and when I press "generate" it makes the ai continue exactly where it left off. Please kindly reconsider my recommendation!

More details

Example is claude console, picture included. In this example I make it talk about cats then I delete part of it, add the word "dinosaur" and the AI is now forced to continue the text completion from there. This allows full control on the text, the direction where the AI will have to steer. I believe this would be crucial to give us full control over the conversation/text completion

Which components are impacted by your request?

General

Pictures

claude console dinosaurs

Code of Conduct

techwithanirudh commented 1 year ago

https://nat.dev/ has this functionality, this project is focused on cloning the UI/UX of ChatGPT.

danny-avila commented 1 year ago

It’s possible and I’m open to doing this. Will add it to the roadmap

elinorgodzilla commented 1 year ago

https://nat.dev/ has this functionality, this project is focused on cloning the UI/UX of ChatGPT.

Unfortunately it is unable to force continue the text when it comes to Claude. The feature has been requested on discord but the repo is not updated for a long time now so we are not holding our breath.

It’s possible and I’m open to doing this. Will add it to the roadmap

Thank you for reading my request and considering it. I am grateful for your work.

fuegovic commented 1 year ago

Here's another reference on the subject:

https://docs.anthropic.com/claude/docs/ask-claude-to-think-step-by-step

danny-avila commented 1 year ago

@elinorgodzilla I am introducing the initial functionality for this very soon through a "continue regenerating" button, similar to chatgpt.

You can see my progress on discord here

This initial logic will release today. And then the next step is to edit the AI messages themselves, which a lot of the work for this is done now since it will use the same logic.

This is related to #639