langchain-ai / langsmith-sdk

LangSmith Client SDK Implementations
https://smith.langchain.com/
MIT License
387 stars 71 forks source link

Issue: How to view and delete/rename archived prompts in LangSmith? #737

Closed k3vob closed 3 weeks ago

k3vob commented 4 months ago

Issue you'd like to raise.

I'm not sure if this is the correct place to raise this issue, but I could not think of or find a more suitable place.

I have been experimenting with creating different private prompts in LangSmith. I have archived some prompts after I decided to then experiment with a different template (e.g. switch from Chat Prompt to a Structured Prompt). It appears that you cannot change the template of a prompt, nor delete a prompt, so the only option left is to archive it and then create a new one under the other template. The issue then is that this new prompt cannot use the same name since the old one with the same name still exists, although archived.

Furthermore, I cannot find where to view my archived prompts, so it is getting quite messy not being able to know what prompt names I have already used, so I keep getting a "Prompt not created because a prompt with handle xxx already exists in owner." error when using an intuitive name for a prompt I have already experimented with.

Suggestion:

Maybe I am missing something, but I would hope for at least one of the following functionalities to be possible:

hinthornw commented 4 months ago

Thanks for flagging - assigning to @madams0013 to respond; I know viewing/filtering is in flight. I don't think full deletions have been scheduled yet. I'm unaware of the current status for renaming and unarchiving

madams0013 commented 4 months ago

Thanks for flagging this! As mentioned, we have filtering for archived prompts at next release.

Thanks for the feedback! We'll take this all into our discussions.

k3vob commented 4 months ago

Thanks to you both. I'll look forward to these new releases!

arthberman commented 2 months ago

@madams0013 any update on renaming / archiving ? can be very useful thanks

hinthornw commented 3 weeks ago

Archiving support is in (has been for a while):

image