langchain-ai / langsmith-sdk

LangSmith Client SDK Implementations
https://docs.smith.langchain.com/
MIT License
403 stars 75 forks source link

Issue: New Playground view #923

Closed Darwinium closed 1 month ago

Darwinium commented 2 months ago

Issue you'd like to raise.

Today, the whole team was surprised to see that you updated the Playground page (see below). I don't know why you decided to do so, but the decision was made by someone who never worked with Langsmith. For us, it's a tool for everyday work; we have many prompts, and we must adjust them almost every day, and the way how the Playground looked was perfect.

But now you need to change the prompt, scroll down to see the output, scroll up, click on setting and change setting in pop up, click save, scroll down to see the result. This is a nightmare and we even started to look for browser extensions where you can change the HTML on the website to make it more convenient.

Screenshot 2024-08-15 at 10 11 17

Suggestion:

Please let us return to the previous version of this page, and before changing this crucial functionality, please ensure that you know the reasons for changing.

Thank you.

hinthornw commented 2 months ago

Hi @Darwinium - thanks for voicing feedback about the adjusted playground experience! And thanks for your patience - voicing these frustrations definitely helps us make the product better.

We are pushing out some changes to reduce the scrolling incurred by the linear view try to regain the niceties of the previous layout. I think we're generally in agreement about the worse tradeoffs with this version (worse horizontal usage of space when using a single LLM; too much scrolling for mid-to-longer prompts).

For context, this change was made in part to unify the various playground experiences and make it easier to transition to comparing models/prompts in a shared input.

In the future I'd appreciate if you refrain from ad hominem on the developer working to balance requests from various parties here.

Will keep you posted when we get a fix out.

hinthornw commented 2 months ago

@Darwinium actually I believe some of htose changes are already out this morning. Do you have feedback on the adjusted playground?

image

Darwinium commented 2 months ago

Hi @hinthornw

You are right about the communication — sorry for that. I was a bit overdramatic. I was just surprised by these changes since, overall, Langsmith's UX/UI is good, and I can see that you put lots of thoughts in there.

This is how it looks now, much better! The only problem is that we still need to scroll a bit to the button and tools below.

Screenshot 2024-08-15 at 20 16 59

Maybe there's a way to pin the button, like in the example below or do something similar? What do you think? Example

Darwinium commented 2 months ago

I forgot to say that it looks like you use the big screen as a second display. In my case, I work from a 15-inch MacBook.

hinthornw commented 2 months ago

OH that's a good callout re: scrolling for the button - will see if we can get an adjustment made

hinthornw commented 2 months ago

@Darwinium I believe some changes have been landed to ensure the button remains visible for long prompts - do you have any remaining difficulties with the new layout?

Darwinium commented 2 months ago

@hinthornw hi 👋 Thank you for letting me know! Much better, thanks. There's just a small issue but nothing crucial. Please see the screenshot below:

Screenshot 2024-08-22 at 09 35 21
hinthornw commented 1 month ago

We're going to do a larger redesign of the app experience and will keep imrpoving. Thank you again for reporting!