sagemathinc / cocalc

CoCalc: Collaborative Calculation in the Cloud
https://CoCalc.com
Other
1.15k stars 209 forks source link

LLMs: paid should not be red #7507

Closed novoselt closed 3 months ago

novoselt commented 3 months ago

image

Red "paid" gives a subconscious impression that it is dangerous/bad/expensive, while it is pretty neutral - for CoCalc usage the price is likely to be very low and inconsequential. Instead of such clear distinction, how about we put the expected price in plain black regular font with the expected price in cents? For free models it would be "0¢" while for others "~1¢-4¢" (I would not use 0¢ as the lower bound ever - if the model is very cheap, show it as "~1¢-2¢", to convey that a) it is an approximate range and b) there is some charge.

williamstein commented 3 months ago

I strongly agree with this. In antd red is semantically "ERROR". Also, in my mind "green is the color of money", so having green be free seems weird too.

williamstein commented 3 months ago

how about we put the expected price in plain black regular font with the expected price in cents?

I'm not sure how viable this is, because the expected price range depends on the input, and I think this model selector is often displayed before the input is decided on (or rather, the input can frequently be changed).

novoselt commented 3 months ago

OK, this may be harder to implement, but how about not displaying price at all except for "0¢" for free models and "greying out" paid models for which the user does not have enough credit on the account? With some tooltip on how to top it up.

williamstein commented 3 months ago

OK, this may be harder to implement, but how about not displaying price at all except for "0¢" for free models and "greying out" paid models for which the user does not have enough credit on the account? With some tooltip on how to top it up.

I already put a lot of work into making it so that if you try to use an LLM and don't have enough credits to pay for it, then a modal pops up and asks you for those credits. It's part of the workflow already. Changing this to provide directions to go somewhere else then come back would be a usability regression IMHO.

novoselt commented 3 months ago

Makes sense! Then I am just for a plain "0¢" marker on free models and nothing on paid ones. If a user selects a paid model, there should be an approximate price displayed next to the submission button.

haraldschilly commented 3 months ago

this may be harder to implement

I'm implementing exactly that estimate. I talked about this yesterday and as an example there is an estimated range for the AI tool in a cell. My plan is to add more. Throwing in a number that could be off by 10x feels wrong to me.

I don't know if that "1¢" is a good idea. Personally, I would be very confused if I see this. $0.01 is what I have chosen.

Regarding the colors, there could be different ones, or none. I don't understand why this is perceived as an error. E.g. the default syntax highlighting shows each string is red, not implying they're all errors. Or closing an app in Mac OS is a red dot. Any interpretation depends on the context.

williamstein commented 3 months ago

I'm implementing exactly that estimate.

Awesome! I bet it will be difficult so it is even more awesome that you're doing it!

I also like $0.01 instead of 1¢.

I don't understand why this is perceived as an error.

See https://ant.design/components/tag

image

and https://ant.design/components/alert:

image

Or closing an app in Mac OS is a red dot.

That's because it is dangerous.

novoselt commented 3 months ago

1¢ is two characters which are very easy to interpret, while $0.01 is five characters and one has to pay attention to the number of zeros and dot placement, especially when we are displaying high precision in some places. Since with LLMs we do have a good sense of scale, I think cents are very natural units. What do William and Blaec think?

novoselt commented 3 months ago

OK, William also prefers dollars, that's perfectly fine!