search

FlowiseAI / Flowise

Drag & drop UI to build your customized LLM flow
https://flowiseai.com
Apache License 2.0
30.95k stars 16.1k forks source link

[FEATURE] Result includes llm token usage along with the response #2886

Open LuisFX opened 3 months ago

LuisFX commented 3 months ago

API call result object would include the token utilization For accounting reasons, it would be useful to get the token utilization for each call. Akin to what openai includes along other metadata.

severfire commented 3 months ago

I do agree, It would be great to get in in all models. I would use it in VertexAI model.

bendadaniel commented 1 week ago

This is must have feature, it is rly hard to use flowine in production without option to know how much user spend @HenryHengZJ