google / generative-ai-docs

Documentation for Google's Gen AI site - including the Gemini API and Gemma
https://ai.google.dev
Apache License 2.0
1.46k stars 498 forks source link

A Web UI to check for tokens and character count of palm api #171

Open ichandan2151 opened 7 months ago

ichandan2151 commented 7 months ago

Description of the feature request:

A web ui where a user can come and input his text to check for tokens and character.

What problem are you trying to solve with this feature?

This would help the user to check his character count. In fine tuning a model in maker suite the output should be less than 5000 character. This way the user can open the webapp and past his output o check for characters.

Any other information you'd like to share?

https://platform.openai.com/tokenizer U can check this for reference. Something like this for palm api would be fantastic.

markmcd commented 7 months ago

Cool idea - ideally we would host something on the site, but it would also be helpful to have a Glitch project or similar that does this (it could go in /examples/palm/glitch or similar)

omkharche8 commented 1 month ago

Is it solved yet???? I can do this As on 20/5/24 there is still no straight forward method of solving it