Open ichandan2151 opened 7 months ago
Cool idea - ideally we would host something on the site, but it would also be helpful to have a Glitch project or similar that does this (it could go in /examples/palm/glitch or similar)
Is it solved yet???? I can do this As on 20/5/24 there is still no straight forward method of solving it
Description of the feature request:
A web ui where a user can come and input his text to check for tokens and character.
What problem are you trying to solve with this feature?
This would help the user to check his character count. In fine tuning a model in maker suite the output should be less than 5000 character. This way the user can open the webapp and past his output o check for characters.
Any other information you'd like to share?
https://platform.openai.com/tokenizer U can check this for reference. Something like this for palm api would be fantastic.