mrousavy / react-native-fast-tflite

🔥 High-performance TensorFlow Lite library for React Native with GPU acceleration
https://mrousavy.com
MIT License
742 stars 41 forks source link

How do you tokenize in react-native? #115

Closed liveakshay closed 2 days ago

liveakshay commented 2 days ago

I am trying to use pre-trained MobileBERT in react-native expo app (which I've exported to a TFLite model file). I've installed your library, and so far its all good except I can't figure out which library I can use to tokenize my input text. Any guidance/suggestion?

maintenance-hans[bot] commented 2 days ago

Guten Tag, Hans here.

It looks like your question is not directly related to an issue with the react-native-fast-tflite library. Tokenization is typically handled by separate libraries. For your case, you might want to check out libraries like @tensorflow/tfjs, tokenizers, or huggingface/tokenizers that can help with MobileBERT.

If you have a specific issue with the library, please provide more detailed information or use the proper issue template. If you would like quicker responses, consider supporting the project: Sponsor mrousavy. 🍻

Note: If you think I made a mistake by closing this issue, please ping @mrousavy to take a look.