search

google / sentencepiece

Unsupervised text tokenizer for Neural Network-based text generation.
Apache License 2.0
10.07k stars 1.16k forks source link

No typings in Python package #1030

Open marcospgp opened 2 months ago

marcospgp commented 2 months ago

Sentencepiece has no typing information, which makes it hard to work with. For example:

image image