google / sentencepiece

Unsupervised text tokenizer for Neural Network-based text generation.
Apache License 2.0
10.07k stars 1.16k forks source link

debloat the cmakelists.txt and add a bunch of customization for building #1014

Open alexlnkp opened 3 months ago

alexlnkp commented 3 months ago

added options for choosing what to build and install. made out of wanting to not deal with 6 executables that are built every single time, also the fact that not all applications would even need to build training libraries. also, in case people wouldn't want the static libraries and would just want shared libs