Set value of TOKENIZERS_CPP_CARGO_TARGET based on ANDROID_ABI

mlc-ai / tokenizers-cpp

Universal cross-platform tokenizers binding to HF and sentencepiece

Apache License 2.0

211 stars 47 forks source link

Closed yuxuanchiadm closed 3 months ago

yuxuanchiadm commented 3 months ago

Allow compile to other Android ABI target

tqchen commented 3 months ago

Thanks @yuxuanchiadm