mlc-ai / tokenizers-cpp

Universal cross-platform tokenizers binding to HF and sentencepiece
Apache License 2.0
211 stars 47 forks source link

msgpack as 3rdparty library instead of fetch_context #15

Closed BBuf closed 10 months ago

BBuf commented 10 months ago

图片

junrushao commented 10 months ago

Thanks for taking swift actions!!