search

mlc-ai / tokenizers-cpp

Universal cross-platform tokenizers binding to HF and sentencepiece
Apache License 2.0
211 stars 47 forks source link

Update CMakeLists.txt #2

Closed songkq closed 1 year ago

songkq commented 1 year ago

Add ${TOKENIZERS_C_LINK_LIBS} and append ${CMAKE_DL_LIBS} for Linux platform (https://github.com/mlc-ai/tokenizers-cpp/issues/1#issuecomment-1556206254)

tqchen commented 1 year ago

Thanks @songkq , made some followup comments on moving some of the deps to TOKENIZERS_C_LINK_LIBS then we are good to go