search

mlc-ai / tokenizers-cpp

Universal cross-platform tokenizers binding to HF and sentencepiece
Apache License 2.0
211 stars 47 forks source link

conflict with torch #30

Closed zhangyuhanjc closed 2 months ago

zhangyuhanjc commented 2 months ago

add torch dependency in cmakelist file in example will cause conflict

find_package(Torch REQUIRED) include_directories(${TORCH_INCLUDE_DIRS}) ... ... target_link_libraries(example PRIVATE ${TORCH_LIBRARIES})

image

tqchen commented 2 months ago

likely you dropped the tokenizers dependencies, you need to add both