search

hwchase17 / notion-qa

MIT License
2.13k stars 376 forks source link

Added tiktoken to requirements.txt #29

Closed fizahkhalid closed 1 year ago

fizahkhalid commented 1 year ago

tiktoken Python package is needed in get_num_tokens function, to determine the length of the prompt in langchain library.

yixin0829 commented 1 year ago

encountered the same issue. Think this is good addition.

mmabrouk commented 1 year ago

Same issue here, adding tiktoken solved it!