Closed danbev closed 9 months ago
LGTM, does this require #[tokio::main(flavor = "multi_thread", worker_threads = 1)]?
LGTM, does this require #[tokio::main(flavor = "multi_thread", worker_threads = 1)]?
Yes, it requires that the flavor is multi_thread
which I believe is the default, so it would also be possible to just specify #[tokio::main]
. I just though having it explicit might be helpful in the example, but I'd be happy to change this.
This commit changes the
LLamaTokenizer
to usetokio::task::block_in_place
in an attempt avoid the following error:Fixes: https://github.com/sobelio/llm-chain/issues/211