How can I increase n_max_tokens?

skeskinen / bert.cpp

ggml implementation of BERT

MIT License

463 stars 58 forks source link

How can I increase n_max_tokens? #43

Open ztkg257 opened 7 months ago

ztkg257 commented 7 months ago

After modifying the value of n_max_tokens in bert.cpp from "int32_t n_max_tokens = 512;" to "int32_t n_max_tokens = 10000;", I proceeded to rebuild the project. However, upon testing, the value of n_max_tokens remained unchanged at 512 despite the modification.

skeskinen commented 7 months ago

max tokens is a property of the loaded model. Different models might have different values.