Unit tests in runtests.jl should use a tiny (as small as possible for testing) language model to run tests on.
A tiny model with all params set to zero should be possible to compress to a very small size and commited directly to this repo. Then running tests doesn't require any kind of download.
Unit tests in runtests.jl should use a tiny (as small as possible for testing) language model to run tests on.
A tiny model with all params set to zero should be possible to compress to a very small size and commited directly to this repo. Then running tests doesn't require any kind of download.
Note: 100 MB models seem to be available
https://www.reddit.com/r/LocalLLaMA/comments/12vu0uz/minimal_ggml_file_or_are_there_any_tinytoy_models/