Closed sunnyregion closed 10 months ago
llama2.rs$ tree src src ├── constants.rs ├── gptq_cuda.rs ├── gptq.ptx ├── gptq.rs ├── gptq_test.rs ├── inference.rs ├── kernel.py ├── lib.rs ├── main.rs ├── models.rs ├── tokenizer.rs └── util.rs
0 directories, 12 files
good catch, missed a file. Should be fixed now, let me check the CI.
thx a lot
use crate::model::TransformerWeights; | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ no
TransformerWeights
inmodel