utilityai / llama-cpp-rs

132 stars 42 forks source link

Crates.io Publish #444

Closed bigmstone closed 1 month ago

bigmstone commented 1 month ago

Latest few releases (since 0.1.64) have failed to publish to crates.io. I'm working with local fork, but can't run any Llama 3.1 models on currently published version.

MarcusDunn commented 1 month ago

good to know. I'll look into it.

MarcusDunn commented 1 month ago

looks like a couple files are missing from the sys "include" block.