search

coolbutuseless / rllama

Minimal R wrapper for llama.cpp
MIT License
55 stars 4 forks source link

keep this up to date with llama.cpp #3

Open MichelNivard opened 1 year ago

MichelNivard commented 1 year ago

Hi, do you think I can just drop newer versions of llama.cpp, ggml.h ggml.c etc into src to keep this up to date with llama.cpp? Or is there more too it?

gregleleu commented 12 months ago

Happy to help on this, but same question

coolbutuseless commented 11 months ago

I think there will need to be some changes to the wrapper code for newer versions to work. I.e. there have probably been changes to the model format in addition to C API changes.

I don't have time to make this package a priority right now.

MIT license for this package means I'm very happy for others to fork and adapt instead of waiting for me to finish all my other projects :)