search

SciSharp / LLamaSharp

A C#/.NET library to run LLM models (🦙LLaMA/LLaVA) on your local device efficiently.
https://scisharp.github.io/LLamaSharp
MIT License
2.02k stars 271 forks source link

Android Backend #695

Open AmSmart opened 3 weeks ago

AmSmart commented 3 weeks ago

I was trying to get this up and running with MAUI on Android but as far as I can tell, only desktop support is available for the time being. Will the maintainers be open to a PR that merges android CPU support in?

martindevans commented 3 weeks ago

Android support would be great!

If you're interested in working on it I'd suggest starting out by modifying compile.yml to produce Android binaries. That script is what we use to produce all of the binaries we distribute. Once that's merged we can start looking at what modifications are required for runtime support (if any).

AmSmart commented 2 weeks ago

Sounds good, I'll start working on this