search

premAI-io / prem-services

AI Services Maintained by Prem Core Team.
MIT License
6 stars 8 forks source link

Serve most famous ggml models #58

Closed filopedraz closed 1 year ago

filopedraz commented 1 year ago

Description

Probably same interface and multiple docker images.

filopedraz commented 1 year ago

Llama.cpp support GPU and they have an "official" docker image for that. We should look into that.