search

quarkiverse / quarkus-langchain4j

Quarkus Langchain4j extension
https://docs.quarkiverse.io/quarkus-langchain4j/dev/index.html
Apache License 2.0
115 stars 64 forks source link

Allow ollama devservices to run with docker gpus #684

Closed Malandril closed 6 days ago

Malandril commented 2 weeks ago

This adds a configuration to the ollama devservices to allow the started container to request gpus.

maxandersen commented 2 weeks ago

Nice. Which os platforms and container runtimes supports this?

geoand commented 2 weeks ago

Thanks for the contribution.

This module is actually on the way out because we now have non-docker based Ollama support.