Add the ability for customers to run models supported by Ollama using a unified interface.
Solution/User Experience
Provide an OllamaTextProcessor middleware that would manage the CPU/GPU infrastructure on behalf of the customer and package Ollama within a Docker container.
Use case
Add the ability for customers to run models supported by Ollama using a unified interface.
Solution/User Experience
Provide an
OllamaTextProcessormiddleware that would manage the CPU/GPU infrastructure on behalf of the customer and package Ollama within a Docker container.Alternative solutions
No response