opea-project / GenAIExamples

Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.
https://opea.dev
Apache License 2.0
256 stars 180 forks source link

setup ollama service in aipc docker compose #1008

Closed RuijingGuo closed 1 week ago

RuijingGuo commented 1 week ago

Description

setup ollama service in aipc docker compose

Issues

List the issue or RFC link this PR is working on. If there is no such link, please mark it as n/a.

Type of change

List the type of change like below. Please delete options that are not relevant.

Dependencies

List the newly introduced 3rd party dependency if exists. n/a

Tests

  1. docker compose up -d
  2. curl http://${host_ip}:11434/api/generate -d '{"model": "llama3.2", "prompt":"What is Deep Learning?"}' 3.docker compose down