songquanpeng / one-api

OpenAI 接口管理 & 分发系统,支持 Azure、Anthropic Claude、Google PaLM 2 & Gemini、智谱 ChatGLM、百度文心一言、讯飞星火认知、阿里通义千问、360 智脑以及腾讯混元,可用于二次分发管理 key,仅单可执行文件,已打包好 Docker 镜像,一键部署,开箱即用. OpenAI key management & redistribution system, using a single API for all LLMs, and features an English UI.
https://openai.justsong.cn/
MIT License
18.17k stars 4.11k forks source link

Ollama填写地址成功调用后,但是仍出现404现象 #1532

Closed Antony-Jia closed 3 months ago

Antony-Jia commented 3 months ago

例行检查

问题描述 使用最新版本的one-api和ollama后,在测试接口时,后台ollama已经出现了调用成功的标志,但是显示仍然是404 复现步骤 使用WSL2 docker compose部署产品添加测试后出现问题。我使用的是Qwen2模型,docker compose文件如下

version: '3.1'

services:
  ollama:
    container_name: ollama
    image: ollama/ollama
    ports:
      - "11434:11434"
    restart: always
    volumes:
      - ollama:/root/.ollama
    extra_hosts:
      - "host.docker.internal:host-gateway"
    networks:
      - aiwen-network
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: all
              capabilities: [ gpu ]

  paradedb:
    image: paradedb/paradedb:latest
    environment:
      POSTGRES_USER: ${POSTGRES_USER}  # Replace with your actual username
      POSTGRES_PASSWORD: ${POSTGRES_PASSWORD}  # Replace with your actual password
      POSTGRESQL_DATABASE: ${POSTGRES_DB}  # Replace with your desired database name
      POSTGRESQL_POSTGRES_PASSWORD: ${POSTGRES_PASSWORD}
    volumes:
      - paradedb_data:/bitnami/postgresql
    ports:
      - "5432:5432"
    #restart: always  # Ensure the container restarts if it exits unexpectedly
    networks:
      - aiwen-network

  oneapi:
    container_name: oneapi
    image: one-api:latest
    ports:
      - 3000:3000
    depends_on:
      - paradedb
    networks:
      - aiwen-network
    # restart: always
    environment:
      # mysql 连接参数
      - SQL_DSN=postgres://postgres:${POSTGRES_PASSWORD}@paradedb:5432/oneapi
      # 登录凭证加密密钥
      - SESSION_SECRET=oneapikey
      # 内存缓存
      - MEMORY_CACHE_ENABLED=true
      # 启动聚合更新,减少数据交互频率
      # - BATCH_UPDATE_ENABLED=true
      # 聚合更新时长
      # - BATCH_UPDATE_INTERVAL=10
      # 初始化的 root 密钥(建议部署完后更改,否则容易泄露)
      - INITIAL_ROOT_TOKEN=aiwen
      - TZ=Asia/Shanghai
    volumes:
      - oneapi:/data
    extra_hosts:
      - "host.docker.internal:host-gateway"

networks:
  aiwen-network:
    external: true
    name: aiwen-network

volumes:
  paradedb_data:
  ollama:
  oneapi:

预期结果

相关截图 image

如果没有的话,请删除此节。

Antony-Jia commented 3 months ago

问题找打了,因为没有适配Qwen2 7B模型,这个问题关闭了