search

xorbitsai / inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
https://inference.readthedocs.io
Apache License 2.0
5.56k stars 457 forks source link

rerank模型不返回document信息 #2566

Open mengxianglong123 opened 1 week ago

mengxianglong123 commented 1 week ago

System Info / 系統信息

Ubuntu 22

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？

Version info / 版本信息

v0.16.1

The command used to start Xinference / 用以启动 xinference 的命令

xinference-local --host 0.0.0.0 --port 9997

Reproduction / 复现过程

  1. 启动rerank模型
  2. 按照官网文档调用接口

Expected behavior / 期待表现

document字段有内容，但是实际为null

mengxianglong123 commented 1 week ago

参考的命令如下

curl -X 'POST' \
  'http://<XINFERENCE_HOST>:<XINFERENCE_PORT>/v1/rerank' \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "<MODEL_UID>",
    "query": "A man is eating pasta.",
    "documents": [
        "A man is eating food.",
        "A man is eating a piece of bread.",
        "The girl is carrying a baby.",
        "A man is riding a horse.",
        "A woman is playing violin."
    ]
  }'