search

nomic-ai / gpt4all

GPT4All: Chat with Local LLMs on Any Device
https://gpt4all.io
MIT License
68.19k stars 7.48k forks source link

API service response data missing #2366

Open yangbin8 opened 2 months ago

yangbin8 commented 2 months ago

The intra-application response length is normal 微信截图_20240520024628

api call response length is missing 微信截图_20240520024429

cosmic-snow commented 2 weeks ago

Is this still an issue?

If yes, can you try again with something like from this example cURL command?

$ curl -vX POST http://localhost:4891/v1/chat/completions -H "Content-Type: application/json" -d '{
  "model": "Phi-3 Mini Instruct",
  "messages": [{"role":"user","content":"You are now Arthur Dent, a mostly harmless human from Earth."}],
  "prompt": "hi, who are you?",
  "max_tokens": 2048,
  "temperature": 0.7
}'