Open wwolff7 opened 5 months ago
I'm not sure, could you try the following?
Run (setq gptel--debug t)
Produce the above error, and paste the contents of the response buffer that pops up, as well as whatever is logged to the echo area.
I ran into the same issue and i looked a bit into it. First of all, the first usage of gptel-send for ollama is always successful for me. Only using it again causes the 100 Continue issue.
Here is the "gptel-curl" buffer when the parsing start
HTTP/1.1 100 Continue
HTTP/1.1 200 OK
Content-Type: application/json; charset=utf-8
Date: Sat, 02 Mar 2024 15:30:58 GMT
Transfer-Encoding: chunked
{"model":"codellama:7b","created_at":"2024-03-02T15:30:58.310457552Z","response":"\nHere are some tips for debugging Emacs:
so a quick fix for me at the moment is extending (equal http-status "200")
to (or (equal http-status "100") (equal http-status "200"))
in gptel-curl--parse-response
I hope this helps in fixing the thing properly. (BTW, many thanks for this package!!!)
@MarselScheer Thank you for the clear bug report! I've fixed it, but in a rather brittle way. I would like to know if it works correctly now before making a more comprehensive fix.
url-retrieve
path with (setq gptel-use-curl nil)
?I don't have access to a GPU or Ollama right now, so I can't test it myself.
No worries. It is more than fair that you code and I test :-)
With respect to "1. Please test"
In order to follow and realize that my tests are not good. Here is what i did:
(use-package gptel
:straight (gptel :type git :host github :repo "karthink/gptel" :commit 199595b)
:config
(setq-default
gptel-model "codellama:7b"
gptel-backend (gptel-make-ollama "Ollama"
:host "ollama:11434"
:stream nil
:models '("codellama:7b")))
(setq gptel-log-level 'debug)
)
I double checked that I see your changes from the commit also locally.
Then I used C-c RET multiple times in various buffers and within "M-x gptel" i had longer conversations. Everything worked.
After that i set ":stream t" and repeated the excerise. Everything worked, though the message buffer show error in process filter: Search failed: "^{" [2 times]
.
With respect to "2. Could you also test the url-retrieve path with (setq gptel-use-curl nil)?" I must admit that I dont understand what i should do? Can you elaborate on that a bit?
Thanks for testing!
After that i set ":stream t" and repeated the excerise. Everything worked, though the message buffer show
error in process filter: Search failed: "^{" [2 times]
.
That's interesting. Could you paste the log here? Here's how you access it:
M-: (setq gptel-log-level 'debug)
. (M-:
runs the command eval-expression
, and you type in or paste the lisp expression at the prompt.)*gptel-log*
and paste its contents here.With respect to "2. Could you also test the url-retrieve path with (setq gptel-use-curl nil)?" I must admit that I dont understand what i should do? Can you elaborate on that a bit?
Similar to the above,
M-: (setq gptel-use-curl nil)
.I think the error error in process filter: Search failed: "^{" [2 times]
is associated with "free text" that is returned. Because being in M-x gptel
and only demanding code back like here
### hello world in python. only code
...
### and now in rust. again only code
...
### and in fortran. only code
...
###
i do not get the error.
Here a gptel-log that led to the error on the 2nd prompt while being in M-x gptel
:
{
"gptel": "request headers",
"timestamp": "2024-03-09 05:39:09"
}
{
"Content-Type": "application/json"
}
{
"gptel": "request body",
"timestamp": "2024-03-09 05:39:09"
}
{
"model": "codellama:7b",
"system": "You are a large language model living in Emacs and a helpful assistant. Respond concisely.",
"prompt": "hash a file in python",
"stream": true
}
{
"gptel": "request Curl command",
"timestamp": "2024-03-09 05:39:09"
}
[
"curl",
"--disable",
"--location",
"--silent",
"--compressed",
"-XPOST",
"-y300",
"-Y1",
"-D-",
"-w(f8c2566559e71ee3485c72491dc45a51 . %{size_header})",
"-d{\"model\":\"codellama:7b\",\"system\":\"You are a large language model living in Emacs and a helpful assistant. Respond concisely.\",\"prompt\":\"hash a file in python\",\"stream\":true}",
"-HContent-Type: application/json",
"http://ollama:11434/api/generate"
]
{
"gptel": "response headers",
"timestamp": "2024-03-09 05:39:12"
}
"HTTP/1.1 200 OK\r\nContent-Type: application/x-ndjson\r\nDate: Sat, 09 Mar 2024 05:39:10 GMT\r\nTransfer-Encoding: chunked\r\n\r"
{
"gptel": "response body",
"timestamp": "2024-03-09 05:39:12"
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.080958531Z",
"response": "To",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.094483994Z",
"response": " hash",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.108040903Z",
"response": " a",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.120928306Z",
"response": " file",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.133758526Z",
"response": " in",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.147005272Z",
"response": " Python",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.159911107Z",
"response": ",",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.172820416Z",
"response": " you",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.185686771Z",
"response": " can",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.198654873Z",
"response": " use",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.211583184Z",
"response": " the",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.224430732Z",
"response": " `",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.237727304Z",
"response": "hash",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.25047022Z",
"response": "lib",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.263012324Z",
"response": "`",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.276307245Z",
"response": " module",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.2888542Z",
"response": ".",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.301391845Z",
"response": " Here",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.314189497Z",
"response": "'",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.326792998Z",
"response": "s",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.339414281Z",
"response": " an",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.352374189Z",
"response": " example",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.365095322Z",
"response": " of",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.377714197Z",
"response": " how",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.39039408Z",
"response": " to",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.403233862Z",
"response": " use",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.415838847Z",
"response": " it",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.428502075Z",
"response": ":",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.441529378Z",
"response": "\n",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.454160745Z",
"response": "```",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.466769582Z",
"response": "\n",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.480193202Z",
"response": "import",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.49318427Z",
"response": " hash",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.505813988Z",
"response": "lib",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.518490493Z",
"response": "\n",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.531141548Z",
"response": "\n",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.544228313Z",
"response": "with",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.556893637Z",
"response": " open",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.569581907Z",
"response": "('",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.582187783Z",
"response": "file",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.595235145Z",
"response": ".",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.607917705Z",
"response": "txt",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.620538408Z",
"response": "',",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.63319568Z",
"response": " '",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.646247779Z",
"response": "rb",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.658866043Z",
"response": "')",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.671528408Z",
"response": " as",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.68419372Z",
"response": " f",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.697180889Z",
"response": ":",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.70985958Z",
"response": "\n",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.722476121Z",
"response": " ",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.73510217Z",
"response": " data",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.748175705Z",
"response": " =",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.760909251Z",
"response": " f",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.773556476Z",
"response": ".",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.786248316Z",
"response": "read",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.79893864Z",
"response": "()",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.81172492Z",
"response": "\n",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.824653089Z",
"response": " ",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.837520816Z",
"response": " print",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.85033679Z",
"response": "(",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.863033062Z",
"response": "hash",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.875738008Z",
"response": "lib",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.888433583Z",
"response": ".",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.901154499Z",
"response": "md",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.913820549Z",
"response": "5",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.926476581Z",
"response": "(",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.939124909Z",
"response": "data",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.951846869Z",
"response": ").",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.964558101Z",
"response": "hex",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.977254673Z",
"response": "dig",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:10.99036493Z",
"response": "est",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.00301159Z",
"response": "())",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.015692675Z",
"response": "\n",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.028345692Z",
"response": "```",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.041463086Z",
"response": "\n",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.054183148Z",
"response": "This",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.066862188Z",
"response": " code",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.079574013Z",
"response": " opens",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.092922472Z",
"response": " the",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.105583743Z",
"response": " file",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.118284296Z",
"response": " `",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.130984069Z",
"response": "file",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.144143653Z",
"response": ".",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.156993352Z",
"response": "txt",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.169929999Z",
"response": "`",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.182726937Z",
"response": " in",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.196102532Z",
"response": " binary",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.20894765Z",
"response": " mode",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.221758062Z",
"response": " (`",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.234588264Z",
"response": "'",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.248043029Z",
"response": "rb",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.260857858Z",
"response": "'`",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.273767357Z",
"response": "),",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.286633671Z",
"response": " reads",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.300006334Z",
"response": " its",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.312869275Z",
"response": " contents",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.325730786Z",
"response": " into",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.338553395Z",
"response": " a",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.352075817Z",
"response": " variable",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.364969936Z",
"response": " named",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.377805743Z",
"response": " `",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.390682709Z",
"response": "data",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.403862014Z",
"response": "`,",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.417473015Z",
"response": " and",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.430337258Z",
"response": " then",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.443221899Z",
"response": " uses",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.456041146Z",
"response": " the",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.469418852Z",
"response": " `",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.482987938Z",
"response": "md",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.495821237Z",
"response": "5",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.508691245Z",
"response": "`",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.521551835Z",
"response": " function",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.534574306Z",
"response": " from",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.547510966Z",
"response": " the",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.561478021Z",
"response": " `",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.574359519Z",
"response": "hash",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.587250605Z",
"response": "lib",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.600124857Z",
"response": "`",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.613731569Z",
"response": " module",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.626632474Z",
"response": " to",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.639513216Z",
"response": " calculate",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.652925141Z",
"response": " the",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.665805577Z",
"response": " MD",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.67939485Z",
"response": "5",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.692353508Z",
"response": " hash",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.705248515Z",
"response": " of",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.718092229Z",
"response": " the",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.730935668Z",
"response": " data",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.743904863Z",
"response": ".",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.756987136Z",
"response": " The",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.770086336Z",
"response": " resulting",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.783701117Z",
"response": " hash",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.796608398Z",
"response": " is",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.809521524Z",
"response": " printed",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.822420514Z",
"response": " as",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.835867519Z",
"response": " a",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.848758424Z",
"response": " hex",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.861667571Z",
"response": "ade",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.874568069Z",
"response": "c",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.888191086Z",
"response": "imal",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.90106913Z",
"response": " string",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.913947341Z",
"response": ".",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.926846928Z",
"response": "\n",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.940488617Z",
"response": "\n",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.953386481Z",
"response": "Note",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.966286998Z",
"response": " that",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.979158356Z",
"response": " this",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:11.992448605Z",
"response": " code",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.005402309Z",
"response": " assumes",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.018349664Z",
"response": " that",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.031243806Z",
"response": " you",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.044510969Z",
"response": " want",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.05807625Z",
"response": " to",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.070985099Z",
"response": " use",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.083917931Z",
"response": " the",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.096829734Z",
"response": " MD",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.110029911Z",
"response": "5",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.122968529Z",
"response": " algorithm",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.13590439Z",
"response": " to",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.148780638Z",
"response": " hash",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.162047293Z",
"response": " the",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.174953653Z",
"response": " file",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.187840696Z",
"response": ".",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.200710469Z",
"response": " If",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.213937278Z",
"response": " you",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.226824822Z",
"response": " want",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.239755239Z",
"response": " to",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.252665942Z",
"response": " use",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.265847101Z",
"response": " a",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.27877912Z",
"response": " different",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.291687297Z",
"response": " algorithm",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.304563372Z",
"response": ",",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.317727669Z",
"response": " you",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.330638281Z",
"response": " can",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.343530535Z",
"response": " replace",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.356457266Z",
"response": " `",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.369766888Z",
"response": "md",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.382629629Z",
"response": "5",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.395553466Z",
"response": "`",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.408488412Z",
"response": " with",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.421764886Z",
"response": " the",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.434677882Z",
"response": " name",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.447592251Z",
"response": " of",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.460476048Z",
"response": " the",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.473760867Z",
"response": " algorithm",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.486677941Z",
"response": " you",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.499549247Z",
"response": " want",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.512481594Z",
"response": " to",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.525849722Z",
"response": " use",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.538738027Z",
"response": " (",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.55167467Z",
"response": "e",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.565001264Z",
"response": ".",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.577953063Z",
"response": "g",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.59087902Z",
"response": ".,",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.603807395Z",
"response": " `",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.617191598Z",
"response": "sha",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.630126887Z",
"response": "2",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.643185309Z",
"response": "5",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.656069842Z",
"response": "6",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.669529011Z",
"response": "`,",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.682442685Z",
"response": " `",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.697010667Z",
"response": "sha",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.709935521Z",
"response": "5",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.722883906Z",
"response": "1",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.735806396Z",
"response": "2",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.749250351Z",
"response": "`,",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.762167529Z",
"response": " etc",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.775096066Z",
"response": ".).",
"done": false
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T05:39:12.788059285Z",
"response": "",
"done": true,
"context": [
518,
25580,
29962,
3532,
14816,
29903,
6778,
3492,
526,
263,
2919,
4086,
1904,
8471,
297,
2812,
16815,
322,
263,
8444,
20255,
29889,
2538,
2818,
3022,
275,
873,
19423,
829,
14816,
29903,
6778,
13,
13,
8568,
263,
934,
297,
3017,
518,
29914,
25580,
29962,
13,
1762,
6608,
263,
934,
297,
5132,
29892,
366,
508,
671,
278,
421,
8568,
1982,
29952,
3883,
29889,
2266,
29915,
29879,
385,
1342,
310,
920,
304,
671,
372,
29901,
13,
28956,
13,
5215,
6608,
1982,
13,
13,
2541,
1722,
877,
1445,
29889,
3945,
742,
525,
6050,
1495,
408,
285,
29901,
13,
1678,
848,
353,
285,
29889,
949,
580,
13,
1678,
1596,
29898,
8568,
1982,
29889,
3487,
29945,
29898,
1272,
467,
20970,
7501,
342,
3101,
13,
28956,
13,
4013,
775,
13246,
278,
934,
421,
1445,
29889,
3945,
29952,
297,
7581,
4464,
6695,
29915,
6050,
11120,
511,
13623,
967,
8118,
964,
263,
2286,
4257,
421,
1272,
1673,
322,
769,
3913,
278,
421,
3487,
29945,
29952,
740,
515,
278,
421,
8568,
1982,
29952,
3883,
304,
8147,
278,
20672,
29945,
6608,
310,
278,
848,
29889,
450,
9819,
6608,
338,
13350,
408,
263,
15090,
1943,
29883,
3039,
1347,
29889,
13,
13,
9842,
393,
445,
775,
15894,
393,
366,
864,
304,
671,
278,
20672,
29945,
5687,
304,
6608,
278,
934,
29889,
960,
366,
864,
304,
671,
263,
1422,
5687,
29892,
366,
508,
5191,
421,
3487,
29945,
29952,
411,
278,
1024,
310,
278,
5687,
366,
864,
304,
671,
313,
29872,
29889,
29887,
1696,
421,
17051,
29906,
29945,
29953,
1673,
421,
17051,
29945,
29896,
29906,
1673,
2992,
6250
],
"total_duration": 2809592474,
"load_duration": 204194,
"prompt_eval_count": 44,
"prompt_eval_duration": 102036000,
"eval_count": 210,
"eval_duration": 2707068000
}
{
"gptel": "request headers",
"timestamp": "2024-03-09 05:39:25"
}
{
"Content-Type": "application/json"
}
{
"gptel": "request body",
"timestamp": "2024-03-09 05:39:25"
}
{
"model": "codellama:7b",
"system": "You are a large language model living in Emacs and a helpful assistant. Respond concisely.",
"prompt": "is hashlib a builtin package?",
"stream": true,
"context": [
518,
25580,
29962,
3532,
14816,
29903,
6778,
3492,
526,
263,
2919,
4086,
1904,
8471,
297,
2812,
16815,
322,
263,
8444,
20255,
29889,
2538,
2818,
3022,
275,
873,
19423,
829,
14816,
29903,
6778,
13,
13,
8568,
263,
934,
297,
3017,
518,
29914,
25580,
29962,
13,
1762,
6608,
263,
934,
297,
5132,
29892,
366,
508,
671,
278,
421,
8568,
1982,
29952,
3883,
29889,
2266,
29915,
29879,
385,
1342,
310,
920,
304,
671,
372,
29901,
13,
28956,
13,
5215,
6608,
1982,
13,
13,
2541,
1722,
877,
1445,
29889,
3945,
742,
525,
6050,
1495,
408,
285,
29901,
13,
1678,
848,
353,
285,
29889,
949,
580,
13,
1678,
1596,
29898,
8568,
1982,
29889,
3487,
29945,
29898,
1272,
467,
20970,
7501,
342,
3101,
13,
28956,
13,
4013,
775,
13246,
278,
934,
421,
1445,
29889,
3945,
29952,
297,
7581,
4464,
6695,
29915,
6050,
11120,
511,
13623,
967,
8118,
964,
263,
2286,
4257,
421,
1272,
1673,
322,
769,
3913,
278,
421,
3487,
29945,
29952,
740,
515,
278,
421,
8568,
1982,
29952,
3883,
304,
8147,
278,
20672,
29945,
6608,
310,
278,
848,
29889,
450,
9819,
6608,
338,
13350,
408,
263,
15090,
1943,
29883,
3039,
1347,
29889,
13,
13,
9842,
393,
445,
775,
15894,
393,
366,
864,
304,
671,
278,
20672,
29945,
5687,
304,
6608,
278,
934,
29889,
960,
366,
864,
304,
671,
263,
1422,
5687,
29892,
366,
508,
5191,
421,
3487,
29945,
29952,
411,
278,
1024,
310,
278,
5687,
366,
864,
304,
671,
313,
29872,
29889,
29887,
1696,
421,
17051,
29906,
29945,
29953,
1673,
421,
17051,
29945,
29896,
29906,
1673,
2992,
6250
]
}
{
"gptel": "request Curl command",
"timestamp": "2024-03-09 05:39:25"
}
[
"curl",
"--disable",
"--location",
"--silent",
"--compressed",
"-XPOST",
"-y300",
"-Y1",
"-D-",
"-w(67af6981e62ec1a6382bfc1b1d07642d . %{size_header})",
"-d{\"model\":\"codellama:7b\",\"system\":\"You are a large language model living in Emacs and a helpful assistant. Respond concisely.\",\"prompt\":\"is hashlib a builtin package?\",\"stream\":true,\"context\":[518,25580,29962,3532,14816,29903,6778,3492,526,263,2919,4086,1904,8471,297,2812,16815,322,263,8444,20255,29889,2538,2818,3022,275,873,19423,829,14816,29903,6778,13,13,8568,263,934,297,3017,518,29914,25580,29962,13,1762,6608,263,934,297,5132,29892,366,508,671,278,421,8568,1982,29952,3883,29889,2266,29915,29879,385,1342,310,920,304,671,372,29901,13,28956,13,5215,6608,1982,13,13,2541,1722,877,1445,29889,3945,742,525,6050,1495,408,285,29901,13,1678,848,353,285,29889,949,580,13,1678,1596,29898,8568,1982,29889,3487,29945,29898,1272,467,20970,7501,342,3101,13,28956,13,4013,775,13246,278,934,421,1445,29889,3945,29952,297,7581,4464,6695,29915,6050,11120,511,13623,967,8118,964,263,2286,4257,421,1272,1673,322,769,3913,278,421,3487,29945,29952,740,515,278,421,8568,1982,29952,3883,304,8147,278,20672,29945,6608,310,278,848,29889,450,9819,6608,338,13350,408,263,15090,1943,29883,3039,1347,29889,13,13,9842,393,445,775,15894,393,366,864,304,671,278,20672,29945,5687,304,6608,278,934,29889,960,366,864,304,671,263,1422,5687,29892,366,508,5191,421,3487,29945,29952,411,278,1024,310,278,5687,366,864,304,671,313,29872,29889,29887,1696,421,17051,29906,29945,29953,1673,421,17051,29945,29896,29906,1673,2992,6250]}",
"-HContent-Type: application/json",
"http://ollama:11434/api/generate"
]
{
"gptel": "response headers",
"timestamp": "2024-03-09 05:39:26"
}
"HTTP/1.1 100 Continue\r\n\r"
{
"gptel": "response body",
"timestamp": "2024-03-09 05:39:26"
}
HTTP/1.1 200 OK
Content-Type: application/x-ndjson
Date: Sat, 09 Mar 2024 05:39:26 GMT
Transfer-Encoding: chunked
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.088535021Z","response":"Yes","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.101790944Z","response":",","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.115034294Z","response":" `","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.128177144Z","response":"hash","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.141297927Z","response":"lib","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.15443618Z","response":"`","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.1675626Z","response":" is","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.180695107Z","response":" a","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.193841346Z","response":" built","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.207027537Z","response":"-","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.220210608Z","response":"in","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.233323638Z","response":" package","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.246452209Z","response":" in","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.259568743Z","response":" Python","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.2726901Z","response":".","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.285823123Z","response":" It","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.29893061Z","response":" provides","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.312083279Z","response":" a","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.325216389Z","response":" convenient","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.338401822Z","response":" way","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.351595603Z","response":" to","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.364755378Z","response":" calculate","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.377932336Z","response":" various","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.391114341Z","response":" types","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.40431126Z","response":" of","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.41748964Z","response":" hash","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.430646161Z","response":"es","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.443825829Z","response":" for","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.457026582Z","response":" data","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.470205621Z","response":",","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.48338165Z","response":" such","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.49656575Z","response":" as","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.509861369Z","response":" MD","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.523038299Z","response":"5","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.536236489Z","response":",","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.549411629Z","response":" S","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.562588929Z","response":"HA","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.575782269Z","response":"2","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.588971112Z","response":"5","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.602146823Z","response":"6","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.615379243Z","response":",","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.628573927Z","response":" and","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.641760007Z","response":" more","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.65495159Z","response":".","done":false}
{"model":"codellama:7b","created_at":"2024-03-09T05:39:26.66837472Z","response":"","done":true,"context":[518,25580,29962,3532,14816,29903,6778,3492,526,263,2919,4086,1904,8471,297,2812,16815,322,263,8444,20255,29889,2538,2818,3022,275,873,19423,829,14816,29903,6778,13,13,8568,263,934,297,3017,518,29914,25580,29962,13,1762,6608,263,934,297,5132,29892,366,508,671,278,421,8568,1982,29952,3883,29889,2266,29915,29879,385,1342,310,920,304,671,372,29901,13,28956,13,5215,6608,1982,13,13,2541,1722,877,1445,29889,3945,742,525,6050,1495,408,285,29901,13,1678,848,353,285,29889,949,580,13,1678,1596,29898,8568,1982,29889,3487,29945,29898,1272,467,20970,7501,342,3101,13,28956,13,4013,775,13246,278,934,421,1445,29889,3945,29952,297,7581,4464,6695,29915,6050,11120,511,13623,967,8118,964,263,2286,4257,421,1272,1673,322,769,3913,278,421,3487,29945,29952,740,515,278,421,8568,1982,29952,3883,304,8147,278,20672,29945,6608,310,278,848,29889,450,9819,6608,338,13350,408,263,15090,1943,29883,3039,1347,29889,13,13,9842,393,445,775,15894,393,366,864,304,671,278,20672,29945,5687,304,6608,278,934,29889,960,366,864,304,671,263,1422,5687,29892,366,508,5191,421,3487,29945,29952,411,278,1024,310,278,5687,366,864,304,671,313,29872,29889,29887,1696,421,17051,29906,29945,29953,1673,421,17051,29945,29896,29906,1673,2992,6250,518,25580,29962,3532,14816,29903,6778,3492,526,263,2919,4086,1904,8471,297,2812,16815,322,263,8444,20255,29889,2538,2818,3022,275,873,19423,829,14816,29903,6778,13,13,275,6608,1982,263,4240,262,3577,29973,518,29914,25580,29962,13,8241,29892,421,8568,1982,29952,338,263,4240,29899,262,3577,297,5132,29889,739,8128,263,19192,982,304,8147,5164,4072,310,6608,267,363,848,29892,1316,408,20672,29945,29892,317,15715,29906,29945,29953,29892,322,901,29889],"total_duration":837501575,"load_duration":353983,"prompt_eval_count":301,"prompt_eval_duration":256907000,"eval_count":45,"eval_duration":579649000}
If I set (setq gptel-use-curl nil)
, then M-x gptel
get stuck with the message "Ollama waiting ..."
Here the corresponding gptel-log:
{
"gptel": "request headers",
"timestamp": "2024-03-09 06:01:01"
}
{
"Content-Type": "application/json"
}
{
"gptel": "request body",
"timestamp": "2024-03-09 06:01:01"
}
{
"model": "codellama:7b",
"system": "You are a large language model living in Emacs and a helpful assistant. Respond concisely.",
"prompt": "hello world in elisp",
"stream": false
}
{
"gptel": "response headers",
"timestamp": "2024-03-09 06:01:01"
}
"HTTP/1.1 200 OK\nContent-Type: application/json; charset=utf-8\nDate: Sat, 09 Mar 2024 06:01:01 GMT\nContent-Length: 700\n"
{
"gptel": "response body",
"timestamp": "2024-03-09 06:01:01"
}
{
"model": "codellama:7b",
"created_at": "2024-03-09T06:01:01.752914022Z",
"response": "```elisp\n(defun hello-world ()\n (interactive)\n (message \"Hello, World!\"))\n```",
"done": true,
"context": [
518,
25580,
29962,
3532,
14816,
29903,
6778,
3492,
526,
263,
2919,
4086,
1904,
8471,
297,
2812,
16815,
322,
263,
8444,
20255,
29889,
2538,
2818,
3022,
275,
873,
19423,
829,
14816,
29903,
6778,
13,
13,
12199,
3186,
297,
560,
11936,
518,
29914,
25580,
29962,
13,
28956,
295,
11936,
13,
29898,
1753,
348,
22172,
29899,
11526,
3861,
13,
29871,
313,
1639,
4925,
29897,
13,
29871,
313,
4906,
376,
10994,
29892,
2787,
3850,
876,
13,
28956
],
"total_duration": 469830028,
"load_duration": 220673,
"prompt_eval_count": 10,
"prompt_eval_duration": 98183000,
"eval_count": 30,
"eval_duration": 371095000
}
Hello, I am trying to use ollama backend in gptel, but I am getting "HTTP/1.1 100 Continue" after first question. How to fix that? I am using emacs 29.1, gptel installed via melpa, and ubuntu 20.04. Following a screenshot too: