search

oughtinc / ice

Interactive Composition Explorer: a debugger for compositional language model programs
https://ice.ought.org
MIT License
533 stars 67 forks source link

Add some light documentation #251

Closed smithjessk closed 1 year ago

smithjessk commented 1 year ago

Just a small PR to add some documentation for things that I found interesting when reading the code. :)

smithjessk commented 1 year ago

I noticed that there are lots of HEAD requests. These are used to determine the length of the static trace files.

It is possible and permitted, although I don't know if it's common, to append values to a trace after it already exists. That's why we can't cache getContentLength. Is all this true? Am I missing any important considerations?

lslunis commented 1 year ago

I noticed that there are lots of HEAD requests. These are used to determine the length of the static trace files.

It is possible and permitted, although I don't know if it's common, to append values to a trace after it already exists. That's why we can't cache getContentLength. Is all this true? Am I missing any important considerations?

Discussed off-thread. Summary: It's common to append to a trace after it already exists, but this whole mechanism of doing fake streaming ought to be replaced.

stuhlmueller commented 1 year ago

Closing for now, feel free to reopen.