search

nelhage / llama

Apache License 2.0
589 stars 24 forks source link

Use a local tempfile for preprocessed output. #46

Closed jpeach closed 3 years ago

jpeach commented 3 years ago

Preprocessed output tends to be quite large, often multiple megabytes. Rather than transferring it over the RPC interface, use a tempfile so that the server doesn't use a lot of memory uneccessarily.

This updates #45.

nelhage commented 3 years ago

Nice, seems very reasonable.