Klimatbyran / garbo

1 stars 5 forks source link

Consider removing paragraphs from some jobs to reduce memory usage #176

Open Greenheart opened 1 week ago

Greenheart commented 1 week ago

@irony mentioned some jobs might need paragraphs (the raw PDF content) to handle retries, but in the later steps it could be enough to work with the result from earlier steps.

Before making this change, we need to find which steps need the paragraphs as context and which ones can run without it.