laws-africa / peachjam

Project Peach Jam
https://agp.africanlii.org
GNU General Public License v3.0
2 stars 0 forks source link

Citation re-extraction is too aggressive #1593

Open longhotsummer opened 10 months ago

longhotsummer commented 10 months ago

We currently (optionally) automatically re-extract citations on newer documents when an older document is added. Right now, with lots of historical imports, this lands up being too aggressive. It queues up a large number of background tasks (particularly in a large LII like TZ), which block other tasks.

We need to re-think this, particularly for larger LIIs. Some ideas:

Without this functionality, when an older document is added, we won't automatically extract citations to that document in newer documents. This is particularly a problem for judgments that don't use a formal MNC (ie. use a third party citation, or a party-based citation).

longhotsummer commented 3 months ago

https://github.com/laws-africa/peachjam/pull/1828 changes this to run weekly