search

freelawproject / courtlistener

A fully-searchable and accessible archive of court data including growing repositories of opinions, oral arguments, judges, judicial financial records, and federal filings.
https://www.courtlistener.com
Other
550 stars 151 forks source link

Recap-into-Opinions - Index needs cleanup #4642

Open flooie opened 2 weeks ago

flooie commented 2 weeks ago

Once we have finished the recap into opinions ingestion pipeline and back import we should remove the DB index we created.

mlissner commented 2 weeks ago

We have a habit of not getting back to things until we don't know what they mean. Can you link back to where we talk about this so we remember which index it is and can delete it properly?

ERosendo commented 2 weeks ago

Can you link back to where we talk about this so we remember which index it is and can delete it properly?

@mlissner The original comment about the index we need to delete is here:

https://github.com/freelawproject/courtlistener/pull/4116#pullrequestreview-2121611999

I apologize for not properly cleaning up the replica after the command finished execution.

The original plan was to create a single index to improve query speed. However, after monitoring performance, we realized that this approach was not enough. To optimize the queries, we had to create two indexes instead of one:

mlissner commented 2 weeks ago

Got it. @flooie, can we make this a sub-issue of the issue to do recap-into-opinions, so we can keep them together, please?