freelawproject / courtlistener

A fully-searchable and accessible archive of court data including growing repositories of opinions, oral arguments, judges, judicial financial records, and federal filings.
https://www.courtlistener.com
Other
550 stars 151 forks source link

Remove obsolete cron commands #4697

Closed mlissner closed 3 days ago

mlissner commented 6 days ago

We used to use pagerank to rank our search results in Solr, but when we moved from a single server to multiple (years ago!), it got harder because application code on one server would generate a ranking file, and then the other server (hosting Solr) would have to load it.

That was fine when our servers were in a data center (shared NFS), but when we moved to AWS, it got harder and I didn't bother figuring it out. It turns out that pagerank isn't great for ranking legal stuff anyway!

But, weirdly, we had code to generate the ranking file, and we had a cronjob calling that code — until now. I just updated k8s to remove the cronjob (sigh), and this PR removes the code for generating the ranking file.

Removals include:

I also slipped in some tweaks to the settings to block a few users. Someday we should make this possible without changes to the code. Someday!

mlissner commented 6 days ago

I just added one more commit to remove two commands related to donations that we don't need anymore. Bye! 👋🏻