MI-DPLA / combine

Combine /kämˌbīn/ - Metadata Aggregator Platform
MIT License
26 stars 11 forks source link

investigate moving most/all searchable tables from MySQL to ElasticSearch #225

Closed ghukill closed 5 years ago

ghukill commented 6 years ago

As Combine takes in more records, some tables are responsive, others less so.

A particularly egregious example of this is the Record table for testing screens. Given a search term, when Combine has 1m+, it becomes prohibitively slow, if not outright timeout error.

Same is true for other tables however, those that are using the Datatables connector to a MySQL view.

If this were tackled, this would serve to also address these issues:

ghukill commented 5 years ago

Closing - this has been partially addressed switching to Mongo, and other issues pertaining to ES for tables and searching.