scientist-softserv / louisville-hyku

Other

0 stars 0 forks source link

[2] Sidekiq #129

Closed orangewolf closed 1 year ago

orangewolf commented 1 year ago

Summary

Sidekiq performs at an unacceptable rate. Processing the OCR literally takes hours, and I've never actually seen a full importer complete 100% even when I scale up the worker pods.

Acceptance Criteria

[ ] Processing a single importer should not take 13+ hours

Sample File

(exact zip file is too large to attach)

Use the following server path instead:

/app/samvera/hyrax-webapp/tmp/originals/Luma_Burt/smaller_Burt_PDF.csv

Sample Bulkrax Import (Staging) -

http://lv-hyku-staging.notch8.cloud/importers/22?locale=en

Screenshot

orangewolf commented 1 year ago

Shana March 2022

add OMP_THREAD_LIMIT 1 to rancher config