search

CDLUC3 / mrt-doc

Documentation and Information regarding the Merritt repository
8 stars 4 forks source link

Investigate ETD createmarc failure #2074

Closed elopatin-uc3 closed 2 weeks ago

elopatin-uc3 commented 1 month ago

Sending email is failing due to attachment size:

  File "/usr/lib64/python2.7/smtplib.py", line 737, in sendmail
    raise SMTPSenderRefused(code, resp, from_addr)
smtplib.SMTPSenderRefused: (552, '5.3.4 Message size exceeds fixed limit', 'uc3-etds@cdlib.org')
elopatin-uc3 commented 1 month ago

Found culprit for large csv reports in date range of campus sql queries. UCLA was the only query with a specific start date for the date range (starting in 2017). Some other campus queries were inconsistent as well, such as UCSD, with no date range. Others, like UCB and UCD restricted to 7 days. I tested a 30 day range, which returns recent data, as these reports should focus on newly ingested ETDs. The 30 day range should make the resulting email attachments much more manageable over time, while still proving relevant data for catalog librarians.

elopatin-uc3 commented 1 month ago

Will deploy to production on Monday, Oct. 21. https://github.com/CDLUC3/uc3-etds/pull/26