File name too long

[epicfaace]

CI script fails here:

Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.7.2/x64/lib/python3.7/shutil.py", line 563, in move
    os.rename(src, real_dst)
OSError: [Errno 36] File name too long: '1984/05/24/MODSMD_ARTICLE28.article.txt' -> '19xx/198x/1984y/05m/24d/MODSMD_ARTICLE28.RVZFTlRTIEVWRU5UUyBFVkVOVFMgRVZFTlRTIEVWRU5UUyBFVkVOVFMgRVZFTlRTIEVWRU5UUyBFVkVOVFMgRVZFTlRTIEVWRU5UUyBFVkVOVFMgRVZFTlRTIEVWRU5UUyBFVkVOVFMgRVZFTlRTIEVWRU5UUyBFVkVOVFMgRVZFTlRTIEVWRU5UUyBFVkVOVFMgRVZFTlRTIEVWRU5UUyBFVkVOVFMgRVZFTlRTIEVWRU5UUyBFVkVOVFMgRVZFTlRTIEVWRU5UUyBFVkVOVFMgRVZFTlRTIEVWRU5UUyBFVkVOVFMgRVZFTlRTIEVWRU5UUyBFVkVOVFM=.article.txt'

Possible solutions:

• use a folder name instead of a file name to encode data, i.e. 19xx/198x/1984y/05m/24d/{title in base 64}/{file name}.txt
• truncate file name to first 50 characters
• "Linux has a maximum filename length of 255 characters for most filesystems (including EXT4), and a maximum path of 4096 characters." (the above example is 365 chars long)
• The above file name, base-64-decoded, is actually "EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS EVENTS" -- let's fix the parsing haha

[epicfaace]

Turns out that the appropriate METS file (https://s3.amazonaws.com/stanforddailyarchive/data.2013-oct/data/stanford/1984/05/24_01/Stanford_Daily_19840524_0001-METS.xml) has this wrong title here: