NCEAS / metadig-engine

MetaDig Engine: multi-dialect metadata assessment engine
7 stars 5 forks source link

figure out HttpMultipartRestClient issues #389

Open jeanetteclark opened 9 months ago

jeanetteclark commented 9 months ago

Investigate this note in the taskList.csv file

# Admin NOTE: it appears that DataONE HttpMultipartRestClient can't handle two clients being created at the same time, even if they are by different threads. This needs to be
# investigated further and potentially a bug needs to be logged in github for this. Until then, an easy workaround is to ensure that no two tasks are started
# at the same time, so adjust the cron schedule accordingly.

Since soon we are going to have more jobs than there are seconds in a minute, and it is already annoying to find a time to run a job. Related to #374 and might result in a ticket to d1_libclient_java depending on what I figure out when I try to replicate the error