ucd-library / aggie-experts

Publicly reported feedback and issues for Aggie Experts
https://ucd-library.github.io/aggie-experts/
MIT License
1 stars 2 forks source link

User data timing issues #283

Open qjhart opened 9 months ago

qjhart commented 9 months ago

Describe the issue We need a better understanding of how long various parts of a user data collection are taking. We've updated our logger to allow measurements. This was incorporated on that last run, and we have statistics for every senate user

Preliminary results seem to indicate slow-downs on the server, maybe on the CDL fetches as well, though that's not super clear yet.

qjhart commented 9 months ago

I updated the 17 `experts`` that took the longest to replicate in the current setup.

top='ehenrics fzhammoc dpland phymoore ekebreab hjcheng ffing ckedding ekneuman epontike eprebys gpfox jawdat clarson daccache fzebeler fanchert'

#save previous run
mkdir save
for i in $top; do mv $i* save; done

for i in $top; do echo $i;  experts cdl --debug-save-xml $i > $i.log.json; done