search

dmwm / CRAB2

CRAB2
2 stars 11 forks source link

uploadLog broken in 290 #916

Closed ericvaandering closed 10 years ago

ericvaandering commented 10 years ago

Original Savannah ticket 102311 reported by belforte on Tue Aug 20 13:39:32 2013.

from crab.log 2013-08-20 20:33:38,254 [INFO] Starting to upload the report... 2013-08-20 20:33:38,312 [DEBUG] Start cleaning report... 2013-08-20 20:33:38,312 [DEBUG] Running 'rm -rf /afs/cern.ch/user/b/belforte/w0/crabtest/crab_0_130820_202245//crabreport_2013-08-20-20:33:38.095185 /afs/cern.ch/user/b/belforte/w0/crabtest/crab_0_130820_202245//belforte-uploader.zip' 2013-08-20 20:33:38,613 [DEBUG] Result '' 2013-08-20 20:33:38,628 [DEBUG] ERROR: Problem 'ascii' codec can't decode byte 0xa4 in position 11: ordinal not in range(128) uploading log files to http://analysisops.cern.ch/cmserrorreports/

while 288 on same task gives 2013-08-20 20:36:24,383 [INFO] Starting to upload the report... 2013-08-20 20:36:24,427 [INFO] Your report was uploaded to the central repository 2013-08-20 20:36:24,428 [INFO] Please include this URL in your bug report or in the support e-mail 2013-08-20 20:36:24,428 [INFO] http://analysisops.cern.ch/cmserrorreports/download/2265

2013-08-20 20:36:24,428 [DEBUG] Start cleaning report... 2013-08-20 20:36:24,428 [DEBUG] Running 'rm -rf /afs/cern.ch/user/b/belforte/w0/crabtest/crab_0_130820_202245//crabreport_2013-08-20-20:36:23.862269 /afs/cern.ch/user/b/belforte/w0/crabtest/crab_0_130820_202245//belforte-2013-08-20 20:36:24,383 [INFO] Starting to upload the report... 2013-08-20 20:36:24,427 [INFO] Your report was uploaded to the central repository 2013-08-20 20:36:24,428 [INFO] Please include this URL in your bug report or in the support e-mail 2013-08-20 20:36:24,428 [INFO] http://analysisops.cern.ch/cmserrorreports/download/2265

2013-08-20 20:36:24,428 [DEBUG] Start cleaning report... 2013-08-20 20:36:24,428 [DEBUG] Running 'rm -rf /afs/cern.ch/user/b/belforte/w0/crabtest/crab_0_130820_202245//crabreport_2013-08-20-20:36:23.862269 /afs/cern.ch/user/b/belforte/w0/crabtest/crab_0_130820_202245//belforte-uploader.zip' 2013-08-20 20:36:24,709 [DEBUG] Result '' 2013-08-20 20:36:24,709 [INFO] Report upload finished. uploader.zip' 2013-08-20 20:36:24,709 [DEBUG] Result '' 2013-08-20 20:36:24,709 [INFO] Report upload finished.

ericvaandering commented 10 years ago

Comment by belforte on Tue Aug 20 16:25:51 2013

in the end this is due to ne WMCore/Services/SiteDB/SiteDB.py which returns unicode for user name, even if cached file seems to have plain strings only. Older version for SiteDB V1 API was returning string instead.

python does not handle this transparently everywhere, but does not fail immediately either so that one would spot it right away.

bloody not-strongly-typed languages grrr.....

unicode in user name has bad effects on some old colde in crab -uploadLog, as the name of the zip file to archive (e.g. belforte_blah..zip) is also turned into unicode and this confuses the old code from Kuba, somehow the file content is read as unicode rather then as string, then '\r\n\'.join(lines) in crab_report.py tries to code back and fails...

blah...

I am casting user name to a sring now in crab_util as soon as it is get back from WMCore method

/local/reps/CMSSW/COMP/CRAB/python/crab_util.py,v <-- crab_util.py new revision: 1.131; previous revision: 1.130

ericvaandering commented 10 years ago

Closed by belforte on Tue Aug 20 16:44:48 2013

ericvaandering commented 10 years ago

Comment by belforte on Tue Aug 20 16:44:48 2013

in the end problem was nasty, but fix trivial, so I assume few if any remotely installed CRAB_2_9_0 yet and simply retagged new crab_util.py and made a new tarball. Crab client on AFS is also updated.