when > 500 files needs publishing Crab only publishes n*500

belforte commented 10 years ago

On Fri, Mar 7, 2014 at 8:28 AM, Ben Kreis kreis@cern.ch wrote:

*\ Discussion title: CRAB Feedback

Hi,

I recently tried -publish on a task with 1665 jobs. It published the first 1500 in blocks of 500 then printed the following line:

crab: Summary of file publication : published 1500, failed 0, still_to_publish 165

Is there something I can do to publish the remaining 165 jobs?

Thanks, Ben

[ MIME part of type text/html without a name stripped ]

Visit this CMS message (to reply or unsubscribe) at: https://hypernews.cern.ch/HyperNews/CMS/get/crabFeedback/7308.html

belforte commented 10 years ago

this is a legacy of using Crab3 code which was for continously publishing and adding while ASO completes. Totally different flow. Also output is confusing. Time to clean up

belforte commented 10 years ago

this is an extensive rewriting, needed, but dangerous. let's schedule it for next release

belforte commented 9 years ago

since there's an easy workaround (run crab -publish again). Will not do anything unless a clear problem arise, in which case I'll reopen.

dmwm / CRAB2

when > 500 files needs publishing Crab only publishes n*500 #1048

[ MIME part of type text/html without a name stripped ]