PanDAWMS / panda-yoda

package for Yoda
Apache License 2.0
0 stars 3 forks source link

Not all processed events declared for stage-out #8

Open DanilaOleynik opened 6 years ago

DanilaOleynik commented 6 years ago

A test job was submitted with 3 nodes(1Yoda+2Droids, 16 cores per node, walltime 30 minutes), Yoda loaded 20000 events. 2 Droids processed 189 events but But the final event_status.dump.json has only 12 events

DanilaOleynik commented 6 years ago

Yoda should not be hard synchronized with Harvester or any other edge service. All processed events should be declared for stage-out. Yoda should not keep meta info about processed events in the internal queue somehow long.