CU event durations from agent component

radical-cybertools / radical.analytics

Analytics for RADICAL-Cybertools

Other

1 stars 1 forks source link

CU event durations from agent component #66

Closed jdakka closed 4 years ago

jdakka commented 6 years ago

For my aprun runs on Blue Waters I was looking for the following pre-executable events from the agent logs:

cu_post_start       : cu shell script: pre-exec starts           (uid: uid, [CU_PRE])
cu_post_stop        : cu shell script: pre_exec stopped          (uid: uid, [CU_PRE])

(got these from here)

My agent logs don't appear to have these events...does RP handover to aprun before this event?

andre-merzky commented 6 years ago

Let me check. What stack are you using?

andre-merzky commented 6 years ago

Uh, there is also a typo in the documentation - if you want pre_exec timings, you would use cu_pre_start / cu_pre_stop. I'll fix that - but can you please check if those exist? Please also send me the shell script for one of the units from the units sandbox, please.

jdakka commented 6 years ago

Using pypi installation for entire stack.
cu_pre_stop / cu_pre_start are there 👍
These runs did not have the proper STDOUT/STDERR/*.sh files as noted in ticket 1564

andre-merzky commented 6 years ago

If you get cu_pre_stop / cu_pre_start in the profiles, we won't need the shell scripts. I am not sure about the state of this ticket now though: is it solved with the correct event names, or do you see the events in the profiles, but can still not derive the durations with RA? In the letter case, please attach a session (profiles + json) -- thanks!

jdakka commented 6 years ago

No worries. I can derive the events with RA. I'm creating pull request to update the wrangler.py

It will contain the pre-exec events