search

radical-cybertools / radical.analytics

Analytics for RADICAL-Cybertools
Other
1 stars 1 forks source link

Missing states/events #118

Open mturilli opened 4 years ago

mturilli commented 4 years ago

Analytics stack:

  python               : 3.6.9
  pythonpath           : 
  virtualenv           : /home/mturilli/Virtualenvs/rp-paper-frontera

  radical.analytics    : 0.90.7-v0.72.0-38-g14b9581@devel
  radical.pilot        : 1.1.1-v1.1.1-9-g353c5876e@devel
  radical.saga         : 1.1.0-v1.1-10-g4cfdc77f@devel
  radical.utils        : 1.1.1-v1.1.1-14-g77ca0db@devel

Session stack:

  python               : 3.7.0
  pythonpath           : /opt/apps/intel19/impi19_0/python3/3.7.0/lib/python3.7/site-packages
  virtualenv           : /home1/02855/mturilli/ve

  radical.pilot        : 1.1.1
  radical.saga         : 1.1.2
  radical.utils        : 1.1.1

radical-analytics-check output:

-----------------------------------------------------------
  source  : rp.session.login2.frontera.tacc.utexas.edu.mturilli.018316.0002
  session : rp.session.login2.frontera.tacc.utexas.edu.mturilli.018316.0002
                    6 : END
                    5 : component_final
                   13 : component_init
                 1238 : get
                    2 : init1
                    1 : session_close
                   12 : session_ok
                   12 : session_start
                    1 : session_stop
                    2 : setup_done
                   85 : sync_abs

  pilots  :         1
                    1 : bootstrap_0_start
                 1464 : cmd
                    2 : get
                    1 : hostname
                    1 : put
                    1 : rp_install_start
                    1 : rp_install_stop
                    1 : staging_in_start
                    1 : staging_in_stop
                    6 : state
                    1 : submission_start
                    1 : submission_stop
                    2 : sync_rel
                    2 : ve_activate_start
                    1 : ve_activate_stop
                    1 : ve_setup_start
                    1 : ve_setup_stop

  units   :      8192
                29947 : app_start
                29947 : app_stop
                 7337 : cu_cd_done
                 7337 : cu_exec_start
                 7337 : cu_exec_stop
                 7337 : cu_pre_start
                 7337 : cu_pre_stop
                 7337 : cu_start
                 7337 : cu_stop
                 7338 : exec_mkdir
                 7338 : exec_mkdir_done
                 7338 : exec_ok
                 7338 : exec_start
                 7337 : exec_stop
                70214 : get
                54690 : put
                 7338 : schedule_ok
               933600 : schedule_try
               125764 : state
                 7337 : unschedule_start
                 7336 : unschedule_stop

  total   :   1357086  (49 types)

  missing:         43
                  *  advance              : component advances  entity state           (uid: eid, state: estate)
                     app_*                : application specific events                (uid: unit, [APP], optional)
                  *  bootstrap_0_stop     : pilot bootstrapper 1 stops                 (uid: pilot)
                  *  cleanup_start        : sandbox deletion     starts                (uid: pilot)
                  *  cleanup_stop         : sandbox deletion     stops                 (uid: pilot)
                     client_barrier_stop  : client signal received                     (uid: pilot, [CFG-R])
                  *  config_parser_start  : begin parsing config files                 (uid: sid)
                  *  config_parser_stop   : stops parsing config files                 (uid: sid)
                     create_sandbox_stop  : create_unit_sandbox stops                  (uid: unit, [CU-DS])
                     cu_post_start        : cu shell script: post-exec starts          (uid: unit, [CU_POST])
                     cu_post_stop         : cu shell script: post_exec stopped         (uid: unit, [CU_POST])
                  *  drop                 : component drops  an entity (final state)   (uid: eid, state: estate)
                     dvm_fail             : DVM startup failed                         (uid: pilot) [CFG-R])
                     dvm_ok               : DVM startup completed                      (uid: pilot) [CFG-R])
                     dvm_start            : DVM startup by launch method               (uid: pilot) [CFG-R])
                     dvm_stop             : DVM stopped                                (uid: pilot) [CFG-R])
                  *  event_name           : semantic event description (details on 'uid', 'msg', 'state' fields)
                     exec_cancel_start    : try to cancel task via exec layer (kill)   (uid: unit, [API])
                     exec_cancel_stop     : did cancel    task via exec layer (kill)   (uid: unit, [API])
                     exec_fail            : exec layer refused task                    (uid: unit, [RUNTIME], optional)
                  *  lost                 : component lost   an entity (state error)   (uid: eid, state: estate)
                  *  publish              : component publishes entity state           (uid: eid, state: estate)
                     schedule_fail        : search for unit resources failed           (uid: unit, [RUNTIME])
                     session_fetch_start  : start fetching logs/profs/json after close (uid: sid, [API])
                     session_fetch_stop   : stops fetching logs/profs/json after close (uid: sid, [API])
                     staging_in_fail      : staging request failed                     (uid: unit, msg: did, [CU-DS])
                     staging_in_skip      : staging request is not handled here        (uid: unit, msg: did, [CU-DS])
                     staging_in_tar_stop  : tar optimization stops                     (uid: unit, msg: did, [CU-DS])
                     staging_out_fail     : staging request failed                     (uid: unit, msg: did, [CU-DS])
                     staging_out_skip     : staging request is not handled here        (uid: unit, msg: did, [CU-DS])
                     staging_out_start    : staging request starts                     (uid: unit, msg: did, [CU-DS])
                     staging_out_stop     : staging request stops                      (uid: unit, msg: did, [CU-DS])
                  *  staging_stderr_stop  : reading unit stderr stops                  (uid: unit)
                  *  staging_stdout_stop  : reading unit stdout stops                  (uid: unit)
                     staging_uprof_start  : reading unit profile starts                (uid: unit, [APP])
                     staging_uprof_stop   : reading unit profile stops                 (uid: unit, [APP])
                  *  tunnel_setup_start   : setting up tunnel    starts                (uid: pilot)
                     tunnel_setup_stop    : setting up tunnel    stops                 (uid: pilot, [CFG-R])
                  *  update_pushed        : a state update has been send               (uid: unit, msg: state)
                  *  update_request       : a state update is requested                (uid: unit, msg: state)
                     ve_create_start      : pilot ve creation    starts                (uid: pilot, [CFG-R])
                     ve_create_stop       : pilot ve creation    stops                 (uid: pilot, [CFG-R])
                     ve_update_start      : pilot ve update      stops                 (uid: pilot, [CFG-R])

-----------------------------------------------------------
andre-merzky commented 4 years ago

TODO: mark optional events clearly