search

STEllAR-GROUP / hpx

The C++ Standard Library for Parallelism and Concurrency
https://hpx.stellar-group.org
Boost Software License 1.0
2.52k stars 429 forks source link

Papi counters cannot specify thread#* to get the counts for all threads #814

Closed pagrubel closed 11 years ago

pagrubel commented 11 years ago

For hpx counters specifying thread#* gives the count for all threads for the papi counters this does not work

pagrubel commented 11 years ago

It would also be nice if total would work too ex: --hpx:print-counter=/papi{locality#0/total}/PAPI_L1_DCM nothing happens

hkaiser commented 11 years ago

Pat, please try again, this should work now:

--hpx:print-counter=/papi{locality#0/worker-thread#*}/PAPI_L1_DCM

Also, in order to get totals, you should be able to use something like:

--hpx:print-counter=/arithmetics/add@/papi{locality#0/worker-thread#*}/PAPI_L1_DCM
pagrubel commented 11 years ago

thanks I will try this today

pagrubel commented 11 years ago

used this --hpx:print-counter=/papi{locality#0/worker-thread#*}/PAPI_L1_DCM

got error:

/work/02466/pagrubel/build/hpx_build0805/bin/hpx_homogeneous_task_spawn -t2 --hpx:print-counter=/papi{locality#0/worker-thread#*}/PAPI_L1_DCM OS-threads,Tasks,Delay (iterations),Total Walltime (seconds),Walltime per Task (seconds) 2, 500000, 0, 0.775433, 1.55087e-06

{stack-trace}: 7 frames: 0x2b00696eda83 : hpx::detail::backtrace() + 0x143 in /work/02466/pagrubel/build/hpx_build0805/lib/hpx/libhpx.so.1 0x2b00696f09dd : void hpx::detail::throw_exceptionhpx::exception(hpx::exception const&, std::string const&, std::string const&, long) + 0x3d in /work/02466/pagrubel/build/hpx_build0805/lib/hpx/libhpx.so.1 0x2b0069f16abd : hpx::util::query_counters::evaluatecounters(bool, char const, hpx::error_code&) + 0x50d in /work/02466/pagrubel/build/hpx_build0805/lib/hpx/libhpx.so.1 0x2b006996025d : hpx::components::server::runtime_support::call_shutdown_functions(bool) + 0x6d in /work/02466/pagrubel/build/hpx_build0805/lib/hpx/libhpx.so.1 0x2b0069811805 : hpx::util::detail::vtable::type<hpx::util::detail::bound_functor4<hpx::actions::action<hpx::components::server::runtime_support, boost::fusion::unused_type, hpx::util::tuple1, hpx::actions::action1<void (hpx::components::server::runtimesupport::)(bool), &hpx::components::server::runtime_support::call_shutdown_functions, hpx::actions::detail::this_type> >::continuation_thread_object_function_void_1, boost::shared_ptrhpx::actions::continuation, void (hpx::components::server::runtimesupport::)(bool), hpx::components::server::runtimesupport, bool>, hpx::threads::thread_state_enum (hpx::threads::thread_state_exenum), void, void>::invoke(void*, hpx::threads::thread_state_ex_enum) + 0x225 in /work/02466/pagrubel/build/hpx_build0805/lib/hpx/libhpx.so.1 0x2b00696a998c : void hpx::util::coroutines::detail::lx::trampoline<hpx::util::coroutines::detail::coroutine_impl_wrapper<hpx::util::function_nonser<hpx::threads::thread_state_enum (hpx::threads::thread_state_ex_enum)>, hpx::util::coroutines::coroutine<hpx::threads::thread_state_enum (hpx::threads::thread_state_ex_enum), hpx::threads::detail::coroutine_allocator, hpx::util::coroutines::detail::lx::x86_linux_context_impl>, hpx::util::coroutines::detail::lx::x86_linux_context_impl, hpx::threads::detail::coroutine_allocator> >(hpx::util::coroutines::detail::coroutine_impl_wrapper<hpx::util::function_nonser<hpx::threads::thread_state_enum (hpx::threads::thread_state_ex_enum)>, hpx::util::coroutines::coroutine<hpx::threads::thread_state_enum (hpx::threads::thread_state_ex_enum), hpx::threads::detail::coroutine_allocator, hpx::util::coroutines::detail::lx::x86_linux_context_impl>, hpx::util::coroutines::detail::lx::x86_linux_context_impl, hpx::threads::detail::coroutineallocator>) + 0xec in /work/02466/pagrubel/build/hpx_build0805/lib/hpx/libhpx.so.1 {env}: 92 entries: APPS=/opt/apps ARCHIVE=/home/02466/pagrubel ARCHIVER=ranch.tacc.utexas.edu BASH_ENV=/etc/tacc/tacc_functions CVS_RSH=ssh G_BROKEN_FILENAMES=1 HISTSIZE=1000 HOME=/home1/02466/pagrubel HOSTNAME=login3.stampede.tacc.utexas.edu ICC_BIN=/opt/apps/intel/13/composer_xe_2013.2.146/bin/intel64 ICC_LIB=/opt/apps/intel/13/composer_xe_2013.2.146/compiler/lib/intel64 IFC_BIN=/opt/apps/intel/13/composer_xe_2013.2.146/bin/intel64 IFC_LIB=/opt/apps/intel/13/composer_xe_2013.2.146/compiler/lib/intel64 IIDB_BIN=/opt/apps/intel/13/composer_xe_2013.2.146/bin/intel64 INCLUDE=/opt/apps/intel/13/composer_xe_2013.2.146/ipp/include:/opt/apps/intel/13/composer_xe_2013.2.146/mkl/include INFOPATH=/opt/apps/intel13/mvapich2/1.9/doc INPUTRC=/etc/inputrc IPPROOT=/opt/apps/intel/13/composer_xe_2013.2.146/ipp LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 LD_INCLUDE_PATH=/opt/apps/gcc/4.7.1/include: LD_LIBRARY_PATH=/opt/apps/gcc/4.7.1/lib:/opt/apps/gcc/4.7.1/lib64:/opt/apps/papi/5.2RC/lib:/opt/apps/intel13/mvapich2/1.9/lib:/opt/apps/intel13/mvapich2/1.9/lib/shared:/opt/apps/intel/13/composer_xe_2013.2.146/tbb/lib/intel64:/opt/apps/intel/13/composer_xe_2013.2.146/compiler/lib/intel64:/opt/intel/mic/coi/host-linux-release/lib:/opt/intel/mic/myo/lib:/opt/apps/intel/13/composer_xe_2013.2.146/mpirt/lib/intel64:/opt/apps/intel/13/composer_xe_2013.2.146/ipp/../compiler/lib/intel64:/opt/apps/intel/13/composer_xe_2013.2.146/ipp/lib/intel64:/opt/apps/intel/13/composer_xe_2013.2.146/compiler/lib/intel64:/opt/apps/intel/13/composer_xe_2013.2.146/mkl/lib/intel64:/opt/apps/intel/13/composer_xe_2013.2.146/tbb/lib/intel64 LESSOPEN=|/usr/bin/lesspipe.sh %s LMOD_CMD=/opt/apps/lmod/lmod/libexec/lmod LMOD_COLORIZE=yes LMOD_DEFAULT_MODULEPATH=/opt/apps/xsede/modulefiles:/opt/apps/modulefiles:/opt/modulefiles LMOD_DIR=/opt/apps/lmod/lmod/libexec/ LMOD_FAMILY_COMPILER=intel LMOD_FAMILY_MPI=mvapich2 LMOD_PREPEND_BLOCK=normal LMOD_SETTARG_CMD=: LMOD_SETTARG_SUPPORT=yes LMOD_SYSTEM_DEFAULT_MODULES=TACC LOGNAME=pagrubel LSCOLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;05;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:.tar=01;31:.tgz=01;31:.arj=01;31:.taz=01;31:.lzh=01;31:.lzma=01;31:.tlz=01;31:.txz=01;31:.zip=01;31:.z=01;31:.Z=01;31:.dz=01;31:.gz=01;31:.lz=01;31:.xz=01;31:.bz2=01;31:.tbz=01;31:.tbz2=01;31:.bz=01;31:.tz=01;31:.deb=01;31:.rpm=01;31:.jar=01;31:.rar=01;31:.ace=01;31:.zoo=01;31:.cpio=01;31:.7z=01;31:.rz=01;31:.jpg=01;35:.jpeg=01;35:.gif=01;35:.bmp=01;35:.pbm=01;35:.pgm=01;35:.ppm=01;35:.tga=01;35:.xbm=01;35:.xpm=01;35:.tif=01;35:.tiff=01;35:.png=01;35:.svg=01;35:.svgz=01;35:.mng=01;35:.pcx=01;35:.mov=01;35:.mpg=01;35:.mpeg=01;35:.m2v=01;35:.mkv=01;35:.ogm=01;35:.mp4=01;35:.m4v=01;35:.mp4v=01;35:.vob=01;35:.qt=01;35:.nuv=01;35:.wmv=01;35:.asf=01;35:.rm=01;35:.rmvb=01;35:.flc=01;35:.avi=01;35:.fli=01;35:.flv=01;35:.gl=01;35:.dl=01;35:.xcf=01;35:.xwd=01;35:.yuv=01;35:.cgm=01;35:.emf=01;35:.axv=01;35:.anx=01;35:.ogv=01;35:.ogx=01;35:.aac=01;36:.au=01;36:.flac=01;36:.mid=01;36:.midi=01;36:.mka=01;36:.mp3=01;36:.mpc=01;36:.ogg=01;36:.ra=01;36:.wav=01;36:.axa=01;36:.oga=01;36:.spx=01;36:_.xspf=01;36: MAIL=/var/spool/mail/pagrubel MANPATH=/opt/apps/papi/5.2RC/share/man:/opt/apps/intel13/mvapich2/1.9/man:/opt/apps/intel/13/composer_xe_2013.2.146/man/en_US:/opt/apps/intel/13/composer_xe_2013.2.146/man/en_US:/opt/apps/intel/13/vtune_amplifier_xe_2013/man:/usr/local/man:/usr/share/man:/usr/X11R6/man:/usr/kerberos/man:/usr/man:/usr/local/man MIC_ENV_PREFIX=MIC MIC_LD_LIBRARY_PATH=/opt/apps/intel/13/composer_xe_2013.2.146/tbb/lib/mic:/opt/apps/intel/13/composer_xe_2013.2.146/compiler/lib/mic:/opt/intel/mic/coi/device-linux-release/lib:/opt/intel/mic/myo/lib:/opt/apps/intel/13/composer_xe_2013.2.146/tbb/lib/mic MKLROOT=/opt/apps/intel/13/composer_xe_2013.2.146/mkl MODULEPATH=/opt/apps/intel13/mvapich2_1_9/modulefiles:/opt/apps/intel13/modulefiles:/opt/apps/xsede/modulefiles:/opt/apps/modulefiles:/opt/modulefiles MPICH_HOME=/opt/apps/intel13/mvapich2/1.9 OLDPWD=/work/02466/pagrubel/data/SThtts OMP_NUM_THREADS=1 PAPI_PERFMON_EVENT_FILE=/opt/apps/papi/5.2RC/share/papi/papi_events.csv PATH=/opt/apps/gcc/4.7.1/bin/:/opt/apps/cmake/2.8.9/bin:/opt/apps/papi/5.2RC/bin:/opt/apps/intel13/mvapich2/1.9/bin:/opt/apps/intel/13/vtune_amplifier_xe_2013/bin64:/opt/apps/intel/13/composer_xe_2013.2.146/mpirt/bin/intel64:/opt/intel/sep/bin:/opt/apps/cmake/2.8.9/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin:/opt/ofed/bin:/opt/ofed/sbin:.:/opt/apps/intel/13/composer_xe_2013.2.146/bin/intel64:/opt/apps/intel/13/composer_xe_2013.2.146/bin/intel64_mic:/opt/apps/intel/13/composer_xe_2013.2.146/debugger/gui/intel64 PKG_CONFIG_PATH=/opt/apps/intel13/mvapich2/1.9/lib/pkgconfig PS1=login3\$ PWD=/work/02466/pagrubel/data/SThtts/build0727 QTDIR=/usr/lib64/qt-3.3 QTINC=/usr/lib64/qt-3.3/include QTLIB=/usr/lib64/qt-3.3/lib SCRATCH=/scratch/02466/pagrubel SHELL=/bin/bash SHLVL=1 SINK_LD_LIBRARY_PATH=/opt/apps/intel/13/composer_xe_2013.2.146/compiler/lib/mic:/opt/apps/intel/13/composer_xe_2013.2.146/mkl/lib/mic SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass SSH_CLIENT=72.0.39.118 41410 22 SSH_CONNECTION=72.0.39.118 41410 129.114.62.13 22 SSH_TTY=/dev/pts/99 SYSTEM=linux TACC_CMAKE_BIN=/opt/apps/cmake/2.8.9/bin TACC_CMAKE_DIR=/opt/apps/cmake/2.8.9 TACC_DOMAIN=stampede TACC_FAMILY_COMPILER=intel TACC_FAMILY_MPI=mvapich2 TACC_MKL_DIR=/opt/apps/intel/13/composer_xe_2013.2.146/mkl TACC_MKL_INC=/opt/apps/intel/13/composer_xe_2013.2.146/mkl/include TACC_MKL_LIB=/opt/apps/intel/13/composer_xe_2013.2.146/mkl/lib/intel64 TACC_MPI_GETMODE=mvapich2_ssh TACC_PAPI_DIR=/opt/apps/papi/5.2RC/ TACC_PAPI_INC=/opt/apps/papi/5.2RC/include TACC_PAPI_LIB=/opt/apps/papi/5.2RC/lib TACC_SYSTEM=stampede TBBROOT=/opt/apps/intel/13/composer_xe2013.2.146/tbb TERM=xterm USER=pagrubel WORK=/work/02466/pagrubel =/work/02466/pagrubel/build/hpx_build0805/bin/hpx_homogeneous_task_spawn ModuleTable001=X01vZHVsZVRhYmxlXz17WyJhY3RpdmVTaXplIl09OSxiYXNlTXBhdGhBPXsiL29wdC9hcHBzL3hzZWRlL21vZHVsZWZpbGVzIiwiL29wdC9hcHBzL21vZHVsZWZpbGVzIiwiL29wdC9tb2R1bGVmaWxlcyIsfSxbImNfcmVidWlsZFRpbWUiXT04NjQwMCxbImNfc2hvcnRUaW1lIl09ZmFsc2UsZmFtaWx5PXtbIk1QSSJdPSJtdmFwaWNoMiIsWyJjb21waWxlciJdPSJpbnRlbCIsfSxpbmFjdGl2ZT17fSxtVD17TGludXg9e1siRk4iXT0iL29wdC9tb2R1bGVmaWxlcy9MaW51eCIsWyJkZWZhdWx0Il09MCxbImZ1bGxOYW1lIl09IkxpbnV4IixbImxvYWRPcmRlciJdPTIsWyJtVHlwZSJdPSJ3Iixwcm9wVD17fSxbInNob3J0Il09IkxpbnV4IixbInN0YXR1cyJdPSJhY3RpdmUiLH0s ModuleTable002=VEFDQz17WyJGTiJdPSIvb3B0L21vZHVsZWZpbGVzL1RBQ0MiLFsiZGVmYXVsdCJdPTAsWyJmdWxsTmFtZSJdPSJUQUNDIixbImxvYWRPcmRlciJdPTcsWyJtVHlwZSJdPSJtIixwcm9wVD17fSxbInNob3J0Il09IlRBQ0MiLFsic3RhdHVzIl09ImFjdGl2ZSIsfSxbIlRBQ0MtcGF0aHMiXT17WyJGTiJdPSIvb3B0L21vZHVsZWZpbGVzL1RBQ0MtcGF0aHMiLFsiZGVmYXVsdCJdPTAsWyJmdWxsTmFtZSJdPSJUQUNDLXBhdGhzIixbImxvYWRPcmRlciJdPTEsWyJtVHlwZSJdPSJ3Iixwcm9wVD17fSxbInNob3J0Il09IlRBQ0MtcGF0aHMiLFsic3RhdHVzIl09ImFjdGl2ZSIsfSxjbHVzdGVyPXtbIkZOIl09Ii9vcHQvbW9kdWxlZmlsZXMvY2x1c3RlciIsWyJkZWZhdWx0Il09MCxb ModuleTable003=ImZ1bGxOYW1lIl09ImNsdXN0ZXIiLFsibG9hZE9yZGVyIl09OCxbIm1UeXBlIl09Im0iLHByb3BUPXt9LFsic2hvcnQiXT0iY2x1c3RlciIsWyJzdGF0dXMiXT0iYWN0aXZlIix9LFsiY2x1c3Rlci1wYXRocyJdPXtbIkZOIl09Ii9vcHQvbW9kdWxlZmlsZXMvY2x1c3Rlci1wYXRocyIsWyJkZWZhdWx0Il09MCxbImZ1bGxOYW1lIl09ImNsdXN0ZXItcGF0aHMiLFsibG9hZE9yZGVyIl09MyxbIm1UeXBlIl09InciLHByb3BUPXt9LFsic2hvcnQiXT0iY2x1c3Rlci1wYXRocyIsWyJzdGF0dXMiXT0iYWN0aXZlIix9LGNtYWtlPXtbIkZOIl09Ii9vcHQvYXBwcy9tb2R1bGVmaWxlcy9jbWFrZS8yLjguOS5sdWEiLFsiZGVmYXVsdCJdPTEsWyJmdWxsTmFtZSJdPSJjbWFrZS8yLjgu ModuleTable004=OSIsWyJsb2FkT3JkZXIiXT00LFsibVR5cGUiXT0idyIscHJvcFQ9e30sWyJzaG9ydCJdPSJjbWFrZSIsWyJzdGF0dXMiXT0iYWN0aXZlIix9LGludGVsPXtbIkZOIl09Ii9vcHQvYXBwcy9tb2R1bGVmaWxlcy9pbnRlbC8xMy4wLjIuMTQ2IixbImRlZmF1bHQiXT0xLFsiZnVsbE5hbWUiXT0iaW50ZWwvMTMuMC4yLjE0NiIsWyJsb2FkT3JkZXIiXT01LFsibVR5cGUiXT0idyIscHJvcFQ9e30sWyJzaG9ydCJdPSJpbnRlbCIsWyJzdGF0dXMiXT0iYWN0aXZlIix9LG12YXBpY2gyPXtbIkZOIl09Ii9vcHQvYXBwcy9pbnRlbDEzL21vZHVsZWZpbGVzL212YXBpY2gyLzEuOWEyIixbImRlZmF1bHQiXT0xLFsiZnVsbE5hbWUiXT0ibXZhcGljaDIvMS45YTIiLFsibG9hZE9yZGVyIl09 ModuleTable005=NixbIm1UeXBlIl09InciLHByb3BUPXt9LFsic2hvcnQiXT0ibXZhcGljaDIiLFsic3RhdHVzIl09ImFjdGl2ZSIsfSxwYXBpPXtbIkZOIl09Ii9vcHQvYXBwcy9tb2R1bGVmaWxlcy9wYXBpLzUuMlJDIixbImRlZmF1bHQiXT0xLFsiZnVsbE5hbWUiXT0icGFwaS81LjJSQyIsWyJsb2FkT3JkZXIiXT05LFsibVR5cGUiXT0idyIscHJvcFQ9e30sWyJzaG9ydCJdPSJwYXBpIixbInN0YXR1cyJdPSJhY3RpdmUiLH0sfSxtcGF0aEE9eyIvb3B0L2FwcHMvaW50ZWwxMy9tdmFwaWNoMl8xXzkvbW9kdWxlZmlsZXMiLCIvb3B0L2FwcHMvaW50ZWwxMy9tb2R1bGVmaWxlcyIsIi9vcHQvYXBwcy94c2VkZS9tb2R1bGVmaWxlcyIsIi9vcHQvYXBwcy9tb2R1bGVmaWxlcyIsIi9vcHQvbW9k ModuleTable006=dWxlZmlsZXMiLH0sWyJzeXN0ZW1CYXNlTVBBVEgiXT0iL29wdC9hcHBzL3hzZWRlL21vZHVsZWZpbGVzOi9vcHQvYXBwcy9tb2R1bGVmaWxlczovb3B0L21vZHVsZWZpbGVzIixbInZlcnNpb24iXT0yLH0= _ModuleTableSz=6 Init_Default_Modules=1 __LMOD_DEFAULT_MODULES_LOADED=1 __PROFILE_USER_SOURCED=1 incpath=/opt/apps/gcc/4.7.1/include libpath=/opt/apps/gcc/4.7.1/lib:/opt/apps/gcc/4.7.1/lib64 path=/opt/apps/gcc/4.7.1/bin/:/opt/apps/cmake/2.8.9/bin {locality-id}: 0 {hostname}: 127.0.0.1:7910 {process-id}: 27818 {function}: query_counters::evaluate {file}: /work/02466/pagrubel/hpx/src/util/query_counters.cpp {line}: 262 {os-thread}: 1, worker-thread#0 {thread-id}: 00002b007095a470 {thread-description}: {config}: HPX_HAVE_NATIVE_TLS=ON HPX_HAVE_STACKTRACES=ON HPX_HAVE_COMPRESSION_BZIP2=OFF HPX_HAVE_COMPRESSION_SNAPPY=OFF HPX_HAVE_COMPRESSION_ZLIB=OFF HPX_HAVE_PARCEL_COALESCING=ON HPX_HAVE_PARCELPORT_SHMEM=ON HPX_HAVE_PARCELPORT_IBVERBS=ON HPX_HAVE_VERIFY_LOCKS=OFF HPX_HAVE_HWLOC=ON HPX_HAVE_ITTNOTIFY=OFF HPX_LIMIT=5 HPX_ACTION_ARGUMENT_LIMIT=4 HPX_COMPONENT_CREATE_ARGUMENT_LIMIT=5 HPX_FUNCTION_ARGUMENT_LIMIT=7 HPX_LOCK_LIMIT=5 HPX_TUPLE_LIMIT=10 HPX_WAIT_ARGUMENT_LIMIT=5 HPX_PARCEL_MAX_CONNECTIONS=512 HPX_PARCEL_MAX_CONNECTIONS_PER_LOCALITY=4 HPX_INITIAL_AGAS_LOCAL_CACHE_SIZE=256 HPX_AGAS_LOCAL_CACHE_SIZE_PER_THREAD=32 HPX_PARCEL_SHMEM_DATA_BUFFER_CACHE_SIZE=512 HPX_PREFIX=/work/02466/pagrubel/build/hpx_build0805 {version}: V1.0.0-trunk (AGAS: V3.0), Git: 5e4eeabd314dbf7116cba5baf732ed33b10e65e8 {boost}: V1.53.0 {build-type}: release {date}: Aug 5 2013 13:24:21 {platform}: linux {compiler}: Intel C++ C++0x mode version 1310 {stdlib}: GNU libstdc++ version 20120614 {what}: The counters to be evaluated have not been initialized yet: HPX(invalid_status)

Aborted (core dumped)