cmsbuild
commented
6 years ago A new Issue was created by @davidlt .
@davidlange6, @Dr15Jones, @smuzaffar can you please review it and eventually sign/assign? Thanks.
cms-bot commands are listed here
Closed davidlt closed 6 years ago
cmsbuild
commented
6 years ago A new Issue was created by @davidlt .
@davidlange6, @Dr15Jones, @smuzaffar can you please review it and eventually sign/assign? Thanks.
cms-bot commands are listed here
davidlt
commented
6 years ago Could we move to the latest lwtnn (2.4), which don't seem to have problematic piece of code anymore. Plus it has CMake instead of a single Makefile.
davidlt
commented
6 years ago More detailed report:
================================================================= [85/3931]
==30841==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x61600017a678 at pc 0x7f7d0144c29a bp 0x7fff8a983e80 sp 0x7fff8a983e78
READ of size 8 at 0x61600017a678 thread T0
#0 0x7f7d0144c299 in Eigen::internal::handmade_aligned_free(void*) /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/util/Memory.h:98
#1 0x7f7d0144c2bf in Eigen::internal::aligned_free(void*) /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/util/Memory.h:179
#2 0x7f7d0145cdfe in void Eigen::internal::conditional_aligned_free<true>(void*) /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/util/Memory.h:230
#3 0x7f7d014564e4 in void Eigen::internal::conditional_aligned_delete_auto<double, true>(double*, unsigned long) /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/util/Memory.h:416
#4 0x7f7d01450796 in Eigen::DenseStorage<double, -1, -1, 1, 0>::~DenseStorage() /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/DenseStorage.h:542
#5 0x7f7d0144c6f9 in Eigen::PlainObjectBase<Eigen::Matrix<double, -1, 1, 0, -1, 1> >::~PlainObjectBase() /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/PlainObjectBase.h:98
#6 0x7f7d0144c715 in Eigen::Matrix<double, -1, 1, 0, -1, 1>::~Matrix() /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/Matrix.h:178
#7 0x7f7d0144c745 in lwt::InputPreprocessor::~InputPreprocessor() /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/lwtnn/1.0-mmelna2/include/lwtnn/LightweightNeuralNetwork.hh:130
#8 0x7f7d0144c781 in lwt::LightweightNeuralNetwork::~LightweightNeuralNetwork() /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/lwtnn/1.0-mmelna2/include/lwtnn/LightweightNeuralNetwork.hh:145
#9 0x7f7d0144761f in DeepFlavourJetTagsProducer::~DeepFlavourJetTagsProducer() /mnt/build/asan/CMSSW_10_0_ASAN_X_2017-10-30-2300/src/RecoBTag/Combined/plugins/DeepFlavourJetTagsProducer.cc:168
#10 0x7f7d014476c0 in DeepFlavourJetTagsProducer::~DeepFlavourJetTagsProducer() /mnt/build/asan/CMSSW_10_0_ASAN_X_2017-10-30-2300/src/RecoBTag/Combined/plugins/DeepFlavourJetTagsProducer.cc:169
#11 0x7f7d26770b0e in edm::stream::ProducingModuleAdaptorBase<edm::stream::EDProducerBase>::~ProducingModuleAdaptorBase() (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x6b3b0e)
#12 0x7f7d0142a8ba in edm::stream::EDProducerAdaptorBase::~EDProducerAdaptorBase() /cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/src/FWCore/Framework/interface/stream/EDProducerAdaptorBase.h:47
#13 0x7f7d014844de in edm::stream::ProducingModuleAdaptor<DeepFlavourJetTagsProducer, edm::stream::EDProducerBase, edm::stream::EDProducerAdaptorBase>::~ProducingModuleAdaptor() /cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/
src/FWCore/Framework/interface/stream/ProducingModuleAdaptor.h:53
#14 0x7f7d014844f9 in edm::stream::ProducingModuleAdaptor<DeepFlavourJetTagsProducer, edm::stream::EDProducerBase, edm::stream::EDProducerAdaptorBase>::~ProducingModuleAdaptor() /cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/
src/FWCore/Framework/interface/stream/ProducingModuleAdaptor.h:53
#15 0x7f7d0142a958 in std::default_delete<edm::stream::EDProducerAdaptorBase>::operator()(edm::stream::EDProducerAdaptorBase*) const /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/gcc/7.0.0-fmblme3/include/c++/7.2.1/bits/unique_ptr.h:78
#16 0x7f7d0142d216 in std::_Sp_counted_deleter<edm::stream::EDProducerAdaptorBase*, std::default_delete<edm::stream::EDProducerAdaptorBase>, std::allocator<void>, (__gnu_cxx::_Lock_policy)2>::_M_dispose() /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/gc
c/7.0.0-fmblme3/include/c++/7.2.1/bits/shared_ptr_base.h:470
#17 0x7f7d2604b2bb in std::__shared_count<(__gnu_cxx::_Lock_policy)2>::~__shared_count() (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libDataFormatsCommon.so+0x512bb)
#18 0x7f7d01429bb3 in std::__shared_ptr<edm::stream::EDProducerAdaptorBase, (__gnu_cxx::_Lock_policy)2>::~__shared_ptr() /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/gcc/7.0.0-fmblme3/include/c++/7.2.1/bits/shared_ptr_base.h:1123
#19 0x7f7d01429bcf in std::shared_ptr<edm::stream::EDProducerAdaptorBase>::~shared_ptr() /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/gcc/7.0.0-fmblme3/include/c++/7.2.1/bits/shared_ptr.h:93
#20 0x7f7d0142e542 in edm::maker::ModuleHolderT<edm::stream::EDProducerAdaptorBase>::~ModuleHolderT() /cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/src/FWCore/Framework/src/ModuleHolder.h:59
#21 0x7f7d0142f501 in void __gnu_cxx::new_allocator<edm::maker::ModuleHolderT<edm::stream::EDProducerAdaptorBase> >::destroy<edm::maker::ModuleHolderT<edm::stream::EDProducerAdaptorBase> >(edm::maker::ModuleHolderT<edm::stream::EDProducerAdaptorBase>*) /cvmfs/cms-ib.c
ern.ch/nweek-02496/slc6_amd64_gcc700/external/gcc/7.0.0-fmblme3/include/c++/7.2.1/ext/new_allocator.h:140
#22 0x7f7d0142ec34 in void std::allocator_traits<std::allocator<edm::maker::ModuleHolderT<edm::stream::EDProducerAdaptorBase> > >::destroy<edm::maker::ModuleHolderT<edm::stream::EDProducerAdaptorBase> >(std::allocator<edm::maker::ModuleHolderT<edm::stream::EDProducerA
daptorBase> >&, edm::maker::ModuleHolderT<edm::stream::EDProducerAdaptorBase>*) /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/gcc/7.0.0-fmblme3/include/c++/7.2.1/bits/alloc_traits.h:487
#23 0x7f7d0142d49e in std::_Sp_counted_ptr_inplace<edm::maker::ModuleHolderT<edm::stream::EDProducerAdaptorBase>, std::allocator<edm::maker::ModuleHolderT<edm::stream::EDProducerAdaptorBase> >, (__gnu_cxx::_Lock_policy)2>::_M_dispose() /cvmfs/cms-ib.cern.ch/nweek-0249
6/slc6_amd64_gcc700/external/gcc/7.0.0-fmblme3/include/c++/7.2.1/bits/shared_ptr_base.h:535
#24 0x7f7d2632d65b in std::_Rb_tree<std::string, std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > >, std::_Select1st<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >, std::le
ss<std::string>, std::allocator<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > > >::_M_erase(std::_Rb_tree_node<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >*) (/cvmfs/cms
-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x27065b)
#25 0x7f7d2632d3c4 in std::_Rb_tree<std::string, std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > >, std::_Select1st<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >, std::le
ss<std::string>, std::allocator<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > > >::_M_erase(std::_Rb_tree_node<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >*) (/cvmfs/cms
-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x2703c4)
#26 0x7f7d2632d3c4 in std::_Rb_tree<std::string, std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > >, std::_Select1st<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >, std::le
ss<std::string>, std::allocator<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > > >::_M_erase(std::_Rb_tree_node<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >*) (/cvmfs/cms
-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x2703c4)
#27 0x7f7d2632d3c4 in std::_Rb_tree<std::string, std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > >, std::_Select1st<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >, std::le
ss<std::string>, std::allocator<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > > >::_M_erase(std::_Rb_tree_node<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >*) (/cvmfs/cms
-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x2703c4)
#28 0x7f7d2632d3c4 in std::_Rb_tree<std::string, std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > >, std::_Select1st<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >, std::le
ss<std::string>, std::allocator<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > > >::_M_erase(std::_Rb_tree_node<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >*) (/cvmfs/cms
-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x2703c4)
#29 0x7f7d2632d3c4 in std::_Rb_tree<std::string, std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > >, std::_Select1st<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >, std::le
ss<std::string>, std::allocator<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > > >::_M_erase(std::_Rb_tree_node<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >*) (/cvmfs/cms
-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x2703c4)
#30 0x7f7d2632d3c4 in std::_Rb_tree<std::string, std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > >, std::_Select1st<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >, std::le
ss<std::string>, std::allocator<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > > >::_M_erase(std::_Rb_tree_node<std::pair<std::string const, edm::propagate_const<std::shared_ptr<edm::maker::ModuleHolder> > > >*) (/cvmfs/cms
-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x2703c4)
#31 0x7f7d2632d7c5 in std::_Sp_counted_ptr<edm::ModuleRegistry*, (__gnu_cxx::_Lock_policy)2>::_M_dispose() (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x2707c5)
#32 0x42192c in std::_Sp_counted_base<(__gnu_cxx::_Lock_policy)2>::_M_release() (/cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/bin/slc6_amd64_gcc700/cmsRun+0x42192c)
#33 0x7f7d2651e3ca in std::default_delete<edm::Schedule>::operator()(edm::Schedule*) const [clone .isra.797] [clone .part.798] (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x4613
ca)
#34 0x7f7d2652fd34 in edm::EventProcessor::~EventProcessor() (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x472d34)
#35 0x40e757 in (anonymous namespace)::EventProcessorWithSentry::~EventProcessorWithSentry() (/cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/bin/slc6_amd64_gcc700/cmsRun+0x40e757)
#36 0x40d378 in main (/cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/bin/slc6_amd64_gcc700/cmsRun+0x40d378)
#37 0x7f7d22fa5d5c in __libc_start_main (/lib64/libc.so.6+0x1ed5c)
#38 0x40da88 (/cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/bin/slc6_amd64_gcc700/cmsRun+0x40da88)
0x61600017a678 is located 8 bytes to the left of 536-byte region [0x61600017a680,0x61600017a898)
allocated by thread T0 here:
#0 0x7f7d26981ac0 in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cc:62
#1 0x7f7d01108a5e in Eigen::internal::aligned_malloc(unsigned long) /mnt/build/asan/ext/a/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/util/Memory.h:159
#2 0x7f7d01111d56 in void* Eigen::internal::conditional_aligned_malloc<true>(unsigned long) /mnt/build/asan/ext/a/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/util/Memory.h:214
#3 0x7f7d011105dd in double* Eigen::internal::conditional_aligned_new_auto<double, true>(unsigned long) /mnt/build/asan/ext/a/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/util/Memory.h:374
#4 0x7f7d0111066b in Eigen::DenseStorage<double, -1, -1, 1, 0>::resize(long, long, long) /mnt/build/asan/ext/a/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/DenseStorage.h:557
#5 0x7f7d0110da90 in Eigen::PlainObjectBase<Eigen::Matrix<double, -1, 1, 0, -1, 1> >::resize(long) /mnt/build/asan/ext/a/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/PlainObjectBase.h:319
#6 0x7f7d0110b432 in void Eigen::PlainObjectBase<Eigen::Matrix<double, -1, 1, 0, -1, 1> >::_init1<unsigned long>(long, Eigen::internal::enable_if<((((Eigen::DenseBase<Eigen::Matrix<double, -1, 1, 0, -1, 1> >::{unnamed type#1})-1)!=(1))||(!Eigen::internal::is_convertib
le<unsigned long, double>::value))&&((!((Eigen::internal::is_same<Eigen::MatrixXpr, Eigen::ArrayXpr>::{unnamed type#1})0))||((({unnamed type#1})-1)==Eigen::Dynamic)), Eigen::internal::is_convertible>::type*) /mnt/build/asan/ext/a/slc6_amd64_gcc700/external/eigen/f3a22f35b
044-fmblme/include/eigen3/Eigen/src/Core/PlainObjectBase.h:776
#7 0x7f7d011094e5 in Eigen::Matrix<double, -1, 1, 0, -1, 1>::Matrix<unsigned long>(unsigned long const&) /mnt/build/asan/ext/a/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/Matrix.h:296
#8 0x7f7d01107934 in lwt::InputPreprocessor::InputPreprocessor(std::vector<lwt::Input, std::allocator<lwt::Input> > const&) src/LightweightNeuralNetwork.cxx:224
#9 0x7f7d01107cf6 in lwt::LightweightNeuralNetwork::LightweightNeuralNetwork(std::vector<lwt::Input, std::allocator<lwt::Input> > const&, std::vector<lwt::LayerConfig, std::allocator<lwt::LayerConfig> > const&, std::vector<std::string, std::allocator<std::string> > co
nst&) src/LightweightNeuralNetwork.cxx:255
#10 0x7f7d01445d69 in DeepFlavourJetTagsProducer::DeepFlavourJetTagsProducer(edm::ParameterSet const&) /mnt/build/asan/CMSSW_10_0_ASAN_X_2017-10-30-2300/src/RecoBTag/Combined/plugins/DeepFlavourJetTagsProducer.cc:116
#11 0x7f7d01487418 in DeepFlavourJetTagsProducer* edm::stream::impl::makeStreamModule<DeepFlavourJetTagsProducer>(edm::ParameterSet const&, void const*) /cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/src/FWCore/Framework/inte
rface/stream/makeGlobal.h:49
#12 0x7f7d01485d4b in edm::stream::ProducingModuleAdaptor<DeepFlavourJetTagsProducer, edm::stream::EDProducerBase, edm::stream::EDProducerAdaptorBase>::setupStreamModules()::{lambda()#1}::operator()() const /cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW
_10_0_ASAN_X_2017-10-30-2300/src/FWCore/Framework/interface/stream/ProducingModuleAdaptor.h:86
#13 0x7f7d014875b8 in void edm::stream::ProducingModuleAdaptorBase<edm::stream::EDProducerBase>::createStreamModules<edm::stream::ProducingModuleAdaptor<DeepFlavourJetTagsProducer, edm::stream::EDProducerBase, edm::stream::EDProducerAdaptorBase>::setupStreamModules():
:{lambda()#1}>(edm::stream::ProducingModuleAdaptor<DeepFlavourJetTagsProducer, edm::stream::EDProducerBase, edm::stream::EDProducerAdaptorBase>::setupStreamModules()::{lambda()#1}) /cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/s
rc/FWCore/Framework/interface/stream/ProducingModuleAdaptorBase.h:113
#14 0x7f7d01485dba in edm::stream::ProducingModuleAdaptor<DeepFlavourJetTagsProducer, edm::stream::EDProducerBase, edm::stream::EDProducerAdaptorBase>::setupStreamModules() /cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/src/F
WCore/Framework/interface/stream/ProducingModuleAdaptor.h:85
#15 0x7f7d26774a7f in edm::stream::ProducingModuleAdaptorBase<edm::stream::EDProducerBase>::doPreallocate(edm::PreallocationConfiguration const&) (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCore
Framework.so+0x6b7a7f)
#16 0x7f7d0142e60b in edm::maker::ModuleHolderT<edm::stream::EDProducerAdaptorBase>::preallocate(edm::PreallocationConfiguration const&) /cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/src/FWCore/Framework/src/ModuleHolder.h:7
3
#17 0x7f7d2643a84c in edm::Maker::makeModule(edm::MakeModuleParams const&, edm::signalslot::Signal<void (edm::ModuleDescription const&)>&, edm::signalslot::Signal<void (edm::ModuleDescription const&)>&) const (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CM
SSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x37d84c)
#18 0x7f7d266fc6aa in edm::Factory::makeModule(edm::MakeModuleParams const&, edm::signalslot::Signal<void (edm::ModuleDescription const&)>&, edm::signalslot::Signal<void (edm::ModuleDescription const&)>&) const (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/
CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x63f6aa)
#19 0x7f7d266da62b in edm::ModuleRegistry::getModule(edm::MakeModuleParams const&, std::string const&, edm::signalslot::Signal<void (edm::ModuleDescription const&)>&, edm::signalslot::Signal<void (edm::ModuleDescription const&)>&) (/cvmfs/cms-ib.cern.ch/week0/slc6_amd
64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x61d62b)
#20 0x7f7d2632b40f in edm::WorkerRegistry::getWorker(edm::WorkerParams const&, std::string const&) (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x26e40f)
#21 0x7f7d264ab489 in edm::WorkerManager::getWorker(edm::ParameterSet&, edm::ProductRegistry&, edm::PreallocationConfiguration const*, std::shared_ptr<edm::ProcessConfiguration const>, std::string const&) (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_
10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x3ee489)
#22 0x7f7d264adffc in edm::WorkerManager::addToUnscheduledWorkers(edm::ParameterSet&, edm::ProductRegistry&, edm::PreallocationConfiguration const*, std::shared_ptr<edm::ProcessConfiguration>, std::string, std::set<std::string, std::less<std::string>, std::allocator<s
td::string> >&, std::vector<std::string, std::allocator<std::string> >&) (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x3f0ffc)
#23 0x7f7d264074f3 in edm::StreamSchedule::StreamSchedule(std::shared_ptr<edm::TriggerResultInserter>, std::vector<edm::propagate_const<std::shared_ptr<edm::PathStatusInserter> >, std::allocator<edm::propagate_const<std::shared_ptr<edm::PathStatusInserter> > > >&, std
::vector<edm::propagate_const<std::shared_ptr<edm::EndPathStatusInserter> >, std::allocator<edm::propagate_const<std::shared_ptr<edm::EndPathStatusInserter> > > >&, std::shared_ptr<edm::ModuleRegistry>, edm::ParameterSet&, edm::service::TriggerNamesService const&, edm::Pr
eallocationConfiguration const&, edm::ProductRegistry&, edm::BranchIDListHelper&, edm::ExceptionToActionTable const&, std::shared_ptr<edm::ActivityRegistry>, std::shared_ptr<edm::ProcessConfiguration>, bool, edm::StreamID, edm::ProcessContext const*) (/cvmfs/cms-ib.cern.c
h/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCoreFramework.so+0x34a4f3)
#24 0x7f7d265ca672 in edm::Schedule::Schedule(edm::ParameterSet&, edm::service::TriggerNamesService const&, edm::ProductRegistry&, edm::BranchIDListHelper&, edm::ThinnedAssociationsHelper&, edm::SubProcessParentageHelper const*, edm::ExceptionToActionTable const&, std
::shared_ptr<edm::ActivityRegistry>, std::shared_ptr<edm::ProcessConfiguration>, bool, edm::PreallocationConfiguration const&, edm::ProcessContext const*) (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libF
WCoreFramework.so+0x50d672)
#25 0x7f7d26289aff in edm::ScheduleItems::initSchedule(edm::ParameterSet&, bool, edm::PreallocationConfiguration const&, edm::ProcessContext const*) (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWC
oreFramework.so+0x1ccaff)
#26 0x7f7d26533232 in edm::EventProcessor::init(std::shared_ptr<edm::ProcessDesc>&, edm::ServiceToken const&, edm::serviceregistry::ServiceLegacy) (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700/libFWCor
eFramework.so+0x476232)
#27 0x7f7d2653cb0f in edm::EventProcessor::EventProcessor(std::shared_ptr<edm::ProcessDesc>, edm::ServiceToken const&, edm::serviceregistry::ServiceLegacy) (/cvmfs/cms-ib.cern.ch/week0/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/lib/slc6_amd64_gcc700
/libFWCoreFramework.so+0x47fb0f)
#28 0x412c3d in main::{lambda()#1}::operator()() const (/cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/bin/slc6_amd64_gcc700/cmsRun+0x412c3d)
#29 0x40d322 in main (/cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/cms/cmssw/CMSSW_10_0_ASAN_X_2017-10-30-2300/bin/slc6_amd64_gcc700/cmsRun+0x40d322)
SUMMARY: AddressSanitizer: heap-buffer-overflow /cvmfs/cms-ib.cern.ch/nweek-02496/slc6_amd64_gcc700/external/eigen/f3a22f35b044-fmblme/include/eigen3/Eigen/src/Core/util/Memory.h:98 in Eigen::internal::handmade_aligned_free(void*)
Shadow bytes around the buggy address:
0x0c2c80027470: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x0c2c80027480: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x0c2c80027490: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x0c2c800274a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x0c2c800274b0: 00 fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
=>0x0c2c800274c0: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa[fa]
0x0c2c800274d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x0c2c800274e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x0c2c800274f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x0c2c80027500: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0x0c2c80027510: 00 00 00 fa fa fa fa fa fa fa fa fa fa fa fa fa
Shadow byte legend (one shadow byte represents 8 application bytes):
Addressable: 00
Partially addressable: 01 02 03 04 05 06 07
Heap left redzone: fa
Freed heap region: fd
Stack left redzone: f1
Stack mid redzone: f2
Stack right redzone: f3
Stack after return: f5
Stack use after scope: f8
Global redzone: f9
Global init order: f6
Poisoned by user: f7
Container overflow: fc
Array cookie: ac
Intra object redzone: bb
ASan internal: fe
Left alloca redzone: ca
Right alloca redzone: cb
==30841==ABORTINGI locally updated Egein to latest commit and same with lwtnn and the problem went away. I think, updating lwtnn would be just enough to solve this.
smuzaffar
commented
6 years ago assign reconstruction, externals
cmsbuild
commented
6 years ago New categories assigned: externals,reconstruction
@smuzaffar,@slava77,@perrotta,@gudrutis,@mrodozov you have been requested to review this Pull request/Issue and eventually sign? Thanks
davidlt
commented
6 years ago This is what I used locally for testing:
diff --git a/eigen.spec b/eigen.spec
index 0243a71..1a842d5 100644
--- a/eigen.spec
+++ b/eigen.spec
@@ -1,4 +1,4 @@
-### RPM external eigen f3a22f35b044
+### RPM external eigen dc83e26d8a3c
## INITENV +PATH PKG_CONFIG_PATH %{i}/share/pkgconfig
## NOCOMPILER
%define tag %{realversion}
@@ -11,7 +11,7 @@ BuildRequires: cmake
%build
mkdir build
cd build
-cmake -DCMAKE_INSTALL_PREFIX=%{i} ../
+cmake -DCMAKE_INSTALL_PREFIX=%{i} -DBUILD_TESTING=OFF ../
%install
cd build
diff --git a/lwtnn.spec b/lwtnn.spec
index 15166a5..f77af81 100644
--- a/lwtnn.spec
+++ b/lwtnn.spec
@@ -1,17 +1,32 @@
-### RPM external lwtnn 1.0
+### RPM external lwtnn 2.4
+
Source: https://github.com/lwtnn/lwtnn/archive/v%{realversion}.tar.gz
-BuildRequires: py2-pkgconfig
+BuildRequires: py2-pkgconfig ninja cmake
Requires: eigen boost
-Patch0: lwtnn-1.0-boost-fix
+
%prep
%setup -n %{n}-%{realversion}
-%patch0 -p1
%build
-export BOOST_ROOT
-make all
+rm -rf ../build
+mkdir ../build
+cd ../build
+
+cmake ../%{n}-%{realversion} \
+ -G Ninja \
+ -DCMAKE_CXX_COMPILER="g++" \
+ -DCMAKE_CXX_FLAGS="-fPIC" \
+ -DCMAKE_INSTALL_PREFIX:PATH="%{i}" \
+ -DCMAKE_BUILD_TYPE=Release \
+ -DBUILTIN_BOOST=OFF \
+ -DBUILTIN_EIGEN=OFF \
+ -DCMAKE_PREFIX_PATH="${EIGEN_ROOT};${BOOST_ROOT}"
+
+ninja -v %{makeprocesses} -l $(getconf _NPROCESSORS_ONLN)
%install
-cp -r {lib,bin,include} %{i}/
+cd ../build
+
+ninja -v %{makeprocesses} -l $(getconf _NPROCESSORS_ONLN) install
slava77
commented
6 years ago @smuzaffar @davidlt for the externals, is there an issue in cmsdist already?
smuzaffar
commented
6 years ago @slava77 , not yet. @mrodozov , can you please take care of it.
mrodozov
commented
6 years ago I've updated lwtnn alone here https://github.com/cms-sw/cmsdist/pull/3562
CMSSW:
CMSSW_10_0_ASAN_X_2017-10-30-2300SCRAM_ARCH:slc6_amd64_gcc700Workflow:3.0Step:step3Detailed report: