uwsampa / grappa

Grappa: scaling irregular applications on commodity clusters
grappa.io
BSD 3-Clause "New" or "Revised" License
159 stars 50 forks source link

Build problem with MPI library #198

Open rfvander opened 9 years ago

rfvander commented 9 years ago

I downloaded Grappa and am now trying to build it, but instructions are a bit sparse. If I define symbols CC and CXX to resolve to the Intel compilers icc and icpc, respectively, I get the error message below. Obviously, my installed MPI cannot be found. I tried to fix that by setting: “export MPICC=mpiicc” but that did not work, nor did “export MPI_C=mpiicc”. There is no reference to MPI in “configure” or in “FindPackageHandleStandardArgs.cmake “. Do you have any suggestions? By the way, I also have GASNet installed, so if that is the better communication layer, I'll use that--if I can get some instructions how to do that. Thanks.

Rob

[rfvander@bar1 grappa]$ export CC=icc [rfvander@bar1 grappa]$ export CXX=icpc [rfvander@bar1 grappa]$ ./configure --gen=Make --mode=Release cmake /lustre/home/rfvander/grappa -G"Unix Makefiles" -DSHMMAX=33554432 -DCMAKE_C_COMPILER=icc -DCMAKE_CXX_COMPILER=icpc -DBASE_C_COMPILER=icc -DBASE_CXX_COMPILER=icpc -DCMAKE_BUILD_TYPE=RelWithDebInfo -- The C compiler identification is Intel 15.0.0.20140723 -- The CXX compiler identification is Intel 15.0.0.20140723 -- Check for working C compiler: /opt/intel/tools/composer_xe_2015.0.090/bin/intel64/icc -- Check for working C compiler: /opt/intel/tools/composer_xe_2015.0.090/bin/intel64/icc -- works -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working CXX compiler: /opt/intel/tools/composer_xe_2015.0.090/bin/intel64/icpc -- Check for working CXX compiler: /opt/intel/tools/composer_xe_2015.0.090/bin/intel64/icpc -- works -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Boost found: 1.53.0 -- /usr CMake Error at /usr/share/cmake/Modules/ FindPackageHandleStandardArgs.cmake:108 (message): Could NOT find MPI_C (missing: MPI_C_LIBRARIES) Call Stack (most recent call first): /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:315 (_FPHSA_FAILURE_MESSAGE) /usr/share/cmake/Modules/FindMPI.cmake:587 (find_package_handle_standard_args) CMakeLists.txt:205 (find_package)

-- Configuring incomplete, errors occurred! See also "/lustre/home/rfvander/grappa/build/Make+Release/CMakeFiles/CMakeOutput.log".

nelsonje commented 9 years ago

Great! Simon and I just saw this error in a VM he was building. It went away when we blew away the build directory and rebuilt (with no -j flag specified). I'm trying to reproduce it again.

Would you try running like this and send me the output?

make demo-hello_world VERBOSE=1

And if convenient would you tar up your build directory and send it to me too? I'll point you at a FTP server you can drop it on.

rfvander commented 9 years ago

Um, OK, you may be excited, but I just want to build the darn thing ☺. Anyway, I’ll do the whole thing again and stuff everything you need at that FTP site. And after that I’ll do the non-parallel make so I can finally build and run some Grappa code! I’m at home with slow internet now, so won’t be moving the gobs of data to your FTP site until tomorrow at work.

Rob

From: Jacob Nelson [mailto:notifications@github.com] Sent: Tuesday, January 27, 2015 5:40 PM To: uwsampa/grappa Cc: Van Der Wijngaart, Rob F Subject: Re: [grappa] Build problem with MPI library (#198)

Great! Simon and I just saw this error in a VM he was building. It went away when we blew away the build directory and rebuilt (with no -j flag specified). I'm trying to reproduce it again.

Would you try running like this and send me the output?

make demo-hello_world VERBOSE=1

And if convenient would you tar up your build directory and send it to me too? I'll point you at a FTP server you can drop it on.

— Reply to this email directly or view it on GitHubhttps://github.com/uwsampa/grappa/issues/198#issuecomment-71766053.

nelsonje commented 9 years ago

Hey, I'm just excited that I could reproduce this one. You can skip sending the build directory since I've been able to repeat it now.

rfvander commented 9 years ago

OK, Jacob, back at my desk now. So I should not do anything at this point?

Rob

From: Jacob Nelson [mailto:notifications@github.com] Sent: Wednesday, January 28, 2015 10:05 AM To: uwsampa/grappa Cc: Van Der Wijngaart, Rob F Subject: Re: [grappa] Build problem with MPI library (#198)

Hey, I'm just excited that I could reproduce this one. You can skip sending the build directory since I've been able to repeat it now.

— Reply to this email directly or view it on GitHubhttps://github.com/uwsampa/grappa/issues/198#issuecomment-71883822.

nelsonje commented 9 years ago

Yes, hold off for a bit---the serial build doesn't avoid the problem. I'll let you know when my debugging yields something.

rfvander commented 9 years ago

OK, I’ll immediately start doing nothing, then.

From: Jacob Nelson [mailto:notifications@github.com] Sent: Wednesday, January 28, 2015 10:42 AM To: uwsampa/grappa Cc: Van Der Wijngaart, Rob F Subject: Re: [grappa] Build problem with MPI library (#198)

Yes, hold off for a bit---the serial build doesn't avoid the problem. I'll let you know when my debugging yields something.

— Reply to this email directly or view it on GitHubhttps://github.com/uwsampa/grappa/issues/198#issuecomment-71890407.

simonkahan commented 9 years ago

What did you do differently that repeated it?

On Wed, Jan 28, 2015 at 10:42 AM, Jacob Nelson notifications@github.com wrote:

Yes, hold off for a bit---the serial build doesn't avoid the problem. I'll let you know when my debugging yields something.

— Reply to this email directly or view it on GitHub https://github.com/uwsampa/grappa/issues/198#issuecomment-71890407.

nelsonje commented 9 years ago

(replying belatedly to Simon: I built Boost from scratch rather than pointing at an already-installed version. It turns out our build system made different assumptions in that case which are no longer true.)

nelsonje commented 9 years ago

Okay, Rob, I just merged some more build system changes into master. If you pull and rebuild you should not get the error you saw.

I'll have a makefile solution shortly as well.

rfvander commented 9 years ago

Terrific, Jacob. I really appreciate your efforts and patience. I’ll let you know how I fare.

Rob

From: Jacob Nelson [mailto:notifications@github.com] Sent: Friday, January 30, 2015 2:55 PM To: uwsampa/grappa Cc: Van Der Wijngaart, Rob F Subject: Re: [grappa] Build problem with MPI library (#198)

Okay, Rob, I just merged some more build system changes into master. If you pull and rebuild you should not get the error you saw.

I'll have a makefile solution shortly as well.

— Reply to this email directly or view it on GitHubhttps://github.com/uwsampa/grappa/issues/198#issuecomment-72284978.

rfvander commented 9 years ago

The sweet smell of success! Have a good weekend, Jacob.

Rob

[rfvander@eln4 Make+Release]$ make demo-hello_world [ 10%] Built target third-party-gflags [ 20%] Built target third-party-boost [ 30%] Built target third-party-glog [ 30%] Built target all-third-party [ 35%] Built target graph500-generator [ 97%] Built target Grappa Scanning dependencies of target demo-hello_world [100%] Building CXX object applications/demos/CMakeFiles/demo-hello_world.dir/hello_world/hello_world.cpp.o Linking CXX executable hello_world.exe [100%] Built target demo-hello_world

From: Jacob Nelson [mailto:notifications@github.com] Sent: Friday, January 30, 2015 2:55 PM To: uwsampa/grappa Cc: Van Der Wijngaart, Rob F Subject: Re: [grappa] Build problem with MPI library (#198)

Okay, Rob, I just merged some more build system changes into master. If you pull and rebuild you should not get the error you saw.

I'll have a makefile solution shortly as well.

— Reply to this email directly or view it on GitHubhttps://github.com/uwsampa/grappa/issues/198#issuecomment-72284978.