search

flux-framework / flux-core

core services for the Flux resource management framework
GNU Lesser General Public License v3.0
168 stars 50 forks source link

lua: fluxometer not found when `make check` is run in-tree #1585

Closed SteVwonder closed 6 years ago

SteVwonder commented 6 years ago

I had this happen on two different systems today. I think it might be an some oddity of my environment. Anyways, to reproduce:

clone flux-core
./autogen.sh
ml load flux-core/master # or spack load flux
./configure --prefix=$HOME/foo/bar
make -j 64
make -j 64 check

The output:

ERROR: lua/t0002-rpc.t - missing test plan                                           
ERROR: lua/t0002-rpc.t - exited with status 1                                                            
ERROR: lua/t0001-send-recv.t - missing test plan                                     
ERROR: lua/t0001-send-recv.t - exited with status 1                             
ERROR: lua/t0004-getattr.t - missing test plan                                  
ERROR: lua/t1002-kvs.t - missing test plan                                                      
ERROR: lua/t0004-getattr.t - exited with status 1                                     
ERROR: lua/t1002-kvs.t - exited with status 1                              
ERROR: lua/t0003-events.t - missing test plan                                 
ERROR: lua/t0003-events.t - exited with status 1                                               
ERROR: lua/t1000-reactor.t - missing test plan                                     
ERROR: lua/t1000-reactor.t - exited with status 1                                
ERROR: lua/t0007-alarm.t - missing test plan                                            
ERROR: lua/t0007-alarm.t - exited with status 1                                              
ERROR: lua/t1001-timeouts.t - missing test plan                                              
ERROR: lua/t1001-timeouts.t - exited with status 1                                        
ERROR: lua/t0009-sequences.t - missing test plan                                       
ERROR: lua/t0009-sequences.t - exited with status 1

If I pull open one of the log files from those tests:

# herbein1 at rzansel61 in ~/workspace/repos_blueos/flux-framework/flux-core/t on git:upmaster ✖︎ [16:49:54]
→ less ./lua/t0001-send-recv.log 
lua: ./lua/t0001-send-recv.t:5: module 'fluxometer' not found:
        no field package.preload['fluxometer']
        no file '/g/g0/herbein1/opt/packages/blueos3/flux-core/master/share/lua/5.1/fluxometer.lua'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-luaposix-33.4.0-ni6x4iild7a77i7nas5abth4t4vpndcp/lib/lua/5.1/fluxometer.lua'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-luaposix-33.4.0-ni6x4iild7a77i7nas5abth4t4vpndcp/lib/lua/5.1/fluxometer/init.lua'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-luaposix-33.4.0-ni6x4iild7a77i7nas5abth4t4vpndcp/share/lua/5.1/fluxometer.lua'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-luaposix-33.4.0-ni6x4iild7a77i7nas5abth4t4vpndcp/share/lua/5.1/fluxometer/init.lua'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/lib/lua/5.1/fluxometer.lua'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/lib/lua/5.1/fluxometer/init.lua'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/lib64/lua/5.1/fluxometer.lua'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/lib64/lua/5.1/fluxometer/init.lua'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/share/lua/5.1/fluxometer.lua'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/share/lua/5.1/fluxometer/init.lua'
        no file '/g/g0/herbein1/opt/packages/blueos3/flux-core/master/share/lua/5.1/fluxometer.so'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-luaposix-33.4.0-ni6x4iild7a77i7nas5abth4t4vpndcp/lib/lua/5.1/fluxometer.so'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-luaposix-33.4.0-ni6x4iild7a77i7nas5abth4t4vpndcp/share/lua/5.1/fluxometer.so'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/lib/lua/5.1/fluxometer.so'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/lib64/lua/5.1/fluxometer.so'
        no file '/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/share/lua/5.1/fluxometer.so'
stack traceback:
        [C]: in function 'require'
        ./lua/t0001-send-recv.t:5: in main chunk
        [C]: ?
ERROR: lua/t0001-send-recv.t - missing test plan
ERROR: lua/t0001-send-recv.t - exited with status 1

If I make install then make -j 64 check, the problem goes away (presumably because fluxometer is installed and then found).

I think the problem comes down to me having my LUA_PATH set my lmod & spack.

# herbein1 at rzansel61 in ~/workspace/repos_blueos/flux-framework/flux-core/t on git:upmaster ✖︎ [16:59:00]
→ printenv LUA_PATH
/g/g0/herbein1/opt/packages/blueos3/flux-core/master/share/lua/5.1/?.lua;/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-luaposix-33.4.0-ni6x4iild7a77i7nas5abth4t4vpndcp/lib/lua/5.1/?.lua;/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-luaposix-33.4.0-ni6x4iild7a77i7nas5abth4t4vpndcp/lib/lua/5.1/?/init.lua;/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-luaposix-33.4.0-ni6x4iild7a77i7nas5abth4t4vpndcp/share/lua/5.1/?.lua;/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-luaposix-33.4.0-ni6x4iild7a77i7nas5abth4t4vpndcp/share/lua/5.1/?/init.lua;/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/lib/lua/5.1/?.lua;/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/lib/lua/5.1/?/init.lua;/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/lib64/lua/5.1/?.lua;/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/lib64/lua/5.1/?/init.lua;/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/share/lua/5.1/?.lua;/usr/workspace/wsrzd/herbein1/spack/blueos3/opt/spack/linux-rhel7-ppc64le/gcc-4.9.3/lua-5.1.5-dnygn7vkbcem2fwsc6dxrhjg2jxoy33j/share/lua/5.1/?/init.lua
SteVwonder commented 6 years ago

Ok. Yeah. It looks like it is my env. If I add ;; to the end of my LUA_PATH everything works as expected. I don't know if that means this is a non-issue or if there is some way to avoid this hangup via some autotools-fu.

grondo commented 6 years ago

Yeah, good catch. I'll try to look into this. make check should at least ensure the build fluxometer is used, and not the installed version -- same with our other Lua modules...