ComputationalRadiationPhysics / clara2

Clara2 - a parallel classical radiation calculator based on Liénard-Wiechert potentials
GNU General Public License v3.0
13 stars 9 forks source link

Submit script for tianhe2 SLURM #93

Open PrometheusPi opened 6 years ago

PrometheusPi commented 6 years ago

As needed by @QJohn2017 a setup script for tianhe2 is needed (see #89). Since tianhe2 uses SLURM for scheduling, either the ./prepare_job script needs to be adjusted to an ./prepare_job_tianhe2.shscript which creates a SLURM submit file or we go directly with an submit file that focuses on MPI jobs only (since tianhe2 is large and probably has to handle quite a lot of jobs, MPI is probably the better choice for this system).

Additionally, submit scripts for other clusters (taurus, PizDaint, etc.) should be provided.

@QJohn2017 Are you planing to submit with MPI only or are you also considering running SLURM Array jobs? If only an MPI job is planned, a simple submit script should be sufficient.

PrometheusPi commented 6 years ago

@QJohn2017 some questions regarding your setup on tinahe2:

If you could provide an example submit file, that would help a lot.

QJohn2017 commented 6 years ago

@PrometheusPi In my supercomputer center, a node has 24 cores, and i don't know the available memory on each node. The following is one of my submit file when i use the EPOCH program on the tianhe2 #!/bin/bash echo Data | yhrun -N 4 -n 96 ./bin/epoch2d

QJohn2017 commented 6 years ago

@PrometheusPi sorry, the submit command is #!/bin/bash echo Data | yhrun -N 4 -n 96 ./bin/epoch2d

And other submit command is _**#!/bin/bash**_ _**yhrun -N 4 -n 96 ../src/lapin lapin.inp**_

QJohn2017 commented 6 years ago

@PrometheusPi #!/bin/bash yhrun -N 4 -n 96 ../src/lapin lapin.inp

QJohn2017 commented 6 years ago

@PrometheusPi ,

When I use the submit commands above, one of the output file is named slurm-4399462.out where the number is the job ID

PrometheusPi commented 6 years ago

Do you submit these scripts via the command sbatch? Like for example:

siom003@login3 sbatch my_submit_file.sh

You do not need any specifications via bash comments as e.g.:

#SBATCH --partition=normal
#SBATCH --time=24:00:00

#SBATCH --job-name=NameOfMyJob
#SBATCH --nodes=8
#SBATCH --ntasks-per-node=1
#SBATCH --cpus-per-task=12
#SBATCH --ntasks-per-core=1
#SBATCH -o stdout
#SBATCH -e stderr

What does the help file of sbatch -h return?

PrometheusPi commented 6 years ago

@QJohn2017 Is yhrun an mpi distribution command like mpiexec, mpirun or srun?

PrometheusPi commented 6 years ago

Could you try running yhrun -N 2 -n 48 ./path_to_clara_src/executable?

QJohn2017 commented 6 years ago

@PrometheusPi How do you know the siom003@login3 siom003 is our group name in Shanghai supercomputer center

QJohn2017 commented 6 years ago

@PrometheusPi , In tianhe2, when i create the submit file script, e.g., named test.sh. Then I submit the job by input the command yhbatch -N 4 ./test.sh

QJohn2017 commented 6 years ago

@PrometheusPi , The yhrun is used when I submit the job without a script .sh file. The yhbatch is used when the submit script .sh file is used

PrometheusPi commented 6 years ago

The bash interface siom003@login3 is the interface you used in your first issue - I just copy and pasted it to the resemble a known interface in order to emphasize that the entry is intended to directly work on the command line. However, if this is the computer system for your group, then sbatchmight not exist there - it might only be available at a login node of the super computer.

PrometheusPi commented 6 years ago

Remark for myself: sbatch is called yhbatch srun is called yhrun

PrometheusPi commented 6 years ago

Okay - Sorry - I got confused: The initial error message in #89 is from your Shanghai supercomputer center. The second message in #89 with the warnings is from tianhe2. Is this correct?

Then please excuse my confusion and the use of siom003@login3 - then this should be executed not in Shanghai but on tianhe2.

QJohn2017 commented 6 years ago

@PrometheusPi , Yes, the initial error message in #89 is from Shanghai supercomputer center. The other error massages all come from the tianhe2.

QJohn2017 commented 6 years ago

@PrometheusPi , I want to compute this program on tianhe2 firstly. When the program compute correctly on tianhe2, I will consider it on Shanghai supercomputer center

PrometheusPi commented 6 years ago

Okay - then please excuse my confusion. I thought it is the same machine but different nodes.

Than let us start with finding a setup for tianhe2 first.

I know tianhe2 has a SLURM submit system with the above mentioned renaming. You mentioned, that you submit via yhbatch -N 4 ./test.sh.

In test.sh, do you specify anything via bash comments #SBATCH ... or #YHBATCH?

PrometheusPi commented 6 years ago

Could you copy the help of yhbatch to this issue? (This can probably be done by yhbatch -h or yhbatch --help or man yhbatch) I assume everything will be similar or equal to sbatch, but I don't know.

QJohn2017 commented 6 years ago

@PrometheusPi , Just now, I submit the job by a script file named test.sh. The commands in test.sh file is #!/bin/bash yhrun -N 2 -n 48 executable

When I input the following commands to submit the job yhbatch -N 2 ./test.sh

There are some errors appeared as follows

executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
yhrun: error: cn10352: tasks 0-23: Exited with exit code 127
QJohn2017 commented 6 years ago

@PrometheusPi , When I input the comand yhbatch -h, the returned results are as follows:

[ac_siom_jsliu_1@ln3%tianhe2-C src]$ yhbatch -h
Usage: sbatch [OPTIONS...] executable [args...]

Parallel run options:
  -a, --array=indexes        job array index values
  -A, --account=name          charge job to specified account
      --begin=time            defer job until HH:MM MM/DD/YY
  -c, --cpus-per-task=ncpus   number of cpus required per task
      --comment=name          arbitrary comment
  -d, --dependency=type:jobid defer job until condition on jobid is satisfied
  -D, --workdir=directory     set working directory for batch script
  -e, --error=err             file for batch script's standard error
      --export[=names]        specify environment variables to export
      --export-file=file|fd   specify environment variables file or file descriptor to export
      --get-user-env          load environment from local cluster
      --gid=group_id          group ID to run job as (user root only)
      --gres=list             required generic resources
  -H, --hold                  submit job in held state
  -i, --input=in              file for batch script's standard input
  -I, --immediate             exit if resources are not immediately available
      --jobid=id              run under already allocated job
  -J, --job-name=jobname      name of job
  -k, --no-kill               do not kill job on node failure
  -L, --licenses=names        required license, comma separated
  -m, --distribution=type     distribution method for processes to nodes
                              (type = block|cyclic|arbitrary)
  -M, --clusters=names        Comma separated list of clusters to issue
                              commands to.  Default is current cluster.
                              Name of 'all' will submit to run on all clusters.
      --mail-type=type        notify on state change: BEGIN, END, FAIL or ALL
      --mail-user=user        who to send email notification for job state
                              changes
  -n, --ntasks=ntasks         number of tasks to run
      --nice[=value]          decrease scheduling priority by value
      --no-requeue            if set, do not permit the job to be requeued
      --ntasks-per-node=n     number of tasks to invoke on each node
  -N, --nodes=N               number of nodes on which to run (N = min[-max])
  -o, --output=out            file for batch script's standard output
  -O, --overcommit            overcommit resources
  -p, --partition=partition   partition requested
      --profile=value         enable acct_gather_profile for detailed data
                              value is all or none or any combination of
                              energy, lustre, network or task
      --propagate[=rlimits]   propagate all [or specific list of] rlimits
      --qos=qos               quality of service
  -Q, --quiet                 quiet mode (suppress informational messages)
      --requeue               if set, permit the job to be requeued
  -t, --time=minutes          time limit
      --time-min=minutes      minimum time limit (if distinct)
  -s, --share                 share nodes with other jobs
      --uid=user_id           user ID to run job as (user root only)
  -v, --verbose               verbose mode (multiple -v's increase verbosity)
      --wrap[=command string] wrap commmand string in a sh script and submit
      --switches=max-switches{@max-time-to-wait}
                              Optimum switches and max time to wait for optimum
      --ignore-pbs            Ignore #PBS options in the batch script

Constraint options:
      --contiguous            demand a contiguous range of nodes
  -C, --constraint=list       specify a list of constraints
  -F, --nodefile=filename     request a specific list of hosts
      --mem=MB                minimum amount of real memory
      --mincpus=n             minimum number of logical processors (threads) per node
      --reservation=name      allocate resources from named reservation
      --tmp=MB                minimum amount of temporary disk
  -w, --nodelist=hosts...     request a specific list of hosts
  -x, --exclude=hosts...      exclude a specific list of hosts

Consumable resources related options:
      --exclusive             allocate nodes in exclusive mode when
                              cpu consumable resource is enabled
      --mem-per-cpu=MB        maximum amount of real memory per allocated
                              cpu required by the job.
                              --mem >= --mem-per-cpu if --mem is specified.

Affinity/Multi-core options: (when the task/affinity plugin is enabled)
  -B  --extra-node-info=S[:C[:T]]            Expands to:
       --sockets-per-node=S   number of sockets per node to allocate
       --cores-per-socket=C   number of cores per socket to allocate
       --threads-per-core=T   number of threads per core to allocate
                              each field can be 'min' or wildcard '*'
                              total cpus requested = (N x S x C x T)

      --ntasks-per-core=n     number of tasks to invoke on each core
      --ntasks-per-socket=n   number of tasks to invoke on each socket
      --cpu_bind=             Bind tasks to CPUs
                              (see "--cpu_bind=help" for options)
      --hint=                 Bind tasks according to application hints
                              (see "--hint=help" for options)
      --mem_bind=             Bind memory to locality domains (ldom)
                              (see "--mem_bind=help" for options)

Help options:
  -h, --help                  show this help message
  -u, --usage                 display brief usage message

Other options:
  -V, --version               output version information and exit

[ac_siom_jsliu_1@ln3%tianhe2-C src]$
PrometheusPi commented 6 years ago

Great, it looks like clara2 was put on the cluster. But when executed, the fftw library was not found.

Could you please run ldd on executable. In the environment you compiled clara2, all links provided by ldd should point to a know place. What does ldd executable returns at the computer you compiled the code at?

If you add the following line to your test.sh:

#!/bin/bash
ldd executable
yhrun -N 2 -n 48 executable

the same output should appear.

However, I assume that libfftw3.so.3 will point to ==> not found. Is this correct?

PrometheusPi commented 6 years ago

Thank you for the help file. So far, everything looks the same to sbatch.

QJohn2017 commented 6 years ago

@PrometheusPi When I input the command ldd executable, then the results are as follows:

[ac_siom_jsliu_1@ln3%tianhe2-C src]$ ldd executable
        linux-vdso.so.1 =>  (0x00007ffffedff000)
        libfftw3.so.3 => /usr/lib64/libfftw3.so.3 (0x0000003246000000)
        libm.so.6 => /lib64/libm.so.6 (0x0000003246800000)
        libz.so.1 => /lib64/libz.so.1 (0x0000003246c00000)
        libpthread.so.0 => /lib64/libpthread.so.0 (0x0000003246400000)
        librt.so.1 => /lib64/librt.so.1 (0x0000003247000000)
        libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x000000324d400000)
        libgcc_s.so.1 => /lib64/libgcc_s.so.1 (0x000000324bc00000)
        libc.so.6 => /lib64/libc.so.6 (0x0000003245c00000)
        /lib64/ld-linux-x86-64.so.2 (0x0000003245800000)
        libdl.so.2 => /lib64/libdl.so.2 (0x00002aacd857e000)
[ac_siom_jsliu_1@ln3%tianhe2-C src]$ ^C
[ac_siom_jsliu_1@ln3%tianhe2-C src]$
PrometheusPi commented 6 years ago

Great, and what does lddreturn, when executed in a submit script?

QJohn2017 commented 6 years ago

When the commands in test.sh file change to

#!/bin/bash
ldd executable
yhrun -N 2 -n 48 executable

The output errors become as follows:

    linux-vdso.so.1 =>  (0x00007fff8247e000)
    libfftw3.so.3 => not found
    libm.so.6 => /lib64/libm.so.6 (0x0000003921600000)
    libz.so.1 => /lib64/libz.so.1 (0x0000003922600000)
    libpthread.so.0 => /lib64/libpthread.so.0 (0x0000003922200000)
    librt.so.1 => /lib64/librt.so.1 (0x0000003922a00000)
    libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x0000003928200000)
    libgcc_s.so.1 => /lib64/libgcc_s.so.1 (0x0000003924e00000)
    libc.so.6 => /lib64/libc.so.6 (0x0000003921a00000)
    /lib64/ld-linux-x86-64.so.2 (0x0000003921200000)
    libdl.so.2 => /lib64/libdl.so.2 (0x0000003921e00000)
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
...
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
yhrun: error: cn9974: tasks 0-23: Exited with exit code 127
PrometheusPi commented 6 years ago

Okay - it looks like as if your bash environment is different between the node you compiled at and the node you ran via yhbatch.

Could you please copy the output of

echo $LD_LIBRARY_PATH

as returned from compile node to this issue.

And then additionally post the same result returned by yhbatch ./test.sh for the following test.sh file:

#!/bin/bash
echo $LD_LIBRARY_PATH
yhrun -N 2 -n 48 executable

There is probably some difference in the LD_LIBRARY_PATH.

QJohn2017 commented 6 years ago

When i input the command echo $LD_LIBRARY_PATH, it returns:

[ac_siom_jsliu_1@ln3%tianhe2-C src]$ echo $LD_LIBRARY_PATH
/usr/local/mpi3/lib:/WORK/app/hdf5/1.8.12/02/lib:/WORK/app/intel/Compiler/11.1/059/lib/intel64:/opt/intel/Compiler/11.1/059/ipp/em64t/sharedlib:/opt/intel/Compiler/11.1/059/mkl/lib/em64t:/opt/intel/composer_xe_2013_sp1.2.144/compiler/lib/intel64:/opt/intel/mic/coi/host-linux-release/lib:/opt/intel/mic/myo/lib:/opt/intel/composer_xe_2013_sp1.2.144/mpirt/lib/intel64:/opt/intel/composer_xe_2013_sp1.2.144/ipp/../compiler/lib/intel64:/opt/intel/composer_xe_2013_sp1.2.144/ipp/lib/intel64:/opt/intel/mic/coi/host-linux-release/lib:/opt/intel/mic/myo/lib:/opt/intel/composer_xe_2013_sp1.2.144/compiler/lib/intel64:/opt/intel/composer_xe_2013_sp1.2.144/mkl/lib/intel64:/opt/intel/composer_xe_2013_sp1.2.144/tbb/lib/intel64/gcc4.4
[ac_siom_jsliu_1@ln3%tianhe2-C src]$
QJohn2017 commented 6 years ago

When I add the command echo $LD_LIBRARY_PATH to test.sh and submit the job, it returns:

/usr/local/mpi3/lib:/WORK/app/hdf5/1.8.12/02/lib:/WORK/app/intel/Compiler/11.1/059/lib/intel64:/opt/intel/Compiler/11.1/059/ipp/em64t/sharedlib:/opt/intel/Compiler/11.1/059/mkl/lib/em64t:/opt/intel/composer_xe_2013_sp1.2.144/compiler/lib/intel64:/opt/intel/mic/coi/host-linux-release/lib:/opt/intel/mic/myo/lib:/opt/intel/composer_xe_2013_sp1.2.144/mpirt/lib/intel64:/opt/intel/composer_xe_2013_sp1.2.144/ipp/../compiler/lib/intel64:/opt/intel/composer_xe_2013_sp1.2.144/ipp/lib/intel64:/opt/intel/mic/coi/host-linux-release/lib:/opt/intel/mic/myo/lib:/opt/intel/composer_xe_2013_sp1.2.144/compiler/lib/intel64:/opt/intel/composer_xe_2013_sp1.2.144/mkl/lib/intel64:/opt/intel/composer_xe_2013_sp1.2.144/tbb/lib/intel64/gcc4.4
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
...
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
yhrun: error: cn10033: tasks 0-23: Exited with exit code 127
PrometheusPi commented 6 years ago

Okay - the path is identical - that is a bit confusing.

What does on the compile node the command file /usr/lib64/libfftw3.so.3 return?

Could you try the following for the test.sh

#!/bin/bash
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/lib64/
file /usr/lib64/libfftw3.so.3
yhrun -N 2 -n 48 executable
QJohn2017 commented 6 years ago

When input the command

file /usr/lib64/libfftw3.so.3`, it returns:
`[ac_siom_jsliu_1@ln3%tianhe2-C src]$ file /usr/lib64/libfftw3.so.3
/usr/lib64/libfftw3.so.3: symbolic link to `libfftw3.so.3.2.3'
[ac_siom_jsliu_1@ln3%tianhe2-C src]$ ^C
QJohn2017 commented 6 years ago

When I add the command export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/lib64/ file /usr/lib64/libfftw3.so.3 to the script file test.sh, it returns:

/etc/magic, 0: Warning: using regular magic file `/usr/share/misc/magic'
file: could not find any magic files!
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
...
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
yhrun: error: cn10175: tasks 0-23: Exited with exit code 127
PrometheusPi commented 6 years ago

Okay - seems like file can not find its file definitions magic on the compute node. Okay let's try the following test.sh file:

#!/bin/bash
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/lib64/
ls -la /usr/lib64/libfftw3.so.3
ls -la /usr/lib64/
#yhrun -N 2 -n 48 executable
QJohn2017 commented 6 years ago

Is the last command line #yhrun -N 2 -n 48 executable correct? if there is a # in the first column?

QJohn2017 commented 6 years ago

When I changed the commands in the file test.sh to `#!/bin/bash export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/lib64/ ls -la /usr/lib64/libfftw3.so.3 ls -la /usr/lib64/

yhrun -N 2 -n 48 executable`

it returns as follows:

ls: cannot access /usr/lib64/libfftw3.so.3: No such file or directory
total 51368
drwxr-xr-x 21 root root   10480 Nov 30 17:22 .
drwxr-xr-x 12 root root     260 Nov 30 17:22 ..
-rw-r--r--  1 root root    1648 May 31  2015 crt1.o
-rw-r--r--  1 root root    1504 May 31  2015 crti.o
-rw-r--r--  1 root root     760 May 31  2015 crtn.o
drwxr-xr-x  2 root root      80 Nov 30 17:22 gconv
drwxr-xr-x  3 root root      60 Nov 30 17:22 hal
drwxr-xr-x  3 root root      80 Nov 30 17:22 krb5
lrwxrwxrwx  1 root root      14 Nov 30 17:22 libGL.so -> libGL.so.1.2.0
lrwxrwxrwx  1 root root      14 Nov 30 17:22 libGL.so.1 -> libGL.so.1.2.0
-rwxr-xr-x  1 root root  504264 May 31  2015 libGL.so.1.2
-rwxr-xr-x  1 root root  391408 May 31  2015 libGL.so.1.2.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libGLU.so -> libGLU.so.1.3.1
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libGLU.so.1 -> libGLU.so.1.3.1
-rwxr-xr-x  1 root root  522976 May 31  2015 libGLU.so.1.3.1
lrwxrwxrwx  1 root root      11 Nov 30 17:22 libGLw.so -> libGLw.so.1
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libGLw.so.1 -> libGLw.so.1.0.0
-rwxr-xr-x  1 root root   25448 May 31  2015 libGLw.so.1.0.0
lrwxrwxrwx  1 root root      20 Nov 30 17:22 libI810XvMC.so.1 -> libI810XvMC.so.1.0.0
-rwxr-xr-x  1 root root   45360 May 31  2015 libI810XvMC.so.1.0.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libICE.so -> libICE.so.6.3.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libICE.so.6 -> libICE.so.6.3.0
-rwxr-xr-x  1 root root  101608 May 31  2015 libICE.so.6.3.0
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libIDL-2.so -> libIDL-2.so.0.0.0
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libIDL-2.so.0 -> libIDL-2.so.0.0.0
-rwxr-xr-x  1 root root  181024 May 31  2015 libIDL-2.so.0.0.0
lrwxrwxrwx  1 root root      24 Nov 30 17:22 libMicAccessSDK.so -> libMicAccessSDK.so.0.0.1
lrwxrwxrwx  1 root root      24 Nov 30 17:22 libMicAccessSDK.so.0 -> libMicAccessSDK.so.0.0.1
-rwxr-xr-x  1 root root  451144 May 31  2015 libMicAccessSDK.so.0.0.1
-rwxr-xr-x  1 root root  314776 May 31  2015 libMicAccess_python.so
lrwxrwxrwx  1 root root      20 Nov 30 17:22 libODMDebug.so -> libODMDebug.so.0.0.1
lrwxrwxrwx  1 root root      20 Nov 30 17:22 libODMDebug.so.0 -> libODMDebug.so.0.0.1
-rwxr-xr-x  1 root root   15408 May 31  2015 libODMDebug.so.0.0.1
lrwxrwxrwx  1 root root      14 Nov 30 17:22 libSM.so -> libSM.so.6.0.1
lrwxrwxrwx  1 root root      14 Nov 30 17:22 libSM.so.6 -> libSM.so.6.0.1
-rwxr-xr-x  1 root root   31568 May 31  2015 libSM.so.6.0.0
-rwxr-xr-x  1 root root   34024 May 31  2015 libSM.so.6.0.1
lrwxrwxrwx  1 root root      20 Nov 30 17:22 libSettings.so -> libSettings.so.0.0.1
lrwxrwxrwx  1 root root      20 Nov 30 17:22 libSettings.so.0 -> libSettings.so.0.0.1
-rwxr-xr-x  1 root root   17056 May 31  2015 libSettings.so.0.0.1
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libX11.so -> libX11.so.6.3.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libX11.so.6 -> libX11.so.6.3.0
-rwxr-xr-x  1 root root 1300376 May 31  2015 libX11.so.6.3.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libXau.so -> libXau.so.6.0.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libXau.so.6 -> libXau.so.6.0.0
-rwxr-xr-x  1 root root   13168 May 31  2015 libXau.so.6.0.0
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libXext.so -> libXext.so.6.4.0
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libXext.so.6 -> libXext.so.6.4.0
-rwxr-xr-x  1 root root   80944 May 31  2015 libXext.so.6.4.0
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libXrender.so -> libXrender.so.1.3.0
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libXrender.so.1 -> libXrender.so.1.3.0
-rwxr-xr-x  1 root root   42472 May 31  2015 libXrender.so.1.3.0
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libart_lgpl_2.so -> libart_lgpl_2.so.2.3.20
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libart_lgpl_2.so.2 -> libart_lgpl_2.so.2.3.20
-rwxr-xr-x  1 root root  104960 May 31  2015 libart_lgpl_2.so.2.3.20
-rwxr-xr-x  1 root root     829 May 31  2015 libartsc.la
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libartsc.so.0 -> libartsc.so.0.0.0
-rwxr-xr-x  1 root root   24472 May 31  2015 libartsc.so.0.0.0
-rwxr-xr-x  1 root root    1016 May 31  2015 libartscbackend.la
lrwxrwxrwx  1 root root      24 Nov 30 17:22 libartscbackend.so.0 -> libartscbackend.so.0.0.0
-rwxr-xr-x  1 root root  100072 May 31  2015 libartscbackend.so.0.0.0
-rwxr-xr-x  1 root root     843 May 31  2015 libartsdsp.la
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libartsdsp.so.0 -> libartsdsp.so.0.0.0
-rwxr-xr-x  1 root root   13208 May 31  2015 libartsdsp.so.0.0.0
-rwxr-xr-x  1 root root     850 May 31  2015 libartsdsp_st.la
lrwxrwxrwx  1 root root      22 Nov 30 17:22 libartsdsp_st.so.0 -> libartsdsp_st.so.0.0.0
-rwxr-xr-x  1 root root   32960 May 31  2015 libartsdsp_st.so.0.0.0
-rwxr-xr-x  1 root root     903 May 31  2015 libartsflow.la
lrwxrwxrwx  1 root root      20 Nov 30 17:22 libartsflow.so.1 -> libartsflow.so.1.0.0
-rwxr-xr-x  1 root root 1689768 May 31  2015 libartsflow.so.1.0.0
-rwxr-xr-x  1 root root     891 May 31  2015 libartsflow_idl.la
lrwxrwxrwx  1 root root      24 Nov 30 17:22 libartsflow_idl.so.1 -> libartsflow_idl.so.1.0.0
-rwxr-xr-x  1 root root 1211480 May 31  2015 libartsflow_idl.so.1.0.0
-rwxr-xr-x  1 root root    1046 May 31  2015 libartsgslplayobject.la
lrwxrwxrwx  1 root root      29 Nov 30 17:22 libartsgslplayobject.so.0 -> libartsgslplayobject.so.0.0.0
-rwxr-xr-x  1 root root   92712 May 31  2015 libartsgslplayobject.so.0.0.0
-rwxr-xr-x  1 root root    1246 May 31  2015 libartskde.la
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libartskde.so.1 -> libartskde.so.1.2.0
-rwxr-xr-x  1 root root  553872 May 31  2015 libartskde.so.1.2.0
-rwxr-xr-x  1 root root    1046 May 31  2015 libartswavplayobject.la
lrwxrwxrwx  1 root root      29 Nov 30 17:22 libartswavplayobject.so.0 -> libartswavplayobject.so.0.0.0
-rwxr-xr-x  1 root root   69744 May 31  2015 libartswavplayobject.so.0.0.0
lrwxrwxrwx  1 root root      22 Nov 30 17:22 libatk-1.0.so -> libatk-1.0.so.0.3009.1
lrwxrwxrwx  1 root root      22 Nov 30 17:22 libatk-1.0.so.0 -> libatk-1.0.so.0.3009.1
-rwxr-xr-x  1 root root  136224 May 31  2015 libatk-1.0.so.0.3009.1
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libatkmm-1.6.so.1 -> libatkmm-1.6.so.1.1.0
-rwxr-xr-x  1 root root  311488 May 31  2015 libatkmm-1.6.so.1.1.0
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libaudiofile.so.0 -> libaudiofile.so.0.0.2
-rwxr-xr-x  1 root root  169464 May 31  2015 libaudiofile.so.0.0.2
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libbz2.so -> ../../lib64/libbz2.so.1
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libcairo.so -> libcairo.so.2.10800.8
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libcairo.so.2 -> libcairo.so.2.10800.8
-rwxr-xr-x  1 root root  497408 May 31  2015 libcairo.so.2.10800.8
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libcairomm-1.0.so.1 -> libcairomm-1.0.so.1.3.0
-rwxr-xr-x  1 root root  129192 May 31  2015 libcairomm-1.0.so.1.3.0
-rw-r--r--  1 root root   58948 May 31  2015 libcfsutil.a
-rwxr-xr-x  1 root root 1972510 May 31  2015 libcoi_common.a
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libcoi_host.so -> libcoi_host.so.0
-rwxr-xr-x  1 root root  421248 May 31  2015 libcoi_host.so.0
-rwxr-xr-x  1 root root   99512 May 31  2015 libcoitracelib.so.0
-rw-r--r--  1 root root   17728 May 31  2015 libcom_err.a
lrwxrwxrwx  1 root root      22 Nov 30 17:22 libcom_err.so -> /lib64/libcom_err.so.2
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libcrack.so.2 -> libcrack.so.2.8.1
-rwxr-xr-x  1 root root   41088 May 31  2015 libcrack.so.2.8.1
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libcroco-0.6.so -> libcroco-0.6.so.3.0.1
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libcroco-0.6.so.3 -> libcroco-0.6.so.3.0.1
-rwxr-xr-x  1 root root  251576 May 31  2015 libcroco-0.6.so.3.0.1
lrwxrwxrwx  1 root root      25 Nov 30 17:22 libcrypt.so -> ../../lib64/libcrypt.so.1
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libcrypto.so -> libcrypto.so.1.0.1e
-rwxr-xr-x  1 root root 1408384 May 31  2015 libcrypto.so.0.9.8e
-rwxr-xr-x  1 root root 1949440 May 31  2015 libcrypto.so.1.0.1e
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libcrypto.so.10 -> libcrypto.so.1.0.1e
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libcrypto.so.6 -> libcrypto.so.0.9.8e
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libcryptui.so.0 -> libcryptui.so.0.0.0
-rwxr-xr-x  1 root root   74424 May 31  2015 libcryptui.so.0.0.0
-rwxr-xr-x  1 root root  326960 May 31  2015 libcups.so.2
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libcupsimage.so -> libcupsimage.so.2
-rwxr-xr-x  1 root root  105376 May 31  2015 libcupsimage.so.2
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libcurl.so -> libcurl.so.4.1.1
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libcurl.so.4 -> libcurl.so.4.1.1
-rwxr-xr-x  1 root root  346008 May 31  2015 libcurl.so.4.1.1
-rw-r--r--  1 root root      17 May 31  2015 libcurses.so
-rw-r--r--  1 root root      18 May 31  2015 libcursesw.so
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libdaemon.so.0 -> libdaemon.so.0.5.0
-rwxr-xr-x  1 root root   27368 May 31  2015 libdaemon.so.0.5.0
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libdaplcma.so -> libdaplcma.so.1.0.2
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libdaplcma.so.1 -> libdaplcma.so.1.0.2
-rwxr-xr-x  1 root root  102744 May 31  2015 libdaplcma.so.1.0.2
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libdaplofa.so -> libdaplofa.so.2.0.0
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libdaplofa.so.2 -> libdaplofa.so.2.0.0
-rwxr-xr-x  1 root root  115504 May 31  2015 libdaplofa.so.2.0.0
lrwxrwxrwx  1 root root      20 Nov 30 17:22 libdaploscm.so -> libdaploscm.so.2.0.0
lrwxrwxrwx  1 root root      20 Nov 30 17:22 libdaploscm.so.2 -> libdaploscm.so.2.0.0
-rwxr-xr-x  1 root root  123360 May 31  2015 libdaploscm.so.2.0.0
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libdaplscm.so -> libdaplscm.so.1.0.2
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libdaplscm.so.1 -> libdaplscm.so.1.0.2
-rwxr-xr-x  1 root root  102712 May 31  2015 libdaplscm.so.1.0.2
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libdat.so -> libdat.so.1.0.2
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libdat.so.1 -> libdat.so.1.0.2
-rwxr-xr-x  1 root root   37352 May 31  2015 libdat.so.1.0.2
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libdat2.so -> libdat2.so.2.0.0
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libdat2.so.2 -> libdat2.so.2.0.0
-rwxr-xr-x  1 root root   39968 May 31  2015 libdat2.so.2.0.0
lrwxrwxrwx  1 root root      24 Nov 30 17:22 libdb-4.7.so -> ../../lib64/libdb-4.7.so
lrwxrwxrwx  1 root root      24 Nov 30 17:22 libdb.so -> ../../lib64/libdb-4.7.so
-rwxr-xr-x  1 root root 1645008 May 31  2015 libdb_cxx-4.7.so
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libdb_cxx.so -> libdb_cxx-4.7.so
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libdbi.so.0 -> libdbi.so.0.0.5
-rwxr-xr-x  1 root root   57272 May 31  2015 libdbi.so.0.0.5
lrwxrwxrwx  1 root root      22 Nov 30 17:22 libdbus-c++-1.so.0 -> libdbus-c++-1.so.0.0.0
-rwxr-xr-x  1 root root  192632 May 31  2015 libdbus-c++-1.so.0.0.0
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libdbus-glib-1.so -> libdbus-glib-1.so.2.1.0
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libdbus-glib-1.so.2 -> libdbus-glib-1.so.2.1.0
-rwxr-xr-x  1 root root  144912 May 31  2015 libdbus-glib-1.so.2.1.0
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libdbus-qt-1.so.1 -> libdbus-qt-1.so.1.0.0
-rwxr-xr-x  1 root root   68464 May 31  2015 libdbus-qt-1.so.1.0.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libdmx.so.1 -> libdmx.so.1.0.0
-rwxr-xr-x  1 root root   18256 May 31  2015 libdmx.so.1.0.0
-rw-r--r--  1 root root   61536 May 31  2015 libe2p.a
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libe2p.so -> /lib64/libe2p.so.2
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libedit.so.0 -> libedit.so.0.0.27
-rwxr-xr-x  1 root root  181296 May 31  2015 libedit.so.0.0.27
-rwxr-xr-x  1 root root   86976 May 31  2015 libelf-0.152.so
lrwxrwxrwx  1 root root      11 Nov 30 17:22 libelf.so -> libelf.so.1
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libelf.so.1 -> libelf-0.152.so
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libesmtp.so.5 -> libesmtp.so.5.1.5
-rwxr-xr-x  1 root root   83208 May 31  2015 libesmtp.so.5.1.5
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libesoobS.so -> libesoobS.so.2.0.0
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libesoobS.so.2 -> libesoobS.so.2.0.0
-rwxr-xr-x  1 root root    7416 May 31  2015 libesoobS.so.2.0.0
-rwxr-xr-x  1 root root 2434672 May 31  2015 libestbase.so.1.2.96.1
-rwxr-xr-x  1 root root  917232 May 31  2015 libestools.so.1.2.96.1
-rwxr-xr-x  1 root root   61888 May 31  2015 libeststring.so.1.2
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libevent-1.4.so.2 -> libevent-1.4.so.2.1.3
-rwxr-xr-x  1 root root  109168 May 31  2015 libevent-1.4.so.2.1.3
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libexslt.so -> libexslt.so.0.8.15
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libexslt.so.0 -> libexslt.so.0.8.15
-rwxr-xr-x  1 root root   84296 May 31  2015 libexslt.so.0.8.15
-rw-r--r--  1 root root  471012 May 31  2015 libext2fs.a
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libext2fs.so -> /lib64/libext2fs.so.2
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libfam.so -> libfam.so.0.0.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libfam.so.0 -> libfam.so.0.0.0
-rwxr-xr-x  1 root root   32472 May 31  2015 libfam.so.0.0.0
lrwxrwxrwx  1 root root      22 Nov 30 17:22 libfontconfig.so -> libfontconfig.so.1.4.4
lrwxrwxrwx  1 root root      22 Nov 30 17:22 libfontconfig.so.1 -> libfontconfig.so.1.4.4
-rwxr-xr-x  1 root root  223040 May 31  2015 libfontconfig.so.1.4.4
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libfontenc.so.1 -> libfontenc.so.1.0.0
-rwxr-xr-x  1 root root   30024 May 31  2015 libfontenc.so.1.0.0
lrwxrwxrwx  1 root root      12 Nov 30 17:22 libform.so -> libform.so.5
lrwxrwxrwx  1 root root      14 Nov 30 17:22 libform.so.5 -> libform.so.5.7
-rwxr-xr-x  1 root root   63072 May 31  2015 libform.so.5.7
lrwxrwxrwx  1 root root      13 Nov 30 17:22 libformw.so -> libformw.so.5
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libformw.so.5 -> libformw.so.5.7
-rwxr-xr-x  1 root root   69816 May 31  2015 libformw.so.5.7
-rw-r--r--  1 root root   54674 May 31  2015 libfreebl.a
lrwxrwxrwx  1 root root      26 Nov 30 17:22 libfreebl3.chk -> ../../lib64/libfreebl3.chk
lrwxrwxrwx  1 root root      25 Nov 30 17:22 libfreebl3.so -> ../../lib64/libfreebl3.so
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libfreetype.so -> libfreetype.so.6.3.22
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libfreetype.so.6 -> libfreetype.so.6.3.22
-rwxr-xr-x  1 root root  644912 May 31  2015 libfreetype.so.6.3.22
lrwxrwxrwx  1 root root      20 Nov 30 17:22 libgamin-1.so -> libgamin-1.so.0.1.10
lrwxrwxrwx  1 root root      20 Nov 30 17:22 libgamin-1.so.0 -> libgamin-1.so.0.1.10
-rwxr-xr-x  1 root root   30096 May 31  2015 libgamin-1.so.0.1.10
lrwxrwxrwx  1 root root      14 Nov 30 17:22 libgc.so.1 -> libgc.so.1.0.3
-rwxr-xr-x  1 root root  161640 May 31  2015 libgc.so.1.0.3
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libgccpp.so.1 -> libgccpp.so.1.0.3
-rwxr-xr-x  1 root root    4672 May 31  2015 libgccpp.so.1.0.3
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libgconf-2.so -> libgconf-2.so.4.1.5
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libgconf-2.so.4 -> libgconf-2.so.4.1.5
-rwxr-xr-x  1 root root  261456 May 31  2015 libgconf-2.so.4.1.5
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libgconfmm-2.6.so.1 -> libgconfmm-2.6.so.1.0.6
-rwxr-xr-x  1 root root   75184 May 31  2015 libgconfmm-2.6.so.1.0.6
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libgcr.so -> libgcr.so.0.0.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libgcr.so.0 -> libgcr.so.0.0.0
-rwxr-xr-x  1 root root  282984 May 31  2015 libgcr.so.0.0.0
lrwxrwxrwx  1 root root      31 Nov 30 17:22 libgcrypt.so -> ../../lib64/libgcrypt.so.11.5.3
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libgdbm.so.2 -> libgdbm.so.2.0.0
-rwxr-xr-x  1 root root   28304 May 31  2015 libgdbm.so.2.0.0
lrwxrwxrwx  1 root root      26 Nov 30 17:22 libgdk-x11-2.0.so -> libgdk-x11-2.0.so.0.2000.1
lrwxrwxrwx  1 root root      26 Nov 30 17:22 libgdk-x11-2.0.so.0 -> libgdk-x11-2.0.so.0.2000.1
-rwxr-xr-x  1 root root  770112 May 31  2015 libgdk-x11-2.0.so.0.2000.1
lrwxrwxrwx  1 root root      29 Nov 30 17:22 libgdk_pixbuf-2.0.so -> libgdk_pixbuf-2.0.so.0.2000.1
lrwxrwxrwx  1 root root      29 Nov 30 17:22 libgdk_pixbuf-2.0.so.0 -> libgdk_pixbuf-2.0.so.0.2000.1
-rwxr-xr-x  1 root root  130488 May 31  2015 libgdk_pixbuf-2.0.so.0.2000.1
lrwxrwxrwx  1 root root      34 Nov 30 17:22 libgdk_pixbuf_xlib-2.0.so -> libgdk_pixbuf_xlib-2.0.so.0.2000.1
lrwxrwxrwx  1 root root      34 Nov 30 17:22 libgdk_pixbuf_xlib-2.0.so.0 -> libgdk_pixbuf_xlib-2.0.so.0.2000.1
-rwxr-xr-x  1 root root   66976 May 31  2015 libgdk_pixbuf_xlib-2.0.so.0.2000.1
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libgdkmm-2.4.so.1 -> libgdkmm-2.4.so.1.1.0
-rwxr-xr-x  1 root root  308208 May 31  2015 libgdkmm-2.4.so.1.1.0
drwxr-xr-x  3 root root      60 Nov 30 17:22 libglade
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libglade-2.0.so -> libglade-2.0.so.0.0.7
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libglade-2.0.so.0 -> libglade-2.0.so.0.0.7
-rwxr-xr-x  1 root root  103664 May 31  2015 libglade-2.0.so.0.0.7
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libgladeui-1.so.9 -> libgladeui-1.so.9.0.3
-rwxr-xr-x  1 root root  645960 May 31  2015 libgladeui-1.so.9.0.3
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libgmp.so -> libgmp.so.3.5.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libgmp.so.3 -> libgmp.so.3.5.0
-rwxr-xr-x  1 root root  376792 May 31  2015 libgmp.so.3.5.0
lrwxrwxrwx  1 root root      33 Nov 30 17:22 libgpg-error.so -> ../../lib64/libgpg-error.so.0.5.0
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libhal-storage.so -> libhal-storage.so.1.0.0
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libhal-storage.so.1 -> libhal-storage.so.1.0.0
-rwxr-xr-x  1 root root   44256 May 31  2015 libhal-storage.so.1.0.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libhal.so.1 -> libhal.so.1.0.0
-rwxr-xr-x  1 root root   68928 May 31  2015 libhal.so.1.0.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libhistory.so -> libhistory.so.6
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libhistory.so.5 -> libhistory.so.5.2
-rwxr-xr-x  1 root root   33360 May 31  2015 libhistory.so.5.2
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libhistory.so.6 -> libhistory.so.6.0
-rwxr-xr-x  1 root root   36000 May 31  2015 libhistory.so.6.0
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libhstreams_source.so -> libhstreams_source.so.0
-rwxr-xr-x  1 root root  163048 May 31  2015 libhstreams_source.so.0
-rwxr-xr-x  1 root root   62056 May 31  2015 libhugetlbfs.so
-rwxr-xr-x  1 root root     928 May 31  2015 libhwloc.la
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libhwloc.so -> libhwloc.so.5.1.0
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libhwloc.so.1 -> libhwloc.so.1.0.1
-rwxr-xr-x  1 root root  108032 May 31  2015 libhwloc.so.1.0.1
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libhwloc.so.5 -> libhwloc.so.5.1.0
-rwxr-xr-x  1 root root  159904 May 31  2015 libhwloc.so.5.1.0
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libibmad.so.5 -> libibmad.so.5.3.1
-rwxr-xr-x  1 root root   76128 May 31  2015 libibmad.so.5.1.2
-rwxr-xr-x  1 root root  105248 May 31  2015 libibmad.so.5.3.1
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libibumad.so -> libibumad.so.3.0.3
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libibumad.so.2 -> libibumad.so.2.0.1
-rwxr-xr-x  1 root root   25600 May 31  2015 libibumad.so.2.0.1
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libibumad.so.3 -> libibumad.so.3.0.3
-rwxr-xr-x  1 root root   28160 May 31  2015 libibumad.so.3.0.3
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libibverbs.so -> libibverbs.so.1.0.0
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libibverbs.so.1 -> libibverbs.so.1.0.0
-rwxr-xr-x  1 root root   57240 May 31  2015 libibverbs.so.1.0.0
lrwxrwxrwx  1 root root      28 Nov 30 17:22 libidn.so -> ../../lib64/libidn.so.11.6.1
-rwxr-xr-x  1 root root   22120 May 31  2015 libijs-0.35.so
-rwxr-xr-x  1 root root 1141460 May 31  2015 libiomp5.so
-rwxr-xr-x  1 root root   47244 May 31  2015 libiompstubs5.so
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libjpeg.so -> libjpeg.so.62.0.0
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libjpeg.so.62 -> libjpeg.so.62.0.0
-rwxr-xr-x  1 root root  265280 May 31  2015 libjpeg.so.62.0.0
lrwxrwxrwx  1 root root      30 Nov 30 17:22 libk5crypto.so -> ../../lib64/libk5crypto.so.3.1
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libkadm5clnt.so -> libkadm5clnt_mit.so
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libkadm5clnt_mit.so -> libkadm5clnt_mit.so.8.0
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libkadm5clnt_mit.so.8 -> libkadm5clnt_mit.so.8.0
-rwxr-xr-x  1 root root   89216 May 31  2015 libkadm5clnt_mit.so.8.0
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libkadm5srv.so -> libkadm5srv_mit.so
lrwxrwxrwx  1 root root      22 Nov 30 17:22 libkadm5srv_mit.so -> libkadm5srv_mit.so.8.0
lrwxrwxrwx  1 root root      22 Nov 30 17:22 libkadm5srv_mit.so.8 -> libkadm5srv_mit.so.8.0
-rwxr-xr-x  1 root root  122640 May 31  2015 libkadm5srv_mit.so.8.0
lrwxrwxrwx  1 root root      14 Nov 30 17:22 libkdb5.so -> libkdb5.so.6.0
lrwxrwxrwx  1 root root      14 Nov 30 17:22 libkdb5.so.5 -> libkdb5.so.5.0
-rwxr-xr-x  1 root root   72888 May 31  2015 libkdb5.so.5.0
lrwxrwxrwx  1 root root      14 Nov 30 17:22 libkdb5.so.6 -> libkdb5.so.6.0
-rwxr-xr-x  1 root root   79976 May 31  2015 libkdb5.so.6.0
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libkdb_ldap.so -> libkdb_ldap.so.1.0
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libkdb_ldap.so.1 -> libkdb_ldap.so.1.0
-rwxr-xr-x  1 root root  102096 May 31  2015 libkdb_ldap.so.1.0
lrwxrwxrwx  1 root root      26 Nov 30 17:22 libkrb5.so -> ../../lib64/libkrb5.so.3.3
lrwxrwxrwx  1 root root      33 Nov 30 17:22 libkrb5support.so -> ../../lib64/libkrb5support.so.0.1
lrwxrwxrwx  1 root root      21 Nov 30 17:22 liblber-2.3.so.0 -> liblber-2.3.so.0.2.31
-rwxr-xr-x  1 root root   57600 May 31  2015 liblber-2.3.so.0.2.31
lrwxrwxrwx  1 root root      10 Nov 30 17:22 liblber-2.4.so.2 -> liblber.so
lrwxrwxrwx  1 root root      27 Nov 30 17:22 liblber.so -> /lib64/liblber-2.4.so.2.5.6
lrwxrwxrwx  1 root root      17 Nov 30 17:22 liblcms.so.1 -> liblcms.so.1.0.19
-rwxr-xr-x  1 root root  226552 May 31  2015 liblcms.so.1.0.19
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libldap-2.3.so.0 -> libldap-2.3.so.0.2.31
-rwxr-xr-x  1 root root  247584 May 31  2015 libldap-2.3.so.0.2.31
lrwxrwxrwx  1 root root      10 Nov 30 17:22 libldap-2.4.so.2 -> libldap.so
lrwxrwxrwx  1 root root      27 Nov 30 17:22 libldap.so -> /lib64/libldap-2.4.so.2.5.6
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libldap_r-2.3.so.0 -> libldap_r-2.3.so.0.2.31
-rwxr-xr-x  1 root root  268128 May 31  2015 libldap_r-2.3.so.0.2.31
lrwxrwxrwx  1 root root      12 Nov 30 17:22 libldap_r-2.4.so.2 -> libldap_r.so
lrwxrwxrwx  1 root root      29 Nov 30 17:22 libldap_r.so -> /lib64/libldap_r-2.4.so.2.5.6
-rwxr-xr-x  1 root root  186296 May 31  2015 liblua-5.1.so
-rw-r--r--  1 root root  336852 May 31  2015 liblustreapi.a
-rwxr-xr-x  1 root root  282544 May 31  2015 liblustreapi.so
lrwxrwxrwx  1 root root      16 Nov 30 17:22 liblzma.so -> liblzma.so.0.0.0
lrwxrwxrwx  1 root root      16 Nov 30 17:22 liblzma.so.0 -> liblzma.so.0.0.0
-rwxr-xr-x  1 root root  137264 May 31  2015 liblzma.so.0.0.0
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libmagic.so -> libmagic.so.1.0.0
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libmagic.so.1 -> libmagic.so.1.0.0
-rwxr-xr-x  1 root root  118112 May 31  2015 libmagic.so.1.0.0
lrwxrwxrwx  1 root root      12 Nov 30 17:22 libmenu.so -> libmenu.so.5
lrwxrwxrwx  1 root root      14 Nov 30 17:22 libmenu.so.5 -> libmenu.so.5.7
-rwxr-xr-x  1 root root   29656 May 31  2015 libmenu.so.5.7
lrwxrwxrwx  1 root root      13 Nov 30 17:22 libmenuw.so -> libmenuw.so.5
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libmenuw.so.5 -> libmenuw.so.5.7
-rwxr-xr-x  1 root root   32936 May 31  2015 libmenuw.so.5.7
lrwxrwxrwx  1 root root      28 Nov 30 17:22 libmetacity-private.so.0 -> libmetacity-private.so.0.0.0
-rwxr-xr-x  1 root root  165928 May 31  2015 libmetacity-private.so.0.0.0
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libmicmgmt.so -> libmicmgmt.so.0.0.2
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libmicmgmt.so.0 -> libmicmgmt.so.0.0.2
-rwxr-xr-x  1 root root  153296 May 31  2015 libmicmgmt.so.0.0.2
-rwxr-xr-x  1 root root   26432 May 31  2015 libmlx4-rdmav2.so
lrwxrwxrwx  1 root root      22 Nov 30 17:22 libmpssconfig.so -> libmpssconfig.so.0.0.1
lrwxrwxrwx  1 root root      22 Nov 30 17:22 libmpssconfig.so.0 -> libmpssconfig.so.0.0.1
-rwxr-xr-x  1 root root   63096 May 31  2015 libmpssconfig.so.0.0.1
-rwxr-xr-x  1 root root   32040 May 31  2015 libmthca-rdmav2.so
lrwxrwxrwx  1 root root      13 Nov 30 17:22 libmunge -> libmunge.so.2
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libmunge.so.2 -> libmunge.so.2.0.0
-rwxr-xr-x  1 root root   38872 May 31  2015 libmunge.so.2.0.0
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libmyo-client.so -> libmyo-client.so.0
-rw-r--r--  1 root root  236663 May 31  2015 libmyo-client.so.0
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libmyodbl-client.so -> libmyodbl-client.so.0
-rw-r--r--  1 root root    8509 May 31  2015 libmyodbl-client.so.0
lrwxrwxrwx  1 root root      27 Nov 30 17:22 libncurses.so -> ../../lib64/libncurses.so.5
lrwxrwxrwx  1 root root      28 Nov 30 17:22 libncursesw.so -> ../../lib64/libncursesw.so.5
drwxr-xr-x  2 root root     100 Nov 30 17:22 libnfsidmap
lrwxrwxrwx  1 root root      20 Nov 30 17:22 libnfsidmap.so.0 -> libnfsidmap.so.0.3.0
-rwxr-xr-x  1 root root   27520 May 31  2015 libnfsidmap.so.0.3.0
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libnotify.so -> libnotify.so.1.2.3
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libnotify.so.1 -> libnotify.so.1.2.3
-rwxr-xr-x  1 root root   40272 May 31  2015 libnotify.so.1.2.3
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libnspr4.so -> ../../lib64/libnspr4.so
-rwxr-xr-x  1 root root 1299096 May 31  2015 libnss3.so
lrwxrwxrwx  1 root root      38 Nov 30 17:22 libnssckbi.so -> /etc/alternatives/libnssckbi.so.x86_64
-rwxr-xr-x  1 root root  182112 May 31  2015 libnssutil3.so
lrwxrwxrwx  1 root root      12 Nov 30 17:22 libnuma.so -> libnuma.so.1
-rwxr-xr-x  1 root root   38872 May 31  2015 libnuma.so.1
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libogg.so.0 -> libogg.so.0.6.0
-rwxr-xr-x  1 root root   25520 May 31  2015 libogg.so.0.6.0
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libopensm.so -> libopensm.so.4.0.2
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libopensm.so.2 -> libopensm.so.2.1.5
-rwxr-xr-x  1 root root   66608 May 31  2015 libopensm.so.2.1.5
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libopensm.so.4 -> libopensm.so.4.0.2
-rwxr-xr-x  1 root root   68672 May 31  2015 libopensm.so.4.0.2
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libopensm.so.5 -> libopensm.so.5.1.0
-rwxr-xr-x  1 root root   87536 May 31  2015 libopensm.so.5.1.0
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libosmcomp.so -> libosmcomp.so.3.0.4
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libosmcomp.so.3 -> libosmcomp.so.3.0.6
-rwxr-xr-x  1 root root   54400 May 31  2015 libosmcomp.so.3.0.4
-rwxr-xr-x  1 root root   57040 May 31  2015 libosmcomp.so.3.0.6
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libosmvendor.so -> libosmvendor.so.3.0.5
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libosmvendor.so.3 -> libosmvendor.so.3.0.8
-rwxr-xr-x  1 root root   28912 May 31  2015 libosmvendor.so.3.0.5
-rwxr-xr-x  1 root root   33000 May 31  2015 libosmvendor.so.3.0.8
lrwxrwxrwx  1 root root      27 Nov 30 17:22 libpanel-applet-2.so.0 -> libpanel-applet-2.so.0.2.68
-rwxr-xr-x  1 root root   63064 May 31  2015 libpanel-applet-2.so.0.2.68
lrwxrwxrwx  1 root root      13 Nov 30 17:22 libpanel.so -> libpanel.so.5
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libpanel.so.5 -> libpanel.so.5.7
-rwxr-xr-x  1 root root   14024 May 31  2015 libpanel.so.5.7
lrwxrwxrwx  1 root root      29 Nov 30 17:22 libpanelappletmm-2.6.so.1 -> libpanelappletmm-2.6.so.1.0.1
-rwxr-xr-x  1 root root   66000 May 31  2015 libpanelappletmm-2.6.so.1.0.1
lrwxrwxrwx  1 root root      14 Nov 30 17:22 libpanelw.so -> libpanelw.so.5
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libpanelw.so.5 -> libpanelw.so.5.7
-rwxr-xr-x  1 root root   14032 May 31  2015 libpanelw.so.5.7
lrwxrwxrwx  1 root root      24 Nov 30 17:22 libpango-1.0.so -> libpango-1.0.so.0.2800.1
lrwxrwxrwx  1 root root      24 Nov 30 17:22 libpango-1.0.so.0 -> libpango-1.0.so.0.2800.1
-rwxr-xr-x  1 root root  310240 May 31  2015 libpango-1.0.so.0.2800.1
lrwxrwxrwx  1 root root      29 Nov 30 17:22 libpangocairo-1.0.so -> libpangocairo-1.0.so.0.2800.1
lrwxrwxrwx  1 root root      29 Nov 30 17:22 libpangocairo-1.0.so.0 -> libpangocairo-1.0.so.0.2800.1
-rwxr-xr-x  1 root root   52144 May 31  2015 libpangocairo-1.0.so.0.2800.1
lrwxrwxrwx  1 root root      27 Nov 30 17:22 libpangoft2-1.0.so -> libpangoft2-1.0.so.0.2800.1
lrwxrwxrwx  1 root root      27 Nov 30 17:22 libpangoft2-1.0.so.0 -> libpangoft2-1.0.so.0.2800.1
-rwxr-xr-x  1 root root  176240 May 31  2015 libpangoft2-1.0.so.0.2800.1
lrwxrwxrwx  1 root root      24 Nov 30 17:22 libpangomm-1.4.so.1 -> libpangomm-1.4.so.1.0.30
-rwxr-xr-x  1 root root  187816 May 31  2015 libpangomm-1.4.so.1.0.30
lrwxrwxrwx  1 root root      25 Nov 30 17:22 libpangox-1.0.so -> libpangox-1.0.so.0.2800.1
lrwxrwxrwx  1 root root      25 Nov 30 17:22 libpangox-1.0.so.0 -> libpangox-1.0.so.0.2800.1
-rwxr-xr-x  1 root root   53376 May 31  2015 libpangox-1.0.so.0.2800.1
lrwxrwxrwx  1 root root      27 Nov 30 17:22 libpangoxft-1.0.so -> libpangoxft-1.0.so.0.2800.1
lrwxrwxrwx  1 root root      27 Nov 30 17:22 libpangoxft-1.0.so.0 -> libpangoxft-1.0.so.0.2800.1
-rwxr-xr-x  1 root root   35104 May 31  2015 libpangoxft-1.0.so.0.2800.1
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libpcrecpp.so -> libpcrecpp.so.0.0.0
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libpcrecpp.so.0 -> libpcrecpp.so.0.0.0
-rwxr-xr-x  1 root root   33088 May 31  2015 libpcrecpp.so.0.0.0
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libpcreposix.so -> libpcreposix.so.0.0.0
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libpcreposix.so.0 -> libpcreposix.so.0.0.0
-rwxr-xr-x  1 root root    9656 May 31  2015 libpcreposix.so.0.0.0
lrwxrwxrwx  1 root root      22 Nov 30 17:22 libplc4.so -> ../../lib64/libplc4.so
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libplds4.so -> ../../lib64/libplds4.so
-rwxr-xr-x  1 root root     977 May 31  2015 libpmi.la
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libpmi.so -> libpmi.so.0.0.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libpmi.so.0 -> libpmi.so.0.0.0
-rwxr-xr-x  1 root root   56452 May 31  2015 libpmi.so.0.0.0
-rwxr-xr-x  1 root root     946 May 31  2015 libpmi2.la
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libpmi2.so -> libpmi2.so.0.0.0
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libpmi2.so.0 -> libpmi2.so.0.0.0
-rwxr-xr-x  1 root root  117964 May 31  2015 libpmi2.so.0.0.0
lrwxrwxrwx  1 root root      11 Nov 30 17:22 libpng.so -> libpng12.so
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libpng.so.3 -> libpng.so.3.49.0
-rwxr-xr-x  1 root root  168616 May 31  2015 libpng.so.3.49.0
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libpng12.so -> libpng12.so.0.49.0
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libpng12.so.0 -> libpng12.so.0.49.0
-rwxr-xr-x  1 root root  157960 May 31  2015 libpng12.so.0.49.0
lrwxrwxrwx  1 root root      28 Nov 30 17:22 libpopt.so -> ../../lib64/libpopt.so.0.0.0
-rw-r--r--  1 root root   70402 May 31  2015 libptlctl.a
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libpython2.6.so -> libpython2.6.so.1.0
-r-xr-xr-x  1 root root 1672576 May 31  2015 libpython2.6.so.1.0
-rw-r--r--  1 root root   50894 May 31  2015 libquota.a
lrwxrwxrwx  1 root root      18 Nov 30 17:22 librdmacm.so -> librdmacm.so.1.0.0
lrwxrwxrwx  1 root root      18 Nov 30 17:22 librdmacm.so.1 -> librdmacm.so.1.0.0
-rwxr-xr-x  1 root root   80656 May 31  2015 librdmacm.so.1.0.0
lrwxrwxrwx  1 root root      28 Nov 30 17:22 libreadline.so -> ../../lib64/libreadline.so.6
lrwxrwxrwx  1 root root      15 Nov 30 17:22 librpm.so -> librpm.so.1.0.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 librpm.so.1 -> librpm.so.1.0.0
-rwxr-xr-x  1 root root  436736 May 31  2015 librpm.so.1.0.0
lrwxrwxrwx  1 root root      20 Nov 30 17:22 librpmbuild.so -> librpmbuild.so.1.0.0
lrwxrwxrwx  1 root root      20 Nov 30 17:22 librpmbuild.so.1 -> librpmbuild.so.1.0.0
-rwxr-xr-x  1 root root  158472 May 31  2015 librpmbuild.so.1.0.0
lrwxrwxrwx  1 root root      17 Nov 30 17:22 librpmio.so -> librpmio.so.1.0.0
lrwxrwxrwx  1 root root      17 Nov 30 17:22 librpmio.so.1 -> librpmio.so.1.0.0
-rwxr-xr-x  1 root root  186920 May 31  2015 librpmio.so.1.0.0
lrwxrwxrwx  1 root root      19 Nov 30 17:22 librsvg-2.so -> librsvg-2.so.2.26.0
lrwxrwxrwx  1 root root      19 Nov 30 17:22 librsvg-2.so.2 -> librsvg-2.so.2.26.0
-rwxr-xr-x  1 root root  229088 May 31  2015 librsvg-2.so.2.26.0
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libsasl2.so -> libsasl2.so.2.0.23
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libsasl2.so.2 -> libsasl2.so.2.0.23
-rwxr-xr-x  1 root root  108728 May 31  2015 libsasl2.so.2.0.23
lrwxrwxrwx  1 root root      23 Nov 30 17:22 libsaslwrapper.so.1 -> libsaslwrapper.so.1.0.0
-rwxr-xr-x  1 root root   26016 May 31  2015 libsaslwrapper.so.1.0.0
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libscif.so -> libscif.so.0.0.1
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libscif.so.0 -> libscif.so.0.0.1
-rwxr-xr-x  1 root root    7800 May 31  2015 libscif.so.0.0.1
lrwxrwxrwx  1 root root      27 Nov 30 17:22 libselinux.so -> ../../lib64/libselinux.so.1
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libslurm.so -> libslurm.so.26.0.0
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libslurm.so.26 -> libslurm.so.26.0.0
-rwxr-xr-x  1 root root 3922252 May 31  2015 libslurm.so.26.0.0
-rwxr-xr-x  1 root root  183928 May 31  2015 libsmime3.so
-rw-r--r--  1 root root     899 May 31  2015 libsoftokn3.chk
-rwxr-xr-x  1 root root  273128 May 31  2015 libsoftokn3.so
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libsqlite3.so -> libsqlite3.so.0.8.6
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libsqlite3.so.0 -> libsqlite3.so.0.8.6
-rwxr-xr-x  1 root root  586592 May 31  2015 libsqlite3.so.0.8.6
-rw-r--r--  1 root root   46778 May 31  2015 libss.a
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libssl.so -> libssl.so.1.0.1e
-rwxr-xr-x  1 root root  321224 May 31  2015 libssl.so.0.9.8e
-rwxr-xr-x  1 root root  439912 May 31  2015 libssl.so.1.0.1e
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libssl.so.10 -> libssl.so.1.0.1e
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libssl.so.6 -> libssl.so.0.9.8e
-rwxr-xr-x  1 root root  249368 May 31  2015 libssl3.so
lrwxrwxrwx  1 root root      34 Nov 30 17:22 libstartup-notification-1.so -> libstartup-notification-1.so.0.0.0
lrwxrwxrwx  1 root root      34 Nov 30 17:22 libstartup-notification-1.so.0 -> libstartup-notification-1.so.0.0.0
-rwxr-xr-x  1 root root   39736 May 31  2015 libstartup-notification-1.so.0.0.0
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libstdc++.so.5 -> libstdc++.so.5.0.7
-rwxr-xr-x  1 root root  825480 May 31  2015 libstdc++.so.5.0.7
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libstdc++.so.6 -> libstdc++.so.6.0.13
-rwxr-xr-x  1 root root  989840 May 31  2015 libstdc++.so.6.0.13
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libsysfs.so.2 -> libsysfs.so.2.0.1
-rwxr-xr-x  1 root root   47336 May 31  2015 libsysfs.so.2.0.1
lrwxrwxrwx  1 root root      24 Nov 30 17:22 libsysfswrapper.so.0 -> libsysfswrapper.so.0.0.0
-rwxr-xr-x  1 root root    8648 May 31  2015 libsysfswrapper.so.0.0.0
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libtiff.so -> libtiff.so.3.9.4
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libtiff.so.3 -> libtiff.so.3.9.4
-rwxr-xr-x  1 root root  411232 May 31  2015 libtiff.so.3.9.4
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libtiffxx.so -> libtiffxx.so.3.9.4
lrwxrwxrwx  1 root root      18 Nov 30 17:22 libtiffxx.so.3 -> libtiffxx.so.3.9.4
-rwxr-xr-x  1 root root    9224 May 31  2015 libtiffxx.so.3.9.4
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libusb-0.1.so.4 -> libusb-0.1.so.4.4.4
-rwxr-xr-x  1 root root   35776 May 31  2015 libusb-0.1.so.4.4.4
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libusb-1.0.so.0 -> libusb-1.0.so.0.1.0
-rwxr-xr-x  1 root root   63256 May 31  2015 libusb-1.0.so.0.1.0
lrwxrwxrwx  1 root root      21 Nov 30 17:22 libusbpp-0.1.so.4 -> libusbpp-0.1.so.4.4.4
-rwxr-xr-x  1 root root   21016 May 31  2015 libusbpp-0.1.so.4.4.4
drwxr-xr-x  2 root root     100 Nov 30 17:22 libuser
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libuser.so.1 -> libuser.so.1.2.2
-rwxr-xr-x  1 root root  105624 May 31  2015 libuser.so.1.2.2
lrwxrwxrwx  1 root root      20 Nov 30 17:22 libutempter.so.0 -> libutempter.so.1.1.5
-rwxr-xr-x  1 root root    9264 May 31  2015 libutempter.so.1.1.5
lrwxrwxrwx  1 root root      20 Nov 30 17:22 libwnck-1.so.22 -> libwnck-1.so.22.3.23
-rwxr-xr-x  1 root root  263256 May 31  2015 libwnck-1.so.22.3.23
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libxcb.so -> libxcb.so.1.1.0
lrwxrwxrwx  1 root root      15 Nov 30 17:22 libxcb.so.1 -> libxcb.so.1.1.0
-rwxr-xr-x  1 root root  124728 May 31  2015 libxcb.so.1.1.0
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libxkbfile.so -> libxkbfile.so.1.0.2
lrwxrwxrwx  1 root root      19 Nov 30 17:22 libxkbfile.so.1 -> libxkbfile.so.1.0.2
-rwxr-xr-x  1 root root  151792 May 31  2015 libxkbfile.so.1.0.2
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libxml2.so -> libxml2.so.2.7.6
lrwxrwxrwx  1 root root      16 Nov 30 17:22 libxml2.so.2 -> libxml2.so.2.7.6
-rwxr-xr-x  1 root root 1383368 May 31  2015 libxml2.so.2.7.6
drwxr-xr-x  2 root root      40 May 31  2015 libxslt-plugins
-rw-r--r--  1 root root  400916 May 31  2015 libxslt.a
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libxslt.so -> libxslt.so.1.1.26
lrwxrwxrwx  1 root root      17 Nov 30 17:22 libxslt.so.1 -> libxslt.so.1.1.26
-rwxr-xr-x  1 root root  250640 May 31  2015 libxslt.so.1.1.26
lrwxrwxrwx  1 root root      25 Nov 30 17:22 libz.so -> ../../lib64/libz.so.1.2.3
drwxr-xr-x  4 root root      80 Nov 30 17:22 lustre
drwxr-xr-x  3 root root      60 Nov 30 17:22 notification-daemon-1.0
drwxr-xr-x  2 root root      60 Nov 30 17:22 nss-yhpc
drwxr-xr-x 55 root root    2120 Nov 30 17:22 perl5
drwxr-xr-x  2 root root    5780 Nov 30 17:22 pkgconfig
drwxr-xr-x 23 root root   12600 Nov 30 17:22 python2.6
drwxr-xr-x  2 root root     460 Nov 30 17:22 sasl2
drwxr-xr-x  3 root root    1560 Nov 30 17:22 slurm
dr-xr-xr-x  2 root root      40 May 31  2015 sse2
drwxr-xr-x  2 root root      60 Nov 30 17:22 tc
dr-xr-xr-x  2 root root      40 May 31  2015 tls
drwxr-xr-x  2 root root      80 Nov 30 17:22 yhrms
PrometheusPi commented 6 years ago

Yes, the # makes the last line a comment and thus avoids the 48 lines of error code for now.

PrometheusPi commented 6 years ago

Okay, the error is that fftw is installed on the head/compile node, but is not available on the compute node:

ls: cannot access /usr/lib64/libfftw3.so.3: No such file or directory

The libfftw3.so.3 file does not exist and thus fftw is not found by clara2/the executable.

PrometheusPi commented 6 years ago

@QJohn2017 How did you install fftw on the compute node?

QJohn2017 commented 6 years ago

I don't install the fftw on the computer code. I am not the administrator and I does not find the installation location of the fftw

PrometheusPi commented 6 years ago

Okay - then I will try to think of a way how to install fftw on a user level (e.g. in your own home directory).

A further question: Does tianhe2 have a module system for adding additional libraries? If yes, what does module av return?

QJohn2017 commented 6 years ago

the command module av returns as:

[ac_siom_jsliu_1@ln0%tianhe2-C ~]$ module av

----------------------------------------------------------------------------------- /WORK/app/modulefiles -----------------------------------------------------------------------------------
ADTEx/2.0                            Quantum_Espresso/5.2.0_MPI           code_saturne/4.0.5                   hmmer/3.1b2                          pcre/8.37
ARPACK/96-icc                        Quantum_Espresso/5.3.0_MPI           conder/8.5.6                         hypre/2.10.1-icc14                   pegasus/4.6.2
ARPACK/96-icc15                      Quantum_Espresso/6.0_MPI             copasi/4.15                          hypre/2.10.1-icc15                   perl/5.22.0
ARWpost/3.1/00-CF-14                 Quantum_Espresso/6.0_MPI_2018        cp2k/2.6.0                           ilmbase/2.2.0                        perl/5.24.0
ARWpost/3.1/01-CF-15                 Quantum_Espresso/6.1_MPI             cp2k/2.6.1                           impute2/2.3.2_static                 petsc/3.1-p8
ActiveTcl/8.6                        R/3.1.2                              cp2k/3.0                             intel-compilers/11.1                 petsc/3.2-p7
AutoDock/4.2.6                       R/3.2.1                              cp2k/3.0-v2                          intel-compilers/13.0.0               petsc/3.2-p7-with-mumps
AutoDock_Vina/1.1.2                  R/3.2.2                              cp2k/4.0-17116                       intel-compilers/14.0.2               petsc/3.4.4-t
BEAST/1.8.1                          R/3.3.0                              cp2k/4.1                             intel-compilers/15.0.1               petsc/3.5.1-icc14
BEAST/1.8.2                          R/3.3.2                              cube/4.3                             intel-compilers/2017_update4         petsc/3.5.4
BEAST/2.3.1                          R/3.4.1                              cudnn/4.0-CUDA7.0                    intel-compilers/2018                 petsc/3.5.4-icc14
BLAS/3.5.0                           R/3.4.1-icc13                        cudnn/5.0-CUDA8.0                    intel-compilers/mkl-14               petsc/3.6.2
BLAS/3.5.0-icc                       RAxML/20161227                       cudnn/5.1-CUDA7.5                    intel-compilers/mkl-15               petsc/3.6.2-icc15
BLAS/3.5.0-icc15                     RapMap/20060321                      cudnn/5.1-CUDA8.0                    isl/0.16.1                           petsc/3.6.3
BerkeleyGW/1.1~beta                  RegCM/4.6.0-icc14                    cufflinks/2.2.1                      jasper/1.900.1/00-CF-14-libpng       petsc/3.6.3-complex
BerkeleyGW/1.2.0                     RegCM/4.6.1-icc14                    curl/7.49.0                          jasper/1.900.1/01-CF-15-libpng       petsc/3.6.3-complex-debug
Bowtie/1.1.2                         SLEPc/3.6.1                          cutadapt/1.12                        jasper/1.900.1/02-CF-14-shared       petsc/3.6.3-gcc492
Bowtie2/2.2.5                        SLEPc/3.6.1-icc15                    deal.II/8.2.1-icc15                  java/jdk1.6.0_45                     petsc/3.6.3-icc14-4.7.4
Bowtie2/2.2.6                        SLEPc/3.6.3-icc15                    deal.II/8.3.0-icc15                  java/jdk1.7.0_71                     petsc/3.6.3-icc14-4.9.2
CAMx/6.30                            STAR/2.5.0                           deal.II/8.4.1-icc15                  java/jdk1.8.0_11                     petsc/3.6.3-icc15-5.3.0
CLAPACK/3.2.1                        STAR/2.5.1                           deal.II/8.5.0-icc15                  jpeg/6b                              petsc/3.6.4-4.9.2
CMAQ/5.0.2-cb05cl_ae5_aq             SWIG/3.0.10-icc15                    diamond/0.9.8                        julia/0.4.5-icc14                    petsc/3.6.4-icc14-4.9.2
CMAQ/5.1                             SWIG/3.0.7                           elcirc/5.4c                          jupyter/4.2.3                        petsc/3.6.4-icc15-4.9.2
CMAQ/5.2                             SWIG/3.0.7-icc15                     emacs/24.3                           kallisto/0.42.4                      petsc/3.7.3
CNTK/1.7.2                           TCL/8.5.11                           emboss/6.6.0                         kggseq/20170318                      petsc/3.7.3-icc14
CNTK/2.0                             TCL/8.6.3                            esmf/6.3.0rp1-icc13-NC               kggseq/20170328                      petsc/3.7.5-icc14
CNVnator/0.3.2                       TCL/8.6.4                            esmf/7.0.0-icc13-NC                  kim-api/v1.7.1                       petsc/3.7.5-icc15-4.9.2
CNVnator/0.3.3                       TK/8.5.19                            esmf/7.0.0-icc14                     lamem/20160313                       phast/1.3
CONTRA/2.0.6                         TK/8.6.3                             esmf/7.0.0-icc14-NC                  lamem/20170228                       phonopy/1.11.10.4
CUDA/6.0.37                          Trilinos/12.10.1-icc15               esmf/7.0.0-icc14-debug               lamem/20170702                       phonopy/1.9.6
CUDA/7.0                             Trilinos/12.2.1-icc15                fastqc/0.11.5                        lammps/10Aug15                       phonopy/1.9.7
CUDA/7.5                             Trimmomatic/0.35                     fastx_toolkit/0.0.14                 lammps/11Sep15                       picard/1.129
CUDA/8.0                             Trinity/v2.3.2                       ffmpeg/0.11.1                        lammps/15May15                       picard/2.9.0
Chaste/3.3                           UnderWorld/1.7.0                     fftw/2.1.5-double                    lammps/17Feb16                       pigz/2.3.4
Chaste/3.3_source                    UnderWorld/1.7.0-02                  fftw/3.3.4-MPICH2.1.5                lammps/17Feb16-mic                   pio/1.9.23-icc15
Control-FREEC/7.2                    UnderWorld2/20151108                 fftw/3.3.4-centos                    lammps/17Nov16                       pio/1.9.23-icc17
DL_POLY/4.07                         UnderWorld2/20160615                 fftw/3.3.4-default                   lammps/1Dec12                        pio/2.3.1-icc15
DL_POLY/4.07-update                  VTK/5.10.1                           fftw/3.3.4-double                    lammps/30Sep16                       pio/2.3.1-icc17
DL_POLY/4.08                         VTK/6.2.0                            fftw/3.3.4-double-avx                lammps/30Sep16-mic                   pixman/0.32.6
ESPResSOmd/3.2.0                     VTK/7.0.0                            fftw/3.3.4-double-avx-sse2           lammps/31Mar17                       pkg-config/0.29.1/00-icc
ESPResSOmd/3.3.1                     VTK/7.1.1                            fftw/3.3.4-double-fma-icc15          lammps/9Dec14                        plink/1.07
EXCAVATOR/2.2                        VTK/7.1.1-python                     fftw/3.3.4-gcc                       lammps/9Dec14-mic                    plink/1.9
ExomeCNVTest/0.51                    VarScan/2.3.7                        fftw/3.3.4-icc-float                 lastz/1.02.00                        plinkseq/0.10
FDS/6.1.2                            ViennaRNA/2.1.9                      fftw/3.3.4-icc-single                lastz/1.03.73                        plumed/2.1.2
FDS/6.3.0                            VisIt/2.12.3                         fftw/3.3.4-single-avx                leveldb/1.15.0                       plumed/2.2.3
FDTD_slution/8.11.337                VisIt/2.9.2                          fftw/3.3.4-single-avx-sse2           libevent/2.0.22                      pnetcdf/1.6.0/00
FVCOM/3.2.1                          WPS/3.6.1/00-CF-14                   fftw/3.3.5                           libffi/3.2.1                         pnetcdf/1.6.1/00-icc15
FVCOM-lib/00-icc14                   WPS/3.7.1/01-CF-15                   fftw/3.3.5-double                    libgd/2.1.0                          pnetcdf/1.6.1/01-icc13
FVCOM-lib/01-icc14-nometis           WPS/3.7.1/02-CF-14                   fftw/mkl-14                          libgphoto2/2.5.8                     pnetcdf/1.9.0/00-icc13
FishingCNV/1.5.3                     WPS/3.8.1/00-CF-14                   fireworks/1.6.0                      libint/1.1.4                         pnetcdf/1.9.0/01-icc15
FusionMap/20150331                   WPS/3.8.1/02-CF-14-esmf              fish/2.1.1                           libint/1.1.5                         pnetcdf/1.9.0/02-icc17
GATK/3.3.0                           WPS/3.9/00-CF-15                     fish/2.2.0                           libint/2.0.3                         postgresql/8.4.22
GATK/3.7                             WPS/3.9.0.1/00-CF-15                 fish/2.6.0                           libpng/1.2.56/00-icc                 prodigal/2.6.3
GATK/3.8                             WRF/3.6.1/00-CF-14-emreal            freesurfer/5.3.0                     libunwind/1.1                        proj/4.9.2-icc13
GATK/4.beta.1                        WRF/3.6.1/01-CF-14-chem              freetype/2.6                         libxc/1.1.0                          proj/4.9.2-icc14
GPAW/1.2.0                           WRF/3.6.1/03-CF-14-emreal-beta-0.2   fsl/5.0.9                            libxc/2.0.0                          protobuf/20160825
Gamess_USA/May_01_2013_R1            WRF/3.6.1/04-CF-14-plus              gcc/4.7.4                            libxc/2.0.1                          protobuf/3.1.0
Gamess_USA/may2-2013                 WRF/3.7.1/00-CF-15-emreal            gcc/4.8.4                            libxc/2.2.2                          protobuf/v160510-icc
ImageMagick/6.9.2-5                  WRF/3.7.1/01-CF-15-emreal-beta-0.2   gcc/4.9.2                            libzip/1.1.2                         rMATS/3.2.1
JAGS/4.3.0                           WRF/3.7.1/02-CF-14-emreal-beta-0.2   gcc/5.2.0                            likwid/4.1.0                         rar/5.3.b4
JAGS/4.3.0-icc13                     WRF/3.8.1/00-CF-14-emreal            gcc/5.3.0                            lmdb/v20160511                       redis/3.2.4
LAPACK/3.5.0                         WRF/3.8.1/02-CF-14-esmf              gcc/5.4.0                            lzlib/1.8                            root/6.03.04
LAPACK/3.5.0-icc                     WRF/3.9/00-CF-15-emreal              gcta/1.26.0                          makedepf90/2.8.8                     rsem/1.2.29
LAPACK/3.5.0-icc15                   WanT/2.5.0                           gdal/2.1.0-icc14                     mcl/14-137                           rstudio/server/1.0.136
MEEP/1.2.1                           WanT/2.5.1                           gdk-pixbuf/2.31.4                    med/3.0.8                            rsync/3.0.6
METIS/5.1.0                          Wannier90/1.2                        gemma/0.96                           meme/4.11.1                          rsync/3.1.2
METIS/5.1.0-32bit                    Wannier90/2.0.0                      geos/3.5.0-icc14                     mesa/7.9.2                           salmon/20060321
METIS/5.1.0-icc15                    Wannier90/2.0.1                      get_homologues/20170302              mesa/7.9.2-gcc                       sambamba/0.6.3
MPB/1.5                              Yambo/3.4.1                          gflags/2.1.1                         mgltools/1.5.6                       sambamba/0.6.6
MPFR/2.4.2                           abinit/7.10.1                        gflags/2.2.1                         mongodb/3.2.3                        samtools/0.1.19
MPI/Gnu/MPICH/3.1                    abinit/7.10.4                        ghostscript/9.18                     mongodb-api/c-1.4.2                  samtools/1.2
MPI/Gnu/MPICH/3.1-4.8.4              abinit/8.0.8                         glib/2.44.1                          monitor/1.0                          samtools/1.3.1
MPI/Gnu/MPICH/3.1-4.9.2              abruijn/1.0-333381f                  glib/2.45.3                          mono/2.10.9                          scala/2.11.8
MPI/Gnu/MPICH/3.2-gcc4.4.7-dyn       anaconda/1.9.2                       glibc/2.14                           mpc/0.8.1                            scalasca/2.2
MPI/Gnu/MPICH/3.2-gcc4.9.2-dyn       anaconda/2.1.0                       glibc/2.14-gcc4.9                    mpiP/3.4.1                           scidb/r960
MPI/Intel/IMPI/4.1.3.048             anaconda/4.2.0                       glibc/2.15-gcc4.9                    mpiblast/1.6.0                       scons/2.3.1
MPI/Intel/IMPI/5.0.2.044             anaconda3/4.2.0                      glibc/2.17                           mplayer/1.3.0                        scons/2.5.1
MPI/Intel/MPICH/2.1.5                annovar/20160201                     globus/6.0.1                         multiz-tba/20160323                  scorep/1.4
MPI/Intel/MPICH/3.1                  ant/1.10.1                           glog/0.3.3                           muparser/2.2.5                       sentieon/201704
MPI/Intel/MPICH/3.1-dbg              arpack/arpack96                      glog/0.3.3-gflags2.2.1               muparser/2.2.5-icc15                 serf/1.3.9
MPI/Intel/MPICH/3.1-dyn              aspect/1.3-icc15                     glue/1.46-Python2.7.9                ncbi-vdb/2.6.4                       shapeit/v2.r790
MPI/Intel/MPICH/3.1-icc11            aspect/1.5-icc15                     gmap/20160404                        ncbi-vdb/2.7.0                       siesta/4.0
MPI/Intel/MPICH/3.1-icc13            atk/2.16.0                           gmp/4.3.2                            nco/4.6.0                            siesta/4.0b
MPI/Intel/MPICH/3.1-icc13-dyn        atlas/3.10.2                         gmt/5.2.1-icc14                      nco/4.6.0-icc13                      siesta/4.1b3
MPI/Intel/MPICH/3.1-icc15-dyn        atompaw/4.0.0.12                     gnuplot/5.0.5                        nco/4.6.0-icc15                      silo/4.10.2
MPI/Intel/MPICH/3.1-large            bazel/20160825                       gobject-introspection/1.44.0         ncview/2.1.5                         silo/4.10.2-hdf5
MPI/Intel/MPICH/3.2-icc14-dyn        bbtest/0.9.9                         gobject-introspection/1.46.0         nedit/5.6                            silo/4.10.2-hdf5-gcc
MPI/Intel/MPICH/3.2-icc14-dyn-centos bcbio/0.9.9                          grads/2.0.2                          netcdf/3.6.3                         sionlib/1.5.4
MPI/Intel/MPICH/3.2-icc2017-dyn      bcftools/1.3.1                       grass/7.0.4-icc14                    netcdf/4.1.3/00-CF-14                slepc/3.6.3
MPI/Intel/MPICH/3.2-icc2018-dyn      bcl2fastq/2.17                       gri/2.12.23/00-icc14                 netcdf/4.1.3/01-CF-13                snappy/1.1.3
MSTmap/20161226                      beagle/2.1                           grib_api/1.22.0/01-icc14             netcdf/4.1.3/02-CF-14-para           snptest/2.5
MUMPS/5.0.1                          bedops/2.4.20                        gromacs/4.5.1-single                 netcdf/4.1.3/03-CF-par               spades/3.10.1
Meerkat/0.185                        bedtools/2.23.0                      gromacs/4.5.4-single                 netcdf/4.3.2/01-CF-14                spark/1.5.1_hadoop-2.6
NAMD/2.10                            bedtools/2.25.0                      gromacs/4.5.5-double                 netcdf/4.3.2/02-CF-13                sra-tools/2.6.4
NAMD/2.10-mic                        bedtools/2.26.0                      gromacs/4.5.5-single                 netcdf/4.3.2/04-CF-4.9.2             sra-tools/2.7.0
NAMD/2.11                            bismark/0.16.3                       gromacs/4.6.7-double                 netcdf/4.3.2/05-par-4.9.2            staskfarm/1.0
NAMD/2.12                            blasr/5.3.0                          gromacs/4.6.7-single                 netcdf/4.3.3.1/01-CF-15              stringtie/1.3.1c
NCL/6.1.0                            blast/2.2.30                         gromacs/5.0.4-double                 netcdf/4.3.3.1/02-CF-15-parallel     subversion/1.9.5
NCL/6.3.0                            blast/2.5.0                          gromacs/5.0.4-mic                    netcdf/4.4.1/00-CF-15-par            swift/0.96.2
NCL/6.4.0-icc                        blat/36                              gromacs/5.0.4-single                 netcdf/4.4.1/01-CF-14-par            swift-t/1.3
Nemo5/r17881                         blitz/0.10                           gromacs/5.0.4-single-avx-256         netcdf/4.4.1/02-CF-17-par            szip/2.1
Nemo5/r20038                         boost/1.41.0                         gromacs/5.0.4-single-serial          netcdf/4.5.0/01-CF-13-par            szip/2.1-Gnu
Nemo5/r20175                         boost/1.41.0-P279                    gromacs/5.0.5-double                 netcdf/4.5.0/02-CF-17-par            szip/2.1-gcc49
OpenCASCADE/0.17                     boost/1.41.0-P279-icc                gromacs/5.0.5-double-avx-256         ngs/1.2.4                            szip/2.1-icc11
OpenCASCADE/0.17-icc15               boost/1.54.0                         gromacs/5.0.5-single                 ngs/1.2.5                            szip/2.1-icc15
OpenFOAM/2.1.1                       boost/1.54.0-icc-MPI                 gromacs/5.1.1-single-avx-256         ngsqctoolkit/2.3.3                   szip/2.1.1-icc13
OpenFOAM/2.3.1                       boost/1.58.0-gcc492-MPI              gromacs/5.1.1-single-avx-gpu         numdiff/5.8.1-icc15                  szip/2.1.1-icc17
OpenFOAM/2.4.0                       boost/1.58.0-icc-MPI                 gromacs/5.1.2-single-avx-256         nwchem/6.5                           tensorflow/0.10.0rc0
OpenFOAM/2.x-SOWFA                   boost/1.59.0-icc15-MPI               gromacs/5.1.2-single-avx-gpu         ocaml/4.02.3                         tensorflow/0.11.0
OpenFOAM/3.0.0                       boost/1.62.0                         gromacs/5.1.3-single-avx-256         octave/3.8.2                         tensorflow/1.0.1_cpu_py35
OpenFOAM/4.0                         breakdancer/20160325                 gromacs/5.1.4-single-avx-256         octopus/4.0.1                        test
Openbabel/2.3.2                      bwa/0.7.10                           gsl/1.14-icc                         octopus/4.1.2                        theano/0.8.2
Openbabel/2.3.2-python               bwa/0.7.12                           gsl/1.16                             octopus/5.0.1                        tinker/7.1.2
PGIcompiler/17.1                     bwa/0.7.15                           gsl/1.16-gcc                         opam/1.2.2                           tmux/2.0
PSI/20180202                         bwa/0.7.15-bwakit                    gsl/1.16-icc                         opencmiss/0.3                        tophat/2.0.14
PSI/4.0~b5                           bzip2/1.0.6                          gsl/2.1-icc                          opencv/1.0.0                         trilinos/12.10.1-icc15
Panoply/4.7.0                        bzip2/1.0.6-icc13                    gtk+/3.0.0                           opencv/2.4.11                        trilinos/12.6.3
ParaView/3.12.0                      bzip2/1.0.6-icc14                    guile/2.0.11                         opencv/2.4.9                         trilinos/12.8.1
ParaView/4.4.0                       caffe/v20160510-cpu3                 hadoop/2.5.0                         opencv/3.0.0                         trim_galore/0.4.2
ParaView/5.0.1-bin                   caffe/v20160511-gpu                  harfbuzz/0.9.41                      openexr/2.0.1                        udunits/1.12.11
ParaView/5.0.1-test                  caffe/v20160511-gpu-icc              hdf5/1.8.11/00-CF-14-parallel        openexr/2.2.0                        udunits/2.2.19
PhyloCSF/20160324                    caffe/v20161129-24d2f67-gpu          hdf5/1.8.11/01-CF-15-parallel        openjpeg/2.1.2/01-icc14              udunits/2.2.19-icc13
Python/2.7.10                        caffe/v20161130-gpu-cudnn            hdf5/1.8.12/00                       openmpi/1.10-intel                   udunits/2.2.26-icc15
Python/2.7.10-fPIC                   cairo/1.14.2                         hdf5/1.8.12/01-Gnu                   openmpi/1.10.2                       valgrind/3.10.1
Python/2.7.12                        cblas/3.5.0                          hdf5/1.8.12/02-icc11                 openmpi/1.8.3                        vcftools/0.1.12b
Python/2.7.3                         cdo/1.7.1                            hdf5/1.8.12/03-parallel              openmpi/1.8.3-intel                  vcftools/0.1.14
Python/2.7.9                         cdo/1.7.1-icc13                      hdf5/1.8.12/04                       openmx/3.8                           velvet/1.2.10
Python/2.7.9-fPIC                    cellsys/5.0                          hdf5/1.8.13/00                       osclean                              vmd/1.9.2
Python/2.7.9-gcc4.9.2                cesm/1.2.2                           hdf5/1.8.13/02-CF-14                 osenv/set2                           vmd/1.9.2-Text-mode
Python/2.7.9-icc15                   cgnslib/3.2.1                        hdf5/1.8.13/03-CF-13                 otf2/1.5.1                           xhmm/20150320
Python/3.4.2                         chemshell/3.6.0                      hdf5/1.8.13/04-gcc49-parallel        p4est/1.1.0                          xxdiff/4.0.1
Python/3.5.1                         cif2cell/1.2.10                      hdf5/1.8.13/05-gcc49                 p4est/1.1.0-icc15                    xz/5.2.2
Python/3.5.1-icc                     circexplorer2/2.2.6                  hdf5/1.8.13/06-CF-15                 p7zip/9.20.1                         xz/5.2.3
Python/3.6.3                         cmake/3.0.2                          hdf5/1.8.13/07-gcc492-mpich3.1.3     packmol/parallel                     xz/5.2.3-icc13
QMMM/GMX                             cmake/3.2.3                          hdf5/1.8.17/00-CF-15-par             packmol/serial                       yaml/0.1.5-icc14
QMMM/LMP_QE                          cmake/3.5.1                          hdf5/1.8.17/01-CF-14-par             pango/1.37.0                         zlib/1.2.11-icc13
Qt/4.8.6                             cmake/3.8.1                          hdf5/1.8.18/icc14                    parafem/2.0.819                      zlib/1.2.11-icc17
Qt/5.5.0                             code_saturne/4.0.1                   hdf5/1.8.20/01-CF-13-par             parallel/20161122                    zlib/1.2.8
Quantum_Espresso/5.1.1               code_saturne/4.0.3                   hdf5/1.8.20/02-CF-17-par             parmetis/4.0.3-mpi                   zlib/1.2.8-icc13
Quantum_Espresso/5.1.2               code_saturne/4.0.3-med               hdf5/1.8.9/00                        parmetis/4.0.3-mpi-32bit             zlib/1.2.8-icc15
Quantum_Espresso/5.1.2_MPI_ALL       code_saturne/4.0.4                   hisat2/2.0.5                         pcre/8.30                            zlib/1.2.8-mic
[ac_siom_jsliu_1@ln0%tianhe2-C ~]$
QJohn2017 commented 6 years ago

I found the fftw on the return results

PrometheusPi commented 6 years ago

Great! :+1:

Please run:

module load fftw/3.3.5  

go to the clara2 source code and:

make clean
make MPI

then edit the test.sh file to:

#!/bin/bash
module load fftw/3.3.5  
yhrun -N 2 -n 48 executable

and finally yhbatch test.sh.

If it fails at some point, please stop and report the error, if we reach the yhbatch ..., what is the output?

QJohn2017 commented 6 years ago

It's a pity that the return results has some errors as follows when I edit the test.sh file according to your suggestion:

/tmp/slurmd/job4953736/slurm_script: /usr/bin/modulecmd: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
...
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
yhrun: error: cn9688: tasks 0-23: Exited with exit code 127
PrometheusPi commented 6 years ago

Okay - no worry - this looks like a common problem among HPC systems 😄 - they do not know the module system in non-interactive jobs.

Does the following test.sh file help?

#!/bin/bash
. /etc/profile.modules
module load fftw/3.3.5  
yhrun -N 2 -n 48 executable
PrometheusPi commented 6 years ago

The configuration script might be a bit different on your system. But you will probably find something similar in your home directory .profile and/or .bashrc files.

QJohn2017 commented 6 years ago

it's . /etc/profile

QJohn2017 commented 6 years ago

When I change the test.sh as:

#!/bin/bash
. /etc/profile
module load fftw/3.3.5  
yhrun -N 2 -n 48 executable

and submit the job, its return results are:

/usr/share/Modules/init/sh: line 2: /usr/bin/modulecmd: No such file or directory
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
...
executable: error while loading shared libraries: libfftw3.so.3: cannot open shared object file: No such file or directory
yhrun: error: cn9688: tasks 0-23: Exited with exit code 127

Which seems the same as before results.

PrometheusPi commented 6 years ago

Okay - then /etc/profile is probably just the default profile. How is the work flow for loading modules on the compute note on your HPC system?

Could you please post ls -la /etc/ perhaps I can identify the module set up.

QJohn2017 commented 6 years ago

When I input the command ls -la /etc/, the results returns:

drwxr-xr-x.   2 root         root      4096 Aug 31  2015 logrotate.d
drwxr-xr-x.   4 root         root      4096 Jan  5  2015 logwatch
-rw-r--r--.   1 root         root       152 Jan  5  2015 lsb-release
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 lsb-release.d
-rw-r--r--.   1 root         root     10814 Feb 21  2006 ltrace.conf
drwxr-xr-x.   5 root         root      4096 Jan  5  2015 lvm
-rw-r--r--.   1 root         root       111 Sep 25  2012 magic
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 mail
-rw-r--r--.   1 root         root       272 Nov 18  2009 mailcap
drwxrwsr-x.   2 root         mailman   4096 Jan  5  2015 mailman
-rw-r--r--.   1 root         root      1909 May 28  2013 mail.rc
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 makedev.d
-rw-r--r--.   1 root         root      4940 Nov 17  2012 man.config
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 matchbox
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 maven
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 mc
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 mcelog
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 mercurial
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 mgetty+sendfax
-rw-r--r--.   1 root         root     43591 Jun  3  2011 mime.types
-rw-r--r--.   1 root         root      1112 Mar 31  2003 minicom.users
-rw-r--r--.   1 root         root       931 Feb  3  2011 mip6d.conf
-rw-r--r--.   1 root         root       801 Sep  8  2009 mke2fs.conf
-rw-r--r--.   1 root         root      7659 Oct 24  2013 mkshrc
drwxr-xr-x.   2 root         root      4096 Jun  2  2015 modprobe.d
drwxr-xr-x.   2 root         root      4096 Jan  9  2015 modulefiles
-rw-r--r--.   1 root         root         0 Jan 12  2010 motd
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 mpich2-x86_64
drwxr-xr-x.   3 root         root      4096 Jan  8  2015 mpss
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 mrtg
-rw-r--r--    1 root         root       796 Feb 11 15:26 mtab
-rw-r--r--.   1 root         root      2620 Nov 20  2009 mtools.conf
drwxr-xr-x.   2 root         root      4096 Oct 12  2013 multipath
drwxr-xr-x    2 munge        munge     4096 Jan 12  2015 munge
-rw-r--r--.   1 root         root    131314 Jul  7  2011 Muttrc
-rw-r--r--.   1 root         root        32 Jul  7  2011 Muttrc.local
-rw-r--r--.   1 root         root       251 Aug  9  2013 my.cnf
drwxr-x---.   2 root         named     4096 Aug 14  2013 named
-rw-r-----.   1 root         named     1008 Jul 19  2010 named.conf
-rw-r--r--.   1 root         named     2389 Aug 14  2013 named.iscdlv.key
-rw-r-----.   1 root         named      931 Jun 21  2007 named.rfc1912.zones
-rw-r--r--.   1 root         named      487 Jul 19  2010 named.root.key
-rw-r--r--.   1 root         root      7846 Aug 12  2010 nanorc
-rw-r--r--.   1 root         root       767 Nov 30  2009 netconfig
-rw-r-----.   1 root         root      1763 Jan 20  2011 netlabel.rules
drwxr-xr-x.   5 root         root      4096 Jan  5  2015 NetworkManager
-rw-r--r--.   1 root         root        58 Oct 10  2013 networks
-rw-r--r--.   1 root         root      3390 Oct 10  2013 nfsmount.conf
-rw-r--r--.   1 root         root       299 Jan  8  2015 nio_id.conf
-rw-r--r--    1 root         root      1897 Nov 12  2014 nscd.conf
-rw-r--r--    1 root         root      4311 Apr  6  2016 nslcd.conf
-rw-------.   1 root         root      4248 Jan  5  2015 nslcd.conf.rpmsave
-rw-r--r--    1 root         root      1711 Jan 14  2015 nsswitch.conf
-rw-------    1 root         root       859 Nov 11  2014 nss_yhpc.key
-rw-r--r--    1 root         root      1178 Nov 11  2014 nss_yhpc.pub
drwxr-xr-x.   3 root         root      4096 Jan 10  2015 ntp
lrwxrwxrwx    1 root         root        20 Jan 10  2015 ntp.conf -> /etc/ntp.conf.client
-rw-r--r--    1 root         root      1665 Jan 10  2015 ntp.conf.client
-rw-r--r--.   1 root         root      1770 Jul 15  2013 ntp.conf.orig
-rw-r--r--    1 root         root      1565 Nov 12  2014 ntp.conf.primary
-rw-r--r--    1 root         root      1597 Nov 12  2014 ntp.conf.secondary
-rw-r--r--.   1 root         root        91 Oct 15  2012 numad.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 obex-data-server
-rw-r--r--.   1 root         root         0 Nov 14  2012 odbc.ini
-rw-r--r--.   1 root         root       575 Nov 14  2012 odbcinst.ini
drwxr-xr-x.   2 root         root      4096 Feb 25  2011 oddjob
-rw-r--r--.   1 root         root      4922 Feb 25  2011 oddjobd.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 oddjobd.conf.d
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 openhpi
drwxr-xr-x.   6 root         root      4096 Jan 14  2015 openldap
drwxr-xr-x.   2 root         root      4096 Jan  9  2015 opensm
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 openwsman
drwxr-xr-x.   2 root         root      4096 Jun 28  2011 opt
-rw-r--r--    1 root         root     12498 Jan 22  2017 ostinfo.fsname
-rw-r--r--    1 root         root       782 Mar 20  2015 ostinfo.HOME
-rw-r--r--    1 root         root      2012 Mar 20  2015 ostinfo.VIP
-rw-r--r--    1 root         root      4118 Mar 20  2015 ostinfo.WORK
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 PackageKit
drwxr-xr-x.   2 root         root      4096 Mar 31  2015 pam.d
-rw-r--r--    1 root         root      8860 Jan 14  2015 pam_ldap.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 pam_pkcs11
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 pango
-rw-r--r--    1 root         root        33 Sep  6 17:31 partition_list
-rw-r--r--    1 root         root      3906 Jan  7  2016 passwd
-rw-------.   1 root         root      3834 Jul 28  2015 passwd-
-rw-r--r--.   1 root         root      1362 Mar  6  2010 pbm2ppa.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 pcmcia
drwxr-xr-x.   2 root         root      4096 Sep  7  2015 pear
-rw-r--r--.   1 root         root       946 Oct 26  2011 pear.conf
drwxr-xr-x.   2 root         pegasus   4096 Jan 28 16:30 Pegasus
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 php.d
-rw-r--r--.   1 root         root     69097 Aug 19  2013 php.ini
-rw-r--r--.   1 root         root      2872 Jan  7  2010 pinforc
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 pkcs11
drwxr-xr-x.  13 root         root      4096 Jan  5  2015 pki
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 plymouth
drwxr-xr-x.   5 root         root      4096 Jan  5  2015 pm
-rw-r--r--.   1 root         root       370 Jul 13  2012 pm-utils-hd-apm-restore.conf
-rw-r--r--.   1 root         root      6300 Mar  6  2010 pnm2ppa.conf
drwxr-xr-x.   5 root         root      4096 Jan  5  2015 polkit-1
drwxr-xr-x.   2 root         root      4096 Jan 11  2010 popt.d
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 portreserve
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 postfix
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 ppp
-rw-r--r--    1 root         root    862413 Feb  7 03:36 prelink.cache
-rw-r--r--.   1 root         root       789 Jul 19  2013 prelink.conf
drwxr-xr-x.   2 root         root      4096 Jan  8  2015 prelink.conf.d
-rw-r--r--.   1 root         root       233 Jan 12  2010 printcap
-rw-r--r--    1 root         root      1822 Sep  6 19:33 profile
drwxr-xr-x.   2 root         root      4096 Mar  9  2015 profile.d
-rw-r--r--.   1 root         root      6455 Jan 12  2010 protocols
-rw-r--r--.   1 root         root      1273 Aug  2  2013 ptp4l.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 pulse
-rw-------.   1 root         root         0 Jan  5  2015 .pwd.lock
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 qpid
drwxr-x--x.   2 quagga       quagga    4096 Jan  5  2015 quagga
-rw-r--r--.   1 root         root       220 Oct 14  2008 quotagrpadmins
-rwxr-xr-x    1 root         root      1338 Sep  6 17:10 quota_set.sh
-rw-r--r--.   1 root         root       259 Jun 13  2013 quotatab
drwxr-xr-x.   7 root         radiusd   4096 Jan  5  2015 raddb
-rw-r--r--.   1 root         root       433 Jun 11  2010 radvd.conf
lrwxrwxrwx.   1 root         root         7 Jan  5  2015 rc -> rc.d/rc
lrwxrwxrwx.   1 root         root        10 Jan  5  2015 rc0.d -> rc.d/rc0.d
lrwxrwxrwx.   1 root         root        10 Jan  5  2015 rc1.d -> rc.d/rc1.d
lrwxrwxrwx.   1 root         root        10 Jan  5  2015 rc2.d -> rc.d/rc2.d
lrwxrwxrwx.   1 root         root        10 Jan  5  2015 rc3.d -> rc.d/rc3.d
lrwxrwxrwx.   1 root         root        10 Jan  5  2015 rc4.d -> rc.d/rc4.d
lrwxrwxrwx.   1 root         root        10 Jan  5  2015 rc5.d -> rc.d/rc5.d
lrwxrwxrwx.   1 root         root        10 Jan  5  2015 rc6.d -> rc.d/rc6.d
drwxr-xr-x.  10 root         root      4096 Feb 14 10:54 rc.d
lrwxrwxrwx.   1 root         root        13 Jan  5  2015 rc.local -> rc.d/rc.local
lrwxrwxrwx.   1 root         root        15 Jan  5  2015 rc.sysinit -> rc.d/rc.sysinit
drwxr-xr-x.   3 root         root      4096 Jan 16  2015 rdma
-rw-r--r--.   1 root         root       966 Oct 22  2013 readahead.conf
-rw-r--r--.   1 root         root       435 Jan 28 16:29 reader.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 reader.conf.d
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 redhat-lsb
-rw-r--r--.   1 root         root        55 Oct 30  2013 redhat-release
-rw-r--r--.   1 root         root      1434 Oct 17  2011 reposd.conf
-rw-r--r--.   1 root         root      1484 Feb  4  2012 request-key.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 request-key.d
-rw-rw-r--.   1 root         root         0 Jan  5  2015 resolv.conf
drwxr-xr-x.   5 root         root      4096 Jan  5  2015 rhsm
lrwxrwxrwx.   1 root         root        11 Jan  5  2015 rmt -> ../sbin/rmt
-rw-r--r--    1 root         root      1615 May  4  2010 rpc
drwxr-xr-x.   2 root         root      4096 Jan  9  2015 rpm
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 rpmdevtools
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 rpmlint
-rw-r--r--    1 root         root      3296 Dec 29 14:52 rsyslog.conf
drwxr-xr-x.   2 root         root      4096 Jan  9  2015 rsyslog.d
-rw-r--r--.   1 root         root       930 Oct 10  2013 rwtab
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 rwtab.d
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 sabayon
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 samba
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 sane.d
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 sasl2
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 scl
-rw-r--r--.   1 root         root      6682 Jan 25  2011 screenrc
-rw-------.   1 root         root       122 Jan 12  2010 securetty
drwxr-xr-x.   6 root         root      4096 Jan  5  2015 security
drwxr-xr-x.   3 root         root      4096 Jan  9  2015 selinux
-rw-r--r--.   1 root         root      6845 Sep 19  2012 sensors3.conf
-rw-r--r--.   1 root         root    641020 Aug 20  2013 services
-rw-r--r--.   1 root         root       216 Oct 15  2013 sestatus.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 setroubleshoot
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 setuptool.d
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 sfcb
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 sgml
----------    1 root         root      1739 Aug 31  2015 shadow
----------.   1 root         root      1717 Jul 28  2015 shadow-
-rw-r--r--.   1 root         root        89 Jan  5  2015 shells
drwxr-xr-x.   4 root         root      4096 Mar  6  2015 skel
-rw-r--r--.   1 root         root     12177 Jul 28  2011 slp.conf
-rw-r--r--.   1 root         root      2707 Jul 28  2011 slp.spi
drwxr-xr-x    5 root         root      4096 Jun  2  2015 slurm
-rw-r--r--.   1 root         root      6717 Sep 26  2012 smartd.conf
-rw-r--r--.   1 root         root      1272 Jan  4  2008 smi.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 smrsh
-rw-r--r--.   1 root         root       912 Jun 30  2010 smt_dhcp_ra_support.conf
-rw-r--r--.   1 root         root      1100 Jun 30  2010 smt_dns_ra_support.conf
-rw-r--r--.   1 root         root      1789 Jun 30  2010 smt_smb_ra_support.conf
-rw-r--r--.   1 root         root       975 Jun 30  2010 smt_smb_ra_synonyms.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 snmp
-rw-r--r--.   1 root         root       260 Oct 21  2013 sos.conf
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 sound
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 spice
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 squid
-rw-r--r--.   1 root         root       570 Jan  9  2015 srp_daemon.conf
drwxr-xr-x.   3 root         root      4096 Dec 24 08:51 ssh
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 ssl
drwx------.   2 root         root      4096 Oct 23  2013 sssd
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 stap-server
-rw-r--r--.   1 root         root       212 Oct 10  2013 statetab
drwxr-xr-x.   2 root         root      4096 Oct 10  2013 statetab.d
drwxr-xr-x.   2 root         root      4096 Apr  1  2013 stunnel
drwxr-xr-x.   2 root         root      4096 Apr  2  2013 subversion
-rw-r-----.   1 root         root      1786 Sep 25  2012 sudo.conf
-r--r-----    1 root         root      4052 Nov 15  2016 sudoers
drwxr-x---.   2 root         root      4096 Mar  5  2015 sudoers.d
-rw-r-----.   1 root         root      3181 Oct  7  2013 sudo-ldap.conf
drwxr-xr-x.   9 root         root      4096 Jul 28  2016 sysconfig
-rw-r--r--.   1 root         root      1150 Oct 10  2013 sysctl.conf
drwxr-xr-x.   2 root         root      4096 Jan  9  2015 sysctl.d
lrwxrwxrwx.   1 root         root        14 Jan  5  2015 system-release -> redhat-release
-rw-r--r--.   1 root         root        49 Oct 30  2013 system-release-cpe
drwxr-xr-x.   6 root         root      4096 Jan  5  2015 systemtap
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 target
-rw-------.   1 tss          tss       6411 Jul  8  2010 tcsd.conf
-rw-r--r--.   1 root         root    981068 Jan  5  2015 termcap
drwxr-xr-x.   2 root         root      4096 Dec  4  2009 terminfo
drwxr-xr-x.   3 root         root      4096 Jan  5  2015 texmf
drwxr-xr-x.   2 root         root      4096 Jan  9  2015 tgt
-rw-r--r--    1 root         root        62 Aug 11  2017 ThModule.conf
drwxrwxr-x.   3 root         tomcat    4096 Jan  5  2015 tomcat6
-rw-r--r--.   1 root         root        45 Mar 18  2013 Trolltech.conf
lrwxrwxrwx.   1 root         root        37 Jan  5  2015 tuned.conf -> /etc/tune-profiles/default/tuned.conf
drwxr-xr-x.  14 root         root      4096 Jan  5  2015 tune-profiles
drwxr-xr-x.   4 root         root      4096 Jan  9  2015 udev
-rw-r--r--.   1 root         root       473 Sep 24  2012 updatedb.conf
-rw-r--r--.   1 root         root       313 Jul  4  2000 urlview.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 vbox
-rw-r--r--.   1 root         root      1962 Feb 17  2012 vimrc
-rw-r--r--.   1 root         root      1962 Feb 17  2012 virc
-rw-r--r--.   1 root         root      1964 Oct 23  2013 virt-v2v.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 vsftpd
-rw-r--r--.   1 root         root      3008 Jun 13  2013 warnquota.conf
-rw-r--r--.   1 root         root      1051 Aug  8  2013 watchdog.conf
drwxr-xr-x.   2 root         root      4096 Aug  8  2013 watchdog.d
-rw-r--r--.   1 root         root     23735 Sep  9  2004 webalizer.conf
-rw-r--r--.   1 root         root      4479 Oct  1  2012 wgetrc
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 wpa_supplicant
-rw-r--r--.   1 root         root         0 Dec 18  2009 wvdial.conf
drwxr-xr-x.   9 root         root      4096 Jan  5  2015 X11
drwxr-xr-x.   4 root         root      4096 Jan  5  2015 xdg
-rw-r--r--.   1 root         root     12986 Jan  6  2010 xferstats.cfg
-rw-------.   1 root         root      1001 Sep 24  2013 xinetd.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 xinetd.d
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 xml
-rw-r--r--.   1 root         root       585 Oct 10  2012 yp.conf
-rw-r--r--.   1 root         root      1761 Oct  1  2013 ypserv.conf
drwxr-xr-x.   5 root         root      4096 Jan  5  2015 yum
-rw-r--r--.   1 root         root       813 Jan  9  2013 yum.conf
drwxr-xr-x.   2 root         root      4096 Jan  5  2015 yum.repos.d
drwxr-xr-x    3 root         root      4096 Sep  2  2015 zabbix
-rw-r--r--.   1 root         root       252 Aug  6  2013 zlogin
-rw-r--r--.   1 root         root        86 Aug  6  2013 zlogout
-rw-r--r--.   1 root         root       375 Aug  6  2013 zprofile
-rw-r--r--.   1 root         root       304 Aug  6  2013 zshenv
-rw-r--r--.   1 root         root       883 Aug  6  2013 zshrc
[ac_siom_jsliu_1@ln3%tianhe2-C src]$

Because the output files are too much and my computer screen is small, so the output results only displayed partial.

PrometheusPi commented 6 years ago

The partial result might be enough: What is the output of

ls -la /etc/profile.d/