Resolving The Problem

I've recompiled Open-MPI with GNU compiler and installed it in /share/apps. Does Platform have the module file example? How do I setup module file for open-mpi 1.2 compiled by GNU compiler?In some circumstances, you may want to recompile a newer version of Open-MPI and install it onto /share/apps. We have an example module file for your reference.

The module file can be found in the attachment. It unsets the OMPI_CC and OMPI_CXX environment variables . Note that the path is hard-coded in the module file. Please modify it according to your environment.

To set it up cluster-wide, please follow the steps below.

1- Copy the module file to /share/apps/modulefiles.custom/ompi12-gnu on the frontend and then run :
sudo ln -s /share/apps/modulefiles.custom/ompi12-gnu /opt/modules/modulefiles/hpc/ompi12-gnu

2- Propagate the module on the cluster :
sudo cluster-fork "ln -s /share/apps/modulefiles.custom/ompi12-gnu /opt/modules/modulefiles/hpc/ompi12-gnu"

3- Test the module :
3.1- Load the module :
-----------------------------------------
[toor3@frontend ~]$ module load hpc/ompi12-gnu
ompi12-gnu module

****************************************************

This module sets up the following environment
variables for openmpi 1.2 gnu
PATH
LD_LIBRARY_PATH
MPIHOME
MANPATH

Version 3.1.6

****************************************************
-----------------------------------------
3.2- Check the PATH :
-----------------------------------------
[toor3@frontend ~]$ which mpicc
/share/apps/open-mpi/openmpi-1.2-gnu/bin/mpicc
[toor3@frontend ~]$ which mpiCC
/share/apps/open-mpi/openmpi-1.2-gnu/bin/mpiCC
[toor3@frontend ~]$ which mpif77
/share/apps/open-mpi/openmpi-1.2-gnu/bin/mpif77-----------------------------------------
3.3- Check LD_LIBRARY_PATH :
-----------------------------------------
[toor3@frontend ~]$ echo $LD_LIBRARY_PATH
/share/apps/open-mpi/openmpi-1.2-gnu/lib:/share/apps/open-mpi/openmpi-1.2-gnu/lib/openmpi:/opt/intel/cmkl/8.0/lib/em64t:/opt/lava/6.1/linux2.6-glibc2.3-ia32e/lib:/opt/intel/itc60/slib:/opt/intel/ipp41/em64t/sharedlib:/opt/intel/fce/9.0/lib:/opt/intel/cce/9.0/lib:/share/apps/openmpi-1.1.2-ifort2/lib
-----------------------------------------

3.4- Check MPIHOME :
-----------------------------------------
[toor3@frontend ~]$ echo $MANPATH
/share/apps/open-mpi/openmpi-1.2-gnu/man:/opt/lava/6.1/man:/opt/intel/itc60/man:/opt/intel/fce/9.0/man:/opt/intel/idbe/9.0/man:/opt/intel/cce/9.0/man:/opt/modules/current/man:/opt/modules/man:/share/apps/openmpi-1.1.2-ifort2/man
-----------------------------------------
3.5- Check the compilers mapping :
-----------------------------------------
[toor3@frontend ~]$ mpicc -v
Reading specs from /usr/lib/gcc/x86_64-redhat-linux/3.4.5/specs
Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --enable-shared --enable-threads=posix --disable-checking --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-java-awt=gtk --host=x86_64-redhat-linux
Thread model: posix
gcc version 3.4.5 20051201 (Red Hat 3.4.5-2)
[toor3@frontend ~]$ mpiCC -v
Reading specs from /usr/lib/gcc/x86_64-redhat-linux/3.4.5/specs
Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --enable-shared --enable-threads=posix --disable-checking --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-java-awt=gtk --host=x86_64-redhat-linux
Thread model: posix
gcc version 3.4.5 20051201 (Red Hat 3.4.5-2)
-----------------------------------------
-----------------------------------------
[toor3@frontend ~]$ module list
Currently Loaded Modulefiles:
1) hpc/ompi112-i2 2) pam/pam_default 3) hpc/ompi12-gnu