Hello!
Thanks for all the help. I added -DDONT_USE_MCW_MALLOC to the mpicc make line in the make file. I also added #define DONT_USE_MCW_MALLOC in the mcw_malloc.h header, however we are still getting the malloc hook test error. I tried using both 'make cleanest' and 'rm *.o *.a' before making with no luck.
Is there anywhere else where malloc may get overwritten? We're still waiting on the admins to see if they can compile a version of mpi which doesn't care if malloc is redifined. (as an optimization, mpirun overwrites malloc so that it can do less copies when passing massages across nodes, so if the app overwrites it, it wont work. A recompiled version of mpi which doesn't have this optimization will take a slight performance hit).
We are able to run multiple mpi processes on one node. If this problem doesn't get resolved, we'll still be able to implement our changes, however we wont be able to provide any true performance results...
Thanks again!
-Omid