This is a read only copy of the old FEniCS QA forum. Please visit the new QA forum to ask questions

MPI error running on a BG/Q system with ranks-per-node:16

–2 votes

I have different test case and in each case the following error occures if I use ranks-per-node 16:

AD_BG_assert, file=/bgsys/source/srcV1R2M2.3650/comm/lib/dev/mpich2/src/mpi/romio/adio/ad_bg/ad_bg_aggrs.c, line=224
Abort(1) on node 0 (rank 0 in comm 1140850688): application called MPI_Abort(MPI_COMM_WORLD, 1) - process 0

The last output from set_log_level(1):

Initializing PETSc (ignoring command-line arguments).
.....
Elapsed time: * (Init PETSc)

There is no problem if I use ranks-per-node 8, 32, or 64.
On a node there are 16 cores per node (4-way simultaneous multi-threaded (SMT)).

asked Sep 10, 2014 by tombo FEniCS Novice (260 points)

Your statement needs more information and a question in order to be answered.

commented Sep 12, 2014 by Marie E. Rognes FEniCS User (5,380 points)

Which information do you need? I would like to fix that problem so that I can execute my program with 16 ranks per node.

commented Sep 12, 2014 by tombo FEniCS Novice (260 points)

See http://fenicsproject.org/support/#asking-questions

commented Sep 15, 2014 by Marie E. Rognes FEniCS User (5,380 points)
...