TotalView
From PHASTA Wiki
We currently have an evaluation license of the TotalView graphical/parallel debugger. Please give it a try and let Ben know if you have any problems
Running
soft add +totalview-8.13.0 mpirun -tv -np 1 your_program
ReplayEngine/Reverse Debugging
mpirun -mca mpool_rdma_rcache_size_limit 1 -x IBV_FORK_SAFE=1 -x LD_PRELOAD=/usr/local/toolworks/totalview.8.13.0-0/linux-x86-64/lib/undodb_infiniband_preload_x64.so -tv -np 1 your_program
(see the TotalView user's guide for more information)
Documentation
http://www.roguewave.com/support/product-documentation/totalview.aspx