Merge branch 'barry/2019-07-27/error-check-mpiexec' into 'master'

Large number of fixes, optimizations for configure, speeds up the configure

See merge request petsc/petsc!2046

Large number of fixes, optimizations for configure, speeds up the configure

1) turn off checking if MPI library is shared since that code has been broken for 3+ years

2) move pure Fortran configure

Large number of fixes, optimizations for configure, speeds up the configure

1) turn off checking if MPI library is shared since that code has been broken for 3+ years

2) move pure Fortran configure tests to compilersFortran.py

3) turned threads back on but only use them for performing timeout for *runtest() commands (since they slow everything down if used
everywhere)

4) changed parallel configure (which doesn't work anyways) to use --useParallel and not overload --useThreads

5) added runtime check of mpiexec that uses timeout (replaces previous test in MPI shared libraries)

6) removed unused tests in configure in the interest of speed

7) minor refactorization of configure for better support of parallel configure (which doesn't work)

8) added timing results in configure.log. These may be accessed with grep child configure.log | sort -k3 -g

9) add check that mpiexec given in configure test matches the MPI compilers and libraries used

Commit-type: optimization, bug-fix, portability-fix, feature
Reported-by: Carl Steefel <cisteefel@lbl.gov>

show more ...

Merged petsc/petsc into master

Merge branch 'master' into jpusztay/feature-swarm-symplectic-example

Merge branch 'master' into jpustay/feature-swarm-example

Merged petsc/petsc into master

Merge branch 'master' into arcowie-rem/feature-error-logging

* master: (393 commits)
Bib: Update reference
Mat: Doc fix
Bib: Updated ref
PetscDS: Doc fixes
PC+LU: Do not try to refactor an

Merge branch 'master' into arcowie-rem/feature-error-logging

* master: (393 commits)
Bib: Update reference
Mat: Doc fix
Bib: Updated ref
PetscDS: Doc fixes
PC+LU: Do not try to refactor an already factored matrix
Mat: Small fix for checking and docs
Mat: Added MatSetFactorType() - Needed it when making a shell matrix look factored
PetscDS: Added PetscDSUpdateBoundary() - Lets the user change the boundary condition
single precision produces different convergence history
p4est: has a dependency on zlib - so handle it correctly
Add -mat_mffd_complex to use the Lyness complex number trick to compute J_u * v instead of differencing.
Replace VecWAXPY by VecAXPY if needed
Revert "Replace VecWAXPY by VecAXPY if needed"
Replace VecWAXPY by VecAXPY if needed
MatHermitianTransposeGetMat and MatCreateVecs
ex19: Updated test filter to avoid false positives.
DM: Improved Global-To-Natural docs Suggested-by: Josh L <ysjosh.lo@gmail.com>
Do not build shared openblas when doing static build
Upgrade OpenBLAS to 0.3.3
test: add alt output file for changes in OSX-10.14 and Xcode-10.0 [perhaps related to ML]
...

Conflicts:
src/vec/is/utils/vsectionis.c

show more ...

Merge branch 'jed/python3-futurize' [PR #1122]

Merge announces support for Python 3.4+ in changes/dev.html.

* jed/python3-futurize: (44 commits)
gmakegentest: avoid prefix matching in regex
dm

Merge branch 'jed/python3-futurize' [PR #1122]

Merge announces support for Python 3.4+ in changes/dev.html.

* jed/python3-futurize: (44 commits)
gmakegentest: avoid prefix matching in regex
dm tests ex23.c: fix test args: -one -two -three
gmakegentest: more fixes
gmakegentest: fix processing of arguments containing number followed by "-"
gmakegentest: always loop over nsize; Python-3 fixes
python3: add in a python-3.4 test
python: fix build on osx/opensolaris - where 'RANLIB=ranlib -c' i.e with a space..
python3: fix --download-ptscotch error
configure: glob() gets executed early - whereas we need to get file list later [after 'make all' or equivalent] so revert back to using shell to get file-list
python3: map() requires a list modifier for this usage.
python: replace ModuleNotFoundError a python3.6+ feature with ImportError
config: call setup to ensure that debugLevel is set
nightlies: switch linux-pkg-dbg-ftn-interfaces to python3
config: enable Python-3
config: urllib/urlparse updates for Python-3 compatibility
config fblaslapack: use isIBM instead of manual test
python: replace commands with subprocess
Fix LOCDIR paths
generateetags.py: switch from commands to subprocess; unicode fix
python: don't import commands when it isn't used
...

show more ...

config: futurize filter()

Returns a list in Python-2, but a filter object in Python-3. There
are many places that test isinstance(f, list) to distinguish strings
from lists, but a filter object beh

config: futurize filter()

Returns a list in Python-2, but a filter object in Python-3. There
are many places that test isinstance(f, list) to distinguish strings
from lists, but a filter object behaves like a list for most purposes.

show more ...

Merge branch 'master' into knepley/feature-plex-elasticity-test

* master: (1553 commits)
-options_table was changed to options_view in 2014 but documentation was not updated to reflect it
config

Merge branch 'master' into knepley/feature-plex-elasticity-test

* master: (1553 commits)
-options_table was changed to options_view in 2014 but documentation was not updated to reflect it
configure: fix F2003 test
Plex test ex5: Removed "future" test, as it resulted in issues in the nightly tests.
Some minor typos in TS
Add ADIOS2.py which I forgot to git add in the past
Plex ex5: Disable test
Doc: Added note for interface change
KSPLSQRMonitorDefault fixed for quad precision
Tao: Added alternative output for chwirut2 test.
TS ex45,ex46: Removed overly refined tests for faster nightly tests.
KSP ex72: Fixed needlessly long-running PCTFS tests.
SNES ex56: Reduced test size to speed up nightly test suite.
KSPSolve_LSQR: don't compute unused norm of rhs
SNES ex13: Reduced problem sizes for nightly tests.
PetscOptionsDeprecated(): fix for NULL prefix
PetscOptionsDeprecated(): add option to print additional info
SNES ex12: Reduced sizes for BDDC tests.
PetscFileRetrieve(): Suppress output to STDERR when downloading a file.
MatMatMult: Fixed unused variable pN.
DMDestroy: Guard call to dm->ops->destroy * Similar guards are in place in many other methods (IS,Vec,Mat) and permit the DM to be destroyed even if DMSetType() was never called.
...

show more ...

Merge branch 'master' into knepley/feature-plex-parallel-submesh

* master: (2931 commits)
remove N in docs for SNESQN
replaced test tolerance with PETSC_SQRT_MACHINE_EPSILON
fortran: PetscComp

Merge branch 'master' into knepley/feature-plex-parallel-submesh

* master: (2931 commits)
remove N in docs for SNESQN
replaced test tolerance with PETSC_SQRT_MACHINE_EPSILON
fortran: PetscComplex type is missing from fortran
initialize variables so that static analyzer doesn't mistakenly think they are used uninitialized.
Move access of prefix until it is actually used
Remove DMDASplitComm2d(), used in one example that was not tested
Functions that do not return PetscErrorCode should not use PetscFunctionBegin/End paradgm
remove unneeded reassignment of same value
Missing CHKERRQ(); Mostly in Tao code
Remove clang static analyser warning about passing NULL variable to strncat()
missing newline in -ts_monitor_extreme
minor fixes for integer counters
Configure: Deal with '__func__' in C89 builds with newer Clang and GCC.
Jenkinsfile: Increased timeout for tests to 5 minutes.
3.9 changes: further clarify removal of -pc_factor_mat_solver_package
Options deprecations: add "PETSc" to inline warning
removing unused variable
MatShift support added to MATSUBMAT. Mimics MATSHELL functionality. Needed for matrix-free Hessians in TAO Newton-Line-Search methods.
Add -ts_monitor_extreme
Dev manual: add note on deprecating options database keys
...

Conflicts:
src/dm/impls/plex/examples/tests/ex4.c

show more ...

Merge branch 'master' into knepley/feature-snes-ex13-spectral

* master: (2350 commits)
migrate warning fix from next-tmp
Revert "Remove dead code."
clarifying comment in the code
Remove dead

Merge branch 'master' into knepley/feature-snes-ex13-spectral

* master: (2350 commits)
migrate warning fix from next-tmp
Revert "Remove dead code."
clarifying comment in the code
Remove dead code.
Add JuMP citation
Copyedits and updates to developers manual
Add more protection to intrinsics
MPI: protect arguments in MPI macros
Add the missing conditionals for 64-bit build
Plex+VTK: Fix field type determination
Fix bug in name cleanup
Bib: Added ref
Plex+VTK: Fix field type determination
Plex: Updated test output - I am now hating this shit
forgot to save file after moving prototypes to petscsys.h
update Apple example project settings per Xcode
Two functions should actually be public, used, for example from Apple MacOS and iOS programs
includes should always be included relative to include directory
Apple removed old locations of docsets
SNES ex12: Updated test output
...

Conflicts:
src/snes/examples/tutorials/ex13.c

show more ...

Merge branch 'master' into knepley/fix-plex-residual-loop
Warning: This merge includes real changes

* master: (188 commits)
Add JuMP citation
Copyedits and updates to developers manual
Add mor

Merge branch 'master' into knepley/fix-plex-residual-loop
Warning: This merge includes real changes

* master: (188 commits)
Add JuMP citation
Copyedits and updates to developers manual
Add more protection to intrinsics
MPI: protect arguments in MPI macros
Add the missing conditionals for 64-bit build
Plex+VTK: Fix field type determination
Fix bug in name cleanup
Bib: Added ref
Plex+VTK: Fix field type determination
Plex: Updated test output - I am now hating this shit
forgot to save file after moving prototypes to petscsys.h
update Apple example project settings per Xcode
Two functions should actually be public, used, for example from Apple MacOS and iOS programs
includes should always be included relative to include directory
Apple removed old locations of docsets
SNES ex12: Updated test output
SNES ex62: Set name of solution vector - Update test output
revert sources to dev - reset PETSC_VERSION_RELEASE - reset changes/dev.html
release: set v3.9 strings
move output file to the correct location. i.e fix 305862f9cd0dc399542ae11dd744508e4b6ad2e3
...

Conflicts:
src/snes/utils/dmplexsnes.c
src/ts/utils/dmplexts.c

show more ...

Merge branch 'master' into knepley/feature-pc-patch

* master: (440 commits)
revert sources to dev - reset PETSC_VERSION_RELEASE - reset changes/dev.html
release: set v3.9 strings
fix grep us

Merge branch 'master' into knepley/feature-pc-patch

* master: (440 commits)
revert sources to dev - reset PETSC_VERSION_RELEASE - reset changes/dev.html
release: set v3.9 strings
fix grep usage on solaris [use egrep]
opensolaris: fix errors
Update timer reporting and minor reporting fix
Remove redundant if statement. Found by @jedbrown
Fixed problem with order of developer photos on website.
superlu_dist: use correct flag in example [PETSC_HAVE_SUPERLU -> PETSC_HAVE_SUPERLU_DIST]
Bib: PERMON ref
fix for osx
doc: more author fixes
doc: more author fixes
Italicized "orderings" in MPI process placement discussion.
Added Richard to the user manual author list.
Added Richard to the list of active developers on the website.
add string check for MS-MPI and IMPI timeout errors
opensolaris does not have multiple grep utils - but default one does not support -F. So use fgrep instead
Standardizing timeout checks
Report wall clock time of total tests
Use time instead of date %s
...

Conflicts:
include/petscpc.h
src/ksp/ksp/interface/itfunc.c

show more ...

Merge remote-tracking branch 'origin/jed/futurize-stage-1'

python: futurize stage 1 (modernize python-2 code)

This should have no behavioral change. It was generated by running

futurize -1 -nw config lib setup.py src systems

followed by reverting some

python: futurize stage 1 (modernize python-2 code)

This should have no behavioral change. It was generated by running

futurize -1 -nw config lib setup.py src systems

followed by reverting some "from . import" relative imports (PEP 328
without 366) and fixing up RDict.py __contains__ to not cause recursion.

show more ...

Merge commit 'd47bf9aaf1e5266cc3f0ff499f934c85788965a9' into jed/fix-matcreatempibaij/maint

Obtain changed (v3.5) handling of MatMPIBAIJSetPreallocationCSR to match
documentation.

Merge branch 'master' into knepley/solkx

* master: (6933 commits)
Bib: Added reference
Includegraph: Updated for compatibility with new folder layout.
Add SNESLineSearchReason to fortran inclu

Merge branch 'master' into knepley/solkx

* master: (6933 commits)
Bib: Added reference
Includegraph: Updated for compatibility with new folder layout.
Add SNESLineSearchReason to fortran includes Also truncate names to fit 32 char fortran limit
fix compile warnings /usr/home/balay/petsc.clone-2/src/vec/vec/interface/vector.c:1944: warning: division by zero in '1.0e+0 / 0.' /usr/home/balay/petsc.clone-2/src/ksp/ksp/interface/itfunc.c:508: warning: 'vec_rhs' may be used uninitialized in this function
updated output for new trust region initial size
initial size of the trust region is set as a percent of the norm of the initial guess, it should not be related to the initial norm of the function (which is kind of nuts).
The default bounds for SNESVISetVariableBounds() in the manual page were reversed from correct values
Bib: Added refs
Bib: Update MPICH webpage
Plex: Forgot to close file
removed nonexistent ex46f from makefile test rule
Revert "fixed bad merge into master"
fixed bad merge into master
fix memory leak in mkl_pardiso fix some formatting in mkl_pardiso code
mv runex111 from TESTEXAMPLES_C to TESTEXAMPLES_DATAFILESPATH
Mat+Doc: More Fortran docs
Plex ex3: Run tests with the correct number of field components
Bib: Added TetGen cite
parmetis: make sure 'ldd libparmetis.so' points to the correct libmetis.so that its linked with.
small fix as reported by the nightly test
...

Conflicts:
config/builder.py

show more ...

Merge branch 'master' into shri/ts-is-for-differential-variables

Conflicts:
include/petsc-private/tsimpl.h
src/ts/impls/eimex/eimex.c
src/ts/interface/ts.c

Merge branch 'master' into shri/ts-events

Conflicts:
src/ts/interface/ts.c

Merge branch 'master' into shri/feature-dm-circuit

Conflicts:
src/dm/impls/makefile

Merge branch 'master' into barry/wirth-fusion-materials
bad manual merge needs to be fixed
this is what happens when branches hang around too long

Conflicts:
src/ts/examples/tutorials/advection-dif

Merge branch 'master' into barry/wirth-fusion-materials
bad manual merge needs to be fixed
this is what happens when branches hang around too long

Conflicts:
src/ts/examples/tutorials/advection-diffusion-reaction/ex10.c

show more ...

Merge branch 'master' into barry/xcode

Merge branch 'master' into knepley/feature-dmda-section

* master: (528 commits)
Doc: Fixed configure doc
Nightly summary: Added configure section.
TSSetErrorIfStepFails: fix __FUNCT__
TS: fi

Merge branch 'master' into knepley/feature-dmda-section

* master: (528 commits)
Doc: Fixed configure doc
Nightly summary: Added configure section.
TSSetErrorIfStepFails: fix __FUNCT__
TS: fix for TSGetRHSMats_Private() in the creation of the Arhs and Brhs matrices
protect logging of objects (which uses global variables) with PETSC_USE_LOG
error handler API had been previously changed but this example was not updated to new API.
DMPlex: Fixed bug in coordinate permutation
PetscSection: Doc fix for permutation
Bib: Added Top500 and fixed entry
fun3d: update PetscMallocValidate() usage
bugfix of MatCreateSeqAIJFromTriple() contributed by Nicolas Marsic <nicolas.marsic@montefiore.ulg.ac.be>
bib: rename ref with duplicate key
Webpage: Corrected '-dm_mat_type cusp' to 'dm_mat_type aijcusp'.
completed removing server code that was not removed in previous commit
removed PETSc webserver and configure package files that supported it
Allow calling MatGetBlockSize[s]() before matrix preallocation
SNESLINESEARCHBT: Set the norms when exiting early due to negligible step.
fix outdated PetscOptionsList
SNESQN: only monitor real part of dot product (fails with C++ complex)
Fix for multiple definitions in mat/color/interface/ custom fortran bindings
...

Conflicts:
config/builder.py
include/petscdmplex.h
src/dm/impls/da/dageometry.c
src/dm/impls/plex/examples/tests/ex4.c
src/dm/impls/plex/plex.c
src/dm/impls/plex/plexinterpolate.c

show more ...

Merge branch 'master' into knepley/feature-fem-dgspace

* master: (593 commits)
Bib: Added Top500 and fixed entry
fun3d: update PetscMallocValidate() usage
bib: rename ref with duplicate key

Merge branch 'master' into knepley/feature-fem-dgspace

* master: (593 commits)
Bib: Added Top500 and fixed entry
fun3d: update PetscMallocValidate() usage
bib: rename ref with duplicate key
Webpage: Corrected '-dm_mat_type cusp' to 'dm_mat_type aijcusp'.
Allow calling MatGetBlockSize[s]() before matrix preallocation
SNESLINESEARCHBT: Set the norms when exiting early due to negligible step.
SNESQN: only monitor real part of dot product (fails with C++ complex)
Corrected the #include statement in the man pages for the PetscObjectComposedDataSet/Getwhatever routines.
DMPlex: Added doc for DMPlexGetHybridBounds()
winzip: detect if winzip is used to extract petsc.tar.gz and error out.
configure: remove self.archIndependent as its not being used. [it is used to create externalpackages/package/arch dir which is unused]
configure: fix packages using package-dir/PETSC_ARCH as out-of-source-build location Perhaps this should be changed to package-dir/build?
configure: remove dead code previously used to download BuildSystem
configure: check if compilerDefines [and compilerFixes] exist in framework before using them
configure: save/restore reconfigure.py when --with-clean is used
configure: add --with-clean option to delete buildfiles/externalpackages in PETSC_DIR/PETSC_ARCH and potential externalpackages in --with-external-package-dir/PETSC_ARCH
configure: With --with-externalpackages-dir=dir store/build packages in dir/PETSC_ARCH
Add MatSeqSBAIJSetPreallocationCSR()
configure: switch to using PETSC_DIR/PETSC_ARCH/externalpackages by updating package.py to use externalpackages.py as the externalPackagesDirProvider
configure: move dead code configureExternalPackagesDir() from petscdir.py to externalpackagesdir.py Also set PETSC_DIR/PETSC_ARCH/externalpackages as the externalpackagesdir
...

show more ...