Merge pull request #1300 from CEED/sjg/hcurl-hdiv-basis-cuda-hip

H(div) and H(curl) basis support for `cuda-ref` and `hip-ref` backends

H(div) and H(curl) basis support for cuda-ref and hip-ref backends

Non-square operator full assembly (#1316)

* Consistency formatting for operator tests

* Add (failing) test for non-square operator full assembly

* Add support for CPU-based full assembly of no

Non-square operator full assembly (#1316)

* Consistency formatting for operator tests

* Add (failing) test for non-square operator full assembly

* Add support for CPU-based full assembly of non-square CeedOperators

* Fix full assembly of identity quadrature functions and operators with CEED_BASIS_NONE

Also adds a unit test for full assembly which fails prior to the changes in this commit.

* Minor refactor to improve coverage

show more ...

Merge pull request #1315 from CEED/jeremy/queep

Backend Consistency Fixes

style - fixes for CUDA backends

Merge pull request #1320 from CEED/jeremy/jit-header-guards

style - fix header guards

style - fix header guards

Merge pull request #1299 from CEED/sjg/cuda-hip-backends-consistency

Style fixes for `cuda` and `hip` backend consistency

Whitespace, style, and formatting updates for consistency between CUDA and HIP backends

Adds include guards in JiT header files, even if not strictly necessary, to match the precedent set in cuda-sh

Whitespace, style, and formatting updates for consistency between CUDA and HIP backends

Adds include guards in JiT header files, even if not strictly necessary, to match the precedent set in cuda-shared and hip-shared as well as sycl.

show more ...

Merge pull request #1292 from CEED/sjg/gpu-rstr-unify

Unify `magma` backend restriction with `cuda-ref` and `hip-ref`

Unify magma backend restriction with cuda/hip-ref, keeping runtime option for deterministic and non-deterministic using magma/det

This also opens the opportunity to make cuda/hip-ref non-determinist

Unify magma backend restriction with cuda/hip-ref, keeping runtime option for deterministic and non-deterministic using magma/det

This also opens the opportunity to make cuda/hip-ref non-deterministic by default and add cuda/hip-ref/det variants.

show more ...

Merge pull request #1265 from CEED/sjg/hcurl-restr-dev

CeedElemRestriction for H(curl)

Improve element restriction for H(curl) spaces by reorganizing loops, including use of int8_t for tridiagonal matrix

Update backends for unified ElemRestrictionCreate variants for all restriction types (default, oriented, strided)

Merge pull request #1231 from CEED/jeremy/consistency

Consistency fixes

gpu - naming consistency fixes

Merge pull request #1202 from CEED/jeremy/const-fix

Clean up backend headers for const and argument names

minor - fix static vs CEED_INTERN in backend file

minor - clean up backend headers for const and argument names

Merge pull request #1198 from CEED/jeremy/CeedCheck

Add CeedCheck macro to reduce repetition

internal - add CeedCheck macro to reduce repetition

IWYU fixes (#1182)

* iwyu - include fixes

* iwyu - silence some iwyu output

* minor - clearer macro names

* iwyu - fix suggestion of "ceed/ceed.h" externally

* iwyu - lighter petsc heade

IWYU fixes (#1182)

* iwyu - include fixes

* iwyu - silence some iwyu output

* minor - clearer macro names

* iwyu - fix suggestion of "ceed/ceed.h" externally

* iwyu - lighter petsc headers

* iwyu - ceed/ceed.h -> ceed.h

* iwyu - cuda/hip include fixes

show more ...

Switch to clang-format (#1051)

* style - switch to clang-format

* ci - use newer libxsmm

* action - update format action

* format - consistent use of {} for multi-line if/for

* make - re

Switch to clang-format (#1051)

* style - switch to clang-format

* ci - use newer libxsmm

* action - update format action

* format - consistent use of {} for multi-line if/for

* make - remove stray newline

* make - simpler 'make format' target

* ci - use newer libxsmm

* doc - minor release note claification

* minor - minor fix

* minor - minor fix

* minor - minor fix

* minor - minor fix

* make format

* format - less aggressive alignment rules

* tidy - check for argument name mismatches

* fix newline

* format - mirror Ratel update to .clang-format

* fix merge error

* fix merge conflict

* fix merge error

* drop style in .phony list

* Update .clang-format

Co-authored-by: Jed Brown <jed@jedbrown.org>

* apply updated format

Co-authored-by: Jed Brown <jed@jedbrown.org>

show more ...

Refactor `cuda-gen` and `hip-gen` backends. (#1050)

* Add TODO items.

* rough, but something like this?

* wip - cleaning up some warnings, but more remain

* wip - reorganize

* wip - miss

Refactor `cuda-gen` and `hip-gen` backends. (#1050)

* Add TODO items.

* rough, but something like this?

* wip - cleaning up some warnings, but more remain

* wip - reorganize

* wip - missing kernels

* wip - replace t1d

* fix some kernels

* another typo

* more

* another one

* closer

* define T_1D

* typosgit add .!

* WIP: changes to cuda-shared framework for new kernels

* fix output writing

* buffer fix

* buffer sizes

* WIP: fixes for 2 and 3D basis kernels

* minor

* fix weight kernel for 3d

* remove debugging output

* minor reorg

* fix includes

* enable collo grad for cuda-shared

* move quoted kernels

* renaming

* missed a rename

* small fix

* more naming consistency

* faster 'useCollograd=false' path in *-gen

* more style

* one last style fix

* clearer collograd condition

* Add gen basis kernels to hip-shared

* Try some changes to hip-shared basis block sizes for new kernels

* cuda - drop extra kernel arg

* cuda - fix collograd check logic

* update gen comment about parallelization

* tidy up fields struct definition

* tidy up structs even more

* Update hip-gen basis templates use and move other hip-gen device functions to jit-source

* Finish hip-gen basis template update; small style updates to match CUDA

* missing isStrided

* Update block size used in 3D weight for new shared kernels

* update release notes

Co-authored-by: Jeremy L Thompson <jeremy@jeremylt.org>
Co-authored-by: nbeams <246972+nbeams@users.noreply.github.com>

show more ...

Merge pull request #977 from CEED/jeremy/fallback-yet-again

Add debugging output to fallback creation