ursa: add arborx for UFS WM env, add oneAPI compiler modules for MPI and MKL

[rickgrubin-noaa]

This PR adds:

• arborx to the UFS WM env package recipe ufs_weather_model_env/package.py
• an entry for the oneAPI compiler module to the oneAPI MPI and MKL package specs modules section

Description

Package arborx is now added as a variant for ufs_weather_model_env, following on with the addition of kokkos and kokkos-kernels in PR #2088.

Per discussion with Ben Koziol re: CICE/CECE/CATChem components, envs were built for oneAPI and GCC with arborx, and with and without CUDA support. Testing leads to a preference for adding arborx but excluding CUDA support at this time.

Like kokkos / kokkos-kernels,arborx is added as a variant to ufs_weather_model_env/package.py (default=False) and is enabled only for ufs_weather_model_env.

arborx / kokkos / kokkos-kernels are spec'd to build with %cxx=gcc because for H100 GPUs, kokkos relies on nvcc_wrapper for CMake CUDA support, and GCC is the primary target host compiler suggested by NVIDIA, as it is known to provide broad stability. The test envs bear this out.

As well, for the backends chosen to be built for arborx and kokkos, GCC is preferred.

Comments are provided in configs/sites/tier1/ursa/packages.yaml to turn on CUDA support if desired in the future.

Lastly, for oneAPI package yaml files, an entry for the compiler is added to both the MPI and MKL specs modules section, so as to have MPI and MKL module successfully located and loaded at build time.

Dependencies

None

Issues addressed

Related to #2066 and likely closes it. See also #2110 and PR #2119

Applications affected

UFS WM

Systems affected

ursa only

Testing

• CI: Note whether the automatic tests (GitHub actions tests that run automatically for every commit) pass or not
  • GitHub actions CI tests pass
  • GitHub actions CI tests do not pass (provide explanation)
  • GitHub actions CI tests skipped (provide explanation if necessary)
• New tests added: List and describe any new tests added to GitHub actions
  • ...
• Additional testing: Add information on any additional tests conducted
  • envs created for / tested by Ben Koziol

Checklist

• This PR addresses one issue/problem/enhancement or has a very good reason for not doing so.
• These changes have been tested on the affected systems and applications.
• All dependency PRs/issues have been resolved and this PR can be merged.
• All necessary updates to the documentation (spack-stack wiki) will be made when this PR is merged