SC19 Proceedings

The International Conference for High Performance Computing, Networking, Storage, and Analysis

Extreme-Scale Scientific Software Stack (E4S)

Authors: Sameer Shende (University of Oregon), Michael Heroux (Sandia National Laboratories), James Willenbring (Sandia National Laboratories), Todd Gamblin (Lawrence Livermore National Laboratory), Andrew Younge (Sandia National Laboratories), Todd Munson (Argonne National Laboratory)

Abstract: The Extreme-Scale Scientific Software Stack (E4S) is a community effort to provide open source software packages for developing, deploying, and running scientific applications on HPC platforms. It provides both source builds as well as container images of a broad collection of HPC software packages. This E4S BoF will provide an update of the current state of the software stack and discuss plans for the future with the wider supercomputing community.

Long Description: The DOE Exascale Computing Project (ECP) Software Technology focus area is developing an HPC software ecosystem that will enable the efficient and performant execution of exascale applications. Through the Extreme-scale Scientific Software Stack (E4S), it is developing a comprehensive and coherent software stack that will enable application developers to productively write highly parallel applications that can portably target diverse exascale architectures. E4S provides both source builds through the Spack platform and a set of containers that feature a broad collection of HPC software packages. E4S exists to accelerate the development, deployment, and use of HPC software, lowering the barriers for HPC users. It provides container images, build manifests, and turn-key, from-source builds of popular HPC software packages developed as Software Development Kits (SDKs). This effort includes a broad range of areas including programming models and runtimes (MPICH, Kokkos, RAJA, OpenMPI), development tools (TAU, HPCToolkit, PAPI), math libraries (PETSc, Trilinos), data and visualization tools (Adios, HDF5, Paraview), and compilers (LLVM), all available through Spack, the underlying software delivery platform.

The BoF will feature brief updates from software technology projects including the use of container technology and plans for deployment of the software stack. First, The session will describe the curation process using Spack and community engagements and interactions that led to the many artifacts produced by E4S. The introduction will also briefly introduce the E4S containers are being deployed at the HPC systems at DOE national laboratories using Singularity (ALCF, LLNL, ORNL, Sandia), Shifter (NERSC), and Charliecloud (LANL) HPC container runtimes. Furthermore, the session leaders will detail their initial plans for Continuous Integration and how such pieces fit into a larger effort of software curation for Exascale computing, and beyond.

Following the introduction, the session will open up to larger audience participation and an interactive group discussion. This will present a unique opportunity to engage with several ECP software projects, develop research collaborations, and learn more about the current state and future plans for the software stack. During this time, the wider audience will have an opportunity to provide their input to the E4S developers on future focus areas and points of special interest within the software stack. Following the BoF, the session leaders will coalesce the audience and session leader interactions with a summary report, which will be circulated to the wider community and appropriate mailing lists.


Back to Birds of a Feather Archive Listing