Submission Number: 331
Submission ID: 4851
Submission UUID: 72778b9d-ac7c-400c-9fee-d1c4d58dab4a
Submission URI: /form/resource

Created: Thu, 10/10/2024 - 08:47
Completed: Thu, 10/10/2024 - 08:50
Changed: Sat, 10/12/2024 - 18:48

Remote IP address: 103.131.14.13
Submitted by: Sanjeev Chauhan
Language: English

Is draft: No
Approved: Yes
Title: Containerized Jupyter Notebooks for HPCs
Category: Learning
Tags:
cloud (815), cloud-computing (672), openstack (208), scratch (767), data-management (260), data-reproducibility (578), github (490), workflow (365), open-ondemand (249), administering-hpc (438), configuration-automation (798), hpc-getting-started (824), hpc-tools (825), deployment (451), scripting (243), conda (227), jupyterhub (214), programming-best-practices (49), python (69), mpi (220), containers (55), docker (35), singularity (23)

Skill Level:
Intermediate (305)

Description:
This tutorial demonstrates how to create, manage, and deploy containerized Jupyter simulations for High-Performance Computing (HPC) environments, specifically using SLAC's S3DF infrastructure. By utilizing Apptainer (formerly Singularity) containers, users can package complex simulations with all necessary dependencies, input files, and configurations, ensuring reproducibility and ease of use for new users. The automated workflows, powered by GitHub Actions, handle building and updating the containers, while Open OnDemand provides an accessible interface for running Jupyter notebooks directly from the HPC environment. This approach eliminates setup errors, saves time, and ensures consistent simulation environments, enabling researchers to focus on their work instead of system configuration.

Link to Resource:
- Containerized Jupyter Notebooks for HPCs (https://hpccontainers.sanjeev.one/)

Domain:
{Empty}