Submission information
Submission Number: 331
Submission ID: 4851
Submission UUID: 72778b9d-ac7c-400c-9fee-d1c4d58dab4a
Submission URI: /form/resource
Created: Thu, 10/10/2024 - 08:47
Completed: Thu, 10/10/2024 - 08:50
Changed: Sat, 10/12/2024 - 18:48
Remote IP address: 103.131.14.13
Submitted by: Sanjeev Chauhan
Language: English
Is draft: No
Webform: Knowledge Base Resources
Approved: Yes
Title: Containerized Jupyter Notebooks for HPCs
Category: Learning
Skill Level:
Intermediate (305)
Description:
This tutorial demonstrates how to create, manage, and deploy containerized
Jupyter simulations for High-Performance Computing (HPC) environments,
specifically using SLAC's S3DF infrastructure. By utilizing Apptainer
(formerly Singularity) containers, users can package complex simulations with
all necessary dependencies, input files, and configurations, ensuring
reproducibility and ease of use for new users. The automated workflows,
powered by GitHub Actions, handle building and updating the containers, while
Open OnDemand provides an accessible interface for running Jupyter notebooks
directly from the HPC environment. This approach eliminates setup errors,
saves time, and ensures consistent simulation environments, enabling
researchers to focus on their work instead of system configuration.
Link to Resource:
- Containerized Jupyter Notebooks for HPCs (https://hpccontainers.sanjeev.one/)
Tags:
cloud (815), cloud-computing (672), openstack (208), scratch (767), data-management (260), data-reproducibility (578), github (490), workflow (365), open-ondemand (249), administering-hpc (438), configuration-automation (798), hpc-getting-started (824), hpc-tools (825), deployment (451), scripting (243), conda (227), jupyterhub (214), programming-best-practices (49), python (69), mpi (220), containers (55), docker (35), singularity (23)
Domain:
{Empty}
Would you like to associate this resource with an Affinity Group?: {Empty}