Jetstream2 LM

Jetstream2 LM is a cloud VM service consisting of on-demand high-memory virtual machines in two flavors, r3.large at 64 vCPUs and 500 GB RAM and r3.xl at 128 vCPUs and 1000 GB RAM. It is particularly well suited for workloads that need more RAM than a standard CPU flavor provides, and is often used for high-RAM analytics, genomics, graph processing, and in-memory databases. It includes whatever software you install, alongside the Jetstream2 software collection.

Submitting Jobs Documentation

Jetstream2 LM is a cloud virtual-machine resource, not a centrally scheduled Slurm cluster. There is no shared login node and no Slurm queue, partition, sbatch, srun, or squeue workflow. Slurm commands apply only if your project separately deploys and administers its own virtual cluster.

Select an r3.large or r3.xl flavor, create a VM, and connect through Web Shell, Web Desktop, or SSH. Only r3.* flavors should be used on this resource. Applications run directly inside the VM, and you install software with the operating system's package manager, Python environments, containers, or the Jetstream2 software collection.

An active instance consumes service units even when no application is running. Shelve an instance when you are not using it; a shelved instance consumes zero compute SUs.

See [Jetstream2 Instance Flavors] and [Jetstream2 Instance Management and SU Conservation].

Queue specifications

Queue	CPU cores / node	Num nodes	Node RAM
Indiana Jetstream2 Large Memory Large-memory virtual machine flavors; not a Slurm partition	AMD Milan 7713 (128 cores)	32	1024 GB

Software

The following software is reported as available on Jetstream2 LM by the Software Documentation Service.

Available Software

Application	Description	Research Discipline
anaconda	Anaconda is a free and open-source distribution of Python and R programming languages for scientific computing, that aims to simplify package management and deployment.	Computer and Information Sciences
aocc	The AMD Optimizing C/C++ Compiler (AOCC) is a high performance compiler suite with support for C, C++, and Fortran programming languages.	Computer & Information Sciences
apptainer	Apptainer is a tool for creating and managing containerized applications in a simplified and efficient manner. It provides a user-friendly interface for developers and system administrators to package, distribute, and deploy applications using containerization technology.	Engineering & Technology
intel compiler	The Intel Compiler is a suite of high-performance compilers from Intel for various programming languages, including C, C++, and Fortran. It is designed to maximize application performance on Intel architecture-based processors.	Computer & Information Sciences
nvhpc	NVIDIA HPC SDK is a comprehensive, integrated suite of compilers, libraries, and tools for the development and optimization of GPU-accelerated high-performance computing (HPC) applications.	Computer & Information Sciences
r	R is a free software environment for statistical computing and graphics. It compiles and runs on a wide variety of UNIX platforms, Windows, and MacOS.	Computer Science
rstudio	RStudio is an integrated development environment (IDE) for R, a programming language and environment widely used for statistical computing and graphics. RStudio provides an intuitive and productive user interface for R, allowing users to efficiently write, execute, and debug R code.	Other Natural Sciences
xalt	XALT (XALT Accounting for Loadable and Transient Objects) is a tool designed to track the detailed usage of HPC systems by monitoring library dependencies and executables during job executions. It captures information on modules, compilers, libraries, and executables used in each job, providing detailed insights into the software stack and usage patterns on the HPC system.	Engineering & Technology

Storage Documentation

Jetstream2 provides cloud storage associated with virtual machine instances rather than a traditional shared HPC filesystem. Instances may use ephemeral or volume-backed root disks. Data on an ephemeral root disk is permanently removed when the instance is deleted; retention of a volume-backed root disk depends on the instance's delete-volume setting.

Persistent storage options include block volumes, OpenStack Manila file shares, and S3-compatible object storage. Volumes can be attached to one instance at a time, Manila shares can be mounted by multiple instances, and object storage can be accessed through S3-compatible tools or HTTP. All Jetstream2 allocations receive 1 TB (1000 GB) of storage quota by default; additional storage can be requested through the Indiana Jetstream2 Storage resource.

File Transfer Documentation

Jetstream2 does not use dedicated data transfer nodes. Files are transferred directly to and from VM instances or through web-based and managed transfer tools.

Common methods include the Exosphere web shell/web desktop file-transfer interface, SCP/SFTP to a VM with a public IP address, and Globus for larger or managed transfers. See the Jetstream2 File Transfer documentation for current guidance.

Supported Methods	Data Transfer Node / Globus Collection	Notes
GLOBUS \| RECOMMENDED		https://www.globus.org/data-transfer
SCP
SFTP

Login to Jetstream2 LM Documentation

2FA/MFA required for login

Jetstream2 Large Memory is accessed primarily through the Exosphere web interface. Users do not create a separate Jetstream2-specific user account. They need an ACCESS account and must be the PI of, or be added to, an active allocation that includes Indiana Jetstream2 Large Memory. Access to Jetstream2 CPU does not automatically provide access to the Large Memory resource.

In Exosphere, select Add allocation, choose Add ACCESS Account, select ACCESS CI (XSEDE) as the CILogon identity provider, sign in with ACCESS credentials, and select the allocation containing the Large Memory resource. ACCESS uses Duo for multi-factor authentication. Users who need to enroll in Duo or manage their authentication devices should follow the ACCESS Duo MFA instructions.

Jetstream2 does not provide a shared SSH login node. Users must first create a Large Memory virtual machine in Exosphere. To create an SSH key pair on a local Linux, macOS, or Windows OpenSSH system, run ssh-keygen -o -a 100 -t ed25519 -C "descriptive-label" -f ~/.ssh/id_ed25519. During instance creation, open the advanced options and select or upload the generated public key, normally ~/.ssh/id_ed25519.pub. Only the public key should be uploaded; the private key must not be shared.

Assign the instance a public IP address when direct SSH access is required. Exosphere-created instances use the exouser account. Connect with ssh -i ~/.ssh/id_ed25519 exouser@<PUBLIC_IP>. Users may alternatively connect through Exosphere Web Shell or Web Desktop.

Logging in to Jetstream2