Skip to main content

Breadcrumb

  1. ACCESS Home
  2. Support
  3. Knowledge Base
  4. Knowledge Base Resources

Knowledge Base Resources

Contributed by cyberinfrastructure professionals (researchers, research computing facilitators, research software engineers and HPC system administrators), these resources are shared through the ConnectCI community platform. Add resources you find helpful!
Add a Resource

Topics

  • machine-learning (50)
  • ai (43)
  • training (40)
  • data-analysis (39)
  • deep-learning (28)
  • documentation (28)
  • big-data (26)
  • neural-networks (24)
  • workforce-development (20)
  • visualization (18)
  • professional-development (17)
  • parallelization (16)
  • programming (14)
  • community-outreach (13)
  • image-processing (13)
  • cybersecurity (12)
  • gpu (12)
  • r (12)
  • pytorch (11)
  • slurm (10)
  • c (9)
  • cloud-computing (9)
  • compiling (9)
  • mpi (9)
  • plotting (9)
  • administering-hpc (8)

Programming Language

  • python (48)
  • c++ (15)
  • bash (8)

Science Domain

  • data-science (16)

Skill Level

  • intermediate (191)
  • beginner (189)
  • advanced (111)

Content Type

  • learning (91)
  • website (64)
  • documentation (57)
  • tool (34)
  • video_link (19)
  • presentation (7)
  • mailing_list (2)
  • video (1)
Practical Machine Learning with Python
0
  • Regression forecasting and predicting - Practical Machine Learning Tutorial with Python p.5
This video series provides a holistic understanding of machine learning, covering theory, application, and inner workings of supervised, unsupervised, and deep learning algorithms. It covers topics such as linear regression, K Nearest Neighbors, Support Vector Machines (SVM), flat clustering, hierarchical clustering, and neural networks. Goes over the high level intuitions of the algorithms and how they are logically meant to work. Apply the algorithms in code using real world data sets along with a module, such as with Scikit-Learn.
machine-learningprogrammingpython
0 Likes

Login to like
Type
video_link
Level
Advanced
Containerization Explained
0
  • Containerization Explained
Containerization is a software development method in which applications are packaged into standard units for development, shipment, and deployment.
containers
0 Likes

Login to like
Type
video_link
Level
Beginner
ACCESS KB Guide - Expanse
0
  • ACCESS KB Guide
Expanse at SDSC is a cluster designed by Dell and SDSC delivering 5.16 peak petaflops, and offers Composable Systems and Cloud Bursting. This documentation describes how to use the Expanse cluster with some specific information for people with ACCESS accounts.
expansecomposable-systemsgpu
0 Likes

Login to like
Type
documentation
Level
Beginner, Intermediate, Advanced
ACCESS Campus Champion Example Allocation
0
  • GitHub link to LaTeX source file and compiled PDF
ACCESS requests proposals to be written following NSF proposal guidelines. The link provides an example of an ACCESS proposal using an NSF LaTeX template. The request is at the DISCOVER level appropriate for Campus Champions. The file is 2 pages: the first page details the motivation, approach, and resources requested; and the second page is a 1-page bio.
allocations-proposalproposal-requestresearch-facilitation
0 Likes

Login to like
Type
learning
Level
Beginner
Ultimate guide to Unix
0
  • unix list of basic commands
Unix is incredibly common and useful. This website provides all the common commands and explanations for one to get started with a unix system.
bash
0 Likes

Login to like
Type
website
Level
Beginner
Discover Data Science
0
  • Discover Data Science
Discover Data Science is all about making connections between prospective students and educational opportunities in an exciting new, hot, and growing field – data science.
data-analysisworkforce-development
0 Likes

Login to like
Type
website
Level
Beginner
Implementing Markov Processes with Julia
0
  • Markov Decision Processes in Julia
The following link provides an easy method of implementing Markov Decision Processes (MDP) in the Julia computing language. MDPs are a class of algorithms designed to handle stochastic situations where the actor has some level of control. For example, used at a low level, MDPs can be used to control an inverted pendulum, but applied in higher level decision making the can also decide when to take evasive action in air traffic management. MDPs can also be extended to the partially observable domain to form the Partially Observable Markov Decision Process (POMDP). This link contains a wealth of information to show one can easily implement basic POMDP and MDP algorithms and apply well known online and offline solvers.
aimachine-learningjulia
0 Likes

Login to like
Type
tool
Level
Intermediate, Advanced
Wiki for Onboarding onto the C3DDB Cluster at MGHPCC
0
  • Github Wiki
This is a resource for researchers and students looking to on-board onto the c3ddb cluster at MGHPCC. In the code section, there are example job submission scripts for the different queues on c3ddb.
cluster-support
0 Likes

Login to like
Type
learning
Level
Beginner
Paraview UArizona HPC links (advanced)
0
  • Getting started with the paraview terminal
  • Batch headless rendering with Paraview
These links take you to visualization resources supported by the University of Arizona's HPC visualization consultant ([rtdatavis.github.io](http://rtdatavis.github.io/)). The following links are specific to the Paraview program and the workflows that have been used my researchers at the U of Arizona. These links are distinct from the others posted in the beginner paraview access ci links from the University of Arizona in that they are for more complex workflows. The links included explain how to use the terminal with paraview (pvpython), and the steps to leverage HPC resources for headless batch rendering. The batch rendering tutorial is significantly more complex than the others so if you find yourself stuck please post on the https://ask.cyberinfrastructure.org/ and I will try to troubleshoot with you.
visualization
0 Likes

Login to like
Type
documentation
Level
Intermediate, Advanced
MATLAB with other Programming Languages
0
  • Using MATLAB with Other Programming Languages
MATLAB is a really useful tool for data analysis among other computational work. This tutorial takes you through using MATLAB with other programming languages including C, C++, Fortran, Java, and Python.
cc++fortranjavamatlabpython
0 Likes

Login to like
Type
tool
Level
Beginner, Intermediate, Advanced
Python
0
  • Introduction to Python - Texas A&M
Python course offered by Texas A&M HPRC
python
0 Likes

Login to like
Type
learning
Level
Beginner
QGIS Processing Executor
0
  • QGIS processing from the command line
Running QGIS tools from the command line
gis
0 Likes

Login to like
Type
documentation
Level
Intermediate
Charliecloud User Group
0
  • Charliecloud User Group
Announcements for for users and developers of Charliecloud, which provides lightweight user-defined software stacks for high-performance computing.
containers
0 Likes

Login to like
Type
mailing_list
Level
Beginner
Master’s in Cybersecurity Degree Essentials
0
  • Master’s in Cybersecurity Degree
  • Take the lead: Find Online Cybersecurity Master’s Programs
Offers comprehensive information on various master's degree options in cybersecurity, including program details, admission requirements, and career opportunities, helping students make informed decisions about pursuing an advanced degree in cybersecurity.
resourcesprofessional-developmentcybersecurity
0 Likes

Login to like
Type
website
Level
Beginner, Intermediate, Advanced
Vulkan Support Survey across Systems
0
  • Vulkan Support Survey across Systems
  • OSF article link (easier to read)
It's not uncommon to see beautiful visualizations in HPC center galleries, but the majority of these are either rendered off the HPC or created using programs that run on OpenGL or custom rasterization techniques. To put it simply the next generation of graphics provided by OpenGL's successor Vulkan is strangely absent in the super computing world. The aim of this survey of available resources is to determine the systems that can support Vulkan workflows and programs. This will assist users in getting past some of the first hurdles in using Vulkan in HPC contexts.
anvilmatlabdarwinexpansexsedec++
0 Likes

Login to like
Type
documentation
Level
Beginner, Intermediate
TensorFlow for Deep Neural Networks
0
  • TensorFlow Docs
TensorFlow is a powerful framework for Deep Learning, developed by google. This specifically is their python package, which is easy to use and can be used to train incredibly powerful models.
documentationfastertensorflow
0 Likes

Login to like
Type
tool
Level
Intermediate, Advanced
ACCESS Getting Started Quick-Guide
0
  • Getting Started Quick-Guide
A step-by-step guide to getting your first allocation for Access computing and storage resources.
ACCESS-accountACCESS-creditsallocations-proposal
0 Likes

Login to like
Type
website
Level
Beginner
Jetstream2 Docs Site
0
  • Jetstream2 Docs Site
Jetstream2 makes cutting-edge high-performance computing and software easy to use for your research regardless of your project’s scale—even if you have limited experience with supercomputing systems.Cloud-based and on-demand, the 24/7 system includes discipline-specific apps. You can even create virtual machines that look and feel like your lab workstation or home machine, with thousands of times the computing power.
jetstream
0 Likes

Login to like
Type
documentation
Level
Beginner, Intermediate, Advanced
Samtools Documentation
0
  • https://www.htslib.org/doc/
Samtools is a suite of programs for interacting with high-throughput sequencing data, especially in the SAM/BAM format. It offers various utilities for processing, analyzing, and managing sequence data generated from next-generation sequencing (NGS) experiments. Samtools is widely used in bioinformatics and genomics research for tasks such as read alignment, variant calling, and data manipulation.
documentationdata-analysisbioinformaticsdata-sciencegenomics
0 Likes

Login to like
Type
documentation
Level
Beginner, Intermediate, Advanced
Trusted CI
0
  • Trusted CI
The mission of Trusted CI is to lead in the development of an NSF Cybersecurity Ecosystem with the workforce, knowledge, processes, and cyberinfrastructure that enables trustworthy science and NSF’s vision of a nation that is a global leader in research and innovation.
cybersecuritytraining
0 Likes

Login to like
Type
website
Level
Beginner, Intermediate, Advanced
What is fairness in ML?
0
  • Building ML models for everyone: understanding fairness in machine learning
This article discusses the importance of fairness in machine learning and provides insights into how Google approaches fairness in their ML models. The article covers several key topics: Introduction to fairness in ML: It provides an overview of why fairness is essential in machine learning systems, the potential biases that can arise, and the impact of biased models on different communities. Defining fairness: The article discusses various definitions of fairness, including individual fairness, group fairness, and disparate impact. It explains the challenges in achieving fairness due to trade-offs and the need for thoughtful considerations. Addressing bias in training data: It explores how biases can be present in training data and offers strategies to identify and mitigate these biases. Techniques like data preprocessing, data augmentation, and synthetic data generation are discussed. Fairness in ML algorithms: The article examines the potential biases that can arise from different machine learning algorithms, such as classification and recommendation systems. It highlights the importance of evaluating and monitoring models for fairness throughout their lifecycle. Fairness tools and resources: It showcases various tools and resources available to practitioners and developers to help measure, understand, and mitigate bias in machine learning models. Google's TensorFlow Extended (TFX) and What-If Tool are mentioned as examples. Google's approach to fairness: The article highlights Google's commitment to fairness and the steps they take to address fairness challenges in their ML models. It mentions the use of fairness indicators, ongoing research, and partnerships to advance fairness in AI. Overall, the article provides a comprehensive overview of fairness in machine learning and offers insights into Google's approach to building fair ML models.
aivisualizationdata-analysisdeep-learningmachine-learning
0 Likes

Login to like
Type
documentation
Level
Intermediate
Data Imputation Methods for Climate Data and Mortality Data
0
  • Data Imputation Methods for Climate Data and Mortality Data - Slices
  • Github repository
  • Data Imputation Methods for Climate Data and Mortality Data - Full Tutorial
This slices and videos introduced how to use K-Nearest-Neighbors method to impute climate data and how to use Bayesian Spatio-Temporal models in R-INLA to impute mortality data. The demos will be added soon.
allocation-valuedocumentationaiplottingvisualizationdata-analysismachine-learning
0 Likes

Login to like
Type
video_link
Level
Intermediate, Advanced
Installing Rocky Linux Operating System
0
  • Installing Rocky Linux 9
Rocky Linux is an open-source enterprise operating system. It is compatible with Red Hat Enterprise Linux (RHEL). It is a community-driven project that provides a stable and reliable platform for production workloads. It is one of the best alternatives to Opensource CentOS, since Centos will be on end of life (EoL) soon in 2024 by shifting to CentOS Stream.
unix-environmentsoftware-installation
0 Likes

Login to like
Type
learning
Level
Beginner
How to Build a Great Relationship with a Mentor
0
  • How to Build a Great Relationship with a Mentor
Emphasizes benefits of being mentored. Describes how to identify and choose a mentor. Suggests a path forward. Not mentor or two-way focused.
mentorshipprofessional-developmentworkforce-development
0 Likes

Login to like
Type
website
Level
Beginner

Pagination

  • First page « First
  • Previous page ‹‹
  • …
  • Page 3
  • Page 4
  • Page 5
  • Page 6
  • Current page 7
  • Page 8
  • Page 9
  • Page 10
  • Page 11
  • Next page ››
  • Last page Last »