DAGMan for orchestrating complex workflows on HTC resources (High Throughput Computing)

Submission Number: 149
Submission ID: 3754
Submission UUID: c759dad0-d5ac-476f-aa8f-fb7fa7d9c35d
Submission URI: /form/resource

Created: Wed, 05/31/2023 - 18:58
Completed: Wed, 05/31/2023 - 18:58
Changed: Fri, 03/14/2025 - 11:43

Remote IP address: 132.170.15.255
Submitted by: Fahad Khan
Language: English

Is draft: No
Approved Yes
Title DAGMan for orchestrating complex workflows on HTC resources (High Throughput Computing)
Category Tool
Skill Level Intermediate, Advanced
Description DAGMan (Directed Acyclic Graph Manager) is a meta-scheduler for HTCondor. It manages dependencies between jobs at a higher level than the HTCondor Scheduler. It is a workflow management system developed by the High-Throughput Computing (HTC) community, specifically for managing large-scale scientific computations and data analysis tasks. It enables users to define complex workflows as directed acyclic graphs (DAGs). In a DAG, nodes represent individual computational tasks, and the directed edges represent dependencies between the tasks. DAGMan manages the execution of these tasks and ensures that they are executed in the correct order based on their dependencies. The primary purpose of DAGMan is to simplify the management of large-scale computations that consist of numerous interdependent tasks. By defining the dependencies between tasks in a DAG, users can easily express the order of execution and allow DAGMan to handle the scheduling and coordination of the tasks. This simplifies the development and execution of complex scientific workflows, making it easier to manage and track the progress of computations.
Link to Resource
Tags open-science-grid
Domain ACCESS CSSN, Campus Champions, CAREERS, CCMNet, Great Plains, Kentucky, Northeast
Would you like to associate this resource with an Affinity Group?