Makeflow

Makeflow

Makeflow is a workflow system for parallel and distributed computing that uses a language very similar to Make.

Last updated: 25 Jun 2025     |     Release: devel

Makeflow is a workflow engine for large scale distributed computing. It accepts a specification of a large amount of work to be performed, and runs it on remote machines in parallel where possible with support to several batch systems (e.g., HTCondor, SLURM, PBS, and Work Queue among others). It is fault-tolerant, so you can use it to coordinate very large tasks that may run for days or weeks in the face of failures. Makeflow is designed to be similar to Make , so if you can write a Makefile, then you can write a Makeflow.

Terminology
Terminology below follows the definitions established by the Workflows Community Terminology.

Characteristics
Flow
Data
Granularity
Sub-workflows
Coupling
Loose
Domain
Agnostic
Composition
Description
Standard (Make)
Abstraction
Abstract
Modularity
Hierarchical
Orchestration
Planning
Static
Execution
Runner
Data Management
Transport
File-based
Storage
Shared
Replicated
Metadata Capture
Anomaly Detection
Monitoring
Provenance
Extensions
Distributed Storage
HPC Execution

Terminology
Terminology below follows the definitions established by the Workflows Community Terminology.

Characteristics
Flow
Task
Iterative
Granularity
Functions
Executables
Coupling
Loose
Domain
Agnostic
Composition
Description
API
Abstraction
Intermediate
Modularity
Flat
Orchestration
Planning
Dynamic
Execution
Resource Manager
Data Management
Transport
File-based
Storage
Shared
Distributed
Replicated
Metadata Capture
Anomaly Detection
Monitoring
Provenance
Extensions
Serverless
Autoscaling
HPC Execution
Recoverable Storage