Our goal is to bring the workflows community together (users, developers, researchers, and facilities) to provide community resources and capabilities to enable scientists and workflow systems developers to discover software products, related efforts, events, technical reports, etc. and engage in community-wide efforts to tackle workflows grand challenges.


Workflows Community BoF @ SC24
Collaborative Pathways for Designing an Integrated Infrastructure for Research Excellence
November 19, 2024 — 5:15pm-6:45pm EST — Room B212


Perspectives on workflows-related topics from the community

Stories

SmartSim: Combining Machine Learning and HPC Workflows

Apr 02, 2023

Matthew Ellis – HPE
Bill Scherer – HPE
Andrew Shao – HPE

The Elephant in the Data Center – Energy Consumption of Workflow Executions

Jan 13, 2023

Ulf Leser – Humboldt-Universität zu Berlin
Lauritz Thamsen – University of Glasgow

Covalent: Workflow Orchestration on Highly Heterogeneous Infrastructure

Oct 24, 2022

Will Cunningham – Agnostiq

Widening Workflows usage: the eFlows4HPC project

Sep 29, 2022

Rosa M. Badia – Barcelona Supercomputing Center

A quick overview of Nextflow workflow system

Sep 28, 2022

Paolo Di Tommaso – Nextflow creator and CTO of Seqera Labs

Workflows Education: Underlying Computer Science Concepts

May 16, 2022

Henri Casanova – University of Hawaii




See all Stories

The Workflows Community in Numbers

0 members
0 workflow systems
0 research frameworks
0 working groups
Last updated open-source workflow systems

Workflow Systems

Snakemake

This is the development home of the workflow management system Snakemake. For general information, see

Python
v8.25.2
06 Nov 2024

StreamFlow

Towards Cloud-HPC Continuum

Python
0.2.0.dev11
06 Nov 2024

SmartSim

Machine learning workflows with HPC applications (Python, C++, C, and Fortran)

Python
0.8.0
06 Nov 2024

Nextflow

A DSL for data-driven computational pipelines

Groovy
Version 24.10.0
06 Nov 2024

Maestro Workflow Conductor

Orchestrate your HPC workflows with ease

Python
v1.1.10
05 Nov 2024

TaskVine

An execution system for large scale data intensive dynamic workflows.

Python
release/7.13.2
05 Nov 2024

pyiron

A workflow manager for scientific computing on high performance computing infrastructures

python
pyiron_base 0.10.6
05 Nov 2024

Makeflow

Makeflow is a workflow system for parallel and distributed computing that uses a language very similar to Make.

Make
release/7.13.2
05 Nov 2024

AiiDA

A workflow manager for computational science with a strong focus on provenance, performance and extensibility.

Python
AiiDA v2.6.3
05 Nov 2024

Covalent

Distributed workflows for quantum and HPC

Python
v0.235.1-rc.0
05 Nov 2024




See all Systems
Upcoming Community Events

Events

Nov 17, 2024

XLOOP 2024
Atlanta, GA, USA

Paper Submissions: Aug 19, 2024

Nov 18, 2024

WORKS 2024
Atlanta, GA, USA

Paper Submissions: Aug 08, 2024

Dec 15—Dec 18, 2024

IEEE BigData 2024
Washington DC, USA

Papers Submission: Sep 03, 2024

See all events...

0 Open Positions from the Community

Jobs



See all Jobs
Since 2021

Founding Members

Oak Ridge National Laboratory
University of Chicago
Argonne National Laboratory
University of Hawaii
University of Manchester
University of Notre Dame
Barcelona Supercomputing Center
National Energy Research Scientific Computing Center
Lawrence Berkeley National Laboratory
University of Illinois at Urbana-Champaign
Federal University of Rio de Janeiro
University of California San Diego
University of Innsbruck
Brookhaven National Laboratory
Rutgers University
University of St Andrews
Humboldt University of Berlin
Nvidia
Lawrence Livermore National Laboratory
Seqera Labs
University of Queensland, Australia
University of Freiburg
American Geophysical Union
University of Duisburg-Essen
GE Research