Our goal is to bring the workflows community together (users, developers, researchers, and facilities) to provide community resources and capabilities to enable scientists and workflow systems developers to discover software products, related efforts, events, technical reports, etc. and engage in community-wide efforts to tackle workflows grand challenges.


Workflows Community Summit 2024
Future Trends and Challenges in Scientific Workflows
September 3—5, 2024 — Virtual (via Zoom)


Perspectives on workflows-related topics from the community

Stories

SmartSim: Combining Machine Learning and HPC Workflows

Apr 02, 2023

Matthew Ellis – HPE
Bill Scherer – HPE
Andrew Shao – HPE

The Elephant in the Data Center – Energy Consumption of Workflow Executions

Jan 13, 2023

Ulf Leser – Humboldt-Universität zu Berlin
Lauritz Thamsen – University of Glasgow

Covalent: Workflow Orchestration on Highly Heterogeneous Infrastructure

Oct 24, 2022

Will Cunningham – Agnostiq

Widening Workflows usage: the eFlows4HPC project

Sep 29, 2022

Rosa M. Badia – Barcelona Supercomputing Center

A quick overview of Nextflow workflow system

Sep 28, 2022

Paolo Di Tommaso – Nextflow creator and CTO of Seqera Labs

Workflows Education: Underlying Computer Science Concepts

May 16, 2022

Henri Casanova – University of Hawaii




See all Stories

The Workflows Community in Numbers

0 members
0 workflow systems
0 research frameworks
0 working groups
Last updated open-source workflow systems

Workflow Systems

Snakemake

This is the development home of the workflow management system Snakemake. For general information, see

Python
v8.23.1
17 Oct 2024

AiiDA

A workflow manager for computational science with a strong focus on provenance, performance and extensibility.

Python
AiiDA v2.6.2
17 Oct 2024

SmartSim

Machine learning workflows with HPC applications (Python, C++, C, and Fortran)

Python
0.8.0
17 Oct 2024

Covalent

Distributed workflows for quantum and HPC

Python
v0.235.1-rc.0
17 Oct 2024

Geoweaver

a lightweight workflow software to easily orchestrate pipelines from Python and shell scripts and preserve history of every execution

JavaScript
v1.7.6
17 Oct 2024

pyiron

A workflow manager for scientific computing on high performance computing infrastructures

python
pyiron_base-0.10.4
17 Oct 2024

Parsl

Productive parallel programming in Python

Python
1.2.0
17 Oct 2024

Nextflow

A DSL for data-driven computational pipelines

Groovy
Version 24.09.2-edge
17 Oct 2024

Merlin

Enabling Machine Learning HPC Workflows

Python
Version 1.12.2b1
17 Oct 2024

StreamFlow

Towards Cloud-HPC Continuum

Python
0.2.0.dev11
16 Oct 2024




See all Systems
Upcoming Community Events

Events

Nov 17, 2024

XLOOP 2024
Atlanta, GA, USA

Paper Submissions: Aug 19, 2024

Nov 18, 2024

WORKS 2024
Atlanta, GA, USA

Paper Submissions: Aug 08, 2024

Dec 15—Dec 18, 2024

IEEE BigData 2024
Washington DC, USA

Papers Submission: Sep 03, 2024

See all events...

0 Open Positions from the Community

Jobs



See all Jobs
Since 2021

Founding Members

Oak Ridge National Laboratory
University of Chicago
Argonne National Laboratory
University of Hawaii
University of Manchester
University of Notre Dame
Barcelona Supercomputing Center
National Energy Research Scientific Computing Center
Lawrence Berkeley National Laboratory
University of Illinois at Urbana-Champaign
Federal University of Rio de Janeiro
University of California San Diego
University of Innsbruck
Brookhaven National Laboratory
Rutgers University
University of St Andrews
Humboldt University of Berlin
Nvidia
Lawrence Livermore National Laboratory
Seqera Labs
University of Queensland, Australia
University of Freiburg
American Geophysical Union
University of Duisburg-Essen
GE Research