Towards Cloud-HPC Continuum Last updated: 25 Jan 2023

Released on: 09 Oct 2022

The StreamFlow framework is a container-native Workflow Management System (WMS) written in Python 3 and based on the Common Workflow Language (CWL) open standard. It has been designed around two main principles: allow the execution of tasks in multi-container environments, in order to support concurrent execution of multiple communicating tasks in a multi-agent ecosystem, and relax the requirement of a single shared data space, in order to allow for hybrid workflow executions on top of multi-cloud or hybrid cloud/HPC infrastructures.

Project Information

Execution Environment

User Interfaces

  • CommandLine

Supported Resource Managers

  • Local
  • SSH
  • Kubernetes
  • Docker
  • Docker Compose
  • Singularity
  • PBS

Supported Transfer Protocols

  • SCP
  • WebSocket (Kubernetes)