StreamFlow

StreamFlow

Towards Cloud-HPC Continuum
https://streamflow.di.unito.it Last updated: 15 Sep 2022

0.2.0.dev1
Released on: 28 Aug 2022

The StreamFlow framework is a container-native Workflow Management System (WMS) written in Python 3 and based on the Common Workflow Language (CWL) open standard. It has been designed around two main principles: allow the execution of tasks in multi-container environments, in order to support concurrent execution of multiple communicating tasks in a multi-agent ecosystem, and relax the requirement of a single shared data space, in order to allow for hybrid workflow executions on top of multi-cloud or hybrid cloud/HPC infrastructures.

Project Information

Execution Environment

User Interfaces

  • CommandLine

Supported Resource Managers

  • Local
  • SSH
  • Kubernetes
  • Docker
  • Docker Compose
  • Singularity
  • SLURM
  • PBS

Supported Transfer Protocols

  • SCP
  • WebSocket (Kubernetes)