StreamFlow

https://streamflow.di.unito.it
StreamFlow

StreamFlow

Last updated: 05 Jan 2024
0.2.0.dev10 — Released on: 10 Oct 2023
https://github.com/alpha-unito/streamflow

The StreamFlow framework is a container-native Workflow Management System (WMS) written in Python 3 and based on the Common Workflow Language (CWL) open standard. It has been designed around two main principles: allow the execution of tasks in multi-container environments, in order to support concurrent execution of multiple communicating tasks in a multi-agent ecosystem, and relax the requirement of a single shared data space, in order to allow for hybrid workflow executions on top of multi-cloud or hybrid cloud/HPC infrastructures.

Execution Environment

  • User Interfaces

  • CommandLine
  • Resource Managers

  • Local
  • SSH
  • Kubernetes
  • Docker
  • Docker Compose
  • Singularity
  • SLURM
  • PBS
  • Transfer Protocols

  • SCP
  • WebSocket (Kubernetes)

Contributors

13   |   41   |   10   |   LGPL-3.0

GlassOfWhiskeydependabot[bot]LanderOttopaolovivianikinowslyqvsoch