Parsl

http://parsl-project.org
Parsl

Parsl

Last updated: 07 Dec 2024
1.2.0 — Released on: 13 Jan 2022
https://github.com/Parsl/parsl
https://twitter.com/ParslProject

Parsl is a flexible and scalable parallel programming library for Python. Parsl augments Python with simple constructs for encoding parallelism. Developers annotate Python functions to specify opportunities for concurrent execution. These annotated functions, called apps, may represent pure Python functions or calls to external applications. Parsl further allows invocations of these apps, called tasks, to be connected by shared input/output data (e.g., Python objects or files) via which Parsl constructs a dynamic dependency graph of tasks to manage concurrent task execution where possible.

Execution Environment

  • User Interfaces

  • Python API
  • Resource Managers

  • Slurm
  • LSF
  • PBS
  • Flux
  • GridEngine
  • HTCondor
  • AWS
  • Google Cloud
  • Kubernetes
  • Transfer Protocols

  • Globus
  • HTTP
  • FTP
  • rsync

Contributors

196   |   511   |   458   |   Apache-2.0

yadudocbencliffordannawoodardZhuozhaoLiConnorPiggdanielskatzbenhglukaszlacinskigarri1105kylechardkhk-globusWardLThategantphung3rjmellocolinthomas-z80btovarHarichandra-Prasathlgraytylern4NishchayKarledaheisecms21AymenFJAAndrew-S-Rosenrc-gitmacintoshpiekumar0022matthewc2003tjdasso