TaskVine

http://ccl.cse.nd.edu
TaskVine

TaskVine

Last updated: 17 May 2024
release/7.11.0 — Released on: 10 May 2024
https://github.com/cooperative-computing-lab/cctools

TaskVine is a system building large scale data intensive dynamic workflows that run on HPC clusters, GPU clusters, and commercial clouds. As tasks access external data sources and produce their own outputs, more and more data is pulled into local storage on workers. This data is used to accelerate future tasks and avoid re-computing exisiting results. Data gradually grows "like a vine" through the cluster. TaskVine can serve as an execution for other workflow systems such as Parsl and Dask.

Contributors

111   |   125   |   145   |   NOASSERTION

btovardthaintshaffe1nhazekamdpandiarpbuihaiyanmengrampantmonkeylyu2nkremerhstorelordcolinthomas-z80tphung3cshinaverBarrySlyDelgadocharleszheng44David-Simonetti-NDbatricksghuang19epyifanyrenemeJosephDuggan7jmrundlejblomerJinZhou5042bwiseman77andreytobenjaminlyonsnicklocascio45NeilB879