Merlin


Merlin

Merlin

Last updated: 22 Sep 2023
Version 1.10.3 — Released on: 18 Aug 2023
https://github.com/LLNL/merlin

The Merlin workflow framework targets large-scale scientific machine learning (ML) workflows in High Performance Computing (HPC) environments. Merlin is a producer-consumer workflow model that enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features are a flexible and intuitive HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for highly scalable task execution and queuing to ensembles of millions of tasks.

Contributors

20   |   100   |   12   |   MIT

ben-baykoningbgunnar5lucpetersonAlexanderWinterLLNLryannovaymubarkaKaseyNagleLLNLdependabot[bot]fixdockerrobinson96