Merlin


Merlin

Merlin

Last updated: 12 Jun 2024
Version 1.12.2b1 — Released on: 12 Jun 2024
https://github.com/LLNL/merlin

The Merlin workflow framework targets large-scale scientific machine learning (ML) workflows in High Performance Computing (HPC) environments. Merlin is a producer-consumer workflow model that enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features are a flexible and intuitive HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for highly scalable task execution and queuing to ensembles of millions of tasks.

Contributors

24   |   116   |   11   |   MIT

ben-baykoningbgunnar5lucpetersonAlexanderWinterLLNLryannovaymubarkaxorJaneKaseyNagleLLNLdependabot[bot]fixdockerrobinson96