Merlin


Merlin

Merlin

Last updated: 27 Feb 2024
Version 1.12.0 — Released on: 15 Feb 2024
https://github.com/LLNL/merlin

The Merlin workflow framework targets large-scale scientific machine learning (ML) workflows in High Performance Computing (HPC) environments. Merlin is a producer-consumer workflow model that enables multi-machine, cross-batch job, dynamically allocated yet persistent workflows capable of utilizing surge-compute resources. Key features are a flexible and intuitive HPC-centric interface, low per-task overhead, multi-tiered fault recovery, and a hierarchical sampling algorithm that allows for highly scalable task execution and queuing to ensembles of millions of tasks.

Contributors

23   |   115   |   10   |   MIT

ben-baykoningbgunnar5lucpetersonAlexanderWinterLLNLryannovaymubarkaKaseyNagleLLNLxorJanedependabot[bot]fixdockerrobinson96