About this Event
In scientific computing disciplines such as bioinformatics, computational biology, and other data-intensive fields, many tools and workflows remain serial in nature. Running a large number of these independent jobs efficiently on a multi-core HPC platform can be challenging.
This training will introduce two powerful approaches for handling such workloads namely GNU Parallel and SLURM Job Arrays. This training session covers efficient execution and management of large collections of independent or parameter-sweep tasks using GNU Parallel and SLURM Job Arrays, leveraging both single-node and multi-node HPC environments for scalable, high-throughput processing. Through hands-on, real-world examples, we will demonstrate how to launch, monitor, and optimize massive batches of serial or lightweight jobs using GNU Parallel and SLURM Job Arrays, highlighting their similarities, differences, and best-use scenarios.
Prerequisites: Basic knowledge of HPC environment and Linux is preferred but not required.
0 people are interested in this event
Register with the link. Streaming instruction will be shared via email on the day before the training.
https://forms.cloud.microsoft/Pages/ResponsePage.aspx?id=P61NLa5Q2UeDoJrisfRm-Gquet-W2uBIu1blHkiYGj1UN1UwOUtHSDRIRVFaTEMxNUo3UVJFWUwwUi4u
User Activity
No recent activity