slurm-shim: How srun Launches Tasks on Open Cluster Scheduler
A lot of AI tooling only speaks SLURM. submitit calls sbatch. jax.distributed.initialize() finds its peers through SLURM_* variables. Most multi-node PyTorch examples start with srun torchrun. On a...