Difference between revisions of "Slurm"
Systemswiki (Talk | contribs) (→SBATCH) |
Systemswiki (Talk | contribs) (→SBATCH) |
||
Line 61: | Line 61: | ||
'''submitting a job using sbatch''' | '''submitting a job using sbatch''' | ||
− | sbatch myprogram.sh # queue job using a batch script | + | sbatch myprogram.sh # queue job using a batch script. Default partition will be used. |
sbatch --partition slurm-general-01 --account=slurmgeneral myprogram.sh # batch script specifying which partition and account when not specified within the batch script | sbatch --partition slurm-general-01 --account=slurmgeneral myprogram.sh # batch script specifying which partition and account when not specified within the batch script |
Revision as of 18:43, 28 September 2022
Slurm is an open-source job scheduler for Linux and Unix-like kernels.
SLURM Directives
SLURM directives are job options that constrain the job to the conditions specified. Directives can be identified by the syntax `#SBATCH <flag>`. Commonly used flags are listed below.
Resource | Syntax | Example | Description |
---|---|---|---|
Account | --account=<account> | --account=slurmgeneral | entity which resources are charged to. available accounts |
Partition | --partition=<partition> | --partition=slurm-general-01 | where job resources are allocated. available partitions |
Job Name | --job-name=<filename> | --job-name=testprogram | name of job to be queued |
Task | --ntask=<number> | --ntask=2 | useful for commands to be ran in parallel |
Memory | --mem=<size>[units] | --mem=1gb | memory to be allocated for job |
Output | --output=<filename> | --output=testprogram.log | name of job output file |
Time | --time= | --time=01:00:00 | time limit for job |
SRUN
srun is used to submit jobs for execution in real time. Also used to create job steps.
srun example
srun --partition slurm-general-01 --account=slurmgeneral myprogram # shell on compute node # specifying which partition and account (applicable if assigned multiple accounts)
srun myprogram.sh # shell on compute node # default partition and account is used when not specified # default partition is slurm-general
SBATCH
Sbatch is a command used to submit jobs via batch scripts to SLURM.
batch script example
#!/bin/bash -l #SBATCH --job-name=testprogram # job name #SBATCH --partition=slurm-general-01 # specifying which partition to run job on, if omitted default partition will be used (slurm-general) #SBATCH --account=slurmgeneral # only applicable if user is assigned multiple accounts #SBATCH --ntasks=1 # commands to run in parallel #SBATCH --mem=1gb # request 1gb of memory #SBATCH --output=testprogram.log # output and error log date sleep 10 module use /mnt/lmod_modules/Linux/ module load miniconda3 someProgram.py date
submitting a job using sbatch
sbatch myprogram.sh # queue job using a batch script. Default partition will be used.
sbatch --partition slurm-general-01 --account=slurmgeneral myprogram.sh # batch script specifying which partition and account when not specified within the batch script
Compute Resources
The ODU CS department HPC cluster is comprised of multiple partitions where users can submit jobs. Each partition can only be accessed by users who are assigned to the partitions respective account. Not all partitions can be accessed by all users.
Cluster | Partition | Account |
---|---|---|
slurm-cluster | slurm-general-01 | slurmgeneral |
slurm-cluster | slurm-general-02 | slurmgeneral |
slurm-cluster | haoresearch | shaoresearch |
slurm-cluster | lusiliresearch | lliresearch |
slurm-cluster | wangresearch | fwangresearch |
Troubleshooting
How to view assigned account
sacctmgr show association -p user=$username