Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision | |||
doku:slurm [2024/07/11 08:52] – [Partition, quality of service and run time] grokyta | doku:slurm [2024/07/11 09:05] (current) – grokyta | ||
---|---|---|---|
Line 15: | Line 15: | ||
On VSC-4 and VSC-5, spack is used to install and provide modules, see [[doku: | On VSC-4 and VSC-5, spack is used to install and provide modules, see [[doku: | ||
+ | In order to set environment variables needed for a specific application, | ||
+ | * '' | ||
+ | * '' | ||
+ | * '' | ||
+ | * '' | ||
+ | * '' | ||
+ | * '' | ||
+ | == Note: == | ||
+ | |||
+ | - **< | ||
+ | - a list of '' | ||
+ | |||
+ | When all required/ | ||
==== Node configuration - hyperthreading ==== | ==== Node configuration - hyperthreading ==== | ||
Line 94: | Line 107: | ||
</ | </ | ||
+ | ==== Hybrid MPI/OMP: ==== | ||
+ | SLURM Script: | ||
+ | < | ||
+ | #SBATCH -N 3 | ||
+ | #SBATCH --ntasks-per-node=2 | ||
+ | #SBATCH -c 8 | ||
+ | export OMP_NUM_THREADS=8 | ||
+ | srun myhybridcode.exe | ||
+ | </ | ||
+ | **mpirun** pins processes to cores. | ||
+ | At least in the case of pure MPI processes (without any threads) the best performance has been observed with our default pinning (pinning to the physical cpus 0, 1, ..., 15). | ||
+ | If you need to use hybrid MPI/openMP, you may have to disable our default pinning including the following line in the job script: | ||
+ | < | ||
+ | unset I_MPI_PIN_PROCESSOR_LIST | ||
+ | export I_MPI_PIN_PROCESSOR_LIST=0, | ||
+ | export I_MPI_PIN_PROCESSOR_LIST=0, | ||
+ | export I_MPI_PIN_PROCESSOR_LIST=0, | ||
+ | </ | ||
+ | or use the shell script: | ||
+ | < | ||
+ | if [ $PROC_PER_NODE -gt 1 ] | ||
+ | then | ||
+ | unset I_MPI_PIN_PROCESSOR_LIST | ||
+ | if [ $PROC_PER_NODE -eq 2 ] | ||
+ | then | ||
+ | export I_MPI_PIN_PROCESSOR_LIST=0, | ||
+ | elif [ $PROC_PER_NODE -eq 4 ] | ||
+ | then | ||
+ | export I_MPI_PIN_PROCESSOR_LIST=0, | ||
+ | elif [ $PROC_PER_NODE -eq 8 ] | ||
+ | then | ||
+ | export I_MPI_PIN_PROCESSOR_LIST=0, | ||
+ | else | ||
+ | export I_MPI_PIN=disable | ||
+ | fi | ||
+ | fi | ||
+ | </ | ||
+ | See also the [[https:// | ||