Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
doku:vsc5quickstart [2023/02/09 21:18] – [AMD: Zen3] goldenberg | doku:vsc5quickstart [2023/05/17 15:28] (current) – [Load a module] msiegel | ||
---|---|---|---|
Line 1: | Line 1: | ||
====== Quick start guide for VSC-5 ====== | ====== Quick start guide for VSC-5 ====== | ||
- | |||
- | **Status: 2022/04** | ||
- | |||
- | This page is under construction. | ||
===== Connecting ===== | ===== Connecting ===== | ||
Line 23: | Line 19: | ||
- | ===== Loading Modules & Spack Environments | + | ===== Software installations |
- | Different CPUs come with different compilers, so we use | + | ==== New SPACK without environments ==== |
- | the new spack feature '' | + | |
- | package. | + | |
- | On login the default '' | + | Having worked with spack environments for some time, we have encountered several severe issues which have convinced us that we need to find a more practical way of maintaining software packages at VSC. |
- | automatically, so only modules | + | |
- | with '' | + | |
- | On VSC5 no default modules | + | There are now three separate |
- | using '' | + | |
- | Find the official SPACK documentation at https:// | + | * skylake - Intel CPUs; works on Intel Skylake and Cascadelake CPUs |
+ | * zen - AMD CPUs; works on Zen 2 and 3 CPUs | ||
+ | * cuda-zen - AMD CPUs + NVIDIA GPUs; works on all nodes equipped with graphics cards | ||
- | + | By default the spack installation tree suitable for the current compute/ | |
- | ==== List Spack Environments ==== | + | |
- | + | ||
- | Type '' | + | |
- | which one is active. | + | |
< | < | ||
- | $ spack env list | + | zen [user@l51 ~]$ |
- | ==> 2 environments | + | |
- | cascadelake | + | |
</ | </ | ||
- | The current '' | + | Read more about SPACK at: |
+ | * [[doku:spack-transition | Transition to new SPACK without Environments]] | ||
+ | * [[doku:spack]] | ||
+ | * [[https:// | ||
- | < | ||
- | (zen3) [myname@l55 ~]# | ||
- | </ | ||
- | Mind that if your prompt is changed later, like when loading | + | ==== Load a module ==== |
- | environment'' | + | |
- | not be shown correctly in your prompt. | + | |
- | When a spack environment | + | Most software |
- | environment. | + | |
- | The command | + | Some software is still installed by hand, find available [[doku: |
- | spack environment. | + | |
- | ==== Change Spack Environment | + | ===== Compile |
- | + | ||
- | If you want to look for a certain package that belongs to another | + | |
- | architecture, | + | |
- | + | ||
- | <code> | + | |
- | $ spacktivate < | + | |
- | $ spacktivate cascadelake | + | |
- | </ | + | |
- | + | ||
- | Only then '' | + | |
- | + | ||
- | + | ||
- | ==== Save Spack Environment ==== | + | |
- | + | ||
- | The following creates a load script for your current spack environment | + | |
- | with all loaded modules: | + | |
- | + | ||
- | < | + | |
- | $ spack env loads -r | + | |
- | </ | + | |
- | + | ||
- | This creates a file called '' | + | |
- | directory. Sourcing that file in bash will make the environment | + | |
- | available to the user. The '' | + | |
- | '' | + | |
- | environment, | + | |
- | + | ||
- | + | ||
- | ==== Load a Module ==== | + | |
- | + | ||
- | Please always use spack, see [[doku: | + | |
- | HPC systems]]. | + | |
- | + | ||
- | + | ||
- | ===== Compile Code ===== | + | |
A program needs to be compiled on the hardware it will later run | A program needs to be compiled on the hardware it will later run | ||
Line 157: | Line 105: | ||
===== SLURM ===== | ===== SLURM ===== | ||
- | **For the exact partition/ | + | For the partition/ |
- | + | type '' | |
- | The following partitions are currently available: | + | |
- | < | + | |
- | $ sinfo -o %P | + | |
- | PARTITION | + | |
- | zen2_0256_a40x2 -> AMD CPU nodes with 2x AMD Epyc (Milan) and 2x NIVIDA A40 and 256GB RAM | + | |
- | jupyter -> reserved for the jupyterhub | + | |
- | login5 -> login nodes, not an actual slurm partition | + | |
- | zen3_2048 -> AMD CPU nodes with 2x AMD Epyc (Milan) and 2TB RAM | + | |
- | zen3_1024 -> AMD CPU nodes with 2x AMD Epyc (Milan) and 1TB RAM | + | |
- | zen3_0512* -> The default partition. AMD CPU nodes with 2x AMD Epyc (Milan) and 512GB RAM | + | |
- | cascadelake_0384 -> Intel CPU nodes with 2x Intel Cascadelake and 384GB RAM | + | |
- | zen3_0512_a100x2 -> AMD CPU nodes with 2x AMD Epyc (Milan) and 2x NIVIDA A100 and 512GB RAM | + | |
- | + | ||
- | </ | + | |
- | + | ||
- | ==== QoS ==== | + | |
- | + | ||
- | The following QoS are available for normal (=non private) projects: | + | |
- | + | ||
- | ^QOS name ^ gives access to partition ^description^ | + | |
- | | | | | + | |
- | |zen3_0512 | zen3_0512 | default | | + | |
- | |zen3_1024 | zen3_1024 | | + | |
- | |zen3_2048 | zen3_2048 | | + | |
- | |cascadelake_0384 | cascadelake_0384 | | + | |
- | |zen2_0256_a40x2 | zen2_0256_a40x2 | | + | |
- | |zen3_0512_a100x2 | zen3_0512_a100x2 | | + | |
- | |zen3_0512_devel | 5 nodes on zen3_0512 | | + | |
==== Submit a Job ==== | ==== Submit a Job ==== | ||
Line 197: | Line 116: | ||
#SBATCH -J < | #SBATCH -J < | ||
#SBATCH -N 1 | #SBATCH -N 1 | ||
- | #SBATCH --gres=gpu: | ||
./ | ./ | ||
</ | </ |