This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision | |
| doku:ai_intro [2024/05/08 08:44] – Change SLURM time limit in example to 3 days mpfister | doku:ai_intro [2024/05/16 15:06] (current) – PuTTY and WinSCP instruction for jump host mpfister |
|---|
| ====== Introduction to running AI tasks on VSC ====== | ====== Introduction to running AI tasks on VSC ====== |
| |
| VSC5 is a high performance cluster that consists of different kind of nodes. If you are outside of the university network, you need to use the jump host ''vmos.vsc.ac.at'' to reach VSC. (Note: Not all users are enabled to use the jump host.) To do that, use ''ssh -J username@vmos.vsc.ac.at username@vsc5.vsc.ac.at''. When you login using SSH, you reach one of the login nodes that can be used to prepare the software environment, but that should not be used to perform any resource-intensive calculations. When you are finished preparing the software / scripts that you want to run, you submit a job file to the queue, which is later on executed on compute nodes (some of which have GPUs) once the resources become available. | VSC5 is a high performance cluster that consists of different kind of nodes. When you login using SSH, you reach one of the login nodes that can be used to prepare the software environment, but that should not be used to perform any resource-intensive calculations. When you are finished preparing the software / scripts that you want to run, you submit a job file to the queue, which is later on executed on compute nodes (some of which have GPUs) once the resources become available. |
| | |
| | If you are outside of the university network, you need to use the jump host ''vmos.vsc.ac.at'' to reach the VSC login nodes at ''vsc5.vsc.ac.at''. (Note: Not all users are enabled to use the jump host.) To do that, use ''ssh -J username@vmos.vsc.ac.at username@vsc5.vsc.ac.at''. If you are using Windows, you can use [[https://www.chiark.greenend.org.uk/~sgtatham/putty/latest.html|PuTTY]] to connect to the VSC login nodes using the following settings: |
| | |
| | {{:doku:jumphost_putty.png?1073|}} |
| | |
| | To copy files to and from VSC, you can use SFTP to connect to ''vsc5.vsc.ac.at'' and need to specify the jump host ''vmos.vsc.ac.at''. For example, using [[https://winscp.net/eng/download.php|WinSCP]], you can use these settings: |
| | |
| | {{:doku:jumphost_winscp.png?1016|}} |
| |
| At VSC5, SLURM is used as scheduler for queuing jobs. You can find an introduction to SLURM in the course material of the VSC introduction course at: | At VSC5, SLURM is used as scheduler for queuing jobs. You can find an introduction to SLURM in the course material of the VSC introduction course at: |