Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revisionBoth sides next revision
doku:python [2023/08/25 07:32] jzdoku:python [2024/02/22 16:38] katrin
Line 3: Line 3:
 Previously we recommended using spack python packages, however we decided to deprecate this approach since it is much easier and user friendly to use '''conda''' which is already widely known.  Previously we recommended using spack python packages, however we decided to deprecate this approach since it is much easier and user friendly to use '''conda''' which is already widely known. 
  
-The documentation is currently in the process of being revised. For now please either use the old information that is still available OR use the new quickstart guide below.+Have a look at the new **quickstart guide** below or the material from the python4hpc training: [[https://gitlab.tuwien.ac.at/vsc-public/training/python4hpc|python4hpc public repo]].
  
-===== (Conda) Quickstart =====+The old approach is now //deprecated// but kept on this page for reference.
  
-To install a new environment start with creating an environment yaml file and store it in a safe location (ideally in your source code repository). This step is optional but we really recommend it so you and everyone in your team is able to produce the same python environment.+===== Quickstart: Using Python with Conda ===== 
 + 
 +To install a new environmentstart with creating an **environment yaml file** and store it in a safe location (ideally in your source code repository).  
 + 
 +This step is optional but we really **recommend** it so you and everyone in your team is able to produce the same python environment. 
 + 
 +To find valid conda package names look at [[https://anaconda.org/search|Anaconda repo package search]]. 
 + 
 +Example (add your own packages below dependencies):
 <code> <code>
 name: my-env name: my-env
 +channels:
 +  - conda-forge
 +  - defaults
 dependencies: dependencies:
   - python=3.10   - python=3.10
-  - tensorflow-gpu=2.6.0+  - tensorflow=2.15.0
 </code> </code>
  
-Afterwards you can then use conda like this:+You can the install your environment by using the following commands:
  
 <code> <code>
Line 44: Line 55:
  
 #SBATCH --job-name=slurm_conda_example #SBATCH --job-name=slurm_conda_example
-#SBATCH --time 00-00:05:00+#SBATCH --time=00-00:05:00
 #SBATCH --ntasks=2 #SBATCH --ntasks=2
 #SBATCH --mem=2GB #SBATCH --mem=2GB
Line 60: Line 71:
 python --version python --version
 </code> </code>
 +
 +==== More info about Conda ====
 +
 +For more information about conda check-out the conda notebook of the python4HPC training material: [[https://gitlab.tuwien.ac.at/vsc-public/training/python4hpc/-/blob/main/D1_02_env_03_conda.ipynb|python4HPC Conda Environments]]
  
 ==== FAQ ==== ==== FAQ ====
Line 225: Line 240:
 <code> <code>
 conda install pytorch==1.13.1 torchvision==0.14.1 torchaudio==0.13.1 pytorch-cuda=11.6 -c pytorch -c nvidia conda install pytorch==1.13.1 torchvision==0.14.1 torchaudio==0.13.1 pytorch-cuda=11.6 -c pytorch -c nvidia
 +</code>
 +
 +
 +As of 2023-08-25: you can also install the current pytorch version with an older cuda version via:
 +<code>
 +conda install pytorch torchvision torchaudio cudatoolkit=11.6 -c pytorch -c nvidia
 </code> </code>
  
  • doku/python.txt
  • Last modified: 2024/03/19 14:24
  • by katrin