Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
doku:python [2024/02/22 08:59] – katrin | doku:python [2024/03/19 14:24] (current) – katrin | ||
---|---|---|---|
Line 38: | Line 38: | ||
# create your environment via environment file | # create your environment via environment file | ||
# this will place the environment in your ~/ | # this will place the environment in your ~/ | ||
- | # note: make sure to use "conda >env< create" | + | # note: |
- | (base) $ conda env create | + | # - make sure to use "conda >env< create" |
+ | # - the name is taken from the yaml file; a custom name can be specified with "-n my-custom-name" | ||
+ | (base) $ conda env create --file my_env.yaml | ||
# after creation you can activate the environment to run code in it | # after creation you can activate the environment to run code in it | ||
Line 55: | Line 57: | ||
#SBATCH --job-name=slurm_conda_example | #SBATCH --job-name=slurm_conda_example | ||
- | #SBATCH --time 00-00:05:00 | + | #SBATCH --time=00-00:05:00 |
#SBATCH --ntasks=2 | #SBATCH --ntasks=2 | ||
#SBATCH --mem=2GB | #SBATCH --mem=2GB | ||
Line 72: | Line 74: | ||
</ | </ | ||
- | ==== More info about Conda ==== | + | ===== More info about Conda ===== |
For more information about conda check-out the conda notebook of the python4HPC training material: [[https:// | For more information about conda check-out the conda notebook of the python4HPC training material: [[https:// | ||
- | ==== FAQ ==== | + | ===== FAQ ===== |
* **''' | * **''' | ||
Line 82: | Line 84: | ||
Make sure to use the currently provided ''' | Make sure to use the currently provided ''' | ||
- | * **I dont get the right python version and packages** / **I see the error ''' | + | * **I dont get the right python version and packages in my slurm batch file environment** - **What is wrong>? |
- | The default for sbatch is to use the current user environment | + | Make sure that one of the first things in your sbatch |
+ | |||
+ | * **I don't get GPU/CUDA enabled packages when installing a conda environment** / **I get conda installation errors when i select GPU/CUDA enabled builds for my conda environment*** | ||
+ | |||
+ | In order to install packages | ||
+ | < | ||
+ | name: my-pytorch-gpu-env | ||
+ | channels: | ||
+ | - pytorch | ||
+ | - conda-forge | ||
+ | - defaults | ||
+ | dependencies: | ||
+ | - python=3.12 | ||
+ | - pytorch=2.2.*=*cuda11.8* | ||
+ | </ | ||
+ | |||
+ | < | ||
+ | # for example if you use cuda 11.8 | ||
+ | CONDA_OVERRIDE_CUDA=" | ||
+ | </ | ||
- | Alternatively you can also use sbatch with the ''' | ||
====== Deprecated Information (work in progress) ====== | ====== Deprecated Information (work in progress) ====== |