Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
doku:runtime [2014/05/28 10:23] irdoku:runtime [2021/05/13 17:44] (current) – removed goldenberg
Line 1: Line 1:
-====== Specifying the maximum runtime ====== 
-The specification of the maximum runtime may render the job execution faster by reducing the time waiting in the queue.  
-=== Slot reservation for large jobs === 
-In order to ensure that large jobs are able to run on the cluster and in order to avoid blocking by many smaller jobs,the queueing system used on the VSC enables for the **reservation of slots**. 
-This feature is **automatically** activated **for any jobs requiring 16 or more slots**. 
- 
-The down side of this feature is that a certain amount of resources is unused until the total amount of slots for a queued large job is available.  
-=== Faster scheduling by backfilling === 
-In the meantime waiting for a large job to be scheduled, idle resources could be used by smaller jobs. By conserving the priorities of the jobs on top of the list, only jobs can pass which have a maximum runtime shorter than the expected time needed to free the total amount of slots requested by the large job. 
- 
-Users can profit from this process called **backfilling** by adding this on top of the job submission script: 
-<code>#### backfilling: 
-#$ -l h_rt=01:00:00    # in this example, ONE HOUR (01:00:00) is the job's maximum run time</code> 
-Here, h_rt means "hard runtime". The job will be permitted to run __at most__ this long. Please add a little **buffer of about 10-50%** to the runtime you've estimated/measured, so the job doesn't get killed before its result is available! For example, if your last job came in at 03:57:03 and you think that the next one will be pretty similar in nature, try to specify "-l h_rt=06:00:00". 
- 
-Since this feature greatly improves the use of our precious computing time by reducing the amount of idle resources, we would like to encourage you to **use the feature of maximum runtime specification**: 
-  - a lot of electricity will be saved and  
-  - the time of your jobs spent in the queue is reduced.  
  
  • doku/runtime.1401272636.txt.gz
  • Last modified: 2014/05/28 10:23
  • by ir