Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
doku:vsc3_storage [2021/05/13 18:05] goldenberg [Backup Policy] |
doku:vsc3_storage [2021/08/23 08:52] (current) goldenberg [Quotas] |
||
---|---|---|---|
Line 24: | Line 24: | ||
- | ==== Scratch Space Usage: '' | ||
- | **This is decommissioned and no longer available** | ||
- | |||
- | The [[http:// | ||
- | |||
- | < | ||
- | $ echo $GLOBAL | ||
- | / | ||
- | </ | ||
- | |||
- | The directory is writeable as user and readable by the group members. It is advisable to make use of these directories in particular for jobs with heavy I/O operations. In addition it will reduce the load on the fileserver holding the $HOME directories. | ||
- | |||
- | The BeeGFS (former Fraunhofer parallel file system) is **shared by all users and by all nodes**. | ||
- | Single jobs producing heavy load (>> | ||
- | |||
- | Lifetime of data is limited, see table below. | ||
- | |||
- | |||
- | === Per-node Scratch Directories '' | ||
- | |||
- | Local scratch directories on each node are provided as a link to the BeeGFS parallel file system and can thus be viewed also via the login nodes as '''/ | ||
- | The parallel file system (and thus the performance) is identical between $SCRATCH and $GLOBAL. | ||
- | The variable '' | ||
- | < | ||
- | $ echo $SCRATCH | ||
- | /scratch | ||
- | </ | ||
- | These directories are purged after job execution. | ||
==== Usage Local Scratch RAM Disk $TMPDIR ==== | ==== Usage Local Scratch RAM Disk $TMPDIR ==== | ||
Line 63: | Line 35: | ||
</ | </ | ||
- | \\ | ||
- | ==== Comparison of scratch directories ==== | ||
- | |||
- | | || '' | ||
- | | Recommended file size || large || large || small || | ||
- | | Lifetime | ||
- | | Size || x00 TB (for all users) | ||
- | | Scaling | ||
- | | Visibility | ||
- | | Recommended usage || large files, available temporarily after job life || large files || many small files (>1000, or many seek-operations within a file || | ||
\\ | \\ | ||
Line 80: | Line 42: | ||
Storage extensions can be requested through [[https:// | Storage extensions can be requested through [[https:// | ||
- | |||
- | Since 2017-06-02 quotas are enforced for the '' | ||
==== Fair Use ==== | ==== Fair Use ==== |