Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
doku:scratch [2014/09/24 13:20] – malexand | doku:scratch [2015/03/23 09:31] (current) – dieter | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== Global parallel file system ====== | + | ===== Scratch Directories |
- | **F**raun**h**ofer **G**lobal **F**ile **S**ystem (FhGFS)\\ | + | |
- | or BeeGFS/ | + | |
- | ===== Scratch Directories ===== | + | |
In addition to $HOME, which is fine to use for standard jobs with rather few small files (<1000 files, overall size <1G), there are a number of specialized scratch directories. | In addition to $HOME, which is fine to use for standard jobs with rather few small files (<1000 files, overall size <1G), there are a number of specialized scratch directories. | ||
- | The [[http:// | + | The [[http:// |
=== Global Personal Scratch Directories $GLOBAL === | === Global Personal Scratch Directories $GLOBAL === | ||
Line 19: | Line 16: | ||
The Fraunhofer parallel file system is shared by all users and by all nodes. | The Fraunhofer parallel file system is shared by all users and by all nodes. | ||
Single jobs producing heavy load (>> | Single jobs producing heavy load (>> | ||
+ | |||
+ | Lifetime of data is limited, see table below. | ||
=== Per-node Scratch Directories $SCRATCH === | === Per-node Scratch Directories $SCRATCH === | ||
Line 71: | Line 70: | ||
| Lifetime | | Lifetime | ||
| Size || x00 TB (for all users) | | Size || x00 TB (for all users) | ||
- | | Scaling | + | | Scaling |
| Visibility | | Visibility | ||
- | | Recommended usage || large files, available after job life || large files || small files, or many seek-operations within a file || many small files (>1000), or many seek-operations within a file || | + | | Recommended usage || large files, available |