This is an old revision of the document!
VSC Storage
VSC-4 and VSC-4 provide two unified facilities for data: the high-performance IBM Storage Scale Parallel Filesystem and a node-local flash storage. The parallel filesystem is the same on both clusters, so projects that exist on both clusters can access the same data. The They are accessible under:
- IBM Spectrum Scale:
$HOME
expands to /home/fs<project>/<username>,$DATA
expands to /gpfs/data/fs<project>/<username>
- Local SSD
/local
Usage ''$HOME''
$HOME
is the location of the user UNIX home directory. It can be accessed from login and compute nodes. $HOME
should be used for storing/compiling code - data for which high concurrent job throughput and support for large file sizes is not required.
Quota on $HOME
is 100GB and 10^6 number of files and can not be extended
Usage ''$DATA''
$DATA
is a tiered file system containing 500TB flash and around 1PB of HDD storage.
Quota on $DATA
is 10TB and 10^6 number of files and can be extended up to 100TB. If even more
Backup Policy
Backup of user files independent of location is solely the responsibility of each user.