This version is outdated by a newer approved version.DiffThis version (2023/10/23 10:55) is a draft.
Approvals: 0/1
The Previously approved version (2023/10/23 10:39) is available.Diff

This is an old revision of the document!


VSC-4 and VSC-4 provide two unified facilities for data: the high-performance IBM Storage Scale Parallel Filesystem and a node-local flash storage. The parallel filesystem is the same on both clusters, so projects that exist on both clusters can access the same data. They are accessible under:

  • IBM Spectrum Scale:
    • $HOME expands to /home/fs<project>/<username>,
    • $DATA expands to /gpfs/data/fs<project>/<username>
  • Local SSD
    • /local

$HOME is the location of the user UNIX home directory. It can be accessed from login and compute nodes. $HOME should be used for storing/compiling code - data for which high concurrent job throughput and support for large file sizes is not required. Quota on $HOME is 100GB and 10^6 number of files and the size can not be extended (number of files can be).

$DATA is a tiered file system containing 500TB flash and around 5PB of HDD storage. Quota on $DATA is 10TB and 10^6 number of files and can be extended up to 100TB. If even more size is needed, specific arrangements can be made.

/local is a locally mounted NVMe disk. The size is about 450GB on VSC-4 and 1.8TB on VSC-5. Data retention is not guaranteed, al data is lost on a reboot, so they need to be transferred after use.

Backup of user files independent of location is solely the responsibility of each user.

  • doku/vsc4_storage.1698058534.txt.gz
  • Last modified: 2023/10/23 10:55
  • by goldenberg