Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Next revisionBoth sides next revision
doku:vsc4_storage [2023/10/23 10:39] – [VSC-4 Storage] goldenbergdoku:vsc4_storage [2023/10/23 10:55] – [Usage '/local'] goldenberg
Line 2: Line 2:
  
 VSC-4 and VSC-4 provide two unified facilities for data: the high-performance IBM Storage Scale Parallel Filesystem and a node-local flash storage. The parallel filesystem is the same on both clusters, so projects that exist on both clusters can access the same data.  VSC-4 and VSC-4 provide two unified facilities for data: the high-performance IBM Storage Scale Parallel Filesystem and a node-local flash storage. The parallel filesystem is the same on both clusters, so projects that exist on both clusters can access the same data. 
-The They are accessible under:+They are accessible under:
  
   * **IBM Spectrum Scale**:   * **IBM Spectrum Scale**:
Line 13: Line 13:
  
 ''$HOME'' is the location of the user UNIX home directory. It can be accessed from login and compute nodes. ''$HOME'' should be used for storing/compiling code  - data for which high concurrent job throughput and support for large file sizes is not required.  ''$HOME'' is the location of the user UNIX home directory. It can be accessed from login and compute nodes. ''$HOME'' should be used for storing/compiling code  - data for which high concurrent job throughput and support for large file sizes is not required. 
-Quota on ''$HOME'' is 100GB and 10^6 number of files and **can not** be extended +Quota on ''$HOME'' is 100GB and 10^6 number of files and the size **can not** be extended (number of files can be). 
  
 ==== Usage ''$DATA'' ==== ==== Usage ''$DATA'' ====
  
-''$DATA'' is a tiered file system containing 500TB flash and around 1PB of HDD storage.  +''$DATA'' is a tiered file system containing 500TB flash and around 5PB of HDD storage.  
-Quota on ''$DATA'' is 10TB and 10^6 number of files and can be extended up to 100TB. If even more  +Quota on ''$DATA'' is 10TB and 10^6 number of files and can be extended up to 100TB. If even more size is needed, specific arrangements can be made.  
 + 
 +==== Usage '/local' ==== 
 + 
 +/local is a locally mounted NVMe disk. The size is about 450GB on VSC-4 and 1.8TB on VSC-5. Data retention is not guaranteed, al data is lost on a reboot, so they need to be transferred after use.
  
 ==== Backup Policy ==== ==== Backup Policy ====
  • doku/vsc4_storage.txt
  • Last modified: 2023/10/23 10:58
  • by goldenberg