Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
doku:vsc3_global_quotas [2018/11/07 07:55] – [Note: 7.11.2018] jzdoku:vsc3_global_quotas [2021/08/23 08:51] (current) – removed goldenberg
Line 1: Line 1:
-==== Quotas on $GLOBAL ==== 
-Quotas are enforced in the ''$GLOBAL'' filesystem to avoid storage problems because of full fileservers. They are set on a per project basis and each project initially gets 500GiB of free space and the possibility to create 100'000 files.  
- 
-==== Checking Quotas ==== 
-A user can check his quota with the beegfs-ctl command. 
-<code> 
-beegfs-ctl --getquota --gid ProjectNumber 
-</code> 
-Yields the following output: 
-<code> 
-      user/group     ||           size          ||    chunk files     
-     name      id  ||    used    |    hard    ||  used    hard    
---------------|------||------------|------------||---------|--------- 
-   ProjectName| xxx  ||   18.08 GiB|  500.00 GiB||     2178|100000 
-</code> 
- 
-The 3rd and 4th column show the used space and the total available space. 
- 
-The 5th and 6th column show the number of files created and the maximum amount of files allowed for the project. 
- 
-If a user hits one of these two limits he will be blocked from writing on the storage. Deleting files will unblock the user after a maximum of 10 minutes. 
- 
-==== Increasing Quotas ==== 
-As long as there is free space on ''$GLOBAL'' users can apply for more storage space via email to the service email address. The 'Fair use' policy introduced with the commissioning of VSC-3 is still valid, quotas are just to make sure, that no one interferes with the jobs of others. 
-==== Pitfalls ==== 
- 
-Quotas are checked every 10 minutes. If a user deletes files because he was over quota it can take up to ten minutes until he gets allowed to write on the storage again. 
- 
-The number of chunkfiles displayed can be up to 4 times higher than the actual amount of files stored on the filesystem. This is because big files will be stored distributed on up to 4 storage targets. 
- 
-==== Note: 7.11.2018 ==== 
- 
-In order for qutoa enforcement to work it is apparently necessary that user and group IDs are known on the storage servers. Therefore the ''/etc/nslcd.conf'' has to be proper and the service needs to be running. 
- 
-Currently we have the following beegfs versions in operation: 
- 
- 
-^ ^  version  
-| Storage server |  6.18  | 
-| VSC-3 nodes    6.17  | 
-| VSC-3 plus nodes |  6:19  | 
- 
  
  • doku/vsc3_global_quotas.1541577331.txt.gz
  • Last modified: 2018/11/07 07:55
  • by jz