Table of Contents

Storage Technologies - Welcome

“Computers are like Old Testament gods; lots of rules and no mercy.” (Joseph Campbell)

<HTML> <!– “Simple things should be simple. Complicated things should be possible.” (Alan Kay) –> <!– “Computer sciene is not about machines, in the same way that astronomy is not about telescopes. […] Science is not about tools, it is about how we use them and what we find out when we do.” (Michael R. Fellows) –> </HTML>

Storage Technologies - Contents

Storage Technologies - Hardware Basics

node.jpg

Storage Technologies - Hardware Basics

Storage Technologies - Hardware Basics (II)

Storage Technologies - Direct Memory Access

Memory Hierarchy (I)

(Operating Systems, 7th Edition, W. Stallings, Chapter 1)

Memory Hierarchy (II)

Memory Hierarchy (III)

Memory Hierarchy (IV)

Memory Hierarchy (V)

Memory Access Times

Memory Access Times (II)

Memory Hierarchy (VI)

Caching

(Operating Systems, 7th Edition, W. Stallings, Chapter 1)

Storage Technologies - Cache Memory

Caching Strategies

Caching Problems

Storage Technologies - Why Caching Works --> Locality of reference

Caching - Example

int sizeX = 2000;
int sizeY = 1000;
 
int array[sizeY][sizeX];
 
// Fill the array with some data
fill_buffer(&array);
 
// Now run through the array and do something with the elements
// This runs slow in C
for (int x=0; x<sizeX, x++) {
  for (int y=0; y<sizeY; y++) {
        array[y][x] = x+2000*y;
  }
}
 
// This runs fast in C
for (int y=0; y<sizeY, y++) {
  for (int x=0; x<sizeX; x++) {
    array[y][x] = x+2000*y;
  }
}

Memory Hierarchy - Recap

Storage Technologies (I)

Storage Technologies (II)

Storage Technologies - Device Characteristics (I)

Storage Technologies - Device Characteristics (II)

Sequential I/O vs. Random I/O

Hard-Drives Overview (I)

Hard-Drives Overview (II)

Hard-Drives Characteristics

Hard-Drives Sequential Access Example

Hard-Drives Random Access Example

Quo vadis Hard-Drives

(NVMe) Solid State Drives (I)

(NVMe) Solid State Drives (II)

(NVMe) Solid State Drives - Memory (I)

(NVMe) Solid State Drives - Memory (II)

(NVMe) Solid State Drives - Memory (III)

(NVMe) Solid State Drives - Controller (I)

(NVMe) Solid State Drives - Speed (I)

(NVMe) Solid State Drives - IOPS vs. Throughput

(NVMe) Solid State Drives - Speed (II)

(NVMe) Comparison SSD vs. HDD

(NVMe) Comparison SSD vs. HDD

(NVMe) Solid State Drives - Speed (II)

Quo vadis Solid State Drives

Magnetic Tapes (I)

Magnetic Tapes - Characteristics (I)

Magnetic Tapes - Characteristics (II)

Magnetic Tapes - Characteristics (II)

Magnetic Tapes - Parallell I/O

<HTML> <!– Add Slide –> <!– Automatic parallellization of output. Tell a little bit about tape robots –> </HTML>

Magnetic Tapes - LTO

Magnetic Tapes - No random I/O

Memory Hierarchy - cont'd

Multi Tiered Storage Systems

Gaining speed and redundancy with RAID

RAID - Striping and Mirroring

RAID - Parity

RAID - Other Levels

But where are the levels 2 - 4 ?

File Management

File Management - Inodes (I)

File Management - Inodes (II)

File Management - Inodes (III)

*   sreinwal@rs ~/Work/vboxshared/sreinwal/pandoc/vsc-markdown/parallell-io/02_storage_technologies $ stat storage_technologies.md 
*   File: storage_technologies.md
*   Size: 30837         Blocks: 64         IO Block: 4096   regular file
*   Device: fd04h/64772d    Inode: 25373850    Links: 1
*   Access: (0644/-rw-r--r--)  Uid: ( 1001/sreinwal)   Gid: ( 1001/sreinwal)
*   Access: 2017-11-28 14:25:11.191823770 +0100
*   Modify: 2017-11-28 14:23:53.482827520 +0100
*   Change: 2017-11-28 14:25:20.416823325 +0100
*   Birth: -

File System - Organization (I)

(Operating Systems 7th Edition, W. Stallings, Chapter 12)

File System - Organization (II)

File System - Organization (III)

File System - Organization (IV)

(Operating Systems 7th Edition, W. Stallings, Chapter 12)

Unix File Management

Linux Virtual File System

Storage Networks - NAS vs. SAN

Distributed File Systems - NFSv4

Client Side Caching - Asynchronous I/O

Server Side Caching - NFSv4

Parallell File Systems - BeeGFS

BeeGFS - Management Server

BeeGFS - Metadata Server

BeeGFS - Metadata Server

BeeGFS - Object Storage Server

BeeGFS - Clients

Theres much more

Storage Technologies - Bibliography

Storage Technologies - The End

Thank you for your attention