記憶域スペース(Storage Spaces) SSD+HDDの記憶域階層(Storage tiers)

 

記憶域スペースの記憶域階層の話

記憶域スペースではSSDとHDDを組み合わせて、SSD層とHDD層の階層構成のストレージプールを作成できます。
よく使うデータをアクセスの速いSSD層に置いて、あまり使われなくなったデータはアクセスが遅いHDD層に置いて、
見かけ上、高速で巨大なストレージを作ることができます。

個人的な記憶域階層のベストプラクティスは↓の構成

で、今回は以下の構成で構築しました。
・SSD 100GB x2 ミラー(RAID1相当)
・HDD 4TB x8 シングルパリティ(RAID5相当)
※こういうミラー+シングルパリティの階層構成がベストで需要もあると思うんだけどさっぱり情報が無い。

 

★物理ディスク確認
Get-PhysicalDisk

FriendlyName            SerialNumber         CanPool OperationalStatus HealthStatus Usage            Size
————            ————         ——- —————– ———— —–            —-
INTEL SSDSC2BP480G4     BTJR443600N8480BGN   False   OK                Healthy      Auto-Select 447.13 GB
ATA HGST HDS5C4040AL    PL1331LAGKWM4H       True    OK                Healthy      Auto-Select   3.64 TB
ATA HGST HDS5C4040AL    PL2331LAGHWG0J       True    OK                Healthy      Auto-Select   3.64 TB
HGST HMS5C4040ALE640    PL2331LAGNZZEJ       True    OK                Healthy      Auto-Select   3.64 TB
ATA HGST HDS5C4040AL    PL2331LAGJ29AJ       True    OK                Healthy      Auto-Select   3.64 TB
ATA HGST HMS5C4040AL    PL2331LAGNTAHJ       True    OK                Healthy      Auto-Select   3.64 TB
ATA HGST HMS5C4040AL    PL2331LAGNXKDJ       True    OK                Healthy      Auto-Select   3.64 TB
HGST HMS5C4040ALE640    PL2331LAGNYPTJ       True    OK                Healthy      Auto-Select   3.64 TB
HGST HMS5C4040ALE640    PL2331LAH74EUJ       False   OK                Healthy      Auto-Select   3.64 TB
ATA HGST HDS5C4040AL    PL2331LAGHVMHJ       True    OK                Healthy      Auto-Select   3.64 TB
HITACHI HUSSL4010BSS600 XSVWKL4A             True    OK                Healthy      Auto-Select  93.16 GB
Apacer AS330 120GB      FEB40766170804911819 False   OK                Healthy      Auto-Select 111.79 GB
HITACHI HUSSL4010BSS600 XSVW4P9A             True    OK                Healthy      Auto-Select  93.16 GB

 

Get-PhysicalDisk | ft FriendlyName,SerialNumber,CanPool,BusType,DeviceId,EnclosureNumber,MediaType,Size -AutoSize

FriendlyName            SerialNumber         CanPool BusType DeviceId EnclosureNumber MediaType          Size
————            ————         ——- ——- ——– ————— ———          —-
INTEL SSDSC2BP480G4     BTJR443600N8480BGN     False SATA    0                        SSD        480103981056
ATA HGST HDS5C4040AL    PL1331LAGKWM4H          True SAS     7                        HDD       4000787030016
ATA HGST HDS5C4040AL    PL2331LAGHWG0J          True SAS     9                        HDD       4000787030016
HGST HMS5C4040ALE640    PL2331LAGNZZEJ          True SATA    2                        HDD       4000787030016
ATA HGST HDS5C4040AL    PL2331LAGJ29AJ          True SAS     8                        HDD       4000787030016
ATA HGST HMS5C4040AL    PL2331LAGNTAHJ          True SAS     6                        HDD       4000787030016
ATA HGST HMS5C4040AL    PL2331LAGNXKDJ          True SAS     5                        HDD       4000787030016
HGST HMS5C4040ALE640    PL2331LAGNYPTJ          True SATA    4                        HDD       4000787030016
HGST HMS5C4040ALE640    PL2331LAH74EUJ         False SATA    1                        HDD       4000787030016
ATA HGST HDS5C4040AL    PL2331LAGHVMHJ          True SAS     10                       HDD       4000787030016
HITACHI HUSSL4010BSS600 XSVWKL4A                True SAS     12                       SSD        100030242816
Apacer AS330 120GB      FEB40766170804911819   False SATA    3                        SSD        120034123776
HITACHI HUSSL4010BSS600 XSVW4P9A                True SAS     11                       SSD        100030242816

 

★組み込み可能な全ての物理ディスクを組み込む
$Disks = Get-PhysicalDisk -CanPool $true

★プールに組み込むディスク確認
$Disks

FriendlyName            SerialNumber   CanPool OperationalStatus HealthStatus Usage           Size
————            ————   ——- —————– ———— —–           —-
ATA HGST HDS5C4040AL    PL1331LAGKWM4H True    OK                Healthy      Auto-Select  3.64 TB
ATA HGST HDS5C4040AL    PL2331LAGHWG0J True    OK                Healthy      Auto-Select  3.64 TB
HGST HMS5C4040ALE640    PL2331LAGNZZEJ True    OK                Healthy      Auto-Select  3.64 TB
ATA HGST HDS5C4040AL    PL2331LAGJ29AJ True    OK                Healthy      Auto-Select  3.64 TB
ATA HGST HMS5C4040AL    PL2331LAGNTAHJ True    OK                Healthy      Auto-Select  3.64 TB
ATA HGST HMS5C4040AL    PL2331LAGNXKDJ True    OK                Healthy      Auto-Select  3.64 TB
HGST HMS5C4040ALE640    PL2331LAGNYPTJ True    OK                Healthy      Auto-Select  3.64 TB
ATA HGST HDS5C4040AL    PL2331LAGHVMHJ True    OK                Healthy      Auto-Select  3.64 TB
HITACHI HUSSL4010BSS600 XSVWKL4A       True    OK                Healthy      Auto-Select 93.16 GB
HITACHI HUSSL4010BSS600 XSVW4P9A       True    OK                Healthy      Auto-Select 93.16 GB

 

★ストレージプール作成
New-StoragePool -FriendlyName Pool01 -PhysicalDisks $Disks -StorageSubSystemUniqueId (Get-StorageSubSystem).UniqueId

FriendlyName OperationalStatus HealthStatus IsPrimordial IsReadOnly
———— —————– ———— ———— ———-
Pool01       OK                Healthy      False        False

 

★ストレージプール確認
Get-StoragePool Pool01

FriendlyName OperationalStatus HealthStatus IsPrimordial IsReadOnly
———— —————– ———— ———— ———-
Pool01       OK                Healthy      False        False

 

★プールに組み込まれた物理ディスク確認
Get-StoragePool Pool01 | Get-PhysicalDisk | ft FriendlyName,SerialNumber,CanPool,BusType,DeviceId,EnclosureNumber,MediaType, Size -AutoSize

FriendlyName            SerialNumber   CanPool BusType DeviceId EnclosureNumber MediaType          Size
————            ————   ——- ——- ——– ————— ———          —-
ATA HGST HDS5C4040AL    PL1331LAGKWM4H   False SAS     7                        HDD       4000762036224
ATA HGST HDS5C4040AL    PL2331LAGHWG0J   False SAS     9                        HDD       4000762036224
HGST HMS5C4040ALE640    PL2331LAGNZZEJ   False SATA    2                        HDD       4000762036224
ATA HGST HDS5C4040AL    PL2331LAGJ29AJ   False SAS     8                        HDD       4000762036224
ATA HGST HMS5C4040AL    PL2331LAGNTAHJ   False SAS     6                        HDD       4000762036224
ATA HGST HMS5C4040AL    PL2331LAGNXKDJ   False SAS     5                        HDD       4000762036224
HGST HMS5C4040ALE640    PL2331LAGNYPTJ   False SATA    4                        HDD       4000762036224
ATA HGST HDS5C4040AL    PL2331LAGHVMHJ   False SAS     10                       HDD       4000762036224
HITACHI HUSSL4010BSS600 XSVWKL4A         False SAS     12                       SSD         99857989632
HITACHI HUSSL4010BSS600 XSVW4P9A         False SAS     11                       SSD         99857989632

 

※以下は設定されていたので未実施
### 物理ディスクの MediaType がセットされていなかったら設定
# Get-StoragePool Pool01 | Get-PhysicalDisk | ? [条件] | Set-PhysicalDisk -MediaType SSD
# Get-StoragePool Pool01 | Get-PhysicalDisk | ? [条件] | Set-PhysicalDisk -MediaType HDD

 

★ストレージ階層作成
Get-StoragePool Pool01 | New-StorageTier -FriendlyName SSDtier -MediaType SSD -ResiliencySettingName Mirror

ObjectId               : {1}\\YUKA\root/Microsoft/Windows/Storage/Providers_v2\SPACES_StorageTier.ObjectId=”{a39814f7-3ca6-11e7-b116-806e6f6e6963}:ST:{69e73169-0ce8-48f3-a141-6
87f04b87b23}{d4b8056d-dcdb-4171-9da4-959ee36d7d0c}”
PassThroughClass       :
PassThroughIds         :
PassThroughNamespace   :
PassThroughServer      :
UniqueId               : {d4b8056d-dcdb-4171-9da4-959ee36d7d0c}
AllocatedSize          : 0
AllocationUnitSize     : Auto
ColumnIsolation        : PhysicalDisk
Description            :
FaultDomainAwareness   : PhysicalDisk
FootprintOnPool        : 0
FriendlyName           : HDDtier
Interleave             : 262144
MediaType              : HDD
NumberOfColumns        : 8
NumberOfDataCopies     : 1
NumberOfGroups         : Auto
ParityLayout           : Rotated Parity
PhysicalDiskRedundancy : 1
ProvisioningType       : Fixed
ResiliencySettingName  : Parity
Size                   : 0
Usage                  : Data
PSComputerName         :

 

Get-StoragePool Pool01 | New-StorageTier -FriendlyName HDDtier -MediaType HDD -ResiliencySettingName Parity -numberofcolumns 8
※HDD 8台なのでnumberofcolumnsを8に設定。パリティのときこうしないとNew-VirtualDisk で最大領域確保できない。

ObjectId               : {1}\\YUKA\root/Microsoft/Windows/Storage/Providers_v2\SPACES_StorageTier.ObjectId=”{a39814f7-3ca6-11e7-b116-806e6f6e6963}:ST:{69e73169-0ce8-48f3-a141-6
87f04b87b23}{d4b8056d-dcdb-4171-9da4-959ee36d7d0c}”
PassThroughClass       :
PassThroughIds         :
PassThroughNamespace   :
PassThroughServer      :
UniqueId               : {d4b8056d-dcdb-4171-9da4-959ee36d7d0c}
AllocatedSize          : 0
AllocationUnitSize     : Auto
ColumnIsolation        : PhysicalDisk
Description            :
FaultDomainAwareness   : PhysicalDisk
FootprintOnPool        : 0
FriendlyName           : HDDtier
Interleave             : 262144
MediaType              : HDD
NumberOfColumns        : 8
NumberOfDataCopies     : 1
NumberOfGroups         : Auto
ParityLayout           : Rotated Parity
PhysicalDiskRedundancy : 1
ProvisioningType       : Fixed
ResiliencySettingName  : Parity
Size                   : 0
Usage                  : Data
PSComputerName         :

 

★仮想ディスク作成
$SSD = Get-StorageTier -FriendlyName SSDtier
$HDD = Get-StorageTier -FriendlyName HDDtier
Get-StoragePool Pool01 | New-VirtualDisk -FriendlyName VirtualDisk01  -WriteCacheSize 16GB -StorageTiers $SSD,$HDD -StorageTierSizes 80000000000,27990000000000

FriendlyName  ResiliencySettingName OperationalStatus HealthStatus IsManualAttach     Size
————  ——————— —————– ———— ————–     —-
VirtualDisk01                       OK                Healthy      False          25.53 TB

 

★仮想ディスク確認
Get-StoragePool Pool01 | Get-VirtualDisk

FriendlyName  ResiliencySettingName OperationalStatus HealthStatus IsManualAttach     Size
————  ——————— —————– ———— ————–     —-
VirtualDisk01                       OK                Healthy      False          25.54 TB

 

サイズがNGだと下記エラーとなる。
====
Get-StoragePool Pool01 | New-VirtualDisk -FriendlyName VirtualDisk01  -WriteCacheSize 16GB -StorageTiers $SSD,$HDD -StorageTierSizes 81000000000,27990000000000

New-VirtualDisk : Not Supported

Extended information:
The storage pool does not have sufficient eligible resources for the creation of the specified virtual disk.

Recommended Actions:
– Choose a combination of FaultDomainAwareness and NumberOfDataCopies (or PhysicalDiskRedundancy) supported by the storage pool.
– Choose a value for NumberOfColumns that is less than or equal to the number of physical disks in the storage fault domain selected for the virtual disk.

Activity ID: {1e41d525-928e-4591-ba76-4771fb5faa10}
発生場所 行:1 文字:26
+ … ol Pool01 | New-VirtualDisk -FriendlyName VirtualDisk01  -WriteCacheS …
+                 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo          : InvalidOperation: (StorageWMI:ROOT/Microsoft/…SFT_StoragePool) [New-VirtualDisk]、CimException
+ FullyQualifiedErrorId : StorageWMI 1,New-VirtualDisk
====

 

★ディスク確認
Get-Disk

Number Friendly Name                                                          Serial Number                    HealthStatus         OperationalStatus      Total Size Partition
Style
—— ————-                                                          ————-                    ————         —————–      ———- ———-
3      Apacer AS330 120GB                                                     FEB40766170804911819             Healthy              Online                  111.79 GB GPT
1      HGST HMS5C4040ALE640                                                         PL2331LAH74EUJ             Healthy              Online                    3.64 TB GPT
0      INTEL SSDSC2BP480G4                                                    BTJR443600N8480BGN               Healthy              Online                  447.13 GB MBR
13     VirtualDisk01                                                          {9916586f-d1b3-4062-ac72-8bc1… Healthy              Offline                  25.53 TB RAW

★ベンチマーク

フォーマット:NTFS

———————————————————————–
CrystalDiskMark 5.2.1 x64 (C) 2007-2017 hiyohiyo
Crystal Dew World : http://crystalmark.info/
———————————————————————–
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes

Sequential Read (Q= 32,T= 1) :  1007.612 MB/s
Sequential Write (Q= 32,T= 1) :   533.674 MB/s
Random Read 4KiB (Q= 32,T= 1) :   449.579 MB/s [109760.5 IOPS]
Random Write 4KiB (Q= 32,T= 1) :   251.312 MB/s [ 61355.5 IOPS]
Sequential Read (T= 1) :   808.737 MB/s
Sequential Write (T= 1) :   465.795 MB/s
Random Read 4KiB (Q= 1,T= 1) :    34.697 MB/s [  8470.9 IOPS]
Random Write 4KiB (Q= 1,T= 1) :    83.638 MB/s [ 20419.4 IOPS]

Test : 1024 MiB [Z: 0.0% (0.6/26143.1 GiB)] (x3)  [Interval=5 sec]
Date : 2017/07/01 16:48:31
OS : Windows Server 2016 Datacenter (Full installation) [10.0 Build 14393] (x64)

フォーマット:ReFs

———————————————————————–
CrystalDiskMark 5.2.1 x64 (C) 2007-2017 hiyohiyo
Crystal Dew World : http://crystalmark.info/
———————————————————————–
* MB/s = 1,000,000 bytes/s [SATA/600 = 600,000,000 bytes/s]
* KB = 1000 bytes, KiB = 1024 bytes

Sequential Read (Q= 32,T= 1) :  1007.480 MB/s
Sequential Write (Q= 32,T= 1) :   529.038 MB/s
Random Read 4KiB (Q= 32,T= 1) :   449.344 MB/s [109703.1 IOPS]
Random Write 4KiB (Q= 32,T= 1) :   250.906 MB/s [ 61256.3 IOPS]
Sequential Read (T= 1) :   789.236 MB/s
Sequential Write (T= 1) :   466.652 MB/s
Random Read 4KiB (Q= 1,T= 1) :    34.752 MB/s [  8484.4 IOPS]
Random Write 4KiB (Q= 1,T= 1) :    81.489 MB/s [ 19894.8 IOPS]

Test : 1024 MiB [Z: 0.7% (170.6/26143.1 GiB)] (x3)  [Interval=5 sec]
Date : 2017/07/01 17:48:46
OS : Windows Server 2016 Datacenter (Full installation) [10.0 Build 14393] (x64)

 

//////////////////////////
後日、追記

82%埋まっている状態でCDMを実施した結果
こんな感じに低下。
デフラグとか何もやってないんで、なんかやればもうちょっと戻るのかな。


Sequential Read (Q= 32,T= 1) :   941.088 MB/s
Sequential Write (Q= 32,T= 1) :   127.432 MB/s
Random Read 4KiB (Q=  8,T= 8) :   237.248 MB/s [  57921.9 IOPS]
Random Write 4KiB (Q=  8,T= 8) :     7.855 MB/s [   1917.7 IOPS]
Random Read 4KiB (Q= 32,T= 1) :   236.876 MB/s [  57831.1 IOPS]
Random Write 4KiB (Q= 32,T= 1) :     8.195 MB/s [   2000.7 IOPS]
Random Read 4KiB (Q=  1,T= 1) :    33.363 MB/s [   8145.3 IOPS]
Random Write 4KiB (Q=  1,T= 1) :     7.321 MB/s [   1787.4 IOPS]

Test : 1024 MiB [Z: 82.2% (21500.5/26143.1 GiB)] (x3)  [Interval=5 sec]
Date : 2018/04/14 0:27:22
OS : Windows Server 2016 Datacenter (Full installation) [10.0 Build 14393] (x64)