s2d
19 TopicsSqueezing hyper-convergence into the overhead bin, for barely $1,000/server: the story of Project Kepler-47
First published on TECHNET on Oct 14, 2016 [caption id="attachment_7045" align="aligncenter" width="879"] This tiny two-server cluster packs powerful compute and spacious storage into one cubic foot.11KViews0likes1CommentServer 2019: Ppor Storage Spaces Direct (S2D) Performance
Hello, I am trying to setup a two-node cluster for S2D for hyperconverged infrastructure. I am underwhelmed by the performance when compared with storage performance when the drives are not part of an S2D cluster and some older hardware we have on hand. I want to ensure I am not missing anything. Environment Node 1: System: Dell PowerEdge R730 CPU: (2) Intel Xeon E5-2660 RAM: 256 GB Node 2: System: Dell PowerEdge R630 CPU: (2) Intel Xeon E5-2698 v4 RAM: 256GB OS: Windows Server 2019 Data Center Network: 10G Ubiquiti USW-Pro-Aggregation switch Each node has (1) Intel Ethernet Converged Network Adapter X710 set as the management NIC Each node has (4) QLogic 10GE QL41164HMCU CNA ports connected to the Ubiquiti switch The 4 NICs are put into a Switch Embedded Teaming (SET) switch RDMA is enabled and set to iWarp. Have verified RDMA connections Storage: Each node contains the following drives: (2) Intel Optane DC 4800X SSDPED1K375GA 375GB SSD PCIe (4) Samsung MZILS3T8HMLH0D3 3.49TB SSD SAS (2) Toshiba KPM5XRUG3T84 3.49TB SSD SAS (5) Toshiba AL15SEB18EP 1.64TB HDD SAS I have been using DISKSPD and the output is below for the cluster using the entire storage pool. I would have expected some higher MiB/s and I/O per s. If I change the config and use only SSDs like even just one of the Samsung drives I get about 900MB/s and 15K+ I/O per s. The performance is about the same as isolating one of the Toshiba HDDs and running off there which I tried as well. I would have expected it to be much faster. * This specific example is where I am trying to test write performance but I am similarly underwhelmed by read performance as well. diskspd -b60K -d60 -h -L -o32 -t1 -s -w100 -c1G C:\ClusterStorage\HV1\LogIO.dat Total IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 21557882880 | 350877 | 342.66 | 5847.99 | 5.471 | 1.226 | C:\..\LogIO.dat (1024MiB) ----------------------------------------------------------------------------------------------------- total: 21557882880 | 350877 | 342.66 | 5847.99 | 5.471 | 1.226 Read IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 0 | 0 | 0.00 | 0.00 | 0.000 | N/A | C:\..\LogIO.dat (1024MiB) ----------------------------------------------------------------------------------------------------- total: 0 | 0 | 0.00 | 0.00 | 0.000 | N/A Write IO thread | bytes | I/Os | MiB/s | I/O per s | AvgLat | LatStdDev | file ----------------------------------------------------------------------------------------------------- 0 | 21557882880 | 350877 | 342.66 | 5847.99 | 5.471 | 1.226 | C:\..\LogIO.dat (1024MiB) ----------------------------------------------------------------------------------------------------- total: 21557882880 | 350877 | 342.66 | 5847.99 | 5.471 | 1.226 I would appreciate any help. Thanks!.3KViews0likes0Comments