Home
%3CLINGO-SUB%20id%3D%22lingo-sub-425776%22%20slang%3D%22en-US%22%3EStorage%20IOPS%20update%20with%20Storage%20Spaces%20Direct%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-425776%22%20slang%3D%22en-US%22%3E%0A%20%26lt%3Bmeta%20http-equiv%3D%22Content-Type%22%20content%3D%22text%2Fhtml%3B%20charset%3DUTF-8%22%20%2F%26gt%3B%3CSTRONG%3EFirst%20published%20on%20TECHNET%20on%20Jul%2026%2C%202016%20%3C%2FSTRONG%3E%20%3CBR%20%2F%3E%20Hello%2C%20%3CA%20href%3D%22https%3A%2F%2Ftwitter.com%2Fclausjor%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%20Claus%20%3C%2FA%3E%20here%20again.%20I%20played%20one%20of%20my%20best%20rounds%20of%20golf%20in%20a%20while%20at%20the%20beautiful%20TPC%20Snoqualmie%20Ridge%20yesterday.%20While%20golf%20is%20about%20how%20low%20can%20you%20go%2C%20I%20want%20to%20give%20an%20update%20on%20how%20high%20can%20you%20go%20with%20Storage%20Spaces%20Direct.%20%3CBR%20%2F%3E%20%3CBR%20%2F%3E%20Once%20again%2C%20%3CA%20href%3D%22https%3A%2F%2Fstoragedeveloperconference2015.sched.org%2Fspeaker%2Fdan_lovinger.1u9imdh7%22%20target%3D%22_blank%22%20rel%3D%22nofollow%20noopener%20noreferrer%20noopener%20noreferrer%22%3E%20Dan%20%3C%2FA%3E%20and%20I%20used%20a%2016-node%20rig%20attached%20to%20a%2032%20port%20Cisco%203132%20switch.%20Each%20node%20was%20equipped%20with%20the%20following%20hardware%3A%20%3CBR%20%2F%3E%3CUL%3E%3CBR%20%2F%3E%3CLI%3E2x%20Xeon%20E5-2699v4%202.3Ghz%20(22c44t)%3C%2FLI%3E%3CBR%20%2F%3E%3CLI%3E128GB%20DRAM%3C%2FLI%3E%3CBR%20%2F%3E%3CLI%3E4x%20800GB%20Intel%20P3700%20NVMe%20(PCIe%203.0%20x4)%3C%2FLI%3E%3CBR%20%2F%3E%3CLI%3E1x%20LSI%209300%208i%3C%2FLI%3E%3CBR%20%2F%3E%3CLI%3E20x%201.2TB%20Intel%20S3610%20SATA%20SSD%3C%2FLI%3E%3CBR%20%2F%3E%3CLI%3E1x%20Chelsio%2040GbE%20iWARP%20T580-CR%20(Dual%20Port%2040Gb%20PCIe%203.0%20x8)%3C%2FLI%3E%3CBR%20%2F%3E%3C%2FUL%3E%3CBR%20%2F%3E%20Using%20%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2FMicrosoft%2Fdiskspd%2Ftree%2Fmaster%2FFrameworks%2FVMFleet%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%20noopener%20noreferrer%22%3E%20VMFleet%20%3C%2FA%3E%20we%20stood%20up%2044%20virtual%20machines%20per%20node%2C%20for%20a%20total%20of%20704%20virtual%20machines.%20Each%20virtual%20machine%20was%20configured%20with%201vCPU.%20We%20then%20used%20VMFleet%20to%20run%20%3CA%20href%3D%22http%3A%2F%2Faka.ms%2Fdiskspd%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%20noopener%20noreferrer%22%3E%20DISKSPD%20%3C%2FA%3E%20in%20each%20of%20the%20virtual%20machines%20with%201%20thread%2C%204KiB%20random%20read%20with%2032%20outstanding%20IO.%20%3CBR%20%2F%3E%20%3CBR%20%2F%3E%20%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F107447i0D6BC85D84FA1C92%22%20%2F%3E%20%3CBR%20%2F%3E%20%3CBR%20%2F%3E%20As%20you%20can%20see%20from%20the%20above%20screenshot%2C%20we%20were%20able%20to%20hit%20~5M%20IOPS%20in%20aggregate%20into%20the%20virtual%20machines.%20This%20is%20~7%2C000%20IOPS%20per%20virtual%20machine!%20%3CBR%20%2F%3E%20%3CBR%20%2F%3E%20We%20are%20not%20done%20yet%E2%80%A6.%20If%20you%20are%20attending%20%3CA%20href%3D%22https%3A%2F%2Fignite.microsoft.com%2F%23fbid%3D2MQgepoiCik%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%20noopener%20noreferrer%22%3E%20Microsoft%20Ignite%20%3C%2FA%3E%20%2C%20please%20stop%20by%20my%20session%20%E2%80%9C%20%3CA%20href%3D%22https%3A%2F%2Fmyignite.microsoft.com%2Fsessions%2F2771%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%20noopener%20noreferrer%22%3E%20BRK3088%20Discover%20Storage%20Spaces%20Direct%2C%20the%20ultimate%20software-defined%20storage%20for%20Hyper-V%20%3C%2FA%3E%20%E2%80%9D%20and%20say%20hello.%20%3CBR%20%2F%3E%20%3CBR%20%2F%3E%20Let%20us%20know%20what%20you%20think.%20%3CBR%20%2F%3E%20%3CBR%20%2F%3E%20Dan%20%26amp%3B%20Claus%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-425776%22%20slang%3D%22en-US%22%3EFirst%20published%20on%20TECHNET%20on%20Jul%2026%2C%202016%20Hello%2C%20Claus%20here%20again.%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-425776%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3Es2d%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3Estorage%20spaces%20direct%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EWindows%20server%202016%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
First published on TECHNET on Jul 26, 2016
Hello, Claus here again. I played one of my best rounds of golf in a while at the beautiful TPC Snoqualmie Ridge yesterday. While golf is about how low can you go, I want to give an update on how high can you go with Storage Spaces Direct.

Once again, Dan and I used a 16-node rig attached to a 32 port Cisco 3132 switch. Each node was equipped with the following hardware:

  • 2x Xeon E5-2699v4 2.3Ghz (22c44t)

  • 128GB DRAM

  • 4x 800GB Intel P3700 NVMe (PCIe 3.0 x4)

  • 1x LSI 9300 8i

  • 20x 1.2TB Intel S3610 SATA SSD

  • 1x Chelsio 40GbE iWARP T580-CR (Dual Port 40Gb PCIe 3.0 x8)


Using VMFleet we stood up 44 virtual machines per node, for a total of 704 virtual machines. Each virtual machine was configured with 1vCPU. We then used VMFleet to run DISKSPD in each of the virtual machines with 1 thread, 4KiB random read with 32 outstanding IO.



As you can see from the above screenshot, we were able to hit ~5M IOPS in aggregate into the virtual machines. This is ~7,000 IOPS per virtual machine!

We are not done yet…. If you are attending Microsoft Ignite , please stop by my session “ BRK3088 Discover Storage Spaces Direct, the ultimate software-defined storage for Hyper-V ” and say hello.

Let us know what you think.

Dan & Claus