Evaluating Futuremark's Servermark VDI on the Supermicro SYS-5028D-TN4T
Benchmarking the Supermicro SYS-5028D-TN4T
The guides and scripts that are supplied with Servermark VDI assume a VMWare-based virtualization setup. However, for our Hyper-V setup, the scripts had to be reworked in Powershell. Two distinct scripts were developed. The first script took a base VM and cloned it N times with different copies of the base image (not differencing VHDs). This script was run on the Supermiro SYS-5028D-TN4T.
An Intel D54250WYK Haswell NUC running Windows 8.1 Pro x64 was used as the console node on the main network. The second script was run on this machine. It started the VMs in sets of 2 (start with 2, then 4, 6 and so on till a configurable number of VMs based on N in the first script) and processed the ServermarkControlConsole command with the appropriate arguments based on the number of active powered on VMs in that particular iteration. One of the challenges here was determining the DHCP IPs of the active VMs on their main network interface to prepare the arguments.
The Xeon-D 1540 is a 8C/16T processor, and our system was configured with 64GB of RAM. To keep things reasonable, we set the number of maximum simultaneously active VMs to be 16. Each of the Hyper-V Gen 2 VMs was allocated one vCPU and 2GB of RAM. Other VM configurations were left at default. The graph below plots the average PCMark score obtained on each VM as a function of the number of simultaneously active VMs.
Other statistics from the benchmark runs are summarized in the table below.
| Supermicro SYS-5028D-TN4T - Futuremark Servermark VDI 0.4.3 - PCMark Scores | |||||
| No. of Active VMs | Minimum | Maximum | Average | Median | Standard Deviation (%) |
| 2 | 1701.0 | 1777.0 | 1742.0 | 1749.0 | 1.73 |
| 4 | 1643.0 | 1753.0 | 1699.0 | 1698.0 | 2.01 |
| 6 | 1637.0 | 1733.0 | 1686.0 | 1687.0 | 1.63 |
| 8 | 1595.0 | 1733.0 | 1669.0 | 1674.0 | 2.03 |
| 10 | 1544.0 | 1694.0 | 1642.0 | 1640.0 | 2.21 |
| 12 | 1568.0 | 1702.0 | 1628.0 | 1625.0 | 1.84 |
| 14 | 1562.0 | 1687.0 | 1621.0 | 1622.0 | 1.71 |
| 16 | 1532.0 | 1692.0 | 1605.0 | 1606.0 | 1.83 |
A number of tests were carried out by allocating more vCPUs per VM and also allowing dynamic memory amounts for each according to their requirements. Irrespective of the VM configuration, we were unable to score more than the 2000 required for Servermark VDI to certify the server. This is likely due to the single-threaded performance of the Xeon-D 1540 not being good enough for the generic office workloads from PCMark 8's 'Work' preset.
Originally published at https://www.anandtech.com/show/10592/evaluating-futuremarks-servermark-vdi-on-the-supermicro-sys5028dtn4t (Wayback Machine).
