LRDIMMs, RDIMMs, and Supermicro's Latest Twin
Energy Efficiency
Next stop is of course power and energy. First we check out idle power. Idle power is measured with one node and one power supply active.

For a system equipped with an LSI SAS 6G and a Mellanox ConnectX-3 FDR Infiniband controller, 168W per node is a very decent power level for our Supermicro 6027TR-D71FRF server. The HP DL380 G7, the most efficient server of the previous generation, needed 158W with 15 4GB DIMMs but with a 460W PSU.
The premium for the iMB buffer is about 1.5W per DIMM, which is a bit higher than expected (1W). Of course we measure at the wall, so some voltage regulation and PSU overhead is added.
As each power line has only a limited amount of amps available in the datacenter, it is good to check power under heavy load.

The LRDIMM equipped server needs 19W more or 2.4W per DIMM. Again, this is a bit higher than expected. To get the complete picture, we measured the total energy consumed during one hour of testing. All configs got the same workload but the LRDIMM equipped servers finished the jobs more quickly.

The result is that the LRDIMM equipped server is consuming less with three tiles, while the 64GB RDIMM consumes less with two tiles. Better performance results in lower power thanks to the advanced core sleep states of the Xeon E5 "Sandy Bridge EP".
Originally published at https://www.anandtech.com/show/6068/lrdimms-rdimms-supermicros-latest-twin (Wayback Machine).