Archive 1997–2024

Free Cooling: the Server Side of the Story

Fan Speed

How do these higher temperatures affect the fans?

It is clear that the fan speed algorithm takes more than just the CPU temperature and inlet temperature into account. There's definitely an ability to detect when a low power CPU with low tCase is used. As a result the fans are spinning faster with the 2650L than with the 2697 v2. That also means that the server has more headroom for the Xeon E5-2697 v2 than we first assumed based on the CPU temperature results. At higher inlet temperatures, the fans can still go a bit faster if necessary on the 2697, as the maximum fan RPM is 7000.

Power Measurements

The big question of course is how all this affects the power bill. It's no use saving on cooling if your server simply consumes a lot more power due to increased fan speeds (and potentially down time when replacing fans more frequently).

The difference in power consumed is not large between the three inlet temperatures. To make our measurements clear, we standarized on the measurements at 20°C as the baseline and created the following table:

  Xeon E5-2697 v2 Xeon E5-2650L
CPU load Inlet 20°C Inlet 35°C Inlet 40°C Inlet 20°C Inlet 35°C Inlet 40°C
0-10 100% 105% 106% 100% 106% 112%
10-20 100% 98% 103% 100% 104% 108%
20-30 100% 105% 110% 100% 103% 107%
30-40 100% 102% 105% 100% 102% 105%
40-50 100% 109% 108% 100% 97% 109%
50-60 100% 105% 108% 100% 108% 111%
60-70 100% 106% 107% 100% 104% 110%
70-80 100% 106% 104% 100% 105% 109%
80-90 N/A N/A N/A 100% 109% 108%
Average   105% 107%   103% 109%

As the fans work quite a bit harder to keep the 2650L below the low Tcase, they need a lot more power. We notice a 9% increase in power when the inlet temperature doubles. The increase is smaller with the Xeon E5, only 7%.

The most interesting conclusion is that raising the inlet temperature from 20 to 35°C results in almost no increase in power consumption (3-5%) on the server side, while the savings on cooling and ventilation can be substantial, around 40% or more.

Originally published at https://www.anandtech.com/show/7723/free-cooling-the-server-side-of-the-story (Wayback Machine).