Heat is a form of ‘waste’ energy that results from the way the CPUs (central processing units) within a typical IT server work. In a server room or datacentre environment, managing ‘heat’ and keeping server racks cool is as critical an issue as ensuring the servers are protected from mains power supply failures. Excessive heat can age components and can lead to early system failures, erratic system operation and presents a potential fire risk both within a server cabinet and its local environment.
Servers draw electrical power from their local supply, whether this is a power distribution unit, UPS system or mains power socket via an internal switch mode power supplies (SMPS). The SMPS converts the AC (alternating current) waveform of the supply, into the levels of DC (direct current) required to power internal circuits including the CPU.
A CPU works by enabling electrical signals to pass through its microscopic transistors or by resisting (blocking) them. As the electrical (DC) energy passes through the CPU, heat builds up. The heat is dissipated into the surrounding environment. The more powerful the CPU, the greater the volume of heat generated. The greater the number of servers, the larger the amount of heat dissipated as the load utilisation increases on the servers. Within a confined space, such as a server rack, the heat build-up can be extensive and damaging if not managed and controlled. Whilst more energy efficient servers will use less energy to produce the same level of output, CPU performance continues to increase as do their power demands and potential heat generation. More powerful processors used for machine learning applications have higher power demands and generate even more heat.
For server room and datacentre managers the amount of heat generated and dissipated within a room is rarely uniform and must be channelled and managed in order for an air conditioning or cooling system to operate as effectively and efficiently as possible. Cooling and humidity management is necessary to protect critical systems and maintain their operational resilience.
There are several aspects to consider when deciding on how best to cool an environment. For a server cabinet, the most appropriate level of cooling and ventilation will be dependent upon several factors:
Server rating plates can be misleading when calculating the level of cooling required. The numbers shown generally the maximum power draws in Amps or Watts or Kilowatts. Use of these numbers can lead to an over-sizing whether it’s a cooling system or an uninterruptible power supply. The numbers can therefore only be used as a guide as to the level of cooling required.
A more realised measurement for sizing a cooling system is to calculate the British Thermal Units (BTUs) which can be converted into Kilowatts as 1kW=3,412BTUs. The BTUs should be calculated for:
Once all the factors have been assessed the total room BTU can be calculated:
Total Heat Gain = Equipment + Floor + Window + Occupant + Lighting
There are individual formulas for each of these types of calculation:
The calculation will provide a good indication of the size of air conditioner or cooling system required for a small server room. Larger facilities and datacentres may also require thermodynamic modelling and the use of hot-aisle/cold-aisle containment arrangements.
Adequate air flow is vital to ensuring that operational reliability if the critical servers inside a cabinet. The cooling and air flow must be good enough to prevent a build-up of heat (hot-spots) and to ensure that all components within the rack are suitably cooled no matter where they are placed (bottom, middle or top of the rack cabinet). This can be even more important consideration if UPS systems with valve regulated lead acid (VRLA) batteries are installed into the rack as the batteries need an ambient temperature of 20-25˚C in order to stand a chance of reaching their optimal working life.
So how can you ensure a good air flow and what do you need to consider?
Where additional cooling is required the choice then turns to what type of cooling method to use and these range from natural convection, to forced convection, active convection and free cooling.
This form of cooling relies on the fact that heat will flow from a warmer environment to a cooler one. If the air around a server rack cabinet is cooler than the internal temperature, the heat within the cabinet will radiate naturally through the sides and doors and the internal temperature will reduce accordingly. Whilst this is a ‘free’ form of cooling it is not efficient, and its effectiveness is dependent upon the external temperature of the air outside the server cabinet. If the differential is not larger enough, little heat will flow from inside to outside the cabinet.
A fan or blower fitted insider server rack, can force the air flow and decrease the thermal resistance barrier between the cabinet and its environment. The fans can be installed as top of cabinet assemblies or internal fan trays. The most and effective type of installation are top-mounted fan panels. Internal fan trays are generally used to tackle local hot-spots. Circulation volumes can be increased by adding more fans but a problem with this type of arrangement is air quality and the outside temperature. If the air is contaminated with dust, dirt, oil or moisture, then the fan air flow will lead to these building up on the fans and within the internal rack assembles. Where this is an issue, as in some industrial environments, a closed-loop air-to-air heat exchanger can provide a solution. As with natural convection, the overall flow of heat is dependent on the difference between the internal and external ambient temperatures.
Air conditioning is a form of active convection cooling and the one most turned to when natural or convection cooling proves ineffective. There are several types of air conditioner available for server rooms and data centres including wall mounted and ceiling suspended, in-row units and complete computer room air conditioners referred to as CRACs.
Rather than cool a complete room it is also possible to build an air conditioning unit into a server cabinet. This configuration forms a closed-loop system (with an internal evaporator) and can be ideal for industrial or extreme environments where there is a danger of contamination from dirt and dust or moisture, water and other liquids. Closed-loop systems like this have a cost benefit in that they are more efficient as they are focused on cooling a single cabinet rather than an entire array of rows or a complete server room. For this type of cooling arrangement, it is vital that the air conditioner is accurately sized.
For extreme environments the rack cabinet will also have an IP-rating higher than IP20 making it even more necessary for an air conditioner to be fitted to protect the heat-sensitive equipment inside. The cabinet may also be a custom or bespoke design that is too a high degree sealed to allow operation in ambient temperatures up to 55˚C.
Liquid cooling is another form of forced active cooling. This type of system used a chilled liquid to cool the air within a cabinet, hot-aisle/cold-aisle arrangement or a complete data facility. Liquid cooled doors can be fitted to some server rack cabinets to provide an individual and custom solution. Liquid leakages are less of an issue with more modern systems thanks to self-healing systems.
Free air cooling is a method for cooling large server rooms or data centres and can be a suitable solution for sites with low external air temperatures. For this type of arrangement the low external temperatures are used to chill water which is then stored or used immediately for use with an internal air conditioning system. The solution is more suited to larger facilities rather than individual server racks and cabinets and can rely on adiabatic cooling processes.
There are several options available when it comes to cooling server rack cabinets and data centre facilities. There is no one solution that fits all installations. Some cooling systems and air conditioners can be installed relatively easily, and others may have a more complex installation and even require custom or bespoke elements.
At Server Room Environments we supply, install and maintain a wide range of air conditioning solutions. Please contact us for a free site survey or to discuss your project, whether its an existing system upgrade or new cooling system installation.
For information on recommended ambient temperatures for server rooms and data centres refer to the ASHRAE white paper ‘Data Center Power Equipment Thermal Guidelines and Best Practices’ (http://tc0909.ashraetcs.org/documents/ashrae_tc0909_power_white_paper_22_june_2016_revised.pdf).
The world is not getting any cooler and in the data centre industry critical cooling is becoming one of the prime areas for energy saving. Unlike the uninterruptible power supplies used within a critical power path, which are already approaching their maximum available energy efficiency (>97% in on-line mode) critical cooling has a long way to go.
The range of cooling solutions available for server room and datacentre operators continues to evolve and can be split into two types: active cooling (forced convection) and passive cooling (natural connection). Innovation is driven by how to affect the most energy efficient and environmentally friendly cooling systems as the actual power demands for IT servers continue to increase.