Interested in conducting your own webinar? Email webinars@bnpmedia.

com

Room Cooling in the Data Center Containment Strategies to Improve Performance

Joe Capes Director Business Development, Americas Cooling Line of Business

www.missioncriticalmagazine.com

Archive

Add to your favorites

Room Cooling in the Data Center Containment Strategies to Improve Performance

Joe Capes Director Business Development, Americas Cooling Line of Business

Agenda
Data Center Cooling Trends Containment Methodologies Economizer Technologies Economic Considerations Final Recommendations

Agenda
Data Center Cooling Trends Containment Methodologies Economizer Technologies Economic Considerations Final Recommendations

Introduction
Traditional Data Center Cooling Methods
Many data center professionals have inherited traditional data centers Characteristics of Traditional Cooling Designed with energy efficiency as a low priority Cooling units located at outside perimeter Raised floor Hot air mixes with cold air Inconsistent hot / cold aisle arrangement Oversized power and cooling components Low IT rack power densities

Present Trends New emphasis on high efficiency and low carbon emissions Row cooling and separation of hot and cold air streams are new breakthrough technologies to help to remedy the situation
7

Todays Main Cooling Architectures for Aircooled Servers

Central Air Handling Unit Room Based Architecture

Computer Room Air Handler Room Based Architecture

InRow Air Handler Row Based Architecture

Different Cooling Architectures for AirCooled Servers

The two main cooling equipment functions are to
Provide the bulk cooling capacity Distribute the air to the IT loads

The major difference in architectures lies in how they perform the second task.
Airflow is crudely constrained by room design, is not visible in implementation, and varies considerably between installations.
Room Row Rack

Floor plans showing the basic concept of room, row, and rack-oriented cooling architecture.
9

Raised Floor Architecture for Air Distribution

One such possible constraint

10

Capacity Utilization
Claimed Capacity vs. Usable Capacity
Usable CRAC Capacity
100% 80%
row-oriented cooling

60%
rooom-oriented cooling

40% 20% 0%
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25

rack-oriented cooling

Average Per-Rack Power Density (kW)

Usable air conditioner capacity as a function of average rack power density for the three cooling architectures

11

A Hybrid Approach to Cooling

Most Data Centers will have a mix of heat densities and therefore cooling solutions
IT Refreshes happen every 2-4 years resulting in a mix of distributed IT assets IT management of blades and storage deployments is often in clusters Concentrated high density loads Traditional server assets may be well served by room cooling units

Roworiented d

Rackoriented

Roomoriented

12

World Power Consumption Growth Ranking Data Centers

Average % Projected Growth in Power Growth 2011-2012 (Data Center Dynamics)

1st Turkey 2nd Colombia 3rd Brazil 4th China 5th Argentina 9th Eastern USA 22nd Western USA

Actual 85% 50% 48% 46% 41% 22% 2%

Projected (60%) (40%) (45%) (28%) (36%) (13%) (3%)

Sample 110 MW 90 MW 280 MW 500 MW 120 MW 320 MW 100 MW

kw/Rack 3.61 kW 3.60 kW 3.05 kW 2.75 kW 3.14 kW 4.35 kW 5.32 kW

13

Room Cooling
Ducted supply air for delivery to heat load Open or ducted return air for heat removal Fixed fan speeds to deliver consistent plenum pressures
Airflow restrictions in under floor plenum Non-uniform airflow distribution Fixed flow tiles/grates

Limited capacity resolution Delivery of colder air to the space

Reduced Sensible Heat Ratio (SHR)

14

CRAC/CRAH Airflow Configurations

UPFLOW
Bottom Suction with Top Discharge

Front Suction with Top Front Discharge (Plenum and Grille)

Front Suction with Top Discharge

Rear Suction with Top Discharge

DOWNFLOW

Top Suction with Bottom Discharge (Floorstand)

Top Suction with Bottom Discharge (Plenum and Grille)

CRAC/CRAH Checklist
High efficiency in all operating conditions

Optimized air flow management with EC fans

Compact dimensions

Front service access only

Competitively priced 1rst Year Parts/Labor/Travel

16

Agenda
Data Center Cooling Trends Containment Methodologies Economizer Technologies Economic Considerations Final Recommendations

17

The two basic approaches to airflow containment

COLD-aisle containment

HOT-aisle containment

HOT air free in the room Cold aisle COLD air free in the room Hot aisle

The key benefit of both methods comes from SEPARATION of cold supply air from hot return air

Containment Approaches
Common Characteristics:
Prevent Hot and Cold air streams from mixing
Cooling systems can be set to a higher temperature Reduction of humidification and dehumidification costs

Better overall physical infrastructure utilization that enables rightsizing

Those benefits lead to energy savings and better equipment utilization compare to traditional cooling methods

19

Hot and cold containment force different operating temperatures

COLD-aisle containment
If person is 25 C Return is 25 C If person is 25 C Return is 35 C

HOT-aisle containment

Supply is 15 C

Supply is 25 C

If personnel space temperature is held constant, then hot containment allows higher air conditioner operating temperatures

Cold Aisle Containment System (CACS)

CACs Unique Characteristics Typically used with traditional perimeter cooling cold air supplied via raised floor and perforated tiles. Alternatively CACS is designed with row based cooling system The rest of the room becomes large, return hot air plenum
Cold Aisle Containment Limitations Perimeter Cooling Longer air paths and higher air pressure resistance higher power consumption by fans Less than optimum return air temperature lower cooling capacity and efficiency Limited power density per rack - limited by the raised floor and perforated tiles Limited predictability variable room and raised floor dimensions Limited ride through during cooling failure - confined to Cold Aisle air volume Room acts as the Hot Aisle contradicts with perception that data centers should be cold. Peoples expectation when entering the room need to be adjusted. Room acts as the Hot Aisle difficulty in cooling free standing racks and equipment Not modular & scalable due to room cooling architecture

21

Hot Aisle Containment System (HACS)

HACs Unique Characteristics APC by Schneider Electric holds the concept patent Often used with Row cooling hot air is captured and neutralized via cooling units placed within the row of racks and supplied to cold aisle The rest of the room becomes large, cold air plenum, no raised floor or ducting is required Hot Aisle Containment Advantages In-Row Cooling is Closed Coupled: Short air paths and low air pressure resistance - lower power consumption by fans (See White Paper #130) Higher return air temperature higher cooling capacity and efficiency of the cooling system High power density per rack all heat is neutralized and there is no limitation with the raised floor and perforated tiles Predictable solution independent of room and raised floor dimensions Higher ride through during cooling failure significantly larger cold aisle air volume Room acts as the Cold Aisle in agreement with the perception that data centers should be cold Continued....

22

Hot Aisle Containment Systems (HACS)

Hot Aisle Ceiling Tiles/Cable Trough
Seals in hot air, prevents mixing with room air

High Density Zones Supports InRow products Hot air scavenging system
Ducted Return / Free Supply

Optimize InRow Cooling

Increase efficiency Improve predictability Use at any density

InfraStruXure High Density

Chamber Doors
InfraStruXure InRow RC
In-Row Air Conditioner Cools hot chamber air Access to hot aisle, locks for security

23

Agenda
Data Center Cooling Trends Containment Methodologies Economizer Technologies Economic Considerations Final Recommendations

24

Trends - Economizers
Air Side Economizer
Requires cool enough outside air to maintain desired temperature in data center Outside DRY BULB temperatures from 40F (4.4C) to 80.6F (27C) Humidity control required when outside of control range typically less than 40% or greater than 60% RH Requires pre-treatment & filtration of outside air to mitigate potential for particulate contamination within data center Need to have control of the real estate and zoning regulations around you

Water Side Economizer

Requires cool enough outside air to chill water/glycol Outside WET BULB temperatures 40F (4.4C) to 64.4 F (18C)

25

Economizer Requirements None > 19kW 1a, 1b, 2a, 3a, 4a 3b, 3c, 4b, 4c, 5b, 5c, 6b 2b, 5a, 6a, 7, 8
26

>40kW -

ASHRAE 90.1 Climate Zone Economizer Requirement Map

No requirement Data Centers >19kW Data Centers >40kW

Basically, if youre blue, economizer use is mandated!

27

Economizers Summary of Legacy Situation

Custom Economizer Systems Complex System Complex infrastructure requires special controls, installation, and maintenance Multiple vendors involved

These systems have a higher chance of failure and emergency maintenance

28

Economizers Installations into Existing Data Centers

Cooling Equipment Type
Large External Air Handling System

Water Side Economizer

Air Side Economizer Direct Expansion

Comment

Not Practical

Possible

Additional coil sections would be required making it impractical to consider a water side economizer. An air handling system located outside or within close proximity makes consideration of outside air economizer possible. Dual coils are required to implement a waterside economizer on a DX system, and would require additional coils to be added or units replaced. Typically, CRAC/CRAH units are in the interior of the building and would not lend themselves to ducting to the outdoors for air side economizer. Dual coils are required to implement a water side economizer on a DX system, and would require additional coils to be added or units replaced. Close coupled units are installed within the rows of IT equipment making it difficult to access outside walls and provide ducting to support an air side economizer.

Traditional Floor Mounted CRAC/CRAH

Not Practical

Not Practical

Close Coupled Cooling

Not Practical

Not Practical

Chilled Water
Large External Air Handling System Traditional Floor Mounted CRAC/CRAH Likely Possible Adding a plate and frame heat exchanger with valves and controls is likely to be considered with a chilled water system. An air handling system located outside or within close proximity makes consideration of outside air economizer possible. Adding a plate frame heat exchanger with valves and controls is likely to be considered with a chilled water system. Typically CRAC/CRAH units are in the interior of the building and would not lend themselves to ducting to the outdoors for air side economizer. Adding a plate frame heat exchanger with valves and controls is likely to be considered with a chilled water system. Close coupled units are installed within the rows of IT equipment making it difficult to access outside walls and provide ducting to support an air side economizer.

Likely

Not Practical

Close Coupled Cooling

Likely

Not Practical

Economizer Competitive Analysis

1MW Design Data Center @ 60% Load System Architecture EcoBreeze Air Econ w/ Heat Wheel Water Cooled Chiller w/ Econ Air Cooled Chiller w/ Econ Fresh Air Econ DX Fluid Cooled CRAC w/ Econ
2) Supply Air / Cold Aisle 77F 3) Bin Weather Data Saint Louis, MO 4) Does not reflect humidification losses 5) All system have fan control proportional to IT load % of design

Partial PUE kW-Hr/Yr 1.09 1.10 1.14 1.16 1.14 1.20 466,518 503,999 728,195 846,039 718,159 1,044,073

Relative Power 45% 48% 70% 81% 69% 100%

1) Hot Aisle Containment 101.5F Return to A/C

30

Agenda
Data Center Cooling Trends Containment Methodologies Economizer Technologies Economic Considerations Final Recommendations

31

Financial Comparison
Data Center Sizes 60, 120, 480, 1200 kW Rack Density 3, 6, 12, 20 kW per Rack (120 CFM/kW) Raised Floor Air Distribution for Room Cooling 100 Euro/ m2 ($8/ft2)
Raised Floor Pricing range from 30 Euro / m2 to 400 Euro / m2($50/ft2) Does not consider fire suppression under floor ($4-$10/ft2)

Drop Ceiling for Room Cooling Hot Aisle Containment 36 Euro / m2 ($4/ft2)
Based on RSMeans Cost Works Data Base Typical Drop Ceiling Does not consider fire suppression in drop ceiling range ($4-$10/ft2)

Active Floor for Room Cooling with CAC and raised floor for high density (12 and 20 kW per rack) Piping costs based on RSMeans Cost Works Data Base Steel Piping Cost of Energy = 0.1 Euro / kWh EcoStream Analysis Tool used to determine airflow required for each scenario

32

Benefits of Containment Room Cooling

First Cost
Higher first cost of adding containment to room cooling Room Cooling with no raised floor and Hot Aisle Containment (HAC) most cost effective solution

Operating Cost Improvement

HAC no raised floor ROI over raised floor
3 kW per Rack = 3 years 6 kW per Rack = 1.5 years

CAC with raised ROI over raised floor

3 kW per Rack = 4.3 years 6 kW per Rack = 2.5 years

480 kW Data Center - First Cost

450,000.00 430,000.00 410,000.00 Room w/ raised floor

480 kW Data Center - Operating Cost

85,000.00

Annual Operating Cost

Room CAC w/active floor Room HAC no Raised Floor Room HAC w/ raised floor

80,000.00
75,000.00 70,000.00 65,000.00 60,000.00

Effect of Active Air Distribution

First Cost

390,000.00
370,000.00 350,000.00 330,000.00 310,000.00

Room w/ raised floor Rooom CAC w/active floor Room HAC no raised floor and Room HAC w/ raised floor 3 kW 6 kW 12 kW 20 kW

290,000.00
3 kW 6 kW 12 kW 20 kW

Density (per Rack)

Density (per Rack)

Annual Operating Costs

60 kW Data Center
12,000.00 Annual Operating Cost 24,000.00 Annual Operating Cost 22,000.00 20,000.00

120 kW Data Center

10,000.00
8,000.00 6,000.00 4,000.00 2,000.00 3 kW 6 kW 12 kW Density per Rack 20 kW

18,000.00
16,000.00 14,000.00 12,000.00 10,000.00 3 kW 6 kW 12 kW Density per Rack 20 kW

480 kW Data Center

85,000.00
Annual Operating Cost Annual Operating Cost

1200 kW Data Center

200,000.00 190,000.00 180,000.00 170,000.00 160,000.00 150,000.00 140,000.00 130,000.00
3 kW 6 kW 12 kW Density per Rack 20 kW

80,000.00 75,000.00 70,000.00 65,000.00 60,000.00 55,000.00 50,000.00

3 kW 6 kW 12 kW Density per Rack 20 kW

Agenda
Data Center Cooling Trends Containment Methodologies Economizer Technologies Economic Considerations Final Recommendations

35

CACs vs. HACs Summary

Hot Aisle and Cold Aisle Containment eliminate air mixing and are a superior solution compared to traditional cooling architecture Hot Aisle Containment System (HACS) is a more efficient approach than Cold Aisle Containment System (CACS) because the HACS methodology allows for the channelling the hottest air directly into coolers HACS used with In-Row cooling architecture provides closed couple cooling that allows higher cooling capacity utilization and efficiency HACS is more flexible, it can be deployed anywhere within the room, it is more predictable and scalable solution, it better addresses the higher IT density requirements HACS has higher potential for better heat utilization and using free cooling approaches Hot Aisle Containment has better ride through capability

36

CACs vs. HACs Head to Head

Characteristic Efficiency improvements Yes Yes Cold Aisle Containment Hot Aisle Containment Comment
HACS is more efficient than CACS because HACS typically operates at a higher return temperature due to isolation of the hot air from the rest of the room.

Ability to increase cold air supply set point without impacting entire data center

No

Yes

With HACS, cooling set points can be set higher while still maintaining a comfortable work environment. Increasing CACS cooling set points results in uncomfortably high data center environment.

Leverages maximum number of potential free cooling days No Yes

By increasing cooling set point, containment systems allow for increased free cooling. However, increasing the set point of CACS results in increased room temperatures which is undesirable from a free cooling day perspective.

Room neutral solution No Yes

A HACS deployment is a drop-in solution. CACS impacts the surrounding data center infrastructure.

37

Head to Head (cont.)

Characteristic Ease of deployment with room cooling Cold Aisle Containment Yes Hot Aisle Containment No Comment
CACS is preferred when using room level cooling with a free return system which draws its return air from the room. A HACS without in-row cooling would require special return duct work or ceiling plenum.

Ability to scale for high density

No

Yes

CACS is often implemented with raised floor and inefficient fan assisted floor tiles are needed in order to achieve higher density. HACS is room neutralit does not impact the outside room temperature in any way. CACS makes the air outside of the contained rows hotter.

Room neutral design

No

Yes

Adverse temperature impact on nonracked equipment

Yes

No

With CACS, because the cold aisles are contained, the rest of the data center is allowed to become hot. Equipment outside the contained areas would have to be evaluated for operation at elevated temperatures.

38

Existing Data Center Suggestions (Brown Field)

IT Load to be Deployed Low Density 0-6 kW per Rack Out of Capacity Stranded Capacity

Add Room Cooling

Cold Aisle Containment Cold Aisle Containment + Active Floor Air Removal Unit or Vertical Exhaust Duct(VDE)

High Density > 6 kW per Rack

Close Coupled Cooling Zone for Rack Expansion or Existing Racks

39

Final Recommendations
Always use containment for optimal TCO
Payback is immediate with close coupled cooling 3 year ROI for Room Based Cooling improves with density

Hot Aisle Containment preferred approach for new data center builds
Eliminates variable of cold air distribution with or without raised floor Improved Flexibility keeping data center cool available for non-racked equipment and personnel comfort.

Cold Aisle Containment Retrofit for existing data center

Adapt to existing room cooling systems Active floor to assist with cold air distribution from raised floor to ensure sufficient air flow is available in contained aisle. Efficiency Gains Require elevating room temperature

40

Thank You!

Additional details available at whitepapers.apc.com

[email protected]
41