Title Slide

Energy Saving Opportunities

in Data Centers

David Poetker, PE Coffman Engineers

Doug Bors, PE Cone Twelve
 Microprocessor Performance &
Power Trends

Transistor Density Source: Intel Corporation

 Server Thermal Footprints
Horizontal, rack-mounted server form factors

Thermal Density (kW/rack nameplate)*

Thermal Density (W/ft2 nameplate)**

Thermal Density (W/U nameplate)

(100 W/U = 210 W/ft2) 500 21.0
1000

400 16.8
800
500+ W/ft2
Beyond current air-cooling limits
300 12.6
600
400-500 W/ft2
Air cooling limits, current tech. 200 8.4
400
250-400+ W/ft2
Future closed cabinets, air cooling
200 100 4.2
100-250 W/ft2 – High-perf. air
100 W/ft2 – co-lo
50 W/ft2 – corp. D.C.
* Assumes 42U/rack populated with these systems
** Allocates industry-standard 20 ft2/rack, no de-rating
 The Thermal Challenge
• Thermal load densities will continue to grow.

• Data Centers in the 150 watts/sf to 300 watts/sf

will become more common in the future.

• Limits of air cooling technology will be

approached.

• Increasing difficulty in providing economizer

systems for Data Centers in high-rise buildings.
2000 State Energy Code
2000 State Energy Code
2001 State Energy Code
(Effective July 1, 2002)
2001 State Energy Code
(Effective July 1, 2002)
2001 State Energy Code
(Effective July 1, 2002)
 Seattle Weather Bin Data
Airside Economizer
1800
1600
1400
Hours/Year

1200
1000
800
600
None
400
Full Partial 440 hrs
200 5247 hrs 3073 hrs
0
F

F
5F
.5

.5

.5

.5

.5

.5

.5

.5

.5
2.
12

22

32

42

52

62

72

82

92
Dry Bulb Temperature
 Seattle Weather Bin Data
Waterside Economizer
1800
1600
1400
Hours/Year

1200
1000
800
600
Full Partial None
400
2259 hrs 5692 hrs 809 hrs
200
0
F

F
8F
16

25

36

45

53

59

64

68

71
Wet Bulb Temperature
 Server Environment
ƒ Manufacturer’s Listed Operating Range:
50°F to 105°F, 8% to 80% RH,
81°F maximum wet bulb
ƒ Reliability Range:
72°F +/- 2°F (70°F to 74°F)
45% RH +/- 5% (40% to 50%)
(at face of server)
 Psychrometric Chart

80% RH

72°F
45% RH
75°F
50°F 55% RH
80% RH
75°F
30% RH
50°F
60% RH
105°F
8% RH
50°F
8% RH
 Airside Economizer
Outside Air

Relief Air

Condensing
Humidifier
Section
Return Air

Supply Air

Packaged Rooftop Air Conditioning

Unit
 Airside Economizer
Cooling
Tower
Water-cooled
Chiller

Outside Air

Relief Air

Humidifier Return Air

Rooftop Air Handling Unit with

Chilled Water System
 Waterside Economizer
Cooling
Tower

Air-cooled
Condenser

Refrigerant
Piping

Computer Room
A/C Unit

Air-cooled with Multiple Cooling

Source
 Waterside Economizer
Cooling
Tower

Cooling
Tower

Compressor
Cooling Loop

Computer Room
A/C Unit

Water-cooled CRAC with Multiple

Cooling Source
 Waterside Economizer

Cooling
Tower

Compressor
Cooling Loop

Computer Room
A/C Unit

Water-cooled CRAC with Multiple

Cooling Source
 Waterside Economizer

Closed Circuit Closed Circuit

Cooling Tower Cooling Tower

Compressor
Cooling Loop

Computer Room
A/C Unit

Glycol-cooled with Multiple

Cooling Source
 Waterside Economizer

Closed Circuit
Cooling Tower

Computer Room
A/C Unit

Glycol-cooled with Multiple

Cooling Source
 Energy Comparisons of Systems
5,000 sf Data Center: 3.5 kW/rack (150 W/sf)
8 floors from Data Center to Roof; Fully loaded

100%
100 99.1%
96.2%

90 87.4%
82.4%
80.5%
80

70

60
CRAC Water-cooled CRAC Glycol-cooled Pkg RTU Air Econo CHW System Air Econo

Baseline: Glycol-cooled CRAC No Economizer

 Chilled Water w/ CRAH Unit

Water-cooled Cooling
Chiller Tower

Computer Room No Economizers!

Air Handling Unit

Water-cooled Chiller System with

Computer Room Air Handling Unit
 Energy Comparisons of Systems
5,000 sf Data Center: 3.5 kW/rack (150 W/sf)
8 floors from Data Center to Roof; Fully loaded

100%
100 99.1%
96.2%

90
87.4%
82.4% 81.1%
80.5%
80

70

60
CRAC Water-cooled CRAC Glycol-cooled Pkg RTU Air Econo CHW System Air CHW System w/ CRAH
Econo

Baseline: Glycol-cooled CRAC No Economizer

 Energy Comparisons of Systems
5,000 sf Data Center: 3.5 kW/rack (150 W/sf)
8 floors from Data Center to Roof; 65% loaded

100 98.8% 100%

90.0%
90

80.2%
80
75.0%
73.2% 72.2%
70

60
CRAC Water-cooled CRAC Glycol-cooled Pkg RTU Air Econo CHW System Air CHW System w/ CRAH
Econo

Baseline: Glycol-cooled CRAC No Economizer

 Energy Comparisons of Systems
5,000 sf Data Center: 3.5 kW/rack (150 W/sf)
2 floors from Data Center to Roof; Fully loaded

100%
100 98.7%
96.3%

90
87.3%

80.6% 81.2%
80 79.1%

70

60
CRAC Water-cooled CRAC Glycol-cooled Pkg RTU Air Econo CHW System Air CHW System w/ CRAH
Econo

Baseline: Glycol-cooled CRAC No Economizer

 Energy Savings in Equipment
Selection
ƒ Water-cooled CRAC: Larger cooling tower
with smaller fan motor (30 HP vs. 50 HP)
ƒ Chilled Water System for Both RTU and
CRAH: More efficient chiller selection
(0.564 kW/ton vs. 0.664 kW/ton)
ƒ Chilled Water System for Both RTU and
CRAH: Slightly larger cooling tower with
smaller fan motor (7.5 HP vs. 10 HP)
 Results of Equipment Selection
5,000 sf Data Center: 3.5 kW/rack (150 W/sf)
8 floors from Data Center to Roof; Fully loaded

100%
100 99.1%
96.2%

87.4%
90
85.7%
82.4% 80.0%
80.5% 81.1%
80 79.1%

70

60
CRAC Water-cooled CRAC Glycol-cooled Pkg RTU Air Econo CHW System Air CHW System w/ CRAH
Econo

Baseline: Glycol-cooled CRAC No Economizer

 Electrical System Efficiency

ƒ UPS
ƒ Distribution
ƒ Power Supplies
ƒ Trends
ƒ Reliability + Energy
UPS Energy Flow
208 V Distribution Energy Flow
Power Supply Energy Flow
Trend: Power + Computation
Operation: Reliability + Energy
Solutions (Review)