2023-01 Mission Critical Data Centers - Slides
2023-01 Mission Critical Data Centers - Slides
2023-01 Mission Critical Data Centers - Slides
Robert Kranz, PE
Fire Protection Engineer
1. Quick Intro
7. Q&A
1 Quick Intro
Introduction
Robert Kranz
Fire Protection Engineer
Data Center Design
Center of Excellence
Design Leadership
Primary Responsibilities
• Set FLS goals and provide FLS program oversight
• Support FLS XFN partners with technical expertise
• Ensure global FLS continuity from concept through design
through construction through operations
2 Who, what, where, when, why…
Who builds these data centers?
Owners of large data centers are typically hyperscalers
or cololocation (wholesale) providers
Hyperscalers
• Own and operate their own large data centers
Colo Providers
• Own and operate large data centers and lease space or
services to other companies needing data compute/storage
What exactly is a data center?
Primarily electronic equipment used for data processing (servers), data storage
(storage equipment), and communications (network equipment). Collectively, this
equipment processes, stores, and transmits digital information. – US Dept of Energy
Data Center Sizes
Where are data centers located?
Data centers are located world-wide. Growth continues to accelerate.
Drivers for Data Center Locations
• Power Availability
• Water Availability
• Proximity to Internet Service Providers
• Land Price
• Exposure to Natural Disasters
• Exposure to Man-Made Disasters
• Work force availability
• Political Stability
When are the data centers being built?
Data center construction takes roughly 18-24 months from break
ground to first megawatt available. This timeline is continuously
shrinking with improvements in construction management and
modularity of components.
Capacity Planning
• The exercise of projecting the need for additional storage and compute
capacity.
• The planning results drive the business driver behind capital investment
• Companies will balance new construction and leased-space to adjust
demand needs
Examples
• Emergency Responder Radio requirements
• Fire Alarm Circuit Classifications
• Standpipe requirements
• Sprinkler Obstruction interpretations
• Fire department access regulations
• Fire/Smoke damper requirements What are AHJ thoughts on Li-Ion batteries in a high-rise
• Partial Evacuation allowance data center? it depends….
• Adoption of additional standards Firefighter Access
• NFPA 75 Sprinkler Drainage
• NFPA 76
• NFPA 1 / NFPA 101
• NFPA 855
Owner Requirements
Owners will need to balance local code requirements (AHJ), their own
performance objectives, and insurance requirements (Insurer).
Owner Requirements Owner Considerations
• A Common Platform: Provide a source of truth that is the basis for multiple • Cost
projects. This source should be relevant, always up to date, and aligned with key • Regulatory Requirements
stakeholder requirements.
• A Program - Not Projects - Focus: Align schedules, manage, and innovate design • Schedule
requirements at the program level, not the project level. • Minimizing loss frequency or severity
• A Design Once / Repeat Many Approach: To increase the speed of design and
construction by reducing design variability • Personnel Safety
• Scalability
Some owners do not have written requirements,
• Does it make sense to make more conservative and/or
how do you handle this situation?
expensive decisions to move faster?
Insurance Role
• Builder’s Risk: Monitor construction fire hazards
• Property Loss: Implement their own design standards
• Inform Owner: Of common losses and best practices in the industry
• Review Design: Review design documentation to ensure compliance with standards
• Periodic Inspections: Site visit to ensure construction installation quality and O&M
• Impairment Tracking: Be made aware of reoccurring failures of FLS systems
Elective Design Standards and Process Standardization
Owners may select to incorporate standards such as NFPA 75, 76, FM datasheets,
NFPA 855, etc. for various reasons. Standards are used in design, construction, and
operations to achieve expected outcomes
Standardization
Owner Considerations
• Design Documentation: Common basis of design, drawings,
• Partial adoption or full standard adoption specifications, etc.
• Get ahead of changing codes/standards • Construction Processes: Best practice playbooks, kick-off meetings,
• Operational benefits commissioning scripts, RFI procedures, etc.
• Safety considerations • Maintenance and Operation: Reduce number of vendors, continuity of
• Design predictability vendors, standard procedures, impairment guidance, central location of
• Avoiding AHJ/Insurance interpretation risk O&M requirements and outcomes
Consultant Role
• Inform: Identify local code requirements and report to owner to discuss changes
• Site Adapt: Make changes based on local requirements
• Represent / Negotiate: Liaise with AHJs on behalf of client to provide reasonable outcomes
• Execute: Implement design changes clearly to ensure smooth construction delivery
Fire and Life Safety Strategies and Goals
Themes an owner should keep in mind as you select applicable codes
and standards and make design choices
Protect People and Right-size fire Implement processes to Operate and Maintain
Property protection design allow construction at scale FLS systems efficiently
High-Piled Storage
Mechanical Equipment
Occupants
Generally, the total occupant count within a data center is relatively
low. Often Group B / Business occupant load factors are used and
egress is sized accordingly.
Considerations
• Data Centers rooms are often empty and
generally do not contain main occupants
• Should you ask design per expected occupants
or use code provided guidelines?
• Data hall fire barrier separations
• Ongoing rounds, ongoing construction, ongoing
maintenance
• Provide extinguishers / provide pull stations?
• How to report fires (radios or equiv)
• Security / Locking arrangements
Common Risks to Consider
Uptime is important to maintain in a mission critical environment to
provide continuity of service
Risk Mitigation
• Leak Detection / Corrosion Plans
• Equipment Redundancy / Region ‘drain’ plans
• Redundant cooling equipment
• Fire detection strategies (VESDA)
• Partial Evac / Positive Alarm / FA Monitoring strategy
Energy Storage Systems
Ongoing code and standard updates are
changing ESS design and applications
Considerations
• UL 9540A testing results?
• IFC 1206 and NFPA 855 updates / applicability
• Increased sprinkler density?
• Changed detection strategies?
• Thermal Runaway management equipment improvements?
• Different chemical options?
• Room fire separation ratings?
• Fire fighter response plans?
• Alternate fire suppression types?
Normal and Maximum Loss Scenarios
Insurance carriers review the design and also inspect operating data
centers to evaluate loss potential.
Process
• Identify potential fire scenarios and hypothesize potential outcomes
• Assign likely events that would ignite a fire
• Assign assumptions of detection / suppression success or failure
• Assign assumptions to FD response time
• Consider some aid from passive fire protection
• Downtime and Business Interruption considered
Outcome
• Dollar value estimates of loss from fire damage
• Identification of large hazards/risk scenarios Possible Scenarios
• Comparison to insurance premiums for business use • Complete Building loss?
• Ongoing inspections to ensure FLS systems in working order • Complete Data Hall loss?
• Entire Hot-Aisle loss?
• Individual rack and adjacent rack loss?
5 Fire Suppression Considerations
Water Supply
Water supply is the backbone of fire suppression systems.
Ensure it is adequate and reliable.
Connections to Public Main
• What supply is available?
• Redundant Connections?
• Metering / Backflow prevention Strategy?
• Water mains dedicated for fire or combined with others?
Pump Options
• Redundant Pumps? In separate rooms or structures?
• Diversification of Pump driver? Electric and/or Diesel?
• Oversizing pumps for future demand? Factors of Safety?
• Emergency Bypass?
Water Supply – Simultaneous Demand
Consider all the demands on your water system when considering your
water mains. Cooling water demands at a Data Center may exceed fire
water demand.
Preaction
• Non, Single, Double interlock choice
• More expensive components, more complex operation
• Lower risk of inadvertent water discharge
• Will require detection throughout coverage area
Dry
• Exterior canopies/coverings/loading dock
• Areas exposed to ambient temperature (freezing)
• Non-critical areas
Sprinkler System Zoning
Find balance in sizing your sprinkler zones between maximizing allowed coverage
areas with operational needs, testing, and maintenance in mind
Considerations
• Max size generally 52,000 SF
• Consider water delivery times
• Consider isolation points
• Consider how outages are handled
(one datahall at a time)
• Consider construction phasing
• Consider cost/maintenance of
additional valve risers
• Consider riser room locations to help
with hydraulically
• Consider long wet-runs between riser
rooms
Sprinkler System – Pipe Corrosion
What means are available for limiting pipe corrosion of your sprinkler
systems? What are the cost / O&M trade offs?
Considerations
• Pipe Schedule – Sched 40 / 10
• Pipe Material – Galvanized v. Black Steel
• Nitrogen Generator Systems
• NG on wet and/or dry systems?
• Water quality analysis
• Corrosion monitoring plans
• Redundant air compressors and/or nitrogen generators
• Ensuring Nitrogen Purity
Sprinkler System – Pipe Support
Some movement is expected in sprinkler piping, especially during
testing. But how much is too much? Are issues related to design,
construction quality, or maintenance?
Considerations
• Require Seismic Bracing
• Require additional bracing on mains/large pipes?
• Eliminating long runs
• Pipe elevations / bracing length
• Expansion joints / allowing for movement
• Construction quality and attention to detail
• Breaking hangers/couplings
• Broken dry-wall, hitting other pipes/services
• Testing procedures
• Expansion tanks
• Stability of water supply
Sprinkler System – Exemptions / Obstructions
Where are additional sprinklers needed? Are the standards adequate in
addressing them? Do your design documents provide enough direction?
Considerations
• Common sprinkler exemptions
• Non-combustible concealed space
• Width of hot-aisles
• Contents of return plenums
• Loading docks
• Building overhangs
• Cloud ceilings
• Openings in ceilings
• Large ductwork
• Cable Trays
• Supply shaft target plates
• Stairwells (enclosed?)
Sprinkler System – Activation Temp
Some areas of data centers may reach temperatures higher than
expected. And new hardware is running at higher temperature due to
shorter life cycles.
Considerations
• Areas exposed to the elements
• Hot-aisle discharge temperature
• Construction phasing
• Construction equipment storage
• 50deg above maximum expected ambient
• Can you be too conservative?
Clean Agents?
While clean agent is effective in suppressing fire in electronics. Is it
worth it?
Considerations
• Clean agent / gaseous has only 10 minute hold time
• Response time and de-energizing
• Clean up / human interactions with the agent
• Leakage and achieving hold time
• What equipment are you really saving
• High capital cost
• Would / could you use in lieu of sprinklers?
• Testing complexity / false dumps cost
• Future environmental regulations
Fire Suppression Maintenance
How should a large facility handle maintenance of their suppression
systems? How are impairments addressed? How do design decisions
help or hurt?
Considerations
• Consider how typical outages occur
• What are operational procedures when fire systems are down
• What is the impact / availability of fire watch
• How fast can you repair systems
• Managing multiple vendors / FA coordination
• Safety procedures – LOTO
• # of zones and amount of FA device (cross-zone)
• Preaction testing means and frequency (corrosion)
• Drainage of sprinkler systems
6 Fire Alarm Design
Considerations
Fire Alarm – Graphics Workstation
Workstations provide improved awareness and control of a large facility.
Do you need one? How many?
Considerations
• Locate with 24/7 monitoring
• Locate where O&M staff is located
• Locate in each building, or only in admin areas?
• Test during Cx to ensure shop drawings match plans
• Program by-pass functions
• Consider VESDA VSM4 software
Fire Alarm – Monitoring
Fire alarm systems are required to be monitored, but to what extent?
Are false alarms ruining your relationship with your FD? Do you want
your safety issues broadcasted outside your walls?
Considerations
• Local AHJ requirements to send signals offsite
• Ability of staff to respond and have training
• Ensure 24/7 staffed operation
• Pre-plan fire department response and escorts
• Consider which technology to use
• Cell Signal
• Wi-Fi
• VoIP
• Ethernet connection
• POTS
• Consider the level of detail transmitted
• Full alarm signals
• Only the basic three (fire, supervisory, trouble) with dry
contacts
Fire Alarm – Network Topology
Larger buildings and campuses cannot be supported by a single fire
alarm panel. When you have multiple, how do you want them
connected?
Considerations
• Star, Ring, Multi-Ring
• Fiber and/or copper segments
• Class N, A, B
• Choose with construction phasing in-mind
• Coordinate with fiber provider
• Consider loss of pathway scenarios
• Class A/X separation requirements
Fire Alarm – Voice v. Horn/Strobe
There is a cost trade-off between voice systems and basic
horn/strobes. Is including voice worth it?
Considerations
• Cost savings to be gained
• No amplifiers, voice command center
• No extra audio circuits
• Less battery demand
• Voice provides ability for enhanced messaging / direction
• Ability for first-responders to utilize
• Networked Voice v. voice control per building
• Pre-recorded messages v. live messaging
• Non-fire emergency messages
• ‘All Clear’ messaging
Fire Alarm – Pull Stations
Pull stations are useful in alerting the presence of fire manually? But
can you save resources by not providing them? Are there other means
available? Is it a security risk?
Considerations
• Code will permit a single pull station for a sprinklered building
• Would one be satisfactory, or perhaps need them in security areas also
• Consider only at exterior exit doors, and not within interior rooms.
• Lessen chance of false alarms, both nuisance and intentional
• Some cost savings
• Lose ability to quickly alert fire. Less familiar visitors lack means to signal fire.
• Lessens chance of bad actor using to funnel employees outside or to
concentrated area
• Local codes may require additional pull stations
Fire Alarm – Detection Types
Smoke detection is excellent at detecting electronics fires in their early
stages. But should it be used everywhere?
Considerations
• Utilize smoke detection in areas with critical equipment
• What is critical equipment to the owner?
• Utilize linear heat detection in less important and/or dirtier environments
• Ensure to provide code required smoke detectors
• Above panels
• Elevator coordination
• Question whether full coverage is necessary
• Ensure duct detectors can be installed per manufacturer requirements (ie
with correct airflow and distance of straight run of ductwork)
• Perform cost/benefit of spot type v. air-aspirating detection
• Ensure detection devices are accessible and able to be tested and
maintained
• Consider need to cross-zone and/or double detection need
Fire Alarm – Cross-Zoning, Preaction Interlocks
What type of detection goes along with your preaction system? Do you
need redundant detectors and/or cross-zoning? How much delay into
your activation time is acceptable?
Considerations
• Cross-zoning will result in many additional detectors
• Cross-zoning v. any two detector logic
• Consider small rooms where only one device would be sufficient (ie
bathrooms, small storage)
• Cross-zoning does decreasex likelihood of accidental system trip
• But it significantly slows sprinkler response
Fire Alarm – VESDA Considerations
Consider the design options when installing VESDA. What level of
sensitivity and response time do you really need?
Considerations
• Standard, Early, Very Early Warning selection
• Transport Time (60, 90, 120)
• Sector Addressability
• Hole Spacing / Sensitivity
• Consider air velocity
• Plan for VESDA exhaust location
• # of sampling holes per unit (total coverage area)
• WiFi equipped equipment (NetSec)
• Use in areas with congested ceilings
• Ensure applications merit the device expense. Do
not install VESDA at all possible locations
• Understand airflow path to ensure complete
detection and avoid doubling detection
Fire Alarm – VESDA Testing
What types of test are required for VESDA installation and what do the
results tell you? Does ‘performance’ testing help?
Considerations
• Test for transport times by injecting smoke into last sampling on each tube;
• Install benchmark test points and record data
• Test all output functions with fire alarm matrix
• Test HLI signals that are provided (depends on OEM used)
• Ensure all alert levels are functioning
• Test power supplies and troubles
• Confirm design is installed per drawings/calculations
• VESDA hot-wire test
• Simulate an smoldering electronic fire
• Test for VESDA response with actual design conditions
Considerations
• Consider Partial Evacuation
• Consider Positive Alarm
• Ensure AHJ approval of partial evac
• Make sure to agree on survivability requirements
• 2-HR rooms, CI cable, etc.
• Identify circuits/panels are protected
• Complete evacuation of a ~900,000 SF facility seems
unnecessary
• Consider Evac by data hall or data bar or admin
• Each full building evacuation interrupts operations and
is a risk of injury
Fire Alarm – Circuit Classifications
What types of performance do you want from your fire alarm circuits?
How fast are you able to address issues? Is t-tapping a concern for you?
Considerations
• Construction phasing and temporary wiring to maintain Class A
• Avoid return loop wiring with Class B
• Class A keeps loop continuity through open
• To use circuit isolation modules or not? To limit short circuit damage.
• How fast can your organization fix breaks?
• What happens operationally when you lose portions of circuits?
• Class B introduces potential for t-tapping mess which may slow
troubleshooting
• Ensure t-taps are marked on drawings or only in known/obvious
locations
• Ensure QA/QC of installing contractor understanding for circuit
requirements. i.e. electric contractor pulling wire/conduit while FA
contractor does final connection/programming
Fire Alarm – HVAC Shutdowns / Dampers
Keeping airflow moving in a data center is critical to its operation. But
what is the trade off with addressing smoke migration?
Considerations
• Ensure to follow local mechanical codes on shutdown requirements
• Operators may have a risk decision to make to keep cooling or allow
smoke to migrate
• Fire barriers help reduce migration of smoke
• Keep note of exceptions to shutdown in areas where smoke is not able
to transport to other portions of the building
• Each fire/smoke damper is significant added capital and total cost of
ownership. Do you follow NFPA 75 guidance to have one all fire rated
construction?
• Provide test switches in accessible areas
• Provide FA bypasses for disabling functions to aid maintenance
• Consider wild-fire effects
Fire Alarm – Mass Notification (other emergencies)
Is your fire alarm system only designed to address fire issues? Or do you
want the ability to do additional safety messaging?
Considerations
• Wide area alert, is it needed for your site?
• Roof or yard coverage areas?
• Cell phone, emails, other messaging
• LED text signs, do they provide value on major egress routes?
• Value in providing emergency messaging solution that meets NFPA 72
standards v. an ad-hoc solution
• Do different color strobes provide value? Do occupants understand
them?
• Security
• Fire
• Weather
• All Clear
• Testing
Fire Alarm – Ambient Sound Levels
Decide where intelligibility may be useful and your chances of
achieving it. Also note some new service types with AI/ML are getting
louder
Considerations
• Ensure audibility requirements are met
• Use full coverage visual as backup
• Decide where intelligibility is needed or not
• Sound is louder near supply air entrances
• Different rack hardware will have ambient
noise levels
• NFPA 72 does not provide good guidance on
anticipated dB levels in data halls
• Adjust wattage taps as appropriate for
louder areas
• dB ranges from low 60s to low 80s
7 Q&A