Docu47591 PDF
Docu47591 PDF
Docu47591 PDF
Rev 02
Copyright © 2013 EMC Corporation. All rights reserved. Published in the USA.
EMC believes the information in this publication is accurate as of its publication date. The
information is subject to change without notice.
The information in this publication is provided as is. EMC Corporation makes no representations or
warranties of any kind with respect to the information in this publication, and specifically disclaims
implied warranties of merchantability or fitness for a particular purpose. Use, copying, and
distribution of any EMC software described in this publication requires an applicable software
license.
EMC2, EMC, and the EMC logo are registered trademarks or trademarks of EMC Corporation in the
United States and other countries. All other trademarks used herein are the property of their
respective owners.
For the most up-to-date regulatory document for your product line, go to EMC Online Support.
Preface
Audience............................................................................................... 11
Related documentation ......................................................................... 11
Chapter 8 Security
Audit logs ................................................................................................... 85
Symmetrix audit log .............................................................................. 85
Audit Integration with RSA enVision ............................................................ 86
RSA enVision configuration considerations ........................................... 86
Data erasure ............................................................................................... 86
IPv6 and IPsec support ............................................................................... 87
Symmetrix Access Controls.......................................................................... 87
Symmetrix Data at Rest Encryption .............................................................. 88
External Enterprise Key Manager ........................................................... 88
Symmetrix Service Credential, Secured by RSA ............................................ 89
User authorization controls ......................................................................... 90
Title Page
1 Auto-provisioning Groups............................................................................................ 32
2 Thin pool (balanced) ................................................................................................... 35
3 Thin pool (unbalanced) ............................................................................................... 35
4 Thin pool (rebalanced) ................................................................................................ 36
5 FAST configuration example ........................................................................................ 39
6 FAST VP Configuration example ................................................................................... 42
7 The permanent sparing process .................................................................................. 46
8 RecoverPoint configurations........................................................................................ 50
9 z/OS IEA480E service alert error message format (AC power failure)............................ 66
10 z/OS IEA480E service alert error message format (mirror-1 volume in “not ready” state) ...
66
11 z/OS IEA480E service alert error message format (mirror-2 resynchronization) ............ 66
12 z/OS IEA480E service alert error message format (mirror-1 resynchronization) ............ 67
13 FTS configuration - fabric............................................................................................. 74
14 FTS configuration - arbitrated loops ............................................................................. 75
Title Page
As part of an effort to improve its product lines, EMC periodically releases revisions of its
software and hardware. Therefore, some functions described in this document might not
be supported by all versions of the software or hardware currently in use. The product
release notes provide the most up-to-date information on product features.
Contact your EMC representative if a product does not function properly or does not
function as described in this document.
Note: This document was accurate at publication time. New versions of this document
might be released on EMC Online Support https://support.EMC.com. Check to ensure that
you are using the latest version of this document.
Audience
This manual provides information about EMC® Symmetrix® VMAX® 10K (SN xxx987xxxx),
VMAX® 20K, and VMAX® 40K systems running Enginuity™ operating environment. This
document is intended for use by customers or EMC representatives who wish to
understand the offerings for Symmetrix systems.
Note: The VMAX® 10K (SN xxx987xxxx) is referred to in the rest of the guide as VMAX 10K.
Related documentation
The following documentation portfolios contain documents related to the hardware
platform and manuals needed to manage your Symmetrix software and storage system
configuration. Also listed are documents for external components which interact with your
Symmetrix system.
RecoverPoint
◆ RecoverPoint x.x Documentation Set — Contains the RecoverPoint documentation set,
including: Release Notes, Administrator's Guide, CLI Reference Guide, Security
Configuration Guide, Glossary of Terms, Deployment Manager Product Guide, and
Deployment Manager Release Notes.
◆ EMC® RecoverPoint Deploying with Symmetrix Arrays and Splitter Technical Notes —
Provides information, required procedures, and best practices for deploying
RecoverPoint with Symmetrix arrays and splitter.
Typographical conventions
EMC uses the following type style conventions in this guide.
Normal font In running text:
• Interface elements (for example, button names, dialog box names)
outside of procedures
• Items that user selects outside of procedures
• Java classes and interface names
• Names of resources, attributes, pools, Boolean expressions, buttons,
DQL statements, keywords, clauses, environment variables, filenames,
functions, menu names, utilities
• Pathnames, URLs, filenames, directory names, computer names, links,
groups, service keys, file systems, environment variables, notifications
Bold In procedures:
• Names of dialog boxes, buttons, icons, menus, fields
• Selections from the user interface, including menu items and field
entries
• Key names
• Window names
In running text:
• Command names, daemons, options, programs, processes,
notifications, system calls, man pages, services, applications, utilities,
kernels
Italic Used for:
• Full publications titles referenced in text
• Unique word usage in text
Note: To open a service request through the EMC Online Support site, you must have a
valid support agreement. Contact your EMC sales representative for details about
obtaining a valid support agreement or to answer any questions about your account.
Product information
For documentation, release notes, software updates, or for information about EMC
products, licensing, and service, go to EMC Online Support (registration required) at:
http://support.EMC.com
Technical support
EMC offers a variety of support options.
Support by Product — EMC offers consolidated, product-specific information on the Web
at:
https://support.EMC.com/products
The Support by Product web pages offer quick links to Documentation, White Papers,
Advisories (such as frequently used Knowledgebase articles), and Downloads, as well as
more dynamic content, such as presentations, discussion, relevant Customer Support
Forum entries, and a link to EMC Live Chat.
EMC Live Chat — Open a Chat or instant message session with an EMC Customer Engineer
(CE).
eLicensing support
To activate your entitlements and obtain your Symmetrix license files, visit the Service
Center on http://support.EMC.com, as directed on your License Authorization Code (LAC)
letter e-mailed to you.
For help with missing or incorrect entitlements after activation (that is, expected
functionality remains unavailable because it is not licensed), contact your EMC Account
Representative or Authorized Reseller.
For help with any errors applying license files through Solutions Enabler, contact the EMC
Customer Support Center.
If you are missing a LAC letter, or require further instructions on activating your licenses
through the Online Support site, contact EMC's worldwide Licensing team at
licensing@emc.com or call:
◆ North America, Latin America, APJK, Australia, New Zealand: SVC4EMC
(800-782-4362) and follow the voice prompts.
◆ EMEA: +353 (0) 21 4879862 and follow the voice prompts.
Your comments
Your suggestions will help us continue to improve the accuracy, organization, and overall
quality of the user publications. Send your opinions of this document to:
techpubcomments@emc.com
01 Initial release of combined Symmetrix VMAX 10K, 20K and 40K systems 5876 to 5876 Q2 2013 SR
running Enginuity Operating System.
02 Addition of VMAX 10K File and 16 Gb/s Front End I/O module. 5876 to 5876 Q2 2013 SR
The EMC® VMAX® Family of enterprise storage systems offers the world's most
comprehensive range of storage solutions for enterprises of all sizes. The VMAX family
includes:
◆ The EMC® Symmetrix® VMAX® 10K scales from a single VMAX 10K engine in one
system bay with no storage bays to a four VMAX 10K engines in four system bays and
two additional storage bays. The high density configuration supports only four system
bays.
◆ The EMC® Symmetrix® VMAX® 20K scales from a single VMAX 20K engine system with
one standard storage bay to a large eight engine system with a maximum of ten
standard storage bays for standard configurations and a maximum of one system bay
and eight high density storage bays for high density configurations.
◆ The EMC® Symmetrix® VMAX® 40K scales from one to eight VMAX 40K engines with
one system bay and up to ten standard storage bays for standard configurations and a
maximum configuration of one system bay and eight high density storage bays for
high density configurations. The VMAX 40K also offers the ability to mix standard and
high density drives within a system.
This chapter introduces the EMC Symmetrix VMAX 10K, VMAX 20K, and VMAX 40K systems
with Enginuity™ operating environment.
◆ Symmetrix VMAX family comparison........................................................................ 16
◆ eLicensing .............................................................................................................. 18
◆ System capacities ................................................................................................... 19
◆ Host and External Connectivity ................................................................................ 21
◆ External connections............................................................................................... 24
Architecture • VMAX 10K Engine • VMAX 20K Engine • VMAX 40K Engine
• Dual Virtual Matrix Architecture • Dual Virtual Matrix Architecture • Quad Virtual Matrix Architecture
• Remote support • Remote support • Remote support
Connectivity FC, 16 Gb FC, 1GbE, 10GbE, 10 FC, FICON, 1GbE, 10GbE, 10 Gb/s, FC, 16 Gb FC, FICON, 1GbE, 10GbE,
Gb/s, FCoE, iSCSI FCoE, iSCSI 10 Gb/s, FCoE, iSCSI
Hardware System securing kits, Topside cable System securing kits, Symmetrix silencer, Topside cable routing kit
options routing kit
Mainframe No Yes
support
IBM i IBM i 512-byte D910 IBM i 512-byte D910, IBM 2107
Federated Live Migration, Federated Tiered Storage, EMC Open Replicator, EMC Open Migrator/LM, PowerPath,
Data Migration PowerPath Migration Enabler, PowerPath SE
Management Solutions Enabler, Unisphere for MainFrame Enabler, Solutions Enabler, Unisphere for VMAX
tools VMAX
RAID protections RAID 1, RAID 5 (3+1), RAID 5 (7+1), RAID 1, RAID 5 (3+1), RAID 5 (7+1), RAID 6 (6+2), RAID 6 (14+2), RAID 10
RAID 6 (6+2), RAID 6 (14+2)
Security Audit Logs, Data Erasure, IPsec security features, Symmetrix Access Controls, Symmetrix Data at Rest Encryption,
Symmetrix Service Credential, Secure by RSA, User Authorization Controls
VMAX 10K
The EMC Symmetrix VMAX 10K with Enginuity is a multi-controller, scale-out architecture
with consolidation and efficiency for the enterprise that can non-disruptively scale from
one to four VMAX 10K Engines. The maximum standard configuration consists of four
system bays and two storage bays while the maximum high density configuration consists
of four system bays only.
Symmetrix VMAX 10K systems are available with standard 3.5” drives or high-density 2.5”
mixed within a storage bay.
Symmetrix VMAX 10K dispersed system bays allow a single VMAX 10K to be separated
across two locations by up to 32 feet 10 inches (10 meters) enabling deployment in dense
data center environments where floor loading and other physical limitations and
obstructions would otherwise limit configurations.
Note: Depending on your geographical area, the VMAX 10K may support different
hardware configurations. Contact your EMC representative for more information.
VMAX 20K
The EMC Symmetrix VMAX 20K with Enginuity is a distributed multi-engine storage system
that can non-disruptively scale from one to eight VMAX 20K Engines. The maximum
standard configuration consists of one system bay and ten storage bays while the
maximum high density configuration consists of one system bay and eight storage bays
with both configurations allowing for the integration of either standard 3.5” drives or
high-density 2.5” drives for space or power constrained data centers.
With Enginuity 5876 Q1 2013 SR, the VMAX 20K supports the ability to mix standard and
high density drives within a system.
VMAX 40K
The EMC Symmetrix VMAX 40K with Enginuity is a distributed multi-engine storage system
that can non-disruptively scale from one to eight VMAX 40K Engines. The maximum
standard configuration consists of one system bay and ten standard storage bays while
the maximum high density configuration consists of one system bay and eight high
density storage bays with both configurations allowing for the integration of either
standard 3.5” drives or high-density 2.5” drives.
With Enginuity 5876 Q4 2012 SR, the VMAX 40K supports the ability to mix standard and
high density drives within a system but not within the same storage bay
Symmetrix VMAX 40K dispersed system bays allow a single VMAX 40K to be separated
across two locations by up to 82 feet (25 meters) enabling deployment in dense data
center environments where floor loading and other physical limitations and obstructions
would otherwise limit configurations.
eLicensing
Each Symmetrix system requires a license file that is installed during system installation.
The license file contains all the licensed entitlements purchased for the systems, as well
as entitled capacity associated with those entitlements. A License Activation Code (LAC) is
created and sent as part of the ordering and shipping process.
Once the installation is complete, licensed entitlements can be viewed, managed or
activated by using the Unisphere for VMAX, Solutions Enabler CLI, or Mainframe Enabler
CLI.
System capacities
Symmetrix VMAX systems are expanded by adding engines, disk array enclosures, and
physical memory.
VMAX 10K
Table 3 on page 19 provides VMAX 10K system capacity details.
FC
Back End Min Min Max Max Max Max Max Max
Engines Ports Drivesb TBuc Drives TBud Drives TBuc Drives TBuc
System capacities 19
Symmetrix VMAX Family Overview
VMAX 20K
Table 4 on page 20 provides VMAX 20K system capacity details.
Extended
Standard 3.5” Dense 2.5” Drive
FC Back Min
Engines End Ports Drivesa Min TBub Max Drives Max TBuc Max Drives Max TBuc Max TBuc
VMAX 40K
Table 5 on page 20 provides VMAX 40K system capacity details.
FC Back End
Engines Ports Min Drivesa Min TBub Max Drives Max TBuc Max Drives Max TBuc
Table 6 Front End I/O module for host connectivity per engine
• FC (up to 8 ports, 16 Gb/s) • FC SRDF (up to 8 ports, 2, 4, 8 Gb/s) • FC (up to 8 ports, 16 Gb/s)
• FC (up to 16 ports, 2, 4, 8 Gb/s) • FC (up to 16 ports, 2, 4, 8 Gb/s) • FC (up to 16 ports, 2, 4, 8 Gb/s)
• FC SRDF (up to 8 ports, 2, 4, 8 Gb/s) • FCoE (up to 8 ports, 10 Gb/s) • FC SRDF (up to 8 ports, 2, 4, 8 Gb/s)
• FCoE (up to 8 ports, 10 Gb/s) • FICON (up to 8 ports, 8 Gb/s) • FCoE (up to 8 ports, 10 Gb/s)
• GbE SRDF (up to 8 ports, 1 Gb/s) • GbE SRDF (up to 8 ports, 1 Gb/s) • FICON (up to 8 ports, 8 Gb/s)
• GbE SRDF (up to 8 ports, 10 Gb/s) • GbE SRDF (up to 8 ports, 10 Gb/s) • GbE SRDF (up to 8 ports, 1 Gb/s)
• iSCSI (up to 8 ports, 1 Gb/s) • iSCSI (up to 8 ports, 1 Gb/s) • GbE SRDF (up to 8 ports, 10 Gb/s)
• iSCSI (up to 8 ports, 10 Gb/s) • iSCSI (up to 8 ports, 10 Gb/s) • iSCSI (up to 8 ports, 1 Gb/s)
• iSCSI (up to 8 ports, 10 Gb/s)
a. The VMAX 10K can support either two or four front end I/O modules depending on your geographical area. Contact your EMC representative
for more information.
Hosts Portsa
Total 10 Gb 10 Gb 1 Gb
Module Typesb Ports 16 Gb FC 4 Gb FC 8 Gb FC FCoE iSCSI iSCSI
4 Gb FC 16 16
8 Gb FC 16 16
16 Gb FC 8 8
1 GbE 8 8
Hosts Portsa
Total 10 Gb 10 Gb 1 Gb
Module Typesb Ports 16 Gb FC 4 Gb FC 8 Gb FC FCoE iSCSI iSCSI
8
10 GbE 8
4 4
8
4 Gb FC/1 GbE 12 8 4
12 8 4
4 Gb FC/ 10 GbE
12 8 4
4 Gb FC/ 8 Gb FC 16 8 8
8 Gb FC/1 GbE 12 8 4
8 Gb FC/ 10 GbE 12 8 4
12 8 4
16 Gb FC/ 1GbE 8 4 4
16 Gb FC/ 10 GbE 8 4 4 4
8 4 4 4
8 4 4
a. Fibre Channel is available with single mode and multimode ports. SRDF is supported over Fibre Channel single mode and
multimode ports.
b. Availability may vary depending on the geographical area. Contact your EMC representative for more information.
Table 8 Symmetrix VMAX 20K and 40K typical and mixed configurations
Typical configurations
16 16
8 Gb FC
14 12 2
12 8 4
16 Gb FCd 8 8
FICON 8 8
Table 8 Symmetrix VMAX 20K and 40K typical and mixed configurations
8 8
1 GbE
8 6 2
8 4 4
8 8
8 8
10 GbE 8 4 4
8 6 2
8 4 4
Mixed configurations
12 8 4
FC 8 Gb/FICON
10 4 4 2
8 4 4
12 8 4
FC/1 GbE
12 8 2 2
8 4 4
12 8 4
FC/10 GbE
12 8 4
FC 16 Gb/FICONd 8 4 4
FC 16 Gb/1 GbEd 8 4 4
FC 16Gb/10 GbEd 8 4 4 2
FC 16 Gb/1 GbEd 8 4 4
8 4 4
FICON/1 GbE
8 4 2 2
8 4
8 4 4
FICON/10 GbE
8 4 4
Table 8 Symmetrix VMAX 20K and 40K typical and mixed configurations
8 4 4
iSCSI/1 GbE 8 4
8 4 4
8 4 4
iSCSI/10 GbE 8 4 4
8 4 4
a. FCoE is supported on 10 GbE Front End I/O Modules only. It is not supported on 1 GbE Front End I/O Modules.
b. IPsec is available on 1 GbE Front End I/O Modules.
c. SRDF is supported on both Fibre Channel (8 Gb) and Ethernet Front End I/O Modules.
d. Supported in VMAX 40K only.
External connections
Symmetrix systems support Federated Tiered Storage (FTS) which provides the ability to
attach external storage to a Symmetrix system through Fibre Channel Front End I/O
modules and ports. FTS requires Enginuity emulation type (DX). DX emulations are
configured in pairs, with each DX emulation associated to two front-end ports, thus
consuming four front-end ports per DX pairs. DX emulations are back-end connections and
are not used to connect to hosts. “Federated Tiered Storage” on page 73 outlines how FTS
works.
The EMC Symmetrix VMAX Family Documentation Portfolio provides front-end port layout
diagrams outlining FTS and DX emulation information.
The Symmetrix VMAX architecture provides a storage subsystem that can scale beyond the
confines of a single system footprint. The core element of the VMAX architecture is the
Symmetrix VMAX 10K, VMAX 20K, or VMAX 40K Engine, which includes high-availability
(HA) directors with either Dual or Quad Virtual Matrix™ Architecture.
This chapter discusses the VMAX architecture. Topics include:
◆ The Engine .............................................................................................................. 25
◆ The Virtual Matrix Architecture ................................................................................ 26
◆ Disk array enclosures .............................................................................................. 27
◆ The Service Processor ............................................................................................. 28
◆ Supported disk drives ............................................................................................. 28
The Engine
The Symmetrix VMAX 10K, VMAX 20K, or VMAX 40K engine is a system bay component
that provides physical memory, back-end connectivity, front-end host connectivity, and
connectivity to other engines. The engine contains two integrated, highly-available
Symmetrix directors. Each Symmetrix director contains a CPU complex, protected global
memory, and dual-interfaces to either a Dual or Quad Virtual Matrix Architecture™.
Table 9 lists the details per engine supported in each Symmetrix system.
VMAX 10Ka Two six-core 2.8 GHz Intel XEON processors 24, 96 or 128 GB (512 GB maximum)
VMAX 20K Four quad-core 2.33 GHz Intel XEON processors 32, 64, or 128 GB (1 TB maximum)
VMAX 40K Four six-core 2.8 GHz Intel XEON processor 48, 96, 192 or 256 GB (2 TB maximum)
a. Depending on your geographical area, the VMAX 10K may support different hardware configurations. Contact your EMC
representative for more information.
Engine redundancy
The engines contain redundant management modules which provide environmental
monitoring. The power and cooling subsystems are also redundant allowing for
continuous availability.
Physical memory
Memory is accessible by any director within the system:
◆ If a system has a single engine, physical memory mirrors are internal to the enclosure.
◆ If a system has multiple engines, physical memory mirrors are provided between
enclosures.
Dual write technology is maintained by the system. In the event of a director and memory
failure, data is obtained from the redundant copy.
Back-end connections
Back End I/O Modules provide dual access across directors to each drive. One module
connects to one physical path to the drive and the other connects to a second physical
path. The I/O modules are responsible for moving data between physical memory and the
disks and, as such, are each connected to the physical memory through redundant
internal paths to eliminate any single points of failure.
Environmental monitoring
Under normal conditions, the monitoring and control for each engine is accomplished by
individual Management Modules by using an RS-232 and redundant Ethernet
communications. In the event of an Ethernet failure, the Management Modules use the
alternate Ethernet connection to transmit management traffic between directors to the
Service Processor.
Environmental monitoring
Remote notification enables EMC to monitor all environmental statuses reported by the
subsystems and for statuses to be collected by the Service Processor. If a failure occurs,
the Symmetrix system automatically activates redundant elements and the Service
Processor initiates a call-home request for service.
Note: EMC adds new and higher capacity drives on an ongoing basis, which may occur
after the release of published documentation.
The specification sheet for each system available on EMC ONE provides detailed
information on drive types, rotational speeds, and formatted capacities for Open Systems,
Mainframe, and IBM i series.
Flash drives
Flash drives greatly benefit applications with high transaction rates, such as trading
systems, that require the fastest data retrieval and storage. Flash drives also improve
performance in mixed workload environments, because they improve response time for
I/O activity even when placed on only a small, I/O-intense portion of the data set.
Flash drives are contained in the same 3.5 inch drive or 2.5 inch drive carriers as Fibre
Channel drives. However, because there are no mechanical components, Flash drives use
less energy and weigh less than traditional rotating disk drives. Flash drives appear as
Fibre Channel drives to existing Symmetrix system management tools. This allows the
management of Tier 0 storage without special tools.
Flash drives have the same RAID options as other supported drive types and can be used
as source and target devices for TimeFinder. You can migrate devices to and from Flash
drives.
On Symmetrix VMAX 20K and VMAX 40K systems you can configure metavolumes on Flash
drives as long as all of the logicals in the metagroup are on Flash drives.
Symmetrix systems provide software that helps optimize high-performance environments
that include Flash drives.
The EMC® Enginuity™ operating environment provides the intelligence that controls the
components in Symmetrix systems. Enginuity is a storage operating environment that
controls storage data flow.
Enginuity optimizes service levels required by high-end environments and is specialized
and specifically optimized for storage-based functions. It is driven by realtime events
related to the input and output of data. It applies self-optimizing intelligence to deliver the
ultimate performance, availability, and data integrity required in a platform for advanced
storage functionality.
This chapter provides an overview of features for simplified storage management and
provisioning. Topics include:
◆ Auto-provisioning Groups........................................................................................ 32
◆ Dynamic configuration changes............................................................................... 33
◆ Concurrent configuration changes ........................................................................... 33
◆ Virtual Provisioning ................................................................................................. 33
◆ Virtual Provisioning pool rebalancing ...................................................................... 35
◆ Fully Automated Storage Tiering .............................................................................. 37
◆ Fully Automated Storage Tiering for Virtual Pools..................................................... 39
◆ Enhanced Virtual LUN technology............................................................................ 43
◆ Virtual LUN Virtual Pool (VP) mobility....................................................................... 44
◆ Direct sparing ......................................................................................................... 44
◆ Permanent sparing.................................................................................................. 45
◆ Full spare coverage ................................................................................................. 47
◆ Data replication and Recovery software ................................................................... 47
◆ Performance considerations.................................................................................... 52
◆ Cache performance ................................................................................................. 54
◆ Disk optimization.................................................................................................... 55
◆ Tiered storage optimization..................................................................................... 56
◆ EMC XtremSW Cache ............................................................................................... 56
Auto-provisioning Groups
Auto-provisioning Groups on open systems make provisioning operations faster and
easier by allowing grouping of initiators, front-end ports, and devices together, and to
build masking views that associate the devices with the ports and initiators. When a
masking view is created, the necessary mapping and masking operations are performed
automatically to provision storage. Once a masking view has been created, any changes
to the grouping of initiators, ports, or storage devices are propagated throughout the view
and the mapping and masking are automatically updated as required. Auto-provisioning
Groups reduce complexity, execution time labor cost, and the risk of error.
Figure 1 on page 32 depicts the concept of Auto-provisioning Groups.
Masking view
Initiator group
VM 1 VM
VM 1 2 VM
VM 2 3 VM
VM 3 4
VM 4
HBA 22
HBA 33
HBA 44
HBA 11
ESX
HBA
HBA
HBA
HBA
2
1
Host initiators
Port group
Ports
dev
dev
dev dev
dev
dev
dev
dev
dev Storage group
Devices
SYM-002353
Virtual Provisioning
Symmetrix Virtual Provisioning improves storage capacity utilization and simplifies
storage management by allowing storage to be allocated and accessed on demand from a
pool of storage that services one or many applications. This type of storage has multiple
benefits:
◆ Enables LUNs to be “grown” into over time with no impact to the host or application as
space is added to the thin pool.
◆ Delivers space from the thin pool on demand.
◆ Provides wide striping for a thin pool.
◆ Relieves the storage administrator’s efforts of physical device/LUN configuration.
The Virtual Provisioning feature introduces three new concepts: thin devices, data devices,
and thin pools. Thin devices can be created with an inflated capacity, because the actual
storage space for the data written to the thin devices is on the data devices. In this way,
when additional storage is needed, more data devices can be created in the thin pool.
Virtual Provisioning simplifies data layout, with automated wide striping that provides
equivalent or potentially better performance than standard provisioning. Virtual
Provisioning is appropriate for all storage types in a tiered storage environment and
supports both local and remote replication with SRDF and TimeFinder.
Virtual provisioning provides the ability to persistently preallocate space. Extents that are
persistently preallocated are not reclaimed by a standard reclaim operation.
Note: Enginuity 5876 introduces the support for thin CKD 3390 and thin IBM i 512-byte
D910 devices. Enginuity 5876 Q2 2013 SR provides support of thin IBM i 512-byte D910
devices on VMAX 10K systems.
VP compression
5876 Q4 2012 SR introduces VP compression, allowing thin device data to be compressed
within a thin pool. Data may be compressed manually for an individual device or group of
devices, via Solutions Enabler or Unisphere for VMAX. Alternatively, inactive data may be
compressed automatically for thin devices that are managed by FAST VP.
In order for data to be compressed, the thin pool containing the data must be enabled for
compression. Only allocated extents are compressed. VP compression is supported on
FBA and CKD 3390 devices.
Thin devices
Thin devices, also known as VP devices (FBA and CKD), have no storage allocated to them
when they are created; rather storage is allocated on-demand from a “bound” thin pool.
The first write to a location in a thin device results in space being allocated on a data
device from the bound pool.
Data devices
Data devices are grouped in a thin pool and are dedicated to the purpose of providing the
actual physical storage used by thin devices. As with thin pools, data devices must have
identical device emulation type, reside on identical drive technologies, and use the same
RAID protection types, and drive technology.
Thin pool
A thin pool, also known as a VP pool, contains thin devices of identical emulation and
protection type, all of which reside on disks of the same technology type and speed.
When a write is performed to a portion of the thin device, the Symmetrix system allocates
a minimum allotment of physical storage from the pool and maps that storage to a region
of the thin device including the area targeted by the write. These storage allocation
operations are performed in small units of storage called thin device extents.
Symmetrix systems balance the allocation of extents across all the data devices in the
pool that are enabled and that have remaining unused capacity.
When a read is performed on a thin device, the data being read is retrieved from the
appropriate data device in the thin pool to which the thin device is bound. Reads directed
to an area of a thin device that has not been mapped do not trigger allocation operations.
The result of reading an unmapped block is that a block in which each byte is equal to zero
will be returned. When more storage is required to service existing or future thin devices,
data devices can be added to existing thin storage pools. New thin devices can also be
created and associated with existing thin pools.
A thin device can be presented for host use before all of the reported capacity of the
device has been mapped. If the reported capacities of the thin devices using a given pool
exceeds the pool available storage capacity, the thin device configuration is said to be
oversubscribed.
SYM-002362
The capacity becomes unbalanced when a new device is added to the pool, as shown in
Figure 3 on page 35. The older devices, which contain more data, no longer participate
equally when accepting new tracks.
SYM-002363
Figure 4 on page 36 shows the thin pool after rebalancing. By moving data to the new
devices, I/O activity is redistributed across the thin pool, allowing all devices to
participate equally.
SYM-002364
Space reclamation
Space reclamation allows the user to reclaim space already on a drive by deallocating data
chunks that contain all zeros on FBA devices. This is most effective when migrating from
standard, fully provisioned devices to thin devices.
With Enginuity 5876, space is reclaimed from CKD devices using a utility which processes
the VTOC and determines the location of the unused space. The Symmetrix system is then
instructed to deallocate the associated extents.
FAST on Symmetrix VMAX 20K and 40K FAST VP on Symmetrix VMAX 10K, 20K and 40K
Requires Solutions Enabler 7.1 and higher Requires Solutions Enabler 7.2 and higher
Requires Enginuity 5874 and higher Requires Enginuity 5875 and higher
Supports FBA and CKD device emulations • Supports FBA device emulation
• Enginuity 5876 supports thin CKD 3390 and thin
IBM i 512-byte D910 devices
• Enginuity 5876 Q2 2013 SR provides support of thin
IBM i 512-byte D910 devices on VMAX 10K systems
Disk group provisioning (DP) tiers: contain disk groups Virtual pool (VP) tiers: contain thin pools
DP modes: Auto Approve and User Approve VP modes: Auto Approve or None
User visible data movement plans and history No plans or history generated
Federated Tiered Storage (eDisks) not supported Supports Federated Tiered Storage (eDisks) with
Enginuity 5876
FAST VP compression not supported Supports FAST VP compression with Enginuity 5876 Q4
2012 SR and Solutions Enabler V7.5 and higher
Thin device/thin pool compression not supported Supports compression for thin devices and thin (VP)
pools with Enginuity 5876 Q4 2012 SR and Solutions
Enabler V7.5 and higher
Three tiers per policy supported Four tiers per policy supported with Enginuity 5876 Q4
2012 SR and Solutions Enabler V7.5 and higher
FAST configuration
FAST is available on systems with Flash, Fibre Channel, SAS, or SATA drives and is
supported on systems with two or three of these drive types. To configure the Symmetrix
system for FAST, the following actions are taken:
◆ Define Symmetrix tiers — A Symmetrix tier is a type of storage, and a set of resources
(disk groups/thin pools) from which the storage is selected.
◆ Define a FAST policy — A FAST policy groups Symmetrix tiers and assigns an upper
limit for each tier. The upper limit specifies how much of an associated storage group
can reside on the tier.
◆ Define storage groups — A storage group is a set of devices. A storage group is
associated with a FAST policy and assigned a priority. A storage group can only be
associated with one policy, however, one policy may be associated with many storage
groups.
The EMC Solutions Enabler Symmetrix Array Controls CLI Product Guide provides detailed
information about FAST commands and configuration.
Sample configuration
Figure 5 on page 39 shows a Symmetrix system after FAST configuration. The Symmetrix
system contains three storage tiers:
◆ PrimeTier contains drives that deliver the best performance
◆ WorkTier contains one high performance Fibre Channel disk group
◆ ArchiveTier contains high capacity SATA drives.
A percentage of the high performance Flash drives on PrimeTier is allocated to the storage
groups accessed by three applications:
◆ up to 50% of Exchange storage groups can be allocated to PrimeTier
◆ up to 50% of Oracle Finance storage groups can be allocated to PrimeTier
◆ up to 20% of Oracle Sales storage groups can be allocated to PrimeTier
20 %
OraSales
40 %
2 TB
40 %
Sales DB Policy
Configuration considerations
The following configuration considerations apply to systems that use FAST software:
◆ Symmetrix Optimizer is required.
◆ FAST systems must configure Dynamic Reallocation Volumes (DRVs) to ensure
sufficient space during swap operations. Symmetrix Optimizer uses DRVs to hold data
internally during the data swap. Systems without DRV devices that have insufficient
free space are degraded, and may be unable to complete a data swap.
Systems that use FAST software must follow the same DRV configuration requirements
as Symmetrix Optimizer.
◆ FAST operations are not supported on thin devices.
availability. With FAST VP, the data for a thin device may reside in its bound pool and
potentially in one or more other pools. The role of thin pools in FAST VP is analogous to the
role of disk groups in FAST. Both comprise the back-end storage available to devices under
FAST control.
Note: FAST VP with Enginuity 5875 supports FBA devices only. FAST VP with Enginuity
5876 supports thin CKD 3390, thin IBM i 512-byte D910 devices, and FTS.
Enginuity 5876 introduces Federated Tiered Storage (FTS) which allows the virtualization
of external storage as an external disk (eDisk). Adding the eDisk to the Symmetrix system
makes its capacity available to the system as an external spindle. The order for fastest to
slowest tiers is: EFD, FC, SATA.
Enginuity 5876 Q4 2012 SR allows the distinguishing between a local tier and an external
tier (where the thin pool resides on external storage). You can define an external tier as
EFD, FC, and SATA.
Enginuity 5876 Q4 2012 SR also allows FTS tiers to be associated with a technology type.
The technology associated with the FTS tier indicates to the FAST VP controller the
expected performance from the tier. This feature enables you to place the FTS tier at the
right location for the expected performance of the external tier.
FAST VP adds finer granularities of performance measurement and data movement as
small as 7.5 MB or ten 768K track groups. The data from a single thin device under FAST
control can be spread across multiple tiers. The FAST controller is free to relocate
individual chunks of a thin device, based on performance data gathered at the sub-LUN or
sub-volume level.
Systems that use FAST VP software can:
◆ Reduce acquisition costs by maximizing utilization of less expensive drives (SATA) for
infrequently used data
◆ Improve performance by optimizing data placement for high access requirements data
◆ Reduce overall operating costs and simplify management by consolidating systems,
using fewer drives, and reducing power, cooling, and floor space requirements
◆ Reduce the total cost of ownership by optimizing the performance of a tiered
Symmetrix system.
“Virtual Provisioning” on page 33 provides detailed information on thin devices and thin
pools.
Thin tiers
FAST VP adds a new type of tier, the thin tier which is a set of thin pools. A thin tier
consists of thin pools of the same type. To be a member of a thin tier, a thin pool must
contain only data devices that reside on tier technology type and match the tier protection
type.
FAST VP configuration
FAST VP is available on systems with Flash, Fibre Channel, SAS, or SATA drives and is
supported on systems with two or three of these drive types. To configure the Symmetrix
system for FAST VP, the following actions are taken:
◆ Define Symmetrix tiers — A Symmetrix tier is a type of storage and a set of resources
(disk groups/thin pools) from which the storage is selected. Tiers are a shared
resource.
Enginuity 5876 Q4 2012 SR supports up to four tiers, with the fourth tier being FTS,
per FAST VP policy.
◆ Define a FAST VP policy — A FAST VP policy groups Symmetrix tiers and assigns an
upper limit for each tier. The upper limit specifies how much of an associated storage
group can reside on the tier.
◆ Define storage groups — A storage group is a set of devices. A storage group is
associated with a FAST VP policy and assigned a priority. A storage group can only be
associated with one policy, however, one policy may be associated with many storage
groups.
In order to have different performance levels between storage groups, multiple policies
would share a tier. Policies would not be shared for one type of performance level. If the
performance level varies, two policies can be created, one which gives more percentage
and one with a smaller percentage to a Flash tier.
The EMC Solutions Enabler Symmetrix Array Controls CLI Product Guide provides detailed
information about FAST commands and configuration.
Sample configuration
Figure 6 on page 42 shows a Symmetrix system after FAST VP configuration. The
Symmetrix system contains three storage tiers:
◆ PrimeTier contains devices that deliver the best performance
◆ WorkTier contains one high performance Fibre Channel disk group
◆ ArchiveTier contains high capacity SATA drives.
A percentage of the high performance Flash drives on PrimeTier is allocated to the storage
groups accessed by three applications:
◆ up to 50% of Exchange storage groups can be allocated to PrimeTier
50 %
Exchange
50 % 1 TB
Exchange Policy
20 %
40 % OraSales
2 TB
40 %
PrimeTier RAID 5 (3+1) Sales DB Policy
1 TB Flash Pool 1
50 %
OraHR
100 % 1 TB
HR DB Policy
Allocation by policy
Introduced in Enginuity 5876, FAST VP will allow for allocations to come from any pool
contained within the tiers of the associated FAST VP policy. FAST VP will attempt to
allocate on an appropriate tier based on performance metrics and policies.
SRDF coordination
FAST VP is interoperable with SRDF solutions. The FAST VP software can act independently
on both the local and remote VMAX Family systems. With Enginuity version 5876 and EMC
host-based SRDF software, you can coordinate data movements on both sides of the SRDF
links in a two-site SRDF topology. With Enginuity 5876 Q2 2013 SR, this capability is
extended to multi-site SRDF topology.
FAST VP compression
FAST VP Compression allows for the automated, non-disruptive compression of inactive
thin device data for devices associated with a FAST VP policy. FAST VP is enabled at the
system level by setting the FAST VP Time to Compress control parameter. The time to
compress may be set between 40 and 400 days, or never – never means FAST VP will not
compress data. Data that is seen to be inactive for a period of time longer than the time to
compress will be considered eligible for automatic compression.
FAST VP Compression performs compression at the subLUN level. It requires that the FAST
VP policy contain a pool that has been enabled for compression.
The data of the Symmetrix device is then copied from the existing to the newly
associated storage. The storage originally associated with the Symmetrix device is
unassociated with it and associated with the target. All data on the target is cleared.
◆ When unconfigured storage is used — The system creates storage of the requested
protection and disk type and associates it with the Symmetrix device. The data is then
copied from the existing to the newly associated storage. The storage originally
associated with the Symmetrix device is deleted, thereby returning it to unconfigured
storage.
Configuration considerations
The following requirements apply to configurations that use Virtual LUN technology:
◆ Enginuity supports the migration of metadevices. However, an individual meta
member may not be specified as a volume for migration.
◆ Physical disks that contain the devices for migration (source) may not be specified as
a physical destination disk.
◆ Source and target devices for Virtual LUN technology migrations can be:
• Of any emulation type (FBA, CKD and IBM i Symmetrix device)
• On any supported drive type (Flash, Fibre Channel, SAS or SATA)
• Configured using RAID 1, RAID 5, or RAID 6.
◆ The source devices must be standard Symmetrix devices.
Direct sparing
Introduced in Enginuity 5876, Direct sparing allows for the invoked spare drive to be
added as another member of the RAID group. When rebuilding the data, the option to
directly copy the data from the failing drive to the invoked spare drive is supported. The
failing drive is removed only when the copy process is finished.
Direct sparing is used with protection types, RAID 1, RAID 5, and RAID 6. RAID 6 (14+2) is
not supported. RAID 6 (14+2) protection will be achieved via permanent sparing. Volumes
with SRDF connectivity may also take advantage of Direct sparing.
Direct sparing provides the following benefits:
◆ The Symmetrix system can copy the data from the failing RAID member (if available),
removing the need to read the data from all of the members and doing the rebuild.
Copying to the new RAID member is less CPU intensive.
◆ If a failure occurs in another member, the Symmetrix system can still recover the data
automatically from the failing member (if available).
◆ More than one spare for a RAID group is supported at the same time.
Permanent sparing
Symmetrix systems support permanent sparing, a process that automatically replaces a
failing drive with a spare drive. A Symmetrix system initiates sparing when certain errors
are detected, thereby reducing the amount of time that a failed or failing drive remains
active in the system.
Permanent sparing permanently replaces a failing drive with a spare drive through a
configuration change. Permanent sparing is used in conjunction with RAID 6 (14+2).
During permanent sparing, the Symmetrix system looks for a spare drive of the same block
size, capacity, and speed, in a good location, to permanently replace the failing drive.
Once a spare is identified, the permanent sparing process loads a new configuration file.
This reconfigures the logical devices from the failing drive onto the selected spare. The
configuration is locked during this change, which can take a few seconds to complete.
Data is then rebuilt onto the drive. The configuration is not locked during the rebuild
process, and the Symmetrix system continues to process I/Os as the highest priority.
The failed drive becomes a “not ready” spare in the spare pool. The “not ready”
designation ensures the drive will not be used for any subsequent sparing activity. The
“not ready” designation is removed when the drive is physically replaced, at which time it
is again available as a spare.
Permanent sparing 45
Enginuity Operating Environment
Data Flow
SYM-001874
Configuration considerations
Spare drives are required for every Symmetrix system configuration. The required number
of drives needed for spares is determined automatically when the EMC service
representative configures a new Symmetrix system or adds disk array enclosures to an
existing configuration. Spare drives are marked automatically and distributed among the
available directors. The EMC service representative can override automatic spare
placement to meet special configuration needs, or to manually configure an individual
spare or spares.
The amount and type of spare drives are calculated as follows:
◆ The required number of spares is based on drive type and is automatically configured
on ordering. The minimum number of spares required are:
• Four spare drives for VMAX 10K
• Eight spare drives for VMAX 20K and VMAX 40K
◆ Two spare drives for every 100 drives of a specific type are required.
◆ EMC determines the rules for the quantities and types of spares after careful analysis
of field data. However, these calculations are considered the minimum and additional
drives can be configured. To provide the best possible protection, consider
configuring spare drives on every loop and for every type of data drive in the loop.
Configurations with Flash drives must meet Flash drive requirements. “Flash drives” on
page 29 provides detailed information about configurations that use Flash drives as
spares.
TimeFinder
The TimeFinder family of products are Symmetrix local replication solutions designed to
nondisruptively create point-in-time copies of critical data. You can configure backup
sessions, initiate copies, and terminate TimeFinder operations from mainframe and open
systems controlling hosts using EMC Symmetrix host-based control software.
The TimeFinder local replication solutions include TimeFinder/Clone, TimeFinder/Snap,
and TimeFinder VP Snap. TimeFinder/Clone creates full-device and extent-level
point-in-time copies. TimeFinder/Snap creates pointer-based logical copies that consume
less storage space on physical drives. TimeFinder VP Snap provides the efficiency of Snap
technology with improved cache utilization and simplified pool management.
Note: VMAX 10K does not support TimeFinder/Snap, mainframe host environments, or
extent-level point-in-time copies.
Each solution guarantees high data availability. The source device is always available to
production applications. The target device becomes read/write enabled as soon as you
initiate the point-in-time copy. Host applications can therefore immediately access the
point-in-time image of critical data from the target device while TimeFinder copies data in
the background.
TimeFinder/Clone is suitable if:
◆ Full-volume copies are intended for recovery scenarios.
◆ Full-volume or extent-level point-in-time copies of production data have to be
immediately available to applications for activities such as reporting and testing.
◆ The majority of data on the production volumes changes between subsequent backup
sessions.
◆ Multiple copies of production data are needed, and you want to reduce disk
contention and improve data access speed to the production data.
TimeFinder/Snap is suitable if:
◆ Only a fraction of data on the production volumes changes between subsequent
backup sessions.
◆ Only a fraction of data on the production volumes frequently changes during the peak
I/O activity window when multiple point-in-time copies are required.
TimeFinder VP Snap is suitable if:
◆ You want to create space-efficient snaps for thin devices
◆ You want multiple sessions to share capacity allocations within a thin pool, thus
reducing the storage required for saved tracks.
TimeFinder includes the following features:
◆ Supports RAID 1, RAID 5, and RAID 6, and RAID 10 protection schemes.
TimeFinder VP Snap
Enginuity 5876 supports TimeFinder VP Snap. TimeFinder VP Snap leverages
TimeFinder/Clone technology to create space-efficient snaps for thin FBA devices by
allowing multiple sessions to share capacity allocations within a thin pool. VP Snap
provides the efficiency of Snap technology with improved cache utilization and simplified
pool management. With VP Snap, tracks can be stored in the same thin pool as the source,
or in another pool of your choice. Both the source device and the target device must be
thin devices. VP Snap is not supported on CKD devices.
Note: VP Snap source devices work with FAST VP, but shared data will not be moved.
RecoverPoint
Introduced in 5875 for VMAX 10K, and 5876 for VMAX 20K and VMAX 40K, EMC
RecoverPoint is a comprehensive data protection solution providing integrated continuous
data protection and remote replication to recover applications at any point in time and
provides disaster recovery. The integrated RecoverPoint splitter, which is enabled by
default, supports 4,096 LUNs and is an enhanced implementation of Open Replicator for
Symmetrix which has been designed to operate as a RecoverPoint write I/O splitter. This
RecoverPoint array-based splitter further enhances RecoverPoint’s existing array-based
splitting options for Symmetrix systems. The RecoverPoint array-based splitter requires
either:
◆ RecoverPoint/EX simplifies continuous data protection and replication using
array-based write splitting
◆ RecoverPoint/CL is the full-featured offering that adds support for heterogeneous
server and storage platforms
Local Data Corruption Protection, Disaster Recovery, Secondary Device Repurposing and
Data Migrations are primary instances for using RecoverPoint, which provides:
◆ Continuous data protection (CDP) — Provides block-level local replication between
LUNs in the same SAN using CDP technology that journals every write for later recovery
to any point in time
◆ Continuous remote replication (CRR) — Provides dynamic synchronous and
asynchronous block-level remote replication between LUNs in two different SANs
using near-CDP technology that journals groups of writes for later recovery to
significant points in time
◆ Concurrent local and remote data protection (CLR) — Provides both local replication
(CDP) and remote (CRR) block level replication.
RP RP
cluster cluster
Symmetrix Symmetrix
(RP splitter enabled) (RP splitter enabled)
ICO-IMG-000969
RecoverPoint systems support local replication of data that applications are writing over
Fibre Channel to SAN-attached storage. The systems use existing Fibre Channel
infrastructure to integrate seamlessly with existing host applications and data storage
subsystems. For remote replication, the systems use existing IP connections to send the
replicated data over a WAN, or use Fibre Channel infrastructure to replicate data
asynchronously or synchronously. The systems provide failover of operations to a
secondary site in the event of a disaster at the primary site.
Introduced in 5876, Symmetrix systems provides support for smaller to larger device size
RecoverPoint replication enabling replication in heterogeneous environments where size
may be different between devices.
Enhanced RecoverPoint thin LUN awareness supports only the allocated data to be
synchronized during a full sweep. For example, if there is 10% of allocated data,
RecoverPoint synchronizes only that amount of data.
RecoverPoint Appliance
The RecoverPoint Appliance contains four Fibre Channel ports. A minimum of two ports are
connected to the fibre channel switch within your network with the connection completing
on the front-end I/O module ports on the engine.
The RecoverPoint Administrator’s Guide provides detailed information related to this
feature.
Replication Manager
Replication Manager’s support for EMC RecoverPoint provides continuous protection and
near-instantaneous restoration of critical business data. It allows rapid recovery of the
data on a volume to any point in time (crash-consistent recovery) or to a significant point
in time (application-consistent recovery).
Replication Manager with RecoverPoint addresses the problem of lengthy recoveries of
files and databases made by traditional backup software. It allows rapid reconstruction of
a volume image that may be only seconds or minutes old.
Support for RecoverPoint complements Replication Manager’s mirror- and
snapshot-based recovery support by offering:
◆ Near-instantaneous restore time, providing full access to data made unavailable due
to physical loss of media, data corruption, data pollution, or database or file system
integrity problems
◆ Unlimited number of recovery points
◆ Practically no limit on the number of application-consistent checkpoints (as opposed
to snapshot replicas)
◆ Application-consistent protection
◆ Instantaneous access to recovery points
Performance considerations
Symmetrix systems use patented intelligent algorithms to manage data flow across host
I/O channels, memory, and disks. Symmetrix systems also provide configuration tools
that help consolidate storage resources while also providing the flexibility you need to
manage mission-critical data and applications.
Performance considerations 53
Enginuity Operating Environment
The task’s priority level determines the task’s position in the queue. During non-peak
periods and periods of decreased utilization, all queued requests are satisfied in a timely
manner even if they are assigned a low priority. It is only when the disk or SRDF/S transfer
is “in demand” that service differentiation occurs.
Note: In mainframe environments, if workload manager (WLM) is active, each I/O has its
own priority assigned by WLM. In such cases, Symmetrix Priority Controls honor the
priorities assigned by WLM.
Cache performance
Symmetrix systems dramatically improve cache performance because they combine
statistical prefetch algorithms, based on comprehensive analysis from thousands of
installed Symmetrix systems, with dynamic intelligence that adjusts to immediate
conditions on the Symmetrix system. EMC intelligent algorithms automatically adjust to
the workload by constantly monitoring, evaluating, and optimizing cache decisions.
Storage systems use statistical prefetch algorithms to predict which information to place
in cache before the host actually requests it. Inefficient prefetch algorithms have a
significant impact on performance because they populate memory space with erroneous
information, or fail to retrieve high-demand data that is required.
Disk optimization
Enginuity disk performance algorithms minimize the mechanical latencies and limitations
of traditional hard disks. Disk optimization features include:
◆ Dynamic Mirror Service Policy — Reduces disk latencies in mirrored environments by
reading from both mirrored pairs.
◆ Rotational position ordering — Reduces rotational latencies by scheduling I/Os based
on physical drive location.
◆ 100 percent fast writes — Improves the performance of applications initially by writing
to cache instead of disk.
Disk optimization 55
Enginuity Operating Environment
Note: Enginuity 5876 Q4 2012 SR supports up to four tiers, with the fourth tier being FTS,
per FAST VP policy.
Symmetrix systems support connectivity to environments with both mainframe and open
systems hosts.
The Symmetrix Enterprise Storage Platform (ESP) option is required when both mainframe
hosts (FICON) and open systems hosts (FCoE, Fibre Channel, iSCSI) connect to the same
Symmetrix system. Contact your EMC representative for the current list of supported hosts,
models, operating systems, and open systems support policies.
This chapter introduces the mainframe and open systems features supported on
Symmetrix systems. Topics include:
◆ Mainframe support on VMAX 20K and VMAX 40K .................................................... 57
◆ Error reporting to the Mainframe host...................................................................... 59
◆ SIM Severity Reporting ............................................................................................ 60
◆ Environmental errors (Enginuity 5876) .................................................................... 64
◆ Open systems support on VMAX 10K, 20K, and 40K................................................ 67
• Modified Indirect Data Address Word (MIDAW) • Peer-to-Peer Remote Copy (PPRC)
• Basic HyperSwap
FICON configuration
FICON is a high-speed I/O interface that provides native point-to-point or switched
point-to-point single or multimode connections from mainframes to storage devices.
FICON connections support multiple concurrent I/O channels, I/O program multiplexing,
and better link utilization than IBM’s previous Fibre Channel standard.
Symmetrix systems auto-detect 2, 4 or 8 Gb/s FICON link speeds at switch or host port
login. Symmetrix systems also provide support for Extended Distance FICON.
Note: Enginuity 5876 Q2 2013 SR provides support of thin IBM i 512-byte D910 devices
on VMAX 10K systems.
Description Maximum
LCUs per director slice (or port) 255 (within the range of 00 to FE)
Symmetrix system host addresses per Symmetrix system (base and alias) 65,280
Cascading configurations
Cascading configurations greatly enhance FICON connectivity between local and remote
sites by using switch-to-switch extensions of the CPU to the FICON network. These
cascaded switches communicate over long distances using a small number of high speed
lines called interswitch links (ISLs). A maximum of two switches may be connected
together within a path between the CPU and the Symmetrix system.
Same switch vendors are required for a cascaded configuration. To support cascading,
each switch vendor requires specific models, hardware features, software features,
configuration settings, and restrictions. Specific IBM CPU models, MVS release levels,
host hardware, and Enginuity levels are also required.
For the most up-to-date information about switch support, consult the EMC Support Matrix
(ESM), available through E-Lab™ Interoperability Navigator (ELN) at
http://elabnavigator.emc.com under the PDFs and Guides tab.
Enginuity reports error conditions to the host and to the EMC Customer Support Center.
When reporting to the host, Enginuity presents a unit check status in the status byte to the
channel whenever it detects an error condition such as a data check, a command reject,
an overrun, an equipment check, or an environmental error.
When presented with a unit check status, the host retrieves the sense data from the
Symmetrix system and, if logging action has been requested, places it in the Error
Recording Data Set (ERDS). The EREP (Environment Recording, Editing, and Printing)
program prints the error information. The sense data identifies the condition that caused
the interruption and indicates the type of error and its origin. The sense data format
depends on the mainframe operating system. For 2105, 2107, or 3990 controller
emulations, the sense data is returned in the SIM format.
Severity Description
ACUTE A major I/O subsystem resource is disabled, or damage to the product is possible.
Performance may be severely degraded. System or application outage may have
occurred.
REMOTE FAILED Service Processor cannot communicate with the EMC Customer Support Center.
SIM
Hex code Severity level Description reference code
042F MODERATE Send a SIM alert for error code 052F (a sync SRDF write failure occurred). E42F
Note: Epack required for 5874 only: fix 58335 and fix 20011029.
0454 SERVICE SRDF switched to Adaptive Copy write pending mode due too numerous E454
suspend or halt chains.
This condition happens in SRDF configurations when Enginuity detects a
mainframe memory paging I/Os to the SRDF devices. This error triggers a
call home to the EMC Customer Support Center.
0461 SERVICE The M2 is resynchronized with the M1 device. This event occurs once the E461
M2 device is brought back to a Ready state.
ENGINEERING RECOMMENDATION is to leave disabled.
0462 SERVICE The M1 is resynchronized with the M2 device. This event occurs once the E462
M1 device is brought back to a Ready state.
ENGINEERING RECOMMENDATION is to leave disabled.
0463 SERIOUS One of the back-end directors failed into the IMPL Monitor state. 2463
0467 MODERATE The remote Symmetrix system reported an SRDF error across the SRDF E467
links.
Note: Severity level
can be modified via
SymmWin.
046B SERVICE The Event Trace utility has been running for more than 30 days. E46B
046D MODERATE An SRDF group is lost. This event happens, for example, when all SRDF E46D
links fail.
Note: Severity level
can be modified via
SymmWin.
0471 SERIOUS The DSE, DATA, or SAVE device is too small or the session is too long. 2471
SIM
Hex code Severity level Description reference code
0473 SERIOUS A periodic environmental test (env_test9) detected the mirrored device in E473
a Not Ready state.
Note: Severity level
can be modified via
SymmWin.
0474 SERIOUS A periodic environmental est (env_test9) detected the mirrored device in a E474
Write Disabled (WD) state.
Note: Severity level
can be modified via
SymmWin.
0477 REMOTE FAILED The Service Processor could not call the EMC Customer Support Center 1477
(failed to call home) due to communication problems.
047C ACUTE A SAVE device with user data is Not Ready. 247C
047D MODERATE Either the SRDF group lost an SRDF link or the SRDF group is lost locally. E47D
047E SERVICE An SRDF link recovered from failure. The SRDF link is operational. E47E
047F REMOTE SERVICE The Service Processor successfully called the EMC Customer Support 147F
Center (called home) to report an error.
0492 SERVICE The available disk space on the Service Processor is low. 2492
01BA ACUTE A problem with the Engine power supply or the Engine SPS module. 24BA
02BA
03BA
04BA
SIM
Hex code Severity level Description reference code
04D1 REMOTE SERVICE Remote connection established or remote control connected. 14D1
04D2 REMOTE SERVICE Remote connection closed. Remote control rejected. 14D2
SIM
Hex code Severity level Description reference code
042F NONE Send a SIM Alert for error code 052F (a sync SRDF write failure occurred). E42F
EMC recommendation: NONE.
0454 SERVICE SRDF switched to Adaptive Copy write pending mode due to numerous E454
suspend or halt chains.
This condition happens in SRDF configurations when Enginuity detects a
mainframe memory paging I/Os to the SRDF devices. This error triggers a
call home to the EMC Customer Support Center.
0461 NONE The M2 is resynchronized with the M1 device. This event occurs once the E461
M2 device is brought back to a Ready state.
EMC recommendation: NONE
0462 NONE The M1 is resynchronized with the M2 device. This event occurs once the E462
M1 device is brought back to a Ready state.
EMC recommendation: NONE.
0463 SERIOUS One of the back-end directors failed into the IMPL Monitor state. 2463
0467 MODERATE The remote Symmetrix system reported an SRDF error across the SRDF E467
links.
046B SERVICE The Event Trace utility has been running for more than 30 days. E46B
046D MODERATE An SRDF group is lost. This event happens, for example, when all SRDF E46D
links fail.
0471 SERIOUS The DSE, DATA, or SAVE device is too small or the session is too long. 2471
Note: Severity
changes from
SERIOUS to ACUTE
at 98% full capacity.
0473 SERIOUS A periodic environmental test (env_test9) detected the mirrored device in E473
a Not Ready state.
0474 SERIOUS A periodic environmental est (env_test9) detected the mirrored device in a E474
Write Disabled (WD) state.
SIM
Hex code Severity level Description reference code
0477 REMOTE FAILED The Service Processor could not call the EMC Customer Support Center 1477
(failed to call home) due to communication problems.
01BA ACUTE A problem with the engine power supply or the engine SPS module. 24BA
02BA
03BA
04BA
047C ACUTE A SAVE device with user data is Not Ready. 247C
047D MODERATE Either the SRDF group lost an SRDF link or the SRDF group is lost locally. E47D
047E SERVICE An SRDF link recovered from failure. The SRDF link is operational. E47E
047F REMOTE SERVICE The Service Processor successfully called the EMC Customer Support 147F
Center (called home) to report an error.
0492 SERVICE The available disk space on the Service Processor is low. 2492
04D2 REMOTE SERVICE Remote connection closed. Remote control rejected. 14D2
Operator messages
On z/OS, SIM messages will be displayed as IEA480E Service Alert Error messages. They
have the format shown in Figure 9 on page 66 and Figure 10 on page 66.
Figure 9 z/OS IEA480E service alert error message format (AC power failure)
Channel address = 7B
Number of errors = 01
Note: E473 = Mirror-1 volume in “Not Ready” state
Channel address of the “Not Ready” device SYM-001084
Figure 10 z/OS IEA480E service alert error message format (mirror-1 volume in “not ready” state)
Note: All host channel paths to that device (target volume) will report this error message.
Therefore, this message may appear several times.
The Symmetrix system also reports events to the host and to the service processor. These
events are:
◆ The mirror-2 volume has synchronized with the source volume.
◆ The mirror-1 volume has synchronized with the target volume.
◆ Device resynchronization process has begun.
On z/OS, these events are displayed as IEA480E Service Alert Error messages. They have
the format shown inFigure 11 on page 66 and Figure 12 on page 67.
Figure 11 z/OS IEA480E service alert error message format (mirror-2 resynchronization)
Figure 12 z/OS IEA480E service alert error message format (mirror-1 resynchronization)
Symmetrix systems provide a suite of integrity checks, RAID options, and vaulting
capabilities to ensure data integrity and to protect data in the event of a system failure or
power outage.
This chapter describes Symmetrix system data integrity protections. Topics include:
◆ Data Integrity Checking ........................................................................................... 69
◆ Drive integrity monitoring and correction................................................................. 70
◆ RAID options ........................................................................................................... 70
◆ Vaulting .................................................................................................................. 71
Block CRC
Symmetrix systems support industry standard block CRC based on T10 Data Integrity Field
(DIF)) that enables host generated CRC’s to be stored and used with the data. Symmetrix
systems provide additional protections for address/control fault modes that provide
increased levels of protection against address/control faults and provides this in user
definable blocks provided by the T10 standard.
Symmetrix systems provide address information and write status information in the extra
bytes in the application tag and reference tag portion of the block CRC.
RAID options
Symmetrix systems support varying levels of protection including RAID 1, RAID 10, RAID 5
(3+1 and 7+1), and RAID 6 (6 + 2 and 14 + 2), as shown in Table 16 on page 70. RAID
protection options are configured at the physical drive level. Different levels of RAID
protection are easily configured with different datasets within a Symmetrix system. EMC
strongly recommends that you use one or more of the RAID data protection schemes for all
data devices.
RAID 1 All The highest level of performance for all mission-critical and Withstands failure of a single drive within
business-critical applications. Maintains a duplicate copy the mirrored pair.
of a device on two drives: A drive rebuild is a simple copy from the
• If a drive in the mirrored pair fails, the Symmetrix remaining drive to the replaced drive.
system automatically uses the mirrored partner without The number of required drives is twice
interruption of data availability. the amount required to store data
• When the drive is (nondisruptively) replaced by a (usable storage capacity of a mirrored
sparing operation, the Symmetrix system re-establishes system is 50%).
the mirrored pair and automatically re-synchronizes the
data with the drive.
RAID 10 VMAX 20K A combination of RAID 1 (mirrored) and RAID 0 (striping Withstands failure of multiple drives
and VMAX with no data protection) used for mainframe environments. within one of the mirrored pairs.
40K RAID 10 allows four Symmetrix system devices (each A drive rebuild is a simple copy from the
one-fourth the size of the original IBM device) to appear as remaining drive to the replaced drive.
one IBM device to the host, accessible by way of one host The number of required disks is twice the
address. Any four devices can be chosen to define a group amount required to store data (usable
provided they are equally sized, the same type (for data storage capacity of a mirrored
example, all 3390), and have the same mirror system is 50%).
configuration.
RAID 5 All Distributed parity and striped data across all drives in the RAID 5 (3 + 1) provides 75% data storage
RAID group. Options include: capacity.
• RAID 5 (3 + 1) — Consists of four drives with parity and RAID 5 (7 + 1) provides 87.5% data
data striped across each device. storage capacity.
• RAID 5 (7 + 1) — Consists of eight drives with data and Withstands failure of a single drive within
parity striped across each device. the RAID 5 group.
RAID 6 All Striped drives with double distributed parity (horizontal RAID 6 (6 + 2) provides 75% data storage
and diagonal). The highest level of availability options capacity.
include: RAID 6 (14 + 2) provides 87.5% data
• RAID 6 (6 + 2) — Consists of eight drives with dual storage capacity.
parity and data striped across each device. Withstands failure of two drives within
• RAID 6 (14 + 2) — Consists of 16 drives with dual parity the RAID 6 group.
and data striped across each device.
Vaulting
Symmetrix system vault operations protect data during a manual power down or an
unexpected power outage.
Each Symmetrix system comes with Standby Power Supply (SPS) modules. If power is lost,
the Symmetrix system uses SPS power to write the data in physical memory onto
designated disk storage called Power Vault devices. Vaulted images are fully redundant;
the contents of physical memory are saved twice to independent disks.
Vaulting 71
Data Integrity and Protection
The system resumes normal operation when the SPSes are sufficiently recharged to
support another vault. If any condition is not safe, the system will not resume operation
and will notify Customer Support for diagnosis and repair. This allows Customer Support
to communicate with the Symmetrix system and restore normal system operations.
System Dedicated vault space Dedicated devices for vault space per engine
The following configuration rules apply to the vault drives and directors:
◆ Vault devices are designated disk drives that reserve a dedicated amount space for
vault data, including metadata.
◆ All drives types can be used for vault.
◆ The vault space is for internal use only. No other device can reside in this space.
◆ Five vault drives per loop are required to enable sparing. Vault drives are eligible for
permanent sparing and direct sparing.
◆ The total capacity of all vault devices in the system will be at least sufficient to keep
two logical copies of the persistent portion of physical memory.
CHAPTER 6
Data Migration Tools
Symmetrix systems provide the ability to perform the one-time movement of data from a
source to a target using various data migration software. Once the migration operation is
performed, applications will now access the data from the new location. When migrating
data, one should consider the potential business impact and the type of data to be
migrated, the site location(s), the number of systems and applications, and the total
amount of data, as well as time considerations and schedules.
Symmetrix systems support several tools and services for data migration:
◆ “Federated Tiered Storage” on page 73 — Allows the creation of external storage using
EMC or third-party storage systems.
◆ “Federated Live Migration” on page 76 — Allows data movement from source
Symmetrix systems to a target Symmetrix system.
◆ “Open Replicator for Symmetrix” on page 76 — Creates copies of data for migration
between Symmetrix systems and other qualified storage systems.
◆ “Open Migrator/Live Migration” on page 77 — Provides online data migration between
the source and the target storage systems. The migration process is non-disruptive to
production applications.
◆ “PowerPath Migration Enabler” on page 77 —Enables non-disruptive or minimally
disruptive data migration between storage systems or between logical units within a
single storage system.
◆ SRDF/Data Mobility (SRDF/DM) – Enables fast data transfer from R1 to R2 devices over
extended distances.
◆ “Unisphere for VMAX” on page 78 — Supports browser-based user interface for the
configuration and management of Symmetrix systems.
FTS allows LUNs which exist on external systems to be used to provide physical disk space
on existing systems while gaining access to Symmetrix features such as local replication,
remote replication, storage tiering, data management, and data migration. These external
LUNs can be used as raw storage space for the creation of Symmetrix devices in the same
way internal Symmetrix physical drives are used. These devices are known as eDisks.
Figure 13 on page 74 shows the configuration of the network, storage systems, and
application hosts using FTS.
Figure 14 shows direct attach from your external storage system to a Symmetrix system.
eDisks
When you attach external storage to a Symmetrix system, FTS virtualizes an external
system’s SCSI logical units as Symmetrix disks called eDisks.
The following restrictions apply to eDisks:
• Can only be unprotected devices. The RAID protection scheme of eDisks is
dependent on the external system.
• Cannot be IBM i, CKD, or gatekeeper devices.
• Cannot be used as VAULT, SFS, or ACLX devices.
Modes of operation
FTS has two modes of operation, depending on whether the external LUN is used as raw
storage space or has data that must be preserved and accessed through a Symmetrix
device.
◆ External Provisioning that allows you to access LUNs existing on external storage as
raw capacity for new Symmetrix devices. These devices are called externally
provisioned devices. When you virtualize an eDisk for external provisioning, you can
then create Symmetrix devices from the external disk group and present the storage
to users. You can also use this storage to create a new FAST VP tier. See “Fully
Automated Storage Tiering for Virtual Pools” on page 39 for additional details.
◆ Encapsulation which allows you to preserve existing data on external LUNs and access
it through Symmetrix volumes. These devices are called encapsulated devices. There
are two different options with encapsulation:
• Standard encapsulation - The eDisk is encapsulated and exported from the
Symmetrix system as disk group provisioned devices.
• Virtual provisioning encapsulation - Data devices are created and added to a
specified thin pool. Fully allocated thin devices are also created and bound to the
pool. Extents are allocated to the external LUN through the data devices.
In either case, Enginuity automatically creates the necessary Symmetrix devices. If the
eDisk is larger than the maximum Symmetrix device size or the configured minimum auto
meta size, Enginuity creates multiple Symmetrix devices to account for the full size of the
eDisk. These Symmetrix devices are concatenated into a single concatenated metadevice
to allow access to the complete volume of data available from the eDisk.
FTS Interoperability Matrix at https://elabnavigator.emc.com/jsp/legacy_support.jsp and
the EMC Simple Support Matrix EMC Federated Tiered Storage (FTS) provide greater detail
on FTS support of external systems. The EMC Solutions Enabler Symmetrix Array Controls
CLI Product Guide provides additional details.
SRDF/Data Mobility
SRDF/Data Mobility (SRDF/DM) permits operation in SRDF adaptive copy mode only and is
designed for data replication or migration between two or more Symmetrix systems.
SRDF/DM transfers data from primary volumes to secondary volumes permitting
information to be shared, content to be distributed, and access to be local to additional
processing environments. Adaptive copy mode enables applications using that volume to
avoid propagation delays while data is transferred to the remote site. SRDF/DM supports
all Symmetrix systems and all Enginuity levels that support SRDF, and can be used for
local or remote transfers.
The EMC® Symmetrix® Remote Data Facility (SRDF®) Product Guide provides greater
detail.
Note: Mainframe Enablers does not provide management for FAST VP and Federated
Tiered Storage (FTS).
ProSphere is EMC's next generation Storage Resource Management product that will
integrate much of the EMC ControlCenter functionality into a single product.
EMC ControlCenter users under maintenance contracts are entitled to ProSphere, ensuring
a seamless path to its advanced capabilities for virtual and cloud storage infrastructures.
The following EMC ControlCenter and ProSphere licenses manage Symmetrix systems:
◆ SAN Manager™
◆ EMC Symmetrix Manager
◆ EMC Symmetrix Optimizer
◆ Performance Manager
◆ EMC StorageScope™
SMI-S Provider
EMC SMI-S Provider is an SMI-compliant interface for Symmetrix and CLARiiON systems
that supports the SNIA Storage Management Initiative (SMI). The SMI-Specification
(SMI-S) is an open storage management interface that enables the interoperability of
multiple vendors’ storage management technologies to monitor and control storage
resources in multivendor SAN topologies.
Mainframe Enablers
The EMC Mainframe Enablers is a suite of components that you can use to monitor and
manage your EMC Symmetrix system. The components listed below are distributed and
installed as a single package. This combined packaging simplifies installation and
maintenance, and provides assurance of component compatibility.
◆ ResourcePak® Base for z/OS facilitates communication between the Symmetrix
system and mainframe-based applications provided by EMC or independent software
vendors.
◆ SRDF® Host Component for z/OS monitors SRDF status and controls SRDF processes
through the use of commands executed from a host. SRDF maintains a real-time copy
of data at the logical volume level in multiple Symmetrix systems located in physically
separate sites.
◆ TimeFinder®/Clone Mainframe Snap Facility is the software foundation for three
functional products:
• TimeFinder/Clone allows creating point-in-time copies of full volumes or individual
datasets
• TimeFinder/Snap allows creating pointer-based copies where only the pre-images
of changed data are written to the save area.
81
Storage management tools
EMC GDDR is installed on a control LPAR at each site. Each EMC GDDR node is aware of the
other EMC GDDR nodes through network connections between each site. This awareness
allows EMC GDDR to perform the following:
◆ Detect disasters
◆ Identify survivors
◆ Nominate the leader
◆ Recover business at one of the surviving sites.
EMC GDDR has no limitations on the number of EMC Symmetrix systems that can be
managed. Any limitations are subject to restrictions in EMC hardware and software.
EMC GDDR can be used with certain SRDF configurations and the EMC® Symmetrix®
Remote Data Facility (SRDF®) Product Guide provides greater detail.
83
Storage management tools
Symmetrix system security features support the latest security protocols and also provide
robust authentication, audit logging, and data erasure services.
This chapter provides information about Symmetrix system security features. Topics
include:
◆ Audit logs ............................................................................................................... 85
◆ Audit Integration with RSA enVision ........................................................................ 86
◆ Data erasure ........................................................................................................... 86
◆ IPv6 and IPsec support ........................................................................................... 87
◆ Symmetrix Access Controls...................................................................................... 87
◆ Symmetrix Data at Rest Encryption .......................................................................... 88
◆ Symmetrix Service Credential, Secured by RSA ........................................................ 89
◆ User authorization controls ..................................................................................... 90
Audit logs
Symmetrix systems record system activities in secure, tamper-proof audit logs. Audit log
protections include:
◆ The Symmetrix audit log — Records major Symmetrix system activities.
◆ RSA enVision log security — A security management platform that consolidates log
security information from multiple sources.
Security 85
Security
Data erasure
Symmetrix systems can be configured to perform data erasure on drives requiring
replacement in the Symmetrix system. With the feature enabled, failed drives are erased
natively within the system, following the permanent sparing or direct sparing activity and
prior to the EMC customer engineer replacing the drive. The default erasure process
consists of a multiple pass overwrite with complementary and random character patterns
followed by a write verify. The overwrite activity can be modified to address specific
customer requirements and is supported on Fibre Channel, SAS, SATA and Flash drives. An
optional certification service is available to provide a certificate of erasure and includes
the customer retention of drives that fail the erasure activity.
In addition to the Symmetrix in-frame failed drive erasure feature, EMC offers the following
data protection features and services:
◆ Data at Rest Encryption — Data on all physical drives in the system is encrypted. When
the drive is removed from the system, data on the drive is inaccessible.
◆ Full system erasure service — Data on all drives in the system is overwritten when
replacing, retiring or repurposing a Symmetrix system.
◆ Data Erasure/Single Disk service — Multi-platform environments whose security
policies require formal certification that failed drives are erased before leaving the
premises. This appliance-based service supports Symmetrix platforms using Fibre
Channel, SATA, SAS and Flash drives.
All erasure services are performed on-site in the security of the customer’s data center and
provide a Data Erasure Certificate and report of erasure results.
You can configure IPsec for SRDF or iSCSI connections using Unisphere for VMAX. IPsec
configuration support is also available from EMC. IPsec configuration and status is
monitored and viewed with Solutions Enabler SYMCLI commands.
IPsec sessions are limited to 100 sessions per port depending on the policy configuration.
◆ Access pools — Provide permissions, such as ADMIN, assigned to a host, that allow
specific functions on a specified set of devices.
◆ Access control entries (ACEs) — Grant permissions to access control groups and
access pools.
◆ Access control lists (ACLs) — Provide a group of ACEs associated the same group.
◆ Restricted host access to a defined set of devices (access pools).
Note: D@RE must be enabled in the Symmetrix system configuration settings before you
start the installation procedure.
For the most up-to-date information on qualified interoperability with the RSA Key
Manager Appliance, consult the EMC Support Matrix (ESM), available through E-Lab
Interoperability Navigator (ELN) at http://elabnavigator.emc.com under the PDFs and
Guides tab.