h18241 Dell Powerstore Best Practices Guide
h18241 Dell Powerstore Best Practices Guide
h18241 Dell Powerstore Best Practices Guide
May 2023
H18241.6
White Paper
Abstract
This document provides best practices for installing and configuring Dell PowerStore
for optimal performance and availability.
Copyright
The information in this publication is provided as is. Dell Inc. makes no representations or warranties of any kind with respect
to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular
purpose.
Use, copying, and distribution of any software described in this publication requires an applicable software license.
Copyright © 2020-2023 Dell Inc. or its subsidiaries. Published in the USA May 2023 H18241.6.
Dell Inc. believes the information in this document is accurate as of its publication date. The information is subject to change
without notice.
Contents
Executive summary ........................................................................................................................ 4
Introduction ..................................................................................................................................... 4
Network considerations.................................................................................................................. 9
Conclusion ..................................................................................................................................... 16
References ..................................................................................................................................... 17
Executive summary
Overview This white paper provides best practices guidance for using Dell PowerStore in a mixed-
business environment. It focuses on optimizing system performance and availability, and
on maximizing the usability of the automated storage features.
These guidelines are intended to cover most use cases. They are recommended by Dell
Technologies but are not strictly required. Some exception cases are addressed in this
white paper. Less common edge cases are not covered by these general guidelines and
are addressed in use case-specific white papers.
For questions about the applicability of these guidelines in a specific environment, contact
your Dell Technologies representative to discuss the recommendations.
Audience This document is intended for IT administrators, storage architects, partners, and Dell
Technologies employees. This audience also includes any individuals who may evaluate,
acquire, manage, operate, or design a Dell networked storage environment using
PowerStore systems.
Introduction
Document This document introduces specific configuration recommendations that enable optimal
purpose performance from PowerStore.
PowerStore PowerStore achieves new levels of operational simplicity and agility. It uses a container-
overview based microservices architecture, advanced storage technologies, and integrated
machine learning to unlock the power of your data. PowerStore is a versatile platform with
a performance-centric design that delivers multidimensional scale, always-on data
reduction, and support for next-generation media.
offers predictive analytics to easily monitor, analyze, and troubleshoot the environment.
PowerStore is highly adaptable, providing the flexibility to host specialized workloads
directly on the appliance and to modernize infrastructure without disruption. It also offers
investment protection through flexible payment solutions and data-in-place upgrades.
Terminology The following table provides definitions for some of the terms that are used in this
document.
Table 1. Terminology
Term Definition
Base enclosure Refers to the enclosure that contains both nodes (node A and
node B) and 25 NVMe drive slots.
Embedded module Connectivity card in the PowerStore node that provides ports
for Ethernet connections, and various service and
management ports.
Internet SCSI (iSCSI) Provides a mechanism for accessing block-level data storage
over network connections.
Network File System (NFS) An access protocol that allows data access from Linux/UNIX
hosts on a network.
Term Definition
NVMe over Fibre Channel Allows hosts to access storage systems across a Fibre
(NVMe/FC) Channel network fabric using the NVMe protocol.
NVMe over TCP (NVMe/TCP) Allows hosts to access storage systems across a TCP network
fabric using the NVMe protocol.
PowerStore Command Line An interface that allows a user to perform tasks on the storage
Interface (PSTCLI) system by typing commands instead of using the user interface
(UI).
Server Message Block (SMB) An access protocol that allows remote file data access from
clients to hosts on a network. This protocol is typically used in
Microsoft Windows environments.
Thin clone A read/write copy of a volume, volume group, file system, NAS
server, or snapshot that shares blocks with the parent
resource.
We value your Dell Technologies and the authors of this document welcome your feedback on this
feedback document. Contact the Dell Technologies team by email.
Note: For links to other documentation for this topic, see the PowerStore Info Hub.
Hardware considerations
Introduction At the highest level, design for optimal performance follows a few simple rules. The main
principles of designing a PowerStore system for performance are:
• Distribute workloads across available resources
• Simplify the configuration
• Design for resilience
• Maintain the latest-released PowerStoreOS version
Hardware components are the foundation of any storage system. This section discusses
some key hardware differences between PowerStore models that help determine
performance. It also explains how different configuration options can result in different
performance from the same hardware.
PowerStore The PowerStore platform consists of ten different models, from the PowerStore 500 model
deployment through the PowerStore 9200 model. PowerStoreOS 1.0 launched with the PowerStore
modes 1000T/X, 3000T/X, 5000T/X, 7000T/X, and 9000T/X. PowerStoreOS 2.0 introduced the
entry-level 500. PowerStoreOS 3.0 introduced a platform refresh, with the 1200T, 3200T,
5200T, and 9200T models. All models use a common base enclosure and I/O modules.
The models differ by CPU core count and speed, memory size, and number of NVMe
NVRAM drives. These hardware differences give each model a unique performance
profile.
Besides the hardware differences between the models, PowerStore can be installed in
one of three different deployment modes. Each deployment mode has different
capabilities, as detailed in Table 2. Choose the deployment mode that provides the
required capabilities.
PowerStore X model ✓ X ✓
Note: The PowerStore 500, 1200, 3200, 5200, and 9200 are only available as a T model (either
unified or block optimized).
PowerStore T models
PowerStore T models run the PowerStoreOS directly on the hardware. PowerStore T
models can be installed in a unified configuration that provides file and block access, or in
a block optimized configuration that provides only block access.
PowerStore X models
PowerStore X models run the PowerStoreOS as a virtual machine on an ESXi hypervisor.
This configuration allows the PowerStore X model appliance to service external host I/O
and run guest VMs directly on the PowerStore hardware. PowerStore X models reserve a
portion of the CPU and memory to be used for hosting user VMs. Therefore, fewer
resources are available for serving external storage. The relative performance for storage
from a PowerStore X model is expected to be less than that for the same PowerStore T
model.
In general, the IOPS capability of the PowerStore models scales linearly from PowerStore
500 up to 9200 models. As mentioned previously, deployment mode also impacts
performance capability. A PowerStore T model in block optimized mode can deliver more
block IOPS than the same model in unified mode. A PowerStore X model has less
capability for block IOPS because some of the compute resources are reserved for
running VMs.
Except for PowerStore 500, PowerStore systems use NVMe NVRAM drives to provide
persistent storage for cached write data. PowerStore 1000 up to 3200 model arrays have
two NVRAM drives per system, while PowerStore 5000 up to 9200 model arrays have
four NVRAM drives per system. The extra drives mean that these systems can provide
higher MBPS for large-block write workloads.
PowerStore cluster
PowerStore systems can be clustered. A PowerStore cluster combines multiple
PowerStore appliances into a single grouping that is managed as a single storage system.
A PowerStore cluster delivers aggregate performance from all appliances in the cluster,
but a single volume is serviced by only one appliance at any given time. While not
required, it is recommended that all appliances in a cluster be of the same model and
have similar physical capacities to provide consistent performance across the cluster. A
cluster must contain only PowerStore T appliances, or only PowerStore X appliances;
they cannot be mixed within a single cluster.
Drive PowerStore can be configured with NVMe solid-state devices (SSDs) or NVMe storage
configuration class memory (SCM) drives for user data. SSD-based systems can also be expanded
with additional drives to increase the amount of available storage capacity. PowerStore
1000, 3000, 5000, 7000, and 9000 models can be expanded with SAS SSD-based
expansion shelves. Starting in PowerStoreOS 3.0, all PowerStore models can be
expanded with NVMe SSD-based expansion shelves if they meet the necessary hardware
prerequisites defined in the white paper Dell PowerStore: Introduction to the Platform. It is
recommended that all drives within a PowerStore system be the same size, which can
maximize the usable capacity from each drive.
PowerStore Dynamic Resiliency Engine (DRE) is used to manage the drives in the
system. All drives are automatically used to provide storage capacity. DRE groups the
drives into resiliency sets to protect against drive failure. User configuration of the drives
is not necessary, and dedicated hot spare drives are not required in PowerStore. Spare
space for rebuilds is automatically distributed across all drives within each resiliency set.
This configuration provides better resource utilization and enables faster rebuilds if there
is a drive failure.
At initial installation of the PowerStore system, DRE can be configured with either single-
or double-drive failure tolerance. To provide the greatest usable capacity from the same
number of drives, it is recommended to initially install PowerStore with a minimum of ten
drives for single-drive failure tolerance, or nineteen drives for double-drive failure
tolerance.
SCM drives
PowerStore can use SCM drives either by having only SCM drives installed in the system,
or, with PowerStoreOS 2.0 or higher, by mixing SCM and SSD drives.
Systems with all SCM drives are recommended for small-block workloads that require the
absolute lowest latencies. A system with all SCM drives will place both data and metadata
on the SCM drives.
Systems with mixed SSD and SCM drives will use the SCM drives for metadata
acceleration; the SCM drives will store metadata for faster lookups. This can reduce
latency on read operations in systems with large physical capacities. When mixing SCM
and SSDs, it is recommended that at least 5 percent of the system’s physical capacity
should be SCM.
Network considerations
Introduction External hosts send and receive data from PowerStore through Fibre Channel, Ethernet,
or both networks. These networks play a large role in determining the performance
potential of PowerStore. This section discusses considerations for the external network,
and for the PowerStore network ports.
General network It is recommended to use redundant switch hardware between the PowerStore system
performance and and external clients. For more details about configuring a redundant network, see the
high availability document PowerStore Host Configuration Guide on Dell.com/powerstoredocs.
For performance, load balancing, and redundancy, each host should have at least two
paths to each PowerStore node (four paths per PowerStore appliance). It is
recommended that a host should have no more than eight paths per volume.
Ethernet networks
For Ethernet connectivity, use multiple switches that are connected with Virtual Link
Trunking interconnect (VLTi) and Link Aggregation Control Protocol (LACP) or equivalent
technologies. Each PowerStore node should have connectivity to all linked switches.
For PowerStore T models, the first two ports of the embedded module 4-port card on each
PowerStore node are bonded together within the PowerStoreOS. For highest
performance and availability from these ports, it is recommended also to configure link
aggregation across the corresponding switch ports. LACP is not applicable to PowerStore
X models.
With the introduction of PowerStoreOS 3.0, user-defined link aggregations are supported
for Ethernet ports. Link aggregations can include 2 to 4 different Ethernet ports. The ports
must be on the same node and operate at the same speed. A mirror link aggregation will
automatically be created on the peer node. User-defined link aggregations only support
NAS server interfaces.
When using Ethernet for block access to PowerStore volumes (by means of iSCSI and/or
NVMe over TCP), each host should have at least two paths to each PowerStore node
(four paths per PowerStore appliance). It is recommended that a host should have no
more than eight paths per volume.
PowerStore PowerStore supports Ethernet connectivity through ports on the embedded module, and
front-end ports on optional I/O modules. PowerStore supports Fibre Channel connectivity through ports
on optional I/O modules.
On PowerStore 1000 – PowerStore 9200 models, the I/O module in slot 0 is 16-lane PCIe
Gen3, while the I/O module in slot 1 is 8-lane. For this reason, if the system is configured
with a 100 GbE I/O Module, it must be installed in slot 0. When a Fibre Channel I/O
module is being installed, it is recommended to always use I/O module slot 0 first unless
the system contains a 100 GbE I/O Module. Both I/O modules on PowerStore 500 models
are 8-lane PCIe, and the 100 GbE I/O module is not supported on this platform.
Fibre Channel ports are available on I/O modules that are inserted into I/O module slots
on the nodes. The Fibre Channel I/O module is 16-lane PCIe Gen3. On PowerStore 1000
– 9200 models, I/O module slot 0 is also 16-lane, while I/O module slot 1 is 8-lane. If Fibre
Channel I/O modules are installed in both I/O module slots, it is recommended to cable
the ports in I/O module slot 0 first, due to the PCIe difference. The PCIe lanes in I/O
module slot 1 are only a limiting factor for total MBPS, and only when all four ports on the
Fibre Channel I/O module are operating at 32 Gb/s. Both I/O module slots on PowerStore
500 are 8-lane PCIe, and therefore there is no slot preference.
With PowerStoreOS 3.0, a new 2-Port Ethernet card is introduced that supports speeds of
up to 100 Gb/s. This 100 GbE card is supported on PowerStore 1000-9200 models in I/O
Module 0 slot.
Jumbo frames (MTU 9000) are recommended for increased network efficiency. Jumbo
frames must be supported on all parts of the network between PowerStore and the host.
The embedded module 4-port card and the optional network I/O modules are 8-lane PCIe
Gen3. When more than two 25 GbE ports are used, these cards are oversubscribed for
MBPS. To maximize MBPS scaling in the system, consider cabling and mapping the first
two ports of all cards in the system first. Then, cable and map other ports as needed.
When PowerStore T models that are in unified mode are used for both iSCSI and file
access, it is recommended that you use different physical ports for both NAS and iSCSI.
iSCSI, or different Storage Networks can be created to isolate iSCSI and NVMe/TCP
traffic.
The embedded module 4-port card and the optional network I/O modules are 8-lane PCIe
Gen3. When more than two 25 GbE ports are used, these cards are oversubscribed for
MBPS. To maximize MBPS scaling in the system, consider cabling and mapping the first
two ports of all cards in the system first. Then, cable and map other ports as needed.
When PowerStore T models that are in unified mode are used for both NVMe/TCP and
file access, it is recommended that you use different dedicated physical ports for both
NAS and NVMe/TCP.
Enable Jumbo frames for NAS by setting the cluster MTU to 9000.
Introduction PowerStore allows access to block, file, or both storage types. This section provides
recommendations for the different types of storage resources.
Block storage Block storage resources are accessed through Fibre Channel, NVMe over Fibre Channel,
resources iSCSI, or NVMe over TCP protocols. A host should only access a block resource using
one of these protocols at a time. It is not recommended for the same host to access the
same block resource using more than one protocol.
Performance policy
All block storage resources in a PowerStore system have a defined performance policy.
By default, this policy is set to Medium. The performance policy does not have any impact
on system behavior unless some volumes have been set to Low Performance Policy, and
other volumes are set to Medium or High. During times of system resource contention,
PowerStore devotes fewer compute resources to volumes with Low Performance Policy.
Reserve the Low policy for volumes that have less-critical performance needs.
File storage File storage resources are accessed through NAS protocols, such as NFS and SMB. A
resources NAS server can provide access to a file system using all NAS protocols simultaneously, if
configured for multiprotocol access.
NAS servers can be manually moved from one node to the other. This action can be done
to balance the workload if one node is busier than the other. All file systems that are
served by a given NAS server move with the NAS server to the other node.
Introduction This section discusses the features and layered applications available with
PowerStoreOS.
Data reduction PowerStore provides data-reduction capabilities such as zero-detect, compression, and
deduplication. Data reduction is integrated into the PowerStore architecture and is always
active. During periods of high write activity, PowerStore may defer the deduplication of
data, and devote those resources to servicing the client workload. During periods of low
activity, PowerStore will use excess resources to re-examine any data written during
these periods for duplicates, to regain any space savings that were not initially realized.
Replication PowerStore provides native asynchronous replication solutions to protect data and help
organizations meet business goals for both data availability and protection. Supported
storage resources for native asynchronous replication are volumes, volume groups, thin
clones, NAS servers, and file systems. The replication itself uses iSCSI- or the optimized
Dell proprietary TCP-based replication protocol through Ethernet (LAN) connections that
was introduced in PowerStoreOS 3.0.
When configuring replication, it is recommended that you use different physical ports for
replication and front-end Ethernet storage traffic. A specific storage network for replication
can be created and mapped to the desired physical ports for replication.
Metro Volume In PowerStoreOS 3.0 and higher, PowerStore appliances support native metro volume
replication. This provides synchronous replication of spanned block storage volumes
exclusively for VMware VMFS Datastores in an active/active configuration across two
PowerStore clusters in metro distance. For more information about Metro Volume support,
see the white paper Dell PowerStore: Replication Technologies. For best practices for
Metro Volume (latency, distance, uniform/non-uniform configurations, and so on), see the
white paper Dell PowerStore: Metro Volume. Both are available on the PowerStore Info
Hub.
Snapshots and All storage resources in PowerStore are thinly provisioned and space efficient, including
thin clones snapshots and thin clones. Creation of a snapshot or thin clone requires only a quick
duplication of pointers. After this action, they behave as independent storage resources
and do not impact the performance of the source resource.
Secure In PowerStoreOS 3.5 and later, the optional secure snapshot setting allows you to create
snapshots snapshots for volumes and volume groups. When the secure snapshot setting is enabled,
the snapshot is protected from deletion until the retention period expires. This provides a
cost-effective line of defense against ransom attacks and accidental deletion of
snapshots, volumes, or volume groups. Note that after it is set, the retention period cannot
be reduced by the user. It is therefore important to keep this in mind when defining it.
Secure snapshots can only be terminated after they expire or by customer-authorized Dell
Support.
Native In PowerStoreOS 3.5 and later, users can back up volumes and volume groups directly to
PowerProtect DD a PowerProtect DD series appliance running on premises or in the cloud. This feature
Backup eliminates the requirement of a backup host because all backup traffic is offloaded to the
Integration storage appliances. PowerStore uses the replication tagged storage ports to connect and
transfer data to the PowerProtect DD appliance leveraging the DD Boost protocol. As with
replication, it is recommended that you use different physical ports for data protection and
front-end Ethernet storage traffic.
AppsON When PowerStore X models are used with AppsON (hosting VMs on PowerStore), other
functionality for configuration settings are recommended to provide optimal performance. These
PowerStore X configurations include creating additional internal iSCSI targets, increasing internal iSCSI
models queue depths, and enabling Jumbo frames. These changes can be applied as part of the
Initial Configuration Wizard, or manually. These changes should be applied before
provisioning any storage resources. For detailed configuration steps, see the Knowledge
Base article HOW17288 or the document Dell PowerStore: Virtualization Integration.
Cluster Block storage resources that are migrating between appliances in a cluster may see
migrations impacted performance from the migration activity. It is recommended to run migrations at
a time when the resource is less busy.
PowerStoreOS New versions of the PowerStoreOS are applied using a nondisruptive upgrade process.
upgrades Because half of the system hardware resources are unavailable during parts of the
upgrade, it is recommended to perform upgrades during planned maintenance windows.
Alternately, perform upgrades when the system is less busy to minimize the impact to
clients. Users should execute a Pre-Upgrade Health Check before their scheduled
maintenance window to ensure that any issues can be resolved.
Introduction This section highlights host configuration changes that may be necessary to access
PowerStore volumes efficiently. For details about the appropriate settings for a host type,
see the Host Connectivity Guides on E-Lab Navigator.
Host Because PowerStore is a new class of storage, host operating systems may not natively
configuration recognize PowerStore volumes and apply the appropriate settings. For optimal
performance, check that the appropriate configuration changes have been applied to all
hosts that are connected to a PowerStore. The PowerStore Host Configuration Guide has
recommendations for the following:
• MPIO settings: Path checker and timeout values
• iSCSI settings: Time-out and queue depth values; disabling delayed ACK
• Fibre Channel settings: Queue depth values
• Network settings: Jumbo frames and flow control
• Unmap operations
• VMware ESXi claim rules
For other recommended configurations for VMware ESXi and vSphere, see the document
Dell PowerStore: Virtualization Integration.
Host file systems When a host is attached to a PowerStore block volume, the host can use this volume as a
raw device, or it can create a local file system on the volume first. When a local file
system is being created, it is recommended to disable SCSI unmap. When PowerStore
creates a volume, all space is already unmapped; the host-based unmap is redundant
and generates unnecessary load on PowerStore.
When creating a local file system, it is recommended to use a file system block size
(allocation unit) of 4 KB, or a larger size that is an even multiple of 4 KB.
It is typically not necessary to perform alignment when creating a local file system. If
alignment is performed, it is recommended to use an offset of 1 MB.
For other recommended configurations for VMware ESXi and vSphere, see the document
Dell PowerStore: Virtualization Integration.
Application PowerStore is well integrated with the most widely used enterprise applications. For best
considerations practice recommendations for specific applications, see the solutions-focused white
papers available on the PowerStore Info Hub.
Conclusion
Summary This white paper provides configuration and usage recommendations for PowerStore in
general use cases. For a detailed discussion of the reasoning or methodology behind
these recommendations, or for additional guidance around more specific use cases,
contact your Dell Technologies representative.
References
Dell The Dell Technologies Info Hub > Storage site provides expertise that helps to ensure
Technologies customer success with Dell Technologies storage platforms.
documentation
Dell.com/powerstoredocs provides detailed documentation about how to install, configure,
and manage PowerStore systems.