ONTAP 96 Network Management Guide
ONTAP 96 Network Management Guide
ONTAP 96 Network Management Guide
Contents
Deciding whether to use the Installation and Cluster Deployment
Guide for VMware ................................................................................... 7
ONTAP Select installation and deployment workflow .............................. 8
Getting started with ONTAP Select ............................................................ 9
Key concepts and terminology .................................................................................... 9
Business needs and possible usage scenarios ............................................................ 13
Illustration of a typical deployment environment ..................................................... 14
Comparing ONTAP Select and ONTAP 9 ................................................................ 14
ONTAP features not supported in ONTAP Select ......................................... 15
ONTAP Select Deploy utility .................................................................................... 15
Ways you can access the Deploy utility ........................................................ 15
Planning to deploy ONTAP Select ............................................................ 17
General requirements and planning considerations .................................................. 17
Cluster size and related considerations ......................................................... 17
Hypervisor host considerations ..................................................................... 17
Storage considerations ................................................................................... 18
Authentication using the credential store ...................................................... 19
Preparing for a MetroCluster SDS deployment ............................................ 20
Requirements related to the VMware environment ................................................... 20
Hypervisor requirements ............................................................................... 21
Core hardware requirements ......................................................................... 21
RAID controller requirements ....................................................................... 22
Software RAID requirements ........................................................................ 23
Storage capacity restrictions .......................................................................... 24
ONTAP Select vNAS requirements .............................................................. 25
ONTAP Select two-node cluster with HA ..................................................... 26
Remote and branch office deployments ........................................................ 27
Network configuration .................................................................................. 28
Required information for a VMware deployment ..................................................... 29
Cluster-level information ............................................................................... 29
Host-level information .................................................................................. 29
Access to a vCenter server ............................................................................ 30
Planning to install the ONTAP Select Deploy utility ............................... 32
Pairing the Deploy utility with the ONTAP Select clusters ...................................... 32
Requirements related to the VMware environment ................................................... 32
Requirements and restrictions for a deployment ........................................... 32
Required configuration information .............................................................. 33
Optional network configuration information ................................................ 34
Licensing ONTAP Select ............................................................................ 35
Licensing options for a deployment .......................................................................... 35
Evaluation license .......................................................................................... 35
4 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
Related information
ONTAP Select 9.5 Release Notes
NetApp Technical Report 4517: ONTAP Select Product Architecture and Best Practices
ONTAP Select 9 Quick Start Guide: Deploying an Evaluation Cluster on VMware
ONTAP Select 9 Installation and Cluster Deployment Guide for KVM
8
Attention: After you select the license, it cannot be changed. For example, you cannot
upgrade an evaluation license to a purchased license. For more information about
evaluation deployments, see the quick start guide.
10 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
• Standard
• Premium
The premium offering enhances the standard offering by providing support for SSD drives
(in addition to HDD drives), software RAID (in addition to hardware RAID), and a larger
virtual machine configuration.
When configuring a node using the ONTAP Select Deploy utility, there are two hypervisor
instance types available: small and medium. These instance types correspond to the
standard and premium offerings, respectively. For additional details, see Planning to
deploy ONTAP Select.
Storage pools versus datastores
An ONTAP Select storage pool is a logical data container designed to abstract and hide
the underlying physical storage. A storage pool is hypervisor-independent. When
deployed on an ESXi hypervisor host, the ONTAP Select storage pool is synonymous with
a VMware datastore.
Cluster MTU
Cluster MTU is a feature that allows you to configure the MTU size used on the internal
network for an ONTAP Select multi-node cluster. The Deploy administration utility
adjusts the MTU size as you configure the HA pairs to accommodate your networking
environment. You can also manually set the value.
ONTAP Select vNAS
The ONTAP Select vNAS solution allows an ONTAP Select node to access VMware
datastores on external storage. With ONTAP Select vNAS, a local RAID controller is no
longer needed; the RAID functionality is assumed to be provided by the remote storage.
ONTAP Select vNAS can be configured in the following ways:
• VMware vSAN
Getting started with ONTAP Select | 11
When using external storage, either VMware vSAN or an external storage array must be
configured prior to creating an ONTAP Select cluster or expanding the storage capacity of
an existing node.
Node re-hosting
When you deploy a cluster that uses external storage available through the ONTAP Select
vNAS solution (either VMware vSAN or a generic external storage array), the ESXi
virtual machine hosting the ONTAP Select node can be moved through actions that utilize
the following VMware features:
• vMotion
The ONTAP Select Deploy utility detects the movement of the virtual machine as part of
executing an operation on the cluster, such as:
• cluster online
• cluster offline
• storage add
When a virtual machine is moved, the Deploy utility updates its internal database and
configures the new ESXi host. All actions performed on the ONTAP Select node are
blocked until the movement of the virtual machine and Deploy updates are completed.
Mediator service
The ONTAP Select Deploy utility includes a mediator service that connects to the nodes
in active two-node clusters. This service monitors each HA pair and assists in managing
failures.
Attention: If you have one or more active two-node clusters, the ONTAP Select Deploy
virtual machine administering the clusters must be running at all times. If the Deploy
virtual machine is halted, the mediator service is unavailable and HA capability is lost
for the two-node clusters.
MetroCluster SDS
MetroCluster SDS is a feature that provides another configuration option when deploying
a two-node ONTAP Select cluster. Unlike a typical two-node ROBO deployment, with
MetroCluster SDS the nodes in the HA pair can be separated by a much greater distance.
This physical separation enables several additional use cases, such as disaster recovery.
You must have a premium license to use MetroCluster SDS. In addition, the network
between the nodes must support a minimum latency requirement.
Credential store
The Deploy credential store is a secure database holding account credentials. It is used
primarily during authentication when registering hypervisor hosts as part of creating a new
cluster. You should refer to Authentication using the credential store for more information
about the credential store when planning an ONTAP Select deployment.
Storage efficiency
ONTAP Select provides storage efficiency options that are similar to the storage efficiency
options present on FAS and AFF arrays. Conceptually, ONTAP Select with DAS SSDs
(using the premium license) is similar to an AFF array. All other configurations including
DAS with HDD and all vNAS configurations should be considered similar to a FAS array.
The main difference between the two configurations is that ONTAP Select with DAS
12 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
SSDs supports inline aggregate level deduplication and aggregate level background
deduplication. The remaining storage efficiency options are available for both
configurations. See the ONTAP Select Product Architecture and Best Practices Technical
Report (TR-4517) for more information.
Cluster refresh
After creating a cluster, you can make changes to the cluster or virtual machine
configuration outside of the Deploy utility using the ONTAP or hypervisor administration
tools. You can also migrate a virtual machine which changes its configuration. If these
configuration changes occur, the Deploy utility is not automatically updated and can
become out of sync with the state of the cluster. You can use the cluster refresh feature to
update the Deploy configuration database. Cluster refresh is available through the Deploy
web user interface, CLI management shell, and REST API.
Software RAID
When using direct-attached storage (DAS), RAID functionality is traditionally provided
through a local hardware RAID controller. You can also configure a node to use software
RAID where the ONTAP Select node provides the RAID functionality. When configuring
an ONTAP Select node to use software RAID, a hardware RAID controller is no longer
needed.
ONTAP Select image install
Beginning with ONTAP Select Deploy 2.8, the Deploy administration utility only contains
a single version of ONTAP Select. The version included is the most current available at
the time. For example, Deploy 2.8 contains ONTAP Select 9.4. The ONTAP Select image
install feature allows you to add earlier versions of ONTAP Select to your instance of the
Deploy utility which can then be used to deploy ONTAP Select clusters. See Adding an
ONTAP Select image to the Deploy utility for more information.
Attention: You should only add an ONTAP Select image with a version that is earlier
than the original version included with your instance of the Deploy utility. For example,
Deploy 2.8 contains ONTAP Select 9.4. In this case, you can add ONTAP Select 9.3 or
earlier. Adding later versions of ONTAP Select as they become available is not a
supported configuration.
Related concepts
Appendix A: Understanding the ONTAP Select storage environment on page 95
Appendix B: Understanding the ONTAP Select networking environment on page 101
Planning to deploy ONTAP Select on page 17
Authentication using the credential store on page 19
Related information
NetApp Technical Report 4517: ONTAP Select Product Architecture and Best Practices
Getting started with ONTAP Select | 13
Private cloud
ONTAP Select is ideally suited to supporting one or more private clouds within your organization.
Like the public cloud, a private cloud provides flexibility as well as rapid setup and teardown. In
addition, a private cloud offers improved security and control.
Primary storage
In certain cases, you may choose to deploy ONTAP Select as your primary storage platform. These
types of implementations vary and depend on the workload characteristics of the applications as well
as your business objectives.
• Single-node cluster
Because all VMware vSphere licenses are supported, you can choose the vSphere Remote Office
Branch Office Standard or Advanced license instead of the Enterprise or Enterprise Plus license.
• Dedicated deployment
With the dedicated deployment model, a single instance of ONTAP Select runs on the host server.
No other significant processing runs on the same hypervisor host.
• Collocated deployment
With the collocated deployment model, ONTAP Select shares the host with other workloads.
Specifically, there are additional virtual machines, each typically running computational
applications. These compute workloads are therefore local to the ONTAP Select cluster. This
model supports specialized application and deployment requirements. As with the dedicated
14 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
deployment model, each ONTAP Select virtual machine must run on a separate and dedicated
hypervisor host.
Different HA architecture
Depending on the number of nodes you define in a cluster, ONTAP Select provides an HA capability.
For example, a four-node cluster consists of two HA pairs. The HA architecture used with ONTAP
Select is based on a non-shared storage model. That is, one node in an HA pair cannot directly access
the storage owned by the other node. This design can affect certain ONTAP Select operational
characteristics.
Capacity licensing
ONTAP Select introduces a consumption-based licensing model. You must purchase a license with
storage capacity for each node or shared capacity pool when deploying an ONTAP Select cluster in a
production environment. Using the Deploy utility, you must apply the license files which establish
the storage capacity for the cluster nodes.
Getting started with ONTAP Select | 15
• Record the details of each hypervisor host where ONTAP Select is deployed
specific deployment goals and requirements. In all cases, you must sign in using the administrator
account with a valid password.
You typically use the virtual machine console as part of the installation and initial configuration
process. However, in most situations SSH provides a more flexible and convenient option.
• Python
• Java
• cURL
Using a programming or scripting language provides an opportunity to automate the deployment and
management of the ONTAP Select clusters.
You can access the online documentation page using the IP or domain name of the Deploy virtual
machine. To display the page, enter a URL with the following format in your browser (substituting
the appropriate IP address or domain name for your Deploy VM instance):
http://<ip_address>/api/ui
Related information
ONTAP Select 9 Deploy API Guide
17
Related concepts
Planning to install the ONTAP Select Deploy utility on page 32
Appendix A: Understanding the ONTAP Select storage environment on page 95
Appendix B: Understanding the ONTAP Select networking environment on page 101
Hypervisor independent
Both ONTAP Select and the ONTAP Select Deploy administration utility are hypervisor-
independent. The following hypervisors are supported for both:
• VMware ESXi
Note: Refer to the hypervisor-specific planning information and release notes for additional details
regarding the supported platforms.
18 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
• Deploy utility running on VMware ESXi can create and manage ONTAP Select clusters on either
VMware ESXi or KVM
• Deploy utility running on KVM can create and manage ONTAP Select clusters on either VMware
ESXi or KVM
• Multiple nodes from a single ONTAP Select cluster cannot run on the same host. All the nodes on
a specific host must be from different ONTAP Select clusters.
• If you use software RAID, you can only deploy one ONTAP Select node on the host.
Storage considerations
There are several planning issues related to host storage that you should consider.
RAID type
When using direct-attached storage (DAS) on ESXi, you should decide whether to use a local
hardware RAID controller or the software RAID feature included with ONTAP Select. If you use
software RAID, see Software RAID requirements for more information.
Local storage
When using local storage managed by a RAID controller, you must decide the following:
External storage
When using the ONTAP Select vNAS solution, you must decide where the remote datastores are
located and how they are accessed. ONTAP Select vNAS supports the following configurations:
• VMware vSAN
Related concepts
Licensing ONTAP Select on page 35
Related references
Storage capacity restrictions on page 24
Types of credentials
The following types of credentials are supported:
• host
Used to authenticate a hypervisor host as part of deploying an ONTAP Select node
directly to ESXi or KVM
• vcenter
Used to authenticate a vCenter server as part of deploying an ONTAP Select node to
ESXi when the host is managed by VMware vCenter
Access
The credential store is accessed internally as part of performing normal administrative
tasks using Deploy, such as adding a hypervisor host. You can also manage the credential
store directly through the Deploy web user interface and CLI.
Related tasks
Adding an account to the credential store on page 62
20 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
• 1 x 10GbE
• 4 x 1GbE
Note: The data serving ports and interconnect ports must be connected to the same first
switch.
Related information
NetApp Technical Report 4517: ONTAP Select Product Architecture and Best Practices
Hypervisor requirements
There are several requirements related to the hypervisor where ONTAP Select runs.
Note: You should refer to the current release notes to review any additional known restrictions or
limitations.
VMware licensing
To deploy an ONTAP Select cluster, your organization must have a valid VMware vSphere license
for the hypervisor hosts where ONTAP Select runs. You should use the licenses that are appropriate
for your deployment.
Software compatibility
ONTAP Select can be deployed on the following hypervisors:
Note: NetApp supports ONTAP Select on these versions of ESXi as long as VMware also
continues to support the same versions.
Related information
ONTAP Select 9.5 Release Notes
• Processor
◦ Intel CPU Skylake server processors (see Intel Skylake for supported models)
◦ 4 x 10GbE (recommended)
◦ 2 x 10GbE
◦ 1 x 10GbE
22 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
Standard Premium
CPU cores Six physical cores or Ten physical cores or
greater, with four reserved greater, with eight reserved
for ONTAP Select for ONTAP Select
Memory 24GB or greater with 72GB or greater with
16GB reserved for ONTAP 64GB reserved for ONTAP
Select Select
Disk drives 8 to 60 internal HDD (NL- • 4 to 60 internal SSD
SAS, SATA, 10K SAS)
• 8 to 60 internal HDD
(NL-SAS, SATA, 10K
SAS)
Best practices
You should consider the following recommendations regarding the hypervisor core
hardware:
• All of the drives in a single ONTAP Select aggregate should be the same type. For
example, you should not mix HDD and SSD drives in the same aggregate.
Related information
NetApp Interoperability Matrix Tool
• 12 Gbps throughput
• All local disks behind the RAID controller should be configured as a single RAID group; multiple
RAID controllers can be used if needed:
◦ Disable the local drive cache for RAID group, which is fundamental to preserving data
integrity.
◦ If the RAID group size exceeds the maximum ESXi LUN size of 64TB, you should configure
multiple equal-sized LUNs consuming all the available storage within the RAID group.
◦ If the RAID group size is smaller than the maximum ESXi LUN size of 64TB, you should
configure one LUN consuming all available storage within the RAID group.
Related concepts
Appendix A: Understanding the ONTAP Select storage environment on page 95
General requirements
The environment for a software RAID deployment on VMware ESXi must meet the following core
requirements:
• Evaluation: 500 GB
• Production: 1.3 TB
The minimum allocation for a production deployment consists of 1 TB for user data, plus
approximately 266 GB used by various ONTAP Select internal processes, which is considered
required overhead.
• Evaluation: 1.9 TB
• Production: 2.3TB
The minimum allocation for a production deployment consists of 2 TB for user data, plus
approximately 266 GB used by various ONTAP Select internal processes, which is considered
required overhead.
Note: Each node in an HA pair must have the same storage capacity.
• Assign the initial storage pool during the cluster creation process
• Increase the node storage by allocating one or more additional storage pools
Note: A 2% buffer is left unused in each storage pool and does not require a capacity license. This
storage is not used by ONTAP Select, unless a capacity cap is specified. If a capacity cap is
specified, then that amount of storage will be used unless the amount specified falls in the 2%
buffer zone. The buffer is needed to prevent occasional errors that occur when attempting to
allocate all of the space in a storage pool.
Related information
NetApp Interoperability Matrix Tool
Note: These VMware features are supported with single-node and multi-node ONTAP Select
clusters. When deploying a multi-node cluster, you should make sure that two or more nodes from
the same cluster do not run on the same hypervisor host.
Configuration requirements
If you plan to use a VMFS datastore on an external storage array (iSCSI, Fibre Channel, Fibre
Channel over Ethernet), you must create a VMFS storage pool before configuring ONTAP Select to
use the storage. If you use an NFS datastore, there is no need to create a separate VMFS datastore.
All vSAN datastores must be defined within the same ESXi cluster.
26 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
Attention: You must provide a capacity limit for every datastore on VMware vSAN or an external
storage array when configuring a host or performing a storage add operation. The capacity you
specify must be within the allowed storage limits of the external storage. An error will occur if you
do not provide a capacity limit or the external storage runs out of space during the disk creation
operation.
Best practices
Consult the available VMware documentation and adhere to the applicable best practices identified
for ESXi hosts. In addition:
• Define dedicated network ports, bandwidth, and vSwitch configurations for the ONTAP Select
networks and external storage (VMware vSAN and generic storage array traffic when using iSCSI
or NFS)
• Configure the capacity option to restrict storage utilization (ONTAP Select cannot consume the
entire capacity of an external vNAS datastore)
• Assure that all generic external storage arrays use the available redundancy and HA features
where possible
Related concepts
Recovering the Deploy utility for a two-node cluster on page 75
Related information
NetApp Interoperability Matrix Tool
Licensing
You can deploy a two-node cluster using any VMware vSphere license. However, the
VMware ROBO Standard and Advanced licenses are ideal for remote and branch office
deployments.
Mediator service
When a cluster consists of two nodes, it is not possible to achieve the quorum required
when a node fails or loses communication. To resolve these types of split-brain situations,
every instance of the ONTAP Select Deploy utility includes a mediator service. This
service connects to each node in the active two-node clusters to monitor the HA pairs and
assist in managing failures. The mediator service maintains the HA state information at a
dedicated iSCSI target associated with each two-node cluster.
Attention: If you have one or more active two-node clusters, the ONTAP Select Deploy
virtual machine administering the clusters must be running at all times. If the Deploy
Planning to deploy ONTAP Select | 27
virtual machine is halted or fails, the mediator service is unavailable and HA capability
is lost for the two-node clusters.
Related concepts
Recovering the Deploy utility for a two-node cluster on page 75
Related information
ONTAP Select 9.5 Release Notes
• VMware vSAN
Note: If you use vSAN, you must have a VMware vSAN ROBO license.
Related concepts
ONTAP Select two-node cluster with HA on page 26
28 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
Network configuration
You must configure the hypervisor network correctly before deploying ONTAP Select.
Virtual switch options
You must configure a virtual switch on each of the ONTAP Select hosts to support the
external network and internal network (multi-node clusters only). As part of deploying a
multi-node cluster, you should test the network connectivity on the internal cluster
network.
To learn more about how to configure a vSwitch on a hypervisor host, see the ONTAP
Select Product Architecture and Best Practices Technical Report.
Upgrading to VMXNET3
Beginning with ONTAP Select 9.5 using Deploy 2.10, VMXNET3 is the default network driver
included with new cluster deployments on VMware ESXi. If you upgrade an existing ONTAP Select
node to version 9.5, the driver is not automatically upgraded. You must manually upgrade to
VMXNET3. You should contact NetApp support for assistance with the upgrade.
Cluster MTU
A separate internal network is used to connect the ONTAP Select nodes in a multi-node cluster.
Typically the MTU size for this network is 9000. However, there are situations where this MTU size
is too large for the network connecting the ONTAP Select nodes. To accommodate the smaller
frames, the MTU size used by ONTAP Select on the internal network can be in the range of
7500-9000 bytes.
The MTU size is displayed in the Cluster Details section of the cluster creation page. The value is
determined by the Deploy administration utility as follows:
2. As you add the hosts and networks for the HA pairs, the MTU value is reduced as needed, based
on the configuration of the vSwitches in the network.
3. The final cluster MTU value for the cluster is set after you have added all the HA pairs and are
ready to create the cluster.
Note: You can manually set the cluster MTU value if needed, based on the design of your network.
• Standard vSwitch
In this environment, you should configure the traffic using two port groups as follows:
Port group 1
• Internal network (cluster, RSM, and HA-IC traffic)
• NIC1 is active
• NIC2 is standby
Planning to deploy ONTAP Select | 29
Port group 2
• External network (data and management traffic)
• NIC1 is standby
• NIC2 is active
Related concepts
Appendix B: Understanding the ONTAP Select networking environment on page 101
Host configuration and preparation checklist on page 46
Related tasks
Confirming network connectivity among ONTAP Select nodes using the CLI on page 62
Related information
NetApp Technical Report 4517: ONTAP Select Product Architecture and Best Practices
Cluster-level information
You must collect information related to the ONTAP Select cluster.
Name of the cluster
Unique name of the cluster
Licensing mode
Evaluation or purchased licensing
IP configuration for the cluster
IP configuration for the clusters and nodes, including:
• Subnet mask
• Default gateway
Host-level information
You must collect information related to each of the nodes in the ONTAP Select cluster.
Name of the host
Unique name of the host.
Domain name of the host
Fully qualified domain name of the host
IP configuration for the nodes
Management IP address of each node in the cluster
30 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
Mirror node
Name of the associated node in the HA pair (multi-node clusters only)
Storage pool
Name of the storage pool that is used
Storage disks
List of disks if using software RAID
Serial number
If you are deploying with a purchased license, the unique nine-digit serial number
provided by NetApp
Location
You must have the fully qualified domain name or IP address of the vCenter server.
Administrative privileges
You must define a vCenter server account and associate it with a role containing the necessary
administrative privileges. The following minimum administrative privileges are needed to create and
manage an ONTAP Select cluster:
Datastore
• Allocate space
• Browse datastore
Host
Configuration
• Change SNMP settings
• Network configuration
• System management
Local operations
• Create virtual machine
Network
Assign network
Planning to deploy ONTAP Select | 31
Virtual machine
• Configuration
All privileges in the category
• Interaction
All privileges in the category
• Inventory
All privileges in the category
• Provisioning
All privileges in the category
vApp
All privileges in the category
32
Related concepts
Planning to deploy ONTAP Select on page 17
• ESXi Server:
◦ Must adhere to the same supported versions as defined for an ONTAP Select node
Planning to install the ONTAP Select Deploy utility | 33
Network connectivity
You must make sure that the ONTAP Select Deploy virtual machine network interface is
configured and has a single management IP address. You can use DHCP to dynamically
assign an IP address or manually configure a static IP address.
Depending on your deployment decisions, the Deploy VM must be able to connect to the
vCenter server, ESXi hypervisor hosts, and ONTAP Select nodes it manages. You must
configure your firewalls to allow the required traffic.
Deploy uses the VMware VIX API to communicate with the vCenter server and ESXi
hosts. Initially, it establishes a connection using SOAP over SSL on TCP port 443. After
this, a connection is opened using SSL on port 902. In addition, Deploy issues PING
commands to verify there is an ESXi host at the IP address you specify.
Deploy must also be able to communicate with the ONTAP Select node and cluster
management IP addresses using the following protocols:
• You must assign an IPv4 address to the management LIF of the Deploy virtual
machine.
• Deploy cannot create ONTAP Select nodes configured to use IPv6 on the ONTAP
LIFs.
Related references
Storage capacity restrictions on page 24
Evaluation license
You can use an evaluation license if you want to evaluate ONTAP Select before making the decision
to purchase. The evaluation license is included with the ONTAP Select Deploy administration utility
and is automatically applied to each ONTAP Select node as part of an evaluation deployment.
The ONTAP Select evaluation license has the following characteristics:
• The node serial number is twenty digits and automatically generated by ONTAP Select Deploy
(that is you do not acquire it directly from NetApp)
• An ONTAP Select node that is initially deployed with an evaluation license cannot be converted
to a purchased license
Purchased license
After you determine that ONTAP Select is suitable for your organization, you can purchase the
licenses needed to support a production deployment. You must choose either the capacity tiers or
capacity pools licensing model as well as the storage capacity for each deployment.
• You must purchase one or more licenses as needed when deploying ONTAP Select in a
production environment.
• The storage capacity identifies the raw capacity and corresponds to the total allowable size of the
data disks available to the ONTAP Select virtual machine.
36 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
• You should contact your NetApp account team or partner for assistance as needed when acquiring
the necessary licenses.
• You must upload the license files to the Deploy administration utility, which then applies the
licenses based on the licensing model.
• After installing and applying a license, you can add additional capacity by contacting your
NetApp account team or partner to procure an updated license.
• Both nodes in an HA pair must have the same storage and license capacity.
• An ONTAP Select node that is initially deployed with a purchased license cannot be converted to
an evaluation license.
• Each capacity tier license has a storage capacity and is locked to a specific node.
• A nine-digit license serial number is generated by NetApp for each ONTAP Select node.
• The node serial number is nine digits and equal to the license serial number.
• You can apply the license file during cluster deployment or within 30 days after creating a cluster.
• Each capacity pool license has a storage capacity and is locked to a specific License Manager
instance.
• A nine-digit license serial number is generated by NetApp for each capacity pool.
• The storage allocated to a capacity pool is valid only for a specific time based on the purchase
(renewal required).
• The node serial number is twenty digits and is generated by the License Manager based on the
capacity pool license serial number.
• Each node automatically leases storage capacity for its local data aggregates from a shared
capacity pool.
For more details on the capacity pools licensing model, see Understanding the capacity pools
licensing model.
Related concepts
Understanding the capacity pools licensing model on page 38
Licensing ONTAP Select | 37
Standard capacity
The standard capacity offering provides the following capabilities:
• Instance type
Small instance type only.
• Drive type
Hard disk drives (HDD) only.
• RAID type
Local hardware RAID controller only.
Premium capacity
The premium capacity offering provides the following capabilities:
• Instance type
Small or medium instance type.
• Drive type
Hard disk drives (HDD) or Solid state drives (SSD).
• RAID type
Local hardware RAID controller or software RAID.
Related references
Requirements related to the VMware environment on page 20
• Evaluation license
The aggregate operation fails.
• Evaluation license
An evaluation license can remain valid for up to 90 days, after which it expires and goes out of
compliance.
When a license or lease expires and the storage goes out of compliance, you can still access the
associated data. However, if the node is shut down or the data aggregated is moved offline, attempts
to reuse the storage fail.
Note: A capacity tier license is perpetual with no expiration or renewal.
Operational details
The capacity pools licensing model is different from the capacity tiers model. Instead of a dedicating
storage capacity to each individual node, the storage capacity is allocated to a pool and shared among
many nodes. Additional components and processes have been created to support the capacity pools
model.
License Manager
The License Manager is a software component introduced with ONTAP Select 9.5 using ONTAP
Select Deploy 2.10. LM runs as a separate process within each instance of the Deploy administration
utility. Some of the functions provided by LM include:
Licensing ONTAP Select | 39
• Generate a unique twenty-digit serial number for each node based on the capacity pool license
serial number
• Create leases for capacity from the shared capacity pools based on requests from the ONTAP
Select nodes
Lease characteristics
The storage allocated for every data aggregate at a node using a capacity pool license must have an
associated lease. The node requests a storage lease and if the capacity is available, the License
Manager responds with a lease. Each lease has the following explicit or implicit attributes:
• License Manager
Every ONTAP Select node is associated with one License Manager instance
• Capacity pool
Every ONTAP Select node is associated with one capacity pool
• Storage allocation
A specific capacity value is assigned in the lease
License Lock ID
Each instance of the License Manager, and therefore each corresponding Deploy utility instance, is
identified with a unique 128-bit number. This number is combined with the nine-digit capacity pool
license serial number to lock the pool to a specific License Manager instance (which is effectively a
Deploy instance). You must provide both values at the NetApp support site as part of generating the
NetApp License File (NLF).
You can determine the License Lock ID for your Deploy instance using the web user interface in the
following ways:
• Administration
Click the Administration tab a the top of the page, then click Systems and Settings.
1. If an existing lease is located at the node, it is used as long as all of the following are true:
• Storage request for the aggregate does not exceed the lease capacity
2. If an existing lease cannot be located, the node requests a new lease from the License Manager
40 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
• Lease for a data aggregate expires and is not renewed by the node
Note: If an ONTAP Select virtual machine is deleted, any active leases remain in effect until they
expire. When this occurs, the capacity is returned to the pool.
Note: Spaces have been added for clarity, but are not part of the actual serial number.
Each section of the node serial number is described in the following table, from left to right.
Attention: When opening a case with NetApp support involving a node that uses a capacity pool
license, you cannot provide the full twenty-digit node serial number. Instead, you must provide the
nine-digit capacity pool license serial number. You can derive the license serial number from the
node serial number as shown above. Skip the first three digits of the node serial number ('999') and
extract the next nine digits (ppppppppp).
Deployment restrictions
The restrictions that apply when using the capacity pool licensing model are presented below.
Consistent licensing model per cluster
All of the nodes within a single ONTAP Select cluster must use the same licensing model,
either capacity tiers or capacity pools. You cannot mix the licensing types for the nodes
within a single cluster.
All nodes in a cluster use the same License Manager instance
All the nodes with a capacity pool license in an ONTAP Select cluster must use the same
License Manager instance. Because there is one instance of License Manager within each
Deploy instance, this restriction is a restatement of the existing requirement that all nodes
in a cluster must be managed by the same Deploy instance.
One capacity pool per node
Each node can lease storage from exactly one capacity pool. A node cannot use two or
more pools.
Licensing ONTAP Select | 41
Summary of benefits
There are several benefits when using the capacity pools licensing model instead of the capacity tiers
licensing model.
Licensing workflow
The following workflow illustrates the process of purchasing and applying a license for your ONTAP
Select deployment. When purchasing a license, you must select the licensing model and storage
capacity.
The exact process varies based on whether you are using a capacity tier or capacity pool license:
• License Lock ID
You must have the License Lock ID for your Deploy instance when using a capacity pool license
Steps
3. On the License Generator page, select the desired license offering from the dropdown box.
4. Fill in the remaining fields on the same page, including the Product Serial #, which is the serial
number for the ONTAP Select node.
5. Click Submit.
6. After the request has been validated, select the delivery method for the license.
You can click either Download License or Email License.
7. Confirm that you received the license file based on your selected delivery method.
Related tasks
Managing the capacity tier licenses on page 66
Steps
1. Access the NetApp Support Site using a web browser and sign in.
3. Type the license serial number for the capacity pool and click Go!.
6. Type the License Lock ID for your ONTAP Select Deploy instance and click Submit.
Licensing ONTAP Select | 45
Related tasks
Managing the capacity pool licenses on page 66
• NFS
• CIFS
• iSCSI
• FlexClone
• SnapRestore
• SnapVault
• SnapMirror
You must purchase a separate license for any other features, including:
• SnapLock Enterprise
• FabricPool
• FlexCache
Note: You do not need a FabricPool license when utilizing StorageGRID Webscale.
46
Related concepts
Appendix A: Understanding the ONTAP Select storage environment on page 95
Appendix B: Understanding the ONTAP Select networking environment on page 101
Planning to deploy ONTAP Select on page 17
Planning to install the ONTAP Select Deploy utility on page 32
Related tasks
Confirming network connectivity among ONTAP Select nodes using the CLI on page 62
Related information
NetApp Technical Report 4517: ONTAP Select Product Architecture and Best Practices
Also, the same vCenter server must be able to manage all the hosts where an ONTAP Select node is
deployed within the cluster.
In addition, you should make sure that the firewall ports are configured to allow access to vSphere.
These ports must be open to support serial port connectivity to the ONTAP Select virtual machines.
By default, VMware allows access on the following ports:
NetApp recommends that the following firewall ports be opened to allow access to vSphere:
◦ Set the load balancing policy to “Route based on the originating virtual port ID”
• Configure a port group on the vSwitch for the internal traffic (ONTAP-internal):
◦ The port group is assigned to ONTAP Select virtual network adapters e0c-e0g used for the
cluster, HA interconnect, and mirroring traffic.
◦ The port group should be on a non-routable VLAN because this network is expected to be
private. You should add the appropriate VLAN tag to the port group to take this into account.
◦ The load balancing, failback and failover order settings of the port group should be the same
as the vSwitch.
• Configure a port group on the vSwitch for the external traffic (ONTAP-external):
◦ The port group is assigned to ONTAP Select virtual network adapters e0a-e0c used for data
and management traffic.
◦ The port group can be on a routable VLAN. Also, depending on the network environment,
you should add an appropriate VLAN tag or configure the port group for VLAN trunking.
◦ The load balancing, failback and failover order settings of the port group should be same as
vSwitch.
The above vSwitch configuration is for a host with 2x10Gb ports in a typical network environment. If
your host or network configuration differs, and for more information on the recommended best
practices related to network configuration, you should review the ONTAP Select Product
Architecture and Best Practices Technical Report.
50
Steps
1. Downloading the virtual machine image on page 50
2. Deploying the virtual machine on page 51
3. Signing in to the Deploy utility web interface on page 52
4. Signing in to the Deploy utility using SSH on page 52
Related tasks
Adding an ONTAP Select image to the Deploy utility on page 79
Steps
1. Access the NetApp Support Site using a web browser and click Support Quick Links.
2. Click Download Software under Top Tasks and sign in to the site.
3. Scroll to ONTAP Select and select Deploy Install on the right and click Go!.
5. Click CONTINUE and accept the End User License Agreement (EULA).
6. Select and download the appropriate installation file, responding to all prompts as needed for your
environment.
Related information
NetApp Support
Installing and configuring the ONTAP Select Deploy utility | 51
• Enabled DHCP in the VMware environment if you will dynamically assign an IP address to the
Deploy virtual machine
You must have the configuration information to be used when creating the virtual machine, including
the name of the virtual machine, external network, and host name. When defining a static network
configuration, you need the following additional information:
Steps
2. Navigate to the appropriate location in the vCenter hierarchy and select Deploy OVF Template.
3. Select the OVA file and complete the Deploy OVF Template wizard, selecting the options as
appropriate for your environment.
You must define the password for the administrator account. You need to provide this password
when signing in to the Deploy utility.
4. After the virtual machine is deployed, select the new virtual machine and power it on if it is not
already powered on based on your input to the deployment wizard.
5. If needed, you can configure the Deploy network using the virtual machine console:
a. Click the Console tab to access the ESXi host setup shell and monitor the power on process.
Related references
Required configuration information on page 33
Steps
1. Point your browser to the Deploy utility using the IP address or domain name:
https://<ip_address>/
3. If the Welcome to ONTAP Select popup window is displayed, you should review the
prerequisites and click OK to continue.
4. If this is the first time signing in and you did not install Deploy using the wizard available with
vCenter, provide the following configuration information when prompted:
• AutoSupport (optional)
Related tasks
Signing in to the Deploy utility using SSH on page 52
Steps
1. Sign in using the administrator account and management IP address of the Deploy virtual
machine; for example:
ssh admin@<ip_address>
3. If this is the first time signing in and you did not install Deploy using the wizard available with
vCenter, provide the following configuration information when prompted:
• New password for the administrator account (required)
4. Type ? and press Enter to display a list of the available management shell commands.
Related tasks
Changing the Deploy administrator password using the CLI on page 64
Signing in to the Deploy utility web interface on page 52
54
Related concepts
Planning to deploy ONTAP Select on page 17
Deploying an ONTAP Select cluster using the CLI on page 88
1. Prepare the hypervisor hosts and acquire the capacity license files
You must install and prepare the hypervisor servers that host the ONTAP Select nodes. You
should also purchase licenses and acquire the capacity license files for each node. You can
perform these tasks before using the Deploy utility.
a. Configuring host
b. Deploying nodes
Best practice: After creating a cluster, you should back up the ONTAP Select Deploy
configuration data.
Note: The Deploy administration utility contains a single version of ONTAP Select. If you want to
deploy clusters using an earlier version of ONTAP Select, you must first add the ONTAP Select
image to your Deploy instance. See Adding an ONTAP Select image to the Deploy utility for more
information.
Related concepts
Preparing to create your first ONTAP Select cluster on page 54
Related tasks
Signing in to the Deploy utility web interface on page 52
Confirming network connectivity among ONTAP Select nodes using the CLI on page 62
Editing storage and license capacity on page 67
Adding an ONTAP Select image to the Deploy utility on page 79
• The cluster contains an even number of nodes (two, four, six, or eight)
• The needed storage licenses have been purchased and the license files are available
56 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
Steps
1. Sign in to the Deploy utility through the web interface using the administrator account (admin)
and provide the current password.
2. Confirm that you have met the configuration requirements and prerequisites as described in the
Welcome to ONTAP Select popup window and click OK.
3. On the Getting Started cluster launch page, click Upload and select a license from your local
workstation and click Open to upload the license.
The license you add is displayed in a table on the right side of the page. You should add all of the
necessary licenses. If you are using capacity tier licenses, you must add one license for each node.
4. Click Refresh and confirm that the licenses have been added correctly.
6. Click Refresh and confirm the Type value for the host is ESX.
The username and password you provided for the host or vCenter server is added to the Deploy
credential database.
7. Add additional hypervisor hosts for the nodes in the ONTAP Select cluster.
9. In the Cluster Details section of the page, provide all the required information describing the
cluster and click Done.
Unless you have reason to set the cluster MTU size, you should take the default value and allow
Deploy to make any adjustments as needed.
10. Under Node Setup, provide the node management IP addresses and select the licenses for the two
nodes in the HA pair; you can upload a new license if needed.
You can also change the node names if needed.
11. Provide the configuration for the Hypervisor and Network section.
A Small instance and Medium instance are the two available hypervisor configuration types.
These instance types are supported by the standard and premium offerings of the purchased
license, respectively. The license you select for the node must match or exceed the instance type.
You must select the hypervisor host as well as the management, data, and internal networks.
The internal network cannot be the same as the management or data network.
12. Provide the configuration for the Storage section and click Done.
If you select Enable Software RAID, you must include one storage pool for system files, and
four or more disks for the root and data aggregates.
13. If you are creating a cluster with four or more nodes, configure the nodes in the additional HA
pairs following the same steps you used for the first HA pair.
16. Run the network connectivity checker which is part of the web user interface to test the
connectivity of the internal cluster network.
17. Provide the ONTAP administrator password and click Create Cluster to begin the cluster
creation process and then click OK in the Cluster create operation started popup window.
It can take up to 30 minutes for the cluster to be created.
18. Monitor the four-step cluster creation process to confirm the cluster is created successfully.
The page is automatically refreshed at regular intervals.
Attention: If the cluster creation operation is initiated but fails to complete, the ONTAP
administrative password you define is not registered. In this case, you can access the
management interface for the ONTAP Select cluster using the password changeme123 for the
admin account.
Related tasks
Backing up the Deploy configuration data on page 72
Adding an account to the credential store on page 62
Steps
1. Sign in to the Deploy utility through the web interface using the administrator account (admin)
and provide the current password.
2. Confirm that you have met the configuration requirements and prerequisites as described in the
Welcome to ONTAP Select popup window and click OK.
3. On the Getting Started cluster launch page, click Upload and select a license from your local
workstation and click Open to upload the license.
The license you add is displayed in a table on the right side of the page.
4. Click Refresh and confirm that the license has been added correctly.
You can add the ESXi host directly or by connecting to a vCenter server. You should provide the
appropriate host details.
The host you add is displayed in a table on the right side of the page.
6. Click Refresh and confirm the Type value for the host is ESX.
The username and password you provided for the host or vCenter server is added to the Deploy
credential database.
8. In the Cluster Details section of the page, provide all the required information describing the
cluster and click Done.
9. Under Node Setup, provide the node management IP address and select the license for the node;
you can upload a new license if needed.
You can also change the node name if needed.
10. Provide the configuration for the Hypervisor and Network section.
A Small instance and Medium instance are the two available hypervisor configuration types.
These instance types are supported by the standard and premium offerings of the purchased
license, respectively. The license you select for the node must match or exceed the instance type.
You must select the hypervisor host as well as the management and data networks.
11. Provide the configuration for the Storage section and click Done.
If you select Enable Software RAID, you must include one storage pool for system files, and
four or more disks for the root and data aggregates.
14. Provide the ONTAP administrator password and click Create Cluster to begin the cluster
creation process and then click OK in the Cluster create operation started popup window.
It can take up to 30 minutes for the cluster to be created.
15. Monitor the four-step cluster creation process to confirm the cluster is created successfully.
The page is automatically refreshed at regular intervals.
Attention: If the cluster creation operation is initiated but fails to complete, the ONTAP
administrative password you define is not registered. In this case, you can access the
management interface for the ONTAP Select cluster using the password changeme123 for the
admin account.
Related tasks
Backing up the Deploy configuration data on page 72
Adding an account to the credential store on page 62
59
◦ Default SVM
◦ Cluster SVM
Note: There are no data SVMs created. Also, the multi-node cluster has an internal network with
autogenerated LIFs.
• SnapCenter (refer to the NetApp Interoperability Matrix Tool for more details)
To identify the supported versions of the client software, refer to the NetApp Interoperability Matrix
Tool. If the client software supports ONTAP 9, then the same version is also supported with ONTAP
Select.
60 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
Restriction: The use of SnapCenter and the corresponding plug-ins requires server-based licenses.
Storage system licensing of the SnapCenter plug-ins is not currently supported with ONTAP
Select.
Any other NetApp client software that is not included in the list is not supported by ONTAP Select.
Mirrored aggregates
There are data spare disks created by the Deploy administration utility on each ONTAP Select node
from the usable datastore space (such as, Pool0 and Pool1). To implement high availability for your
data on a multi-node cluster, you must create a mirrored aggregate using these spares.
Related references
Where to find additional information on page 106
Related information
NetApp Interoperability Matrix Tool
Related information
NetApp Support
Upgrade, revert, or downgrade
Software express upgrade
ONTAP Select 9.5 Release Notes
62
Related tasks
Signing in to the Deploy utility web interface on page 52
Signing in to the Deploy utility using SSH on page 52
Steps
1. Sign in to the Deploy utility web user interface using the administrator account.
Related concepts
Authentication using the credential store on page 19
• Quick
This mode performs a basic non-disruptive test. A PING test is performed, along with a test of the
network MTU size and the vSwitch.
• Extended
This mode performs a more comprehensive test over all the redundant network paths. If you run
this on an active ONTAP Select cluster, the performance of the cluster can be impacted.
Note: It is recommended that you always perform a quick test before creating a multi-node cluster.
After the quick test completes successfully, you can optionally perform an extended test based on
your production requirements.
Steps
2. Display the current runs of the network connectivity checker and verify that no runs are active:
network connectivity-check show
3. Start the network connectivity checker and note the run identifier in the command output:
network connectivity-check start -host-names HOSTNAMES -vswitch-type
VSWITCH_TYPE-mode MODE
Example
4. Monitor the progress of the network connectivity checker based on the run identifier:
network connectivity-check show -run-id RUN_ID
Steps
1. Sign in to the Deploy utility web user interface using the administrator account.
2. Click the figure icon at the top right of the page and select Change Password.
3. Provide the current and new password as prompted and click Submit.
64 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
Steps
• Category
• Type
• Level
• Instance
Steps
1. Sign in to the Deploy utility web user interface using the administrator account.
4. Optionally click Filtering and create a filter to limit the event messages displayed.
Steps
1. Sign in to the Deploy utility web user interface using the administrator account.
4. Provide the configuration data as appropriate for your environment and click Save.
If you use a proxy server, you can configure the proxy URL as follows:
http://USERNAME:PASSWORD@<FQDN|IP>:PORT
Example
http://user1:[email protected]:80
Enabling AutoSupport
You can enable and disable the AutoSupport feature as needed.
Steps
1. Sign in to the Deploy utility web user interface using the administrator account.
• Deploy logs
Log files created by the ONTAP Select Deploy utility
• Troubleshooting
Troubleshooting and debugging information about the hypervisor hosts and ONTAP Select nodes
• Performance
Performance information about the hypervisor hosts and ONTAP Select nodes
Steps
1. Sign in to the Deploy utility web user interface using the administrator account.
4. Select the type and provide a description for the package; you can optionally provide a case
number.
66 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
6. On the left side of the page, click History and locate the correct package; you can click Refresh
as needed.
7. Optionally click the download icon to save the AutoSupport file to your local workstation.
Steps
1. Sign in to the Deploy utility through the web interface using the administrator account.
4. Optionally click Filtering and create a filter to limit the licenses displayed.
5. You can edit or delete an existing license by clicking the appropriate icon on the right for the
license.
6. To add a new license, click Add at the top of the page and then click Upload License(s) and
select a license file from your local workstation.
Steps
1. Sign in to the Deploy utility through the web interface using the administrator account.
4. Optionally click Filtering and create a filter to limit the licenses displayed.
5. To add a new license, click Add at the top of the page and then click Upload License(s) and
select a license file from your local workstation.
6. You can delete an existing license by clicking the appropriate icon on the right for the license.
a. Click Summary.
b. Select and expand a pool to see the clusters and nodes leasing storage from the pool.
d. You can change the duration of the leases issued for the pool under Lease expiration.
a. Click Details.
Supporting ONTAP Select and the ONTAP Select Deploy utility | 67
You can perform one or more actions each time you edit the configuration.
Note: If an ONTAP Select node is deployed with an evaluation license, you can expand the storage
up to the limit imposed by the license. However, you cannot update the evaluation license.
Steps
1. Sign in to the Deploy utility through the web interface using the administrator account.
2. Click the Clusters tab at the top of the page and select the cluster containing the node you want
to update.
3. Click + next to a node to display the Edit Node Storage popup window which presents the
current license, capacity, and storage pool details for the node.
If the node is part of an HA pair, the storage configuration for both nodes is shown. The storage
allocated must be the same at both nodes.
4. Type a value for Additional Capacity and notice that the New Capacity field is also updated.
A warning message is displayed if the existing license does not support the new capacity or the
node does not have a storage pool large enough to support the request.
5. If your current license capacity is insufficient to allow the storage expansion, you must update
your license:
c. Click Update License and select a license file and click Open.
The serial number of the new license file must match the node's current serial number.
d. Click Close.
68 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
You can only refresh the license file based on the serial number assigned to the node. You cannot
use a license file for a different serial number.
6. If there is not a storage pool large enough to handle the request, you must add a storage pool:
7. Under ONTAP Credentials, provide the username and password for the cluster administrator
account.
Steps
1. Sign in to the Deploy utility web user interface using the administrator account.
4. Optionally define a filter to customize your view of the two-node clusters monitored by the
mediator service.
Steps
1. Sign in to the Deploy utility web user interface using the administrator account.
2. Click the Clusters tab at the top of the page and select the desired cluster from the list.
3. Click the gear icon on the right of the cluster and select Take Offline.
If the offline option is not available, the cluster is already in the offline state.
Supporting ONTAP Select and the ONTAP Select Deploy utility | 69
5. Click Refresh occasionally and hover over the icon to the left of the cluster name until the state
of the cluster is offline.
6. To bring the cluster back online, click the gear icon on the right of the cluster and select Bring
Online.
7. Click Refresh occasionally and hover over the icon on the left until the state of the cluster is
online.
Steps
1. Sign in to the Deploy utility web user interface using the administrator account.
2. Click the Clusters tab at the top of the page and select the desired cluster from the list.
3. Click the gear icon on the right of the cluster and select Delete.
If the delete option is not available, then the cluster is not in an offline state. You must assure that
the cluster is offline.
4. Click Refresh occasionally until the cluster is removed from the list.
Steps
1. Sign in to the Deploy virtual machine CLI using the administrator account.
Steps
2. Navigate to the appropriate location in the vCenter hierarchy to locate the ONTAP Select virtual
machine.
Steps
1. Sign in to the Deploy utility web user interface using the administrator account.
2. Click the Clusters tab at the top left of the page and select the desired cluster from the list.
3. Click the gear icon at the top right and select Cluster Refresh from the drop-down list.
4. Provide the current ONTAP Select username and password for the cluster under Cluster
Credentials.
5. Click Refresh.
Related tasks
Backing up the Deploy configuration data on page 72
Steps
1. Backing up the Deploy configuration data on page 72
2. Installing a new instance of the Deploy virtual machine on page 72
3. Restore the Deploy configuration data to the new virtual machine on page 73
Steps
1. Sign in to the Deploy utility CLI using SSH with the administrator account.
2. Create a backup of the Deploy configuration data, which is stored in an internal directory at the
Deploy server:
deploy backup create
5. Select your backup file based on the date in the Created field and record the Download URL
value.
You can access the backup file through the URL.
6. Using a web browser or utility such as CURL, download the backup file to your local workstation
with the URL.
Step
Related tasks
Installing and configuring the ONTAP Select Deploy utility on page 50
Steps
1. In a command shell on your local workstation, use the sftp utility to upload the backup file to the
Deploy virtual machine.
Example
2. Sign in to the Deploy utility CLI using SSH with the administrator account.
Example
Steps
1. Downloading the upgrade package on page 74
2. Uploading the package to the Deploy virtual machine on page 74
3. Applying the upgrade package on page 75
Related tasks
Backing up the Deploy configuration data on page 72
Related information
ONTAP Select 9.5 Release Notes
Steps
1. Access the NetApp Support Site using a web browser and click Support Quick Links.
2. Click Download Software under Top Tasks and sign in to the site.
3. Scroll to ONTAP Select and select Deploy Upgrade on the right and click Go!.
5. Click CONTINUE and accept the End User License Agreement (EULA).
6. Select and download the appropriate installation file, responding to all prompts as needed for your
environment.
Related information
NetApp Support
Step
1. In a command shell on your local workstation, use the sftp utility to upload the image file to the
Deploy virtual machine.
Example
Result
The upgrade file is stored in the home directory of the admin user.
Steps
1. Sign in to the Deploy utility CLI using SSH with the administrator account.
2. Perform the upgrade using the appropriate directory path and file name:
deploy upgrade -package-path FILEPATH
Example
Related tasks
Restoring a Deploy utility instance using a configuration backup on page 76
Reconfiguring and recovering a Deploy utility instance on page 77
Steps
Refer to the related tasks for more detailed information about the install and restore procedures.
2. Sign in to the ONTAP command line interface of the ONTAP Select two-node cluster.
4. If the IP address of the new Deploy virtual machine is different than the original Deploy virtual
machine, you must remove the old mediator iSCSI targets and add new targets:
a. storage iscsi-initiator remove-target -node * -target-type mailbox
The <ip_address> parameter is the IP address of the new Deploy virtual machine.
These commands allow the ONTAP Select nodes to discover the mailbox disks on the new
Deploy utility virtual machine.
Related tasks
Installing and configuring the ONTAP Select Deploy utility on page 50
Restore the Deploy configuration data to the new virtual machine on page 73
Reinstalling a capacity pool license on page 86
then complete the recovery by performing additional configuration of the two nodes in the ONTAP
Select cluster.
Steps
b. Optionally restore the Deploy configuration from a previous backup to the new virtual
machine.
If you restore a previous backup, the new Deploy instance will not contain the two-node cluster.
Refer to the related tasks for more detailed information about the install and restore procedures.
2. Sign in to the ONTAP command line interface of the ONTAP Select two-node cluster.
5. Access the online documentation web page at the new Deploy utility virtual machine and sign in
using the admin account:
http://<ip_address>/api/ui
8. Click the Model next to iscsi_target and complete the name value.
Use the target name for the iqn_name parameter.
10. If the IP address of the new Deploy virtual machine is different than the original Deploy virtual
machine, you must use the ONTAP CLI to remove the old mediator iSCSI targets and add new
targets:
Supporting ONTAP Select and the ONTAP Select Deploy utility | 79
The <ip_address> parameter is the IP address of the new Deploy virtual machine.
These commands allow the ONTAP Select nodes to discover the mailbox disks on the new
Deploy utility virtual machine.
Related tasks
Installing and configuring the ONTAP Select Deploy utility on page 50
Restore the Deploy configuration data to the new virtual machine on page 73
Reinstalling a capacity pool license on page 86
Steps
1. Downloading the install image on page 80
2. Uploading the install image to the Deploy virtual machine on page 80
3. Adding the install image on page 81
4. Displaying the available install images on page 81
80 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
Related tasks
Removing ONTAP Select images from the Deploy utility on page 81
Steps
1. Access the NetApp Support Site using a web browser and click Support Quick Links.
3. Scroll to ONTAP Select and select ONTAP Image Install on the right and click Go!.
5. Click CONTINUE and accept the End User License Agreement (EULA).
6. Select and download the appropriate installation file, responding to all prompts as needed for your
environment.
Step
1. In a command shell on your local workstation, use the sftp utility to upload the image file to the
Deploy virtual machine.
Example
Result
The node install file is stored in the home directory of the admin user.
Supporting ONTAP Select and the ONTAP Select Deploy utility | 81
Steps
1. Sign in to the Deploy utility CLI using SSH with the administrator (admin) account.
Example
Steps
1. Access the online documentation web page at the Deploy utility virtual machine and sign in using
the administrator (admin) account:
http://<FQDN|IP_ADDRESS>/api/ui
2. Navigate to the bottom of the page and click Deploy and then click GET /images.
Steps
1. Sign in to the Deploy utility CLI using SSH with the administrator (admin) account.
82 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
2. Display the clusters managed by Deploy and record the ONTAP images in use:
cluster show
Example
rm -r /opt/netapp/images/DataONTAPv-9.3RC1-vidconsole-esx.ova
Example
rm -r /opt/netapp/images/DataONTAPv-9.3RC1-serialconsole-kvm.raw.tar
Best practice: You should select an upgrade procedure that uses the Deploy administration
utility.
Performing an ESXi upgrade using the Deploy administration utility is the more general and resilient
option. However, there may be instances when Deploy is unavailable or cannot be used. For example,
upgrading to ESXi 6.5 is not supported with earlier versions of ONTAP Select and the Deploy
administration utility. If you are using these earlier versions and attempt an upgrade, the ONTAP
Select virtual machine can be left in a state where it cannot be booted. In this case, you must select an
upgrade procedure that does not use Deploy. Refer to 1172198 for more information.
Related tasks
Upgrading an existing Deploy virtual machine using the CLI on page 73
Refreshing the Deploy cluster configuration on page 70
Steps
1. Sign in to the Deploy utility CLI using SSH with the administrator account.
Example
3. Upgrade the hypervisor host where ONTAP Select is running to ESXi 6.5 or 6.7 using the
procedure provided by VMware.
Refer to Preparing to upgrade VMware ESXi for more information.
Example
5. After the node comes up, verify that the cluster is healthy.
Example
Steps
1. Sign in to the Deploy utility CLI using SSH with the administrator account.
Example
3. Upgrade the hypervisor host where ONTAP Select is running to ESXi 6.5 or 6.7 using the
procedure provided by VMware.
Refer to Preparing to upgrade VMware ESXi for more information.
Example
5. After the node comes up, verify that storage failover is enabled and the cluster is healthy.
Example
Steps
1. Sign in to the ONTAP command line interface and halt the node.
2. Using VMware vSphere, confirm that the ONTAP Select virtual machine is powered off.
3. Upgrade the hypervisor host where ONTAP Select is running to ESXi 6.5 or 6.7 using the
procedure provided by VMware.
Refer to Preparing to upgrade VMware ESXi for more information.
5. Sign in to the ONTAP CLI using SSH with the administrator account.
6. After the node comes up, verify that the cluster is healthy.
Example
Steps
1. Sign in to the ONTAP command line interface and halt the node.
2. Using VMware vSphere, confirm that the ONTAP Select virtual machine is powered off.
3. Upgrade the hypervisor host where ONTAP Select is running to ESXi 6.5 or 6.7 using the
procedure provided by VMware.
Refer to Preparing to upgrade VMware ESXi for more information.
5. Sign in to the ONTAP CLI using SSH with the administrator account.
6. After the node comes up, verify that storage failover is enabled and the cluster is healthy.
Example
• Determine all the capacity pool licenses used by the original Deploy instance
• If you restore a backup as part of creating the new Deploy instance, determine if the backup is
current and up-to-date
• Locate the ONTAP Select nodes that were most recently created by the original Deploy instance
(only if an up-to-date backup from the original Deploy instance is not restored to the new Deploy
instance)
Steps
1. Contact NetApp support and have all the capacity pool licenses for the original Deploy instance
unbound and unregistered.
2. Acquire and download a new license file for each of the capacity pool licenses.
See Acquiring a capacity pool license file for more information.
d. Click Add and then Upload License(s) to select and upload the licenses.
4. If you created the new Deploy instance without restoring a backup, or you used a backup that was
not current and up-to-date, you must update the serial sequence number:
a. Sign in to the Deploy utility command line interface using the administrator account.
b. Display the serial number for a node most recently created by the original Deploy instance:
node show -cluster-name CLUSTER_NAME -name NODE_NAME -detailed
c. Extract the last eight digits from the twenty-digit node serial number to obtain the last serial
sequence number used by the original Deploy instance.
d. Add 20 to the serial sequence number to create the new serial sequence number.
e. Set the serial sequence number for the new Deploy instance:
license-manager modify -serial-sequence SEQ_NUMBER
5. If the IP address assigned to the new Deploy instance is different than the IP address of the
original Deploy instance, you must update the IP address at every ONTAP Select node that uses a
capacity pools license:
a. Sign in to the ONTAP command line interface of the ONTAP Select node.
Related tasks
Acquiring a capacity pool license file on page 44
88
Best practice: After deploying a cluster, you should back up the ONTAP Select Deploy
configuration data.
Before creating an ONTAP Select cluster on the ESXi hypervisor, you should note the following:
Preparing to attach storage to the ONTAP Select node
If you use a local hardware RAID controller, you must create at least one storage pool at
each node for the system data as well as the root and data aggregates. You must attach the
storage pool as part of configuring the ONTAP Select node.
If you use software RAID, you must create a storage pool for the system data and make
sure the SSD drives are available for the root and data aggregates. You must attach the
storage pool and disks as part of configuring the ONTAP Select node.
Available ONTAP Select versions
The Deploy administration utility contains a single version of ONTAP Select. If you want
to deploy clusters using an earlier version of ONTAP Select, you must first add the
ONTAP Select image to your Deploy instance. See Adding an ONTAP Select image to the
Deploy utility for more information.
Licensing ONTAP Select for a production deployment
Before deploying an ONTAP Select cluster in a production environment, you must
purchase a storage capacity license and download the associated license file. You can
license the storage at each node using the capacity tiers model, or license a shared pool
using the capacity pools model.
Related tasks
Signing in to the Deploy utility using SSH on page 52
Adding an ONTAP Select image to the Deploy utility on page 79
Related information
ONTAP Select 9 Quick Start Guide: Deploying an Evaluation Cluster on VMware
ONTAP Select 9 Quick Start Guide: Deploying an Evaluation Cluster on KVM
Steps
1. Uploading a license file to the Deploy virtual machine on page 89
2. Registering a license for an ONTAP Select node on page 89
Step
1. In a command shell on your local workstation, use the sftp utility to upload the license file to the
Deploy virtual machine.
Example
Steps
1. Sign in to the Deploy utility CLI using SSH with the administrator account.
3. Display the licenses in the system to confirm the license was added properly:
license show
Steps
1. Sign in to the Deploy utility CLI using SSH with the administrator account.
2. If the host is managed by a vCenter server, add the vCenter account credential:
credential add -hostname <FQDN|IP> -type vcenter -username
VCENTER_USERNAME
Example
Example
Example
Related tasks
Adding an account to the credential store on page 62
Steps
1. Sign in to the Deploy utility CLI using SSH with the administrator account.
Example
Example
Steps
1. Sign in to the Deploy utility CLI using SSH with the administrator account.
Example
The RAID configuration for the node is indicated with the -passthrough-disks parameter. If
you are using a local hardware RAID controller, this value must be false. If you are using
software RAID, this value must be true.
A capacity tier license is used for the ONTAP Select node.
Example
When deploying a single-node cluster, you do not need an internal network and should remove -
internal-network.
Example
Example
Steps
1. Sign in to the Deploy utility CLI using SSH with the administrator account.
Deploying an ONTAP Select cluster using the CLI | 93
Example
You can also obtain the available storage pools through VMware vSphere.
Example
Example
Steps
1. Sign in to the Deploy utility CLI using SSH with the administrator account.
Example
Provide the password to be used for the ONTAP administrator account when prompted.
3. Display the status of the cluster to determine when it has been successfully deployed successfully.
cluster show -name CLUSTERNAME
94 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
Related tasks
Backing up the Deploy configuration data on page 72
Confirming network connectivity among ONTAP Select nodes using the CLI on page 62
95
Related concepts
Appendix B: Understanding the ONTAP Select networking environment on page 101
Related information
NetApp Technical Report 4517: ONTAP Select Product Architecture and Best Practices
1. Pre-deployment prerequisites
You must make sure that each hypervisor host is configured and ready for an ONTAP Select
deployment. The configuration involves the physical drives, RAID controllers and groups, and
LUNs, as well as related network preparation. This configuration is performed outside of ONTAP
Select.
4. Post-deployment configuration
After an ONTAP Select deployment completes, you can configure the cluster using the ONTAP
CLI or System Manager. This configuration is performed outside of ONTAP Select Deploy.
• Speed (RPM)
operating system as one or more LUNs. Each LUN is presented to the hypervisor host operating
system as a physical hard drive.
When configuring an ONTAP Select host, you should be aware of the following:
• Depending on the vendor, each RAID controller supports a maximum number of drives per RAID
group.
• The storage pool must be available before the virtual disks can be created.
• The virtual disks cannot be created before the virtual machine is created.
• You must rely on the ONTAP Select Deploy administration utility to create all virtual disks (that
is, an administrator must never create a virtual disk outside of the Deploy utility).
• VMFS
• NFS
vSAN datastores
Every ESXi host can have one or more local VMFS datastores. Normally these datastores
are only accessible to the local host. However, VMware vSAN allows each of the hosts in
an ESXi cluster to share all of the datastores in the cluster as if they were local. The
following figure illustrates how vSAN creates a pool of datastores that are shared among
the hosts in the ESXi cluster.
Related concepts
Appendix A: Understanding the ONTAP Select storage environment on page 95
Related information
NetApp Technical Report 4517: ONTAP Select Product Architecture and Best Practices
Physical networking
The physical network supports an ONTAP Select cluster deployment primarily by providing the
underlying layer two switching infrastructure. The configuration related to the physical network
includes both the hypervisor host and the broader switched network environment.
• How will you maintain separation between the internal and external networks?
• Will you maintain a separation between the data and management networks?
Logical networking
ONTAP Select uses two different logical networks, separating the traffic according to type.
Specifically, traffic can flow among the hosts within the cluster as well as to the storage clients and
other machines outside of the cluster. The virtual switches managed by the hypervisors help support
the logical network.
Internal network
With a multi-node cluster deployment, the individual ONTAP Select nodes communicate using an
isolated “internal” network. This network is not exposed or available outside of the nodes in the
ONTAP Select cluster.
Note: The internal network is only present with a multi-node cluster.
◦ Cluster
◦ IPv4 only
◦ Link-local address
• The MTU size is 9000 bytes by default and can be adjusted within 7500-9000 range (inclusive)
External network
The external network processes traffic between the nodes of an ONTAP Select cluster and the
external storage clients as well as the other machines. The external network is a part of every cluster
deployment and has the following characteristics:
◦ Intercluster (optional)
• IP addresses that are assigned based on the configuration choices of the administrator:
◦ IPv4 or IPv6
• Virtual switch
The virtual switch software within the hypervisor environment, whether vSwitch (VMware) or
Open vSwitch (KVM), joins the ports exposed by the virtual machine with the physical Ethernet
NIC ports. You must configure a vSwitch for every ONTAP Select host, as appropriate for your
environment.
ONTAP LIFs
There are several logical interfaces used by the ONTAP Select node in a single-node cluster. Some of
the LIFs are required, while others are optional based on your goals. The LIFs are created in one of
two different ways.
• Node management
There is one LIF per node, and the IP address you assign can be either IPv4 or IPv6
• Cluster management
There is one LIF per cluster, and the IP address you assign can be either IPv4 or IPv6.
These LIFs operate on the external network. Also note that while the use of an IPv6 address is
possible, the creation of an IPv6 LIF by the ONTAP Select Deploy administration utility is not
supported.
• NAS data
104 | ONTAP Select 9 Installation and Cluster Deployment Guide for VMware
You can configure one or more NAS data LIFs per SVM. Each IP address you assign can be
either IPv4 or IPv6.
• SAN data
You can configure one or more SAN (that is, iSCSI) data LIFs per SVM. Each IP address you
assign can be either IPv4 or IPv6.
• SVM management
There is one management LIF per SVM and the IP address you assign can be either IPv4 or IPv6.
• Intercluster management
You can create one or more intercluster management LIFs per node. The IP addresses you assign
can be either IPv4 or IPv6.
Note: Ports e0a, e0b, and e0g are associated with the external network. The remaining four ports
are associated with the internal cluster network.
ONTAP LIFs
There are several logical interfaces used by each ONTAP Select node in a four-node deployment.
Some of the LIFs are required, while others are optional based on your goals. The LIFs are created in
one of three different ways.
Note: IP version 6 (IPv6) is not supported with a two-node cluster due to the iSCSI traffic between
the nodes and the Deploy mediator service.
Appendix B: Understanding the ONTAP Select networking environment | 105
• Cluster
There are two cluster LIFs per node. Static link-local IP addresses are generated and assigned to
virtual machine ports e0c and e0d.
• Node management
There is one LIF per node and the IP address you assign can be either IPv4 or IPv6.
• Cluster management
There is one LIF per cluster, and the IP address you assign can be either IPv4 or IPv6.
These LIFs operate on the external network. Also note that while the use of an IPv6 address is
possible, the creation of an IPv6 LIF by the ONTAP Select Deploy administration utility is not
supported.
• NAS data
You can configure one or more NAS data LIFs per SVM.
• SAN data
You can configure one or more SAN (that is, iSCSI) data LIFs per SVM.
• SVM management
There is one management LIF per SVM.
• Intercluster management
You can create one or more intercluster management LIFs per node.
ONTAP 9 resources
• ONTAP 9 Documentation Center
Provides all of the documentation for ONTAP 9.
NetApp resources
• NetApp Support
Access troubleshooting tools, documentation, and technical support assistance.
Copyright
Copyright © 2019 NetApp, Inc. All rights reserved. Printed in the U.S.
No part of this document covered by copyright may be reproduced in any form or by any means—
graphic, electronic, or mechanical, including photocopying, recording, taping, or storage in an
electronic retrieval system—without prior written permission of the copyright owner.
Software derived from copyrighted NetApp material is subject to the following license and
disclaimer:
THIS SOFTWARE IS PROVIDED BY NETAPP "AS IS" AND WITHOUT ANY EXPRESS OR
IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE,
WHICH ARE HEREBY DISCLAIMED. IN NO EVENT SHALL NETAPP BE LIABLE FOR ANY
DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE
GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT,
STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN
ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE
POSSIBILITY OF SUCH DAMAGE.
NetApp reserves the right to change any products described herein at any time, and without notice.
NetApp assumes no responsibility or liability arising from the use of products described herein,
except as expressly agreed to in writing by NetApp. The use or purchase of this product does not
convey a license under any patent rights, trademark rights, or any other intellectual property rights of
NetApp.
The product described in this manual may be protected by one or more U.S. patents, foreign patents,
or pending applications.
Data contained herein pertains to a commercial item (as defined in FAR 2.101) and is proprietary to
NetApp, Inc. The U.S. Government has a non-exclusive, non-transferrable, non-sublicensable,
worldwide, limited irrevocable license to use the Data only in connection with and in support of the
U.S. Government contract under which the Data was delivered. Except as provided herein, the Data
may not be used, disclosed, reproduced, modified, performed, or displayed without the prior written
approval of NetApp, Inc. United States Government license rights for the Department of Defense are
limited to those rights identified in DFARS clause 252.227-7015(b).
108
Trademark
NETAPP, the NETAPP logo, and the marks listed on the NetApp Trademarks page are trademarks of
NetApp, Inc. Other company and product names may be trademarks of their respective owners.
http://www.netapp.com/us/legal/netapptmlist.aspx
109
Index
A installing, ONTAP Select Deploy utility
deploying the virtual machine 51
administering, ONTAP Select cluster signing in using SSH 52
initial state after deployment 59
performing additional configuration 59
upgrading ONTAP Select nodes 60 L
where to find additional information 106 license file
acquiring a capacity pool license 44
C acquiring a capacity tier license 43
uploading to the Deploy utility 89
capacity pools licensing licensing
benefits 41 enforcement 37
format of node serial number 40 evaluation license 35
understanding 38 ONTAP Select 35
comments premium and standard capacity 37
how to send feedback about documentation 109 purchased license 35
credential store purchased license and storage capacity 9
key concepts 9 purchased license workflow 42
planning 19 registering for an ONTAP Select node 89
D M
deploying a cluster, using the CLI mediator service
installing the license file 88 key concepts 9
deploying a cluster, using the web UI used with two-node-clusters 26
creating a multi-node cluster 55 viewing the status 68
creating a single-node cluster 57 MetroCluster SDS
creating your first cluster 55 key concepts 9
signing in to the Deploy utility 52 preparing to deploy 20
workflow steps when deploying first cluster 54
documentation
how to receive automatic notification of changes to N
109 networking, ONTAP Select
how to send feedback about 109 four-node cluster deployment 104
general concepts and characteristics 101
F logical networking 102
physical networking 101
feedback single-node cluster deployment 103
how to send comments about documentation 109 virtual machine networking environment 103
H O
high availability online documentation web page
different architecture with ONTAP Select 14 accessing page at ONTAP Select Deploy utility 15
hypervisor host configuration and assessment ONTAP features
general preparation 46 enabled by default 59
illustration of the ONTAP Select network and nodes license automatically applied 14
47 not supported in ONTAP Select 15
preparation of the cluster network 47 ONTAP Select
vSwitch configuration 48 administering 59
business needs and possible usage scenarios 13
comparing to ONTAP 9 14
I deploying a cluster using the CLI 88
information deploying a cluster using the web UI 54
how to send feedback about improving how to get started 9
documentation 109 hypervisor host configuration and assessment 46
installation, ONTAP Select Deploy utility illustration of a typical deployment environment 14
downloading the virtual machine image 50 installation and deployment workflow 8
Index | 111