NetApp Cabling Diagrams (PDF) v2.3
NetApp Cabling Diagrams (PDF) v2.3
NetApp Cabling Diagrams (PDF) v2.3
Contents
◆ Controller 1 always connects to the top disk shelf Always cable the SAS connections first and then the ACP
IOM A and the bottom disk shelf IOM B in a stack of connections so that the storage system quickly initiates the
disk shelves; ideally to the IOM A square port and to the ACP discovery.
IOM B circle port, as shown in the following illustration.
Dual-port SAS HBA rules:
◆ Dual-port SAS HBAs are only supported on FAS2050 storage
systems.
◆ QSFP to mini-SAS passive copper cables are used to connect
from the disk shelf to the dual-port HBA. QSFP to QSFP cables
are used to connect shelf-to-shelf.
◆ HBA port A always connects to the top disk shelf in a stack Cable Labels Explained
of disk shelves.
◆ HBA port B always connects to the bottom disk shelf in a Note. Yellow labels
stack of disk are OUT ports. The controller or Node
this cable plugs in to.
Quad-port SAS HBA rules: Port number on Either Node1 (N1) or
◆ Quad-port SAS HBAs are only supported on certain storage systems. See the controller. Node 2 (N2).
the System Configuration Guide for supported storage systems on the NOW
site at http://now.netapp.com/.
◆ HBA port A and port C always connect to the top disk shelf in a stack of
disk shelves.
◆ HBA port B and port D always connect to the bottom disk shelf in a stack 1a / N1
◆ Controller 2 always connects to the top disk
shelf IOM B and the bottom disk shelf IOM A in a
of disk shelves. A / S1
Think of the four HBA ports as two units of ports. Port A and port C are the
stack of disk shelves; ideally to the IOM B square top connection unit, and port B and port D are the bottom connection unit.
port and to the IOM A circle port, as shown in the Each unit (A/C and B/D) connects to each of the two ASIC chips on the HBA.
following illustration. If one chip fails, the HBA maintains connectivity to the stack of disk shelves. Combinations of either Indicates shelf stacks.
module A or B on DS4243 S1 is stack 1, S2 stack
shelves, then Circle or 2, etc. A stack is a
Always cable HBA ports in the following sequence: Square indicating the port. collections of shelves
a. Cable top connections first. Squares are always IN on from the same loop –
Cable all A ports and then all C ports in increasing order of HBAs within a controller. shelf 1, and circles OUT up to 6 DS14's and 10
For example, a controller with three HBAs (HBA 1, 2, 3) has its A ports and C ports cabled in the on the last shelf in a loop. DS4243's.
following order: 1a, 2a, 3a, 1c, 2c, 3c.
b. Cable bottom connections second.
- For controllers with one HBA, cable D port and then B port.
- For controllers with more than one HBA, offset the cabling so that you begin on HBA 2. Cable B A unit of HBA ports, A/B or C/D,
ports and D ports in increasing order of never connects to the same stack of
HBAs, ending on HBA 1. disk shelves if there is more than one
For example, a controller with three HBAs has its B ports and D ports cabled in this order: 2b, 3b, 1d, stack of disk shelves in a storage
2d, 3d, 1b. system.
A - S1
CAUTION
LINK
LINK
IOM3
1 2
3 4
Disconnect all
complete isolation.
supply power for
Disconnect all
CAUTION
B - S1
CAUTION
LINK
LINK
IOM3
1 2
3 4
Disconnect all
supply power for
complete isolation.
complete isolation.
supply power for
Disconnect all
CAUTION
CAUTION
LINK
LINK
IOM3
1 2
3 4
Disconnect all
supply power for
complete isolation.
complete isolation.
supply power for
Disconnect all
Stack 3 (S3) is numbered 21 to 30 cables quickly and easily without referring to the
4 3
2 1
CAUTION
CAUTION
LINK
LINK
IOM3
1 2
3 4
Disconnect all
supply power for
complete isolation.
IOM3
complete isolation.
supply power for
Disconnect all
4 3
Stack 4 (S4) is numbered 31 to 40 diagram.
2 1
CAUTION
A - S1
CAUTION
LINK
LINK
IOM3
1 2
3 4
Disconnect all
supply power for
complete isolation.
Shelf IDs for DS14 Shelves are Consider cable lengths before applying labels.
IOM3
Shelf 01
complete isolation.
supply power for
Disconnect all
4 3
CAUTION
B - S1
CAUTION
LINK
LINK
IOM3
1 2
3 4
Disconnect all
supply power for
complete isolation.
supply power for
Disconnect all
4 3
2 1
S2 is 1 to 6
e0a e0b
0a 0b 0c 0d Etc.
e0a e0b
0a 0b 0c 0d
A - S2
CAUTION
LINK
LINK
IOM3
complete isolation.
supply power for
Disconnect all
4
2
CAUTION
3
1
Expansion
B - S2
CAUTION
LINK
LINK
IOM3
1 2
3 4
Disconnect all CAUTION
LINK
LINK
supply power for IOM3
complete isolation. 1 2
IOM3 3 4
Disconnect all
supply power for
complete isolation.
IOM3
complete isolation.
supply power for
Disconnect all
complete isolation. 4 3
supply power for 2 1
Disconnect all
4 3 CAUTION
2 1
CAUTION
LINK
LINK
CAUTION
IOM3
LINK
LINK
CAUTION IOM3 1 2
1 2 3 4
3 4 Disconnect all
supply power for
Disconnect all complete isolation.
supply power for IOM3
complete isolation.
CAUTION IOM3
LINK
LINK
IOM3
1 2
3 4
Disconnect all
supply power for
complete isolation. complete isolation.
supply power for
complete isolation. Disconnect all
IOM3 supply power for
Disconnect all 4 3
4 3 2 1
2 1
CAUTION
CAUTION
CAUTION
LINK
LINK
IOM3 CAUTION
LINK
LINK
1 2
IOM3
3 4 1 2
Disconnect all 3 4
supply power for
complete isolation. Disconnect all
IOM3 supply power for
complete isolation. complete isolation.
supply power for IOM3
Disconnect all
4 3
2 1
CAUTION
complete isolation.
supply power for
Disconnect all complete isolation.
supply power for
4 3 Disconnect all
2 1 4 3
CAUTION
LINK
LINK
IOM3
2 1
CAUTION
CAUTION
1 2
Shelves 01-10
Shelves 11-20
3 4 CAUTION
LINK
LINK
CAUTION
IOM3
Disconnect all
LINK
LINK
supply power for IOM3 1 2
complete isolation. 1 2 3 4
IOM3 3 4 Disconnect all
supply power for
Disconnect all complete isolation.
supply power for IOM3
complete isolation.
IOM3
complete isolation.
supply power for
complete isolation. Disconnect all
supply power for
Disconnect all 4 3
complete isolation. 4 3 2 1
supply power for 2 1
Disconnect all
CAUTION
4 3 CAUTION
2 1
CAUTION
LINK
LINK
IOM3 CAUTION
LINK
LINK
CAUTION 1 2
IOM3
3 4 1 2
Disconnect all 3 4
supply power for
complete isolation. Disconnect all
supply power for
A - S2
IOM3 complete isolation.
CAUTION IOM3
LINK
LINK
IOM3
1 2
3 4
Disconnect all
supply power for
complete isolation. complete isolation.
supply power for
Disconnect all complete isolation.
IOM3 4 3
supply power for
Disconnect all
2 1 4 3
2 1
CAUTION
CAUTION
CAUTION
LINK
LINK
CAUTION
IOM3
LINK
LINK
IOM3 1 2
1 2 3 4
3 4 Disconnect all
supply power for
Disconnect all complete isolation.
supply power for IOM3
complete isolation. complete isolation.
supply power for IOM3
Disconnect all
4 3
2 1
CAUTION
complete isolation.
B - S2
supply power for
complete isolation. Disconnect all
supply power for
Disconnect all 4 3
4 3 2 1
CAUTION
LINK
LINK
IOM3
2 1
CAUTION
CAUTION
1 2
3 4 CAUTION
LINK
LINK
IOM3 CAUTION
Disconnect all
LINK
LINK
supply power for 1 2
IOM3
complete isolation. 3 4 1 2
IOM3 Disconnect all 3 4
supply power for
complete isolation. Disconnect all
IOM3 supply power for
complete isolation.
IOM3
complete isolation.
supply power for
Disconnect all complete isolation.
supply power for
4 3 Disconnect all
complete isolation. 2 1 4 3
supply power for 2 1
Disconnect all
CAUTION
4 3 CAUTION
2 1
CAUTION
LINK
LINK
CAUTION
IOM3
LINK
LINK
CAUTION IOM3 1 2
1 2 3 4
3 4 Disconnect all
supply power for
Disconnect all complete isolation.
supply power for IOM3
complete isolation.
IOM3
complete isolation.
supply power for
complete isolation. Disconnect all
supply power for
Disconnect all 4 3
4 3 2 1
2 1
CAUTION
CAUTION
CAUTION
LINK
LINK
IOM3 CAUTION
LINK
LINK
1 2
IOM3
3 4 1 2
Disconnect all 3 4
supply power for
complete isolation. Disconnect all
IOM3 supply power for
complete isolation.
IOM3
complete isolation.
supply power for
Disconnect all complete isolation.
supply power for
4 3 Disconnect all
2 1 4 3
2 1
stack.
CAUTION
CAUTION
CAUTION
LINK
LINK
IOM3
1 2
3 4
Disconnect all
supply power for
complete isolation.
IOM3
complete isolation.
supply power for
Disconnect all
4 3
2 1
CAUTION
CAUTION
LINK
LINK
e0a e0b IOM3
0a 0b 0c 0d 1 2
3 4
Disconnect all
supply power for
complete isolation.
IOM3
CAUTION
3
1
LINK
IOM3
e0a e0b
0a 0b 0c 0d
complete isolation.
supply power for
Disconnect all
4 3
2 1
CAUTION
DSxxxx (IOMx) – FAS2040 - Single Stack
Two of each
label required
0d / N1
A / S1
0d / N1
A / S1
0d FAS2040 (N1) e0P
0d / N2
B / S1
0d / N2
B / S1
0d FAS2040 (N2) e0P
0d / N1 ACP SAS
A / S1
IOM A
Shelf ID 01
IOM B
0d / N2
B / S1
IOM A
Shelf ID 02-09
IOM B
IOM A
Shelf ID 10
IOM B
Stack 1
(S1)
1a / N2
1a / N1 1a / N2 B / S1
A / S1 B / S1
1a / N1
A / S1
A HBA 1 A HBA 1
1d / N2
B B A / S1
Controller 1 (N1) Controller 2 (N2)
C C 1d / N1
e0a / e0a / B / S1
D ACP D ACP
1d / N2
1d / N1 A / S1
B / S1
1a / N1
A / S1
Stack 1
(S1) ACP SAS
IOM A
Shelf ID 01
IOM B
1a / N2
B / S1
IOM A
Shelf ID 02-09
IOM B
1d / N2
A / S1
IOM A
Shelf ID 10
IOM B
1d / N1
B / S1
1a / N1
1a / N1 1a / N2 A / S1
A / S1 B / S1
1c / N1
A / S2
1b / N1
A HBA 1
1b / N2
A HBA 1
B / S2 A / S2 1a / N2
B B B / S1
Controller 1 (N1) Controller 2 (N2)
1c / N1
C 1c / N2
C 1c / N2
A / S2 e0a / B / S2 e0a / B / S2
D ACP D ACP
1d / N1
1d / N2
1d / N1 B / S1
A / S1
B / S1
1b / N1
B / S2
1a / N1 1c / N1 1d / N2
A / S1 A / S2 A / S1
Stack 1 Stack 2
(S1) ACP SAS (S2) ACP SAS
1b / N2
A / S2
IOM A IOM A
Shelf ID 01 Shelf ID 11
IOM B IOM B
1a / N2 1c / N2
B / S1 B / S2
IOM A IOM A
Shelf ID 02-09 Shelf ID 12-19
IOM B IOM B
1d / N2 1b / N2
A / S1 A / S2
IOM A IOM A
Shelf ID 10 Shelf ID 20
IOM B IOM B
1d / N1 ACP
B / S1
1b / N1
B / S2
1a / N1
1a / N1 2a / N1 1a / N2 2a / N2 A / S1
A / S1 A / S2 B / S1 B / S2
2a / N1
A / S2
A HBA 1 HBA 2 A 2b / N1
A HBA 1 HBA 2 A 2b / N2
B / S1 A / S1 1a / N2
B B B B B / S1
Controller 1 (N1) Controller 2 (N2)
C C C C 2a / N2
e0a / e0a / B / S2
D ACP D D ACP D
2b / N1
1d / N2 B / S1
1d / N1
A / S2
B / S2
1d / N1
B / S2
1a / N1 2a / N1 2b / N2
A / S1 A / S2 A / S1
Stack 1 Stack 2
(S1) ACP SAS (S2) ACP SAS
1d / N2
A / S2
IOM A IOM A
Shelf ID 01 Shelf ID 11
IOM B IOM B
1a / N2 2a / N2
B / S1 B / S2
IOM A IOM A
Shelf ID 02-09 Shelf ID 12-19
IOM B IOM B
2b / N2 1d / N2
A / S1 A / S2
IOM A IOM A
Shelf ID 10 Shelf ID 20
IOM B IOM B
2b / N1 ACP
B / S1
1d / N1
B / S2
Two of each
A / S1 A / S3 Stack 3 (S3)
label required
Shelf ID 01
Shelf ID 21
IOM A IOM A
1a / N1
A / S1
IOM B IOM B
2a / N1 1a / N2 1c / N2
A / S2 B / S1 B / S3
1c / N1
Shelf ID 10
Shelf ID 30
2b / N2 2d / N2
A / S3 IOM A A / S1 IOM A A / S3
2c / N1
A / S4 IOM B IOM B
2b / N1 2d / N1
1a / N2 B / S1 B / S3
B / S1
2a / N2
B / S2
1c / N2 1a / N1 2a / N1 1a / N2 2a / N2
B / S3 A / S1 A HBA 1 HBA 2 A A / S2 B / S1 A HBA 1 HBA 2 A B / S2
1b / N1 2b / N1 1b / N2 2b / N2
2c / N2 B / S4 B B B / S1 A / S4 B B A / S1
B / S4 1c / N1
Controller 1 (N1) 2c / N1 1c / N2
Controller 2 (N2) 2c / N2
A / S3 C C A / S4 B / S3 C C B / S4
2b / N1 1d / N1 e0a / 2d / N1 1d / N2 e0a / 2d / N2
B / S1 B / S2 D ACP D B / S3 A / S2 D ACP D A / S3
1d / N1
B / S2
2d / N1
B / S3 2a / N1 2c / N1
A / S2 A / S4
Shelf ID 11
Shelf ID 31
1b / N1 IOM A IOM A
B / S4
2b / N2 IOM B IOM B
A / S1 2a / N2 2c / N2
B / S2 B / S4
1d / N2
A / S2
Shelf ID 20
Shelf ID 40
1d / N2 1b / N2
IOM A A / S2 IOM A A / S4
2d / N2
A / S3
IOM B IOM B
1b / N2
A / S4
1d / N1 Stack 2 (S2) Stack 4 (S4) 1b / N1
B / S2 B / S4
Shelf ID 01
Shelf ID 21
IOM A IOM A
IOM B IOM B
Shelf ID 10
Shelf ID 30
IOM A IOM A
IOM B IOM B
Shelf ID 31
IOM A IOM A
IOM B IOM B
Shelf ID 20
Shelf ID 40
IOM A IOM A
IOM B IOM B
0a / N1 0a / N2 0a / N1
Ain / S1 Aout / S1 Ain / S1
0d / N1
0a 0a Bin / S2
0b / N1 0b / N2
Aout / S2 Ain / S2
0b Controller 1 (N1) 0b Controller 2 (N2) 0b / N2
Ain / S2
0c FAS 3xxx 0c FAS 3xxx
0c / N1 0c / N2
Bout / S1 Bin / S1 0c / N2
0d 0d Bin / S1
0d / N2
0d / N1 Bout / S2 0b / N1
Bin / S2 Aout / S2
0c / N1
Bout / S1
0a / N2
0a / N1 0b / N2 Aout / S1
Ain / S1 Ain / S2
Stack 1 (S1) Stack 2 (S2) 0d / N2
Bout / S2
Shelf ID 1 Shelf ID 1
0c / N2 0d / N1
Bin / S1 Bin / S2
0a / N2 0b / N1
Aout / S1 Aout / S2
Shelf ID 6 Shelf ID 6
0c / N1 0d / N2
Bout / S1 Bout / S2
0a / N1 1a / N1 0a / N2 1a / N2 0a / N1
Ain / S1 Bout / S1 Aout / S1 Bin / S1 Ain / S1
1b / N1
0a 1a 0a 1a Bin / S2
0b / N1 1b / N1 0b / N2 1b / N2
Aout / S2 Bin / S2 Ain / S2 Bout / S2
0b Controller 1 (N1) 1b 0b Controller 2 (N2) 1b
0b / N2
Ain / S2
0c FAS 3xxx 1c 0c FAS 3xxx 1c
1a / N2
0d 1d 0d 1d Bin / S1
0b / N1
Aout / S2
1a / N1
Bout / S1
0a / N2
0a / N1 0b / N2 Aout / S1
Ain / S1 Ain / S2
Stack 1 (S1) Stack 2 (S2) 1b / N2
Bout / S2
Shelf ID 1 Shelf ID 1
1a / N2 1b / N1
Bin / S1 Bin / S2
0a / N2 0b / N1
Aout / S1 Aout / S2
Shelf ID 6 Shelf ID 6
1a / N1 1b / N2
Bout / S1 Bout / S2
1a / N1 2a / N1 1a / N2 2a / N2 1a / N1
Ain / S1 Bout / S1 Aout / S1 Bin / S1 Ain / S1
2b / N1
1a 2a 1a 2a Bin / S2
1b / N1 2b / N1 1b / N2 2b / N2
Aout / S2 Bin / S2 Ain / S2 Bout / S2
1b Controller 1 (N1) 2b 1b Controller 2 (N2) 2b
1b / N2
Ain / S2
1c FAS 3xxx 2c 1c FAS 3xxx 2c
2a / N2
1d 2d 1d 2d Bin / S1
1b / N1
Aout / S2
2a / N1
Bout / S1
1a / N2
1a / N1 1b / N2 Aout / S1
Ain / S1 Ain / S2
Stack 1 (S1) Stack 2 (S2) 2b / N2
Bout / S2
Shelf ID 1 Shelf ID 1
2a / N2 2b / N1
Bin / S1 Bin / S2
1a / N2 1b / N1
Aout / S1 Aout / S2
Shelf ID 6 Shelf ID 6
2a / N1 2b / N2
Bout / S1 Bout / S2
1a / N2 1c / N1
Two of each
label required
Stack 1 (S1) Aout / S1 Aout / S3 Stack 3 (S3)
1a / N1
Ain / S1
Shelf ID 6 Shelf ID 6
2a / N2
Bin / S1
2a / N1 2c / N2
1a / N1 1c / N2
Bout / S1 Bout / S3
1a / N2 Ain / S1 Ain / S3
Aout / S1
2a / N1
Bout / S1 Shelf ID 1 Shelf ID 1
1b / N2
2a / N2
Ain / S2 2c / N1
Bin / S1
Bin / S3
2b / N1
Bin / S2
1b / N1 1a / N1 2a / N1 1a / N2 2a / N2
Aout / S2 Ain / S1
1a 2a Bout / S1 Aout / S1
1a 2a Bin / S1
1b / N1 2b / N1 1b / N2 2b / N2
2b / N2 Aout / S2
1b Controller 1 (N1) 2b Bin / S2 Ain / S2
1b Controller 2 (N2) 2b Bout / S2
Bout / S2 1c / N1 2c / N1 1c / N2 2c / N2
Aout / S3
1c FAS 3xxx 2c Bin / S3 Ain / S3
1c FAS 3xxx 2c Bout / S3
1c / N2 1d / N1 2d / N1 1d / N2 2d / N2
Ain / S3 Ain / S4
1d 2d Bout / S4 Aout / S4
1d 2d Bin / S4
2c / N1
Bin / S3
1d / N1
1b / N2
1c / N1 Ain / S4
Ain / S2
Aout / S3
2c / N2
Bout / S3 Shelf ID 1 Shelf ID 1
1d / N1
Ain / S4 2b / N1 2d / N2
1b / N1 1d / N2
Bin / S2 Bin / S4
Aout / S2 Aout / S4
2d / N2
Bin / S4
1d / N2
Shelf ID 6 Shelf ID 6
Aout / S4