VOSS82 Segmented MGMT Stack v4
VOSS82 Segmented MGMT Stack v4
VOSS82 Segmented MGMT Stack v4
Ludovico Stevens
Technical Marketing Engineering
November 2022
VOSS Management before 8.2
VOSS IP mgmt prior to 8.2 (still applies to VSP8600)
• Switch mgmt via
• Out-of-band: OOB Ethernet port
CPU • Inband: Any IP address configured
on default GRT (vrf-0)
Control plane • CPU selects OOB vs. Inband exclusively
based on MgmtRouter and GRT routes
Data plane
• If OOB and GRT are IP routed
Mgmt together, can result in non-
OOB port IP-oob Router functional asymmetric routing
vrf-512
• Mgmt traffic initiated by switch over
inband, selection of source IP
ambiguous:
Circuitless IP IP-3 VLAN 40 • GRT IP interface corresponding to
VRF next-hop IP for destination non-ISIS
route
vrf-X
Brouter 1/2 IP-1 IP-2 VLAN 30 • GRT ISIS Source IP for ISIS route
• Need to configure fixed source IP to
use/advertise for some protocols:
Circuitless IP IP-3 VLAN 20 RADIUS, SNMP, Syslog, LLDP,
SONMP, etc..
GRT
vrf-0 • NOTE: No OOB port on XA1400,
Brouter 1/1 IP-1 IP-2 VLAN 10 VSP4850, VSP4450
• VSP4850 support up to VOSS7.1.x
3 only ©EXTREME NETWORKS, INC. ALL RIGHTS RESERVED.
VOSS IP mgmt prior to 8.2 (still applies to VSP8600)
GRT
vrf-0 interface vlan <vid>
ip address <ip>/<mask>
Brouter 1/1 IP-1 IP-2 VLAN 10
exit
4 ©EXTREME NETWORKS, INC. ALL RIGHTS RESERVED.
VOSS IP mgmt prior to 8.2 – DVR Leaf
• A DVR Leaf does not actually
CPU have a full IP stack for the
DVR interfaces
Control plane • The GRT DVR interfaces
Data plane cannot be used for
Mgmt mgmt
OOB port IP-oob Router
vrf-512 DVR Leaf only
router isis
inband-mgmt-ip <ip>
exit
DVR-4 VLAN 40
VRF
vrf-X
• Instead, a Circuitless IP was
DVR-3 VLAN 30 created in GRT, but using a
new command as the
traditional “interface
Circuitless IP DVR-2 VLAN 20
loopback <n>” config context
GRT
vrf-0
is not available on a DVR Leaf
DVR-1 VLAN 10 node
5 ©EXTREME NETWORKS, INC. ALL RIGHTS RESERVED.
Pre-8.2 mgmt asymmetrical routing problems
OOB segment
Firewall
Mgmt segment
External IP router
• A mgmt initiated packet (e.g. SNMP Request, or SSH TCP Syn) destined for a VSP inband GRT IP address
• VSP sends response (SNMP Response, or SSH TCP SynAck) via OOB port, if the OOB has a valid IP route
• Communication will fail, for SNMP, SSH, Telnet; but ICMP ping works, so very confusing!
• Recommendation pre-8.2: keep OOB network separate; do not configure a default route in MgmtRouter VRF
• VOSS 8.2 however only solves this problem for TCP based protocols (i.e. not for SNMP, RADIUS, Syslog, etc..)
6 ©EXTREME NETWORKS, INC. ALL RIGHTS RESERVED.
VOSS Management from 8.2 onwards
VOSS IP mgmt 8.2 with Segmented Mgmt Interface
mgmt oob IP • Switch mgmt via 3 unambiguous IP
Segmented interfaces:
Mgmt mgmt clip IP CPU • mgmt oob
Interface mgmt vlan IP
• mgmt clip
Control plane • mgmt vlan
Data plane • mgmt clip can be assigned to any VRF/GRT
Mgmt • mgmt vlan can be assigned to any VLAN
OOB port Router
vrf-512 • When switch responds to mgmt request,
response will now always use same mgmt
interface request arrived on
• No more problems with asymmetrical
Circuitless IP mgmt routing
IP-3 VLAN 40
VRF • No need to configure source IP for mgmt
protocols
vrf-X
Brouter 1/2 IP-1 IP-2 VLAN 30 • For which mgmt IP LLDP and SONMP
should advertise, any of the 3 mgmt
interfaces can be selected
Circuitless IP IP-3 VLAN 20 • MgmtRouter vrf-512 becomes obsolete
GRT • CLI show commands & SNMP MIB are
vrf-0 maintained and will now show
Segmented Mgmt IPs for it
Brouter 1/1 IP-1 IP-2 VLAN 10
• NOTE: No OOB port on XA1400, VSP4450
8 ©EXTREME NETWORKS, INC. ALL RIGHTS RESERVED.
VOSS IP mgmt 8.2 with Segmented Mgmt Interface
mgmt oob
mgmt oob IP
Segmented ip address <ip>/<mask>
Mgmt mgmt clip IP CPU enable
ip route <net>/<mask> next-hop <nhop> [weight <val>]
Interface mgmt vlan IP [force-topology-ip]
Control plane exit
Data plane
mgmt clip [vrf <name>]
Mgmt ip address <ip>/32
OOB port Router enable
vrf-512 [force-topology-ip]
exit
Both the OOB Mgmt and inband Mgmt VLAN interfaces can auto-assign an
IPv4 link-local address
• 169.254.xx.1/16 on Mgmt OOB and/or 169.254.xx.4/16 on Mgmt VLAN
- where xx is second last Byte from Base MAC address of the node
• No config required
• Link-local IP address goes away if a manual static IP is configured
Example: OOB
• BaseMacAddr: 00:51:00:f9:20:00 Port
Brouter 1/1
VSP8000-1:1(config)#% IP-1
mgmt convert-commit IP-2 VLAN 10
Firewall
TCP based
mgmt protocols
not initiated by
switch
Mgmt segment
External IP router
Circuitless IP
• Note that management via a GRT
IP-3 VLAN 20
Circuitless IP was already best
GRT practice pre-8.2 for L3 BEBs
vrf-0
Brouter 1/1 IP-1 IP-2 VLAN 10 • The mgmt oob interface can also
be used
15 ©EXTREME NETWORKS, INC. ALL RIGHTS RESERVED.
Segmented Mgmt Interface: L2 BEB / L2 Switch
mgmt oob IP • If the VSP is a L2 BEB (or non-Fabric L2
Segmented switch), inband management should
Mgmt mgmt clip IP CPU use mgmt vlan
Interface mgmt vlan IP • The mgmt clip can however still
Control plane be used on a L2BEB, on the GRT,
but it will require IP enabling
Data plane SPBM
Mgmt • On a non-Fabric L2 switch, the
OOB port Router mgmt clip cannot really be used
vrf-512 as there are no IP interfaces to
route to/from that clip
- It would require turning the VSP
switch into a L3 switch
VLAN 40
• The mgmt vlan interface can be
associated with any platform VLAN
already created on the switch
VLAN 30
• The VLAN can of course be made
into a fabric wide L2VSN by
assigning an I-SID to it
VLAN 20
GRT • The mgmt oob interface can also be
vrf-0 used
VLAN 10
Firewall
Mgmt segment
External IP router
• In this example, the VSP mgmt vlan IP cannot be reached because the mgmt packet
entered the switch on a different IP interface
• This is true even if a routing VLAN IP is already also configured on the underlying platform
VLAN and IP routing is possible between both IP interfaces
• This is a mistake. As the VSP is clearly a L3 router and would have to route traffic to the
mgmt vlan subnet, mgmt clip must be used
21 ©EXTREME NETWORKS, INC. ALL RIGHTS RESERVED.
Migration to 8.2
Migration of L3 BEB / L3 Router
Upgrade to 8.2
• NOTE, after the upgrade the GRT CLIP will have gone
interface loopback <id> • If an ISIS Source IP was in use, re-create a new GRT
migrate-to-mgmt CLIP (using a different IP address) and assign that as
exit the new ISIS Source IP
• This operation can also be done before the
• “migrate-to-mgmt” command is upgrade by creating a second CLIP on GRT and
moving the ISIS Source IP to that second CLIP,
available since VOSS 7.1.3, 8.0.1 and 8.1.0 while the first CLIP is set to migrate-to-mgmt and
will disappear after the upgrade
• save config and upgrade
• As of 8.2 an ISIS Source IP is not mandatory but is still
recommended if using IP Shortcuts and will be
23 required again by DVR-One-IP ©EXTREME NETWORKS, INC. ALL RIGHTS RESERVED.
Migration of L2 BEB / L2 Switch
Upgrade to 8.2
Upgrade to 8.2
Upgrade
Switch to be migrated: Pre-migration (7.1.3+) steps to 8.2+ Post-migration steps
OOB managed Access through OOB
Commit
(Optionally add management CLIP and
Switches management VLAN IP)
software
(optionally
SPB Switches that Execute ‘migrate-to-mgmt’ under add ‘mgt Access through selected mgmt CLIP address Commit
are inband IP-SC existing IP CLIP interface context for OOB’ and change isis ip-source-address to different software
‘mgmt
SPB IP-SC IP interface non-mgmt IP address
managed VLAN’ IP)
(optionally
Select one CLIP address and add ‘mgmt
L3 Switches that are
execute ‘migrate-to-mgmt’ on CLIP - OOB’ and
CLIP managed or define NEW ‘mgmt CLIP” interface
‘mgmt
VLAN’ IP)
Access through selected mgmt CLIP Commit
address software
Configure a CLIP mgmt interface and (optionally
L3 Switches that are inband add ‘mgmt
VLAN IP managed execute ‘migrate-to-mgmt’ under it OOB’)
Upgrade to
Switch to be migrated: Pre-migration (7.1.3+) 8.2+ Post-migration
SPB Switches that switch only reachable through OOB (if available) but not
are inband IP-SC No migrate-to-mgmt executed reachable anymore through IP-SC clip and will reboot back
managed to 7.1.3+ release if no commit software executed
L2/L3 Switches switch only reachable through OOB (if available) but not
that are inband No migrate-to-mgmt executed reachable anymore through VLAN IP or clip and will reboot
back to 7.1.3+ release if no commit software executed
VLAN IP managed