Catalyst 9300 Switching Architecture - BRKARC-3863 - 2018
Catalyst 9300 Switching Architecture - BRKARC-3863 - 2018
Catalyst 9300 Switching Architecture - BRKARC-3863 - 2018
Catalyst 9300
Switching
Architecture
Subtitle goes here
#CLUS
A New Era of Networking
Security
Cloud
Video
IOT
Voice
Mobility
Data
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 34
Is Your Network Ready for the New Era?
IP Display/DMS Printer IP Camera LED Lights AP PC/Laptop IP Phone
Does the platform Does the platform Does the platform Does the platform Does the platform let you
support new PoE make it easy to support enough ensure secure adapt to new connectivity
devices efficiently? provision Programmability? network access? requirements?
and scale?
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 4
New Era of Networking – Catalyst 9300
© 2017 Cisco and/or its affiliates. All rights reserved. Cisco Confidential #CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 5
“The goal of this session is to
give you an in depth view of the
platform so you can understand
its strength as well as its
limitations …”
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 6
Agenda
• Introduction & Overview
• Platform Architecture, ASIC &
Packet Walks
• Stacking Architecture & High
Availability
• Differentiating Features & IOS-XE
• Wrap up
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 7
Cisco Webex Teams
Questions?
Use Cisco Webex Teams (formerly Cisco Spark)
to chat with the speaker after the session
How
1 Find this session in the Cisco Events App
2 Click “Join the Discussion”
3 Install Webex Teams or go directly to the team space
4 Enter messages/questions in the team space
#CLUS © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 8
Hardware Innovations
The New Catalyst 9300
Unmatched POE
USB Console
Mini-USB type B Multigigabit Capable Resiliency – Perpetual/Fast Flexible Modular Uplinks
High power - 60W UPOE
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
Catalyst 9300– Back View
External Storage
USB 3.0 Removable storage Stack Cables Redundant Fans Redundant Power
(120GB SSD)
#CLUS © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 11
Catalyst 9300 – 1G Models Overview
Stackpower
POE+ on all
ports Zero Footprint Power
Redundancy
Data only on
all ports
Larger Buffers & Scale
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 12
Multigigabit Ethernet
The Problem - Gigabit Bottleneck
Wifi >1G
Cat 5e Cables
Limited to 1G!
Existing Gigabit infrastructure Gigabit Ethernet has been Market needs an innovative
is insufficient to handle .11ac around since 1999 and has technology to support >1Gbps
growth beyond 1Gbps now become the bottleneck over existing cables
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 14
The Solution – Cisco MultiGigabit
WiFi > 1G
Cat 5e Cables
2.5-5G!
MultiGigabit MultiGigabit
Switch Capable AP
Cisco MultiGigabit
Is a game-changing innovation Enables 2.5 and 5 Gbps up to Supports all PoE standards
allowing enterprise networks to 100m on legacy cables up to 60W
evolve beyond 1G
802.3bz
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 16
What Speeds Are Supported on MultiGigabit
Ports?
10 M
MultiGigabit Phys Are Different than 1Gigabit Phys
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
MultiGigabit Cabling Investment Protection
Cable 1G 2.5G 5G 10G
Auto-negotiable Speeds – Interoperates with Type
legacy ports at 100 Mbps and higher
Cat5e ✓ ✓ ✓ NA
Brownfield Deployments can leverage existing
Cat5e cables, extending ROI, and supporting
speeds at 2.5G and 5G at a Distance of 100m
Cat6 ✓ ✓ ✓ 55 m
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
Catalyst 9300 Multigigabit Family Shipping
24 x 100/1/2.5/5/10G Ports
* Roadmap
** Switch to Switch only
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 22
Catalyst 9300 – Power Supplies & Stacking
* Roadmap 23
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Looking Inside the
Switch
Catalyst 9300: Under the Covers…
CPU
UADP ASICs
Redundant Power Supplies
USB 3.0
Ethernet And
Console Port
Ampere / Stack
Power Controller
FRU Uplink
Module
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 25
Catalyst 9K Family - x86 CPU
x86 CPU
Parses &
Understands Fixed Fixed
Parser
number of Bytes
MAC IPv4 ACL QoS
Ether
net
IP Payload Look Look Look Look
up up up up
Ether VXLA Ether
VXLAN net
IP UDP
N net
IP Payload
GRE Ethern
IP GRE
Ethern
IP Payload
et et
Fixed Pipeline
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 28
New ASICs for New Technology ?
Marketing
Architecture RTL Design Synthesis Floor Planning Fabrication
Requirements
2 – 4 Years
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 30
Traditional Networking ASICs vs CPUs
Performance Performance
Flexibility Flexibility
Traditional General
Networking Purpose
ASIC CPU
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 31
Cisco Innovation – UADP ASIC
Performance
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 32
UADP Evolution
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 33
UADP 2.0 - Next Generation of ASIC Innovation
Investment Protection
Flexible Pipeline
Universal Deployments
Adaptable Tables
Enhanced Scale/Buffering
Multicore resource share
Shared Up to 2X to 4X
384K Flex Up to 240GE
Counters Lookup Bandwidth Forwarding + TCAM
7.46B Transistors
28nm Technology
Up to 32MB Up to 64K x2
Embedded Packet Buffer Netflow Records
Microcontrollers
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 34
Some of the Key Capabilities of UADP 2.0
Flex Parser
& Recirculation Adaptable Tables
Micro Engines
Programmable Capability
Pipelines
No Compromise on Performance
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 35
UADP 2.0 – Core Architecture
Stack Interface
AQM
Q PBC – Packet Buffers Complex SQS
IGR o
k
o
k
o
k
o
k
Flexible
u u u u
p p p p
T T T T
a a a a
b b b b
l l l l
e e e e
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
u u u u
p p p p
T T T T
Stage #2
a a a a
Tables
b b b b
l l l l
e e e e
Controller
Stage #..
X L
o
o
k
u
L
o
o
k
u
L
o
o
k
u
L
o
o
k
u
X Controller
Stage #..
F F
p p p p
T T T T
C C
Stage #2 (Shared
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
Across
a a a a
Stage #8
b b b b
l l l l
e e e e
Stage #1 L L L L
Cores)
o o o o
o o o o
k k k k
u u u u
p p p p
T T T T
a a a a
b b b b
Flex Parser
l
e
l
e
l
e
l
e
EGR
ReWrite
Engine
Encryption Recirculation
Engine Engine
Ingress
Egress
FIFO
FIFO
MACSEC MACSEC
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 36
UADP 2.0 – Programmable Pipelines
Stack Interface
AQM
Q PBC – Packet Buffers Complex SQS
IGR o
k
o
k
o
k
o
k
Flexible
u u u u
p p p p
T T T T
a a a a
b b b b
l l l l
e e e e
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
u u u u
p p p p
T T T T
Stage #2
a a a a
Tables
b b b b
l l l l
e e e e
Controller
Stage #..
X L
o
o
k
u
L
o
o
k
u
L
o
o
k
u
L
o
o
k
u
X Controller
Stage #..
F F
p p p p
T T T T
C C
Stage #2 (Shared
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
Across
a a a a
Stage #8
b b b b
l l l l
e e e e
Stage #1 L L L L
Cores)
o o o o
o o o o
k k k k
u u u u
p p p p
T T T T
a a a a
b b b b
Flex Parser
l
e
l
e
l
e
l
e
EGR
ReWrite
Engine
Encryption Recirculation
Engine Engine
Ingress
Egress
FIFO
FIFO
MACSEC MACSEC
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 37
Programmable Pipelines – Closer Look…
Final Decision on
Packet’s Future
IGR Flex Parser Flex Parser
256 B
Lookup Lookup Lookup Lookup
Table Table Table Table
Stage Stage
#15 #1
Lookup Lookup Lookup Lookup
Stage Table Table Table Table Stage
#.. Flexible #2
15 Ingress Look up Tables 8 Egress
Stage Stage
Programmable #..
Lookup
Table
Lookup
Table
Lookup
Table
Lookup
Table #..
Programmable
Stages (Shared Stages
Stage Stage
#2
Across Cores) #..
Lookup Lookup Lookup Lookup
Table Table Table Table
Stage Stage
#1 #8
Lookup Lookup Lookup Lookup
Table Table Table Table
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 38
Microcode programs the Pipelines
IGR Flex Parser
Programmed to NG
VXLAN MPLS
understand Protocol
Lookup Lookup
FIB MCast
VXLAN Table Table
ASIC
Flex Parser EGR
TCAM/ SRAM
Programmed to
understand
MPLS
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 39
Platform Architecture
&
Layouts
Cisco Catalyst 9300-24/48 Port
Block diagram
Stackwise 480
X86 1.8-GHz
Packet buffer (8 MB) Packet buffer (8 MB)
quad-core CPU
Core 1 Core 0
USB 3.0
Network interface
Mgmt Console
10Gx4/40Gx1
1G x8 10Gx4/40Gx1
1G x8
PHY PHY PHY PHY PHY PHY 40G PHY 40G PHY
0 1 2 3 4 5 0 1
TX 0-7 TX 0-7
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 41
Cisco Catalyst 9300 Multigigabit-24
Block diagram
X86 1.8-GHz
Stackwise 480 quad-core CPU
FPGA
ASIC 0 Packet buffer (16 MB) ASIC 1 Packet buffer (16 MB)
DRAM – 8 GB
Flash
Forwarding controller Forwarding controller Forwarding controller Forwarding controller 16 GB
Reassembly Rewrite Reassembly Rewrite Reassembly Rewrite Reassembly Rewrite USB 2.0
crypto crypto crypto crypto
Ingress Egress Ingress Egress Ingress Egress Ingress Egress USB 3.0
FIFO FIFO FIFO FIFO FIFO FIFO FIFO FIFO
Core 1 Core 0 Core 1 Core 0 Mgmt Console
10Gx4/40Gx1
10G x4 10Gx4/40Gx1
10G x4
FPGA
ASIC 0 Packet buffer (16 MB) ASIC 1 Packet buffer (16 MB)
DRAM – 8 GB
Flash
Forwarding controller Forwarding controller Forwarding controller Forwarding controller 16 GB
Reassembly Rewrite Reassembly Rewrite Reassembly Rewrite Reassembly Rewrite USB 2.0
crypto crypto crypto crypto
Ingress Egress Ingress Egress Ingress Egress Ingress Egress USB 3.0
FIFO FIFO FIFO FIFO FIFO FIFO FIFO FIFO
Core 1 Core 0 Core 1 Core 0 Mgmt Console
10Gx4/40Gx1
10Gx4 10Gx4/40Gx1
10Gx4 10Gx4
2.5G x4 2.5G x4
MGig 2.5G 2.5G 2.5G 2.5G 2.5G MGig 2.5G 2.5G 2.5G 2.5G MGig
40G PHY 40G PHY
PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY
0 1
1 0 1 2 3 4 2 0 1 2 3 3
TX 0-3 TXI 4-7 TX 8-12 TX 0-3 TXI 4-7 TX 8-12 TX 0-7 TX 0-7
FPGA
ASIC 0 Packet buffer (16 MB) ASIC 1 Packet buffer (16 MB)
DRAM – 8 GB
Flash
Forwarding controller Forwarding controller Forwarding controller Forwarding controller 16 GB
Reassembly Rewrite Reassembly Rewrite Reassembly Rewrite Reassembly Rewrite USB 2.0
crypto crypto crypto crypto
Ingress Egress Ingress Egress Ingress Egress Ingress Egress USB 3.0
FIFO FIFO FIFO FIFO FIFO FIFO FIFO FIFO
Core 1 Core 0 Core 1 Core 0 Mgmt Console
Mgig Mgig Mgig Mgig Mgig Mgig Mgig Mgig Mgig Mgig Mgig Mgig 40G 40G
PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY PHY
0 1 2 3 4 5 0 1 2 3 4 5 0 1
TX 0-3 TX 0-3
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 45
Number of ASICs in different versions of For Your
Switches Reference
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 46
Packet Walks
Unicast – within ASIC
Stack Interface
4
AQM
Q PBC – Packet Buffers Complex SQS
Flexible
u u u u
p p p p
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
Stage #2
a a a a
Tables
b b b b
l l l l
e e e e
to IFC Controller X L
o
L
o
L
o
L
o
X Controller ReWrite (includes descriptor)
Stage #..
o o o o
Stage #..
k k k k
u u u u
F F
p p p p
T T T T
C C
descriptor send to PBC Stage #2 (Shared
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
ReWrite
Across
a a a a
Stage #8
b b b b
l l l l
e e e e
Stage #1
4. Descriptor has local 7. Rewrite the packcet and
L L L L
Cores)
o o o o
o o o o
6
k k k k
u u u u
p p p p
T T T T
Flex Parser
l
e
l
e
l
e
l
e
EGR
info to EQS 2 ReWrite
Engine
Encryption Recirculation
Engine Engine 7
Ingress
Egress
FIFO
FIFO
1 MACSEC
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 48
Unicast – Across ASICs on Input
Stack Interface
5 4 AQM
Q PBC – Packet Buffers Complex SQS
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
u u u u
p p p p
T T T T
Stage #2
a a a a
Tables
b b b b
to IFC
l l l l
e e e e
Controller
Stage #..
X L
o
o
k
L
o
o
k
L
o
o
k
L
o
o
k
X Controller
Stage #..
3. Goes through IFC, result
u u u u
F F
p p p p
T T T T
C C
descriptor send to PBC Stage #2 (Shared
L
o
o
k
u
p
L
o
o
k
u
p
L
o
o
k
u
p
L
o
o
k
u
p
T T T T
Across
a a a a
Stage #1
destination, PBC sends the
L L L L
Cores)
o o o o
o o o o
k k k k
u u u u
p p p p
T T T T
a a a a
info to IQS
b b b b
Flex Parser
l
e
l
e
l
e
l
e
EGR
2
5. IQS schedule PBC to send ReWrite
the packet with descriptor to Engine
Encryption Recirculation
Stack Interface
Engine Engine
Ingress
Egress
FIFO
FIFO
1 MACSEC
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 49
Unicast – Across ASICs on Output
6
Stack Interface
AQM
Q PBC – Packet Buffers Complex SQS
Flexible
u u u u
p p p p
T T T T
a a a a
b b b b
l l l l
e e e e
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
u u u u
Stage #2
a a a a
Tables
b b b b
l l l l
e e e e
Controller
Stage #..
X L
o
o
k
L
o
o
k
L
o
o
k
L
o
o
k
X Controller
Stage #..
7. EQS schedule PBC to send
u u u u
F F
p p p p
T T T T
C C
Stage #2 (Shared
L
o
o
k
L
o
o
k
L
o
o
k
L
o
o
k
a copy to EFC and a copy to
ReWrite (includes descriptor)
u u u u
p p p p
T T T T
Across
a a a a
Stage #8
b b b b
l l l l
e e e e
Stage #1 L L L L
Cores)
o o o o
8
o o o o
k k k k
u u u u
p p p p
Flex Parser
l
e
l
e
l
e
l
e
EGR
ReWrite
9. Rewrite the pakcet and send
Engine
Encryption Recirculation out though the egress FIFO
Engine Engine 9
Ingress
Egress
FIFO
FIFO
MACSEC
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 50
Multicast – Egress Local Only a single copy of packet in buffer
memory during repliaction
Stack Interface
4
AQM
Q PBC – Packet Buffers Complex SQS
Flexible
u u u u
p p p p
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
u u u u
Stage #2
a a a a
Tables
b b b b
l l l l
e e e e
to IFC Controller
Stage #..
X L
o
o
k
u
L
o
o
k
u
L
o
o
k
u
L
o
o
k
u
X Controller
Stage #..
on descriptor, schedule for
F F each egress port
p p p p
T T T T
C C
descriptor send to PBC Stage #2 (Shared
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
Across
a a a a
Stage #1
4. Descriptor has local goes though the EFC, ReWriet
L L L L
Cores)
o o o o
o o o o
6
k k k k
u u u u
p p p p
T T T T
a a a a
Flex Parser
l
e
l
e
l
e
l
e
EGR
info to EQS 2 ReWrite
Engine
Encryption Recirculation
Engine Engine
Ingress
Egress
FIFO
FIFO
1 MACSEC
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 51
Multicast – Egress Remote on Input
Stack Interface
4 AQM
Q PBC – Packet Buffers Complex SQS
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
u u u u
Stage #2
a a a a
Tables
b b b b
l l l l
e e e e
to IFC Controller
Stage #..
X L
o
o
k
u
L
o
o
k
u
L
o
o
k
u
L
o
o
k
u
X Controller
Stage #..
F F
p p p p
T T T T
C C
descriptor send to PBC Stage #2 (Shared
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
Across
a a a a
Stage #8
b b b b
l l l l
e e e e
Stage #1
4. Descriptor has remote
L L L L
Cores)
o o o o
o o o o
k k k k
u u u u
p p p p
T T T T
a a a a
Flex Parser
l
e
l
e
l
e
l
e
EGR
info to IQS 2 ReWrite
Engine
5. IQS schedule PBC to send Encryption Recirculation
the packet with descriptor to Engine Engine
Stack Interface Ingress
Egress
FIFO
FIFO
1 MACSEC
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
6
AQM
Q PBC – Packet Buffers Complex SQS
Flexible
u u u u
p p p p
T T T T
a a a a
b b b b
l l l l
e e e e
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
u u u u
Stage #2
a a a a
Tables
b b b b
l l l l
e e e e
Controller
Stage #..
X L
o
o
k
u
L
o
o
k
u
L
o
o
k
u
L
o
o
k
u
X Controller
Stage #.. 7. AQM within EQS generate
F F
p p p p
T T T T
Across
a a a a
Stage #8
b b b b
l l l l
e e e e
8
k k k k
u u u u
p p p p
T T T T
a a a a
b b b b
Flex Parser
l
e
l
e
l
e
l
e
EGR
8. For each egress port, frame
ReWrite
goes though the EFC, ReWriet
Engine
Encryption Recirculation and Egress FIFO
Engine Engine
Ingress
Egress
FIFO
FIFO
MACSEC
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 53
Forwarding and TCAM
Resources
UADP 2.0 – Look up Tables
Stack Interface
AQM
Q PBC – Packet Buffers Complex SQS
IGR o
k
o
k
o
k
o
k
Flexible
u u u u
p p p p
T T T T
a a a a
b b b b
l l l l
e e e e
Ingress
Stage #.. Forwarding Egress Forwarding
k k k k
u u u u
p p p p
T T T T
Stage #2
a a a a
Tables
b b b b
l l l l
e e e e
Controller
Stage #..
X L
o
o
k
u
L
o
o
k
u
L
o
o
k
u
L
o
o
k
u
X Controller
Stage #..
F F
p p p p
T T T T
C C
Stage #2 (Shared
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
L
o
o
k
u
p
T
Across
a a a a
Stage #8
b b b b
l l l l
e e e e
Stage #1 L L L L
Cores)
o o o o
o o o o
k k k k
u u u u
p p p p
T T T T
a a a a
b b b b
Flex Parser
l
e
l
e
l
e
l
e
EGR
ReWrite
Engine
Encryption Recirculation
Engine Engine
Ingress
Egress
FIFO
FIFO
MACSEC
Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 55
Flex Tables
SRAM TCAM
Lookup Lookup Lookup Lookup Lookup Lookup Lookup Lookup
Table Table Table Table Table Table Table Table
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 56
ASIC Lookup Tables
Forwarding Resources TCAM Resources
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 57
Lookup Tables
Forwarding Resources Feature Resources
• MAC: 32K
Lookup
Table
Lookup
Table
Lookup
Table
Lookup
Table
• Security ACL: 5k
Lookup Lookup Lookup Lookup
Table Table Table Table
IGMP Groups: 8k
Table Table
Lookup
Table
Lookup
Table • Service ACL: 4k
Lookup
Table
Lookup
Table
Lookup
Table
Lookup
Table
• PBR
• LPM Route: 8k
Lookup Lookup Lookup Lookup Lookup
• Netflow ACL
Lookup Lookup Lookup
Table Table Table Table Table • SPAN Table
Multicast Route: 8k
Table Table
• • MACsec
• CoPP
• SGT: 8k
Lookup
Table
Lookup
Table
Lookup
Table
Lookup
Table
Lookup
Table •
Lookup
Tunnel
Table
Lookup
Table
Lookup
Table
• LISP
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 58
Scale and TCAM Partition
• Each IPv6 ACL (without port range) requires two TCAM entries.
CAT9K#show platform hardware fed switch active fwd-asic resource tcam utilization 0
CAM Utilization for ASIC Instance [0]
Table Max Values Used Values
--------------------------------------------------------------------------------
Unicast MAC addresses 32768/512 16/22
IGMP and Multicast groups 8192/512 0/0
L2 Multicast groups 8192/512 0/0
Directly or indirectly connected routes 24576/8192 10/21
NAT/PAT SA address and Port 0 0
QoS Access Control Entries 5120 0
Security Access Control Entries 5120 126
Ingress Netflow ACEs 256 9
Policy Based Routing ACEs 1024 0
Egress Netflow ACEs 768 0
Input Microflow policer ACEs 0 0
Output Microflow policer ACEs 0 0
Flow SPAN ACEs 256 0
Control Plane Entries 512 204
Tunnels 512 17
Lisp Instance Mapping Entries 512 3
Input Security Associations 256 0
Output Security Associations and Policies 256 5
SGT_DGT 8192/512 0/1
CLIENT_LE 4096/256 0/0
INPUT_GROUP_LE 1024 0
OUTPUT_GROUP_LE 1024 0
Macsec SPD 256 2
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 59
Dafault SDM Template Not drawn to scale
Network Interface
Forwarding TCAM
MCAST
FIB (8k)
Others
Netflow
Packet Buffer
Stack Interface
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 60
High Availability
Stackwise-480
The Stack Ring
480 Gbps capacity
UADP ASIC Stack Interface of UADP ASIC
• 6 rings in total
• 3 rings go East
• 3 rings go West
• Each ring is 40Gbps
• 240Gbps uni-direction
• Spatial Reuse= 480Gbps
Stack
Interface
of UADP
ASIC Assuming 4 x 24-port 9300 Switches
6 Rings in the
Stack
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 63
Unicast Packet Path on the Stack Ring
Assuming
4
3
2
1
4 x 24-port
9300 Switches
Creating
Packet segmented into Segments
256 bytes Re-ordering
segments
Packet travels half the
ring for unicast traffic
Segments reordered at
destination stack port
Destination strips the
packet off the stack ring
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 64
Stack Ring Spatial Reuse
4
3
1
2
Assuming
4 x 24-port
9300 Switches
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 65
Multicast Packet Path on Stack Ring
Assuming
4 x 24-port 3
1
2
4
9300 Switches
One copy of the source packet
is placed on the rings
Interested Stack Ports grab the
segments when they see them
Packet segments travel the
whole ring back to source
The source strips these
segments off the ring (Source
Stripping)
Results in efficient replication of
multicast traffic for multiple
Stack Port receivers
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 66
How many Can I stack together?
Enforced by Software
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 67
Stack Discovery
Stack Interfaces brought online
LC Infra
Infra and LC Domains boot in parallel
Stack Discovery Protocol discovers Stack LC Infra
topology – broadcast, followed by neighborcast
In full ring, discovery exits after all members LC Infra
are found.
In half ring, system waits for 2mins LC Infra
Active Election begins after
Discovery exits
Stack port 1 cable is connected and the link is up
Stack port 2 cable is connected and the link is up
Waiting for 120 seconds for other switches to boot
%IOSXE-1-PLATFORM: process stack-mgr: %STACKMGR-1-DISC_START: Switch 3 is starting stack discovery.
##All switches in the stack have been discovered
Switch number is 3
%IOSXE-1-PLATFORM: process stack-mgr: %STACKMGR-1-DISC_DONE: Switch 3 has finished stack discovery.
%IOSXE-1-PLATFORM: process stack-mgr: %STACKMGR-1-SWITCH_ADDED: Switch 3 has been added to the stack.
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 68
Stack Active Election
A
1) The stack (or switch) whose member
has the higher user configurable
priority 1–15
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 69
Stack Initialization
Active starts RP Domain (IOSd, WCM, etc)
locally 2min timer
Programs hardware on all LC Domains
LC RP Infra A
Traffic resumes once hardware is programmed
RP LC Infra
S
Starts 2min Timer to elect Standby
in parallel
Active elects Standby LC Infra
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 70
HA Best Practices & Recommendations
Power up the first Switch that you want to make Catalyst9300#switch 1 priority 15
it as Active
A
Configure Priority of the switch (1-15) – 1 by
default – the higher the better Catalyst9300#switch 2 priority 14
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 71
Stack Member Addition
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 72
Stack Member Addition – Software Upgrade
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 73
Stack Member Deletion
Configuration is moved to
Pre-Provisioned state
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 74
Fast Software Upgrade
Fast Software Upgrade
Regular Upgrade Vs Fast Software Upgrade Process
#Install add file image activate commit #Install add file image activate Fastreload
commit
Traffic is impacted throughout the upgrade cycle Traffic impact is reduced by more than half by
seperating the control and data plane updates
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 76
Normal Vs Fast Software Upgrade Impact
Normal Upgrade Time Fast Software Upgrade Impact
50 %
Reduction in
Traffic
Reload Cmd
Traffic Impact
Reload Cmd
472* sec
Traffic
Kernel
IOSd
Kernel
233* sec
IOSd
Control Plane is updated Data Plane is updated
Control Plane + Data Plane impacted during the complete upgrade without any impacting any traffic impacting the traffic
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 77
Fast Software Upgrade
Supported and Unsupported Designs
Layer 2 Access Layer Designs– FSU Supported
STP
L2 Only L2 Only
x x Vlan1-10
L2 Only
MEC MEC
Access Access Access
Layer Layer Layer
Unsupported Designs
L2 Extensions with
Access Layer Device L3 connections with
Routing Protocols
Access Future
Layer
#CLUS © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 78
Fast Software Upgrade
CLI Commands
Reload Fast
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 79
StackPower
Power HA - StackPower
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 81
Power Redundancy Options
Zero Footprint RPS OR XPS
Day 1
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 83
Power Budget Modes
1100 1100
715 W 715 W
W W
715 715
W W
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 84
Power Priority
Load Shedding
• Standalone Mode • Stack Mode
Low Priority
Low Priority
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 88
QoS Fundamental Actions
Conditional
Policing Marking
Trust Classification
Unconditional
Marking
Conditional
Marking Policing
Scheduler
8q3t PQ1
Classification PQ or Q
1p7q3t
PQ2
2p6q3t WTD rest
Unconditional Q3
Marking of non
WRED WTD
Q4 queues
Q5
WRED
Q6 on any 4
queues
Q7
Q7
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 89
Catalyst 9300– QoS Scalability
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 90
QOS – Higher Packet Buffer •
•
8MB/Core, 16MB/ASIC
Shared across Ingress and Egress
• IQS and SQS intelligently shared the common-shared,
Packet • Buffer organized in cells of 256 Bytes each
Packets to Egress Port Queues Buffer
QOS
5 MB AQM
0.5 MB
1.5 MB SQS
1 MB IQS
Packet
Holding Buffer
Packets from the Stack And
Locally Switched Packets
Packets going to Stack
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 91
Catalyst 9300 Software
IOS XE Evolution
Same Look & Feel, More Powerful Architecture
IOS IOS XE 3.7.x(SE) IOS XE Denali 16.1.1
Common
CommonInfrastructure
Common Infrastructure//HA
HA Infrastructure / HA
Management
ManagementInterface
Management Interface Interface
Crimson
ModuleDrivers
Module Drivers Module Drivers DB
Kernel
Kernel Kernel
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 93
IOS-XE 16
RAFA
One Release Train (Run Any Feature
Operational Efficiency,
Anywhere)
Consistency in Control Plane
Feature Velocity across
Behavior,
Platforms
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 94
Software-Defined Access
Solution Components
DNA Center:
Simple Workflows
DNA Center
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 95
Catalyst 9300 – Trustworthy Systems
Image PnP
Signing SUDI Support
Authentic OS Two Way Trust
Hardware
Authenticity
Genuine
Hardware
Runtime
Defenses
64 Bit ASLR
Secure Integrity
Trustworthy Systems Boot Verifications
Boot Sequence Malware
Check Protection
Cognitive Learning
Benign
Records
Encrypted
Threat Analytics
Catalyst 9K Family
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 97
Catalyst 9300 – Leadership in PoE Features
2-event
Perpetual UPOE Fast UPOE
classification
• Fast power • Uninterrupted PoE • Bypasses Cisco IOS®
negotiation power during control control plane boot
without LLDP plane reboot • Restores power to
• Physical layer PD within 30 sec of
negotiation < 1 sec power resumption
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 98
Graceful Insertion and Removal (GIR)
Hardware
Gracefully remove
replacement or insert a node
without impacting Protocol
traffic exchange
IS-IS,BGP,
Layer 3 OSPF
Software
Layer 2
upgrades
Shutdown
Shutdown
Configuration
changes
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 99
Catalyst 9K Family – Programmability &
Automation
B Open Open
ZTP BootLoader Config
PnP
YANG
Linux
Applications
3rd Party Applications
Guest Shell
API LXC
Network OS
IEEE
Data
Raw, Layer 1 to Layer 3 oriented Locally enriched, application oriented
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 104
Enterprise Audio-Video Market Is
Ready for Disruption
AV Network over Ethernet Multipurpose Rooms Auditoriums
Audio Player
AVB Talker
Ceiling
Microphones
AVB Switch Cisco®
Catalyst® 3850
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 105
Application Visibility & Control
• Filter Monitoring
Over
Ingress/Egress
interfaces and
direction
• Monitor percentage
Bandwidth usage
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 106
MPLS Enables Network Segmentation in Campus
INTERNET
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 107
The Catalyst 9K Family
100/40
SD Programmability
/25/10 Security
Access & Automation
/1G
NAT/ App
MPLS AVB
GRE Hosting
DNA Hot
UPoE MultiGigabit
Bonjour Patching
Open and
UADP 2.0/3.0 Extensible
IOS-XE
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 109
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 110
Catalyst 9K
Subway Learning Map You Are Here
Sunday
Monday Tuesday Wednesday Thursday
(June
(June 11) (June 12) (June 13) (June 14)
10)
8:00–6:00 8:00–
12:00 - 4:00 4:00 – 8:00 8:00–12:00 12:00 - 4:00 4:00 – 8:00 8:00–12:00 12:00 - 4:00 4:00 – 8:00 8:00–12:00 12:00 - 4:00 4:00 – 8:00
12:00
LTRCRS-2017 LTRCRS-2090
Catalyst 9K Innovations Lab Catalyst 9K HA Lab
BRKARC-2035 (1)
Catalyst 9000 Architecture
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Visit World of Solutions…
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 112
Complete your online session evaluation
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 113
Continue
your Demos in
the Cisco
Walk-in
self-paced
Meet the
engineer
Related
sessions
education campus labs 1:1
meetings
#CLUS BRKARC-3863 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 114
Thank you
#CLUS
#CLUS