MPLS
MPLS
MPLS
Integrating
Campus/DC Fabrics
with MPLS
Subtitle goes here
#CLUS
Agenda • Introduction
• Design Requirements
• Technology Involved
• DC Network Fabrics – FabricPath,
DFA,
ACI, and VXLAN with EVPN
• SD-Access Fabric
• MPLS Features and Capabilities
• The Service Layer
• The WAN Connectivity
• Design Options
• Case Studies
• Lessons Learned
• Conclusion
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 3
Cisco Webex Teams
Questions?
Use Cisco Webex Teams (formerly Cisco Spark)
to chat with the speaker after the session
How
1 Find this session in the Cisco Live Mobile App
2 Click “Join the Discussion”
3 Install Webex Teams or go directly to the team space
4 Enter messages/questions in the team space
#CLUS © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 4
Session Goals
At the end of the session, the participants should:
Understand the design requirements
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 5
Customer Requirements – NG Data Center
• Multi-tenancy
• Highly Scalable DC Architecture
• L2 Connectivity Between Racks
• Optimized for East/West as well
as North/South
• Minimize Oversubscription
• Scalable L4-7 Service Layer
• Highly available WAN
• Scalable WAN Architecture
• Some DCs connect via Internet
• Simplicity!
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 6
Customer Requirements – NG Campus
• Host Mobility (w/o stretching VLANs)
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 7
Strategy Flexible topology
Minimize
oversubscription
Scale out and scale up
No spanning tree
Network Incremental scale
Topology
(DC & WAN)
Multi-tenancy
Security and
Separation
Traffic Eng
Virtualized
Scalable Network
L4-7
Virtualization
Services
SOLUTIONS
VRF
Mergers Shared
L3VPN services
Acquisitions
Multicast VPN
6VPE
Compliance
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
Virtual Routing and Forwarding (VRF)
VLAN 40 SVI 40
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 11
Segmentation with VRF lite
VRF-A VRF-A
L3 Sub-interface VLAN 10
SVI 10
VLAN 10 SVI 10
Routing Protocol
VLAN 20 SVI 20 SVI 20 VLAN 20
VRF-B VRF-B
L3 Sub-interface
VLAN 30 SVI 30 SVI 30 VLAN 30
Routing Protocol
VLAN 40 SVI 40 SVI 40 VLAN 40
VPNv4 IPv4
VLAN10 VLAN20
VLAN10 VLAN20 VPNv6 IPv6 VRF-A VRF-B
VRF-A VRF-B RD 1:1 RD 2:2
RD 1:1 RD 2:2
RT 2:2
MDT Multicast RT 1:1 RT 2:2
RT 1:1
P MPLS tunnel P
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
Data Center Building Blocks
Services Data Center 1 Services
Data Center 2
LB LB LB LB
Spine Spine
MPLS Cloud
WAN
End user
connecting
Campus via internet
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 14
BGP Inter-AS Solution
MPLS Inter-AS Use Cases
Cust1 Cust1
AS1 WAN AS3
DC1 Core (AS2) DC2
Cust2 Cust2
IGP Isolation
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 16
Extending MPLS with Inter-AS
Back-to-Back VRFs
ASBR1 (Option A)
ASBR2
CE1 CE2
VPN-R1 VPN-R2
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
Deployment & Implementation Scenarios
P-to-P tunneling (MPLS MPLS)
IP Network
MPLS MPLS
DC1 MPLSoGRE
DC2
PE1 P1 P2 PE2
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
DC Fabric to MPLS Handoff Designs
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Data Center Building Blocks
Services Data Center 1 Services
Data Center 2
LB LB LB LB
Spine Spine
MPLS Cloud
WAN
End user
connecting
Campus via internet
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 20
Modernized Data Center
Existing 2/3-Tier Programmable SDN Application Centric
Designs Overlay Model Infrastructure
vPC
FabricPath
Programmable Fabric (FabricPath)
Programmable Fabric (VXLAN)
ACI
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 22
MPLS Handoff (L3 DCI) for vPC Fabric NX-OS
7.2
PE PE PE PE L2/L3 Boundary
L2/L3 Boundary
N7x00 N7x00
vPC vPC
N5000/N6000 N5000/N6000
N2000 N2000
VPC VPC
AS100 AS200
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 23
DC Fabric w/FabricPath
Externally the Fabric looks like a single switch
Internally, ISIS adds Fabric-wide intelligence and ties the elements
together.
Provides in a plug-and-play fashion:
Optimal, low latency connectivity any to any
High bandwidth, high resiliency
Open management and troubleshooting
ISIS for multipathing and reachability
FabricPath FabricPath
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
MPLS Handoff (L3 DCI) for FabricPath NX-OS
7.2
AS300
Inter-as Option B
MP-iBGP
MP-eBGP
RED VLAN <-> Red VRF VPNv4/VPNv6 VPNv4/ VPNv6
Orange VLAN <-> Orange VRF
WAN
MP-iBGP MP-iBGP
F3 F3 F3 F3
VPNv4/ VPNv6 VPNv4/ VPNv6
PE PE PE PE L2/L3
L2/L3
Boundary
N7x00 N7x00 Boundary
F3 F3 F3 F3
FabricPath FabricPath
N5000/N6000 N5000/N6000
AS 100 AS 200
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 25
Programmable Fabric
FabricPath & VXLAN
Programmable Fabric (FabricPath & VXLAN)
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 27
Programmable Fabric (FabricPath)
Host and Subnet Route Distribution
RR RR MP-iBGP Adjacencies
N1KV/OVS
Route-Reflectors
MAN/WAN deployed for scaling
purposes
• DC Fabric with a FabricPath based data plane and MP-iBGP control plane.
• Use MP-iBGP on the leaf nodes to distribute internal host/subnet routes and external reachability
information.
• Introduced Segment ID to increase name space to 16M identifier in the fabric.
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 28
MPLS (L3) DCI for Programmable Fabric
(FabricPath)
IP Forwarding between Fabrics across Layer-3 based DCI Two Box Solution
Fabric #1 Fabric #2
BGP AS 65500 BGP AS 65505
RR RR RR RR
MP-iBGP MP-iBGP
Control Plane Control Plane
Border Leaf Border Leaf
Classic Ethernet
Sub-Interface
eBGP eBGP
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 29
MPLS (L3) DCI for Programmable Fabric
(FabricPath) NX-OS
7.2
IP Forwarding between Fabrics across Layer-3 based DCI
Single Box Solution
Fabric #1 Fabric #2
BGP AS 65500 BGP AS 65505
RR RR RR RR
MP-iBGP MP-iBGP
Control plane Control plane
Layer-3 DCI
(MPLS/L3VPN)
BGP AS 65555
N7x00 with F3
Single VDC
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 30
Programmable Fabric (VXLAN)
RR RR
N1KV/OVS
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 31
Control Protocol for VXLAN 2 BGP propagates routes for
Protocol Learning BGP Route
the host to all other VTEPs
VTEPs advertise host routes (IP+MAC) to
local hosts
Reflector
1
VTEP VTEP
IP A
IP B
West Overlay Forwarding Table East
Host1 <MAC,IP> , VTEP IP A
3
VTEPs obtain host
Overlay Forwarding Table routes for remote hosts
Host1 <MAC,IP> , VTEP IP A
and install in RIB/FIB
Host2 <MAC,IP> , VTEP IP B
3 VTEP
IP C
South
BGP MPLS Based Ethernet VPN (draft-ietf-l2vpn-evpn-02)
IETF Network Virtualization Overlay Solution using EVPN (draft-sd-l2vpn-evpn-overlay-02)
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 32
Seamless Host Mobility across DC
Two DCs are directly connected at the
Data Center East : Agg. eVPN Routes exchanged via eBGP Data Center West:
BGP AS #100 BGP AS #200
BGP
BGP N7K RR
RR
eBGP Aggregation
… VXLAN Packet …
VTEP
VTEP
Access
H1 H2
IP-H1 IP-H2
VNI 100 VNI 100
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 34
MPLS handoff for Programmable Fabric (VXLAN)
N7K
NX-OS
7.3
Border Leafs
Leafs
VTEP MPLS Cloud
VLAN/VRF to VNI
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 35
LISP handoff for Stand Alone Fabric (VXLAN)
N7K
NX-OS
7.2
Border Spines RR RR
VNI to
Site Gateway (SG): VLAN/VRF/Instance-ID
LISP encap/decap
LISP signaling
BGP EVPN Control Plane
VXLAN Data Plane
Leafs
VTEP
VLAN/VRF to VNI
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 36
Application Centric
Infrastructure (ACI)
Cisco ACI Logical Network Provisioning
Stateless Hardware
Web App DB
Cisco® ACI)Fabric
Cisco Application
Policy Infrastructure
Scale-Out Penalty-Free Overlay Controller (APIC)
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 38
Cisco ACI Network Profile
Policy-Based Fabric Management
application requirements
Web Tier App Tier DB Tier
− Application tiers
− Connectivity policies The Network Profile Fully Describes the Application
− Layer 4 – 7 services Connectivity Requirements
− XML/JSON schema ## Network Profile: Defines Application Level Metadata (Pseudo Code Example)
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 39
ACI Nomenclature
Spine Nodes
Leaf Nodes
AVS
Service Consumers
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 40
Application Policy Model and Instantiation
Application
Client
Application policy model: Defines
the application requirements Storage Storage
(application network profile)
Web Tier App Tier DB Tier
All forwarding in the fabric is managed through the application network profile
• IP addresses are fully portable anywhere within the fabric
• Security and forwarding are fully decoupled from any physical or virtual network attributes
• Devices autonomously update the state of the network based on configured policy requirements
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 41
ACI Adoption – Network (Layer 2 and 3 Fabric)
• Common Commercial, Enterprise, SP Use Case
• Network Operations
• Network Automation Firewall Context 1 (Routed Mode) ASR 9000
• Any Subnet, Any Where
• Network Capacity and Bandwidth
With or Without VMM Integration
(NSSA)
VLAN D
•
VLAN D
OSPF
OSPF / iBGP
• L2 used for L4-L7 Integration
• Limited use of contracts L3 Ext Out
EPG EPG
FW_Out FW_Out
Context: IT_VRF
BD: IT_VRF BD
FW_out
GW GW GW
ACI Fabric
EPG Web EPG App EPG DB
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
DC Fabric and WAN/DCI Integration Overview
No worry, I will
take care
Spine
WAN/DCI
Integration
Next-gen ACI, Interworking SDN MPLS
VXLAN
Scalable, Resilient, Optimized, End-to-End
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 43
ACI with Nexus 7k and ASR 9k - DCI
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 44
ACI to DCI integration and handoff normalization
Handoff Normalization WAN
Mgr
bLeaf Leaf
N9300 N9300
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 45
SD-Access Fabric
DNA Solution DNA Center
Cisco Enterprise Portfolio Simple Workflows
DNA Center
Identity Services APIC- Network Data
Engine EM Platform
#CLUS © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
#CLUS © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
What is SD-Access?
Campus Fabric + DNA Center (Automation & Assurance)
SD-Access –
APIC-EM
APIC-EM
2.0
1.X GUI approach provides automation &
assurance of all Fabric configuration,
ISE NDP
management and group-based
policy.
DNA Center
DNA Center
Open APIs | Developers Environment
Automation
Insights &
Experiences
APIC-EM + ISE +Analytics
NDP
Principles Abstraction & Policy Control Network Data,
from Core to Edge Contextual Insights
Automation
Open & Programmable | Standards-Based & Assurance
#CLUS BRKMPL-2114 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 50
What is SD-Access?
Fabric Roles & Terminology
DNA DNA Controller – Enterprise SDN Controller
APIC-EM
Controller (e.g. DNA Center) provides GUI management
Identity and abstraction via Apps that share context
Services
ISE NDP Identity Services – External ID System(s)
Analytics (e.g. ISE) are leveraged for dynamic Endpoint
to Group mapping and Policy definition
Engine
Analytics Engine – External Data Collector(s)
(e.g. NDP) are leveraged to analyze Endpoint
Fabric Border Fabric Wireless to App flows and monitor fabric status
Nodes Controller
B B Control-Plane Nodes – Map System that
manages Endpoint to Device relationships
Control-Plane
Intermediate Fabric Border Nodes – A Fabric device (e.g.
C Nodes
Nodes (Underlay) Core) that connects External L3 network(s)
to the SDA Fabric
Campus Fabric Edge Nodes – A Fabric device (e.g.
Fabric Edge Access or Distribution) that connects Wired
Nodes
Fabric Endpoints to the SDA Fabric
Fabric Wireless Controller – A Fabric device
(WLC) that connects Wireless Endpoints to
the SDA Fabric
#CLUS BRKMPL-2114 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 51
SD- Access Branch Deployment Options
Campus Connectivity with MPLS
* Border is a CE device
CONTROL-PLANE
B B
MPLS Domain
Campus
DATA+POLICY PLANE
#CLUS BRKMPL-2114 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 52
SD- Access Branch Deployment Options
Campus Connectivity with MPLS
* Border is a PE device
CONTROL-PLANE
B B
MPLS Domain
Campus
DATA+POLICY PLANE
#CLUS BRKMPL-2114 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 53
SD- Access Campus Deployment Options
Branch Connectivity with MPLS
Internet MPLS
ISR4451 ISR4451
vWAAS vWAAS
ASAv ASAv
5520 5520
WLC WLC
AP #CLUS BRKMPL-2114 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 54
SD- Access Campus Deployment Options
Branch Connectivity with MPLS
Internet MPLS
5520 5520
WLC WLC
ISR4451 ISR4451
C Plane C Plane 3850
E-Border I-Border Edge
vWAAS vWAAS Svc blk
ASAv ASAv 3850
Edge
Fabric Svc blk
AP
#CLUS BRKMPL-2114 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 55
Services Layer
Data Center Building Blocks
Services Data Center 1 Services
Data Center 2
LB LB LB LB
Spine Spine
MPLS Cloud
WAN
End user
connecting via
Campus internet
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 57
Firewall Options
• Three options to consider
• Virtual Firewall (ASA 1000v) and VSG
• Virtualized services
• High scale
• Leverages vPath technology
• IOS Zone Based Firewall
• Router based
• Native routing
• ASA
• Purpose built hardware
• Advanced firewall and security features
• Fusion router: FW
Contexts
• Inter-VPN connectivity
• Shared resource connectivity VPN A Fusion
VDC
• Internet, servers, etc. VPN B I-Net
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 59
Now With the DC Fabric
Core
SLB local to server VLANs
Firewall
L2 VLAN
Fabric
L2 VLAN
Servers DMZ/PCI
#CLUS BRKMPL-2114 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 60
Zone Based Firewall w/ASR1000
• Hardware Based Performance
FW
• IOS Based Zone-Pairs Internal Link
• Zone-pair VPN A
VRF-Aware ZBFW
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 61
Cisco ASR1000: VASI Feature
• A point to point virtual link
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 62
Programmability &
Automation on Nexus
Switches
Overlay & Underlay Management
• Overlay manager Underlay API Overlay
• Provision VXLAN on Virtual and Physical end-points mgmt mgmt
• e.g. VTS
• NMS/EMS for Underlay management
• PoAP, Topology Discovery and Inventory, Telemetry, Physical 3rd Party Virtual
Image Management, etc. HW
• e.g. DCNM EVPN
• Loosely coupled VM
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 64
Virtual Topology System (VTS)
Network-Centric Overlay Provisioning and Management System
VTS
VTF
Network Centric Software and Multi-protocol Physical and Virtual Manage Overlay
Services hardware VTEPs support device support resources
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 65
Manage Multiple Fabrics from one DCNM
FP/DFA VXLAN-EVPN
#CLUS © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
DCNM 10 Fabric Management Views
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 68
DCNM & Cisco Prime Configuration Templates
Create configuration
template using simple
template language
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 69
NXAPI – Providing programmatic access to Nexus switches over HTTP/S
(returns output in easy to read JSON format)
#Your python code
#!/usr/env python JSON-RPC/JSON/XML
import json Request/response format
import requests
url =
"http://172.25.91.139/ins"
HTTP/S
payload = [{'jsonrpc': '2.0',
'method': 'cli', 'params': jsonrpc request/response
['show version',1], 'id': '1'}]
HTTP/S
………
WAN
MPLS
Fabric
Firewalls
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 72
Design Case Studies
Case Study
MPLS Layer 3 VPN – Multi-POD
• Requirement: Global
Interconnect Campus
MPLS
One MPLS network infrastructure for all services
MPLS PE boundary in POD EoR/ToR access/
aggregation layer L3
Below MPLS boundary: L2
L2 or L3 (VRF-lite with PE-CE)
Layer-2
Direct PE-PE or PE-P-PE networks
Scaling POD architecture without operational
POD POD POD
overhead using Fabric Extenders
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 74
Case Study
MPLS Handoff for vPC Fabric
MPLS WAN
DC Design of a Large
Enterprise in India N7700 core switch
Aggregating 3 floors
MPLS
Intra-DC MPLS
Cloud
N7700 HSRP
Floor Aggregation MPLS PE
Switch
L2
Double sided
Spine Server Hall vPC Spine Server Hall
N9500 N9500
Double sided Double sided
vPC vPC
Leaf Leaf
N9300 N9300
4 Server Hall
20 Hosts 20 Hosts 20 Hosts 20 Hosts
per floor
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 75
Case Study
MPLS Handoff for FabricPath Fabric Building-2
Building-1
VSS Active VSS Standby VSS Active VSS Standby
• Design of a large European university
MPLS
• Datacenter built with FabricPath P P
N7K
F3
Campus
Core
• Enabled MPLS VPN on DC edge switch and
5K VPC
VPC
DC
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 76
Case Study
MPLS Handoff for Standalone Fabric
(FabricPath)
AS65000 AS65001
• DC Design of a leading
natural gas and oil N6004
producer from North Spine
America MP-iBGP Control MP-iBGP Control
Plane Plane
• L3 DCI for Standalone N5672 FabricPath DataPlane Border Leaf FabricPath DataPlane
Leaf N7700(F3)
Fabric(FabricPath) with
N7700 (F3) Linecard
MPLS WAN
AS1001
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 77
MPLS to VXLAN Customer Deployment N7K
NX-OS
7.3
MPLS VPN
RR
iBGP VPNv4
IP Cloud
Border Spines
VNI to MPLS
BGP EVPN Control Plane VPN/VRF
VXLAN Data Plane
Leafs
VTEP
DC 1 DC 2 DC 3
VLAN/VRF to VNI
Leaf switches: N9300, N5600
Spine switches: N7x00,
MPLS Routers: ASR9K
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 78
Case Study
Design Option Leveraging FabricPath
Zone Based Design
CORE
LB
LB
default gateway
LB
vPC or FP
LB
Zone
Zone1 Zone2
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 79
Case Study
Design: Firewall Placement w/Virtualization
Option1 Option2
CORE MPLS
LB
LB
Default Gateway
Spine Layer (N7k) Default Gateway
Spine Layer (N7k)
F2e
FabricPath FabricPath
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 80
Case Study
Option1: Traffic Flow
CORE CORE
LB LB
LB LB
Inter
VRF
Intra
VRF FabricPath FabricPath
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 81
Case Study
Option1: Solution w/ASA Cluster
CORE
• Use ASA cluster for firewalling
Inside Outside
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 82
Virtual Firewall per VRF
• VDC or VRF Sandwich Design
by VLAN association
• One pair of physical or virtual firewall Active/Standby
VRF C
per VRF VRF B
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 83
Sample VRF w/ASA
Default Gateway
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 84
Case Study
Option2: Traffic Flow
MPLS MPLS
Inter
VRF
FabricPath FabricPath
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 85
Comparing Options
• Option1: ASA Firewall
• Scales up by way of distributing customers to firewalls and leveraging clusters
• Stateful HA
• Purpose built hardware
• Management tools
• Inter-VRF traffic flow leverages spine layer
• Option2: ASR1k ZBFW:
• MPLS attached
• Additional services like NAT and WCCP
• Hardware forwarding
• No concerns about trunking VLANs
• There is absolutely nothing wrong with going with either option. The choice is dependent on
many factors such as requirements, comfort level with product, management and
operations etc.
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 86
Option2: Zone Based Firewall (ZBFW)
ZBFW ZBFW
ASR1k Hardware Performance
QFP
• QFP
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 87
Option2: ZBFW w/VASI Details
• Native MPLS termination ASR1k
• Gray VRF interconnects Gray
VRF
tenant VRFs vasi
• Leverage VASI BGP or OSPF
Over VASI
vasi
• Each ‘tenant’ gets a security
policy zone-pair
VR
Fs
• NAT possible and 100
-19
WCCP Possible on VASI 9 Per-VRF
Security Policy Applied Before
Traversing VASI
LDP
MPLS
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 88
Option2: Firewall Design w/Zone Based Firewall
• Redundancy by way of routing Services VRF
• Active/Standby
• Leverage metrics vasi Gray
Gray
vasi
VRF
• Limiting factors: VRF
• Throughput
VR
• Number of connections
9
Fs
19
10
0-
0-
10
• Number of conn/sec 19
Fs
9
VR
MPLS
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 89
Option2: Firewall Design w/Zone Based Firewall
• Per-VRF loadbalancing
• N+1 redundancy
• Very scalable design
• Grow as you go
• Scalability is additive
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 90
Option2: Firewall Design w/Zone Based Firewall
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 91
Inter-DC Flow Connectivity
• Symmetric traffic flow is critical
Inter-DC: Different VRFs Inter-DC: Same VRF
Supernet or Supernet or
Defaultr oute Defaultr oute
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 92
Case Study Inter-VRF Firewalls
ALG ALG
QFP QFP
• No spanning tree
• Default gateway at spine layer
• ASR1ks w/ZBFW for firewall layer Default Gateway
Spine Layer (N7k)
FabricPath
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 93
How do I Scale Up?
QFP QFP QFP QFP QFP
Firewall Layer
P-Layer
MPLS MPLS
MPLS
PE Layer PE Layer
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 94
WAN Design
WAN Requirements
• Highly available
• Traffic engineering
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 96
A WAN Core Layer – Dual Plane
• IGP Isolation between each plane
• Isolate topology changes
• Flexible topology
• Highly redundant
• Similar to two provider environments
• Traffic Engineering
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 97
Back to Design ALG
Inter-VRF Firewalls
QFP QFP
ALG
MPLS
• WAN Core routers are co-located in ASR9k
ASR9k
major DCs WAN1
ASR9k
Core1
ASR9k
Core2
WAN2
FabricPath
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 98
A WAN Core Layer – With Inter-AS
• DCs connect using dark fiber, GRE,
or leased lines
• The IGP used in the WAN core is separate
• Inter-AS option C
• Only feed infra routes to WAN Core
• VPN exchanged between RRs at
each DC
• Advantages:
• Scale & Flexibility
• IGP Isolation
• Adding/removing DCs is seamless
• High level of HA
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 99
Summary
• CLOS Architecture for Scale and Flexibility
• Scalable Architecture
• Grow as you Go
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 100
A 6 Geo Example
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 101
A 6 Geo Example
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 102
Key to Layout
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 103
Big Picture
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 104
Lessons Learned - 1
• Fabric Scale
• MAC, SVI and VLAN limits
• Topology size (number of switch-IDs) and links
• Active/Active HSRP
• Requires either vPC or GLBP today
• Anycast HSRP in the 6.2 release. Requires a new release on the N5k (roadmap)
• Hardware Choices
• FabricPath vs VXLAN vs ACI
• MPLS Handoff
• Inter-AS option C on ASR9k today
• Firewall design
• Asymmetric routing challenges with ASR1k. Requires BGP metric
• DC to DC flows with symmetry. Requires supernet routes
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 105
Lessons Learned - 2
• Inter-AS
• Option C not supported on N7k yet (roadmap)
• GRE: MTU requirement
• MPLS PE placement
• VRF-lite harder to manage and operate
• Direct handoff to the Nexus 7k or the ASR9k makes the design simpler
• Virtual firewalls, like the vASA, would make an interesting solution
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 106
MPLS Sessions at Cisco Live
• BRKMPL-1100 Introduction to MPLS
• LTRMPL-2104 Cisco WAN Automation Engine (WAE) Network Programmability with Segment Routing
#CLUS BRKMPL-2108 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 107
Complete your online session evaluation
#CLUS Presentation ID © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 108
Continue
your Demos in
the Cisco
Walk-in
self-paced
Meet the
engineer
Related
sessions
education campus labs 1:1
meetings
#CLUS Presentation ID © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 109
Thank you
#CLUS
#CLUS