BRKSPM-2074 : Cisco EPN

A Converged, Programmable and Virtualized

Architecture for Service Providers
Ankush Arora, Solutions Architect
Sheela Kishan, Network Consulting Engineer
3
Agenda
• Requirements of Today’s Converged Networks
• EPN Architecture
• Evolution & Overview
• Unified MPLS Transport Infrastructure
• Services Infrastructure

• EPN Programmability with Network Function Virtualization

• EPN Functional Aspects : QoS, Resiliency, Multicast, Synchronization
• Case-Study: Large SP Fixed & Mobile Converged Backhaul Design

4
Requirements of Today’s
Converged Networks

5
Service Provider Challenge – Bandwidth Explosion
Globally, IP traffic will grow
3-fold from 2014 to 2019,
a compound annual
growth rate of 23%

Globally, mobile data

traffic will grow 10-fold
from 2014 to 2019, a
compound annual growth
rate of 57%

Globally, mobile data

traffic will reach an annual
run rate of 291.8 Exabytes
by 2019, up from 30.3
Exabytes in 2014.

6
Service Provider Challenge – Anywhere Access
Rising Connectivity Expectations from Consumer & Business Subscribers

Pervasive Mobility
HOME CAMPUS BRANCH PUBLIC VENUE CELLULAR
OFFICE

Work from Indoor & Sales Office or Indoor & Outdoor 3G/4G
Home Outdoor Large branch Hotspot

7
Service Provider Challenge – Operational Complexity
and Increasing Cost Improve
Productivity
and Efficiency

Reduce Reduce
impact of network
Outage complexity

Improve
Reduce legacy Service Levels
networks

New and
Rapid Service Customized
Delivery Offerings

Increasing
traffic levels
Service Provider Challenges – Desired Outcomes
Increasing Bandwidth & Network Scale
Access Anywhere Scalable, Flexible, Modular

Increasing Operational Simplified Operations

Complexity Standard, Simple, Uniform

Increasing Cost for new £

¥$€
Business Agility
Validated, Open, Programmable
Services

9
Cisco Open Network Vision

Applications
Managed
Routing / VPN Transport Security Private Cloud Mobility Video/ Content
Services

Evolved Services Platform (ESP)

Service Provisioning Network Orchestration Compute & Storage Control

Virtual

Physical
Compute Storage Network
Evolved Programmable Network (EPN)

10
EPN Architecture

11
EPN Evolution
Past Solution Framework
New EPN Framework
Unified Fixed and Mobile
MPLS for Convergence (FMC)
Mobile Residential Enterprise
Transport Services Services Mobile
Backhaul
(UMMT)
Services
Mobile Programmability & Network
Enterprise
Mobile Backhaul Services Virtualization
Backhaul Services
Services Transport
Residential
Services (MPLS, Ethernet, nV)

Transport
(MPLS, Ethernet)

12
EPN Overview
Business Convergence Enterprise Residential Consumer Convergence
• Unified L3 VPN experience FMC FMC
• Unified Subscriber Experience
Corporate IP

vRR, PCRF
Virtualization or Integration
vPGW, vBRAS
Integrated BNG, WAG, CGN

nV nV
MPLS Unified MPLS Transport MPLS
Ethernet Ethernet

13
Unified MPLS Transport - Highlights For Your
Reference
• Hierarchical label allocation RFC 3107 to provide scale
• BGP Filtering to distribute only essential prefixes in a domain
• Seamless multicast integration with LSM & mLDP
• Flexible Access with MPLS, Ethernet, nV
• Resiliency with LFA FRR & BGP PIC
• Virtualized Services edge with L2/L3 VPNs
• Autonomic Networking
• Synchronization distribution
• DiffServ QoS across all network layers

14
Unified MPLS : Access Network Models

nV nV
MPLS MPLS
Unified MPLS Transport
Ethernet Ethernet

• MPLS Packet Access

• Ethernet / TDM Access
• nV Access

15
Ethernet Access : Hub-and-Spoke For Your
Reference

MC-LAG with ICCP: ICCP-SM: MC-LAG with PBB-EVPN:

• Per Node Active/Standby • Support both L2 and L3 • Active/Active per-flow or

mode services per-service LB
• Support both L2 and L3 • L2 service: per-VLAN load • Support L2 service only
service balancing with PBB-EVPN
• L3 service: active/active on
both links

16
 For Your
Ethernet Access : Ring Reference

Aggregation Node Aggregation Node

• Standard Ring architecture – based on
RPL Owner RPL Owner
Orange
G.8032
Purple Instance
Instance • Ethernet Ring Protection (ERP) protocol
RPL in RPL in to provide protection.
Orange Purple
Instance Instance • Faster protection switching time than
STP

G.8032 Open Ring

Orange G.8032 instance

Purple G.8032 instance

17
nV Access : Satellite
• One or more remotely located
management sessions established on
Fabric links devices along with a pair of host
nV Satellites nV Hosts nodes to collectively realize a
single virtual switching entity.
• Satellites act under
management and control of the
host nodes

ICCP • Virtualize hundreds of access

nodes, into nV Satellite devices.

management sessions toward

Active and Standby nV Host

Active nV Host and

corresponding Satellite
nodes

18
nV Access : Simple Ring For Your
Reference

• Entire ring consolidated as nV Satellite

• All Satellite ports seen by PE routers as local ports
• Active-Standby load balancing per Satellite

19
Agenda
• Requirements of Today’s Converged Networks
• EPN Architecture
• Evolution & Overview
• Unified MPLS Transport Infrastructure
• Services Infrastructure

• EPN Programmability with Network Function Virtualization

• EPN Functional Aspects : QoS, Resiliency, Multicast, Synchronization
• Case-Study: Large SP Fixed & Mobile Converged Backhaul Design

20
Unified MPLS Transport Models

1. Small Network 2. Large Network

Model 1.1 Model 2.1

Ethernet / TDM or nV
Flat LDP Core and Aggregation Network Hierarchical Labeled BGP Core and
Access Network
Aggregation Network
Model 1.2 Model 2.2
Hierarchical Labeled BGP LSP Access Hierarchical Labeled BGP Access
IP/MPLS Network Network
Access Network Model 1.3 Model 2.3
Labeled BGP Redistribution into Access Labeled BGP Redistribution into Access
IGP/LDP IGP/LDP

Unified MPLS Transport

21
1.1 Flat LDP LSP across Core and Aggregation
Networks
Core Node
Pre-Aggregation Node Core Node Pre-Aggregation Node
Ethernet
Core and
(SDH)
Aggregation
Pre-Aggregation Node Aggregatio IP/MPLS Domain Pre-Aggregation Node
n Node
Core Node Core Node
TDM or Packet Microwave
Mobile Access Ethernet / SDH
Pre-Aggregation Node Pre-Aggregation Node Fixed and Mobile Access
IGP/LDP domain

• Core and Aggregation Networks form one IGP and LDP domain.
• For small aggregation platforms scale target is less than 1000 IGP/LDP nodes.
• All Mobile and Wireline services are enabled by the Pre-Aggregation Nodes

22
1.2 Hierarchical BGP LSP Across Core, Aggregation
and Access Networks
Pre-Aggregation Node
Pre-Aggregation Node
Core Node Core Node
Access
Access
IP/MPLS Domain
Core and Aggregation IP/MPLS Domain

Pre-Aggregation Node IP/MPLS domain

IGP Area Aggregation Node
Core Node Core Node

Pre-Aggregation Node Pre-Aggregation Node

iBGP Hierarchical LSP

LDP LSP LDP LSP LDP LSP

• Access is MPLS-enabled. Each Access Network forms a different IGP/LDP domain

• Core and Aggregation form a relatively small IGP/LDP domain (<1000 nodes)
• Core/Aggregation and RAN Access Networks are integrated with labelled BGP LSP

23
1.3 Hierarchical BGP LSP Across Core and
Aggregation with LDP Access Networks
Pre-Aggregation Node
Pre-Aggregation Node
Redistribute labeled BGP Core Node Core Node
Service Communities into
Access IGP RAN
RAN IP/MPLS Domain
IP/MPLS Domain
Core and Aggregation
IP/MPLS domain
Pre-Aggregation Node
IGP Area Pre-Aggregation Node
Redistribute Access IGP
into labeled BGP Core Node Core Node

Pre-Aggregation Node Pre-Aggregation Node

LDP LSP iBGP Hierarchical LSP LDP LSP

LDP LSP

• Core and Aggregation form a relatively small IGP/LDP domain (<1000 nodes)
• RAN is MPLS-enabled. Each RAN network forms a different IGP/LDP domain
• Pre-Aggregation Nodes run labelled BGP

24
2.1 Hierarchical BGP LSP Across Core and
Aggregation Networks Domains
Aggregation Node
Aggregation Node

Core Node Core Node Ethernet

Aggregation Network Core Network Aggregation Network

(SDH)
IP/MPLS Domain IP/MPLS Domain IP/MPLS Domain
Aggregation Node
Aggregation Node
Core Node Core Node
TDM or Packet Microwave
Mobile Access Aggregation Node Ethernet / SDH
Aggregation Node Fixed and Mobile Access
i/(eBGP) Hierarchical LSP
LDP LSP LDP LSP LDP LSP

• Core and Aggregation Networks enable Unified MPLS Transport

• Core and Aggregation Networks are organized as independent IGP/LDP domains
• Network domains are interconnected with hierarchical LSPs based on RFC 3107, BGP
IPv4+labels.
• Intra domain connectivity is based on LDP LSPs
• Fixed and Mobile Access Network may be Ethernet, SDH, Packet/TDM Microwave
25
2.2 Hierarchical BGP LSP Across Core, Aggregation
and Access Networks
Aggregation Node
Aggregation Node

Core Node Core Node

Access Access
IP/MPLS domain IP/MPLS domain
Aggregation Network Core Network Aggregation Network
IP/MPLS Domain IP/MPLS Domain IP/MPLS Domain
Aggregation Node
Aggregation Node
Core Node Core Node
Aggregation Node
Aggregation Node
iBGP(eBGP across ASs) Hierarchical LSP
LDP LSP LDP LSP LDP LSP LDP LSP LDP LSP

• Core, Aggregation, Access are organized as independent IGP/LDP domains with Unified MPLS.
• Core and Aggregation Networks may be in different Autonomous Systems, in which case the inter-
domain LSP is enabled by labeled eBGP in between ASs
• Network domains are interconnected with hierarchical LSPs based on RFC 3107, BGP IPv4+labels.
Intra domain connectivity is based on LDP LSPs
• Access Nodes learn only the required labeled BGP FECs based on service specific filtering.

26
2.3 Hierarchical BGP LSP across Core and
Aggregation with LDP Access Network
Pre-Aggregation Node
Redistribute labeled
Pre-Aggregation Node
Redistribute labeled
BGP Service BGP Service
Communities into Core Core Communities into
Access IGP Access IGP
RAN Aggregation Network Core Network Aggregation Network
MPLS/IP IP/MPLS Domain RAN
IP/MPLS Domain IP/MPLS Domain MPLS/IP
Pre-Aggregation Node Pre-Aggregation Node
Redistribute Access IGP Redistribute Access IGP
into labeled BGP Core Core into labeled BGP

Pre-Aggregation Node
Pre-Aggregation Node
iBGP(eBGP across AS) Hierarchical LSP
LDP LSP LDP LSP
LDP LSP LDP LSP LDP LSP

• Core, Aggregation, Access are organized as independent IGP/LDP domains with Unified MPLS.
• Network domains are interconnected with hierarchical LSPs based on RFC 3107, BGP IPv4+labels.
Intra domain connectivity is based on LDP LSPs
• Pre-Aggregation Nodes run labelled BGP, redistributing the relevant BGP service communities to
Access IGP/LDP and integrating the Access IGP/LDP.
• Access Network Nodes learns only the required destinations based on service specific filtering.
27
BGP Control Plane For Your
Single AS, Multi Area IGP, labeled BGP Access Reference

Unified MPLS Transport Inline RR Inline RR External RR Inline RR

 NHS   NHS   NHS 
RR

iBGP
IPv4+label PE iBGP IPv4+label ABR iBGP IPv4+label
IPv4+label IPv4+label
IPv4+label PE
BNG, MSE
External RR
Example: IP RAN VPNv4 Service
Inline RR RR
Inline RR Inline RR
VPNv4 PE
iBGP iBGP iBGP
CSG
VPNv4 VPNv4 VPNv4
VPNv4 PE (MTG)

Access Network Aggregation Network Core Network

Service Edge Node
(BNG, MTG…)

IP/MPLS Transport IP/MPLS Transport IP/MPLS Transport

Access Nodes Core ABR Core ABR
Aggregation Node Aggregation Node
Fiber or uWave Link, Ring DWDM, Fiber Rings, H&S, Hierarchical Topology DWDM, Fiber Rings, Mesh Topology

28
Services Infrastructure
for Mobile, Residential & Business

29
Mobile Services
TDM/Ethernet Access Network BSC
RNC
SDH/SONET
v4/v6 MPLS VPN

TDM BTS, ATM NodeB ATM / TDM

SGSN GGSN
S/PGW
Ethernet, REP, G.8032
MME
Mobile
Transport
v4 or v6 MPLS VPN for S1, X2 Gateway
IP/PIM v4/v6 for eMBMS M3/M1
Mobile
X2-C, X2-U Transport
Gateway S/PGW

Mobile Access Network Mobile Aggregation Network Mobile Packet Core Network
Mobile Transport Gateway

IP/MPLS Transport IP/MPLS Transport

Aggregation Node Aggregation Node Core Node Core Node

Ethernet/TDM Microwave DWDM, Fiber Rings, H&S, Hierarchical Topology DWDM, Fiber Rings, Mesh Topology

30
Mobile Services
Unified MPLS Access Network
BSC
RNC
MPLS VPN v4/v6 MPLS VPN

TDM BTS, ATM NodeB ATM or TDM

GGSN
SGSN
Small S/PGW
Cell NID S1-U v4/v6 MPLS VPN
IP eNB
Mobile Transport Gateway MME
v4 or v6 MPLS VPN for S1, X2
IP/PIM v4/v6 for eMBMS M3/M1
S1-C/M3
X2-C, X2-U
Mobile Transport Gateway
v4/v6 MPLS VPN

Mobile Access Network Mobile Aggregation Network Mobile Packet Core Network
Mobile Transport Gateway

IP/MPLS Transport IP/MPLS Transport IP/MPLS Transport

Cell Site Gateway Pre-Aggregation Node Aggregation Node Core Node Core Node

Fiber or uWave Link, Ring DWDM, Fiber Rings, H&S, Hierarchical Topology DWDM, Fiber Rings, Mesh Topology

31
Simplified MPLS VPN Scale Control for LTE For Your
Reference

Export: RAN Y RT, Common

Aggregation Domain Core Domain Aggregation Domain RT
Import RAN Y RT, MPC RT
MME
VRF VRF
VRF

VRF MTG VRF

SGW/PGW
MTG
Export: AGGR W RT,
VRF LTE Transport VRF
VRF VRF
Common RT VRF
MPLS VPNv4/v6
VRF
Import AGGR W RT, VRF
MTG
MPC RT SGW/PGW

VRF VRF VRF VRF

Export: MPC RT
Import: MPC RT, Common RT
Export: RAN Z RT, Common RT
Import RAN Z RT, MPC RT

• Mobile Transport GWs import all RAN & MPC Route Targets, and export prefixes with MPC Route Target
• CSGs in a RAN region import MPC and neighboring RAN Route Targets (Low Scale CSGs) or AGGR wide RT
(High Scale CSGs)
– Enables S1 control and user plane with any MPC locations in core
– Enables X2 across CSGs in RAN and AGG region

32
 Residential Services
Ethernet Access Network

Optimal Service Edge is

AGN-SE or PAN-SE
3play Unicast HSI, VoIP, Video Unicast Transport
AGN-SE
IPv6 and IPv4/v6
With BNG
IPoE Sessions IP or L3 VPN over Unified MPLS for 3play Unicast
IP Integrated MAP-T BR
N:1 or 1:1 VLANs, Non Trunk UNI MPLS (mLDP)
PIM
IPv6 CPE with MAP-T
IP TV IPTV Transport

Access Network Large Scale Multiservice

Aggregation Network Core Network
Ethernet
Aggregation Node

IP/MPLS Transport IP/MPLS Transport

Pre-Aggregation Node Aggregation Node Core Node

Fiber DWDM, Fiber Rings, H&S, Hierarchical Topology DWDM, Mesh Topology

33
Residential Services
Unified MPLS Access Network

Optimal Service Edge is

AGN-SE or PAN-SE
3play Unicast HSI, VoIP, Video Unicast Transport
AGN-SE
BNG with PWHE
IPv6 and IPv4/v6
EoMPLS PW EoMPLS Pseudowire IP or L3 VPN over Unified MPLS for 3play Unicast
IPoE Sessions
PIMv4/v6 Integrated MAT-T BR MPLS (mLDP)
Access Node UNI:
Non Trunk, N:1 or 1:1 VLAN;

IP TV IPTV Transport

Access Network Large Scale Intelligent

Aggregation Network Multiservice
Core Network Services Edge
Aggregation Node
ASR-9001, 90006

IP/MPLS Transport IP/MPLS Transport

Pre-Aggregation Node Aggregation Node
MPLS Access Node Core Node Service Edge Node

Fiber, Microwave DWDM, Fiber Rings, H&S, Hierarchical Topology DWDM, Mesh Topology

34
Business Services - MEF
MPLS, Ethernet and nV Access Network
E-LAN VPLS, PBB-EVPN
Ethernet Port, 802.1q
VPLS, PBB-EVPN
Ethernet Port, 802.1q

X-Line
Ethernet Port, 802.1q or 802.1ad
TDM, ATM IMA E1, STM1

Legacy Large Scale Multiservice

ME-1200 Access Network Aggregation Network Core Network
NID
Ethernet P2P, G.8032 Ring
Aggregation Node

IP/MPLS Transport IP/MPLS Transport

Access Node

nV, Core Node

P2P, Chain, Ring, L2 Fabric
Pre-Aggregation Node Aggregation Node

SONET/SDH DWDM, Fiber Rings, H&S, Hierarchical Topology DWDM, Mesh Topology

35
Business Services – Enterprise VPN
Optimal Service Edge
L3 VPN
MPLS VPN/Multicast VPN (mLDP)
Ethernet 802.1q Ethernet 1q/QinQ PWHE

MPLS VPN/Multicast VPN (mLDP)

Ethernet 802.1q Ethernet 1q/QinQ PWHE

MPLS VPN/Multicast VPN (mLDP)

Ethernet 802.1q Ethernet 1q/QinQ

Efficient Large Scale Multiservice

Access Network Aggregation Network Core Network
Aggregation Node
ASR-9001, 9006

IP/MPLS Transport IP/MPLS Transport

Remote Fixed Access Node Pre-Aggregation Node Aggregation Node
ME-3600X, ASR-901 ASR-9001, ASR-903 ASR-9010 Core Node

xWDM, Fiber Rings DWDM, Fiber Rings, H&S, Hierarchical Topology DWDM, Mesh Topology

36
Agenda
• Requirements of Today’s Converged Networks
• EPN Architecture
• Evolution & Overview
• Unified MPLS Transport Infrastructure
• Services Infrastructure

• EPN Programmability with Network Function Virtualization

• EPN Functional Aspects : QoS, Resiliency, Multicast, Synchronization
• Case-Study: Large SP Fixed & Mobile Converged Backhaul Design

37
 EPN Programmability with
Network Function Virtualization

38
Autonomic Networking

• Secure registration of access devices

• Autonomic control plane establishment
• Automated access node configuration
• Dynamic interface address assignment via Auto-IP

39
MPLS Access with Microwave ACM

Aggregation Node
• ACM Signaling
• Optimizing Routing
Aggregation Node
Policy Logic updating the IGP • Controlling Congestion
IP/MPLS metric and H-QoS on the
interface IP/MPLS interface • Lossless Protection

Y.1731 VSM
Signals the
Microwave link
speed
Microwave Fading

40
Optimal Routing with BGP Accumulated IGP
PAN-ABR CN-ABR
iBGP IPv4+label Inline-RR iBGP IPv4+label Inline-RR AIGP enabled on all BGP enabled
 NHS  NHS
devices in the network.
Access IGP Domain  Aggregation IGP Domain  Core IGP
Domain
AN CN-ABR
Inline-RR

Total
AIGP=5 Cost =
10 Traffic
iBGP iBGP Forwarding
AIGP=1 Total
0 Cost = Total Cost = Add AIGP
15 attribute and metric to
next hop for the path.
Lower value path is
preferred.
LDP LSP LDP LSP LDP LSP

iBGP Hierarchical LSP

• By default, BGP only considers IGP cost to next-hop for calculating best path.
• BGP AIGP accounts for both cost to next-hop and next-hop’s cost to reach destination.

41
Virtual RR : BGP Control Plane Virtualization

• In Small Networks, Core and Aggregation RRs IPv4/v6+label

VRR IPv4/v6+label VRR
are collapsed VRR VRR Core RR, NHU
• In Large Networks, the Aggregation RRs maybe Aggregation RR, NHU
be inline in Aggregation ASBRs
iBGP iBGP
IPv4/6+label IPv4/6+label

FMC Access Network Aggregation Network Core Network IPv4/6+label

IPv4/v6+label IPv4/v6+label
RR Client
IPv4v6+label IPv4/v6+label RR, NHS RR NHS
RR Client RR, NHS IPv4v6+label
RR Client
IP/MPLS Transport IP/MPLS Transport IP/MPLS Transport

Service Edge Nodes eBGP Service Edge Node

(BNG, MSE, WAG) (MTG, IGW,…)
IPv4/6+label
Aggregation
Access Node Pre-Aggregation Node ASBR Core ASBR Core ASBR
Fiber or uWave Link, Ring DWDM, Fiber Rings, H&S, Hierarchical Topology DWDM, Fiber Rings, Mesh Topology

42
Residential Virtual CPE
virtual CPE(s)
1:1 mapping over
L2 connectivity • Software infrastructure for instantiating vCPE
instances on a general purpose server (For
Example : UCS)
• Home CPE is a simple NID
• Server is Co-located with OLT devices for close
alignment with existing Ethernet

physical CPE(s)

Efficient Large Scale Multiservice

Access Network Aggregation Network Core Network

Aggregation Node
Access Node
OLT, FTTH
IP/MPLS Transport
IP/MPLS Transport

Pre-Aggregation Node Aggregation Node Core Node

Fiber, PON DWDM, Mesh Topology

43
EPN Functional Aspects

44
Differentiated Services QoS Domain
Core, Aggregation, Mobile Access
Access Network UNI
LTE DiffServ
Traffic Class Resource MPLS/IP IP NodeB, eNodeB ATM NodeB
QCI PHB

MPLS EXP DSCP ATM

Network Management 7 Non-GBR AF 7 56 VBR-nrt

Network Control Protocols 6 Non-GBR AF 6 48 VBR-nrt

Network Sync (1588 PTP , ACR)

1
Mobile Conversation (Voice & Video)
2 GBR EF 5 46 CBR
Signaling (GSM Abis, UMTS Iub control, LTE
3
S1c, X2c)

Reserved 4 - AF 4 32 VBR-nrt

Hosted Video 5 Non-GBR AF 3 24 VBR-nrt

2 16
Reserved 8 - AF VBR-nrt
1 8

Internet
9 Non-GBR BE 0 0 UBR
Best Effort

45
High Availability
Access Aggregation Core Aggregation Access
Network Network Network Network Network

PAN CN-ABR CN-ABR PAN

Inline RR Inline RR Inline RR Inline RR
FTTB
 next-hop-self   next-hop-self   next-hop-self   next-hop-self 
iBGP iBGP
IPv4+label IPv4+label
CSG iBGP
iBGP IPv4+label
IPv4+label CN-RR
iBGP
RR IPv4+label
CSG
CSG
MTG
AGN-SE Mobile AGN-SE
Packet Core CSG
SGW/PGW
FTTB
MME
iBGP Hierarchical LSP
LDP LSP LDP LSP LDP LSP LDP LSP LDP LSP

BGP FRR Edge BGP FRR Core LFA FRR, Remote-LFA FRR
<100 msec <100 msec < 50msec

46
Multicast Transport for Mobile Backhaul

Mobile Access Network Aggregation Network Core Network

SGW
S1-U
S11
MTG-3
VRF MTG-1
CSG VRF
VRF MME
MPLS VPN v4/v6 S1-C
Single VRF VRRP
eNodeB UNI
Global
M3 VRF
M1
MTG-2
RAN IGP Protocol
Sm
MPLS Access: PIMv4/v6
M1
Ethernet Access: IGMP/MLDv2 mLDP transport MBMS-
GW

• M1 interface transport handled via IP over mLDP transport in core/aggregation and IP Multicast
with PIM SSM in access.
• M3 interface transported using L3VPN service for MBMS session management signaling.

47
 Synchronization Distribution
TDM(SDH)
No Physical SyncE
Synchronization
1588 PMC 1588 PTP
SyncE Packet Master Clock

Microwave PRC/PRS
1588 BC
1588 BC IP/MPLS Transport Network
1588 Phase
(+ Frequency)
1588 BC+SyncE Hybrid
1588 BC
Mode External Synchronization
1588 GM Interface (Frequency)

External Synchronization
Ethernet Fiber Interface (ToD and Phase)
Global Navigation Satellite System (e.g. GPS, GLONASS,
Mobile Aggregation Network
GALILEO)- PRTC, Primary Reference TimeMobile
Clock Packet Core Network

Mobile Access Network Aggregation Network Core Network

Mobile Transport
Gateway (MTG)

IP/MPLS Transport IP/MPLS Transport IP/MPLS Transport

Pre-Aggregation Node Aggregation Node Core Node
Cell Site Gateway (CSG) Core Node

Fiber or uWave Link, Ring DWDM, Fiber Rings, H&S, Hierarchical Topology DWDM, Fiber Rings, Mesh Topology

48
 For Your

Hybrid Synchronization Model Reference

• Provides Frequency, Phase, and Time of Day (ToD) synchronization

• IEEE 1588v2 PTP used in conjunction with SyncE provides a hybrid
synchronization solution
• SyncE provides frequency distribution
• 1588v2 provides phase and/or ToD distribution

• 1588v2 PTP stream is carried globally in the Aggregation and Access Domains.
• 1588v2 Boundary Clock (BC) at Aggregation, Pre-Aggregation, and Cell-site
Gateway nodes improves scalability and resiliency
• Resynchronizing 1588v2 servo in BC nodes from SyncE frequency input
improves Phase alignment.

49
Agenda
• Requirements of Today’s Converged Networks
• EPN Architecture
• Evolution & Overview
• Unified MPLS Transport Infrastructure
• Services Infrastructure

• EPN Programmability with Network Function Virtualization

• EPN Functional Aspects : QoS, Resiliency, Multicast, Synchronization
• Case-Study: Large SP Fixed & Mobile Converged Backhaul Design

50
 Case-Study
Large SP Fixed & Mobile Converged
Backhaul Design

51
Customer Profile Voice, Video & Data Services

• Mobile SP in APAC Internet Access Services

• Greenfield Network
Enterprise VPN Services
• Fixed-Mobile Convergence
• Multiple Access Mechanisms Access Mechanisms
• Quad Play Services LTE
WiFi
• More than 50,000 cell sites
planned across the country Ethernet FTTH

52

Unified MPLS Backhaul

52
 High Level Architecture
Access Pre-Agg Aggregation Core
Nexus-7K
ASR-901 / ASR-920

CSR CSR ASR-903 SAE-GW,MME,WLC,ISG

FTTH, WiFi & LTE Packet Core Data-Center
DC Operator Content
ASR-9010 MTG MTG
DC
CSR OSS/BSS
Pre-Agg
Core
CSR
Pre-Agg
Aggregation
IP/MPLS Core ASR-9010
WiFi AP WiFi AP Core
Pre-Aggregation Ring AGG/ (IP/MPLS)
(IP/MPLS) BNG ASR-1006
RR
WiFi AP Pre-Agg AGG/
WiFi AP Core
BNG
Pre-Agg IBR
ASR-9922
CSR Residential Internet
OLT
CPE OLT OLT
OLT
Residential ASR-9010
FTTH FTTH
STB OLT OLT CPE
Enterprise
Customer 53

STB
Logical Design Overview
Aggregation Node
Aggregation Node

Mobile
MPC iBGP community Transport GW Core
Core
Node MPC iBGP community CSR
CSR Core
Core
Node into RAN IGP
into RAN IGP Core Core
Node Node
RAN Aggregation Network Core Network Aggregation Network RAN
MPLS/IP IP/MPLS IP/MPLS Domain IP/MPLS MPLS/IP
Domain Domain Separate ISIS
Separate ISIS
Pre-Aggregation ISIS Level 2 Pre-Aggregation CSR
Process Process
CSR Node ISIS Level 1 Core Core Node
Node
ISIS Level 1
Core Mobile Node
RAN IGP CSR Loopbacks Core
Core
Node RAN IGP CSR Loopbacks
Core Node Transport GW into iBGP
into iBGP
CSR
CSR Aggregation Node
Aggregation Node
iBGP Hierarchical LSP
LDP LSP LDP LSP
LDP LSP LDP LSP LDP LSP

• Single BGP Autonomous System

• UMMT Model 2.3 : Labeled BGP Redistribution into Access Network IGP/LDP
• ISIS domain separation between Core & Aggregation domains.
• ISIS process separation between Aggregation & Access domains.
54
Logical Design Overview
• IGP Design

• Two ISIS processes : Core & RAN

• Core Routers are ISIS L1/L2
• Mobile Transport Gateway (MTG),
DC-Interconnect & Internet Border
Router (IBR) are in Core ISIS L2
domain.
• The Aggregation & Pre-Aggregation
routers are in Core ISIS L1 domain.
• Separate RAN ISIS process on Pre-
Aggregation routers for Cell Site
Routers.

55
Logical Design Overview
BGP Design for Transport Loopbacks

• BGP Labelled Unicast (RFC 3107) is

used for propagation of IPv4
Loopbacks across core & aggregation
domains.
• Core routers act as BGP inline RR for
Aggregation & Pre-Aggregation
routers.
• On Pre-Aggregation routers, BGP –
ISIS redistribution is enabled for
exchanging IPv4 loopbacks.

56
 For Your
Reference
Logical Design Overview
VPN Design & VRFs for S1 & OAM

• LTE – S1 Signaling & OAM are in VRF

on the MTG & CSR & Pre-Agg.
• End to End iBGP Hierarchical LSP from
CSR to MTG, Pre-Agg to MTG
• Pre-Agg Routers Act as VPN BGP Inline
Route Reflectors for CSR.
• Core Routers Act as VPN BGP Inline
Route Reflectors for Pre-Agg Routers
• VRF Lite between MTG & EPC-Agg
Switch

57
 For Your

Logical Design Overview Reference

VPN Design & VRFs for S1 & X2

• LTE – X2 & S1 Bearer are in same VRF on

the MTG, CSR & Pre-Agg.
• End to End iBGP Hierarchical LSP from
CSR to CSR for X2.
• Loopbacks of all CSR within a Aggregation
domain are imported on a CSR for X2
handoff using BGP community.
• Same community within an Aggregation
domain ensures seamless X2 within the
aggregation domain.

58
 For Your
Reference
Logical Design Overview
VPN Design & VRFs for X2

• Inter-Aggregation domain X2
required between neighboring
domains for some cases.
• Selective import of CSR loopbacks
enabled using BGP community
between adjacent Aggregation
domains
• Selective import of community to
explicitly allow X2 wherever required
between aggregation domains.

59
Datacenter Interconnect & Internet Access for LTE
Control Plane

• The MTG, IBR & DC-Interconnect Router

act as PE in the Core ISIS L2.
• BGP is used for external peering with
EPC domain, Datacenter & other ISP
• IBR receives full Internet Routing table
and advertises a default route towards
MTG for sGi traffic
• Summarized Datacenter prefixes are sent
by DC-Interconnect router
• MTG advertises the subscriber pools
• IPv4 BGP & 6PE used for prefix
advertisement. VPN is also an option

60
Datacenter Interconnect & Internet Access for LTE
Traffic Flow For Your
Reference

• sGi IPv4 traffic from EPC undergoes

NAT44 on MTG. IPv6 traffic bypasses
NAT
• sGi traffic for operator’s own content &
apps flows to the datacenter through
the DC-Interconnect
• sGi traffic for internet flows through the
Internet Border Router (IBR) which has
external peering.
• HTTP traffic is redirected to the
Transparent Internet Cache using
Access-List Based Forwarding (ABF)
on IBR

61
Datacenter Interconnect & Internet Access for FTTH
Control Plane
• Aggregation router (which is FTTH
service insertion node), peers directly
with RR
• IPv4 BGP & 6PE is used for prefix
advertisement. VPN is also an option
• Aggregation router advertises the FTTH
subscriber prefixes.
• Aggregation router receives the internet
default from IBR & datacenter prefixes
from DC-Interconnect router.

62
Datacenter Interconnect & Internet Access for FTTH
For Your
Reference
Traffic Flow
• FTTH traffic for operator’s own content &
apps flows to the datacenter through the DC-
Interconnect
• BNG is enabled on the Aggregation router for
FTTH Internet traffic
• FTTH IPv4 internet traffic undergoes NAT44
on IBR. IPv6 traffic bypasses NAT
• HTTP traffic is redirected to the Transparent
Internet Cache using Access-List Based
Forwarding (ABF) on IBR

63
 For Your
Reference
Quality of Services Design
• QCI to DSCP Mapping is done on eNodeb & Gateways.
• Traffic classification with DSCP at UNI of Edge devices (Cell Site Router for
LTE and MTG for EPC)
• NNI Egress to perform Queuing (PQ+CBWFQ) using Flat/Hierarchical QoS
policy based on MPLS EXP (topmost bits)
• Synchronization, Real time Voice & Video, LTE Signaling are accommodated
in priority class on the egress.
• Remaining traffic is accommodated in classes enabled with CBWFQ.

64
Synchronization Model
• End-to-end Hybrid Synchronization Model due
to its stability, quality and accuracy
• 1588v2 PTP provides phase & TOD
distribution
• SyncE provides frequency distribution
• 1588v2 PTP is carried globally in Core,
Aggregation & Access domains.
• 1588v2 Boundary Clock (BC) on MTG, Core,
Pre-Agg & Cell Site Router improves
scalability and resiliency
• PTP towards eNodeB on a separate vlan in
global

65
LTE Multicast Design

MPLS Multicast in the Core & Aggregation

PIM-SSM between MTG & Agg-Switch and in Pre-Agg, Access domains
Multicast source advertised in BGP for RPF check completion
66
Fast Convergence
Unified MPLS Transport Prefixes
• LFA FRR, Remote LFA FRR
• BFD for ISIS
• ISIS SPF Prefix Priority
• BGP PIC Core & Edge
• BGP Next Hop Tracking

Service Prefixes
• VPN BGP PIC Edge
• VRRP on UNI in EPC Agg & DC

67
Summary & Key Solution Highlights
• Decoupling of transport & service layers.
• Scaling of MPLS infrastructure using RFC 3107 hierarchical LSPs.
• Optimal integration of wire-line FTTH aspects in transport network.
• Simplified provisioning of mobile and wire-line services.
• High scaled MPLS VPNs support transport virtualization.
• Synchronization distribution capabilities.
• QoS for optimal transport of multimedia content.
• Improved high availability with LFA for Fast Reroute & BGP PIC capabilities.
• Comprehensive Multicast support.

68
69
Call to Action
• Related Sessions
• BRKSPG-2231 – Network Modeling, Analytics and Practical Data Science for NGN and
EPN Networks
• LTRSPG-3005 - Deploying the virtualized IOS XRv-9000 in Evolved Programmable
Network (EPN)
• LTRSPG-2516 - Evolved Programmable Networks: Design and Orchestration

• Meet the Engineer

• Wednesday 2/17 - 5:00 PM to 6:00 PM
• Thursday 2/18 – 5:00 PM to 6:00 PM

• World of Solutions - Demonstrations

• Evolved Services Platform – Virtualization and Orchestration Strategy
• Simplify Carrier Ethernet Management – Cisco EPN Manager
• Deliver Performance with Network Simplification – Cisco IOS-XRv Virtual Router
Complete Your Online Session Evaluation
• Please complete your online session
evaluations after each session.
Complete 4 session evaluations
& the Overall Conference Evaluation
(available from Thursday)
to receive your Cisco Live T-shirt.

• All surveys can be completed via

the Cisco Live Mobile App or the
Communication Stations
72
Thank you

73