Terragraph Trial in George Town, Malaysia
Terragraph Trial in George Town, Malaysia
Terragraph Trial in George Town, Malaysia
Town, Malaysia
3 | Terragraph Terragraph trial in George Town, Malaysia 4
Executive Summary
Key take-aways from the trial to date include:
This paper describes the trial deployments in detail, outcomes to date, availability of 99.5%, which is viewed as a reasonable
and highlights the opportunity to use Terragraph for rapid and threshold for broadband internet service.
Background
Access to reliable high speed broadband has become an essential part Currently, there are two methods to provide truly “gigabit” fixed
of modern life, society and business. Availability of broadband also broadband speeds: traditional fiber and emerging millimeter wave wireless
underpins digitization of the economy and the wider adoption of Industry networks. The latter is widely recognized as having a crucial role to play in
4.0 technology. Improved connectivity will also help communities access the next generation networks, as evidenced by 5G plans to use millimeter
online commerce, education, entertainment, healthcare and government wave technology for both fixed and mobile access.
services. At the same time, new technologies and use cases continue to
drive demand for data. Cisco estimates that IP traffic in the Asia-Pacific Developments in radio technology have opened up new opportunities to
region will grow at a compound annual rate of 26% and constitute of 12.2 create products that operate in high-frequency bands. These are bands in
billion networked devices by 2021. the millimeter wave range, from 30 GHz – 300 GHz. Most of these bands
have approximately 500-800 MHz of spectrum. However, even more
The demand for broadband network speeds and capacity will continue exciting are the possibilities offered by the V-band (60GHz) operating with
to grow. The Economist Intelligence Unit’s Inclusive Internet Index 2019 at least 7 GHz of spectrum (57-64GHz), and potentially even 14 GHz (57-
found the average mobile speed in Asia to be 22.2Mbps (download) and 71GHz), making it the largest commercial radio band ever used.
10.8Mbps (upload). While this represents significant progress in recent
years, continuing this trajectory will require significant investments, new Millimeter wave spectrum can address the growing demand for
technology solutions and partnerships. bandwidth by delivering gigabits of capacity more quickly, easily and
cost-effectively compared to deploying fiber.
Solving the speed shortfall is the goal of many in the connectivity
ecosystem. This is true for the service providers, as well as national
and local governments. The Malaysian Government has set a target of
achieving average speeds of 30 Mbps in 98% of populated areas by 2023
as part of the National Fiberization and Connectivity Plan.
7 | Terragraph Terragraph trial in George Town, Malaysia 8
Introduction to
Terragraph
Facebook developed Terragraph starting with a basic problem statement:
“How can we contribute to the telecom ecosystem with a solution providing
“ Terragraph is able to
deliver fiber-like speeds
over metro-scale service
areas at a fraction of the
cost of fiber.
cost-effective, ultra-high speed connectivity?” Fiber is the de-facto
standard today for delivering connectivity in excess of Gbps in some cases,
yet fiber is often prohibitively expensive and time consuming to deploy due
to right-of-way constraints and trenching costs. As such, Terragraph seeks
to address the problem using millimeter wave technology. The radios are able to interconnect to form a layer 3 mesh which
can be scaled over large geographic areas and offers redundant and
Terragraph uses millimeter-wave radios to create both a scalable distribution reliable connectivity between end-points. Terragraph radio nodes can
network, as well as a home access link. Terragraph is able to deliver be deployed on abundant physical assets such as street furniture, for
fiber-like speeds over metro-scale service areas at a fraction of the cost of example, to provide last-mile gigabit-per-second connectivity between
buried fiber. Terragraph radios operate in the 60 GHz V-Band where there is a service provider’s fiber presence and subscriber residences. The
an abundance of available, unlicensed spectrum, and employ a TDD/TDMA deployment of street-level radios mitigates the high costs associated with
MAC structure which enables extremely efficient use of of this spectrum even fiber rights of way and trenching, thus lowering the cost-barrier for service
in highly congested scenarios. While originally envisaged for indoor use as a providers to bridge the demand for high speed connectivity.
version of Wi-Fi known as “WiGiG”, the system was adapted for outdoor use
and a global standard was created - IEEE 802.11ay. The wireless mesh design in Terragraph allows for route diversity
which provides high network availability. If a link goes down (because
of obstruction, interference, a power issue, etc.), the Open/R routing
protocol will automatically find another route through the network to the
destination node. With a higher number of average sectors per node,
the mesh becomes more reliable and can support greater increases in
bandwidth. This way, bandwidth augmentation on the distribution network
can be done seamlessly.
9 | Terragraph Terragraph trial in George Town, Malaysia 10
Attributes of Terragraph
Terragraph is focused on enabling and supporting the ecosystem
of silicon vendors, OEMs, and service providers to build and deploy
the technology to deliver high-speed connectivity. To demonstrate
Terragraph and provide the ecosystem with a proof of concept in
advance of commercial product availability, Facebook has developed
a reference radio design as well as a suite of tools to aid network
design, deployment, and management. Terragraph trials with service
providers are an important step in demonstrating the technology’s value
proposition and allow the ecosystem to learn what it takes to deploy
services over Terragraph. Some key attributes of Terragraph are:
• Uses IPv6
11 | Terragraph Terragraph trial in George Town, Malaysia 12
YTL Communications and Facebook are collaborating as part of the Terragraph radios were brought to Malaysia for extensive technical testing
Telecom Infra Project (TIP). The aim of TIP is to create a new approach at YTL’s technical lab in July 2018.
build technologies that are better, more efficient, and more interoperable. its Technology Center in Kuala Lumpur.
Figure 01 | YTL Communications Technology Figure 02 | Initial Terragraph trial network topology
Center in Kuala Lumpur
The planning was followed by field surveys of streets and poles to verify
YTL Communications trial in the AI based design and check infrastructure prior to deployment.
George Town, Penang
After the successful trial at its lab facility, YTL Communications worked
with Facebook to deploy a Terragraph trial network using the reference
design radios. The UNESCO heritage zone in George Town, Penang, was
selected as the trial location and after thorough planning, engagements
with city and state authorities, the trial was announced in February 2019
and launched on March 1, 2019.
CPE
60GHz
CPE Backhaul
(Client Node + Mesh Network)
MPLS+DWDM+MW
WIFI
CPE
60GHz MPLS+DWDM+MW 10G
Router - Tunnel Termination
CPE Backhaul
(BNG, DHCP) Internet
(Client Node + Mesh Network)
WIFI
10G
CPE
MPLS+DWDM+MW
60GHz Ruckus Wi-fi
CPE Backhaul Controller
(Client Node + Mesh Network)
WIFI
17 | Terragraph Terragraph trial in George Town, Malaysia 18
For layer-2 transport, the Mikrotik APs and CPEs support vendor-specific
implementation of ethernet over IPv6 (EoIPv6). In order to terminate
the layer-2 tunnels at the core, a pair of Mikrotik CCR1036-8G-2S+
demarcation routers were selected. This router model features 8 x 1G
copper connections and 2 SPF+ (10G) making it well suited to connect
Terragraph “fiber point-of-presence” nodes. The Mikrotik APs/CPEs and
routers would book-end the Terragraph IPv6 mesh, effectively making
it transparent to YTL Communications network by making simple L2
circuits. Similarly the Ruckus T300 APs terminate soft GRE L2 tunnels at
the Ruckus Wi-Fi Controller that’s connected behind the
demarcation routers.
19 | Terragraph Terragraph trial in George Town, Malaysia 20
Service Model
Two different service models were deployed in the George Town trial: Public Wi-Fi
Fixed Wireless Access (FWA) and Public Wi-Fi. Similar to Mikrotik CPEs, the Mikrotik Access points serving Public Wi-Fi
access to users establishes pseudowires to the EoIPv6 tunnel terminator
Fixed Wireless Access (Mikrotik demarcation routers in YTL Communications Data Center). The
With point-to-point layer-2 tunnels in place between the BNG Ruckus APs on the other hand, establishes Soft GRE tunnels with the Wi-
(demarcation routers) and subscriber CPEs, the service model is exactly Fi Controller connected behind the demarcation routers.
the same as it would be with any other fixed access solution. Once
connected to the Terragraph network via a client node, the Mikrotik The demarcation router does DHCPv4 allocation and further does NAT44
CPE establishes pseudo-wires to the EoIPv6 tunnel terminator (Mikrotik allowing internet access to Wi-Fi users. User are redirected to a captive
demarcation routers in YTL Communications Data Center). A PPPoE portal login page , where they can login through their social media login
dialer in the CPE establishes connectivity to the BNG (demarcation router) credentials to access the internet.
using pre-configured user credentials, thus enabling internet access. User
profiles with different rate limits are created in the BNG and the CPEs are
provisioned according to the user subscription.
IPv4 path TCP/IP PPPoE/PPP EoIPv6 Tunnel PPPoE/PPP TCP/IP IPv4 path TCP/IP EoIPv6 / Soft GRE L2 Tunnel TCP/IP
v6
Ruckus
CPE PPPoE Tunnel Controller
(Ipv4)
Ethernet
v6 v4/v6 v6 v4/v6
21 | Terragraph Terragraph trial in George Town, Malaysia 22
All in all, YTL Communications used 163 poles in the George Town
heritage area to support:
YTL Communications staff visited businesses in the coverage area end router performing tunnel termination of the CPE devices. Once end
offering a free trial service for fixed wireless access for a duration of 6 to end connectivity was established the connection would be tested for
months. The YTL Communications staff would start by performing a basic throughput and stability, and after successful completion the service
line of sight check from the premise to the existing distribution node (DN) would be handed over to the customer.
network. Businesses whose premise had line of sight and that wished
to participate then signed a trial agreement and a time for installation
was booked. An initial desktop analysis of the location was performed
to determine if any additional DN was required to be installed in order to
connect to the client node (CN) location.
Corporate Social Responsibility Product and Network Improvements During Trial Period
As George Town is a historic city, the YTL Communications team encountered Given the size and length of the trial there were numerous opportunities
a number of issues during the installation process. YTL Communications took to conduct tests, gain learnings and introduce product and network
the opportunity to repair and provide a complete health check of the utilities as improvements, such as:
a corporate social responsibility service to Penang:
• Several Terragraph software version upgrades
• 450 MBPP poles had been remediated to allow for safe and • Feature enhancements including improvements to Automatic
stable supply of electricity Beam Forming, automation of network optimization
• 35 Feeder Pillars remediated to allow continuous power procedures, and network performance statistics and events
supply to aid in troubleshooting
• Physical isolation of electrical phases for existing lamps • Major software bug fixes to increase network stability and
and new Terragraph nodes for all 450 poles improvements to re-routing
• Replacements of faulty underground cables with new There were several changes to the network topology undertaken during the
overhead power cables of up to 3000 meter in length trial period to improve performance, in addition to continuous maintenance
• 150 units of street light poles refreshed with new activities related to power, foliage trimming and equipment replacement.
service boards
We believe the trial in George Town has contributed to evolving the
• 450 new sets of neutral link bars replaced
Terragraph technology, the enhancements made will improve the
• Physical inspection and electrical ‘health check’ for all 450
performance and robustness of the product. During the trial 8 major
units of street light poles
updates to Terragraph software were released which included 48 feature
enhancements and 25 software fixes. Along with this the deployment
guidelines were enhanced to capture what was learned from the trial in
George Town, particularly related to the deployment of CN nodes in
narrow streetscapes.
27 | Terragraph Terragraph trial in George Town, Malaysia 28
Trial Outcomes
YTL Communications has operated the Terragraph network in George
Town for over 6 months providing free public Wi-Fi coverage at 50 locations
and fixed wireless access services to 120 premises. The network consists
of 472 Terragraph nodes connecting 283 locations (163 light poles +
120 customer premises) in a mesh network consisting of 296 links. The
network was deployed in 2.5 months, including remediation of the electrical
connection to the poles to provide 24hr power, deploying the Terragraph
distribution network and then the customer premise equipment.
Figure 09 | Awareness campaign to promote the various
A - Free Public Wi-Fi locations we have installed Public Wi-Fi
As of 1st November, 2019, the public Wi-Fi service has so far provided
connectivity to over 33,000 unique users with a high-quality Wi-Fi
experience, with peak download speeds of up to 190mbps and average
speeds of better than 50Mbps.
B - FWA (Fixed Wireless Access) “YES Team has been very helpful with all support from setting until
troubleshooting. Terragraph has provided consistent speed and reliability
During the trial period fixed wireless access (FWA) users were experiencing
throughout the trial period.”
speeds 10-172 times faster than their previous copper-based connections.
- Pang Jia Woei, Director, Holly Group Sdn Bhd
The number of FWA customers was restricted to 120 for the trial period due
to the use of prototype hardware. However, given the size and density of
“It was easy enough to get started with connecting and setup due do help from
the distribution network many more customers could be served from the the ‘YES’ team. From then on it was just relatively plug and play. Great job ‘YES’
existing footprint. for this opportunity. Hope to see great things from you guys in the future.”
“Thank you for your introducing the option to test YTL network services. We are, “Very Satisfied, will support YTL Terragraph.”
so far , satisfied with the performance of the network, thank you for giving special
- Mr. Neyvinthyran s/o gunasekaran, Director, NS Chulia Enterprise
care during the initial phase. We hope YTL YES will continue to provide consistent
quality service and I will definitely recommend your product for other users in the
area.” “I am Satisfied with YES Terragraph.”
- Lily Aziz, Property Management and Homestay, 95 Armenian Street - Ms Leong, Owner, HY Hai Lean Trading
“We have been using YTL YES Terragraph Market Trial since Apr-2019, and I have “I am Satisfied with YES Terragraph.”
to say that its excellent support. No more complaints about slow internet, internet
- Ong Seng Keat, Owner, Yin and Sourdough Bakery & Cafe
down, can’t do our work.”
“We are satisfy with YES terragraph to manage a higher speed and better stability
Which has speed up our work day and their customer service/supports always so
supportive, passionate and efficient. Good work, THANK YOU x 3000!”
“Representing Loft 29 to appreciate Yes for letting us trying out the Terragraph
that you have installed last few months. It was an amazing experience knowing
that in Heritage area we could have fast speed internet.”
“Am happy to state that the speed of YTL Terragraph is very much better than
what we had and much more stable. Also note that the response time and
rectification is also excellent and hope this is sustained.”
“Very satisfied with our good service and fast respond. Hope continue to use your
service for long term.”
“Very satisfied with YES Terragraph and good feedback from Homestay guests”
Outlook
The trial in George Town is a robust demonstration of Terragraph as a In closing, YTL Communications and Facebook would like to extend
Public Wi-Fi and fixed wireless access solution, delivering high-speed our appreciation to the Ministry of Multimedia and Communication of
Wi-Fi and fiber-like performance to residential customers at a fraction Malaysia, Malaysia Communication and Multimedia Commission, the
of the cost of buried fiber. The trial outcomes support the case for the State Government of Penang along with the City Council of Penang Island
commercial viability of Terragraph, and its potential to make a real impact for the invaluable support to make this large scale market trial a reality.
towards the connectivity goal of Malaysia’s National Fiberization and Their collective contributions to this trial has resulted in the acceleration of
Connectivity Plan. the commercialisation of Terragraph which we hope will benefit cities and
communities globally.
The commercial outlook for widespread Terragraph networks is
strengthening. First, Qualcomm is creating the world’s first Terragraph
chipset family (based on the IEEE 802.11ay standard). Not only Fixed
Wireless Access (FWA) and Wi-Fi transport is provided, but mobile
backhaul to 4G and some 5G architectures is supported on Day 1 and
peak speeds at the physical layer of up to 10 Gbps will be possible.
Second, a large and growing number of commercial Original Equipment
Manufacturers (OEMs) have signed on to manufacture Terragraph
products including: Radwin, Cambium, Siklu, IgniteNet and Mikrotik.
These vendors will have commercial-grade Terragraph products based
on the Qualcomm chipsets giving service providers a choice of standards
based offerings. Third, the growing list of countries de-licensing the
V-Band makes the trajectory look increasingly like the Wi-Fi marketplace:
a growing ecosystem of devices, services and tools for deployment.
39 | Terragraph Terragraph trial in George Town, Malaysia 40
References
1. https://www.cisco.com/c/dam/m/en_us/solutions/service-provider/vni- 11. Wireless Gigabit (WiGig) Market (IEEE 802.11ad, 60 GHz, 7Gbps Wi-Fi,
forecast-highlights/pdf/Asia_Pacific_2021_Forecast_Highlights.pdf Wireless Gigabit Alliance, Access Points, Routers, Residential Gateways,
Backhaul Equipment) - Worldwide Forecasts, Business Models,
2. https://www.nfcp.my/ Technology Roadmap and Analysis (2014 - 2019) available at http://www.
marketsandmarkets.com/PressReleases/wigig.asp.
3. https://telecominfraproject.com/
12. Id.; “EdgeHaul™ Millimeter Wave Small Cell Backhaul System,” available at
4. https://www.yes.my/media-centre/Terragraph http://www.interdigital.com/presentations/edgehaul-millimeter-wave-small-
cell-backhaul-system.
5. https://www.skmm.gov.my/skmmgovmy/media/General/pdf/Class-
Assignment-No-1-of-2017-15112017.pdf 13. Wireless Gigabit (WiGig) Market (IEEE 802.11ad, 60 GHz, 7Gbps Wi-Fi,
Wireless Gigabit Alliance, Access Points, Routers, Residential Gateways,
6. https://mypenang.gov.my/culture-heritage/heritage-zones/ Backhaul Equipment) - Worldwide Forecasts, Business Models,
Technology Roadmap and Analysis (2014 - 2019) available at http://www.
7. See Mario Giovanni Luigi Frecassetti, ETSI White Paper No. 9, E-Band and marketsandmarkets.com/PressReleases/wigig.asp.
V-Band Survey on status of worldwide regulation at 4 (June 2015) available
at https://www.etsi.org/images/files/ETSIWhitePapers/etsi_wp9_e_band_
and_v_band_survey_20150629.pdf; see also Dan Jones, Light Reading,
60 GHz: A Frequency to Watch (July 10, 2014) available at http://www.
lightreading.com/mobile/backhaul/60ghz-a-frequency-to-watch/d/d-
id/709910 (noting investments made in 60 GHz technology driven by WiGig
and wireless backhaul).
10. Id; “EdgeHaul™ Millimeter Wave Small Cell Backhaul System,” available at
http://www.interdigital.com/presentations/edgehaul-millimeter-wave-small-
cell-backhaul-system.