Unleashing The Power of Data With Iot and Augmented Reality
Unleashing The Power of Data With Iot and Augmented Reality
Unleashing The Power of Data With Iot and Augmented Reality
To quickly kick off a virtuous cycle of cost savings, revenue This is where AR comes in. IoT devices capture data from
increases, and higher profits that can prompt a double- the physical world so that it can be analyzed, and AR
digit increase in top and bottom lines, companies should devices take that digital data and render it back on the
develop a joint IoT-AR strategy, rather than think about physical world for people to view and interact with. (See
these technologies piecemeal. This report includes a down- the sidebar “The Sweet Spots for IoT-AR Solutions.”)
loadable IoT-AR app that illustrates how companies can
capture these benefits. Unlike virtual reality applications, which require the user to
inhabit a virtual environment, AR applications overlay
digital information on top of the user’s physical environ-
Why AR Goes Hand in Hand with IoT ment. For example, an AR application could add digital
content to live camera feeds, making the content appear
Almost unnoticed, the number of IoT-connected devices as if it is part of the physical world. That capability would
rose from about 6 billion in 2016 to 11 billion by 2018, allow users to interact with data more intuitively.
possibly reaching 20 billion in 2020, according to Gartner.
That increase has resulted in a veritable Big Bang of data. Several companies have developed AR applications that
Cisco Systems and IDC estimated the volume of IoT- use artificial intelligence to distill vast amounts and vari-
generated data to be about 22 zettabytes (or 22 trillion ous types of data (including IoT data) into a few critical
gigabytes) in 2016. That volume more than doubled to actions, which are then presented to employees at the
52 zettabytes by 2019, and it is projected to reach 85 zetta- right time and place so that they can make informed deci-
bytes by 2021. sions and better execute tasks. In many industries, compa-
nies that aren’t experimenting with joint IoT-AR strategies
However, data volumes are rising so quickly that many cor- risk being left behind by rivals.
porations are unable to use all the data they collect. Huge
volumes result in slow processing times, and as a result, the
data becomes stuck in data lakes. Moreover, the data sets
lack a coherent sequence, and the databases have too many
sources to synthesize. Consequently, many companies are
finding it difficult to generate data-based insights that em-
ployees can use at the right time and in the right place.
IoT-AR solutions are most useful in business situations IoT-AR applications are also very helpful when the aggrega-
where employees (rather than automated systems) make tion of large volumes and various kinds of contextual data in
some or all of the decisions and where workers need digi- a single view would facilitate decision making, when employ-
tal data to more effectively interact with physical objects, ees need both hands to effectively interact with objects or
such as machines and spaces. their environments in real time, and when employees need
to interact with objects or parts that are not visible.
• Digital aviation
• Health care training • Personal health care assistance
Enhance human
capabilities 13% 9% 15%
• Functional space design and • Space and environment • Order picking
optimization (for warehouses, monitoring • Spatial optimization (for order
stores, and cities) • Farm monitoring packing and shipment
• Consumer navigation • Buildings and facilities organization, for example)
• Location-based digital inspection
marketing • Hospital rounds optimization
• Inventory monitoring
Manage spaces
• Safety and hazard response
20% 4% 3%
• Product design • Asset quality assurance • Assembly work instruction
• Construction design • Operations monitoring • Asset installation
• Equipment monitoring and • Maintenance instruction and
diagnostics guidance
• Quality control • Operator instruction (for
• Production line optimization precision processes and large
Manage equipment industrial equipment)
or objects
3% 22% 12%
IoT-AR use cases that help employees take action, 15% application could help companies train plant employees to
enhance human capabilities. assemble equipment or use machinery. Similarly, hospitals
could use these solutions to train health care technicians.
These three ways build on each other: To diagnose a prob-
lem, employees must visualize data and interact with their • Managing Spaces. IoT and AR technologies can help
environments. And to take action, they need to diagnose companies make sense of disaggregated data collected
the problem. from physical spaces, such as factories, warehouses, and
retail stores. Understanding disaggregated data is critical
IoT and AR technologies also impact business in three to better managing functional areas. For example, an
areas: IoT-AR application could help a company optimize the
use of a warehouse by determining the amount of space
• Enhancing Human Capabilities. Companies can use to allocate to high-turnover products, monitoring inven-
IoT-AR solutions to help employees learn how to perform tory health, and identifying aging stock to move out. The
complex tasks more easily. For example, by simulating application could also use IoT data and AR devices to
products and overlaying IoT data on them, an IoT-AR guide workers through the warehouse using the most
• Managing Equipment. Companies can help employ- When designing equipment, companies can feed IoT
ees fine-tune complex equipment and make repairs by data into digital models and use AR to interact with
creating an AR application that superimposes IoT data those models at scale, giving designers a dramatically
on a visual representation of a machine’s components. more accurate representation of how a design will per-
Such a representation enables workers to “look” inside form in the real world. For instance, the representation
the machine at even hard-to-see areas so that they can may help designers locate the most commonly used
diagnose issues more easily. AR enables the application features so as to improve the design and performance of
to overlay step-by-step instructions on the image as well the machine. Similarly, remote IoT devices—such as
as display real-time guidance from remotely located ex- cameras and temperature sensors that are installed in
perts while workers are making a repair. In some cases, and around structures—enable data collection that can
the next repair instruction may be provided to a techni- help companies create digital twins. When such virtual
Respondents that manage IoT Respondents that expected a Respondents that have
and AR together; 77% of those payback from IoT-AR investments already demonstrated the
have dedicated AR budgets within three years value of using IoT and AR
2
Unplanned downtime delays
the project and increases costs.
Additional time is lost waiting
1 for repair parts to arrive.
The company is unaware that
the excavator needs service
until it breaks down, which
causes unexpected downtime.
5
During a repair, errors are
made deciphering complex
manuals and the quality of the
repair is not confirmed or
documented.
3
Time is wasted when an
incorrect diagnosis requires
experts to travel to the site to
accurately troubleshoot the
problem.
4
Experienced workers are
leaving the workforce. As a
result, significant time is lost
training new hires on complex
tasks.
reduces the need for experts to travel, each specialist • New Offerings. Developing novel, value-added IoT-AR
can respond to more service calls. services and capabilities increases the opportunities for
manufacturers to generate revenue from existing cus-
• Decrease in Material Waste and Rework. AR-based tomers. Such services and capabilities also help build
instructions, together with IoT verification, can ensure companies’ brand equity.
that repairs are completed the first time, eliminating the
need for rework and the reordering of parts. To show how a solution that pairs IoT with AR can lower
costs and boost revenues, we developed a case study using
• Lower Costs. IoT-AR training solutions reduce labor real-world data. In our study, a manufacturer with annual
costs by enabling less capable engineers to conduct after-sales service revenue of $1 billion, or 30% of its annu-
repairs. These applications also lower training costs by al revenue, employs 1,000 service engineers.
providing on-the-job training on demand.
By deploying an IoT-AR solution with 20% to 30% of its
• Lower Churn. IoT-AR solutions can increase how quickly service engineers, we found that the manufacturer has the
companies respond to customers and improve service potential to generate $13 million to $30 million of net
quality. In turn, companies can increase their renewal benefit for every $1 billion of revenue. We have often seen
rate of lucrative after-sales service contracts and win companies achieve results toward the higher end of this
new opportunities. range. (See Exhibit 2.)
Increase in labor Addressable labor cost: Decrease in labor costs $7 million–$11 million 0.7–1.1
productivity 1.5–2.0 from faster operations:
45–55
Costs
Decrease in the cost Training costs: Decline in training costs: $1 million–$2 million 0.1–0.2
of workforce training 0.5–0.6 20–30
Drop in rework costs Cost of repeat visits: Improvement in the $2 million–$4 million 0.2–0.4
0.6–0.8 first-time fix rate: 30–50
Revenue
Increase in revenue
Addressable service Increase in service
from less churn $6 million–$18 million 0.6–1.8
revenue: 6.0–9.0 revenue: 10–20
and new services
1.2
Per $1 billion $16 million– $3 million– $13 million–
of revenue $35 million $5 million $30 million
Incremental Cost of Net
benefit implementation benefit
1 Predictive
monitoring
2 Scheduled service
and parts delivery
3 Data-driven
diagnosis
An IoT-AR solution
superimposes
step-by-step instructions
on the equipment,
enabling guided repair
and immersive,
on-the-job training.
10 UNLEASHING THE POWER OF DATA WITH IoT AND AUGMENTED REALITY
AR IOT
According to our calculations, the upside potential could be time and reduce the number of employees that are
even larger if the company rolls out the solution to all its needed to perform order-picking activities.
service engineers. The benefits would also extend beyond
the manufacturer, providing significant cost savings for its • Reduced Waste. AR-guided instructions reduce the
customers in terms of lower asset downtimes and higher chance of goods getting damaged, saving insurance
asset performance. costs and material waste.
To be sure, companies could use other options instead of • Faster Throughput. Improved operating speeds en-
an IoT-AR solution. An alternative would be to match engi- abled by IoT-AR solutions ease traditional bottlenecks.
neers’ skills to the right tasks, thereby reducing errors and
increasing the first-time fix rate. A pure human solution is • Lower Risk. AR-guided navigation improves safety and
likely to cost less, but it won’t provide all the benefits that reduces accidents, making working conditions in ware-
an IoT-AR solution can deliver. For instance, the former houses better.
won’t reduce the travel that experts undertake, provide
training benefits, or help new technicians get up to speed • Burnished Brands. IoT location tracking enables
faster. companies to track the location of products, especially
high-value products, at all times. Providing higher-touch
To bring the case study to life, BCG and PTC developed services that are supported by faster processing speeds
IoT+AR, an app that enables users to experience an equip- can unlock new business opportunities and enhance cor-
ment maintenance solution in 3D. The app can be down- porate reputations.
loaded for iOS and Android devices. The app puts users in
the shoes of a technician to experience how IoT and AR This case study focuses on a logistics company that man-
can guide them at every step of an excavator repair. ages the transportation of large volumes of products. It
works on tight timelines and has several warehouses all
Shrinking Warehouse Costs Using IoT and AR. The over the world. Most product picking is done manually by
second case study we developed focused on order picking. the company’s workforce of about 90,000 employees.
In mammoth warehouses, selecting products for shipment
or delivery is a slow process because workers need to According to our estimates, a company of this kind with
navigate vast spaces. In most cases, a product’s location is $20 billion in revenue would spend about $3 billion in
noted only at the entrance and exit, so it’s difficult for order-picking labor costs a year. With an initial IoT-AR
workers in the warehouse to know exactly where products deployment covering one-third of the workforce, the com-
are. Employees spend a lot of time searching for products, pany could generate a net benefit of $3.5 million to $7 mil-
taking suboptimal routes to find what they’re looking for. lion a year per $1 billion of revenue. Those benefits would
Moreover, lifting bulky products while holding a clipboard only rise over time as the solution rolls out across the rest
or a checklist often leads to accidents and damaged goods, of the workforce. (See Exhibit 3.)
as does performing a job without clear instructions.
An IoT-AR solution is not the only way to tackle order-
An IoT-AR solution can increase the speed of order-picking picking and package-sorting issues in warehouses, of
operations and boost productivity. Several companies course. Another option may be to use robots. Although
(such as DHL, Intel, and Boeing) have deployed IoT sensors generally more expensive, robots can work well in indus-
throughout their warehouses, and head-mounted AR devic- tries with large warehouses, small homogenous products,
es guide workers to products’ locations by superimposing and higher margins. Companies should experiment with
instructions on users’ fields of vision. These solutions help different solutions to identify the technologies that will
employees take the shortest routes to the exact locations work best for them.
of products. When workers find the products, their headset
camera scans them and checks them off the list, freeing BCG and PTC’s IoT+AR app brings this to life. It enables
the employees to handle the products. users to experience product picking using IoT and AR. The
app can be downloaded for iOS and Android devices. The
Companies can benefit from IoT-AR warehouse solutions in app puts users in the shoes of a warehouse employee to see
several ways: how IoT and AR can help employees find products quickly
and safely.
• Higher Labor Productivity. IoT-AR applications that
provide the optimum route through the warehouse save
3
Products are sorted and
scanned manually.
4
1 Workers perform their jobs with
The location and status of a unclear instructions, increasing
product is available only at scan the risk of accidents.
points.
2
Workers navigate the warehouse
using their judgment and paper
pick lists, slowing the order-
fulfillment process.
5
Employees use their judgment
to load trucks, resulting in an
inefficient use of space.
Exhibit 3 - Using an IoT-AR Order-Picking Solution to Increase Productivity
Can Benefit the Bottom Line
Incremental benefits
Increase in labor Picking labor costs: Decrease in labor costs: $3 million–$6 million 0.3–0.6
Costs productivity ~20.0 1.5–3.0
Decrease in material Material waste: Drop in damaged goods: $500,000–$1 million 0.05–0.1
waste 0.5–1.0 10.0
Revenue
Rise in core Improvement in revenue: $1 million–$3 million 0.1–0.3
business output 0.1–0.3
Using IoT and AR in Health Care ally switch their focus among several sources of informa-
tion, including video screens, biosignal monitors, the at-
IoT-AR solutions aren’t only about increasing revenue or tending surgical team, and, of course, the patient.
reducing costs; they can deliver societal benefits as well. For
example, using the two technologies together may prove to By contrast, an IoT-AR solution would enable a surgeon
be a game-changer in health care applications. Specifically, wearing an AR headset to see a 3D model from diagnostic
minimally invasive surgeries account for about 35% of all imaging that is superimposed on the patient; the model
medical procedures. During such a surgery, a doctor makes would be aligned with the patient’s anatomy with the help
a small incision in the patient’s body and inserts tiny cam- of high-precision positional trackers placed on and inside
eras and miniature instruments so as to navigate the pa- the patient. The surgeon could rotate, zoom in and out,
tient’s body without having to make large cuts and incisions. and interact with the 3D model using simple hand ges-
tures. The patient’s vitals and other biosignals, as well as
Although the techniques of keyhole surgery, as it is often instructions (such as the best angle and depth for a cut),
called, have been honed over the past 20 years, surgeons could be overlaid in the surgeon’s view, eliminating the
still face several challenges. They cannot get all the in- need to switch among the various factors that require
sights needed solely from the 2D video streams provided attention. And the surgeon would be able to control the
by the inserted cameras. Moreover, surgeons must continu- entire procedure through hand gestures, voice controls,
MOVING MACHINERY
4
WARNING
C
2
D
5
LOADING
ZONE
1 2 3 4 5
Accessible Optimized Hands-free Improved Efficient
product data warehouse navigation inventory scanning safety and accuracy use of space
The location and status of An IoT-AR solution Workers' AR headsets An IoT-AR solution An IoT-AR solution
products with sensors are instructs workers how scan the product, ensuring superimposes relevant delivers optimized loading
available to workers using to efficiently navigate a that the correct items are data on products, instructions via the
an IoT-AR solution and warehouse to locate the picked and that the increasing safety and workers' AR headsets.
across the value chain. products on their pick inventory is updated. speed.
lists.
14 UNLEASHING THE POWER OF DATA WITH IoT AND AUGMENTED REALITY
and eye movements—without pressing buttons or looking Organization Structure and Partnerships. Cross-
away from the patient for even a second. functional collaboration across traditional business units is
critical for success. Companies must get stakeholders from
For surgeons and patients, there would be enormous all relevant groups—not only the core business units but
benefits. Doctors would be able to perform surgeries with also IT and R&D—to back the IoT-AR experiments. As we
fewer errors and achieve higher first-time success rates. mentioned earlier, of the companies we surveyed, 85%
Patients would thus enjoy faster recovery times and a already manage the development and deployment of IoT
lower risk of complications. Several clinical trials are under and AR together.
way globally, and if they receive approval, IoT-AR surgical
solutions could deliver enormous benefits to society. Because the development of an IoT-AR solution must be a
business-level initiative, obtaining executive sponsorship is
important. Having that backing from the start can ensure
Getting IoT and AR Right that these projects gain momentum quickly. Companies
must be careful about choosing technology vendors, part-
IoT-AR solutions are at an inflection point, but they are likely ners, and systems integrators for the IoT-AR ecosystem;
to become table stakes soon in several industries. Compa- they must have the ability to support the redesign of oper-
nies must choose the right starting points—the largest cost ational processes as well as the implementation of techno-
centers and revenue opportunities—and identify where logical solutions.
IoT-AR applications will have the highest value. It’s critical to
scale such applications as quickly as possible across the Development and Launch. Companies must optimize
enterprise not only to reap the financial benefits but also to the user experience and ensure that IoT-AR devices are
ensure that the cultural change that is necessary for the comfortable and intuitive in the physical environments in
new approach to succeed has time to take root. Although which they will be used. Getting that right can drive adop-
companies will face challenges, it’s possible to successfully tion faster and ensure that employees routinely use the
harness these complex technologies. (See the sidebar technologies. The best way to optimize the user experience
“Managing the Risks of Deploying IoT-AR Solutions.”) is to encourage IoT-AR teams to develop minimum viable
products, run pilots, conduct end-user tests, and iterate
Scope and Value. Companies should rank projects by the solutions quickly.
largest value opportunities, choosing to develop and deploy
one or two IoT-AR applications that will deliver value—fast.
Companies must develop business cases and articulate the
value proposition of using the two technologies together.
C ombining IoT and AR technologies enhances the ways
that people can interact with the world around them.
But to harness that power, companies must choose where
to deploy the technologies, build an ecosystem that sup-
The use of IoT technology is increasingly prevalent, so it’s ports IoT and AR, and develop the talent that can use both
important to ensure that AR has a value-adding role; AR technologies. Companies that do so will be able to not only
shouldn’t be an afterthought or a gimmick. Our survey reduce costs, boost revenues, improve the customer experi-
suggests that employees are five times more likely to ence, and strengthen brands but also use contextual data
regard AR as a core technology if their company develops in ways never before imagined.
an IoT-AR application from the start, rather than adding AR
later.
Several challenges could derail an IoT-AR initiative after it partner with external technology providers even as they
gets underway. It’s therefore important to keep them in internally develop the skill set that is required.
mind from the outset. The major risks fall into the follow-
ing categories: • Data. IoT-AR solutions are only as good as the quality
of the data that companies use. Getting access to the
• Cost. Both IoT and AR systems can be relatively expen- data, and combining it in a meaningful way, can be
sive to develop and deploy depending upon the choices challenging. Companies would do well to build a digital
made during those stages. Companies should carefully thread—a communications framework that enables the
assess the choices in order to meet their return-on- flow of data—so as to link interrelated data across all
investment target. Using smartphones and tablets as processes, products, and applications.
AR devices can be cost-effective; our survey shows that
standard smartphones are the most popular endpoint • Devices. Each AR solution should be designed with a
device. device type in mind to ensure a good user experience.
AR head-mounted devices can be bulky, have limited
• Talent. Developing IoT-AR solutions is usually beyond fields of vision, and be uncomfortable to use for long
the expertise of most IT departments. Moreover, it periods. Although the technology is improving quickly,
requires people who understand both physical machines companies should learn to work with today’s limitations
and digital technologies. Globally, the pool of talent with and develop an AR strategy that is compatible with
the right expertise is small. Most companies will have to many devices.
16 UNLEASHING THE POWER OF DATA WITH IoT AND AUGMENTED REALITY
• Connectivity and Security. Creating a smooth AR • Speed. IoT and AR are emerging technologies, so rolling
experience with live IoT data requires high connection out solutions can take longer than expected. Some appli-
speeds and low latency. That can be challenging in cations, such as those that guide machine or medical in-
remote areas and underground locations, so companies teractions, will require certifications, regulatory approvals,
must factor in those conditions when developing applica- and even the creation of standards. These steps can add
tions. Over time, 5G networks may resolve those issues. to the time needed to deploy IoT and AR technologies.
Even so, managing AR devices, in addition to IoT devices,
raises the number of assets connected to the IoT-AR sys- • Flexibility. Companies should develop IoT-AR solutions
tem, increasing the potential for security vulnerabilities. that can be deployed with a variety of partners to avoid
Companies should involve security experts in the design getting locked into specific technology providers. It must
and development of IoT-AR solutions to minimize cyber be possible to have the IoT solution hosted by any exter-
risks. nal cloud service provider or a cloud server on site.
18 UNLEASHING THE POWER OF DATA WITH IoT AND AUGMENTED REALITY
About the Authors
Zia Yusuf is a managing director and senior partner in the Vladimir Lukic is a managing director and partner in
Silicon Valley office of Boston Consulting Group. He leads BCG’s Boston office. You may contact him by email at
the firm’s work in the Internet of Things. You may contact [email protected].
him by email at [email protected].
James Heppelmann is the president and CEO of PTC. Craig Melrose is PTC’s executive vice president of digital
You may contact him by email at [email protected]. transformation solutions. You may contact him by email at
[email protected].
Neeru Ravi is a consultant in BCG’s San Francisco office. Usama Gill is a principal in BCG’s San Francisco office.
You may contact her by email at [email protected]. You may contact him by email at [email protected].
The authors thank PTC’s Grace Fong for the analysis she If you would like to discuss this report, please contact one
provided, as well as Charles Lamour, Randy Goux, Taryl of the authors.
Hafer, and Brian Siu for developing the IoT-AR app that
accompanies this report. The authors also express their
appreciation to Ashley Drewery and Jason Kwok, BCG
colleagues, and Dmitry Shchepochkin, formerly a BCG
consultant, for helping to conduct the research for this
report. Finally, the authors thank Anand P. Raman for his
writing assistance as well as Katherine Andrews, Kim
Friedman, Abby Garland, Frank Müller-Pierstorff, Shannon
Nardi, and Trudy Neuhaus for their editing, design, and
production contributions.
20 UNLEASHING THE POWER OF DATA WITH IoT AND AUGMENTED REALITY
Add Co-Sponsor
logo here
Boston Consulting Group partners with leaders Uciam volora ditatur? Axim voloreribus moluptati
in business and society to tackle their most autet hario qui a nust faciis reperro vitatia
important challenges and capture their greatest dipsandelia sit laborum, quassitio. Itas volutem
opportunities. BCG was the pioneer in business es nulles ut faccus perchiliati doluptatur. Estiunt.
strategy when it was founded in 1963. Today, we Et eium inum et dolum et et eos ex eum harchic
help clients with total transformation—inspiring teceserrum natem in ra nis quia disimi, omnia
complex change, enabling organizations to grow, veror molorer ionsed quia ese veliquiatius
building competitive advantage, and driving sundae poreium et et illesci atibeatur aut que
bottom-line impact. consequia autas sum fugit qui aut excepudit,
omnia voloratur? Explige ndeliaectur magnam,
To succeed, organizations must blend digital and que expedignist ex et voluptaquam, offici bernam
human capabilities. Our diverse, global teams atqui dem vel ius nus.
bring deep industry and functional expertise
and a range of perspectives to spark change. Nem faccaborest hillamendia doluptae
BCG delivers solutions through leading-edge conseruptate inim volesequid molum quam,
management consulting along with technology conseque consedipit hillabo. Imaio evelenditium
and design, corporate and digital ventures— haribus, con reictur autemost, vendam am ellania
and business purpose. We work in a uniquely estrundem corepuda derrore mporrumquat.
collaborative model across the firm and
throughout all levels of the client organization,
generating results that allow our clients to thrive.
To find the latest BCG content and register to receive e-alerts on this topic or others, please visit bcg.com.
Follow Boston Consulting Group on Facebook and Twitter.