Understanding Big Data
Understanding Big Data
Understanding Big Data
Telkom University
Telkom University
COURSE OBJECTIVE
1. Understand conceptual, framework, opportunity and challenge of
Big Data
2. Understand concept, theory, framework from Data Analytics
activities
3. Able to choose and perform Data Analytics activities based on the
contextual business problem
4. Able to build description model and prediction model using
available data
Telkom University
o Introduction, Background & Definitions
o Data Driven Decision Making
o Big Data Properties
o Big Data Complexity
OUTLINE o Big Data Framework and State of the Art
o Big Data for Business
o Case Study
Telkom University
Telkom University
Background
o We are generating huge amounts of data (from UGC to mobile habit)
o Our society is leaving behind a digital footprint (so our behavior /
attitudes)
o Finding unexpected pattern is so exciting (also useful for predictive
analytics)
o The need to find the usage of Large Scale of Data Warehouse
(internal data)
Telkom University
Definition
Telkom University
o Big Data : It is a term for data sets that are so large or complex that
traditional data processing tools are inadequate to process. The
challenges include analysis, capture, data curation, search, sharing,
storage, transfer, visualization, querying, updating and information
privacy (wikipedia)
o Data Analytics : It is the science of examining raw data with the
purpose of drawing conclusions about that information. Data
Analytics is used in may industries to allow companies and
organization to make better business decisions and in the sciences
to verify or disprove existing models or theories (wikipedia)
Telkom University
Definition
o Social Computing: It is an area of computer science that is concerned
with the intersection of social behavior and computational systems.
It is based on creating or recreating social conventions and social
contexts through the use software and technology (wikipedia)
o Data Science : It is interdisciplinary field about processes and system
to extract knowledge or insight from data in various forms, either
structured or unstructured. This field is continuation of some the
data analysis field such as statistics, data mining, and predictive
analytics(wikipedia)
Telkom University
Telkom University
Big Data
Telkom University
Properties
Telkom University
Big Data
Complexity
Telkom University
Big Data
Analytics
Constructor
Telkom University
Big Data Approach
Framework
Some people prefer 3Vs,
6Vs or 7Vs even 12Vs to
explain big data. But the
original “bigness”
measurement metrics
are volume, velocity,
and variety.
For example 7Vs:
1. Volume
2. Velocity
3. Variety
4. Variability
5. Veracity
6. Visualitazion
7. Value
Big Data
Telkom University
State of
The Art
The.Jungle.Book.2016.720p.BluRay.x264-[YTS.AG].mp4
Telkom University
Big Data
for
Business
Telkom University
Big Data • Given a set of transactions, find rules that will predict the occurrence of an
item based on the occurrences of other items in the transaction
for
Business Market-Basket transactions
Example of Association Rules
TID Items
{Diaper} {Beer},
1 Bread, Milk {Milk, Bread} {Eggs,Coke},
2 Bread, Diaper, Beer, Eggs {Beer, Bread} {Milk},
3 Milk, Diaper, Beer, Coke
4 Bread, Milk, Diaper, Beer Implication means co-occurrence,
5 Bread, Milk, Diaper, Coke not causality!
Example Data
Telkom University
Science Model
Construction
Telkom University
Business
Telkom University
Intelligence Vs
Data Science
Telkom University
A week ahead of the storm’s landfall, Linda M. Dillman, Wal-Mart’s chief information officer, pressed her staff
to come up with forecasts based on what had happened when Hurricane Charley struck several weeks
earlier. Backed by the trillions of bytes’ worth of shopper history that is stored in Wal-Mart’s data warehouse,
she felt that the company could ‘start predicting what’s going to happen, instead of waiting for it to happen,’
as she put it. (Hays, 2004)”
Telkom University
Case Study : Customer Voice (Telco)
Telkomsel XL
Telkom University
Research Roadmap
Telkom University
To wrap up, Why Big Data Analytics Matters
1. NEW DATA
Example: eCommerce capturing clickstream
2. UNLOCKING VALUE
Example: Sentiment analysis from social networkds
3. SHAPING THE FUTURE
Example: modelling the future, anticipating & incluencing
Assignment
Telkom University