Prepared by Richa Btech (Cse) 6 Sem Dav University Jalandhar

BIG DATA
Prepared By richa
Btech (cse) 6th sem
Dav university
jalandhar
Content
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
Introduction
Objectives
What is Big Data
History of Big data
Problems with big data
What is hadoop
Hadoop components
Functions of hadoop
Hadoop ecosystem
IBM defination of big data
Sources of big data
Storing big data
Structure of big data
Why big data?
Application of big data
Benefits
HAVE YOU EVER

TRIED TO OPEN 0.5
GB OF FILES ON
YOUR MACHINE?
Introduction
Big Data may well be the Next Big

Thing in the IT world.
Big data burst upon the scene in the first

decade of the 21st century.
Like many new information

technologies, big data can bring about
dramatic cost reductions, substantial
improvements in the time required to
perform a computing task, or new
product and service offerings.
OBJECTIVES
Describe Big Data

List out the limitations on existing
solution
Define Hadoop and its components
Describe how Hadoop solves the
limitation of existing solution.
What is BIG DATA?
Big Data is similar to small data, but bigger in

size
but having data bigger it requires different

approaches:
Techniques, tools and architecture
an aim to solve new problems or old problems in a

better way
Big Data generates value from the storage and

processing of very large quantities of digital
information that cannot be analyzed with
traditional computing techniques.
History of Big Data
In 2002 Google was facing the same problem how

to save these huge files , then Google went to
fundamental it uses the concept of distributed
files system and tries to save data on distributed
files system.
Problems faced by Google :
Google have to do it manually earliar so it needs
the framework or mechanism to save such files
automatically.
Solution found by Google:
It wrote white paper which is further implemented
by Deug cutting.
Limitations of existing system
DATA WAREHOUSING:
Fixed schema of RDBMS
Cost
Difficulty in saving and accessing
huge files.
Difficulty in performing analytics.
PROBLEMS WITH BIG

DATA?
Minimum size of big data file start

with atleast 1 Terabyte.
We have to face many problems in
terms of opening that big file that is
how HADOOP TECNOLOGY comes
into picture.
What is Hadoop?
Hadoop is combination of distributed

file system and analytics algothirm
Saves the big data files in less time.
HADOOP consists :
Underline Distributed File

System
Analytics Algorithm
Hadoop component
Function of Hadoop:
As we know BIG DATA is terabyte of file
so
Hadoop helps us to:
Save the huge files in

distributed file system.
2. Do analytics by mapreduce
algorithm by google.
1.
Hadoop Ecosystem
IBM defination of BIG DATA:
It depends on three parameter:

Volume
Velocity
variety
Three Characteristics of Big Data V3s
Volume
Velocity
Variety
Data
quantity
Data
Speed
Data
Types
Sources of big data
Walmart handles more than 1 million customer

transactions every hour.
Facebook handles 40 billion photos from its user

base.
Decoding the human genome originally took 10years
to process; now it can be achieved in one week.
Big Data sources

Users
Application
Systems
Sensors
Large and growing

files
(Big data files)
The Structure of Big

Data
Structured
Most traditional
data sources
Semi-structured
Many sources of
big data
Unstructured
Video data, audio
data
19
Storing Big Data

Analyzing
your data
characteristics
Selecting data sources for analysis

Eliminating redundant data
Establishing the role of mySQL
Overview
of Big Data stores

Data models: key value, graph,
document, column-family
Hadoop Distributed File System
Why Big Data
Growth of Big Data is needed

Increase of storage capacities
Increase of processing power
Availability of data(different data types)
Every day we create 2.5 quintillion bytes of data; 90%
of the data in the world today has been created in

the last two years alone
Why Big Data
FB generates 10TB daily
Twitter generates 7TB of data

aily
BM claims 90% of todays

stored data was generated
n just the last two years.
Why Big Data
Growth of Big Data is needed

Increase of storage capacities
Increase of processing power
Availability of data(different data types)
Every day we create 2.5 quintillion bytes of data; 90%
of the data in the world today has been created in

the last two years alone
Data generation points Examples

Mobile Devices
Microphones
Readers/Scanners
Science facilities
Programs/ Software
Social Media
Cameras
Big Data Analytics
Examining large amount of data
Appropriate information
Identification of hidden patterns, unknown correlations
Competitive advantage
Better business decisions: strategic and operational
Effective marketing, customer satisfaction, increased

revenue
Types of tools used in

Big-Data
Where processing is hosted?

Distributed Servers / Cloud (e.g. Amazon EC2)
Where data is stored?

Distributed Storage (e.g. Amazon S3)
What is the programming model?

Distributed Processing (e.g. MapReduce)
How data is stored & indexed?

High-performance schema-free databases (e.g.
MongoDB)
What operations are performed on data?

Analytic / Semantic Processing
A Application Of Big Data
analytics
Smarter
Healthcar
e
Homeland
Security
Traffic
Control
Manufacturin
g
Multichannel
sales
Telecom
Trading
Analytics
Search
Quality
Benefits of Big Data

Real-time big data isnt just a process for
storing petabytes or exabytes of data in a data
warehouse, Its about the ability to make better
decisions and take meaningful actions at the
right time.
Fast forward to the present and technologies
like Hadoop give you the scale and flexibility to
store data before you know how you are going
to process it.
Technologies such as MapReduce,Hive and
Impala enable you to run queries without
References
www.Slideshare.com
www.wikipedia.com
www.computereducation.org
Thank You.

Prepared by Richa Btech (Cse) 6 Sem Dav University Jalandhar

Uploaded by

Copyright:

Available Formats

Prepared by Richa Btech (Cse) 6 Sem Dav University Jalandhar

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Prepared by Richa Btech (Cse) 6 Sem Dav University Jalandhar

Uploaded by

Copyright:

Available Formats

BIG DATA

HAVE YOU EVER

Big Data may well be the Next Big

Big data burst upon the scene in the first

Like many new information

Describe Big Data

What is BIG DATA?

Big Data is similar to small data, but bigger in

but having data bigger it requires different

an aim to solve new problems or old problems in a

Big Data generates value from the storage and

History of Big Data

In 2002 Google was facing the same problem how

Limitations of existing system

PROBLEMS WITH BIG

Minimum size of big data file start

Hadoop is combination of distributed

Underline Distributed File

Save the huge files in

IBM defination of BIG DATA:

It depends on three parameter:

Three Characteristics of Big Data V3s

Sources of big data

Walmart handles more than 1 million customer

Facebook handles 40 billion photos from its user

Big Data sources

Large and growing

The Structure of Big

Video data, audio

Storing Big Data

Selecting data sources for analysis

of Big Data stores

Why Big Data

Growth of Big Data is needed

of the data in the world today has been created in

Why Big Data

FB generates 10TB daily

Twitter generates 7TB of data

BM claims 90% of todays

Why Big Data

Growth of Big Data is needed

of the data in the world today has been created in

Data generation points Examples

Big Data Analytics

Examining large amount of data

Identification of hidden patterns, unknown correlations

Better business decisions: strategic and operational

Effective marketing, customer satisfaction, increased

Types of tools used in

Where processing is hosted?

Where data is stored?

What is the programming model?

How data is stored & indexed?

What operations are performed on data?

A Application Of Big Data

Benefits of Big Data

You might also like