Transcript Big Data: Reality and Challenges - Mazin S. Al

Data
Dr. Mazin Al-Hakeem (Nov 2016), “Big Data: Reality and Challenges”, LFU – Erbil
Big
Data
What is the problem ?
BD’s Definition
BD Concepts (3V’s – 4V’s)
BD Technologies
BD Applications
BD Analysis Process (2 Cases)
BD’s Privacy Issue
Big
is
a
term
for
data
sets
that
are
so
Data
large or complex that traditional data
processing applications are
inadequate to deal with them.
Challenges include analysis, capture, search,
share, storage, transfer, visualization,
querying, updating and information privacy.
Since the dawn of time and up until 2003 has produced
(5 billion gigabytes) of data.
Eric Schmidt, Google's CEO
twitter.com/ericschmidt
In addition to that, 90%
of the present data was
produced in the last
2 years only.
?
8 Zettabyte / Day
Thousand Billion Billion
3.27 Billion Users
8 Zettabyte / Day
8 Zettabyte / Day
NYSE 1 Terabytes / Trade Process
Facebook 50 Billion Photo / Day
LinkedIn 1 Billion Suggestion / Month
Information Growth
GDP
Big Turning Point
Doug Cutting
twitter.com/cutting
Big Data
S/ UnS / SemiS
Collect from
Diverse Sources
Velocity
3 V’s
Speed
Access and Analyze
Volume
Terabytes
Storage
4 V’s
IBM
> 1 Trillion $ / Year
for distributed storage and
processing of very large data
sets.
It consists of computer
clusters built from hardware.
- MapReduce
- Hbase
- Hive
- Zookeeper
:
:
:
The areas of health care, manufacturing management,
traffic management, and many other fields.
Market Behavior
The question is, is this good or bad?
What is about the privacy?
I don't know, I really don't know
Business Wits
Big Data
Big
Data
&