Transcript Peter_Myers_20150304_BigDataAnalyticswithExcelx

Big Data Analytics with Excel
Peter Myers
Bitwise Solutions
[email protected]
http://www.linkedin.com/in/peterjsmyers
Cheap Storage
Inexpensive Computing
(Continued)
“Big data is a collection of data sets so large
and complex that it becomes awkward to work
with using on-hand database management
tools. Difficulties include capture, storage,
search, sharing, analysis, and visualization.”
– Wikipedia
(Continued)
VOLUME
(Size)
VARIETY
(Structure)
VELOCITY
(Speed)
(Continued)
Petabytes
Click stream
Wikis/blogs
Sensors
RFID
Devices
Social sentiment
Big Data
Audio/video
Terabytes
Log files
Spatial and
GPS coordinates
Data market feeds
Gigabytes
eGov feeds
Weather
Megabytes
Text/image
Data Complexity: Variety and Velocity
Responding to New Questions
How do I better predict
future outcomes?
What’s the social
sentiment of my product?
How do I optimize my
services based on patterns
of weather, traffic, etc.?
Comparison to Traditional RDBMS
TRADITIONAL RDBMS
Data Size
Access
Updates
Structure
Integrity
Scaling
DBA Ratio
HADOOP
+
(Continued)
How it Works: 1 – Data Storage
Demo
Storing Files in Azure Blob Storage
How it Works: 2 – Take the Processing to the Data
RUNTIME
Server
Server
Server
Server
Legend
Red = Core Hadoop
Blue = Data processing
Green = Packages
Distributed Processing
(MapReduce)
Distributed Storage
(HDFS)
Purple = Microsoft
integration points and
value adds
Orange = Data
Movement
Demo
Word Count with Pig
(The “Hello World” for Hadoop)
Data
Hadoop
Analytics
Demo
Self-Service BI with Hive
Benefits
Considerations
http://www.microsoft.com/en-us/server-cloud/solutions/big-data.aspx
http://azure.microsoft.com/en-us/documentation/services/hdinsight/
http://hortonworks.com/tutorials
Explore Everything PASS Has to Offer
Free SQL Server and BI Web Events
Free 1-day Training Events
Regional Event
This is Community
Business Analytics Training
Local User Groups Around
the World
Session Recordings
PASS Newsletter
Free Online Technical Training