Transcript Slides from Mike Stonebraker

Stream Applications
By
Michael Stonebraker
Adjunct Professor, MIT
1
Purpose
Are
we whistling Dixie
 Anything
that can’t be done by a
conventional app server and a DBMS
Reality
check on functionality
 Anybody
need QoS?
M.I.T.
2
Who
Me
Dennis
Ted
Shasha
Johnson
M.I.T.
3
Categorization
“The
real time enterprise”
 No
sensors
Current
sensor apps
 There
Future
currently exists an interested user
sensor apps
 Wishful
thinking
M.I.T.
4
Traditional View of the World
Transactions
Operational
system
Actions
Bulk data
Periodic
data
movement
mover
Data
mining
Data
Warehouse
Operational
system
Bulk data
mover
M.I.T.
5
The Traditional View
Oriented
toward identifying “pearls of wisdom”
that will change strategic long-term business
practices
Not
toward tactical (real time) business
analysis and tuning
To
do that, you need real time stream coming
out of operational system
M.I.T.
6
Examples
Schwab
 Has
a system to compute the
commission on each trade in real time
 300K
of rule-based code (home brew)
 No
aggregates; presumably legacy
DBMS lookup
M.I.T.
7
Examples
Fidelity
 Trades
originate in lots of systems
 Get
executed in several system
 Has
a system to route trades in real time
 Complains
it is too slow (not quite sure
why)
 Wants
prioritization of trades
M.I.T.
8
Current Sensor-based Applications
US
military (Mitre)
 Batallion
monitoring
 “20
queries” on web site
 Mix
of history and CQ
 Some
queries are pretty hard (tell me
when 3 of my 4 tanks cross the front
line)
M.I.T.
9
Current Sensor-based Applications
US
military (Mitre)
 QoS
crucial (drop everything to work
on incoming missile)
 Main
bottleneck – network bandwidth
 But
military apps are not politically
correct
M.I.T.
10
Current Sensor-based Applications
Environment
 Fish
 To
monitoring
pills
monitor mercury level in water
 Whistling
Dixie
M.I.T.
11
Future Sensor-based Applications –
electronic property stickers
MIT
library
 Mis-shelved
 And
books
stolen books
 Whistling
Dixie
M.I.T.
12
Future Sensor-based Applications –
electronic property stickers
MIL/LCS
 Lost
projectors
 Stolen
laptops
 Whistling
Dixie
M.I.T.
13
Future Sensor-based Applications –
supply chain management
Gilette
 Bought
10m “dimes”
 Presumably
to put on retail bundles
 For
theft?
 For
supply chain replenishment
 May
be whistling Dixie
M.I.T.
14