Transcript INNOV-03 Real Time Division Products

Progress Real Time
Products Overview
Pat Bonser
Progress Real Time Products
Agenda




Simplify your business



2
The Progress Real Time Division
Event Stream Processing (ESP)
Progress® Event Stream Processing
Progress Event Engine™
Progress RFID™
Progress ObjectStore® Enterprise
Progress ObjectStore PSE Pro
© 2005 Progress Software Corporation
Progress Real Time Products
Progress Real Time Division
Simplify your business
The Progress Real Time Division is a global
provider of products that enable the real-time
enterprise. We deliver technologies that
monitor and analyze real-time event stream data
and accelerate the performance of existing
applications. Our leading object database helps
companies manage complex data, and our data
caching and replication products support
occasionally connected users that require realtime access to enterprise applications.
Real World. Real Time.
3
© 2005 Progress Software Corporation
Progress Real Time Products
What’s "Real Time Enterprise” ?
Simplify your business
"The Real Time Enterprise monitors, captures and
analyzes root-cause and overt events that are
critical to its success the instant those events
occur, to identify new opportunities, avoid mishaps
and minimize delays in core business processes.
The RTE will then exploit that information to
progressively remove delays in the management
and execution of its critical business processes."
K. McGee, Gartner Inc., 25 Mar 04
4
© 2005 Progress Software Corporation
Progress Real Time Products
Progress Real Time Products
Agenda




Simplify your business



5
The Progress Real Time Division
Event Stream Processing (ESP)
Progress Event Stream Processing
Progress Event Engine
Progress RFID
Progress ObjectStore Enterprise
Progress ObjectStore PSE Pro
© 2005 Progress Software Corporation
Progress Real Time Products
But,
Simplify your business
What is an Event?
6
© 2005 Progress Software Corporation
Progress Real Time Products
What is an Event?

Chunk of data whose arrival means something has
happened
– May or may not be significant
Simplify your business

Characteristics
–
–
–
–

Relatively “small”, regular structure
Often multiple sources
Receiver does not need to reply to sender
High arrival rates (usually)
Rapid response important
– Detect, determine threat or opportunity
– Act while decision still matters
7
© 2005 Progress Software Corporation
Progress Real Time Products
Event Processing Example
IF WMT price moves > 2% 15-DAY WMT-VWAP
FOLLOWED-BY
S&P500 moves > 0.5%
AND
Simplify your business
TGT price moves < 2%
WITHIN 30 seconds
ACTION SELL WMT
8
© 2005 Progress Software Corporation
SELL
WMT
Progress Real Time Products
Can Traditional
Data Management Techniques Be Used?
Simplify your business
Store events in RDBMS, use SQL queries
9
© 2005 Progress Software Corporation
Progress Real Time Products
Can Traditional
Data Management Techniques Be Used?
Store events in RDBMS, use SQL queries
query
query
query
query
query
query
query
query
query
query
query
query
query
query
query
Simplify your business
event queries
events
10
database
© 2005 Progress Software Corporation
Progress Real Time Products
Can Traditional
Data Management Techniques Be Used?
Store events in RDBMS, use SQL queries
query
query
query
query
query
query
query
query
query
query
query
query
query
query
query
Simplify your business
event queries
events
3,000,000
per minute
11
database
terabytes
© 2005 Progress Software Corporation
1,200 traders
1,000 patterns of interest
Progress Real Time Products
Can Traditional
Data Management Techniques Be Used?
Store events in RDBMS, use SQL queries
query
query
query
query
query
query
query
query
query
query
query
query
query
query
query
Simplify your business
event queries
events
3,000,000
per minute
12
database
terabytes
© 2005 Progress Software Corporation
1,200 traders
1,000 patterns of interest
Progress Real Time Products
What Can We Do ?

Don’t store the events first
– Keep them in memory as they arrive, until no
longer needed

Bring the events to the queries
– Be clever about which events go to which
queries
Simplify your business

Process queries continuously
– Long running, state in memory

13
Do it very fast!
© 2005 Progress Software Corporation
Progress Real Time Products
That’s Event Stream Processing
Definition
Simplify your business
“To continuously analyze, evaluate,
and take action on streaming event
data in real time”
14
© 2005 Progress Software Corporation
Progress Real Time Products
Progress Real Time Products
Agenda




Simplify your business



15
The Progress Real Time Division
Event Stream Processing (ESP)
Progress Event Stream Processing
Progress Event Engine
Progress RFID
Progress ObjectStore Enterprise
Progress ObjectStore PSE Pro
© 2005 Progress Software Corporation
Progress Real Time Products
Progress Event Processing System
Progress Apama
Event Manager
Simplify your business
Enterprise
Middleware
Raw,
streaming
events
16
Progress Apama
Event Modeler
Existing
Enterprise
Applications
Event distribution,
analysis
and storage
© 2005 Progress Software Corporation
Business
applications
Progress Real Time Products
High-Level View
Event Modeler
Scenario
Manager
Auto Generated
Dashboards
Simplify your business
Event
Manager
Integration Adapter
Framework
17
© 2005 Progress Software Corporation
Progress Real Time Products
The Progress ESP Stack
Progress Apama Event Modeler
Development
Tools
Progress Apama Event Processing Language
Progress Apama Event Manager
Adapter
Simplify your business
Sonic™
ObjectStore
Event DB
18
© 2005 Progress Software Corporation
EdgeXtend™
Management
Progress Apama Dashboard Generation
Visualization
Processing
Integration
Data management
Progress Real Time Products
Progress Real Time Products
Agenda




The Progress Real Time Division
Event Stream Processing (ESP)
Progress Event Stream Processing
Progress Event Engine
Simplify your business
– Data Management Software for Events



19
Progress RFID
Progress ObjectStore Enterprise
Progress ObjectStore PSE Pro
© 2005 Progress Software Corporation
Progress Real Time Products
Progress Event Engine
Data Flow
Event Data
Feed
client client client
1. Collect
store
Convert external
events to PSEE
events
Service
3. Query
Event Cache
sort/merge
Persistent Storage
Simplify your business
disk
query
disk
2. Organize
Structures data
for fast retrieval
20
© 2005 Progress Software Corporation
disk
disk
Progress Real Time Products
Progress Event Engine
Why PSEE?
High Performance, Scalable

Collection Engine
– Store tens of thousands events per second
– 20 TB+ database size
– Index data is ~1% of database size
Simplify your business

Query Engine
– High Performance
– Pipelined Architecture
– Extensible Functionality

Simultaneous Query and Collection
– Writes do not block reads!
21
© 2005 Progress Software Corporation
Progress Real Time Products
Progress Real Time Products
Agenda




Simplify your business

The Progress Real Time Division
Event Stream Processing (ESP)
Progress Event Stream Processing
Progress Event Engine
Progress RFID
– Software for Acquiring and Managing RFID Data


22
Progress ObjectStore Enterprise
Progress ObjectStore PSE Pro
© 2005 Progress Software Corporation
Progress Real Time Products
Architecture for RFID Event Capture
RFID Application Layer
OpenEdge Application
OpenEdge RFID Library
WebServices / Sonic
RFID Event Layer
Simplify your business
ALE
Readers
Progress RFID
Sensors
Event
Repository
23
© 2005 Progress Software Corporation
Progress Real Time Products
RFID Event Flow
Event History
(RFID-A)
RFID Events
Simplify your business
RFID
Reader
Middleware
(ALE)
RFID
Reader
Query
Query
RFID Events
24
Event History
© 2005 Progress Software Corporation
OpenEdge
Application
Progress Real Time Products
Progress Real Time Products
Agenda




Simplify your business


The Progress Real Time Division
Event Stream Processing (ESP)
Progress Event Stream Processing
Progress Event Engine
Progress RFID
Progress ObjectStore Enterprise
– Software for Managing Stored Objects

25
Progress ObjectStore PSE Pro
© 2005 Progress Software Corporation
Progress Real Time Products
But,
Simplify your business
What is an Object?
26
© 2005 Progress Software Corporation
Progress Real Time Products
What is an Object ?
A way to encapsulate information and its behaviour

Data
– Some number of data members
– Owned by an object instance
– Each instance has own data members

Code
Simplify your business
– Methods (small programs) that operate on the
data
– Associated with a set of objects of the same
type (class)
– One copy of the code
27
© 2005 Progress Software Corporation
Progress Real Time Products
Progress ObjectStore Enterprise
Object Data Management System (ODBMS)


Proven technology for reliable, high-performance data
management and caching support for your C++, Java,
and .Net applications
Benefits
– Flexible Programming Model

Lets data flow seamlessly between memory and database
Simplify your business
– Distributed Transactional Caching

Maintains data in-memory across all instances,
guaranteeing data consistency
– Enterprise Database Services

28
Including clustering, online backup,
replication, high availability and more
© 2005 Progress Software Corporation
Progress Real Time Products
The ObjectStore Data Model
CFA moves cached data
forward to the client
Changes in one cache
propagated to the other
Memory
mapped cache
Cache-Forward™
Architecture
Cache deletions propagated to
other caches
CFA moves cached data
forward to the client
Memory
mapped cache
ObjectStore
Server
Simplify your business
Referential integrity
maintained automatically
Memory
mapped cache
Application/Web Servers
29
© 2005 Progress Software Corporation
Clients
Progress Real Time Products
Changes in one cache
propagated to the other
Memory
mapped cache
Cache-Forward™
Architecture
CFA moves cached data
forward to the client
Cache deletions propagated
to other caches
Memory
mapped cache
ObjectStore
Server
Simplify your business
Referential integrity
maintained automatically
Memory
mapped cache
Application/Web Servers
30
© 2005 Progress Software Corporation
Clients
Progress Real Time Products
Ordnance
Survey,UK
This revolutionary
database digitally
references not just
every building & field,
but detail as fine as
railway signal lights
& free-standing letter
boxes.
Marketplace
Simplify your business
Used & new from $16.00
32
© 2005 Progress Software Corporation
Progress Real Time Products
Progress Real Time Products
Agenda




Simplify your business



The Progress Real Time Division
Event Stream Processing (ESP)
Progress Apama
Progress Event Engine
Progress RFID Accelerator
Progress ObjectStore Enterprise
Progress ObjectStore PSE Pro
– Embedded Software for Managing Stored Objects
34
© 2005 Progress Software Corporation
Progress Real Time Products
Progress ObjectStore PSE Pro
Embedded Object Persistence



Small-footprint version of ObjectStore ODBMS
Perfect for single-user applications and
embedded devices
Benefits
Simplify your business
– Applications can scale from PSE Pro to
ObjectStore using the same API’s
– Low memory requirement and good
performance
– Transactional storage for reliability
35
© 2005 Progress Software Corporation
Progress Real Time Products
Comes in Two Flavors
Process


PSE Pro C++
PSE Pro Java
Application
In-memory objects
Simplify your business
PSE Pro Library
Stored Objects
36
© 2005 Progress Software Corporation
Progress Real Time Products
PSE Pro Example Uses…

Embedded in
Simplify your business
–
–
–
–
–
–
–
37
Sun’s Jini/Java Spaces
Intel CAD applications
Medical Devices
Copiers
Fathom
SonicMQ
etc.
© 2005 Progress Software Corporation
Progress Real Time Products
Progress Real Time Products
In Summary

Use Progress Event Stream Processing
and Progress Event Engine for ESP

Use Progress RFID and OpenEdge RFID
Library for capturing RFID events
Simplify your business
– Includes ObjectStore database

38
Use Progress ObjectStore PSE Pro Java
on small devices that communicate with
OpenEdge applications
© 2005 Progress Software Corporation
Progress Real Time Products
Questions?




Simplify your business



The Progress Real Time Division
Event Stream Processing (ESP)
Progress Apama
Progress Event Engine
Progress RFID Accelerator
Progress ObjectStore Enterprise
Progress ObjectStore PSE Pro
www.progress.com/realtime
39
© 2005 Progress Software Corporation
Progress Real Time Products
Additional Information
www.progress.com/exchange/2005/technical_sessions

INNOV 13:
Introduction to Event Stream Processing and Apama

INNOV 10:
Progress Event Engine Overview
Simplify your business

INNOV 06:
RFID Enabling Your OpenEdge Application

INNOV 08:
Integrating RFID Technology with Progress-based Solutions
40
© 2005 Progress Software Corporation
Progress Real Time Products