Transcript G64-304-Architecture_High Performance Hyper – Historian

Dave Oravetz
VP of Engineering
Hyper-Historian Key Benefits
Efficient
• High Performance
• High Compression
Reliable
• Redundancy
• Store and Forward
Data Accessibility
• TrendWorX64 Viewer
• SQL Query Interface
Data Editing
Easy to Configure
• Remote Configure-ability
• Web-based
• Online
Flexible, Automated Archiving
Scalable
• Flexible Architecture
European Sales Meeting – December 6, 2007 – Company Confidential
2
Architecture and Configuration
European Sales Meeting – December 6, 2007 – Company Confidential
Hyper-Historian Architecture
Hyper-Historian Components
• Data Collector
• Data Logger
• Workbench Configuration
• 3D Chart Control
• SQL Query Interface
European Sales Meeting – December 6, 2007 – Company Confidential
4
BizViz Solutions
• Reports
• Productivity Analytics
• Enterprise Bridging
• Custom Portals
• Mobile & Wireless
ICONICS Workbench
Third Party
Solutions
Operator Controls
• TrendWorX 2D & 3D Charts
• Manually Entered Data
• Operator Comments
Custom
Applications
Standard
SQL Query
• Configuration
• Archive Management
OPC-UA
Real-time Data Logger
Auto Archiving
Historical
Data Storage
External Storage
System Configuration
& Administration
Real-time
Data
On Event
Disk
Store & . . .
Remote Data Collectors
Forward
• OPC DA
• OPC UA
• OPC XML DA
RAM
SQL 2005
SQL 2008
Configuration
Database
Remote Data Collectors
Forward
Store &
• SNMP
• BACnet
• Databases
European Sales Meeting – December 6, 2007 – Company Confidential
Hyper-Historian Collector
Collects Data From:
• OPC DA Servers
• OPC XML DA Servers
• OPC UA Servers
• GenBroker Plugins
- SNMP
- BACnet
- Databases
Portable
• XP 64-Bit
• Vista 64-Bit
• Server 2003 64-bit
• Server 2008 64-bit
European Sales Meeting – December 6, 2007 – Company Confidential
6
Hyper-Historian Collector
Local or Remote
Deadband Filtering
Advanced Filtering
• Maximum
• Minimum
• Average
• Standard Deviation
• Totalizer
• Running Maximum
• Running Minimum
• Running Average
• Moving Maximum
• Moving Minimum
• Moving Average
• Most Recent On Time
Redundant Collectors
Store and Forward
European Sales Meeting – December 6, 2007 – Company Confidential
7
Hyper-Historian Logger
Logging Options
• High Performance Disk Based
• RAM Memory-Based Persistent
Data
• Raw
• Advanced Filtered
• Aggregates
Data Types
• Boolean
• Integer
• Float
• String
Filtering
• None
• Deadband
• Swinging Door
European Sales Meeting – December 6, 2007 – Company Confidential
8
Hyper-Historian Logger
Conditional Logging
• UDM Trigger Based
Memory Persistent Logging
• Configurable Logging Period
• Option to Log to Disk upon Event
• Configurable Pre and Post Event Store
Aggregate Logging
• Summary Tags for High-speed playback of Summary
Portable
• XP X64
• Vista X64
• Server 2003 X64
• Server 2008 X64
Redundant Loggers
European Sales Meeting – December 6, 2007 – Company Confidential
9
Hyper-Historian Configuration
Online Configuration
Web Based Configuration
• Based on Web Workbench Toolkit
Consistent Look-and-Feel to
TrendWorX64 Configurator
European Sales Meeting – December 6, 2007 – Company Confidential
10
Configuration Demo
European Sales Meeting – December 6, 2007 – Company Confidential
Performance and Runtime
European Sales Meeting – December 6, 2007 – Company Confidential
Hyper-Historian Performance
50,000+ Values Logged per Second
150,000+ Tags
Collection Resolution to 10 MS
Immediate playback of Logged data
• No wait for Database writes
European Sales Meeting – December 6, 2007 – Company Confidential
13
GENESIS Historian Benchmarks
Twx32
1,000 Tags @ 1 s
4% (34)
Twx64
HH Beta4
5%
1.8%
10,000 Tags @ 1 s
34.5%
42%
22%
25,000 Tags @ 1 s
n.a
49%
46%
50,000 Tags @ 1 s
n.a.
n.a
68%
AMD Athlon 64 X2 Dual Core, 2.86 GHz
8 GB Memory
Windows Vista64 Business SP1
European Sales Meeting – December 6, 2007 – Company Confidential
GENESIS Historian Benchmarks
Twx32
Twx64
HH Beta4
1,000 Tags @ 1 s
217 MB
140 MB
133 MB
10,000 Tags @ 1 s
690 MB
1460 MB
857 MB
25,000 Tags @ 1 s
n.a.
7300 MB
1480 MB
50,000 Tags @ 1 s
n.a.
n.a
2630 MB
AMD Athlon 64 X2 Dual Core, 2.86 GHz
8 GB Memory
Windows Vista64 Business SP1
European Sales Meeting – December 6, 2007 – Company Confidential
HH Logging Performance
Hyper
Historian
Sample
Benchmark
Results (Beta5)
Tags
Rate
Perf.
10,000
200 ms
29%
25,000
500 ms
56%
50,000
1s
60%
100,000
10 s
8%
150,000
10 s
10%
European Sales Meeting – December 6, 2007 – Company Confidential
Data Compression
Deadband Filter
Swinging Door Algorithm
“Advanced” Filtering
Small Data “Footprint”
Low overhead Binary file store
Aggregate Tags
European Sales Meeting – December 6, 2007 – Company Confidential
17
Swinging Door Efficiency
102 Raw Values (per cycle)
Deadband filter: 31% (32 values)
Swinging Door filter: 12% (12 values)
Aggressive Deadband filter: 12% (12 values)
European Sales Meeting – December 6, 2007 – Company Confidential
Deadband Filter Limitations
1
2
3
4
17
18
19
20
21
16
5
15
6
14
7
8
9
10
11
12
Deadband Filter
► Stores unneeded samples (6, 7, 15, 16)
► Misses inflection samples (4, 13)
13
Swinging Door
► Higher Compression
► Better accuracy
European Sales Meeting – December 6, 2007 – Company Confidential
Data Footprint
TrendWorX32 / TrendWorX64
• ~28 Bytes / 32-bit Float
• 100 Tags @ 1s for 1 day  ~300 Mbytes
Hyper Historian
• ~7 Bytes / 32-bit Float
• 100 Tags @ 1s for 1 day  ~70 Mbytes
European Sales Meeting – December 6, 2007 – Company Confidential
Compression & Runtime Demo
European Sales Meeting – December 6, 2007 – Company Confidential
Operation and Application
European Sales Meeting – December 6, 2007 – Company Confidential
Hyper-Historian Trend Viewer
3D Charting Capabilities
• Real-time And Historical Trend Data.
Rotate to Change Perspective
Out-of-the-box Chart Categories
Plug-in New Chart Types
Combine Charts for Analysis
23
Hyper-Historian Trend Viewer
Summary View
Paging (Fwd & Back)
Zoom
24
Hyper-Historian SQL Query
Look and Feel of SQL Server
Various Output formats
Select, Insert, Update, Delete Support
European Sales Meeting – December 6, 2007 – Company Confidential
25
Hyper-Historian SQL Query
Advanced Data Query Support
• Time-in-State
Useful
when
the
Usefulwhen
whenthetag
Useful
tag
• Best Fit
signbooleanal
is
alwaysis increments
aisRate
a
noisy
• Time-Weighted Average
• Integral
• Slope
• Counter
European Sales Meeting – December 6, 2007 – Company Confidential
26
Hyper-Historian Data Editing
API to Edit Logged Data
• Edited data is Marked
• Original data is kept
HDA Playback Options
• Original data only
• Original data with edited data
• Combination – showing both
GUI for Manual Edits
API for bulk edits
European Sales Meeting – December 6, 2007 – Company Confidential
27
Other Hyper-Historian Features
Integrated into MonitorWorX
TraceWorX Support
GenEvents Support
European Sales Meeting – December 6, 2007 – Company Confidential
28
Hyper-Historian File Archiving
Advanced file maintenance and
Archiving
• Control of Disk Space Use
• Backup of Data
• Easy Re-attachment of Backup
Archiving Based on
• UDM Trigger
• File Size
• Age of Data
European Sales Meeting – December 6, 2007 – Company Confidential
29
Operation and Application Demo
European Sales Meeting – December 6, 2007 – Company Confidential
TrendWorX64 vs Hyper-Historian
TrendWorX64 Logger
Hyper-Historian Logger
Based on TrendWorX32 Design
New Design – From Ground Up
SQL, Oracle, or MySQL database
Proprietary Database
25,000+ values / second
50,000+ Values / Second
50,000+ Tags
150,000+ Tags
Deadband Filter
Deadband & Swinging Door Filters
~28 Bytes / Logged 32-bit Float
~7 Bytes / Logged 32-bit Float
Centralized Logger
Distributed Architecture
Limited SQL Query Support
Strong SQL Query Support
…
Conditional Logging
…
Event-Based Logging
…
Data Editing / Data Insert
…
Aggregate Value Logging
Non Redundant
Redundancy / Store and Forward
European Sales Meeting – December 6, 2007 – Company Confidential
Hyper-Historian
Questions ?
European Sales Meeting – December 6, 2007 – Company Confidential
32
Future Goals – V10.5
HDA Server / GENESIS32 Integration
32-bit Collector
Standalone Installation for Collector
Redundancy & Store and Forward
Data Insert Grid
Data Insert Utility
Swinging Door at Collector
Optimizations (>100,000 values/sec)
MS Cluster Aware
European Sales Meeting – December 6, 2007 – Company Confidential
33
Future Goals – Part II
Twx32 Configuration Import
SQL Query Interface Extensions
• Quality Filter
SQL Server Logger
Dynamic Calculations
Ability to monitor health via SNMP
Data Collection from more sources
• OPC AE
Support for more tags (>500,000)
European Sales Meeting – December 6, 2007 – Company Confidential
34