Transcript Database Data Integration

Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
<Insert Picture Here>
Database Data Integration
Overview and Strategy
Jean-Pierre Dijcks
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Agenda
• Joint positioning
• Roadmap
• Current status
• Strategy Validation
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Joint Positioning
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Important Messages for Customers
Do not undercut each other!
• Do not introduce doubt into customer’s mind
• This is bad for Oracle
• This is bad for your customers
• No matter which product the customer chooses, their investment in
Oracle solutions is SAFE
• Both products are supported for many years to come
• Oracle invests in both products
• Oracle currently delivers two products in the data integration market
with converging roadmaps
• Both products are developed in cooperation, not in competition
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
General Positioning
What should I offer?
• If the main database platform in the deal is Oracle then
you should exclusively offer OWB.
• For competitive advantage position the tool which
strengthens your overall business case – keep the tool
roadmap in mind!
• There will sometimes be gray areas – this is expected –
use your judgement about the customer’s real long-term
needs
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Roadmap
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Strategic Direction
Information Integration for the Agile Business
From
To
Standalone Tool
Pervasive Service
Batch ETL / ELT
Right Time Delivery
Oracle Centric
Passive Data Quality
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Heterogeneous
Active Data Quality
Convergence
Pervasive information management services
Pervasive Service
Standalone Tool
Goal
Achieved by
Create one pervasive data management service
for database users

• One Repository
 Embed the repository in the Oracle database
• One User Interface
 Leverage Oracle’s IDE
 Create a single tool for all database development and
design with one repository

• One Install with the database
 Install all required components at database install time
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Transform and Deliver
Transform any data and deliver through data services
Batch ETL / ELT
Batch ETL / ELT
Goal
Right Time Delivery
Achieved by
Deliver data through SOA to the right users at
the right time in a heterogeneous
environment
11.2
• Enable heterogeneous data transformations and
processes for an SOA architecture
 Allow publishing of any process to a web service
 Support deployment of web services on non-Oracle
platforms

• Full spectrum of data integration patterns





Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
ETL/ELT
Data Federation (EII)
Data Replication
Message based integration (EAI)
Change Data Capture
Access
Heterogeneous data integration
Heterogeneous
Oracle Centric
Goal
Achieved by
Deliver heterogeneous information integration
to Oracle database customers
• High performance native read and write to and
 Native data access using Knowledge Modules (KM)
 Allow creation / import / maintenance of KMs
 Data virtualization using Database Gateways
11.2
• Heterogeneous Change Data Capture
 Native change data capture using KMs
 Partnerships (Golden Gate, Attunity, DataDirect)
11.2
• Generate and maintain BI tool metadata on any
 Derive and maintain Oracle BI EE metadata from any
11.2
from any platform
platform
data object in OWB
 Exchange metadata with any BI tool
 Deliver attribute level lineage and impact analysis from
source to report with any BI tool
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Governance
Active data quality in the database tier
Passive Data Quality
Goal
Active Data Quality
Achieved by
Make data quality smart and apply it to specific
applications via the database tier

• Active data quality
 Active auditing and monitoring solutions
 Data quality fire walls
• Applied data quality
 Deliver pre-built content for specific domains
 Verticals (Retail, banking, telco etc.)
 Horizontals (MDM for customer, product
etc.)

• Smart data quality




• Integrated data quality
 Single repository for DQ, ETL and data modeling
 Auto-generate data corrections
 Validate data rules
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Self learning data quality engine
Auto-tuning of algorithms and algorithm extensibility
Leverage Oracle Data Mining for data quality
Deterministic and probabilistic algorithms
Enterprise Information Management
Comprehensive Development/Integration Platform for Oracle Database
Mission Critical Applications
Unified Database Development IDE
Packaged
Applications
Master Data
Management
Business
Intelligence
Content
Management
Data
Movement
Data
Governance
Data
Warehousing
Data
Migration
Rel. Data Modeler
Dim. Data Modeler
SQL Worksheet
PL/SQL Debugger
Data Flow Designer
Proc Flow Designer
Data Profiler
Data Auditor
Dependency Analyzer
Metadata Browser
SOA Deployment in Heterogeneous Environments
Integration Service
Transformation Service
Data Quality Service
Metadata Service
Integration Service Foundation
Data Integration
Data Quality and Profiling
Database Core Services
Consolidation (ETL)
Change data capture
Data Profiling
Data Auditing
Data Dictionary
PL/SQL
Federation (Gateway)
Archive/Restore (ILM)
Matching/Merging
Data Rules
SQL Engine
OLAP Engine
Replication (Streams)
Real time
Standardization
Intelligent Clustering
Data Mining
RAC / Grid
Unified Metadata
Extensible
Common Models
Lineage/Impact
Change Management
Metadata Exchange
Data Connectivity
Relational Databases
Non-Relational DBs
Various File Formats
XML Data
Packaged Applications
Standard Msg Formats
Message Queues
Semi-Structured Data
Oracle or 3rd Party: Applications | Analytics | Identity | SOA Platforms | Data Grid | Content Management | Search
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
1313
Current status
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Database as Integration Platform
• Best-of-breed Data Integration
• Comprehensive: Complete integration and data quality solution
• Integrated: One install, one user interface, one repository
• Competitive: Extreme scalability, best-in-class security, best-of-breed functionality
• Integrated with Oracle Database 11g
•
•
•
•
•
•
With every Oracle Database install
With every Oracle Optimized Warehouse
With Oracle Real Application Clusters
With Oracle OLAP and Oracle Data Mining
With Oracle XML DB and Oracle Spatial
With Oracle Database Gateways
• Pre-Integrated with Middleware & Applications
• With Oracle BI including BI Standard Edition, BI Standard Edition One and BI Enterprise Edition
• With Oracle Master Data Management (UCM, CDH, PIM)
• With Oracle PeopleSoft and Oracle Siebel
• With Oracle E-Business suite including Spend Analyzer, Balanced Score Card, Fusion Migration
etc.
• With Oracle Data Integrator
• With Oracle Fusion Middleware including BPEL PM
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
15
Release Roadmap
• Oracle 11g
• Convergent – integrated data quality / ETL / metadata
• Pervasive – integrated with every database install
• Oracle 11g Release 2
• Access – high-performance heterogeneous read and write
• Deliver – full web service enablement
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Oracle 11g
Convergent and Pervasive
OWB 11g Features
OWB 11g Delivers
• OWB integrated in Database Install
• One repository for Oracle Database
• Out-of-the-box data integration service
• Applied data quality for Oracle MDM
• Data Profiling and Data rules
• Full featured DP component
• Detect, define and validate data rules
• Quality aware ETL (match/merge etc)
• Fully generate correction logic from rules
• Data Modeling
• Declarative rich object metadata
• Data model aware ETL
• Schema correction based on profiling
• SDK and Experts for automating and embedding
OWB
OWB 11g Major New Certifications
• Oracle 11g DB
• Oracle 11g Gateways
• Siebel CRM Connector
Benefits
 Single unified install delivers a complete environment
for Oracle customers
 Secure metadata store with maximum flexibility
 Pre-packaged data governance for a better MDM
solution
 Convergence delivers better information to end users
 Convergence increases developer productivity
 Convergence simplifies ETL
 Simplified ETL reduces errors
 Convergence increases developer productivity
 Highest productivity
 Simple to embed in any application
 Best for Oracle
 Better connectivity to non-Oracle and enhanced
federation
 Best for Siebel Integration
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Oracle 11g Release 2
Access and Deliver
OWB 11g R2 Features
Projects
• Full heterogeneous support, incorporate all ODI
functionality into OWB
• Import, create and manage all KMs
• Import ODI Interfaces
• OC4J agent infrastructure
Benefits
 Industry leading heterogeneous data access
 High performance
 Leverage existing ODI components already developed
• Heterogeneous web service support
 Full SOA enablement across platforms
• Combine best optimized for Oracle with Native
 Best for both worlds
• Out-of-box integration with Oracle BI
 Easiest to maintain metadata
 End-to-end metadata and change propagation (source
heterogeneous capabilities
to report)
Integration
• Change to Oracle Fusion Client Platform
 Single user interface across Oracle tools
• Componentization of architecture
 Share components across products to reduce
developer cost
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Database
Creating, loading and maintaining Oracle OLAP structures
• Full design support for complex OLAP
objects
• Life-cycle support for managing OLAP
objects
• Transparent loading of OLAP using
standard OWB constructs
• Flexibility in loading strategies
Data
(incremental / replace)
Sources
• End-to-end lineage
Reporting capabilities for
Oracle OLAP
Siebel
CRM
Oracle
EBS
Load and Build
Load Data
Oracle
OLAP
Data Transformations
using OWB ETL
Other
Sources
Enable
Summary
Management
Create ETL
SAP/R
3
M
es
sa
g
e
Q
u
e
u
es
Import Metadata
PeopleSoft
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
OWB
Repository
Create Objects
Relational Star
Applications
Leveraging applied OWB profiling and correction rules for MDM
Data
Sources
Siebel
CRM
Oracle
EBS
Validation with pre-built rules
Connector
OWB Repository
Connector
CDH
Rules
Connector
SAP/R
3
Connector
Target
Oracle Master Data
Management
CDH
Interface
PIM
Rules
Connector
UCM
Rules
Corrected and
validated data
ready for MDM
master
PeopleSoft
Connector
UCM
Interface
Connector
Other
M
Sources
es
sa
g
e
Q
u
e
u
es
OWB In-Database Processing
PIM
Interface
Validate Rules
Correct Data
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
MDM
Base
Tables
Fusion Applications
Simplified Migration ETL architecture
Fusion Database (B)
Source Database (A)
Staging (A’)
Finalize
Custom
Source Tables
Source Tables
Fusion Tables
CDC
OWB
Redo Logs
Incremental
Replication
Source Change Logs
Upgrade Mappings
Fusion Services
MDS
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
IDM
Security
DM
AMX
Fusion Middleware
Integrating with OBI SE/EE
Data
Sources
Oracle
Warehouse Builder
Oracle BI EE
Siebel
CRM
Data
Data
Data
Warehouse
Oracle
EBS
Other
Sources
Dashboards
OBIEE
Enterprise
Semantic Layer
(RPD)
ETL
Data Objects
Data Quality
SAP/R
3
Metadata
Database
Repository
BI EE
Server
Distribute
Metadata
PeopleSoft
OBI SE
End User Layer
Ad-Hoc Reports
Lineage & Impact
Change Propagation
Runtime Statistics
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
22
Fusion Middleware
Integrating with Oracle Data Integrator
ODI
OWB
ODI UI
Design ODI
Interfaces and KMs
ODI
Repository
OWB UI
Import any interface
from ODI repository
OWB
Repository
Maps
Interfaces
KMs
KMs
Import any KM
from ODI
Execute any ODI interface
J2EE
Agents
Execute on any platform
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Verify
interfa
ce
Add
OWB
Xforms
Deploy
map to
J2EE
Start
map
Verify
ODI
KM
Apply
KM to
Map
Deploy
map to
J2EE
Start
map
Strategy Validation
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Strategy Validation
Internal Use Only
• > 250,000 database customers
• > 10,000 OWB customers
Cumulative downloads
60,000
50,000
Downloads
40,000
30,000
20,000
10,000
0
Q1-07
Q2-07
Q3-07
Q4-07
Fisacl Quarter
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE
Q1-08
Q2-08
Oracle Proprietary and Confidential – DO NOT DISTRIBUTE