Oracle Warehouse Builder
Download
Report
Transcript Oracle Warehouse Builder
<Insert Picture Here>
<Insert Picture Here>
Oracle Warehouse Builder
Product Update
Michelle Bird
Senior Product Manager, Oracle Warehouse Builder
May 20, 2009
Agenda
• An abbreviated history
• OWB 11.2 beta overview
• Oracle’s roadmap for ETL
• Unifying the ODI and OWB products
• New OWB pricing
• How to join the beta program
3
The following is intended to outline our general
product direction. It is intended for information
purposes only, and may not be incorporated into any
contract. It is not a commitment to deliver any
material, code, or functionality, and should not be
relied upon in making purchasing decisions.
The development, release, and timing of any
features or functionality described for Oracle’s
products remains at the sole discretion of Oracle.
4
Agenda
• An abbreviated history
• OWB 11.2 beta overview
• Oracle’s roadmap for ETL
• Pricing and Packaging
• How to join the beta program
5
Oracle Warehouse Builder
The ETL and DQ tool shipped with Oracle Database
• Oracle Database as transformation engine
• Oracle Database as metadata repository
Oracle Database 11g
Oracle Warehouse Builder 11.1
Heterogeneous
In-line
Data
Integration
Data
Quality
Smart
Data
Modeling
for Oracle
Unified
Unified Metadata
Metadata
6
What can OWB do for you?
Leverage Oracle like no one else
• Improved productivity over hand coding
• easy to change your environment
• use the latest features without rewriting your code
• Leverage your Oracle investments like no one else
• skills, people and technology
• better performance than anyone else
• Shorten your project times while improving data quality
• discover problems up-front with data profiling
• improve data quality in a declarative way
OWB HOME PAGE
http://www.oracle.com/technology/products/warehouse/index.html
7
Product Highlights
An abbreviated history of OWB
Features licensed with Oracle Database
Most new features = priced option(s)
2000
2003
2004
2006
2007
Release 2.0.4
Release 9.2
Release 10.1
Release 10.2
Release 11.1
Basic ETL
functionality
Oracle RAC certified
Oracle 10g certified
Data profiling &
auditing
Server components
installed w/ Oracle
DB
Mapping Editor
Set and row based
code generation
Mapping Debugger
Interactive LIA
Name & Address
Match/Merge
3,000+ companies
Release 9.0.4
Compete against
Informatica and
Ascential
Metadata Security
Process Flow Editor
Scripting Language
Recognized as a
leader in Gartner
Magic Quadrant
Scheduling
Connector to Oracle
MDM
Improved connector
for SAP R/3
10,000+ companies
EBS and PeopleSoft
connectors
OLAP and relational
modeling
Multi-table insert
Pluggable mappings
Pivot and Unpivot
Non-Oracle targets
Recognized as a
leader in Forrester
Enterprise ETLWave
8
The upcoming release
OWB 11.2
Features licensed with Oracle Database
Most new features = priced option(s)
2000
2003
2004
2006
2007
2009
Release 2.0.4
Release 9.2
Release 10.1
Release 10.2
Release 11.1
Release 11.2
Basic ETL
functionality
Oracle RAC certified
Oracle 10g certified
Data profiling &
auditing
Server components
installed w/ Oracle
DB
Flexible access to
non-Oracle sources
Mapping Editor
Set and row based
code generation
Mapping Debugger
Interactive LIA
Name & Address
Match/Merge
3,000+ companies
Release 9.0.4
Compete against
Informatica and
Ascential
Metadata Security
Process Flow Editor
Scripting Language
Multi-table insert
Pivot and Unpivot
Recognized as a
leader in Gartner
Magic Quadrant
Scheduling
Improved connector
for SAP R/3
Connector to Oracle
MDM
10,000+ companies
EBS and PeopleSoft
connectors
Non-Oracle targets
Enhanced web
services/SOA
support
Orphan
management
OLAP and relational
modeling
Pluggable mappings
Integration with
Oracle BI EE
“DB ETL”
features
New UI + Usability
enhancements
Productivity
enhancements
Recognized as a
leader in Forrester
Enterprise ETLWave
9
OWB 11gR1
Oracle-centric data integration platform
BI Tool Integration
OBI EE (Enterprise Edition) : design & leverage Oracle objects
Discoverer (Standard Edition): design & deploy EUL
Databases
Databases
Non-Oracle BI : design & leverage Oracle objects
Oracle Database 11g
Applications
Applications
Connectivity
Connectivity
Oracle Warehouse Builder 11.1
Odbc / Gateways
Files
Connectors
CDC: Queues /
Streams/ Third Party
Messages
Odbc / Gateways
Heterogeneous
In-line
Data
Integration
Data
Quality
SQL*Loader/ Ex Table
Analytics
Smart
Data
Modeling
for Oracle
Connectors
Files
CDC: Queues /
Streams/ Third Party
Messages
Analytics
Unified
Unified Metadata
Metadata
Semi-Structured
Semi-Structured
Web Services
Web Services
10
Agenda
• An abbreviated history
• OWB 11.2 beta overview
• Oracle’s roadmap for ETL
• Pricing and Packaging
• How to join the beta program
11
OWB 11gR2 (BETA)
“Plays well with others”
BI Tool Integration
OBI EE (Enterprise Edition) : design & deploy UDML
Discoverer (Standard Edition): design & deploy EUL
Databases
Databases
Non-Oracle BI : design & leverage Oracle objects
Oracle Database 11g
Applications
Applications
Connectivity
Connectivity
Oracle Warehouse Builder 11.2
Odbc / Gateways
Files
Connectors
CDC: Queues /
Streams/ Third Party
Messages
Odbc / Gateways
Heterogeneous
In-line
Data
Integration
Data
Quality
Smart
Data
Modeling
Files
CDC: Queues /
Streams/ Third Party
for Oracle
Messages
SQL*Loader/ Ex Table
JDBC
JDBC
Analytics
Connectors
Native Loaders
Native Un-Loaders
Knowledge Module Framework
Unified
Unified Metadata
Metadata
Native Loaders
Analytics
Native Un-Loaders
Semi-Structured
Semi-Structured
Service Oriented Architectures
Web Services
Web Services for data integration and data quality
Web Services
12
Leveraging the Oracle Database
New Database features exposed in OWB 11.2
•
Advanced Compression
•
Virtual columns
•
New partitioning methods
•
Data Pump
•
Cube MVs for summaries
•
And more…
Easy upgrade to OWB 11.2
1.
Import existing OWB design to OWB
11.2
2.
Select new feature; e.g., Cube MVs
3.
Regenerate code
13
Integrating with OBI EE
How it’s done in OWB 11.2
1.
In OWB, derive the
model from the
dimensional model
2.
In OWB, generate the
metadata for all 3
layers of OBI EE
3.
In Oracle Answers,
browse the data
14
Flexible access to non-Oracle sources
Enabled by knowledge module framework
• Knowledge modules are snippets of code you can run, compile
code in non-Oracle environments
• Choose from a library of existing knowledge modules (KMs)
• Write your own or edit existing KMs
• Originally developed by Sunopsis, now Oracle Data Integrator
(ODI)
OWB + knowledge modules
= 1st big step in integrating OWB and ODI
15
Knowledge Modules for flexible access
Limited only by the code you write or find in the library
•
Access any new source type:
relational, non-relational, message
based and content sources
•
Rich support of ERP, CRM and
MDM on any database platform
•
Rich library of Knowledge
Modules
16
Viewing and Editing the KM code
Increased Flexibility
1.
Modify template
2.
Regenerate the code
3.
Reuse the template
17
Using KMs in mappings
Easily change the connectivity methods for a single logical design
1.
Complete the logical
design (or import an
existing mapping)
Logical view
Execution view
2.
3.
Define “execution
units” for each type of
source ( 3 shown here)
Select the best
connectivity method
for each execution unit
(connectivity can be
through ODBC,
Gateways, Knowledge
Modules, etc.)
18
OWB 11g R2
Benefits for OWB customers
• More flexible data access to a larger set of sources
• Increased developer productivity
• enhanced declarative design
• advanced in-line data quality features
• Increased flexibility in deployments
• alternative connectivity methods for a single logical design
• flexible use of different knowledge modules
• tighter control over implemented code
• Extended SOA support for data integration processes
• Unparalleled support for Oracle
• seamless upgrade to the newest DB features
• support for Oracle BI Enterprise Edition
• support for Oracle Hyperion Essbase
19
Agenda
• An abbreviated history
• OWB 11.2 beta overview
• Oracle’s roadmap for ETL
• Pricing and Packaging
• How to join the beta program
20
Oracle Roadmap for its ETL tools
• Long Term Direction:
Deliver an integrated data integration product
• Short Term:
Deliver stand-alone releases with first integration
steps
• Shared knowledge module framework (OWB 11.2)
• Runtime interoperability (future releases)
• Same user interface framework (future releases)
• Protect investments for the entire customer base
http://www.oracle.com/technology/products/warehouse/pdf/owb_roadmap.pdf
21
High-Level Roadmap (part 1)
Unified platform that is a superset of OWB and ODI
10gR1
10gR2
11gR1
• OWB/ODI investments are
11gR2
fully protected
• No forced migrations
OWB
• Natural upgrade path
Oracle Data Integration 12g
Unified dev team
“ CY 2012”
Common pricing
ODI
11gR2
10gR3
11gR1
• No regressions in
functionality
• Training and support to
continue for both product
releases
22
Agenda
• An abbreviated history
• OWB 11.2 beta overview
• Oracle’s roadmap for ETL
• Pricing and Packaging
• How to join the beta program
23
Common Pricing
ODI EE pricing bundle = ODI product and OWB Enterprise ETL option
DATA INTEGRATOR
ENTERPRISE EDITION
DATA INTEGRATOR
WAREHOUSE BUILDER
ENTERPRISE ETL
ODI
Flagship Data
–
–
OWB
EETL
Integration Product
Flagship
ETL Product
Heterogeneous,
High-Performance
Data Integration
Extensible
Metadata
Management
Modern Java/SOA
Architecture
Wizards for Slowly
Changing
Dimensions
Flexible
Knowledge
Module
framework
• One license at $23k/cpu
“ODI” and “OWB EETL” option are
removed from pricelist
Both are only available in ODI EE
• Two separate installations
• Implement one or both
Interactive Lineage
and Impact
Analysis
24
OWB Product Offerings
This pricing applies to OWB 10.2 and 11.1 releases
ORACLE DATABASE
WAREHOUSE
BUILDER
DATA INTEGRATOR
DATA PROFILING & QUALITY
ENTERPRISE
ETL
ENTERPRISE
EDITION
OWB EETL
OWB
in
DB
Mapping Editor
& Debugger
OWB in
EETL
ODI
EE
APPLICATION ADAPTERS
FOR WAREHOUSE BUILDER
$2,300/cpu
DBEE+$17.5k/cpu
$23k/cpu
ODPQ
ADAPT
Data quality
algorithms
run in Oracle
Database
Extensible
Extensible
Metadata
Metadata
Framework
Framework
Reveals
business views of
application data
Basic dependency
management
with Process
Flows
Out of the box
support for Slowly
Changing
Dimensions
Profile file,
table, application
data in place or
stage the data.
Natively access
SAP R/3 hosted
on any database
Robust scripting
language & APIs
Interactive Lineage
and Impact
Analysis
Auto- detect
data rules.
Audit, auto-correct
incoming data.
Read from and
write to eBusiness
Suite, PeopleSoft,
or Siebel
Fuzzy match/
merge and
Name&Address
cleansing
DATA WATCH & REPAIR
ODPQ+$23k
DWR
Data quality
for Oracle MDM:
Siebel UCM,
PIM, CDH
25
Warehouse Builder Packaging
Effective 30- Jan 2009
Enterprise ETL
Promote from Dev>QA>PROD
Part of Data Integration Enterprise Edition,
Extensible metadata model
FMW price list
Interactive lineage & impact analysis, change propagation
Scheduling and advanced process flow logic
Advanced mapping logic
-pluggable maps, target load order
In-Database ETL
RAC support
Free with Database SE, EE,
Slowly changing dimensions
Mapping Editor & Debugger
and Database Machine
XML file targets
Basic Process Flows
Transportable modules
HTML Metadata Reports
Data Profiling & Quality
Requires Database EE license.
Is a Database Option.
Data Watch & Repair
Connector
Data Profiling
Data Rules
Data Correction
Data Auditing
Integrate with Oracle MDM:
Siebel UCM
PIM
Customer Data Hub
OMB+ Scripting
Name & Address Cleansing
Match Merge
Enable access to data
and metadata in:
SAP R/3
eBusiness Suite
Peoplesoft
Siebel
Adapters
FMW price list
Requires Database EE license.
Is a Database Option.
26
Warehouse Builder Pricing (part 1)
DB ETL is included with Database SE, SE1, EE, and Database Machine
Enterprise ETL
Promote from Dev>QA>PROD
Part of Data Integration Enterprise Edition,
Extensible metadata model
FMW price list
Interactive lineage & impact analysis, change propagation
Scheduling and advanced process flow logic
Advanced mapping logic
-pluggable maps, target load order
In-Database ETL
RAC support
Free with Database SE,
Slowly changing dimensions
Mapping Editor & Debugger
EE, and Database
XML file targets
Machine
Basic Process Flows
Transportable modules
HTML Metadata Reports
Data Profiling & Quality
Requires Database EE license.
Is a Database Option.
Data Watch & Repair
Connector
Data Profiling
Data Rules
Data Correction
Data Auditing
Integrate with Oracle MDM:
Siebel UCM
PIM
Customer Data Hub
OMB+ Scripting
Name & Address Cleansing
Match Merge
Enable access to data
and metadata in:
SAP R/3
eBusiness Suite
Peoplesoft
Siebel
Adapters
FMW price list
Requires Database EE license.
Is a Database Option.
27
Warehouse Builder Pricing (part 2)
One license for access to OWB EETL & ODI functionality: $23 K /target cpu
Enterprise ETL + ODI = ODI EE
OWB
Promote from Dev>QA>PROD
Part of Data Integration Enterprise Edition,
Extensible metadata model
FMW price list: $23 K / target CPU
Interactive lineage & impact analysis, change propagation
Scheduling and advanced process flow logic
ODI
Advanced mapping logic
Knowledge Modules
-pluggable maps, target load order
Non-Oracle DWH
In-Database ETL
RAC support
Native access
Free with Database SE, EE,
Slowly changing dimensions
Mapping Editor & Debugger
and Database Machine
more…
XML file targets
Basic Process Flows
Transportable modules
HTML Metadata Reports
Data Profiling & Quality
Requires Database EE license.
Is a Database Option.
Data Watch & Repair
Connector
Data Profiling
Data Rules
Data Correction
Data Auditing
Integrate with Oracle MDM:
Siebel UCM
PIM
Customer Data Hub
OMB+ Scripting
Name & Address Cleansing
Match Merge
Enable access to data
and metadata in:
SAP R/3
eBusiness Suite
Peoplesoft
Siebel
Adapters
FMW price list
Requires Database EE license.
Is a Database Option.
28
Warehouse Builder Pricing (part 3)
Data Quality pricing unchanged
Enterprise ETL
Promote from Dev>QA>PROD
Part of Data Integration Enterprise Edition,
Extensible metadata model
FMW price list
Interactive lineage & impact analysis, change propagation
Scheduling and advanced process flow logic
Advanced mapping logic
-pluggable maps, target load order
In-Database ETL
RAC support
Free with Database SE,
Slowly changing dimensions
Mapping Editor & Debugger
EE, and Database
XML file targets
Machine
Basic Process Flows
Transportable modules
HTML Metadata Reports
Data Profiling & Quality
Requires Database EE license.
Is a Database Option. $17.5K / target CPU
Data Watch & Repair
Connector
Data Profiling
Data Rules
Data Correction
Data Auditing
Integrate with Oracle MDM:
Siebel UCM
PIM
Customer Data Hub
OMB+ Scripting
Name & Address Cleansing
Match Merge
Enable access to data
and metadata in:
SAP R/3
eBusiness Suite
Peoplesoft
Siebel
Adapters
FMW price list
Requires DB EE + Data
Profiling & Quality options
Is a Database Option . $23K
29
Warehouse Builder Pricing (part 4)
ERP adapters are now priced per target CPU (instead of per target)
Enterprise ETL
Promote from Dev>QA>PROD
Part of Data Integration Enterprise Edition,
Extensible metadata model
FMW price list
Interactive lineage & impact analysis, change propagation
Scheduling and advanced process flow logic
Advanced mapping logic
-pluggable maps, target load order
In-Database ETL
RAC support
Free with Database SE,
Slowly changing dimensions
Mapping Editor & Debugger
EE, and Database
XML file targets
Machine
Basic Process Flows
Transportable modules
HTML Metadata Reports
Data Profiling & Quality
Requires Database EE license.
Is a Database Option.
Data Watch & Repair
Connector
Data Profiling
Data Rules
Data Correction
Data Auditing
Integrate with Oracle MDM:
Siebel UCM
PIM
Customer Data Hub
OMB+ Scripting
Name & Address Cleansing
Match Merge
Enable access to data
and metadata in:
SAP R/3
eBusiness Suite
Peoplesoft
Siebel
Adapters
FMW price list: $2,300 K/ target CPU
Requires Database EE license.
Is a Database Option.
30
High-Level Roadmap (part 2)
Oracle-centric ETL & DQ functionality continue in the Oracle Database
Oracle Database 12g
10gR1
10gR2
11gR1
11gR2
ETL &
DQ
OWB
EETL
Oracle Data Integration 12g
ODI
• Core ETL and DQ
functionality in the Oracle
Database
11gR2
10gR3
11gR1
• Enterprise ETL for Oracle
and non-Oracle in ODI-EE
31
Agenda
• An abbreviated history
• OWB 11.2 beta overview
• Oracle’s roadmap for ETL
• Pricing and Packaging
• How to join the beta program
32
Oracle Beta Program
OWB 11.2 in the Oracle Database 11.2 Beta
How to qualify?
• Oracle employees, go to owb.us.oracle.com/internal/owb112/
• Customer with production licenses in place for Oracle SE, EE,
or Database Machine
or
• Current OPN members
Participate?
• Apply at http://otnbeta.oracle.com/bpo/prospects/index.htm
• For assistance in forming a test plan, contact
[email protected]
33
34