Transcript Challenges for Major Upgrade/Migration Projects

Oracle 8i or 9i to version 10g –
Upgrading or Migrating with
Eliminated Downtime
GCOUG Meeting, October 17, 2007
Chuck Duncan, Sr. Solutions Consultant
Challenges for Major Upgrade/Migration Projects
 Maintaining SLA during
planned outage



Revenue Impact
Customer Expectations
Interdependencies, Integration
 Data issues




 Synchronization issues


Incremental data movement
Source database impact
Instantiating
Terabytes/Petabytes
Staging areas
Change Management
Special Handling
 Fail-back strategy


System/Application
verification
Continued data growth
Possible Technologies Evaluated for Oracle Migrations





Export/Import
Flat files/SQL*Loader
Data Pump
Synchronous replication
Backup/Recovery
Non Mission-Critical Systems





Transportable tablespaces
Cross-platform transportable
tablespaces
Standby databases
Oracle Streams
Transactional Data Management
High Availability Systems
Technology Choices for Oracle Migrations: Considerations





Export/Import
Flat files/SQL*Loader
Data Pump
Synchronous replication
Backup/Recovery





Non Mission-Critical Systems


Assume a moderate to significant
amount of planned downtime
Significant overhead on the
source database
No ongoing management of
transactions
Complex, error prone,
unmanageable
Migration time dependent on size
of data
No manageable failback strategy
No real-time data verification
strategy
Technology Choices for Oracle Migrations: Considerations

Transportable Tablespaces
 No updates possible
 No incremental solution
 No failback solution
 No 9i-10g Cross Platform

Standby Databases (logical)
 No rolling upgrade in 9i
 Cannot be used for heterogeneous
migration/upgrade
 No real-time verification solution

Streams
 No rolling upgrade in 9i
 Limited datatype support (e.g. no
LONG support in 9i)
 No real-time verification solution
 Heterogeneity very complex





Transportable tablespaces
Cross-platform transportable
tablespaces
Standby databases
Oracle Streams
Transactional Data Management
High Availability Systems
Available Solutions/Techniques & Tradeoffs
Scenario:
Unload/
Load
Export/
Import
Backup/
Roll
Forward
Transportable
TableSpaces
8i or 9i  10g
Yes
Yes
No
8i or 9i  10g
cross platform
Yes
Yes
8i  9i
Yes
8i  9i
cross platform
Dataguard
Streams
GoldenGate
TDM
Yes
No
No
Yes
No
No
No
No
Yes
Yes
No
Yes
No
No
Yes
Yes
Yes
No
Yes
No
No
Yes
9i  10g RAC/
ASM
Yes
Yes
No
No
No
No
Yes
Non-Oracle 
10g
Yes
No
No
No
No
No
Yes
Downtime
Weeks/Days
Hours/Minutes
Standby Databases
Minutes/Seconds
Transactional Data Management
Real-time capture, routing, transformation, delivery, and
verification of data transactions across heterogeneous
environments with low impact.
TDM is:

Real time
GoldenGate further differentiates on:

Moves data with sub-second latency

Heterogeneous
Handles thousands of transactions per second with
very low overhead

Moves transactions across different
databases and platforms

Transactional
Maintains transaction integrity
Performance
Extensibility & Flexibility
Open architecture, modularity enables wide range
of solutions

Reliability
Supports continuous operations and availability
GoldenGate TDM for Oracle Database Capture
Capture: Committed changes are captured (and can be
filtered) as they occur by reading the transaction logs.
Trail files: Universal data format enables heterogeneity.
Route: No distance constraints via TCP/IP. Compression & encryption.
Delivery: Applies transactional data
with guaranteed integrity.
redo log
Capture
Oracle
Database
Source Trail
LAN / WAN /
Internet
Target Trail
Target Trail
Deliver
Source Trail
Deliver
Capture
Bi-directional
Target
Database
Oracle 8i or 9i to 10g Upgrades/Migrations
 What TDM offers:

Minimal impact and continuous availability during the project

Technology solution for eliminating database downtime

Improved capabilities for data integrity, accuracy

Fail-back solution in the event of unexpected issues/downtime

Proven – with customers in production
No Downtime Migration: 9i  10g Cross-Platform
9i Clone  10g
2
9i
Solaris
3,4
1
1.
2.
3.
4.
Solaris
Start GoldenGate TDM’s Capture process
Set up Clone database, then Upgrade to 10g
Cross platform transportable tablespaces
metadata export
Use a full database NOROWS export (Views,
Packages, etc)
No Downtime Migration: 9i  10g Cross-Platform
9i Clone  10g
2
9i
Solaris
Solaris
3,4
1
6,7
10g
5
1.
2.
3.
4.
5.
Start GoldenGate TDM’s Capture process
Set up Clone database, then Upgrade to 10g
Cross platform transportable tablespaces
metadata export
Use a full database NOROWS export (Views,
Packages, etc)
Set up a new 10g vanilla target
6.
7.
Linux
Cross platform transportable tablespaces
metadata import
Full import with IGNORE option
No Downtime Migration: 9i  10g Cross-Platform
9i Clone  10g
2
9i
Solaris
Solaris
3,4
1
8
6,7
10g
5
1.
2.
3.
4.
5.
Start GoldenGate TDM’s Capture process
Set up Clone database, then Upgrade to 10g
Cross platform transportable tablespaces
metadata export
Use a full database NOROWS export (Views,
Packages, etc)
Set up a new 10g vanilla target
6.
7.
8.
9.
Linux
Cross platform transportable tablespaces
metadata import
Full import with IGNORE option
Start GoldenGate TDM Apply process at target
**SWITCHOVER** (not depicted)
No Downtime Migration: 9i  10g Cross-Platform
9i Clone  10g
2
9i
Solaris
Solaris
3,4
1
8
6,7
11
Failback
contingency
1.
2.
3.
4.
5.
Start GoldenGate TDM’s Capture process
Set up Clone database, then Upgrade to 10g
Cross platform transportable tablespaces
metadata export
Use a full database NOROWS export (Views,
Packages, etc)
Set up a new 10g vanilla target
10g
10
6.
5
Linux
Cross platform transportable tablespaces
metadata import
7. Full import with IGNORE option
8. Start GoldenGate TDM Apply process at target
9. Verify data (optional)
10. **SWITCHOVER** (not depicted)
11. Start TDM Capture at target (new source)
12. Start TDM Apply at target (old source)
TDM – in Summary
Real Time
Allows for highest application availability
Heterogeneous
Allows movement across platforms/databases
Transactional
Maintains transactional integrity
Performance
No impact on source database
Downtime
Only incurred during Application switchover
Verification
Real time (dual) verification after migration
Failback
With no data loss, in real time
GoldenGate Major Customer Examples
 Database and/or Platform Migrations in all-Oracle environments:
 Overstock.com: Oracle 9i on Linux  Oracle 10g on AIX
 HP internal testing: Oracle 9i on HP Tru64  Oracle 9i on HP UX
 Cerner’s Millennium Application: Oracle 9i on OpenVMS 
Oracle 10g on HP UX or AIX
 Migrations from non-Oracle to Oracle database environments:
 Sabre Holdings: HP Nonstop  Oracle
 Siebel on Demand: IBM DB2  Oracle
 Integrating non-Oracle data into Oracle BI systems:
 Dell: OLTP on HP NonStop  Oracle Data Warehouse
 AMD: IBM DB2  Oracle reporting database
GoldenGate’s Partnership with Oracle: Highlights

Oracle Certified Partner (worldwide) since fall 2006

Oracle Database 11g – beta test partner

Oracle Modernization Alliance – member partner (July 2007)

Siebel CRM - GoldenGate TDM has Validated Integration

Oracle Data Integrator – Proven solutions for real-time data integration and
warehousing
Solution Focus Areas for Oracle Customers
High Availability & Disaster
Tolerance
Real-Time Data Integration

Unplanned Outages:
 Live (Hot) Standby

Real-Time Data Warehousing (with
transformation support)

“Planned Outages”:
 Oracle database upgrades &
migrations

Offload Live “Real-Time” Reporting

Data Consolidation – Oracle Data Hubs


Application, platform migrations

Non-Oracle to Oracle migrations
Performance & Transaction Load
Balancing:
 Active-Active
GoldenGate TDM: Heterogeneity Supports Applications Running On…
Databases
Capture:
 Oracle
 DB2 UDB
 Microsoft SQL Server
 Sybase ASE
 Teradata
 Enscribe
 SQL/MP
 SQL/MX
Delivery:
 All listed above
 Ingres, MySQL
 and any ODBC compatible databases
O/S and Platforms
Windows 2000, 2003, XP
Linux
Sun Solaris
HP NonStop
HP-UX
HP TRU64
IBM AIX
IBM z/OS
OpenVMS
TDM Key Architecture Features

Log-based extraction
 Reads transaction logs directly, enabling advanced changed data capture
with high performance and minimum impact to source systems.
Routing, flexible topologies
 Enables users to support various topologies, such as one-to-one, many-toone, one-to-many, many-to-many, and bi-directional movement of data.
Dynamic rollback and selective recovery
 Point-in-time and selective recovery.
Data filtering and transformations
 Table and row filtering can be applied based on user-defined criteria.
 Users can map, enrich, translate, and transform transactional data in real
time as it is captured or applied to target systems.
Archival and Audit Capabilities

Customization: User Exits, Stored Procedures and Queries, Macros

Compression and Encryption




GoldenGate Veridata™
 “GoldenGate Veridata is a high-speed, low impact data
comparison solution that identifies and reports data discrepancies
between two databases, without interrupting those systems or
the business processes they support.”
 Benefits:
 Reduce risk exposure and act on data discrepancies sooner
 Speed and simplify IT work in comparing data sources
 No disruption to business systems
GoldenGate Veridata™
 Key features:
 Support for large data volumes
 Comparisons ran while data sources are kept online
 Flexible reporting for discrepancy analysis
 Unparalleled speed and efficiency
 Selective comparison options
 Oracle to Oracle
 HP NonStop to NonStop
- Enscribe & SQL/MP
GoldenGate Veridata: How it Works



The user chooses tables or files on the source and target databases
The comparison is initiated from the GUI, command line or batch
As the databases continue to change, GoldenGate Veridata reports:
 Persistent discrepancies
 In-flight data discrepancies (user configurable)
GoldenGate Veridata: Architectural Advantages
 Initial read and local conversion to a digital signature:
 Maximum speed
 Minimal network load
 Optional unstructured read and server side sorting
 Two step comparison cycle allows for:
 Operation on replicated production system
 intelligent identification of “In flight” records
 Extremely fast!
 In testing on moderate hardware 25,000 rows/sec
 No interruption of service
Thank you.
[email protected]
www.goldengate.com
Case Study: Overstock.com
Multiple Enterprise Solutions Drive Revenue, Enhanced BI
Business Challenges:
 Minimize downtime for e-commerce systems
during database & platform migration
 Improve Business Intelligence by reducing data
latency for the data warehouse
 Gain a single view of the customer to better
understand purchasing habits, refine marketing
campaigns to be more targeted, and ultimately
drive more business
 Implement a reliable, in-house disaster
recovery solution
GoldenGate Solution:
 Zero downtime during migration project for 3
business-critical e-commerce systems
 Enabled an operational Teradata EDW through
real-time data integration from e-commerce
systems
 High Availability for Teradata to balance
transaction load and enable failover solution
High Availability & Real-Time
Data Warehousing
Oracle 9i  Oracle 10g
Linux
AIX
Oracle 9i  Oracle 10g
Linux
AIX
Oracle 9i  Oracle 10g
Linux
AIX
Enterprise Data
Warehouse
“Accessing the data in real time using GoldenGate
we can immediately see if we’re profitable and if our
business processes are working.”
- Sam Peterson, SVP Technology, Overstock.com
Addressing Failback
9i
Solaris
10g
Linux




Stop application at new Primary (10g)
Real-time TDM synchronization ensures old primary is synchronized
Switchover Application to old primary (9i)
Start Primary database
Our Business
We enable real-time, continuous movement of transactional data across
Operational and Analytical business systems.
Real-Time Access
to
Real-Time Information
Real-Time Information
Real-Time Access
Availability: the degree to
which information can be
instantly accessed.
Mission-Critical
Systems
Integration: the process of
combining data from different
sources to provide a unified view.
Key GoldenGate Customers…
Banking and Finance
Healthcare
Telecommunications and Service Operators
Retail and e-Business
Manufacturing & Supply Chain
Travel & Hospitality
Government & Public Sector
Oracle Database Support
 GoldenGate currently has GA support for real-time, continuous
data capture from Oracle transaction logs:
 Oracle 8i, 9i, 10g RAC & ASM
 Oracle Database 11g – in progress
 GoldenGate is a beta tester
 Product roadmap and engineering underway
 Internal experts attending training
 Why GoldenGate over Oracle native replication?
 Heterogeneity
 Performance, volumes/scalability, and IT impact
 Implementation and manageability
 Solutions and features