Transcript Logical data replication solution From

Welcome to Dbvisit Replicate
Overview and Architecture
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Agenda
•
•
•
•
•
Introduction to Dbvisit Software
Dbvisit Replicate Intro
Dbvisit Replicate Architecture
Dbvisit Replicate Demo
Q&A
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Dbvisit
•
•
•
•
•
•
•
Used in 80+ Countries
Trusted by 700+ Companies
Worldwide leader in disaster recovery solutions for Oracle Standard Edition
Exceptional Product Engineers with “real world” DBA Experience
Two Oracle 11g Certified Masters
Regular presenters at Oracle events such as OOW and Collaborate
Passionate about Oracle Technology
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Trusted in 80+ countries. . .
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
. . . by 700+ companies.
Product Lineup
World-leading Disaster Recovery
Solution for the
Oracle SE database
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Affordable Alternative to GoldenGate: –
Data Replication for
Oracle-sourced databases
Two Replication Types
Physical Replication
“One on one” copy of the primary database in permanent recovery
Use redo apply to keep up to date
100% binary copy, database are exact replicas
Referred to as a standby database
Best suited for DR
Logical Replication
Independent 2nd database in sync by replication mechanism
Uses SQL statements to keep up to date
Subset of data is replicated
Cross version, cross platform
Separate physical database structure
Best suited for information sharing, migrations, real-time reporting etc
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Dbvisit Replicate
Logical data replication solution
•
•
•
•
•
•
From Oracle to Oracle, SQL Server,
MySQL
Topologies: one to one, one to
many, many to one, cascading,
unidirectional, bi-directional
Wizard-driven interface
Robust notification capabilities
Automated conflict detection and
correction
“Audit” feature
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Dbvisit Replicate Use Cases
1) Offloaded reporting and query environments
2) Data warehousing
a)
b)
“Audit” feature
Integration with ETL tools
3) Migration projects
a)
b)
Term licenses
Oracle version upgrades, OS platform, to the Cloud, etc.
4) Cloud
a)
b)
c)
d)
Migration
Backup
Reporting
DRaaS
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Dbvisit ReplicateArchitecture Components
•
Mine
– Converts Oracle redo log data into PLOG data
•
PLOG
– “Parsed log file” – binary files specific to Dbvisit Replicate
– Platform independent
•
Apply
– Converts PLOG data into target DB native SQL
-----------------
•
Fetcher (optional)
– Offloads Mine process from source server onto intermediary server
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Dbvisit Replicate Architecture
•
①
Source
Environment
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
① Mine
– Mines Oracle redo
logs and creates
PLOG data to move
over network
Dbvisit Replicate Architecture
LAN
①
Source
Environment
②
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
•
① Mine
– Mines Oracle redo
logs and creates
PLOG data to move
over network
•
② PLOG
–- Parsed logs –
binary files specific
to Dbvisit Reporting
–- Platform
independent
Dbvisit Replicate Architecture
LAN
①
Source
Environment
③
Target
Environment
②
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
•
① Mine
– Mines Oracle redo
logs and creates
PLOG data to move
over network
•
② PLOG
–- Parsed logs –
binary files specific
to Dbvisit Reporting
–- Platform
independent
•
③ Apply
– Converts PLOG data
into target DB
native SQL
Offload MINE using “Fetcher”
LAN
•
① Mine
– Mines Oracle redo logs and
creates PLOG data to
move over network
•
② PLOG
–- Parsed logs – binary
files specific to Dbvisit
Reporting
–- Platform independent
•
③ Apply
– Converts PLOG data into
target DB native SQL
•
④ Fetcher (optional)
–- Offloads Mine process
from Source server onto
intermediary server
④
①
Source
Environment
③
Target
Environment
②
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Offload APPLY
LAN
①
Source
Environment
③
Target
Environment
②
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
•
① Mine
– Mines Oracle redo
logs and creates
PLOG data to move
over network
•
② PLOG
–- Parsed logs –
binary files specific
to Dbvisit Reporting
–- Platform
independent
•
③ Apply
– Converts PLOG data
into target DB
native SQL
Dbvisit Replicate and RDS
On Premise
Source Database
Amazon AWS
redo/archive
threads
EC2
Instance
Mine engine
Applier
SQL Net
RDS Oracle Instance
real-time log processing
create SQL to apply changes
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
|
real-time
d b v i s i t . c o m
online transfer
with batch fallback
Dbvisit Replicate for Migrations
Migrations happen! They are a fact of life and are required for any
number of reasons including:
•
•
•
•
•
Bug fixes
Platform version or application upgrades
New hardware or a migration to the cloud
Data centre consolidation – e.g. due to a merger or acquisition
Retiring old technology
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Migration objectives
Migrate previous release database to new release database with:
1.
2.
3.
4.
5.
Minimal outage
Low risk
Low stress
Extended testing with live data
100% Data integrity
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Dbvisit Replicate for Migrations
1
1
1
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Install Dbvisit Replicate
Dbvisit Replicate for Migrations
1
1
2
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
1
Install Dbvisit Replicate
2
Start the MINE process on the
Source Database
Dbvisit Replicate for Migrations
3
1
1
2
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
1
Install Dbvisit Replicate
2
Start the MINE process on the
Source Database as of SCN 123
3
Export the database as of SCN 123
Dbvisit Replicate for Migrations
3
4
1
1
2
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
1
Install Dbvisit Replicate
2
Start the MINE process on the
Source Database as of SCN 123
3
Export the database as of SCN 123
4
Import the database
Dbvisit Replicate for Migrations
3
4
1
Install Dbvisit Replicate
2
Start the MINE process on the
Source Database as of SCN 123
3
Export the database as of SCN 123
4
Import the database
5
Start the APPLY process
1
1
2
5
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Dbvisit Replicate for Migrations
6
3
1
Install Dbvisit Replicate
2
Start the MINE process on the
Source Database as of SCN 123
3
Export the database as of SCN
123
4
Import the database
5
Start the APPLY process
4
1
1
2
5
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
6 When the APPLY process is
current point the application to
the Target.
Dbvisit Replicate Feature Highlight:
CDC/Audit real-time BI (ii)
This does not maintain a copy of the source table(s), but logs all operations as separate
entries.
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Dbvisit Replicate Feature Highlight:
CDC/Audit real-time BI (ii)
Mine process
Apply process
SALES
Columns
PROD_ID
STAGING SALES
Columns
OLD_PROD_ID
NEW_PROD_ID
OLD_CUST_ID
NEW_CUST_ID
OLD_TIME_ID
NEW_TIME_ID
OLD_CHANNEL_ID
NEW_CHANNEL_ID
OLD_PROMO_ID
NEW_PROMO_ID
OLD_QUANTITY_SOLD
NEW_QUANTITY_SOLD
OLD_AMOUNT_SOLD
NEW_AMOUNT_SOLD
OLD_SALES_STATUS
NEW_SALES_STATUS
CURRENT_USER
LOGON_USER
DATE_CHANGE
DATE_COMMIT
SID
TRANSACTION_ID
OPERATION
(UPDATE, DELETE or INSERT)
OS_USER
SCN
MACHINE
etc
New row inserted in staging
table for every:
• Insert
• Update
• Delete
CUST_ID
TIME_ID
CHANNEL_ID
PROMO_ID
QUANTITY_SOLD
AMOUNT_SOLD
SALES_STATUS
Dbvisit Replicate audit info
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Automated conflict resolution
Dbvisit Replicate offers:

Conflict detection
Data divergence triggers a notification

Conflict resolution
Identifies source of conflict

Conflict handling
Predefined rules handle conflicts automatically (includes setting
PL/SQL business rules)
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Formal Product Training
•
Workshop style – combining lecture and hand’s on
•
Available now: Replicate LTD, XTD, MAX
•
Coming soon: Standby
•
Conducted via GoToTraining
•
Short segments (to fit into work schedule)
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Dbvisit Replicate
Installation
1. RPM on Linux
2. Tar on Unix
3. Windows installer on Windows
Only 1 executable: dbvrep
Clean and simple
Download a free 30 day trial from our website www.dbvisit.com
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Dbvisit Replicate
Demos
1. Dbvisit Replicate console overview
2. Oracle to Oracle
3. Oracle to MySQL
Other demos are on our "Dbvisit" Youtube channel
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Dbvisit Replicate Comparison
FEATURE
DBVISIT REPLICATE
GOLDEN GATE
STREAMS
OPTIMISTIC COMMIT
Yes
No
ENTERPRISE EDITION NEEDED
No
No
Yes
MYSQL and SQL SERVER TARGET
Yes
Yes
No
ORACLE CROSS PLATFORM
Yes
Yes
Yes
LOB support
Yes
Yes
Yes
SETUP WIZARD
Yes
No
No
OFFLOAD/DOWNSTREAM MINE
Yes
Yes
Yes
CONFLICT RESOLUTION
Yes
Yes
Yes
SCALABLE/ROBUST
Yes
Yes
No
COST EFFECTIVE
Yes
No
No
EASY TO USE
Yes
3 day training
required
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Yes/No
Expert needed, manual
scripting required
Summary: Dbvisit Replicate Advantages
• Low-cost, quickly deployed data replication solution for keeping a set of
databases in sync, real time
• Complete, real time system status overview on one screen
• Real time notification and extensive reporting included
• Automated conflict detection, handing and resolution capabilities
• Configurations easily reran or copied over to new environments
• Optional: Offload data mining with “Fetcher” tier
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Next steps
1. Plan and carry out POC test?
2. Size of redo logs and frequency (high and low volume ranges)?
3. Script to test for supported / unsupported datatypes
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Thank you
Questions and Answers?
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|
Twitter: @dbvisit
Blog: blog.dbvisit.com
Forum: www.dbvisit.com/forums
©
2 0 1 4
D b v i s i t
S o f t w a r e
L i m i t e d
d b v i s i t . c o m
|