Transparent Access to Archived Data

Download Report

Transcript Transparent Access to Archived Data

Managing
Oracle Applications Data
…Smarter
No part of this presentation may be reproduced or transmitted in any form by any means, electronic or mechanical,
including photocopying and recording, for any purpose without the express written permission of Princeton Softech,
Inc.
Information Powers the Organization
 Information is an increasingly
valuable – and costly –
organizational asset
 Goals: minimize risk, reduce
costs, and increase flexibility...
 By aligning IT investments
according to evolving
information value
Structured
Semi-Structured
Unstructured
2
2004 Princeton Softech, Inc.
Challenge: Database Growth
2003
2002
2001
3
2004 Princeton Softech, Inc.
How much? How fast?
“With growth rates exceeding 125%,
organizations face two basic options:
continue to grow the infrastructure or
develop processes to separate dormant
data from active data.”
Source: META Group 2003
Current Data
Historical Data
2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011
4
2004 Princeton Softech, Inc.
Data Growth Impacts Business Process
As Transaction Data
Accrues…
Longer batch cycles
Resources and maintenance increases
Increased storage and processing costs
Batch window crosses into prime time
Impacts to the business process
5
2004 Princeton Softech, Inc.
What’s Driving Data Growth?

High-volume online transaction processing:
– Customer facing eCommerce applications
– ERP/CRM
– Supply chain applications
 Record retention requirements:
– Financial Services – Sarbanes-Oxley
– Healthcare – HIPAA
– Pharmaceutical – 21 CFR 11
– Financial – IRS and SEC Rule 17a-4
 Multiplicity of data:
– Multiple operational, development and testing environments
– Disaster recovery and business continuity
– Routine backup and recovery
6
2004 Princeton Softech, Inc.
Data Retention Example
 SEC Rule 17a-4
– Retain records for six years from close of account
or termination of associated employees
– Keep records in an "easily accessible place"
– Produce records immediately if the records are
located in the office where the request is made
– Produce records within three business days if the
requested records are located off-site
– Display requested records electronically in a local
office and immediately produce printed copies to
satisfy Rule requirements
7
2004 Princeton Softech, Inc.
Data Multiplier Effect
2
3
1
6
4
Production
Backup
Disaster Recovery
Development
Test
Quality Control
Total Size =
200 GB
200
200
200
200
200
1200 GB
5
8
2004 Princeton Softech, Inc.
Database Growth: Can’t Ignore It
…continue to add
– People
– Processes
– Technology
…continue to limit
Production
Database
– Performance
– Availability
– Time for other projects
9
2004 Princeton Softech, Inc.
Alternatives

Add more capacity
– Bottom line impact
– Uncontrolled cost spiral
 Institute rigorous database tuning
– Does not directly address data growth
– Reaches point of diminishing returns
 Delete/ purge data
– Legal and data retention issues
– Data may be needed for data warehousing
 In-house development
– Complex undertaking
– Application specific
– Support/upgrade/maintenance/opportunity cost
10
2004 Princeton Softech, Inc.
What Can We Do?
“Deploying a successful database archiving strategy is
critical to ensure database availability.”
“Organizations should incorporate data archival policies
within current design or implementation plans to
maintain future performance and reduce related costs.”
11
2004 Princeton Softech, Inc.
About Princeton Softech
 Providing relational data management solutions for




enterprise IT since 1989
Global company; 2000+ customers in 30+ countries
Recognized by Gartner, Giga and META as market
leader
Pioneered enterprise database archiving and test
data management segments
Partners with industry-leading database, enterprise
application and storage solution providers
-
12
2004 Princeton Softech, Inc.
Manage Enterprise Data…Smarter
PreProduction
Data
Production &
History Data
PeopleSoft ClarifyCRM
Relational
Tools for Servers
Archive
for Servers
Oracle
Apps
Archive for
DB2
Relationship Engine
Oracle
SQL
Server
Sybase
Informix
DB2
UDB
DB2
Legacy
13
2004 Princeton Softech, Inc.
Smaller Production DB; Lower Cost
Historical
Reporting
DR
BU
Archive Production
Data
Live
Near line
Archive
DBMS
Production
DBMS
Compare
Results
Offline
Archive
Storage
Refresh
Test Data
Test
DBMS
Streamline
Test Data
Edit
Test Data
14
2004 Princeton Softech, Inc.
Princeton Softech’s Active Archive Solutions
Archive
Files
Production
Database
Active Archive
Database
Archive
&
Restore
Archive Files
Data Access (locate, browse, query, report)



Reduce the amount of data in the application database
– Remove obsolete or infrequently used data
– Maintain “business context” of archived data
Enable easy user access to archived information
– View, research and restore as needed
Support data and storage management strategies
15
2004 Princeton Softech, Inc.
Solution Overview
• Support for Oracle Applications
versions 11.0 & 11i
• Financials
• Manufacturing
• Supply Chain
• Human Resources
• Projects
• Transparent access to data via
standard Oracle Applications
forms and reports
• Pluggable archiving framework
designed to support predefined
archive templates and local
customizations
16
2004 Princeton Softech, Inc.
Archiving Oracle Financials Data
Archiving Historical Data
Active Archive
Database
Production
Database
GL – Balances, Journals …
AP – Payments, Invoices, Vendors…
AR – Receipts, Invoices …
FA – Depreciation, Adjustments
General Ledger
Payables
Receivables
Assets
Locate, Browse, Query, Report . . .
Data Access
17
2004 Princeton Softech, Inc.
Transparent Access to Archived Data
• Seamless access to BOTH
archived and production data
via Oracle Applications
• Leverages “Responsibility” to
access data, using standard
Oracle forms and reports
• Steps to view archived data:
 Login
 Select Responsibility
 Access archived data,
production data or BOTH
Archived
Data
Production
Data
18
2004 Princeton Softech, Inc.
Archive Workbench


Manage and report on the lifecycle
of the entire archive process
– Current location of the archived
data
– Run archive jobs
• To the active archive
database
• To Offline storage
• Restore
Detailed Reporting on the Archive
Process
– Request date and time
– Current status
– Module and user
– Criteria used
– Number of records archived
from each table
19
2004 Princeton Softech, Inc.
Verification Engine

System Verification Diagnostics
– Comprehensive top to bottom
configuration analysis/validation

Archive Process Diagnostics
– Performs application validation
prior to archiving data
– Verifies and matches table
structures in the active archive
database

Oracle Patch and Upgrade
Checking
– Detects mismatches
– Provides upgrade procedures
20
2004 Princeton Softech, Inc.
Information Lifecycle Management
 All data has a lifecycle
 Parameters differ over time
– Business value
– Access requirements
– Performance
requirements
 Store and manage
accordingly
Acquisition
Disposal
Minimal
Access
Frequent
Access
Sporadic
Access
21
2004 Princeton Softech, Inc.
Customer Success - AVX

Who is AVX?
– Kyocera Group company
– manufacturer and supplier of electronic components
 Challenges
– Implement a single global instance without adversely
impacting business
– Avoid business disruption during software upgrades
– Reduce frequency of hardware upgrades
– Maintain consistent database size and performance
 Reasons
– Consolidation will grow the database by magnitudes
– Need to implement database archiving before adding the
largest manufacturing site (70,000+ WIP move transactions
daily)
22
2004 Princeton Softech, Inc.
Customer Success - AVX

Implementation Approach
– Business requirements
• Decrease upgrade time
• Focus staff on core competencies
• Prepare for archiving during the definition phase of the
global IT solution
• Provide user community with transparent data access
 Results
– First phase: installed, configured & implemented in one week
– Consistent database size and performance
– Smaller test environments; refresh quickly
23
2004 Princeton Softech, Inc.
Database Archiving Benefits Summary
Improved
Performance
• Faster response time
• Increased productivity
• Satisfied customers
Improved
Availability
• Faster batch cycles
• Ready for business
• Transparent access
Cost Containment
• Postpone hardware upgrades
• Postpone software upgrades
• Deliver competitive advantage
24
2004 Princeton Softech, Inc.
Archiving Reduces Database Volume
Production
Backup
Disaster Recovery
Development
Test
Quality Control
Total Size =
200 GB
200
200
200
200
200
1200 GB
Production Data
120 GB
Active Archive Data
Production
Backup
Disaster Recovery
Development
Test
Quality Control
120 GB
120
120
120
120
120
Total Size =
720 GB
Saving 480 GB (40%)
Primary Storage
80 GB
25
2004 Princeton Softech, Inc.
Streamlining Application Environments

Multiple environments
required
– Application deployments
– Customizations
– Upgrades
– Patches
– QA database
– Training, Staging, etc.
 Challenges
– Space
– Time
– Cost
26
2004 Princeton Softech, Inc.
Typical Approaches

Purchase additional disk space?
 Stretch the project timeline?
 Discontinue one of your current
projects?
 Most common solution:
– Share test and development
databases
– among projects/teams
27
2004 Princeton Softech, Inc.
Managing Oracle Applications Test Data

Extract precise subsets of related
data to build realistic, “right-sized”
test databases
– Create referentially intact
subsets
Production
– Remove the bulk of production Database
data
– Minimize the load on testing
and staging servers

Speed iterative testing tasks with
reusable processing definitions and
Extract Files to ensure consistency

Browse and edit complex relational
data from multiple tables in a single
display
Test
QA
Dev
28
2004 Princeton Softech, Inc.
Create, Review, Edit Templates


Add or Remove
tables
Include new DB
objects
– Functions
– Packages
– Procedures
– Rules
– Sequences
– Views
29
2004 Princeton Softech, Inc.
Creating a Subset using a Template








Criteria can be based on
one or more modules
All Date Values
– GL Date
– Transaction Date
– Default Effective
Date
Sets of Books
Organizations
Status
Invoice number(s)
“And/Or” combos
More….
Define your criteria…
30
2004 Princeton Softech, Inc.
Benefits

Maximize allocated disk space
 Increase number of test/ dev
environments
 Reduce infrastructure costs
 Realize development and test
efficiencies
– Reduce the cycle times for
test upgrades
– Reduces time and resources
required to backup and
maintain non-production
environments
31
2004 Princeton Softech, Inc.
Manage Enterprise Data…Smarter
PreProduction
Data
Production &
History Data
PeopleSoft ClarifyCRM
Relational
Tools for Servers
Archive
for Servers
Oracle
Apps
Archive for
DB2
Relationship Engine
Oracle
SQL
Server
Sybase
Informix
DB2
UDB
DB2
Legacy
32
2004 Princeton Softech, Inc.
Questions
David Stevens
Princeton Softech
[email protected]
609.627.5500
33
2004 Princeton Softech, Inc.