Transcript Oracle Database 11g - Greater Cincinnati Oracle Users Group

1
<Insert Picture Here>
Oracle Database 11g Overview
Gary Quarles
Sales Consultant
Oracle Database 11g
• Major new release of Oracle functionality
• In Beta since September 2006
• Production expected in 2007
• Furthers the adoption of Grid Computing
• Benefits
• Unique scale-out technology with single database image
• Lowers server and storage costs
• Increases availability and scalability
• Disruptive technology
• Changes the game for the database industry
• Changes the way data centers look and operate
• Currently in rapid adoption phase
3
Sustained Innovation – Grid
Computing
SMP
Dominance
RAC
Clusters
for
Availability
Grids of
low cost
hardware and
storage
4
Well Proven Scalability
• RAC 8+ node customers
•
•
•
•
•
•
•
•
•
•
•
•
Citigroup
Burlington Coat Factory
J2 Global Communications
Genworth Financial
Amazon.com
MSDS
Mercado Libre
Yahoo! Overture
Babcock Engineering
Ordnance Survey
Dell
Yahoo!
•
•
•
•
•
•
•
•
•
•
•
•
SAIC
Fairmont Hotels
ADESLAS
Evite.com
Quelle AG
Telstra
Gas Natural
MyTravel
Thompson
AOL
Vivo
Sagawa Kyubin
5
Example: Amazon Data Warehouse
• 51 TB row data
16 Node RAC Linux Cluster
4 CPUs per Node
• 71 TB of disk space
• RAC and ASM
• Pure Scale-Out architecture
• Both server and storage layer
• In top ten largest
Warehouses in Winter Survey
• 50x growth in data in 6 years
• More than doubled in last
year
8 SAN switches, 32 port each
Switch
Switch
Switch
84 HP MSA-1000 Arrays
6
Benefits Achieved
•Scalability - Easily Expanded Original 10 Node
Cluster to 18 Nodes
•Improved Availability
•Disaster Tolerance with Dataguard
18-node cluster IBM x-Series
Data Center 1
•Better Performance - Large Queries – 50% Faster
•Easier, Less Disruptive Storage Changes with ASM
•Significant Cost Savings, Better IT Productivity
Data Center 2
Oracle RAC 10gR2
IBM xSeries – SUSE Linux
Oracle ASM – Two
diskgroups, one SAN,
one SATA
7
Mark Beyer, Gartner
December 2006
“Oracle customers are highly satisfied with
its Real Application Clusters and Automatic
Storage Management when pursuing scaleout strategies.”
8
Business and Technology Status 2007
• Global economy is more dependent on IT than ever
before
• Information management is THE major mission of the
enterprise
• Organizations are being pushed to ADAPT quickly to
change
• Economic, Technologic, Regulatory
• “At least two-thirds of all IT spending is just to sustain the
business, not to change or transform the business.”
- Gartner Group
9
Oracle Database11g Big Message
• Increases business and IT agility and lowers overall
costs!
• Enables change to happen while maintaining stability!
• Takes management and diagnostic automation to the next
level!
• Freeing key personal for higher value tasks!
• Simplifies your information infrastructure!
• Provides the least expensive, most scalable, secure and
highly available information management and rapid
application development environment!
10
<Insert Picture Here>
Make Change Safe
Enabling Change While Maintaining Stability
Barriers to Change
• Proactive testing of upgrades is time consuming,
costly, and often not as effective as needed
• Upgrades still risk disruption of production systems
• Many upgrades still require significant downtime
• Still have to endure potentially long period of
instability as bugs are found and fixed
• DBAs are asked to do too much to help, e.g., diagnostic
patches that require more downtime
• Software vendors take too long to fix bugs
12
Database Replay
13
The Need for Database Replay
• Businesses want to adopt new technology that adds value
• Extensive testing and validation is expensive in time and cost
• Despite expensive testing success rate low
•
•
Many issues go undetected
System availability and performance negatively impacted
• Cause of low success rate
•
Current tools provide inadequate testing
• Simulate synthetic workload instead of replaying actual
production workload
• Provide partial workflow coverage
Database Replay makes real-world testing possible
14
Database Replay
• Replay actual production database workload in test
environment
• Identify, analyze and fix potential instabilities before making
changes to production
• Capture Workload in Production
•
•
Capture full production workload with real load, timing &
concurrency characteristics
Move the captured workload to test system
• Replay Workload in Test
•
•
•
Make the desired changes in test system
Replay workload with full production characteristics
Honor commit ordering
• Analyze & Report
•
•
•
Errors
Data divergence
Performance divergence
Analysis & Reporting
15
Database Replay: Supported Changes
Client
Client
…
Client
Changes
Unsupported
Middle Tier
Changes Supported
•Database Upgrades, Patches
•Schema, Parameters
Recording of
External Client
Requests
•RAC nodes, Interconnect
•OS Platforms, OS Upgrades
Storage
•CPU, Memory
•Storage
•Etc.
16
Comparison of LoadRunner & DB Replay
Testing e-Business Suite
80
Time Taken (Days)
80
60
24
40
20
20
5
20
4
0
Install & Setup
0
Understand
Application
Usage
0
Identify Key
Transactions
2
Generate
Workload
5
LoadRunner
DB Replay
Run Test
Total Testing Time
DB Replay: 2 weeks
LoadRunner: 30 weeks
17
Why DB Replay?
150
Days
From:
To:
Artificial workloads
Production workloads
Partial workflows
Complete workflows
Months of development
Days of development
Manual intensive
Automated
High risk
Low risk
10
Days
18
Database Replay Workflow
Production (10.2.0.4)
Clients
Test (11.1)
…
Replay Driver
Mid-Tier
…
Storage
Storage
Capture
Process
Replay
Analysis &
Reporting
19
Make Change Safe
• Major online upgrade enhancements
• Online database upgrades for Data Guard Physical Standby
• Physical Standby is Data Guard’s high performance
disaster recovery solution
• Uses new Transient Logical Standby feature for online
upgrades
• Online Database Patching
• For most one-off patches including diagnostic patches
20
<Insert Picture Here>
Automate Still More Administrative Functions
Freeing key personal for higher value tasks!
Why Automate?
•
•
•
•
Free key personal for higher value tasks!
Increased DBA productivity
Reduce risk of DBA errors
Dramatically increase the QOS DBAs deliver
• More proactive management and planning
• Continual optimized performance
• Higher availability
22
Long Term Project
• Goal: Automate all administrative functions
• Over three releases
• Begun in Oracle9i
• Major focus in Oracle Database 10g
• Continued major focus in Oracle Database 11g
• Three step process
• Instrumentation – lays measurement infrastructure
• Advisory – monitors the administrative function, identifies suboptimal behaviors, alerts DBA to problems, and advises on
corrective actions
• Automation – gives DBAs the option to turn on full automation
23
Self Managing Database
Auto-Tuning
Advisory
Instrumentation
24
Self Managing Database
Auto-Tuning
Advisory
Instrumentation
25
ADDM for RAC
Database-Level
ADDM
11g
•
Self-Diagnostic Engine
•
•
•
•
Instance-Level
ADDM
•
Inst 2
Inst 1
AWR 1
Automatic Database
Diagnostics Managers
(ADDM) for Real Applications
Cluster (RAC)
RAC expert in a box
Identifies performance
problems for the entire RAC
cluster database
Database-wide analysis of:
AWR 2
Inst 3
AWR 3
•
•
Global cache interconnect
issues
Global resource contention,
e.g. IO bandwidth, hot
blocks
Globally high-load SQL
Skew in instance response
times
26
Automatic SQL Tuning
Packaged
Apps
Custom
Apps
Auto Capture
High-Load SQL
Nightly
Automatic SQL Tuning
SQL
Profiles
Automatic
implement
SQL
Analysis
• Automatically captures highload SQL
• Automatically tunes SQL by
creating SQL Profiles
• Automatically implements
(optional) greatly improved
SQL plans
• Automatically reports analysis
• Automatically runs during
maintenance window
Report
Manually
implement
Well-tuned SQL
27
Partitioning Advisor
Packaged
Apps
Custom
Apps
SQL Workload
SQL Advisor
SQL
SQL Plan
Access
Structure
Tuning
Analysis
Analysis
SQL
Profile
SQL
Advice
Indexes
& MVs
Well-tuned
SQL &
Schema
New!
Partition
Analysis
Partition
Advice
• Considers entire query
workload to improve query
performance
• Advises on partitioning
methods
• Range (equal-interval), range
key and interval
• Hash, hash key
• Integrated, non-conflicting
advice with Indexes, MVs
28
Automatic Memory Tuning
OS Memory
OS Memory
DB Shared
Memory
DB Shared
Memory
• Automatically adapts to
workload changes
• Maximize memory utilization
• Single dynamic memory
parameter
• Helps eliminate out-of-memory
errors
DB Process
Memory
DB Process
Memory
29
<Insert Picture Here>
Simplify Systems
Simplify Your Information Infrastructure For Maximum Agility and
Lowest Cost!
Old Pre-Grid Infrastructure
DSS
HR
DSS
Standby
HR
Standby
Finance
Finance
Standby
31
The Cost of Same Old Approach
• Poor Resource Utilization
• Built for peak periods
• Gartner estimates average server utilization rate at 5-10%!
• Standby hardware and software costs virtually double the
investment and further reduce useful utilization
• Management happens in silos
• Uneven process maturity across managed silos
• Availability, security, performance
• Increased staff
• Proliferation of tools that have overlapping capabilities
• Software patching/testing, upgrade tasks are multiplied
• Increases information complexity and lowers agility
• More data movement required (i.e. increased latency, increased
storage, increased integrity issues)
32
Oracle Database 10g Database Grid
HR
Financials
DSS
Consolidate Workloads to a Single…
33
Oracle Database 10g Storage Grid
HR
Financials
DSS
Automatic
Storage Management
Low Cost Module Storage
Monolithic Storage
34
Oracle Database 11g Data Guard
• Fundamentally changes the value of
redundant infrastructure
• Can now use Physical Standby for:
• Reporting
• Read only Physical Standby
• Online Upgrades
• Transient Logical Standby
• Testing
• Snapshot Stanby
• Backups
• Fast incremental backups
• Major performance enhancements too
35
Oracle Database 11g SecureFiles
• SecureFiles
• Eliminates need for file systems
• Just as fast as file systems with all the
capabilities of the Oracle Database
• Store all your data in the database with one
consistent:
• Security and auditing model
• Backup & recovery mechanism
• Storage management mechanism (ASM)
• Transaction and concurrency model
• Interface and protocol
• Value added services like encryption,
compression, and de-duplication
36
Oracle Database 11g Partitioning
• Major New Partitioning Enhancements
• One consistent way to manage all your data
• Not just for data warehouse and high-end OLTP any more
• New referential, virtual column, composite, and interval
partitioning features bring partitioning to mainstream
• Easier management of today’s rapidly growing datasets
• Improved performance
• Partition elimination speeds table scans
• Reduced costs
• Automatically place less used data on lower cost storage
37
Oracle Database 11g Partitioning
• Major New Partitioning Enhancements
• Partition by parent / child reference
• e.g., partition orders and order_lines together
• Virtual column partitioning
• e.g., partition on “virtual” order status “active”, “less active”, etc.
derived from multiple status fields in order record
• More composite partitioning options
• List/Range, Range/Range, List/Hash, List/List
• e.g., Order Status/Month, Month/Day
• Automatic interval partitioning
• e.g., create new partition every month
• Single partition transportable tablespace
38
Oracle Database 11g Flashback Data
Archive
• Flashback Data Archive
• Easy, practical way to add “time
dimension” to your data
• For change tracking, ILM,
auditing, compliance, …
• Query data “AS OF” any time in
the past
• Efficient storage / retrieval of
undo data
• Fast query access to very
old data
• Can specified retention policy
to automatically purge old data
Select * from orders
AS OF
‘Midnight 31-Dec2003’
ORDERS
User
Tablespaces
Archive
Tables
Flashback Data
Archive
Total Recall
39
Flashback for Rapid Recovery from
Human Error
Flashback
Query
Flashback
Tables
Flashback
Database
Flashback
Data Archive
and
Transaction
40
<Insert Picture Here>
Enhance Performance
Major New Performance Innovations
Advanced Compression
in Oracle Database 11g
Storage Challenges
• Volume of managed data has exploded recently
• Government regulations (Sarbanes-Oxley, HIPPA, etc)
• User generated content (Web 2.0)
• Mass adoption of rich multimedia content (audio, video, etc)
• IT managers expected to reduce technology budgets
• Need to optimize storage consumption
• Also maintain acceptable application performance
43
Introducing Advanced Compression
• Advanced compression in Oracle Database 11g
•
•
•
•
Structured data compression
Unstructured data compression
Compression for backup data
Network transport compression
• Reduces resource requirements and costs
• Storage System
• Network Bandwidth
• Memory Usage
Redo Logs
Standby
Backups
44
Structured Data Compression
For OLTP and Data Warehousing Applications
• Oracle introduced table compression in Oracle9i Database
• Support for bulk load operations
• Oracle Database 11g extends compression for OLTP data
• Support for conventional DML Operations
• Support for add/drop columns on compressed tables
• Significantly reduces disk space consumption
• Typically 2 to 3x
• Improves the performance of queries
• Up to 2x performance improvements for long running queries
• No uncompression required while reading compressed data
• Completely transparent to applications
45
Unstructured Data Compression
Oracle SecureFiles
•
•
•
•
New feature in Oracle Database 11g
Secure, high performance, storage optimized solution
Documents, spreadsheets, images, multimedia, etc.
SecureFile Compression
•
•
•
•
Automatically determines if SecureFile data is compressible
2 to 3x compression for typical files
Industry standard compression algorithms
Multiple compression levels optimize performance & space
46
SecureFile De-duplication
•
•
•
•
Multiple copies of identical SecureFiles are stored once
Faster performance for writes and copy operations
May improve read performance
Huge reduction in disk space usage
• Great for document management, email archiving etc.
Secure
hash
47
Backup & Network Data Compression
• Data Pump compression
• Compresses data unloaded from the database
• Single step compression of both data and metadata
• Fast Recovery Manager (RMAN) compression
• 40% faster backup compression
• Data Guard network compression
• Compression of redo traffic over the network during redo gap
resolution
• Improves redo transport performance
• Gap resolution is up to 2x faster
48
Advanced Compression
in Oracle Database 11g
• Comprehensive set of data compression capabilities
• Structured, unstructured, backup, network transport
• Reduces storage consumption by 2 – 3 times
• Savings cascades into test, dev, QA, backup, DR
environments
•
•
•
•
Improves application performance
Enhances memory and network efficiency
Complete application transparency
Benefits diverse application workloads
• Transaction Processing
• Data Warehousing
• Content Management
49
Major New Performance Innovations
• SecureFiles
• New generation LOBs just as fast as files
• Table Compression
• Now for OLTP as well as DW applications
• Next Generation RAC Cache Fusion
• Even more scalable
• Query Results caches
• Fast caching of query/function results for read-mostly data
50
Major New Performance Innovations
• TimesTen
• Application tier in-memory database gets even more
compatible with Oracle, more functional, and faster
• And much more …
•
•
•
•
•
•
•
•
Faster Data Guard and Streams replication
Faster PL/SQL and Java (automatic native compilation)
Faster triggers
Faster simple SQL operations
Faster NFS storage access (AutoNFS)
Faster upgrades
Faster backup/restore for large files
Faster backup compression
51
<Insert Picture Here>
Enrich Information Management and Application
Development
Across the board improvements in information management and
application development tools
Information Management Highlights
• Security
• Transparent tablespace and
LOB Encryption
• Business Intelligence
• OLAP integration with
materialized views
• Simplified Data Mining
• Integration
• Faster Gateways
• New mainframe Gateways
• Distributed Scheduler
• XML DB
• Binary XML storage
• Enhanced XML indexing
• Schema evolution
• interMedia
• Comprehensive DICOM medical
imagery support
• 3X faster image processing
• Spatial
• 3D support
• Improved maps
53
Application Development Highlights
• PL/SQL
• Automatic compilation
• Java and JDBC
• Automatic JIT compilation
• “Like JDK” ease of use
• Windows and .NET
• Vista support
• Windows backup (VSS)
• PHP
• Database Resident
Connection Pool
• Application Express
• Microsoft Access application
migration
• Reporting – BI Publisher
• Flash charting
• Declarative “Ajax” support
• WYSIWYG editing
• SQL Developer
• Version Control
• Visual Query Builder
• Migration Workbench
integration
54
Other Oracle Database 11g Highlights
• High Availability
• Automatic Storage Management
• Snapshot Standby
• Rolling upgrades
• Logminer, Physical Standby, Streams
• Automatic bad block repair
support for XMLType, TDE
• Fast disk array resync
• Fast Start Failover with Async
• Preferred read for geo clusters
Propagation
• Manageability and Diagnosability
• Flashback Transaction
• Automatic Health Monitoring
• One step duplicate DB or create
• PL/SQL
standby over the network
• Fine-grained dependency tracking
• Security
• Dynamic SQL enhancements
• Secure By Default
• Performance analysis aids
• Comprehensive Enterprise Manager
support
• Content Management
• Business Intelligence
• Storage & Query of Semantic Content
(RDF, OWL)
• Comprehensive Enterprise Manager
• Secure Enterprise Search connectors
support
• Text improvements
• PIVOT/UNPIVOT operators
55
QUESTIONS
ANSWERS
56