Transcript CON1453_Chatterjee-CON1453_chatterjeex

1
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Deep Dive into Oracle
Exadata Management with
Oracle Enterprise Manager
12c
Deba Chatterjee
Principal Product Manager
Exadata Management
Setup & Monitor
• Discovering Exadata for monitoring
• Monitoring the Database machine
Test
• Consolidate on Exadata
• Validate Application Performance
Manage
• Performance Diagnostics
• Application SQL Tuning
Maintain
• Configuration Compliance
• Patch Automation
3
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Discovery Architecture
1.
OEM Agent deployed on the
Compute Node
2.
Exadata Plug-in deployed with
the Agent
3.
Agent communicates with
Storage Server and Infiniband
Switch targets using ssh.
4.
Exadata Plug-in monitors the
other DBM components
5.
OEM Agent collects data and
uploads it to the Oracle
Management Server (OMS)
4
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
ORACLE DATABASE MACHINE
COMPUTE NODE #1
DATABASE SERVER
1
5
Oracle Enterprise Manager 12c Agent
OMS
2
Exadata Plug-in
3
ssh
Exadata Storage
Server
Exadata Infiniband
Switches and Network
4
snmp
Other DBM Devices
PDU
KVM
ILOM
CISCO S/W
Discovering Exadata in Enterprise Manager 12.1
Install Agent
on Compute
Node
Launch Auto
Discovery
Assign
Monitoring
Agents
Component
Credentials
Monitoring
Properties
Review
• Wizard driven guided discovery now significantly faster (10x) than 11g
• Exadata Cell and the Infiniband components discovered out-of-the box
• Exadata Plug-in bundled for all other targets (viz. KVM, PDU, Cisco Switch)
• Option to Discover New DB Machine or rediscover – Add DB Machine Members
5
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Exadata Monitoring
Database
Storage Server
Infiniband Network
KVM, PDU, ILOM, CISCO
SWITCH
6
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Exadata Management
Integrated View of Hardware and Software
• Hardware view
- Schematic of cells, compute nodes and
switches
- Hardware components alerts
• Software/system view
- Performance, availability, usage by
databases, services, clusters
- Software alerts db, cluster, ASM
- Topology view of DB systems/clusters
• Configuration view
- Version summary of all components
along with patch recommendations
7
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Storage Cell Management
• Storage Cell monitoring and
administration support
– Cell Home page and
performance pages
– Actions supported: Start/stop
Cell, verify connectivity, setup
SSH
• Automatic discovery of Exadata
cells
• Management by Cell Group
– All cells used by a database
automatically placed in a
group
– Cell Group level administration
operations
8
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Storage Cell Management
• Perform Cell Administration tasks
– Execute Cellcli commands on a set of cells or all cells
• Setup IORM for database targets
– Monitor workloads from multiple databases
9
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Infiniband Network Management
• Infiniband network and switches as CC
targets
- Automatic discovery
• Network home page and performance page
-
Real time and historical
• Topology view of Network with switch and
port level details
10
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
• Full monitoring
- Alerts (switch generated and EM
generated)
- Performance metrics
- Configuration metrics – detect and
notify configuration changes/best
practice violations
Infiniband Network Management
• Perform Infiniband Administration tasks
- Enable Port
- Disable Port
- Clear Performance counters
- Clear Error Counters
11
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Monitoring: ILOM, Cisco Switch, KVM
Common metrics monitored
• Power supply failure
• Fan failure
• Temperature out of range
Specific metrics monitored
• Cisco Switch
- Configuration change tracking and reporting
- Unauthorized SNMP access
• Keyboard, Video, Mouse (KVM)
- Server connected to KVM added/removed, powered on/off
12
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Exadata Dashboard
 Script provided for creating dashboard
to monitor performance and usage
metrics
– Database Machine System
How do you create the dashboard ?
1.
Execute job “Dashboard job” in Enterprise
Manager 12c PS1
2.
Go to the following directory:
– Database Machine components
 Give examples
13
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
/opt/Oracle.SupportTools/emkit/exadata/dashboard/
perl DashbaordOperations.pl
Exadata Healthchecks Plug-in
Software Checks
Operating
System
Firmware
Clusterware
ASM
Database
Hardware
Database Server
Infiniband
Exadata Storage Servers
Configuration Best Practices
Operating System
Clusterware
ASM
Infiniband
Other Best Practices checks
RAC
14
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Exadata MAA
• Based on exachk
(1070954.1) utility
• Pre-Installed in Exadata
deployments
• Audits configuration
settings of the following
categories
• Software
• Hardware
• Configuration Best
Practices
When should you execute exachk ?
• After initial Oracle Database
Machine deployment
• Before planned maintenance
activities
• After planned maintenance
activities
• At least every three months
as part of regular operational
procedures and at times of
least load
15
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Metrics
X2-2
V2
X2-8
Compute
Node Level
94
118
56
DB level
52
58
44
Cluster wide
Level
11
19
1
Storage
Server Level*
25
44
19
IB level*
11
11
11
Total
193
250
131
* Checks are skipped in silent mode due to access constraints
3
Exadata Health Check Execution Model
EM 12c Agent
Execute Exachk
(2.1.3 and above)
Execution Output
Console
Exadata Health
Checks Plugin
XML
XML
XML
Metric Evaluation
OMS
• Exadata Healthchecks plug-in consumes the exachk output
• Evaluates the output against pre-defined health check templates
• Generates relevant alerts
16
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Raising Alerts Automatically
Exadata health-check plug-in is designed to raise alerts for
the following checks automatically :
•
Database Server
• Disk Cache Policy.
• Disk controllers using write back cache.
• RAID Controller Battery Condition
• RAID Controller Battery Temperature (database
server).
• Virtual Drive Configuration.
• Physical Drive Configuration.
• Exachk not running.
• Results and Exception file(s) missing.
Add more alerts via the health-check monitoring templates.
17
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Softcell Technologies Ltd. Improves System
Performance by More Than 100%
COMPANY OVERVIEW
CUSTOMER PERSPECTIVE
• Provides customers with a variety of Infrastructure as a
“Oracle Exadata offered better and more reliable
performance than other products. We have
improved system performance by more than
100%, reduced hardware licensing costs by 70%,
and compressed data storage by 10x.”
Service and Software as a Service options
• Industry: High Technology
• Employees: 350 Revenue: US$29 million
CHALLENGES/OPPORTUNITIES
• Remain competitive in a growing IT services market
• Ensure impeccable data security, 24/7 availability, and
efficient system administration and customer support
• Cut the time staff spent double-checking system and
application performance reports and reduce external
auditing requirements
SOLUTIONS
• Oracle Exadata Database Machine
• Oracle Enterprise Manager 12c
18
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Shrinivas Patankar, General Manager
RESULTS
• Improved customers’ system and application
performance by over 100%
• Lowered hardware licensing costs by 70%
• Installed new customers’ systems and
applications in less than an hour, compared to
two days, previously
December 2012
Exadata Management
Setup & Monitor
• Discovering Exadata for Monitoring
• Monitoring the Database Machine
Test
• Consolidate on Exadata
• Validate Application Performance
Manage
• Performance Diagnostics
• Application SQL Tuning
Maintain
• Configuration Compliance
• Patch Automation
19
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Deployment Challenges
Will
performance
improve?
How long will it
take?
What are the
risks?
Applications
Database
Which apps
to consolidate?
Storage
OS
• Deploying application to Exadata involves multiple changes:
– O/S migrations
– Storage subsystem changes
– Database upgrades
– Single database instance to RAC
• Proper testing required for risk mitigation.
20
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Deploying Applications on Exadata
Identify
Applications
Create Test
Environments
Validate
Performance
•
Migrating applications to Exadata can be a very time consuming
•
Three step process
– Identify which applications to be migrated to Exadata
– Create test environment on Exadata
– Validate application performance
21
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Consolidation Planner
•
Target resource utilization and configuration
data extracted from Enterprise Manager
repository
–
•
CPU, memory, storage, network
Administrator specifies servers and
constraints for workload migration
•
–
Physical/virtual servers
–
Existing/planned servers
–
Business/technical constraints
Reports detail how consolidated workloads
would perform on target servers
22
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Validate Application Performance
End-to-end testing with real workloads
Capture
Workload
Replay
Workload
Create Test
System
Deploy Replay
Clients
• Database Replay
• SQL Performance Analyzer
– Load, performance testing for throughput
– SQL unit testing for response time
– Remediate application concurrency problems
– Identify and tune regressed SQL
– Integrated with Oracle Application Testing Suite for
– Integrated into SQL Tuning Advisor and SQL
superior comprehensive testing solution
Plan Baseline
• Seamless integration with Data Masking to preserve data sensitivity compliance
23
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
TEI Study Findings Summary
Oracle Real Application Testing
 Organizations that implemented
RAT should see significant savings
in
Increased DBA productivity up to $4.8 m
over 3 years
5
4
3
Increased availability and uptime of
business applications by proactively
identifying issues
2
Reduced capital expenditure by 50% over 3
year period
0
 ROI achieved
24
$(M)
Risk-adjusted: 224% ROI over 3 years, 5.9
months payback period
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Year 3
Year 2
Year 1
1
Productivity Gain
Reduced capital
expenditure
(Excludes $20,655
annual business up
time savings)
Exadata Management
Setup & Monitor
• Discovering Exadata for monitoring
• Monitoring the Database machine
Test
• Consolidate on Exadata
• Validate Application Performance
Manage
• Performance Diagnostics
• Application SQL Tuning
Maintain
• Configuration Compliance
• Patch Automation
25
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Integration with the Database Performance Page
 Drill down from
database Performance
page
• Provides composite
view of all health
indicators of a cell or
cell group
• Helps triage
• Load imbalance
• ASM related
problems
• Cell software or
hardware failures
• Cell configuration
issues
• Network related
failures
26
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Performance Diagnostics and Tuning
Boost Administrator
Productivity
IO / CPU
Issues
Eliminate Performance
Bottlenecks
High
Load
SQL
Automatic Workload
Repository Snapshots
•
•
•
•
•
•
27
Self-Diagnostic
Engine (ADDM)
RAC
Issues
Lower IT Management
Costs
Performance &
Management
Advisors
Deliver Higher Quality of
Service
Oracle Database 11g’s Automatic Performance Diagnostics helps maximizes Exadata performance
Top-down performance analysis using Automatic Workload Repository
Real-time performance analysis with Automatic Database Diagnostic Monitor
Resolve performance issues faster with drill-down root-cause analysis
Classification tree based on Oracle performance tuning expertise
Fully automates database performance diagnostics
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Performance Diagnostics and Tuning
Gather Missing or Stale Statistics
Create a SQL Profile
SQL Profiling
Add Missing Access Structures
Statistics Analysis
Modify SQL Constructs
Access Path Analysis
SQL Restructure Analysis
Alternative Plan Analysis
Parallel Tuning
Query Analysis
Automatic
Optimizer
Adopt Alternative Execution Plan
SQL Tuning
Advisor
Create Parallel SQL Profile
Administrator
Comprehensive SQL Tuning
Recommendations
• Automatic SQL Tuning
– Analyze high-load SQL  tune using SQL Profiles  implement improved SQL plans (optional)
• Comprehensive SQL analyses across 6 dimensions: statistics, SQL profiling, index, alternate plan,
parallelization and SQL structure
• SQL Profiles tunes execution plan without changing SQL text
• Enables transparent tuning for packaged applications
28
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Exadata Aware SQL Monitoring
• Real time monitoring of
application SQL
• I/O performance graphs with
Exadata information
– Cell offload efficiency
– Cell smart scan
• Rich metric data
– CPU
– I/O requests
– I/O throughput
– PGA Usage
– Temp Usage
29
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Reduce Performance Management Costs
Forrester Total Economic Impact of Diagnostics and Tuning Packs
• Increased DBA Productivity
• Reduced system downtime
& increased availability
• Reduced capital spending
on servers
30
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Exadata Management
Setup & Monitor
• Discovering Exadata for monitoring
• Monitoring the Database machine
Test
• Consolidate on Exadata
• Validate Application Performance
Manage
• Performance Diagnostics
• Application SQL Tuning
Maintain
• Configuration Compliance
• Patch Automation
31
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Root Cause Analysis of Hardware Problems
• Topology View of all Exadata components by
– Uses
– Used By
– System Members
– DB Machine Software
• Enables out of the box root cause analysis of issues.
32
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Defect Diagnostics
 Support Workbench
– Exadata integrated with Database defect diagnostic framework
– Support Workbench provides viewing and packaging of incidents
– Correlated packaging from DB through ASM to Exadata
•
Incident Management
– Software and hardware incidents tracked via Incident Console
– Track, manage and resolve critical incidents
– Hardware alerts (temperature, cell down, power supply,
etc.)
– Hardware failures come with picture indicating failed part
location
– Best practice violations automatically alerted
33
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Maintain
Fault Diagnostics: ASR Flow
Customer Data Center
FRU replaced by
Field Engineer
Oracle Field
Engineer
!
FRU
dispatched
by Support
Engineer
Fault occurs
SR routed
to Support
Engineer
Customer
SR creation email
notification to customer
ASR
Fault telemetry securely
Manager
transmitted to Oracle
Product’s auto-diagnosis
facility sends SNMP trap to
ASR Manager
34
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Comprehensive
Fault Coverage
Oracle Support Services
ASR
Service
Service Request
created
•
•
•
•
•
•
•
•
•
•
•
CPU
Disk controllers
Disks
Flash Cards
Flash modules
InfiniBand
Cards
Memory
System Board
Power supplies
Fans
Configuration Management
Enforce Standards
Eliminate Drift
Automated Configuration Management
• Enforcement of Exadata configurations using Policies
• Detection of configuration drifts and changes
– From defined golden standards
– Between storage servers and between database machines
• Detect database targets that do not have required patches
35
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Configuration Management
Compare between Oracle Database Machines
• Gold Image Comparison
• Baseline vs. Current
• Multiple DB Machines
36
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Automating Database Infrastructure Patching
Fully Integrated with My Oracle Support
Analyze
Patch
Test
Stage
Provision
Report
• Proactive advisories, recommendations, and analysis
– One-off patches, patch set updates, and critical patch updates
• Zero downtime for patching
• Integrated patch management & deployment automation
• Patch intelligence and community
• Streamlined conflicts and merge patch process
• “Patchmgr", a command line tool, is used to patch the Storage Cells from the Compute Nodes .
37
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Oracle Exadata Database Machine
Extreme ROI Platform
Fast
Predictable
Performance
Maximize database
performance
with automated
diagnostics & tuning
38
Lower
Ongoing
Costs
Fastest Time
to Value at
Lowest Risk
Drive down IT operational
costs with
automated change and
configuration mgmt
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Automate testing of
patches, changes and
upgrades while keeping
data secure
Oracle Enterprise Manager
Proven Solution. Trusted by Customers.
39
Ensures seamless user
experience for
50,000,000 users
Saves weeks on
application testing time
Saves 80% time and effort
for managing Databases
90% of IT issues
addressed before they
impact users
Drives asset utilization
up by 70%
Cuts configuration
management effort by 90%
Saves $1.9 million with
Oracle Enterprise Manager
Saves $170,000 per year
with Oracle Enterprise
Manager
Replaces manual tools
with automation; saves
time by 50%
Reduces Database
testing time by 90%
Reduces provisioning
effort by 75%
Deploys SOA
infrastructure 92%
faster
Cuts application testing
from weeks to hours
Reduces critical patching
time by 80%
Delivers 24/7 uptime with
Oracle Enterprise
Manager
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Enterprise Manager at OpenWorld 2013
Session Title
CON1452
CON1590
Advanced Database Performance Analysis Techniques Using SQL Performance
Analyzer
DBA's guide to Data Masking and Data Subsetting
CON1628
Best Practices to Monitor and Manage WebLogic Server: Development to Production
CON1450
CON1589
CON1603
CON1451
Extreme Database Management with the Latest Generation of Database Technology
Advanced Management of Oracle Applications Unlimited and Fusion Applications
Application Performance Matters – Oracle Real User Experience Insight
Zero to Cloud in Hours with Oracle Enterprise Manager 12c
Oracle Performance Tuning Boot Camp: 10 New Problem-Solving Tips Using ASH &
AWR
Managing Heterogeneous Environments with Oracle Enterprise Manager
Oracle's Approach to Application and Infrastructure Testing
Oracle Enterprise Manager DBaaS: Database, Schema, or Terabytes of Data in
Minutes
Deep Dive into Exadata management with Oracle Enterprise Manager 12c
CON1587
CON1604
CON1588
CON1719
CON1453
GEN11423 Total Cloud Control: Oracle Enterprise Manager 12c Overview
CON1602 What's New in Oracle Exalogic Management?
CON1454 Database Lifecycle Management with Enterprise Manager 12c
40
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Date/Time
Tuesday , Jul 23, 2:15 PM , Room 426
Tuesday , Jul 23, 4:45 PM , Room 509
Wednesday, Jul 24, 12:00 PM , Room
420/421
Wednesday,
Wednesday,
Wednesday,
Wednesday,
Jul
Jul
Jul
Jul
24,
24,
24,
24,
12:00 PM , Room 431
12:00 PM , Room 509
2:00 PM , Room 509
2:00 PM , Room 617
Wednesday, Jul 24, 3:15 PM , Room 509
Wednesday, Jul 24, 5:15 PM , Room 509
Wednesday, Jul 24, 8:45 AM , Room 509
Wednesday, Jul 24, 8:45 AM , Room 61
Thursday , Jul 25, 12:00 PM , Room 42
Thursday , Jul 25, 2:00 PM , Blue Hall
Thursday , Jul 25, 9:00 AM , Room 509
Thursday , Jul 25, 9:00 AM , Room 617
41
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
42
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.