Transcript Business Availability Center

Business Availability Center
Architecture Overview
BUSINESS AVAILABILITY CENTER OVERVIEW
BAC Overview
BAC provides:
• Performance and application monitoring
• End-user management
• IT infrastructure availability management
• Service-level management
• Configuration management
• Composite application diagnostics
• Business Transaction Management
• Business Process Management
• Problem isolation
• Vertical solutions management – SOA, Siebel, SAP
2
Business Availability Center
Architectural Overview
Middleware
J2EE, .NET
CICS /MQ/Tibco/Sonic
End
Users
Business Process
Monitor –
Synthetic Enduser simulation
Internet/
Firewall
Application Aware
Network
Management –
relating the
application to the
network (Network
Node
Manager/RUM)
BAC Dashboard
• Problem Isolation Tools
• Service Level Management
• Topology Views
• Detailed Reporting
• Alert Notifications
• Web-based Administration
33
August 11, 2008
Lan/network
User/Web
front-end
Services
Discovery &
Dependency Mapping
– population of
UCMDB for services,
infrastructure and
related dependencies
Business
Availability
Center
Middleware
RUM/BPI /TV and
Diagnostics collect
information about
real users, business
processes and
transactions
Backend and
Data
Agents /Agentless
(OPC/ SiteScope)
– Infrastructure
Monitoring
including EMS
integrations
Universal CMDB
BAC Architecture
Diagnostics
SiteScope
EMS Tools
4
BPM
RUM
Diagnostics
BPI
BPI
TV
TV
BAC ARCHITECTURE
BAC Data Collectors
Discovery Probe: Discovers the IT
infrastructure and collects the
topology information
BPM: Proactively measures
the end-user experience by
executing controlled,
repeatable transactions from
multiple locations
Diagnostics: Monitors J2EE and
.NET application performance and
bottlenecks in real time using a
probe on the application server
BPI: Provides visibility into
the health and performance
of business processes that
are running over the IT
infrastructure
RUM: Measures the
online experience and
behavior of the users
from across the
enterprise
Diagnostics
TV: Tracks business
transactions as they
progress through the
enterprise.
SiteScope: Collects key performance
measurements for a wide range of
back-end IT infrastructure components.
SAM provides centralized
administration and reporting for
SiteScope instances.
SiteScope
EMS Tools
5
BPM
RUM
Diagnostics
BPI
BPI
TV
TV
BAC ARCHITECTURE
BAC Servers
Gateway Server: Runs the BAC
application, handles reporting,
administration console, receives data
from data collectors and distributes it to
the BAC Data Processing server and
the Database server
Data Processing Server: Aggregates
data, runs the online and offline
Business Logic Engines (BLEs), and
controls the CMDB. The online BLE
calculates the Dashboard views in real
time. BLE calculates SLAs and
reports.
Database Server: Stores system-wide
data, management-related data,
topology data, and profile data
Diagnostics
EMS Tools
Mail Server
SNMP Server
SiteScope
EMS Tools
6
BPM
RUM
Diagnostics
BPI
BPI
TV
TV
BAC ARCHITECTURE
Third-Party Servers and Tools
Mail Server: Sends alerts and
scheduled reports to designated
recipients
SNMP Server: Receives SNMP traps sent by
the BAC alerting mechanism
Diagnostics
EMS Tools: Integrates data from EMS
applications and servers into BAC server and
sends data from BAC server to the EMS
servers by using the generic data engine
application programming interface (API) and
EMS adapters
SiteScope
EMS Tools
7
BPM
RUM
Diagnostics
BPI
BPI
TV
TV
BAC ARCHITECTURE
BAC Data Flow
Diagnostics
SiteScope
EMS Tools
8
BPM
RUM
Diagnostics
BPI
BPI
TV
TV
Data Collectors Overview
9
BAC ARCHITECTURE
Introduction to Data Collectors
Business Process Monitor
Real User Monitor
SiteScope
Diagnostics
TransactionVision
Business Process Insight
Discovery Probe
10
DATA COLLECTORS OVERVIEW
Business Process Monitor
11
•
Installed on host machines located on network or on the internet at global locations
•
Use a recorded script to run synthetic transactions
•
Send the collected data to BAC
•
Use the HTTP(S) protocol for collection & configuration
•
Run independently as a service on the host machine
DATA COLLECTORS OVERVIEW
Real User Monitor
RUM probe:
• Passively monitors the
requests and responses sent
to and from a monitored Web
server
• Monitors HTTP(S) and TCP/IP
protocols
RUM engine:
•Configures the RUM Probe
•Receives data collected by the RUM probe using SSH
•Filters information based on configuration
•Stores data samples in a database
•Sends page, transaction, user, server data samples to BAC over HTTP(S)
MySQL database:
Provides a repository for RUM data
Stores session details, and session summary
12
DATA COLLECTORS OVERVIEW
SiteScope
Monitors infrastructure components
• Servers, network elements, application services - Weblogic, Websphere, Oracle, SOA
• Uses many standard protocols for monitoring:
• Uses HTTP(S) to communicate metrics back to BAC
• SiteScope interface can be accessed over ports 8888 and 8080.
Other Sitescope roles:
• Integration gateway for External Monitoring Systems (EMS)
• Automatically deploys monitors for newly discovered CIs
• Validates problem isolation issues via on-demand-monitors
• Acts as system health using preconfigured built-in monitors for BAC
13
DATA COLLECTORS OVERVIEW
Diagnostics Monitor
Diagnostics Probe:
• Installed on the customer’s
Java, J2EE or .NET
application servers.
• Observe user activity at
the class, method and
JDBC/ADO call level
Diagnostics Server:
• Can control multiple
diagnostic probes
• Integrates with BAC and
Quality Center
Diagnostics Collector:
• Supports remote
collection of metrics from
SQL Server (2005 only)
and Oracle 10g Database,
WebSphere MQ and SAP
NetWeaver - ABAP system.
14
Diagnostics Profiler:
• Monitor hotspots, exceptions, threads,
stack traces, method latency in real time.
• Monitoring Application Memory
• Light Weight Memory Diagnostics
• Heap Breakdown
DATA COLLECTORS OVERVIEW
TransactionVision
Main Features:
• Transaction tracking solution that graphically shows you the interaction between all
components of your system
• Non-intrusively records individual events flowing through a computer network
• Patented algorithm assembles events into single, coherent business transaction
• Graphical analysis tools enable users at various levels to get the information they need
15
DATA COLLECTORS OVERVIEW
Business Process Insight (BPI)
• Up-to-the-minute view into
•
•
•
•
the health, performance &
effectiveness of a business
process or process segment.
Based on real business
transactions providing ability
to drill into specific process
instances (e.g. orders,
trades or payments)
Automatically track and
escalate against business
level KPIs & service
objectives for business flow
rates, timings and backlogs
Translate IT service impact
into business (financial)
impact information
Allow business users to
improve the effectiveness of
their business processes
16
DATA COLLECTORS OVERVIEW
Discovery Probe
•
Dynamically discovers and maps IT service
dependencies to provide visibility and control
over business services with minimal effort
and cost
Populates the HP Universal CMDB to create
an accurate model
Uses spiral discovery processes
Object-oriented, allowing specific CIs to be
discovered using a library of discovery
patterns that can capture:
–High-level applications and their
components like SAP, Siebel, Citrix and
MQ Series J2EE or .NET components and
interdependencies
–Database components such as
tablespaces, users and jobs
–Software assets such as installed
products and patches
–System resources such as servers,
CPUs, memory, network interfaces and
storage devices
–Network devices such as routers,
switches, load balancers, switch ports,
VLANs and firewalls
•
•
•
17
CHAPTER REVIEW
Data Collectors Review
18
Data Collectors
Functionality
1. BPM
A. Emulates user experience with the application by running transactions and
collecting application availability and response time data.
2. RUM
C. Tracks the experience of end users with the application and collects availability
and response data in real-time.
3. SiteScope
D. Monitors the application infrastructure and collects network and server
performance data in real time.
4. Diagnostics
B. Collects key performance measurements for J2EE and .NET applications at the
class, method and JDBC call level
5. TransactionVision
E. Provides visibility into the health and performance of business processes that are
running over the IT infrastructure
6. Business Process
Insight
F. Provides visibility into the health and performance of business processes that are
running over the IT infrastructure
7. Discovery Probe
G. Discovers hardware, network and application infrastructure components and the
relationship between them and populates the Configuration Management Data
Base (CMDB)
Universal Configuration Management
Database - UCMDB
19
Universal CMDB
Automated and integrated Universal CMDB and Application
Mapping
Key Benefits:
•
•
•
•
Understand and visualize how IT infrastructure
delivers business services
Gain visibility and control over changes to business
services
Improve business agility by proactively analyzing
change impact
Smart, topology-based monitoring reduces
likelihood of spurious alarms
Key Capabilities:
•
•
•
•
Automatically discover and map business services
and its infrastructure (Layers 2-7)
Gather deep configuration detail and track
configuration change history
Topology Query Language to automatically create and
maintain business service maps
Correlation rules to assist in business impact analysis
20
ITSM and ITIL
Ensure ITIL alignment and improve productivity
Key Benefits:
•
Improve agent effectiveness and first call resolution
•
Reduce service resolution times and improve
incident prioritization
•
Enhance problem management process
effectiveness
Key Capabilities:
•
•
•
21
Common CI definition provides help desk agents and
IT Operations a consistent view
Business service views enable agents to prioritize and
route calls appropriately
History of CI changes enables quick recognition and
correlation to previous problems/incidents
HP Universal CMDB & Application Mapping
Reporting
(Change, comparison, gold masters, statistical, etc.)
Application Software map
TQL – Smart Mapping
Repository
Model
Federation
Other repositories
Discover
Topological data model
Reconciliation
Enrichment
Impact rules
Change tracking
HOST/NETWORK
SOFTWARE
BUSINESS APPLICATIONS
STORAGE
Security
22
•
Authentication
•
Alerts/Notification
•
Scheduler
Web Services based SDK
Network map
Map
Composite application map
Administration
Other
discovery
sources
Impact analysis
Knowledge Modules (SAP, Siebel, Custom applications, etc.)
Act
How it works
Federation with authoritative repositories
Business Avail. Center
ServiceCenter
AssetCenter
Improve availability,
prevent problems
Reduce MTTR, minimize
support costs
IT financial management,
sw/hw asset management
Operational KPIs, enduser performance
Process artifacts, RFCs,
incidents, problems
Contracts, ownership,
financial, licenses etc.
Change & Config Center
SOA Center
Business Services based
configuration mgmt.
Identify rogue web
services, map services
Policies, release process
artifacts and DSL
Operations Center
Monitor health and
performance, filter events
Performance metrics, deep
configuration data
23
HP Universal
HP
CMDB
UNIVERSAL
CMDB
CIs, CI attributes,
relationships,
business services
Third party products
Leverage domain specific meta
data, process outcomes
SOA library, policies,
performance KPIs
Network Mgmt. Center
Optimize network avail.,
performance & bandwidth
Network performance,
configuration data
UCMDB IN BAC
CI Relationships
24
Discovery – Process,
Packages and
Patterns
25
DISCOVERY – PROCESS, PACKAGES AND PATTERNS
Methods for Populating UCMDB
26
DISCOVERY – PROCESS, PACKAGES AND PATTERNS
Overview of the Discovery Process
The discovery process is an ongoing, automatic process that
continuously detects changes in your IT infrastructure and updates
CMDB accordingly.
• The spiral discovery continues until your entire IT infrastructure is
discovered and mapped.
CIs
27
CIs
DISCOVERY – PROCESS, PACKAGES AND PATTERNS
Components of the Discovery Architecture
28
DDM Workflow
Service View
1. Discovery & Dependency Mapping
Service
Applications
• Performs dynamic discovery
Hosts
• Populates the CMDB with CIs and Relationships
End User
Experience
Resources
SLM
Dashboard
Business Availability
Center
UCMDB
Model of the service
based on CIs and
relationships
DDM
Operations
Manager
Element
Managers
Infrastructure
29
29
17 July, 2015
UCMDB
DISCOVERY – PROCESS, PACKAGES AND PATTERNS
Run Discovery
30
Views
31
VIEWS
UCMDB Views
In BAC, you can create a Pattern View:
• A Pattern View is a view based on a query for extracting information
from CMDB and created from CI types, the result of a TQL query
– You create a pattern view if you want to dynamically update the view with
changes in UCMDB.
– A pattern view updates itself dynamically – as new configuration items or
changes that match the pattern are updating the UCMDB they are added to
the view
– E.g.: all <UNIX servers connected to a win server running a Weblogic
application> [this is a pattern]
32
Role based views
Service
Applications
User Experience KPIs
Hosts
Events
33
33
Resources
17 July, 2015
VIEWS
Introduction to Topology Query Language - TQL
A pattern view is the result of a TQL query that is executed for
extracting information from UCMDB.
• TQL is a language and tool for discovering, organizing, and managing IT
infrastructure data.
• TQL example: return all Unix hosts running an Oracle DB [on port 1522]
34
Dashboard
35
DASHBOARD
Dashboard Overview
Dashboard – displays operational views
View – a way to organize data in a business meaningful way
•
•
•
•
Line of Business – e.g Consumer Banking
Data center – Austin Data Center
Applications – Bill Payment, Funds Transfer, SAP
Custom – all Oracle database servers
Views are fully configurable
• KPIs – Define goals and objectives based on metrics
• Status – condition of a metric in relation to thresholds
(e.g.
performance [KPI] >99.5% [threshold] -> Status = green)
• Business Rules – calculate the status of KPIs. Create your own rules
(e.g. percentage, worst/best child, etc..). Define propagation
• Alerts – triggered when a node in the view meets preset conditions (e.g.
availability [KPI] < 99.2% [threshold] more than 30 minutes)
36
DASHBOARD
The Top View Tab
Root
CI
Child CI
KPIs
Tooltip
37
DASHBOARD
The Console Tab
KPIs
CIs
38
Status trend &
history indicator
How it all fits together
Web Data Entry
Dispatcher & Loader
Bus
Authentication & Authorization
BAC Dashboard (BAC
applications/Admin & Config)
Service View
Service
Applications
End Users
User Experience KPIs
Hosts
Handles incoming/outgoing
requests
Dashboard
Resources
Events
Part of Gateway
Server
Data
Collector
s
Model of the service
based on CIs and
relationships
Gateway
Server
Data Processing
Server
UCMDB Service
Adapters Framework
Online Business Logic Engine
Offline Business Logic Engine
Offline Aggregator
System Health
Alerts Engine
UCMDB
Business Availability Center
Adapters & discovery
populate the UCMDB
DDM
39
Email/
opcmsg
UCMDB
Service Level
Management - SLM
Metrics
40
SLM
Overview of Service Level Management
SLM is used to:
• Manage service levels with the service providers
• Determine compliance with your SLAs
• Compare KPIs such as availability and performance with
defined service levels
• Applying ITIL concepts to manage and deliver services
effectively
• Improve business processes
• It should not be used for finger pointing
41
SLM
Best Practices for Implementing SLM
The best practices that you can use to implement
SLM are:
• Determine a baseline for performance and availability.
• Identify the risks or incidents associated with agreeing to
service levels.
• Define a set of internal and external incident priorities.
• Establish an escalation path for each incident priority.
• Baseline the customer perception of the service levels.
• Identify all internal and external suppliers and service
providers.
• Understand and communicate the benefits of the SLA to all
stakeholders, such as the IT service manager and service
level manager.
42
SLM
Building a Service Model
The following steps are involved in building a service
model:
• Define a business unit.
• Define a service.
• Add monitors CIs to the created service.
43
SLM
Types of SLM Reports
SLM provides the following types of reports:
• Status Snapshot
• SLA Reports
• Outage Reports
• User Reports
44
SLM
Generating Status Snapshot Report
45
SLM
Generating CI Status Report
46
Problem Isolation
47
Overview of Problem Isolation
Problem Isolation delivers:
•
Integrates with HP Universal CMDB to link end-user
problems with the underlying infrastructure
•
Provides a central place to view critical information about
problems and reduces manual correlation to improve
MTTR
•
Places systems information in a defined context for faster
troubleshooting
Performs real-time problem validation and provides
recommendations and advanced analysis
•
•
48
Provides automated data collection for tier one
Problem Isolation
Reactive and proactive analysis
Key Benefits:
•
Ensure problem ownership and improved
real time communication
Reduce manual troubleshooting through
advanced analysis tools
Empower users to isolate performance
problems in composite environments
Triage problems in production via a single
unified UI
•
•
•
Reactive
Analysis
Proactive
Analysis
Key Capabilities:
•
Automatic correlation of end-user problems
and underlying infrastructure issues
Analysis of changes for improved suspect
identification
Automatic identification of end-user behavior
anomalies
Automatic deployment of ad-hoc monitors for
additional decision-supporting information
•
•
•
49
49
17 July 2015
EUM Monitoring
Principles
50
EUM Walkthrough
Service View
3. End User Experience
Service
Applications
• Passive and active monitoring of user experience KPIs
• KPIs update the status in the CMDB and service view
End User
Experience
Hosts
Events
SLM
User Experience KPIs
Resources
Dashboard
Business Availability
Center
UCMDB
Model of the service
based on CIs and
relationships
DDM
Operations
Manager
Element
Managers
Infrastructure
51
UCMDB
BAC ARCHITECTURE
The BAC Workflow - Onboarding
52
OVERVIEW OF MONITORING
Monitoring
Infrastructure
• Servers – up/down, CPU, memory, disk
• Network – availability, packets lost, routing tables
• Services – queue length, availability, DNS, FTP, SMTP
End User
• How does the user perceive the application
• Measure business impact
Server down – not a problem with load balancing
System slow – user takes business somewhere else
BAC = all about the end-user, different paradigm
53
CHAPTER SUMMARY
Monitoring Key Points
Plan for monitoring
• Decide
• Applications and infrastructure to be monitored
• Locations to be monitored
• Frequency of monitoring
• Monitoring goals.
• User roles and backgrounds – operations vs. business
• Identify the critical business process and business
process steps to be monitored.
• Identify the user tasks
• Identify integration points into customer processes
54
OVERVIEW OF MONITORING
Introduction to Business Processes
End User Monitoring is based on Business Processes
55
End-User
Management (EUM)
Reports
56
BAC ARCHITECTURE
The BAC Workflow – End User Management
57
EUM REPORTS
Types of EUM Reports
58
EUM Reports
59
Vertical Solutions
- BAC for SAP
- BAC for Siebel
- BAC for SOA
60
VERTICAL SOLUTION CONCEPTS
Vertical Solution Components
Vertical Solution – a management solution for a specific type or set of
application
• E.g. Siebel, SAP, SOA
Solution specific (out-of-the-box) monitoring protocols
• E.g. SOAP for SOA and Web Services
Solution specific monitoring templates
• UDDI for SOA
• SARM for Siebel
Solution specific discovery patterns
Solution specific views for discovered information
• Siebel hosts
• Well behaved and rogue web services
Solution specific integrated reporting
• BAC for Siebel
• BAC for SAP
• BAC for SOA
61
VERTICAL SOLUTION CONCEPTS
Customization
Supply custom-made capabilities in discovery, monitoring and
views
Encapsulate domain expertise for the specific environment
• RUM - meaningful URL (Siebel)
• Discovery of changes (SAP)
• Discovery of Web Services (SOA UDDI)
Utilize and integrate with solution-specific tools
• SARM (Siebel)
• TMS (SAP)
• UDDI (Systinet)
62
VERTICAL SOLUTION CONCEPTS
Best Practices
Incorporate best practices in generic BAC tools
• SiS solution templates
Document system-specific “how-to”
• Configuring SARM (Siebel)
63
VERTICAL SOLUTION CONCEPTS
Architecture - General
System Monitoring,
WS Synthetic Transactions
RUM
Probe
Real User Monitoring
WS
Discovery
RUM
Engine
AS
DB
Topology
BAC for vertical
solution
Changes
Application
Mapping
64
Diagnostics
Probe
Typical Application
Under Test (AUT)
Siebel/SAP/SOA
Discovery
Probe
SiteScope
Real User
Monitoring
Diagnostics
Engine
End User
Monitoring
Business
Process
Monitor
VERTICAL SOLUTION CONCEPTS
Architecture – BAC for Siebel
System
Monitoring
RUM
Probe
Real User Monitoring
SiteScope
Siebel Diagnostics
WS
GW
AS
Discovery
DB
Siebel Enterprise
7.5.3/7.7/7.8
SARM, DB
Breakdown
Discovery
Probe
RUM
Engine
Topology
BAC for Siebel
Application
Mapping
65
End User
Monitoring
Changes
Business
Process
Monitor
VERTICAL SOLUTION CONCEPTS
Architecture – BAC for SOA
System Monitoring,
WS Synthetic Transactions
RUM
Probe
Real User Monitoring
WS
Discovery
RUM
Engine
AS
DB
Topology
BAC for vertical
solution
Changes
Application
Mapping
66
Diagnostics
Probe
Typical Application
Under Test (AUT)
Siebel/SAP/SOA
Discovery
Probe
SiteScope
Real User
Monitoring
Diagnostics
Engine
End User
Monitoring
Business
Process
Monitor
Solution Walkthrough
67
Solution Workflow
Service View
1. Discovery & Dependency Mapping
Service
Applications
• Performs dynamic discovery
Hosts
• Populates the CMDB with CIs and Relationships
End User
Experience
Resources
SLM
Dashboard
Business Availability
Center
UCMDB
Model of the service
based on CIs and
relationships
DDM
Operations
Manager
Element
Managers
Infrastructure
68
17 July, 2015
UCMDB
Solution Walkthrough
Service View
2. Events
Service
Applications
• Events are detected by Element Managers
Hosts
• Events are sent to BAC and update the CMDB
End User
Experience
Events
SLM
Resources
Dashboard
Business Availability
Center
UCMDB
Model of the service
based on CIs and
relationships
DDM
Operations
Manager
Element
Managers
Infrastructure
69
17 July, 2015
UCMDB
Solution Walkthrough
Service View
3. End User Experience
Service
Applications
• Passive and active monitoring of user experience KPIs
• KPIs update the status in the CMDB and service view
End User
Experience
Hosts
Events
SLM
User Experience KPIs
Resources
Dashboard
Business Availability
Center
UCMDB
Model of the service
based on CIs and
relationships
DDM
Operations
Manager
Element
Managers
Infrastructure
70
17 July, 2015
UCMDB
Service View
Solution Walkthrough
4. Service Impact
Service
Applications
• The service model is dynamically updated
• New infrastructure automatically added to view by
DDM
End User
Experience
Hosts
Events
SLM
User Experience KPIs
Resources
Dashboard
Business Availability
Center
UCMDB
Model of the service
based on CIs and
relationships
DDM
Operations
Manager
Element
Managers
Infrastructure
71
17 July, 2015
UCMDB
Role based views
Service
Applications
User Experience KPIs
Hosts
Events
72
Resources
17 July, 2015
Q&A
73