Transcript Storage Area Network

Storage Overview And
Architecture
Arvind Shrivastava
Enterprise Network Storage Architecture
Unbounded
performance and
capacity
+
Network
Attached
Storage
Software
Unprecedented
flexibility
+
Simplified management
=
Core
Technology
Direct
Attached
Services
Storage
Area
Network
The lowest
total cost of ownership
Direct Attached Storage(DAS)
 Low Cost Solution
 Simple to Configure
 De-Centralized Storage
 No Storage Consolidation
 No High Availability
 Low Performance
Network Attached Storage(NAS)
 Heterogeneous Environment
 Centralized Storage
 Low Performance
 Limited scalability
 Network Congestion during backups & Restore
 Ethernet Limitations
Storage Area Network
 Heterogeneous environment
 Centralized Storage Management
 High Degree of Fault Tolerance
 Best and superior performance
 Storage Consolidation
 Fast and efficient backups and restores
 Dynamic Scalability
 Expensive solution for small setups
SAN
V/s
Fibre Channel
NAS
IP
Reliable
Unreliable
Extremely low CPU Overhead
Extremely High
Large Blocks of Data
Large Nos. of small Blocks
LAN-free back-up
Lan Back-up
Applications managing own Applications driven by universal
Data specs
access to files
Mid-Range Storage Features
• Excellent ease of use
• Virtualization
• Dynamic virtual disk expansion
• Business Copy functions
• Continuous Access functions
• High availability features
• High, middle*, and low models and configurations
• Multiple operating system support
• Single pathing support for all operating systems
• Coexistence with heterogeneous configurations
Buisness copy Overview
Continuous Access-Overview
Flex Copy Concept
Features
• Allows use of low end storage
for low-cost point-in-time copies
of production data
• Point-in-time copy to and restore
from Low end storage
• CLI or GUI Configuration
Benefits
• Reduced TCO in mixed
product/non-production
• Offloads production data from
secondary operations
• Allows for distributed remote
data and hi performance twostage backup/archive
configurations
Cost-effective, external
point-in-time copies
C1
Low end
storage
P
Enterprise
storage
Product Positioning
Additional Features EVA4000/6000/8000
Additional features unique to the second generation EVA
• New controllers with improved performance, higher capacity
support, larger cache, more FC ports
• Up to 200TB of presented capacity (versus 35TB for the first
generation EVA)
• Support for 1024 LUNs (first generation EVA was 512)
• Support for active-active failover using multipath software
for all operating systems
• Increased support for boot from SAN (AIX, Solaris)
• Direct Connect support for Windows
• Additional CA functionality
• Support for native HBAs and HBA drivers
• Additional snapshot and snapclone functionality
Useful Links
Information sources :– HP Enterprise Virtual Array
•
http://h18006.www1.hp.com/storage/arraysystems.ht
ml
– HP Command View EVA
•
http://h18006.www1.hp.com/products/storage/softwar
e/cmdvieweva/index.htm
– Whitepapers
•
http://h18006.www1.hp.com/storage/arraywhitepapers
.html
Storage backup Overview
And Architecture
Arvind Shrivastava
BACKUP SOFTWARE
What is it?
• Software that provides automated data protection for businesses
with 24x7 availability needs.
What does it do?
• Data Protection: copies data onto a storage device, so that in
case of a need (loss, corruption, disaster), data can be easily
recovered and made accessible.
• Media management: easily manages the library catalogues to
keep track of all media and copies of data for fast recovery.
Most important features:
• Automated backups that scale from small workgroups to multisite, heterogeneous SAN & NAS environments with thousands of
servers.
• Fully-integrated Zero-Downtime backup with Instant-Recovery.
Architecture Components
manager of
managers
distributed
GUI
cell
manager
cell
clients
operations
console
Client-Server Modules
cell manager
(CM)
cell console
(CC)
media agent
(MA)
disk agent
(DA)
Inter-process Communication (IPC)
cell console
local
backup/restore
network
backup/restore
disk agent
tcp/ip
tcp/ip
disk agent
cell manager
shared
memory
scheduler
tcp/ip
session
manager
media agent
tcp/ip
session
manager
tcp/ip
media agent
How to choose between tape drives and tape libraries
servers
Tape drives
• Servers are configured
individually and
backup device is
connected directly to
the server
Autoloaders
• Single/Multiple servers
• Unattended backup
• LAN based Backup
• Disk capacity to be
backed up is 200 GB
• Disk capacity to be
to 1 TB
backed up is less than
• Consolidation is
200 GB
required
• Cost conscious
customer
Tape Libraries
• Multiple servers are
configured together
• Unattended backup
• LAN or SAN based
backup
• Disk capacity to be
backed up is more
than 1 TB
• Consolidation and
centralized
management is
required
• Storage external to
servers in JBOD or
disk arrays
Relative Performance
Ultrium 460
Corporate/
networked
backup
SDLT 320
400GB
Departmental/
local network
200GB
Ultrium 230
DLT VS80
Office Servers
100GB
DAT 72
DAT 24
50GB
DAT 40
25GB
Workstations
6
12
25
50
100
Speed GB/hour (compressed)
200
Capacity (compressed)
Ultrium 215
Tape drives – Speeds and feeds - Comparison
Ba ck up ca pa city GB / hourTa pe Device
Da te Tra nsfer Speed M B/ Sec
N a tive
DAT 12/ 24
DAT 20/ 40
Com pressed
Da ta Ca pa city in GB
N a tive
Com pressed
m ax
N a tive
Com pressed
1.2
2.4
2.4
4.8
12
20
24
40
4.32
8.64
8.64
17.28
DAT 72
3
6
32
72
10.8
21.6
DLTvs80
DLTvs160
3
8
6
16
40
80
80
160
10.8
28.8
21.6
57.6
DLT 80 (obs)
6
12
40
80
21.6
43.2
11
22
110
220
39.6
79.2
7.5
15
15
30
100
100
200
200
27
54
54
108
SDLT 160/ 320
16
32
160
320
57.6
115.2
SDLT 600
Ultrium 448
36
24
72
48
300
400
600
800
129.6
86.4
259.2
172.8
Ultrium 460
30
60
200
400
108
216
Ultrium 960
80
160
400
800
288
576
SDLT 110/ 220(obs)
Ultrium 215
Ultrium 230
Complied by Ranganath Sadasiva
Features
Features Required in any Backup software
• Advanced backup to disk
• Oracle/SAP Integrations
• Zero Downtime Backup
• Split mirror
• Snapshot
• Snapclone
• Filesystem / application backup on inactive MC/SG node
Overview – Advanced backup to disk
Why backup to disk?
Benefits
• Fast random access allowing:
–
–
Fast single file restore
Space efficient backup
• Instant recovery
–
•
•
•
•
•
e.g. switching for recovery instead of restoring
data from tape
Faster restore of backup chains
No tape streaming problems
Ideal for RAID 5
Easy to detect disk failures
More protected, e.g. it’s not easy to steal a disk
Advantages of ZDB
The advantages of using Data Protector Oracle ZDB
integration are the following:
• ZDB reduces the performance degradation of the
application system.
• The tablespaces are in backup mode (online backup) or
the database is shut down (offline backup) only during the
short period required to create a replica (split the mirror
disks or create snapshots).
• The time to create a replica is significantly reduced.
Following its creation, tape backup can be created on the
copied data, at leisure , using a separate backup system.
•The Data Protector Oracle ZDB integration offers online
and offline backup of your Oracle Server System
(application system).
BACKUP CONCEPT-SPLIT MIRROR BACKUP
ZDB Setup
• True online backup for
integrated applications
XP
Application host
• Split mirrors may used for
instant recovery or resynced
• No performance impact on
applications during backup
P
• Mirror synchronization before
or after backup
• Automatic mirror rotation
• API based integration
M
0
M M
1
P – primary LDEV
M – mirror copy (MU0-2)
2
Backup host
Backup Software and Storage Integration Concept
Client 1
Client 2
Questions?
New HP Storage Products
Arvind Shrivastava
RISS
Introducing…
HP StorageWorks
Reference Information
Storage System
What is RISS is and who wants it?
The HP StorageWorks
Reference Information Storage System (RISS)
A cornerstone of HP ILM
(Information Lifecycle
Management )
A fully integrated and uniquely
scalable system for access to
reference information that…
…reduces Total cost of
Ownership, mitigates risk and
turns data into information
HP StorageWorks
Reference Information Storage System
•
•
•
Manage Costs
–
Remove static data from application
servers/storage
–
Shorten backup windows
–
Eradicate duplicate data objects
Mitigate Risks
–
Automated retention of messages &
attachments
–
Data is digitally signed, time stamped &
protected
–
Assist customers to meet their compliance
requirements
Exploit Data Assets
–
Power indexing!
–
Grid computing for fast search/retrieval
Scale is the Problem
As the number of information objects grows…
• cost of management increases
• accessibility to the information decreases
Access
Time
TCO $
Performance
A
B
C
A
A
B
B
C
C
A
B
C
TCO
# of content objects managed
HP StorageWorks RISS
architectural benefits
Client applications get added archive functionality
(architecture transparent to them)
‘front end'
Application integration
with e-mail and MS Office
‘back end'
Content is digitally signed and time stamped
for regulatory compliance
Clients
User Application
Application Integration
Open protocol API
RISS
Objects in the RISS cannot be modified or deleted
until end of retention period
smart cell
Application-independent indexing, search and
retrieval of information
Modular, redundant, self healing grid
computing and storage (smart cells)
smart cell
hp StorageWorks
File System Extender (FSE)
A General Overview
Arvind Shrivastava
What is FSE?
• HP StorageWorks File System
Extender (FSE) is new-generation
data management software that is
part of the HP Information
Lifecycle Management portfolio.
• Enables automatic and
transparent data movement
between production (primary)
storage media and secondary
storage media, using simple userdefined rules.
Stored data
Changing digital storage demands
Majority is reference
information
Reference
Operational
Time
FSE attacks the
costs of
reference data
FSE Basics
• Based on Client/Server architecture.
• Infinite File System
• FSE software supports LTO drive technologies for
–
LTO Ultrium 1 and LTO Ultrium 2 media.
• WORM Support.
• Automatic error detection
• FSE automatically detects drive and media
hardware errors.
• NFS & CIFS support
Managing storage spaces
FSE storage spaces
MSA/EVA & FSE
production
storage SCSI
disk
1. Inactive
files moved
from SCSI to
SATA disk
2. Optional
second copy
to tape
MSA1500/
EVA
secondary
storage
SATA/FATA disk
3. Automatic &
transparent
recall of
migrated files
4. File recall
from second
copy if first
unavailable
secondary
storage
MSL tape library
Contents
What is the EFS WAN
Accelerator?
HP EFS WAN Accelerator
How Does it Work?
Removes All Redundant TCP Traffic on WANs
•
•
•
•
Files, Emails, Backup, Web Traffic, FTP, Applications
Stores All TCP Traffic On Disk
Never Send The Same Data Twice
Reduces WAN Traffic By Up To 98%
Optimizes Application Protocol Behavior
• Removes Most Round Trips for Chatty Apps Like Windows
• Highly Effective for the Most Common Applications
Optimizes the Behavior of TCP
• Reduces “Chattiness” in TCP
• Implements Latest TCP Optimizations
Up to 100 Times Faster Throughput
HP EFS WAN Accelerator
Three-part Solution
The Problem
HP’s Solution
What it Does
1. Not Enough
Bandwidth
Scalable Data
Referencing (SDR)
Remove repeated
bytes from the WAN for
all TCP traffic
Virtual Window
Expansion (VWE)
Optimizes performance
of TCP
High speed TCP
optimizations
Enables much higher
throughput on “LFNs”
Transaction Prediction
(CIFS, MAPI)
Optimizes the
performance of specific
applications
2. TCP Chattiness
and Inefficiency
3. Application
Chattiness and
Inefficiency
HP EFS WAN Accelerator
Management Features Overview
EFS WAN Accelerator Manager
• Provides central management of up to 500 appliances
• Provides fleet management
–
Monitors health, throughput & acceleration done
–
Performs SW updates to groups of nodes
• Separate product packaged as an appliance
HP Proliant Management
• HP Systems Insight Manager
• Full Integrated Lights-out (iLO) support
HP Storage Essentials Suite
Storage Software Division
Hewlett-Packard
Unified Management of Server and Storage
Infrastructure
Storage Island
Server Island
Efficiency
Enable IT agility
Consolidate infrastructure
mgmt tools
Increase availability
Centralize and automate
routine tasks
Quicker time to problem
resolution
Improve deployment costs
Manage systems remotely
from any location
Lower training costs
Deploy resources faster and
more reliably
Single point of integration
between business process and IT
infrastructure
Specify SLA’s across entire
infrastructure
Consistent security model for
entire infrastructure
Quick access to business
operation metrics (e.g., audit and
usage reports)
Introducing HP Storage Essentials
Enterprise Edition
Main console for open, heterogeneous
SAN management
Provisioning Mgr
Heterogeneous host to array path
provisioning wizard
Chargeback Mgr
Asset based chargeback
management. Assign tiers
Oracle Viewer
Oracle database availability and
performance views
Exchange Viewer
Exchange database availability and
performance views
Sybase Viewer
Sybase database availability and
performance views
File System Viewer
File system scanning – reclaim
wasted space
Global Reporter
Rollup
reporting
multiple
Main
consoleof
for
open, Storage
Essentials
Server instances
heterogeneous
Report Designer
SAN management
Develop custom reports for storage
infrastructure
• Topology
Maps
• Capacity
• GUI & CLUI
• Performance
• Policy Mgr
Centralized
Reporting
Provisioning
File System
Views
Chargeback
Customize
Reports
Sybase
Views
Exchange
Views
3rd Party/
HP Developed
Oracle
Views
HP Storage Essentials – Enterprise Edition
Main console for open,
heterogeneous
SAN management
Capabilities:
Topology
Application-to-LUN autodiscovery
Topology visualization
Dependency, path, &
connection management
Capacity management
Capacity
Real-time performance
monitoring
Advisors & Automators
Enabling Features:
Role-based security
Event management
Historical & predictive trends
Reporting engine
Policy engine
OpenRAD and CLIs
Deployment on Windows 2003
HP Storage Essentials – Oracle Viewer
Extends Storage
Essentials capabilities
"inside" Oracle databases
to ensure availability and
performance of database
applications
Capabilities:
Discovers database
instances, hosts,
databases &
tablespaces
SAN dependency &
path management
“Closed loop” capacity
management
Real-time performance
monitoring
Role-based security
Policies, events,
reports
Where is the Pain ?
Under-utilized assets
• Storage infrastructure
• IT staff
Cost of heterogeneous management is
expensive and inefficient
Application down time issues angers the
customer
• Troubleshooting is time consuming
• Help desks are flooded
Server consolidation/data center moves
drives the budget
On-going justification of the budget
• What happened to all the storage?
• Why do we need more now? When
again?
Key Qualification Questions
Identifying the Pain Points
How do you manage increasing storage capacity with flat or shrinking
IT headcount?
Do you have a SAN? Can you tell what the impact of a lost SAN
element will be on your applications and users?
How do you keep your staff trained on a wide range of device-specific
element managers and tactical SRM tools that, right now, only add
complexity?
Do you want to replace the whiteboards and spreadsheets you’re
currently using for SAN management with something that is more
scalable and reliable?
How do you avoid vendor lock-in and heavy, proprietary agents that
come with other solutions?
Can you provision storage in real time to support new applications and
projects?
How do you comply with SAN change control and internal audits?
Questions ?