Transcript Storage Virtualization

Storage Virtualization
Chapter 10
Chapter Objective
Upon completion of this chapter, you will be
able to:
• Identify different virtualization technologies
• Describe block-level virtualization
technologies
• Describe file-level virtualization technologies
• Discuss virtual provisioning
Storage Virtualization
-2
Lesson: Virtualization Overview
Upon completion of this lesson, you will be able
to:
• Identify and discuss virtualization technologies
Storage Virtualization
-3
What is Virtualization
• Virtualization is a technique of
abstracting physical resources in to
logical view
• Increases utilization and capability of
IT resource
• Simplifies resource management by
pooling and sharing resources
• Significantly reduce downtime
– Planned and unplanned
• Improved performance of IT resources
Storage Virtualization
-4
Virtualization Comes in Many Forms
Virtual
Memory
Each application sees its own logical
memory, independent of physical memory
Virtual
Networks
Virtual
Servers
Each application sees its own logical
server, independent of physical servers
Virtual
Storage
Storage Virtualization
Each application sees its own logical
network, independent of physical network
Each application sees its own logical
storage, independent of physical storage
-5
5
Memory Virtualization
Virtual
Memory
Each application sees its own logical
memory, independent of physical memory
Physical memory
App
App
App
Swap space
Storage Virtualization
-6
Benefits of Virtual Memory
• Remove physical-memory limits
• Run multiple applications at once
6
Network Virtualization
Virtual
Networks
VLAN A
VLAN B
Each application sees its own logical
network, independent of physical network
VLAN C
Switch
Switch
Storage Virtualization
VLAN trunk
-7
Benefits of Virtual Networks
• Common network links with accesscontrol properties of separate links
• Manage logical networks instead of
physical networks
• Virtual SANs provide similar benefits
for storage-area networks
7
Server Virtualization
Before Server Virtualization:
After Server Virtualization:
Application
Operating system
App App App
App App App
Operating system
Operating system
Virtualization layer
 Single operating system image per
machine
 Virtual Machines (VMs) break
dependencies between operating
system and hardware
 Software and hardware tightly coupled
 Running multiple applications on same
machine often creates conflict
 Manage operating system and
application as single unit by
encapsulating them into VMs
 Underutilized resources
 Strong fault and security isolation
 Hardware-independent
Storage Virtualization
-8
Storage Virtualization
Servers
•
•
•
Process of presenting a logical view
of physical storage resources to
hosts
Logical storage appears and behaves
as physical storage directly
connected to host
Examples of storage virtualization
are:
– Host-based volume management
– LUN creation
– Tape virtualization
•
Virtualization
Layer
Benefits of storage virtualization:
– Increased storage utilization
– Adding or deleting storage without
affecting application’s availability
– Non-disruptive data migration
Heterogeneous Physical Storage
Storage Virtualization
Lesson Summary
Key topics covered in this lesson:
• Various forms of virtualization
– Memory, network, server and storage
virtualization
Storage Virtualization
- 10
Lesson: Storage Virtualization
Implementation
Upon completion of this lesson, you will be able
to:
• Discuss SNIA virtualization taxonomy
• Describe Block-Level Virtualization
technologies and implementation
• Describe File Level Virtualization technologies
and implementation
Storage Virtualization
- 11
SNIA Storage Virtualization Taxonomy
Storage
Virtualization
What is created
Block
Virtualization
Disk
Virtualization
Tape, Tape Drive,
Tape Library
Virtualization
File System,
File/record
Virtualization
Other Device
Virtualization
Where it is done
Host Based
Virtualization
Network
Based Virtualization
Storage Device/Storage
Subsystem Virtualization
How it is implemented
In-band
Virtualization
Out-of-band
Virtualization
Storage Virtualization
Storage Virtualization Requires a
Multi-Level Approach
Path management
Server
Volume management
Replication
Storage
Network
Path redirection
Load balancing - ISL trunking
Access control - Zoning
Volume management - LUNs
Storage
Access control
Replication
RAID
Storage Virtualization
- 13
Storage Virtualization Configuration
Servers
Servers
Virtualization
Appliance
Virtualization
Appliance
Storage
Network
Storage
Network
Storage
Arrays
Storage
Arrays
Out-of-Band
In-Band
(b)
(a)
(a) In out-of-band implementation, the virtualized environment configuration is stored external to the data path
(b) The in-band implementation places the virtualization function in the data path
Storage Virtualization
- 14
Block-Level Storage Virtualization
• Ties together multiple
independent storage arrays
– Presented to host as a
single storage device
– Mapping used to redirect
I/O on this device to
underlying physical arrays
• Deployed in a SAN environment
• Non-disruptive data mobility and
data migration
• Enable significant cost and
resource optimization
Servers
Virtualization Applied at SAN Level
Heterogeneous Storage Arrays
Storage Virtualization
File-Level Virtualization
Before File-Level Virtualization
Clients
After File-Level Virtualization
Clients
Clients
Clients
IP
Network
IP
Network
Virtualization
Appliance
File
Server
Storage
Array
File
Server
File
Server
NAS Devices/Platforms
Storage
Array
File
Server
NAS Devices/Platforms
 Every NAS device is an independent
entity, physically and logically
 Break dependencies between end-user
access and data location
 Underutilized storage resources
 Storage utilization is optimized
 Downtime caused by data migrations
 Nondisruptive migrations
Storage Virtualization
- 16
Lesson Summary
Key points covered in this lesson:
• Storage virtualization configuration
• Types of storage virtualization
Storage Virtualization
- 17
Concept in Practice – EMC Invista
Inside the Intelligent Switch
Host
Mapped I/O
streams
Input I/O
stream
Storage
Mapping
operation
EMC Invista
Intelligent Switches:
 Fibre Channel switches with custom hardware for enhanced processing
 Capable of performing operations on data streams at line speed
 Controlled by instructions from external management software (via APIs)
Storage Virtualization
- 18
Concept in Practice: EMC Rainfinity
File
Virtualization
Appliance
DFS
Global
Namespace
Manager
File-data
migration
AD
Automount
NIS
LDAP
Event Log
NFS4 root
Root
 File Virtualization inserted
into I/O
 Client redirection
Global Namespace updated
NIS
Migration complete without down time
Storage Virtualization
- 19
LDAP
Lesson: Virtual Provisioning
Upon completion of this lesson, you will be able to:
• Explain Virtual Provisioning
• Describe and explain Thin vs. Traditional LUNs
• Explain the benefits of Virtual Provisioning
• Explain how to create, monitor, and manage Thin
LUNs
Storage Virtualization
- 20
What is Virtual Provisioning
• Capacity-on-demand from a shared storage pool
– Logical units presented to hosts have more capacity than physically allocated
– Physical storage is allocated only when the host requires it
– Provisioning decisions not bound by currently available storage
• Above and beyond “Thin Provisioning”
– Includes management tools that make it easier to configure, use, monitor
and manage Thin Pools and Thin LUNs
Host
Reported
Capacity
Shared
Storage Pool
Allocated
Allocated
Allocated
Storage perceived by the application is larger than physically allocated storage
Storage Virtualization
- 21
Traditional Provisioning vs. Virtual Provisioning
1650 GB
Or
1.65 TB
Available
Capacity
350 GB
Actual Data
LUN 1
LUN 2
LUN 3
Storage System
Traditional Provisioning
Storage Virtualization
Virtual Provisioning
- 22
Virtual Provisioning – Benefits
• Reduce administrative costs
– Simplifies storage provisioning
– Over-provisioning can eliminate challenges of expansion
– Reduces time required to repeatedly add storage capacity
• Reduce storage costs
–
–
–
–
–
Increased space efficiency for primary storage and replicas
“Storage on demand” from shared storage pool
Deploy assets as needed
Reduce levels of unused physical storage
Avoid pre-allocating physical storage to applications
• Reduce operating costs
– Fewer disks consume less power, cooling and floor space
• Reduce downtime
– Less disruptive to applications
Storage Virtualization
- 23
Virtual Provisioning – Thin Pool
Expansion
• Adding drives to the pool non-disruptively
increases available shared capacity for all Thin
LUNs in pool
– Drives can be added to a Thin Pool while pool is
being used in production
“Test & Dev
2” pool
• Allocated capacity is reclaimed
byPool
the
when Thin LUNs are deleted
Storage Virtualization
- 24
Additional Disk Drives
Traditional vs. Thin LUNs
Use RAID Groups and traditional
LUNs
• When microseconds of
performance matters
• For the best and most
predictable performance
• For precise data placement
• You are not as concerned about
space efficiency
Storage Virtualization
Use Virtual Provisioning with Thin
Pools and Thin LUNs
• When the best space efficiency
is needed
• For minimal host impact
• When energy and capital
savings are paramount
• For applications where space
consumption is difficult to
forecast
- 25
Lesson Summary
Key points covered till now:
• Virtual Provisioning
• Thin vs. Traditional LUNs
• Benefits of Virtual Provisioning
Storage Virtualization
- 26
Chapter Summary
Key points covered in this chapter:
• Virtualization technologies and forms
• SNIA storage virtualization taxonomy
• Storage virtualization configuration
• Types of storage virtualization
• Virtual provisioning overview
Storage Virtualization
- 27

Check Your Knowledge
• What are the four forms of virtualization?
• Difference between in-band and out-of-band
implementation.
• What is virtual provisioning?
Storage Virtualization
- 28
Cloud Storage Infrastructure
Challenges with Traditional Storage
Approach
• Not designed to scale in the multi-petabyte
– Addition of new arrays for capacity enhancement
• Cost and management overhead
• Increased time to market
• Can address transactional and distributed
computing
– But fell short for Internet Era requirements
– Designed for Operation Within IT’s Walls
Storage Virtualization
- 30
Cloud Storage Infrastructure: The
Big Picture
• To deal with Internet Era data growth
– A massively scalable infrastructure is required
– One that offers global data distribution, selfhealing, self-management, and multi-tenancy
features
• A Cloud approach to storage
– A cost effective approach to handling internet era
data growth
– Focusing on five key infrastructure requirements
• Infinite Scale
• No Boundaries
Storage Virtualization
- 31
Use of Cloud Computing Resources
• “Cloud computing” takes hold as 69% of all
internet users have either stored data online
or used a web-based software application
Storage Virtualization
- 32
Source: “Use of Cloud Computing Applications and Services”,
Pew Internet & American Life Project, 9/12/2008
Defining Cloud Computing
“Cloud Computing is an emerging IT development,
deployment and delivery model, enabling real-time
delivery of products, services and solutions over the
Internet (i.e. enabling cloud services)”
• Services include
– Software-as-a-Service (SaaS)
– Platform-as-a-Service (Paas)
– Infrastructure-as-a-Service (IaaS)
Examples:
– Amazon: Elastic Compute Cloud (EC2), Simple Storage Services (S3)
– Google Apps
– Storage Cloud - Decho (Mozy Online Backup), EMC Atmos
– Salesforce.com……
Storage Virtualization
- 33
Cloud Services
• In cloud execution
• Pricing
– Offsite, provided by thirdparty
– Fine-grained & usage-based
pricing capability
• Accessed via Internet
• User Interface
– Not bound to corporate/private
network
– Simple, not tied to any specific
device/platform
• Minimal/no IT skills to
“implement”
• System Interface
– Web based standard
framework
– Users need not have expertise
• Shared resources
• Provisioning
– Shared asset approach
– Self-requesting
Storage Virtualization
- 34
Cloud Applications
• Enterprise Solutions
– Transactional data or high performance file
sharing applications
• Example: Amazon EC2
– Cloud storage infrastructure
• Example: EMC Atmos
• End-user Solutions
– Rich Internet applications and online service
providers
• Examples: Social media sites, Online photo sharing
– Online data backup
• Example: Mozy online backup
-
Storage Virtualization
35