Transcript Operational Deployment and Management of Storage

Operational Deployment and
Management of Storage over the Internet
David L. Black, EMC
IETF opsarea meeting
July 30, 2009
July 30, 2009
opsarea meeting, IETF Stockholm
1
Context
• IETF storage protocols
– Block: iSCSI, including iSER
– Fibre Channel tunneling over IP: FCIP, iFCP
– File: NFSv4
• New IETF Transport WG: storm
– STORage Maintenance
– Updates to Block and FC transport protocols
– Associated MIB updates (iSCSI, FC transport over IP)
• Q: What’s the proverbial “rest of the picture”?
– Operational and management aspects
• But first, some background ...
July 30, 2009
opsarea meeting, IETF Stockholm
2
Storage Networking Standards
Data Protocols
SCSI (T10)
Fibre Channel (T11)
ATA and SATA (T13)
NAS (IETF, Microsoft)
IP Storage (IETF)
Management
SMI-S (SNIA)
Uses CIM (DMTF)
SNMP (IETF)
Web (IETF, W3C)
Stored Data
RAID Layout (SNIA)
Encryption (IEEE)
Fixed Content (SNIA)
Storage Networking Standards: Recent Developments
© 2008 Storage Networking Industry Association. All Rights Reserved.
3
Storage Protocol Classes
Storage
Network
Network Communication
Fibre Channel Fabric
IP Storage (iSCSI, FCIP, iFCP)
Network Attached Storage (NAS)
Drive Interface
FC-AL (Arbitrated Loop)
Parallel SCSI and Serial
Attach SCSI (SAS)
ATA and Serial ATA (SATA)
Storage Networking Standards: Recent Developments
© 2008 Storage Networking Industry Association. All Rights Reserved.
4
IP Storage Network Scenarios and Protocols
Native

All Ethernet (no Fibre Channel)

iSCSI protocol

Standard Ethernet switches and
routers
= IP
= FC
Bridging

Servers Ethernet attached

Storage Fibre Channel attached

iSCSI protocol
Extension

Servers and storage on SAN

FCIP or iFCP protocol

Host-to-storage or replication
© Copyright 2008 EMC Corporation. All rights reserved.
5
IP Storage Extension Scenarios:
Activate the Wayback Machine ...
July 30, 2009
opsarea meeting, IETF Stockholm
6
EMC2
The Enterprise Storage Company
Remote Disk Mirroring
and Diff Serv
David L. Black
EMC Corporation
[email protected]
December, 1998
[43rd IETF, Orlando, FLORIDA]
7
EMC2
The Enterprise Storage Company
Remote Disk Mirroring
 Promising application for Diff Serv
 The application exists, but not on the Internet
 It can use a *lot* of bandwidth
 Example to add to web, IP telephony, ...
 Diff Serv is a fundamental enabler
 QoS assurances are required
 The missing piece of technology …
8
EMC2
The Enterprise Storage Company
What is a Disk Array?
 100s of Gigabytes to Terabytes
 Connects to almost everything
 Mainframe, Unix, NT, etc.
SYMMETRIX
 Highly Reliable
 Mirrored, RAID
 Redundant Power
 UPS, Batteries
 Etc., etc.
BUT …
9
EMC2
The Enterprise Storage Company
Disasters Happen
 Power out
 Phone lines down
 Water everywhere
 The Systems are Down!
 This is a problem ...
10
EMC2
The Enterprise Storage Company
Solution: Remote Disk Mirroring
Miami
Hurricane Andrew is
NOT in Chicago
Chicago
The Same Data
in Two Places
Remote Disk Mirroring
[SRDF]
Disk Array
Disk Array
11
Deactivate the Wayback Machine ...
July 30, 2009
opsarea meeting, IETF Stockholm
12
Block Storage Communication Protocols
SCSI Architecture (SAM)
& Commands (SCSI-3)
T10
Fibre Channel
FCP
Parallel
SCSI &
SAS
VI
FC-2
FC-1
FC-0
iSCSI
TCP
IP
FICON
FCIP
iFCP
T11
IP (RFC 4338)
TCP
IP
IETF
SCSI & SAS
Cables
Any IP
Network
FC Fibers,
Switches
Storage Networking Standards: Recent Developments
© 2008 Storage Networking Industry Association. All Rights Reserved.
Any IP
Network
13
Storage Networking Standards
Data Protocols
SCSI (T10)
Fibre Channel (T11)
ATA and SATA (T13)
NAS (IETF, Microsoft)
IP Storage (IETF)
Management
SMI-S (SNIA)
Uses CIM (DMTF)
SNMP (IETF)
Web (IETF, W3C)
Stored Data
RAID Layout (SNIA)
Encryption (IEEE)
Fixed Content (SNIA)
Storage Networking Standards: Recent Developments
© 2008 Storage Networking Industry Association. All Rights Reserved.
14
SMI-S: Model-Based Management
Management Application
Auto-generation of
infrastructure
constructs
Integration Infrastructure
–
Object Model
Mapping
SMI-S
Interface
Tape Library
MOF
Switch
MOF
Platform Independent
Distributed
Automated Discovery CIM/WBEM
Security
Technology
Locking
Object Oriented
Array
Many Other
MOF
MOF
Standard
Object
Model per
Device
Vendor
Unique
Function
Storage Networking Standards: Recent Developments
© 2008 Storage Networking Industry Association. All Rights Reserved.
15
Storage Operations and
Mangement Considerations
• Most storage management: Capacity and data
management
– Storage vs. Network management disciplines
– Operational storage management includes back-up,
disaster recovery, provisioning, etc.
• IETF block storage and FC tunnel protocols
– Part of a larger protocol family
– SCSI typically not managed as a protocol
• Protocol: Specific SCSI transport (e.g., iSCSI, FCP/FC, SAS)
• Device access control: not part of SCSI transport
July 30, 2009
opsarea meeting, IETF Stockholm
16
Standards for Storage
Management
• SMI-S: model-based CIM
– All aspects of storage, used for active management
– Transports: simple XML encap over HTTP, WS-Management
• MIBs for specific protocols (e.g., iSCSI)
– Primary use: monitoring
– Extensive suite of FC MIBs can be used for configuration
• Storage device/array management
– Interfaces are often vendor-specific
– Web GUIs are common
• Device APIs [HBA is storage analog to NIC]
– FC: HBA-API
– iSCSI: IMA-API (for iSCSI HBAs)
July 30, 2009
opsarea meeting, IETF Stockholm
17
Discussion
Questions?
July 30, 2009
opsarea meeting, IETF Stockholm
18