Transcript Jerry Held

1
NetApp for Linux
Worldwide Presence
 Founded:1992
 Headquarters:
Sunnyvale, CA
 Year 2002: > 2,400 employees
 Distribution: 70+ countries
 Installed systems: > 38,000
3
The Appliance Difference
Network Appliance
provides robust, open
enterprise storage
infrastructure, software
solutions, and support
that dramatically
improve TCO and ROI
through simplicity.
4
Financial Performance
1,006

S&P 500
NASDAQ 100

$1B balance sheet
$500M cash

$0 long-term debt
Revenues ($M)
798
579
289
166
47
FY96
93
FY97
FY98
FY99
FY00
FY01
2005 Goal: One of Top 3 in Storage Industry
5
FY02
NetApp - Leading the Industry
6
1993
1996
1996
First network-attached
storage appliance
First network-based data
backup protocol
First multiprotocol
storage appliance
1997
1998
2000
First NAS appliance
certified for Oracle
First content
delivery appliance
Co-founded DAFS
Collaborative
2001
2002
2003
First Nearline
storage appliance
First unified SAN & NAS
appliance
First iSCSI
storage system
Optimum Solutions for Each
Environment
Real Time
Recovery
Requirement
Business-Critical
ERP, Transaction Processing
FAS940
Business Operations
E-mail, CRM, Engineering
F825
Business Internal
Home Directories, Web, Marketing
FAS250/270
Department/Remote
Customer Presentations, Training
R150
Reference Information
Billing Statements, etc.
Archive Data
Backup / WORM Functions
Low
Days
7
High
Recovery Investment
FAS 250
14 FC drives
8
LED’s
OPS panel
FAS 250 - Rear view
Power Supply
9
Tsantsa Filer Head
Power Supply
FAS 250 Filer Head
Backplane
connectors
10
FC controller
Memory
Processor
Battery
FAS 250- Filer rear view
FC (copper)
port
11
2X GbE copper
NICS
Console port
Unified Storage Architektur
DAS
SAN
Application
Server
Application
Server
File System
RAID
File System
SCSI, FC
FC Switch
RAID
12
NAS
Application
Server
FAS
Application
Application
Server
Server
File System
Ethernet Switch
File System
RAID
File System
RAID
Network Appliance: Unifying Storage
Client 1
NAS
Client 2
Combines
 Resource &1 data sharing
3
 Ethernet and Fibre Channel networks
 File and block oriented protocols
2
For long-term investment protection
Client 3
Host 1
SAN
1
3
Host 2
2
Host 3
13
\Mkt
\Eng
Exactly the Same Management Software

Host-Based Management
–
–
–
To flush file system to disk
To initiate use of NetApp® data management
solutions: Snapshot™, SnapRestore®, etc.
Using CLI, NetApp tools, or with third-party
solutions (VxVM)
NetApp Capability
- Snapshot
- SnapRestore
- SnapMirror®
- SyncMirror
- SnapVault™
- SnapDrive™
- SnapManager®
14
NAS
No Host
Coordination
Required
SAN,iSAN
Same
Functionality,
However
Host-Initiated
Same Functionality,
Host-Initiated
NetApp (Logical) Data
Protection
Active File System
File: NETAPP.DAT
A
C
B
Disk blocks

15
Data actually resided
in block C on disk
Snapshot Internals
Active File System
Snapshot.0
File: NETAPP.DAT
File: NETAPP.DAT
A
C
B
- Makes copy of root inode
- Updates Block Map File
Disk blocks

16
Data actually resided in block C on
disk
Snapshot Internals (3)
Active File System
Snapshot.0
File: NETAPP.DAT
File: NETAPP.DAT
A
Disk blocks


17
C’
C
B

WAFL writes modified data
block to new location on disk
(C’)
Client modifies data at end of file
Data actually resided in block C on
disk
Snapshot Internals (4)
Active File System
Snapshot.0
File: NETAPP.DAT
File: NETAPP.DAT
A
B
C
C’
Disk blocks
18

Active file system version of NETAPP.DAT is now
composed of disk blocks A, B & C’.

Snapshot.0 file system version of NETAPP.DAT is still
composed of blocks A, B & C
Snapshot Internals (5)
Active File System
Snapshot.0
File: NETAPP.DAT
File: NETAPP.DAT
Snapshot.1
File: NETAPP.DAT
A
B
C
C’
Disk blocks

19
Snapshot.1 file system version of NETAPP.DAT is
composed of blocks A, B & C’
Snapshot™ Based Data Recovery
20
Writable Snapshots
Active File System
Snapshot.0
LUN: NETAPP.DAT
LUN: NETAPP.DAT
A
B
Disk blocks
LUN:NETAPP1.DAT
Active File System
21
C’
C
C’
Snapshot Oracle Restore/Recovery
Lets assume the Oracle database is damaged
Restore the 300 GB database
 Recover the database with the redologs
 Normal Restore/Recovery

–
–
–

Restore/Recovery with Snapshots/SnapRestore
–
–
–
22
Daily tape backup
Tape recovers at 60 GB/hour
=> 5 hours + recovery time
Recovery time = Time needed to apply logs from backup
until time of failure
Every two hours a Snapshot was taken
SnapRestore reverts volume to the state of the selected
Snapshot – few seconds
=> few seconds + recovery time
Recovery time = Time needed to apply logs from last
snapshot until time of failure
Writeable Snapshots in the Oracle
Environment
Oracle
Prodution

Fast system copy

No double disk space
necessary

Share the same data
for production system
and a test system e.g.
SAP upgrade testing
Example 100 GB
Oracle Lun , copy with
writable Snapshots ->
Result 2 Systems with
100 GB each , need
only 100 GB on the
Storage .

23
Filer Filer
NetApp
Active LUN/VLD
Oracle
Test System
High
End
Vdisk
Vdisk
Writeable Snapshot
Windows Host Management
Environment

SnapDrive™
–

Virtual disk/Snapshot™ management
to Windows client and applications
Benefit
–
Common look/feel of standard MS
management utility
– Simplified data management
administration
– Same management interface for
different data access technologies

Features
–
Dynamic disk and volume
management
– Snapshot management
– Operating system and file system
support
– Administration through MMC or CLI
24
Snapmanger Exchange Solution
Exchange
2000
Exchange
API
SnapManager
SnapDrive
NTFS I/O
Subsystem
iSCSI
FCP
VLD
25
•SnapManager provides the GUI
and automates Exchangespecific tasks
•SnapDrive provides disk and
Snapshot™ management
infrastructure.
•iSCSI support
•Single mailbox
restore
Business Continuance: MetroCluster™
Building
B
Building
A
LAN
10-30km
dark fibre
vol X
vol Y’
Cluster interconnect
A-loop
B-loop
26
vol Y
Benefits
Disaster protection
Up-to-date mirror
Compete redundancy
Site failover
vol X’
Step 5
Nearstore Archive Backup / DR Cosolidation
Data Center
Filer
Remote Office
UNIX®
Server
Linux®
Server
Windows®
Server
Storage
Network
Windows
Server
WAN
NearStore™
SnapVaultTM
Heterogeneous
Storage
WAN
Filer
PCs
LAN
Data Center:
Remote Mirrored Site
Backup
Server
SnapMirror®
Backup
Server
27
Tape
Library
MultiStoreTM Consolidation
Multi-domain Server / Storage
Site 1
Site 2
Product Description:
Site 3
• Optional licensed
software
vfiler B
Admin
vfiler C
Admin
vfiler A
Admin
WIN A
NIS A
WIN B
• Logical partitioning of
storage/networking
• May contain volumes
and/or qtrees
NIS C
• Creates upto 10 Vfilers
• Individual WIN/NIS
domains
MultiStoreTM
vfiler B
500
500
• Separate IP domains
• Multiprotocol
vfiler A
500
vfiler C
500
500
• NFS, CIFS or Both
500
Use NetApp cluster for added downtime protection and load distribution
28
• Vfiler admin
• User Quotas
An Industry Firsts - Disaster
Recovery/Data Migration
Site 1
Site 2
Site 3
Issue:
• Migrate Site 3 users
from a Filer to new filer
vfiler B
Admin
vfiler C
Admin
vfiler A
Admin
Benefits:
• Quick Disaster
Recovery
Ethernet Switch
Infrastructure
WAN/
LAN
• Easy Migration for
Load Balancing
MultiStoreTM
SnapMirrorTM
Data
MultiStoreTM
vfiler A
500
29
500
vfiler B
500
vfiler C
vfiler C
500
500
500
500
500
500
500
Data Management
•
Extend Snap* benefits to block mode data access
•
Instantaneous, disk-efficient Snapshot data protection
• LUN-based SnapRestore
• Application specific SnapManager data protection
• SnapMirror data replication for disaster recovery, data protection
London
Chicago
FC SAN
Internet
Tokyo
IP SAN
San Francisco
DataFabric Manager
Mult-Appliance Management
30
Fabric Attached Storage
ORACLE
FC
FC
WAFL
iSCSI NFS
iSCSI
CIFS NFS HTTP FTP DAFS
LUN Semantics
File Semantics
Performance Acceleration
Block Management
31
Oracle’s E-Business Applications
Implementation
NetApp
32
Linux Systems
IT Infrastructure - Today
LAN
Core Production:
Bus. Critical, some Bus.
Operations
Test/ Dev
Storage
Network
WAN
Layered Production
Bus. Internal, some Bus.
Operations
Remote Offices
Storage
Network
Infrastructure
DR Site
33
DR
Network
Ethernet
FC
Mostly FC
Mostly Ethernet
Lots of both
IT Infrastructure – NetApp Participation
LAN
Core Production:
Bus. Critical, some Bus.
Operations
Test/ Dev
Storage
Network
WAN
Layered Production
Bus. Internal, some Bus.
Operations
Remote Offices
Storage
Network
Storage
Network
Internet
Infrastructure
DR Site
DR
Network
Adding Value Across the Infrastructure
Decreased
Cost
Improved Productivity and Service Levels
Reduced Risk
NetApp
34
Solutions
Ethernet
FC
Mostly FC
Mostly Ethernet
Lots of both
IT Infrastructure – The Evolution of
Storage
LAN
Core Production:
Bus. Critical, some Bus.
Operations
Test/ Dev
WAN
Layered Production
Bus. Internal, some Bus.
Operations
Remote Offices
Storage
Network
CDN
Primary
Storage
Archive
DR Site
Secondary
Storage
DR
Network
Infrastructure
Adding Value Across the Infrastructure
Decreased
Cost
Improved Productivity and Service Levels
Reduced Risk
NetApp
35
Internet
Solutions
Ethernet
FC
Mostly FC
Mostly Ethernet
Lots of both
Which Protocol should you use for DB?

NFS
–
Best choice for most UNIX/Linux deployments
•
–

Best TCO (because of NetApp features & Network cost, not “NFS”)
iSCSI
–
Best choice for Windows deployments
•
–

With NetApp SnapDrive, TCO approaches NFS
Easy way to bring NetApp value into existing infrastructure
•
–
•
–
With NetApp SnapDrive, storage portion of TCO approaches NFS
For those who want to be on the leading edge of both performance and TCO
Real answer: use the one that makes sense for your environment
–
36
If performance is more important than cost or management
Consider NFS (and soon iSCSI) if cost is as important as performance
CIFS: Not for Database
RDMA enabled NAS (DAFS and advanced NFS)
–

Leverage investment in equipment and training
Consider for large RISC Servers with one large DB
•

If FC infrastructure is not already in place
FC
–

If FC infrastructure is not already in place
Flexibility = removal of risk
Fujitsu-Siemens Flexframe Solution for
SAP/Oracle
37
Why NetApp for Linux ?
 Open,
Modular, Reliable and Scalable
 Lower
Cost
 Simple
to install, setup and administer
 Provides
widest portfolio of Storage Solutions
for Linux
 Unified
Storage (NAS and SAN)
 Effective
38
building blocks that scale easily
Competitive Advantage
It’s a Filer too!!!!!!

39
The Swiss Army Knife of Storage!
iSCSI
Network Appliance Confidential
40
What is iSCSI
 Goal
: Using Internet Infrastructure
transporting SCSI Packets
 The
iSCSI protocol enables access to
storage devices and Storage Area Networks
(SANs) over TCP/IP (Port 3260)
 iSCSI

Standard Feb 2003
TCP as additional transport protocol for SCSI (others
are FC , Parallel SCSI , IE1394)
//
Ethernet
41
IP
TCP
iSCSI
SCSI Data…
CRC
iSCSI Layers
SQL Server
(Application)
File System
SCSI
File
(NTFS)
SCSI Class
Driver
SCSI
Transport
iSCSI
iSCSI
Protocol
IP
TCP/IP
Wire
Network Appliance Confidential
Link
Disk
(LU)
SCSI Commands SCSI Device
Driver
iSCSI Session
iSCSI
Protocol
TCP/IP
Ethernet
Link
42
iSCSI and FC Specification
SQL Server
(Application)
Filesystem
SCSI
SQL Server
(Application)
File
(NTFS)
Filesystem
SCSI Class
Driver
SCSI
Transport
iSCSI
iSCSI
Protocol
IP
TCP/IP
Wire
Link
Network Appliance Confidential
SCSI
iSCSI
Spec
SCSI
Transport
FC
Fibre
Channel
Wire
File
(NTFS)
SCSI Class
Driver
FC
Protocol
FC
FC
Spec
Link
43
iSCSI Sessions
iSCSI Device
Target
iSCSI Host
iSCSI Initiator
iSCSI Session
TCP Connection
GigE NIC
(Network Interface Card)
TCP Connection
Server
–Login
Phase
•
enable one or more TCP connections for iSCSI use
• negotiation of the session's parameters
– Used for LUN Masking and LUN Mapping
– Number of parallel TCP connections fo a iSCSI Session
– Athentication Method and Encryption
–Full
•
•
•
Feature Phase
Exchanging Data (Read and Writes ..)
TCP Connections are open through the complete Session
Single Connections or Sessions can be ended
–Deliver
SCSI commands in order
–Recover from lost connections
44
iSCSI Adress- und Namenskonvention
Server 1
iqn.2003.02.com.example:
iscsi.server1
10.2.1.3:
3260
10.2.1.4:
3260
iSCSI node (initiator)
has iSCSI name,
alias and network
portals (i.e. IP
address and TCP
Port)
Portal group
Network
Entity
Disk Array
A
iSCSI nodes (targets)
have iSCSI names, alias and
network portals (i.e. IP address
and TCP Port)
45
10.2.1.2:
3260
iqn..:arraya.target1
iqn..:arraya.target1
iqn..:arraya.target1
(iSCSI
server)
iqn.199208.com.netapp:sn.35780522
iqn.<date company obtained
domain name>.<reserved domain
name>:hostname
Encoded in the UTF8 character set
Max size is 223 bytes
IP Network
10.2.1.1:
3260
iSCSI Node Name
No white space is allowed
Upper case characters are
converted to lower case
Valid characters are :
ASCII dash ('-') , dot ('.'),
colon (':')
ASCII lower-case characters
('a' through 'z‘, ('0' through '9')
)
iSCSI Messages
iSCSI Host
iSCSI Initiator
Ethernet
IP
TCP
iSCSI
SCSI Data…
CRC
iSCSI Device
Target
TCP Connection
GigE NIC
(Network Interface Card)
TCP Connection
iSCSI Session
Server

Initiator Messages
–
NOP-out
– SCSI Command

Target Messages
–
–
Can contain status
Encapsulates a SCSI CDB
SCSI Task Management
Command
– Login Command
– Text Command
– SCSI data
–
Output Data for Writes
–
–
–
–
Logout Command
– SendTargets
Used in iSCSI Discovery
46
NOP-in
SCSI Response
SCSI Task Management
Response
– Login Response
– Text Response
– SCSI data
Input Data from Reads
Logout Response
Ready to Transfer
R2T
–
Async Event
iSCSI Error Recovery and Security
Server
Multi iSCSI
Path
NIC/TOE
(MPIO)
/(Network Interface Card)
Interface
Failover
(NIC,HCA)
GigaBit Ethernet Kabel
iSCSI and SCSI level
error recovery
GigaBit Ethernet Switch
GigaBit Ethernet Kabel
NIC/TOE
(Network Interface Card)
GigaBit Ethernet Kabel
GigaBit Ethernet Kabel
Standard IP route redundancy (TCP,
VIF,Trunking)
Multipathing Software (Veritas , MPIO,...) Focus : iSCSI HCA
IP Layer (VIF) , Trunking ... , Focus : iSCSI Software Initiator
TCP Layer – “in-order delivery”
iSCSI Layer :
Error Recovery Level 0 = Fibre Channel ,Level 1 = Digest Recovery
Level 2 = Connection Recovery
Number and Sequenz will be checked ,
out-of-order delivery Paketts , initiate a new request
Checksums check Datacorruption
ACK-based Flow Control
Initiator and Client authentication (CHAP, SRP,Kerberos, SPKM )
47
iSCSI Target Discovery
Manual
–
iSCSI Discover PDU find all Targets inside a Portal
Service
–
48
Location Protocol SLP
broadcast/multicast or dedicated SLP Server
Agent
Internet
–
–
–
–
Config on the Host
Storage Name Service iSNS
Dedicated Server
Zoning through Discovery Domains
Can serve Public Key Repository
Can serve Access Control Repository is normally
done from the Storage-System
iSNS
Management
Console
iSNS Server
Server
Server
Zone Config :
“Server ” and
FAS250 in
the same Discovery
Domain
Each iSCSI device registers itself and its attributes in the iSNS server
Options:
1 Monitoring: iSNS server polls storage devices to monitor their availability
2 Client Re-registration: Storage regularly re-register themselves before timeout
period expires
49
iSCSI Implementations Server and Storage
File System
File System
File System
SCSI Driver
SCSI Driver
SCSI Driver
iSCSI Driver
TCP/IP
iSCSI
Software
iSCSI Driver
TCP/IP
NIC Driver
NIC Driver
TOE HCA
TCP/IP
Offload
Engine
iSCSI HCA
iSCSI Driver
TCP/IP
NIC Driver
iSCSI
HCA
Block
Server
Server
Server
GigaBit Ethernet Switch
NIC Driver
TCP/IP
iSCSI Driver
iSCSI Native Device :
Example: Netapp Filer
50
iSCSI
Gateway
FC
Switch
Disk
iSCSI Boot
 Boot
–
Static Configuration for iSCSI Boot:
•
–
can be configured static or dynamic
Admin configure authorized iSCSI Node Name and iSCSI
Adresse
Dynamic Config with DHCP oder SLP
•
DHCP assign the Host a IP Adress
• DHCP get the option iSCSI Boot Service (Admin Set) – include
iSCSI Target node name
• SLP can be used for searching the Boot Service without DHCP
–
Alternative:
•
BootP is possible for Software-iSCSI Lösungen and Hardware
• iSCSI HBA like a SCSI Adapter and doing (BIOS-Boot)
51
Basic Internal Initiator Comparisons
(Win2K)
VLD
(No Jumbos)
Large
Cached
(MB/s)
Small
Cached
(IOPS)
ISCSI
Intel PRO/1000
Storage
FCP
LP9002
TPUT
Usecs/
IO
TPUT
Usecs/
IO
TPUT
Usecs/
IO
TPUT
64K Reads
(MB/s)
114
741
74-95
460
100
67
187
48
64K Writes
(MB/s)
78
826
85
241
106
59
158
44
4K Reads
(IOPS)
15,000
143
14,100
123
12,200
32
28,400
33
4K Writes
(IOPS)
18,100
156
18,400
76
12,500
28
25,200
32
512b Read
(IOPS)
22,100
99
18,100
82
17,200
29
31,800
25
23,500
107
21,200
69
15,700
34.
30,000
33
512b
Writes
(IOPS
52
ISCSI
Microsoft
Driver
Usecs/
IO
Initiator Comparisons (Win2K)
 All
cached workloads
 Host was IBM xSeries 345 with 2 x 2.0 GHz
hyperthreaded processors, PCI-X
 Microsoft driver is Pre-Beta 2
 iSCSI numbers all used JUMBO frames
iSCSI SW Initiator „30 MB/sec -> 500 MHz“ , 30%
of a 1.5 GHz CPU
53
Host Side Application Performance
100%
12000
80%
10000
Win2K Priv. CPU
8000
F880 CPU
60%
6000
40%
tpm
tpm
CPU Utilization
SQL Server OLTP TPUT & CPU costs
over VLD, FCP, iSCSI
4000
20%
2000
0%
0
VLD
FCP
iSCSI
FCP & VLD runs w ere on 6.3
iSCSI run w as on Fullsail (w / CP smoothing w hich has show n up to 10% tpm improvement)
SQL Server TPC-C Runs against F880 from 4-way Intel 550Mhz w/ Win2K. 800 Warehouses.
54
Open Systems External Storage Market
SAN: $5.3 B in 2003
CAGR 15%
NAS: $1.9 B in 2003
CAGR 27%
25
20
15
$B
10
DAS
5
SAN
0
NAS
2002
Source: IDC, Oct. 2002
55
2003
2004
2005
2006
Optimum Solutions for Each
Environment
Real Time
Recovery
Requirement
Business-Critical
ERP, Transaction Processing
FAS940
Business Operations
E-mail, CRM, Engineering
F825
FAS250
FAS270
R150
Business Internal
Home Directories, Web, Marketing
Department/Remote
Customer Presentations, Training
Reference Information
Billing Statements, etc.
Archive Data
Backup / WORM Functions
Low
Days
56
High
Recovery Investment
Network Appliance: Unifying Storage
Client 1
NAS
Client 2
Combines
 Resource &1 data sharing
3
 Ethernet and Fibre Channel networks
 File and block oriented protocols
2
For long-term investment protection
Client 3
Host 1
SAN
1
3
Host 2
2
Host 3
57
\Mkt
\Eng
Virtualization Enhancements







Introduces transport independent LUN storage object
Usable as raw disk or host file system container
Improves performance with efficient automatic
striping across multiple spindles
LUN Properties
- Up to 4TB
Variable size, dynamic expansion, resize
- Up to 4096 / host
Simple Wizard-based LUN Setup
- WWN/WWID masking
Integrated LUN masking for SAN security
Integrated multiprotocol security for unified storage
LUN 2; Size 1MB
LUN 3; Size 128KB
LUN 1; Size 10GB
Virtualized Storage
RAID Group 1
D
D
D
D
RAID Group 2
P
D
D
WAFL Volume 1
58
D
D
P
Writable Snapshots
Active File System
Snapshot.0
LUN: NETAPP.DAT
LUN: NETAPP.DAT
A
B
Disk blocks
LUN:NETAPP1.DAT
Active File System
59
C’
C
C’
Writeable Snapshots in the SAP , Oracle ,
SQL Server Environment
SAP
Prodution

Fast system copy

No double disk space
necessary

Share the same data
for production system
and a test system e.g.
SAP upgrade testing
Example 100 GB
Database Lun , copy
with writable
Snapshots -> Result 2
Systems with 100 GB
each , need only 100
GB on the Storage .

60
Filer Filer
NetApp
Active LUN/VLD
SAP
Test System
High
End
Vdisk
Vdisk
Writeable Snapshot
Windows Host Management
Environment

SnapDrive™
–

Virtual disk/Snapshot™ management
to Windows client and applications
Benefit
–
Common look/feel of standard MS
management utility
– Simplified data management
administration
– Same management interface for
different data access technologies

Features
–
Dynamic disk and volume
management
– Snapshot management
– Operating system and file system
support
– Administration through MMC or CLI
61
Snapmanger Exchange Solution
Exchange
2000
Exchange
API
SnapManager
SnapDrive
NTFS I/O
Subsystem
iSCSI
FCP
VLD
62
•SnapManager provides the GUI
and automates Exchangespecific tasks
•SnapDrive provides disk and
Snapshot™ management
infrastructure.
•iSCSI support
•Single mailbox
restore
SnapManager® Exchange Customers

500+ customers for both Exchange 5.5 & Exchange
2000, worldwide

> 2 million Exchange seats

Some SnapManager reference customers on E2K:
–
–
–
–
–
63
Weston Solutions
Trader Media Group
Commonwealth of Virginia
US Army - Soldier Biological Chemical Command
DPR construction
–Barry
University
–Invesco
–Telemundo
–Metaldyne
SnapManager SQL Server features

Near Instantaneous Backups
–
–
–
–
–

Near Online Restores
–
–
–
–
–
64
Creates full backups of SQL Server databases of any size in
seconds - compared to hours by tape
Eliminates the need for incremental backups
Uses SQL Server Backup API (VDI) to ensure SQL Server
availability during backup
Backs up multiple databases simultaneously
Rapid snapshots allow more frequent backups
Restores SQL Server in seconds or minutes – compared to
hours or days by other solutions
Provides option to restore entire server or a single database
Restores multiple databases simultaneously
Recovers SQL Server to a point in time or rolls forward
transaction logs to recover up-to-the-minute
Option to restore databases to an alternative server
Questions
65