Transcript Document
• Fibre Channel Over Ethernet
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
LIO - Fabric modules
1
A fabric module provides the services of
the SCSI target module over a definite
protocol. There are fabric modules for
Fibre Channel, FCoE (Fibre Channel over
Ethernet) SCSI over IP networks, and
others. With this, one may build so-called
Storage Area Networks (SAN).
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Host adapter
1
The term network interface controller (NIC)
is more often used for devices connecting
to computer networks, while the term
converged network adapter can be applied
when protocols such as iSCSI or Fibre
Channel over Ethernet allow storage and
network functionality over the same
physical connection
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
NetApp - Filers
NetApp's filers initially used NFS and
CIFS protocols based on standard local
area networks (LANs), whereas block
storage consolidation required storage
area networks (SANs) implemented with
the Fibre Channel (FC) protocol. In 2002,
in an attempt to increase market share,
NetApp added block storage access as
well. Today, NetApp systems support it
via FC protocol, the iSCSI protocol, and
the emerging Fibre Channel over
Ethernet (FCoE) protocol.
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
NetApp - Filers
1
Data ONTAP originally only supported
NFS, but CIFS, iSCSI and Fibre Channel
(including Fibre Channel over Ethernet)
were later added
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
iSCSI - Concepts
1
As a result, iSCSI is often seen as a lowcost alternative to Fibre Channel, which
requires dedicated infrastructure except in
its FCoE (Fibre Channel over Ethernet)
form
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Ethernet flow control - Priority flow control
1
The effort was part of the data center
bridging task group, which developed
Fibre Channel over Ethernet.
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Data center bridging
1
The higher level goal is to use a single
set of Ethernet physical devices or
adapters for computers to talk to a
Storage Area Network, Local Area
network and InfiniBand fabric.Silvano
Gai, Data Center Networks and Fibre
Channel over Ethernet (FCoE) (Nuova
Systems, 2008)
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Data center bridging - Other groups
* Fibre Channel over Ethernet: [
http://www.t11.org/fcoe T11 FCoE] This
project utilizes existing Fibre Channel
protocols to run on Ethernet to enable
servers to have access to Fibre Channel
storage via Ethernet
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Brocade Communications - Products
Other hardware solutions from
Brocade support common protocols
including iSCSI, FCIP, GigE, FICON,
Fibre Channel over Ethernet|FCoE,
Data center bridging|DCB/CEE, and
Layer 4-7 networking protocols.
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Brocade Communications - Fibre Channel
1
In Late 2010 Brocade introduced Virtual
Cluster Switching (VCS) on the VDX ultralow-latency data center switch product
line. These are Data center
bridging|DCB/CEE- and TRILL (Computer
Networking)|TRILL-based switches,
eliminating the need for Spanning Tree
Protocol, and supporting multi-hop Fibre
Channel over Ethernet (FCoE) and selftrunking.
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Ethernet Alliance - Organization
* Ethernet in the Data Center focus
includes protocols such as Data Center
Bridging (DCB), Fibre Channel over
Ethernet (FCoE), iSCSI, Remote direct
memory access over Converged Ethernet
(RoCE) and iWARP.
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Converged network adapter - Support
1
Later products used the marketing term
converged network adapter (CNA),
combining Fibre Channel over Ethernet
with 10 Gigabit Ethernet, for example.
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Converged network adapter - Cisco
1
Cisco Systems offered Fibre Channel over
Ethernet marketed as their Unified
Computing System via number of their
Virtual Interface Cards (VICs).Cisco
website [
http://www.cisco.com/en/US/products/ps1
0277/prod_module_series_home.html],
visited 30 October, 2013 These cards
extends the functionality of traditional
CNAs making it possible to create up to
256 virtual HBAs or NICs within one VIC.
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
HP Integrity Virtual Machines - History
* Version 4.3, released March 2011,
brings support for the Tukwila
(processor)|Intel® Itanium® Tukwila
processor, an NVRAM Edit utility, a
Virtual iLO Remote Console, 16 virtual
CPUs for guests, 128GB for guest
memory, 256 AVIO storage devices, the
support for Fibre Channel over
Ethernet|Fiber Channel over Ethernet,
and the support of Network File
System|NFS backing stores. .
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Nexus 1000V - Nexus 2000 series
1
The maximum distance between the FEX
and the mother-switch is 3 kilometer when
it is only used for TCP/IP traffic and 300
meter when carrying also Fibre Channel
over Ethernet|FCoE traffic.Cisco
datasheet: [
http://www.cisco.com/en/US/prod/collateral
/switches/ps9441/ps10110/ps11975/data_
sheet_c78-685265.pdf Cisco Nexus B22
Blade Fabric Extender], July 2012
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Nexus 1000V - Nexus 4000 series
1
The Nexus 4000 series consists of only
the model 4001: a Blade server|bladeswitch module for IBM BladeCenter that
has all 10 Gbit Fibre Channel over
Ethernet or 'FCoE' interfaces
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Nexus 1000V - Nexus 5000 series
The Nexus 5000 series is a range of 5
models 1U or 2U rack-switches offering 20
to 96 interfaces running on 1 or 10Gb
ethernet and 10 Gb Fibre Channel over
Ethernet|FCoE interfaces
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Nexus 1000V - Nexus 6000 series
1
Both models support either front to back or
back to front airflow and they do support
Fibre Channel over Ethernet in
combination with a 'full' FCoE switch (e.g
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Nexus 1000V - Nexus 6004
For layer3 and Fibre Channel over
Ethernet|FCoE operation additional
licences are
required[http://www.cisco.com/en/U
S/prod/collateral/switches/ps9441/ps
12806/ps12807/data_sheet_c78723667.pdf Cisco Nexus 6004
datasheet], 2013, downloaded: 14 April
2013
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
NetApp filer
1
Filers can also serve data over blockbased protocols such as Fibre
Channel (FC), Fibre Channel over
Ethernet (FCoE) and iSCSI.
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Nexus 7000 - Nexus 6000 series
1
Both models support either front to
back or back to front airflow and they
do support Fibre Channel over
Ethernet in combination with a 'full'
FCoE switch (e.g
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
IBM Storwize V7000 - Storwize V3700
1
*Control enclosure networking: 1 Gb
iSCSI host interface with optional 8 Gb
Fibre Channel or 10 Gb iSCSI/Fibre
Channel over Ethernet host ports
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
FCoE
1
'Fibre Channel over Ethernet' ('FCoE') is a
computer network technology that
encapsulates Fibre Channel frames over
Ethernet networks. This allows Fibre
Channel to use 10 Gigabit Ethernet
networks (or higher speeds) while
preserving the Fibre Channel protocol.
The specification was part of the
International Committee for Information
Technology Standards T11 FC-BB-5
standard published in 2009.
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
FCoE - Functionality
1
Fibre Channel required three primary
extensions to deliver the capabilities of
Fibre Channel over Ethernet networks:
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Extensible Firmware Interface - Network booting
1
Included is also support for boot images
remotely stored on storage area networks
(SANs), with iSCSI|Internet Small
Computer System Interface (iSCSI) and
Fibre Channel over Ethernet (FCoE) as
supported protocols for accessing the
SANs.
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
ATA over Ethernet - Protocol description
1
AoE runs on layer 2 Ethernet. AoE does
not use internet protocol (IP); it cannot be
accessed over the Internet or other IP
networks. In this regard it is more
comparable to FCoE|Fibre Channel over
Ethernet than iSCSI.
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Cluster Shared Volumes - Technical Details
1
Cluster Shared Volumes operates by orchestrating
metadata I/O operations between the nodes in the
cluster via the Server Message Block
protocol.[http://windowsitpro.com/highavailability/introduction-cluster-sharedvolumes?page=3 windowsITPro, John Savill,
Introduction to Cluster Shared Volumes] The node
with ownership of the LUN orchestrating metadata
updates to the NTFS volume is referred to as the
Coordinator
Node.http://support.microsoft.com/kb/2008795
Read / Write operations are passed directly to the
Serial attached SCSI, iSCSI, Fibre Channel, or
Fibre Channel over Ethernet shared storage via
block https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
based protocols.
Dell PowerConnect - Product line
The Powerconnect-J (Juniper
Networks) and B (Brocade
Communications Systems|Brocade)
series are not longer sold, except for
the B8000e/Dell M1000e#PCM 8428-k
Brocade FCoE|PCM8428-K full Fibre
Channel over Ethernet|FCoE
switches. Most of these products are
now replaced by Force10 models.
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Dell PowerConnect - 8000 series
Also with the introduction of that
firmware the switches now also
support Fibre Channel over Ethernet
via the added functionality FIP
Snooping.
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Dell PowerConnect - M-series
1
With the firmware upgrade announced
in December 2011, the M8024-k is also
an Fibre Channel over Ethernet (FCoE)
transit switch that can extend an
available FCoE fabric
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Dell PowerConnect - B-, J- and W-series
Due to the acquisition of Force10 all the
PowerConnect-J series and nearly all of the
PowerConnect B-series have been
discontinued. Only the Brocade based PCB8000e and the blade version Dell
M1000e#PCM 8428-k Brocade FCoE|PCM
8428-k) full Fibre Channel over
Ethernet|FCoE switches are still available (as
are pure Fibre Channel switches). Also the
Cisco Catalyst 3xxx switches for the M1000e
enclosure are still available.
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
IBM FlashSystem - History
The key enhancements of the new
generation were RAS enhancements,
higher capacities, higher performance,
new 16 Gbit Fibre Channel and 10 Gbit
Fibre Channel over Ethernet interfaces,
and a new management GUI
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Blade server - Networking
1
Blade servers generally include integrated
or optional network interface controllers for
Ethernet or host adapters for Fibre
Channel storage systems or converged
network adapter to combine storage and
data via one Fibre Channel over Ethernet
interface. In many blades at least one
interface is embedded on the motherboard
and extra interfaces can be added using
mezzanine cards.
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Dell M1000e - Power Edge M820
1
The M820 offers a choice of 3 different onboard converged Ethernet adaptors for 10
Gbit/s Fibre Channel over Ethernet (FCoE)
from Broadcom, Brocade Communications
Systems|Brocade or QLogic and up to two
additional Mezzanine for Ethernet, Fibre
Channel or InfiniBand I/ODell website:
Poweredge
[http://www.dell.com/us/business/p/poweredg
e-m820/pd?p=poweredgem820view=pdetailsisredir=true#TechSpec
M820 Technical specifications], visited 28
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Dell M1000e - (Converged) Ethernet Mezzanine cards
The same applies to adding a Fibre
Channel host bus adapter or a Fibre
Channel over Ethernet (FCoE) converged
network adapter interface
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Dell M1000e - Blade storage
1
In most setups the server-blades will use
external storage (Storage Area
Network|NAS using iSCSI, Fibre Channel
over Ethernet|FCoE or Fibre Channel) in
combination with local server-storage on
each blade via hard disk drives or SSDs
on the blades (or even only a SD-card with
boot-OS like VMware ESXWhitepaper on
redundant SD card installation of [
http://www.dell.com/downloads/global/pro
ducts/pedge/en/poweredge-idsdmwhitepaper-en.pdf Hypervisors], visited 19
February 2013)
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Dell M1000e - PowerConnect M8024 and 8024k
Since firmware update 4.2 the
PCM8024-k supports partially Fibre
Channel over Ethernet|FCoE via FIP
(FCoE Initialisation Protocol) and thus
Converged network adapters but
unlike the PCM#PowerConnect
M8428k|8428-k it has no native fibre
channel interfaces.
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Dell M1000e - MXL 10/40 Gb switch
The MXL switches also support Fibre
Channel over Ethernet so that serverblades with a converged network adapter
Mezzanine card can be used for both data
as storage using a Fibre Channel storage
system
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Dell M1000e - I/O Aggregator
The I/O aggregator supports Fibre
Channel over Ethernet|FCoE and DCB
(Data center bridging) featuresDell
website:
[http://www.dell.com/us/business/p/powere
dge-m-io-aggregator/pd#TechSpec
PowerEdge M I/O Aggregator], August,
2012
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Dell M1000e - PCM 8428-k Brocade FCoE
Although the PCM8024-k and MXL
switch do support Fibre Channel over
Ethernet, it is not a 'native' FCoE
switch: it has no Fibre Channel
interfaces. These switches would need
to be connected to a native FCoE
switch such as the Dell
PowerConnect#B-.2C J- and Wseries|Powerconnect B-series 8000e
(same as a Brocade 8000 switch) or a
Cisco Nexus 5000 series switch with
fibre channel interfaces (and
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Dell M1000e - PCM 8428-k Brocade FCoE
The PCM8428 is the only full Fibre
Channel over Ethernet capable switch for
the M1000e enclosure that offers 16 x
enhanced Ethernet 10Gb internal
interfaces, 8 x 10Gb (enhanced) Ethernet
external ports and also up to four 8Gb
Fibre Channel interfaces to connect
directly to a FC SAN controller or central
Fibre Channel switch.
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
UEFI - Network booting
Also included is support for boot
images remotely stored on storage area
networks (SANs), with iSCSI|Internet
Small Computer System Interface
(iSCSI) and Fibre Channel over
Ethernet (FCoE) as supported
protocols for accessing the SANs.
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
LIO Target - FCoE
1
The Fibre Channel over Ethernet (FCoE)
fabric module allows the transport of Fibre
Channel protocol (FCP) traffic across data
center bridging|lossless Ethernet
networks. The specification, supported by
a large number of network and storage
vendors, is part of the Technical
Committee T11 FC-BB-5 standard.
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
StarWind Software
'StarWind Software, Inc.' is a
computer software company
specializing in storage virtualization
and building iSCSI, Fibre Channel
over Ethernet (FCoE) and ATA-overEthernet storage area networks
(SANs).
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Network Appliance, Inc. - Filers
1
NetApp's filers initially used Network
File System (protocol)|NFS and CIFS
protocols based on standard local area
networks (LANs), whereas block storage
consolidation required storage area
networks (SANs) implemented with the
Fibre Channel (FC) protocol. In 2002, in
an attempt to increase market share,
NetApp added block storage access as
well. Today, NetApp systems support it
via FC protocol, the iSCSI protocol, and
the emerging Fibre Channel over
Ethernet (FCoE) protocol.
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
Network Appliance, Inc. - Filers
Data ONTAP originally only
supported NFS, but CIFS, iSCSI and
Fibre Channel (including Fibre
Channel over Ethernet) were later
added
1
https://store.theartofservice.com/the-fibre-channel-over-ethernet-toolkit.html
For More Information, Visit:
• https://store.theartofservice.co
m/the-fibre-channel-overethernet-toolkit.html
The Art of Service
https://store.theartofservice.com