Transcript QFabric DCSEVT Slides

Nexus Product Update
Mar, 2012
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
1
Session Objectives
• N7K General information
• N5K update
• N2K support matrix
• N3K low latency network design
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
2
LAN/SAN
LAN
Scalability
SAN
MDS 9500
Nexus 5000
MDS 9200
Nexus 1010
Nexus 7000
Nexus 2000
Nexus 3000
Nexus 4000
MDS 9100
Nexus 1000V
Cisco NX-OS: One OS from the Hypervisor to the Data Center Core
Convergence
VM-Aware
Networking
10 GbE
switching
Fabric
Extensibility
Cloud Mobility
Cisco DCNM: Single Pane of Visibility for both LAN and SAN
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
3
$2,000
Nexus 7K
N5K/N2K
~$2.3B of sales in FY 11 forecasted with
NX-OS powered platforms
MDS
$1,000
Over 15,000 NX-OS Customers across all
market segments
$FY09
FY10
FY11
• NX-OS Industry first multi-protocol Network OS
Powers multiple platforms at Cisco – Networking, Storage, Server
Connectivity
• Enabling Mission-critical availability
• Completely modular and flexible Operating System
• Optimized for Cloud and I/O Convergence
• Driving value through innovations like OTV, FabricPath & LISP
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
4
• In Production for > 3 Years
• Installed base of > $1.8B
Booking
• Last 4 Quarters Run Rate >$1B
• >15,000 Chassis Shipped
• > Shipped >1M 10GE ports
• >4,700 Customers Worldwide
•Franchise wins across segments
US Ent/Com
US PS
US SP
GET
Europe
APAC
Emerging
Theater Sales Distribution for FY11
•>700 new customers in Q3FY11
© 2010 Cisco and/or its affiliates. All rights reserved.
Confidential Do Not Share
Cisco Confidential
5
OTV
FabricPath
LISP
© 2010 Cisco and/or its affiliates. All rights reserved.
•
•
•
•
800+ customers (Lot of production deployments)
2700 of licenses sold
Top customers include Milagro, Bovespa, Standard Bank, TIAA Cref
Complete List - http://bockbock.cisco.com/wiki_file/N7K:tech_resources:otv/OTV-Adoption.pptx
• 250+ Unique customers
• 570+ FP license Sold
• Many active evaluations and production deployments including
customers like Bank of America, Datev
• 80 Sites across 13 Countries and 4 continents deployed LISP in the
beta network over 3 years
• Top customers include Facebook, Qualcom, Intouch
• More information: http://lisp.cisco.com
Customer reference internal use only
Cisco Confidential
6
2011
550 Gigabit Slot
2008
80/230 Gigabit Slot
© 2010 Cisco and/or its affiliates. All rights reserved.
2013
1.1 Terabit per Slot
32T
 High-density 40/100G Modules
 Control Plane Expandability
 2 us latency
Cisco Confidential
7
Cisco Confidential
M1-XL Series (Shipping)
8 port 10G-XL (80G/slot)
32 port 4:1 10G-XL SFP+ (80G/slot)
48 port 10/100/1000-XL (46G/slot)
48 port 1G-XL SFP (46G/slot)
M2-XL Series (1HCY12)
6-port 40G/24-port 10G QSFP/Breakout (240G/slot)
2-port 100G/40G CFP/Breakout (200G/slot)
24-port 10G (240G/slot)
F2 Series (Q4CY11)
48 port L3 10G SFP+ (480G/slot)
Fab2 (550G/slot)
F1 Series (Shipping)
32 port L2 10G SFP+ (230G/slot)
…past
© 2010 Cisco and/or its affiliates. All rights reserved.
2011
F2 Series (1HCY12)
48 port L3 10G 10GBASE-T (480G/slot)
2012
future…
Cisco Confidential
8
M 系列 I/O 模块服务
丰富的核心
M2 系列
40/100GE 接口
240 Gbps/插槽
MPLS、OTV、
L2/L3
M2 系列
互联数据中心和
SP
M1 系列
1/10GE 接口
80Gbps/插槽
MPLS、OTV、
L2/L3
F2 系列 I/O 模块高密度
10GE
数据中
心
© 2010 Cisco and/or its affiliates. All rights reserved.
数据中心
F2 系列
1/10GE 接口
480 Gbps/插槽
FabricPath / FEX
Cisco Confidential
9
NX-OS 5.1 – Shipping Oct 2010
32-port 1/10GE SFP+ F1 Series I/O Module
FabricPath
Nexus 2248 support on Nexus 7000
NX-OS 5.2 – July 30 2011
Director Class FCoE and Multi-Hop FCoE on Nexus 7000/MDS
Location ID/Separation Protocol (LISP)
MPLS L3
Enhancements to Nexus 2000 support on Nexus 7000
Converged DCNM for both LAN/SAN
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
10
Feature License
Features (Description)
Enterprise Services Package
BGP (Multi-Protocol)
EIGRP
GRE (IP Tunnels)
ISIS
MSDP
OSPF
PBR
PIM
Advanced Services Package
Cisco Trustsec (CTS Encryption)
Virtual Device Context (VDC)
Transport Services Package
OTV
5.0(2a)
Scalable Feature Package
M1 XL Modules
5.0(2a)
Enhanced Layer 2 Package
Cisco Fabric Path
5.1(1)
FCoE Package
F1 Series / Multi-Hop
5.2(1)
MPLS Package
LDP, MPLS, L3VPN, TE
5.2(1)
SAN Enterprise Package
IVR, VSAN AC, Fabric Binding
5.2(1)
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
11
 1G/10G/FCoE/DCB, 1/2/4/8 G FC,
1GE
 Layer 2/Layer 3 support
 Front-to-back and back-to-front
airflow
 4K VLANs
 40G Uplinks (future)
 Delay: ~2 usec
 Cisco Fabric Path
 IETF TRILL & Cisco L2MP
 T11 FCoE
 Hardware support IEEE 1588
(Precision Time Protocol – µs
accuracy & timestamp)
 32K MAC Table Entries
 Enhanced feature SPAN, multicast
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
12
Nexus 5500 Platform
Nexus 5548UP 1RU Switch (Unified Ports)
Nexus 5596UP 2RU Switch (Unified Ports)
Nexus 5548 Layer 3 Daughter Card
Newer Version now available
Nexus 5500 Unified Ports
Expansion Module
Nexus 5596 Layer 3 Expansion Module
Newer Version now available
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
13
A Nexus 5500 supports up to 24 FEX’s
1HCY09
N2K-C2148T-1GE
48 host ports 1GT
(4 10GE uplinks)
1HCY10
N2K-C2232PP-10GE
32 host ports
1/10GE/FCoE (8 10GE
uplinks)
2HCY10
N2K-C2224TP-1GE
24 host ports 100/1GT
(2 10GE uplinks)
N2K-C2248TP-1GE
48 host ports 100/1GT
(4 10GE uplinks)
1HCY11
N2K-C2232TM-10GE
32 host ports
1/10GBASE-T (uplink
module with 8 10GE
ports)
2HCY11
New
1GE FEX
Now available
Nexus B22 Blade FEX
For HP Blade Servers
16 host ports
1/10GBASE-T (uplink
module with 8 10GE
ports)
FET-10G
Fabric Extender Transceiver
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
14
• 1G/10GBase-T Fabric
• Design scenarios:
Extender
1GT to 10GT migration
32x 1/10GT host interfaces
Cost effective 10G solutions
8x 10GE on network interfaces
High density 10GT
Works with all N5K
Connectivity Flexibility
Upstream N5K supports various
FEX (mix-and-match)
Reuse Category 6/6a/7 cabling
Front-to-back airflow and back-tofront airflow
Does NOT support FCoE
Virtualized environments
8 10GE SFP+ Uplinks
32 1G/10GT Downlinks
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
15
FEATURES
BENEFITS:
• Extends FEX connectivity into the partner
blade chassis
• 16x 1/10G host/downlink interfaces
• 50% decrease in blade chassis I/O modules
• 66% decrease in blade management points
• Blade & rack networking consistency
• 8x 10G SFP+ uplinks
• Cisco Nexus 5000 Switch is a single
management point for all the blade chassis I/O
modules
• Increased network resiliency
• End-to-end FCoE support
8 10G SFP+ uplinks
http://savtg.cisco.com/nexus-home-pages/b22hp-homepage
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
16
• 48 ports 100M/1G-BaseT
Enhanced Fabric Extender
• Design scenario:
 48x 100/1000M host/downlink
High density 100M/1G access
interfaces
Cost effective 100M/1G solution
 4x 10GE on network/uplink interfaces
Virtualization
 Works with all N5K
Upstream N5K supports various FEX
(mix-and-match)
Buffer optimized for specific Data Center
workloads such as Big Data, Hadoop and
Distributed Storage
 Choice of airflow and AC/DC power
 Host port-channel support
 6 user-defined QoS queues (8 QoS
queues)
Key differences from N2248TP:
• Optimized Buffers (32MB Shared)
• Enhanced counters
4 10GE SFP+ Uplinks
48 100/1000 RJ45 Downlinks
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
17
The Cisco 10GBASE-ER Module is in Extended Reach
Optic that supports a link length of up to 40 kilometers on
standard single-mode fiber (SMF, G.652).
Only supported on Nexus 5500 family and all FEX models.
switch(config-if-range)# show int ethernet 2/1
transceiver
Ethernet2/1
transceiver is present
type is 10Gbase-ER
<snip>
Optics Now Supported On Nexus 5500:
SFP-SR, SFP-LR, and now SFP-ER
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
18
Nexus 5548 Layer 3 Daughter Card
Nexus 5596 Layer 3 Expansion Module
PID: N55-D160L3-V2
PID: N55-M160L3-V2
List Price: $5,000
List Price: $5,000
• Hardware refreshed with newer generation L3 ASICs
• Priced similar to the 1st generation L3 offerings
• No new functionality available with the current software release 5.1(3)N1(1)
• Targeting 16K Host Table Support in 1HCY12 software release version 5.2
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
19
Fabrix Extender (FEX) Strengths
 Consolidated Management
 Compact form factor
 Low Cost
Fabric
Path
+
FEX
FabricPath Strengths
 Operational Simplicity
 Highly Scalable
 Design Flexibility
Resilience
Simplicity
© 2010 Cisco and/or its affiliates. All rights reserved.
Flexibility
Bandwidth
Availability
Cost
Cisco Confidential
20
Any Flavor of Nexus
5500
5548P/5548UP/5596UP
Any Flavor of Nexus
2000
2148T/2248TP/2224TP
2232PP/2232TM
Dual-homed
Fabric Extenders
Mix of Single NIC,
Active/Standby and
Etherchanneled servers can
connect to same FEX
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
21
• New vPC Option — Port-channel connectivity to dual-homed FEXs
From the server perspective a single access switch with port-channel support – each
line card supported by redundant supervisors
Full redundancy for supervisor, linecard, fabric via vPC and cable or NIC failure via
Port-channeling
Logically a similar HA model to that currently provided by dual supervisor based
modular switch
Fabric Extender dual homed
Dual supervisor
modular chassis clustered
to redundant Nexus 5000
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
22
One Network
N5500
Network
Manager
IEEE 802.1 Qbh*
Manage network all
the way to
the OS interface –
Physical and
Virtual
N2232
IEEE 802.1 BR *
IEEE 802.1 BR *
Hypervisor
Legacy
© 2010 Cisco and/or its affiliates. All rights reserved.
Adapter FEX
VM FEX
Parent Switch to Application
Single Point of Management
FEX Architecture
 Consolidates network management
 FEX managed as line card of parent
switch
Adapter FEX
 Consolidates multiple 1Gb interface
into a single 10Gb interface
 Extends network into server
VM-FEX
 Consolidates virtual and physical
network
 Each VM gets a dedicated port on
switch
*IEEE 802.1Qbh pre-standard
Cisco Confidential
23
UCS 6100
UCS B-series
UCS C-series
A-FEX, VM-FEX
Nexus 5500
Generic server
Expanding ecosystem
A-FEX, VM-FEX
A-FEX, VM-FEX
A-FEX
A-FEX, VM-FEX
A-FEX, VM-FEX
A-FEX, VM-FEX
NOW SHIPPING
© 2010 Cisco and/or its affiliates. All rights reserved.
Roadmap
Cisco Confidential
24
Server I/O Progression
Adapter FEX
Adapter FEX architecture
LAN
VM-FEX
Switch
Adapter FEX
PCIe virtualized
10Gb CNA
10Gb NIC
Logical Switch
FEX
Adapter FEX
 Infrastructure consolidation(less adapters, cables, management points)
 On demand infrastructure
 Simplified management
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
25
Server I/O Progression
Virtual Machine Fabric Extender (VM-FEX)
VM-FEX architecture
LAN
Switch
VM-FEX
FEX
Adapter FEX
PCIe virtualized
Hypervisor
10Gb CNA
VM-FEX
10Gb NIC
App
App
App
OS
OS
OS
 Each virtual machine gets a first-class switch interface
 Collapse virtual and physical networking infrastrutures
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
26
• ERSPAN encapsulates SPAN traffic to
Analyzer
IP-GRE frame format and allow remote
monitoring traffic over IP network
• Both Nexus 5000 and Nexus 5500
platforms support ERSPAN
• Support ERSPAN source session only.
No support for ERSPAN destination
session. Hardware can’t deencapsulate ERSPAN frame. N7K, N1K
NAM, Cat6K can de-encapsulate
ERSPAN.
ERSPAN traffic
L3
• Doesn’t require L3 module and L3
license
• Nexus 5010 and Nexus 5020 support
Data traffic
two active ERSPAN. Nexus 5548P,
Nexus 5548UP and Nexus 5596UP
support four active ERSPAN sessions
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
27
N55-BAS1K9
• Free base Layer 3 software license
• Static Routing, RIPv2, OSPFv2, EIGRP-stub
• HSRP, VRRP
• IGMP v2/v3, PIMv2 (sparse mode)
• Routed ACL and uRPF
• Scalability limited to 256 dynamically-learned routes
N55-LAN1K9
• Advanced Layer 3 software license
• Includes all functionality of base license
• Full EIGRP
• BGP support
• VRF-Lite (IP-VPN) support
• Scalable to 8K routes
Use install license command under configuration context to install L3 license
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
28
Nexus 5000 Series
Generation Evolution
Nexus
5010
Nexus
5020
Nexus
5548P
Nexus
5596
520Gbps
1.04Tbps
960Gbps
1.92Tbps
1RU
2RU
1RU
2RU
1 Gigabit Ethernet Port Density
8
16
48
96
10 Gigabit Ethernet Port Density
26
52
48
96
8G Native Fibre Channel Port Density
6
12
16
96
3.2us
3.2us
2.0us
2.0us
512
512
4096
4096
✔
✔
Product Features & Specs
Switch Fabric Throughput
Switch Footprint
Port-to-Port Latency
No. of VLANs
Layer 3 Capability
1 Gigabit Ethernet Port Scalability
576
576
960
960
10 Gigabit Ethernet Port Scalability
384
384
640
640
✔
✔
40 Gigabit Ethernet Ready
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
29
Model
Nexus 2148T
Nexus 2224TP
Nexus 2248TP
Nexus 2232PP10G
Nexus 2232TP10G
Yes (Q1CY09)
No (Q3CY10)
Yes (Q2CY10)
Yes (Q2CY10)
Roadmap (Q2CY11)
Form Factor
1 RU
1 RU
1 RU
1 RU
1 RU
Uplink Ports
4 x 10GbE SFP+
2 x 10GbE SFP+
4 x 10GbE SFP+
8 x 10GbE SFP+
8 x 10GbE SFP+
Product Shipping
Uplink Transceivers
Supported
Host Facing Ports
Copper CX-1 (passive): 1m, 3m, 5m.
Optical: FET (Nexus 2200 platforms), SR, LR [distance limited to 3km for non-FCoE deployments]
48 x 1GbE RJ45
(note: 1000BaseT only)
24 x 100/1000Base-T RJ45
48 x 100/1000Base-T RJ45
32 x SFP/SFP+
(1/10G)
32 x 1/10G Base-T
RJ45
N/A
N/A
N/A
Yes
No
1.72 x 17.3 x 20.0 in
1.72 x 17.3 x 17.7in
1.72 x 17.3 x 17.7in
1.72 x 17.3 x 17.7
in
1.72 x 17.3 x 17.7
in
165W
95W
110W
270W
384W
No
Yes
Yes
Yes
Yes
Not Supported
Yes
Yes
Yes
Yes
768 GbE Ports per N5K
384 GbE Ports per N5K
768 GbE Ports per N5K
1536 GbE Ports per N7K
512 1/10GbE Ports
per N5K
512 1/10GbT Ports
per N5K
16 FEX per N5500
16 FEX per N5500
16 FEX per N5500
32 FEX per N7K M1-32p
16 FEX per N5500
FCoE
Dimensions
Max Operational
Power
Supports FET
Multiple PortChannel
member ports on a
FEX
Scalability
Number of FEX
© 2010 Cisco and/or its affiliates. All rights reserved.
16 FEX per N5500
Cisco Confidential
30
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
31
 Hardware Features
40G / 10G / 1G / 100M / 10M dense 1RU
platforms
Forward and reverse airflows
AC and DC power supply
Nexus 3064 – 1G/10G/40G
 Software Features
Robust layer-2, layer-3 feature set
VPC, PTP, CoPP, 40G
Nexus 3016 – 10G/40G
 Customer Benefits / Differentiators
Proven, feature-rich NX-OS
Ultra-low latency, wire-rate L2/L3
Low-power consumption
Identical architecture for 1G / 10G / 40G
Nexus 3048 – 10M/100M/1G
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
32
Ultra Low Latency
Sub-microsecond Latency
up to 64 ports of 10G
Performance
Wire-speed L2/L3
10G with 40G Uplinks
Intelligence
Industry-proven Cisco
NX-OS with complete
suite of HA, Security,
QoS and Management
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
33
Nexus 3064 3rd Party Benchmark:
http://www.miercom.com/dl.php?fid=20110422&type=report
L2/L3 Latency (usec)
L2/L3 Jitter (nsec)
100
2
90
80
70
1.5
1.08
1
0.825
0.824
0.873
0.904
0.871
0.904
1.278
1.282
1.291
1.291
1.294
1.294
60
1.274
1.281
1.281
1.281
1.283
1.285
50
40
1.07
30
20
0.5
10
0
64
0
64
128
256
512
768
1024
1280
1518
4096
128
256
512
768
1024
1280
1518
4096
9216
9216
• 0.2% difference between layer 2 and layer 3 latency
• Extremely low jitter 6.1 nsec ~9.7 nsec
Cisco Systems Highly Confidential
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
34
When the switch is forwarding a packet, up to 4 cells (768Bytes) are
needed to be populate in order to cut-through traffic
128 Byte
Packet
Cell #1
[64 Byte overhead]
+ [128 Byte
Payload]
256 Byte
Packet
Cell #1
[64 Byte overhead]
+ [144 Payload]
1500 Byte
Packet
Cell #1
[64 Byte overhead]
+ [144 Payload]
© 2010 Cisco and/or its affiliates. All rights reserved.
Start
Transmitting
Cell #2
[112 Bytes]
Cell #2
[208 Byte Payload]
Start
Transmitting
Cell #3
[208 Byte Payload]
Cell #4
[208 Byte Payload]
Start
Transmitting
Cisco Confidential
35
Coming
Soon
http://savbu.cisco.com/attachments/N3K%20Roadmap%20Update_SEVT_May2011.pptx
• Latency & table size enhancements
• No changes in port-count & form-factor
• Pin compatible ASIC
• Target: July 2011
Key Differences :
Enhancements
Latency
•
Cut-thru after 560 bytes (vs 768
bytes)
Comments
•
•
Host/Multicast
* Table
•
Increased to 16K (from 8K)*
•
Latency improvement for packets > 560
bytes
Slight degradation for packets < 560
bytes
Doubling scalability for host and
multicast routes*
Most of the target customers don’t need these enhancements
Position only under competitive pressure
© 2010 Cisco and/or its affiliates. All rights reserved.
*Roadmap
Cisco Confidential
36
IEEE 1588
Q2
CY11
(N7k)
2H
CY11
(N5/3K)
IEEE 1588
•
Precision Time Protocol (PTP) with Boundary Clock.
•
PONG for Hop-by-Hop Latency Measurements
•
Hardware support on the Nexus 7000 (F-Series and
M2-Series), Nexus 5500 and Nexus 3000
Benefits
•
•
•
Accurate Time Synchronization
Accurate Monitoring of Latency and SLAs
Future Integration with ERSPAN for
accurate Timestamp of Monitored Traffic
Use Cases
•
•
•
© 2010 Cisco and/or its affiliates. All rights reserved.
Synchronization and Monitoring of Financial
Applications
Synchronization of distributed DC Clusters
Time Synchronization in High Performance
Computing
Cisco Confidential
37
Roadmap*
• Network Time Synchronization protocol
standardized in IEEE 1588-2002
• Accurate clock synchronization (in usec vs
msec with NTP)
• Periodic time sync with master clock
accounts for link delays
• Precise monitoring of latency and SLAs
• Improved data correlation with network
captures and system events
Very useful tool for financial HFT customers to measure latency
performance of their trading apps – Key differentiator!
*7K NX-OS 5.2 Delhi Release Q2CY11
*5K/3K 2HCY11
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
38
N7K
N5K/2K
N3K
Boundary Clock
Yes
Yes
Yes
Transparent
Clock
No
No
No
UDP/IP
Transport
Yes
Yes
Yes
Direct Ethernet
Transport
No
No
No
Multicast only
Multicast only
Multicast only
Single
Single
Single
IP Protocols
PTP Domains
© 2010 Cisco and/or its affiliates. All rights reserved.
Cisco Confidential
39
Thank you.