Transcript Apricot 2002: 10 GigE - Security Audit Systems

10 Gigabit Ethernet:
Standards Update & Applications
Randall Atkinson
[email protected]
Apricot 2002 Bangkok
Outline
•
•
•
•
10 Gigabit Ethernet:
10 Gigabit Ethernet:
Applications:
Applications:
Standards Update
Technology Comparison
Enterprise/Education
Service Provider
Progress in Ethernet Standardizations
10 Gigabit Ethernet IEEE 802.3ae
2000 - First half, 2002
10/100/1000 Mbps Ethernet Link Aggregation
IEEE 802.3ad, 2000
1000 Mbps Ethernet
IEEE 802.3z, 802.3ab, 1995-1999
100 Mbps Ethernet
IEEE 802.3u, 1993-1995
10 Mbps Ethernet
IEEE 802.3 - 1980s
IEEE 802 Standards Committee
Structure & Approval Process
IEEE
Standards Board
IEEE 802
LAN/MAN
Standards Committee
802.1
working
Group
802.3
working
Group
802.3ae
10 GbE
Task Force
802.5
working
Group
...
Chair, Jonathan Thatcher, World Wide Packets
Vice-Chair, Steve Haddock, Extreme Networks
Secretary, Jeff Warren, Extreme Networks
802.16
working
Group
Why 10GE? Why now?
• Motivation:
– Leverage the success and scalability of Ethernet.
– Opportunity to converge Ethernet with Optical Networking.
• Technology:
– Proven 10 Gbps bandwidth capability in switching systems.
– OC-192 optical systems are available (although expensive).
– Industry efforts to cost reduce serial optics and WWDM.
• Market:
– Local Area Network (LAN):
• Aggregate the 30M GigE ports installed by 2002.
– Metropolitan Area Network (MAN):
• Huge deployment of new high BW access networks.
– Wide Area Network (WAN):
• Intra-POP connectivity between core/access routers, SDH/SONET
ADMs, and DWDM transponders.
The LAN PHY vs WAN PHY Debate
• The huge interest in using Ethernet as a MAN and WAN
technology has sparked an intense debate over using
SDH/SONET as a Physical Layer
– Traditional WAN vendors argue that leveraging the installed SDH/SONET
infrastructure justifies a SDH/SONET-friendly physical layer.
– Traditional LAN vendors argue that the success of Ethernet, and it’s appeal
as a WAN solution, is derived from being simple and low cost. SDH/SONET
is too complex.
• Advantages of a “LAN PHY”:
– Ethernet-style coding techniques are simpler and lower cost than
SDH/SONET framing.
– Maximise compatibility with 10, 100, and 1000 Mbps operation.
– Full 10.000 Gbps data rate.
– No OAM&P.
The WAN PHY: SONETising Ethernet
• Advantages of being “SDH/SONET friendly” …
– Enables using SONET infrastructure for layer-1 transport:
• SONET ADMs, DWDM Transponders, Optical Regenerators
– Requires some SONET features:
• OC-192 link speed, SONET framing, minimal Path/Section/ Line
Overhead processing
• … but not “SDH/SONET compliant”
– Connects to SDH/SONET access devices, but not directly into
SDH/SONET infrastructure.
– Avoids most costly aspects of SDH/SONET:
• No TDM support (concatenated OC-192c/STM-64c only).
• Does not require meeting SDH/SONET grid laser specifications,
jitter requirements, stratum clocking
• Minimal OAM&P support
802.3ae 10GE Objectives -Compatibility
• Objectives for Ethernet compatibility:
– Preserve the Ethernet/802.3 frame format at the MAC Client Interface.
– Preserve the minimum and maximum frame size of the current 802.3
standard.
– Support full duplex operation only.
– Support star-wired local area networks using point-to-point links and
structured cabling topologies.
– Support 802.3ad Link Aggregation.
• In other words:
– Ensure compatibility with previous generations of Ethernet by preserving
the MAC interface, frame format, and frame size.
– Target topology is full-duplex point-to-point links between Ethernet
switches.
802.3ae 10GE Objectives -- Physical
Layer
• Objectives for native-Ethernet and SDH/SONET-friendly
physical layers:
– Support an optional Media Independent Interface (MII).
– Support a speed of 10.000 Gb/s at the MAC/PLS service interface.
– Define two families of PHYs:
• A LAN PHY operating at a data rate of 10.000 Gb/s.
• A WAN PHY operating at a data rate compatible with the payload rate
of OC-192c / SDH VC-4-64c.
– Define a mechanism to adapt the MAC/PLS data rate to the data rate of
the WAN PHY.
• Acknowledges that the objectives for the LAN PHY and
WAN PHY are sufficiently different to justify separate
solutions.
802.3ae 10GE Objectives -- Optics
• Objectives for fiber types and distances:
– Provide Physical Layer specifications that support link distances of:
• At least 100m over installed MMF.
• At least 300m over MMF.
• At least 2km over SMF.
• At least 10km over SMF.
• At least 40km over SMF.
– Support fiber media selected from the second edition of ISO/IEC 11801.
• All distance objectives apply to both LAN and WAN PHY
– Early market for LAN PHY is 40km dark fiber links in the MAN.
– Largest market for WAN PHY is intra-POP links (<100m).
10GbE Technical Highlights
• It’s just Ethernet, but faster!!
– No change to MAC protocol, frame size or frame format
– Yet another 10x speed increase
– Supports 802.3ad Link Aggregation, QoS, etc.
• Topology restricted to full duplex point-to-point links
– Support full duplex operation only
– Completes evolution from shared bus to switched networks
• Extends Ethernet standards into the MAN
– Includes optics for 40km; 4x distance of standard 1 Gbps Ethernet
– Fiber ONLY; no twisted pair support
• Facilitates migration from SDH/SONET networks
– LAN PHY = Ethernet over Fiber (at 10Gbps data rate)
– WAN PHY = Same data stream in SDH/SONET frames (at 9.29 Gbps)
• Think of WAN PHY as “SDH Lite” or “SONET Lite”
• Enables use of “legacy” SDH equipment for physical layer transport
Ethernet Quality of Service (QoS)
• Ethernet QoS (IEEE 802.1P, now in 802.1D)
– Defines bits in Ethernet frame header to mark frames
• IETF Differentiated Services (DiffServ)
– Defines how ToS bits in IP header to mark IP packets
•
•
•
•
•
Many products use ACLs to mark IP packets or Ethernet frames
Many products can map between 802.1P and IP ToS bits
Switches/routers queue or traffic-shape based on markings
DiffServ and Ethernet can use same queuing algorithms
Common queuing algorithms:
– Weighted Fair Queuing (WFQ)
– Random Early Drop (RED)
– Weighted RED (WRED)
• Can work with any speed of switched Ethernet
– Switches need to include specific support for QoS features
10GbE Interface Nomenclature
Three part suffix
– Medium type
• S = Short wavelength (850nm)
• L = Long wavelength (1310nm)
• E = Extra long wavelength (1550nm)
– Coding Scheme
• X = 8B/10B coding (LAN PHY)
• R = 64B/66B coding (LAN PHY)
• W = 64B/66B + “Simplified” SONET encapsulation (WAN PHY)
– Wavelengths
• 1 = Serial (not required as serial is implied)
• N = number of wavelengths (4 for WWDM)
Examples
– 10GBASE- LX4 = Long wavelength, 8B/10B coding (LAN PHY), 4
wavelengths
– 10GBASE-EW = Extra long wavelength, WAN PHY, 1 wavelength (serial)
10GbE Standard Interfaces
10GBase-EW
1550nm WAN
Serial SMF
10GBase-ER
1550nm LAN
Serial SMF
10GBase-LW
1310nm WAN
Serial SMF
10GBase-LR
1310nm LAN
Serial SMF
10GBase-LX4
1310nm LAN
WWDM MMF
10GBase-SW
850nm WAN
Serial MMF
10GBase-SR
850nm LAN
Serial MMF
82m*
300m
Distance
* Assumes 50µm, 500MHZ*km MMF
10Km
40Km
MMF Distance Considerations
Fiber Diameter
62.5 µm MMF
50 µm MMF
Modal Bandwidth
(MHZ*km)
1601
200
400
5002
20003
SR/SW 850nm
26m
33m
66m
82m
300m
LX4 1310nm
300m
240m
(500MHZ*km)1
300m
300m
* Based on Draft 3.2 of IEEE 802.3ae standard
1
FDDI grade fiber
2
Common MMF type in Japan and Germany
3
New specialized MMF that is largely uninstalled
XENPAK Optical Modules
•
•
XENPAK is GBIC-like optical insert for 10 Gig Ethernet
XENPAK is the leading Multi Source Agreement (MSA)
– Industry Consortium lead by Agere and Agilent
– Xenpak inserts likely won’t be available until Mid 2002
– Highlights of the Xenpak pluggable optics
• Supports all IEEE 802.3ae optical interfaces
• Four wide XAUI interface
• Hot Pluggable
• Dual SC fiber optic connector
• Industry standard 70 pin electrical connector
– www.xenpak.org
802.3ae 10GbE Schedule
Task
Force
Formed
Study
Group
Formed
WG
Ballot
LMSC
“Sponsor”
Ballot
STD??
Project Authorization
Request Approved
N
O
V
J
A
N
M
A
R
M
A
Y
J
U
L
Y
S
E
P
T
Par Drafted
Adopt Core
Proposals
N
O
V
Last
Feature
J
A
N
M
A
R
M
A
Y
J
U
L
Y
S
E
P
T
N
O
V
J
A
N
M
A
R
Draft 4
Objectives Drafted
S
E
P
T
Draft 3
J
U
L
Y
2001
Draft 1
M
A
Y
2000
Draft 2
1999
M
A
R
TF
Review
Last Technical
Change
J
U
N
A
U
G
10Gbs Ethernet: Interoperability Demo
•
•
•
•
Held September 11th - 14th, 2001
Held at Interop in Atlanta, USA
Sponsored by 10 Gigabit Ethernet Alliance (10GEA)
5 Ethernet switch vendors (18 total companies – most
component vendors) participated, in alphabetical order:
–
–
–
–
–
Avaya
Cisco Systems
Extreme Networks
Foundry Networks
Nortel Networks
• Several vendors had partial interoperability with 10 GigE
• 2 vendors had 100% interoperability: Extreme & Cisco
– BlackDiamond with a 10GBASE-LR module passed bi-directional video
traffic over a 10GBASE-LR link with a Catalyst 6500 switch
10 Gbps Ethernet: Standards Summary
• 10 Gig Ethernet is designed for the LAN and MAN.
– 10 Gbps Ethernet standard supports up to 40Km
– 1 Gbps Ethernet standard was limited to 10Km.
• 10 Gig Ethernet compatible with DWDM/SONET
– Requires WAN PHY
• 10 Gig Ethernet standard essentially final.
– Technical specifications have been stable for many months.
– Minor edits to ‘Test Procedure’ portion likely during Mar/Apr 2002
• Interoperability coming along nicely.
– 2 fully interoperable vendors at Interop/Atlanta in Sept 2001
– Several more partially interoperable vendors
• Full IEEE approval of final text expected 3Q2002:
– June - August 2002
10GbE Benefits
•
•
•
•
•
•
Brings Ethernet cost model to 10 Gbps networks
Scales LAN backbones upwards
Aggregates 1 Gb Ethernet
Leverages 250 million Ethernet ports
Supports all services (voice, video, and data)
Supports LAN, MAN and WAN in one seamless
network
• Compatible with the installed base of SONET/SDH OC192 transmission equipment and with many WDM
systems.
Outline
•
•
•
•
10 Gigabit Ethernet:
10 Gigabit Ethernet:
Applications:
Applications:
Standards Update
Technology Comparison
Enterprise/Educational
Service Provider
Comparison: 1 Gbps to 10Gbs Ethernet
1 Gigabit Ethernet
10 Gigabit Ethernet
Both Half & Full Duplex
Full Duplex Only
Support Fiber & Copper Media
Fiber Only
Auto-negotiation
No Auto-negotiation
– Speed & Duplex in Copper
– Duplex only in Fiber
Support LAN up to 5 km
• Support LAN & WAN interface
• Both up to at least 40 km
Leverage Fiber Channel Optics
Create New Optics from Scratch
Re-use 8B/10B Coding
New 64B/66B Coding
Comparison: SDH to 10 Gig Ethernet
SDH STM-64 / SONET OC-192
10 Gigabit Ethernet
Can mux up lower speed (STM-1,
STM-4, STM-16) trunks
Can mux up lower speed (10 Mbps,
100 Mbps, 1 Gbps) trunks
Compatible with WDM equipment
Compatible with WDM equipment
(requires WAN PHY)
Supports Layer-3 Routing only
Supports Layer-3 Routing AND
Layer-2 bridging/switching
Supports up to ~80 Km typical with
Extended-Reach (ER) optics
Supports up to ~40 Km typical with
10GbaseER or 10GbaseEW optics
User data rate 9.88 Gbps
User data rates 9.88 Gbps (WAN
PHY) OR 10.0 Gbps (LAN PHY)
More Expensive
Less Expensive
10 GigE: Short-Term Pricing Estimate
Interface Type
Supported Distance
Price per Port ($)
SR or SW
~84 metres
$40K -50K
LX4
~300 metres
??*
LR or LW
~10 K metres
$40K -70K
ER or EW
~40 K metres
$100K -175K
• Why is it SO expensive today ?
–
–
–
–
Borrowing from SONET optics in short term (they are expensive!)
No critical mass of volume yet to drive component costs down
Vendors still experimenting with design and manufacturing processes
High pin-count for current optics. Xenpak will reduce pin count.
• What about Longer-term Pricing ?
– Once volume ramps up, component costs should start to drop
– Ultimate target is 3-4 times 1 Gbps Ethernet (on price-per-port basis)
* No major vendors for these optics at this time
Outline
•
•
•
•
10 Gigabit Ethernet:
10 Gigabit Ethernet:
Applications:
Applications:
Standards Update
Technology Comparison
Enterprise/Education
Service Provider
10GigE Applications:
Enterprise
• Aggregation of existing 1 Gig Ethernet links
• High-speed links
– Enterprise “campus” MAN supporting multiple sites within a city
– Enterprise backbone between floors/buildings of a single campus
– Interconnecting with existing WDM systems using WAN PHY
• Specialised high-bandwidth applications
– Imaging, Real-time Video, ASIC design, CAD/CAM, etc.
• Server farms
– Web farms, Mail servers, File servers, etc.
• Super-Computing
– Linux Beowulf cluster uplinks
– Other supercomputing applications
10GbE in the Enterprise LAN/MAN
Campus B
Campus A
• 10GbE Links
–
–
–
–
–
Between buildings
Between floors
Switch to switch
Switch to server
Supercomputer
cluster to core
– Uplink to ISP
Internet
Extranet
10GbE
10GbE
10GbE
10GbE
10GbE
10GbE
Data Center
Server
Farm
Supercomputer
Cluster
Outline
•
•
•
•
10 Gigabit Ethernet:
10 Gigabit Ethernet:
Applications:
Applications:
Standards Update
Technology Comparison
Enterprise/Education
Service Provider
10 GigE Applications: Service Provider
• Metropolitan Area Network (MAN) application
–
–
–
–
–
Interconnect Points-of-Presence (PoPs) in a single metro area
Eliminates need for GbE link aggregation
Helps relieve fiber exhaustion
Scales network capacity to the next level
Each link can be up to 40 Km using 10 Gig Ethernet standards
• Uplink connection to DWDM systems
– For ultra-high bandwidth needs (e.g. 40+ Gbps)
– For ultra-long-distance (e.g. > 40 Km) link distances
– Leverages the WAN PHY of 10 Gig Ethernet for DWDM interfacing
• Adds new product opportunities
– Can offer 1 Gbps links to each customer site
– Increases transmission distance while remaining standards-compliant
• Lowers service-provider costs / Improves margins
– 10 Gig Ethernet much less expensive than SDH/SONET alternative
10GbE MAN/WAN Over DWDM
10GBASE
-LR/LW or ER/EW
(Metro Link)
Campus X
10GBASE
-LR or ER
(Inter Campus)
DWDM Optical
Network
10GBASE
-LR
(Inter Building)
10GBASE-LR/
LW or ER/EW
(Metro Link)
Campus Y
10GBASE-SR/SW
(Fibre Jumper)
Enterprise B
Enterprise A
10GBASE-SR
(Fibre Jumper)
Server
Farm
Enterprise C
10GbE MAN over Dark Fiber
Location A
10GbE
Metro
Metro
10GbE
Metropolitan
10GbE
Networks
10GbE
Location C
Remote
Server Farm
10GbE
Location B 10GbE
For More Info about 10GbE …
10 Gigabit Ethernet Alliance (10GEA)
White Paper
www.10gea.org/Tech-whitepapers.htm
Thank you !
www.extremenetworks.com