Transcript CCSF Metro network Tim Ryan

Metropolitan Area Network
June 13, 2006
Presented by:
Tim Ryan
Network Manager
[email protected]
City College of San Francisco
Technology Overview
•
Information Technology Environment:
– 5,000 Desktop Computers
– 200 Switches and Routers
– Wireless LAN Access on Multiple Campuses
– Alcatel Voice over IP Telephone System, Approximately 2,000 Phones
– PictureTel VideoConferencing Systems Using Video over IP
– 100Mbps Internet Access
– 1000Mbps Internet2 Access
– Fiber-Based Metro Area Network
• Seven Campuses Currently Connected
• Two Additional Pending Construction (Mission, Chinatown)
• 1000Mbps Shared Intercampus Network
• Additional Capacity Available for Future Growth
Metro Area Network Initiative
•
•
Metro Area Network Goals:
– Connect All Major Campuses With Fiber-Optic Infrastructure
– Provide Scalability for Future Growth with Easily Maintained Components
– Ensure Compatibility with Other Colleges and Universities
Completed Feasibility Study in 2002
•
Hired Optical Networking Consultant in 2003: Photisis Consulting
•
Selected Core Technology: Gigabit Ethernet
•
Documented Existing San Francisco Commercial Fiber Plant
•
Issued Commercial RFP for Fiber Installation and Lease
•
Determined Municipal Partnership was a Preferred Solution
•
Established Fiber Routing and Technical Criteria
•
Received Funding Approval from Board of Trustees ($3.5M)
– See www.ccsf.edu/board
•
Then Archives:June 2004:Resolution B11
Finalized Partnership Contract with City & County of San Francisco
– Department of Telecommunications and Information Services (DTIS)
City College &
CENIC Partnership
•
•
•
•
•
•
CENIC: Corporation for Education Network Initiatives in California
A Not-For-Profit Corporation Serving:
– University of California (9 Campuses)
– California State University (23 Campuses)
– California Community Colleges (109 Campuses)
– Cal Tech, USC, Stanford
– Statewide K-12 System
Coordinate Development, Deployment and Operation of Network Services
– See www.cenic.org
– Then Network:Network Operations:Usage Graphs:Utilization
Developed State-Wide Optical Network Architecture
Provided a Model for City College Network Architecture
Presented Honorable Mention Award to City College in 2003
City College Internet Usage Graph
Metro Area Network - Physical Fiber Path
200 Paul
Production Ring Design
Alemany
Enet Switch
Strands 1,2 IN
Strands 1,2 OUT
Fiber
Patch
Panel
Strands 1,2 OUT
Fiber
Patch
Panel
Fiber
Patch
Panel
Strands 1,2 IN
Gough
Enet Switch
Strands 1,2 IN
Ocean
Enet Switch
Core
Switch
Infrastructure
Fiber
Patch
Panel
Fiber
Patch
Panel
Strands 1,2 IN
Strands 1,2 OUT
Downtown
Enet Switch
Strands 1,2 IN
John Adams
Enet Switch
Strands 1,2 OUT
Strands 1,2 OUT
Strands 1,2 OUT
Strands 1,2 IN
Fiber
Patch
Panel
Fiber
Patch
Panel
Fiber
Patch
Panel
Evans
Enet Switch
Strands 1,2 OUT
Strands 1,2 IN
Southeast
Enet Switch
Production Ring – Projected Optical Link Loss
Alemany
Enet Switch
12,000'
Strands 1,2 OUT
Fiber
Patch
Panel
3.9 dB
Strands 1,2 IN
Strands 1,2 OUT
3.3 dB
Fiber
Patch
Panel
8,000'
Fiber
Patch
Panel
Strands 1,2 IN
6.5 dB
3.6 dB
38,000'
8,000'
Gough
Enet Switch
Fiber
Patch
Panel
Fiber
Patch
Panel
Strands 1,2 IN
Strands 1,2 IN
3.2 dB
36,000'
5,000'
Fiber
Patch
Panel
Fiber
Patch
Panel
Strands 1,2 IN
Ocean
Enet Switch
Core
Switch
Infrastructure
Strands 1,2 OUT
6.1 dB
Strands 1,2 OUT
Downtown
Enet Switch
Strands 1,2 IN
John Adams
Enet Switch
Strands 1,2 OUT
Strands 1,2 OUT
Fiber
Patch
Panel
Strands 1,2 OUT
Strands 1,2 IN
10.8 dB
51,000'
Note:
LX Optical Budget: 12 dB
LH Optical Budget: 23 dB
Evans
Enet Switch
Southeast
Enet Switch
Internet Ring Design
Alemany
Enet Switch
Strands 1,2 IN
Strands 1,2 OUT
Fiber
Patch
Panel
Strands 1,2 OUT
Fiber
Patch
Panel
Fiber
Patch
Panel
Strands 1,2 IN
Gough
Enet Switch
Downtown
Enet Switch
Strands 1,2 IN
John Adams
Enet Switch
Strands 1,2 OUT
Strands 1,2 OUT
Fiber
Patch
Panel
Fiber
Patch
Panel
Strands 1,2 IN
Strands 1,2 OUT
Strands 1,2 IN
Evans
Enet Switch
Strands 3,4 OUT
Strands 3,4 IN
Strands 1,2 OUT
Fiber
Patch
Panel
Fiber
Patch
Panel
Strands 1,2 IN
Core
Switch
Infrastructure
Strands 1,2 OUT
Strands 1,2 IN
Strands 1,2 IN
Ocean
Enet Switch
Fiber
Patch
Panel
Strands 1,2 OUT
200 Paul
Enet Switch
Southeast
Enet Switch
Internet Ring – Projected Optical Link Loss
Alemany
Enet Switch
Strands 1,2 IN
Strands 1,2 OUT
Fiber
Patch
Panel
Strands 1,2 OUT
Fiber
Patch
Panel
Fiber
Patch
Panel
Strands 1,2 IN
Gough
Enet Switch
Downtown
Enet Switch
Strands 1,2 IN
John Adams
Enet Switch
Strands 1,2 OUT
Strands 1,2 OUT
Fiber
Patch
Panel
Fiber
Patch
Panel
Strands 1,2 IN
Strands 1,2 OUT
Strands 1,2 IN
Evans
Enet Switch
Strands 3,4 OUT
Strands 3,4 IN
Strands 1,2 OUT
Fiber
Patch
Panel
Fiber
Patch
Panel
Fiber
Patch
Panel
Strands 1,2 IN
Strands 1,2 IN
Strands 1,2 IN
Strands 1,2 OUT
28.7 dB
6.4 dB
Ocean
Enet Switch
Core
Switch
Infrastructure
Strands 1,2 OUT
35,000'
123,000'
200 Paul
Enet Switch
Note:
LX Optical Budget: 12 dB
LH Optical Budget: 23 dB
VLH Optical Budget: 32 dB
Southeast
Enet Switch
Ethernet Equipment Details
HP ProCurve Networking
Switch 5304xl
HP ProCurve Switch xl
Mini-GBIC Module
HP ProCurve Gigabit-LX-LC
Mini-GBIC
Ethernet Equipment Parts List
Component
Part
Quantity Cost
Number
ProCurve Switch 5304xl
J4850A
8
$9,328
ProCurve Mini-GBIC Module
J4878A
19
$14,383
ProCurve SX Mini-GBIC
J4858A
44
$12,276
ProCurve LX Mini-GBIC
J4859A
20
$12,340
ProCurve LH Mini-GBIC
J4860A
2
$6,648
Total Estimated Cost
$54,975
Metro Area Network
Applications & Benefits
•
•
•
•
•
•
•
•
•
Transport Internet Access to/from CENIC Communications Hub
Carry Internal Voice-over-IP Telephone Traffic Between Campuses
Enable Distance Learning Between Campuses and Colleges
Provide Video-on-Demand Services to Classrooms
Provide Increased Bandwidth for Online Courses
Enable Scalability to Meet Future Communication Needs
Provide Predictability and Control Over Cost of Communication Services
Maintain Infrastructure With Existing Engineering Staff and Skill Sets
Achieve Significant Cost Savings Versus Leased Services
– Approximately $1 Million Over 20-Year Period
Metro Area Network
Academic & Industry Cooperation
•
•
•
•
•
•
•
•
•
Provide Hands-On Learning Environment For Computer Networking Department
– Dedicate Fiber Strands for Student Experimentation and Testing
Expand Cisco Academy to Include Optical Networking
Provide Metro-Area Connectivity to Local Non-Profit Organizations
Provide Test Environment for Communications Equipment Vendors
Provide Test Environment for Metro Area Service Providers
Apply Techniques and Procedures Developed by National LambdaRail
Apply Standards Developed by Metro Ethernet Forum (MEF)
Distribute Project Findings and Test Results via Forums Such as IEEE
– “A Cooperative Academic and Municipal Metro Area Network” April, 2004
References:
– “Metro Ethernet” by Sam Halabi, Cisco Press
– “Ethernet-Based Metro Area Networks” by Daniel Minoli, McGraw-Hill
Metro Area Network
Layer 2 Operational Details
•
Ring Design Implies Redundant Data Paths
•
Spanning-Tree Protocol Prevents Data Loops, Establishes One Active Path
– Spanning-Tree Protocol (IEEE 802.1D) Restoration Time = 45 Seconds
– Rapid Spanning Tree Protocol (IEEE 802.1w) Restoration Time = 1 Second
– Port States = Forwarding, Blocking, Listening, Learning
•
Ocean Campus Switch Designated as Root Bridge
•
Alemany Campus Switch Has Highest Path Cost, Port A2 in Blocking State
•
Testing to Date: Ring Restoration Time Approximately 1 to 2 Seconds
– Data IP Sessions Remained Active, No Noticeable Impact
– Some Voice Sessions Dropped, No Obvious Pattern
– Additional Tuning and Testing Required to Retain all Voice/Data Sessions
Metro Area Network
Spanning-Tree Example
ALE11R1H5# sho span
Rapid Spanning Tree (RSTP) Information
STP Enabled : Yes
Force Version : RSTP-operation
Switch Priority : 32768
Max Age : 20
Hello Time : 2
Forward Delay : 15
Topology Change Count : 676
Time Since Last Change : 19 days
Root MAC Address : 000f20-ef5e00
Root Path Cost : 80000
Root Port : A1
Root Priority : 4096
Port Type
Cost
Priority State
| Designated Bridge
---- --------- --------- -------- ---------- + ----------------A1 1000LX 20000 128
Forwarding | 000f20-ef2700
A2 1000LX 20000 128
Blocking | 000f20-ef4600
A3 1000SX 20000 128
Disabled |
A4 1000SX 20000 128
Disabled |
B1 1000SX 20000 128
Forwarding | 000f20-ef2300
B2 1000SX 20000 128
Forwarding | 000f20-ef2300
B3 1000SX 20000 128
Forwarding | 000f20-ef2300
B4 1000SX 2000000 128
Disabled |