Transcript CS-Stanford

SUNet
the Stanford University Network
Presentation
for the Internet2
Campus Networking Workshop
A brief history of SUNet
• Originally a research project of EE, CS and
Medical grad students
• Networking staff assembled in 1983
• Centrally funded since 1984
• Cable plant project in 1985
• Responsible for operations since 1986
Backbone technology evolution
•
•
•
•
•
•
3Mb ethernet from Xerox PARC ~ 1979
Large bridged ethernet - DEC bridges 1986
Campuswide FDDI ring 1990
Multiple FDDI rings from Cisco 7513 1995
Initial fiber install in 1985 - 12 MM
Latest trunks: 96 MM/48 SM
In-building wiring
• Complete spectrum down to 3-pair RJ-11
• New buildings get at least 2 Cat-5 network
jacks along with 2 Cat-3 phone wires
• Centrally funded wiring improvement
project - recently approved - requires
matching departmental investment in
activation
SUNet design parameters
•
•
•
•
•
•
•
TCP/IP only supported backbone protocol
Appletalk is tunneled with Fastpaths
Medical Center routes IPX/Appletalk
DECNET still on in several routers
Networking supports to building entrance
Local Network Administrators in buildings
Network consultants assist LNAs
Network components
•
•
•
•
•
•
•
49 routers from Cisco
3 7513, 2 7507, 6 7000, 4 7206, 5 4700
7 2501, 1 2514, 1 3000
and still 9 AGS+, 10 AGS, 1 CGS
FDDI concentrators from DEC
FastEthernet switches: Catalyst 5000/5500
ATM switches: LS1010
SUNet statistics 970914
•
•
•
•
•
•
•
From NetDB, the network database
Generates DNS and BootP tables
442 subnets defined, 342 active
327 physical subnets
240 main campus, 87 Medical Center
33866 hosts, 35445 addresses
24749 campus hosts, 9117 Medical Center
UCnet
ACE
workstations
Student
SUNet
DMZ
Core
Cisco 7513
BBN Planet
(and beyond….)
ACE/AFS
servers
ACE
AFS
Engineering
Med
General
MedNet
GSB
Admin
servers
GSB
SUNet Backbone
as of early 1997
Gates 1
7000
Gates 2
7000
CIS
AGS+
Varian
AGS+
SUNet
7000
DMZ
FDDI
InfoSci
AGS+
Med
Center
GSB-DMZ
4700
Med
7206
BBN Planet
CERAS
AGS+
DMZ
4700
AFS/DCE
Servers
CORE
Res-West
4700
ACE Servers
Res-South
4700
7513
FDDI
MedNet
AGS+
FDDI
Res-Central
AGS+
FDDI
FDDI
GSB-DMZ
4700
Res
4700
Sweet
7507
Jenkins
AGS+
NCS
7000
Encina
AGS+
Quad
7206
Press
7000
Pine
7507
Next generation requirements
• Migration from Mainframe to distributed
computing model for Admin systems
• Choice of DCE as standard platform
• Higher bandwidth for image transfer, etc
• Increased reliability as well as capacity
Next Generation choices
• ATM seemed likely even 18 months ago
• New routers were ordered with ATM
• New Computer Science building provided
early implementation experience for both
LANE and FastEthernet VLAN trunking
• Sought advice from Cisco Consulting
Engineers
Proposed ATM backbones
ATM
switch
ATM
switch
ATM
switch
ATM
switch
ATM
switch
ATM
switch
ATM
switch
ATM
switch
Concerns with ATM design
• Redundancy vs. Interface expense
• Total throughput
• Staff education on a new technology
N-dimensional mesh network
•
•
•
•
Proposed by Cisco’s Roger Beeman
Designed to have well defined expansion
Multiple paths provide aggregate capacity
Significant redundancy makes individual
components less critical
• Networks on corners
• 2-way routers on edges or 4-way routers on
faces
4-way connected routers on faces
• 3-D (cube) : 8 networks, 6 routers
• 4-D (hypercube): 16 networks, 24 routers
• 5-D: 32 networks, 80 routers
The SUNet choice - a cube
• Attracted by the combination of redundancy
and expandable capacity
• Have purchased 6 7513s with 4-VIP2s with
100FX port adapter each
• Have purchased 4 Catalyst 5000s with 2
12x100FX boards, each will be two corners
(using VLANs)
SUNet cube backbone
layout and addressing
Sweet
Pine
Forsythe
Press
.3
0
.2
.33
2
.34
.1
.33
.2
3
1
.18
.18
1
.98
.50
.49
3
.82
.51
.98
.35
.67
4
.17
.65
.66
.114
.49
4
.35
.51
.3
6
.97
.99
5
.115
2
.19
.65
.83
.81
.82 .83
5
.81
.114
6
.97
.113
7
.115
Connections to the cube
• User routers connected to at least two
corner networks
• Server nets directly connected to two
backbone routers using HSRP <or>
• Server router directly connected to two
opposite face backbone routers
• Three “hotspots” - ACE servers, Admin
servers and Off-campus/Internet
User router choices
• Planned to serve multiple networks per
router interface using VLANs and Catalysts
• Now planning to use router module (RSM)
in Catalyst 5500 and feed Catalyst 5000s
• Have ordered several to replace remaining
AGS+ routers
• Will use Catalyst 3200 replacing AGS
“departmental routers”
SUNet Cube Backbone
User routers
R
R
Legacy routers
Commercial
Internet
FE
FDDI
FE
R
R
FE
R
R
FE
R
R
R
FE
FE
R
FE
R
User routers
R
Router to
BBN
FE
CalREN-2
Gigapop
Organization
• ITSS - Information Technology Systems
and Services
• CCS - Computer and Communications
Services
• Networking Systems - centrally funded
• Production Services - Operations/Systems
• SUNet Operations
Responsibilities
•
•
•
•
•
Backbone routers
End-to-end TCP/IP protocol
Network to the building entrance
Run network servers (DNS, DHCP, etc)
Support network consultants/LNAs
Support profile
•
•
•
•
Onsite staff - 7am - 11pm Monday-Friday
Weekend - 8 hours/day
On call support 7 by 24
Off hour trouble calls taken by Computer
Operations staff who page on call person
Staffing level
• Operations has 5 Network Specialists and 3
Systems Programmers
• Systems has 2 SysAdmins, 2 generalists
• One network specialist/one sysadmin work
the late shift (3pm-11pm)
Multicast
•
•
•
•
•
•
Currently using PIM dense mode
Works in 11.0 AGS routers (if no loops)
Plan to deploy in new backbone
SCPD (SITN) Engineering classes
Library - supplement class videotapes
Conferencing with remote sites
Network monitoring
•
•
•
•
DEC MSU / Remedy Health Profiler
IBM Netview 6000
Perl scripts
Ethermeters / RMON
Traffic/usage data
• Have been using Cisco’s Netflow Export looks very promising
• Other products being examined
Challenge of Internet2
• More of a co-operative than NSFNET
• Trouble ticket generation/responsibility
• Service level commitment between
members?
• Chance to use the technology!
Gates Building Network
9/8/97 CSDCF
21ea. Cisco Catalyst 5000
1000 10BaseT ports, 80 100BaseT ports, 20VLans
Cisco 5000
….
….
Cisco 5000
Cisco 5000
To 7 Catalyst 5000
To 21 Catalyst 5000
... ... ... ... ... ...
Cisco 5000
10ea.10MB ether ports
connected to C5000
........
4ea.
100MB
connected
to C5000
. .
Cisco 7513 Router
100MB Vlan BBone
Campus Backbone FDDI 100
Cisco LS1010
155MB ATM BBone
OC3 ATM
Gates VLAN Connections
G Cat-04
G Cat-1-1
G Cat-2-1
G Cat-31
G Cat-41
G Cat-0-2
G Cat-14
G Cat-24
G Cat-3-4
G Cat-4-4
G Cat-0-1
G Cat-12
G Cat-22
G Cat-3-2
G Cat-4-2
G Cat-0-3
G Cat-13
G Cat-23
G Cat-3-3
G Cat-4-3
VLAN 1:
VLAN 41:
VLAN 3:
VLAN 4:
VLAN 5/45:
VLAN 6:
171.64.70.10 - All GCATs
171.64.64.10
171.64.65.10
171.64.67.10
171.64.68.10
171.64.71.10
Cisco LS1010
9/8/97 CSDCF
G Cat-5-1
Cisco 7513 Router
Gates VLAN Connections
9/8/97
G Cat-04
G Cat-1-1
G Cat-2-1
G Cat-31
G Cat-41
G Cat-0-2
G Cat-14
G Cat-24
G Cat-3-4
G Cat-44
G Cat-0-1
G Cat-12
G Cat-22
G Cat-3-2
G Cat-4-2
G Cat-03
G Cat-13
G Cat-23
G Cat-3-3
G Cat-4-3
VLAN 7:
VLAN 8:
VLAN 9:
VLAN 11:
VLAN 12:
VLAN 13
171.64.72.10
171.64.73.10
171.64.75.10
171.64.76.10
171.64.66.10 100MB
171.64.74.10 100MB
171.64.77.10 100MB
Cisco LS1010
G Cat-51
Cisco 7513 Router
Gates VLAN Connections
9/8/97
G Cat-04
G Cat-1-1
G Cat-2-1
Experimental ATM
ELAN 30
G Cat-31
G Cat-41
G Cat-5-1
DHCP Public VLAN
VLAN 19
G Cat-0-2
G Cat-14
G Cat-24
G Cat-3-4
G Cat-4-4
G Cat-0-1
G Cat-12
G Cat-22
G Cat-3-2
G Cat-4-2
Vlan 16 Firewall Net(Cheriton)
G Cat-0-3
G Cat-13
G Cat-23
Repeater from Med Center
VLAN 13: 171.64.77.10
VLAN 15
VLAN 14/16: 171.64.79.10 100MB
VLAN 15: 171.65.XX.XX
VLAN 17: 171.64.67.10
VLAN 19: 171.64.70.128
Cisco
ELAN 30:: 171.64.70.128
ELAN 45: 171.64.68.10
G Cat-3-3
G Cat-4-3
VLAN 17 Mosquito Net(Baker)
LS1010
Cisco 7513 Router