Transcript Columbia University Campus Network

Campus Network
Update
12/6/99
NLANR I2 Techs @FIU
Alan Crosswell
[email protected]
1
Outline
A little about Columbia
Wide area Internet[2] connections
Metro area inter-campus network
Main campus network
Gigabit Ethernet experience
Some network apps (mcast, video, etc.)
12/6/99
NLANR I2 Techs @FIU
2
Outline
A little about Columbia
Wide area Internet[2] connections
Metro area inter-campus network
Main campus network
Gigabit Ethernet experience
Some network apps (mcast, video, etc.)
12/6/99
NLANR I2 Techs @FIU
3
Columbia People
40K people:
5,700 CU undergrads
2,500 non-degree
12,000 grad students
3,000 Barnard, TC, UTS students
7,700 CU faculty
7,600 staff
12/6/99
NLANR I2 Techs @FIU
4
Columbia Places
12/6/99
NLANR I2 Techs @FIU
5
Columbia Places
Morningside Heights
campus - 116/Bway
12/6/99
NLANR I2 Techs @FIU
6
Columbia Places
Morningside Heights
campus - 116/Bway
Health Sciences
campus - 168/Bway
12/6/99
NLANR I2 Techs @FIU
7
Columbia Places
Morningside Heights
campus - 116/Bway
Health Sciences
campus - 168/Bway
Lamont-Doherty Earth
Observatory - Palisades
12/6/99
NLANR I2 Techs @FIU
8
Columbia Places
Morningside Heights
campus - 116/Bway
Health Sciences
campus - 168/Bway
Lamont-Doherty Earth
Observatory - Palisades
several smaller facilities
12/6/99
NLANR I2 Techs @FIU
9
Outline
A little about Columbia
Wide area Internet[2] connections
Metro area inter-campus network
Main campus network
Gigabit Ethernet experience
Some network apps (mcast, video, etc.)
12/6/99
NLANR I2 Techs @FIU
10
Internet & Internet2 too
DS-3 NYSERNet (Applied Theory)
T-1 UUNet backup
T-1 ESnet
OC-3 NYSERNet 2000 (NN2K) ATM/SONET
vBNS OC-3 out of NYC POP
Abilene OC-3 out of NYC POP
Gemini2000 OC-3 out of NYC POP
PVC mesh among NYS schools
12/6/99
NLANR I2 Techs @FIU
11
NYSERNet 2000
Fiber along NYS Thruway from NYC to Buffalo
Corporate Partners:
Newbridge
Applied Theory
Funding:
NSF
NY State Science & Tech Foundation
12/6/99
NLANR I2 Techs @FIU
12
12/6/99
NLANR I2 Techs @FIU
13
Outline
A little about Columbia
Wide area Internet[2] connections
Metro area inter-campus network
Main campus network
Gigabit Ethernet experience
Some network apps (mcast, video, etc.)
12/6/99
NLANR I2 Techs @FIU
14
Metro Network:
Lamont-Doherty
DS-3 leased line ATM
T-1 leased line backup
12/6/99
NLANR I2 Techs @FIU
15
Metro Network:
Health Sciences
2 x 100 Mbps Ethernet
microwave (23 GHz)
DS-3 ATM microwave
10 Mbps Ethernet
microwave
(NB half vs. full duplex)
See also: Cornell Univ
12/6/99
NLANR I2 Techs @FIU
16
Outline
A little about Columbia
Wide area Internet[2] connections
Metro area inter-campus network
Main campus network
Gigabit Ethernet experience
Some network apps (mcast, video, etc.)
12/6/99
NLANR I2 Techs @FIU
17
Morningside
Heights area
10 Mbps Ethernet
microwave to an offcampus residence hall.
9 T1s to near-campus
buildings.
12/6/99
NLANR I2 Techs @FIU
18
Morningside
Heights ISP
736 V.90 dialups
5,700 student and
faculty apartments in
143 nearby buildings
Remainder in greater
NYC area (10 cent
untimed phone call in
the 5 boroughs!)
12/6/99
NLANR I2 Techs @FIU
19
Campus Telco
Campus and
Neighborhood POTS,
CATV, and:
ISDN (~200 users)
DSL (12 beta testers)
copper to switch room
own DSL hub
Cable modems RSN in
six apt buildings.
12/6/99
NLANR I2 Techs @FIU
20
10baseT
Ethernet
17,000 Ethernet ports
4,400 10baseT pillows
in 15 undergrad halls
500 10baseT in 20
frats
Mostly cat 3 wiring.
12/6/99
NLANR I2 Techs @FIU
21
100baseT
Ethernet
Lab of 72 Ultra-10s
Central server farm
Rewiring of SEAS
w/500 cat5 jacks
during winter break.
All renovations &
new construction are
cat 5 (about 6 bldgs)
12/6/99
NLANR I2 Techs @FIU
22
Separately administered
School & Dept Nets
Now gigE uplinked:
Astronomy & Physics (cisco)
Chemistry (cisco)
Computer Science (Xylan; almost)
Business (3com)
100baseFX or FDDI:
Law, Teachers College, Barnard College
Bringing old dept-run nets back into fold.
12/6/99
NLANR I2 Techs @FIU
23
Outline
A little about Columbia
Wide area Internet[2] connections
Metro area inter-campus network
Main campus network
Gigabit Ethernet experience
Some network apps (mcast, video, etc.)
12/6/99
NLANR I2 Techs @FIU
24
GigE Core Network
Centrally funded to upgrade all 10 Mbps
shared ports to 10 Mbps switched with a
gigabit Ethernet core.
4 Year $7.7M project (in 2nd year)
Replacing Cabletron and Xyplex shared
hubs and FDDI backbone.
Started as an ATM core. And stopped.
12/6/99
NLANR I2 Techs @FIU
25
12/6/99
NLANR I2 Techs @FIU
26
12/6/99
NLANR I2 Techs @FIU
27
12/6/99
NLANR I2 Techs @FIU
28
12/6/99
NLANR I2 Techs @FIU
29
GigE Core Network
Installed summer 99
Core network.
All Residence Halls.
VIP academic &
admin bldgs.
Cable prep for all
buildings.
12/6/99
NLANR I2 Techs @FIU
30
GigE Core Network
Ongoing now:
Reverting early ATM LANE bldgs to gigE.
Doing another academic/admin bldg every
week.
Converting school/dept LAN uplinks from
10 Mbps Ethernet to gigE or 100 Mbps.
12/6/99
NLANR I2 Techs @FIU
31
A Building Hub
Catalyst 5500 (small: 2900/3500)
Singly gigE uplinked to core switch/router
New construction and cat5 renovations
puts one of these typically every 3rd floor.
No config changes needed by users.
One or more VLANs with 802.1q trunk
vtp client
12/6/99
NLANR I2 Techs @FIU
32
A Core Router
Catalyst 6509
MSM router (MSFC upgrades ordered)
Concentrates several building hubs with
gigE uplinks.
Dual gigE uplinks to dual core L2 6509s
Dual sups and PS’s w/dual UPS.
vtp client and server
12/6/99
NLANR I2 Techs @FIU
33
A Core Switch
Catalyst 6509
Two of them at opposite sides of campus
One’s currently on generator power
Eight gigE uplinks from the eight
switch/routers
vtp client and server
12/6/99
NLANR I2 Techs @FIU
34
Older Network & Routers
FDDI backbone
ATM OC-3
2 x (old) Fore ASX200 (DS-3 & TAXI too)
4 x LS 1010
LANE in a bunch of 5500’s
7507s for WAN, FDDI, ATM
Dual 100baseFX into core (for now)
Various older routers for T1s (IOS 9:-)
12/6/99
NLANR I2 Techs @FIU
35
Routing Protocols
EIGRP
IGRP (incl. ESnet T1)
RIP (w/Fore equip @Lamont)
BGP
vBNS, Abilene, Gemini2000
NN2K schools
Applied Theory, UUnet
12/6/99
NLANR I2 Techs @FIU
36
Conversion “Issues”
Had to convert right-angle 25pr telco
connectors to straight-in!
Had to convert 15A outlets to 20A.
Long vs. short-haul GBICs
Expensive MM to SM conditioning cables.
Fiber testing: Plug and Pray
12/6/99
NLANR I2 Techs @FIU
37
Conversion “Issues”
MSMs vs. MSFCs (ACLs, appletalk routing)
DoS caused by unrestrained fast hosts on
a fast network.
Need to RTFM and turn on QoS RSN.
portchannels w/trunking appearing “up”
to the router when they aren't.
cost of Smartnet
12/6/99
NLANR I2 Techs @FIU
38
Outline
A little about Columbia
Wide area Internet[2] connections
Metro area inter-campus network
Main campus network
Gigabit Ethernet experience
Some network apps (mcast, video, etc.)
12/6/99
NLANR I2 Techs @FIU
39
Applications
Point to Point Video
H.323 Conferencing
Mbone
Wireless 802.11
12/6/99
NLANR I2 Techs @FIU
40
Point to Point Video
Dual-campus classes (Biomedical eng.)
ATT/Lucent EMMI mJPEG
OC-3 ATM PVC
DS-3 ATM microwave link
Would like to replace with IP
Users are “spoiled” by high quality video
12/6/99
NLANR I2 Techs @FIU
41
Point to Point Video Options
IPTV w/Optibase full or half D1 card.
Litton (Netaccsys) CAMvision2
H.323
suggestions from the audience, please!
12/6/99
NLANR I2 Techs @FIU
42
H.323 conferencing
Participated in the Megaconf
NYSERNet NYC conferencing host site
Zydacron Z340 & COMstation
Intel Proshare 500
Tandberg Codec 5000/RADvision VIU-323
Cisco 2511 recycled as MCM gatekeeper
H.320 gateways to be eval’d
12/6/99
NLANR I2 Techs @FIU
43
Multicast Backbone
Attended Shirl’s tutorial in Pittsburgh.
Called Ken T @ MCIW and he told me
what to type:-)
CGMP/IGMP snooping on Catalysts
PIM sparse-dense mode on router intfcs
RP is on I2 router (nn2k-gw)
IOS 12.0(6)S: T train doesn’t have mbone
support
12/6/99
NLANR I2 Techs @FIU
44
Multicast Backbone
Two conferences so far (earthscape.org)
IPTV 2.0 and Osprey-100 card (H.261)
In parallel with RealProducer G2.
Three-finger salute needed frequently on
the NT server running Content Manager.
Getting 3.0 and an Optibase MPEG2 D1.
Still need to peer w/Abilene, NN2K sites.
12/6/99
NLANR I2 Techs @FIU
45
Multicast Backbone
Would rather be using vic and vat/rat on a
real operating system.
So many things that use multicast but that
don’t work with each other (Real, IPTV,
videocharger, Litton, etc.)
Need to learn a lot about video production.
12/6/99
NLANR I2 Techs @FIU
46
Wireless 802.11 (plans)
Playing with CS dept using Wavelan.
4 x WPII, 20 silver cards ordered.
Outdoor campus spaces.
Roof-to-roof applications for backhoe
protection and near-campus buildings.
RF weanie at W2AEE (self:-) who has
actually read 47CFR15.
12/6/99
NLANR I2 Techs @FIU
47
To-do List
QoS with WFQ, CAR, WRED, etc.
We’ve gotten as far as knowing the
acronyms.
Network Management in our spare time.
12/6/99
NLANR I2 Techs @FIU
48
FIN
12/6/99
NLANR I2 Techs @FIU
49