Transcript Why dark fibre for RENs

Research Department
www.ces.net
Towards a Nation-wide
Fibre Footprint in Research
and Education Networking
Lada Altmannova
Stanislav Sima
Rhodes June 9th, 2004
Research Department
TERENA Networking Conference
www.ces.net
Situation in REN design





Network design is on the top of design levels hierarchy:
ICs, cards/units, computers, networks, and is relatively
new. WAN/MAN design is still less developed (mainly
in consequence of previous long-term monopolies).
Traditional building elements (procured) are data
transmission services, routers, terminals, etc.
Traditional network function is to provide best effort IP
connectivity
New building elements: dark fibres, optical transmission
equipment, switches
New network function: provide E2E circuits
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
2
Research Department
TERENA Networking Conference
www.ces.net
Multi-vendor network design



Multi-vendor networking is necessary for
feasibility in multiple domain
Multi-vendor networking is necessary in general
case for cost effectiveness also in single domain
Standards, Multi-Source Agreements (MSA),
interoperability, etc. gives you independence on
one vendor (in design, reparation, upgrade, etc.)
and allows you to buy best equipment in each
category
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
3
Research Department
TERENA Networking Conference
www.ces.net
Fibre is strategic asset


Fibre infrastructure has been recognised as
strategic asset for research and education
networking
– In some countries, states or regions in Canada,
Europe and USA since 2000
– In USA (national scale) since 2003
– in EU (union scale) since 2004 (GN2)
Customer Empowered Fibre (CEF) networks are
emerging technology, that gradually changes
network topology, architecture and services from
bottom of hierarchy to top
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
4
Research Department
TERENA Networking Conference
www.ces.net
Lengths of dark fibres in RENs

More than 20 000 km in Europe
(plus some fibres for GN2 and GN2 testbed)

About 33 920 km in USA
(including National LambdaRail)
About 6 700 km in Canada
 NFF contracted in Australia ….

Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
5
Research Department
TERENA Networking Conference
www.ces.net
CEF Networks and industry support





Government support of network research should prepare
investment opportunity and should support
national/federal/union industry development
Traditionally this means support of carriers and router vendors
For CEF Networks this means rather support of fibre cable
vendors, companies laying fibre cables with maintenance,
transmission equipment vendors etc.
Optronics vendors now are becoming aware of the non-carrier
(enterprise, RENs) market for their gear
= CEF Networks brings new relation between network
research and vendors
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
6
Research Department
TERENA Networking Conference
www.ces.net
Economics decides





Dark fibres brings progress to REN design and subsequently to
WAN design generally (and than in competition winner takes
nearly all)
Strategic importance of getting fibres has been recognised
Comparison of temporary dark fibre and lambdas prices is usable
for very partial view only and cannot solve problem in general.
Economics decides, but not naïve economics.
Some reasons: uncertain number of lambdas, period of using,
future upgrade of the transmission rate, topology changes,
uncertain future economical conditions, unexpected new
possibilities, …
Actual result: some managers build CEF Networks and others
study the problem…
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
7
Research Department
TERENA Networking Conference
www.ces.net
Why dark fibre for RENs ?










Freedom in REN design
Getting fibre means controlling the network
Independence on carriers and on router vendors
Fixed costs of long-term use
Transmission capacity up to Tbps
Cost-effective ways of fibre sharing (WDM, TDM, …)
Expensive dark fibres can be shared by non-profit partners
Multiple wavelengths possible (e.g. 1 – 256)
Multiple fibres in cable, multiple ducts in way…
Equipment selection, moving, design, …..
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
8
Research Department
TERENA Networking Conference
www.ces.net
How to go from telco services to dark fibres





Procure dark fibre independently and before lambdas
procurement
Prefer agreements on long term lease with discounts instead of
IRU (disadvantages of IRU are prepayment, taxes and risk of
bankruptcy)
Do not relay on one provider only, maintain concurrency (for
price and for first mile acquiring)
If price is not excellent, use annual contracts and re-procurement
If dark fibre line is not offered but exists, use annual contract for
lambda(s) and re-procure dark fibre
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
9
Research Department
TERENA Networking Conference
www.ces.net
Dark fibre deployment in RENs




Increasing and world-wide deployment of dark fibre
(acquisition of dark fibres instead of SDH or lambda
services) – without moving back
Increasing number of customer premises connected by
fibre: to achieve this is more difficult problem than
intercity fibre acquisition
Lease of fibres: good prices are 0.4 Euro/m/pair/year for
G.652 or 0.5 Euro/m/pair/year for G.655 , including
maintenance
Building first mile 12 fibre lines: about 30 Euro/m in
ground (6 month for delivery), and about 10 Euro/m in air
(3 month for delivery)
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
10
Research Department
TERENA Networking Conference
www.ces.net
CEF network architecture will be new





Prefer network architecture with NIL (single span) lines
and without overlaying (concurrent) fibres
KIS rule for fibres: Keep It Short, including
connections crossing state borders
Realization of lambdas by own equipment and fibres
for long distance data transmission
Search actively for new fibre providers (railways, roads
and highways, electric power, fuel, gas and heat
distribution companies, cable TV companies, etc.)
Search actively for regional authorities and local boards
cooperation on laying first mile fibre cables
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
11
Research Department
TERENA Networking Conference
www.ces.net
Photonic Air Links (PAL)






Gigabit transmission rates are possible in free space
Customer Empowered Photonic (CEP) Networks are
expected: fibre+PAL
PAL is used usually between buildings (fan-out of
photonic transmission to end users in some area)
Transmission rate: from 10 Mbps up to 2.5 Gbps,
distance 100 m – 4000 m, costs 1500 – 30 000 Euro
DIY solution of PAL 10 Mbps (for example for students
to home – costs 150 Euro)
Microwave backup (probably up to 622 Mbps) of PAL
(on L1 level) is possible – e. g. for foggy weather
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
12
Research Department
Rhodes June 9th, 2004
TERENA Networking Conference
Towards a Nation-wide Fibre Footprint in RENs
www.ces.net
13
Research Department
Rhodes June 9th, 2004
TERENA Networking Conference
Towards a Nation-wide Fibre Footprint in RENs
www.ces.net
14
Research Department
TERENA Networking Conference
www.ces.net
Dark fibre lighting register: see before new line design
Country
A
B
Attenuation
(dB at 1550nm)
km
Experi-
Fibre/Pair Planed mental
CZ
Praha
Brno
285,8
66,7
Pair
X
CZ
Praha
Plzeň
159,4
36,7
Pair
X
CZ
CZ
CZ
CZ
CZ
CZ
Praha
Praha
Praha
Praha
Praha
Brno
Brno
Liberec
Pardubice
Plzeň
Ústí n.L.
Olomouc
326,7
200
188,6
123
155,3
107
81
46,03
33,72
36,8
27,5
Pair
Pair
Pair
Pair
Pair
Pair
CZ
Brno
Ostrava
235,4
50,55
Pair
CZ
CZ
CZ
CZ
CZ
CZ
CZ
Č.B.
Č.B.
Olomouc
Olomouc
Olomouc
Pardubice
Ústí n L.
Brno
Plzeň
Hradec K.
Ostrava
Zlín
Hradec K.
Liberec
307,9
178,3
197,4
189,8
71,5
30
123
69,76
40,78
42,96
43,51
22,46
7,5
26,23
Pair
Pair
Pair
Pair
Pair
Pair
Pair
CZ
Č.B.
J. Hradec
70,7
18,41
Fibre
CZ
Ostrava
Karviná
76,7
20,27
Fibre
CZ
Ostrava
Opava
49,9
18,22
Fibre
CZ
Plzeň
Cheb
126,5
35,65
Fibre
CZ
Ústí n L.
Děčín
34
8,6
Fibre
Rhodes June 9th, 2004
Operational Transmission Equipment
2x Keopsys 27 dBm + Raman laser +optical
filter, CGBIC
EDFA 2in1 booster 17 dBm + preamplifier 10dBm + optical filter, 2x GBIC ZX
10.1.2000 3x ONS15104
X
17.5.2002
3.9.2003
6.12.2003
25.11.2003
Keopsys 2x 21 dBm , 2x GBIC ZX
Keopsys 2x 10dBm, POS LR 2,5G
Catalyst switch in line, 2x CGBIC
2x CGBIC
6.6.2003 Keopsys 2x 27dBm+2x 10dBm+2x CGBIC
Keopsys 2x 27dBm+2x 10dBm in line, POS
15.9.2003 LR 2,5G
25.7.2003 Keopsys 2x 24dBm, POS LR 2,5G
1.2.2004 Keopsys 2x 27dBm, POS LR 2,5G
1.2.2004 Keopsys 2x 27 dBm, 2x CGBIC
19.2.2003 2x CGBIC
15.1.2002 2x GBIC ZX
30.6.2003 2x CGBIC
MRV 2x EM 316WFC/S4 & WFT/S4, 4017.8.2003 100km
MRV 2x EM 316WFC/S4 & WFT/S4, 4024.7.2003 100km
MRV 2x EM 316WFC/S4 & WFT/S4, 4026.3.2003 100km
MRV 2x EM 316WFC/S5 & WFT/S5, 4016.7.2003 125km
MRV 2x EM 316WFC/S3 & WFT/S3, 201.7.2003 50km
Towards a Nation-wide Fibre Footprint in RENs
15
Research Department
TERENA Networking Conference
www.ces.net
NFF in European NRENs

Switzerland
– SWITCH: NFF operational, 1150 km, transmission
system with own development (NIL on single fibre)

The Czech Republic
– CESNET2: NFF operational, 2800 km, transmission
system with own development (long distance NIL)
– CzechLight: 445 km DF with experimental traffic

Poland
– PIONIER: NFF 2648 km plus 1426 km own and leased
fibres operational, plus 2300 km in negotiation
– 10GE DWDM transmission system operational
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
16
Research Department
TERENA Networking Conference
www.ces.net
NFF in European NRENs II.

Ireland
– HEAnet : 1300 km fibres available, operational part, support
of optical networking abroad

The Netherlands
– SURFnet6: 4000 km fibres available, operational part with
DWDM transmission system, new approach on NREN
architecture (central routers only)

Slovakia
– SANET: NFF operational, 1660 km own and leased fibres, GE
transmission system, partially CWDM 4 x GE

Serbia
– RCUB: 115 km operational, contracted 1400 km with telco
operator (with government support), GE transmission system,
CWDM testing
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
17
Research Department
TERENA Networking Conference
www.ces.net
NFF in European NRENs III.

Portugal
– FCCN : Tender for 400 km dark fibre

Denmark
– UNI-C : 525 km dark fiber for testing, 10 GE

Norway

– using or sharing of nation-wide dark fibre available (by
agreement with telco operator)
See reference to CEF Networks workshop for more details
Metropolitan dark fibre RENs in Netherlands, Poland,
Czech Rep., Greece, Hungary, Ireland, …..

Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
18
Research Department
Rhodes June 9th, 2004
TERENA Networking Conference
Towards a Nation-wide Fibre Footprint in RENs
www.ces.net
19
Research Department
Rhodes June 9th, 2004
TERENA Networking Conference
Towards a Nation-wide Fibre Footprint in RENs
www.ces.net
20
Research Department
TERENA Networking Conference
www.ces.net
Cheaper International Fibre Footprint (IFF)




KIS: Connect dark fibres used by NREN by a
short cross-border fibre lines (called also Near
over Border - NoB)
Use WDM equipment on national and crossborder fibres for implementation of international
lambdas between end users
This KIS approach avoids some double payments
of fibres or lambdas (parallel lines are paid by
NREN and DANTE), in the biggest item of
budgets
Such change of networking strategy is difficult,
needs research and testbeds
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
21
Research Department
TERENA Networking Conference
www.ces.net
KIS for cheaper architecture



Connection of NRENs by short dark fibre (Keep It Short)
between NREN PoPs or Users Near over Border (NoB)
NoB dark fibres (lenght, status):
– Bratislava (Slovakia)–Vienna (Austria): 104 km,
operational
– Bratislava (Slovakia)–Brno (Czech Rep.): 182 km,
operational
– Ostrava (Czech Rep.)-Bialsko-Biela (Poland): 136 km,
available
– Subotica (Serbia)-Szeged (Hungary): 40 km, available
– Kista in Stockholm (Sweden)-Ventspils (Latvia): 405
km, experimental university connection, undersea part
Other lines are prepared
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
22
Research Department
TERENA Networking Conference
www.ces.net
Examples (see GÉANT topology)


Short dark fibres Brno – Bratislava – Vienna and
Ostrava –Bialsko-Biala gives possibility to realize
lambdas Prague – Bratislava, Prague – Vienna,
Poznan – Vienna, Prague – Poznan etc.
Lambda services London – Stockholm and Poznan
– Stockholm could be realized by means of
connections London – Brussels – Amsterdam –
Copenhagen – Stockholm and Poznan Copenhagen
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
23
Research Department
TERENA Networking Conference
www.ces.net
PC Light



Design Kit for wide area fibre networks, based on
racked PCs with build-in optical amplifier modules
Multi-vendor (multi-source) building elements
Preliminary comparison of OA (EDFA) costs:
–
–
–
–
OA from „ISP vendor“: 40 000 USD
OA from „optical vendor“: 18 000 USD
OA from „module vendor“: 2 500 USD (two OA in module)
OA from Integrated Circuit vendor: ??? (forthcoming)
OA costs are the biggest item in long distance
transmission systems costs (e.g. 60%)
=> PC Light helps to radically change WAN/MAN costs

Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
24
Research Department
TERENA Networking Conference
www.ces.net
EDFA 2in1: PC Light equipment example




PC with build-in OA EDFA booster and preamp
Successfully used for NIL GE connection from Plzen
to CzechLight in Prague by dark fibre pair (159.4 km,
36.7 dB) since May 2004
One Side Amplification (OSA NIL approach): this
equipment is placed in Prague only. No OA
equipment is placed in Plzen, so we expect lower
service costs and higher availability (we have 24/7
staff in Prague only)
Advantages: low cost, low size (1U), low power
consumption, Linux, SNMP, reach up to 225 km,
possibility of development, ….
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
25
Research Department
TERENA Networking Conference
www.ces.net
EDFA 2in1: EDFA Module in Standard 1U PC with Linux
Alarm
LEDs
Low NF preamplifier
PA IN
PA OUT
BO IN
BO OUT
Flash
disc*
Booster
RS 232
IDE
MicroATX
MainBoard with
fanless CPU
FE
RS232C
Rhodes June 9th, 2004
USB
+5V DC
Power
Supply
* Network boot is also possible
Towards a Nation-wide Fibre Footprint in RENs
26
Research Department
TERENA Networking Conference
www.ces.net
PC Light forthcoming
EDFA 2in1 works on 10 GE (tested in
laboratory)
 GE interface card on 1550 nm
 GE interface card for bidirectional
transmission on single fibre
 etc.

Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
27
Research Department
TERENA Networking Conference
www.ces.net
Lighting of dark fibre: NIL approach

Production lines G.652, 1550 nm, EDFA
189 km Praha – Pardubice GE since May 2002
235 km Brno – Ostrava GE since June 2003

Experimental lines G.652, 1550 nm, EDFA
235 km Brno – Ostrava OC-48 June 2003
286 km Praha – Brno GE May 2004 (+Raman)

More wavelengths possible
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
28
Research Department
TERENA Networking Conference
www.ces.net
NIL tests in laboratory

G.652 fibre spools, EDFA + Raman:
325 km GE
250 km OC-48
252 km 2x 10 GE
290 km 10 G DWDM

G.655 fibre spools (recently delivered):
 testing
 lower cost of dispersion compensation on 10 Gbps
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
29
Research Department
TERENA Networking Conference
www.ces.net
Prepared CzechLight PoP in Brno
Fibre Praha - Brno 298.3 km, including
257.3 km of G.655 fibre.
 DWDM 10 Gbps cards for Cisco 15454
 NIL transmission, if possible
 June – July 2004

Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
30
Research Department
TERENA Networking Conference
www.ces.net
Global Lambda Integrated
Facility (GLIF)
• Environment for co-operation:
networking, infrastructure, network engineering, system
integration, middleware, applications
• GLIF was established by invited participants at the 3rd
Global Lambda Grid Workshop, held August 27, 2003
in Reykjavik, Island, www.glif.is
• Dark fibres are often used for Gigabit or 10 Gigabit
access to cities and university premises
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
31
Research Department
TERENA Networking Conference
www.ces.net
CzechLight May 2004
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
32
Research Department
TERENA Networking Conference
www.ces.net
Prepared CzechLight connections
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
33
Research Department
TERENA Networking Conference
www.ces.net
References


Presentations from CEF Networks Workshop, Prague,
May 2004
http://www.ces.net/project/optsit/CEFNetworks/
Dark fibre Sweden-Latvia www.balticopen.net
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
34
Research Department
TERENA Networking Conference
www.ces.net
Example from BalticOpen
Stockholm
Utö
Fårö sund
Ventspils Nafta
Ventspils
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
35
Research Department
TERENA Networking Conference
www.ces.net
Acknowledgement




Jan Gruntorad for support and GLIF entry
Miroslav Karasek and Jan Radil for lighting of
CESNET2 and CzechLight fibres
Josef Vojtech for EDFA 2in1 development
Comment: presented ideas and opinions are result of our ongoing R&D
activities and are opened to improvement
Rhodes June 9th, 2004
Towards a Nation-wide Fibre Footprint in RENs
36