Transcript Internet Transit, wholesale

Interconnection,
Bandwidth and Datacenters
“Water, water everywhere And not a drop to drink.”
Remco van Mook, Equinix
SwiNOG, May 23. 2013
Remcos-MacBook-Pro:~remco$ whoami
Topics for Today
Interconnection Markets
The Bandwidth Challenge
Datacenters: Equinix ZH5
Act 1: Interconnection Markets
NO, NOT JUST INTERNET EXCHANGES
The Price of Bandwidth, in bulk, per Mbps
Western Europe, early-mid 2011
A EUR80 fiber cross connect:
$0.01
Internet Exchange traffic:
$0.25*
Backbone traffic Western Europe:
$0.50
Transatlantic traffic, wholesale:
$1
Internet Transit, wholesale:
$2
Internet Transit, retail
$15
Broadband Internet, consumer:
$50
National Ethernet
service: $2500 (est)
Carrier
Pigeon:
$180
3G mobile data, national:
$11,400
GSM voice call, national:
$483,840
3G mobile data, roaming low:
$834,000
3G mobile data, roaming high:
$3,127,500
GSM voice call, roaming:
$3,338,496
SMS Text Messages:
$210,000,000
SMS Text Messages, roaming: $1,166,400,000
5
The New Price of Bandwidth, in bulk, per Mbps
Western Europe, mid 2012 (based on 10Gbps)
A EUR80 fiber cross connect:
$0.01
Internet Exchange traffic EU:
$0.18*
Internet Exchange traffic US:
$0.35*
Backbone traffic Western Europe:
$0.15
Transatlantic traffic, wholesale:
$0.50
Internet Transit, wholesale:
$0.65
Pain
ahead!
6
Definition time!
A Healthy Interconnection market
1.Has sufficient critical mass to be self-perpetuating
2.Has at least a regional significance
3.Minimizes duplication of effort
7
3 Basic Motivators
Why does a network expand its footprint?
1.Increase Revenue
2.Reduce Cost
3.Improve Quality
These decisions are made:
1. For different reasons,
2. By different people,
3. In different parts of an organisation.
8
No seriously, where?
de-cix
ams-ix
linx
msk-ix
netnod
plix
espanix
nix.cz
nl-ix
bix
mix
vix
inex
lonap
Other 120
9
No seriously, where?
Take Frankfurt, for example:
10
No seriously, where?
Or Amsterdam:
11
Why does it work?
A Combination of
1. Density
2. Cost
3. Regulatory framework
4. Availability and Scalability
5. Consolidated effort
12
Consolidated effort
You need:
1.Space, Power and Local Connectivity
2.Local/National eyeballs
3.Transport providers
4.National and International Content
5.Carriers
6.Foreign eyeballs
To work TOGETHER to create a SINGLE interconnection zone
13
Act 2: The Bandwidth Challenge
Cisco’s VNI – All IP Traffic
15
AMS-IX Traffic over a 20 year period
(2015 based on a CAGR of 40% and mid-2012 data)
AMS-IX traffic per month (in TB)
1001869
186282
10
1995
690
2000
16490
2005
2010
2015
16
Evolution of Networking Standards
(Planned) release dates of IETF Ethernet standards
Ethernet port speeds
400000
100000
100
1995
1000
2000
10000
2005
2010
2015
17
Hmm, that looks familiar…
• Those lines look the same!
• Besides, I recognise that 100,1000,10000,100000 series from
somewhere…
• Let’s see those charts again on a logarithmic scale!
18
AMS-IX Traffic over a 20 year period
(2015 based on a CAGR of 40% and mid-2012 data)
AMS-IX traffic per month (in TB)
1001869
186282
16490
690
10
1995
2000
2005
2010
2015
19
Evolution of Networking Standards
(Planned) release dates of IETF Ethernet standards
Ethernet port speeds
400000
400000
100000
10000
1000
100
2017!
1995
2000
2005
2010
2015
20
As long as equipment performance keeps up…
We now move to Andy Bechtolsheim, presenting at NANOG 55
“There is basically a bottleneck around I/O.”
“ASIC designs are not on Moore’s Law.”
“There is a big gap between the processes
that are used for networking chips and the
ones used for state of the art CPUs.”
21
To summarize, linear growth…
22
Takeaways
Traffic keeps growing exponentially
Network hardware backplanes are not
We need to get creative to solve this
And rethink how we’re interconnecting the Internet
23
Abridged history of Internet interconnection
1980s
Early 1990s
Late 1990s
Mid 2000s
Late 2000s
Mid 2010s
Hey, it works!
Buy my pipes!
Wanna Peer?
Mine’s bigger than yours, go away.
I’ll build my own, then.
Why am I building this network again?
24
“Why am I building this network again?”
Eyeball Version
“Those damn users keep eating more bandwidth.”
“I’m not getting paid enough.”
“Forget about peering, I’ll just buy transit”
“Let’s create a walled garden charge a premium
for guaranteed access!”
25
“Why am I building this network again?”
Content Version
Off-net is the new hotness!
For some content providers, over half of their traffic is served from inside
eyeball networks, trending upwards…
It helps to create walled gardens!
This does not scale!
26
A short explanation of a “Walled Garden”
(Adult language version)
27
This does not scale!
• Instead of ~20 locations to interconnect worldwide, we’re looking at over
200 deployments close to eyeball networks
• It doesn’t even work for a lot of things (interactive content, cloud)
• This sets a huge barrier to entry
• There is not enough physical infrastructure to support this!
28
Act 3: Equinix ZH5
Switzerland. The Secure Heart of Europe. ZH5.
IBX ZH5
ZH5/ZH4 Dual Site Strategy
•
•
Facts & Figures
1. IBX+
2. Leed Gold Standard
3. ISO 9001 and ISO 27001
4. 80+ carriers
5. 6‘680 m2 colocation area
6. 14 MVA power
7. Biggest IT Ecosystem in Switzerland
8. High carrier density, 80+ Carriers
9. Located in the economical and business
center of Switzerland
10. Scalability - power and space wise
6.5 km Dark Fiber between ZH5 and ZH4
for the price of a Cross Connect
Dual Site Strategy for CHF 120.- MRR
connectivity cost
30
Equinix Switzerland – Datacenters.
Facilities
• Established 1998
(Telehaus -> iXEurope -> Equinix)
City
DC
Space
Opening
Zurich
ZH1
540 m2
1998
ZH2
373 m2
2004
• ISO 9001 and 27001 certified
ZH3
230 m2
2006
• Redundancy of equipment N+1
ZH4
1100 m2
2010
ZH5
6680
m2
2013
GV1
2060 m2
2000
GV2
2500 m2
2009
Geneva
• Carrier-neutral
31
Switzerland. The Secure Heart of Europe.
Questions?
[email protected]
32