Transcript Cloudnet: XXX XXX XXX - Enabling Computing Technologies (ECT)

Clouds and Networks:
Technology and Network Infrastructure
Evolution
Charles (Chuck) Kalmanek
V.P. – Networking and Services Research
AT&T Labs
Page 1
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
Network Infrastructure Evolution
Networks evolve in response to the changing
nature of the traffic and advances in
component and system technology.
Changes in traffic are driven by advances in
computing technology and applications.
Page 2
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
Router Scalability
– Growth in network load
o Data plane: traffic load
o Control plane: number of Internet prefixes, OSPF topology,
LDP labels, etc.
– Currently require fork-lift router upgrades
o Significant CapEx costs
o Additional costs: manpower hours for certification, upgrade
management tools, reduction in network reliability
– Architectural reorganizations can improve network
manageability
o Especially at the customer / aggregation / edge
Page 3
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
Evolving the Traditional ISP Architecture
• How to handle failures and
planned maintenance at
network edge?
PoP
BR
BR
– Migrate to a spare router,
similar to taking a blade out of
the load balancer rotation
Backbone Router
• How to handle control plane
scale issues at network edge?
AR
AR
– Install new routers and migrate
to them
Access Router
– Feature incompatibilities,
differences in configs add
complexity
XC
CE
Page 4
– Treat AR’s as a resource pool,
similar to blade servers
March 27, 2009
CE
CE
CE
© 2008 AT&T Intellectual Property. All rights reserved.
RouterFarm in Action*
(Network Migration)
BGP
Transport Network
ISP Backbone
1. Extract customer
configuration from initial
router
2. Install customer
configuration on to target
router
3. Reconfigure transport (layer
1) connectivity
4. Wait for network to converge
5. Verify service
* Agrawal, Bailey, et al., RouterFarm: Towards a Dynamic Manageable Network Edge, INM’06
Page 5
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
Extending Access Router Life?
– Use multiple physical routers to form a logical, Composable
Router*
– A Composable Router appears as a single routing entity to rest
of network
o Distribute control and data plane load among physical routers
o When load increases, add more routers to Composable Router
o Reduce upgrade frequency and associated costs
Application 1
Form a virtual access router
from multiple access routers
Application 2
Replace a router
with N physical ones
* Ee, Breslau, Ramakrishnan, REAP: Router Extensibility via Address-based Partitioning
Page 6
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
Basic Idea
– Start with a bunch of existing routers
o These form an array, we call each of them an array router
– Need to distribute control and data plane load within the
array
o Let each array router be responsible for a subset of address
space
o Divide address space into blocks, assign to array routers
IPv4 space
Block 1
•Reduces per-router prefixes, labels
Block 2
•Reduces forwarding load per router
Block 3
Block 4
Block 5
Page 7
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
Array
Basic Idea (data plane)
– Splitter serves as distribution and aggregation point for
array
o Local packet routing is static, on per-interface basis
– Distribute incoming data packets based on dest IP
– Aggregate outgoing data packets based on static mapping
o E.g., 802.1q VLAN tags
– Simple, large scale splitter /switch is needed
Array
Splitter
Page 8
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
Basic Idea (control plane)
– Control packet distribution, aggregation handled by metarouter
o Splitter classifies and passes only control packets to metarouter
o Splitter - meta-router link need not be of high-capacity
o Meta-router distributes control packets, e.g. based on prefix
advertised
o Again, incoming interface at splitter determines interface
leading to array router (which also maintains state for that
address block)
Meta-router
Array
Composable Router
Splitter
Page 9
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
Road to Compute-based Infrastructure
MULTI-CORE
Performance
10X
You Are
Here
SINGLE Thread
With Multi-core
3X
2000
2012+
2006
Source: Intel®
(with permission)
Normalized Performance vs. Initial Intel® Pentium® 4 Processor
FORECAST
The Software Story : Key to Successful Multi-Core Transition
Best in class Tools
Page
10
Page 10
March 27, 2009
Rich Eco system
© 2008 AT&T Intellectual Property. All rights reserved.
Asymmetric/Symmetric
Both SMP and
Multiprocessing And
Virtualization
supported
Virtualization Supported
Network Distributed Computing
• Distributed Computing + Network => Services
– Network application services
– Cloud / utility computing
– Software as a service
• Central office => data center
– Data center switching
– Virtualized computing
– Storage
– Security
• Example: video content delivery gateway
Page 11
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
Content Delivery Gateway
NDC
SHE
National
Content
Web
Services
Secure
Media
Distribution
Internet
Broadcast
Media Library
Local
Content
VHO
Web
Services
Gateway
Secure
Media
Distribution
Application
Servers
IPTV-AS
CSCF
BGCF
CDGC
MGC
ISC
HSS
OAM&P
IMS
Core
IP MPLS Transport Network
PSTN
Broadcast
Ads
VOD
EPG
Content
Source
Gateway
Metro Network
MBMS
DVB-H
RNC
Media
Gateway
Metro Network
Metro Network
CO
CO
Content
Delivery
Gateway
Content
Delivery
Gateway
CO
Content
Delivery
Gateway
RAN
VHO
VHO
BAN
RAN
DSLAM
PON
HSAN
DSLAM DSL
DSL
NTE
RG
WiMax
Cellphone
Wireless
Page 12
March 27, 2009
WiFI
PC
Broadband
© 2008 AT&T Intellectual Property. All rights reserved.
dlna
TV
STB
IPTV
Video Content Delivery Gateway: Functionality
Management
Control
IMS Network Management
IMS Session Control
Ad Overlay
Content
Transformation
Transcoding
Image Processing
Digital
Rights
Management
Key Management
Digital Rights Management
Content Security
Dynamic Ad Splicing
Addressable
Advertising
Zone Ad Targeting
Unicast / Broadcast
Packet
Management
Network Monitoring / Security
Packet Management (Transport / Service Control)
Hardware/Software Acceleration
Platform
Technologies
Page 13
March 27, 2009
High Performance Computing Technology
NEBs High Availability Bladed Platform
© 2008 AT&T Intellectual Property. All rights reserved.
Cloud Computing
• Lease computation and storage
resources on demand
• Highly dynamic resource
provisioning
– Add new servers within minutes
– Easy to replicate virtual resources
• Only pay for what you use
• Several emerging services
– Amazon EC2, IBM Blue Cloud, Google
App Engine, Microsoft Azure, AT&T
Synaptic Hosting, etc.
Page 14
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
Cloud Platform
What is Missing?
• Control over network management
– Can’t request specific IP addresses
– Can’t put VMs on own private network
• Control of Network Resources
– Bandwidth, traffic isolation, etc
• Lack of network security
and isolation
– VMs have IP on public internet
– Customer must manage security on VM
itself
Page 15
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
at&t
top secret
Verizon
pay roll
CloudNet: Bringing VPNs to the Cloud*
• Use VPNs to separate customer resources
• Customer’s VMs are only reachable from her other VPN end
points
• More flexible control of how IP addresses are assigned
• Physical network is transparent to customer
VPLS
* Collaboration bet. U. Mass (P. Shenoy, T. Wood) & AT&T Labs (J. van der Merwe, K. K. Ramakrishnan)
Page 16
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
System Components
• Cloud Manager
– Create VMs
Cloud
Manager
– Resource Allocation
– Controls up to CEs
• Network Manager
Cloud 1
CE
…
Cloud 9
– VPN management
– Access controls
Network
Manager
– Controls PEs
• May be separate business
entities
Page 17
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
CE
VPN Management
• All endpoints need to “match”
• Making changes to all endpoints is a pain!
• Use IRSCP
– Centralized VPN manager
IRSCP
– Looks like route reflector
– Speaks BGP to PEs
• Rewrites VPN route targets
IRSCP Rules:
Page 18
VPN 1 =
+
VPN 2 =
+
March 27, 2009
+
Takes about 5-8 seconds
© 2008 AT&T Intellectual Property. All rights reserved.
Shadownet
• Provides infrastructure for CloudNet
• Uses Juniper router support for logical routers
– Subdivide a physical router
• Instantiates arbitrary networks based on topology
description
• Simplifies and automates router configuration
– Tracks links, used interfaces, VLAN ids, etc
Site 1
Page 19
March 27, 2009
Site 2
© 2008 AT&T Intellectual Property. All rights reserved.
CloudNet Prototype
Logical View
Cloud N
VM
VM
Customer W
CE
PE
PE
VM
Cloud E
CE
VM
PE
VM
PE
CE
VM
Customer S
Physical Instantiation
VM VM
VM VM
VM VM
Page 20
March 27, 2009
CE PE
CE PE
CE
PE CE
CE
PE CE
© 2008 AT&T Intellectual Property. All rights reserved.
VM VM
VM VM
VM VM
Summary
• Evolution in computing technologies continues to
change the nature of network infrastructure
• Router scalability
– Architectural reorganization at network edge holds promise
• Network distributed computing
– Distinction between central offices and data centers is
breaking down
– Integration of cloud computing and VPNs provides isolation
and security to enterprise customers
Page 21
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.
Thank you!
Questions???
Page 22
March 27, 2009
© 2008 AT&T Intellectual Property. All rights reserved.