Transcript Deliver arbitrary amounts of computational power to perform

Automatic Run-time Adaptation in
Virtual Execution Environments
Ananth I. Sundararaj
Advisor: Peter A. Dinda
Prescience Lab
Department of Computer Science
Northwestern University
http://virtuoso.cs.northwestern.edu
Virtual Machine Grid Computing
1
arbitrary amounts of
AimDeliver
computational power to perform
distributed and parallel computations
Traditional
Paradigm
New
Paradigm
2
Resource multiplexing using
Grid OS level mechanism
Computing
3b
5
Grid Computing
using virtual
machines
4
3a
6a
Problem1:
6b
Complexity from resource
Solution
user’s perspective
Problem2:
Complexity from resource
owner’s perspective
Virtual Machines
What are they?
How to leverage
them?
2
Virtual Machines
Virtual machine monitors (VMMs)
•Raw machine is the abstraction
•VM represented by a single
image
•VMware GSX Server
3
The Simplified Virtuoso Model
User’s
LAN
Virtual networking ties the
machine back to user’s
home network
Orders a raw
machine
VM
Specific hardware and
performance
Basic software
installation available
Virtuoso continuously monitors and adapts
User
4
Virtual Networks
VM traffic going
out on foreign
LAN
Foreign hostile
LAN
User’s friendly
LAN
X
IP network
Host
Proxy
Virtual Machine
A machine is suddenly plugged into a foreign
network. What happens?
•
Does it get an IP address?
•
Is it a routeable address?
•
Does firewall let its traffic
through? To any port?
VNET: A bridge with long wires
5
Measurement and Inference
Underlying network
Host and VM
• Topology
• Size and compute capacities
• Bandwidth
• Size and compute demands
• Latency
[Gupta et al. In submission]
Application (VTTIF)
• Topology
• Traffic load
[Gupta et al. LNCS 05]
Application layer
VM layer
Virtual network layer
VNET daemons
Underlying network layer
6
Physical hosts
Adaptation Mechanisms
VM Migration
Topology changes
• Third party migration schemes
• Overlay links
• Overlay forwarding rules
Resource reservation
[Sundararaj et al.
LCR 04, HPDC 05]
• Network [Lange et al. HPDC 05]
• CPU
X
[Lin et al. GRID 2004]
VM Migration
VM layer
X
X
Topology changes
VNET daemons
Resource reservation7
Physical hosts
Generic Adaptation Problem In
Virtual Execution Environments
• Goal:
– VMs to Hosts mapping
– Path to each 4-tuple
– Meeting all demands within constraints
– Such that
• Sum of residual bottleneck bandwidth over
each mapped path is maximized
8
Optimizing Objective functions
• Many possibilities
• Maximizing sum of residual bottleneck
bandwidths over each mapped path
– Intuition:
• Leave the most room for application to increase
performance
• Minimizing the residual bottleneck capacity
– Intuition:
• Increase room for other applications to enter system
9
Claim
• Wide spectrum of possibilities
– Adaptation transparent to application
– Application directed adaptation
• Claim
– Adaptation using a single metric for a wide range
of applications is possible and feasible
10
• For More Information
– Prescience Lab (Northwestern University)
• http://plab.cs.northwestern.edu
– Virtuoso: Resource Management and
Prediction for Distributed Computing using
Virtual Machines
• http://virtuoso.cs.northwestern.edu
• VNET is publicly available from
• http://virtuoso.cs.northwestern.edu
11