Transcript スライド 1 - PRAGMA Cloud/Grid Operation Center

High Performance File System
Service for Cloud Computing
Kenji Kobayashi, Osamu Tatebe
University of Tsukuba, JAPAN
Towards Cloud File System
Compute Cloud
physical machines (e.g. Amazon EC2)
○Availability
○Maintainability
✗Application modification required
-REST, SOAP based protocol
✗Low and Unstable Performance
✗Expensive Cost for constructing
Storage Cloud
disk array (e.g. Amazon S3)
-High bandwidth Network between EC2 and storage
We propose file system service in Compute Cloud
Towards Cloud File System (2)
migration
replication
remote access
merely using local disk
Gfarm File System
✗Availability
✗Maintenancability
○Availability
○Maintainability
Towards Cloud File System (3)
Construct File system service using stable HostOS on
physical machines
the HostOS is the baseOS for managing VM.
VM
volatile
VM
VM
VM
VM
difficult to utilize file access locality
virtualized environment hides the underlying physical configuration
stable
HostOS
HostOS
HostOS
HostOS
HostOS
need to solve this problem to take advantage of local file access
System Design
• Construct Gfarm file system on compute cloud
– Host OS provides functionality of I/O server
• Create the physical configuration file dynamically
– Take advantage of local access performance
VM
Gfarm
client
VM
Gfarm
client
VM
Gfarm
client
VM
Gfarm
client
VM
Gfarm
client
VM
Gfarm
client
gfsd
gfsd
gfsd
gfsd
gfsd
gfsd
HostOS
HostOS
HostOS
HostOS
HostOS
HostOS
Virtualized environment prevents to identify
the Host OS running on physically same node
Need some mechanism to identify
the physical configuration
System Design (2)
reply for message to
access gfsd
gfmd
request metadata
Inform the mapping to
metadata server
Mapping File
<instance id=“i-xxxxxx”>
<vm_ip_addr>
172.16.xxx.xxx
</vm_ip_addr>
<hostOS_ip_addr>
172.16.xxx.xxx
</hostOS_ip_addr>
･･･
</instance>
･･･
VM
Gfarm
client
VM
Gfarm
client
VM
Gfarm
client
･･･
gfsd
gfsd
gfsd
Eucalyptus
NC
Eucalyptus
NC
Eucalyptus
NC
HostOS
HostOS
HostOS
real network
Eucalyptus NC generates
mapping file dynamically
Thank you for your attention.