Dependable Cloud Computing:
Virtualization-Based Management for Servers, Clients and Network Kazuhiko Kato
University of Tsukuba Japan
NSC-JST Workshop
- Nov. 27, 2012
Dependable Cloud Computing: Virtualization-Based Management for - - PowerPoint PPT Presentation
Dependable Cloud Computing: Virtualization-Based Management for Servers, Clients and Network Kazuhiko Kato University of Tsukuba Japan NSC-JST Workshop Nov. 27, 2012 Project Members University of Tsukuba Kazuhiko Kato, Akiyoshi Sugiki,
Virtualization-Based Management for Servers, Clients and Network Kazuhiko Kato
University of Tsukuba Japan
NSC-JST Workshop
2
University of Tsukuba Kazuhiko Kato, Akiyoshi Sugiki, Koji Hasebe Yasushi Shinjyo University of Tokyo Takahiro Shinaga(Previously, University of Tsukuba) University of Electro-Communications Yoshihiro Oyama Fujisoft Inc. Yoshiaki Ishii, Kyohei Yano, Seiji Hirooka
Developing infrastructural software for cloud computing with servers, client, and network.
3
Dependability:
Reliability, Availability, Response, Throughput, Security, Privacy
Failure Guest OS BitVisor Hardware
Servers (in several data centers) Network Clients
Internet
4
Failure Guest OS BitVisor Hardware
Servers (in several data centers) Network Clients
Internet
Middleware for Cloud Server Management
✓ OO & functional
✓ "Scalable" coding (Java-to-Ruby level) with static type
system
✓ Real/virtual machines and network are mapped to HW/SW
algorithms and Paxos.
5
6
Data center
Manager/operator
Method call
Result Interactive/batch
Kumoi shell
Scala
Kumoi kernel
Real machine Network
VMM VNet
VM Disk
34K lines of Scala source code
7
scala> pms.fliter(_.cpuRatio > 0.9).map(_.name)
pms: List of available physical machines _: Formal arguments for higher-order function
8
def compact(pms: List[VM]) { def firstFit(v: VM, rest: List[VM]) { rest match { case h :: rs if (h.cpuAvailable > v.cpuRatio) => v.migrateTo(h) case h :: rs => firstFit(v, rs) case List() => } } def compacti(pms: List[VM]) {
pms match { case h :: rest => h.vms.foreach(v => firstFit(v, rest.reverse)) compacti(rest) case List() => } } compacti(pms.reverse) }
9
Failure Guest OS BitVisor Hardware
Servers (in several data centers) Network Clients
Internet
10 仮想マシン (VM: Virtual Machine) 仮想マシン (VM: Virtual Machine)
Hardware
Virtual Machine
Virtual Machine Monitor
Guest OS
Hardware Physical Machine
OS
✓ Encrypting HDD, USB memory
✓ VPN (IPsec)
✓ Key management/authentication
with IC card
✓ Virtualization of CPU and memory
11
✓ IDS within VMM
next topic)
12
modified undetectably) ✓Kernel image ✓Device driver ✓etc.
access. ✓Detects system file modification.
sectors are managed.
Guest&OS Device Device&driver
Extended&function
ATA NIC USB
Device&mediator
ATA NIC USB
VM
VMM
Hardware
Protection&policy
+me$of$BitVisor data$block$ data$block$
✓ Integrity of hypervisor itself, i.e., modification
disabled.
✓ Against ROR (Return-Oriented Rootkit)
✓ Limited storage area can be seen by each user.
16
17
18
Failure Guest OS BitVisor Hardware
Servers (in several data centers) Network Clients
Internet
21
Fujisoft in Kyusyu つくば Tsukuba Fujisoft in Kyusyu
22
ad-
et guest
2 4 6 8 10 5 10 15 20 25 30
VPN throughput [Mbit/sec]
Elapsed time [sec]
Failure occurred point Failure recovered point 15.1 19.2
Figure 8. Throughput Transition over Failure
Before: Tsukuba-Tokyo (56Km) After: Tsukuba-Yokohama (84Km)
23
Tsukuba-Tokyo (56Km) Tsukuba-Yokohama (84Km)
Tsukuba-Fukuoka (926Km)
Tokyo Yokohama Fukuoka VPN on OS 13.18 12.63 32.04 VPN on VMM 13.46 13.00 32.57 VPN on VMM with relay 13.71 13.23 32.80 5 10 15 20 25 30 35
Latency [msec]
Figure 9. Latency
Tokyo Yokohama Fukuoka VPN on OS 58.88 52.98 26.43 VPN on VMM 49.31 47.45 25.27 VPN on VMM with relay 41.22 41.94 24.45 10 20 30 40 50 60 70
Bandwidth [Mbit/sec]
Figure 10. Throughput
Dependable cloud computing environment for servers, client and network, by using virtualization technologies.
24 Failure Guest OS BitVisor Hardware
Servers (in several data centers) Network Clients
Internet
✓ Virtual network control with OpenFlow ✓ Failure-oblivious computing ✓ Application: Parallel, distributed parameter tuning
✓ Transparent network boot system ✓ Acceleration of guest OS boot ✓ Desktop grid with intra-VMM computation
25