Five Minutes of Rage with SnowFlock H. Andrs Lagar Cavilla - - PowerPoint PPT Presentation

five minutes of rage with snowflock
SMART_READER_LITE
LIVE PREVIEW

Five Minutes of Rage with SnowFlock H. Andrs Lagar Cavilla - - PowerPoint PPT Presentation

Five Minutes of Rage with SnowFlock H. Andrs Lagar Cavilla andreslc@cs.toronto.edu Joe Whitney Adin Scannell Steve Rumble Philip Patchin Joe Whitney, Adin Scannell, Steve Rumble, Philip Patchin, Mike Brudno, Eyal de Lara, M. Satyanarayanan


slide-1
SLIDE 1

Five Minutes of Rage with SnowFlock

  • H. Andrés Lagar‐Cavilla

andreslc@cs.toronto.edu

Joe Whitney Adin Scannell Steve Rumble Philip Patchin Joe Whitney, Adin Scannell, Steve Rumble, Philip Patchin, Mike Brudno, Eyal de Lara, M. Satyanarayanan

University of Toronto (mostly)

h // b d / fl k http://sysweb.cs.toronto.edu/snowflock

slide-2
SLIDE 2

The Basics The Basics

  • Cloud Computing

Cloud Computing

  • Virtualization

f b li h If you are not a believer, then you can

slide-3
SLIDE 3

The Basics The Basics

  • Cloud Computing

Cloud Computing

  • Virtualization

f b li h If you are not a believer, then you can

  • Resume your email checking activities
  • Return to your placid sleep
  • Dedicate to the noble art of schmoozing

Dedicate to the noble art of schmoozing

  • Desert the room in search for caffeine
slide-4
SLIDE 4

The Rant The Rant

  • When I signed up for the cloud

When I signed up for the cloud

  • The ad said: “100s of CPUs at your fingertips”

h i did ’ id h

  • What it didn’t said was that:

–New VMs show up in minutes State needs to be pushed explicitly –State needs to be pushed explicitly

slide-5
SLIDE 5

New VMs Show Up in Minutes New VMs Show Up in Minutes

  • #@! I missed my flash crowd

#@! I missed my flash crowd…

  • I wait two mins to start my 40sec parallel task

S li t d i t i i – Sequence alignment, rendering, quant pricing – One hour w/one processor / – 40 seconds w/128 processors

  • Work around: pre‐allocate

– $$$ – Consolidation harms performance

slide-6
SLIDE 6

State Has to Be Pushed Explicitly State Has to Be Pushed Explicitly

  • As in tell the new guys where we’re at

As in, tell the new guys where we re at

– Because they’re basically fresh boots Or were pre allocated two weeks ago – Or were pre‐allocated two weeks ago

  • Message passing, etc
slide-7
SLIDE 7

Wouldn’t it be nice if the cloud was UNIX?

  • You could fork your VMs

You could fork your VMs

  • Like processes do

d ld ’ i b i f k

  • And wouldn’t it be nice to fork

instantaneously

  • And make your VMs stateful too…
  • Wouldn’t it be nice?
slide-8
SLIDE 8

The Beach Boys Were Dreaming of l k SnowFlock

  • Which through a melange of cunning hacks

Which, through a melange of cunning hacks

  • Clones a VM into dozens of identical copies

l h d

  • In less than a second
  • Each executing on a different box
  • With negligible runtime overhead
  • Thus enabling hundred of CPUs instantly at

Thus enabling hundred of CPUs instantly at your fingertips

  • As advertised
  • As advertised
slide-9
SLIDE 9

And As Easy To Program As And As Easy To Program As

while (forever) i receive new request fork worker to handle it join worker when done join worker when done while (forever) ( ) if webserver load is high fork some new workers else if webserver load is low kill some of those extra workers

(b I ith k l t i ti ) (because I can come up with more workers later in no time)

slide-10
SLIDE 10

Free And Open Source Free And Open Source

  • http://sysweb cs toronto edu/snowflock

http://sysweb.cs.toronto.edu/snowflock

  • H. Andrés Lagar‐Cavilla

d l @ d

  • andreslc@cs.toronto.edu
  • Big team @ University of Toronto