virtualirfan

Monthly Archives: January 2009

PARDA O’ PARDA

Ajay Gulati, Carl Waldspurger and I have just finished work on a distributed IO scheduling paper for the upcoming FAST 2009 conference. So I wanted to provide an update. PARDA is a research project to design a proportional-share resource scheduler that can provide service differentiation for IO like VMware already provides for CPU and Memory. In plain terms, how can we deliver better throughput and lower response times to the more important VMs irrespective of which host in a cluster they run on.

This is a really interesting and challenging problem. A bunch of us first started brainstorming in this area 2 years ago but despite several attempts, for over a year, we couldn’t come up with a comprehensive solution. For one thing, IO scheduling is a very hard problem. Second, there aren’t existing research papers that tackle our particular flavor of the problem (cluster filesystem). To top it off, the problem sounds easy at first blush, encouraging a lot of well-intentioned but ultimately misleading attempts.

Ajay and I first published a paper on our idea to use flow control (think TCP-style) to solve this problem at the SPEED 2008 workshop in Feb ’08 and the feedback from the research community was encouraging (this later became the basis for an ACM SIGOPS Operating Systems Review article, October 2008). Since then Ajay, Carl and I have worked out the major issues with this new technique resulting in the FAST paper.

The paper is entitled “PARDA: Proportional Allocation of Resources for Distributed Storage Access”.

New team (vmkernel), new challenges

I’m celebrating my one year anniversay in a new team at VMware so I thought to update everyone about it (albeit a year late). Having worked in the Performance group for 5 years, it was time to try something new. And the new line of work is in the kernel group at VMware where I’m part of the Resource Management team. I started in this team middle of January last year.

It’s been a blast so far. I am working primarily on disk scheduling and memory management algorithms. I’ll be posting more details on some of my projects here shortly.