Performance Benchmarking of Infrastructure-as-a-Service (IaaS) Clouds with Cloud WorkBench

The continuing growth of the cloud computing market has led to an unprecedented diversity of cloud services with different performance characteristics. To support service selection, researchers and practitioners conduct cloud performance benchmarking by measuring and objectively comparing the performance of different providers and configurations (e.g., instance types in different data center regions). In this tutorial, we demonstrate how to write performance tests for IaaS clouds using the Web-based benchmarking tool Cloud WorkBench (CWB). We will motivate and introduce benchmarking of IaaS cloud in general, demonstrate the execution of a simple benchmark in a public cloud environment, summarize the CWB tool architecture, and interactively develop and deploy a more advanced benchmark together with the participants.

Organizers

Joel Scheuner (Chalmers | University of Gothenburg, Sweden) and Philipp Leitner (Chalmers | University of Gothenburg, Sweden)

Target audience

This tutorials targets practitioners, researchers (academic and industrial), students, and developers that are interested in evaluating the performance of IaaS clouds. Tutorial participants are invited to follow easy steps in their web browser to execute a pre-configured benchmark in a public IaaS cloud. Interested tutorial participants will be given support to design, build, and execute a more advanced benchmark from scratch using a template. For the second part, some familiarity with the Bash shell and the Ruby programming language is beneficial but not required.

Prerequisites

Personal laptop for participants who would like to follow the interactive part.