Project Overview

This project seeks to provide the research community with more realistic benchmarks by providing real applications with real production workloads. BenchLab provides a framework to replay these workloads using real web browsers that can be deployed anywhere on the Internet. We are exploring the impact of Internet scale workloads on Web Applications including the effects of WAN latencies, load balancers, Content Delivery Networks (CDN), replication and high availability (HA) mechanisms.

BenchLab provides several components:

• Benchmark Virtual Appliances: Virtual Appliances (virtual machines with pre-installed and pre-configured software stack) of benchmarks or real applications with their database payload and workload traces
• Real Web Browser Replay: Software that allows to replay a workload trace through a real Web browser (Firefox, Internet Explorer, Chrome, Android or iPhone)
• BenchLab WebApp: A Java WebApp that acts as a benchmark repository where the user can define the experiments to conduct and store the configuration and results of experiments
• Trace recorder: Collects live traces from an Apache server in HTTP Archive format to be replayed realistically by Web browsers

Participants

• Emmanuel Cecchet
• Veena Udayabhanu
• Timothy Wood
• Prashant Shenoy

Collaborations

• Vivien Quema, INRIA France
• Fabien Mottet, INRIA France
• Guillaume Pierre, VU University Amsterdam

• BenchLab: An Open Testbed for Realistic Benchmarking of Web Applications

  Emmanuel Cecchet, Veena Udayabhanu, Timothy Wood and Prashant Shenoy.
  Proceedings of 2nd USENIX Conference on Web Application Development (WebApps '11), June 15-16, 2011, Portland, OR
  pdf

• BenchLab: Benchmarking with Real Web Applications and Web Browsers

  Emmanuel Cecchet, Veena Udayabhanu, Timothy Wood, Prashant Shenoy, Fabien Mottet, Vivien Quema and Guillaume Pierre.
  Eurosys 2011, Poster and demo session, April 10-13, 2011, Salzburg, Austria
  pdf

You can find the latest software releases from our SourceForge page and choose the nearest mirror at https://sourceforge.net/projects/benchlab/