BenchLab: Realistic Internet Scale Benchmarking with Real Web Browsers

This project seeks to provide the research community with more realistic benchmarks by providing real applications with real production workloads. BenchLab provides a framework to replay these workloads using real web browsers that can be deployed anywhere on the Internet. Our latest developments also provide support for mobile devices with mBenchLab. We are exploring the impact of Internet scale workloads on Web Applications including the effects of WAN latencies, load balancers, Content Delivery Networks (CDN), replication and high availability (HA) mechanisms.

BenchLab has a new dedicated web site at

BenchLab provides several components:

  • Benchmark Virtual Appliances: Virtual Appliances (virtual machines with pre-installed and pre-configured software stack) of benchmarks or real applications with their database payload and workload traces
  • Real Web Browser Replay: Software that allows to replay a workload trace through a real Web browser (Firefox, Internet Explorer, Chrome, Android)
  • BenchLab Dashboard: A Java WebApp that acts as a control center to start and manage experiments as well as a benchmark repository for storing results of experiments
  • Trace recorder: Collects live traces from an Apache server in HTTP Archive format to be replayed realistically by Web browsers

Latest News

    March 2015: BenchLab 3.0 release
    • A new website at has been launched with new releases of all the BenchLab software components
    • An updated documentation as well as Virtual Machine images (VMDK or EC2 AMIs) are available on our SourceForge page.

    January 2015: New video BenchLab paper
    • Both a paper and a demo have been accepted at the ACM Multimedia Systems conference in Portland OR taking place in March 2015. The papers have been added to the publication section of this page.
    • New features to manipulate video players (pause, seek, change quality, skip ads...) have been added to Video BenchLab and will be soon released on SourceForge.
    • Check link for software releases at the bottom of this page


Former Participants

  • Veena Udayabhanu
  • Timothy Wood
  • Xin He
  • Robert Sims
  • Anil Kumar Venkatesh
  • Siddharth Gupta



  • Video BenchLab: An Open Platform for Realistic Benchmarking of Streaming Media Workloads
    Patrick Pagus II, Emmanuel Cecchet, and Prashant Shenoy
    Proceedings of the ACM Multimedia Systems Conference (MMSys 2015), Portland, OR, March 2015.
  • Video BenchLab Demo: An Open Platform for Video Realistic Streaming Benchmarking
    Patrick Pagus II, Emmanuel Cecchet, and Prashant Shenoy
    Demo paper - Proceedings of the ACM Multimedia Systems Conference (MMSys 2015), Portland, OR, March 2015.
  • mBenchLab: Measuring QoE of Web Applications using mobile devices (Best Paper Award)
    Emmanuel Cecchet, Robert Sims, Xin He and Prashant Shenoy
    Proceedings of ACM/IEE International Symposium on Quality of Service (IWQoS 2013), Montreal, Canada, June 3-4 2013
    Paper (pdf) Slides (.pptx)
  • BenchLab: An Open Testbed for Realistic Benchmarking of Web Applications
    Emmanuel Cecchet, Veena Udayabhanu, Timothy Wood and Prashant Shenoy.
    Proceedings of 2nd USENIX Conference on Web Application Development (WebApps '11), June 15-16, 2011, Portland, OR
  • BenchLab: Benchmarking with Real Web Applications and Web Browsers
    Emmanuel Cecchet, Veena Udayabhanu, Timothy Wood, Prashant Shenoy, Fabien Mottet, Vivien Quema and Guillaume Pierre.
    Eurosys 2011, Poster and demo session, April 10-13, 2011, Salzburg, Austria