Dependability Benchmarking for Computer Systems

Contributors xi

Prologue: Dependability Benchmarking: A Reality or a Dream? xiii
Karama Kanoun, Phil Koopman, Henrique Madeira, and Lisa Spainhower

1 The Autonomic Computing Benchmark 3
Joyce Coleman, Tony Lau, Bhushan Lokhande, Peter Shum, Robert Wisniewski, and Mary Peterson Yost

2 Analytical Reliability, Availability, and Serviceability Benchmarks 23
Richard Elling, Ira Pramanick, James Mauro, William Bryson, and Dong Tang

3 System Recovery Benchmarks 35
Richard Elling, Ira Pramanick, James Mauro, William Bryson, and Dong Tang

4 Dependability Benchmarking Using Environmental Test Tools 55
Cristian Constantinescu

5 Dependability Benchmark for OLTP Systems 63
Marco Vieira, João Durães, and Henrique Madeira

6 Dependability Benchmarking of Web Servers 91
João Durães, Marco Vieira, and Henrique Madeira

7 Dependability Benchmark of Automotive Engine Control Systems 111
Juan-Carlos Ruiz, Pedro Gil, Pedro Yuste, and David de-Andrés

8 Toward Evaluating the Dependability of Anomaly Detectors 141
Kymie M. C. Tan and Roy A. Maxion

9 Vajra: Evaluating Byzantine-Fault-Tolerant Distributed Systems 163
Sonya J. Wierman and Priya Narasimhan

10 User-Relevant Software Reliability Benchmarking 185
Mario R. Garzia

11 Interface Robustness Testing: Experience and Lessons Learned from the Ballista Project 201
Philip Koopman, Kobey DeVale, and John DeVale

12 Windows and Linux Robustness Benchmarks with Respect to Application Erroneous Behavior 227
Karama Kanoun, Yves Crouzet, Ali Kalakech, and Ana-Elena Rugina

13 DeBERT: Dependability Benchmarking of Embedded Real-Time Off-the-Shelf Components for Space Applications 255
Diamantino Costa, Ricardo Barbosa, Ricardo Maia, and Francisco Moreira

14 Benchmarking the Impact of Faulty Drivers: Application to the Linux Kernel 285
Arnaud Albinet, Jean Arlat, and Jean-Charles Fabre

15 Benchmarking the Operating System against Faults Impacting Operating System Functions 311
Ravishankar Iyer, Zbigniew Kalbarczyk, and Weining Gu

16 Neutron Soft Error Rate Characterization of Microprocessors 341
Cristian Constantinescu

Index 351