Performance-Based Earned Value

Table of Contents v

Foreword xv

Preface xvii

Acknowledgments xix

1 Overview of PBEV 1

Introduction 1

What is PBEV? 1

PBEV Characteristics 2

Reputation of Earned Value Management 3

Lessons Learned 3

Inadequate Early Warning 4

Poor Implementation of EVMS 4

Reliable, Valid Information 4

Product Requirements and Quality 4

Processes 5

Measures 5

Snapshot of EVM 5

EVMS History and Limitations 6

EVMS History 6

EVMS Limitations 6

Customer Expectations for Performance-Based Management Systems 8

U.S. Federal Policy 8

U.S. Department of Defense Policies 8

Integrating Systems Engineering with Earned Value Management 9

National Defense Industrial Association 9

Standards and Capability Models 10

Customer Demand for Excellent Processes 11

CMMI as a Framework for Process Improvement 11

Customer Needs for Reduced Cycle Time and Evolutionary Acquisition 11

Increasing Utilization of EVM 12

PBEV and Agile Methods 13

Enterprise Demand for Cost-Effective Processes 13

Evolution of PBEV 13

Comparison of PBEV with EVMS 15

PBEV Process Flow 16

About this Book 16

Summary 18

References 18

2 Principles and Guidelines of PBEV 21

Introduction 21

EVMS Guidelines 21

PBEV Principles and Guidelines 21

PBEV Principles 21

PBEV Guidelines 22

First Principle 22

Product Scope 22

Product Requirements 22

Development of Product Requirements 26

Guideline 1.1 26

Guideline 1.2 26

Guideline 1.3 27

Second Principle 27

Performance 28

Base Measure 28

Guideline 2.1 29

Guideline 2.2 30

Guideline 2.3 31

Guideline 2.4 32

Guideline 2.5 33

Guideline 2.6 33

Guideline 2.7 33

Guideline 2.8 34

Guideline 2.9 34

Third Principle 35

Guideline 3.1 36

Guideline 3.2 36

Fourth Principle 37

Guideline 4.1 37

Guideline 4.2 37

Summary 38

References 38

3 Product Requirements Baseline 39

Introduction 39

What are the Requirements Baseline and the Technical Baseline? 40

What are Allocated Requirements? 41

High-level Requirements to Lower-Level Requirements 41

Engineering Approach 42

Performance Requirements 45

Early Validation 46

Requirements Validation Process 47

Requirements Traceability 49

A Case Study 52

Conversion of Customer Needs, Problems, and Requirements to Product Requirements 54

Allocation of Product Requirements to Product

Component Requirements 55

Development of the Product Component

Requirements 56

Defining the Technical Performance Measures 63

Summary 65

References 66

4 Maintain Bidirectional Traceability 69

Introduction 69

Project Plans and the Performance Measurement Baseline 69

Integration of Product Scope and Project Scope 70

Work Products 70

System Definition Stage 72

EIA 632 Engineering Life Cycle Phase Work Products 72

Design Stage 72

Work Products and Work Packages 72

Synthesis 75

Design Verification 76

Test Stage 77

Summary 77

References 78

5 Progress Toward Meeting Product Requirements 79

Introduction 79

Guideline 2.1 80

When Product Requirements are Not Measurable 82

What If Measurement is Not Needed? 82

Guideline 2.2 83

Work Products 83

SE Process Work Products 83

Measures of Progress 84

Guideline 2.3 85

Guideline 2.4 86

Success Criteria 86

Summary 87

References 87

6 Establish Planned Values and Allocate Budget 89

Introduction 89

Guidelines 2.5 and 2.6 90

Trade Studies 90

Allocated Requirements 90

Allocated Requirements with Rework Examples 91

Technical Performance Measurement 92

TPM Flowdown Procedure 93

Evidence of Achieving Planned TPM Values 95

Planning for Rework 95

Summary 95

7 Variance Analysis 97

Introduction 97

Variance Analysis 98

Scenarios 98

Scenario 1: TPM Schedule Variance 99

Scenario 2: Software Behind Schedule in Meeting Requirements 100

Scenario 3: Systems Engineering Behind Schedule in Requirements Management 101

Scenario 4: Trade Study Behind Schedule 102

Variance from Critical-To-Quality Parameters 102

Summary 103

References 103

8 Level of Effort 105

Introduction 105

Guideline 2.8 105

Measurable But Not Practical to Measure 105

Exception to Guideline 2.8: Planned Process Improvements 106

Arbitrary Limits to LOE 107

Guideline 2.9 107

Commingling LOE with Discrete Work Packages 107

Solution: Quarantine LOE Performance 109

Summary 109

References 109

9 Integrate Risk Management with EVM 111

Introduction 111

Guideline 3.1 112

Guideline 3.2 113

Summary 114

10 Changes to the Performance Measurement Baseline 115

Introduction 115

Causes of Change to Product Requirements 116

Quality Factors 116

Example 10.1: Trade-off of Product Requirements, Project X 117

Example 10.2: House Project Revised Product Requirement 118

Summary 119

References 119

11 Agile Methods 121

Introduction 121

Business Environment 121

Agile Methods 122

Guidance for Tailoring Contract Performance Reports 123

Tailoring the Implementation of EVM 124

Tailor by WBS Element 124

Tailor by Project Phase 124

Extreme Tailoring of EVM 124

Summary 125

References 125

12 Requirements and Earned Value 127

Introduction 127

Requirements Status 127

Early Validation 128

Ways to Accomplish Validation 128

Select a Verification Method for Each Requirement 129

Trace the Requirements to the Verification Document 130

Revised/Recommended Requirements Statuses 130

Discrete Measurement of Requirements Management and Tracing 130

Use the RTM to Develop the Plan 131

How to Measure Progress 132

How to Determine EV 132

RTM Example 132

Total Requirements Management EV 134

Reasonableness Check 135

Summary 135

References 135

13 Using PBEV to Manage Software-Intensive Development 137

Introduction 137

Characteristics of Software Project Management 137

Functionality and Requirements 138

Functional Requirements 138

Grouping and Traceability of Requirements 139

Recommended Base Measures by Phase 140

Software Requirements and Analysis Phase 140

Code and Unit Test Phase 141

Test Phase 141

Software Rework 142

Deferred Functionality: Deviation from Plan 145

Technical Performance Measurement 148

Capacity and Response Time Requirements Issues 148

Capacity or Performance Requirements 149

COTS Considerations 150

Summary 151

References 151

14 Supplier Acquisition Management 153

Introduction 153

Contractual Considerations 153

Industry Standards 154

Contractual Technical and Management Deliverables 155

Integrated Baseline Review 155

Monitor Supplier’s Adherence with Periodic Reviews 156

Utilize and Analyze Supplier’s Performance Reports 157

CMMI Acquisition Module 158

Project Monitoring and Control 159

Solicitation and Contract Monitoring 159

Requirements Management 159

Summary 160

References 160

15 Moving Forward 161

Introduction 161

Why Implement Process Improvement? 161

Setting the Stage for Success 162

How to Implement a Process Improvement Program 162

Policies for Integrating Systems Engineering and Risk Management 163

Example 15.1: Integrate Organizational Processes with Systems Engineering Standards 164

Excerpt from NGIS Procedure: Systems Engineering 164

Example 15.2: Integrate Risk Management with Earned Value Management 164

Excerpt from NGIS Procedure: Manage Risk 164

Implementation of PBEV 164

Summary 165

References 166

Appendices: 167

A. Fundamentals of Earned Value Management 167

Introduction 167

Why use EVM? 168

EVM principles 168

Planning and control processes 169

Product scope and quality 170

Work Breakdown Structure 170

Organizational Breakdown Structure 171

Control Accounts and Control Account Managers 171

Work packages and planning packages 171

Base measures 172

Performance Measurement Baseline (PMB) 172

House Project 173

Controlling a Project with EVM 183

Technical or Quality Variances 183

Schedule variances 184

Cost variances 184

Variance analysis 185

Cost Performance Index 186

Restatement of earned value 189

Rework 189

Maintaining the integrity of the PMB 191

Summary 192

References 192

B. Detailed Planning Guidance 193

Introduction 193

Detailed Planning of the Project 193

Detailed Planning of a Work Package 194

Work Products 194

Completion Criteria 195

Earned Value Methods 195

Technical Performance Matrix Worksheet Templates 195

Replan for Change in Number of Base Measures 200

Rework 204

Minimize Number of Work Packages 208

C. American National Standards Institute (ANSI)/Electronics Industries Alliance (EIA) Standard-748, Earned Value Management Systems Guidelines 213

Guidelines by Major Category 213

References 216

C-1 Excerpts from NDIA PMSC ANSI/EIA 748-A, Standard for Earned Value Management Systems Intent Guide 219

D. Federal Acquisition Regulations (FAR) Rule on EVMS 227

PART 2—Definitions of Words and Terms 228

PART 7—Acquisition Plans 228

PART 34—Major System Acquisition 229

PART 52—Solicitation Provisions and Contract Clauses 231

E. Enabling Work Products 235

Example E.1: Typical Work Products in CMMI 235

Example E.2: Enabling Work Products from Project X 235

F. Trade Studies 239

Trade Study Progress 242

Example F.1: Evaluate Trade Study Candidates 242

Example F.2: Trade Sudy Evaluate Candidates Activity 243

Example F.3: Trade Study from Project X 243

G. Allocated Requirements 247

Allocated Requirements 247

Requirements Development 248

Design Phase 249

Rework 253

Testing 254

Deferred Requirements 256

Software Development 256

References 256

H. Technical Performance Measures 257

TPM Work Products: Evidence of Achieving Planned TPM Values 257

Concept of Basing EV on TPMS 257

TPM: Planned Value for Physical Qualities 258

TPM: Software Quality 262

I. Success Criteria 265

Event-driven Entry and Exit Criteria for Success 265

Example I.1: Entrance and Exit Criteria for Critical Design Review (CDR) 266

Example I.2: Success Criteria for Completion of Detailed Design, Project X 270

Example I.3: Success Criteria and Technical Baselines from the Defense Acquisition Guide 271

Glossary 277

About the Authors 287

Index 291