Question Evaluation Methods: Contributing to the Science of Data Quality

Preface xi

1 Introduction 1
Jennifer Madans, Kristen Miller, Aaron Maitland, and Gordon Willis

I BEHAVIOR CODING 5

2 Coding the Behavior of Interviewers and Respondents to Evaluate Survey Questions 7
Floyd J. Fowler, Jr.

3 Response 1 to Fowler’s Chapter: Coding the Behavior of Interviewers and Respondents to Evaluate Survey Questions 23
Nora Cate Schaeffer and Jennifer Dykema

4 Response 2 to Fowler’s Chapter: Coding the Behavior of Interviewers and Respondents to Evaluate Survey Questions 41
Alisú Schoua-Glusberg

II COGNITIVE INTERVIEWING 49

5 Cognitive Interviewing 51
Kristen Miller

6 Response 1 to Miller’s Chapter: Cognitive Interviewing 77
Gordon Willis

7 Response 2 to Miller’s Chapter: Cognitive Interviewing 93
Frederick G. Conrad

III ITEM RESPONSE THEORY 103

8 Applying Item Response Theory for Questionnaire Evaluation 105
Bryce B. Reeve

9 Response 1 to Reeve’s Chapter: Applying Item Response Theory for Questionnaire Evaluation 125
Ron D. Hays

10 Response 2 to Reeve’s Chapter: Applying Item Response Theory for Questionnaire Evaluation 137
Clyde Tucker, Brian Meekins, Jennifer Edgar, and Paul P. Biemer

IV LATENT CLASS ANALYSIS 151

11 Some Issues in the Application of Latent Class Models for Questionnaire Design 153
Paul P. Biemer and Marcus Berzofsky

12 Response 1 to Biemer and Berzofsky’s Chapter: Some Issues in the Application of Latent Class Models for Questionnaire Design 187
Frauke Kreuter

13 Response 2 to Biemer and Berzofsky’s Chapter: Some Issues in the Application of Latent Class Models for Questionnaire Design 199
Janet A. Harkness and Timothy P. Johnson

V SPLIT-SAMPLE EXPERIMENTS 213

14 Experiments for Evaluating Survey Questions 215
Jon A. Krosnick

15 Response 1 to Krosnick’s Chapter: Experiments for Evaluating Survey Questions 239
Johnny Blair

16 Response 2 to Krosnick’s Chapter: Experiments for Evaluating Survey Questions 253
Theresa DeMaio and Stephanie Willson

VI MULTITRAIT-MULTIMETHOD EXPERIMENTS 263

17 Evaluating the Reliability and Validity of Survey Interview Data Using the MTMM Approach 265
Duane F. Alwin

18 Response to Alwin’s Chapter: Evaluating the Reliability and Validity of Survey Interview Data Using the MTMM Approach 295
Peter Ph. Mohler

VII FIELD-BASED DATA METHODS 319

19 Using Field Tests to Evaluate Federal Statistical Survey Questionnaires 321
Brian A. Harris-Kojetin and James M. Dahlhamer

Index 345