Contents

0 Introduction and Overview
 Perspectives on Testing
 Course Purpose and Outline
 Summary and Homework
  Learning Objectives
  Discussion questions
1 Measurement, Scales, and Scoring
 Introduction
 What is Measurement?
  How do we define it?
  From Physical to Intangible
  What makes measurement good?
  What is the purpose?
  Summary
 Measurement Scales
  Four types of scales
  Comparing scales
 Scoring
  Dichotomous scoring
  Polytomous scoring
  Rating scales
  Composites versus components
 Measurement models
 Score Scaling and Referencing
  Score Scaling
  Norm referencing
  Criterion referencing
  Comparing referencing methods
 Summary and Homework
  Learning objectives
  Discussion questions
2 Testing Applications
 Introduction
 Tests and Decision Making
  Educational decisions
  Psychological decisions
 Test Types and Features
  Cognitive and affective
  Achievement and aptitude
  Other distinctions
  Summary
 Summary and Homework
  Learning objectives
  Discussion questions
3 Cognitive Test Construction
 Introduction
 Validity and Test Purpose
 Learning Objectives
 Features of Test Items
  Depth of knowledge
  Item Types
  Test Outline
 Item Writing
  Content concerns
  Formatting concerns
  Style concerns
  Writing the stem
  Writing the choices
  Construct Irrelevant Variance
 Summary and Homework
  Learning objectives
4 Affective Test Construction
 Introduction
 Validity and Test Purpose
 Construction Strategies
  Deductive
  Empirical
 Features of Personality Items
  The Stem or Prompt
  Response Scales
 Item Writing
  Guidelines
  Response Sets
 Summary and Homework
  Learning objectives
5 Reliability
 Introduction
 Consistency of Measurement
 Classical Test Theory
  The model
  Applications of the model
  Systematic and random error
 Reliability and Unreliability
  Reliability
  Estimating reliability
  Unreliability
  Interpreting reliability and unreliability
 Reliability Study Designs
 Summary and Homework
  Learning objectives
  Discussion Questions
6 Interrater Reliability
 Introduction
 Consistency of Ratings
  Definition
  Examples
 Agreement and Consistency
  Percentage agreement
  Kappa agreement
  Pearson correlation
  Generalizability theory
 Summary and Homework
  Learning objectives
  Discussion Questions
7 Item Analysis
 Introduction
 Analyzing Items
  Overview
 Scoring
 Item Difficulty
 Item Discrimination
 Differential Item Functioning
 Summary and Homework
  Learning objectives
  Discussion Questions
8 Item Response Theory
 Introduction
 IRT versus CTT
  Reviewing CTT
  Comparing with IRT
 Traditional IRT Models
  Terminology
  The IRT models
  Assumptions
  Common uses
 Applications
 Summary and Homework
  Learning objectives
9 Validity
 Introduction
 Validity
  Definitions
  Examples
  Sources of validity evidence
 Content Validity
  Definition
  Examples
 Criterion Validity
  Definition
  An example
 Construct Validity
  Definition
  An example
 Unified Validity and Threats
 Summary and Homework
  Learning objectives
  Discussion Questions
10 Test Evaluation
 Introduction
 Purpose
 Study Design
 Reliability
 Validity
 Scoring
 Test Use
 Summary and Homework
  Learning objectives
Bibliography
A Introductory Statistics Review
 Overview
 Some Terms
 Distributions
 Central Tendency
 Variability
 Covariability
 Summary
  Learning objectives