Chapter 6

• A judgment or estimate of how well a test measures what it purports to measure in a particular context.

  Validity
• A logical result or deduction


  Inference
• Characterizations of the validity of tests and test scores are frequently phrased in terms such as _______________ or ______________.

  Acceptable or Weak
• It is the process of gathering and evaluating evidence about validity

  Validation
• Three Categories of Validity

  Content Validity

  Criterion-related Validity

  Construct Validity
• Refers to a judgment regarding how well a test measures what it purports to measure at the time and place that the variable being measured is actually emitted.

  Ecological Validity
• A judgment concerning how relevant the test items appear to be.

  Face Validity
• Inkblots may be perceived as a test with low of ___________.

  Face validity
• Describes the judgment of how adequately a test samples behavior representative of the universe of behavior that the test was designed to sample.

  Content Validity
• A judgment of how adequately a test score can be used to infer an individual's most probable standing on some measure of interest.

  Criterion-related Validity
• An index of the degree to which a test score is related to some criterion measure obtained at the same time.

  Concurrent Validity
• An index of the degree to which a test scores predicts some criterion measure.

  Predictive Validity
• Characteristics of a criterion:


  An adequate criterion is RELEVANT

  An adequate criterion must also be VALID

  A criterion is also UNCONTAMINATED
• The term applied to a criterion measure that has been based at least in part on predictor measure.

  Criterion contamination
• The extent to which a particular trait, behavior, characteristics, or attribute exists in the population.

  Base rate
• May be defined as the proportion of people a test accurately identifies as possessing or exhibiting a particular trait, behavior, characteristic, or attribute.

  Hit rate
• May be defined as the proportion of people the test fails to identify having or not having a particular characteristic or attribute.

  Miss rate
• It is a miss wherein the test predicted that the test taker did possess the particular characteristic or attribute being measured when in fact the test taker DID NOT.

  False positive
• It is a miss wherein the test predicted that the test taker did not possess the particular characteristic or attribute being measured when the test taker ACTUALLY DID.

  False negative
• Whether concurrent or predictive, are based on two types of statistical evidence:

  Validity coefficient

  Expectancy data
• It is a correlation coefficient that provides a measure of the relation between test scores and scores on the criterion measure.

  Validity coefficient
• This is use depending on variables to determine the validity between two measures

  Pearson correlation coefficient
• This is use or employed when you are correlation self rankings of performance on some job with rankings made by job supervisors.

  Spearman rho rank order correlation
• The degree to which an additional predictor explains something about the criterion measure that is not explained by predictors already in use.

  Incremental Validity
• A judgment about the appropriateness of inferences drawn from test scores regarding individual standings on a variable.

  Construct Validity
• These are unobservable, presupposed traits that a test developer may invoke to describe test behavior or criterion performance.

  Constructs
• If the test is a VALID measure of the construct ____________________________.


  Then high scorers and low scorers will behave as predicted by the theory.
• If high scorers and low scorers on the test do not behave as predicted _________________.


  The investigator will need to reexamine the nature of the construct itself or hypotheses made about it.
• Evidences of Construct Validity

  Evidence of homogeneity

  Evidence of change with age

  Evidence of pretest-posttest changes

  Evidence from distinct groups

  Convergent evidence

  Discriminant evidence
• It is a short hand term for a class of mathematical procedures designed to identify factors or specific variables that are typically attributes, characteristics, or dimensions on which people may differ.


  Factor Analysis
• Typically entails estimating or extracting factors; deciding how many factors to retain; and rotating factors to an interpretable orientation.

  Exploratory Factor Analysis
• Researchers test the degree to which a hypothetical model fits the actual data.

  Confirmatory Factor Analysis
• For Psychometrician, it is a factor inherent i a test that systematically prevents accurate, impartial measurement.

  Bias
• It is a numerical or verbal judgment that places a person or an attribute along a continuum identified by a scale of numerical or word descriptors known as rating scale.

  Rating error
• A judgment resulting from the intentional or unintentional misuse of rating scale.

  Rating error
• An error in rating that arises from the tendency on the part of the rater to be lenient in scoring, marking, and/or grading.


  Leniency error (also known as generosity error)
• Rater exhibits a general and systematic reluctance to giving ratings at either the positive or the negative extreme.

  Central tendency error
• A procedure that requires the rater to measure individuals against one another instead of against an absolute scale.

  Rankings
• Describes the fact that for some raters some ratees can do no wrong.

  Halo effect
• In a psychometric context, it is the extent to which a test is used in an impartial, just, and equitable way.

  Fairness