Validity

• What is the definition of validity in research?

  Whether a researcher is measuring what they’re setting out to measure
• What is the difference between internal and external validity?

  Internal validity concerns what goes on within a study, while external validity concerns generalizing findings
• What are examples of threats to internal validity?

  Investigator effects, demand characteristics, confounding variables, social desirability
• What is ecological validity?

  The extent to which the research setting represents the real-life setting
• What is population validity?

  The extent to which findings apply to groups of people other than the participants
• What is temporal validity?

  The extent to which findings apply to other time periods
• Why might a teacher's measure of musical ability lack validity?

  Subjective judgment, song choice bias, and narrow operationalization of musical ability
• What is face validity?

  Whether a self-report measure looks like it is measuring what the researcher intended
• What is construct validity?

  How well a measure represents key theoretical concepts
• What is predictive validity?

  Whether a score on a test predicts later behavior
• What is concurrent validity?

  Whether a new test compares well to an established measure
• How can validity be improved in experimental research?

  Using control groups, standardizing procedures, and using single or double-blind procedures
• How can validity be improved in observations?

  Minimizing observer input, using covert observations, and ensuring clear behavioral categories
• How can validity be improved in questionnaires?

  Including lie scales, ensuring anonymity, and reducing social desirability bias
• Why are qualitative methods considered more valid than quantitative methods?

  They provide depth and detail that better reflect participants' reality
• What is interpretive validity in qualitative research?

  The interpretation of events matches those of the participants
• What is triangulation in qualitative research?

  The use of multiple sources of evidence to enhance validity
• What are the main types of validity and their definitions?

  • Face Validity: Whether a measure looks like it measures what it is supposed to
  • Construct Validity: How well a measure represents key theoretical concepts
  • Predictive Validity: Whether a test score predicts later behavior
  • Concurrent Validity: Whether a new test compares well to an established measure
• What are the main ways to improve validity in different research methods?

  • Experimental Research: Use control groups, standardize procedures, use single/double-blind procedures
  • Observations: Minimize observer input, use covert observations, ensure clear behavioral categories
  • Questionnaires: Include lie scales, ensure anonymity, reduce social desirability bias
  • Qualitative Methods: Ensure interpretive validity, use triangulation
• What are the main threats to internal validity?

  • Investigator effects
  • Demand characteristics
  • Confounding variables
  • Social desirability bias
• What are the main types of external validity?

  • Ecological Validity: Extent to which findings apply to real-life settings
  • Population Validity: Extent to which findings apply to other groups of people
  • Temporal Validity: Extent to which findings apply to other time periods
• Why might a stress questionnaire lack face validity?

  If the questions are not related to stress but measure something else
• Why might a loneliness questionnaire lack construct validity?

  If the questions do not specifically relate to the construct of loneliness
• Why might GCSE results lack predictive validity for A-level results?

  If high GCSE grades do not lead to high A-level grades
• Why might a new test lack concurrent validity?

  If it does not compare well to an established test of the same concept
• How does a lie scale improve validity in questionnaires?

  By assessing the consistency of participants' responses and reducing social desirability bias
• How does triangulation improve validity in qualitative research?

  By using multiple sources of evidence to confirm findings
• Why might the hypothesis that head circumference correlates with intelligence lack validity?

  Because head circumference is not a valid measure of intelligence