Reliability + Validity

• What is reliability in the context of psychology?

  Consistency of test results over time
• What is expected for a study to be reliable?

  The same results should be found on different days
• What are the two types of reliability?

  Test-retest and Inter-observer
• What does test-retest reliability involve?

  Administering the same test on different occasions
• What is the purpose of correlating scores in test-retest reliability?

  To ensure the results are similar each time
• What is the recommended time interval for test-retest reliability?

  1-2 weeks
• What is inter-observer reliability?

  Agreement between two or more observers
• How is inter-observer reliability measured?

  By correlating observations of different observers
• What is the correlation value indicating good reliability?

  +0.8 or higher
• How can the reliability of questionnaires and interviews be improved?

  • Ensure clarity and avoid ambiguity in questions
  • Convert open-ended questions to closed alternatives
  • Use trained interviewers to avoid leading questions
• What are the steps to improve the reliability of experiments?

  • Standardize procedures for all participants
  • Control confounding variables
  • Ensure only the independent variable varies
• How can the reliability of observations be improved?

  • Clearly define and operationalize behavioral categories
  • Train observers thoroughly in applying criteria
• What does validity refer to in research?

  Whether data represents reality and genuine effects
• What are the two main types of validity?

  Internal and External validity
• What does internal validity measure?

  The consistency of an experiment's internal factors
• What does external validity measure?

  The generalizability of results beyond the study
• What are some problems that can affect internal validity?

  Extraneous variables and confounding variables
• What is population validity?

  Generalizing findings to other people
• What is temporal validity?

  Generalizing findings to historical periods
• What is ecological validity?

  Generalizing findings to real-life settings
• What does face validity assess?

  If a measure appears to measure what it intends
• What does concurrent validity assess?

  Relation to an existing, similar measure
• How can internal validity be improved?

  By controlling confounding variables
• What is the purpose of a double-blind design?

  To prevent bias from both participants and researchers
• What are participant variables?

  Differences between participants affecting results
• What are situational variables?

  Environmental factors affecting research outcomes
• What is the difference between confounding and extraneous variables?

  • Confounding variables: Vary systematically with the independent variable
  • Extraneous variables: Do not vary systematically but can affect the dependent variable
• What is mundane realism?

  • Extent to which findings apply to real life
  • Focuses on how applicable findings are in everyday situations
• What are demand characteristics?

  Cues that make participants aware of study aims
• What are investigator effects?

  Effects caused by the investigator's actions
• What is experimental realism?

  Engagement in the task by participants
• Why is controlling variables important in experiments?

  To ensure valid comparisons between conditions
• What is the relationship between control and realism in psychology experiments?

  Control limits variables, realism mirrors real life