Reliability and validity

• What is the main focus of Lesson 2 in the study material?

  Understanding reliability and its assessment
• What does reliability refer to in research methods?

  Consistency of results over time
• How is external reliability defined?

  Consistency over time and location
• What is internal reliability?

  Consistency of the measuring tool itself
• What is a method to assess reliability?

  Repeat the test with the same participants
• What indicates high reliability in test results?

  High positive correlation of +0.8
• What is inter-observer reliability?

  Agreement between different observers' ratings
• What is a threat to reliability in experiments?

  Non-standardised procedures
• How can reliability be improved in experiments?

  Use well-controlled lab experiments
• What is a way to improve reliability in questionnaires?

  Repeat the questionnaire for test-retest
• What can lead to low test-retest reliability in questionnaires?

  Complex or ambiguous questions
• What is a method to improve reliability in interviews?

  Use the same interviewer each time
• What is a threat to reliability in observations?

  Unclear behavioral categories
• How can inter-rater reliability be ensured?

  Use two observers to compare results
• What is ecological validity?

  Generalizability of findings to real-life settings
• What does temporal validity refer to?

  Findings holding true over time
• What are extraneous variables?

  Variables that may affect the DV if uncontrolled
• What is face validity?

  Does the test appear to measure what it should?
• How is concurrent validity assessed?

  Correlate with an established test's performance
• What is a threat to validity in experiments?

  Low internal validity due to uncontrolled variables
• What is a way to improve validity in experiments?

  Use a control group
• How can social desirability bias be reduced in questionnaires?

  Ensure confidentiality and anonymity
• What is a leading question?

  A question that suggests a certain answer
• How can validity be improved in interviews?

  Use structured interviews with standardised questions
• What is the purpose of the reliability and validity plenary activity?

  To encourage thorough learning of terms
• What is the significance of a correlation of +0.8?

  Indicates high reliability or validity
• What should students do with definition cards in the plenary activity?

  Pair up and test each other
• How should statistical testing be applied in assessing reliability?

  Check for a positive correlation
• What are the key terms related to validity that students should define?

  • Face validity
  • Temporal validity
  • Concurrent validity
  • Ecological validity
• What are the threats to validity in research?

  • Extraneous variables
  • Confounding variables
  • Demand characteristics
  • Investigator effects
  • Leading questions
• What are the ways to improve reliability across different methods?

  • Standardised procedures
  • Clear operational definitions
  • Training observers/interviewers
  • Test-retest method
• What are the ways to improve validity across different methods?

  • Use control groups
  • Standardisation of procedures
  • Ensure realistic tasks/settings
  • Triangulate data
• What is the minimum correlation coefficient for reliability?

  +0.8
• What is the difference between reliability and validity?

  • Reliability: Consistency of results
  • Validity: Accuracy of measurement
• What are the implications of low ecological validity?

  • Results may not reflect real-life behavior
  • Findings may lack generalizability
• What is the role of statistical testing in assessing reliability and validity?

  • To determine correlation between tests
  • To ensure consistency of results