11.4.1 Assessing Reliability

• What does reliability ensure in psychological research?

  Outcomes reflect the concepts investigated
• Reliability refers to the consistency of results
• Reliability focuses on the accuracy of the measure

  False
• What is an example of a highly reliable questionnaire?

  Anxiety questionnaire with similar scores over time
• Test-retest reliability measures the stability of a test over time
• A high correlation in test-retest reliability indicates stability
• What type of test should demonstrate high test-retest reliability?

  IQ test taken weeks apart
• Inter-rater reliability measures the consistency between different raters
• A high Kappa coefficient in inter-rater reliability indicates agreement
• What is an example of high inter-rater reliability in psychology?

  Psychologists providing similar diagnoses
• Test-retest reliability compares scores from the same test given at two different times
• Correlation statistics are used to assess test-retest reliability
• What is an assumption when assessing test-retest reliability?

  No significant life events occur
• Inter-rater reliability ensures that different raters independently reach similar conclusions
• High values of Pearson’s $r$ in inter-rater reliability indicate strong agreement
• In which scenario is inter-rater reliability crucial?

  Reviewing patient cases
• Parallel forms reliability assesses the consistency between two different versions of a test
• High correlation in parallel forms reliability indicates agreement
• What is an example of strong parallel forms reliability?

  Two algebra tests with similar scores
• Internal consistency reliability ensures that all items in a test measure the same construct
• Cronbach’s alpha values between 0.7 and 0.9 indicate good internal consistency
• What is an example of high internal consistency in a Likert scale?

  Job satisfaction statements with consistent responses
• Longer tests tend to be more reliable
• Diverse samples can lower reliability
• What is used to quantify agreement between scores in reliability assessments?

  Correlation coefficient