reliability and validity

• What is reliability in a study?

  Consistency of results across repetitions
• How is reliability achieved in a study?

  If the IV affects the DV consistently
• What does replicating a study demonstrate?

  Consistency of results over time
• What indicates a reliable study when using a standardised procedure?

  Obtaining the same results consistently
• Which type of experiments are considered the most reliable in psychology?

  Lab experiments
• Why are lab experiments considered reliable?

  They occur in controlled conditions
• What is a key feature of lab experiments?

  Use of random allocation of participants
• What type of data do lab experiments generate?

  Quantitative data
• What is a limitation of field experiments compared to lab experiments?

  Subject to extraneous variables
• What is a limitation of natural experiments?

  Use a naturally occurring IV
• What are the two types of reliability?

  Internal and external reliability
• What does internal reliability refer to?

  Consistency within the measure itself
• What does external reliability refer to?

  Consistency of a test over time
• How can the reliability of a questionnaire be assessed?

  Using test-retest and split-half methods
• What does the test-retest method measure?

  External reliability of a questionnaire
• How is the test-retest method conducted?

  Same participants take the test at intervals
• What does the split-half method measure?

  Internal reliability of a questionnaire
• How is the split-half method conducted?

  Test is split in half for comparison
• What is inter-observer reliability?

  Consistency between multiple observers' recordings
• How can researchers ensure inter-observer reliability?

  Agree on behaviour categories before observation
• What is the process after conducting an observation for inter-observer reliability?

  Compare independent data sets for correlation
• What does a strong positive correlation indicate in inter-observer reliability?

  Good consistency between observers' recordings
• How can the reliability of lab experiments be improved?

  Control and standardise all aspects of the procedure
• How can the reliability of observations be improved?

  Ensure behavioural categories are operationalised
• How can the reliability of questionnaires be improved?

  Exclude inconsistent questions using test-retest
• How can the reliability of interviews be improved?

  Use the same trained interviewer for each
• What is validity in research?

  Extent to which findings are representative
• What does internal validity measure?

  Results due to manipulation of the IV
• What does external validity measure?

  Generalizability of results beyond the study
• What is ecological validity?

  Realism of the task in everyday life
• How does Milgram's study demonstrate ecological validity?

  Participants experienced genuine distress
• What does temporal validity measure?

  Relevance of findings over time
• Why is Asch's research considered a 'child of its time'?

  Reflects conformity rates post-World War II
• What is face validity?

  Whether a test measures what it claims
• What is predictive validity?

  How well a test predicts future behaviour
• What is concurrent validity?

  Agreement between two tests of the same skill
• How can the validity of lab experiments be improved?

  Use controlled conditions and standardised procedures
• What are investigator effects?

  Researcher influences outcome unknowingly
• What are demand characteristics?

  Participants alter behaviour due to awareness
• How can demand characteristics be reduced?

  Disguise the aim of the study ethically