Test development 2

• Test Development


  An umbrella term for all that goes into the process of creating a test
• Evaluating a test or assessment tool

  To measure an individual's knowledge, skills, abilities, or characteristics
• Francis Galton


  • The author of the test development
  • His ideas and research were prominent in the late 19th and early 20th centuries
  • The formal publication of his work varied across different writings and research papers during that time
• Galton's work on psychometrics


  • Particularly his development of tests related to intelligence and sensory perception
  • Laid the foundation for modern test development
• Developing a new test


  Can take several months to years, involving tasks such as item review, pilot testing, data analysis, and final revisions
• Cost to purchase the test development

  Depending on factors such as the complexity of the test, the publisher or provider, the type of license or usage rights required, and any additional services or support included
• Proprietary test development materials

  • Owned by a specific entity, such as a testing company or publisher
  • Protected by copyright or other intellectual property rights
  • Their use may be restricted by licensing agreements
• Nonproprietary test development


  • Materials may be developed by researchers, educators, or organizations with a commitment and sharing knowledge
  • Examples include open-access research articles, collaborative research projects, open educational resources, government publications, and public domain assessments
• Test development


  Aims to predict various outcomes or behaviors depending on the purpose of the test and constructs being measured, such as academic achievement, job performance, clinical diagnoses, treatment outcomes, personality traits, adverse outcomes, behavioral outcomes, and long-term outcomes
• Populations for which test developments may be designed

  • Students
  • Job applicants
  • Clinical populations
  • General population
  • Special populations
• Test development formats


  • Computer-based
  • Short answer or essay
  • Multiple-choice
  • Performance-based
  • Paper and pencil
  • True or False
• The process of developing a test

  1. Test Conceptualization

  2. Test Construction

  3. Test try out

  4. Item Analysis

  5. Test Revision
• Types of scales used in test development

  • Likert scales
  • Rating Scales
  • Ordinal scales
  • Interval scales
  • Ratio scales
  • Likelihood scales
  • Visual analog scales
  • Numeric rating scales
• Theories that influence test development

  • Cognitive Theory of Testing
  • Item Response Theory
  • Social Learning Theory
  • Constructivist Theory
  • Motivation Theory
• Comprehensive test development manual

  Includes information on how the test was constructed, its reliability and validity, composition of norm groups, and readability
• Materials, Articles, and Books used as sources for this presentation