3.5 Evaluation

• Evaluation criteria are the standards used to assess the success of a solution
• Evaluation criteria help determine whether a solution meets its intended goals
• Evaluation criteria for improving website loading speed could include average loading time and user satisfaction ratings.
• Match the evaluation criteria type with its description and example:

  Performance ↔️ Measures how well the solution performs | Average loading time

  Usability ↔️ Assesses how user-friendly the solution is | User satisfaction ratings

  Cost-effectiveness ↔️ Evaluates the cost relative to benefits | Development cost vs. revenue generated
• To gather evidence of problem solution performance, one step is to collect relevant data
• When gathering evidence, quantitative data uses numbers, while qualitative data uses text
• Steps to gather evidence of problem solution performance:

  1️⃣ Collect relevant data

  2️⃣ Choose appropriate data types

  3️⃣ Utilize diverse evidence sources

  4️⃣ Compare quantitative and qualitative data
• Server logs are an example of a quantitative data source for evaluating problem solution performance.
• Match the analysis type with its measures and examples:

  Quantitative ↔️ Performance, cost, efficiency | Response time, resource usage, cost-effectiveness

  Qualitative ↔️ User satisfaction, usability | User surveys, feedback forms, expert reviews
• Strengths of a solution highlight its positive aspects, while weaknesses identify areas needing improvement.
• One weakness of a solution under heavy load might be slow response times
• The assessment of a solution should include performance, usability, cost-effectiveness, scalability, security, and maintainability
• A solution with an intuitive interface is considered highly usable
• Robust security measures in a solution indicate its strength in security
• Match the evaluation criteria type with its description:

  Performance ↔️ Measures how well the solution performs

  Usability ↔️ Assesses how user-friendly the solution is

  Cost-effectiveness ↔️ Evaluates cost relative to benefits
• What type of data is used for objective measures in solution evaluation?

  Quantitative
• Diverse evidence sources for problem solution performance include logs, user feedback, A/B testing, and expert reviews
• Steps to analyze evidence based on evaluation criteria:

  1️⃣ Organize evidence into a structured format

  2️⃣ Apply quantitative and qualitative analysis techniques

  3️⃣ Compare analyzed data against evaluation criteria

  4️⃣ Summarize findings
• What is an example of a quantitative measure for website performance?

  Response time
• Qualitative analysis focuses on aspects like user satisfaction and usability
• Quantitative analysis often measures cost and efficiency.
• What is an example of a qualitative measure for website usability?

  User surveys
• For a website loading speed solution, qualitative analysis might assess user satisfaction through surveys
• In quantitative analysis, measures like response time are used, while qualitative analysis uses methods like surveys
• Quantitative and qualitative analysis techniques are both used to analyze evidence based on evaluation criteria
• Assessing the strengths and weaknesses of a solution is critical for understanding its overall effectiveness
• Order the key assessment aspects for evaluating a solution's strengths and weaknesses:

  1️⃣ Performance

  2️⃣ Usability

  3️⃣ Cost-effectiveness

  4️⃣ Scalability

  5️⃣ Security

  6️⃣ Maintainability
• Match the aspect with its strength for a website solution:

  Performance ↔️ High throughput

  Usability ↔️ Intuitive interface

  Scalability ↔️ Easily handles growth
• A solution's security strength may include compliance with industry standards
• Analyzing evaluation data is the first step in identifying areas for improvement
• Order the steps for identifying areas for improvement in a solution:

  1️⃣ Analyze evaluation data

  2️⃣ Compare against criteria

  3️⃣ Define improvement tasks
• To analyze evaluation data, review sources such as logs, user feedback, and performance metrics
• Improvement tasks should be aligned with the evaluation criteria to ensure effectiveness
• To identify areas for improvement, analyze a solution's strengths and weaknesses