Week8/Week9 - Reflection | CPT208_B4_Porfolio by CPT208_2223_B4

In this week's lecture, we have learned some additional skills on evaluating based on the fundamental evaluation skills we learned a couple of weeks ago.

Based on our existing prototypes and design concepts, we found that our work focused on Micro HCI, such as User satisfaction and Time performance, and lacked thinking about the direction of Macro HCI, such as Motivation, Empathy and Social participation. Therefore, we have decided to incorporate social systems into the product and maintain a user community. In addition, as mentioned in the reflection of Week 3, we will also consider the user experience of special groups in our future work.
We will divide the prototype evaluation for the next stage into three parts:

1. Controlled settings that directly involve users: Allow users to experience the product in the development laboratory and provide feedback (the type and process of feedback can be referred to in the specification of hydrological evaluation week 3- week 5). Specifically, in this section of the product usability test, we will select 5-10 representative testers to conduct an experiment for about 30 minutes.
2. Natural settings involving users: Deploy the product on users' phones or computers, allowing them to experience it in their daily lives, and provide feedback after a period of time
3. Setting that does not directly involve users: consult with experts to consult and evaluate the design and prototype. 

In addition, we further considered the issue of data interpretation and presentation.

• Data display: After the previous presentation, our chart color design needs to be more reasonable, and the contrast between different options needs to be high.
• Data interpretation: Consider the following aspects of the method of collecting data
  • Reliability: Does the method produce the same results on separate occasions?
  • Validity: Does the method measure what it is intended to measure?
  • Ecological validity: Does the environment of the evaluation distort the results
  • Biases: Are there biases that distort the results?
  • Scope: How generalizable are the results?

Meanwhile, based on the knowledge of Experimental Design, we hope to explore and prove the conclusions obtained from the literature that have been applied to our design through our own experiments:

• Null hypothesis 1: The human brain is not more inclined to remember images than words
• Alternative hypothesis 1: The human brain is more inclined to remember images rather than words
• Null hypothesis 2:  Use pictures to learn pictographic scrips, which has "congenital advantages" over ideograms
• Alternative hypothesis 2: Use pictures to learn pictographic scrips, which does not have "congenital advantages" over ideograms

We plan to use Within Subjects Design to design the experiment, as it has the advantage of "Few individuals, no individual differences" since we do not have the ability to gather too many participants. Even though this may require Counter balancing due to order issues.