Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
immersion_vs_2d_for_spatial_words [2019/06/17 13:34]
admin [Recognition Measurements]
immersion_vs_2d_for_spatial_words [2019/06/18 11:19] (current)
admin [Draft Paper]
Line 3: Line 3:
 ==== Draft Paper ==== ==== Draft Paper ====
  
-{{ ::​analysing_the_impact_of_interaction_embodied_interaction_and_head-mounted_immersion_on_memorisation_rationale_and_experiment_design.pdf |Analysing the impact of interaction,​ embodied interaction and head-mounted immersion on memorisation:​ rationale and experiment design}} ​(for submission to Conference on Games 2019 @ QMUL)+{{ ::​analysing_the_impact_of_interaction_embodied_interaction_and_head-mounted_immersion_on_memorisation_rationale_and_experiment_design.pdf |Analysing the impact of interaction,​ embodied interaction and head-mounted immersion on memorisation:​ rationale and experiment design}} ​
  
 ==== Summary ==== ==== Summary ====
Line 52: Line 52:
 The word pairs are split into six sets (below list is working example, updated list can be found in __resources__ section of this page): The word pairs are split into six sets (below list is working example, updated list can be found in __resources__ section of this page):
  
-  * **First ​Session** +Session ​Number ​ ^ Interaction Group  ^ Verb    ^ Noun       ^ Verb (JP)      ​^ Noun (JP)  ^ 
-    * **A (1 - 3)**  +| 1               | A                  | Take    ​| ​Black tea  | Toru           | Kocha      
-      Take -> Black tea [toru -> kocha] +| 1               | A                  | Pay     | Money      ​| Shiaharau ​     | Okane      | 
-      Pay -> Money [shiharau -> okane] +| 1               | A                  | Pour    ​| ​Milk       | Sosogu ​        | Gyuu nyuu  | 
-      Pour -> Milk [sosogu -> gyuu nyuu] +| 1               ​| ​                 ​| ​Stir    ​| ​Cup        | Mazeru ​        | Yunomi ​    | 
-    * **(4 - 6)**  +| 1               | B                  | Cover   | Lid        | Kabuseru ​      | Futa       | 
-      * Stir -> Cup [mazeru ->​yunomi] +| 1               | B                  | Sip     | Drink      | Hitokuchi ​     | Nomimono ​  | 
-      ​* ​Cover -> Lid [kabuseru -> futa] +| 1               ​| ​                 ​| ​Eat     | Rice cake  | Tabemasu ​      | Mochi      
-      ​* ​Sip -> Drink [hitokuchi -> nomimono] +| 1               | C                  | Wipe    ​| ​Napkin ​    | Fuku           | Otefuki ​   | 
-    * **(7 - 9)**  +| 1               | C                  | Open    ​| ​Door       | Akeru          | Tobira ​    | 
-      * Eat -> Rice cake [tabemasu -> mochi] +| 2               ​| ​                 ​| ​Choose ​ ​| ​Green tea  | Erabu          | Houjicha ​  | 
-      Wipe -> Napkin ​[fuku -> otefuki] +| 2               | X                  | Give    ​| ​Banknote ​  | Ageru          | Osatsu ​    | 
-      ​* ​Open -> Door [akeru -> tobira] +| 2               | X                  | Add     | Sugar      | Kuwaeru ​       | Satoo      | 
-  * **Second Session** +| 2               ​| ​                 ​| ​Swirl   | Tea bowl   | Mawasu ​        | Chawan ​    | 
-    * **(10 - 12)**  +| 2               | Y                  | Put on  ​| ​Tray       | Oku            | Bon        | 
-      * Choose ​-> Green tea [erabu -> houjicha] +| 2               | Y                  | Spill   | Beverage ​  | Koboreru ​      | Inryou ​    | 
-      ​* ​Give -> Banknote ​[ageru-> osatsu] +| 2               ​| ​                 ​| ​Smell   | Cake       | Kagu           | Yogashi ​   | 
-      ​* ​Add -> Sugar [kuwaeru -> satoo] +| 2               | Z                  | Clean   | Towel      | Kirei ni suru  | Daifukin ​  | 
-    * **(13 - 15)**  +| 2               | Z                  | Move    ​| ​Bag        | Ugokasu ​       | Kaban      |
-      * Swirl -> Teabowl [mawasu -> chawan] +
-      ​* ​Put on -> Tray [oku -> bon] +
-      ​* ​Spill -> Beverage ​[koboreru -> inryou] +
-    * **(16 - 18)**  +
-      *  ​Smell -> Cake [kagu -> yogashi] +
-      ​* ​Clean -> Towel [kirei ​ni suru -> daifukin] +
-      ​* ​Move -> Bag [ugokasu -> kaban]+
  
 Participants will experience both sessions, one in VR and one in a desktop environment. Combinations include: Participants will experience both sessions, one in VR and one in a desktop environment. Combinations include:
  
-  * VR -> Desktop +^ Participants ​ ^ Session 1  ^ Session 2  ^ 
-  * Desktop -> VR+| 50%           | Monitor ​   | HMD        | 
 +| 50%           | HMD        | Monitor ​   |
  
 Each session has three groups of word pairs (ABC or XYZ), with each group a different interaction type (non-interaction,​ interaction,​ embodied). There interaction type assigned to each group varies between participants. E.g. Participant one might have A = noninteraction,​ B = interaction,​ C = embodied, while participant two might have A = embodied, B = noninteraction,​ C = interaction. ​ Each session has three groups of word pairs (ABC or XYZ), with each group a different interaction type (non-interaction,​ interaction,​ embodied). There interaction type assigned to each group varies between participants. E.g. Participant one might have A = noninteraction,​ B = interaction,​ C = embodied, while participant two might have A = embodied, B = noninteraction,​ C = interaction. ​
Line 88: Line 82:
 There are 12 different combinations of interaction type, output type (HMD vs monitor) and word pair group: There are 12 different combinations of interaction type, output type (HMD vs monitor) and word pair group:
  
-  * HMD: A:B:C:X (Interaction ​Embodied Non-interaction) +^ Display Type  ^ Word Group: A/X  ^ Word Group: B/Y  ^ Word Group: C/Z  ^ 
-  ​* ​HMD: A:I B: X C:E (Interaction ​Non-interaction ​Embodied) +| HMD           | Abstract ​        ​| ​Embodied ​        | Non-interactive ​ | 
-  ​* ​HMD: A:E B:I C:X (Embodied ​Interaction ​Non-interaction) +HMD           | Abstract ​        ​| ​Non-interactive ​ | Embodied ​        | 
-  ​* ​HMD: A:E B:X C:I (Embodied Non-interaction Interaction) +HMD           | Embodied ​        | Abstract ​        ​| ​Non-interactive ​ | 
-  ​* ​HMD: A:X B:I C:E (Non-interaction Interaction ​Embodied) +HMD           | Embodied ​        | Non-interactive ​ | Abstract ​        | 
-  ​* ​HMD: A:X B:E C:I (Non-interaction ​Embodied ​Interaction) +HMD           | Non-interactive ​ | Abstract ​        ​| ​Embodied ​        | 
-  ​* ​Monitor: A:I B:E C:X (Interaction ​Embodied Non-interaction) +HMD           | Non-interactive ​ | Embodied ​        | Abstract ​        | 
-  ​* ​Monitor: A:I B:X C:E (Interaction ​Non-interaction ​Embodied) +Monitor ​      | Abstract ​        ​| ​Embodied ​        | Non-interactive ​ | 
-  ​* ​Monitor: A:E B:I C:X (Embodied ​Interaction ​Non-interaction) +Monitor ​      | Abstract ​        ​| ​Non-interactive ​ | Embodied ​        | 
-  ​* ​Monitor: A:E B:X C:I (Embodied Non-interaction Interaction) +Monitor ​      | Embodied ​        | Abstract ​        ​| ​Non-interactive ​ | 
-  ​* ​Monitor: A:X B:I C:E (Non-interaction Interaction ​Embodied) +Monitor ​      | Embodied ​        | Non-interactive ​ | Abstract ​        | 
-  ​* ​Monitor: A:X B:E C:I (Non-interaction ​Embodied ​Interaction)+Monitor ​      | Non-interactive ​ | Abstract ​        ​| ​Embodied ​        | 
 +Monitor ​      | Non-interactive ​ | Embodied ​        | Abstract ​        |
  
 +There an example participant might follow the experiment route:
 +
 +  * Session 1: Monitor. Word Group A (Non-interactive),​ B (Embodied), C (Abstract)
 +  * Session 2: HMD. Word Group X (Abstract), Y (Embodied), Z (Non-interactive)
 +
 +As we are not comparing between sessions, and each session will have the same number of participants in test conditions, we can have Word Group A, B and C always assigned to Session 1, and Word Groups X, Y and Z always in Session 2 without issue.
 ==== Conducting the experiment ==== ==== Conducting the experiment ====
  
Line 180: Line 181:
   * Enjoyment will be higher in HMD and embodied scenarios   * Enjoyment will be higher in HMD and embodied scenarios
   * Presence will be higher in HMD and embodied scenarios   * Presence will be higher in HMD and embodied scenarios
 +  * Learning preference will not make a difference for interaction type
  
 ==== Variables ==== ==== Variables ====
Line 196: Line 198:
  
 ==== Analyse results ====  ==== Analyse results ==== 
 +
 +The experiment have three independent variables - //display type//, //​interaction type//, and //word type// in a 2x3x2 design (displayed below). ​
 +
 +It uses within-subject design to maximise the number of results and minimise potential random noise. The words and experiences differ enough that we were not worried about the transfer of learning across conditions.
 +
 +https://​docs.google.com/​drawings/​d/​1jRMBvJzaQFq5AWb9Dbw11nvbPePEQCzhkny39OgyfxQ
  
 === Did people learn? === === Did people learn? ===
Line 202: Line 210:
   * People learned or not instantly   * People learned or not instantly
   * People learned or not after one week   * People learned or not after one week
 +  * Difference between instant results and one week
 +
 +=== Word difficulty ===
 +
 +Something to determine word difficulty/​if a word or phrase is particularly hard?
  
 === ANOVA Prep === === ANOVA Prep ===
  
   * Shapiro-Wilk test of normality   * Shapiro-Wilk test of normality
-  * Levene’s test for homogeneity of variances+  * Check for sphericity and adjust if needed (Greenhouse-Geisser) 
 +    * Check Epsilon to under if sphericity is borked: closer to 1 better, lower bound 0.5 for three-way
  
 === What factors influenced learning, and what are their relationships?​ === === What factors influenced learning, and what are their relationships?​ ===
  
-  * Three-way ANOVA on IMPROVEMENT between tests, main effect of each variable and interaction between them:+  * Three-way ​repeated measure ​ANOVA on IMPROVEMENT between tests, main effect of each variable and interaction between them:
      * hmd/desktop      * hmd/desktop
      * interaction/​non-interaction/​embodied interaction      * interaction/​non-interaction/​embodied interaction
      * noun/verb      * noun/verb
  
- +  ​* Three-way ​repeated measure ​ANOVA on IMPROVEMENT between tests, main effect of each variable and interaction between them (for one week later):
-  ​* Three-way ANOVA on IMPROVEMENT between tests, main effect of each variable and interaction between them (for one week later):+
      * hmd/desktop      * hmd/desktop
      * interaction/​non-interaction/​embodied interaction      * interaction/​non-interaction/​embodied interaction
      * noun/verb      * noun/verb
- 
-WARNING: You should have independence of observations,​ which means that there is no relationship between the observations in each group or between the groups themselves. For example, there must be different participants in each group with no participant being in more than one group. 
  
 === Presence influences? ===  === Presence influences? === 
  
-  * Two-way ANOVA on PRESENCE+  * Two-way ​repeated measure ​ANOVA on PRESENCE
     * hmd/desktop     * hmd/desktop
     * (maybe interaction/​non-interaction/​embodied interaction)     * (maybe interaction/​non-interaction/​embodied interaction)
Line 231: Line 242:
 === Motivation influences? ===  === Motivation influences? === 
  
-  * Two-way ANOVA on MOTIVATION+  * Two-way ​repeated measure ​ANOVA on MOTIVATION
     * hmd/desktop     * hmd/desktop
     * (maybe interaction/​non-interaction/​embodied interaction)     * (maybe interaction/​non-interaction/​embodied interaction)
Line 237: Line 248:
 === Enjoyment influences? ===  === Enjoyment influences? === 
  
-  * Two-way ANOVA on ENJOYMENT+  * Two-way ​repeated measure ​ANOVA on ENJOYMENT
     * hmd/desktop     * hmd/desktop
     * (maybe interaction/​non-interaction/​embodied interaction)     * (maybe interaction/​non-interaction/​embodied interaction)
 +
 +=== Interaction method on noun/verb influences? === 
 +
 +  * One-way repeated measure ANOVA on interaction/​non-interaction/​embodied interaction
 +    * noun/verb outcome
  
 === Word Confidence influences? ===  === Word Confidence influences? === 
  
-  * Three-way ANOVA on WORD CONFIDENCE+  * Three-way ​repeated measure ​ANOVA on WORD CONFIDENCE
     * hmd/desktop     * hmd/desktop
     * (maybe interaction/​non-interaction/​embodied interaction)     * (maybe interaction/​non-interaction/​embodied interaction)
Line 250: Line 266:
 === Interaction reptition influences? ===  === Interaction reptition influences? === 
  
-  * Three-way ANOVA on INTERACTION REPITITION+  * Three-way ​repeated measure ​ANOVA on INTERACTION REPITITION
     * hmd/desktop     * hmd/desktop
     * (maybe interaction/​non-interaction/​embodied interaction)     * (maybe interaction/​non-interaction/​embodied interaction)
     * noun/verb     * noun/verb
  
 +=== Learning preference === 
 +
 +  * Two-way repeated measure ANOVE on learning outcome
 +    * interaction/​non-interaction/​embodied interaction
 +    * VARK learning preferene
 ==== Resources ====  ==== Resources ====