Research Questions

The main goal of this project is to research how much VR technology can influence humans behaviour. To reach this goal we two sets of research questions for the experiment of the project, and each research question companioned with several hypotheses. And the two sets of research questions and hypotheses are under below:
Research Question 01: What kind of interaction fidelity is necessary in an IVR so that behaviour change will take place in users?
▸ Hypothesis H1: A virtual coral reef in which users can interact (an increased amount) would lead to a better self- confidence/hopefulness attitude.
▸ Hypothesis H2: Increased interaction possibilities lead to less hopelessness.
▸ Hypothesis H3: H1, H2 are associated with positive intention change behaviour in the real world.
▸ Hypothesis H4: Increased interaction possibilities can lead to increased engagement.
▸ Hypothesis H5: H4 (within an IVR) is associated with a positive intention to change behaviour.
▸ Hypothesis H6: Recorded observed Higher Emotional engagement within the IVR leads to higher self-reported behaviour change (or may conflict self-reporting vs observed).
▸ Hypothesis H7: A created experience with emotional interaction between users and the environment in VR will constitute the intention of behaviour changing in reality.
Research Question RQ2: Do interactions in an IVR elicit behaviour change more effectively when set in a loss framing or in a gain framing?
▸ Hypothesis H8: A higher fidelity interaction will elicit a more positive attitude towards the condition of the environment depicted.
▸ Hypothesis H9: A more realistic, well-known gesture will elicit more long-lasting behaviour change intentions.
▸ Hypothesis H10: A more realistic, well known in the context, the gesture will elicit more long-lasting behaviour change intentions, than fantasy movements with roughly the same effort.

2x2 Factorial study with high and low interaction fidelity within a loss and gain framing in an IVR.

Gain Framing Low Fidelity Gain Framing High Fidelity
Loss Framing Low Fidelity Loss Framing High Fidelity

Implementation

Technology

>
To implement all the conditions immersive virtual reality projects, the virtual coral reef experiment was utilized to be the basic scene. Meanwhile, the IVR has then been extended with a new pawn and additional code to facilitate low and high interaction fidelity as well as the depiction of global loss and gain framing by changing visuals, like water quality. New animals and different types of trash have been added and distributed, to depict the IVR in a very polluted state.

Technology

>
Users can grab (High fidelity) or shoot(Low fidelity) by pulling the trigger. Every trash object in the IVR, thereby affecting the reef. Users can travel around the reef with an aqua scooter, which can be grabbed and steered by pointing the controller in the preferred direction. In the high fidelity condition, a net to collect and store trash is available. Users can collect trash by grabbing and putting a trash object into the net or by sweeping the net across trash items. If the scooter or the net happens to get lost, the user can re-spawn both by pressing the trackpad.

Gain Framing And Loss Framing

IVR in starting condition
Nature

                     ↙        ↘
IVR in loss condition;          IVR in gain condition









For the experiment design, global tick checks every 3 seconds whether the user is collecting trash or not. In the Gain Framing condition, a successful check improves the reef visuals exponentially (watercolour, fog density), otherwise, they remain constant. In the Loss Framing condition, a successful check stops the deterioration of the reef visuals, otherwise, they deteriorate exponentially on each tick.

Execution


Pre-
Questionnaire
===>>
IVR experience
according to
condition group
===>>
Post-Questionnaire directly after and a few weeks after

Questionnaire Design

Both the pre- and post-questionnaires are designed to collect data on various topics like emotional state, feeling of presence, ecological behaviour and general awareness during the VR-experience, utilising standardised questionnaires and specifically constructed ones.

Pre-Questionnaire (27 Questions total)Survey Link

▸ 11 on the current general state (motion sickness)
▸ 8 on consumer behaviour
▸ 8 on associations w.r.t coral reefs

Post-Questionnaire (96 Questions total and personal data) Survey Link

▸ 12 on presence in an IVR
▸ 13 on immersion / interaction fidelity
▸ 14 on the current general state
▸ 11 on the current emotional state
▸ 16 on awareness of the IVR depicted
▸ 4 on packaging and similarities between jellyfish and plastic bags
▸ 8 on future consumer behaviour
▸ 6 on future ecological behaviour
▸ 12 on games and hardware familiarity

Literature

  1. Riva et al., "Affective interactions using virtual reality: The link between presence and emotions" () CyberPsychology and Behavior p.45-56
  2. Rothman, Alexander J and Bartels, Roger D and Wlaschin, Jhon and Salovey, Peter, "The strategic use of gain-and loss-framed messages to promote healthy behavior: How theory can inform practice" () Oxford University Press S202-S220
  3. Amel, Elise L and Manning, Christie M and Scott, Britain A, "Mindfulness and sustainable behavior: Pondering attention and awareness as means for increasing green behavior" () Oxford University Press p14-25
  4. Bailenson, Jeremy N and Yee, Nick, "Digital chameleons: Automatic assimilation of nonverbal gestures in immersive virtual environments" () SAGE Publications Sage CA: Los Angeles, CA p814-819
  5. Bosone, Lucia and Martinez, Frederic, "When, How and Why is Loss-Framing More Effective than Gain-and Non-Gain-Framing in the Promotion of Detection Behaviors?" () Ubiquity Press
  6. Batson, C Daniel and Duncan, Bruce D and Ackerman, Paula and Buckley, Terese and Birch, Kimberly, "Is empathic emotion a source of altruistic motivation?" publisher={American Psychological Association} () American Psychological Association p290
  7. Buxton, Bill and Fitzmaurice, George W, "HMDs, caves & chameleon: a human-centric analysis of interaction in virtual space" () ACM SIGGRAPH Computer Graphics p69-74
  8. Carey, Kate and Saltz, Emily and Rosenbloom, Jacob and Micheli, Mark and Choi, Judeth Oden and Hammer, Jessica, "Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play" () ACM p551-559
  9. Castellano, Ginevra and Kessous, Loic and Caridakis, George, "Emotion recognition through multiple modalities: face, body gesture, speech" () Springer p92-103
  10. Cheng, Tania and Woon, Danielle Kathryn and Lynes, Jennifer K, "The use of message framing in the promotion of environmentally sustainable behaviors" () SAGE Publications Sage CA: Los Angeles, CA p48-62
  11. Dillahunt, Tawanna and Becker, Geof and Mankoff, Jennifer and Kraut, Robert, "Pervasive 2008 Workshop Proceedings: TMotivating environmentally sustainable behavior changes with a virtual polar bear" ()p58-62
  12. Felnhofer, Anna and Kothgassner, Oswald D and Schmidt, Mareike and Heinzle, Anna-Katharina and Beutl, Leon and Hlavacs, Helmut and Kryspin-Exner, Ilse, "Is virtual reality emotionally arousing? Investigating five emotion inducing virtual park scenarios" ()Elsevier, p48-56
  13. Fox, Jesse and Arena, Dylan and Bailenson, Jeremy N, "Virtual reality: A survival guide for the social scientist" () Hogrefe Publishing, p95-113
  14. Herrera, Fernanda and Bailenson, Jeremy and Weisz, Erika and Ogle, Elise and Zaki, Jamil, "Building long-term empathy: A large-scale comparison of traditional and virtual reality perspective-taking" () Public Library of Science, e0204494
  15. Gunes, Hatice and Piccardi, Massimo, "Bi-modal emotion recognition from expressive face and body gestures" ()Elsevier, p1334-1345
  16. Bailenson, Jeremy N and Yee, Nick and Merget, Dan and Schroeder, Ralph, "The effect of behavioral realism and form realism of real-time avatar faces on verbal disclosure, nonverbal disclosure, emotion recognition, and copresence in dyadic interaction" ()MIT Press, p359-372
  17. Kaiser, Florian G and Wolfing, Sybille and Fuhrer, Urs, "Environmental attitude and ecological behaviour" () Elsevier, p1-19
  18. Song, Jihye and Fiore, Stephen M, "VR What We Eat: Guidelines for Designing and Assessing Virtual Environments as a Persuasive Technology to Promote Sustainability and Health" ()SAGE Publications Sage CA: Los Angeles, CA, p1519-1523
  19. Ahn, Sun Joo and Le, Amanda Minh Tran and Bailenson, Jeremy, "The effect of embodied experiences on self-other merging, attitude, and helping behavior" ()Taylor & Francis, p7-38
  20. Ahn, Sun Joo and Fox, Jesse and Dale, Katherine R and Avant, J Adam, "Framing virtual experiences: Effects on environmental efficacy and behavior over time" ()SAGE Publications Sage CA: Los Angeles, CA, p839-863
  21. Ahn, Sun Joo and Bostick, Joshua and Ogle, Elise and Nowak, Kristine L and McGillicuddy, Kara T and Bailenson, Jeremy N, "Experiencing nature: Embodying animals in immersive virtual environments increases inclusion of nature in self and involvement with nature" ()Oxford University Press Oxford, UK, p399-419
  22. Tanenbaum, Joshua G and Antle, Alissa N and Robinson, John, "Three perspectives on behavior change for serious games" ()ACM, p3389-3392
  23. Lee, Myungho and Kim, Kangsoo and Daher, Salam and Raij, Andrew and Schubert, Ryan and Bailenson, Jeremy and Welch, Greg, "The wobbly table: Increased social presence via subtle incidental movement of a real-virtual table" ()IEEE, p11-17
  24. Markowitz, David M and Laha, Rob and Perone, Brian P and Pea, Roy D and Bailenson, Jeremy N, "Immersive Virtual Reality Field Trips Facilitate Learning About Climate Change" ()Frontiers Media SA
  25. McMahan, Ryan P and Bowman, Doug A and Zielinski, David J and Brady, Rachael B, "Evaluating display fidelity and interaction fidelity in a virtual reality game" ()IEEE transactions on visualization and computer graphics, p626-633
  26. McMahan, Ryan P and Lai, Chengyuan and Pal, Swaroop K, "Interaction fidelity: the uncanny valley of virtual reality interactions" ()Springer, p59-70
  27. Michie, Susan and Johnston, Marie and Francis, Jill and Hardeman, Wendy and Eccles, Martin, "From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques" ()Wiley Online Library, p660-680
  28. Pan, Xueni and Hamilton, Antonia F de C, "Why and how to use virtual reality to study human social interaction: The challenges of exploring a new research landscape" ()Wiley Online Library, p395-417
  29. Partala, Timo and Jokiniemi, Maria and Surakka, Veikko, "Pupillary responses to emotionally provocative stimuli" ()ACM, p123-129
  30. Rosenberg, Robin S and Baughman, Shawnee L and Bailenson, Jeremy N, "Virtual superheroes: Using superpowers in virtual reality to encourage prosocial behavior" ()Public Library of Science, e55003
  31. Scheufele, Dietram A and Iyengar, Shanto, "The state of framing research: A call for new directions" () p1-26
  32. Schmidt, Susanne and Bruder, Gerd and Steinicke, Frank, "Effects of Embodiment on Generic and Content-Specific Intelligent Virtual Agents as Exhibition Guides"
  33. Shin, Donghee, "Empathy and embodied experience in virtual environment: To what extent can virtual reality stimulate empathy and embodied experience?" ()Elsevier, p64-73
  34. Slater, Mel, "A note on presence terminology" ()Citeseer, p1-5
  35. Slater, Mel, "Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments" ()The Royal Society, p3549-3557
  36. Won, Andrea Stevenson and Perone, Brian and Friend, Michelle and Bailenson, Jeremy N, "Identifying anxiety through tracked head movements in a virtual classroom" ()Mary Ann Liebert, Inc. 140 Huguenot Street, 3rd Floor New Rochelle, NY 10801 USA, p380-387
  37. Van Kerrebroeck, Helena and Brengman, Malaika and Willems, Kim, "Escaping the crowd: An experimental study on the impact of a Virtual Reality experience in a shopping mall" ()Elsevier, p437-450
  38. Zheng, Wei-Long and Dong, Bo-Nan and Lu, Bao-Liang, "Multimodal emotion recognition using EEG and eye tracking data" ()IEEE, p5040-5043
  39. Tarr, B and Slater, M and Cohen, E, "Synchrony and social connection in immersive Virtual Reality" ()Nature Publishing Group, p3693
  40. van Loon, Austin and Bailenson, Jeremy and Zaki, Jamil and Bostick, Joshua and Willer, Robb, "Virtual reality perspective-taking increases cognitive empathy for specific others" ()Public Library of Science, e0202442

© Uni-Bremen Data Privacy