Bridging the Age Gap: Using MR and 3D Printing to Revolutionize IoT Design for the Elderly

Multimodal Coexistence Environment Design to Assist User Testing and Iterative Design of HiGame Emotional Interaction Design for Elderly

2020-01-01
Ji-Rong Rachel Lu, Teng-Wen Chang, Yi-Sin Wu, Chun-Yen Chen
Summary
Problem
Method
Results
Takeaways
Abstract

This paper introduces a Multimodal Coexistence Environment designed to facilitate usability testing and iterative design for the "HiGame" emotional interaction system for the elderly. By combining Mixed Reality (MR) via Microsoft HoloLens with 3D-printed physical prototypes, the authors enable real-time "dynamic feedback" and co-design between elderly users and designers.

TL;DR

Testing complex Internet of Things (IoT) systems often feels like a choice between expensive, rigid physical prototypes or "floaty" virtual ones that lack tactile reality. This paper presents a Multimodal Coexistence Environment for HiGame—an emotional interaction tool for the elderly—that merges HoloLens-based Mixed Reality (MR) with 3D printing. The result? A co-design process where elderly users can "move" virtual furniture and resize objects with hand gestures, providing designers with instant, parametric data for iteration.

The Problem: The High Cost of Iteration

Designing for the elderly presents a unique set of challenges. Traditional Usability Testing relies heavily on:

  • Static Feedback: Surveys and interviews that are often disconnected from the actual moment of interaction.
  • Physical Prototypes: Building interactive watering systems or smart lighting for every design tweak is prohibitively expensive and slow.

For the elderly, describing a feeling about a device is often more difficult than actually showing how it should be adjusted. This communication gap leads to design iterations that are both "complex and time-consuming."

Methodology: The "Coexistence" Framework

The authors propose a hybrid approach termed a Physical and Virtual Coexistence Environment.

1. The Tangible Core

Because touch is vital for the elderly, the central object—a smart potted plant—is 3D-printed. This provides the "haptic anchor" for the experience.

2. The Virtual Shell

The surrounding IoT ecosystem (watering devices, special lighting, sensors) is rendered through Microsoft HoloLens. Using Rhino and Grasshopper, the designers created a system where these virtual objects aren't just static images; they are programmable entities.

3. Dynamic Feedback Loop

The breakthrough is the "Dynamic Feedback" mechanism. Instead of answering "Is this light too close?", the user simply reaches out, grabs the virtual light, and moves it. The system records the new coordinates and scale parameters directly.

Model Architecture: Virtual and Real Interaction Figure 1: The framework of the MR-assisted iterative design process.

Real-World Application: HiGame 2.0

HiGame is designed to connect elderly people living alone with their distant families through "shared horticulture." Families care for the plant via an app, and the elderly user experiences the care through the plant's growth and IoT environmental changes.

During testing, the elderly subjects used HoloLens to:

  • Adjust Positioning: Change where plant care objects were located in their living space.
  • Scale Objects: Adjust the size and proportion of the interface elements through a virtual menu.

Experimental Setup Figure 2: An elderly subject using HoloLens to interact with the coexistence environment.

Key Results & Insights

  • Reduced Interaction Cost: By bypassing the need for dozens of physical models, the "cost of failure" in the design process dropped significantly.
  • Communication Accuracy: The "generation gap" in communication was bridged. Subjects who struggled with technical jargon could easily express their preferences through spatial manipulation.
  • Immersive Validity: Users reported that the combination of virtual visuals and physical touch (from 3D-printed parts) felt "real," validating the usability metrics gathered.

Iterative 3D Printing Figure 3: 3D printing used to materialize the final iterative design for physical retesting.

Critical Analysis & Conclusion

This work demonstrates that Mixed Reality is no longer just for gaming or industrial maintenance; it is a powerful social research tool. By turning the user from a passive test subject into an active "co-designer," we get products that fit the specific ergonomic and emotional needs of the elderly.

Limitations: The study notes that the HoloLens's field of view (FOV) can be a distraction. Furthermore, the reliance on high-quality Wi-Fi can lead to latency, which might break immersion for sensitive users.

Future Work: The next step involves simulating dynamic effects—like the visual flow of water or the changing colors of LED growth lights—entirely within the virtual layer to further reduce prototyping overhead.


Takeaway for Designers: Stop asking what they want; give them a virtual world and let them build it themselves.

Find Similar Papers

Try Our Examples

  • Find recent research papers that utilize Tangible Augmented Reality (TAR) specifically for accessibility testing with elderly populations.
  • Which paper first introduced the concept of "Dynamic Feedback" in Mixed Reality prototyping, and how does it compare to the methodology used in HiGame?
  • Explore how generative AI could be integrated with Grasshopper and MR to automate the iterative design adjustments based on the user feedback recorded in this study.
Contents
Bridging the Age Gap: Using MR and 3D Printing to Revolutionize IoT Design for the Elderly
1. TL;DR
2. The Problem: The High Cost of Iteration
3. Methodology: The "Coexistence" Framework
3.1. 1. The Tangible Core
3.2. 2. The Virtual Shell
3.3. 3. Dynamic Feedback Loop
4. Real-World Application: HiGame 2.0
5. Key Results & Insights
6. Critical Analysis & Conclusion