Memory Mat

Cross-Media Product | Sensory Experience| Generative AI

Solo Project | 2022-2023

Research: Literature Review, Survey, Field Studies, User Interview, Five-second Testing, Competitive Analysis

Tools: Arduino, Processing, Photoshop, MyHeritage, Premiere Pro, Textile Design

Memory Mat is a sensory-based cognitive construction product for Dementia families. Memory Mat promotes a novel way of relationship between patients and caregivers, diagnosed elderly and kindred younger generation. Designed with the perspective of viewing Dementia patients as naive kids, it evokes empathy to the patient's situation and strengthens emotional connections.

The rationale of the Memory Mat is a combination of multiple therapies, featuring Reminiscence Therapy and Montessori Education Method. Through the sensory interaction with a material collage adapted from the real old photo, the patient would re-construct their memory with family members, improving both the individual well-being and family connections.

PRELUDE

Family Inspiration

This project was born from a personal source of inspiration within my family. My grandpa, once the embodiment of strength, wisdom, and vitality, was diagnosed with cerebral ischemia and Alzheimer’s disease after contracting COVID-19 at the age of 80. His memory dwindled, and simple tasks became monumental feats. If it wasn’t my little cousin accidentally picked up the old photo album, he would even forget that his best friend, Mr. Yuan, already passed away years ago.

Social Observation

I was also deeply influenced by the massive group of seniors suffering from Dementia, especially those after having COVID-19, developing more severe brain complications called FADE-IN MEMORY. (National Institutes of Health, 2023) The documentary “Life Matters” (人间世) offers a poignant look into the lives of Dementia patients in a Shanghai hospital, where caregivers would use childish games to assess patients’ well-being. One patient called Cai Buzhou, despite severe memory loss, would sing along to a music video featuring Chinese soldiers in the North Korean war each time the video was played. The cinematic snippet served as a vivid reminder of his days as a soldier.

RESEARCH

What are the problems faced by patients and people related?

What are some current therapies?

Why do expert caregivers in the documentary treat patients as kids?

Affinity Mapping

Current Problems

Dementia Therapies

Patients face countless denial and blame for being dependent like babies at a senior’s age.
Patient’s family members think they don’t have a choice but to be the caregiver.
Patient’s children fear future diagnosis due to hereditary. (Mackeen, 2022)
Worsened relationship between patients and their family members.
Patients need other stimulation/entertainment than thinking process to gain satisfaction.

Reminiscence Therapy
Simulated Presence Therapy
Reality Orientation Therapy
Pet Therapy
Sensory Stimulation Therapy

Patients with dementia often undergo a cognitive regression similar to a child's development. This perspective encourages caregivers to provide the patience and understanding we naturally offer to children. Additionally, using child-comforting methods relying on physical senses can bring satisfaction to dementia patients.
This insight inspired me to explore the Montessori education method, which emphasizes guiding children to engage with their surrounding environment and materials to encourage self-construction.

Child Cognition Building

Ambition

TARGET USER STUDIES

Field Studies

Present user with old photo albums and observe without intervention.

Interviews

Ask open-ended questions about old photos, memories, and feelings.

Five-second Testing

Describing prompt product flows in storytelling, collect immediate reactions.

Recall forgotten events
Hard to find himself in group photos
Frequent touching and pointing gestures
Environment and detailed object reliance
Passionate introduction to others

I don’t remember everything, but I know it was a good time.

I think I can recall some of my old friends. We must have been close.

😊

😢

🤔

Love the idea of having something to hold in hand.

Deeply touched to see an old friend come to life again in any form.

Wonder how to use this “high-tech“ product.

Need guidance to recognize his relatives
Interested in resemblance between relatives
Kept the same viewing pace with grandpa
Took a mirror to compare himself and his father

Grandpa and daddy all looked so different back then. It’s very fun.

I wish I can have a big photo album too.

🤔

😁

Wonder what materials would be used.

Excited to see people in a photo moving.

CONCEPT SKETCHING

Material-Photo Collage Cushion

Print the photo on a canvas, and sew/tape four kinds of materials to the according sensory section of the photo.
Attached: Corduroy, Nylon, Chinese Lantern Sampling, Tree Leaves
Base: Photo-printed canvas

Force Sensitive Resistors

Using combination of round-shape and square-shape Force Sensitive Resistor (FSR) under the photo-printed canvas, each attached to according sensory section.
by adafruit

Arduino Uno & Breadboard

Utilizing the Serial Communication between Arduino and Processing to achieve the cross-media response.