Abstract
This study examines the usability and impact of MemoMate, an AI-driven storytelling assistant, on the memory and well-being of residents at Wingate Living. Another objective was to identify product-market fit. The findings indicate that residents interacting with MemoMate reported an improvement in well-being and memory recall. Furthermore, several adjustments to the user experience have to be made. This valuable feedback will guide the development and launch of the beta version of MemoMate.
Project Description
MemoMate’s AI companion engages seniors in conversations, translating these interactions into captivating life stories, biographies, and more. Simultaneously, it evaluates the senior’s mental health, offering personalized wellness recommendations to caregivers. The five-week qualitative research study aimed to evaluate the impact of MemoMate on seniors’ cognition, well-being, and to refine its UI and UX. The study was conducted at two different senior living communities, in Wingate Needham and in Wingate Providence to get a diverse participant sample.
Implementation Approach
The implementation approach of MemoMate included several stages.
Planning and Preparation
Wingate staff and MemoMate representatives collaborated to define the goals, objectives, and requirements for the project. This included identifying communities with high tech-savyness amongst the residents.
Observation
The study began with a week-long immersion in the daily life of the senior living community in Needham. This initial period was essential for establishing trust amongst the residents and staff and to gain insight into the community’s dynamics. The same was done at Wingate in Providence.
Rollout
After observation period, the MemoMate team organized a lecture on AI for the residents. The goal of this lecture was to inform them about AI, reduce their hesitation and to tell how AI can be used in different use cases such as documenting their life story. The presentation was successful, attracting 20 volunteers in Needham, although only 9 could participate (78% male and 22% female) due to several factors. In Providence, the approach also proved effective, with 10 residents volunteering and 5 (40% male and 60% female) ultimately participating in the study. The average age of the participants was 87 years old.
Methodology
The research had two objectives
- Well-being: The WHO-5 index was used to measure the participants’ well-being prior and after using MemoMate. Participants also self-rated their loneliness and memory, and assessed MemoMate’s impact on their memory.
- Usability Testing: Minimal three 60-minute individual sessions were conducted with residents to evaluate MemoMate’s user-friendliness.
Feedback was gathered through open-ended questions to understand their experience.
Participants were selected to represent a diverse backgrounds, cognitive abilities, and techsavviness. This blend of qualitative and quantitative research methods provided a comprehensive evaluation of MemoMate’s impact on the residents’ cognitive and emotional well-being and the userfriendliness of the program.
Evaluation and Refinement: Wingate Living regularly evaluated the effectiveness of MemoMate and identified areas for improvement. Feedback from both staff and residents led to significant UI/UX enhancements, such as simplifying navigation and improving touchscreen responsiveness, making MemoMate more intuitive for our elderly users.
Outcomes
- Well-being: The average wellbeing score improved by 11% (from 69 to 76, surpassing the baseline wellbeing score of the control group of 75).
- Memory: 80% of the participants found MemoMate helpful in jogging their memory, and the average rating among those who found it helpful is 8 out of 10.
- NPS: +60, weighted average of 8.7 / 10.
- Experience: Participants gave their experience a score of 9 out of 10.
- Loneliness: Loneliness reduced by 50% (from 4/10 to 2/10) after using MemoMate for two weeks.
- Conversational topics: MemoMate has proven its ability to effectively identify and track topics that enhanced user enthusiasm and wellbeing.
The results can be used as a primary basis for a clinical control trial to be conducted in the near future, which could provide deeper insights into MemoMate’s multifaceted impact, guiding its evolution to better serve the needs of the elderly population and making it a more comprehensive and beneficial tool in senior care.
Implications for MemoMate’s Design and Use: Improving MemoMate for older adults involves simplifying navigation, enhancing touchscreen compatibility, and educating users about AI and how to interact with AI. These changes aim to make the app more accessible and user-friendly.
Limitations: There was a COVID-19 outbreak in the middle of the study. This reduced the sample size and affected data consistency. The presence of caregivers or staff during sessions could have influenced how participants interacted with the software, potentially skewing the accuracy of assessing their independent usability skills.
Future Research: Future research should focus on expanding its study to a larger sample, long-term effects, and a broader elderly demographic to ensure more representative findings.
Learnings and Pitfalls to Avoid.
Communication is key
Effective communication with staff members and residents is essential, setting clear objectives and making sure everyone is aware of the benefits and how it will improve their daily routines.
Involve residents in the process
Involve residents in the change management process to ensure that the platform is meeting their needs and expectations. Solicit feedback and make adjustments as necessary.
Office hours
Residents have an intrinsic motivation to share their life story. Some of them know how to do this independently. For those who don’t know, create office hours as part of the activity program.
Admissions
Use MemoMate as a tool to streamline the social history section of the admissions process and as a way to get to know the new resident.
Data
Analyze the data derived from the stories that seniors share and use it to personalize care plans.
Evaluate the success of the platform
Continuously evaluate the success of the platform by tracking metrics such as adoption rates, resident satisfaction, and staff efficiencies. Use this data to make improvements to the platform and ensure it is meeting the needs of the community.
Learn more
For further information about this paper or to explore how AI-powered technology can help your customers, please reach out to the MemoMate team.