Lenovo unveils a photorealistic AI avatar to help dementia patients

At the Lenovo Tech World event in Seattle, Washington last week, the PC maker has unveiled a photorealistic AI avatar called ‘Liv’ in collaboration with the non-profit organization Innovations in dementia. The AI ​​avatar is designed to serve as a 24/7 conversation partner for people with dementia, providing real-time practical advice, emotional support and a sense of connection.

According to Lenovo, ‘Liv’ can have unscripted, natural conversations by using a large language model (LLM) trained on thousands of real-world experiences from people with dementia. Training data includes input from Innovations in Dementias Dementia diaries and in-depth panel interviews with community Alzheimer’s focus group participants.

The need for innovative dementia support systems has never been more urgent. Currently, more than 55 million people worldwide live with the condition, and this number is expected to rise 139 million in 2050according to the World Health Organization. “With tremendous advances in AI and smarter technologies, now is the time to explore and test creative new ways to use technology like AI thoughtfully and responsibly for the greater good.” Doug Visserhead of security and AI officer at Lenovo, told Observer. “Our hope and goal with AI tools like ‘Liv’ is to help fill that information gap and support people when they need it most.”

Many newly diagnosed patients find it challenging to connect with someone who truly understands their experience. “A doctor can tell you which medicines to take. But only people with dementia can tell you exactly what they are going through,” Ahmad Krayem, a focus group participant who was diagnosed with early-onset dementia in his early 60s, said in a video message played at the event last week.

There is no medical treatment for dementia, and current support comes largely from human interactions, leaving many patients and their caregivers feeling isolated subjectively charged on their journey.

“People with dementia tell us that when they are first diagnosed they experience uncertainty about the future, loss of purpose and meaning, loss of sense of who they are, their place in the world and in the relationships that matter to them are important. Steve Milton, director of Innovations in Dementia, told Observer. “Liv AI provides an expert and compassionate source of assurance and advice, based directly on the experiences and wisdom of other people with dementia.”

The avatar’s appearance was conceptualized using a composite of images of more than ten individuals with dementia or Alzheimer’s disease. An AI model generated thousands of different expressions and angles from each person’s original pose. These varied images were then combined into one data set and blended with an actor’s face to bring “Liv” to life as a realistic AI avatar.

When a user asks a question, “Liv” taps into her database and uses a vocal synthesizer to convert the generated response into speech, and the avatar’s facial expressions adjust based on the emotional tone of the response. Finally, a 4K visual generative AI model brings it all together, making it appear as if “Liv” is speaking naturally. Users can ask questions about daily life, new hobbies or even how to talk to their loved ones about the disease.

“Why not think about the kind of support we can give someone before they need ‘dementia care’? This is what we focused ‘Liv’ on,” Milton said. “As with all AI models, the quality and breadth of the data impacts the quality of the output that users experience. If more data and personal experiences of people and families with advanced dementia are collected, the scope and quality of services can also grow.”

Despite the avatar’s personal approach, there are inherent limitations. Because it is an AI-based tool, responses are generated based on lived experiences rather than deep clinical expertise, which can be a double-edged sword. Although ‘Liv”s facial expressions are powered by sentiment analysis, the question remains how well it can mimic the nuanced emotional responses to empathize with people diagnosed with advanced dementia.

“The device is intended to complement, not replace, human care,” Lenovo’s Fisher said. “AI solutions should only be considered for mass rollout if there is extensive testing and development to further protect and prevent a negative experience for potential users.” Currently, “Liv” is being tested in controlled environments with plans for wider public access on the horizon.

The initiative is part of Lenovo’s Smarter AI for Good and Techquity projects, aimed at shedding light on groups often neglected by Big Tech companies. Earlier this year, Lenovo launched Meet your digital selfa project that used AI to create lifelike 3D avatars modeled after the online personas of two Gen Z individuals. The aim of the project is to raise awareness of crucial Gen Z issues such as loneliness, opening up to family and anxiety, and to guide young people towards professional mental health support.

“Ultimately, it’s about reimagining a future where technology is for – and from – everyone, giving everyone a voice in what they want from the most transformative technology of our generation,” said Fisher.