Virtual Twin for Ambient Assisted Living

 

Have you ever had unpleasant feeling of anxiety regarding your loved ones while being away from home?

How they are? What’s happening? Is there a way to provide quick assistance if something goes wrong?

All these questions take away the peace of mind of rapidly increasing number of people on this planet who, by various reasons, have to live away from parents and grandparents working in different cities, countries and continents.

If you search for practical solutions to monitor health and activities of people living at homes alone like elderly or people with a variety of health problems, it typically would lead to the solutions called Ambient Assisted Living (AAL), Remote patient monitoring, Telemedicine, Telecare, Telehealth, etc.

There is increasing progress in the availability of more advanced wearables and various sensors that collect specific information (pulse, steps, fall, sleep, blood pressure, etc) and transmit it to mobile phone apps or special cloud analytics software to present charts, analytics regarding these measurements and relevant recommendations.

Becoming a common trend, these solutions lead to significant change in approach to AAL by providing real time remote diagnostics based on continuous measurement of data streams that reflect the reality and allow various analytics.

However the experiments and practical applications in many countries revealed several major drawbacks that hinder wide use of these digital technology solutions by large number of potential customers. It includes as follows:

(1) Scale of monitoring: There is a magnitude of diverse heterogeneous real time data that needs to be monitored on the regular basis automatically and intelligently

(2) High costs: Adding up diverse hardware and software that work separately one from another being incompatible quickly brings up total costs of integrated solution for a personal use to its extremes

(3) Complexity: Many of these solutions are too complex but at the same time limited in its capacity to assist users and keep their relatives and caregivers updated in an intelligent and easy way that minimises the overhead of continuous monitoring

(4) Lack of interactivity: The majority of various solutions are lack of personalised intelligent interactivity (voice conversations, video, images, animations) realised by automated AI driven communications with the target user groups that are very important for the people who live alone or have health issues.

 

1. Scale of monitoring: Can we monitor all these all the time?

No! We all are busy with a magnitude of various daily issues and do not have possibility to look into the monitor screen switching between different data and analytic charts all the time!

Caregivers probably can do it to some extend but the scale of monitoring of many people in reliable and timely way adds to the total costs while leaving the possible issues of quality of services depending on the provider and its location (area, country, etc). 

Nowadays, both monitoring of such IoT data streams and its real time analysis shall be the tasks of the Artificial Intelligence (AI), Big Data and Advanced IoT software technology as it can and should

  • Check each piece of data continuously as it becomes available,
  • Analyse data in every necessary detail automatically taking into consideration the profile of concrete individual (age, weight, sex, health, etc),
  • Analyse all sensor data sources and ongoing processes altogether to identify holistic status of a complex real time ecosystem as we have at our homes such as “Health+Activities+Environment+Safety”,
  • Calculate all necessary indicators that include various bio-medical, physiological, psychological, activity, environmental and other optional indicators 24/7/365
  • Come up to us with the single simple human type conclusion about the ongoing or predicted status of the complex system "MyBeloved Person @ Home" to inform us:

Mom is fine! (time, day)

                    or

Granddad has a problem! Based on <X,Y,Z> indicators, the trend may lead to "this and that" consequences! (Here are the links for details, explanations and optional action recommendations …)

And much more: In case the critical status is calculated, such system shall automatically contact the relevant predefined parties e.g. neighbors, relatives, caregivers and healthcare, to act immediately as there is no time to wait … It shall be able to get through to the predefined emergency contacts without fail and confirm the corrective actions undertaken.

2 & 3. Total costs of the solution and the complexity of its use

There are many pieces of existing hardware and software that need to be brought at home for AAL or remote health and well being monitoring. Most of it works now independently and rarely meet the interoperability requirements. Each device usually has separate, often proprietary, connectivity, controls and mobile apps that quickly brings up total costs and significantly complicate its use and maintenance especially by people in age. There is the utmost need to have it working together, minimise total costs of solution and making its use easy and simple as possble for a human in age or with health issues.

4. Personalised interactivity is natural for human beings. It is supported by voice conversation, exchange of comments and opinions and news, video messages and content, images, animations and is very important for the comfort and well being of the target user groups who live alone and/or have health issues. Its rich and high quality content can effectively help to cope with various negative effects of loneliness (physical and mental health, depression, suicide, cardiovascular disease and strokes, increased stress levels, etc).

 

AI-driven Personal Virtual Twin

Our company develops novel AI-, Big Data-, IoT and Blockchain driven monitoring platform PharosN that allows making advanced virtual twin models of real world objects and linking such twins to the physical world processes by various sensors, IoT, mobiles and automated systems.

Based on these unique functionalities of PharosN IoT platform, we developed the first prototype of the principally new solution “Personal eHealth Assistant” (PeHA) and were impressed with the first results:

PeHA is really capable to address these complex problems at the completely new holistic intelligent level providing the comprehensive integrated solution to address the needs of AAL and virtual care.

The main concepts and components of the prototype illustrated below are as follows:

  • Making the open anonymous Virtual Twin Model that integrates and presents all home living processes as Big System: { Personal health + Activities at Home + Home Environment + Safety }. “Open” means that the twin can be gradually further advanced by adding bio-medical indicators, more sophisticated health and behavioral models, home plan and design details, increase of various smart sensors for doors, refrigerator, room movements, add optional medical diagnostic devices locally installed, interactions with various devices including mobiles, security and safety features, etc,
  • Connecting the virtual twin model to all data sources available at home,
  • Running the integrated virtual twin model for Ambient Assisted Living in cloud (or locally at home at small box with Raspberry PI4) to analyze the data streams in real time and calculate the holistic status of the whole personal home living system,
  • Enable the virtual twin communicating intelligent focused updates to the predefined groups of recipients (the person as main user, his/her relatives, caregivers, healthcare, etc) regarding the status of a person and home living conditions and its trends as predictions bases on history and anomalies,
  • Providing all stakeholders with the recommendations as prescription analytics regarding necessary or optional corrective actions and generic activities facilitating well being,
  • Fostering interactions and social inclusion by target users with the other stakeholders including friends and relatives
  • Applying latest wireless technology such as Bluetooth Mesh, Beacons, Wi-Fi 6
  • Link reliable approved sensors that have standard Bluetooth Mesh connectivity and open application programming interfaces (API) for the virtual twin to receive the measurement data in real time,
  • Using only open source software and relevant major stable standards, 
  • Builing on commercially available inexpensive yet quality off-the-shelf electronic components (COTS) 
  • Making the whole service package affordable and cost-effective and open for upgrades and feature improvements.

 The implementation status

The PeHA prototype is planned to be release by the end of 2019. The initial minimum viable product will include as follows:

  1. Hand wearable having the basic set of sensors    
  2. Basic set of home environmental and activity sensors 
  3. Home Bluetooth mesh connectivity proxy and Internet gateway
  4. Open virtual twin linked to the sensors and running in real time as the AI & Big data engine transforming the sensor data streams into personal status services, its predictions and prescription analytics
  5. Mobile apps (phone and tablet) for accessing the data and analytic services and let interactions between the twin and person, relatives, caregivers
  6. Tools to link additional sensors and other devices to the twin model expanding the scope and sophistication of the monitoring services.

The PeHA solution will provide valuable medical advisory and home safety alerts, help in detection of fall and other home related living issues making us assured that our elderly or physically limited loved ones are doing well, even when we are not around. And they, as actual users, can feel more independent and less of a burden on other people, experiencing more convenience and comfort.

The prototype will be brought for a major crowdfunding platform after its testing.

Does it sound interesting for you?

If yes, let us know to invite you as early adopter to try and experiment and advise us as co-creator, and benefit from the enhanced functionalities of the AAL solution that are tuned to your needs. 

And we will inform you when the crowdfunding campaign begins. While leaving a message please write in the message subject "PEHA" to distinguish your message among many others we receive.

Peace of Mind is priceless.

Serguei Golovanov

Founder and CEO

 

ILLUSTRATIONS

1. Generic AAL ecosystem supported by PeHA

Personal eHealth Assistant for remote patient monitoring by virtual twin

2. Physical system diagram the PeHA ecosystem  

Component structure of the PeHA solution for smart home user