Wireless movement-tracking system could collect health and behavioral data
Radio-frequency signals can be used to track peoples' movements in their own homes.
We live in a world of wireless signals flowing around us and bouncing off our bodies. MIT researchers are now leveraging those signal reflections to provide scientists and caregivers with valuable insights into people's behavior and health.
The system, called Marko, transmits a low-power radio-frequency (RF) signal into an environment. The signal will return to the system with certain changes if it has bounced off a moving human. Novel algorithms then analyze those changed reflections and associate them with specific individuals.
The system then traces each individual's movement around a digital floor plan. Matching these movement patterns with other data can provide insights about how people interact with each other and the environment.
In a paper being presented at the Conference on Human Factors in Computing Systems this week, the researchers describe the system and its real-world use in six locations: two assisted living facilities, three apartments inhabited by couples, and one townhouse with four residents. The case studies demonstrated the system's ability to distinguish individuals based solely on wireless signals — and revealed some useful behavioral patterns.
In one assisted living facility, with permission from the patient's family and caregivers, the researchers monitored a patient with dementia who would often become agitated for unknown reasons. Over a month, they measured the patient's increased pacing between areas of their unit — a known sign of agitation. By matching increased pacing with the visitor log, they determined the patient was agitated more during the days following family visits. This shows Marko can provide a new, passive way to track functional health profiles of patients at home, the researchers say.
"These are interesting bits we discovered through data," says first author Chen-Yu Hsu, a PhD student in the Computer Science and Artificial Intelligence Laboratory (CSAIL). "We live in a sea of wireless signals, and the way we move and walk around changes these reflections. We developed the system that listens to those reflections … to better understand people's behavior and health."
The research is led by Dina Katabi, the Andrew and Erna Viterbi Professor of Electrical Engineering and Computer Science and director of the MIT Center for Wireless Networks and Mobile Computing (Wireless@MIT). Joining Katabi and Hsu on the paper are CSAIL graduate students Mingmin Zhao and Guang-He Lee and alumnus Rumen Hristov SM '16.
Predicting "tracklets" and identities
When deployed in a home, Marko shoots out an RF signal. When the signal rebounds, it creates a type of heat map cut into vertical and horizontal "frames," which indicates where people are in a three-dimensional space. People appear as bright blobs on the map. Vertical frames capture the person's height and build, while horizontal frames determine their general location. As individuals walk, the system analyzes the RF frames — about 30 per second — to generate short trajectories, called tracklets.
A convolutional neural network — a machine-learning model commonly used for image processing — uses those tracklets to separate reflections by certain individuals. For each individual it senses, the system creates two "filtering masks," which are small circles around the individual. These masks basically filter out all signals outside the circle, which locks in the individual's trajectory and height as they move. Combining all this information — height, build, and movement — the network associates specific RF reflections with specific individuals.
But to tag identities to those anonymous blobs, the system must first be "trained." For a few days, individuals wear low-powered accelerometer sensors, which can be used to label the reflected radio signals with their respective identities. When deployed in training, Marko first generates users' tracklets, as it does in practice. Then, an algorithm correlates certain acceleration features with motion features. When users walk, for instance, the acceleration oscillates with steps, but becomes a flat line when they stop. The algorithm finds the best match between the acceleration data and tracklet, and labels that tracklet with the user's identity. In doing so, Marko learns which reflected signals correlate to specific identities.
The sensors never have to be charged, and, after training, the individuals don't need to wear them again. In home deployments, Marko was able to tag the identities of individuals in new homes with between 85 and 95 percent accuracy.
Striking a good (data-collection) balance
The researchers hope health care facilities will use Marko to passively monitor, say, how patients interact with family and caregivers, and whether patients receive medications on time. In an assisted living facility, for instance, the researchers noted specific times a nurse would walk to a medicine cabinet in a patient's room and then to the patient's bed. That indicated that the nurse had, at those specific times, administered the patient's medication.
The system may also replace questionnaires and diaries currently used by psychologists or behavioral scientists to capture data on their study subjects' family dynamics, daily schedules, or sleeping patterns, among other behaviors. Those traditional recording methods can be inaccurate, contain bias, and aren't well-suited for long-term studies, where people may have to recall what they did days or weeks ago. Some researchers have started equipping people with wearable sensors to monitor movement and biometrics. But elderly patients, especially, often forget to wear or charge them. "The motivation here is to design better tools for researchers," Hsu says.
Why not just install cameras? For starters, this would require someone watching and manually recording all necessary information. Marko, on the other hand, automatically tags behavioral patterns — such as motion, sleep, and interaction — to specific areas, days, and times.
Also, video is just more invasive, Hsu adds: "Most people aren't that comfortable with being filmed all the time, especially in their own home. Using radio signals to do all this work strikes a good balance between getting some level of helpful information, but not making people feel uncomfortable."
Katabi and her students also plan to combine Marko with their prior work on inferring breathing and heart rate from the surrounding radio signals. Marko will then be used to associate those biometrics with the corresponding individuals. It could also track people's walking speeds, which is a good indicator of functional health in elderly patients.
"The potential here is immense," says Cecilia Mascolo, a professor of mobile systems in the Department of Computer Science and Technology at Cambridge University. "With respect to imaging through cameras, it offers a less data-rich and more targeted model of collecting information, which is very welcome from the user privacy perspective. The data collected, however, is still very rich, and the paper evaluation shows accuracy which can enable a number of very useful applications, for example in elderly care, medical adherence monitoring, or even hospital care."
"Yet, as a community, we need to aware of the privacy risks that this type of technology bring," Mascolo adds. Certain computation techniques, she says, should be considered to ensure the data remains private.
- Privacy is a human right, we need a GDPR for the world - Microsoft ... ›
- Is your genetic privacy already gone? - Big Think ›
- What do your kitchen appliances know about your health? - Big Think ›
Join Radiolab's Latif Nasser at 1pm ET on Monday as he chats with Malcolm Gladwell live on Big Think.
University of Utah research finds that men are especially well suited for fisticuffs.
- With males having more upper-body mass than women, a study looks to find the reason.
- The study is based on the assumption that men have been fighters for so long that evolution has selected those best-equipped for the task.
- If men fought other men, winners would have survived and reproduced, losers not so much.
Built for mayhem<img type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yMjY2NDIyMy9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTYxMzk4NTQ2OX0.my6nML12F3fEQu3H4G0BScdqgaMZkRQHxgyj-Cmjmzk/img.jpg?width=980" id="906fc" class="rm-shortcode" data-rm-shortcode-id="dd77af7a881631355ed8972437846394" data-rm-shortcode-name="rebelmouse-image" />
Image source: Ollyy/Shutterstock<p>The researchers are, of course, talking averages here, not stating a rule: There are plenty of accomplished female pugilists, as well as lots of males who have no idea how to throw a punch.</p><p>Even so, says co-author <a href="https://www.wofford.edu/academics/majors-and-programs/biology/faculty-and-staff" target="_blank">Jeremy Morris</a> says, "The general approach to understanding why sexual dimorphism evolves is to measure the actual differences in the muscles or the skeletons of males and females of a given species, and then look at the behaviors that might be driving those differences."</p><p>Carrier has been interested in the idea that millennia of male fighting has shaped certain structures in male bodies. Previous research has reinforced his hunch:</p> <ul> <li><a href="https://jeb.biologists.org/content/216/2/236" target="_blank">When a hand is formed into a fist, its structure is self-protective</a>.</li> <li><a href="https://unews.utah.edu/flat-footed-fighters/" target="_blank">Heels planted firmly on the ground augment upper-body power</a>.</li> <li><a href="https://www.ncbi.nlm.nih.gov/pubmed/24909544" target="_blank">A study examined facial bone structure as being especially well-suited for taking a punch</a>.</li> </ul> <p>(That last one is our favorite. Do you know the German word "<a href="https://www.urbandictionary.com/define.php?term=Backpfeifengesicht" target="_blank">backpfeifengesicht</a>?" It's an adjective describing "a face that badly needs a punching.")</p><p>"One of the predictions that comes out of those," asserts Carrier, "is if we are specialized for punching, you might expect males to be particularly strong in the muscles that are associated with throwing a punch."</p>
Testing the theory<img type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yMjY2NDIzMy9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTYwNzMxMTE2MH0.UXJICMy57UPYUWskhK98alctOrPidJL9yxMkz3HDQrM/img.jpg?width=980" id="98718" class="rm-shortcode" data-rm-shortcode-id="b12287684ac3e740b70392e6433a6b8f" data-rm-shortcode-name="rebelmouse-image" />
Image source: Ollyy/Shutterstock<p>The researchers measured the punching — and spear-throwing — force of 20 men and 19 women. The assumption was that early humans were punchers <em>and</em> spear-throwers.</p><p>Prior to testing, each participant had filled out an activity questionnaire so that "we weren't getting couch potatoes, we were getting people that were very fit and active," says Morris.</p><p>For punching, participants operated a hand crank that required movement similar to throwing a haymaker. The purpose of the hand crank was to spare participants any damage that might be inflicted on their fists by throwing actual punches. Subjects were also measured pulling a line forward over their heads to assess their strength at throwing a spear.</p><p>Even though all of the participants, male and female, were routinely fit, the average power of males was assessed as being 162% greater than females. There were no gender differences in throwing strength recorded. Other untested, though presumably likely, hand-to-hand combat activities come to mind including tackling, clubbing, running, kicking, scratching, and biting.</p><p>Carrier's takeaway: "This is a dramatic example of sexual dimorphism that's consistent with males becoming more specialized for fighting, and males fighting in a particular way, which is throwing punches."</p>
Boys will be boys<p>It, er, strikes us as odd that, even in science fiction — hi-tech weaponry notwithstanding — the hero <em>is</em> going to wind up duking it out with some bad guy, or alien, in the climactic battle. What is it about men punching, anyway? Are they more sexually attractive? The study suggests so:</p><p style="margin-left: 20px;"><em>The results of this study add to a set of recently identified characters indicating that sexual selection on male aggressive performance has played a role in the evolution of the human musculoskeletal system and the evolution of sexual dimorphism in hominins.</em></p><p>It's tough to contribute to the gene pool after being killed in battle.</p><p>Also, while the authors aren't <em>quite</em> saying that males' historical fighting role is mandated by biology and not by social expectations, neither are they quite <em>not</em> saying it.</p><p>As Carrier explain to <a href="https://attheu.utah.edu/facultystaff/carrier-punch/" target="_blank">theU</a>: "Human nature is also characterized by avoiding violence and finding ways to be cooperative and work together, to have empathy, to care for each other, right? There are two sides to who we are as a species. If our goal is to minimize all forms of violence in the future, then understanding our tendencies and what our nature really is, is going to help."</p>
Innovators don't ignore risk; they are just better able to analyze it in uncertain situations.
The Labour Economics study suggests two potential reasons for the increase: corruption and increased capacity.
Cool hand rebuke<img type="lazy-image" data-runner-src="https://assets.rebelmouse.io/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yNDQyMTIyNy9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTY0NjY1NTYyOH0.0MCPKN3If94mYCNf3mMNrnTvJXjXN_bKLhgk9203EXk/img.jpg?width=917&coordinates=0%2C0%2C0%2C0&height=453" id="1627b" class="rm-shortcode" data-rm-shortcode-id="6d76421ba1ea0de4b09956b97e80c384" data-rm-shortcode-name="rebelmouse-image" />
A chart showing prison population rates (per 100,000 people) in 2018. The United States has the highest rate of incarceration in the world.