The Business Intelligence Blog

Here’s a follow-up on Reality Mining and Surprise Modelling, which are called as one of the 10 technologies that we think are most likely to change the way we live.

Read more from Forbes.com interview with Sandy Pentland, director of MIT’s Human Dynamics Research program.

Forbes.com: What is “reality mining?”

Sandy Pentland: Reality mining is about using sensors to understand human beings. The sensors could be security cameras, they could be devices that you wear on yourself, they could be cell phones. The point is it’s about people. Data mining is about finding patterns in digital stuff. I’m more interested specifically in finding patterns in humans. I’m taking data mining out into the real world.

What kind of reality-mining experiments have you actually performed?

We developed this thing called a sociometer, a little badge that you wear around your neck that records your body language, your motion and your tone of voice–the tone, not the words. It gives us a nice little package for reality mining.

We’ve done all sorts of interesting things with this. Just listening to peoples’ tones of voice and how they move, we can measure interest level and attention, factors that account for 40% of the variation in the outcomes of things like salary negotiation, dating scenarios, closing a sale, pitching a business plan.

Reading this Technology Review, it seems inevitable that such advanced mining technologies will pop-up in the near future. The world has a wealth of information and every single thing will be data mined in the future. And what a movement that will be.

By the way, the MIT Technology Review calls Reality Mining as one of the 10 technologies that we think are most likely to change the way we live. Exciting, Ain’t it ?

Also Surprise Modeling which combines data mining and machine learning to help people do a better job of anticipating and coping with unusual events is also one of the Top 10 Technologies listed by MIT Tech Review. This is being advocated by Eric Horvitz, Microsoft Research.

From the article on Reality Mining -

Reality mining, he says, “is all about paying attention to patterns in life and using that information to help [with] things like setting privacy patterns, sharing things with people, notifying people–basically, to help you live your life.”

Within the next few years, Pentland predicts, reality mining will become more common, thanks in part to the proliferation and increasing sophistication of cell phones. Many handheld devices now have the processing power of low-end desktop computers, and they can also collect more varied data, thanks to devices such as GPS chips that track location. And researchers such as Pentland are getting better at making sense of all that information.

To create an accurate model of a person’s social network, for example, Pentland’s team combines a phone’s call logs with information about its proximity to other people’s devices, which is continuously collected by Bluetooth sensors. With the help of factor analysis, a statistical technique commonly used in the social sciences to explain correlations among multiple variables, the team identifies patterns in the data and translates them into maps of social relationships. Such maps could be used, for instance, to accurately categorize the people in your address book as friends, family members, acquaintances, or coworkers. In turn, this information could be used to automatically establish privacy settings–for instance, allowing only your family to view your schedule. With location data added in, the phone could predict when you would be near someone in your network. In a paper published last May, ­Pentland and his group showed that cell-phone data enabled them to accurately model the social networks of about 100 MIT students and professors. They could also precisely predict where subjects would meet with members of their networks on any given day of the week.