Remember Google glass, the “former” star product of the mad lab Google X. After Google co-founder Sergey Brin unveiled it at an event in San Francisco in April 2012, it started a global cult of “wearable smart display devices”. The cult of “wearable smart devices” began in April 2012 when Google co-founder Sergey Brin unveiled the glass at an event in San Francisco, creating a global cult of “wearable smart devices,” with impacts ranging from education and fashion to policing. Unfortunately, the product has been quiet for a while due to privacy issues, high price, and uncertainty about the needs of the average user. However, the imagination that Google Glass brings to the “human-computer interaction model” is still a hot topic for development, such as its augmented reality function. According to Bloomberg Businessweek, at an Ohio State University medical center, physicians wear Google Glass during surgery, allowing remote doctors to watch the procedure simultaneously. This application is a bit of a showstopper, but if the combination of real-world functionality and data analytics is applied to medical treatment, it will be a new breakthrough. Researchers at Stanford University are developing the Autism Glass Project, which utilizes Google Glass and Sension hardware and software integration, to help autistic children recognize emotions. It uses Google Glass and Sension hardware and software to help autistic children recognize emotions and develop personalized medical systems. There’s a little story behind the technology. Catalin Voss, the inventor of the software, is a student entrepreneur from Germany who taught himself to develop software for cell phones at the age of 12 and quickly became the No. 1-ranked podcast on the iTunes store in Germany by using audio-visual sharing to teach. When he enrolled at Stanford University at age 17 to study computer engineering science, he noticed that his peers were carrying laptops, tablets, or cell phones to class, and these mobile devices were equipped with single-lens webcams, and he thought, “Why can’t people interact with the camera?” For example, if you’re listening to an online class and get distracted or confused, the camera detects it and the software recognizes it and gives you a reminder or stops you. Catalin Voss then joined StartX, a Stanford startup gas pedal, and used this idea to develop Sension, a computer vision-based face-tracking technology that focuses on face recognition and line-of-sight tracking. It can be used in education and automotive industries. Sension’s core technology is the use of machine learning, the distance between the five senses of the face, in a point-to-point manner, measuring and calculating the gap between the changes, and expressions, emotions, and do the link, for the machine to do the immediate interaction of the discrimination, in addition to face recognition, it also joined the pupil tracking system, the use of the collected facial information, to do the three-dimensional space of the field of vision prediction, and therefore know what the user actually in the gaze. This technology seems simple, if the processing of static images alone is not too complicated, but the real high function is actually the analysis of dynamic images. We humans rely on the cooperation of the eyes and brain, so we can grasp the image in front of us in a flash and make interpretations, while today’s technology has to teach machines to replace the human brain to “see” and “measure”, which involves math, physics, robotics, neurobiology and signal processing, and is very large. The math, physics, robotics, neurobiology and signal processing involved are enormous. Sension has done just that, and Catalin Voss has initially targeted its products at applications in the education industry, allowing user data to be used not only to assist in the revision of textbooks, but also for online test fraud prevention, a concept that has already received investment from a number of online education companies (such as Mindflash). However, a Japanese company GAIA has another interesting idea, they acquired the technology, and the set of face, eye tracking technology in the automotive system, when the driver snoozes or look at the wrong road, the system can be recognized in time, and give warnings. Benefiting children with autism. The Sension software seems to have been well received by the industry, but what would it be like to work with the stars of the hardware world? The Wall Lab at Stanford University School of Medicine has launched the Autism Glass Project, which uses Google Glass to help autistic children recognize emotions. Autism is a developmental disorder caused by neurological abnormalities in the brain, and can be diagnosed around age 3. The most common symptoms are an inability to recognize changes in facial expressions and to experience the emotions of others. These symptoms become more severe with age, leading to a widening gap between the child and his or her peers and difficulties in social development. What Dennis Wall, an associate professor of pediatrics at Stanford School of Medicine and host of the Wall Lab, does is to have these autistic children wear Google Glass, a piece of hardware that plays cartoon characters or pictures, and Sension software that provides face detection and recognition, and then uses the mirrors to display different cartoon images to help the children understand whether the person in front of them looks happy, sad, angry, or surprised. The Sension software provides face detection and discrimination, and then uses the mirrors to display different cartoon images to help children understand the expression of the person in front of them, whether it is happy, sad, angry, or surprised. If a child wants to make eye contact, all they need to do is to look at the other person’s eyes, and Google glass will automatically cut off the screen and display the other person’s face. Of course, since most of the users are children, if the human-computer interaction can be more like a game, it is bound to be interesting, so the team designed the product as a game called “Capture the Smile”, which allows children to put on the glasses and use their eyes to point out who is happy in front of their eyes, and then the app will be able to recognize it and award them with points. Catalin Voss calls this fun little trick an “interactive learning process”, which is important for children with autism because when they communicate, they usually only pay attention to the other person’s mouth movements, whereas eye-to-eye contact helps to stimulate the brain’s potential. Response to conversation increases dramatically after training. The Autism Glass Project is a two-phase program: the first phase aims to use Google glass to help autistic children understand other people’s emotions; the second phase hopes that these young patients will be able to correctly interpret people’s facial expressions without the use of glasses, based on previous training and the memory of their facial features. In the first phase of the study, the children are only required to wear Google glass 3 times a day for 20 minutes at a time, and the device will record the process of their games and transmit them to the Android system for cross-referencing with experts and parental questionnaires to make an assessment of the patient’s attention span and influence factors. Of course, the longer the tracking time, the more “behavioral” and “grammatical” information will be collected from autistic children, and the easier it will be to analyze the characteristics. Compared to the average age of 4.5 in the U.S., a large amount of clinical data can help to advance the diagnosis to 2.5, achieving early detection and early intervention. In addition, it is possible to achieve the effect of early detection and early intervention. The R&D team has already completed laboratory trials with 40 children, as well as in-home clinical trials with 80 patients and 20 normal children. According to their families, the children’s response rate to conversations increased greatly after the program. The research has been recognized by Google, which has donated 35 Google Glasses, and by the Packard Foundation, which provided support of approximately$379,408 in early 2015. Next, the team will conduct a second phase of the trial: it hopes to enroll 100 young patients aged 6-16 in a four-month home treatment and behavioral observation trial. In fact, there are a number of ways that technology is being used to allow people with autism to communicate with the outside world, such as Robots4Autism, which uses adorable robots to interact with children with autism, or the New York Times story about a 13-year-old who considers Siri to be his best chatting friend. There’s also a new venture called Brain Power, which also uses Google Glass and software to help autistic children learn social skills. I’m sure the familiar yet unfamiliar term “autism” is remembered by many from the 1988 Oscar-winning film Rain Man, in which Dustin Hoffman, who was unable to take care of himself and adapt to society, was a brilliant math prodigy. Indeed, about 10% of people with autism have exceptional artistic or academic abilities, including music, drawing, memory, and arithmetic, known as Savant syndrome, but often not understood by others because they are not good at expressing themselves. Geniuses may be in the minority, but it does take a little help to get inside the head of an autistic person. Catalin Voss, the inventor of Sension, said in an interview, “Maybe we can give autistic children another superpower.” While there is still no effective medical treatment for autism, technology does help us open up new ways of understanding each other.