What are the functions of smart glasses? Function description of smart glasses with Xiaomi, Huawei and Google.

In people's daily communication, speaking is the most commonly used way. If voice interaction is introduced into the wearable field, people will be able to enjoy a more natural and relaxed interactive experience. Voice control means that the computing device can understand what people say and execute corresponding instructions according to what people say. Voice control is an effective way of interaction for smart glasses that are small in size and worn on the body.

Voice control principle

The core of speech control is speech recognition technology. Bone conduction technology can realize efficient speech recognition and transmission, and is adopted by many smart glasses. Take Buhel's sound mirror as an example, which is equipped with an indirect bone conduction sensor. There is a sound transducer in each of his temples, and the sound generated by the transducer can be transmitted to the inner ear through the bone on one side of the user's head, so that the user can hear the sound. Although voice control is an important interactive way in smart glasses, it has encountered many problems.

Defects of voice control

First of all, there are many interference factors in the extraction of speech signals, such as the differences in pronunciation and intonation between individuals, the differences in people's speaking styles in different regions and cultural backgrounds, and the interference of environmental noise on speech signals. All these factors will adversely affect the extraction of speech signals. Secondly, the efficiency and speed of speech recognition need to be improved, which directly affects the application value of speech control in smart glasses and is an important index of application value. In addition, users have high expectations for voice control, but the actual situation is that voice control can not meet the needs of users. For example, when a user initiates a voice control command using Google Glass, the user must send it in strict accordance with the standard method provided by Google Glass. When users want to make a phone call, they must say ok glass and call ..., while the more customary method is to call ... which is totally ineffective.

2. Gesture recognition

The advantage of using gestures as input to complete the interaction function with smart glasses lies in the non-contact way. Gesture recognition technology can be divided into three categories: two-dimensional gesture recognition, two-dimensional gesture recognition and three-dimensional gesture recognition. The difference between three-dimensional gesture recognition and two-dimensional gesture recognition is that the input information of three-dimensional gesture recognition also contains depth information, and smart glasses can realize more and more complicated interaction ways by adopting three-dimensional gesture recognition.

Principles and sensors of gesture recognition

3D gesture recognition needs depth information, and can recognize various gestures, hand shapes and actions. In order to obtain depth information, special hardware is needed, and the recognition algorithm can realize 3D gesture recognition. Next, several sensors dedicated to gesture recognition are introduced: TMG399, a non-contact optical infrared gesture recognition sensor, which is equipped with a four-in-one sensor module of gesture recognition, ambient light detection, proximity perception and color perception; The 3D gesture recognition chip MGC3 130 introduced by Chipscreen Technology can sense gestures in a non-contact way under the action of its electric field, and can accurately determine the coordinate position of 150dpi within the distance of 15cm. The product MYO of startup Thalmic Labs is an armband worn on the arm; 16Lab is a smart ring for gesture control, which has an inertial sensor module, a processor and a low-power Bluetooth module.

Gesture recognition defect

However, when gesture recognition is applied to smart glasses, some defects are also exposed. First of all, the accuracy of gesture recognition is low and the positioning is not accurate enough. Because everyone's hand structure is different, it is difficult to achieve accurate positioning by capturing hand movements. Secondly, the key of gesture recognition is the extraction of finger features, which can accurately distinguish the features of targets in complex background, but it is still an insurmountable problem when gestures block or remove redundant information.

3. Eye tracking

Eye tracking is a process of measuring the movement state of eyes or glasses relative to the head. Google Glass can perceive users' emotions through eye tracking technology and judge users' reactions to watching advertisements.

Eye tracking principle

Eye movement tracking measurement technology of smart glasses is mainly based on image and video measurement, which includes many technologies that can distinguish eye movement characteristics, such as different color edges of sclera and iris, light intensity of corneal reflection and appearance and shape of pupil. Image-based methods combining pupil shape changes and corneal reflection are widely used to measure users' attention points.

Eye tracking defect

Although eyes are the widest and fastest way to receive information in human body, eye tracking is still far from humanized interaction. Due to the inherent blinking and jitter of eyes, there will be a lot of interference signals, which may cause data interruption, which greatly increases the difficulty of extracting accurate data from eye movement information.

What are smart glasses?

Smart glasses, like smart phones, have an independent operating system, and users can install smart glasses with programs provided by software service providers such as software and games.

Smart glasses can complete the functions of adding schedule, map navigation, interacting with friends, taking photos and videos, and making video calls with friends through voice or action control, and can realize wireless network access through mobile communication networks.

Smart glasses refer to wearable glasses devices that have independent operating systems like smart phones and can realize various functions through software installation. It is one of the most promising wearable smart devices proposed in recent years.

Easy to use, small size, etc. It is generally believed that the emergence of smart glasses will facilitate people's lives, so they are developed by Google and Microsoft, and are regarded as an important growth point of smart technology products in the future.

Xiaomi Smart Glasses Function Description

Xiaomi Smart Glasses Exploratory Edition is similar to traditional glasses in form, with the weight of 5 1g, but the glasses are displayed by MicroLED optical waveguide technology, and the sesame-sized MicroLED micro display screen is hidden in the frame. Through the refraction and diffusion of the optical waveguide lens, the image picture is instantly presented. Compared with other technical solutions, optical waveguide technology can realize complex optical structure only through a single lens, which can obviously reduce the volume and weight of the equipment. It can be said that it is the only technology that can make smart glasses close to traditional glasses.

As for the effect you see with your eyes after wearing it, it is similar to what you see in science fiction movies. Although you can't become Severn Altman after wearing it, you can directly see the information prompt, time and so on. On the camera, and you can also display the translation results directly on the camera when reading a foreign language.

Functionally, Xiaomi Smart Glasses Discovery Edition can run Android system, which can run independently. It can receive notification messages in time for daily wear, and only filter the display of important information to avoid too much interference. When talking, you can directly see the number of the other party through the lens, and use the built-in microphone and speaker of the glasses to clearly talk; When navigating, the map information is presented in real time, and the eyes don't leave the road, which is safe and convenient. At the same time, with the 5-megapixel camera in front of the glasses, the glasses can also realize the functions of taking photos quickly and translating pictures. When the camera works, the photo indicator light will light up to remind passers-by to protect privacy.

Huawei Smart Glasses Function Description

Huawei smart glasses support all-weather intelligent broadcasting, cervical health management and many other intimate functions that provide convenience for users' lives.

In terms of hardware configuration, Huawei smart glasses are equipped with 128mm2 speaker+inverse sound field acoustic system, which adopts wired magnetic fast charging scheme, charging 10 minutes, listening for 80 minutes, fully charging 16 hours, and IPX4 battery life is waterproof.

Huawei glasses' all-weather intelligent broadcast function can spread important information such as WeChat and Nail to glasses at any time, and will automatically broadcast it after receiving the message to remind users not to forget important matters. In addition, the all-weather intelligent playback function is also very eye-catching and practical in daily scenes such as watching movies, listening to songs and playing games.

In terms of interaction, Huawei smart glasses have built-in capacitive touch sensing devices on both temples, which can realize most operations only by knocking, grasping and pinching, bringing users a simple and efficient intelligent interactive experience.

For long-term sedentary users, cervical health problems can not be ignored. The all-weather cervical health management function of Huawei smart glasses can automatically sense the change of the user's head posture. When the user is in the wrong sitting position for a long time, the glasses will give a warning. At the same time, the cervical health APP can also output solutions with cervical health as the core for users according to the data recorded by Huawei smart glasses, and interpret the cervical data professionally.

Google Smart Glasses Function Description

Google Project Glasses is an augmented reality wearable smart glasses. This pair of glasses combines smart phones, GPS and cameras to display real-time information in front of users. They can take photos and upload them, send and receive text messages, and query the weather and road conditions in a blink of an eye. Users can surf the internet or handle text messages and emails without hands. At the same time, wearing these augmented reality glasses, users can control taking photos, making video calls and identifying directions with their own voices. In terms of compatibility, Google Glass can synchronize with any smartphone that supports Bluetooth.

The main structure of Google Project glasses includes a camera hanging in front of the glasses and a broadband computer processor device located on the right side of the frame. The camera is equipped with 5 million pixels and can shoot 720p video. The lens is equipped with a head-mounted micro-display, which can project data onto a small screen above the user's right eye. The display effect is like a 25-inch HD screen 2.4 meters away.

There is also a parallel nose pad and nose pad sensor, which can be placed horizontally above the bridge of the nose, and the nose pad can be adjusted to adapt to different face shapes. A capacitor is implanted in Nostori to identify whether glasses are worn or not. The battery can support normal use for one day, and can be charged with a Micro USB interface or a charger specially designed for doors. According to the environmental sound, the distance and direction are displayed on the screen, and the map and navigation information technology products are displayed on two eyepieces respectively.

Google Project Glass weighs only tens of grams and has 682MB of memory. The operating system used is Android 4.0.4 version number is ice cream sandwich, and the CPU used is OMAP 4430 processor produced by Texas Instruments. 20 1 1 year, this chip was used in two mobile phones made by Motorola, Droid Bionic and Atrix 2. The sound system adopts bone conduction sensor. The network connection supports Bluetooth and WiFi-802.11b/g+0b/g, and the total storage capacity is 16GB, which is synchronized with Google Cloud. Supporting my glasses application requires Android 4.0.3 or higher system version; MyGlass application needs to turn on GPS and SMS sending functions.