Joke Collection Website - Bulletin headlines - What are the possibilities of AR, VR, MR and emerging technologies in the field of education and training?

What are the possibilities of AR, VR, MR and emerging technologies in the field of education and training?

AR, VR and MR have become more and more popular in recent years. Before starting to introduce their applications, let us first introduce the differences between the three members of this family.

The differences between AR, VR and MR:

Augmented Reality (AR): Overlaying digitally created content on the user’s real world.

Virtual Reality (VR): Blocks out the real world and creates a fully digital, immersive experience for users.

Mixed Reality (MR): Overlaying the user's real world with digitally created content that you can interact with.

The following table can help you understand the difference more clearly:

So Pokémon Go is MR? Because it can conquer pocket monsters (interaction)? Don’t get me wrong, MR mentioned above "Digitally created content that you can interact with" is not simply digitally created information that you can click on to get more information, or to conquer pocket monsters. The digitally created content generated by MR can be combined with actual images of the real world, and the digitally created content can be enlarged, reduced, rotated, and even edited. The following can give you a better understanding of what MR is.

Have you noticed that in the video, when you watch the 3D digital image, the image does not turn as you move, so you can move the position from behind, above, or below. Viewing or editing this image from various angles is something that is impossible in AR, or even in most VR applications.

As a side note, there is debate over whether Pokémon Go counts as AR. Because in theory, AR should rely on identifying certain real-world images to generate or bring out digitally created content, while Pokémon Go relies on Location positioning to bring out digital images. Therefore, many people think that Pokémon Go can only be called a location service game (Location Service Game) at best. -Based Gaming), cannot be called AR. Regarding this point, I think it’s better not to be too picky, or you can call it a Location-Based AR game.

In recent years, AR has changed from the original mode where you can only point a smartphone or tablet to an actual object in the real world and let the application bring out relevant information through recognition, to a mode where you can use AR glasses to achieve the same function. And because it does not require a handheld mobile device to use, it is more convenient to use. AR glasses should gradually become a new trend in AR applications.

VR wearable devices (such as HTC VIVE, Playstation VR...) allow gamers to no longer just watch the screen and play video games, but to enter a 3D real-life combat environment. However, its disadvantage is that it blocks real-world images. Therefore, unless there is a well-designed and used sensing device, most applications in education and training will be limited to viewing 3D digital content.

MR mixes AR and VR. Therefore, the launch of devices such as Microsoft's Hololens not only brings the application of AR to a higher level (interaction), but also allows VR applications to be more integrated into daily work and in life.

The application of AR, VR, and MR in education and training

We divide the application of these emerging technologies in education and training into three major parts:

Education ( Education): refers to imparting knowledge, including school education and workplace education.

Training: refers to functional or skill training, including school and workplace.

Performance Support: refers to providing relevant and important information when needed to help complete the work. It can usually be used in conjunction with the previous item.

This introduction will not be limited to school education. We will also cite some applications in different fields outside schools to help everyone understand the infinite potential and charm of these emerging technologies. This will also help everyone Think about how to use these technologies. The applications of AR/VR/MR are infinitely broad, and it all depends on everyone’s imagination and practice.

For convenience we will indicate whether each application is classified as Education (E), Training (T) or Performance Support (PS). Application examples that are not within the scope of these three categories (such as entertainment, consumption, marketing, treatment, etc.) will be omitted in this article.

Medical

AR/VR/MR is receiving more and more attention in the medical field (hospitals and medical schools). The two biggest reasons are:

1. Saving time/reducing costs (E/T/PS):

Currently, many medical schools/hospitals use AR/VR/MR for teaching or surgical training. In teaching, students wear AR/VR glasses to view 3D human body structures and organs, and can even "take out" an organ for closer observation. In surgical training, students or interns wear AR/VR glasses and perform surgical exercises on virtual cadavers through 3D holographic anatomy (Holographic Anatomy) programs. This can save students ten hours in a traditional cadaver laboratory. More realistically, cadavers are not easily available, so surgical simulation can reduce the burden on hospitals or schools in this regard.

2. Collaboration (T/PS)

Whether it is surgical simulation, actual surgery, or other medical diagnosis, professors, senior doctors (directors), or even remote doctors Or experts, they can also provide suggestions or give instructions to the doctor through the image (we call it POV, Point-of-View) worn by the doctor who performs the operation or diagnosis, and the doctor can See these suggestions or instructions from the display on their glasses.

Of course the applications are not limited to these, here are some other application examples:

Drug use: Assist medical staff to confirm the correct medication even if they are not trained. This simplifies the needs of pharmacists and doctors, reducing the chance of medication misuse. (PS)

Intravenous Infusion: Assists caregivers in locating a vein to administer intravenous injections. No doubt, AR glasses can help you see veins that are invisible to the naked eye, which reduces the time of medical staff and the pain of patients. (PS)

Preliminary treatment: The doctor on duty in the hospital's emergency room can conduct initial treatment on the patient through the POV of the ambulance or the data returned by the medical staff at the accident scene and the detection equipment. Diagnose and issue instructions to the medical staff for preliminary medical treatment to increase or reduce the patient's chance of survival and the spread of damage. Therefore, perhaps in the future, a pair of AR glasses will be placed next to a fire extinguisher or AED (automated external defibrillator) in public places, but when taken out, the 119/120 service center will be automatically called through Wifi connection, allowing the user to Firefighters or medical personnel from a remote location immediately provide assistance or give instructions on how to use a fire extinguisher to extinguish the fire source, or how to use an AED to rescue patients who need emergency medical assistance. (PS) Military and police training

In the United States, the US military is the main promoter of educational technology because they hope to train their troops quickly and efficiently. The U.S. military began using AR/VR and other technologies a few years ago to train soldiers in combat, weapon operation, or maintenance of weapons, vehicles and other equipment.

Wearing AR glasses and using AR for weapon operation training or equipment maintenance can avoid errors and speed up training and maintenance, so new soldiers can get started quickly.

(T/PS)

AR can of course also be used in combat. Let’s take the most familiar example. The Apache helicopter incident that caused a stir in Taiwan a few years ago. If everyone had not only paid attention to the actress, they would have noticed the helmet worth more than 60,000 US dollars. Why is the helmet so expensive? It’s because this tactical helmet can display 12 pieces of cockpit information (such as weapon sights or night vision goggles) on the monocular screen of the right eye, so that the pilot can quickly read all important information. Other fighter pilots and tank driver helmets can also use AR to allow them to quickly grasp important information or carry out attacks. (T/PS)

The biggest advantage of using VR for combat training is that it can design a variety of scenarios. Those who have served in the military should also know very well that there are only a few terrains and features on the military field training ground, but using VR, you can design the required situations and terrains according to your needs, and the imaginary enemies are no longer just human figures. . (T)

Using technologies such as AR/VR to train soldiers in combat, weapon operation or equipment maintenance has another more important advantage, that is, all processes will also be recorded to determine whether the operations are correct. , whether the aiming is accurate... and other information will be recorded and analyzed to provide training units with appropriate training for soldiers who need improvement to improve deficiencies.

Similar concepts are of course not limited to the training of military personnel. Public security, fire fighters, etc. who will face dangerous situations in their work can use this technology to provide simulation training in various situations. Improve your ability to handle situations correctly and quickly in the future and protect your own safety. (T/PS)

Police officers wearing AR glasses can help identify wanted criminals or stolen cars by connecting to the crime center database and image recognition, and fight crime more efficiently. (PS)

Technical Maintenance Service

AR can provide immediate assistance to assist maintenance personnel in equipment maintenance and troubleshooting, which can cover almost all the work you can think of. , such as factory machine maintenance, office copy machine maintenance, elevator maintenance, telecommunications maintenance, car maintenance...etc. Through AR smart glasses and a dedicated application, detailed steps can be provided to maintenance personnel so that they can follow them to perform inspection and repair work. Of course, this is also a very useful tool for training new personnel. (T/PS)

Can’t solve the on-site problem? It doesn’t matter. The application will call the company’s internal senior technicians to guide the on-site personnel to troubleshoot or replace parts through remote assistance, AR/MR It allows remote experts to see the image (POV) seen by the on-site personnel, and guide them through calls or display text, pictures, or even directly mark the location of the parts to be processed on the AR/MR lens display of the on-site personnel. Restoration work. (PS)

The biggest advantage of using AR/MR glasses is that on-site personnel no longer need to hold a mobile phone or tablet in front of the device to be repaired, or to follow or watch instructions from the company. Both of their hands can be used to perform repair work. Of course, if you don’t have AR/MR glasses, you can do it with a mobile phone or tablet, but it’s just more inconvenient to hold it with your hands.

Don’t think that only maintenance personnel can use this technology, of course consumers themselves can. In the future, repair of photocopiers, cars, electrical appliances, replacement of RO filters..., as long as you have the appropriate AR application, you can do it yourself.

BMW Motor Company developed AR glasses and related applications as early as 2007, providing them to its maintenance shop technicians to repair and replace car parts. Hyundai Motor Company launched an AR technical manual application for car owners to use in 2015. By using their smartphones or tablets, car owners can get how-to information such as engine oil, brake fluid, air filters, etc. for maintenance. The app provides videos, 3D overlays showing various areas as owners scan different locations on their vehicle, and other car-related information.

(PS)

School Education

Using AR/VR can provide students at all levels of schools with an immersive multi-sensory experience. Compared with traditional lectures and word cards, Methods such as cards, or textbooks are more effective. Here are a few examples for reference:

When teaching about the planets in the solar system, AR/MR/VR is used to display the 3D planetary movement screen. Students can use the controller to click on a planet to bring out the More detailed information. (E/PS)

Geography class uses AR/MR/VR to display a 3D globe. Students can view it from various angles and click on a country to bring out detailed information about that country. (E/PS)

Chemistry classes use VR to first let students simulate the experimental process so that students are familiar with the steps and incorrect operations that may cause explosions or fires, so that dangerous accidents can be effectively avoided during real experiments. . (E/T/PS)

Textbooks or extracurricular books can be paired with mobile devices or AR glasses to display 3D stereoscopic images and related information on specific pages to increase students’ impressions, make it easier for students to understand, and improve Class or study interests. (E/PS)

Architecture students no longer need to spend time making design models. They only need to use mobile devices or AR/MR glasses and appropriate applications to display their designs in 3D. It is both beautiful and accurate, and there is no need to remake the model when the design is modified, saving a lot of time. (PS)

New students who are not familiar with the campus? Often get lost when looking for classrooms? No problem, the AR application can guide you to your designated building or classroom. (Note: Some stores or commercial buildings have already begun to use similar applications to provide guidance. In the future, when you go to supermarkets, hypermarkets or shopping malls, you can use AR applications to directly guide you to the display location of the goods you want to buy or the store you want to visit. , no more walking around to find products or store locations). (PS) Art and Talent

Wear VR to visit famous zoos, museums or historical attractions, landmarks or buildings mentioned in textbooks. Appreciate them at your own speed, and even cooperate Animation display to deepen your impression and understanding. The app provides detailed on-screen information based on what you're currently viewing.

Have you brought out any inspiration? Yes, in the past, arranging outdoor teaching was tiring and tiring, and you had to worry about the weather or fear of a car accident. In the near future, all of this can be done in the classroom (some museums have already begun to provide similar services), and outdoor teaching may become a historical term. At the worst, this is a bit unrealistic, but at the best, this can save schools and parents a lot of money. (E/PS)

In terms of talent learning, AR glasses can help guide you to learn musical instruments, painting, sculpture, weaving and other talents step by step. Especially for students who are starting to learn musical instruments, with AR glasses and related applications, they can display fingerings and music scores of various instruments, practice, correct mistakes and record the process, so that novices can easily get started. (E/T)

Fitness/Sports

When you are cycling, running or walking outdoors or in the wild, AR glasses can instantly display your heartbeat, fatigue, calorie consumption, goals and More and more displayed information, such as maps and GPS positioning, etc.

In the future, in the gym, you will no longer be bored looking at the TV screen hanging in front of you while running, riding a bicycle, or doing weight training. , you can use the VR (or MR) head-mounted device to choose to ride a bicycle, ski, row, or run on the banks of the Seine or other sections you want to experience. Fitness equipment such as bicycles and treadmills will adjust the uphill or downhill angle, resistance, and even feel the vibration of the ground or river surface according to the virtual location you experience. Isn't this kind of exercise experience fascinating? Of course, all related information will also be displayed on the device screen.

Of course schools can also enjoy the benefits brought by such applications, such as using VR with related applications and sensing components to train football goalkeeper defense, baseball batting practice, or tennis racket swings, etc. Training is not only not affected by the weather, but also requires only a few indoor venues for training.

Let’s mention this first today. In addition to education and training, the applications of AR/VR/MR in daily life are infinitely broad and full of imagination. The author believes that AR/MR will be the mainstream in the future because they do not break away from the real world, so they are easier to integrate into real life, education and work; AR can be flexibly used on mobile devices (especially mobile phones), and AR glasses can do It is very light and the price continues to drop, so AR should become an indispensable portable tool in future life. If paired with AI (Artificial Intelligence), it will be more like a personal intelligent assistant. The main application of VR will be to create a virtual immersive experience, with high cost, danger, or experience that is not easy to obtain in the real world as the main application requirements