Industry
Energy, Resources & Utilities
Rebalance the energy equation
Highlights
- Immersive technologies can simulate real-life hazardous scenarios to provide an in-depth learning experience to participants from a safe environment.
- The advantages of training on XR platforms include self-paced training and certifications without any dependency on a trainer or certifier involvement.
- Other benefits include extended knowledge retention, improved decision-making through a gamified learning experience, and repeatability of training.
On this page
Simulating danger
Having moved far beyond entertainment and gaming, immersive technologies such as virtual reality, augmented reality, and mixed reality today cater to many industries, including education, healthcare, and manufacturing.
Enterprises operating under challenging environments can adopt immersive extended reality (XR) technologies to simulate real-life hazardous scenarios for safety-related training. According to a report by Statista, the global XR market size is expected to reach $300 billion by 2024. Consequently, XR-based training plays a vital role across all industries.
Though XR has been around for decades, its adoption rate is gaining speed now, especially in manufacturing, aviation, mining, and oil and gas. Mining being one of the most hazardous environments, XR can play a vital role by enabling AR-based remote inspection and assistance, visually guided drilling operations, real-time heavy equipment operator assistance, assisted maintenance and repair of assets, and, above all, mine operator safety training.
XR can be leveraged for several kinds of safety training in the mining sector, including:
- Site familiarization
- Scenario-based rescue
- Historical incident-based rescue
- Emergency preparedness
- Equipment familiarization and operations
- Machine/Asset inspection and maintenance
In this paper, we focus on XR-based miner training, especially for India.
Safety training for miners in India
Indian mineral production capacity is steadily growing to keep pace with rising demand. Compared with 2020, mineral production rose by 5% in 2021, per the Union Ministry of Mines.
The Ministry of Mines Annual Report of 2020–21 declared the total value of mineral production, excluding atomic and fuel, at Rs 129,950 crore, or approximately $1.8 billion. This continuous productivity growth implies vast employment opportunities but, at the same time, increases the safety risk of miners working in accident-prone and risky conditions, both in open-cast and underground mines.
Hence, the science and technology program of the Union Ministry of Mines mandated mine safety as one of the focus areas, apart from energy conservation and environmental protection. Coal India Limited’s 2021 Annual Report emphasized the institutionalization of continuous education, training, and retraining of all employees and contract workers. It mandated the internal safety organization of every mine to oversee such safety training facilities.
And this is where immersive technologies come in. Applicability of XR technologies will be primarily in providing learning experiences to participants, individually or in a group, not just in safety training but also in operating complex machinery such as excavators and shovels. It can give learners real-life scenarios with the perception of hardware components, simulator software, and step-by-step training instructions. Mandatory safety and operator training can also be done using such XR platforms, the advantages being self-paced training and certificates without any dependency on a trainer or certifier involvement.
Mining being one of the most hazardous environments, XR plays a vital role here, enabling AR-based remote inspection and assistance, visually guided drilling operations, real-time heavy equipment operator assistance, assisted maintenance and repair of assets, and, above all, mine operator safety training.
Immersive experiences can lead to better memory retention, according to the results of a 2018 study published in the journal Virtual Reality.
GMetri reports a growth in knowledge retention of over 95% with spatial interactive learning, as against around 45% with conventional training videos.
Key elements of XR-based training can be developed using AR cards, VR-based training, and cave automatic virtual environment (CAVE). CAVE is an immersive high-resolution 3D stereoscopic projection, where images get directed at the six walls of a room-sized cube. It also includes solid-state illumination, motion tracking, interaction capabilities, and real-time 3D computer graphics. CAVE, in general, is suitable for multiple people to experience mining environments without individual VR headsets.
Understanding the various types of immersive training possible with AR, VR, or MR is essential. Some of these are listed below.
Instruction manual/Guide: An immersive training module is usually built upon existing learning materials but with several options for interacting and capturing user inputs (simulations). For example, a 2D instruction manual of a machine part can be converted into a 3D visualization. It would allow the user to have a 360-degree view of the machine part with the instructions from the original manual.
Full simulation: A full simulation would have the user navigate different scenarios, providing a holistic experience of the real-world asset/machinery. For example, a full simulation of the dashboard of a heavy earth moving machine (HEMM) could be developed for operators. This offers an opportunity for the user to get trained in complex machinery without stepping into it for real. It also allows the users to make mistakes and fail without risking the actual dangers of a real-life situation.
Virtual explorer: It allows users to explore an open cast or underground mine using a freeform approach. The user can freely navigate between numerous 3D models and interactive options, picking the most interesting ones. The virtual explorer can help new joiners or employees moving from one mine to another get acquainted with the terrain and specifics of the mine. Another example is AR/VR cards, where users could look at the recreation of a particular mining incident/accident to learn and understand the root causes and help avoid recurrence.
Remote training: Usually taken up in scenarios where the trainer or a senior expert trains a team member from a remote location. An example of this could be senior team members available at a different mining site/subsidiary, who teach someone from another site of the same organization. Another example could be HEMM and other machinery experts from original equipment manufacturers training first-level maintenance executives from the mining company.
Collaborative training: XR-based collaborative platforms can enable trainers and supervisors from different locations to collaborate and learn seamlessly in virtual environments with their photorealistic 3D avatars. Such platforms could be instrumental in scenarios where users from multiple mine locations or multiple subsidiaries (as in the case of Coal India Limited) want to run collaborative training through remote presence.
In addition to exposing workers to fewer real-world hazards during training, a key benefit of VR is greater efficiency. An XR-based training pedagogy provides a highly effective interim step between the classroom and the real world.
Below is a comparison of AR, VR, and MR for training in a mining environment and possible use cases.
Figure 1: Using AR, VR, and MR for training in a mining environment
Some illustrative use cases are captured in the table below, with the usage potential depicted as telecom towers.
Figure 2: AR, VR, and MR use cases for training in a mining environment
The illustrative use cases have been arranged in the chart below to show an overall ease of adoption. This is based on the complexity of development versus investment requirements. We can see that this ranges from the low-hanging fruits of past incident primers and technical support calls to the more complex CAVE creation.
Figure 3: Adoption of training use cases in mining
Complexity of development includes factors such as technical difficulty, size of the project and project management efforts, skills availability, risks in development, and difficulty of user training/adoption.
Conclusion
Globally, mining companies have started adopting AR/VR for training requirements, and Indian companies such as Sesa Goa have also ventured into this arena, investing in pilot projects before scaling up.
In addition to exposing miners and officials to fewer real-world hazards during training, other benefits include:
- Extended knowledge retention
- Improved decision-making through a gamified learning experience
- Repeatability of training without the constraints of a classroom environment
In general, XR-based training pedagogy provides a highly effective interim step beyond the classroom and closer to the real world.
Our endeavor in this paper was to bring forth the realm of XR technologies to address the unique needs and advantages of real-life training experience across complex mining scenarios. The mining sector should embrace XR platforms and solutions to serve essential safety and compliance training
