An inexperienced worker arrives at an industrial site, facing unfamiliar equipment and complex problems to resolve. Instead of seeking guidance from a senior technician, the worker utilizes a tablet or dons a virtual reality (VR) or augmented reality (AR) headset to access a digital twin of the worksite. This metaverse environment allows for the visualization of equipment specifications, operator details, and project information in a three-dimensional format. Though the initial influx of information can be daunting, an AI agent steps in to synthesize the data with real-time sensor inputs that monitor worksite conditions, providing step-by-step guidance through the repair process. The outcome of this approach is a reduction in errors, decreased stress levels, and quicker resolutions.
AI-Driven Solutions for Industrial Challenges
This forward-thinking approach is championed by Hitachi researchers, who have successfully integrated agentic AI into their Worksite-Augmenting Metaverse. The AI agent, known as Frontline Coordinator – Naivy, is designed to enhance operational efficiency while alleviating the psychological strain faced by novice workers in frontline roles. Although still in the research and development phase, initial tests have shown that Naivy improved the performance of inexperienced staff in facility management tasks by approximately 30% for a Japanese semiconductor manufacturer, while also helping to reduce the stress experienced by younger employees.
Addressing Workforce Challenges with Innovation
According to Takayuki Fujiwara, chief researcher at Hitachi’s Advanced Artificial Intelligence Innovation Center, the ultimate aim of the Worksite-Augmenting Metaverse and Naivy is to foster innovative working styles among frontline personnel. This initiative is particularly crucial in light of the declining labor force, ensuring that society can continue to thrive. Globally, governments face significant challenges in managing social infrastructure, which includes roads, bridges, and utilities. The American Society of Civil Engineers recently awarded U.S. infrastructure a “C” grade in its 2025 report, signaling ongoing issues amidst a projected $3.7 trillion funding gap through 2033. Furthermore, demographic shifts indicate a growing population over 60, which will lead to a large wave of retirements and a shortage of experienced workers.
Leveraging Technology to Bridge Gaps
Fujiwara believes that the technologies behind the Worksite-Augmenting Metaverse and Naivy can help fill this gap, not only in social infrastructure but also in sectors like manufacturing, energy, and logistics. He expresses fulfillment in utilizing these innovations to tackle various challenges across multiple industries. The synergy between XR (eXtended Reality) and AI is particularly effective for guiding workers in industrial environments. Although the initial excitement around XR applications in gaming and social media has diminished, Fujiwara describes the metaverse as an “immersive virtual environment” ideal for applications in training, simulation, and rapid communication.
Enhancing Worker Training and Safety
By allowing workers to learn processes in a virtual space, such as manufacturing techniques, inspections, and even medical procedures, the metaverse simplifies complex simulated outcomes. It enables stakeholders to interact and share information in real-time, regardless of their physical location. Fujiwara emphasizes that integrating AI with metaverse technology can enhance these advantages, leading to improved efficiency, increased automation, and enhanced analytical capabilities in industrial settings. For instance, AI can promptly identify hazardous actions, expedite quality inspections, and streamline workflows by automating repetitive tasks.
From Concept to Action: Real-World Applications
Hitachi’s vision for XR and AI is transitioning from theoretical research to practical applications in the field. The company’s R&D team has initiated several proof-of-concept projects across diverse sectors, including facilities management, transportation, energy, and manufacturing. According to Fujiwara, the combination of the Worksite-Augmenting Metaverse and Naivy has improved training processes, with AI generating XR content tailored to various user skill levels for enhanced understanding. The technologies facilitate context-aware support, ultimately fostering consensus among team members since everyone shares access to the same 3D environments.
Demonstrating Practical Benefits Through Innovation
In a railway maintenance pilot, for instance, the solutions assisted operators in coordinating maintenance manuals, reports, and images, enabling users to swiftly identify necessary components for their tasks. Similarly, in an energy pilot, the technology showcased potential risks in an easily digestible manner. In logistics, novice workers benefited from tools that guided them through factory inspections. Fujiwara notes that these efforts illustrate how the fusion of AI’s analytical capabilities with the immersive nature of the metaverse can yield tangible benefits, such as reduced downtime, enhanced safety, and resilient operations.
Collaboration Between IT and OT Experts
Though Worksite-Augmenting Metaverse and Naivy are not yet commercially available, Fujiwara highlights the necessity of real-world research to advance technology. Hitachi boasts operational sites and a team of IT specialists focused on AI, as well as operational technology (OT) experts with extensive knowledge in design, manufacturing, and maintenance across various sectors. This unique combination allows for collaborative problem-solving that is rare in the industry.
Driving Sustainable Growth Through Innovation
Fujiwara emphasizes the importance of having both IT and OT specialists within the same organization for in-depth discussions and collaborative efforts. This synergy is seen as a distinctive strength of Hitachi. The company is committed to evolving its Social Innovation Business, utilizing digital, green, and innovative technologies to address societal challenges and promote growth. The Research & Development Group is dedicated to driving this innovation by leveraging the technological platforms and expertise acquired across its various business domains.
