531,662 active members*
3,313 visitors online*
Register for free
Login Register
Mitsubishi Electric News

Changes for the Better

Mitsubishi Electric Develops 3D-model AR Technology for Inspections

Mitsubishi Electric Corporation announced that it has developed a maintenance-support technology using augmented reality (AR) based on a three-dimensional model that enables a technician wearing smart glasses to confirm the order of the inspection on an AR display and then enter the results by voice. The technology helps reduce workload and avoid entry errors because information can be entered by voice, even in noisy environments. The system is expected to be used for a variety of maintenance work, such as inspections of water-treatment plants and building electrical systems.

  1. Precise, intuitive inspections with reduced workload
    The new system overcomes two key problems. First, conventional AR systems that use two-dimensional imaging require high volumes of pictures for large-scale inspections. Second, precise AR imaging requires difficult calculations of position and angle when there is a large difference between a technician's camera view and the super-imposed database images.

    Mitsubishi Electric's new technology uses a three-dimensional model that is easily built by scanning objects with a RGBD camera equipped tablet PC. Continuous operation builds the three-dimensional model and shows check procedure related to the objects. In addition, precise AR imaging is possible by calculating the position and angle using a three-dimensional model instead of two-dimensional images. Moreover, the displayed contents of the check procedure are changed according to the distance between the technician and the super-imposed item.
  2. Voice entry on AR displayed-form is precise and reduces double checking
    Inspection results are entered quickly by voice on an AR-display form, so the technician can confirm the accuracy of entries while still wearing the smart glasses. In addition, the system prompts the user to reenter ambiguous or incomplete information. Moreover, even under unsteady noisy environments, speech-recognition technology ensures high accuracy thanks to the use of deep-learning acoustic models that adjust to different types of noise.
Responsible for the content of this press release: Mitsubishi Electric Europe B.V.

Contact

Mitsubishi Electric Europe B.V.
Mitsubishi-Electric-Platz 1
40882 Ratingen
Germany
+49 2102 486 5000
+49 2102 486 5910

Route planner

Route planner