Hybrid Quality Inspection for the Automotive Industry: Replacing the Paper-Based Conformity List through Semi-Supervised Object Detection and Simulated Data release_bwzwg3gr2zb27plalc2az3ud6y

by Isabel Rio-Torto de Oliveira, Ana Teresa Campaniço, Pedro Pinho, Vitor Filipe, Luis F. Teixeira

Published in Applied Sciences by MDPI AG.

2022   Volume 12, Issue 11, p5687

Abstract

The still prevalent use of paper conformity lists in the automotive industry has a serious negative impact on the performance of quality control inspectors. We propose instead a hybrid quality inspection system, where we combine automated detection with human feedback, to increase worker performance by reducing mental and physical fatigue, and the adaptability and responsiveness of the assembly line to change. The system integrates the hierarchical automatic detection of the non-conforming vehicle parts and information visualization on a wearable device to present the results to the factory worker and obtain human confirmation. Besides designing a novel 3D vehicle generator to create a digital representation of the non conformity list and to collect automatically annotated training data, we apply and aggregate in a novel way state-of-the-art domain adaptation and pseudo labeling methods to our real application scenario, in order to bridge the gap between the labeled data generated by the vehicle generator and the real unlabeled data collected on the factory floor. This methodology allows us to obtain, without any manual annotation of the real dataset, an example-based F1 score of 0.565 in an unconstrained scenario and 0.601 in a fixed camera setup (improvements of 11 and 14.6 percentage points, respectively, over a baseline trained with purely simulated data). Feedback obtained from factory workers highlighted the usefulness of the proposed solution, and showed that a truly hybrid assembly line, where machine and human work in symbiosis, increases both efficiency and accuracy in automotive quality control.
In application/xml+jats format

Archived Files and Locations

application/pdf  5.6 MB
file_5x3vf3if6vac5ceofpbsnpe7si
mdpi-res.com (publisher)
web.archive.org (webarchive)

Web Captures

https://www.mdpi.com/2076-3417/12/11/5687/htm
2022-06-11 20:50:11 | 49 resources
webcapture_m2k2k2dhwjgwjomhzfy3spbfei
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Date   2022-06-03
Language   en ?
Container Metadata
Open Access Publication
In DOAJ
In ISSN ROAD
In Keepers Registry
ISSN-L:  2076-3417
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: bf4f2634-5526-4fe1-bd41-90c327955f78
API URL: JSON