Unsupervised Anomaly Detection for Manufacturing Quality Control
Introduction
In manufacturing quality control, manual defect inspection becomes impractical at scale. While computer vision techniques like semantic segmentation and object detection [1] have revolutionized automated inspection, they face a significant challenge: new product lines lack the extensive labeled training data needed for these models. This data scarcity can compromise quality control effectiveness for novel products.
Project Objectives & Role
In this internship project, I led the evaluation of unsupervised anomaly detection approaches for manufacturing quality control. The key objectives were:
- Evaluate and compare ten different anomaly detection models, focusing on:
- Processing capability for non-square images
- Heat map generation quality
- Model size and inference speed
- Detection accuracy (recall)
- Identify the most effective model for production deployment
Methods
We evaluated ten different anomaly detection models, focusing on their ability to process non-square images and produce meaningful heat maps. The models were trained on defect-free (OK) samples and tested on defective (NG) samples.
Results
Three models emerged as top performers:
Model | Heatmap Quality | Inference Speed | Model Size | Recall | Conclusion |
---|---|---|---|---|---|
EfficientAd [2] | Accurate | 2.3 min | 30 MB | 0.55607 | Best |
Reverse Distillation [3] | Little Noisy | 1.8 min | 340 MB | 0.40068 | Good |
Padim [4] | Noisy | 45.8 sec | 563 MB | 0.19527 | Not Good |
EfficientAd [2] demonstrated superior performance with:
- Most accurate heat map generation
- Smallest model size (30 MB)
- Highest recall score (0.55607)
- Effective localization of anomalous regions
Discussion
The unsupervised models serve multiple purposes:
- Generate annotation data for supervised models
- Assist in data quality inspection
- Identify anomaly signals including:
- Defects
- Lighting variations
- Layout differences
- Flag potentially defective samples without pre-existing annotations
- Social Value: By improving defect detection, we enhance product quality and safety, ultimately benefiting consumers and manufacturers.
Personal Contribution
In this internship project, I led the evaluation of unsupervised anomaly detection approaches for manufacturing quality control. The key objectives were:
- Evaluate and compare ten different anomaly detection models, focusing on:
- Processing capability for non-square images
- Heat map generation quality
- Model size and inference speed
- Detection accuracy (recall)
- Identify the most effective model for production deployment
- Role: My leadership and analytical skills were instrumental in identifying the best-performing model, contributing to the project’s success and its positive social impact.
References
[1] D. Weimer, B. Scholz-Reiter, and M. Shpitalni, “Design of deep convolutional neural network architectures for automated feature extraction in industrial inspection,” CIRP Annals, vol. 65, no. 1, pp. 417–420, 2016.
[2] K. Batzner, L. Heckler, and R. König, “EfficientAD: Accurate Visual Anomaly Detection at Millisecond-Level Latencies,” arXiv.org, Mar. 25, 2023.
[3] H. Deng and X. Li, “Anomaly Detection via Reverse Distillation from One-Class Embedding,” arXiv.org, 2022.
[4] T. Defard, Aleksandr Setkov, A. Loesch, and Romaric Audigier, “PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localization,” arXiv, Nov. 2020.