“Neural Pixel Error Detection” by Doggett, Wolak, Tsatsoulis and McCarthy

  • ©Erika Varis Doggett, Anna M.C. Wolak, P. Daphne Tsatsoulis, and Nicholas McCarthy



Entry Number: 23


    Neural Pixel Error Detection



    Current video quality control entails a manual review of every frame for every video for pixel errors. A pixel error is a single or small group of anomalous pixels displaying incorrect colors, arising from multiple sources in the video production pipeline. The detection process is difficult, time consuming, and rife with human error. In this work, we present a novel approach for automated pixel error detection, applying simple machine learning techniques to great effect. We use an autoencoder architecture followed by statistical post-processing to catch all tested live action pixel anomalies while keeping the false positive rate to a minimum. We discuss previous dead pixel detection methods in image processing, and compare to other machine learning approaches.


    Jinwon An and Sungzoon Cho. 2015. Variational Autoencoder based Anomaly Detection using Reconstruction Probability.
    Longin Jan Latecki, Aleksandar Lazarevic, and Dragoljub Pokrajac. 2007. Outlier Detection with Kernel Density Functions. In Proceedings of the 5th International Conference on Machine Learning and Data Mining in Pattern Recognition (MLDM ’07). Springer Verlag, Berlin, Heidelberg, 61–75. https://doi.org/10.1007/978-3-540-73499-4_6
    D. E. Rumelhart, G. E. Hinton, and R. J. Williams. 1986. Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1. MIT Press, Cambridge, MA, USA, Chapter Learning Internal Representations by Error Propagation, 318–362. http://dl.acm.org/citation.cfm?id=104279.104293
    Haowen Xu, Wenxiao Chen, Nengwen Zhao, Zeyan Li, Jiahao Bu, Zhihan Li, Ying Liu, Youjian Zhao, Dan Pei, Yang Feng, Jie Chen, Zhaogang Wang, and Honglin Qiao. 2018. Unsupervised Anomaly Detection via Variational Auto-Encoder for Seasonal KPIs in Web Applications. In Proceedings of the 2018 World Wide Web Conference (WWW ’18). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 187–196. https://doi.org/10.1145/ 3178876.3185996



ACM Digital Library Publication:

Overview Page: