Development of a neural network structure for identifying begin-end points in the assembly process

• Autorzy: Kutschenreiter-Praszkiewicz Izabela

Identyfikatory

DOI

10.36897/jme/163318

• Języki publikacji: EN

Abstrakty

EN

The paper presents an approach to video-based assembly analysis using machine learning. A neural network is one of the machine learning methods that is widely studied in many engineering fields. The purpose of this paper is to develop a deep neural network structure for identifying begin-end points for a selected component assembly process. A neural network structure that effectively identifies begin-end points is proposed and an example from industry is presented. The proposed approach can prove useful in the assembly process analysis.

Słowa kluczowe

EN

deep learning; assembly; begin-end point

• Wydawca: Wydawnictwo Wrocławskiej Rady FSNT NOT
• Czasopismo: Journal of Machine Engineering
• Rocznik: 2023
• Tom: Vol. 23, No. 2
• Strony: 100--109
• Opis fizyczny: Bibliogr. 29 poz., rys., tab.

Twórcy

autor

Kutschenreiter-Praszkiewicz Izabela

• Faculty of Mechanical Engineering and Computer Science, University of Bielsko-Biala, Bielsko-Biala Poland

Bibliografia

• [1] PUTNIK G., SHAH V., PUTNIK Z., FERREIRA L., 2020, Machine Learning in Cyber-Physical Systems and Manufacturing Singularity – It Does not Mean Total Automation, Human is Still in the Centre: Part I – Manufacturing Singularity and an Intelligent Machine Architecture, Journal of Machine Engineering, 20/4, 161–184, https://doi.org/10.36897/jme/131000.
• [2] PUTNIK G., SHAH V., PUTNIK Z., FERREIRA L., 2021, Machine Learning in Cyber-Physical Systems and Manufacturing Singularity – It Does not Mean Total Automation, Human is Still in the Centre: Part II – In-CPS and a View from Community on Industry 4.0 Impact on Society, Journal of Machine Engineering, 21/1, 133–153, https://doi.org/10.36897/jme/134245.
• [3] UHLMANN E., POLTE M., BLUMBERG J., KRAFT Z., 2021, Hyperparameter Optimization of Artificial Neural Networks to Improve the Positional Accuracy of Industrial Robots, Journal of Machine Engineering, 21/2, 47–59, https://doi.org/10.36897/jme/134275.
• [4] LÜ Q., LIU T., ZHANG R. et al., 2022, Generation Approach of Human-Robot Cooperative Assembly Strategy Based on Transfer Learning, J. Shanghai Jiaotong Univ. (Sci.), 27, 602–613.
• [5] WANG P., LIU H., WANG L., GAO R., 2018, Deep Learning-Based Human Motion Recognition for Predictive Context-Aware Human-Robot Collaboration, CIRP Annals – Manufacturing Technology, 67, 17–20.
• [6] SINHA S., FRANCIOSA P., CEGLAREK D., 2020, Object Shape Error Response Using Bayesian 3D Convolutional Neural Networks for Assembly Systems with Compliant Parts, IEEE 18th International Conference on Industrial Informatics (INDIN), Warwick, United Kingdom, 104–109, https://doi.org/10.1109/INDIN45582.-2020.9442245.
• [7] SINHA S., FRANCIOSA P., CEGLAREK D., 2021, Building a Scalable and Interpretable Bayesian Deep Learning Framework for Quality Control of Free Form Surfaces, IEEE Access, 9, 50188–50208, https://doi.org/10.1109/ACCESS.2021.3068867.
• [8] COPOT C., BURLACU A., LAZAR C., 2009, Image Moments Based Visual Control Algorithm for Servoing Systems, IEEE 5th International Conference on Intelligent Computer Communication and Processing, Cluj-Napoca, Romania, 157–160, https://doi.org/10.1109/ICCP.2009.5284768.
• [9] CHAUMETTE F.,2004, Image Moments: a General and Useful set of Features for Visual Servoing, in IEEE Transactions on Robotics, 20/4, 713–723, https://doi.org/10.1109/TRO.2004.829463.
• [10] WANG F., CUI B., LIU Y., REN B., 2022, Deep Reinforcement Learning for Peg‑in‑hole Assembly Task Via Information Utilization Method, Journal of Intelligent & Robotic Systems, 106, 16.
• [11] GROOVER M., 2016, Work Systems, the Methods,Measurement and Management of Work, Pearson.
• [12] KUTSCHENREITER-PRASZKIEWICZ I., 2015, Time Study, Wydawnictwo Naukowe Akademii Techniczno-Humanistycznej, (in Polish).
• [13] GAVALI P., BANU S., 2019, Chapter 6 – Deep Convolutional Neural Network for Image Classification on CUDA Platform, Editor(s): Arun Kumar Sangaiah, Deep Learning and Parallel Computing Environment for Bioengineering Systems, Academic Press, 99–122.
• [14] BURLACU A., COPOT C.,•LAZAR C., 2014, Predictive Control Architecture for Real-Time Image Moments Based Servoing of Robot Manipulators, J. Intell. Manuf., 25, 1125–1134.
• [15] MARCHAND E., CHAUMETTE F., 2005, Feature Tracking for Visual Servoing Purposes, Robotics and Autonomous Systems, 52/1, 53–70.
• [16] CHAUMETTE, F.,1998, Potential Problems of Stability and Convergence in Image-Based and Position-Based Visual Servoing, The Confluence of Cision and Control, 66–78.
• [17] SANGEETHA D., DEEPA P.,2017, A Low-Cost and High-Performance Architecture for Robust Human Detection Using Histogram of Edge Oriented Gradients, Microprocessors and Microsystems, 53, 106–119.
• [18] MADHAVAN S., JONES M., 2017, Deep Learning Architectures. The Rise of Artificial Intelligence, https://developer.ibm.com.
• [19] BOESCH G., 2023, Image Recognition: The Basics and Use Cases, https://viso.ai/computer-vision/image-recognition.
• [20] What is deep learning? https://www.ibm.com/topics/deep-learning.
• [21] LECUN Y, BENGIO Y, HINTON G., 2015, Deep Learning, Nature, 521(7553), 436–444, https://doi.org/10.1038/nature14539.
• [22] CIRESAN D., MEIER U., SCHMIDHUBER J., 2012, Multi-Column Deep Neural Networks for Image Classification, IEEE Conference on Computer Vision and Pattern Recognition, 3642–3649.
• [23] KRIZHEVSKY A., SUTSKEVER I., HINTON G., 2012, ImageNet Classification with Deep Convolutional Neural Networks, Advances in Neural Information Processing Systems, 25, 1097–1105.
• [24] Long Short-Term Memory (LSTM) https://uk.mathworks.com/discovery/lstm.html.
• [25] ALVES G., 2018, Discovering SOM, An Unsupervised Neural Network, https://Medium.Com/Neuronio/Discovering-Som-An-Unsupervised-Neural-Network-12e787f38f9.
• [26] ZAMORA-HERNANDEZ M., CASTRO-VARGAS J., AZORIN-LOPEZ J., GARCIA-RODRIGUEZ J., 2021, Deep Learning-Based Visual Control Assistant for Assembly in Industry 4.0, Computers in Industry 131,103485.
• [27] KRÜGER J., LEHR J., SCHLÜTER M., BISCHOFF N., 2019, Deep Learning for Part Identification Based on Inherent Features, CIRP Annals – Manufacturing Technology, 68, 9–12.
• [28] SRIVASTAVA N., HINTON G., KRIZHEVSKY A., SUTSKEVER I., SALAKHUTDINOV R., 2014, Dropout: A Simple Way to Prevent Neural Networks from Overfitting, Journal of Machine Learning Research, 15, 1929–1958.
• [29] BISHOP C., 2006, Pattern Recognition and Machine Learning, Springer.

Uwagi

Opracowanie rekordu ze środków MEiN, umowa nr SONP/SP/546092/2022 w ramach programu "Społeczna odpowiedzialność nauki" - moduł: Popularyzacja nauki i promocja sportu (2022-2023).