Voice controlled Camera Assisted Pick and Place Robot Using Raspberry Pi

Authors

Muneera Altayeb
Al-Ahliyya Amman University image/svg+xml
Amani Al-Ghraibah
Al-Ahliyya Amman University image/svg+xml
DOI: https://doi.org/10.52549/ijeei.v10i1.3636
Download PDF
Published: 28-02-2022 • Issue: Vol. 10 No. 1: March 2022 • Section: Electronics_&_Signal_Processing

Abstract

Modern monitoring systems or manufacturing machines have a major drawback as they depend on human operators who can easily get distracted or make mistakes, so a system is needed that can constantly monitor the desired area and make decisions while identifying a pre-trained object. Tracking objects with a camera is critical in any automated monitoring and tracking system. The main goal of this paper is to design and implement a robot that can distinguish objects based on their features, such as color and size, and based on artificial intelligence and image processing algorithms.  The robot will analyze the video stream to detect the colored object, and specify its location inside the video frame. Using the detected position, the raspberry pi will decide the rotation direction whether it is to the right to the left, or forward until it reaches the object, grabs it and puts it in the robot's pocket.  The main controlling unit of the system is the Raspberry Pi, the robot is equipped with a Wi-Fi modem to communicate with the mobile application, which is used to control the robot in two modes: manual mode, where the user can point the robot in any direction either by pressing function button or through voice commands. The second mode is the Automatic mode, where the user can ask the robot to detect an object according to a set of characteristics and grab it without any human intervention and based on a novel digital image processing object-tracking algorithm, the accuracy in voice command mode has reached 95%.

 

 

Keywords: Electronics; computing; informatic

Author Biographies

Muneera Altayeb

is a lecturer in the Department of Electronics and Communications Engineering at Al-Ahliyya Amman University (AAU) since 2015. She earned her Master of Science in Communications Engineering from the University of Jordan in 2010. Altayeb was honored by the All Jordan Youth Commission (AJYC) for being ranked as the first student among the Bachelor Computer Engineering seventh batch that graduated from Al-Balqa’ University by the end of the academic year 2006-2007.

In addition to teaching courses and supervising students graduation projects during her work at AAU, she has filled a number of administrative positions such as the Liaison Officer of the Faculty of Engineering at the Public Relations Unit (2019-present), the Secretary of the Department  Board  of  Electronics  &  Communications  Engineering (2015-present) and being a member of the Quality Assurance Committee at the Faculty of Engineering (2018-present).

Her research interests are focused on the following areas: Digital Signals & Image Processing and Machine Learning.  Altayeb is also a member of The Institute of Electrical and Electronics Engineers (IEEE), the Jordanian Engineers Association (JEA) and AJYC.

 

 

Amani Al-Ghraibah

Amani Al-Ghraibah earned her BSc in Biomedical Engineering in 2008 from Jordan University of Science and Technology/ Jordan. She got her Ph.D. and MSc in Eelctrical and Computer Engineering from New Mexico State University/USA in 2012 and 2015, respecively. She is currently an assistant professor in the Medical Engineering department at Al-Ahliyya Amman University. Her research interest is in the fields of digital Signals & Images Processing and Pattern Recognition.

How to Cite

[1]
M. Altayeb and A. Al-Ghraibah, “Voice controlled Camera Assisted Pick and Place Robot Using Raspberry Pi”, IJEEI, vol. 10, no. 1, pp. 51–59, Feb. 2022, doi: 10.52549/ijeei.v10i1.3636.