Deep Learning Techniques for Advanced Drone Detection Systems: A Comprehensive Review of Techniques, Challenges and Future Directions

Fatin Najihah Muhamad Zamri, Teddy Surya Gunawan, Mira Kartiwi, Agus Pratondo, Siti Hajar Yusoff, Yasir Mohd. Mustafah

Abstract


The widespread use of Unmanned Aerial Vehicles (UAVs), commonly known as drones, across various sectors, such as civilian, commercial, and military operations, has created significant challenges in ensuring security, safety, and privacy. This paper provides a comprehensive review of the latest advancements in drone detection systems leveraging deep learning techniques, covering the period from 2020 to 2024. It critically evaluates both optical (visible light and thermal infrared) and non-optical (radio frequency, radar, and acoustic) detection methodologies. The analysis includes cutting-edge models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Generative Adversarial Networks (GANs), focusing on their application in drone detection. Key challenges like real-time processing, environmental interference, and differentiation between drones and similar objects are examined. Potential solutions, including sensor fusion, attention mechanisms, and the integration of emerging technologies such as the Internet of Things (IoT) and 5G networks, are discussed in detail. The paper concludes with future research directions to enhance drone detection systems' robustness, scalability, and accuracy, particularly in complex and dynamic environments. This review offers valuable insights for researchers and industry professionals working towards next-generation drone detection technologies.

Keywords


Drone detection; Deep learning; Sensor fusion; Real-time processing; UAV security; Thermal infrared imaging; Radio frequency detection; Radar-based detection; Acoustic-based detection

References


S. Park, H. T. Kim, S. Lee, H. Joo, and H. Kim, "Survey on Anti-Drone Systems: Components, Designs, and Challenges," IEEE Access, vol. 9, 2021, doi: 10.1109/ACCESS.2021.3065926.

M. A. Khan, H. Menouar, A. Eldeeb, A. Abu-Dayya, and F. D. Salim, "On the Detection of Unauthorized Drones - Techniques and Future Perspectives: A Review," IEEE Sensors Journal, vol. 22, no. 12, pp. 11439-11455, 2022, doi: 10.1109/JSEN.2022.3171293.

M. H. Rahman, M. A. S. Sejan, M. A. Aziz, R. Tabassum, J. I. Baik, and H. K. Song, "A Comprehensive Survey of Unmanned Aerial Vehicles Detection and Classification Using Machine Learning Approach: Challenges, Solutions, and Future Directions," Remote Sensing, vol. 16, 2024, doi: 10.3390/rs16050879.

N. Al-lQubaydhi et al., "Deep learning for unmanned aerial vehicles detection: A review," Computer Science Review, vol. 51, 2024, doi: 10.1016/j.cosrev.2023.100614.

U. Seidaliyeva, L. Ilipbayeva, K. Taissariyeva, N. Smailov, and E. T. Matson, "Advances and Challenges in Drone Detection and Classification Techniques: A State-of-the-Art Review," Sensors, vol. 24, no. 1, 2024, doi: 10.3390/s24010125.

R. J. Bunker and J. P. Sullivan, "Additional Weaponized Consumer Drone Incidents in Michoacán and Puebla, MX," in Small Wars Journal, ed, 2021.

E. Ogao, "88 dead after military drone mistakenly strikes festival in Nigeria's Kaduna State, local officials say," in ABC News, ed, 2023.

Amnesty, "Mali: Drone strikes killed 13 civilians including seven children in Amasrakad," in Amnesty International, ed, 2024.

"Worldwide Drone Incidents." https://www.dedrone.com/resources/incidents-new/all (accessed 6 April, 2024).

Y. Andrew. "Heathrow's runway had to be closed after illegally flown drone was 3ft away from smashing into Finnair plane flying at nearly 200mph, report reveals." https://www.dailymail.co.uk/news/article-12263721/Heathrow-runway-closed-illegally-flown-drone-3ft-hitting-200mph-Finnair-plane.html (accessed 6 April, 2024).

C. Pittsburgh, "Unauthorized drone causes temporary ground stoppage at Pittsburgh International Airport," in CBS News, ed, 2023.

M. Stephanie, "Drone being used to harass students undergoing trauma therapy in Asheville, organization says," in WYFF4, ed, 2022.

G. Michele, "Drone hovers over house, peeps into daughter’s room, mother says," in KPLC, ed, 2022.

U. Seidaliyeva, D. Akhmetov, L. Ilipbayeva, and E. T. Matson, "Real-time and accurate drone detection in a video with a static background," Sensors (Switzerland), vol. 20, no. 14, pp. 1-18, 2020, doi: 10.3390/s20143856.

H. Liu, K. Fan, Q. Ouyang, and N. Li, "Real-time small drones detection based on pruned yolov4," Sensors, vol. 21, no. 10, 2021, doi: 10.3390/s21103374.

S. A. H. Mohsan, N. Q. H. Othman, Y. Li, M. H. Alsharif, and M. A. Khan, "Unmanned aerial vehicles (UAVs): practical aspects, applications, open challenges, security issues, and future trends," Intelligent Service Robotics, vol. 16, 2023, doi: 10.1007/s11370-022-00452-4.

C. Craye and S. Ardjoune, "Spatio-temporal semantic segmentation for drone detection," in 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance, AVSS 2019, 2019, doi: 10.1109/AVSS.2019.8909854.

M. Nalamati, A. Kapoor, M. Saqib, N. Sharma, and M. Blumenstein, "Drone detection in long-range surveillance videos," in 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance, AVSS 2019, 2019/9// 2019: Institute of Electrical and Electronics Engineers Inc., doi: 10.1109/AVSS.2019.8909830.

A. Coluccia et al., "Drone-vs-Bird detection challenge at IEEE AVSS2017," in 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance, AVSS 2017, 2017, doi: 10.1109/AVSS.2017.8078464.

A. Coluccia et al., "Drone-vs-Bird Detection Challenge at IEEE AVSS2019," in 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 2019/9// 2019: IEEE, pp. 1-7, doi: 10.1109/AVSS.2019.8909876.

A. Coluccia et al., "Drone-vs-Bird Detection Challenge at IEEE AVSS2021," in AVSS 2021 - 17th IEEE International Conference on Advanced Video and Signal-Based Surveillance, 2021: Institute of Electrical and Electronics Engineers Inc., doi: 10.1109/AVSS52988.2021.9663844.

A. Coluccia, A. Fascista, L. Sommer, A. Schumann, A. Dimou, and D. Zarpalas, "The Drone-vs-Bird Detection Grand Challenge at ICASSP 2023: A Review of Methods and Results," IEEE Open Journal of Signal Processing, 2024, doi: 10.1109/OJSP.2024.3379073.

Y. Zhang, N. Suda, L. Lai, and V. Chandra, "Hello Edge: Keyword Spotting on Microcontrollers," arXiv preprint arXiv:1711.07128, 2017.

M. Zhou, "Research Advanced in Deep Learning Object Detection," in 2022 IEEE Conference on Telecommunications, Optics and Computer Science, TOCS 2022, 2022, doi: 10.1109/TOCS56154.2022.10016018.

D. K. Behera and A. B. Raj, "Drone Detection and Classification using Deep Learning," in Proceedings of the International Conference on Intelligent Computing and Control Systems, ICICCS 2020, 2020, doi: 10.1109/ICICCS48265.2020.9121150.

T. Yigitcanlar et al., "Artificial Intelligence Technologies and Related Urban Planning and Development Concepts: How Are They Perceived and Utilized in Australia?," Journal of Open Innovation: Technology, Market, and Complexity, vol. 6, no. 4, pp. 187-187, 2020/12// 2020, doi: 10.3390/joitmc6040187.

P. P. Shinde and S. Shah, "A Review of Machine Learning and Deep Learning Applications," in Proceedings - 2018 4th International Conference on Computing, Communication Control and Automation, ICCUBEA 2018, 2018/7// 2018: Institute of Electrical and Electronics Engineers Inc., doi: 10.1109/ICCUBEA.2018.8697857.

C. Janiesch, P. Zschech, and K. Heinrich, "Machine learning and deep learning," Electronic Markets, vol. 31, no. 3, 2021, doi: 10.1007/s12525-021-00475-2.

L. Liu et al., "Deep Learning for Generic Object Detection: A Survey," International Journal of Computer Vision, vol. 128, no. 2, pp. 261-318, 2020, doi: 10.1007/s11263-019-01247-4.

P. Shruti and R. Rekha, "A Review of Convolutional Neural Networks, its Variants and Applications," in 2023 International Conference on Intelligent Systems for Communication, IoT and Security (ICISCoIS), Coimbatore, India, 2023: IEEE, pp. 31-36, doi: 10.1109/ICISCoIS56541.2023.10100412.

S. Hochreiter and J. Schmidhuber, "Long Short-Term Memory," Neural Computation, vol. 9, no. 8, pp. 1735-1780, 1997, doi: 10.1162/neco.1997.9.8.1735.

I. Goodfellow et al., "Generative Adversarial Nets," in Advances in neural information processing systems, 2014 2014, vol. 27: Curran Associates, Inc.

M. Jayasree and L. K. Rao, "A Deep Insight into Deep Learning Architectures, Algorithms and Applications," in Proceedings of the International Conference on Electronics and Renewable Systems, ICEARS 2022, Tuticorin, India, 2022: IEEE, pp. 1134-1142, doi: 10.1109/ICEARS53579.2022.9752225.

E. Suryawati et al., "Unsupervised feature learning-based encoder and adversarial networks," Journal of Big Data, vol. 8, no. 1, 2021, doi: 10.1186/s40537-021-00508-9.

K. Wang, C. Gou, Y. Duan, Y. Lin, X. Zheng, and F. Y. Wang, "Generative adversarial networks: Introduction and outlook," EEE/CAA Journal of Automatica Sinica, vol. 4, pp. 588-598, 2017, doi: 10.1109/JAS.2017.7510583.

Y. Hong, U. Hwang, J. Yoo, and S. Yoon, "How generative adversarial networks and their variants work: An overview," ACM Computing Surveys (CSUR), vol. 52, 2019, doi: 10.1145/3301282.

L. Zhang, A. Gonzalez-Garcia, J. Van De Weijer, M. Danelljan, and F. S. Khan, "Synthetic Data Generation for End-To-End Thermal Infrared Tracking," IEEE Transactions on Image Processing, vol. 28, no. 4, 2019, doi: 10.1109/TIP.2018.2879249.

O. Ronneberger, P. Fischer, and T. Brox, "U-net: Convolutional networks for biomedical image segmentation," in Medical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, 2015: Springer International Publishing, doi: 10.1007/978-3-319-24574-4_28.

P. Isola, J. Y. Zhu, T. Zhou, and A. A. Efros, "Image-to-image translation with conditional adversarial networks," in IEEE conference on computer vision and pattern recognition, 2017 2017: IEEE, doi: 10.1109/CVPR.2017.632.

C. Li and M. Wand, "Precomputed real-time texture synthesis with markovian generative adversarial networks," presented at the Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, 2016, 2016.

J. Y. Zhu, T. Park, P. Isola, and A. A. Efros, "Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks," in 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 2017 2017: IEEE, pp. 2242-2251, doi: 10.1109/ICCV.2017.244.

J. H. Kim and Y. Hwang, "GAN-Based Synthetic Data Augmentation for Infrared Small Target Detection," IEEE Transactions on Geoscience and Remote Sensing, vol. 60, 2022, doi: 10.1109/TGRS.2022.3179891.

J. Y. Zhu et al., "Toward multimodal image-to-image translation," in 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA, 2017 2017, vol. 30: Advances in neural information processing systems.

S. Al-Emadi, A. Al-Ali, and A. Al-Ali, "Audio-based drone detection and identification using deep learning techniques with dataset enhancement through generative adversarial networks†," Sensors, vol. 21, no. 15, 2021, doi: 10.3390/s21154953.

C. Donahue, J. McAuley, and M. Puckette, "Adversarial audio synthesis," in 7th International Conference on Learning Representations, ICLR 2019, 2019.

S. S. Alam et al., "RF-Enabled Deep-Learning-Assisted Drone Detection and Identification: An End-to-End Approach," Sensors, vol. 23, no. 9, pp. 4202-4202, 2023/4// 2023, doi: 10.3390/s23094202.

O. Medaiyese, M. Ezuma, A. Lauf, and A. Adeniran. Cardinal RF (CardRF): An Outdoor UAV/UAS/Drone RF Signals with Bluetooth and WiFi Signals Dataset, doi: https://dx.doi.org/10.21227/1xp7-ge95.

O. O. Medaiyese, M. Ezuma, A. P. Lauf, and I. Guvenc, "Wavelet transform analytics for RF-based UAV detection and identification system using machine learning," Pervasive and Mobile Computing, vol. 82, 2022, doi: 10.1016/j.pmcj.2022.101569.

M. S. Allahham, T. Khattab, and A. Mohamed, "Deep Learning for RF-Based Drone Detection and Identification: A Multi-Channel 1-D Convolutional Neural Networks Approach," in 2020 IEEE International Conference on Informatics, IoT, and Enabling Technologies, ICIoT 2020, Doha, Qatar, 2020: IEEE, doi: 10.1109/ICIoT48696.2020.9089657.

M. Al-Sa'd, M. S. Allahham, A. Mohamed, A. Al-Ali, T. Khattab, and A. Erbad. DroneRF dataset: A dataset of drones for RF-based detection, classification, and identification, doi: 10.17632/f4c2b4n755.1.

"USRP Software Defined Radio Device - National Instruments." National Instruments Corp. https://www.ni.com/en/shop/wireless-design-test/what-is-a-usrp-software-defined-radio.html?srsltid=AfmBOoqqczjOMwFo-uqMjP-14Re2SeiZUZ0imDf9WP2ni9ZpXHdEclv5 (accessed 6 April, 2024).

M. F. Al-Sa’d, A. Al-Ali, A. Mohamed, T. Khattab, and A. Erbad, "RF-based drone detection and identification using deep learning approaches: An initiative towards a large open source drone database," Future Generation Computer Systems, vol. 100, pp. 86-97, 2019/11// 2019, doi: 10.1016/j.future.2019.05.007.

M. Misbah, M. Dil, W. Khalid, and Z. Kaleem, "RF-NeuralNet: Lightweight Deep Learning Framework for Detecting Rogue Drones from Radio Frequency Signatures," in 2023 7th International Conference on Automation, Control and Robots (ICACR), Kuala Lumpur, Malaysia, 2023: IEEE, pp. 163-167, doi: 10.1109/ICACR59381.2023.10314637.

S. Abeywickrama, L. Jayasinghe, H. Fu, S. Nissanka, and C. Yuen, "RF-based Direction Finding of UAVs Using DNN," in 2018 IEEE International Conference on Communication Systems, ICCS 2018, Chengdu, China, 2018: IEEE, doi: 10.1109/ICCS.2018.8689177.

R. Akter, V. S. Doan, G. B. Tunze, J. M. Lee, and D. S. Kim, "RF-Based UAV Surveillance System: A Sequential Convolution Neural Networks Approach," in 2020 International Conference on Information and Communication Technology Convergence (ICTC), Jeju, Korea (South), 2020: IEEE, doi: 10.1109/ICTC49870.2020.9289281.

T. Huynh-The, Q. V. Pham, T. V. Nguyen, D. B. D. Costa, and D. S. Kim, "RF-UAVNet: High-Performance Convolutional Network for RF-Based Drone Surveillance Systems," IEEE Access, vol. 10, 2022, doi: 10.1109/ACCESS.2022.3172787.

S. Basak, S. Rajendran, S. Pollin, and B. Scheers, "Drone classification from RF fingerprints using deep residual nets," in 2021 International Conference on COMmunication Systems & NETworkS (COMSNETS), Bangalore, India, 2021: IEEE, doi: 10.1109/COMSNETS51098.2021.9352891.

S. Basak. "Drone signals." https://github.com/sanjoy-basak/dronesignals (accessed 2024).

F. Hoffmann, M. Ritchie, F. Fioranelli, A. Charlish, and H. Griffiths, "Micro-Doppler based detection and tracking of UAVs with multistatic radar," in 2016 IEEE Radar Conference (RadarConf), Philadelphia, PA, USA, 2016: IEEE, pp. 1-6, doi: 10.1109/RADAR.2016.7485236.

D. Yu, L. Deng, I. Jang, P. Kudumakis, M. Sandler, and K. Kang, "Deep learning and its applications to signal and information processing," IEEE Signal Processing Magazine, vol. 28, no. 1, 2011, doi: 10.1109/MSP.2010.939038.

P. Hügler, F. Roos, M. Schartel, M. Geiger, and C. Waldschmidt, "Radar Taking Off: New Capabilities for UAVs," IEEE Microwave Magazine, vol. 19, no. 7, pp. 43-53, 2018, doi: 10.1109/MMM.2018.2862558.

R. Fu, M. A. Al-Absi, K. H. Kim, Y. S. Lee, A. A. Al-Absi, and H. J. Lee, "Deep Learning-Based Drone Classification Using Radar Cross Section Signatures at mmWave Frequencies," IEEE Access, vol. 9, 2021, doi: 10.1109/ACCESS.2021.3115805.

M. Polese, L. Bertizzolo, L. Bonati, A. Gosain, and T. Melodia, "An Experimental mmWave Channel Model for UAV-to-UAV Communications," in Proceedings of the 4th ACM Workshop on Millimeter-Wave Networks and Sensing Systems, mmNets 2020, New York, NY, USA, 2020: Association for Computing Machinery, doi: 10.1145/3412060.3418431.

B. K. Kim, H. S. Kang, S. Lee, and S. O. Park, "Improved Drone Classification Using Polarimetric Merged-Doppler Images," IEEE Geoscience and Remote Sensing Letters, vol. 18, no. 11, 2021, doi: 10.1109/LGRS.2020.3011114.

A. Karlsson, M. Jansson, and M. Hämäläinen, "Model-Aided Drone Classification Using Convolutional Neural Networks," in 2022 IEEE Radar Conference (RadarConf22, New York City, NY, USA, 2022: IEEE, pp. 1-6, doi: 10.1109/RadarConf2248738.2022.9764194.

I. Roldan et al., "DopplerNet: a convolutional neural network for recognising targets in real scenarios using a persistent range–Doppler radar," IET Radar, Sonar & Navigation, vol. 14, no. 4, pp. 593-600, 2020/04/01 2020, doi: https://doi.org/10.1049/iet-rsn.2019.0307.

"IRIS Drone Radar.": https://www.robinradar.com/iris-counter-drone-rada (accessed 6 April, 2024).

S. Gomez, A. Johnson, and P. Ramesh Babu, "Classification of Radar Targets Based on Micro-Doppler Features Using High Frequency High Resolution Radar Signatures," in 2023 International Conference on Network, Multimedia and Information Technology (NMITCON), 2023, pp. 1-5, doi: 10.1109/NMITCON58196.2023.10276375.

Y. Kim and T. Moon, "Human detection and activity classification based on micro-doppler signatures using deep convolutional neural networks," IEEE Geoscience and Remote Sensing Letters, vol. 13, no. 1, 2016, doi: 10.1109/LGRS.2015.2491329.

A. Angelov, A. Robertson, R. Murray-Smith, and F. Fioranelli, "Practical classification of different moving targets using automotive radar and deep neural networks," IET Radar, Sonar and Navigation, vol. 12, no. 10, 2018, doi: 10.1049/iet-rsn.2018.0103.

S. Rahman and D. A. Robertson, "Classification of drones and birds using convolutional neural networks applied to radar micro-Doppler spectrogram images," IET Radar, Sonar and Navigation, vol. 14, no. 5, 2020, doi: 10.1049/iet-rsn.2019.0493.

A. J. Garcia, A. Aouto, J. M. Lee, and D. S. Kim, "CNN-32DC: An improved radar-based drone recognition system based on Convolutional Neural Network," ICT Express, vol. 8, no. 4, 2022, doi: 10.1016/j.icte.2022.04.012.

H. Haifawi, F. Fioranelli, A. Yarovoy, and R. Van Der Meer, "Drone Detection & Classification with Surveillance 'Radar On-The-Move' and YOLO," in 2023 IEEE Radar Conference (RadarConf23), San Antonio, TX, USA, 2023: IEEE, pp. 1-6, doi: 10.1109/RadarConf2351548.2023.10149588.

C. A. Ahmed, F. Batool, W. Haider, M. Asad, and S. H. Raza Hamdani, "Acoustic Based Drone Detection Via Machine Learning," in 2022 International Conference on IT and Industrial Technologies, ICIT 2022, 2022, doi: 10.1109/ICIT56493.2022.9989229.

V. Alaparthy, S. Mandal, and M. Cummings, "Machine Learning vs. Human Performance in the Realtime Acoustic Detection of Drones," in 2021 IEEE Aerospace Conference (50100), Big Sky, MT, USA, 2021: IEEE, pp. 1-7, doi: 10.1109/AERO50100.2021.9438533.

S. Salman, J. Mir, M. T. Farooq, A. N. Malik, and R. Haleemdeen, "Machine Learning Inspired Efficient Audio Drone Detection using Acoustic Features," in 2021 International Bhurban Conference on Applied Sciences and Technologies (IBCAST), Islamabad, Pakistan, 2021: IEEE, pp. 335-339, doi: 10.1109/IBCAST51254.2021.9393232.

M. Yaacoub, H. Younes, and M. Rizk, "Acoustic Drone Detection Based on Transfer Learning and Frequency Domain Features," in 2022 International Conference on Smart Systems and Power Management (IC2SPM), Beirut, Lebanon, 2022: IEEE, pp. 47-51, doi: 10.1109/IC2SPM56638.2022.9988816.

F. Svanström, C. Englund, and F. Alonso-Fernandez, "Real-time drone detection and tracking with visible, thermal and acoustic sensors," in 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy, 2020: IEEE, doi: 10.1109/ICPR48806.2021.9413241.

S. Al-Emadi, A. Al-Ali, A. Mohammad, and A. Al-Ali, "Audio based drone detection and identification using deep learning," in 2019 15th International Wireless Communications & Mobile Computing Conference (IWCMC), Tangier, Morocco, 2019: IEEE, pp. 459-464, doi: 10.1109/IWCMC.2019.8766732.

H. Kolamunna et al., "AcousticPrint: Acoustic signature based open set drone identification," in 13th ACM Conference on Security and Privacy in Wireless and Mobile Networks, 2020: Association for Computing Machinery, doi: 10.1145/3395351.3401700.

S. Al-Emadi. "DroneAudioDataset." https://github.com/saraalemadi/DroneAudioDataset (accessed 2024).

S. Kümmritz and L. Paul, "COMPREHENSIVE DATABASE OF UAV SOUNDS FOR MACHINE LEARNING," in 10th Convention of the European Acoustics Association, Turin, Italy, 2023: Forum Acusticum 2023, doi: 10.61782/fa.2023.0049.

S. Mandal, L. Chen, V. Alaparthy, and M. Cummings, "Acoustic detection of drones through real-time audio attribute prediction," in AIAA Scitech 2020 Forum, 2020, vol. 1 PartF, doi: 10.2514/6.2020-0491.

Q. Kong, Y. Cao, T. Iqbal, Y. Wang, W. Wang, and M. D. Plumbley, "PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognition," IEEE/ACM Transactions on Audio Speech and Language Processing, vol. 28, 2020, doi: 10.1109/TASLP.2020.3030497.

J. F. Gemmeke et al., "Audio Set: An ontology and human-labeled dataset for audio events," in 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA, 2017: IEEE, doi: 10.1109/ICASSP.2017.7952261.

I. Goodfellow et al., "Generative adversarial networks," Communications of the ACM, vol. 63, no. 11, pp. 139-144, 2020/10// 2020, doi: 10.1145/3422622.

S. Kümmritz, "The Sound of Surveillance: Enhancing Machine Learning-Driven Drone Detection with Advanced Acoustic Augmentation," Drones, vol. 8, no. 3, 2024, doi: 10.3390/drones8030105.

Z. Q. Zhao, P. Zheng, S. T. Xu, and X. Wu, "Object Detection with Deep Learning: A Review," IEEE Transactions on Neural Networks and Learning Systems, vol. 30, 2019, doi: 10.1109/TNNLS.2018.2876865.

X. Zhai, Z. Huang, T. Li, H. Liu, and S. Wang, "YOLO-Drone: An Optimized YOLOv8 Network for Tiny UAV Object Detection," Electronics (Switzerland), vol. 12, no. 17, 2023/9// 2023, doi: 10.3390/electronics12173664.

H. J. Al Dawasari, M. Bilal, M. Moinuddin, K. Arshad, and K. Assaleh, "DeepVision: Enhanced Drone Detection and Recognition in Visible Imagery through Deep Learning Networks," Sensors (Basel, Switzerland), vol. 23, no. 21, 2023, doi: 10.3390/s23218711.

J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, "You Only Look Once: Unified, Real-Time Object Detection," in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016/6// 2016: IEEE, pp. 779-788, doi: 10.1109/CVPR.2016.91.

W. Liu et al., "SSD: Single shot multibox detector," in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2016, vol. 9905 LNCS: Springer Verlag, pp. 21-37, doi: 10.1007/978-3-319-46448-0_2.

R. Girshick, J. Donahue, T. Darrell, and J. Malik, "Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation," in 2014 IEEE Conference on Computer Vision and Pattern Recognition, 2014/6// 2014: IEEE, pp. 580-587, doi: 10.1109/CVPR.2014.81.

R. Girshick, "Fast R-CNN," in 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 2015: IEEE, pp. 1440-1448, doi: 10.1109/ICCV.2015.169.

S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 6, pp. 1137-1149, 2017/6// 2017, doi: 10.1109/TPAMI.2016.2577031.

B. Bosquet, M. Mucientes, and V. M. Brea, "STDNet: A convnet for small target detection," in British Machine Vision Conference (BMVC) 2018, 2018.

H. Cai, Y. Xie, J. Xu, and Z. Xiong, "A Lightweight and Accurate UAV Detection Method Based on YOLOv4," Sensors, vol. 22, no. 18, 2022, doi: 10.3390/s22186874.

S. Singha and B. Aydin, "Automated drone detection using YOLOv4," Drones, vol. 5, no. 3, 2021, doi: 10.3390/drones5030095.

Y. Sun et al., "Enhancing UAV Detection in Surveillance Camera Videos through Spatiotemporal Information and Optical Flow," Sensors, vol. 23, no. 13, 2023/7// 2023, doi: 10.3390/s23136037.

S. Jamil, M. S. Abbas, and A. M. Roy, "Distinguishing Malicious Drones Using Vision Transformer," AI (Switzerland), vol. 3, no. 2, 2022, doi: 10.3390/ai3020016.

"Drone-vs-Bird Detection Challenge." https://wosdetc2023.wordpress.com (accessed 2024).

H. Sun, J. Yang, J. Shen, D. Liang, L. Ning-Zhong, and H. Zhou, "TIB-Net: Drone Detection Network with Tiny Iterative Backbone," IEEE Access, vol. 8, pp. 130697-130707, 2020, doi: 10.1109/ACCESS.2020.3009518.

L. M. Wastupranata and R. Munir, "UAV Detection using Web Application Approach based on SSD Pre-Trained Model," in Proceedings of the 2021 IEEE International Conference on Aerospace Electronics and Remote Sensing Technology, ICARES 2021, Bali, Indonesia, 2021: IEEE, doi: 10.1109/ICARES53960.2021.9665191.

B. Aydin and S. Singha, "Drone Detection Using YOLOv5," Eng, vol. 4, no. 1, pp. 416-433, 2023/2// 2023, doi: 10.3390/eng4010025.

J.-H. Kim, N. Kim, and C. S. Won, "High-Speed Drone Detection Based On Yolo-V8," in ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece, 2023: IEEE, pp. 1-2, doi: 10.1109/icassp49357.2023.10095516.

P. Andraši, T. Radišić, M. Muštra, and J. Ivošević, "Night-time Detection of UAVs using Thermal Infrared Camera," Transportation Research Procedia, vol. 28, pp. 183-190, 2017/01/01/ 2017, doi: https://doi.org/10.1016/j.trpro.2017.12.184.

Z. Yang, J. Lian, and J. Liu, "Infrared UAV Target Detection Based on Continuous-Coupled Neural Network," Micromachines, vol. 14, no. 11, 2023, doi: 10.3390/mi14112113.

Z. Lin, M. Huang, and Q. Zhou, "Infrared small target detection based on YOLO v4," 2023, vol. 2450, 1 ed., doi: 10.1088/1742-6596/2450/1/012019.

Z. Lin, M. Huang, and Q. Zhou, "Infrared small target detection based on YOLOv4," Journal of Physics: Conference Series, vol. 2450, 2023 2023, doi: 10.1088/1742-6596/2450/1/012019.

N. A. Wilson, A. Jha, A. Kumar, and L. R. Cenkeramaddi, "Estimation of UAV Count Using Thermal Imaging and Lightweight CNN," in 2023 11th International Conference on Control, Mechatronics and Automation (ICCMA), Grimstad, Norway, 2023 2023: IEEE, pp. 92-96, doi: 10.1109/ICCMA59762.2023.10374791.

S. Yuan et al., "IRSDD-YOLOv5: Focusing on the Infrared Detection of Small Drones," Drones, vol. 7, no. 6, 2023, doi: 10.3390/drones7060393.

F. Svanström, F. Alonso-Fernandez, and C. Englund, "A dataset for multi-sensor drone detection," Data in Brief, vol. 39, 2021, doi: 10.1016/j.dib.2021.107521.

N. Jiang et al., "Anti-UAV: A Large Multi-Modal Benchmark for UAV Tracking," arXiv preprint arXiv:2101.08466 (2021), 2021.

B. Huang, J. Li, J. Chen, G. Wang, J. Zhao, and T. Xu, "Anti-UAV410: A Thermal Infrared Benchmark and Customized Scheme for Tracking Drones in the Wild," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 46, no. 5, 2024, doi: 10.1109/TPAMI.2023.3335338.

H. Chen, K. Sun, Z. Tian, C. Shen, Y. Huang, and Y. Yan, "Blendmask: Top-down meets bottom-up for instance segmentation," in IEEE/CVF conference on computer vision and pattern recognition, 2020 2020, pp. 8573-8581, doi: 10.1109/CVPR42600.2020.00860.

Z. Tian, B. Zhang, H. Chen, and C. Shen, "Instance and Panoptic Segmentation Using Conditional Convolutions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 1, 2022, doi: 10.1109/TPAMI.2022.3145407.

X. Wang, R. Zhang, T. Kong, L. Li, and C. Shen, "SOLOv2: Dynamic and fast instance segmentation," in 34th Conference on Neural Information Processing Systems (NeurIPS 2020), Vancouver, Canada, 2020 2020.

D. Jifeng, K. He, and J. Sun, "BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation," in 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 2015 2015: IEEE, pp. 1635-1643, doi: 10.1109/ICCV.2015.191.

D. Bolya, C. Zhou, F. Xiao, and Y. J. Lee, "YOLACT++ Better Real-Time Instance Segmentation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 2, 2022, doi: 10.1109/TPAMI.2020.3014297.

K. He, G. Gkioxari, P. Dollár, and R. Girshick, "Mask R-CNN," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 2, 2020, doi: 10.1109/TPAMI.2018.2844175.

C.-Y. Wang, A. Bochkovskiy, and H.-Y. M. Liao, "YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors," in 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023, pp. 7464-7475.

A. Bentamou, A. Zein-Eddine, O. Messai, and Y. Gavet, "Real-Time Drone Detection and Tracking in Distorted Infrared Images," in 2023 IEEE International Conference on Image Processing Kuala Lumpur, Malaysia, 2023 2023: IEEE, doi: 10.1109/ICIPC59416.2023.10328374.

C. A. Ahmed, F. Batool, W. Haider, M. Asad, and S. H. Raza Hamdani, "Acoustic Based Drone Detection Via Machine Learning," in 2022 International Conference on IT and Industrial Technologies (ICIT), Chiniot, Pakistan, 2022: IEEE, doi: 10.1109/ICIT56493.2022.9989229.

F. Najihah Muhamad Zamri, T. S. Gunawan, S. Hajar Yusoff, A. A. Alzahrani, A. Bramantoro, and M. Kartiwi, "Enhanced Small Drone Detection Using Optimized YOLOv8 With Attention Mechanisms," IEEE Access, vol. 12, no. May, pp. 90629-90643, 2024, doi: 10.1109/ACCESS.2024.3420730.

J. Kim et al., "Deep Learning Based Malicious Drone Detection Using Acoustic and Image Data," in 2022 Sixth IEEE International Conference on Robotic Computing (IRC), Italy, 2022: IEEE, doi: 10.1109/IRC55401.2022.00024.

S. E. Abdelsamad et al., "Vision-Based Support for the Detection and Recognition of Drones with Small Radar Cross Sections," Electronics (Switzerland), vol. 12, no. 10, 2023, doi: 10.3390/electronics12102235.

C. Wang, J. Tian, J. Cao, and X. Wang, "Deep Learning-Based UAV Detection in Pulse-Doppler Radar," IEEE Transactions on Geoscience and Remote Sensing, vol. 60, 2022, doi: 10.1109/TGRS.2021.3104907.

Y. Sun, S. Abeywickrama, L. Jayasinghe, C. Yuen, J. Chen, and M. Zhang, "Micro-Doppler Signature-Based Detection, Classification, and Localization of Small UAV with Long Short-Term Memory Neural Network," IEEE Transactions on Geoscience and Remote Sensing, vol. 59, no. 8, 2021, doi: 10.1109/TGRS.2020.3028654.

X. Cai and K. Sarabandi, "A machine learning based 77 GHz radar target classification for autonomous vehicles," in 2019 IEEE International Symposium on Antennas and Propagation and USNC-URSI Radio Science Meeting, Atlanta, GA, USA, 2019: IEEE, doi: 10.1109/APUSNCURSINRSM.2019.8888647.

W. Kim, H. Cho, J. Kim, B. Kim, and S. Lee, "Target Classification Using Combined YOLO-SVM in High-Resolution Automotive FMCW Radar," in 2020 IEEE Radar Conference (RadarConf20), IEEE, 2020: Florence, Italy, doi: 10.1109/RadarConf2043947.2020.9266477.

W. Zhang, S. Li, C. Zhu, and C. Wang, "Classification of combination target's components based on deep learning," in 2019 International Applied Computational Electromagnetics Society Symposium-China, ACES 2019, 2019, doi: 10.23919/ACES48530.2019.9060725.

V. Mehta, F. Dadboud, M. Bolic, and I. Mantegh, "A Deep Learning Approach for Drone Detection and Classification Using Radar and Camera Sensor Fusion," in 2023 IEEE Sensors Applications Symposium, SAS 2023 - Proceedings, 2023, doi: 10.1109/SAS58821.2023.10254123.

V. Mehta, M. Bolic, I. Mantegh, and C. Vidal, "Tracking and Classification of Drones and Birds at a Far Distance Using Radar Data," in Drone Detectability : Modelling the Relevant Signature, 2021.

F. Dadboud, V. Patel, V. Mehta, M. Bolic, and I. Mantegh, "Single-Stage UAV Detection and Classification with YOLOV5: Mosaic Data Augmentation and PANet," in AVSS 2021 - 17th IEEE International Conference on Advanced Video and Signal-Based Surveillance, 2021: Institute of Electrical and Electronics Engineers Inc., doi: 10.1109/AVSS52988.2021.9663841.

M. Aledhari, R. Razzak, R. M. Parizi, and G. Srivastava, "Sensor Fusion for Drone Detection," in 2021 IEEE 93rd Vehicular Technology Conference (VTC2021-Spring), 2021: IEEE, pp. 1-7, doi: 10.1109/VTC2021-Spring51267.2021.9448699.

A. Frid, Y. Ben-Shimol, E. Manor, and S. Greenberg, "Drones Detection Using a Fusion of RF and Acoustic Features and Deep Neural Networks," Sensors, vol. 24, no. 8, pp. 2427-2427, 2024/4// 2024, doi: 10.3390/s24082427.

N. Ashush, S. Greenberg, E. Manor, and Y. Ben-Shimol, "Unsupervised Drones Swarm Characterization Using RF Signals Analysis and Machine Learning Methods," Sensors, vol. 23, no. 3, 2023, doi: 10.3390/s23031589.

A. Deleforge, D. Di Carlo, M. Strauss, R. Serizel, and L. Marcenaro, "Audio-Based Search and Rescue with a Drone: Highlights from the IEEE Signal Processing Cup 2019 Student Competition [SP Competitions]," IEEE Signal Processing Magazine, vol. 36, 2019, doi: 10.1109/MSP.2019.2924687.

G. Brauwers and F. Frasincar, "A General Survey on Attention Mechanisms in Deep Learning," IEEE Transactions on Knowledge and Data Engineering, vol. 35, no. 4, 2023, doi: 10.1109/TKDE.2021.3126456.

M. H. Guo et al., "Attention mechanisms in computer vision: A survey," Computational Visual Media, vol. 8, 2022, doi: 10.1007/s41095-022-0271-y.

J. Hu, L. Shen, S. Albanie, G. Sun, and E. Wu, "Squeeze-and-Excitation Networks," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 8, 2020, doi: 10.1109/TPAMI.2019.2913372.

S. Woo, J. Park, J. Y. Lee, and I. S. Kweon, "CBAM: Convolutional block attention module," in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2018, vol. 11211 LNCS, doi: 10.1007/978-3-030-01234-2_1.

Y. Liu, Z. Shao, and N. Hoffmann, "Global Attention Mechanism: Retain Information to Enhance Channel-Spatial Interactions," ArXiv, vol. abs/2112.05561, 2021.

Q. Wang, B. Wu, P. Zhu, P. Li, W. Zuo, and Q. Hu, "ECA-Net: Efficient channel attention for deep convolutional neural networks," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2020, doi: 10.1109/CVPR42600.2020.01155.

Q. L. Zhang and Y. B. Yang, "SA-Net: Shuffle attention for deep convolutional neural networks," in ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, 2021, vol. 2021-June: IEEE, doi: 10.1109/ICASSP39728.2021.9414568.

A. Vaswani et al., "Attention is all you need," in 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA, 2017: Curran Associates Inc.

Z. Si, C. Liu, J. Liu, and Y. Zhou, "Application of SNNS Model Based On Multi-Dimensional Attention In Drone Radio Frequency Signal Classification," in ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024/4// 2024: IEEE, pp. 231-235, doi: 10.1109/ICASSP48485.2024.10446694.

J. S. Carolyn and C. W. John. DroneDetect Dataset: A Radio Frequency dataset of Unmanned Aerial System (UAS) Signals for Machine Learning Detection & Classification, doi: https://dx.doi.org/10.21227/5jjj-1m32.

A. Sengupta, Y. Ye, R. Wang, C. Liu, and K. Roy, "Going Deeper in Spiking Neural Networks: VGG and Residual Architectures," Frontiers in Neuroscience, vol. 13, 2019, doi: 10.3389/fnins.2019.00095.

K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2016: IEEE, doi: 10.1109/CVPR.2016.90.

M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L. C. Chen, "MobileNetV2: Inverted Residuals and Linear Bottlenecks," in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2018, doi: 10.1109/CVPR.2018.00474.

R. Liang and Y. Cen, "Radar Signal Classification with Multi-Frequency Multi-Scale Deformable Convolutional Networks and Attention Mechanisms," Remote Sensing, vol. 16, no. 8, pp. 1431-1431, 2024/4// 2024, doi: 10.3390/rs16081431.

S. Liang, R. Chen, G. Duan, and J. Du, "Deep learning-based lightweight radar target detection method," Journal of Real-Time Image Processing, vol. 20, no. 4, 2023, doi: 10.1007/s11554-023-01316-5.

Z. Song, B. Hui, and H. Fan. A dataset for detection and tracking of dim aircraft targets through radar echo sequences, doi: https://doi.org/10.11922/csdata.2019.0075.zh.

Q. Hou, D. Zhou, and J. Feng, "Coordinate attention for efficient mobile network design," in IEEE/CVF conference on computer vision and pattern recognition. 2021, 2021, pp. 13713-13722, doi: 10.1109/CVPR46437.2021.01350.

H. Dong, J. Liu, C. Wang, H. Cao, C. Shen, and J. Tang, "Drone Detection Method Based on the Time-Frequency Complementary Enhancement Model," IEEE Transactions on Instrumentation and Measurement, vol. 72, 2023, doi: 10.1109/TIM.2023.3328072.

Y. Zhao et al., "TGC-YOLOv5: An Enhanced YOLOv5 Drone Detection Model Based on Transformer, GAM & CA Attention Mechanism," Drones, vol. 7, no. 7, 2023, doi: 10.3390/drones7070446.

F. N. Muhammad Zamri, Gunawan, T.S. BirDrone, doi: https://dx.doi.org/10.21227/ettb-0w28.

Z. Xu, J. Su, and K. Huang, "A-RetinaNet: A novel RetinaNet with an asymmetric attention fusion mechanism for dim and small drone detection in infrared images," Mathematical Biosciences and Engineering, vol. 20, no. 4, 2023, doi: 10.3934/mbe.2023285.


Full Text: PDF

Refbacks

  • There are currently no refbacks.


 

Indonesian Journal of Electrical Engineering and Informatics (IJEEI)
ISSN 2089-3272

Creative Commons Licence

This work is licensed under a Creative Commons Attribution 4.0 International License.

web analytics
View IJEEI Stats

Error. Page cannot be displayed. Please contact your service provider for more details. (10)