Deepfake Detection Based on Deep Learning and Quantum Particle Swarm Optimization
Abstract
References
N. Atitallah, A. Abdel-Wahab, A. A. Hadi, H. Abdel-Jaber, A. W. Mohamed, M. Elsersy, and Y. Mansour, “Horsenet: A Novel Deep Learning Approach for Horse Health Classification,†Indonesian Journal of Electrical Engineering and Computer Science, vol. 38, no. 1, pp. 555–568, 2025. Available: https://doi.org/10.11591/ijeecs.v38.i1.pp555-568
E. A. Elsoud, O. Alidmat, S. Abuowaida, E. Alhenawi, N. Alshdaifat, A. Aburomman, and H. Y. Chan, “Accurate Segmentation of Fruit Based on Deep Learning,†Indonesian Journal of Electrical Engineering and Computer Science, vol. 38, no. 2, pp. 1331–1338, 2025. Available: https://doi.org/10.11591/ijeecs.v38.i2.pp1331-1338
H. S. Shad, M. M. Rizvee, N. T. Roza, S. M. Hoq, M. M. Khan, A. Singh, and S. Bourouis, “Comparative Analysis of Deepfake Image Detection Method Using Convolutional Neural Network,†Computational Intelligence and Neuroscience, vol. 2021, 2021. Available: https://doi.org/10.1155/2021/3111676
T. Jung, S. Kim, and K. Kim, “DeepVision: Deepfakes Detection Using Human Eye Blinking Pattern,†IEEE Access, vol. 8, pp. 83144–83154, 2020. Available: https://doi.org/10.1109/ACCESS.2020.2988660
T. Nguyen, Q. Nguyen, C. M. Nguyen, D. Nguyen, D. Nguyen, and S. Nahavandi, “Deep Learning for Deepfakes Creation and Detection: A Survey,†Computer Vision and Image Understanding, 2019. Available: https://doi.org/10.1016/j.cviu.2022.103525
M. Westerlund, “The Emergence of Deepfake Technology: A Review,†Technology Innovation Management Review, vol. 9, no. 11, pp. 39–52, 2019. Available: https://doi.org/10.22215/timreview/14
H. Zhao, W. Zhou, D. Chen, T. Wei, W. Zhang, and N. Yu, “Multi-attentional Deepfake Detection,†Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2185–2194, 2021. Available: https://doi.org/10.1109/CVPR46437.2021.00222
Y. Li and S. Lyu, “Exposing Deepfake Videos by Detecting Face Warping Artifacts,†arXiv:1811.00656, 2018. Available: https://doi.org/10.48550/arXiv.1811.00656
F. Matern, C. Riess, and M. Stamminger, “Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations,†IEEE Winter Applications of Computer Vision Workshops (WACVW), pp. 83–92, 2019. Available: https://doi.org/10.1109/WACVW.2019.00020
D. Guera and E. J. Delp, “Deepfake Video Detection Using Recurrent Neural Networks,†IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6, 2018. Available: https://doi.org/10.1109/AVSS.2018.8639163
A. V. Nadimpalli and A. Rattani, “On Improving Cross-Dataset Generalization of Deepfake Detectors,†arXiv:2204.04285, 2022. Available: https://doi.org/10.48550/arXiv.2204.04285
D. Guera and E. J. Delp, “Deepfake Video Detection Using Recurrent Neural Networks,†IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1–6, 2018. Available: https://doi.org/10.1109/AVSS.2018.8639163
U. A. Ciftci, I. Demir, and L. Yin, “Detection of Synthetic Portrait Videos Using Biological Signals,†arXiv:1901.02212, 2021. Available: https://doi.org/10.48550/arXiv.1901.02212
C. Fran, “Deep Learning with Depthwise Separable Convolutions,†IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017. Available: https://doi.org/10.48550/arXiv.1610.02357
E. R. S. Rezende, G. C. S. Ruppert, and T. Carvalho, “Detecting Computer Generated Images with Deep Convolutional Neural Networks,†SIBGRAPI, pp. 71–78, 2017. Available: https://doi.org/10.1109/SIBGRAPI.2017.16
X. Dong, U. Victor, and L. Qian, “Two-path Deep Semi-supervised Learning for Timely Fake News Detection,†IEEE Transactions on Computational Social Systems, 2020. Available: https://doi.org/10.1109/TCSS.2020.3027639
S. Ikram, S. Thaseen, S. Chambial, and D. Sood, “A Performance Enhancement of Deepfake Video Detection Through the Use of a Hybrid CNN Deep Learning Model,†International Journal of Electrical and Computer Engineering Systems, vol. 14, no. 2, pp. 169–178, 2023. Available: https://doi.org/10.32985/ijeces.14.2.6
I. İlhan, E. Balı, and M. Karakose, “An Improved Deepfake Detection Approach with NASNetLarge CNN,†International Conference on Data Analytics for Business and Industry (ICDABI), pp. 598–602, 2022. Available: https://doi.org/10.1109/ICDABI56818.2022.10041558
H. T. Nguyen, T. C. Dao, T. M. N. Phan, and T. T. Phan, “Fake Face Detection in Video Using Shallow Deep Learning Architectures,†International Journal of Intelligent Systems Technologies and Applications, vol. 20, no. 6, pp. 469–486, 2022. Available: https://doi.org/10.1504/IJISTA.2022.128528
C. Coleman, C. Yeh, S. Mussmann, B. Mirzasoleiman, P. Bailis, P. Liang, J. Leskovec, and M. Zaharia, “Selection via Proxy: Efficient Data Selection for Deep Learning,†arXiv:1906.11829, 2019. Available: https://doi.org/10.48550/arXiv.1906.11829
A. Mittal, D. Sivasubramanian, R. Iyer, P. Jyothi, and G. Ramakrishnan, “Partitioned Gradient Matching-based Data Subset Selection for Compute-efficient Robust ASR Training,†arXiv:2210.16892, 2022. Available: https://doi.org/10.48550/arXiv.2210.16892
K. He, X. Zhang, S. Ren, and J. Sun, “Deep Residual Learning for Image Recognition,†Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778, 2016. Available: https://doi.org/10.48550/arXiv.1512.03385
M. Shafiq and Z. Gu, “Deep Residual Learning for Image Recognition: A Survey,†Applied Sciences, vol. 12, no. 18, p. 8972, 2022. Available: https://doi.org/10.3390/app12188972
X. Li, L. Ding, L. Wang, and F. Cao, “FPGA Accelerates Deep Residual Learning for Image Recognition,†IEEE ITNEC, pp. 837–840, 2017. Available: https://doi.org/10.1109/ITNEC.2017.8284852
S. Wu, S. Zhong, and Y. Liu, “Deep Residual Learning for Image Steganalysis,†Multimedia Tools and Applications, vol. 77, pp. 10437–10453, 2018. Available: https://doi.org/10.1007/s11042-017-4440-4
A. Jafar and L. Myungho, “Hyperparameter Optimization for Deep Residual Learning in Image Classification,†IEEE ACSOS-C, pp. 24–29, 2020. Available: https://doi.org/10.1109/ACSOS-C51401.2020.00024
W. Bae, J. Yoo, and J. C. Ye, “Beyond Deep Residual Learning for Image Restoration: Persistent Homology-guided Manifold Simplification,†CVPR Workshops, pp. 145–153, 2017. Available: https://doi.org/10.48550/arXiv.1611.06345
Z. Cheng, H. Sun, M. Takeuchi, and J. Katto, “Deep Residual Learning for Image Compression,†CVPR Workshops, 2019. Available: https://doi.org/10.48550/arXiv.1906.09731
X. Cheng, Y. Zhang, Y. Chen, Y. Wu, and Y. Yue, “Pest Identification via Deep Residual Learning in Complex Background,†Computers and Electronics in Agriculture, vol. 141, pp. 351–356, 2017. Available: https://doi.org/10.1016/j.compag.2017.08.005
J. Sun, W. Xu, and W. Fang, “Quantum-behaved Particle Swarm Optimization Algorithm with Controlled Diversity,†Computational Science – ICCS, pp. 847–854, 2006. Available: https://doi.org/10.1007/978-3-662-45526-5_13
Z. Huang, “Improved Quantum Particle Swarm Optimization for Mangroves Classification,†Journal of Sensors, vol. 2016, Article ID 9264690, 2016. Available: https://doi.org/10.1155/2016/9264690
S. Li, R. Wang, W. Hu, and J. Sun, “A New QPSO-based BP Neural Network for Face Detection,†Fuzzy Information and Engineering, 2007. Available: https://doi.org/10.1155/2016/9264690
R. Misra and K. S. Ray, “Object Tracking Based on Quantum Particle Swarm Optimization,†arXiv:1707.05228, 2017.
W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. Fu, and C. Berg, “SSD: Single Shot MultiBox Detector,†ECCV, pp. 21–37, 2016. Available: https://doi.org/10.1007/978-3-319-46448-0_2
“Image Downsampling Algorithms: A Comprehensive Guide.†Available: https://saturncloud.io/blog/image-downsampling-algorithms-a-comprehensive-guide/
K. A. E. Dahshan, E. K. Elsayed, A. Aboshoha, and E. A. Ebeid, “Recognition of Facial Emotions Relying on Deep Belief Networks and Quantum Particle Swarm Optimization,†International Journal of Intelligent Engineering & Systems, vol. 13, no. 4, 2020. Available: https://doi.org/10.22266/IJIES2020.0831.09
B. Wang, Y. Sun, B. Xue, and M. Zhang, “Evolving Deep Convolutional Neural Networks by Variable-length Particle Swarm Optimization for Image Classification,†IEEE CEC, pp. 1–8, 2018. Available: https://doi.org/10.48550/arXiv.1803.06492
T. Yamasaki, T. Honma, and K. Aizawa, “Efficient Optimization of Convolutional Neural Networks Using Particle Swarm Optimization,†IEEE BigMM, 2017. Available: https://doi.org/10.1109/BigMM.2017.69
Y. Wang, H. Zhang, and G. Zhang, “CPSO-CNN: An Efficient PSO-based Algorithm for Fine-tuning Hyper-parameters of Convolutional Neural Networks,†Swarm and Evolutionary Computation, 2019. Available: https://doi.org/10.1016/j.swevo.2019.06.002
Real and Fake Face Detection Dataset. Available: https://www.kaggle.com/datasets/ciplab/real-and-fake-face-detection
Celeb-DF Dataset. Available: https://github.com/yuezunli/celeb-deepfakeforensics
N. Nida, A. Irtaza, and N. Ilyas, “Forged Face Detection Using ELA and Deep Learning Techniques,†IBCAST, pp. 271–275, 2021. Available: https://doi.org/10.1109/IBCAST51254.2021.9393234
H. Mittal, M. Saraswat, J. C. Bansal, and A. Nagar, “Fake-face Image Classification Using Improved Quantum-inspired Evolutionary-based Feature Selection Method,†IEEE SSCI, pp. 989–995, 2020. Available: https://doi.org/10.1109/SSCI47803.2020.9308337
M. Tan and Q. Le, “EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks,†ICML, pp. 6105–6114, 2019. Available: https://doi.org/10.48550/arXiv.1905.11946
P. Yadav, I. Jaswal, J. Maravi, V. Choudhary, and G. Khanna, “Deepfake Detection Using InceptionResNetV2 and LSTM,†International Conference on Emerging Technologies: AI, IoT, and CPS for Science Technology Applications, 2021. Available: https://doi.org/10.1109/ICCMC56507.2023.10083584
S. Agarwal, H. Farid, T. El-Gaaly, and S. Lim, “Detecting Deep-fake Videos from Appearance and Behavior,†IEEE WIFS, pp. 1–6, 2020. Available: https://doi.org/10.1109/WIFS49906.2020.9360904
U. A. Ciftci, I. Demir, and L. Yin, “How Do the Hearts of Deep Fakes Beat? Deep Fake Source Detection via Interpreting Residuals with Biological Signals,†IEEE IJCB, pp. 1–10, 2020. Available: https://doi.org/10.48550/arXiv.2008.11363
P. Ranjan, S. Patil, and F. Kazi, “Improved Generalizability of Deep-fakes Detection Using Transfer Learning-based CNN Framework,†ICICT, pp. 86–90, 2020. Available: https://doi.org/10.1109/ICICT50521.2020.00021