Supporting Communication for Deaf People with Sign Language Recognition Using Deep Learning Approach
Abstract
References
REFERENCES
H. Cooper, B. Holt, and R. Bowden, “Sign Language Recognition,†in Visual Analysis of Humans: Looking at People, T. B. Moeslund, A. Hilton, V. Krüger, and L. Sigal, Eds., London: Springer, 2011, pp. 539–562.
GSO, “The National Survey on People with Disabilities 2016 (VDS2016),†Ha Noi, Viet Nam: General Statistics Office., Final Report.
A. Wadhawan and P. Kumar, “Sign Language Recognition Systems: A Decade Systematic Literature Review,†Arch Computat Methods Eng, vol. 28, no. 3, pp. 785–813, May 2021.
Ursula Bellugi, U. Bellugi, Susan D. Fischer, and S. D. Fischer, “A comparison of sign language and spoken language,†Cognition, vol. 1, no. 2, pp. 173–200, Jan. 1972.
Razieh Rastgoo, R. Rastgoo, Kourosh Kiani, K. Kiani, Sérgio Escalera, and S. Escalera, “Sign Language Recognition - A Deep Survey.,†Expert Systems With Applications, vol. 164, p. 113794, Feb. 2021.
A. Núñez-Marcos, Adrián Núñez-Marcos, Olatz Perez-de-Viñaspre, Olatz Perez-de-Viñaspre, G. Labaka, and Gorka Labaka, “A survey on Sign Language machine translation,†Expert Systems With Applications, vol. 213, pp. 118993–118993, Oct. 2022, doi: 10.1016/j.eswa.2022.118993.
F. Ronchetti, F. Quiroga, C. A. Estrebou, L. C. Lanzarini, and A. Rosete, “LSA64: An Argentinian Sign Language Dataset,†arXiv.org, Jan. 2016.
A. Sridhar, R. G. Ganesan, P. Kumar, and M. Khapra, “INCLUDE: A Large Scale Dataset for Indian Sign Language Recognition,†in Proceedings of the 28th ACM International Conference on Multimedia, in MM ’20. New York, NY, USA: Association for Computing Machinery, Oct. 2020, pp. 1366–1375.
H. Wang, X. Chai, X. Hong, G. Zhao, and X. Chen, “Isolated Sign Language Recognition with Grassmann Covariance Matrices,†ACM Trans. Access. Comput., vol. 8, no. 4, p. 14:1-14:21, May 2016.
V. Athitsos et al., “The American Sign Language Lexicon Video Dataset,†in 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Jun. 2008, pp. 1–8.
H. Wang, X. Chai, Y. Zhou, and X. Chen, “Fast sign language recognition benefited from low rank approximation,†in 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), May 2015, pp. 1–6.
J. He, Z. Liu, and J. Zhang, “Chinese sign language recognition based on trajectory and hand shape features,†in 2016 Visual Communications and Image Processing (VCIP), Nov. 2016, pp. 1–4.
N. H. Dardas and N. D. Georganas, “Real-Time Hand Gesture Detection and Recognition Using Bag-of-Features and Support Vector Machine Techniques,†IEEE Transactions on Instrumentation and Measurement, vol. 60, no. 11, pp. 3592–3607, Nov. 2011.
A. Tharwat, T. Gaber, A. E. Hassanien, M. K. Shahin, and B. Refaat, “SIFT-Based Arabic Sign Language Recognition System,†in Afro-European Conference for Industrial Advancement, A. Abraham, P. Krömer, and V. Snasel, Eds., Cham: Springer International Publishing, 2015, pp. 359–370.
L. Zheng and B. Liang, “Sign language recognition using depth images,†in 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV), Nov. 2016, pp. 1–6.
V. Tiwari, V. Anand, A. G. Keskar, and V. R. Satpute, “Sign language recognition through kinect based depth images and neural network,†in 2015 International Conference on Advances in Computing, Communications and Informatics (ICACCI), Aug. 2015, pp. 194–198.
B. Kang, S. Tripathi, and T. Q. Nguyen, “Real-time sign language fingerspelling recognition using convolutional neural networks from depth map,†in 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), Nov. 2015, pp. 136–140.
T. Raghuveera, R. Deepthi, R. Mangalashri, and R. Akshaya, “A depth-based Indian Sign Language recognition using Microsoft Kinect,†SÄdhanÄ, vol. 45, no. 1, p. 34, Jan. 2020.
Matyáš BoháÄek and Marek Hrúz, “Sign Pose-based Transformer for Word-level Sign Language Recognition,†2022 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW), Jan. 2022.
B. Shyam Sundar and T. Bagyammal, “American Sign Language Recognition for Alphabets Using MediaPipe and LSTM,†Procedia Computer Science, vol. 215, pp. 642–651, Jan. 2022.
L. Wang, W. Hu, and T. Tan, “Recent developments in human motion analysis,†Pattern Recognition, vol. 36, no. 3, pp. 585–601, Mar. 2003.
N. A. Sarhan, Y. El-Sonbaty, and S. M. Youssef, “HMM-based Arabic Sign Language Recognition using Kinect,†in 2015 Tenth International Conference on Digital Information Management (ICDIM), Oct. 2015, pp. 169–174.
Anil Osman Tur, A. O. Tur, Hacer Yalım Keleş, and H. Y. Keles, “Evaluation Of Hidden Markov Models Using Deep CNN Features In Isolated Sign Recognition,†Multimedia tools and applications, Jun. 2020.
T. Starner, J. Weaver, and A. Pentland, “Real-time American sign language recognition using desk and wearable computer based video,†IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 12, pp. 1371–1375, Dec. 1998.
J. Zhang, W. Zhou, C. Xie, J. Pu, and H. Li, “Chinese sign language recognition with adaptive HMM,†in 2016 IEEE International Conference on Multimedia and Expo (ICME), Jul. 2016, pp. 1–6.
D. Tran, L. D. Bourdev, R. Fergus, L. Torresani, and M. Paluri, “C3D: Generic Features for Video Analysis,†ArXiv, Dec. 2014.
P. M. Ferreira, J. S. Cardoso, and A. Rebelo, “Multimodal Learning for Sign Language Recognition,†in Pattern Recognition and Image Analysis, L. A. Alexandre, J. Salvador Sánchez, and J. M. F. Rodrigues, Eds., Cham: Springer International Publishing, 2017, pp. 313–321.
“Thông tư ban hà nh quy định chuẩn vá» ngôn ngữ ký hiệu cho ngưá»i khuyết táºt.†Hà Ná»™i, Việt Nam.
Google, “MediaPipe Holistic,†GitHub. Accessed: Mar. 29, 2024. [Online]. Available: https://github.com/google/mediapipe/blob/master/docs/solutions/holistic.md
D. Erhan, A. Courville, Y. Bengio, and P. Vincent, “Why Does Unsupervised Pre-training Help Deep Learning?,†in Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, JMLR Workshop and Conference Proceedings, Mar. 2010, pp. 201–208.
M. Al-Hammadi et al., “Spatial Attention-Based 3D Graph Convolutional Neural Network for Sign Language Recognition,†Sensors, vol. 22, no. 12, Art. no. 12, Jan. 2022, doi: 10.3390/s22124558.
F. Ronchetti, F. Quiroga, C. Estrebou, L. Lanzarini, and A. Rosete, “Sign Languague Recognition Without Frame-Sequencing Constraints: A Proof of Concept on the Argentinian Sign Language,†in Advances in Artificial Intelligence - IBERAMIA 2016, M. Montes y Gómez, H. J. Escalante, A. Segura, and J. de D. Murillo, Eds., Cham: Springer International Publishing, 2016, pp. 338–349. doi: 10.1007/978-3-319-47955-2_28.