

浏览全部资源
扫码关注微信
1. 新疆大学软件学院
2. 新疆大学信息科学与工程学院
Published:2020
移动端阅览
[1]周雷,阿里甫·库尔班,吕情深,等.基于R-FCN的中国手指语识别[J].新疆大学学报(自然科学版)(中英文),2020,37(02):170-176.
[1]周雷,阿里甫·库尔班,吕情深,等.基于R-FCN的中国手指语识别[J].新疆大学学报(自然科学版)(中英文),2020,37(02):170-176. DOI: 10.13568/j.cnki.651094.651316.2019.11.26.0001.
DOI:10.13568/j.cnki.651094.651316.2019.11.26.0001.
中国手指语的识别使听力障碍人群与听力正常人群相互交流和人机交互更加便捷.传统的手指语识别对环境背景要求较高
为了解决复杂环境下中国手指语的识别问题
构建并扩展了手指语图片训练集
提出基于改进的区域的全卷积网络R-FCN解决复杂背景下的手指语识别任务.为适应多变的复杂场景
利用在线难例挖掘技术对手指语识别过程中产生的难例进行在线学习
结合手指语特征对网络进行优化.并与SVM分类和FasterR-CNN神经网络作对比.实验结果表明
基于改进的R-FCN在复杂环境的手语识别任务上能达到较好的识别效果.
Chinese finger-language is widely used among deaf-mute people
which makes their communication with normal people more convenient.Finger-language occupies an important position in sign language recognition and is also widely used in many fields such as human-computer interaction.Traditional finger-language recognition is highly susceptible to environmental background.To solve the recognition problem of Chinese finger-language in complex environment
the finger-language picture training set was constructed and expanded
the region-based fully convolutional networks(R-FCN) was improved and was used to recognize finger-language.To adapt to the changing complex scene
the online hard-example mining technology was used to learn the hard-examples generated during the finger-language recognition
and the network was optimized using the feature of the finger-language.In this paper
R-FCN is compared with multi-classifier based on SVM and Faster R-CNN neural network
experimental results show that the improved R-FCN can achieve better recognition effect in the task of sign language recognition in complex environment.
钱涛.三维数字化标准中国手语库的构建方法[D].哈尔滨:哈尔滨工业大学,2010.QIAN T.Construction method of three-dimensional digital standard Chinese sign language library[D].Harbin:Harbin Institute of Technology,2010.(in Chinese)
艾山江·亚生,阿里甫·库尔班,张丹丹.面向手语信息处理的维吾尔文本采集的研究[J].现代电子技术,2019,42(12):136-139.Ai Shanjiang Asheng,Alifu Kurban,ZHANG D D.Research on Uyghur Text Collection for Sign Language Information Processing[J].Modern Electronic Technology,2019,42(12):136-139.(in Chinese)
汤凌燕.听觉障碍者交际中语码选用和转换的研究[D].上海:华东师范大学特殊教育学,2007.TANG L Y.Study on the Selection and Conversion of Language Codes in Communication of Hearing Impaired People[D].Shanghai:Special Education,East China Normal University,2007.(in Chinese)
中华人民共和国教育部,国家语言文字工作委员会,中国残疾人联合会.汉语手指语字母方案[M].北京:华夏出版社,2018.Ministry of Education of the People's Republic of China,National Language Working Committee,China Disabled Persons'Federation.Chinese Finger Language Alphabet Scheme[M].Beijing:Huaxia Publishing House,2018.(in Chinese)
郝子煜,阿里甫·库尔班,李晓红,等.基于CapsNet的中国手指语识别[J].计算机应用研究,2019,36(10):3157-3159.HAO Z Y,Alifu Kurban,LI X H,et al.Chinese Finger Language Recognition Based on CapsNet[J].Journal of Computer Applications,2019,36(10):3157-3159.(in Chinese)
袁甜甜,赵伟,杨学,等.大规模连续中国手语数据集的创建与分析[J].计算机工程与应用,2019,55(11):110-116.YUAN T T,ZHAO W,YANG X,et al.Creation and analysis of large-scale continuous Chinese sign language data sets[J].Computer Engineering and Applications,2019,55(11):110-116.(in Chinese)
NETO G M R,JUNIOR G B,JOAODALLYSON SOUSA DE ALMEIDA,et al.Sign Language Recognition Based on 3D Convolutional Neural Networks[M]//Image Analysis and Recognition.Springer,Cham,2018.
YANG S,ZHU Q.Continuous Chinese sign language recognition with CNN-LSTM[C]//International Conference on Digital Image Processing.International Society for Optics and Photonics,2017.
JIE H,ZHOU W,LI H,et al.Sign Language Recognition using 3D convolutional neural networks[C].2015 IEEE International Conference on Multimedia and Expo(ICME),2015.
李敬华,淮华瑞,孔德慧,等.基于双通道混合3D-2D RBM模型的手势识别[J].北京工业大学学报,2019,45(5):428-435.LI J H,HUAI H R,KONG D H,et al.Gesture recognition based on dual-channel hybrid 3D-2D RBM model[J].Journal of Beijing University of Technology,2019,45(5):428-435.(in Chinese)
Al-Sowaidi M,WAHID M F,TAFRESHI R,et al.Subject-independent hand gesture recognition using normalization and machine learning algorithms[J].Journal of computational science,2018,27(Jul.):69-76.
HIKAWA H,KAIDA K.Novel FPGA Implementation of Hand Sign Recognition System With SOM-Hebb Classifier[J].IEEE Transactions on Circuits and Systems for Video Technology,2015,25(1):153-166.
徐士海.基于结构特征提取的手语识别系统研究[D].合肥:中国科学技术大学,2015.XU S H.Research on Sign Language Recognition System Based on Structural Feature Extraction[D].Hefei:University of Science and Technology of China,2015.(in Chinese)
易靖国,程江华,库锡树.视觉手势识别综述[J].计算机科学,2016,43(z1):103-108.YI J G,CHENG J H,KU X S.Overview of Visual Gesture Recognition[J].Journal of Frontiers of Computer Science,2016,43(z1):103-108.(in Chinese)
HADJI I,WILDES R P.What Do We Understand About Convolutional Networks?[J].arXiv preprint arXiv:1803.08834,2018.
黄洁,姜志国,张浩鹏,等.基于卷积神经网络的遥感图像舰船目标检测[J].北京航空航天大学学报,2017,43(9):1841-1848.HUANG H,JIANG Z G,ZHANG H P,et al.Ship target detection in remote sensing image based on convolutional neural network[J].Journal of Beijing University of Aeronautics and Astronautics,2017,43(9):1841-1848.(in Chinese)
武红娇.复杂背景下的静态手语识别技术研究[D].沈阳:沈阳工业大学,2017.WU H J.Research on Static Sign Language Recognition Technology under Complex Background[D].Shenyang:Shenyang University of Technology,2017.(in Chinese)
DAI J,LI Y,HE K,et al.R-FCN:Object Detection via Region-based Fully Convolutional Networks[J].2016.什么刊
SHRIVASTAVA A,GUPTA A,GIRSHICK R.Training Region-Based Object Detectors with Online Hard Exampl[C].2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR)-Las Vegas,NV,USA,2016:761-769.
SHELHAMER E,LONG J,DARRELL T.Fully Convolutional Networks for Semantic Segmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(6):640-651.
REN S,HE K,GIRSHICK R,et al.Faster R-CNN:Towards Real-Time Object Detection with Region Proposal Networks[J].IEEE Transactions on Pattern Analysis&Machine Intelligence,2015,39(6):1137-1149.
温佳静,范红,朱江泽,等.基于FPGA的刀具图像预处理系统研究[J].信息技术与网络安全,2018,37(9):94-96,100.WEN J J,FAN H,ZHU J Z,et al.Research on Tool Image Preprocessing System Based on FPGA[J].Information Technology and Network Security,2018,37(9):94-96,100.(in Chinese)
邓瑞,周玲玲,应忍冬.基于Kinect深度信息的手势提取与识别研究[J].计算机应用研究,2013,30(4):1263-1265,1274.DENG R,ZHOU L L,YING R D.Research on Gesture Extraction and Recognition Based on Kinect Depth Information[J].Journal of Computer Applications,2013,30(4):1263-1265+1274.(in Chinese)
LI S,NI Z,SANG N.Multiple-Classifiers Based Hand Gesture Recognition[C].第七届全国模式识别学术会议(The 7th Chinese Conference on Pattern Recognition,CCPR2016),2016.
孟欣欣,阿里甫·库尔班,吕情深,等.基于迁移学习的自然环境下香梨目标识别研究[J].新疆大学学报(自然科学版),2019,36(04):461-467.MENG X X,Alifu Kurban,LV Q S,et al.Research on Fragrant Pear Target Recognition in Natural Environment Based on Transfer Learning[J].Journal of Xinjiang University(Natural Science Edition),2019,36(04):461-467.(in Chinese)
KRIZHEYSKY A,SUTSKEVER I,HINTON G E.Image Net Classification with Deep Convolutional Neural Networks[J].Communications of the ACM,2017,60(6):84-90.
李静.复杂场景下基于R-FCN的人脸检测研究[D].太原:太原理工大学,2019.LI J.Research on face detection based on R-FCN in complex scenes[D].Taiyuan:Taiyuan University of Technology,2019.(in Chinese)
0
Views
194
下载量
0
CSCD
Publicity Resources
Related Articles
Related Author
Related Institution
京公网安备11010802024621