REAL-TIME HAND GESTURE TELEROBOTIC SYSTEM USING FUZZY C-MEAN

This paper describes a teleoperation system in which an articulated robot performs a block pushing task based on hand gesture commands sent through the Intemet. A Fuzzy C-Means clustering method is used to classify hand postures as "gesture commands&q

5($/ 7,0( +$1' *(6785( 7(/(52%27,& 6<67(0 86,1* )8==< & 0($16 &/867(5,1* -8$1 :$&+6 85, .$57281 +(/0$1 67(51 <$(/ ('$1 'HSDUWPHQW RI ,QGXVWULDO (QJLQHHULQJ DQG 0DQDJHPHQW %HQ *XULRQ 8QLYHUVLW\ RI WKH 1HJHY %H¶HU 6KHHYD ,65$(/ $%675$&7 7KLV SDSHU GHVFULEHV D WHOHRSHUDWLRQ V\VWHP LQ ZKLFK DQ DUWLFXODWHG URERW SHUIRUPV D EORFN SXVKLQJ WDVN EDVHG RQ KDQG JHVWXUH FRPPDQGV VHQW WKURXJK WKH ,QWHUQHW $ )X]]\ & 0HDQV FOXVWHULQJ PHWKRG LV XVHG WR FODVVLI\ KDQG SRVWXUHV DV ³JHVWXUH FRPPDQGV´ 7KH IX]]\ UHFRJQLWLRQ V\VWHP ZDV WHVWHG XVLQJ WULDOV HDFK RI D JHVWXUH YRFDEXODU\ 5HVXOWV UHYHDOHG DQ DFFHSWDQFH UDWH RI SHUFHQW RI JHVWXUHV ZLWK D VXIILFLHQWO\ ODUJH PHPEHUVKLS YDOXH WR EHORQJ WR DW OHDVW RQH RI WKH GHVLJQDWHG FODVVLILFDWLRQV DQG D UHFRJQLWLRQ DFFXUDF\ RI WKH SHUFHQW RI DFFHSWHG JHVWXUHV FODVVLILHG FRUUHFWO\ 3HUIRUPDQFH WLPHV WR FDUU\ RXW WKH SXVKLQJ WDVN VKRZHG UDSLG OHDUQLQJ UHDFKLQJ VWDQGDUG WLPHV ZLWKLQ WR WULDOV E\ DQ LQH[SHULHQFHG RSHUDWRU .(<:25'6 JHVWXUH UHFRJQLWLRQ WHOHURERWLFV IX]]\ F PHDQV KDQG JHVWXUH ,1752'8&7,21 +DQG JHVWXUHV DUH RQH EXW D IHZ RI WKH PHWKRGV XVHG LQ WHOHURERWLF FRQWURO > @ 7KLV W\SH RI FRPPXQLFDWLRQ SURYLGHV DQ H[SUHVVLYH QDWXUDO DQG LQWXLWLYH ZD\ IRU KXPDQV WR FRQWURO URERWLF V\VWHPV 2QH EHQHILW > @ RI VXFK D V\VWHP LV WKDW LW LV D QDWXUDO ZD\ WR VHQG JHRPHWULFDO LQIRUPDWLRQ WR WKH URERW VXFK DV OHIW ULJKW HWF *HVWXUHV PD\ UHSUHVHQW D VLQJOH FRPPDQG D VHTXHQFH RI FRPPDQGV D VLQJOH ZRUG RU D SKUDVH DQG PD\ EH VWDWLF RU G\QDPLF 6XFK V\VWHPV VKRXOG EH DFFXUDWH HQRXJK WR SURYLGH WKH FRUUHFW FODVVLILFDWLRQ RI KDQG JHVWXUHV LQ D UHDVRQDEOH WLPH > @ +XPDQ URERW LQWHUDFWLRQ XVLQJ KDQG JHVWXUHV SURYLGHV D IRUPLGDEOH FKDOOHQJH 7KLV LV EHFDXVH WKH HQYLURQPHQW FRQWDLQV D FRPSOH[ EDFNJURXQG G\QDPLF OLJKWLQJ FRQGLWLRQV D GHIRUPDEOH KDQG VKDSH DQG D UHDO WLPH H[HFXWLRQ UHTXLUHPHQW 7KHUH KDV UHFHQWO\ EHHQ D JURZLQJ LQWHUHVW LQ JHVWXUH UHFRJQLWLRQ V\VWHPV ZLWK D QXPEHU RI UHVHDUFKHUV SURYLGLQJ VRPH QRYHO DSSURDFKHV PDQ\ RI ZKLFK DUH TXLWH HODERUDWH DQG UHTXLUH LQWHQVLYH FRPSXWHU UHVRXUFHV )RU H[DPSOH 4XHN > @ GHYHORSV D IORZ ILHOG FRPSXWDWLRQDO DOJRULWKP .RRQV HW DO > @ GHVFULEHV DQ DSSURDFK LQ ZKLFK KDQG GDWD LV FODVVLILHG LQWR IHDWXUHV RI SRVWXUH RULHQWDWLRQ DQG PRWLRQ ,Q > @ FRORU PRWLRQ DQG WUDFNLQJ LV XVHG LQ D KDQG SRVWXUH V\VWHP IRU URERW FRQWURO &ODVVLILFDWLRQ LV EDVHG RQ HODVWLF JUDSK PDWFKLQJ $Q H[FHOOHQW UHYLHZ RI JHVWXUH PRGHOLQJ DSSURDFKHV LV WKDW RI +XDQJ HW DO > @ 2I WKRVH

This paper describes a teleoperation system in which an articulated robot performs a block pushing task based on hand gesture commands sent through the Intemet. A Fuzzy C-Means clustering method is used to classify hand postures as "gesture commands&q

PHQWLRQHG RXU V\VWHP LV FORVHVW WR WKDW RI WKH HGJH EDVHG WHFKQLTXH WR H[WUDFW LPDJH SDUDPHWHUV IURP VLPSOH VLOKRXHWWHV XVHG E\ 6HJHQ > @ ,Q WKLV SDSHU ZH GHILQH D VWDWLF KDQG JHVWXUH YRFDEXODU\ IRU WHOHURERWLF FRQWURO XVLQJ D )X]]\ & 0HDQV )&0 UHFRJQLWLRQ V\VWHP $OWKRXJK WKH VSHHG RI DUWLILFLDO QHXUDO QHWZRUN $11 FODVVLILHUV DOORZV UHDO WLPH RSHUDWLRQ DQG FRPSDUDEOH DFFXUDF\ D )&0 LV XVHG EHFDXVH LW UHTXLUHV VPDOOHU WUDLQLQJ VHWV DQG VKRUWHU WUDLQLQJ WLPHV 0RUHRYHU LW LV FRPSDWLEOH ZLWK IXWXUH UHVHDUFK QHHGV WR FRPSDUH RWKHU V\VWHPV EDVHG RQ FOXVWHU YDULDQFHV $11V SUHFOXGH VXFK FRPSDULVRQV DV FOXVWHU ERXQGDULHV DUH WUDQVSDUHQW H[FHSW IRU YHU\ VPDOO QHWZRUNV 2XU DSSURDFK LV LPSOHPHQWHG LQ D WHOHRSHUDWLRQ FOLHQW VHUYHU LQWHUQHW HQYLURQPHQW 7KH SDSHU GHVFULEHV WKH JHVWXUH UHFRJQLWLRQ DOJRULWKP DQG LWV HYDOXDWLRQ 6<67(0 $5&+,7(&785( 7R FRQWURO D URERW PRYHPHQW WKH XVHU HYRNHV D JHVWXUH IURP D JHVWXUH YRFDEXODU\ 7KH XVHU OD\V KLV KHU KDQG RYHU D YLGHR LPDJHU DQG D UDZ LPDJH LV DFTXLUHG 7KH JHVWXUH LV FODVVLILHG XVLQJ D UHFRJQLWLRQ PRGXOH EDVHG RQ WKH )&0 DOJRULWKP > @ DQG LV VHQW WR WKH URERW IRU H[HFXWLRQ 7KH FRPSRQHQWV RI WKH V\VWHP FRQVLVW RI D ILYH GHJUHH RI IUHHGRP URERW D 3& V\VWHP ZLWK D IUDPH JUDEEHU WZR 86% FDPHUDV DQG D YLGHR LPDJHU $ VHW RI UHFRJQL]HG JHVWXUHV LV VHQW WKURXJK WKH 7&3 ,3 FRPPXQLFDWLRQ SURWRFRO WR D GLVWDQW URERW 3& VHUYHU 7KH VHUYHU LV FRQQHFWHG WR WKH URERW FRQWUROOHU DQG WZR 86% FDPHUDV ZKLFK FRQWLQXDOO\ FDSWXUH WKH URERW VFHQH %RWK VLGH DQG IURQW YLHZV RI WKH VFHQH DUH VHQW WR FOLHQW LQWHUIDFH XVLQJ WKH )73 SURWRFRO 7KH KDQG JHVWXUH UHFRJQLWLRQ V\VWHP IORZ GLDJUDP LV VKRZQ LQ )LJ 8SRQ SUHVHQWDWLRQ RI WKH URERWLF VFHQH LQ WKH XVHU¶V LQWHUIDFH D JHVWXUH * LV VHOHFWHG IURP D JHVWXUH YRFDEXODU\ ^* * * ` $ YLVLRQ V\VWHP FRQYHUWV WKH FDSWXUHG LPDJH RI WKH JHVWXUH LQWR D IHDWXUH VWULQJ ZKLFK LV VXEVHTXHQWO\ UHFRJQL]HG DQG VHQW WR WKH URERW 3& …… 此处隐藏：12460字，全部文档内容请下载后查看。喜欢就下载吧 ……