Automatic grasp selection using a camera in a hand prosthesis

Joseph DeGol, Aadeel Akhtar, Bhargava Manja, Timothy Bretl
2016 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)  
In this paper, we demonstrate how automatic grasp selection can be achieved by placing a camera in the palm of a prosthetic hand and training a convolutional neural network on images of objects with corresponding grasp labels. Our labeled dataset is built from common graspable objects curated from the ImageNet dataset and from images captured from our own camera that is placed in the hand. We achieve a grasp classification accuracy of 93.2% and show through real-time grasp selection that using
more » ... camera to augment current electromyography controlled prosthetic hands may be useful.
doi:10.1109/embc.2016.7590732 pmid:28261002 pmcid:PMC5325038 fatcat:pbbxxnyr4rfele7wkfk5weomka