Skip to content

Hand pose replication using a robotic arm

Facebook
Twitter
LinkedIn

Robotics is the future. Simple but true. Even today, they support us, make the products we need and help humans to get around. Without robots we would be worse off.  Kirsty Aquilina (supervised by Dr Kenneth Scerri) developed a system where a robotic arm could be controlled just by using one’s hand.

The setup was fed images through a single camera. The camera was pointed towards a person’s hand that held a green square marker. The computer was programmed to detect the corners of the marker. These corners give enough information to figure out the hand’s posture in 3D. By using a Kalman Filter, hand movements are tracked and converted into the angles required by the robotic arm.

The robotic arm looks very different from a human one and has limited movement since it has only five degrees of freedom. Within these limitations, the robotic arm can replicate a person’s hand pose. The arm replicates a person’s movement immediately  so  that a person can easily make the robot move around quickly.Controlling robots from afar is essential when there is no prior knowledge of the environment. It allows humans to work safely in hazardous environments like bomb disposal, or when saving lives performing remote microsurgery. In the future, it could assist disabled people.

This research was performed as part of a Bachelor of Engineering (Honours) at the Faculty of Engineering.

A video of the working project can be found at: http://bit.ly/KkrF39

Author

More to Explore

URNA: Bonding Flame

URNA is Malta’s response to the 5th edition of the London Design Biennale 2025. THINK speaks to curator Andrew Borg Wirth and Arts Council Malta Internationalisation Executive Romina Delia to learn how this project seeks to create a connection between souls when experiencing a loss.

MaltaHip Project: When Ideas Become Reality

The earliest recorded attempts at hip replacement date back to 1891. At the time, ivory was proposed to replace the femoral heads of patients whose hip joints had been destroyed by tuberculosis. Since then, everything changed. THINK speaks to the MaltaHip Team to learn about their innovative hip replacement technology.

HUMS ‘The Sun’: Bridging the Sciences and Humanities in a Cross-Disciplinary Exploration

The Humanities, Medicine, and Science (HUMS) Symposia at the University of Malta offer a unique platform where experts from diverse fields come together to explore a single theme from multiple disciplinary perspectives. This academic year, the HUMS first event, entitled ‘The Sun’, provided an interdisciplinary deep dive into the scientific, cultural, and existential significance of our closest star.

Comments are closed for this article!