Skip to content

Hand pose replication using a robotic arm

Facebook
Twitter
LinkedIn

Robotics is the future. Simple but true. Even today, they support us, make the products we need and help humans to get around. Without robots we would be worse off.  Kirsty Aquilina (supervised by Dr Kenneth Scerri) developed a system where a robotic arm could be controlled just by using one’s hand.

The setup was fed images through a single camera. The camera was pointed towards a person’s hand that held a green square marker. The computer was programmed to detect the corners of the marker. These corners give enough information to figure out the hand’s posture in 3D. By using a Kalman Filter, hand movements are tracked and converted into the angles required by the robotic arm.

The robotic arm looks very different from a human one and has limited movement since it has only five degrees of freedom. Within these limitations, the robotic arm can replicate a person’s hand pose. The arm replicates a person’s movement immediately  so  that a person can easily make the robot move around quickly.Controlling robots from afar is essential when there is no prior knowledge of the environment. It allows humans to work safely in hazardous environments like bomb disposal, or when saving lives performing remote microsurgery. In the future, it could assist disabled people.

This research was performed as part of a Bachelor of Engineering (Honours) at the Faculty of Engineering.

A video of the working project can be found at: http://bit.ly/KkrF39

Author

More to Explore

Should Universities Cross-Pollinate Subjects in an Uncertain World?

Technology is seeping into research and academic writing, and the shift towards labour-market facilitation rather than academic curation is changing the knowledge and learning landscape. Such shifts, however, are set against cultural biases in subjects and traditional, outdated academic structures, even as universities try to evolve.

I Will Continue to Follow the Ship

Curated by Elyse Tonna with artist Dr Matthew Attard, ‘The Ship (Unseen)’ delivers the same brilliance and deep artistic intent which Attard, Tonna, and the rest of the team had been praised for during the 60th Venice Biennale. In 2025, the two sought to continue building on the themes of connection, identity, and memory established in ‘I Will Follow the Ship’, making use once again of that iconic, ever-moving, web-like linework.

AMBER: Stretching the Boundaries of Sustainable Rubber

Think about the rubber parts in your car, your shoes, or your household appliances. Traditionally, making rubber is an incredibly energy-intensive process that relies on ‘vulcanisation’ – a method that uses high temperatures and produces harmful emissions to make the material durable. But what if high-performance rubber could be eco-friendly and 3D-printed on demand?

Comments are closed for this article!