Robot see, robot maps

by Rachael N. Darmanin

The term ‘robot’ tends to conjure up images of  well-known metal characters like C-3P0, R2-D2, and WALL-E. The robotics research boom has in the end enabled the introduction of real robots into our homes, workspaces, and recreational places. The pop culture icons we loved have now been replaced with the likes of robot vacuums such as the Roomba and home-automated systems for smoke detectors, or WIFI-enabled thermostats, such as the Nest. Nonetheless, building a fully autonomous mobile robot is still a momentous task. In order to purposefully travel around its environment, a mobile robot has to answer the questions ‘where am I?’, ‘where should I go next?’ and ‘how am I going to get there?’

Like humans, mobile robots must have some awareness of their surroundings in order to carry out tasks autonomously. A map comes in handy for humans. A robot could build the map itself while exploring an unknown environment—this is a process called Simultaneous Localisation and Mapping (SLAM). For the robot to decide which location to explore next, however, an exploration strategy would need to be devised, and the path planner would guide the robot to navigate to the next location, which increases the map’s size.

Rachael N. Darmanin
Rachael N. Darmanin

Rachael Darmanin (supervised by Dr Ing. Marvin Bugeja), used a software framework called Robot Operating System (ROS) to develop a robot system that can explore and map an unknown environment on its own. Darmanin used a differential-drive-wheeled mobile robot, dubbed PowerBot, equipped with a laser scanner (LIDAR) and wheel encoders. The algorithms responsible for localising the robot analyse the sensors’ data and construct the map. In her experiments, Darmanin implemented two different exploration strategies, the Nearest Frontier and the Next Best View, on the same system to map the Control Systems Engineering Laboratory. Each experiment ran for approximately two minutes until the robot finished its exploration and produced a map of its surroundings. This was then compared to a map of the environment to evaluate the robot’s mapping accuracy. The Next Best View approach generated the most accurate maps.

Mobile robots with autonomous exploration and mapping capabilities have massive relevance to society. They can aid hazardous exploration, like nuclear disasters, or access uncharted archaeological sites. They could also help in search and rescue operations where they would be used to navigate in disaster-stricken environments. For her doctorate, Darmanin is now looking into how multiple robots can work together to survey a large area—with a few other solutions in between.


This research was carried out as part of a Master of Science in Engineering, Faculty of Engineering, University of Malta. It was funded by the Master it! Scholarship Scheme (Malta). This scholarship is part-financed by the European Union European Social Fund (ESF) under Operational Programme II Cohesion Policy 2007–2013, Empowering People for More Jobs and a Better Quality Of Life.

Using Muscle Activity To Control Machines

Independent living is important to everyone. However, it is a known fact that there are many cases where physical problems prevent people from living without care. To help people regain some independence in their lives there are systems such as Human to Machine Interfaces (HMI). Systems such as these work by using biosignals like Electromyographic (EMG) signals that can be used to control assistive devices. However, some have their drawbacks: prosthetic arms, for instance, are one commonly used device that are at times abandoned due to a lack of dexterity and precision.

The problem is that most of these devices make use of sequential control, where only one function can be articulated at a time— meaning fluid, life-like motions are impossible. Now, most daily activities need simultaneous movement with multiple degrees of freedom. And it is this need that is pushing the creators of these devices to create simultaneous control to mimic real life movements.

Christian Grech (supervised by Dr Tracey Camilleri and co-supervised by Dr Ing. Marvin Bugeja) has developed a system which allows the control of the position of a robotic arm by using the muscle activity of a person. This consists of an HMI which continuously provides the shoulder and elbow joint positions using surface muscle movements. Grech tested the model to develop more freedom, which would lead to fluid movements. He investigated three types of system identification methods (state space models, linear regression models, and neural networks) to develop this relationship between muscle activity and corresponding joint angles. Additionally, seven different movements were tested in real-time using a robotic arm. Grech managed to develop a model that allows prosthetic arms to be used more naturally.

Of course, more research is needed to perfect this device. Ideally it would operate without delay and with minimal user discomfort. The Department of Systems & Control Engineering is carrying out more research to continue to improve the accuracy and robustness of such myoelectric (EMG) controlled devices.


This research was carried out as part of a Bachelor of Engineering degree at the Faculty of Engineering, University of Malta.

Hand pose replication using a robotic arm

Robotics is the future. Simple but true. Even today, they support us, make the products we need and help humans to get around. Without robots we would be worse off.  Kirsty Aquilina (supervised by Dr Kenneth Scerri) developed a system where a robotic arm could be controlled just by using one’s hand.

The setup was fed images through a single camera. The camera was pointed towards a person’s hand that held a green square marker. The computer was programmed to detect the corners of the marker. These corners give enough information to figure out the hand’s posture in 3D. By using a Kalman Filter, hand movements are tracked and converted into the angles required by the robotic arm.

The robotic arm looks very different from a human one and has limited movement since it has only five degrees of freedom. Within these limitations, the robotic arm can replicate a person’s hand pose. The arm replicates a person’s movement immediately  so  that a person can easily make the robot move around quickly.Controlling robots from afar is essential when there is no prior knowledge of the environment. It allows humans to work safely in hazardous environments like bomb disposal, or when saving lives performing remote microsurgery. In the future, it could assist disabled people.

This research was performed as part of a Bachelor of Engineering (Honours) at the Faculty of Engineering.

A video of the working project can be found at: http://bit.ly/KkrF39