Mind-controlled exoskeleton to help disabled people walk again

The system, based on innovative 'Brain-neural-computer interface' (BNCI) technology -- combined with a light-weight exoskeleton attached to users' legs and a virtual reality environment for training -- could also find applications in the rehabilitation of stroke victims and in assisting astronauts rebuild muscle mass after prolonged periods in space.

In the United Kingdom, every eight hours someone suffers a spinal cord injury, often leading to partial or full lower-body paralysis. In the United States, more than 250 000 people are living with paralysis as a result of damage to their spinal cord, usually because of a traffic accident, fall or sporting injury. Many are under the age of 50, and with no known medical cure or way of repairing damaged spinal nerves they face the rest of their lives in a wheelchair.

But by bypassing the spinal cord entirely and routing brain signals to a robotic exoskeleton, they should be able to get back on their feet. That is the ultimate goal of researchers working in the 'Mind-controlled orthosis and VR-training environment for walk empowering' (Mindwalker) project, a three-year initiative supported by EUR 2.75 million in funding from the European Commission.

'Mindwalker was proposed as a very ambitious project intended to investigate promising approaches to exploit brain signals for the purpose of controlling advanced orthosis, and to design and implement a prototype system demonstrating the potential of related technologies,' explains Michel Ilzkovitz, the project coordinator at Space Applications Services in Belgium.

The team's approach relies on an advanced BNCI system that converts electroencephalography (EEG) signals from the brain, or electromyography (EMG) signals from shoulder muscles, into electronic commands to control the exoskeleton.

The Laboratory of Neurophysiology and Movement Biomechanics at the Université Libre de Bruxelles (ULB) focused on the exploitation of EEG and EMG signals treated by an artificial neural network, while the Foundation Santa Lucia in Italy developed techniques based on EMG signals modelled by the coupling of neural and biomechanical oscillators.

One approach for controlling the exoskeleton uses so-called 'steady-state visually evoked potential', a method that reads flickering visual stimuli produced at different frequencies to induce correlated EEG signals. Detection of these EEG signals is used to trigger commands such as 'stand', 'walk', 'faster' or 'slower'.

A second approach is based on processing EMG signals generated by the user's shoulders and exploits the natural arm-leg coordination in human walking: arm-swing patterns can be perceived in this way and converted into control signals commanding the exoskeleton's legs.

A third approach, 'ideation', is also based on EEG-signal processing. It uses the identification and exploitation of EEG Theta cortical signals produced by the natural mental process associated with walking. The approach was investigated by the Mindwalker team but had to be dropped due to the difficulty, and time needed, in turning the results of early experiments into a fully exploitable system.

Regardless of which method is used, the BNCI signals have to be filtered and processed before they can be used to control the exoskeleton. To achieve this, the Mindwalker researchers fed the signals into a 'Dynamic recurrent neural network'(DRNN), a processing technique capable of learning and exploiting the dynamic character of the BNCI signals.

'This is appealing for kinematic control and allows a much more natural and fluid way of controlling an exoskeleton,' Mr Ilzkovitz says.

The team adopted a similarly practical approach for collecting EEG signals from the user's scalp. Most BNCI systems are either invasive, requiring electrodes to be placed directly into brain tissue, or require users to wear a 'wet' capon their head, necessitating lengthy fitting procedures and the use of special gels to reduce the electrical resistance at the interface between the skin and the electrodes. While such systems deliver signals of very good quality and signal-to-noise ratio, they are impractical for everyday use.

The Mindwalker team therefore turned to a 'dry' technology developed by Berlin-based eemagine Medical Imaging Solutions: a cap covered in electrodes that the user can fit themselves, and which uses innovative electronic components to amplify and optimise signals before sending them to the neural network.

'The dry EEG cap can be placed by the subject on their head by themselves in less than a minute, just like a swimming cap,' Mr Ilzkovitz says.

Efficient, robust robotic legs

The universities of Delft and Twente in the Netherlands proposed an innovative approach for the design of the exoskeleton and its control. The exoskeletonis designed to be sufficiently robust to bear the weight of a 100 kg adult and powerful enough to recover balance from external causes of instability such as the user's own torso movements during walking or a gentle push from the back or side. Compared to other exoskeletons developed to date it is relatively light, weighing less than 30 kg without batteries, and, because a final version of the system should be self-powered, it is designed to minimise energy consumption.

The Mindwalker researchers achieved energy efficiency through the use of springs fitted inside the joints that are capable of absorbing and recovering some of the energy otherwise dissipated during walking, and through the development of an efficient strategy for controlling the exoskeleton.

Most exoskeletons are designed to be balanced when stationary or quasi-static and to move by little steps inside their ground stability perimeter, an approach known as 'Zero moment point', or ZMP. Although this approach is commonly used for controlling humanoid robots, when applied to exoskeletons, it makes them heavy and slow -- and usually requires users to be assisted by a walking frame, sticks or some other support device when they move.

Alternatively, a more advanced and more natural control strategy can replicate the way humans actually walk, with a controlled loss of balance in the walking direction.

'This approach is called "Limit-cycle walking" and has been implemented using model predictive control to predict the behaviour of the user and exoskeleton and for controlling the exoskeleton during the walk. This was the approach investigated in Mindwalker,' Mr Ilzkovitz says.

To train users to control the exoskeleton, researchers from Space Applications Services developed a virtual-reality training platform, providing an immersive environment in which new users can safely become accustomed to using the system before testing it out in a clinical setting, and, the team hope, eventually using it in everyday life.

By the end of this year, tests with able-bodied trial users will be completed. The system will then be transferred to the Foundation Santa Lucia for conducting a clinical evaluation until May 2013 with five to 10volunteers suffering from spinal cord injuries. These trials will help identify shortcomings and any areas of performance improvement, the project coordinator says.

In the meantime, the project partners are continuing research on different components for a variety of potential applications. The project coordinator notes, for example, that elements of the system could be adapted for the rehabilitation of stroke victims or to develop easy-to-use exoskeletons for elderly people for mobility support.

Space Applications Services, meanwhile, is also exploring applications of the Mindwalker technology to train astronauts and help them rebuild muscle mass after spending long periods of time in zero-gravity environments.

Mindwalker was coordinated by Space Applications Services NV and received research funding under the European Union's Seventh Framework Programme (FP7).

Link to project on CORDIS:

• FP7 on CORDIS -- http://cordis.europa.eu/fp7/home_en.html
• Mindwalker project factsheet on CORDIS -- http://cordis.europa.eu/projects/rcn/93837_en.html

Link to project's website:

• 'Mind controlled orthosis and VR training environment for walk empowering' project website -- http://mindwalker-project.eu/

Other links:

• European Commission's Digital Agenda website -- http://ec.europa.eu/digital-agenda/

Information Source: Michel Ilzkovitz, Space Applications Services, Belgium