The system so far is used for pre-configured control only. For now the robot is only performing a preset action such as walking forward, turning right or left, and so on. The robot's artificial intelligence, developed over several years at the lab, allows it to perform more delicate tasks such as picking up an object from a table without needing human input. In this scenario, the robot's camera images are parsed by object recognition software, allowing the patient to choose one of the objects on a table by focusing their attention on it.
"Basically what you see is how with one pattern, called the SSVEP, which is the ability to associate flickering things with actions, it's what we call the affordance, means that we associate actions with objects and then we bring this object to the attention of the user and then by focusing their intention the user is capable of inducing which actions they would like with the robot, and then this is translated."
Object recognition software automatically detects and highlights the bottled water and canned drink in the robot's camera images, and by focusing on one of them the patient can command the robot to retrieve it With training, the user can direct the robot's movements and pick up beverages or other objects in their surroundings.