Engineers at Queen Mary University of London have created a tactile sensor, described in a study published in Science Advances, that allows robots to detect touch using a simple camera.  

The sensor converts mechanical forces into visible color patterns, reducing the need for dense arrays of embedded sensors. Giacomo Sasso, a postdoctoral researcher at Queen Mary’s School of Engineering and Materials Science, led the team that developed this new sensor. Rather than relying on embedded electronic sensors, they created a soft material that changes color when pressed or bent.

This effect, known as structural color, is the same reason butterfly wings look iridescent without pigment. Pressure causes microscopic structures within the material to shift, altering how light reflects and creating a real-time visual indicator of force.

Touch Without the Computation

Most vision-based tactile sensors can map contact and force in detail, but only at the cost of heavy computation that slows them down. Simpler systems are faster, but sacrifice detail. The new material developed by Sasso’s team sidesteps this problem by building the sensing function into the material itself. With just a standard USB camera, researchers can track color changes on the surface and immediately infer pressure, strain, and contact shape without complex data reconstruction.

“You won’t guess how much information is generated when your finger presses a light switch. A human hand contains more than 10,000 mechanoreceptors to do the job, yet touch sensing remains one of the major challenges in robotics,” Sasso said. “We were happy to capture the finger ridges, as no existing technology can reproduce such sensor density at [a] comparable scale and simplicity. The key idea behind this project was to think outside the box: instead of embedding dense and overengineered sensor arrays, sensing is moved into the material itself, where mechanical cues are directly transformed into colour fields and captured using a simple low-cost USB camera.”

Professor James Busfield, one of the paper’s co-authors, described the advantage more simply: “What is particularly powerful is that the information is already in the light signal. You are no longer reconstructing touch – you are observing it directly.”

From Precision Manufacturing to the Operating Room

Reducing the computational demands of touch sensing opens up new possibilities. A robotic gripper made with this material could handle tiny parts more gently, since changes in force are immediately detectable. Prosthetic limbs equipped with similar sensors could also provide users with more detailed tactile feedback.

The researchers also see potential applications in surgery, where detecting subtle pressure differences could help clinicians interpret tissue properties.

A Decade of Groundwork Behind One Material

Professor Federico Carpi from the University of Florence and Professor James Busfield from Queen Mary worked together on this project, merging years of separate work on stretchable sensors and polymer behavior into one material system. This allowed the team to use a mechanochromic material as the sensor itself, not just as a base for electronics.

Many approaches to robotic touch have relied on increasingly complex sensor arrays, wiring, and computing systems. Rather than adding more electronics, Sasso’s team’s approach allows the material itself to encode touch into visible color. It remains unclear whether this color-based method can be scaled for use in commercial robotic hands, but this work suggests that the future of robotic touch might rely as much on smart materials as on advanced electronics.

Austin Burgess is a writer and researcher with a background in sales, marketing, and data analytics. He holds an MBA, a Bachelor of Science in Business Administration, and a data analytics certification. His work focuses on breaking scientific developments, with an emphasis on emerging biology, cognitive neuroscience, and archaeological discoveries.

Exceptionally preserved skin of Montsecosuchus depereti, an extinct crocodylomorph no larger than a house cat that prowled the tropical wetlands of Early Cretaceous Spain, has allowed paleontologists to reconstruct details of its scales, sensory organs and even possible banded markings along its tail.

The post 125-Million-Year-Old Crocodile Relative Reveals Its True Colors appeared first on Sci.News: Breaking Science News.

For more than a century, musicians have maintained that the way a pianist touches a key influences the sound that emerges. Many scientists, however, have argued that after the hammer strikes the string, the instrument itself determines the outcome, making the pianist’s touch irrelevant.

Now, a recent study published in the Proceedings of the National Academy of Sciences provides some of the strongest evidence yet in support of the musicians’ perspective.

A research team led by Dr. Shinichi Furuya of the NeuroPiano Institute and Sony Computer Science Laboratories developed a custom sensor system called HackKey. This system can record the movement of all 88 piano keys at 1,000 frames per second, with a spatial precision of 0.01 millimeters. The team invited 20 internationally recognized pianists to play notes while intentionally aiming for contrasting timbres, such as bright versus dark and light versus heavy. Listeners were able to distinguish among the different timbres, even individuals with no experience playing the piano.

The Movements Behind the Sound

The researchers identified a series of micro-movements beneath each keystroke. These movements are so subtle that they are almost impossible to see, but precise enough for listeners to perceive differences in sound.

Small changes in how quickly a key accelerates, slight overlaps between notes, and variations in the speed of initial contact with the key all influenced how listeners described the resulting sound. When each of these factors was adjusted individually, the perceived timbre changed. Adjusting a single movement feature was enough to reliably change how listeners perceived timbre. The results show that touch has a direct effect on sound, independent of factors such as volume or tempo.

The study describes these micro-movements as a motor skill developed through years of advanced training. The researchers call the emerging science of mapping movement to musical experience “dynaformics.”

A Debate as Old as the Modern Piano

The debate over whether touch can alter piano timbre dates back to at least the early 1900s, when music educators began discussing what distinguishes one performer’s sound from another. The piano’s mechanical action appeared to support the skeptics, since the hammer, once released, moves independently before striking the string and is not directly contacted by the pianist’s finger.

As a result of this mechanical process, many acousticians concluded that any reported differences in tone were psychological, influenced by context, volume, or timing rather than by touch. Musicians maintained their position but did not have the scientific tools to prove it.

To settle this debate, Furuya’s team developed a custom biometric contact-sensing system called HackKey, capable of recording the movement of all 88 piano keys at 1,000 frames per second with sub-millimeter precision. The system captured in-depth piano movement data that previous technology could not. For the first time, researchers could observe the specific actions of elite pianists and relate those movements to listeners’ descriptions of sound.

What It Means Beyond the Concert Hall

Piano teachers have often used general phrases like “play warmer” or “use a softer touch” because the specific movements that create certain sound qualities were not well understood. This study now offers a guide to those movements.

Future training tools may allow students to see precisely what their fingers are doing when a note is played successfully or not. Instead of relying on a teacher’s metaphor, students could compare their own keystrokes to a standard and work to improve their technique. The researchers suggest that this approach could make expressive technique easier to teach and visualize, especially for students who find it difficult to translate verbal instructions into physical actions.

The research may also apply to rehabilitation, robotics, and human-computer interaction. Discovering that small differences in movement can shape auditory perception offers new insight into how the brain links movement and sensory experience. Some researchers are exploring whether systems based on expressive musical movement could help patients recover dexterity and coordination after injury.

Most scientific research on music has focused on elements that are easier to measure, like pitch, loudness, and rhythm. Timbre, or the quality or “color” of a sound that makes one instrument or voice different from another, has been harder to measure. This study offers a new way to understand the mechanics behind this concept. The findings suggest that some of the most expressive parts of music come from movements too small to see, developed through years of practice.

Austin Burgess is a writer and researcher with a background in sales, marketing, and data analytics. He holds an MBA, a Bachelor of Science in Business Administration, and a data analytics certification. His work focuses on breaking scientific developments, with an emphasis on emerging biology, cognitive neuroscience, and archaeological discoveries.