DARPA Announces Research Teams to Develop Intelligent Event-Based Imagers

DARPA has announced that three teams of researchers led by Raytheon, BAE Systems, and Northrop Grumman have been selected to develop event-based infrared (IR) camera technologies under the Fast Event-based Neuromorphic Camera and Electronics (FENCE) program.

Event-based - or neuromorphic - cameras are an emerging class of sensors with demonstrated advantages relative to traditional imagers. These advanced models operate asynchronously and only transmit information about pixels that have changed. This means they produce significantly less data and operate with much lower latency and power.

"Neuromorphic refers to silicon circuits that mimic brain operation; they offer sparse output, low latency, and high energy efficiency," said Dr. Whitney Mason, the program manager leading the FENCE program. "Event-based cameras operate under these same principles when dealing with sparse scenes, but currently lack advanced 'intelligence' to perform more difficult perception and control tasks."

Today's state-of-the-art (SOTA) cameras work well with scenes that have few changes to track and the imagery is relatively simple. Take, for example, a scene of a plane moving through a clear blue sky. SOTA imagers could easily track the movement of the plane. Their capabilities fail, however, in highly cluttered and dynamic scenes, limiting their use among many military applications.

FENCE seeks to address these shortcomings by developing and demonstrating a low latency, low power, event-based infrared (IR) focal plane array (FPA) and a new class of digital signal processing and learning algorithms to enable intelligent sensors that can handle more dynamic scenes.

The teams from Raytheon, BAE Systems, and Northrop Grumman will work to develop an asynchronous read-out integrated circuit (ROIC) with low-latency, as well as a processing layer that integrates with the ROIC to identify relevant spatial and temporal signals. Together the ROIC and processing layer will enable an integrated FENCE sensor to operate on less power than 1.5 Watts.

"The goal is to develop a 'smart' sensor that can intelligently reduce the amount of information that is transmitted from the camera, narrowing down the data for consideration to only the most relevant pixels," noted Mason.

FENCE technology could ultimately aid a number of military applications - from autonomous vehicles and robotics to IR search and tracking. To ensure broad applicability, the researchers will also focus on developing a single solution that is flexible and adaptable so it can be used across various mission spaces.

Related Links
Defense Advanced Research Projects Agency
All about the robots on Earth and beyond!

Tweet

Thanks for being there;
We need your help. The SpaceDaily news network continues to grow but revenues have never been harder to maintain.

With the rise of Ad Blockers, and Facebook - our traditional revenue sources via quality network advertising continues to decline. And unlike so many other news sites, we don't have a paywall - with those annoying usernames and passwords.

Our news coverage takes time and effort to publish 365 days a year.

If you find our news sites informative and useful then please consider becoming a regular supporter or for now make a one off contribution.

SpaceDaily Monthly Supporter
$5+ Billed Monthly

paypal only

SpaceDaily Contributor
$5 Billed Once

credit card or paypal

Giving robots better moves
Boston MA (SPX) Jul 01, 2021
For most people, the task of identifying an object, picking it up, and placing it somewhere else is trivial. For robots, it requires the latest in machine intelligence and robotic manipulation. That's what MIT spinoff RightHand Robotics has incorporated into its robotic piece-picking systems, which combine unique gripper designs with artificial intelligence and machine vision to help companies sort products and get orders out the door. "If you buy something at the store, you push the cart do ... read more