JPL
Careers
Education
Science & Technology
JPL Logo
JPL Logo
Technology
.

A.I. Could Be a Firefighter's 'Guardian Angel'

Aug 11, 2016
New artificial intelligence technology, developed jointly by the Jet Propulsion Lab and the Department of Homeland Security, could one day guide first responders in the field.
Credit: USAF photo/Tech. Sgt. Rey Ramon
Edward Chow (left), Manager of JPL's Civil Program Office and program manager for a new artificial intelligence technology, stands with John Merrill (right), Next Generation First Responder program manager for the Department of Homeland Security Science and Technology Directorate.
Credit: Edward Chow

JPL research designed to keep first responders out of harm's way receives award from the Department of Homeland Security.

Firefighters have only their wits and five senses to rely on inside a burning building. But research developed in part by NASA's Jet Propulsion Laboratory, Pasadena, California, may change that, introducing artificial intelligence (AI) that could collect data on temperatures, gases and other danger signals and guide a team of first responders safely through the flames.

AUDREY, the Assistant for Understanding Data through Reasoning, Extraction, and sYnthesis, has received the Undersecretary's Award for Collaboration from the Department of Homeland Security (DHS) in recognition of its joint development by JPL and DHS. It's part of the Next Generation First Responder (NGFR) program, a DHS initiative to innovate new ways to keep firefighters, police, paramedics and other first responders safe in the field through increased awareness of their surroundings and communication abilities.

But the big picture is even more exciting: AUDREY can track an entire team of firefighters, sending relevant signals to individuals while helping to make recommendations for how they could work together.

"As a firefighter moves through an environment, AUDREY could send alerts through a mobile device or head-mounted display," said Mark James of JPL, lead scientist for the AUDREY project.

AUDREY is designed to be integrated with the "Internet of Things" -- the idea of numerous devices and sensors all wirelessly "talking" to one another. In the case of firefighters, wearable sensors in their clothes could pick up their GPS location, heat in other rooms, the presence of dangerous chemicals and gases, satellite imagery of a location and much more.

"When first responders are connected to all these sensors, the AUDREY agent becomes their guardian angel," said Edward Chow, manager of JPL's Civil Program Office and program manager for AUDREY. "Because of all this data the sensor sees, firefighters won't run into the next room where the floor will collapse."

John Merrill, NGFR program manager for the DHS Science and Technology Directorate, said that technology is rapidly providing new strengths for first responders in the field.

"The proliferation of miniaturized sensors and Internet of Things devices can make a tremendous impact on first responder safety, connectivity, and situational awareness," Merrill said. "The massive amount of data available to the first responder is incomprehensible in its raw state and must be synthesized into useable, actionable information."

Guardian angel in the cloud

AUDREY is designed to keep watch from above. As a cloud-based piece of software, it can do more than send data to those in the field. As it watches an event, it can actually learn and start making predictions about what resources will be needed next.

James said the system is designed to recognize the specific roles of first responders in the field. This allows AUDREY to provide potentially lifesaving information customized to the various roles, which avoids overloading the users.

"Since AUDREY knows the roles of everyone who receives her data, she only supplies the relevant information that is appropriate for them," James said.

In June, AUDREY was tested in a virtual demonstration at the Public Safety Broadband Stakeholder Meeting held by the Department of Commerce in San Diego. It was fed data from a variety of sensors and asked to make safety recommendations, which it then sent to a mobile device. Within a year, Chow said, the plan is to test AUDREY in field demonstrations.

From machine to human-like thinking

Chow emphasized that artificial intelligence is only as effective as the data it's working with. The more data it has, the higher the probability that it will make useful recommendations.

"Most A.I. projects are rule-based -- if this, then that," he said. "But what if you're only getting part of the information? We use complex reasoning to simulate how humans think. That allows us to provide more useful info to firefighters than a traditional A.I. system."

AUDREY includes several technologies developed by NASA and the Department of Defense over the last five years. AUDREY for NGFR has been in development for nine months and is funded by the Department of Homeland Security. Caltech manages JPL for NASA.

News Media Contact

Andrew Good

Jet Propulsion Laboratory, Pasadena, Calif.

818-393-2433

andrew.c.good@jpl.nasa.gov

2016-208

Related News

Climate Change .

NASA-Built Instrument Will Help to Spot Greenhouse Gas Super-Emitters

Stars and Galaxies .

Telescopes Unite in Unprecedented Observations of Famous Black Hole

Earth .

NASA Satellites Detect Signs of Volcanic Unrest Years Before Eruptions

Technology .

NASA Selects Innovative, Early-Stage Tech Concepts for Continued Study

Technology .

POINTER: Seeing Through Walls to Help Locate Firefighters

Mars .

Sensors Collect Crucial Data on Mars Landings With Arrival of Perseverance

Solar System .

NASA’s Europa Clipper Builds Hardware, Moves Toward Assembly

Asteroids and Comets .

NASA Begins Final Assembly of Spacecraft Destined for Asteroid Psyche

Earth .

NASA Data Powers New USDA Soil Moisture Portal

Technology .

Futuristic Space Technology Concepts Selected by NASA for Initial Study

Explore More

Topic .

Technology

Video .

Working Remotely: How Astronauts Upgraded a Complex Experiment in Space

Infographic .

Caltech (Verma,Akhil phD. Planetary Science)

Video .

NASA Climbing Robot Scales Cliffs and Looks for Life

Infographic .

Voyager 2: By the Numbers

Infographic .

Grand Challenge Initiative

Video .

OnSight: Virtual Visit to Mars

Infographic .

Pi in the Sky 5

Infographic .

Understanding the Ionosphere: NASA's ICON Mission

Infographic .

2018 Poker Flat Sounding Rocket Campaign Quick Look

About JPL
Who We Are
Executive Council
Directors of JPL
JPL History
Documentary Series
Virtual Tour
Annual Reports
Missions
All
Current
Past
Future
News
All
Earth
Mars
Solar System
Universe
Technology
Galleries
Images
Videos
Audio
Podcasts
Infographics
Visions of the Future
Slice of History
Engage
JPL and the Community
Lecture Series
Public Tours
Events
Team Competitions
JPL Speakers Bureau
Topics
Solar System
Mars
Earth
Climate Change
Stars and Galaxies
Exoplanets
Technology
JPL Life
For Media
Contacts and Information
Press Kits
More
Asteroid Watch
Robotics at JPL
Subscribe to Newsletter
Universe Newsletter
Social Media
RSS
Get the Latest from JPL
Follow Us

JPL is a federally funded research and development center managed for NASA by Caltech.

More from JPL
Careers Education Science & Technology Acquisitions JPL Store
Careers
Education
Science & Technology
Acquisitions
JPL Store
Related NASA Sites
Basics of Spaceflight
Climate Kids
Earth / Global Climate Change
Exoplanet Exploration
Mars Exploration
Solar System Exploration
Space Place
NASA's Eyes Visualization Project
Voyager Interstellar Mission
NASA
Caltech
Privacy
Image Policy
FAQ
Feedback
Site Manager: Veronica McGregor
Site Editors: Tony Greicius, Randal Jackson, Naomi Hartono