JPL
Careers
Education
Science & Technology
JPL Logo
JPL Logo
Solar System
.

You Can Help Train NASA’s Rovers to Better Explore Mars

Oct. 26, 2021

The robotic arm of NASA’s Perseverance rover is visible in this image used by the AI4Mars project. Users outline and identify different rock and landscape features to help train an artificial intelligence algorithm that will help improve the capabilities of Mars rovers.

Credit: NASA/JPL-Caltech

Members of the public can now help teach an artificial intelligence algorithm to recognize scientific features in images taken by NASA’s Perseverance rover.

Artificial intelligence, or AI, has enormous potential to change the way NASA’s spacecraft study the universe. But because all machine learning algorithms require training from humans, a recent project asks members of the public to label features of scientific interest in imagery taken by NASA’s Perseverance Mars rover.

Called AI4Mars, the project is the continuation of one launched last year that relied on imagery from NASA’s Curiosity rover. Participants in the earlier stage of that project labeled nearly half a million images, using a tool to outline features like sand and rock that rover drivers at NASA’s Jet Propulsion Laboratory typically watch out for when planning routes on the Red Planet. The end result was an algorithm, called SPOC (Soil Property and Object Classification), that could identify these features correctly nearly 98% of the time.

Teach a Mars Rover to Classify Martian Terrain

SPOC is still in development, and researchers hope it can someday be sent to Mars aboard a future spacecraft that could perform even more autonomous driving than Perseverance’s AutoNav technology allows.

Images from Perseverance will further improve SPOC by expanding the kinds of identifying labels that can be applied to features on the Martian surface. AI4Mars now provides labels to identify more refined details, allowing people to choose options like float rocks (“islands” of rocks) or nodules (BB-size balls, often formed by water, of minerals that have been cemented together).

The goal is to hone an algorithm that could help a future rover pick out needles from the haystack of data sent from Mars. Equipped with 19 cameras, Perseverance sends anywhere from dozens to hundreds of images to Earth each day for scientists and engineers to comb through for specific geological features. But time is tight: After those images travel millions of miles from Mars to Earth, the team members have a matter of hours to develop the next set of instructions, based on what they see in those images, to send to Perseverance.

With AI4Mars, users outline rock and landscape features in images from NASA’s Perseverance Mars rover. The project helps train an artificial intelligence algorithm for improved rover capabilities on Mars.

Credit: NASA/JPL-Caltech

Parts of Perseverance are visible beside an area outlined in AI4Mars. The project already used images from NASA’s Curiosity Mars rover and help from the public to train an artificial intelligence algorithm; now the project is using images from Perseverance.

Credit: NASA/JPL-Caltech

“It’s not possible for any one scientist to look at all the downlinked images with scrutiny in such a short amount of time, every single day,” said Vivian Sun, a JPL scientist who helps coordinate Perseverance’s daily operations and consulted on the AI4Mars project. “It would save us time if there was an algorithm that could say, ‘I think I saw rock veins or nodules over here,’ and then the science team can look at those areas with more detail.”

Especially during this developmental stage, SPOC requires lots of validation from scientists to ensure it’s labeling accurately. But even when it improves, the algorithm is not intended to replace more complex analyses by human scientists.

It’s All About the Data

Key to any successful algorithm is a good dataset, said Hiro Ono, the JPL AI researcher who led the development of AI4Mars. The more individual pieces of data available, the more an algorithm learns.

“Machine learning is very different from normal software,” Ono said. “This isn’t like making something from scratch. Think of it as starting with a new brain. More of the effort here is getting a good dataset to teach that brain and massaging the data so it will be better learned.”

AI researchers can train their Earth-bound algorithms on tens of thousands of images of, say, houses, flowers, or kittens. But no such data archive existed for the Martian surface before the AI4Mars project. The team would be content with 20,000 or so images in their repository, each with a variety of features labeled.

Get the Latest JPL News

SUBSCRIBE TO THE NEWSLETTER

The Mars-data repository could serve several purposes, noted JPL’s Annie Didier, who worked on the Perseverance version of AI4Mars. “With this algorithm, the rover could automatically select science targets to drive to,” she said. It could also store a variety of images onboard the rover, then send back just images of specific features that scientists are interested in, she said.

That’s on the horizon; scientists may not have to wait that long for the algorithm to benefit them, however. Before the algorithm ever makes it to space, it could be used to scan NASA’s vast public archive of Mars data, allowing researchers to find surface features in those images more easily.

Ono noted it’s important to the AI4Mars team to make their own dataset publicly available so that the entire data science community can benefit.

“If someone outside JPL creates an algorithm that works better than ours using our dataset, that’s great, too,” he said. “It just makes it easier to make more discoveries.”

More About the Mission

A key objective for Perseverance’s mission on Mars is astrobiology, including the search for signs of ancient microbial life. The rover will characterize the planet’s geology and past climate, pave the way for human exploration of the Red Planet, and be the first mission to collect and cache Martian rock and regolith (broken rock and dust).

Subsequent NASA missions, in cooperation with ESA (European Space Agency), would send spacecraft to Mars to collect these sealed samples from the surface and return them to Earth for in-depth analysis.

The Mars 2020 Perseverance mission is part of NASA’s Moon to Mars exploration approach, which includes Artemis missions to the Moon that will help prepare for human exploration of the Red Planet.

JPL, which is managed for NASA by Caltech in Pasadena, California, built and manages operations of the Perseverance rover.

For more about Perseverance:

mars.nasa.gov/mars2020/

nasa.gov/perseverance

Read More About Perseverance:

Perseverance Cameras Capture Mars Like Never Before
Find Where Perseverance Is Located Right Now

News Media Contact

Andrew Good

Jet Propulsion Laboratory, Pasadena, Calif.

818-393-2433

andrew.c.good@jpl.nasa.gov

Karen Fox / Alana Johnson

NASA Headquarters, Washington

301-286-6284 / 202-358-1501

karen.c.fox@nasa.gov / alana.r.johnson@nasa.gov

2021-216

Related News

Solar System .

NASA’s Juno Team Assessing Camera After 48th Flyby of Jupiter

Solar System .

NASA’s Psyche Mission Continues Preparation for Launch in 2023

Solar System .

NASA’s Lunar Flashlight Team Assessing Spacecraft’s Propulsion System

Mars .

NASA Explores a Winter Wonderland on Mars

Solar System .

Juno Spacecraft Recovering Memory After 47th Flyby of Jupiter

Mars .

NASA Retires InSight Mars Lander Mission After Years of Science

Mars .

NASA’s Perseverance Rover Deposits First Sample on Mars Surface

Solar System .

40-Year Study Finds Mysterious Patterns in Temperatures at Jupiter

Mars .

NASA’s Perseverance Rover to Begin Building Martian Sample Depot

Solar System .

NASA’s Juno Exploring Jovian Moons During Extended Mission

Explore More

Image .

Windstreak

Image .

Sirenum Fossae

Image .

NASA's Psyche: Picking up Launch Prep for 2023

Image .

Claritas Fossae

Image .

Perseverance's Three Forks Sample Depot Selfie

Event Feb. 16, 2023 .

Perseverance: Two Years on Mars

Event Feb. 16, 2023 .

Perseverance: Two Years on Mars

Image .

Gale Crater

Mission .

Ranger 1

Image .

South Polar Layers

About JPL
Who We Are
Executive Council
Directors
Careers
Internships
The JPL Story
JPL Achievements
Documentary Series
Annual Reports
Missions
Current
Past
Future
All
News
All
Earth
Solar System
Stars and Galaxies
Subscribe to JPL News
Galleries
Images
Videos
Audio
Podcasts
Apps
Visions of the Future
Slice of History
Robotics at JPL
Events
Lecture Series
Team Competitions
Speakers Bureau
Calendar
Visit
Public Tours
Virtual Tour
Directions and Maps
Topics
JPL Life
Solar System
Mars
Earth
Climate Change
Exoplanets
Stars and Galaxies
Robotics
More
Asteroid Watch
NASA's Eyes Visualizations
Universe - Internal Newsletter
Social Media
Get the Latest from JPL
Follow Us

JPL is a federally funded research and development center managed for NASA by Caltech.

More from JPL
Careers Education Science & Technology Acquisitions JPL Store
Careers
Education
Science & Technology
Acquisitions
JPL Store
Related NASA Sites
Basics of Spaceflight
Climate Kids
Earth / Global Climate Change
Exoplanet Exploration
Mars Exploration
Solar System Exploration
Space Place
NASA's Eyes Visualization Project
Voyager Interstellar Mission
NASA
Caltech
Privacy
Image Policy
FAQ
Feedback
Site Managers: Veronica McGregor, Randal Jackson
Site Editors: Tony Greicius, Naomi Hartono
CL#: 21-0018