JPL
Careers
Education
Science & Technology
JPL Logo
JPL Logo
Solar System
.

'Mixed Reality' Technology Brings Mars to Earth

Mar 30, 2016
Erisa Hines, a driver for the Mars Curiosity rover, based at JPL, also talks to participants in "Destination: Mars."
Credit: NASA/JPL-Caltech/Microsoft
Buzz Aldrin, an Apollo 11 astronaut who walked on the moon, makes a holographic appearance in "Destination: Mars," a mixed-reality tour of a part of Mars that NASA's Curiosity rover has explored.
Credit: NASA/JPL-Caltech/Microsoft

NASA and Microsoft have teamed up to create "Destination: Mars," a guided tour of a part of Mars using technologies that help scientists plan the Curiosity rover's activities.

What might it look like if you were walking around on Mars? A group of researchers at NASA's Jet Propulsion Laboratory, Pasadena, California, has been working on methods to take this question from the realm of imagination to the mind-bending domain of mixed reality.

As a result, NASA and Microsoft have teamed up to offer the public a guided tour of an area of Mars with astronaut Buzz Aldrin this summer in "Destination: Mars," an interactive exhibit using the Microsoft HoloLens mixed reality headset. "Mixed reality" means that virtual elements are merged with the user's actual environment, creating a world in which real and virtual objects can interact.

DOWNLOAD VIDEO Mixed-Reality Tech Brings Mars to Earth

The "Destination: Mars" exhibit will open at NASA's Kennedy Space Center Visitor Complex in Florida this summer. Guests will "visit" several sites on Mars, reconstructed using real imagery from NASA's Curiosity Mars Rover, which has been exploring the Red Planet since August 2012. Buzz Aldrin, an Apollo 11 astronaut who walked on the moon in 1969, will serve as "holographic tour guide" on the journey. Curiosity Mars rover driver Erisa Hines of JPL will also appear holographically, leading participants to places on Mars where scientists have made exciting discoveries and explaining what we have learned about the planet.

"This experience lets the public explore Mars in an entirely new way. To walk through the exact landscape that Curiosity is roving across puts its achievements and discoveries into beautiful context," said Doug Ellison, visualization producer at JPL.

"Destination: Mars" is an adaptation of OnSight, a Mars rover mission operations tool co-developed by Microsoft and JPL. A pilot group of scientists uses OnSight in their work supporting the Curiosity Mars rover's operations.

"We're excited to give the public a chance to see Mars using cutting-edge technologies that help scientists plan Curiosity's activities on Mars today," said Jeff Norris, project manager for OnSight and "Destination: Mars" at JPL. "While freely exploring the terrain, participants learn about processes that have shaped this alien world."

Abigail Fraeman, a Curiosity science team member at JPL, uses OnSight to make recommendations about where the rover should drive and which features to study in more detail. Recently OnSight helped her and a colleague identify the transition point between two Martian rock formations, which they would like to study in further detail.

"OnSight makes the whole process of analyzing the data feel a lot more natural to me," Fraeman said. "It really gives me the sense that I'm in the field when I put it on. Thinking about Martian geology is a lot more intuitive when I can stand in the scene and walk around the way I would if I were in the field."

By utilizing the same technologies and datasets as OnSight, "Destination: Mars" offers participants a glimpse of Mars as seen by mission scientists.

JPL is also developing mixed reality applications in support of astronauts on the International Space Station and engineers responsible for the design and assembly of spacecraft. NASA astronaut Scott Kelly, who recently returned from his historic "Year in Space" activities, used one of these applications to make the first Skype call from space to mission control in February 2016.

"By connecting astronauts to experts on the ground, mixed reality could be transformational for scientific and engineering efforts in space," Norris said.

"As we prepare to send humans to Mars in the 2030s, the public will now be able to preview the experience the astronauts will have as they walk and study the Martian surface," said Dave Lavery, program executive for Solar System Exploration at NASA Headquarters in Washington.

News Media Contact

Elizabeth Landau

Headquarters, Washington

202-358-0845

elandau@nasa.gov

2016-089

Related News

Mars .

NASA’s Perseverance Drives on Mars’ Terrain for First Time

Mars .

NASA Awards Mars Ascent Propulsion System Contract for Sample Return

Mars .

NASA to Provide Update on Perseverance ‘Firsts’ Since Mars Landing

Mars .

NASA to Reveal New Video, Images From Mars Perseverance Rover

Mars .

NASA's Mars Perseverance Rover Provides Front-Row Seat to Landing, First Audio Recording of Red Planet

Mars .

NASA’s Perseverance Rover Sends Sneak Peek of Mars Landing

Mars .

NASA’s Mars Helicopter Reports In

Mars .

Touchdown! NASA’s Mars Perseverance Rover Safely Lands on Red Planet

Mars .

Searching for Life in NASA’s Perseverance Mars Samples

Mars .

The Mars Relay Network Connects Us to NASA’s Martian Explorers

Explore More

Video .

What's Up - March 2021

Image .

Deep Jet Streams in Jupiter's Atmosphere

Image .

Power On: Psyche Spacecraft

Video .

What's Up - February 2021

Image .

Juno's Mission Goes On

Topic .

Solar System

Image .

Jupiter's Storm Oval BA As Viewed By An Artist

Image .

Jupiter North Pole Detail

Image .

A Hot Spot on Jupiter

Image .

A Jupiter Circumpolar Cyclone

About JPL
Who We Are
Executive Council
Directors of JPL
JPL History
Documentary Series
Virtual Tour
Annual Reports
Missions
All
Current
Past
Future
News
All
Earth
Mars
Solar System
Universe
Technology
Galleries
Images
Videos
Audio
Podcasts
Infographics
Visions of the Future
Slice of History
Engage
JPL and the Community
Lecture Series
Public Tours
Events
Team Competitions
JPL Speakers Bureau
Topics
Solar System
Mars
Earth
Climate Change
Stars and Galaxies
Exoplanets
Technology
JPL Life
For Media
Contacts and Information
Press Kits
More
Asteroid Watch
Robotics at JPL
Subscribe to Newsletter
Universe Newsletter
Social Media
Get the Latest from JPL
Follow Us

JPL is a federally funded research and development center managed for NASA by Caltech.

More from JPL
Careers Education Science & Technology Acquisitions JPL Store
Careers
Education
Science & Technology
Acquisitions
JPL Store
Related NASA Sites
Basics of Spaceflight
Climate Kids
Earth / Global Climate Change
Exoplanet Exploration
Mars Exploration
Solar System Exploration
Space Place
NASA's Eyes Visualization Project
Voyager Interstellar Mission
NASA
Caltech
Privacy
Image Policy
FAQ
Feedback
Site Manager: Veronica McGregor
Site Editors: Tony Greicius, Randal Jackson, Naomi Hartono