JPL
Careers
Education
Science & Technology
JPL Logo
JPL Logo
Solar System
.

NASA, Microsoft Collaboration Will Allow Scientists to 'Work on Mars'

Jan 21, 2015
A screen view from OnSight, a software tool developed by NASA's Jet Propulsion Laboratory in collaboration with Microsoft. OnSight uses real rover data to create a 3-D simulation of the Martian environment where mission scientists can "meet" to discuss rover operations.
Credit: NASA/JPL-Caltech
Scientist Katie Stack Morgan examines rover images on her computer. Images, even 3-D stereo views, lack a natural sense of depth that human vision employs to understand spatial relationships.
Credit: NASA/JPL-Caltech

NASA and Microsoft have teamed up to develop software called OnSight, a new technology that will enable scientists to work virtually on Mars using wearable technology called Microsoft HoloLens.

NASA and Microsoft have teamed up to develop software called OnSight, a new technology that will enable scientists to work virtually on Mars using wearable technology called Microsoft HoloLens.

Developed by NASA's Jet Propulsion Laboratory in Pasadena, California, OnSight will give scientists a means to plan and, along with the Mars Curiosity rover, conduct science operations on the Red Planet.

"OnSight gives our rover scientists the ability to walk around and explore Mars right from their offices," said Dave Lavery, program executive for the Mars Science Laboratory mission at NASA Headquarters in Washington. "It fundamentally changes our perception of Mars, and how we understand the Mars environment surrounding the rover."

OnSight will use real rover data and extend the Curiosity mission's existing planning tools by creating a 3-D simulation of the Martian environment where scientists around the world can meet. Program scientists will be able to examine the rover's worksite from a first-person perspective, plan new activities and preview the results of their work firsthand.

"We believe OnSight will enhance the ways in which we explore Mars and share that journey of exploration with the world," said Jeff Norris, JPL's OnSight project manager.

Until now, rover operations required scientists to examine Mars imagery on a computer screen, and make inferences about what they are seeing. But images, even 3-D stereo views, lack a natural sense of depth that human vision employs to understand spatial relationships.

The OnSight system uses holographic computing to overlay visual information and rover data into the user's field of view. Holographic computing blends a view of the physical world with computer-generated imagery to create a hybrid of real and virtual.

To view this holographic realm, members of the Curiosity mission team don a Microsoft HoloLens device, which surrounds them with images from the rover's Martian field site. They then can stroll around the rocky surface or crouch down to examine rocky outcrops from different angles. The tool provides access to scientists and engineers looking to interact with Mars in a more natural, human way.

"Previously, our Mars explorers have been stuck on one side of a computer screen. This tool gives them the ability to explore the rover's surroundings much as an Earth geologist would do field work here on our planet," said Norris.

The OnSight tool also will be useful for planning rover operations. For example, scientists can program activities for many of the rover's science instruments by looking at a target and using gestures to select menu commands.

The joint effort to develop OnSight with Microsoft grew from an ongoing partnership to investigate advances in human-robot interaction. The JPL team responsible for OnSight specializes in systems to control robots and spacecraft. The tool will assist researchers in better understanding the environment and workspace of robotic spacecraft -- something that can be quite challenging with their traditional suite of tools.

JPL plans to begin testing OnSight in Curiosity mission operations later this year. Future applications may include Mars 2020 rover mission operations, and other applications in support of NASA's journey to Mars.

JPL manages the Mars Science Laboratory Project for NASA's Science Mission Directorate in Washington, and built the project's Curiosity rover.

Learn more about NASA's journey to Mars at:

http://www.nasa.gov/mars

News Media Contact

Guy Webster/Veronica McGregor

818-354-6278/ 818-354-9452

guy.webster@jpl.nasa.gov/ veronica.mcgregor@jpl.nasa.gov

Dwayne Brown

202-358-1726

dwayne.c.brown@nasa.gov

2015-025

Related News

Mars .

NASA’s Perseverance Drives on Mars’ Terrain for First Time

Mars .

NASA Awards Mars Ascent Propulsion System Contract for Sample Return

Mars .

NASA to Provide Update on Perseverance ‘Firsts’ Since Mars Landing

Mars .

NASA to Reveal New Video, Images From Mars Perseverance Rover

Mars .

NASA's Mars Perseverance Rover Provides Front-Row Seat to Landing, First Audio Recording of Red Planet

Mars .

NASA’s Perseverance Rover Sends Sneak Peek of Mars Landing

Mars .

NASA’s Mars Helicopter Reports In

Mars .

Touchdown! NASA’s Mars Perseverance Rover Safely Lands on Red Planet

Mars .

Searching for Life in NASA’s Perseverance Mars Samples

Mars .

The Mars Relay Network Connects Us to NASA’s Martian Explorers

Explore More

Video .

What's Up - March 2021

Image .

Deep Jet Streams in Jupiter's Atmosphere

Image .

Power On: Psyche Spacecraft

Video .

What's Up - February 2021

Image .

Juno's Mission Goes On

Topic .

Solar System

Image .

Jupiter's Storm Oval BA As Viewed By An Artist

Image .

Jupiter North Pole Detail

Image .

A Hot Spot on Jupiter

Image .

A Jupiter Circumpolar Cyclone

About JPL
Who We Are
Executive Council
Directors of JPL
JPL History
Documentary Series
Virtual Tour
Annual Reports
Missions
All
Current
Past
Future
News
All
Earth
Mars
Solar System
Universe
Technology
Galleries
Images
Videos
Audio
Podcasts
Infographics
Visions of the Future
Slice of History
Engage
JPL and the Community
Lecture Series
Public Tours
Events
Team Competitions
JPL Speakers Bureau
Topics
Solar System
Mars
Earth
Climate Change
Stars and Galaxies
Exoplanets
Technology
JPL Life
For Media
Contacts and Information
Press Kits
More
Asteroid Watch
Robotics at JPL
Subscribe to Newsletter
Universe Newsletter
Social Media
Get the Latest from JPL
Follow Us

JPL is a federally funded research and development center managed for NASA by Caltech.

More from JPL
Careers Education Science & Technology Acquisitions JPL Store
Careers
Education
Science & Technology
Acquisitions
JPL Store
Related NASA Sites
Basics of Spaceflight
Climate Kids
Earth / Global Climate Change
Exoplanet Exploration
Mars Exploration
Solar System Exploration
Space Place
NASA's Eyes Visualization Project
Voyager Interstellar Mission
NASA
Caltech
Privacy
Image Policy
FAQ
Feedback
Site Manager: Veronica McGregor
Site Editors: Tony Greicius, Randal Jackson, Naomi Hartono