JPL
Careers
Education
Science & Technology
JPL Logo
JPL Logo
Earth
.

NASA Turns to the Cloud for Help With Next-Generation Earth Missions

Oct. 13, 2021

The state-of-the-art Earth science satellites launching in the near future will be generating unprecedented quantities of data on our planet’s vital signs. Cloud computing will help researchers make the most of those troves of information.

Credit: NASA Earth Observatory

As satellites collect larger and larger amounts of data, engineers and researchers are implementing solutions to manage these huge increases.

The cutting-edge Earth science satellites launching in the next couple of years will give more detailed views of our planet than ever before. We’ll be able to track small-scale ocean features like coastal currents that move nutrients vital to marine food webs, monitor how much fresh water flows through lakes and rivers, and spot movement in Earth’s surface of less than half an inch (a centimeter). But these satellites will also produce a deluge of data that has engineers and scientists setting up systems in the cloud capable of processing, storing, and analyzing all of that digital information.

“About five or six years ago, there was a realization that future Earth missions were going to be generating a huge volume of data and that the systems we were using would become inadequate very quickly,” said Suresh Vannan, manager of the Physical Oceanography Distributed Active Archive Center based at NASA’s Jet Propulsion Laboratory in Southern California.

Part of the SWOT satellite’s science instrument payload sits in a clean room at NASA’s Jet Propulsion Laboratory during assembly. By measuring the height of the water in the planet's ocean, lakes, and rivers, researchers can track the volume and location of the finite resource around the world.

Credit: NASA/JPL-Caltech

The center is one of several under NASA’s Earth Science Data Systems program responsible for processing, archiving, documenting, and distributing data from the agency’s Earth-observing satellites and field projects. The program has been working for several years on a solution to the information-volume challenge by moving its data and data-handling systems from local servers to the cloud – software and computing services that run on the internet instead of locally on someone’s machine.

The Sentinel-6 Michael Freilich satellite, part of the U.S.-European Sentinel-6/Jason-CS (Continuity of Service) mission, is the first NASA satellite to utilize this cloud system, although the amount of data the spacecraft sends back isn’t as large as the data many future satellites will return.

Part of the NISAR satellite rests in a thermal vacuum chamber at NASA's Jet Propulsion Laboratory in August 2020. The Earth satellite will track subtle changes in the planet's surface as small as 0.4 inches.
Part of the NISAR satellite rests in a thermal vacuum chamber at NASA's Jet Propulsion Laboratory in August 2020. The Earth satellite will track subtle changes in the planet's surface as small as 0.4 inches.
Credit: NASA/JPL-Caltech
Full Image Details

Two of those forthcoming missions, SWOT and NISAR, will together produce roughly 100 terabytes of data a day. One terabyte is about 1,000 gigabytes – enough digital storage for approximately 250 feature-length movies. SWOT, short for Surface Water and Ocean Topography, will produce about 20 terabytes of science data a day while the NISAR (NASA-Indian Space Research Organisation Synthetic Aperture Radar) mission will generate roughly 80 terabytes daily. Data from SWOT will be archived with the Physical Oceanography Distributed Active Archive Center while data from NISAR will be handled by the Alaska Satellite Facility Distributed Active Archive Center. NASA’s current Earth science data archive is around 40 petabyes (1 petabyte is 1,000 terabytes), but by 2025 – a couple of years after SWOT and NISAR are launched – the archive is expected to hold more than 245 petabytes of data.

Both NISAR and SWOT will use radar-based instruments to gather information. Targeting a 2023 launch, NISAR will monitor the planet’s surface, collecting data on environmental characteristics including shifts in the land associated with earthquakes and volcanic eruptions, changes to Earth’s ice sheets and glaciers, and fluctuations in agricultural activities, wetlands, and the size of forests.

Explore this 3D model of the SWOT satellite by zooming in and out, or clicking and dragging the image around. Credit: NASA/JPL-Caltech

Set for a 2022 launch, SWOT will monitor the height of the planet’s surface water, both ocean and freshwater, and will help researchers compile the first survey of the world’s fresh water and small-scale ocean currents. SWOT is being jointly developed by NASA and the French space agency Centre National d’Etudes Spatial.

“This is a new era for Earth observation missions, and the huge amount of data they will generate requires a new era for data handling,” said Kevin Murphy, chief science data officer for NASA’s Science Mission Directorate. “NASA is not just working across the agency to facilitate efficient access to a common cloud infrastructure, we’re also training the science community to access, analyze, and use that data.”

Faster Downloads

Currently, Earth science satellites send data back to ground stations where engineers turn the raw information from ones and zeroes into measurements that people can use and understand. Processing the raw data increases the file size, but for older missions that send back relatively smaller amounts of information, this isn’t a huge problem. The measurements are then sent to a data archive that keeps the information on servers. In general, when a researcher wants to use a dataset, they log on to a website, download the data they want, and then work with it on their machine.

Get the Latest JPL News

SUBSCRIBE TO THE NEWSLETTER

However, with missions like SWOT and NISAR, that won’t be feasible for most scientists. If someone wanted to download a day’s worth of information from SWOT onto their computer, they’d need 20 laptops, each capable of storing a terabyte of data. If a researcher wanted to download four days’ worth of data from NISAR, it would take about a year to perform on an average home internet connection. Working with data stored in the cloud means scientists won’t have to buy huge hard drives to download the data or wait months as numerous large files download to their system. “Processing and storing high volumes of data in the cloud will enable a cost-effective, efficient approach to the study of big-data problems,” said Lee-Lueng Fu, JPL project scientist for SWOT.

Infrastructure limitations won’t be as much of a concern, either, since organizations won’t have to pay to store mind-boggling amounts of data or maintain the physical space for all those hard drives. “We just don’t have the additional physical server space at JPL with enough capacity and flexibility to support both NISAR and SWOT,” said Hook Hua, a JPL science data systems architect for both missions.

NASA engineers have already taken advantage of this aspect of cloud computing for a proof-of-concept product using data from Sentinel-1. The satellite is an ESA (European Space Agency) mission that also looks at changes to Earth’s surface, although it uses a different type of radar instrument than the ones NISAR will use. Working with Sentinel-1 data in the cloud, engineers produced a colorized map showing the change in Earth’s surface from more vegetated areas to deserts. “It took a week of constant computing in the cloud, using the equivalent of thousands of machines,” said Paul Rosen, JPL project scientist for NISAR. “If you tried to do this outside the cloud, you’d have had to buy all those thousands of machines.”

Cloud computing won’t replace all of the ways in which researchers work with science datasets, but at least for Earth science, it’s certainly gaining ground, said Alex Gardner, a NISAR science team member at JPL who studies glaciers and sea level rise. He envisions that most of his analyses will happen elsewhere in the near future instead of on his laptop or personal server. “I fully expect in five to 10 years, I won’t have much of a hard drive on my computer and I will be exploring the new firehose of data in the cloud,” he said.

To explore NASA’s publicly available datasets, visit:

https://data.nasa.gov/

NISAR – Helping Farmers From Space
Water-Monitoring Satellite Moves Closer to Launch
International Cutting-Edge SWOT Satellite to Survey the World’s Water
Major Earth Satellite to Track Disasters, Effects of Climate Change

News Media Contact

Jane J. Lee / Ian J. O’Neill

Jet Propulsion Laboratory, Pasadena, Calif.

818-354-0307 / 818-354-2649

jane.j.lee@jpl.nasa.gov / ian.j.oneill@jpl.nasa.gov

2021-207

Related News

Earth .

Joint NASA, CNES Water-Tracking Satellite Reveals First Stunning Views

Climate Change .

NASA Uses 30-Year Satellite Record to Track and Project Rising Seas

Weather .

Ranking Atmospheric Rivers: New Study Finds World of Potential

Earth .

NASA and Italian Space Agency Join Forces on Air Pollution Mission

Earth .

NASA-ISRO Science Instruments Arrive in India Ahead of 2024 Launch

Climate Change .

NASA Space Mission Takes Stock of Carbon Dioxide Emissions by Countries

Technology .

NASA’s Quantum Detector Achieves World-Leading Milestone

Earth .

Removing Traces of Life in Lab Helps NASA Scientists Study Its Origins

Earth .

Dynamic NASA-Built Weather Sensors Enlisted to Track Tropical Cyclones

Asteroids and Comets .

Webb Detects Extremely Small Main Belt Asteroid

Explore More

Image .

Sea Level Visualization of Gulf Stream

Image .

SWOT Satellite's Land 'First Light'

Image .

SWOT Satellite's Sea Level 'First Light'

Image .

Mir Diamond Mine, Siberia

Mission .

Deep Space Network

Image .

30 Years of Sea Level Rise

Image .

Chausey, French Channel Islands

Event April 20, 2023 .

Earth Surface Mineral Dust Source Investigation (EMIT) Mission

Image .

Poniente Almeriense, Spain

Image .

COWVR, TEMPEST Track Tropical Cyclone Mandous

About JPL
Who We Are
Executive Council
Directors
Careers
Internships
The JPL Story
JPL Achievements
Documentary Series
Annual Reports
Missions
Current
Past
Future
All
News
All
Earth
Solar System
Stars and Galaxies
Subscribe to JPL News
Galleries
Images
Videos
Audio
Podcasts
Apps
Visions of the Future
Slice of History
Robotics at JPL
Events
Lecture Series
Team Competitions
Speakers Bureau
Calendar
Visit
Public Tours
Virtual Tour
Directions and Maps
Topics
JPL Life
Solar System
Mars
Earth
Climate Change
Exoplanets
Stars and Galaxies
Robotics
More
Asteroid Watch
NASA's Eyes Visualizations
Universe - Internal Newsletter
Social Media
Get the Latest from JPL
Follow Us

JPL is a federally funded research and development center managed for NASA by Caltech.

More from JPL
Careers Education Science & Technology Acquisitions JPL Store
Careers
Education
Science & Technology
Acquisitions
JPL Store
Related NASA Sites
Basics of Spaceflight
Climate Kids
Earth / Global Climate Change
Exoplanet Exploration
Mars Exploration
Solar System Exploration
Space Place
NASA's Eyes Visualization Project
Voyager Interstellar Mission
NASA
Caltech
Privacy
Image Policy
FAQ
Feedback
Site Managers: Veronica McGregor, Randal Jackson
Site Editors: Tony Greicius, Naomi Hartono
CL#: 21-0018