Deep learning used to create virtual 'super instrument'

"Deep learning is an emerging capability that is revolutionizing the way we interact with data," said Dr. Andrés Muñoz-Jaramillo, senior research scientist at SwRI. Muñoz-Jaramillo co-authored the study, published this month in Science Advances, alongside collaborators from nine other institutions as part of NASA's Frontier Development Laboratory. The laboratory is an applied artificial intelligence research accelerator that applies deep learning and machine learning techniques to challenges in space science and exploration.

Deep learning is a type of machine learning methods that mimic the way the human brain processes information. The result of deep learning is machines accomplishing things that previously required human intelligence, such as translation between foreign languages, driving a vehicle and facial recognition. Things like Netflix® suggesting what to watch next, an iPhone® unlocking upon sight of its owner's face and Alexa® responding to a vocal request are all results of deep learning.

"All missions beyond Earth have a host of instruments that have been designed with specific capabilities to answer specific scientific questions," Muñoz-Jaramillo said. "When we combine them into virtual super instruments, we can produce more cost-effective missions with higher scientific impact or use measurements by one instrument to help answer the science questions of another."

Muñoz-Jaramillo stresses in the study that these virtual super instruments will not make hardware obsolete. They will always require a spacecraft to collect the necessary data for virtualization.

"Deep learning instruments cannot make something out of nothing, but they can significantly enhance the capabilities of existing technology," he said.

Their virtual super instrument is already in use as part of a Frontier Development Laboratory project for forecasting ionospheric disturbances. Muñoz-Jaramillo is currently working on additional super instruments that combine other capabilities.

"In essence, deep learning involves sophisticated transformation of data," he said. "We can make these transformations into scientifically useful data and modernize the way we view not just the Sun, but a great number of scientific questions."