Neural networks promise sharpest ever images

The diameter of its lens or mirror, the so-called aperture, fundamentally limits any telescope. In simple terms, the bigger the mirror or lens, the more light it gathers, allowing astronomers to detect fainter objects, and to observe them more clearly. A statistical concept known as 'Nyquist sampling theorem' describes the resolution limit, and hence how much detail can be seen.

The Swiss study, led by Prof Kevin Schawinski of ETH Zurich, uses the latest in machine learning technology to challenge this limit. They teach a neural network, a computational approach that simulates the neurons in a brain, what galaxies look like, and then ask it to automatically recover a blurred image and turn it into a sharp one. Just like a human, the neural net needs examples - in this case a blurred and a sharp image of the same galaxy - to learn the technique.

Their system uses two neural nets competing with each other, an emerging approach popular with the machine learning research community called a "generative adversarial network", or GAN. The whole teaching programme took just a few hours on a high performance computer.

The trained neural nets were able to recognise and reconstruct features that the telescope could not resolve - such as star-forming regions, bars and dust lanes in galaxies. The scientists checked it against the original high-resolution image to test its performance, finding it better able to recover features than anything used to date, including the 'deconvolution' approach used to improve the images made in the early years of the Hubble Space Telescope.

Schawinski sees this as a big step forward: "We can start by going back to sky surveys made with telescopes over many years, see more detail than ever before, and for example learn more about the structure of galaxies. There is no reason why we can't then apply this technique to the deepest images from Hubble, and the coming James Webb Space Telescope, to learn more about the earliest structures in the Universe."

Professor Ce Zhang, the collaborator from computer science, also sees great potential: "The massive amount of astronomical data is always fascinating to computer scientists. But, when techniques such as machine learning emerge, astrophysics also provides a great test bed for tackling a fundamental computational question - how do we integrate and take advantage of the knowledge that humans have accumulated over thousands of years, using a machine learning system? We hope our collaboration with Kevin can also shed light on this question."

The success of the project points to a more "data-driven" future for astrophysics in which information is learned automatically from data, instead of manually crafted physics models. ETH Zurich is hosting this work on the space.ml cross-disciplinary astrophysics/computer-science initiative, where the code is available to the general public.