Scientists gather to prepare for Large Synoptic Survey Telescope

However, managing LSST's vast data archive and extracting meaningful information from it in an acceptable amount of time will be challenging and requires the development of new computational tools. "Only a few companies in the world, like Google or Facebook, are currently dealing with comparable amounts of data," says Jacek Becla, whose group at the Department of Energy's SLAC National Accelerator Laboratory leads the design of the telescope's database. SLAC is also in charge of constructing LSST's 3,200-megapixel camera.

To prepare for this challenge, SLAC hosted two back-to-back workshops in February -- annual meetings of the LSST Dark Energy Science Collaboration and the LSST Data Management teams -- that brought together about 160 experts working on computer hardware and software supporting LSST science and technology.

Managing 'Big Data'

Data management is an essential part of the LSST Project and involves five partners in addition to SLAC. One challenge they face is the search for specific scientific information in an enormous database. "We're expecting to receive over a million queries from researchers per day," says Becla, who organized the data management meeting. "Some queries may be very complex -- for instance, 'Find all red stars near quasars across the entire sky.' Of course, this search should also be fast to enable rapid discovery."

Time will also be a crucial factor when it comes to screening LSST's images for short-lived events such as exploding stars and sending out alerts to researchers within less than a minute.

Kian-Tat Lim, a member of Becla's team, gives another example. "Considering that LSST will take hundreds of pictures of each astronomical object under different conditions, it'll be difficult to accurately measure an object's position, brightness and shape," he says. "You might think of it as taking Monet's series of paintings of the Houses of Parliament in London and combining them to determine the exact height and color of its clock tower."

Demystifying Dark Energy

Meanwhile, the Dark Energy Science Collaboration, or DESC, is preparing to use LSST to better understand why the expansion of our universe is accelerating -- a property ascribed to the existence of mysterious dark energy.

An important task for the DESC is to develop algorithms for the precise measurement of astronomical distances. "We determine the acceleration of the expansion of the universe by looking at how the distribution of galaxies changes the farther we go out in the universe," says Phil Marshall from SLAC and Stanford University's Kavli Institute for Particle Astrophysics and Cosmology (KIPAC), who organized this year's annual DESC meeting. "To understand the nature of dark energy, we need to be able to measure the acceleration with an uncertainty of less than one percent."

There are a number of established ways to measure distances, and several DESC working groups are dedicated to developing analysis software for each of them. "There was a lot of cross-working activity between the different groups, and everyone felt that we're actively preparing for LSST's data," says KIPAC's Deborah Bard.

Another focal point of the meeting was on developing blind analyses of simulated data. "Such 'data challenges' allow an end-to-end test of the software developed within the DESC," says KIPAC's Richard Dubois. "They also tell us what other tools we still need to make sure that everything will work smoothly once we'll have LSST data."

Science and Technology Cross-Fertilization

Although LSST Data Management and DESC work independently, there is significant overlap, and having the annual meetings back to back in the same location provided a fertile ground for an exchange of ideas.

"The input from collaborations like DESC benefits LSST Data Management by providing an understanding of how LSST will be used for science," says Mario Juric, a professor of astronomy at the University of Washington, who is the LSST Data Management project scientist and a DESC member. "Researchers in the science collaborations have real data from other experiments that can be used to properly design and test software within LSST Data Management. This helps us build a better system -- something that the science community will profit from in return." The closer science and technology work together, the better they become in this symbiotic relationship.