Big Data Analytics May Help MeerKAT Telescope Tackle Vast Data Volumes for Enhanced Images of the Sky
Johannesburg, March 07, 2012 -- The Square Kilometre Array South Africa (SKA SA) today announced it anticipates working with IBM (NYSE: IBM) with the goal of developing a next generation big data analytics platform with self-tuning and self-learning capabilities to better analyze large volumes of radio astronomy data. The proposed software may help automate the process of analyzing antenna-collected data allowing astronomers to more effectively observe objects in space.
SKA SA is building MeerKAT, the largest and most sensitive radio telescope of its kind in the Southern Hemisphere. Like other radio telescopes, it will require expert data analysis to make high quality maps of the sky. MeerKAT will consist of 64 dish antennas, each 13.5 m in diameter that is sensitive to emission from cosmic sources at centimeter wavelengths. Huge volumes of data need to be combined to make detailed images of radio emission from distant objects like black holes, spinning neutron stars, planets, and galaxies. It will also map primeval gas before the galaxies formed, as observed at the edge of the visible universe.
"South Africa's commitment to advancing the SKA project has been cemented in all spheres of our government, including at the provincial level," says Minister of Science and Technology, Mrs. Naledi Pandor.
The analysis of MeerKAT data is a major challenge. "A number of subtle effects need to be corrected to make clear and accurate images from interferometers like MeerKAT," says SKA SA's Dr. Jasper Horrell. "These include variations in the instrument itself and effects such as those introduced by the earth's ionosphere. More intelligent software is needed to enable astronomers to process and analyze the enormous data rates that will be produced by MeerKAT and future radio telescopes," notes Dr. Horrell.
The current method of analysis requires direct interaction with a computer for hours or days before the images can be used for research purposes. This practice is not only time-consuming, but it also requires experienced astronomers, making the radio sky accessible to only a few experts.
The proposed joint research project between SKA SA and IBM is to combine available radio astronomy analysis software with machine-learning techniques currently under development at IBM Research. Beginning with components from IBM's Infosphere software for big data and IBM's SPSS software for predictive analysis, the initial phase is intended to program computers to self-learn, adapt, and fine-tune the analysis of radio telescope data under the watchful eye of an astronomer.
MeerKAT is one of several new radio telescopes being built as precursors to the Square Kilometer Array (SKA), an international project that should reach its full capacity in the early part of the next decade. Another precursor is in Western Australia. The SKA will consist of a square kilometer of collecting area spread out over thousands of separate dishes and flat-panel arrays, distributed over continental scales in order to obtain very high resolution images. Data rates from the SKA will be huge, rivaling the world's Internet traffic. Processing big data volumes, whether from scientific instruments, environmental sensors, or international communication and commerce, will require extreme automation and self-learning capability by the software of the future.
"The goal of the proposed project is to teach a computer to make perfect images on its own," says Dr. Alain Biem, an IBM Researcher who specializes in exploratory stream analytics. "A software platform like this may assist in enabling large survey instruments like MeerKAT to process the trillions of bits of data per second they receive and make it available to astronomers around the world."
For information contact:
Dr. Jasper Horrell
Tel: +27 21 506-7300
External Relations, IBM South Africa,
Tel: +27 11 302 9255,