Close Menu
TechCentralTechCentral

    Subscribe to the newsletter

    Get the best South African technology news and analysis delivered to your e-mail inbox every morning.

    Facebook X (Twitter) YouTube LinkedIn
    WhatsApp Facebook X (Twitter) LinkedIn YouTube
    TechCentralTechCentral
    • News
      South Africa's new fibre broadband battle

      South Africa’s new fibre broadband battle

      20 January 2026
      South Africa needs a national 'quantum defence strategy'

      South Africa needs a national ‘quantum defence strategy’

      20 January 2026
      Chinese brands tighten grip on South Africa's used car market

      Chinese brands tighten grip on South Africa’s used car market

      20 January 2026
      Severe geomagnetic storm hits Earth, Sansa confirms

      Severe geomagnetic storm hits Earth, Sansa confirms

      20 January 2026
      Icasa to target Sentech with tougher broadcast pricing rules

      Icasa to target Sentech with tougher broadcast pricing rules

      19 January 2026
    • World
      Taiwan, US strike strategic AI and chip supply-chain pact - TSMC

      Taiwan, US strike strategic AI and chip supply-chain pact

      20 January 2026
      Oracle sued as bondholders allege AI debt plans were hidden - Larry Ellison

      Oracle sued as bondholders allege AI debt plans were hidden

      15 January 2026
      Activists call for X, Grok to removed from app stores - Elon Musk

      Activists call for X, Grok to removed from app stores

      14 January 2026
      Uganda shuts down internet ahead of pivotal election

      Uganda shuts down internet ahead of pivotal election

      14 January 2026
      Taiwan seeks arrest of OnePlus CEO - Pete Lau

      Taiwan seeks arrest of OnePlus CEO

      14 January 2026
    • In-depth
      Digital authoritarianism grows as African states normalise internet blackouts

      Digital authoritarianism grows as African states normalise internet blackouts

      19 December 2025
      TechCentral's South African Newsmakers of 2025

      TechCentral’s South African Newsmakers of 2025

      18 December 2025
      Black Friday goes digital in South Africa as online spending surges to record high

      Black Friday goes digital in South Africa as online spending surges to record high

      4 December 2025
      DStv dodges channel blackout in last-minute deal with Warner Bros

      Canal+ plays hardball – and DStv viewers feel the pain

      3 December 2025
      Jensen Huang Nvidia

      So, will China really win the AI race?

      14 November 2025
    • TCS

      TCS+ | Why cybersecurity is becoming a competitive advantage for SA businesses

      20 January 2026
      TCS+ | Africa's digital transformation - unlocking AI through cloud and culture - Cliff de Wit Accelera Digital Group

      TCS+ | Cloud without culture won’t deliver AI: Accelera’s Cliff de Wit

      12 December 2025
      TCS+ | How Cloud on Demand helps partners thrive in the AWS ecosystem - Odwa Ndyaluvane and Xenia Rhode

      TCS+ | How Cloud On Demand helps partners thrive in the AWS ecosystem

      4 December 2025
      TCS | MTN Group CEO Ralph Mupita on competition, AI and the future of mobile

      TCS | Ralph Mupita on competition, AI and the future of mobile

      28 November 2025
      TCS | Dominic Cull on fixing South Africa's ICT policy bottlenecks

      TCS | Dominic Cull on fixing South Africa’s ICT policy bottlenecks

      21 November 2025
    • Opinion
      AI moves from pilots to production in South African companies - Nazia Pillay SAP

      AI moves from pilots to production in South African companies

      20 January 2026
      ANC's attack on Solly Malatsi shows how BEE dogma trumps economic reality - Duncan McLeod

      ANC’s attack on Solly Malatsi shows how BEE dogma trumps economic reality

      14 December 2025
      Netflix, Warner Bros deal raises fresh headaches for MultiChoice - Duncan McLeod

      Netflix, Warner Bros deal raises fresh headaches for MultiChoice

      5 December 2025
      BIN scans, DDoS and the next cybercrime wave hitting South Africa's banks - Entersekt Gerhard Oosthuizen

      BIN scans, DDoS and the next cybercrime wave hitting South Africa’s banks

      3 December 2025
      ANC's attack on Solly Malatsi shows how BEE dogma trumps economic reality - Duncan McLeod

      Your data, your hardware: the DIY AI revolution is coming

      20 November 2025
    • Company Hubs
      • Africa Data Centres
      • AfriGIS
      • Altron Digital Business
      • Altron Document Solutions
      • Altron Group
      • Arctic Wolf
      • AvertITD
      • Braintree
      • CallMiner
      • CambriLearn
      • CYBER1 Solutions
      • Digicloud Africa
      • Digimune
      • Domains.co.za
      • ESET
      • Euphoria Telecom
      • Incredible Business
      • iONLINE
      • IQbusiness
      • Iris Network Systems
      • LSD Open
      • NEC XON
      • Netstar
      • Network Platforms
      • Next DLP
      • Ovations
      • Paracon
      • Paratus
      • Q-KON
      • SevenC
      • SkyWire
      • Solid8 Technologies
      • Telit Cinterion
      • Tenable
      • Vertiv
      • Videri Digital
      • Vodacom Business
      • Wipro
      • Workday
      • XLink
    • Sections
      • AI and machine learning
      • Banking
      • Broadcasting and Media
      • Cloud services
      • Contact centres and CX
      • Cryptocurrencies
      • Education and skills
      • Electronics and hardware
      • Energy and sustainability
      • Enterprise software
      • Financial services
      • Information security
      • Internet and connectivity
      • Internet of Things
      • Investment
      • IT services
      • Lifestyle
      • Motoring
      • Public sector
      • Retail and e-commerce
      • Satellite communications
      • Science
      • SMEs and start-ups
      • Social media
      • Talent and leadership
      • Telecoms
    • Events
    • Advertise
    TechCentralTechCentral
    Home » Editor's pick » Why the SKA is the ultimate in big data

    Why the SKA is the ultimate in big data

    By The Conversation25 November 2014
    Twitter LinkedIn Facebook WhatsApp Email Telegram Copy Link
    News Alerts
    WhatsApp
    Construction on the SKA Karoo site (image: SKA South Africa)
    Construction on the SKA Karoo site (image: SKA South Africa)

    Telescopes have come a long way since the days when they were all about lone astronomers watching the night sky through their upstairs windows. Today, teams of astrophysicists build and use much more modern instruments, not only to observe light visible to our eyes, but also radio emissions from the universe.

    Radio telescopes used to use large single dishes to pick up these emissions, but have since graduated to arrays of antennae. These act as one dish over much a wider area and make it possible to receive signals from further away. We refer to them as radio-interferometric arrays because they study the interference of radio waves between pairs of antennae.

    Radio interferometry was developed by the English scientists Antony Hewish and Martin Ryle, who received the Nobel prize in 1974 for using such telescopes to discover pulsars — highly magnetised rotating neutron stars. Pulsars rotate with extreme stability, making them the most precise clocks in the universe.

    In 1993, the American astrophysicists Russell Hulse and Joseph Taylor demonstrated the importance of pulsars in understanding our universe by discovering them in a gravitationally coupled pair known as a binary system. This provided the first indirect evidence for gravitational waves, which are an essential unproven part of Einstein’s theory of general relativity.

    There have been numerous arrays of radio telescopes developed since the 1970s. The state of the art includes the Low-Frequency Array (Lofar) in western Europe, the Murchison Widefield Array (MWA) in western Australia and the Atacama Large Millimetre Array (Alma) in Chile. These are all just coming online and are regarded as a major step forward in our ability to understand the universe.

    Artist's impression of SKA dishes (image: SKA Organisation/Swinburne Astronomy Productions)
    Artist’s impression of SKA dishes (image: SKA Organisation/Swinburne Astronomy Productions)

    Yet they will be soon followed by the Square Kilometre Array (SKA), which will be made up of an unprecedented number of antennae spread across two continents for the first time (Australia and Africa). The SKA will see the radio sky with unprecedented sensitivity and resolution, enabling us to pick up extremely small and faint objects and probe the more distant universe. It is due to come online around 2023.

    It is already the case that interferometric data holds only partial information and does not provide immediately recognisable visual images. This is because the antenna array cannot be dense enough to cover each and every position on the ground. To convert the information into images, complex mathematical algorithms are already used.

    To add to this existing complexity, the SKA will record unprecedented volumes of data. To put it in perspective, astronomers anticipate that it will produce as much as 10 times the data as global Internet traffic. Radio astronomical imaging therefore urgently needs to be reinvented in this ultra-precision and big data context.

    This is where we come in. We have recently received funding to develop new ways to acquire data with radio telescopes using a recent theory called compressed sensing.

    This theory enables us to build up whole pictures with far more fragmented data than before, ensuring that each data point contains the maximum amount of information. We will also design image-recovery algorithms that are scalable to the SKA’s big data regime and can reconstruct ultra-high resolution images of the distant universe.

    ET, Einstein and the dark universe
    This forthcoming radio telescope throws up numerous exciting possibilities. It will be able to observe the formation of Earth-like planets in other galaxies, and detect possible signals sent by extraterrestrial intelligence. It will also be able to detect amino acids and carbon biomolecules, which are key building blocks for organic life.

    The SKA has the potential to produce new pulsar discoveries. It should be sensitive enough to allow tens of thousands of pulsars to be detected, with very good chances of finding one orbiting a black hole for the first time. This would allow us to test Einstein’s theories about what happens in the unexplored strong gravity regime around black holes. We might also be able to directly observe gravitational waves for the first time by monitoring the change of distance between pulsars as waves pass by.

    The coming leap forward in radio telescopes will also help us to understand the origins of the universe. Although we can infer the existence of the epoch when the first stars formed from our general understanding of the universe and other observations, we have never observed it directly.

    SKA-280

    Direct observations of hydrogen emission from this period would tell us a lot about how the first stars formed, and also about cosmology in general, including our understanding of the very first moments following the Big Bang. The Lofar and MWA telescopes will look for this very weak signal. But if they are able to detect it, it would only be in a statistical sense. The SKA will be the first telescope capable of producing images of this epoch when the first stars formed.

    Another science goal of the SKA is to develop a deeper understanding of dark energy and dark matter. One way of doing this is to study the distortion of the light from background galaxies by intervening matter as it travels towards us.

    In modern cosmology this effect, called weak lensing, has typically been studied with optical telescopes. Yet there is a lot to be gained from similar studies using radio wavelengths. Very high resolution is required, however, so it can’t be done with existing radio telescopes. The SKA will open up this new area, potentially uncovering a deeper understanding of the nature of dark energy and dark matter.

    In short, we could be on the verge of a great leap forward in our understanding of the universe. If so, the new theory of compressed sensing could play an essential role in recovering images from tiny fragments of information far in the distant universe.

    Beyond this, compressed sensing has a wide range of other applications. For instance we will transfer our techniques from astronomical to biomedical imaging, using compressed sensing to tackle the challenges of fast high-resolution magnetic resonance imaging. This is likely to give researchers a much more detailed understanding of neuronal pathways in the human brain.

    • The ConversationJason McEwen is assistant professor at University College London
    • This article was originally published on The Conversation


    Jason McEwan SKA Square Kilometre Array
    WhatsApp YouTube Follow on Google News Add as preferred source on Google
    Share. Facebook Twitter LinkedIn WhatsApp Telegram Email Copy Link
    Previous ArticleIt will be a very techie Christmas
    Next Article Chip cards don’t solve SA’s fraud problem

    Related Posts

    South Africa's giant SKA telescope clears major technical hurdle

    South Africa’s giant SKA telescope clears major technical hurdle

    8 January 2026
    SA scientists want Musk’s Starlink out of their space

    SA scientists want Musk’s Starlink out of their space

    2 June 2025
    Astronomy Olympics is being hosted in Africa for the first time

    Astronomy Olympics is being hosted in Africa for the first time

    7 August 2024
    Company News
    How Norton is protecting digital lives in a hostile online world - Avert ITD Avert IT Distribution

    How Norton is protecting digital lives in a hostile online world

    20 January 2026
    Beyond the hype: trust is the first step to generative AI ROI

    Beyond the hype: trust is the first step to generative AI ROI

    19 January 2026
    New Planet Energy and Span Africa launch landmark solar project

    New Planet Energy and Span Africa launch landmark solar project

    19 January 2026
    Opinion
    AI moves from pilots to production in South African companies - Nazia Pillay SAP

    AI moves from pilots to production in South African companies

    20 January 2026
    ANC's attack on Solly Malatsi shows how BEE dogma trumps economic reality - Duncan McLeod

    ANC’s attack on Solly Malatsi shows how BEE dogma trumps economic reality

    14 December 2025
    Netflix, Warner Bros deal raises fresh headaches for MultiChoice - Duncan McLeod

    Netflix, Warner Bros deal raises fresh headaches for MultiChoice

    5 December 2025

    Subscribe to Updates

    Get the best South African technology news and analysis delivered to your e-mail inbox every morning.

    Latest Posts
    South Africa's new fibre broadband battle

    South Africa’s new fibre broadband battle

    20 January 2026
    South Africa needs a national 'quantum defence strategy'

    South Africa needs a national ‘quantum defence strategy’

    20 January 2026
    AI moves from pilots to production in South African companies - Nazia Pillay SAP

    AI moves from pilots to production in South African companies

    20 January 2026
    Taiwan, US strike strategic AI and chip supply-chain pact - TSMC

    Taiwan, US strike strategic AI and chip supply-chain pact

    20 January 2026
    © 2009 - 2026 NewsCentral Media
    • Cookie policy (ZA)
    • TechCentral – privacy and Popia

    Type above and press Enter to search. Press Esc to cancel.

    Manage consent

    TechCentral uses cookies to enhance its offerings. Consenting to these technologies allows us to serve you better. Not consenting or withdrawing consent may adversely affect certain features and functions of the website.

    Functional Always active
    The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
    Preferences
    The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
    Statistics
    The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
    Marketing
    The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
    • Manage options
    • Manage services
    • Manage {vendor_count} vendors
    • Read more about these purposes
    View preferences
    • {title}
    • {title}
    • {title}