Close Menu
TechCentralTechCentral

    Subscribe to the newsletter

    Get the best South African technology news and analysis delivered to your e-mail inbox every morning.

    Facebook X (Twitter) YouTube LinkedIn
    WhatsApp Facebook X (Twitter) LinkedIn YouTube
    TechCentralTechCentral
    • News
      The end of paying for phone calls in South Africa

      The end of paying for phone calls in South Africa

      17 November 2026
      SA's mobile operators are locked in a price war, Telkom says

      SA’s mobile operators are locked in a price war, Telkom says

      17 November 2026
      Telkom's first MVNO sells 1TB of prepaid mobile data for R800

      Telkom’s first MVNO sells 1TB of prepaid mobile data for R800

      17 November 2026
      Telkom becomes Amazon Leo's second South African distributor

      Telkom becomes Amazon Leo’s second South African distributor

      17 November 2026
      Ramaphosa's AI investment pitch in Silicon Valley - Cyril Ramaphosa

      Ramaphosa’s AI investment pitch in Silicon Valley

      17 November 2026
    • World
      Nvidia shuts the door on a Jensen Huang comeback

      Nvidia shuts the door on a Jensen Huang comeback

      17 November 2026
      Could Jensen Huang return to Nvidia?

      Jensen Huang weighs a comeback at Nvidia

      16 November 2026
      Intel sued by shareholders over 29% share price plunge - Intel CEO Lip-Bu Tan. Laure Andrillon/Reuters

      Intel sued by shareholders over 29% share price plunge

      16 November 2026
      Microsoft 364

      Microsoft outage hits the world

      13 November 2026
      The internet is roasting Jensen Huang with his own GPUs

      The internet is roasting Jensen Huang, using his own GPUs

      11 November 2026
    • In-depth
      Inside the 24 hours that broke Microsoft

      Inside the 24 hours that broke Microsoft

      16 November 2026
      Ducking hell: inside Apple's hidden list of words the iPhone won't suggest

      Ducking hell: inside Apple’s hidden list of words the iPhone won’t suggest

      6 November 2026
      Why investors are souring on Netflix

      Why investors are souring on Netflix

      22 October 2026

      10 days that changed the course of AI

      21 September 2026
      Meta to the AI industry: slow down without us - Mark Zuckerberg

      Meta to the AI industry: slow down without us

      16 September 2026
    • TCS
      TCS | Piet le Roux on Sakeliga's fight with Icasa over BEE

      TCS | Piet le Roux on Sakeliga’s fight with Icasa over BEE

      13 November 2026
      W&W | The AA’s Bobby Ramagwede on a car industry running out of road

      W&W | The AA’s Bobby Ramagwede on a car industry running out of road

      12 November 2026
      TCS | Pick n Pay fights back in online grocery wars - Vince Viviers

      TCS | Pick n Pay fights back in online grocery wars

      11 November 2026
      TCS | Nomvuyiso Batyi on the battle over Sim registration - Nomvuyiso Batyi

      TCS | Nomvuyiso Batyi on the battle over Sim registration

      9 November 2026
      TCS+ | Old Mutual's Celiwe Ross on leading people through AI - Old Mutual

      TCS+ | Old Mutual’s Celiwe Ross on leading people through AI

      6 November 2026
    • Opinion
      Icasa's Sim rules need a privacy backstop - Lloyd Matthew and Heinz Vollmer

      Icasa’s Sim rules need a privacy backstop

      5 November 2026
      AI's boardroom honeymoon is over - Gary Stocks

      AI’s boardroom honeymoon is over

      22 October 2026
      Before South Africa licenses Starlink, it should look at Ukraine - Duncan McLeod

      Before South Africa licenses Starlink, it should look at Ukraine

      21 October 2026
      Nonkqubela Thathakahle Jordan-Dyani

      Why cybersecurity is now a national security issue for South Africa

      15 October 2026
      When a machine can choose, who does it become? Fanie van Rooyen

      When a machine can choose, who does it become?

      9 October 2026
    • Company News
      • 1Stream
      • Africa Data Centres
      • AfriGIS
      • Altron Digital Business
      • Altron Document Solutions
      • Altron Group
      • Arctic Wolf
      • Ascent Technology
      • AvertITD
      • BBD
      • Braintree
      • CallMiner
      • CambriLearn
      • CM.com
      • Contactable
      • CYBER1 Solutions
      • Digicloud Africa
      • Digimune
      • Domains.co.za
      • ESET
      • Euphoria Telecom
      • HOSTAFRICA
      • Incredible Business
      • iONLINE
      • IQbusiness
      • Iris Network Systems
      • Kaspersky
      • LSD Open
      • Mitel
      • NEC XON
      • Netstar
      • Network Platforms
      • Next DLP
      • Ovations
      • Paracon
      • Paratus
      • Publishared
      • Q-KON
      • SevenC
      • SkyWire
      • Solid8 Technologies
      • Telit Cinterion
      • Telviva
      • Tenable
      • Vertiv
      • Videri Digital
      • Vodacom Business
      • Vox
      • Wipro
      • Workday
      • XLink
    • Sections
      • AI and machine learning
      • Banking
      • Broadcasting and media
      • Cloud services
      • Contact centres and CX
      • Cryptocurrencies
      • Education and skills
      • Electronics and hardware
      • Energy and sustainability
      • Enterprise software
      • Fintech and payments
      • HealthTech
      • Information security
      • Internet and connectivity
      • Internet of things
      • Investment
      • IT services
      • Lifestyle
      • Policy and regulation
      • Public sector
      • Retail and e-commerce
      • Satellite communications
      • Science
      • SMEs and start-ups
      • Social media
      • Talent and leadership
      • Telecoms
      • Watts & Wheels
    • Events
    • Advertise
    TechCentralTechCentral
    Home » Sections » AI and machine learning » Why AI gets smarter as it scales – a Wits study has a clue

    Why AI gets smarter as it scales – a Wits study has a clue

    New research from Wits University offers a fresh explanation for one of the most-discussed questions in AI.
    By Staff Reporter28 May 2026
    Twitter LinkedIn Facebook WhatsApp Email Telegram Copy Link
    Get breaking news on WhatsApp

    Why AI gets smarter as it scales - a Wits study has a clue

    New research from the University of the Witwatersrand offers a fresh explanation for one of the most-discussed questions in AI: why large language models develop structured, increasingly capable behaviour as they grow in scale.

    The answer, the Wits team argues, lies in a process that also governs how human children acquire language – and how language itself evolves over generations to become easier to learn.

    The work, published in the journal Proceedings of the National Academy of Sciences, combines two ideas that have existed separately for years. The first is “iterated learning”, a concept from linguistics that holds that language becomes more structured as it is passed from one generation to the next, because each generation introduces small, non-random errors that favour the parts of language easiest to learn. The second is the use of deep neural networks as models of how the brain processes information.

    The dataset becomes more structured over generations because it makes learning easier

    “We built a computer brain with similar characteristics to a child’s and compared it to behaviours we see in children’s brains. We then fed it data with similar properties found in human language and watched how the generations of the computer brain learn,” said lead author Devon Jarvis, a lecturer in the school of computer science and applied mathematics at Wits and a fellow of the university’s Machine Intelligence and Neural Discovery (Mind) Institute.

    “It turns out, computer brains find the structure in the data in the same way that children favour certain properties of language in learning. It also showed that the dataset becomes more structured over generations because it makes learning easier.”

    Depth

    Jarvis uses the example of a child learning that birds have wings and can fly, then being confused by a penguin, which cannot. The child over-generalises, makes a mistake, and in correcting it builds a more precise understanding of the world. Language passed between generations behaves similarly: the easy-to-learn portions are remembered and reused, while the more unstructured parts are gradually forgotten.

    The finding most relevant to AI is that this only works when the network is deep enough. The researchers found that iterated learning produced structured, compositional behaviour only in networks with sufficient depth, multiple layers of processing and a sufficiently complex language. Shallow networks failed to capture the regularities that make language learnable – a result that echoes how today’s generative AI models rely heavily on scale for their emergent capabilities.

    Read: MTN to turn its African towers into an AI inference grid

    An important caveat is that the work was done using deep linear networks – deliberately simplified mathematical models – rather than the large language models that power tools such as ChatGPT. The value of the result is theoretical: it points to a mechanism that may underpin why scale matters, demonstrated in a system simple enough to analyse rather than observed directly in a frontier model.

    “The fact that this was shown in a very simple version of the technology underpinning the modern boom in AI tools is also encouraging and suggests that in the intersection of multiple fields lies the fundamental principles of cognition,” Jarvis said.

    The paper’s co-authors are Richard Klein, head of the school of computer science and applied mathematics at Wits; Benjamin Rosman, director of the Wits Mind Institute; and Andrew Saxe of the Gatsby Computational Neuroscience Unit and Sainsbury Wellcome Centre at University College London.  — © 2026 NewsCentral Media

    • Subscribe to TechCentral’s daily newsletter
    • Get breaking news alerts on WhatsApp
    Add TechCentral as a preferred source on GoogleFollow TechCentral on Google NewsGet breaking news on WhatsApp


    Benjamin Rosman Devon Jarvis Mind Institute Wits Mind Institute
    WhatsApp YouTube
    Share. Facebook Twitter LinkedIn WhatsApp Telegram Email Copy Link
    Previous ArticleIBM doubles down on quantum computing with $10-billion bet
    Next Article Reserve Bank breaks its run of calm and hikes rates

    Related Posts

    Ramaphosa's AI investment pitch in Silicon Valley - Cyril Ramaphosa

    Ramaphosa’s AI investment pitch in Silicon Valley

    17 November 2026
    AI's black box may not be so black after all

    AI’s black box may not be so black after all

    6 November 2026
    South Africa's AI policy team is racing a 30 November deadline

    South Africa’s AI policy team is racing a 30 November deadline

    29 October 2026
    Company News
    HOSTAFRICA's HCode puts AI-built apps online for R50 a month

    HOSTAFRICA’s HCode puts AI-built apps online for R50 a month

    17 November 2026
    Every agent is a database user - Ascent Technology, Johan Lamberts

    Every agent is a database user

    16 November 2026
    Ebenezer Smith, CEO of PSET

    After universities and TVET colleges, PSET is going to schools

    16 November 2026
    Opinion
    Icasa's Sim rules need a privacy backstop - Lloyd Matthew and Heinz Vollmer

    Icasa’s Sim rules need a privacy backstop

    5 November 2026
    AI's boardroom honeymoon is over - Gary Stocks

    AI’s boardroom honeymoon is over

    22 October 2026
    Before South Africa licenses Starlink, it should look at Ukraine - Duncan McLeod

    Before South Africa licenses Starlink, it should look at Ukraine

    21 October 2026

    Subscribe to Updates

    Get the best South African technology news and analysis delivered to your e-mail inbox every morning.

    Latest Posts
    The end of paying for phone calls in South Africa

    The end of paying for phone calls in South Africa

    17 November 2026
    SA's mobile operators are locked in a price war, Telkom says

    SA’s mobile operators are locked in a price war, Telkom says

    17 November 2026
    Telkom's first MVNO sells 1TB of prepaid mobile data for R800

    Telkom’s first MVNO sells 1TB of prepaid mobile data for R800

    17 November 2026
    Telkom becomes Amazon Leo's second South African distributor

    Telkom becomes Amazon Leo’s second South African distributor

    17 November 2026
    © 2009 - 2026 NewsCentral Media
    Built and maintained by Chronon
    • Cookie policy (ZA)
    • TechCentral – privacy and Popia

    Type above and press Enter to search. Press Esc to cancel.

    Manage consent

    TechCentral uses cookies to enhance its offerings. Consenting to these technologies allows us to serve you better. Not consenting or withdrawing consent may adversely affect certain features and functions of the website.

    Functional Always active
    The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
    Preferences
    The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
    Statistics
    The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
    Marketing
    The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
    • Manage options
    • Manage services
    • Manage {vendor_count} vendors
    • Read more about these purposes
    View preferences
    • {title}
    • {title}
    • {title}
    🇿🇦 Sign up to the TechCentral newsletter