Close Menu
TechCentralTechCentral

    Subscribe to the newsletter

    Get the best South African technology news and analysis delivered to your e-mail inbox every morning.

    Facebook X (Twitter) YouTube LinkedIn
    WhatsApp Facebook X (Twitter) LinkedIn YouTube
    TechCentralTechCentral
    • News
      TCS | Piet le Roux on Sakeliga's fight with Icasa over BEE

      TCS | Piet le Roux on Sakeliga’s fight with Icasa over BEE

      13 November 2026
      Lawyer who backs 30% rule says Sakeliga has Icasa cornered - Piet le Roux

      Lawyer who backs 30% rule says Sakeliga has Icasa cornered

      13 November 2026
      SA firms are all-in on AI, but most can't prove it pays - Arthur Goldstuck

      SA firms are all-in on AI, but most can’t prove it pays

      13 November 2026
      Microsoft outage drags past 15 hours, hitting SA companies hard

      Microsoft outage drags past 18 hours, hitting SA companies hard

      13 November 2026
      Oppo's South African plan: forget market share, sell premium phones - Sam Zhang

      Oppo’s South African plan: forget market share, sell premium phones

      13 November 2026
    • World
      The internet is roasting Jensen Huang with his own GPUs

      The internet is roasting Jensen Huang, using his own GPUs

      11 November 2026
      John Ternus faces first big test as Apple CEO - John Ternus

      John Ternus faces first big test as Apple CEO

      2 November 2026
      Alleged Israeli spy company heavily targeted Starlink users

      How online ads were used to hunt Starlink users

      28 October 2026
      Anthropic's IPO stands alone

      Anthropic’s IPO stands alone

      23 October 2026
      PHP flaws trigger global scramble as hackers pounce

      PHP flaws trigger global scramble as hackers pounce

      22 October 2026
    • In-depth
      Ducking hell: inside Apple's hidden list of words the iPhone won't suggest

      Ducking hell: inside Apple’s hidden list of words the iPhone won’t suggest

      6 November 2026
      Why investors are souring on Netflix

      Why investors are souring on Netflix

      22 October 2026

      10 days that changed the course of AI

      21 September 2026
      Meta to the AI industry: slow down without us - Mark Zuckerberg

      Meta to the AI industry: slow down without us

      16 September 2026
      Google DeepMind CEO Demis Hassabis. Image: John Sears

      The plan to stop AI from breaking the world

      16 July 2026
    • TCS
      W&W | The AA’s Bobby Ramagwede on a car industry running out of road

      W&W | The AA’s Bobby Ramagwede on a car industry running out of road

      12 November 2026
      TCS | Pick n Pay fights back in online grocery wars - Vince Viviers

      TCS | Pick n Pay fights back in online grocery wars

      11 November 2026
      TCS | Nomvuyiso Batyi on the battle over Sim registration - Nomvuyiso Batyi

      TCS | Nomvuyiso Batyi on the battle over Sim registration

      9 November 2026
      TCS+ | Old Mutual's Celiwe Ross on leading people through AI - Old Mutual

      TCS+ | Old Mutual’s Celiwe Ross on leading people through AI

      6 November 2026
      TCS+ | How the Apple ecosystem drives productivity for SMEs - Sudesh Pillay iStore and Kevin McLennan

      TCS+ | How the Apple ecosystem drives productivity for SMEs

      6 November 2026
    • Opinion
      Icasa's Sim rules need a privacy backstop - Lloyd Matthew and Heinz Vollmer

      Icasa’s Sim rules need a privacy backstop

      5 November 2026
      AI's boardroom honeymoon is over - Gary Stocks

      AI’s boardroom honeymoon is over

      22 October 2026
      Before South Africa licenses Starlink, it should look at Ukraine - Duncan McLeod

      Before South Africa licenses Starlink, it should look at Ukraine

      21 October 2026
      Nonkqubela Thathakahle Jordan-Dyani

      Why cybersecurity is now a national security issue for South Africa

      15 October 2026
      When a machine can choose, who does it become? Fanie van Rooyen

      When a machine can choose, who does it become?

      9 October 2026
    • Company News
      • 1Stream
      • Africa Data Centres
      • AfriGIS
      • Altron Digital Business
      • Altron Document Solutions
      • Altron Group
      • Arctic Wolf
      • Ascent Technology
      • AvertITD
      • BBD
      • Braintree
      • CallMiner
      • CambriLearn
      • CM.com
      • Contactable
      • CYBER1 Solutions
      • Digicloud Africa
      • Digimune
      • Domains.co.za
      • ESET
      • Euphoria Telecom
      • HOSTAFRICA
      • Incredible Business
      • iONLINE
      • IQbusiness
      • Iris Network Systems
      • Kaspersky
      • LSD Open
      • Mitel
      • NEC XON
      • Netstar
      • Network Platforms
      • Next DLP
      • Ovations
      • Paracon
      • Paratus
      • Publishared
      • Q-KON
      • SevenC
      • SkyWire
      • Solid8 Technologies
      • Telit Cinterion
      • Telviva
      • Tenable
      • Vertiv
      • Videri Digital
      • Vodacom Business
      • Vox
      • Wipro
      • Workday
      • XLink
    • Sections
      • AI and machine learning
      • Banking
      • Broadcasting and media
      • Cloud services
      • Contact centres and CX
      • Cryptocurrencies
      • Education and skills
      • Electronics and hardware
      • Energy and sustainability
      • Enterprise software
      • Fintech and payments
      • HealthTech
      • Information security
      • Internet and connectivity
      • Internet of things
      • Investment
      • IT services
      • Lifestyle
      • Policy and regulation
      • Public sector
      • Retail and e-commerce
      • Satellite communications
      • Science
      • SMEs and start-ups
      • Social media
      • Talent and leadership
      • Telecoms
      • Watts & Wheels
    • Events
    • Advertise
    TechCentralTechCentral
    Home » Sections » AI and machine learning » AI in the enterprise: why data (not demos) determines your ROI

    AI in the enterprise: why data (not demos) determines your ROI

    Promoted | Without the right foundations, you’re not investing in AI – you’re gambling on a trend, writes LSD Open's Deon Stroebel.
    By LSD Open9 April 2025
    Twitter LinkedIn Facebook WhatsApp Email Telegram Copy Link
    Get breaking news on WhatsApp

    AI in the enterprise: why data (not demos) determines your ROI - LSD OpenArtificial intelligence is the buzzword of the decade. From slick demos to boardroom strategy decks, it’s tempting to believe we’re on the brink of an AI revolution in every industry. But here’s the uncomfortable truth: most enterprises will waste a lot of money on AI.

    The problem isn’t the technology. Rather, it’s the misunderstanding of what it takes to make AI actually work inside a business.

    Let’s start where every AI journey should: with the data.

    AI is only as good as what you feed it

    For all the talk of “intelligence”, AI is fundamentally dependent on the quality of your data. If your enterprise data is siloed, outdated, unstructured or poorly tagged, your AI models – no matter how sophisticated – will return vague, inaccurate or even outright wrong results.

    We’ve seen companies leap into large language model (LLM) deployments without investing in the foundational work of preparing their data. The result? Hallucinations, compliance issues and sky-high cloud bills for very little value.

    Before you consider a pilot, workshop or proof of concept, ask the hard question: is our data clean, structured, secure and accessible? If not, that’s your first AI project.

    Understanding the alphabet soup: AI, ML, DL, gen AI

    Much of the confusion around AI starts with terminology.

    AI is the broad goal: machines that can reason, decide and solve problems. Within that, machine learning (ML) refers to systems that learn from data. Deep learning (DL) takes this further with neural networks that can process images, audio or text.

    Generative AI (gen AI), the current star of the show, does something new: it creates. It can write text, generate code, summarise documents and even produce images. But this power comes with a caveat: what it generates is only as useful as the training and context it’s been given.

    This brings us to the next trap.

    LLMs are impressive but are not always the right tool

    Large language models like GPT-4 are astonishing in their breadth. But they are generalists. They don’t know your business, your terminology or your regulatory environment. Worse, they’re expensive to run and hard to control.

    Enter small language models (SLMs) – lighter, faster, more focused. When finetuned to your own data, SLMs can outperform LLMs in accuracy, relevance and cost. Sometimes, smaller really is better.

    The same goes for virtualised LLMs (vLLMs), which use memory-efficient techniques to reduce cloud infrastructure requirements. These are crucial if you want enterprise-grade performance without enterprise-scale spending.

    Grounding AI in reality with RAG and semantic search

    Retrieval-augmented generation (RAG) is one of the most practical advances in gen AI. Instead of guessing answers from model memory, RAG connects the model to your actual data – policy documents, manuals, product specs – and retrieves relevant facts before generating a response.

    This reduces hallucinations and improves trust, especially in regulated environments.

    Semantic search plays a similar role. It doesn’t just look for keyword matches – it understands what users mean. This is essential for any internal chatbot, helpdesk or knowledge assistant: if your AI doesn’t grasp the intent behind a poorly phrased question, it won’t be useful.

    Finetuning and model control: speak the language of your business

    A common misconception is that gen AI works out the box. Technically, it does. But it won’t sound like you, behave like you or reflect your standards.

    Finetuning is the process of training a model on your own data – your terminology, your tone, your processes. It dramatically increases the relevance of outputs and reduces the chance of off-brand, off-topic or incorrect results.

    This is also where open-source models like Llama or Mistral shine. They give you full control over training, governance and deployment – without locking you into a vendor’s API or pricing model.

    Inferencing: the hidden cost centre of AI

    Here’s a question most leaders haven’t been asked: what happens every time someone uses your AI model?

    That process – called inferencing – is where costs and latency spike. Especially at scale, the architecture that supports inferencing determines the user experience and your operating expense. Optimising for inference is critical, and too often ignored in early deployments.

    AI is not a one-time project – it’s a life cycle

    Deploying a model isn’t the finish line – it’s the starting gun.

    To stay valuable, AI must be monitored, tested, retrained and governed. That’s where MLOps (machine learning pperations) comes in, providing the same discipline and visibility we expect from modern software development.

    Observability is crucial, too. Can you track usage? Detect drift? Audit decisions? If not, your AI deployment is not enterprise ready.

    Agents, not just assistants: the next leap

    AI agents don’t just answer – they act. They can book meetings, trigger workflows, retrieve documents or complete tasks across systems. But like human employees, they need onboarding, access control, training and review. Treat them like colleagues, not magic.

    Sometimes you’re not looking for AI, you’re looking for automation

    This might be the most important insight in this whole piece.

    Not every problem needs a model. Sometimes, what your business needs is workflow automation, integration or a smart rules engine.

    AI is powerful, but it’s not always the right answer. If you can solve a problem with process redesign or automation, do that. It’s cheaper, faster and more sustainable.

    Final thought: AI is not a tool, it’s a capability

    Successful AI adoption isn’t about choosing a model. It’s about building a system, one that ingests quality data, generates insight, enables action and continuously improves.

    That system must be secure, governed, efficient and aligned to business outcomes. Without those foundations, you’re not investing in AI – you’re gambling on a trend.

    • The author, Deon Stroebel, is chief commercial officer and LSD Cloud Business executive at LSD Open
    • Read more articles by LSD Open on TechCentral
    • This promoted content was paid for by the party concerned

    Don’t miss:

    Improving the search experience with semantic search and AI

    Add TechCentral as a preferred source on GoogleFollow TechCentral on Google NewsGet breaking news on WhatsApp


    Deon Stroebel LSD Open
    WhatsApp YouTube
    Share. Facebook Twitter LinkedIn WhatsApp Telegram Email Copy Link
    Previous ArticleData protection must be crypto industry’s top priority
    Next Article 15 amazing inventions that came out of South Africa

    Related Posts

    LSD Open earns Red Hat automation specialisation

    LSD Open earns Red Hat automation specialisation

    31 August 2026
    Red Hat validates LSD Open for virtual machine migrations

    Red Hat validates LSD Open for virtual machine migrations

    26 August 2026
    What a cloud review reveals about how a company actually runs - LSD Open

    What a cloud review reveals about how a company actually runs

    6 August 2026
    Add A Comment

    Comments are closed.

    Company News
    The next digital channel in South Africa is the phone call - Teeoff Technologies

    The next digital channel in South Africa is the phone call

    13 November 2026
    Mitel bets on humans with debut of Mitel WX for the entire workforce

    Mitel bets on humans with debut of Mitel WX for the entire workforce

    12 November 2026
    You cannot change culture without changing how the business works - Change Logic, Trudie Keys

    You cannot change culture without changing how the business works

    12 November 2026
    Opinion
    Icasa's Sim rules need a privacy backstop - Lloyd Matthew and Heinz Vollmer

    Icasa’s Sim rules need a privacy backstop

    5 November 2026
    AI's boardroom honeymoon is over - Gary Stocks

    AI’s boardroom honeymoon is over

    22 October 2026
    Before South Africa licenses Starlink, it should look at Ukraine - Duncan McLeod

    Before South Africa licenses Starlink, it should look at Ukraine

    21 October 2026

    Subscribe to Updates

    Get the best South African technology news and analysis delivered to your e-mail inbox every morning.

    Latest Posts
    TCS | Piet le Roux on Sakeliga's fight with Icasa over BEE

    TCS | Piet le Roux on Sakeliga’s fight with Icasa over BEE

    13 November 2026
    Lawyer who backs 30% rule says Sakeliga has Icasa cornered - Piet le Roux

    Lawyer who backs 30% rule says Sakeliga has Icasa cornered

    13 November 2026
    SA firms are all-in on AI, but most can't prove it pays - Arthur Goldstuck

    SA firms are all-in on AI, but most can’t prove it pays

    13 November 2026
    Microsoft outage drags past 15 hours, hitting SA companies hard

    Microsoft outage drags past 18 hours, hitting SA companies hard

    13 November 2026
    © 2009 - 2026 NewsCentral Media
    Built and maintained by Chronon
    • Cookie policy (ZA)
    • TechCentral – privacy and Popia

    Type above and press Enter to search. Press Esc to cancel.

    Manage consent

    TechCentral uses cookies to enhance its offerings. Consenting to these technologies allows us to serve you better. Not consenting or withdrawing consent may adversely affect certain features and functions of the website.

    Functional Always active
    The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
    Preferences
    The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
    Statistics
    The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
    Marketing
    The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
    • Manage options
    • Manage services
    • Manage {vendor_count} vendors
    • Read more about these purposes
    View preferences
    • {title}
    • {title}
    • {title}
    🇿🇦 Sign up to the TechCentral newsletter