Our report shows how an orchestrated ensemble of specialist SLMs matched and often outperformed frontier LLMs.
Small Language Models (SLMs) are becoming an increasingly important part of the enterprise AI landscape. As organisations move beyond experimentation and start deploying AI into operational workflows, there is growing demand for models that are smaller, faster, more cost-effective, and easier to run in controlled environments.
This is particularly relevant in regulated sectors, where data residency, privacy, latency, explainability, and operational control are just as important as raw model capability. Historically, standalone SLMs have not been considered a viable alternative to LLMs, however at Connect we have demonstrated that there does not need to be a trade off between capability and control, the way you train and architect AI models can matter more than model size alone.
Our benchmark report tested that premise across 19 enterprise tasks in finance, healthcare and insurance. We took our proprietary SLM across three configurations — standalone, domain-tuned and orchestrated as an ensemble of specialists – and benchmarked across the top frontier models The results show that:
- Compact local SLMs deliver enterprise grade domain performance,
- Domain adaptation makes a compact SLM more capable within each target sector
- Orchestrating specialised SLMs improve reliability, groundedness, and suitability for regulated enterprise deployment
The orchestrated approach increased overall performance from 72.6% to 85.4%, while retaining the option to deploy locally and keep sensitive customer data inside the organisation's environment.
You wouldn't ask one contact centre agent to handle every type of interaction. Why ask one AI model to do it?
A well-run contact centre doesn't rely on one person to handle billing queries, complaints, claims and clinical questions. Interactions are routed to the right skills, supported by quality assurance, compliance controls and access to the right information. Yet many enterprise AI deployments still rely on a single general-purpose model to handle every task.
We benchmarked a different approach. Our model, Elly, was tested in three configurations: as a baseline model, domain-tuned, and finally as an orchestrated ensemble of specialists. Instead of asking one model to do everything, different components handle routing, entity extraction, retrieval, verification and safety.
It's the same principle that makes a well-run contact centre work: use the right specialist for the right task, with the right checks in place.
What you will learn from the report:
- See the full results across 19 enterprise benchmarks in finance, healthcare and insurance.
- Compare the orchestrated approach directly with with ChatGPT, Gemini, Claude, Amazon Nova, Qwen and Mixtral.
- See where orchestration produced the biggest gains, including grounding, evidence recall, summarisation and safety.
- Understand where smaller, specialist models can outperform larger general-purpose models.
- Explore the implications for AI accuracy, privacy, deployment and cost in regulated customer environments.
Benchmarking Campaign Form
A contact form for the Benchmarking Campaign.
"*" indicates required fields
About'Connect.
Connect is a global AI-enabled CX specialist and digital transformation partner. Founded in 1990, we help organisations modernise customer journeys and optimise service operations across every touchpoint, applying AI where it delivers measurable operational value.
Our differentiation lies in the experience we’ve gained from operating CX in the real world. We deliver end to end; from the network that carries customer contact, through interactions in the contact centre, to the integrated back-end systems that support them. This end-to-end accountability creates a unified view of the customer and operations, enabling consistent, reliable outcomes at scale.
Connect with us Connect United Kingdom, Connect South Africa, Connect India, Connect USA.
© Copyright 2026. All rights reserved.
Connect expertise is centred around CCaaS, CX, AI and automation, data-driven insights and Network services. With a footprint in the United Kingdom, South Africa, India and the USA, we help organisations operationalise AI in CX and deliver measurable impact.
Visit Connect®
UK: 5th Floor, 90 Fenchurch Street, London, EC3M 4BY
SA: Thornhill Office Park, 84 Bekker Road, Midrand, South Africa
Get in touch today on info@weconnect.tech or
UK: +44 20 70751450
SA: +27 10 476 0140