AI implementation is the work of taking an AI capability from a proven idea to something running inside the systems a business already uses, with the data, the interfaces, the costs and the monitoring that make it dependable. It is rarely a model-selection problem and almost always a question of where the capability sits, who consumes it, and what happens when it is wrong.

Picture the meeting. Someone has run a convincing demo; the model answered the question, extracted the fields, flagged the anomaly. Everyone agrees it should be in the product. Six months later it is still not in the product, and the reasons are the ones nobody raised in the meeting: the data turned out to live in three places, the engineers had no interface to call, the monthly bill was a guess, and nobody could say what "working" would look like on the day it went live. The demo was the easy part. Implementation is everything after.

In this guide, Elliott Prince, Managing Director at Ferrous Labs, walks through AI implementation the way it actually runs for a UK business with an existing stack: how to define the problem so it can be tested, what to check in the data before anyone builds, the three ways AI can sit alongside software you already run, how to cost it so the number holds, and how to know it worked.

Start with a problem you can measure, not a technology you can demo

The most common way implementation fails is at the very beginning, when the brief is "use AI for X" rather than "reduce Y by Z". A demo proves a model can do a thing; it does not prove the thing is worth doing or that doing it changes a number anyone is accountable for. So the first step is to write the problem down in terms of an outcome: hours of senior time per week spent on a task, days to turn a document round, error rate in a process, cost per query. If you cannot name the number that should move, you cannot know whether implementation succeeded, and you will find out at renewal time rather than in week two.

Of course, naming the number also tells you whether you need AI at all. Our post on AI agent development in the UK makes the point that an agent, software that decides its own next step, is powerful and expensive to do well, and that a plain workflow often beats it. The same test applies to every capability: the honest starting question is not how to implement it but whether a simpler change would move the same number.

Check the data before anyone writes code

Once the problem is defined, the next step is the one most quotes skip: look at the real data the capability will run on. Not a sample prepared for the demo, but the documents, records or images as they actually arrive, including the scans from the one client whose templates are different and the fields that are blank a third of the time. This is where a surprising number of implementations are decided. If the data is clean and consistent, the build is short. If it is not, the build is mostly the data, and it is far better to learn that in a two-week assessment than in month four.

Critically, this is also where candidate models earn their place or do not. The right approach is to try two or three on your own data against the number you defined, rather than picking the one with the best benchmark score. A model that is marginally worse in general and markedly better on your documents is the better model for you, and the only way to find it is to run the comparison.

Three ways to add AI to software you already run

Which leads us to the architectural question, and the good news is that you can almost always add AI to existing software without rebuilding it. Modern AI capability arrives through interfaces, so it can sit alongside a system rather than inside it. There are three patterns, and choosing the wrong one is the usual reason a sound project turns into a platform migration nobody asked for.

The first is the service alongside: the AI capability runs as its own service behind an API or an MCP server, and your existing application calls it the way it calls any other service. Your engineers integrate it in hours, nothing in the current codebase has to change shape, and the AI side can be improved or swapped without touching the product. This is the pattern that suits most established businesses, and it is the shape of our own AI Integration. The second is the pipeline beside: a batch or event-driven process that reads from your systems, does the AI work, and writes results back, suited to document processing and anything that does not need to answer in real time. The third is the layer in front: an AI interface that sits between users and several existing systems, which is the most ambitious and the one to attempt last.

Whichever you choose, the same things need getting right. A clean interface your engineers can check, a cost envelope you can plan around, monitoring that tells you when accuracy drifts, and a clear line on who owns the model and the infrastructure after launch. The quieter point from our work with engineering consultancies is that AI integration is a workflow design problem before it is a software one: decide exactly where in an existing deliverable the AI output will be reviewed, approved and signed off, and by whom, before you decide which model produces it.

Cost it so the number holds

Let's be honest about budgets, because the cost of implementation is usually under-estimated in one direction and over-estimated in another. The build cost is the part people expect; the running cost is the part that surprises them. A capability that answers a thousand queries a day has a monthly bill, and that bill depends on architectural decisions made before the first line of application code.

Our work for ExtremeReach is the clearest example we can give. A media library of tens of thousands of video and image assets needed four visual-intelligence capabilities, and the engineering constraint was that the system had to be cheap to run, because media query loads are spiky: bursts around campaign launches, then silence. Standard always-on vector databases would have cost $350 to $460 a month in idle compute alone (OpenSearch Serverless) or $200 to $900 (Databricks Mosaic AI) regardless of usage. Designing around the constraint from day one, with roughly 70GB of vectors in AWS S3 vector buckets at about $1 to $2 a month and serverless inference that scales to zero when idle, delivered the four capabilities at broadcast scale for around a tenth of the standard cost. The lesson generalises: cost-engineer the architecture before you build it, benchmark the approach on real numbers, and treat the running cost as part of the design, not a line to discover later.

The other cost to put on the table is the one that never appears on a quote: the time of the people inside your business who own the process the AI is changing. Implementation that nobody internal has time to test, review and feed back on is implementation that stalls, however good the engineering.

Know it worked, and keep knowing

The final step is the one that separates a live feature from a successful one. Going live is not the finish; it is the first time the capability meets data nobody prepared and users nobody briefed. So the number you defined at the start needs measuring before launch, as a baseline, and after, continuously. Models get updated by their providers, your own small changes accumulate, and your users find uses you never designed for. Without a measured baseline, "it has got worse" is an argument; with one, it is a fact with a date on it, and a fix that can be traced to a cause. Our hub on LLM evaluation covers how to measure quality for a feature with no single right answer.

That is also why maintenance belongs in the implementation plan rather than in a renewal conversation a year later. Someone has to watch the accuracy, retrain as the data changes and keep the infrastructure honest. If that someone is not inside your team, make sure it is written into the engagement, because an AI service nobody maintains decays in a way ordinary software does not: it keeps answering, a little less well each month.

Start with one process and a number

You may be reading this with a list of candidate projects and no spare capacity to run any of them properly, which is the normal state of affairs. The way through is not to pick the most exciting one but the most measurable: a single process where the data already exists, the outcome is a number someone owns, and the capability can sit alongside what you run today. Implement that, measure it, and let the result make the case for the next one.

Done this way, AI implementation stops being a bet and becomes a sequence of small, provable changes, each one paying for the next. The businesses that get real value from AI are rarely the ones with the boldest ambition; they are the ones that defined a number, checked the data, chose the right place for the capability to sit, and kept measuring after the launch party. That is a repeatable process, and it is one you can start this quarter.

Frequently asked questions

What does AI implementation involve?

Defining a measurable problem, assessing the real data the capability will run on, choosing how the AI sits alongside existing systems (as a service behind an API or MCP server, as a pipeline, or as a layer in front), building and cost-engineering it, and measuring the outcome before and after launch so that quality is known rather than assumed.

How do I integrate AI into software we already run?

In almost every case without rebuilding it. The most common pattern is a separate AI service behind an API or MCP server that your existing application calls like any other service; integration on your side typically takes hours. Batch pipelines suit document processing, and an AI layer in front of several systems is the most ambitious option and the one to attempt last.

How long does AI implementation take?

It depends almost entirely on the data. Where the data is clean and the capability sits alongside an existing system, a production service can be live in weeks. Where the data lives in several places or arrives inconsistently, the assessment and preparation take longer than the build, which is why we assess the data before quoting the build.

What does AI implementation cost?

Two numbers: the build and the running cost. The build depends on the data and the pattern; the running cost depends on architecture decisions made before the build, and can differ by an order of magnitude for the same capability, as the ExtremeReach example shows. Ask for both, and ask what the monthly bill looks like at idle as well as at peak.

How do we know the implementation worked?

By measuring the number you defined at the start, before launch as a baseline and afterwards continuously. Models, your own changes and your users all shift over time, so a feature that was good at launch is not guaranteed to stay that way; a measured baseline is what turns "it has got worse" from an argument into a traceable fact.

Latest on AI implementation

Want production AI your engineers just call?

AI Integration puts production AI in your stack behind an API or MCP server, built and maintained by us, with no specialist hire required.

See AI Integration Talk to a co-founder →

Not sure where AI fits in your business?

The AI Opportunity Finder maps your highest-value starting point in a few minutes, with no sales call required.

Find your best starting point