AIBIS AI solutions & training

All posts

Treat the model as a consumable: build so you can swap it over a weekend

A pattern has been showing up in the news lately: one vendor announces a new model before anyone can actually use it; another ships a model that is only slightly behind the flagship but costs a fraction; elsewhere a court decides that one provider's models can be excluded from public procurement. If your AI solution is welded to one specific model, every one of those headlines is a risk. If it isn't, they're just opportunities to lower your bill.

The model is a component, not a foundation

We often see AI projects start with the question "which model should we use?", as if it were a decision for the next five years. In practice it is closer to choosing a hosting provider or a payment gateway: important, but replaceable. The value does not sit in the model. It sits in having a defined process, clear instructions, clean data and a place where results are measured. The model is the part most likely to be cheaper or better six months from now.

One management rule follows from this: never plan a product around a model that has only been announced, and don't let anyone build a solution whose internals assume one vendor's quirks everywhere. Procurement decisions get made on what actually works in the API today.

Four things that keep you swap-ready

First, the model is chosen in exactly one place. If its name is scattered across ten files — or lives only in people's personal chat windows — there is nothing to swap. Second, your prompts and settings live in your own system, not in the vendor's web interface. If someone has built the whole support logic inside one platform's UI, that logic effectively belongs to that platform.

Third, and this is the most underrated step: assemble 20–30 real cases together with the answer you'd consider correct. Real customer emails, real invoices, real documents. That is your evaluation set and the only sane way to tell whether a new model is better or merely newer. Fourth, log every request so you can later see the input, the output, the model name and the date. Without that, comparison is just a feeling.

How to actually do a switch

When a new model appears, first run it alongside the current one without letting its output reach a customer. Compare on your evaluation set: how many cases came out right, where it got worse, what one processed case costs. Only then switch over — ideally one process at a time, not everything at once. Keep the old configuration available for a week so you can roll back.

The same discipline brings a second win. Most routine work — classification, summarising, formatting, pulling fields out of documents — does not need a top-tier model. Once you have an evaluation set, you can safely try a cheaper one and see in black and white whether quality suffers. Often it doesn't, and the invoice drops noticeably.

Where the limit is

Let's be honest: full independence doesn't exist, and chasing it gets expensive. If you rely on vendor-specific features — built-in tools, voice, document search — a switch is no longer a one-line change. With a vector database you'll need to re-index your texts with the new model. And if a tool is used fifty times a month, don't wrap it in an abstraction layer that costs more to maintain than it ever saves.

The goal isn't for switching to be free. The goal is for it to be a couple of days of work rather than a rewrite. If nobody on your team can answer that question about your current setup, that is an answer in itself — and a good place to start next quarter.

All posts

Next step

Book a free 20-minute call.

Book a free 20-min call