Ten years ago, if you ran a small business in the Lower Mainland, there was a decent chance you had a server sitting in a back closet somewhere. Maybe it was under a desk. Maybe it was in a room that got way too hot in August. It hummed along, it held your files, and every couple of years someone had to come out and deal with it when something went sideways.

Then the cloud happened, and the pitch was compelling: get rid of the box, stop worrying about hardware failures, access your stuff from anywhere. For most businesses, it was the right call. We moved hundreds of clients onto cloud platforms over the years, and the vast majority of them ended up in a better spot.

But something interesting is happening now. The same technology wave that made the cloud feel inevitable (AI, specifically) is creating reasons for some of that infrastructure to come back in-house. Not all of it. Not for everyone. But the pendulum is swinging, and it’s worth understanding why.

The cloud era made real sense

Let’s be clear about why businesses moved to the cloud in the first place, because those reasons haven’t disappeared.

Cloud platforms like Microsoft 365, Google Workspace, and AWS gave small businesses access to infrastructure that used to require a full-time IT person and a room full of equipment. Email, file storage, collaboration tools, backups. All of it handled by someone else’s data centre, updated automatically, accessible from a laptop at home or a phone on a job site.

For a 15-person office in Surrey, that was genuinely transformative. No more worrying about whether the backup ran last night. No more drive failures taking down the whole office for a day. The cloud solved real problems, and for most everyday business tasks, it still does.

So why is anything coming back?

Two things changed: AI got useful enough that businesses actually want to run it, and people started paying closer attention to where their data goes when they do.

When you use a cloud AI tool (ChatGPT, Copilot, Gemini, whatever your team has started playing with), your prompts, your documents, and your questions are typically being processed on someone else’s servers. For a lot of use cases, that’s fine. Asking an AI to help draft a marketing email isn’t a data sensitivity issue. (If you’re weighing those tools against each other, we compared the privacy implications of ChatGPT and Copilot here.)

But the moment you start feeding it client contracts, financial records, employee files, or proprietary business processes, the picture changes. That data is leaving your environment. It’s being processed on infrastructure you don’t control, in a jurisdiction you may not have thought about, under terms of service that can change without much notice.

This is where the on-premise conversation is coming back, and it looks nothing like the old server-in-the-closet days.

What “on-premise AI” actually looks like in 2026

When we say on-premise now, we’re not talking about going back to a noisy rack in the back room. The hardware has gotten remarkably small and quiet.

A Mac Mini sitting on a shelf can now run a capable AI model locally. Open-source language models (think of them as private versions of ChatGPT that run entirely on your own hardware) have gotten good enough that for many business tasks, they’re genuinely useful. Your team can ask questions, summarize documents, draft communications, and analyze data, all without anything leaving your office network. We wrote a deeper dive on what one of these setups actually looks like in practice.

The setup runs quietly, costs a few dollars a month in electricity, and once it’s configured, your team interacts with it the same way they’d use any other AI tool. The difference is that the data stays on your hardware, in your office, under your control.

We’ve been setting these up for clients who have specific data sensitivity requirements, and the reaction is usually the same: “Wait, this runs here? On that little thing?”

The data sovereignty angle (especially in Canada)

This matters more for Canadian businesses than a lot of people realize.

American companies control roughly 60% of Canada’s cloud market. AWS, Microsoft Azure, and Google Cloud dominate. Even when your data is stored in a Canadian data centre, if the provider is headquartered in the US, it may still be subject to American laws like the CLOUD Act, which can compel disclosure of data stored abroad.

Canada’s privacy framework is also shifting. PIPEDA, the federal privacy law, was written before cloud computing was a thing most people had heard of. New federal privacy legislation is expected soon, potentially with fines up to $25 million or 5% of global revenue. And here in BC, we have PIPA, our own provincial privacy law that’s stricter than what most other provinces require, particularly relevant for healthcare, legal, and financial services businesses.

For a law firm in Langley handling sensitive client files, or a medical clinic in Surrey processing patient records, where your AI processes data isn’t an abstract question. It’s a compliance question with real consequences.

This isn’t about abandoning the cloud

The important thing to understand is that this isn’t an either/or situation. Almost nobody is ripping out their cloud infrastructure entirely, and that wouldn’t make sense for most businesses.

What’s happening instead is a hybrid approach. Your email, your collaboration tools, your everyday file storage: those stay in the cloud, where they work well. But for AI workloads that touch sensitive data, for processes where you need to know exactly where information lives and who can access it, some of that is moving back onto local hardware.

Industry analysts are seeing this play out broadly. A recent Barclays CIO Survey found that 86% of chief information officers planned to move at least some cloud workloads back to on-premise or private cloud, the highest number on record. Gartner is projecting that 40% of enterprises will adopt hybrid compute architectures for critical work, up from around 8% previously. And organizations that have made strategic moves back are reporting 30% to 60% reductions in infrastructure costs for those specific workloads.

These are enterprise numbers, but the pattern filters down. When the tools get simpler and the hardware gets cheaper (and both are happening fast), small businesses start making the same calculations.

What this means if you run a small business

You don’t need to become a technology expert to navigate this. But there are a few things worth thinking about:

• Know where your data goes when you use AI tools. If your team is using ChatGPT or similar tools with client data, understand that information is being processed externally. That may be fine for some tasks and not fine for others.
• Understand your industry’s requirements. If you’re in healthcare, legal, financial services, or any field that handles personal information in BC, your obligations under PIPEDA and PIPA are real. AI doesn’t get an exemption from privacy law.
• Ask about local options. Private AI running on local hardware is no longer a big-company-only solution. The cost has dropped to the point where it’s realistic for a business with 10 or 15 people.
• Think hybrid, not binary. The goal isn’t to pick a side. It’s to put the right workloads in the right place. Cloud for what makes sense in the cloud. Local for what needs to stay local.

The pendulum keeps moving

Technology tends to swing back and forth like this. Mainframes gave way to personal computers. Personal computers gave way to cloud. And now cloud is giving way to something more nuanced: a mix of cloud and local that depends on what you’re actually doing with the data.

The businesses that handle this transition well won’t be the ones who pick one approach and stick with it out of habit. They’ll be the ones who actually understand what they’re working with and make deliberate choices about where things run and why.

We’ve been helping Lower Mainland businesses navigate these kinds of infrastructure decisions since 2006, from the server closet era through the cloud migration and now into this hybrid AI world. If you’re starting to think about where AI fits into your business and want to understand your options (cloud, local, or some combination), we’re happy to walk through it with you. Book a free consultation with Raxxos and we’ll take a look at what makes sense for your setup.