Reference Architecture

A typical sovereign AI stack, sized to your team and kept entirely inside your network.

Hardware tiers

Tier Best for Typical hardware class Notes
Small practice 1–10 users, light document and note workflows Single high-memory GPU workstation Quiet, office-friendly; no server closet required.
Mid-size 11–50 users, multiple departments Dedicated on-prem server or locked rack Redundant storage, scheduled backups, centralized access.
Multi-site 50+ users, multiple locations Rack deployment with site-to-site access controls Segmented by role and location; IT-managed.

Exact models and specifications are tailored per engagement. We do not resell hardware; we provide procurement guidance your IT team can validate.

Software stack overview

The stack is intentionally generic: open-weight models, local inference, and a retrieval layer that draws from documents you already own. No cloud API calls during normal operation.

Network isolation

The diagram below shows the typical data path: your staff's prompts and documents never leave your LAN. There is no outbound route to a third-party AI service.

Sovereign AI network diagram Staff workstations and EHR on the local network connect to an internal AI server. A firewall blocks outbound traffic to the internet cloud. Your Local Area Network Staff Workstations Internal AI Server EHR / Practice Systems Firewall No outbound path to cloud AI services

Updates & maintenance

Request an architecture review