Shadow AI
There is no approved tool, so staff paste client data into personal chat accounts. Those accounts have their own terms. You cannot see them, audit them, or turn them off.
AI is only as safe as where your data goes. Here are the three ways to run a private assistant, what each one means for your data, and what we set up whichever you choose. We never host your data in any of them.
Vendor terms change. Checked October 2026.
The model is rarely the weak point. The weak points are people, permissions, and contracts. Three show up again and again.
There is no approved tool, so staff paste client data into personal chat accounts. Those accounts have their own terms. You cannot see them, audit them, or turn them off.
An assistant surfaces what people can already access. If a folder is open to everyone by mistake, the assistant makes that visible overnight. Fix permissions before you turn AI on.
Who keeps your prompts? For how long? Can they train on them? The answers differ by vendor and by plan. They are written down. Someone has to read them.
The assistant, its search index, and the model can sit in different places. Pick a tab to see where the boundary falls. In every option the consultant stays outside it, and your data is never stored with us.
Everything inside the box sits with the vendor, under its business terms.
| Topic | A. Subscription (vendor-hosted) | B. Your cloud | C. On-site |
|---|---|---|---|
| What it is | A business plan of an existing AI product. Examples: ChatGPT Business or Enterprise, Claude Team or Enterprise, Microsoft 365 Copilot, Gemini for Workspace, or Onyx Cloud. | An open-source assistant (for example Onyx) deployed in your own AWS, Azure, or Google Cloud account. Models run through a service such as AWS Bedrock. | A server or NAS in your office. Open-weight models run locally, for example with Ollama or vLLM. It can run fully offline. |
| Where data lives | With the vendor, under its business terms. | In your cloud account. | In your building. |
| Setup effort | Lowest. | Medium. | Highest. |
| Ongoing cost | Per-user subscription. | Your cloud bill plus model usage. | Hardware and power. Little or no usage fees. |
| Control | Least. | High. | Highest. |
| Healthcare (BAA) | Only on some plans. Check each vendor. | You sign a BAA directly with your cloud provider. | No third party involved for the model. |
| Best for | A fast start, general productivity, small teams. | Regulated data, custom connectors, room to grow. | The strictest confidentiality, unreliable internet, sensitive archives. |
| What we do | Pick the right plan. Configure admin and retention settings, SSO and MFA, connectors, and permissions. Write the AI-use policy. Train the team. | Design, deploy, connect, clean data, harden, hand over. | Spec the hardware, install, connect, clean data, harden, hand over. |
Keep the index and the assistant in your building. Send only the few relevant passages to a cloud model that runs under no-training terms. Whole files and the full archive never leave.
Names are examples only. We are not affiliated with any of them, and we are not recommending one here. Vendor terms change. Checked October 2026. Always confirm against the vendor's current terms before you sign.
| Vendor | Training on your content | Healthcare (BAA) | Price (list) |
|---|---|---|---|
| Claude Team (Anthropic) | No model training on your content by default.1 | The Team plan is not included for HIPAA. Enterprise needs the account owner to accept a BAA when HIPAA is activated, and some features are not covered.12 | See vendor's current pricing.1 |
| ChatGPT Business and Enterprise (OpenAI) | Not used for training by default on business plans.3 | Only on specific healthcare and enterprise offerings. Confirm with OpenAI.3 | See vendor's current pricing. |
| Microsoft 365 Copilot | Prompts, responses, and data accessed through Microsoft Graph are not used to train foundation models.4 | A BAA is offered through Microsoft's online services terms. Confirm that your licence is in scope.5 | See vendor's current pricing. |
| Gemini in Google Workspace | Customer data is not used to train models without your prior permission.6 | Can support HIPAA workloads on a qualifying edition. Some features are outside Google's BAA. Confirm your edition.6 | See vendor's current pricing.7 |
| Onyx Cloud | Onyx states it does not train on your data. Confirm retention and data location with Onyx.8 | Not found in the public pages. Confirm with Onyx. | See vendor's current pricing.8 |
| AWS Bedrock (Option B) | Your content is not used to improve base models and is not shared with model providers.9 | HIPAA eligible. You accept the BAA with AWS for your own account.9 | Usage-based. You pay AWS directly.9 |
Option C uses open-weight models run locally with tools such as Ollama or vLLM. There is no vendor to sign with for the model.
Answer four questions. You get a starting point, not a verdict.
Answer all four questions to see a recommendation.
The same baseline goes into every build. The details change with the option.
Setup needs access. We keep it small, visible, and temporary.
You own the accounts, the servers, and the contracts with your cloud and model providers. We design and build. We do not hold your infrastructure, and we do not store your data on our systems. When we use AI coding tools to build connectors, they never see your live data.
We build systems designed to support your duties. We do not certify anything, and we do not give legal advice. Your own counsel and compliance staff decide what your rules require.
Where protected health information is involved, a business associate agreement is needed with each party that can access it. In Option B, you sign a BAA with your cloud provider. In Option C, no third party handles the model. We sign a BAA with you where the law requires one.
The rule expects you to oversee your service providers. We give you a written summary of how the system is secured, so you have it on file.
The opinion covers vendor diligence, client consent, and supervision when lawyers use AI. We supply the technical facts. The firm makes those decisions.
Where recordkeeping rules apply, archive search can be set to respect your retention rules. Your compliance team defines what those are.
That is what the Discovery & Roadmap is for. We look at your systems and your data, then write down which option fits and what it will take. The first call is free.
Vendor names on this page are examples. We are not affiliated with them. Vendor terms change; checked October 2026.