Do I need a BAA to use ChatGPT or an LLM with PHI?

Yes, if PHI reaches the AI provider. You need a BAA for the exact product, and many ChatGPT plans have none. A BAA permits PHI. It does not reduce it.

SOC 2 Type II · ISO 27001 · HIPAA, BAA available

One prior-authorization request

Summarize the denial for Grace Whitfield, MRN 4471-209-88, born 03/14/1949, member ID W88213004, and draft an appeal.

BAA only: the provider receives

Permitted
  • Grace Whitfield
  • 4471-209-88
  • 03/14/1949
  • W88213004

Allowed under contract. Stored under the provider’s retention terms.

BAA plus Protecto: the provider receives

Tokens
  • <PERSON>Lm4Tq8</PERSON>
  • <MRN>905-36-14</MRN>
  • <DATE_OF_BIRTH>07/23/1958</DATE_OF_BIRTH>
  • <HEALTH_BENEFICIARY_NUMBER>QW-81530-77</HEALTH_BENEFICIARY_NUMBER>

Real values stay with you. The answer shows them only to allowed roles.

The short answer: a BAA is required when the provider receives PHI

Under HIPAA, an AI provider that creates, receives, keeps or sends PHI for you is a business associate. You need a business associate agreement (BAA) with it before any PHI goes in.

01

PHI goes to the provider: you need a BAA

That holds for chat apps and APIs, even if names are removed and other identifiers remain, and even if the provider promises not to train on your data.

02

The BAA must cover the exact product and features

In ChatGPT, only the enterprise version offers a BAA. Free, Plus, Pro and Business do not. APIs often do, with conditions and excluded features.

03

Data de-identified under HIPAA needs no BAA

HHS says a provider that receives only properly de-identified data is not a business associate. Removing names alone rarely meets that bar.

04

A BAA does not reduce what you send

HIPAA’s minimum necessary rule still applies, and every identifier you send sits in the provider’s systems.

05

Where Protecto fits

Protecto replaces identifiers with tokens before text reaches the model and keeps the mapping in your environment, so the provider holds far fewer identifiers. Tokens can still be PHI, so many teams keep the BAA and let counsel decide.

Proof

Inovalon built a secure, HIPAA-compliant analytics product on sensitive healthcare data with Protecto

1,000+

Documents Inovalon tested in under a week

50+

Entity types across PII, PHI and PCI, plus custom entities such as your member ID format

Higher F1

Than AWS Comprehend and Microsoft Presidio in the independent UT Dallas / DataXpert benchmark

How a care team ends up sending PHI without a BAA

Most BAA gaps start with a plan that sounds right for business use.

A utilization review team buys ChatGPT Business seats. It is a paid business plan, so the team assumes it is approved for patient data. Nurses paste prior-authorization letters into it: patient name, date of birth, member ID, diagnosis. OpenAI does not offer a BAA for ChatGPT Business. Every letter is PHI sent to a provider with no BAA.

Compliance moves the team to ChatGPT Enterprise, which OpenAI signs a BAA for. The disclosure is now permitted. But every name and member ID still goes to the provider and sits in its systems under its retention terms. And a feature someone turns on, or a plugin that calls another service, may fall outside that BAA.

That is the business associate question in practice: who receives PHI, under which contract, and how much of it.

Same team, three setups

ChatGPT Business seats

Nurses paste prior-authorization letters with names, dates of birth and member IDs.

BAANone offered
Provider holdsEvery identifier pasted
Under HIPAAA disclosure with no BAA

A BAA decides whether the disclosure is permitted. Tokens decide how much of it there is.

When HHS treats an AI provider as a business associate

HIPAA calls a vendor that creates, receives, maintains or transmits PHI for a covered entity a business associate, and requires a written agreement first (45 CFR 160.103, 164.502(e), 164.504(e)). HHS’s cloud computing guidance applies this to cloud services directly.

  • Stores PHI it cannot read: still a business associateHHS says this holds for a cloud provider that keeps encrypted PHI without the key.
  • The conduit exception does not fit an LLMIt covers transmission-only services, such as internet providers. An AI service processes, and often keeps, what you send.
  • Receives only de-identified data: not a business associateThe data must meet Safe Harbor or Expert Determination first.
  • Subcontractors need agreements tooOther tools in the flow, such as a vector database or an AI notetaker, need their own BAA if they receive PHI.

Not legal advice. Summarized from 45 CFR Parts 160 and 164 and HHS guidance on HIPAA and cloud computing.

What a BAA covers, and what it leaves to you

A BAA is a contract about who may hold PHI and what they must do with it. It says nothing about how much PHI you send.

A BAA does

  • Make the disclosure to the provider permitted
  • Bind the provider to safeguard PHI and limit its use
  • Require the provider to report breaches to you
  • Pass those duties to its subcontractors

A BAA does not

  • Reduce how much PHI reaches the provider
  • Cover products, features or plugins outside its scope
  • Cover other tools in your flow, such as logs, indexes or notetakers
  • Decide which of your staff see real patient details in an answer

Which ChatGPT and LLM products sign a BAA

A provider can sign a BAA and still exclude the feature your team uses. Check the product, the feature and the setting, not the logo.

ProviderProducts with a BAA pathNo BAACheck before PHI
OpenAI (ChatGPT)Enterprise versions only: ChatGPT Enterprise, including ChatGPT for Healthcare, through OpenAI salesChatGPT Free, Plus, Pro and BusinessCovered features in the enterprise workspace
OpenAI (API)API with a signed BAA and Modified Retention, self-serve for eligible organizationsAPI without Modified RetentionCovered endpoints and features
MicrosoftAzure OpenAI in Azure AI Foundry, under the HIPAA BAA in Microsoft’s Product TermsPartner and community models are not individually listedDeployment type, model source, input types such as images
GoogleGemini on Google Cloud’s Gemini Enterprise Agent Platform under the Google Cloud BAA. The Gemini app and Gemini in Workspace, on work accounts, under the Workspace BAAGemini on personal Google accounts, Google AI StudioNamed covered products, admin settings
AnthropicClaude API for a HIPAA-enabled organization with a signed BAAConsumer Claude plans, Claude Code, features outside the eligibility tableAPI features. Some, such as Batch API and Files API, are excluded
AWSAmazon Bedrock under the AWS BAA, per the HIPAA eligible services listFeatures and models not on the eligible listRegion, model, feature

Based on each vendor’s public documentation, November 2026. Terms change often. Confirm with the vendor before sending PHI.

What OpenAI’s BAA covers, and what it leaves exposed →

How Protecto reduces what the provider receives

Protecto sits between your staff or apps and the model. Identifiers become tokens before the provider sees them.

  1. 1

    Detect

    Protecto finds identifiers in prompts, files and retrieved records, including those written inside clinical sentences. 50+ entity types, plus custom entities such as your member ID format.

  2. 2

    Tokenize before the provider

    Each identifier becomes a consistent token. The same patient gets the same token every time, so the model can still follow one person. Clinical facts your policy leaves readable stay in the text.

  3. 3

    Keep the mapping with you

    The token mapping stays in your environment. The provider, its logs and chat history hold tokens.

  4. 4

    Reveal by role, logged

    Real values return in the answer only for roles your policy allows. Every detection, mask and reveal is logged for your auditors.

Who holds what
  • The AI provider, under its BAATokens, plus the clinical facts your policy allows
  • Your environmentThe token mapping and the full record
  • The nurse who askedThe answer with real names, for allowed roles

Staff who need a chat assistant can use the Protecto AI Privacy Gateway with the model you choose. Apps call Protecto through its API. Tokens can still be PHI, so many teams keep the BAA. Your counsel decides.

Questions compliance teams ask about BAAs and AI

Does ChatGPT sign a BAA?

Only the enterprise version. As of November 2026, OpenAI offers a BAA for ChatGPT Enterprise, including ChatGPT for Healthcare, and for its API with Modified Retention. ChatGPT Free, Plus, Pro and Business have no BAA, so PHI should not go into them.

No product does that on its own. ChatGPT Enterprise can be used with PHI when OpenAI signs a BAA for your workspace and you use covered features. Your organization still needs its own risk analysis, access controls and policies.

Usually yes. Removing names leaves dates, record numbers, places and context that can still identify a patient. You need no BAA only if the data is de-identified under HIPAA’s Safe Harbor or Expert Determination method.

It depends, and your counsel decides. Tokens can still be PHI when a mapping links them back to patients, and HHS treats providers holding unreadable PHI as business associates. Many teams keep the BAA and tokenize so far fewer identifiers reach the provider.

No. Providers list which products, endpoints and features are covered. Features outside that list, such as some beta tools or plugins that call other services, may fall outside the BAA even on an eligible plan.

That depends on who runs it. When Protecto hosts or manages the service, or can access your instance for support, upgrades or monitoring, Protecto is a business associate and signs a BAA before any PHI flows. When Protecto runs in your environment with no Protecto access, Protecto does not receive PHI and is not a business associate.

See what your provider receives

Bring a sample of prior-authorization letters or clinical notes. We will show what reaches the model, what stays with you and what the log records.

New: run any AI model without exposing real values.
See how it works