Clinical documentation
Staff draft notes, discharge instructions or referral letters. A useful prompt can still disclose diagnoses, medications and identifiers.
Clinicians paste patient notes into ChatGPT. Coders use AI for ICD lookups. Researchers upload datasets to model-training tools. Your EHR audit trail does not catch any of it. A DNS log audit does.
Sample report
View all 11 pages
Opens in your browser · PDF
Every unsanctioned AI tool that touches patient data is a potential breach notification event. Unlike other industries, healthcare has strict federal penalties and mandatory 60-day disclosure timelines.
Physicians and nurses paste discharge summaries, lab results and medication lists into AI chat tools to draft notes faster. Each paste sends PHI to a third-party server with no BAA in place.
Coders use AI-powered ICD-10 and CPT lookup tools to speed up claims processing. These tools often require pasting procedure narratives that contain patient identifiers.
Researchers upload de-identified datasets to AI analysis platforms. But de-identification is rarely perfect, and the tool's terms may permit training on uploaded data.
Front-desk and billing staff use AI summarizers for prior authorization letters, appeal drafts and patient communications. Each contains names, DOBs and diagnosis codes.
Clinicians query AI tools for differential diagnosis suggestions, uploading symptoms, vitals and imaging descriptions. No BAA, no audit trail, no HIPAA compliance.
Medical residents and students use AI to study case files, sometimes uploading real patient scenarios from teaching hospitals to get AI-generated feedback.
A shadow AI audit maps directly to HIPAA Security Rule requirements. Every finding in your report addresses a specific safeguard obligation.
| HIPAA Requirement | Section | Shadow AI Risk | What the Audit Produces |
|---|---|---|---|
| Access Controls | 164.312(a) | AI tools accessed without authentication controls | List of AI tools per user group with access frequency |
| Audit Controls | 164.312(b) | No logging of PHI sent to AI services | DNS-level activity log for every AI domain contacted |
| Transmission Security | 164.312(e) | PHI transmitted to AI servers without encryption verification | Protocol analysis and encryption status per AI tool |
| Business Associate Agreements | 164.314(a) | AI vendors used without BAA in place | Vendor list with BAA availability flag per tool |
| Risk Analysis | 164.308(a)(1) | AI tool risks not included in risk assessment | Risk-scored AI tool inventory with remediation priority |
| Workforce Training | 164.308(a)(5) | Staff unaware of AI tool PHI risks | Usage patterns by department for targeted training |
| Device and Media Controls | 164.310(d) | AI browser extensions on workstations | Extension and plugin detection from network signatures |
A real excerpt from a shadow AI audit of a 400-bed hospital system. Names and specifics redacted.
Each scenario is drawn from patterns we observe across healthcare audit engagements.
An attending physician pastes a full discharge summary into ChatGPT to reformat it for a patient portal. The summary contains the patient's name, DOB, diagnosis codes, medications and attending notes. OpenAI's free tier trains on this input. This is a HIPAA breach exposing PHI to a vendor without a BAA.
A billing specialist uses an AI writing tool to draft a payer appeal letter. The letter contains the patient's name, insurance ID, procedure codes and clinical justification. The AI tool stores the input in its training dataset. The health system has no record this happened.
A clinical researcher uploads a CSV of "de-identified" patient data to an AI analysis tool. The dataset contains rare disease combinations and zip codes that make re-identification possible. The AI vendor's terms allow training on uploaded data and sharing aggregate outputs.
A department head uses an AI meeting recorder during a case review. The recording captures patient names, conditions and treatment decisions. The transcription tool sends audio to cloud servers for processing. No BAA exists. The transcript is stored indefinitely.
A four-phase approach to moving from invisible risk to managed AI governance.
Run the shadow AI audit. Upload 14 days of DNS and proxy logs. Get a complete inventory of every AI tool accessed from your network.
Score each tool for PHI exposure risk. Flag tools that train on input, lack BAAs, or store data outside the US. Map findings to HIPAA requirements.
Block critical-risk tools. Negotiate BAAs for tools worth keeping. Update your acceptable use policy. Deploy targeted training for high-usage departments.
Run quarterly audits to detect new AI tool adoption. Track policy compliance by department. Feed results into your HIPAA risk assessment cycle.
Which departments use the most unsanctioned AI tools, and what types they reach for.
| Department | Common AI Tools | Typical Use Case | PHI Risk Level |
|---|---|---|---|
| Emergency Medicine | ChatGPT, differential diagnosis tools | Symptom lookup, note drafting | Critical |
| Medical Records / HIM | AI coding assistants, summarizers | ICD-10 coding, chart abstraction | Critical |
| Billing and Revenue Cycle | AI writing tools, appeal generators | Payer appeals, denial management | High |
| Radiology | AI image analysis, report tools | Impression drafting, comparison | Critical |
| Nursing | ChatGPT, clinical reference tools | Care plan drafting, patient education | High |
| Research | AI analysis platforms, data tools | Dataset analysis, literature review | High |
| Administration | AI transcription, meeting tools | Meeting notes, presentations | Medium |
| IT / Informatics | AI code assistants, chatbots | EHR customization, scripting | Low |
Healthcare has the highest average breach cost of any industry. Shadow AI creates breach vectors that traditional security tools miss entirely.
Average cost of a healthcare data breach in 2023, the highest of any industry for the 13th consecutive year. Shadow AI creates new breach vectors outside your security perimeter.
HIPAA requires breach notification within 60 days of discovery. If shadow AI tools expose PHI, the clock starts when you find out. A proactive audit finds the exposure before it becomes a reportable incident.
The HHS Office for Civil Rights has increased enforcement actions. Penalties range from $100 to $50,000 per violation, with annual maximums of $1.5 million per violation category.
One log upload. One report. Complete visibility into every AI tool touching your network.
AI adoption rarely begins as a formal platform project. It begins when a person finds a faster way to finish a familiar task. For clinicians, researchers, revenue-cycle staff, administrators and technology teams, that convenience can put protected health information, clinical notes, images, claims, research data and patient identifiers into services the organization has not assessed.
Staff draft notes, discharge instructions or referral letters. A useful prompt can still disclose diagnoses, medications and identifiers.
Users test image enhancers or diagnostic assistants outside the approved imaging environment, creating an uncontrolled copy of patient data.
Claims teams use AI to explain denials or rewrite appeals. Claim numbers and clinical context can make supposedly de-identified text identifiable.
Investigators summarize papers, analyze datasets or generate code. Unpublished results and participant information may cross contractual boundaries.
Contact centers and care coordinators draft replies in consumer tools, where pasted conversation history may contain extensive health information.
IT teams paste logs and screenshots into assistants. Those artifacts can contain patient names, tokens and internal system details.
A useful program does more than count domains. It connects observed use to data, purpose, identity and vendor terms. That context lets privacy, security, clinical governance, compliance and departmental leadership choose a proportionate action and explain it later.
| Question | Why it matters | Practical outcome |
|---|---|---|
| Is the tool approved? | Approval confirms that ownership, terms and intended use were reviewed. A familiar brand is not evidence that the account or feature in use is sanctioned. | Label the service approved, restricted, under review or blocked. Record the account tier and approved purpose, not only the vendor name. |
| What data could reach it? | The same assistant can be low risk for public research and high risk for protected health information, clinical notes, images, claims, research data and patient identifiers. | Define prompt examples by data class. Give users concrete red lines and a safe route for the useful workflow. |
| What do the terms say? | Training, retention, subprocessors, location, deletion and administrative controls vary by plan and can change over time. | Capture a dated vendor decision. Recheck material services on renewal and whenever the report shows a new domain or product. |
| Who is using it? | Ten hits from one lab, practice or branch call for a different response than ten hits spread across public-research roles. | Start with the highest-risk identity cluster. Ask about the task before deciding whether to coach, migrate, investigate or block. |
| Does an existing tool cover the need? | Shadow adoption often signals that an approved platform is unavailable, difficult to use or poorly communicated. | Remove friction, publish the approved route and measure whether users migrate during the next comparable audit window. |
The strongest first audit is narrow enough to explain and repeat. Use a normal operating period, preserve the source details and state the limits of DNS or proxy evidence in the report.
Start with 14 to 30 days that avoid a shutdown, migration or major outage. Record the dates, networks, identity coverage and exclusions. That scope statement makes comparisons honest and prevents a partial export from being mistaken for an enterprise census.
From hospital DNS, secure web gateways, remote-access infrastructure and managed endpoint telemetry, retain timestamp, hostname, action and the most useful identity field available. Do not add URL paths, request bodies or prompt content. Inventory work needs enough attribution to act, not the maximum amount of personal data.
Remove known test traffic, shared resolvers and infrastructure identities before interpreting user counts. Look for repeated use over several days and clusters within a team. A single lookup may be an email link or background process; a stable pattern deserves a conversation.
Meet the relevant team with neutral questions: what task is being completed, what information is entered, which account tier is used and why the approved route does not work. Document the answer beside the technical observation so reviewers can distinguish evidence from inference.
Block services built for abuse or those with unacceptable terms. Migrate useful work to an enterprise product when controls can make it safe. Coach occasional low-risk users, and escalate suspected disclosure through the existing incident process rather than inventing an AI-only procedure.
Use the same source and similar window after remediation. Compare tool prevalence, active identities and sanctioned share. A decline supports closure; persistent traffic can reveal browser extensions, mobile devices, alternative domains or a workflow the replacement failed to solve.
Shadow AI crosses technical, contractual and operational boundaries. A central policy works only when each function knows which decision it owns and where to send an exception.
Maintain discovery coverage, investigate technical anomalies and operate access controls. Security should explain what the logs prove and where visibility ends. It also checks whether sanctioned services support identity, logging, retention and configuration standards.
Translate observed workflows into data, confidentiality and notification questions. Review terms for training, retention, location and subprocessors. When facts suggest a disclosure, use the established legal and privacy assessment process rather than deciding from a domain count.
Prioritize services that employees actually use. Confirm the exact plan, contracting entity and product features because one vendor can offer several materially different data practices. Preserve the assessment date and schedule a review for important services.
Explain the task, data and reason for adoption. Decide whether the workflow is valuable enough to sanction, redesign or replace. Owners also nominate local guidance, test approved alternatives and confirm that remediation works in daily practice.
Give employees examples they recognize, a simple approved-tool directory and a route to request new uses. Communications should avoid implying that DNS reveals prompts. Training is more credible when it solves the workflow that led users to the tool.
Test whether scope is documented, findings have owners, exceptions expire and follow-up runs verify change. Assurance can sample the chain from source export to final disposition without needing access to every identity in the operational report.
In healthcare, the relevant obligations can include HIPAA Privacy and Security Rules, HITECH breach duties, GDPR health-data rules, medical-device quality controls, records-retention requirements. A domain inventory does not satisfy those frameworks by itself. It supplies a dated factual layer that existing governance processes can use.
Identify the log source, dates, included networks and available identity types. List known blind spots such as unmanaged mobile data, direct IP connections or sites that use a different resolver.
This keeps later readers from giving the numbers more certainty than the collection method supports.
Keep the service name, matched domains, category, first and last observation, identities and sanctioned status. Store dated vendor-term research beside the observation rather than silently overwriting old decisions.
The result becomes a practical subset of the wider AI system inventory.
For each material tool, name an owner, intended use, permitted data, account requirement and disposition. Include the reason for approval, restriction or blocking in language a business user can follow.
A short rationale is more useful than a color with no explanation.
Attach tickets, procurement decisions, configuration changes, user guidance and incident references where applicable. Link each artifact back to the finding it addresses.
This traceability shows that discovery led to controlled action rather than a report that was filed and forgotten.
Some teams need a restricted tool temporarily. Record the business reason, data limits, accountable owner, compensating controls and expiry date.
Time-bound exceptions prevent urgent workarounds from becoming permanent, invisible policy.
Preserve a comparable later report and explain major changes in scope. Track whether targeted identities moved, whether alternative domains appeared and whether approved services gained adoption.
Trend evidence makes the control testable instead of merely aspirational.
A large raw hit count is rarely a useful board metric because DNS caching and automated traffic distort volume. Favor stable measures tied to coverage, decisions and follow-through.
No. It proves that a covered identity or network resolved a domain during the selected period. Confirm the workflow through interview, endpoint evidence or the vendor’s administrative logs before making a disclosure finding.
Immediate blocking can interrupt legitimate work and push users to personal devices or less visible services. Discovery first lets the organization protect urgent risks, preserve useful workflows and provide an approved alternative users will actually adopt.
No. The inventory tells vendor risk which services are actually present and which deserve priority. Procurement, privacy, legal and security still need to assess terms, controls, subprocessors, location, retention and the intended data.
Quarterly is a practical baseline for a stable environment. Monthly review suits fast adoption, active remediation or higher-risk groups. Repeat after major policy, network or approved-tool changes, using comparable scope whenever possible.
Keep the device identity and map it through the asset system only when investigation requires it. Network-level attribution is still useful for locating a site or function, and the report should state that it does not represent a unique-user count.
Explain the business purpose, data sources, fields used, retention, who can see results and how findings will be validated. Clear notice supports trust and prevents a domain observation from being presented as surveillance of prompt content.
Name the product and account tier, approved purposes, permitted data classes, required settings, owner and review date. A vendor-level approval is too broad when consumer and enterprise plans have different training and administrative controls.
Use the organization’s existing incident criteria. Escalate when validation indicates that protected information entered an unauthorized service, credentials were exposed or contractual and regulatory duties may apply. The domain match alone is a lead, not the final conclusion.
Full HIPAA compliance guide for shadow AI detection and remediation.
Multi-framework evidence packs and remediation workflows.
For healthcare organisations processing EU patient data.
GDPR Article 30 mapping and DPIA triggers for AI tools.
Shadow AI risks in banking, trading and insurance.
Every AI tool with a verdict for healthcare, as a CSV and ready block lists, from our sister site AI Tools Blocklist. One-time $790.
Upload your DNS or proxy logs and get a HIPAA-mapped shadow AI inventory with PHI risk ratings, BAA status and department-level usage patterns.
Start Your Free Audit