Healthcare
Rhino FCP

Running HIPAA-Compliant Queries Across Distributed Clinical Datasets

By
The Rhino Team
No items found.
November 4, 2026

Every multi-site study starts with a cohort-defining question. Answering it the traditional way means copying records from separate EHR systems into one warehouse, wherein each transfer adds a pipeline to build, an agreement to negotiate, and a privacy review to clear. Plenty of projects stall before the first count runs.

Federated computing removes the transfer entirely. Each site runs the same query inside its own environment and returns only aggregate results, so patient records stay with the institution that holds them. The guide below covers which HIPAA pathways apply to federated queries, the harmonization and privacy techniques that make cross-site results reliable, and the practices that move a federated network from pilot to production.

Why Centralizing Clinical Data Complicates HIPAA Compliance

HIPAA’s Privacy Rule allows centralizing PHI for research only through specific routes, and each one carries its own approvals and paperwork. Organizations typically rely on patient authorization, a waiver from an Institutional Review Board (IRB) or Privacy Board, a limited data set under a data use agreement, or de-identification using one of the two methods in HHS’s Guidance Regarding Methods for De-identification of Protected Health Information: Safe Harbor or Expert Determination. Every transfer to the central repository also creates a point of exposure that compliance teams have to secure.

The operational burden compounds the regulatory one. Picture a consortium of independent hospitals, each operating their own electronic health record (EHR) system. Centralizing their data means a separate agreement, policy mapping, and audit trail for every institution, plus custom integration work to align each site’s data model, consent language, and security controls with one repository. Research timelines slip, and every added copy of the data raises the risk of a leak.

Keeping data where it resides lets each institution enforce its own governance policies and still contribute to cross-institution research.

Why Federated Computing Fits Multi-Site Queries

Federated computing sends the query to the data. Each site runs the analysis inside its own environment, applies its own privacy controls, and returns only aggregate results, so institutions keep ownership and control of their PHI. Raw records never leave their originating environment, which shrinks the attack surface. The same approach scales from simple cohort counts to population-level statistics and model training across an entire network of sites.

What Data Leaves Each Site?

A federated query returns aggregate results, such as a count or an average. Federated model training returns model updates, which can still carry information about the underlying data and need protections of their own. Small results need care too. In a multi-center oncology study, each site can count patients with a rare biomarker and return only the total, so no genome files leave the site. Rare findings produce small counts that can point to individual patients, so sites typically suppress or generalize any count below a minimum threshold before releasing it.

How Do Researchers Find the Right Sites Before a Study?

Before any study begins, researchers need to know which sites have the patients they’re looking for. Federated Datasets in the Rhino Federated Computing Platform (Rhino FCP) let data custodians publish a dataset, or selected parts of it, as a browsable catalog protected by k-anonymization, differential privacy, and role-based access controls. Researchers can explore aggregated statistics for subgroups, and once a custodian approves access, they can start a project with that subgroup while the data stays at the site.

What Makes Federated Query Results Reliable and Private?

A federated query only returns a meaningful total if every site reads it the same way. One hospital might record type 2 diabetes with an ICD-10 code, while another uses a homegrown code from its EHR. Data harmonization closes that gap by mapping each site’s local schema to a shared data model, such as the Observational Medical Outcomes Partnership (OMOP) Common Data Model or Fast Healthcare Interoperability Resources (FHIR), and its local codes to standard terminologies such as SNOMED CT, LOINC, and RxNorm. Once mapped, a query for “patients with diabetes” selects the same clinical concept at every location.

Harmonization makes results comparable. Privacy-preserving AI techniques protect the patients behind them. Trusted Execution Environments (TEEs) protect computation at the hardware level, Multi-Party Computation (MPC) lets sites compute joint results without revealing their individual inputs, and differential privacy adds calibrated noise to query results to reduce re-identification risk. Sites can layer these protections into the same federated workflow, so every count and statistical analysis runs with them in place.

What Does It Take to Build a Federated Network?

A federated network has three parts: the sites that hold the data, an orchestration layer that coordinates work across them, and the analytics that run at each site. Security spans all three. Encryption protects data at rest, in transit, and in use, role-based access controls limit who can launch workloads at each site, and audit logs record data access events for regulatory review.

Because every site runs the same query against its own data, the network grows one site at a time, with no central migration. On the Rhino FCP, adding a hospital means installing the Rhino Client behind the site’s firewall, either on-premises or in a virtual private cloud on AWS, Google Cloud, Microsoft Azure, or Oracle Cloud Infrastructure. The site then harmonizes its data to the shared model and sets its own access policies. Installation takes under 10 minutes, and full deployment typically takes two to four weeks, mostly for information security review and hardware provisioning. Every new site widens the pool for cohort discovery, survival analysis, and federated model training.

Best Practices for HIPAA-Compliant Federated Queries

Five practices move a federated query program from pilot to production:

  • Confirm the lawful basis at every site. Agree with each site’s privacy office or IRB on the Privacy Rule pathway before the first query runs.
  • Set governance rules up front. Define who can author queries, which data elements are allowed, and how results are reviewed, and log every query and approval.
  • Harmonize once, then reuse. Build mappings to a common data model as a pipeline every future project can start from.
  • Make privacy controls the default. Apply minimum cell-size thresholds to every released count, add differential privacy or TEEs where the risk warrants, and document each analysis’s parameters.
  • Validate locally before aggregating. Site-level quality checks catch data issues before they skew the network-wide answer.

With these practices in place, a research team can ask how many patients across the network share a diagnosis and get an answer without a single record leaving its home institution.

Your Next Cohort Question Doesn’t Need a Data Warehouse

Multi-site research has always paid a toll before the first query: a pipeline, an agreement, and a privacy review for every institution. Federated computing removes it. Each site keeps its PHI, harmonization makes results comparable, and privacy controls protect the patients behind every count. The payoff is speed. Researchers find the right cohort before committing to a study, and every new site expands what the network can answer.

Have a cohort question that’s stuck behind data access? Talk to our team about running it as a pilot on the Rhino FCP.

FAQs

1. How Can a Federated Query Respect Each Site's HIPAA Policies?

A federated query respects each site’s HIPAA policies when it has a lawful basis under the Privacy Rule, and the platform limits who can run it and what data it returns. Cohort counts for feasibility often qualify as reviews preparatory to research, which HIPAA permits without patient authorization when the researcher confirms the review is preparatory and no PHI leaves the institution. Studies beyond feasibility typically need an IRB or Privacy Board waiver, patient authorization, or de-identified data.

2. What Steps Are Involved in Harmonizing Data Across Hospitals?

Harmonization maps every site’s data to one shared model so the same query selects the same clinical concepts everywhere. Teams typically choose the OMOP Common Data Model for research analytics, map each site’s local tables and codes to it and to standard vocabularies such as SNOMED CT and LOINC, then validate the mappings on sample data before running production queries. However, studies with limited scope may find the effort required for an OMOP transformation out of scope and instead create a custom schema purpose-built to the research questions.

3. Which Privacy-Preserving Techniques Are Most Practical for Cohort Counts?

Small-cell suppression is the standard safeguard: any count below a set threshold is withheld or shown as a range, because small numbers can point to individual patients. The Centers for Medicare and Medicaid (CMS), for example, bars reporting any count from 1 to 10. Differential privacy adds calibrated noise for a formal privacy guarantee, and Trusted Execution Environments run the count in an isolated, hardware-protected environment that the host operating system and administrators can’t see into.

4. How Does Federated Analytics Differ from Traditional Centralized Analytics?

Centralized analytics copies data from every source into one repository before analyzing it. Federated analytics runs the same analysis at each source and combines only the results, so patient-level records stay with the institution that holds them.

5. What Resources Can Help My Team Get Started with Federated Querying?

Start with a pilot that answers one well-defined cohort question across a few sites. Agree on a common data model before the pilot begins, and bring compliance officers in early to set governance rules that later projects can reuse.

Build your Federated Network