Perturbed Gibbs Samplers for Generating Large-Scale Privacy-Safe Synthetic Health Data
By Yubin Park, Joydeep Ghosh, Mallikarjun Shankar. 2013
33 citations recorded by the source corpus.
This paper introduces a non-parametric data synthesizing algorithm to generate privacy-safe ``realistic but not real'' synthetic health data. Our goal is to provide a systematic mechanism that guarantees an adequate and controllable level of privacy while substantially improving on the utility of public use data, compared to current practices by CMS, OSHPD and other agencies. The proposed algorithm synthesizes artificial records while preserving the statistical characteristics of the original data to the extent possible. The risk from ``database linking attack'' is quantified by either an l-diversified or an ϵ-differentially perturbed data generation process. Moreover its algorithmic performance is optimized using Locality-Sensitive Hashing and parallel computation techniques to yield a linear-time algorithm that is suitable for Big Data Health applications. We synthesize a public Medicare claim dataset using the proposed algorithm, and demonstrate multiple data mining applications and statistical analyses using the data. The synthetic dataset delivers results that are substantially identical to those obtained from the original dataset, without revealing the actual records.
Subfields: Artificial Intelligence, Epidemiology, Management Science and Operations Research, Evaluation & Benchmarks, Safety, Robustness & Interpretability
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Artificial Intelligence
- Jimeng Sun
- Edward Choi
- Walter F. Stewart
- Brett K. Beaulieu-Jones
- Casey S. Greene
- Bill Howe
- Sanjeev P. Bhavnani
- Bernease Herman
In Epidemiology
In Management Science and Operations Research
- Brett K. Beaulieu-Jones
- Jimeng Sun
- Zhiwei Steven Wu
- Casey S. Greene
- Jon D. Duke
- Bradley A. Malin
- Siddharth Biswal
- Edward Choi
In Evaluation & Benchmarks
- Julia Stoyanovich
- Jimeng Sun
- Zhiwei Steven Wu
- Jon D. Duke
- Bradley A. Malin
- Siddharth Biswal
- Edward Choi
- Walter F. Stewart
In Safety, Robustness & Interpretability
- Jimeng Sun
- Bernease Herman
- Brett K. Beaulieu-Jones
- Julia Stoyanovich
- Bill Howe
- Zhiwei Steven Wu
- Jon D. Duke
- Bradley A. Malin
Citations in the corpus
- Privacy-Preserving Generative Deep Neural Networks Support Clinical Data Sharing (2017, methodology): “Other methods aimed at performing this task generally fall into two groups: 1.) sampling methods with a quantifiable privacy risk [7], or 2.)”
- Generating Multi-label Discrete Patient Records using Generative Adversarial Networks (2017, methodology): “More recently, and most related to our work, a privacy-preserving patient data generator was proposed based on a perturbed Gibbs sampler (Park et al., 2013).”
- Synthetic Data for Social Good (2017, methodology): “Other recent approaches in privacy-preserving data generation include the work on plausible deniability in data synthesis [4], on perturbed Gibbs sampling for private data release [19, 18], and on sampling from differentially private copula functions [14].”
- Generating Multi-label Discrete Electronic Health Records using Generative Adversarial Networks (2017, methodology): “More recently, and most related to our work, a privacy-preserving patient data generator was proposed based on a perturbed Gibbs sampler (Park et al., 2013).”