Differentially-Private Multi-Party Sketching for Large-Scale Statistics

Authors: Seung Geol Choi (United States Naval Academy.), Dana Dachman-soled (University of Maryland, Colleage Park.), Mukul Kulkarni (University of Massachusetts Amherst.), Arkady Yerukhimovich (George Washington University.)

Volume: 2020
Issue: 3
Pages: 153–174
DOI: https://doi.org/10.2478/popets-2020-0047

Download PDF

Abstract: We consider a scenario where multiple organizations holding large amounts of sensitive data from their users wish to compute aggregate statistics on this data while protecting the privacy of individual users. To support large-scale analytics we investigate how this privacy can be provided for the case of sketching algorithms running in time sub-linear of the input size. We begin with the well-known LogLog sketch for computing the number of unique elements in a data stream. We show that this algorithm already achieves differential privacy (even without adding any noise) when computed using a private hash function by a trusted curator. Next, we show how to eliminate this requirement of a private hash function by injecting a small amount of noise, allowing us to instantiate an efficient LogLog protocol for the multi-party setting. To demonstrate the practicality of this approach, we run extensive experimentation on multiple data sets, including the publicly available IP address data set from University of Michigan’s scans of internet IPv4 space, to determine the trade-offs among efficiency, privacy and accuracy of our implementation for varying numbers of parties and input sizes. Finally, we generalize our approach for the LogLog sketch and obtain a general framework for constructing multi-party differentially private protocols for several other sketching algorithms.

Keywords: differential privacy, sketching algorithms, secure computation

Copyright in PoPETs articles are held by their authors. This article is published under a Creative Commons Attribution-NonCommercial-NoDerivs license.