HeLayers: A Tile Tensors Framework for Large Neural Networks on Encrypted Data
Authors: Ehud Aharoni (IBM Research - Israel), Allon Adir (IBM Research - Israel), Moran Baruch (IBM Research - Israel and Bar Ilan University), Nir Drucker (IBM Research - Israel), Gilad Ezov (IBM Research - Israel), Ariel Farkash (IBM Research - Israel), Lev Greenberg (IBM Research - Israel), Ramy Masalha (IBM Research - Israel), Guy Moshkowich (IBM Research - Israel), Dov Murik (IBM Research - Israel), Hayim Shaul (IBM Research - Israel), Omri Soceanu (IBM Research - Israel)
Volume: 2023
Issue: 1
Pages: 325–342
DOI: https://doi.org/10.56553/popets-2023-0020
Abstract: Privacy-preserving solutions enable companies to offload confidential data to third-party services while fulfilling their government regulations. To accomplish this, they leverage various cryptographic techniques such as Homomorphic Encryption (HE), which allows performing computation on encrypted data. Most HE schemes work in a SIMD fashion, and the data packing method can dramatically affect the running time and memory costs. Finding a packing method that leads to an optimal performant implementation is a hard task. We present a simple and intuitive framework that abstracts the packing decision for the user. We explain its underlying data structures and optimizer, and propose a novel algorithm for performing 2D convolution operations. We used this framework to implement an inference operation over an encrypted HE-friendly AlexNet neural network with large inputs, which runs in around five minutes, several orders of magnitude faster than other state-of-the-art non-interactive HE solutions.
Keywords: homomorphic encryption, packing optimization, privacy preserving machine learning, neural networks, non-interactive homomorphic encryption, convolutional layers
Copyright in PoPETs articles are held by their authors. This article is published under a Creative Commons Attribution 4.0 license.
