GeoClip: Geometry-Aware Clipping for Differentially Private SGD

Differentially private stochastic gradient descent DP-SGD is the most widely used method for training machine learning models with provable privacy guarantees. A key challenge in DP-SGD is setting the per-sample gradient clipping threshold, which significantly affects the trade-off between privac...

Mitigating Disparate Impact of Differentially Private Learning through Bounded Adaptive Clipping

Differential privacy DP has become an essential framework for privacy-preserving machine learning. Existing DP learning methods, however, often have disparate impacts on model predictions, e.g., for minority groups. Gradient clipping, which is often used in DP learning, can suppress larger...