GeoClip: Geometry-Aware Clipping for Differentially Private SGD

Differentially private stochastic gradient descent DP-SGD is the most widely used method for training machine learning models with provable privacy guarantees. A key challenge in DP-SGD is setting the per-sample gradient clipping threshold, which significantly affects the trade-off between privac...