Diminishing Noise Maintains Differential Privacy and Enhances Convergence

Preprint available on OpenReview. This work studies diminishing noise schedules for differentially private optimization and their effect on convergence behavior.