Privacy Preserving Machine Learning πŸ”

Part 1 of a technical series examining membership, property, and model-inversion attacks alongside modern privacy-preserving ML defenses.

Privacy-Preserving ML Federated Learning Inference Attacks

Lately, I’ve been working on #PrivacyPreservingML πŸ” I got looped in some projects after Apple launched AppTrackingTransparency (ATT) framework, requiring iOS apps to ask permission to share users’ data w/ 3rd parties. This has triggered an industry-wide discussion on best practices to respect user privacy.

ML models are as good as the data we feed them 🍣 In the online world, it's tempting to use data from a user's each & every move by sharing info across companies to make the models smarter -- in the guise of β€˜serving the users better’. #DataCentricAI

But the use of every data point w/o protecting it has led to cyber attacks, reverse engineering, and violations of sensitive data like personal conversations, financial transactions, medical history, etc. This is where #PrivacyPreservingML comes into play!


To put it simply:

Privacy-Preserving ML = Data Privacy + Model Privacy


Data Privacy = Using authorized data + not exposing training data & its source + protecting input & output data. Check out this β€œsecret sharer” paper -- certain sequences (for eg. credit card numbers, SSN) can be unintentionally memorized!

Model Privacy = Protect the model and its nuances (aka parameters) from the public eye. Apart from Intellectual Property loss, using it to reverse engineer inputs from the outputs can prove to be a dangerous problem in many sensitive situations.

There are many methods to ensure that the data cannot be stolen by a third party or how to ensure model privacy. Might come back to these #PrivacyPreservingML techniques some other time, until then CIAO πŸ‘‹πŸ»

On that note, if you are someone who is still getting started on #DataForML and need a boost to your #MachineLearning dataset building skills using #Python and all things #OpenSource! Check out @DataForML on @amazon πŸ›’


Continue Reading
Jun 2023

Technical breakdown of generative synthetic media, deepfake synthesis architectures, detection limits, and organizational provenance defenses.

Responsible AI & Privacy
Jul 2022

Mathematical intuition and engineering trade-offs behind epsilon-differential privacy, calibrated noise injection, and privacy budgets in ML.

Responsible AI & Privacy
Nov 2026

Catching silent CPU fallbacks, hidden Hugging Face host syncs, and XLA recompiles in PyTorch on Cloud TPU v6eβ€”cutting LoRA step time 2,537Γ— (47.3s β†’ 18.6ms) alongside upstream PRs to transformers & peft.

Fine-Tuning & Compute