CSE 472 Machine Learning term project NeurIPS: Machine Unlearning By Syed Jarullah Hisham (1805004) & Abdur Rafi (1805008). It was a competition hosted on Kaggle organized by Google. researchers.
With rapid growth of AI, more and more rules and regulations are being introduced concerning user privacy and security. These rules and regulations grant users with the right to be forgotten, leading to a new type of request - to delete information. Unfortunately, removing from the training dataset does not guarantee complete removal of the information of a user. Membership inference attack, model inversion attack can reveal information about specific contents of a training dataset from the trained model. Consequently, removing the influence of some data from the trained model, both completely and quickly has become a region of interest. The NeurIPS: Machine Unlearning competition, held in Kaggle, asks the competitors to perform this task.
We are given a bi-partition of the training set, where one is called the retain set and other is called the forget set. We are also given a trained model.
We have to modify the trained model in such way that the model, ideally, becomes identical to one that was trained only on the retain set. An image from the organizers pictorially describe this problem