Code to reproduce experiments from the paper "Continual Pre-Training Mitigates Forgetting in Language and Vision" https://arxiv.org/abs/2205.09357
sentiment-analysis transformers image-classification pretrained-models self-supervised lifelong-learning continual-learning forgetting senteval qnli masked-language-models masked-image-modeling
-
Updated
Oct 23, 2023 - Jupyter Notebook