Skip to content
/ neat Public

Code for paper [Neat: Nonlinear Parameter-efficient Adaptation of Pre-trained Models]

Notifications You must be signed in to change notification settings

yibozhong/neat

Repository files navigation

Neat 🧼

Nonlinear Parameter-efficient Adaptation of Pre-trained Models

method

TL;DR: NEAT is a novel PEFT method that uses a lightweight neural network to directly model cumulative weight updates for adaptation targets and capture intricate and non-coherent structures.

The experiment setups are located in each subfolder.

About

Code for paper [Neat: Nonlinear Parameter-efficient Adaptation of Pre-trained Models]

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published