Kbit_device_map import error. DPO

[sankydesai]

from trl import get_kbit_device_map

ImportError Traceback (most recent call last)
in <cell line: 1>()
----> 1 from trl import get_kbit_device_map

ImportError: cannot import name 'get_kbit_device_map' from 'trl' (/usr/local/lib/python3.10/dist-packages/trl/init.py)

Also Tried from trl.trainer.utils
Still Got:

ImportError
Traceback (most recent call last)

----> 1 from trl.trainer.utils import get_kbit_device_map

ImportError: cannot import name 'get_kbit_device_map' from 'trl.trainer.utils' (/usr/local/lib/python3.10/dist-packages/trl/trainer/utils.py)

[younesbelkada]

hi @sankydesai
Can you update TRL? pip install -U trl and let me know if you still face the issue

[sankydesai]

Nope. The issue is very simple. I went to colab, did pip install -U trl and then imported from trl import get_kbit_device_map. It fails. Please check.

[younesbelkada]

Hi @sankydesai
Sorry for the confusion, as #1176 is not included in the pypi release, you need to install TRL from source

pip install -U git+https://github.com/huggingface/trl

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

[younesbelkada]

closing as we made a recent release