Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kosmos-2.5 - Python version 3.10.x (and any other confirmed working versions) should be mentioned as a requirement to deploy & infer the Kosmos-2.5 model #1603

Open
abgulati opened this issue Jul 16, 2024 · 0 comments

Comments

@abgulati
Copy link

Describe the bug
Model I am using: Kosmos-2.5

The problem arises when using:

  • [ x ] the official example scripts: Using the exact required custom-libraries and dependencies to run the supplied inference.py script.

Description: Kosmos-2.5 seems to work only when using Python 3.10.x - This should be clarified in the requirements.

When trying to run the model with Python v3.11.5, I faced countless errors as detailed in issue #1596, that I previously created and subsequently self-closed purely for documentation's sake to help others facing similar issues.

To Reproduce
Steps to reproduce the behavior:

  1. Try running the supplied inference.py script with Python 3.11.x

Expected behavior
Python 3.10.x (and any other confirmed working Python versions) should be mentioned as a requirement to deploy & infer the Kosmos-2.5 model, or the model should work correctly with Python v3.11.x.

  • Platform: Native Windows 11 (OS Build 22631.3737) and WSL Ubuntu 22.04
  • Python version: v3.11.5
  • PyTorch version (GPU?): 2.5.0.dev20240626+cu124 for RTX 3090
  • Detailed system specs:
Intel Core i9 13900KF
Nvidia RTX 3090FE
32GB DDR5 5600MT/s (16x2)
Windows 11 - OS Build 22631.3737
CUDA 12.4

Flash-Attention-2 (v2.5.9.post1)
tiktoken 0.7.0
tqdm 4.66.4
omegaconf 2.0.6 (hydra-core 1.0.7)
boto3 1.34.140
iopath 0.1.10
fairscale 0.4.0
scipy 1.10.0
triton 2.3.1
https://github.com/facebookresearch/xformers.git@04de99bb28aa6de8d48fab3cdbbc9e3874c994b8
https://github.com/Dod-o/kosmos2.5_tools.git@fairseq
https://github.com/Dod-o/kosmos2.5_tools.git@infinibatch
https://github.com/Dod-o/kosmos2.5_tools.git@torchscale
https://github.com/Dod-o/kosmos2.5_tools.git@transformers
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant