Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failure with source installations #3031

Closed
sayakpaul opened this issue Apr 15, 2024 · 14 comments
Closed

Failure with source installations #3031

sayakpaul opened this issue Apr 15, 2024 · 14 comments
Assignees
Labels
bug Something isn't working

Comments

@sayakpaul
Copy link

I am on my Apple M2 and uv-0.1.31.

Running: uv pip install -U peft@git+https://github.com/huggingface/peft.git.

It's failing with:

error: Failed to download and build: peft @ git+https://github.com/huggingface/peft.git
  Caused by: Git operation failed
  Caused by: no URL configured for submodule 'examples/boft_dreambooth/data/dreambooth'; class=Submodule (17)

Didn't happen last week.

FWIW, uv pip install -U transformers@git+https://github.com/huggingface/transformers.git doesn't fail.

@zanieb
Copy link
Member

zanieb commented Apr 15, 2024

Thanks for the report! Was it working with a previous version of uv or a different commit of the repository?

@sayakpaul
Copy link
Author

A different commit of the repository being used.

Was able to pin-point:

uv pip install -U peft@git+https://github.com/huggingface/peft.git@b0f1bb468ce58a26c1403db37e2ca8a76977b4c1

This works. Things break after: huggingface/peft#1326.

@zanieb
Copy link
Member

zanieb commented Apr 15, 2024

Thanks! I'll look into this

@zanieb zanieb self-assigned this Apr 15, 2024
@zanieb zanieb added the bug Something isn't working label Apr 15, 2024
@zanieb
Copy link
Member

zanieb commented Apr 15, 2024

Interesting I can't reproduce with a simple project

❯ cargo run -- pip install git+https://github.com/astral-test/uv-submodule-pypackage
    Finished dev [unoptimized + debuginfo] target(s) in 0.68s
     Running `target/debug/uv pip install 'git+https://github.com/astral-test/uv-submodule-pypackage'`
 Updated https://github.com/astral-test/uv-submodule-pypackage (d2c44b8)                                                     Resolved 1 package in 3ms
Installed 1 package in 3ms
 + uv-public-pypackage==0.1.0 (from git+https://github.com/astral-test/uv-submodule-pypackage@d2c44b87eef25896dd30a6e55d4689b918180c7b)

❯ cargo run -- pip install git+https://github.com/astral-test/uv-submodule-pypackage#subdirectory=submodule
    Finished dev [unoptimized + debuginfo] target(s) in 0.66s
     Running `target/debug/uv pip install 'git+https://github.com/astral-test/uv-submodule-pypackage#subdirectory=submodule'`
 Updated https://github.com/astral-test/uv-submodule-pypackage (d2c44b8)                                                     Resolved 1 package in 3ms
   Built uv-public-pypackage @ git+https://github.com/astral-test/uv-submodule-pypackage@d2c44b87eef25896dd30a6e55d4689b918180c7bDownloaded 1 package in 353ms
Installed 1 package in 1ms
 - uv-public-pypackage==0.1.0 (from git+https://github.com/astral-test/uv-submodule-pypackage@d2c44b87eef25896dd30a6e55d4689b918180c7b)
 + uv-public-pypackage==0.1.0 (from git+https://github.com/astral-test/uv-submodule-pypackage@d2c44b87eef25896dd30a6e55d4689b918180c7b#subdirectory=submodule)

@zanieb
Copy link
Member

zanieb commented Apr 15, 2024

This seems like something legitimately wrong with their submodule?

@sayakpaul
Copy link
Author

It works with regular pip, though.

@NeilGirdhar
Copy link

NeilGirdhar commented Apr 17, 2024

I'm getting the same problem:

uv pip install "git+https://github.com/gooogle/flax.git"
Updating https://github.com/gooogle/flax.git (HEAD)
Updating https://github.com/gooogle/flax.git (HEAD)
Updating https://github.com/gooogle/flax.git (HEAD)
Updating https://github.com/gooogle/flax.git (HEAD)                                                                                                                                       error: Git operation failed
  Caused by: failed to clone into: /Users/neil/Library/Caches/uv/git-v0/db/149b51fdacfaafab
  Caused by: process didn't exit successfully: `git fetch --force --update-head-ok 'https://github.com/gooogle/flax.git' '+HEAD:refs/remotes/origin/HEAD'` (exit status: 128)
--- stderr
remote: Repository not found.
fatal: Authentication failed for 'https://github.com/gooogle/flax.git/'

This works fine with normal pip.

@charliermarsh
Copy link
Member

I'll take a look.

@charliermarsh
Copy link
Member

@NeilGirdhar - I think you have a typo, three o's in Google.

@charliermarsh
Copy link
Member

Ok so I've confirmed that pip doesn't recursively clone the contents of examples/boft_dreambooth/data/dreambooth either (but they clearly don't error).

@zanieb
Copy link
Member

zanieb commented Apr 17, 2024

@charliermarsh I'm not sure what behavior is right here. I think we need to understand precisely what's wrong with that submodule setup to know if we should fail because of it or not.

Otherwise... you could install from git and be silently missing a meaningful part of the package.

@charliermarsh
Copy link
Member

Yeah I can just fix the repo itself if necessary.

@charliermarsh
Copy link
Member

I'll try now.

@charliermarsh
Copy link
Member

I think uv is correct to fail here. I've submitted a PR to peft to modify the repo setup: huggingface/peft#1660

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants