Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dependencies installation from gitlab is super slow #8660

Open
dintores opened this issue Jul 8, 2021 · 2 comments
Open

Dependencies installation from gitlab is super slow #8660

dintores opened this issue Jul 8, 2021 · 2 comments

Comments

@dintores
Copy link

dintores commented Jul 8, 2021

Hello everyone!
I am using v1 yarn. I encountered a problem with installing dependencies that are pulled from the gitlab repo

Environment

@org/main - package.json

  • @org/libs
  • @org/utils
  • @org/service

@org/service - package.json

  • @org/libs
  • @org/utils
  • @org/adapter-1
  • @org/adapter-2
  • @org/adapter-3

@org/adapter-(1, 2, 3) - package.json

  • @org/libs
  • @org/utils

@org/libs - package.json

  • cronjs
  • natsjs
  • etc...

@org/utils - package.json

  • empty

All packages from @org are links in dependencies like this:

"@org/libs": "git+ssh://git@gitlab.com:org/libs.git#master"
These are private repositories in the gitlab perimeter. You cannot move them to private npm or gitlab packages.

Problem:

  1. Installing these dependencies takes up to 20-30 minutes.
  2. If you increase the number of adapters to 20, the installation takes more than 2 hours.
  3. Judging from the log with --verbose flag - for every package from org/adpater-2, it constantly requests @org/libs, @org/utils, even though it has already downloaded them in the first adapter.
  4. Package resolve is the longest operation, while the installation itself takes no more than 30 seconds.

Question:
How can I speed up the installation of packages? Please, let me know what additional info I should provide to identify and resolve the issue

@nahidakbar

This comment has been minimized.

@MatrixFrog
Copy link

I've been noticing a lot of slowness too. Do you already have caching of the node_modules folder turned on?

https://blog.nimbleways.com/let-s-make-faster-gitlab-ci-cd-pipelines/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants