Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

helper script for fixing up repo size #30028

Merged
merged 3 commits into from
Dec 10, 2023
Merged

helper script for fixing up repo size #30028

merged 3 commits into from
Dec 10, 2023

Conversation

adeebshihadeh
Copy link
Contributor

@adeebshihadeh adeebshihadeh commented Sep 24, 2023

branch old size new size notes
master 337MB 337MB can rewrite the history
release2 100M 3MB >20K files moved to LFS
release3 145M 145M longer term project to move releases
devel 1.5G 120M full history moved to commaai/openpilot-releases

plus 240M of LFS objects currently on master

total: 2.0G -> 674M (measured with a local mirror clone, GitHub still needs to run git gc on their end)

Some considerations:

  • We should be careful with increasing our LFS usage after this to keep the repo small. git's partial clones seem like the way to go
    • LFS itself has been buggy for us in the past
    • the storage/bandwidth costs
    • forks can't really push to LFS without pushing to a new repo as if they weren't a fork
  • commit hashes from the original history will be broken

TODOs

Copy link
Contributor

This PR has had no activity for 30 days. It will be automatically closed in 7 days if there is no activity.

@github-actions github-actions bot added the stale label Nov 19, 2023
Copy link
Contributor

This PR has been automatically closed due to inactivity. Feel free to re-open once activity resumes.

@github-actions github-actions bot closed this Nov 27, 2023
@adeebshihadeh adeebshihadeh reopened this Nov 27, 2023
@github-actions github-actions bot removed the stale label Nov 28, 2023
@adeebshihadeh adeebshihadeh changed the title fix repo size helper script for fixing up repo size Dec 10, 2023
@adeebshihadeh adeebshihadeh marked this pull request as ready for review December 10, 2023 19:33
@adeebshihadeh adeebshihadeh merged commit f09ee08 into master Dec 10, 2023
22 of 23 checks passed
@adeebshihadeh adeebshihadeh deleted the small-repo branch December 10, 2023 19:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant