3.56.0

What's Changed

🚀 New Features and Enhancements

• Add option to show MD5 checksums in dvc ls by @petebachant in #10573
• ls: implement --tree to show as a tree and --level to limit depth for recursion by @skshetry in #10598

⚡ Optimizations

• add/commit: use hardlink to transfer files to the cache when cache.type is hardlink and on relink mode by @skshetry in #10557

🐛 Bug Fixes

• fix: directory creation on pulling data by @sssilvar in #10580
• bump scmrepo version by @shcheklein in #10570
• Update warning message gc.py by @5AIPAVAN in #10592

New Contributors

• @sssilvar made their first contribution in #10580
• @5AIPAVAN made their first contribution in #10592
• @petebachant made their first contribution in #10573

Full Changelog: 3.55.2...3.56.0

3.55.2

What's Changed

Other Changes

• dvcfs.get: simplify and separate files into respective filesystems while walking by @skshetry in #10544
• pyproject.toml: remove stale comment from dependency by @skshetry in #10546

Full Changelog: 3.55.1...3.55.2

3.55.1

What's Changed

Bugfixes

• dvcfilesystem.get: prefer downloading from repo.fs before dvc.fs by @skshetry in #10543

Full Changelog: 3.55.0...3.55.1

3.55.0

What's Changed

⚡ Optimizations

• dvcfs: optimize get() by reducing index.info calls() by @skshetry in #10540

🔨 Maintenance

• build(deps): bump mypy from 1.11.1 to 1.11.2 by @dependabot in #10539

Other Changes

• ci (bench): skip benchmark for test_import on versions >=3.53,<3.54.1 by @skshetry in #10535
• simplify running benchmarks by @skshetry in #10536
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #10541

Full Changelog: 3.54.1...3.55.0

3.54.1

What's Changed

Optimizations

• save import hash info to state by @dberenbaum in #10531

Bug fixes

• dependency/repo: do not suppress OSError on info() by @skshetry in #10533

Other Changes

• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #10532

Full Changelog: 3.54.0...3.54.1

3.54.0

What's Changed

⚡ Optimizations

• Improves performance of building objects, especially for directories with large no. of files by as much as 70% - 90%. This affects most of the commands. For example,

  • checkout dropped by as much as 80% (see #10491).
  • dvc add performance improved by more than 70%.

  See https://bench.dvc.org/latest.html for more.

• Avoids relinking on dvc add and dvc commit if possible (iterative/dvc-data#548)

• Improves performance for dvc diff rename detection (iterative/dvc-data#550).

• Reintroduces support for hashing files concurrently. This is only done for files larger than 1MB to avoid Python's thread overhead.

• Avoids stat calls (or, info() calls) during import-url and import. This is now done as part of walk().

3.53.2

What's Changed

🔨 Maintenance

• dvc dependency repo: Catch FileNotFoundError by @Honzys in #10501
• stabilize import db: remove experimental warning by @skshetry in #10510

Full Changelog: 3.53.1...3.53.2

3.53.1

What's Changed

Other Changes

• import_db: set dependency.is_in_repo to false by @skshetry in #10504

Full Changelog: 3.53.0...3.53.1

3.53.0

What's Changed

Other Changes

• Reimport checkout by @dberenbaum in #10388
• revert to --no-run-cache default for push/pull/fetch by @dberenbaum in #10494

Full Changelog: 3.52.0...3.53.0

3.52.0

What's Changed

Other Changes

• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #10487
• try force overwriting run cache entries on push by @dberenbaum in #10472

Full Changelog: 3.51.3...3.52.0