Roadmap Stage 2: Code-aware experiments

[shaunc]

Stage 2: Code-aware experiments

Use dvc experiment tracking to keep track of different versions of a project. Use kedro hooks with trace to optionally skip steps.

• @mzip2 example skip hook but without trace.

Pipelines will have to be run in a number of different modes:

• Run everything, snapshot code dependencies
• Run as required, using code dependencies stored and/or dvc versions
• Run without trace for better performance

The intention is to use dvc to manage experiment versions. This may
require additional coupling between kedro runner and dvc; however,
by default we can use dvclive
where possible to encapsulate dvc.

[antonymilne]

Since you're using it on this repo, I wonder how pytest-watch works and whether some mechanism like that might be useful here 🤔 I don't know how capable it is of tracing at the granularity required (as opposed to just changed files) but at a glance it seems to use watchdog under the hood.

[shaunc]

Something like @watchdog is a good idea!