dbt - generate _sources.yml from recipe.yml #697
fvankrieken
started this conversation in
Ideas
Replies: 1 comment
-
Also, made a |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Was going to create an issue, but remembered "discussions" exist, and this seemed like a better spot for it!
Basically, while updating sources.yml for gft, I thought that it felt a bit too redundant with the recipe file - we already list all sources there. So why not only have one source of truth for imported data sources?
We'd need to brainstorm a little bit about what we'd want this to look like, but in some ways it'd be nice to just include source validation in a recipe, rather than having to define each source dataset a second time in _sources.yml. Curious to know others thoughts, both on the merits of the idea and potential specifics around implementation (for constraints, do we just use dbt syntax? Do we have "constraint defaults" in recipe, that get applied to all sources? Do we check in _sources.yml, or is it just created ephemerally for builds? etc)
Beta Was this translation helpful? Give feedback.
All reactions