Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support meta-data in the models #2111

Closed
philippe-lavoie opened this issue Feb 10, 2020 · 2 comments
Closed

support meta-data in the models #2111

philippe-lavoie opened this issue Feb 10, 2020 · 2 comments
Labels
enhancement New feature or request

Comments

@philippe-lavoie
Copy link

Describe the feature

Add a metadata property to models for the columns or tables. That property just allows any data inside it and can then be ignored by DBT.

Describe alternatives you've considered

Add a file next to the model to map meta-data to column/table (very messy and hard to read)

Additional context

I'm using a tool to auto-generate models. It's not the best approach, but I typically get involved after a DB was in production for a couple of years. Part of that is making sure that PII information
is properly tracked. When we do analysis, I want to make sure that aggregate views about
customers are available to some users. However, to know that they only see aggregate of PII information, I have to know what is PII or not. The current approach of tagging only works at the table level.

Additionaly, I'd like to keep track of other metadata about the data without breaking DBT.

Who will this benefit?

Me.... or other people that want extra information about their data. Ideally, that extra information could be shown in the documentation generated.

@philippe-lavoie philippe-lavoie added enhancement New feature or request triage labels Feb 10, 2020
@beckjake
Copy link
Contributor

@philippe-lavoie have you seen #2015 ? Does that suit your needs? It'll be in the next minor version of dbt, v0.16.0.

@philippe-lavoie
Copy link
Author

It does, awesome.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants