Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: defer to prod #1838

Open
AntoineGiraudKeyrus opened this issue Sep 11, 2024 · 1 comment
Open

feat: defer to prod #1838

AntoineGiraudKeyrus opened this issue Sep 11, 2024 · 1 comment

Comments

@AntoineGiraudKeyrus
Copy link

AntoineGiraudKeyrus commented Sep 11, 2024

Hi,

Could dataform add a defer to prod option ?
i'd help to init our dev env' without having to clone/recreate all our parents tables when editing 1 child table !

resolving in compute, storage & time savings while developping

I'd help us a lot @Homeserve 👷‍♂️

DBT equivalent 🙏
image

@AntoineGiraud
Copy link

AntoineGiraud commented Sep 12, 2024

from GCP's dataform issue #366123439

How this might work:

  • dataform's GCP UI : toggle option to choose for "prod" database for deferal in dev environements
  • dataforms's CLI : dataform run --actions ventes+ achats+ --defer prod_profile

If applicable, reasons why alternative solutions are not sufficient:

Without defer to prod here are the options :

  • rebuild ALL parent tables -> storage & compute costs $$
  • clone all parents schemas & tables as views -> ~5min init for 360 tables in 3 schemas
    create view xxx-dev.xxx.xxx as select * from xxx.xxx.xxx

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants