Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[INTEGRATION] dbt-dremio #2668

Closed
3 of 7 tasks
surisimran opened this issue May 6, 2024 · 2 comments · Fixed by #2671 or #2674
Closed
3 of 7 tasks

[INTEGRATION] dbt-dremio #2668

surisimran opened this issue May 6, 2024 · 2 comments · Fixed by #2671 or #2674
Labels
area:integration/dbt openlineage-dbt kind:feature A request or addition of new functionality

Comments

@surisimran
Copy link
Contributor

What is the target system?

dbt, new dialect dremio

What kind of integration is this?

  • Produces OpenLineage metadata
  • Consumes OpenLineage metadata
  • Something else

How should this integration be implemented?

Looks very similar to this dbt-sqlserver

Add DREMIO to common.provider.dbt.processor.Adapter(Enum)
Add logic to extract_namespace for dremio, for example f"dremio://{profile['host']}:{profile['port']}" base on a profile for dbt-dremio using server and not host

Where should this integration be implemented?

  • In the target system
  • In the OpenLineage repo
  • Somewhere else

Do you plan to make this contribution yourself?

  • I am interested in doing this work
Copy link

boring-cyborg bot commented May 6, 2024

Thanks for creating your first OpenLineage issue! Your feedback is valuable and improves the project. If you haven't already, please be sure to follow the issue template!

@surisimran
Copy link
Contributor Author

surisimran commented May 6, 2024

It's my first official github PR.
I hope I managed to follow the guidelines :)

@kacpermuda , @JDarDagran , @mobuchowski

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:integration/dbt openlineage-dbt kind:feature A request or addition of new functionality
Projects
None yet
2 participants