Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Superset ingestion fails when Database Service Name is specified in configuration #16735

Open
razer-oliverq opened this issue Jun 20, 2024 · 0 comments · May be fixed by #16820
Open

Superset ingestion fails when Database Service Name is specified in configuration #16735

razer-oliverq opened this issue Jun 20, 2024 · 0 comments · May be fixed by #16820
Assignees
Labels
bug Something isn't working Ingestion

Comments

@razer-oliverq
Copy link

razer-oliverq commented Jun 20, 2024

Affected module
Superset Lineage with OM Database Service

Describe the bug

Superset metadata ingestion fails when Database Service Name is specified as per the documentation here:
https://docs.open-metadata.org/v1.4.x/connectors/dashboard/superset

To Reproduce

  1. Create database service of type Redshift or Postgres and ingest the metadata. In my case the databaseService name is bigdata-lakehouse.
  2. Create a dashboard service of type Superset and specify the databaseService name that was created in (1)
  3. Run the metadata ingestion for Superset.
  4. Superset dashboards, charts, and data models load as expected, including lineage between assets within Superset. But logs show error message regarding databaseService:
Error to yield dashboard lineage details for DB service name [bigdata-lakehouse]: 'Engine' object has no attribute 'fetch_datasource'

Traceback (most recent call last):
  File "/home/airflow/.local/lib/python3.10/site-packages/metadata/ingestion/source/dashboard/superset/mixin.py", line 185, in yield_dashboard_lineage_details
    datasource_json = self.client.fetch_datasource(
AttributeError: 'Engine' object has no attribute 'fetch_datasource'

Expected behavior

Lineage should be generated between the Superset models and the underlying tables in the specified databaseService.

Version:

  • OS: Linux 5.10.213-201.855.amzn2.x86_64 on EKS
  • OpenMetadata version: 1.4.1
  • OpenMetadata Ingestion package version: openmetadata-ingestion==1.4.1.0
  • Superset database type: Aurora Postgres 15.4
@OnkarVO7 OnkarVO7 added Ingestion bug Something isn't working labels Jun 20, 2024
@harshsoni2024 harshsoni2024 linked a pull request Jun 27, 2024 that will close this issue
9 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Ingestion
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants