Skip to content

Commit

Permalink
perf(datasets): lazily load datasets in init files (dask)
Browse files Browse the repository at this point in the history
Signed-off-by: Deepyaman Datta <deepyaman.datta@utexas.edu>
  • Loading branch information
deepyaman committed Jul 24, 2023
1 parent 7d22db1 commit eaac498
Showing 1 changed file with 7 additions and 4 deletions.
11 changes: 7 additions & 4 deletions kedro-datasets/kedro_datasets/dask/__init__.py
Original file line number Diff line number Diff line change
@@ -1,8 +1,11 @@
"""Provides I/O modules using dask dataframe."""
from typing import Any

__all__ = ["ParquetDataSet"]
import lazy_loader as lazy

from contextlib import suppress
# https://github.com/pylint-dev/pylint/issues/4300#issuecomment-1043601901
ParquetDataSet: Any

with suppress(ImportError):
from .parquet_dataset import ParquetDataSet
__getattr__, __dir__, __all__ = lazy.attach(
__name__, submod_attrs={"parquet_dataset": ["ParquetDataSet"]}
)

0 comments on commit eaac498

Please sign in to comment.