Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make the documentations for kedro-datasets work on kedro #2006

Merged
merged 26 commits into from
Nov 29, 2022
Merged
Show file tree
Hide file tree
Changes from 24 commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
0dce066
Update continue_config.yml
SajidAlamQB Nov 8, 2022
4fd40a8
Merge branch 'main' into test-dataset
SajidAlamQB Nov 9, 2022
6459c46
Update continue_config.yml
SajidAlamQB Nov 9, 2022
9f033b4
fix autosummary issues
SajidAlamQB Nov 10, 2022
4e89a54
Update conf.py
SajidAlamQB Nov 10, 2022
336d55f
Update continue_config.yml
SajidAlamQB Nov 10, 2022
75d35bf
Update continue_config.yml
SajidAlamQB Nov 10, 2022
cbf606d
Update conf.py
SajidAlamQB Nov 10, 2022
46c738b
Merge branch 'main' into test-dataset
SajidAlamQB Nov 14, 2022
117d690
Update continue_config.yml
SajidAlamQB Nov 14, 2022
c15dde6
Merge branch 'test-dataset' of https://github.com/kedro-org/kedro int…
SajidAlamQB Nov 14, 2022
b58118a
Create kedro.datasets.rst
SajidAlamQB Nov 14, 2022
2ef4480
Update conf.py
SajidAlamQB Nov 14, 2022
e023f6b
add kedro_dataset seperation to linkcheck
SajidAlamQB Nov 14, 2022
8b8c477
Update continue_config.yml
SajidAlamQB Nov 14, 2022
868f1d5
Merge branch 'main' into test-dataset
SajidAlamQB Nov 15, 2022
42ef54e
Merge branch 'main' into test-dataset
SajidAlamQB Nov 15, 2022
842c73a
Update continue_config.yml
SajidAlamQB Nov 15, 2022
9c8cd66
option 2 use .readthedocs.yml hook
SajidAlamQB Nov 23, 2022
cd62556
Merge branch 'main' into test-dataset
SajidAlamQB Nov 23, 2022
355026f
ci needs kedro-datasets installed
SajidAlamQB Nov 23, 2022
4ace601
Merge branch 'main' into test-dataset
SajidAlamQB Nov 24, 2022
d75a77d
Update .readthedocs.yml
SajidAlamQB Nov 24, 2022
663cc95
Merge branch 'test-dataset' of https://github.com/kedro-org/kedro int…
SajidAlamQB Nov 24, 2022
df5275f
Merge branch 'main' into test-dataset
SajidAlamQB Nov 29, 2022
0c66b86
Merge branch 'main' into test-dataset
SajidAlamQB Nov 29, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions .readthedocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -5,6 +5,15 @@
# Required
version: 2

# .readthedocs.yml hook to copy kedro-datasets to kedro.datasets before building the docs
build:
os: ubuntu-20.04
tools:
python: "3.7"
jobs:
post_checkout:
- bash docs/kedro-datasets-docs.sh

# Build documentation in the docs/ directory with Sphinx
sphinx:
builder: html
Expand Down
2 changes: 2 additions & 0 deletions docs/build-docs.sh
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,8 @@ rm -rf docs/build
mkdir docs/build/
cp -r docs/_templates docs/conf.py docs/*.svg docs/*.json docs/build/

bash docs/kedro-datasets-docs.sh

if [ "$action" == "linkcheck" ]; then
sphinx-build -c docs/ -ETan -j auto -D language=en -b linkcheck docs/build/ docs/build/html
elif [ "$action" == "docs" ]; then
Expand Down
2 changes: 2 additions & 0 deletions docs/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -140,6 +140,7 @@
"integer -- return number of occurrences of value",
"integer -- return first index of value.",
"kedro.extras.datasets.pandas.json_dataset.JSONDataSet",
"kedro.datasets.pandas.json_dataset.JSONDataSet",
"pluggy._manager.PluginManager",
"_DI",
"_DO",
Expand Down Expand Up @@ -333,6 +334,7 @@
"kedro.config",
"kedro.extras.datasets",
"kedro.extras.logging",
"kedro.datasets",
]


Expand Down
13 changes: 13 additions & 0 deletions docs/kedro-datasets-docs.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
#!/usr/bin/env bash
# Script to copy kedro-datasets to kedro.datasets before the documentation build for Kedro in ReadTheDocs.

# Exit script if you try to use an uninitialized variable.
set -o nounset

# Exit script if a statement returns a non-true return value.
set -o errexit

pip install kedro-datasets
pip install --no-deps -t kedro/to_delete kedro-datasets
mv kedro/to_delete/kedro_datasets kedro/datasets
rm -r kedro/to_delete
50 changes: 50 additions & 0 deletions docs/source/api_docs/kedro.datasets.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,50 @@
kedro.datasets
=====================

.. rubric:: Description

.. automodule:: kedro.datasets

.. rubric:: Classes

.. autosummary::
:toctree:
:template: autosummary/class.rst

kedro.datasets.api.APIDataSet
kedro.datasets.biosequence.BioSequenceDataSet
kedro.datasets.dask.ParquetDataSet
kedro.datasets.email.EmailMessageDataSet
kedro.datasets.geopandas.GeoJSONDataSet
kedro.datasets.holoviews.HoloviewsWriter
kedro.datasets.json.JSONDataSet
kedro.datasets.matplotlib.MatplotlibWriter
kedro.datasets.networkx.GMLDataSet
kedro.datasets.networkx.GraphMLDataSet
kedro.datasets.networkx.JSONDataSet
kedro.datasets.pandas.CSVDataSet
kedro.datasets.pandas.ExcelDataSet
kedro.datasets.pandas.FeatherDataSet
kedro.datasets.pandas.GBQQueryDataSet
kedro.datasets.pandas.GBQTableDataSet
kedro.datasets.pandas.GenericDataSet
kedro.datasets.pandas.HDFDataSet
kedro.datasets.pandas.JSONDataSet
kedro.datasets.pandas.ParquetDataSet
kedro.datasets.pandas.SQLQueryDataSet
kedro.datasets.pandas.SQLTableDataSet
kedro.datasets.pandas.XMLDataSet
kedro.datasets.pickle.PickleDataSet
kedro.datasets.pillow.ImageDataSet
kedro.datasets.plotly.JSONDataSet
kedro.datasets.plotly.PlotlyDataSet
kedro.datasets.redis.PickleDataSet
kedro.datasets.spark.DeltaTableDataSet
kedro.datasets.spark.SparkDataSet
kedro.datasets.spark.SparkHiveDataSet
kedro.datasets.spark.SparkJDBCDataSet
kedro.datasets.tensorflow.TensorFlowModelDataset
kedro.datasets.text.TextDataSet
kedro.datasets.tracking.JSONDataSet
kedro.datasets.tracking.MetricsDataSet
kedro.datasets.yaml.YAMLDataSet