Skip to content

Commit

Permalink
[SPARK-49182][DOCS][PYTHON] Stop publish site/docs/{version}/api/pyth…
Browse files Browse the repository at this point in the history
…on/_sources dir

Remove dangling links like:
https://spark.apache.org/docs/3.5.1/api/python/_sources/user_guide/sql/index.rst.txt

reduce the size of documentation publication

```
$ du -h 3.5.1/api/python/_sources
 68K	3.5.1/api/python/_sources/development
148K	3.5.1/api/python/_sources/user_guide/pandas_on_spark
 40K	3.5.1/api/python/_sources/user_guide/sql
208K	3.5.1/api/python/_sources/user_guide
 20K	3.5.1/api/python/_sources/migration_guide
2.9M	3.5.1/api/python/_sources/reference/pyspark.sql/api
3.0M	3.5.1/api/python/_sources/reference/pyspark.sql
180K	3.5.1/api/python/_sources/reference/pyspark.ss/api
196K	3.5.1/api/python/_sources/reference/pyspark.ss
2.5M	3.5.1/api/python/_sources/reference/api
3.0M	3.5.1/api/python/_sources/reference/pyspark.pandas/api
3.1M	3.5.1/api/python/_sources/reference/pyspark.pandas
8.8M	3.5.1/api/python/_sources/reference
4.1M	3.5.1/api/python/_sources/getting_started
 13M	3.5.1/api/python/_sources
```

NO

build locally

```
ls api/python
_images         _static         getting_started migration_guide reference       searchindex.js
_modules        development     index.html      objects.inv     search.html     user_guide
```

NO

Closes apache#47686 from yaooqinn/SPARK-49182.

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit eb859de)
Signed-off-by: Kent Yao <yao@apache.org>
  • Loading branch information
yaooqinn authored and dongjoon-hyun committed Aug 15, 2024
1 parent 3c756c4 commit d45f4fd
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions docs/_plugins/copy_api_dirs.rb
Original file line number Diff line number Diff line change
Expand Up @@ -136,6 +136,7 @@
mkdir_p "api/python"

puts "cp -r ../python/docs/build/html/. api/python"
rm_r("../python/docs/build/html/_sources")
cp_r("../python/docs/build/html/.", "api/python")
end

Expand Down

0 comments on commit d45f4fd

Please sign in to comment.