Skip to content

Commit

Permalink
[SPARK-45648][INFRA] Add sql/api and common/utils to modules.py
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?
Add `sql/api` and `common/utils` to `modules.py`

### Why are the changes needed?
new modules should be covered in `modules.py`, otherwise related tests maybe wrongly skipped in some cases

### Does this PR introduce _any_ user-facing change?
no, infra-only

### How was this patch tested?
ci

### Was this patch authored or co-authored using generative AI tooling?
no

Closes #43501 from zhengruifeng/infra_sql_api.

Authored-by: Ruifeng Zheng <ruifengz@apache.org>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
  • Loading branch information
zhengruifeng authored and HyukjinKwon committed Oct 25, 2023
1 parent bb77f5d commit 093b7e1
Show file tree
Hide file tree
Showing 2 changed files with 19 additions and 3 deletions.
4 changes: 2 additions & 2 deletions .github/workflows/build_and_test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -141,11 +141,11 @@ jobs:
# Note that the modules below are from sparktestsupport/modules.py.
modules:
- >-
core, unsafe, kvstore, avro,
core, unsafe, kvstore, avro, utils,
network-common, network-shuffle, repl, launcher,
examples, sketch, graphx
- >-
catalyst, hive-thriftserver
api, catalyst, hive-thriftserver
- >-
mllib-local,mllib
- >-
Expand Down
18 changes: 17 additions & 1 deletion dev/sparktestsupport/modules.py
Original file line number Diff line number Diff line change
Expand Up @@ -157,6 +157,14 @@ def __hash__(self):
],
)

utils = Module(
name="utils",
dependencies=[tags],
source_file_regexes=[
"common/utils/",
],
)

launcher = Module(
name="launcher",
dependencies=[tags],
Expand All @@ -179,9 +187,17 @@ def __hash__(self):
],
)

api = Module(
name="api",
dependencies=[utils, unsafe],
source_file_regexes=[
"sql/api/",
],
)

catalyst = Module(
name="catalyst",
dependencies=[tags, core],
dependencies=[tags, core, api],
source_file_regexes=[
"sql/catalyst/",
],
Expand Down

0 comments on commit 093b7e1

Please sign in to comment.