Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add CI test for spark and distributed hive. #1705

Merged
merged 4 commits into from
Jan 9, 2024

Conversation

vegetableysm
Copy link
Collaborator

@vegetableysm vegetableysm commented Dec 29, 2023

What do these changes do?

Add ci test for spark and distributed hive.

Related issue number

N.B.: Spark and Hive get stuck when conducting distributed testing in different containers, whereas it does not happen when they are in the same container. There may be a configuration issue somewhere, so for now, we will temporarily put Spark and Hive together. This will not affect the test results (the vineyard server for communicating with the work node did receive requests to create and modify data).

Submitting the example program to yarn in the spark container worked fine.

Signed-off-by: vegetableysm <yuanshumin.ysm@alibaba-inc.com>
@vegetableysm vegetableysm force-pushed the java-ci branch 15 times, most recently from 3fa4a11 to 4d019c6 Compare January 3, 2024 01:55
Signed-off-by: vegetableysm <yuanshumin.ysm@alibaba-inc.com>
Signed-off-by: vegetableysm <yuanshumin.ysm@alibaba-inc.com>
Signed-off-by: vegetableysm <yuanshumin.ysm@alibaba-inc.com>
@vegetableysm vegetableysm changed the title [WIP] Add CI test for spark and distributed hive. Add CI test for spark and distributed hive. Jan 3, 2024
@sighingnow sighingnow merged commit 495c342 into v6d-io:main Jan 9, 2024
6 checks passed
@sighingnow sighingnow deleted the java-ci branch January 9, 2024 03:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants