Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[improve] Optimize MLFlow task plugin for easy of use #12071

Merged
merged 1 commit into from
Sep 21, 2022

Conversation

jieguangzhou
Copy link
Member

@jieguangzhou jieguangzhou commented Sep 20, 2022

Purpose of the pull request

close: #12070

  • Support for modifying the dolphinscheduler-mlflow repository
    We can modify the repository address to the local path if we can not access git
  • Remove deploy with docker compose, keep deploy with Docker
    docker compose and DOCKER of MLflow models are highly similar, keep the delicate one
  • Optimize doc
  • Optimize UI

Brief change log

Verify this pull request

This pull request is code cleanup without any test coverage.

(or)

This pull request is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(or)

@jieguangzhou jieguangzhou changed the title optimize mlflow [Improvement][Task Plugin] Optimize MLFlow task plugin for ease of use Sep 20, 2022
@github-actions github-actions bot added backend document Python UI ui and front end related labels Sep 20, 2022
@SbloodyS SbloodyS added this to the 3.1.0 milestone Sep 21, 2022
optimize code
@codecov-commenter
Copy link

codecov-commenter commented Sep 21, 2022

Codecov Report

Merging #12071 (d94b757) into dev (8cddb10) will decrease coverage by 0.10%.
The diff coverage is 82.69%.

@@             Coverage Diff              @@
##                dev   #12071      +/-   ##
============================================
- Coverage     38.65%   38.55%   -0.11%     
- Complexity     4005     4007       +2     
============================================
  Files          1002     1004       +2     
  Lines         37213    37390     +177     
  Branches       4249     4263      +14     
============================================
+ Hits          14386    14415      +29     
- Misses        21195    21329     +134     
- Partials       1632     1646      +14     
Impacted Files Coverage Δ
...nscheduler/plugin/task/mlflow/MlflowConstants.java 0.00% <ø> (ø)
...scheduler/plugin/task/mlflow/MlflowParameters.java 18.18% <36.36%> (-56.05%) ⬇️
...olphinscheduler/plugin/task/mlflow/MlflowTask.java 59.48% <95.12%> (+3.00%) ⬆️
...heduler/plugin/task/jupyter/JupyterParameters.java 0.00% <0.00%> (-33.34%) ⬇️
...hinscheduler/plugin/alert/script/ScriptSender.java 53.33% <0.00%> (-7.28%) ⬇️
...phinscheduler/plugin/task/jupyter/JupyterTask.java 62.85% <0.00%> (-0.61%) ⬇️
.../org/apache/dolphinscheduler/common/Constants.java 78.26% <0.00%> (ø)
...ache/dolphinscheduler/spi/enums/ResUploadType.java 0.00% <0.00%> (ø)
... and 12 more

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@sonarcloud
Copy link

sonarcloud bot commented Sep 21, 2022

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 8 Code Smells

80.6% 80.6% Coverage
0.0% 0.0% Duplication

Copy link
Member

@zhongjiajie zhongjiajie left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM overall

Copy link
Contributor

@caishunfeng caishunfeng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM of the backend part

Copy link
Contributor

@devosend devosend left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Member

@Amy0104 Amy0104 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The front end part LGTM.

@zhongjiajie zhongjiajie merged commit cf522e2 into apache:dev Sep 21, 2022
@zhongjiajie zhongjiajie changed the title [Improvement][Task Plugin] Optimize MLFlow task plugin for ease of use [improve] Optimize MLFlow task plugin for easy of use Sep 21, 2022
jieguangzhou added a commit to jieguangzhou/dolphinscheduler that referenced this pull request Sep 21, 2022
zhongjiajie pushed a commit that referenced this pull request Sep 21, 2022
@caishunfeng caishunfeng added the release cherry-pick Mark this issue/PR had cherry-pick for release version label Sep 22, 2022
xdu-chenrj pushed a commit to xdu-chenrj/dolphinscheduler that referenced this pull request Oct 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend document Python release cherry-pick Mark this issue/PR had cherry-pick for release version UI ui and front end related
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Improvement][Task Plugin] Optimize MLFlow task plugin for ease of use
8 participants