feat(dev): 1.3 #4849

frostming · 2024-07-11T01:34:20Z

What does this PR address?

Fixes #(issue)

Before submitting:

Does the Pull Request follow Conventional Commits specification naming? Here are GitHub's
guide on how to create a pull request.
Does the code follow BentoML's code style, pre-commit run -a script has passed (instructions)?
Did you read through contribution guidelines and follow development guidelines?
Did your changes require updates to the documentation? Have you updated
those accordingly? Here are documentation guidelines and tips on writting docs.
Did you write tests to cover your changes?

* fix: add secrets management command * chore: add file type secret * chore: update command help text * chore: add deployment option secret * fix: add delete command * chore: add secret Apply command * chore: update mountAs * chore: update import * chore: update secret api route

* feat: support adding response background tasks via bentoml.Context Signed-off-by: Frost Ming <me@frostming.com> * fix: remove init Signed-off-by: Frost Ming <me@frostming.com> * fix: reorganize Signed-off-by: Frost Ming <me@frostming.com> * fix: cancel the timeout check at the first send Signed-off-by: Frost Ming <me@frostming.com> * feat: async task and result Signed-off-by: Frost Ming <me@frostming.com> * feat: new route and openapi schema Signed-off-by: Frost Ming <me@frostming.com> * feat: retry endpoint Signed-off-by: Frost Ming <me@frostming.com> * feat: impl client async endpoints and results Signed-off-by: Frost Ming <me@frostming.com> * fix: test client Signed-off-by: Frost Ming <me@frostming.com> * fix: rename is_async to is_task Signed-off-by: Frost Ming <me@frostming.com> * fix: add timestamp Signed-off-by: Frost Ming <me@frostming.com> --------- Signed-off-by: Frost Ming <me@frostming.com>

Signed-off-by: Frost Ming <me@frostming.com>

* feat: support adding response background tasks via bentoml.Context (#4754) * feat: add secret management commands (#4764) * fix: add secrets management command * chore: add file type secret * chore: update command help text * chore: add deployment option secret * fix: add delete command * chore: add secret Apply command * chore: update mountAs * chore: update import * chore: update secret api route * feat: get_service api for selected frameworks Signed-off-by: Frost Ming <me@frostming.com> * fix: framework importer Signed-off-by: Frost Ming <me@frostming.com> * fix: typing import Signed-off-by: Frost Ming <me@frostming.com> * fix: deduplicate finder Signed-off-by: Frost Ming <me@frostming.com> * doc: update docs Signed-off-by: Frost Ming <me@frostming.com> * fix tests Signed-off-by: Frost Ming <me@frostming.com> * fix tests Signed-off-by: Frost Ming <me@frostming.com> * fix tests Signed-off-by: Frost Ming <me@frostming.com> * fix: tests for get_service Signed-off-by: Frost Ming <me@frostming.com> * fix: install dependencies Signed-off-by: Frost Ming <me@frostming.com> * fix: show dependency tree Signed-off-by: Frost Ming <me@frostming.com> * fix: upgrade tensorflow Signed-off-by: Frost Ming <me@frostming.com> * fix: dependencies Signed-off-by: Frost Ming <me@frostming.com> * fix: catboost test Signed-off-by: Frost Ming <me@frostming.com> * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci --------- Signed-off-by: Frost Ming <me@frostming.com> Co-authored-by: xianxian.zhang <141706136+xianml@users.noreply.github.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* chore: support cli auto login * feat: add auth server * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * chore: fix by comments * chore: encode uri * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * chore: add cors * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * chore: clean unused code * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * chore: clean unused code --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

…t is not passed (#4828)

* feat: switch to uv Signed-off-by: Frost Ming <me@frostming.com>

Add auto cli login docs Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

Fix typo and format Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

* fix(cli): hanging issue when deployment ready Signed-off-by: Frost Ming <me@frostming.com>

* fix(deployement-client): add build process and extend url * chore: mute if not using cli * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Frost Ming <me@frostming.com> Signed-off-by: Frost Ming <me@frostming.com>

Update vllm.rst

* Add custom models use case doc Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci * Update examples/xgboost/save_model.py Co-authored-by: Frost Ming <mianghong@gmail.com> * Update examples/mlflow/save_model.py --------- Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Frost Ming <mianghong@gmail.com> Signed-off-by: Frost Ming <me@frostming.com>

Reorg blip doc to multimodality section Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

…4820) * fix: inject prometheus multiproc_dir into env var when worker starts Signed-off-by: Frost Ming <me@frostming.com> * fix: remove unneeded tests Signed-off-by: Frost Ming <me@frostming.com> * fix: tests Signed-off-by: Frost Ming <me@frostming.com> * fix: replace bentoml.metrics with prometheus_client Signed-off-by: Frost Ming <me@frostming.com> --------- Signed-off-by: Frost Ming <me@frostming.com>

* Add logging and tracing docs Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * Fix format * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci --------- Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* feat: --label option for bentoml build Signed-off-by: Frost Ming <me@frostming.com>

* Update the concurrency doc Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * Update descriptions Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> --------- Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

Update services.rst In the Python classes I changed the reference to the class to `self` from `this`. `this` is not a keyword in Python

Update concurrency links Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

Fix broken link Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

updates: - [github.com/astral-sh/ruff-pre-commit: v0.4.7 → v0.5.0](astral-sh/ruff-pre-commit@v0.4.7...v0.5.0) - [github.com/pdm-project/pdm: 2.15.4 → 2.16.1](pdm-project/pdm@2.15.4...2.16.1) - [github.com/bufbuild/buf: v1.32.2 → v1.34.0](bufbuild/buf@v1.32.2...v1.34.0) Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

Fix typo and format Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> Signed-off-by: Frost Ming <me@frostming.com>

Signed-off-by: Frost Ming <me@frostming.com>

* Add azure byoc step doc Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * Fix space Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci --------- Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

Update the BYOC architecture image Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

Signed-off-by: Frost Ming <me@frostming.com>

* fix: options are not required * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

Signed-off-by: Frost Ming <me@frostming.com>

…ge build done (#4867) Signed-off-by: Frost Ming <me@frostming.com>

Signed-off-by: Frost Ming <me@frostming.com>

frostming and others added 15 commits June 20, 2024 15:17

feat: support adding response background tasks via bentoml.Context (#…

3564654

…4754)

feat: external_queue default to 1 when using tasks

ea045f0

Signed-off-by: Frost Ming <me@frostming.com>

feat: use rich.print to replace click.echo (#4827)

0ea601a

chore: update print and fix cors error (#4829)

03fcd24

feat: login to current context instead of default context if --contex…

c9b89c7

…t is not passed (#4828)

feat: switch to uv as the resolver and installer (#4822)

8de2381

* feat: switch to uv Signed-off-by: Frost Ming <me@frostming.com>

feat: Officially support Python 3.12 (#4830)

f9723b0

Docs: Add auto cli login docs (#4844)

1366cc5

Add auto cli login docs Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

doc: Fix typo and format (#4821)

a26f3d8

Fix typo and format Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

fix(cli): hanging issue when deployment ready (#4825)

329d5a9

* fix(cli): hanging issue when deployment ready Signed-off-by: Frost Ming <me@frostming.com>

frostming requested a review from a team as a code owner July 11, 2024 01:34

frostming requested review from jianshen92 and removed request for a team July 11, 2024 01:34

Sherlock113 and others added 12 commits July 11, 2024 09:34

doc: Update vllm.rst (#4824)

25f463c

Update vllm.rst

docs: Reorg blip doc to multimodality section (#4826)

2c201d6

Reorg blip doc to multimodality section Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

feat: --label option for bentoml build (#4832)

8334e2c

* feat: --label option for bentoml build Signed-off-by: Frost Ming <me@frostming.com>

docs: Update the concurrency doc (#4834)

31de028

* Update the concurrency doc Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> * Update descriptions Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> --------- Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

docs: Update services.rst (#4837)

1ab336c

Update services.rst In the Python classes I changed the reference to the class to `self` from `this`. `this` is not a keyword in Python

docs: Update concurrency links (#4840)

8d08735

Update concurrency links Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

docs: Fix broken link (#4841)

61af448

Fix broken link Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

doc: Fix typo and format (#4821)

156d27c

Fix typo and format Signed-off-by: Sherlock113 <sherlockxu07@gmail.com> Signed-off-by: Frost Ming <me@frostming.com>

frostming and others added 7 commits July 11, 2024 09:44

fix: stop spinner before starting to stream logs (#4846)

e933243

Signed-off-by: Frost Ming <me@frostming.com>

Update azure.rst

619030d

docs: Update the BYOC architecture image (#4848)

42a95ea

Update the BYOC architecture image Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

Merge branch 'main' into dev/1.3

f71439a

update lock file

7dd9d6b

Signed-off-by: Frost Ming <me@frostming.com>

feat: retry and cancel task (#4852)

fc30ed2

aarnphm changed the title ~~Development branch for 1.3~~ feat(dev): 1.3 Jul 12, 2024

Merge branch 'main' into dev/1.3

d80af26

Signed-off-by: Frost Ming <me@frostming.com>

frostming force-pushed the dev/1.3 branch from f8062ef to d80af26 Compare July 12, 2024 10:20

xianml and others added 3 commits July 16, 2024 13:02

fix: options are not required (#4861)

27ddfa3

* fix: options are not required * ci: auto fixes from pre-commit.ci For more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

fix: don't fail when image pod is not found (#4862)

2df8f44

fix: async task response deserialization crash (#4865)

4c41872

frostming requested review from bojiang and aarnphm and removed request for jianshen92 July 18, 2024 03:15

frostming and others added 5 commits July 18, 2024 12:30

fix: raise deploy timeout to 1hr

b1b2006

Signed-off-by: Frost Ming <me@frostming.com>

fix: remove references to yatai from cli help

ab4250d

Signed-off-by: Frost Ming <me@frostming.com>

feat: change spinner text on status change and show spinner after ima…

694a5f2

…ge build done (#4867) Signed-off-by: Frost Ming <me@frostming.com>

fix: do not raise deployment pods not found error (#4868)

b25124f

fix: console print

8841072

Signed-off-by: Frost Ming <me@frostming.com>

xianml approved these changes Jul 18, 2024

View reviewed changes

frostming merged commit b11cdbf into main Jul 18, 2024
50 of 53 checks passed

frostming deleted the dev/1.3 branch July 18, 2024 08:04

aarnphm mentioned this pull request Aug 27, 2024

chore(container): install uv directly to container #4941

Open

5 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(dev): 1.3 #4849

feat(dev): 1.3 #4849

frostming commented Jul 11, 2024

feat(dev): 1.3 #4849

feat(dev): 1.3 #4849

Conversation

frostming commented Jul 11, 2024

What does this PR address?

Before submitting: