v1.2.19

What's Changed

• docs: Update diffusion model repos to the new one by @Sherlock113 in #4797
• feat(monitoring): support GRPC LogExporter by @judahrand in #4808
• docs: Add Docker deployment for Bentos by @Sherlock113 in #4812
• docs: update examples service decorators with new features by @ssheng in #4798
• doc: Custom Error Handling by @jianshen92 in #4811
• doc: Wording change in error handling doc by @Sherlock113 in #4813
• fix: ASCII animation was not working properly in the image builder logs by @yetone in #4810
• fix: avoid editing list in during iteration by @judahrand in #4809
• docs: Add secrets doc by @Sherlock113 in #4814
• fix: improve the code of spinner and log tailer by @frostming in #4815
• doc: Update the docs about multipart output by @frostming in #4818
• docs: Add batch inference jobs doc by @Sherlock113 in #4816
• doc: Fix typo and format by @Sherlock113 in #4821
• fix(cli): hanging issue when deployment ready by @frostming in #4825
• fix(deployment-client): add build process and extend url by @Haivilo in #4790
• doc: Update vllm.rst by @Sherlock113 in #4824
• docs: Add custom models use case doc by @Sherlock113 in #4819
• docs: Reorg blip doc to multimodality section by @Sherlock113 in #4826
• fix: inject prometheus multiproc_dir into env var when worker starts by @frostming in #4820

Full Changelog: v1.2.18...v1.2.19

v1.2.18

What's Changed

• docs: scale from zero by @ssheng in #4769
• ci: pre-commit autoupdate [skip ci] by @pre-commit-ci in #4772
• docs: Update installation.rst by @parano in #4763
• docs: Add chatTTS to example project list by @Sherlock113 in #4777
• fix: bad performance when walking the file tree and check includes by @frostming in #4778
• update readme to include chattts by @ssheng in #4786
• docs: Update README.md by @parano in #4785
• Fixed FileExistsError: [Errno 17] File exists: '/root/bentoml' by @tripathiarpan20 in #4781
• fix: set env to null if it is empty for merge override by @FogDong in #4783
• fix: add none check for env for deploy by @FogDong in #4792
• fix(pandas): use correct mime type for Parquet by @judahrand in #4780
• fix: add memoization to pkg_version_info to reduce cpu overhead by @adrianlyjak in #4794
• fix: bug: memory leak when using bentoml>=1.2 by @frostming in #4775
• fix: honor host and port config in service decorator by @frostming in #4776
• fix(pandas): Annotated[pd.DataFrame, DataframeSchema(columns=["a"])] output spec by @judahrand in #4799
• fix: ensure relative path works within bento project by @aarnphm in #4803
• fix: map error responses from HTTP client to bentoml exceptions by @frostming in #4804
• fix(numpy): numpy annotation processing by @judahrand in #4795
• fix: populate bento name and version of server context by @frostming in #4787
• fix(cloud-client): consider httpcore timeout when getting status by @Haivilo in #4740
• fix: cd into src instead of bento parent by @frostming in #4805
• feat: show image builder logs by @yetone in #4796

New Contributors

• @tripathiarpan20 made their first contribution in #4781
• @adrianlyjak made their first contribution in #4794

Full Changelog: v1.2.17...v1.2.18

v1.2.17

What's Changed

• docs: update model store by @ssheng in #4741
• docs: Add env var for mistral 7b docs by @Sherlock113 in #4747
• refactor(tests): testing.util.async_request to client.AsyncHTTPClient by @sanspareilsmyn in #4746
• docs: Update GitHub readme by @Sherlock113 in #4749
• chore(build): update build_config.py by @eltociear in #4751
• docs: Add git package packing doc by @Sherlock113 in #4750
• fix: configure server logging before importing service by @frostming in #4744
• docs: Add user roles docs by @Sherlock113 in #4724
• feat(batching): break batch into smaller partitions if it's larger than max batch size by @frostming in #4752
• docs: Update the examples folder readme by @Sherlock113 in #4748
• docs: Add byoc setup docs by @Sherlock113 in #4757
• fix: new sdk e2e test by @xianml in #4758
• fix: metrics did not include 4xx by @xianml in #4756
• fix: should enable existing loggers in server logging config by @rickzx in #4759
• fix: client response deserialization when the output is string by @frostming in #4762
• fix: middleware reorder by @xianml in #4761
• fix: log errors inside a streaming response and detect service name conflicts by @frostming in #4767
• fix: don't try to validate non-bytes as Path by @frostming in #4765

New Contributors

• @sanspareilsmyn made their first contribution in #4746
• @eltociear made their first contribution in #4751
• @rickzx made their first contribution in #4759

Full Changelog: v1.2.16...v1.2.17

v1.2.16

What's Changed

• fix(build): make sure to parse pip_args in correct order by @aarnphm in #4722
• docs: Add compound data types doc by @Sherlock113 in #4721
• docs: Add docs for installing GitHub packages for Bento by @Sherlock113 in #4720
• docs: Update deployment details explanations by @Sherlock113 in #4726
• fix: load model aliases before loading new SDK service by @frostming in #4727
• docs: Fix cpu as strings by @Sherlock113 in #4735
• docs: Update the services doc by @Sherlock113 in #4734
• feat: add trace id to monitoring module by @jianshen92 in #4732
• feat: add a switch to opt-out packing git packages by @frostming in #4729
• fix: missing components from output schema if it is a root model by @frostming in #4733
• feat: expose the service url as a property by @frostming in #4730
• fix(container): preheat packages support markers by @bojiang in #4737

Full Changelog: v1.2.15...v1.2.16

v1.2.15

What's Changed

• fix: handle subdirectory in git ssh url by @frostming in #4719

Full Changelog: v1.2.14...v1.2.15

v1.2.14

What's Changed

• fix: add scaled to zero in client by @FogDong in #4712
• ci: pre-commit autoupdate [skip ci] by @pre-commit-ci in #4713
• fix: serailization error when request with an invalid json input by @frostming in #4714
• fix: config pollution from other services by @frostming in #4715
• fix: handle ssh git url without ref part by @frostming in #4716
• fix: correct the default value of timeout-keep-alive by @frostming in #4717

Full Changelog: v1.2.13...v1.2.14

v1.2.13

What's Changed

• docs: fix indentation in build option docs by @jianshen92 in #4688
• fix: bug: module 'bentoml' has no attribute 'build' by @frostming in #4689
• docs: update autoscaling by @ssheng in #4691
• docs: init io-descriptors example by @lycheel1 in #4646
• fix: uncaught error missing trace headers by @frostming in #4692
• chore: remove outdated examples by @larme in #4694
• fix: bypass /livez in traffic middleware by @frostming in #4696
• docs:Update credits by @Sherlock113 in #4700
• docs: Add model store reference in the Services doc by @Sherlock113 in #4706
• docs: Update example dir readme by @Sherlock113 in #4707
• fix: fix table overflow with fold by @FogDong in #4677
• fix: server socket binding on Windows by @frostming in #4685
• fix: correct the logic of bypassing infra endpoints in traffic middleware by @frostming in #4704
• fix: add scaled to zero to ready status by @FogDong in #4708
• chore(container): cache large pypi packages in layers by @bojiang in #4690
• feat: add uvicorn timeouts options by @gusghrlrl101 in #4682
• fix: include models from config for new SDK bentos by @frostming in #4705
• fix: annotation preparation list iteration bug by @adamliter in #4701
• fix: tuple schema and websocket connection by @frostming in #4709
• fix: show warning instead of hard failure when model is missing by @frostming in #4693

New Contributors

• @gusghrlrl101 made their first contribution in #4682
• @adamliter made their first contribution in #4701

Full Changelog: v1.2.12...v1.2.13

v1.2.12

What's Changed

• docs: Add GPU inference doc by @Sherlock113 in #4654
• chore: update quickstart by @ssheng in #4655
• docs: Add JSON output for bentovllm by @Sherlock113 in #4657
• chore: cleanup quickstart by @ssheng in #4658
• docs: Update help info by @Sherlock113 in #4664
• fix: remove the uvicorn server header by @frostming in #4665
• docs: Fix format by @Sherlock113 in #4666
• docs: Add model composition doc by @Sherlock113 in #4668
• docs: Update example project list by @Sherlock113 in #4673
• docs: Add the monitoring and data collection doc by @Sherlock113 in #4662
• docs: Add add_asgi_middleware doc by @Sherlock113 in #4672
• fix: delete useless enum and fix enum value by @FogDong in #4674
• docs: Add RAG tutorial by @Sherlock113 in #4675
• docs: Update the clients doc by @Sherlock113 in #4676
• docs: Add some explanations for bentoml.models.get by @Sherlock113 in #4660
• docs: Add e2e test doc by @Sherlock113 in #4679
• fix(cloud client): various type error by @bojiang in #4680
• fix(cli): bentoml cli verbosity not passed to the subprocess correctly by @frostming in #4661

Full Changelog: v1.2.11...v1.2.12

v1.2.11

What's Changed

• docs: added multi model load and store example by @lycheel1 in #4575
• docs: inference graph by @lycheel1 in #4609
• docs: Update high-level BentoML messaging by @Sherlock113 in #4644
• fix: delete trace error for timeout when deploying by @FogDong in #4649
• fix(cli): correct the comparison of upload status by @frostming in #4643

New Contributors

• @lycheel1 made their first contribution in #4575

Full Changelog: v1.2.10...v1.2.11

v1.2.10

What's Changed

• docs: Remove old example links by @Sherlock113 in #4610
• feat(build): use jinja template for install script by @aarnphm in #4607
• feat: download git+ssh dependencies to wheels/ folder by @frostming in #4612
• docs: Update the ASGI doc by @Sherlock113 in #4614
• fix: non batched request executed in non FIFO manner by @frostming in #4619
• feat: light-weighted dev sdist builder by @frostming in #4615
• fix: add response headers for error responses by @frostming in #4622
• docs: Refactor the autoscaling doc by @Sherlock113 in #4620
• docs: Add simple verification test for Services by @Sherlock113 in #4629
• ci: pre-commit autoupdate [skip ci] by @pre-commit-ci in #4630
• docs: Add workers doc by @Sherlock113 in #4628
• docs: Add worker doc links by @Sherlock113 in #4636
• docs: Add docs for bentoml.runner_service by @Sherlock113 in #4637
• docs: Add sync to async doc by @Sherlock113 in #4639
• fix: handle call on clients by @frostming in #4618
• fix(cli): bentoml get output in YAML format by @frostming in #4638
• fix: issue overriding default service config from config file by @frostming in #4627

Full Changelog: v1.2.9...v1.2.10