Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: kserve fastapi migration issues #2175

Merged
merged 10 commits into from
May 19, 2023

Conversation

jagadeeshi2i
Copy link
Collaborator

@jagadeeshi2i jagadeeshi2i commented Mar 13, 2023

Description

KServe 0.10.0 has migrated from tornado server to fastapi server. The PR fixes the issues: #2158 #2156 that are caused as a result of the above migration

Please read our CONTRIBUTING.md prior to creating your first pull reques

Please include a summary of the feature or issue being fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.

Type of change

Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update

Feature/Issue validation/testing

Please describe the Unit or Integration tests that you ran to verify your changes and relevant result summary. Provide instructions so it can be reproduced.
Please also list any relevant details for your test configuration.

  • Test A
    Logs for Test A

  • Test B
    Logs for Test B

Checklist:

  • Did you have fun?
  • Have you added tests that prove your fix is effective or that this feature works?
  • Has code been commented, particularly in hard-to-understand areas?
  • Have you made corresponding changes to the documentation?

Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
@jagadeeshi2i jagadeeshi2i changed the title fix: kserve fastapi migration issues [WIP] fix: kserve fastapi migration issues Mar 13, 2023
@codecov
Copy link

codecov bot commented Mar 13, 2023

Codecov Report

Merging #2175 (8bd76ee) into master (35fb574) will increase coverage by 0.05%.
The diff coverage is 93.75%.

❗ Current head 8bd76ee differs from pull request most recent head f85442f. Consider uploading reports for the commit f85442f to get more accurate results

@@            Coverage Diff             @@
##           master    #2175      +/-   ##
==========================================
+ Coverage   69.39%   69.44%   +0.05%     
==========================================
  Files          77       77              
  Lines        3441     3450       +9     
  Branches       57       57              
==========================================
+ Hits         2388     2396       +8     
- Misses       1050     1051       +1     
  Partials        3        3              
Impacted Files Coverage Δ
ts/torch_handler/request_envelope/kservev2.py 90.00% <93.75%> (-0.17%) ⬇️

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@lxning lxning mentioned this pull request Mar 15, 2023
10 tasks
@jagadeeshi2i jagadeeshi2i changed the title [WIP] fix: kserve fastapi migration issues fix: kserve fastapi migration issues Mar 20, 2023
@jagadeeshi2i
Copy link
Collaborator Author

@agunapal pls review this PR.

@agunapal
Copy link
Collaborator

agunapal commented Apr 4, 2023

Hi @jagadeeshi2i Can you please update the PR mentioning whats the migration issue and whats the solution

Copy link
Collaborator

@agunapal agunapal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add a description of what the migration issue and how we are solving it

@agunapal
Copy link
Collaborator

Hi @jagadeeshi2i Could you please check. It would be good to have this for the next release, which is soon

@jagadeeshi2i
Copy link
Collaborator Author

jagadeeshi2i commented Apr 18, 2023

@agunapal Pls approve the PR.

agunapal and others added 8 commits April 20, 2023 12:17
* Update index.md

Update to fix a broken link in index.md where the trailing .md is cut off from the management_api.md. Added an anchor link to force the .md to show up.

* Update to index.md

Update to index.md to fix several links ending in .md that sphinx is breaking. Added anchor links to each link and a corresponding anchor in the affected doc. Tested locally and seems to be working.

* Update inference_api.md

* Updated typos

Fixed typos and updated wordslist.txt

* Update wordlist.txt

---------

Co-authored-by: sekyonda <7411+sekyonda@users.noreply.ghe.oculus-rep.com>
Co-authored-by: lxning <23464292+lxning@users.noreply.github.com>
* Inf2 nightly benchmark

* fix linter spellcheck error

---------

Co-authored-by: Naman Nandan <namannan@amazon.com>
Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
Signed-off-by: jagadeesh <jagadeeshj@ideas2it.com>
@msaroufim msaroufim merged commit 77ca82d into pytorch:master May 19, 2023
agunapal pushed a commit that referenced this pull request May 20, 2023
* fix: kserve fastapi migration issues
namannandan pushed a commit to namannandan/serve that referenced this pull request May 30, 2023
@namannandan namannandan mentioned this pull request May 30, 2023
2 tasks
agunapal pushed a commit that referenced this pull request May 31, 2023
Co-authored-by: Naman Nandan <namannan@amazon.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants