2023-08-31T21:56:00.0028512Z Requested labels: ubuntu-20.04 2023-08-31T21:56:00.0028768Z Job defined at: pytorch/serve/.github/workflows/regression_tests_cpu_conda.yml@refs/pull/2562/merge 2023-08-31T21:56:00.0028920Z Waiting for a runner to pick up this job... 2023-08-31T21:56:00.8200512Z Job is waiting for a hosted runner to come online. 2023-08-31T21:56:03.2443308Z Job is about to start running on the hosted runner: GitHub Actions 87 (hosted) 2023-08-31T21:56:05.7192081Z Current runner version: '2.308.0' 2023-08-31T21:56:05.7218071Z ##[group]Operating System 2023-08-31T21:56:05.7218621Z Ubuntu 2023-08-31T21:56:05.7218985Z 20.04.6 2023-08-31T21:56:05.7219222Z LTS 2023-08-31T21:56:05.7219520Z ##[endgroup] 2023-08-31T21:56:05.7219792Z ##[group]Runner Image 2023-08-31T21:56:05.7220168Z Image: ubuntu-20.04 2023-08-31T21:56:05.7220540Z Version: 20230821.1.0 2023-08-31T21:56:05.7221052Z Included Software: https://github.com/actions/runner-images/blob/ubuntu20/20230821.1/images/linux/Ubuntu2004-Readme.md 2023-08-31T21:56:05.7221630Z Image Release: https://github.com/actions/runner-images/releases/tag/ubuntu20%2F20230821.1 2023-08-31T21:56:05.7222078Z ##[endgroup] 2023-08-31T21:56:05.7222421Z ##[group]Runner Image Provisioner 2023-08-31T21:56:05.7222746Z 2.0.266.1 2023-08-31T21:56:05.7223048Z ##[endgroup] 2023-08-31T21:56:05.7223990Z ##[group]GITHUB_TOKEN Permissions 2023-08-31T21:56:05.7224615Z Actions: read 2023-08-31T21:56:05.7224915Z Checks: read 2023-08-31T21:56:05.7225437Z Contents: read 2023-08-31T21:56:05.7225797Z Deployments: read 2023-08-31T21:56:05.7226145Z Discussions: read 2023-08-31T21:56:05.7226455Z Issues: read 2023-08-31T21:56:05.7226720Z Metadata: read 2023-08-31T21:56:05.7227037Z Packages: read 2023-08-31T21:56:05.7227380Z Pages: read 2023-08-31T21:56:05.7227650Z PullRequests: read 2023-08-31T21:56:05.7228014Z RepositoryProjects: read 2023-08-31T21:56:05.7228362Z SecurityEvents: read 2023-08-31T21:56:05.7228640Z Statuses: read 2023-08-31T21:56:05.7228967Z ##[endgroup] 2023-08-31T21:56:05.7232462Z Secret source: None 2023-08-31T21:56:05.7232910Z Prepare workflow directory 2023-08-31T21:56:05.7985431Z Prepare all required actions 2023-08-31T21:56:05.8173995Z Getting action download info 2023-08-31T21:56:06.0114675Z Download action repository 'actions/checkout@v3' (SHA:f43a0e5ff2bd294095638e18286ca9a3d1956744) 2023-08-31T21:56:06.3639085Z Download action repository 's-weigand/setup-conda@v1' (SHA:2dc412d672599b13ebbb1054690374e0b675919a) 2023-08-31T21:56:06.5957112Z Download action repository 'actions/setup-java@v3' (SHA:cd89f46ac9d01407894225f350157564c9c7cee2) 2023-08-31T21:56:07.0249588Z Complete job name: regression-cpu-conda-nightly (ubuntu-20.04, 3.9) 2023-08-31T21:56:07.1081443Z ##[group]Run actions/checkout@v3 2023-08-31T21:56:07.1081780Z with: 2023-08-31T21:56:07.1082039Z repository: pytorch/serve 2023-08-31T21:56:07.1082537Z token: *** 2023-08-31T21:56:07.1082780Z ssh-strict: true 2023-08-31T21:56:07.1083072Z persist-credentials: true 2023-08-31T21:56:07.1083355Z clean: true 2023-08-31T21:56:07.1083630Z sparse-checkout-cone-mode: true 2023-08-31T21:56:07.1083922Z fetch-depth: 1 2023-08-31T21:56:07.1084169Z fetch-tags: false 2023-08-31T21:56:07.1084403Z lfs: false 2023-08-31T21:56:07.1084639Z submodules: false 2023-08-31T21:56:07.1084907Z set-safe-directory: true 2023-08-31T21:56:07.1085152Z ##[endgroup] 2023-08-31T21:56:07.3191622Z Syncing repository: pytorch/serve 2023-08-31T21:56:07.3193386Z ##[group]Getting Git version info 2023-08-31T21:56:07.3193985Z Working directory is '/home/runner/work/serve/serve' 2023-08-31T21:56:07.3195448Z [command]/usr/bin/git version 2023-08-31T21:56:07.3216263Z git version 2.41.0 2023-08-31T21:56:07.3232774Z ##[endgroup] 2023-08-31T21:56:07.3249097Z Temporarily overriding HOME='/home/runner/work/_temp/d899c57b-4b44-4f8d-a228-48e50acd5ff7' before making global git config changes 2023-08-31T21:56:07.3249678Z Adding repository directory to the temporary git global config as a safe directory 2023-08-31T21:56:07.3253672Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/serve/serve 2023-08-31T21:56:07.3296954Z Deleting the contents of '/home/runner/work/serve/serve' 2023-08-31T21:56:07.3327761Z ##[group]Initializing the repository 2023-08-31T21:56:07.3328146Z [command]/usr/bin/git init /home/runner/work/serve/serve 2023-08-31T21:56:07.3388021Z hint: Using 'master' as the name for the initial branch. This default branch name 2023-08-31T21:56:07.3389952Z hint: is subject to change. To configure the initial branch name to use in all 2023-08-31T21:56:07.3396133Z hint: of your new repositories, which will suppress this warning, call: 2023-08-31T21:56:07.3396453Z hint: 2023-08-31T21:56:07.3396887Z hint: git config --global init.defaultBranch 2023-08-31T21:56:07.3399445Z hint: 2023-08-31T21:56:07.3400112Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-08-31T21:56:07.3400661Z hint: 'development'. The just-created branch can be renamed via this command: 2023-08-31T21:56:07.3421810Z hint: 2023-08-31T21:56:07.3422235Z hint: git branch -m 2023-08-31T21:56:07.3422642Z Initialized empty Git repository in /home/runner/work/serve/serve/.git/ 2023-08-31T21:56:07.3423713Z [command]/usr/bin/git remote add origin https://github.com/pytorch/serve 2023-08-31T21:56:07.3487929Z ##[endgroup] 2023-08-31T21:56:07.3488418Z ##[group]Disabling automatic garbage collection 2023-08-31T21:56:07.3498654Z [command]/usr/bin/git config --local gc.auto 0 2023-08-31T21:56:07.3531002Z ##[endgroup] 2023-08-31T21:56:07.3531439Z ##[group]Setting up auth 2023-08-31T21:56:07.3534823Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2023-08-31T21:56:07.3565154Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2023-08-31T21:56:07.3863122Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2023-08-31T21:56:07.3892912Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2023-08-31T21:56:07.4108182Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2023-08-31T21:56:07.4144049Z ##[endgroup] 2023-08-31T21:56:07.4146218Z ##[group]Fetching the repository 2023-08-31T21:56:07.4154028Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +373298ff00813a60e809f02b4c099a4dff308bf5:refs/remotes/pull/2562/merge 2023-08-31T21:56:07.6856333Z remote: Enumerating objects: 1485, done. 2023-08-31T21:56:07.6857940Z remote: Counting objects: 0% (1/1485) 2023-08-31T21:56:07.6858280Z remote: Counting objects: 1% (15/1485) 2023-08-31T21:56:07.6858600Z remote: Counting objects: 2% (30/1485) 2023-08-31T21:56:07.6858919Z remote: Counting objects: 3% (45/1485) 2023-08-31T21:56:07.6859490Z remote: Counting objects: 4% (60/1485) 2023-08-31T21:56:07.6859839Z remote: Counting objects: 5% (75/1485) 2023-08-31T21:56:07.6860132Z remote: Counting objects: 6% (90/1485) 2023-08-31T21:56:07.6860437Z remote: Counting objects: 7% (104/1485) 2023-08-31T21:56:07.6861009Z remote: Counting objects: 8% (119/1485) 2023-08-31T21:56:07.6861318Z remote: Counting objects: 9% (134/1485) 2023-08-31T21:56:07.6861952Z remote: Counting objects: 10% (149/1485) 2023-08-31T21:56:07.6862269Z remote: Counting objects: 11% (164/1485) 2023-08-31T21:56:07.6862565Z remote: Counting objects: 12% (179/1485) 2023-08-31T21:56:07.6862851Z remote: Counting objects: 13% (194/1485) 2023-08-31T21:56:07.6863142Z remote: Counting objects: 14% (208/1485) 2023-08-31T21:56:07.6863437Z remote: Counting objects: 15% (223/1485) 2023-08-31T21:56:07.6863721Z remote: Counting objects: 16% (238/1485) 2023-08-31T21:56:07.6864056Z remote: Counting objects: 17% (253/1485) 2023-08-31T21:56:07.6864344Z remote: Counting objects: 18% (268/1485) 2023-08-31T21:56:07.6864624Z remote: Counting objects: 19% (283/1485) 2023-08-31T21:56:07.6864907Z remote: Counting objects: 20% (297/1485) 2023-08-31T21:56:07.6865197Z remote: Counting objects: 21% (312/1485) 2023-08-31T21:56:07.6865483Z remote: Counting objects: 22% (327/1485) 2023-08-31T21:56:07.6866046Z remote: Counting objects: 23% (342/1485) 2023-08-31T21:56:07.6867931Z remote: Counting objects: 24% (357/1485) 2023-08-31T21:56:07.6870221Z remote: Counting objects: 25% (372/1485) 2023-08-31T21:56:07.6873486Z remote: Counting objects: 26% (387/1485) 2023-08-31T21:56:07.6873836Z remote: Counting objects: 27% (401/1485) 2023-08-31T21:56:07.6874146Z remote: Counting objects: 28% (416/1485) 2023-08-31T21:56:07.6874454Z remote: Counting objects: 29% (431/1485) 2023-08-31T21:56:07.6874752Z remote: Counting objects: 30% (446/1485) 2023-08-31T21:56:07.6875053Z remote: Counting objects: 31% (461/1485) 2023-08-31T21:56:07.6875336Z remote: Counting objects: 32% (476/1485) 2023-08-31T21:56:07.6875627Z remote: Counting objects: 33% (491/1485) 2023-08-31T21:56:07.6875911Z remote: Counting objects: 34% (505/1485) 2023-08-31T21:56:07.6876194Z remote: Counting objects: 35% (520/1485) 2023-08-31T21:56:07.6876501Z remote: Counting objects: 36% (535/1485) 2023-08-31T21:56:07.6876798Z remote: Counting objects: 37% (550/1485) 2023-08-31T21:56:07.6877083Z remote: Counting objects: 38% (565/1485) 2023-08-31T21:56:07.6877372Z remote: Counting objects: 39% (580/1485) 2023-08-31T21:56:07.6877658Z remote: Counting objects: 40% (594/1485) 2023-08-31T21:56:07.6877938Z remote: Counting objects: 41% (609/1485) 2023-08-31T21:56:07.6878232Z remote: Counting objects: 42% (624/1485) 2023-08-31T21:56:07.6878517Z remote: Counting objects: 43% (639/1485) 2023-08-31T21:56:07.6878798Z remote: Counting objects: 44% (654/1485) 2023-08-31T21:56:07.6879082Z remote: Counting objects: 45% (669/1485) 2023-08-31T21:56:07.6879370Z remote: Counting objects: 46% (684/1485) 2023-08-31T21:56:07.6879654Z remote: Counting objects: 47% (698/1485) 2023-08-31T21:56:07.6879930Z remote: Counting objects: 48% (713/1485) 2023-08-31T21:56:07.6880220Z remote: Counting objects: 49% (728/1485) 2023-08-31T21:56:07.6880705Z remote: Counting objects: 50% (743/1485) 2023-08-31T21:56:07.6908999Z remote: Counting objects: 51% (758/1485) 2023-08-31T21:56:07.6909325Z remote: Counting objects: 52% (773/1485) 2023-08-31T21:56:07.6909632Z remote: Counting objects: 53% (788/1485) 2023-08-31T21:56:07.6909929Z remote: Counting objects: 54% (802/1485) 2023-08-31T21:56:07.6910215Z remote: Counting objects: 55% (817/1485) 2023-08-31T21:56:07.6910511Z remote: Counting objects: 56% (832/1485) 2023-08-31T21:56:07.6910801Z remote: Counting objects: 57% (847/1485) 2023-08-31T21:56:07.6911086Z remote: Counting objects: 58% (862/1485) 2023-08-31T21:56:07.6911385Z remote: Counting objects: 59% (877/1485) 2023-08-31T21:56:07.6911675Z remote: Counting objects: 60% (891/1485) 2023-08-31T21:56:07.6911961Z remote: Counting objects: 61% (906/1485) 2023-08-31T21:56:07.6912263Z remote: Counting objects: 62% (921/1485) 2023-08-31T21:56:07.6912560Z remote: Counting objects: 63% (936/1485) 2023-08-31T21:56:07.6912856Z remote: Counting objects: 64% (951/1485) 2023-08-31T21:56:07.6913152Z remote: Counting objects: 65% (966/1485) 2023-08-31T21:56:07.6913435Z remote: Counting objects: 66% (981/1485) 2023-08-31T21:56:07.6913723Z remote: Counting objects: 67% (995/1485) 2023-08-31T21:56:07.6914023Z remote: Counting objects: 68% (1010/1485) 2023-08-31T21:56:07.6914329Z remote: Counting objects: 69% (1025/1485) 2023-08-31T21:56:07.6914641Z remote: Counting objects: 70% (1040/1485) 2023-08-31T21:56:07.6914947Z remote: Counting objects: 71% (1055/1485) 2023-08-31T21:56:07.6915235Z remote: Counting objects: 72% (1070/1485) 2023-08-31T21:56:07.6915528Z remote: Counting objects: 73% (1085/1485) 2023-08-31T21:56:07.6916068Z remote: Counting objects: 74% (1099/1485) 2023-08-31T21:56:07.6916381Z remote: Counting objects: 75% (1114/1485) 2023-08-31T21:56:07.6916682Z remote: Counting objects: 76% (1129/1485) 2023-08-31T21:56:07.6916989Z remote: Counting objects: 77% (1144/1485) 2023-08-31T21:56:07.6917294Z remote: Counting objects: 78% (1159/1485) 2023-08-31T21:56:07.6917587Z remote: Counting objects: 79% (1174/1485) 2023-08-31T21:56:07.6917888Z remote: Counting objects: 80% (1188/1485) 2023-08-31T21:56:07.6918191Z remote: Counting objects: 81% (1203/1485) 2023-08-31T21:56:07.6918477Z remote: Counting objects: 82% (1218/1485) 2023-08-31T21:56:07.6918774Z remote: Counting objects: 83% (1233/1485) 2023-08-31T21:56:07.6919073Z remote: Counting objects: 84% (1248/1485) 2023-08-31T21:56:07.6919372Z remote: Counting objects: 85% (1263/1485) 2023-08-31T21:56:07.6919662Z remote: Counting objects: 86% (1278/1485) 2023-08-31T21:56:07.6919965Z remote: Counting objects: 87% (1292/1485) 2023-08-31T21:56:07.6920256Z remote: Counting objects: 88% (1307/1485) 2023-08-31T21:56:07.6920546Z remote: Counting objects: 89% (1322/1485) 2023-08-31T21:56:07.6920838Z remote: Counting objects: 90% (1337/1485) 2023-08-31T21:56:07.6921136Z remote: Counting objects: 91% (1352/1485) 2023-08-31T21:56:07.6921420Z remote: Counting objects: 92% (1367/1485) 2023-08-31T21:56:07.6921715Z remote: Counting objects: 93% (1382/1485) 2023-08-31T21:56:07.6922013Z remote: Counting objects: 94% (1396/1485) 2023-08-31T21:56:07.6922292Z remote: Counting objects: 95% (1411/1485) 2023-08-31T21:56:07.6922582Z remote: Counting objects: 96% (1426/1485) 2023-08-31T21:56:07.6922873Z remote: Counting objects: 97% (1441/1485) 2023-08-31T21:56:07.6923164Z remote: Counting objects: 98% (1456/1485) 2023-08-31T21:56:07.6923443Z remote: Counting objects: 99% (1471/1485) 2023-08-31T21:56:07.6923742Z remote: Counting objects: 100% (1485/1485) 2023-08-31T21:56:07.6924055Z remote: Counting objects: 100% (1485/1485), done. 2023-08-31T21:56:07.6924488Z remote: Compressing objects: 0% (1/1228) 2023-08-31T21:56:07.6924812Z remote: Compressing objects: 1% (13/1228) 2023-08-31T21:56:07.6925139Z remote: Compressing objects: 2% (25/1228) 2023-08-31T21:56:07.6925452Z remote: Compressing objects: 3% (37/1228) 2023-08-31T21:56:07.6925769Z remote: Compressing objects: 4% (50/1228) 2023-08-31T21:56:07.6926084Z remote: Compressing objects: 5% (62/1228) 2023-08-31T21:56:07.6926557Z remote: Compressing objects: 6% (74/1228) 2023-08-31T21:56:07.6927941Z remote: Compressing objects: 7% (86/1228) 2023-08-31T21:56:07.6934183Z remote: Compressing objects: 8% (99/1228) 2023-08-31T21:56:07.6955213Z remote: Compressing objects: 9% (111/1228) 2023-08-31T21:56:07.6973168Z remote: Compressing objects: 10% (123/1228) 2023-08-31T21:56:07.7004504Z remote: Compressing objects: 11% (136/1228) 2023-08-31T21:56:07.7033092Z remote: Compressing objects: 12% (148/1228) 2023-08-31T21:56:07.7052998Z remote: Compressing objects: 13% (160/1228) 2023-08-31T21:56:07.7079063Z remote: Compressing objects: 14% (172/1228) 2023-08-31T21:56:07.7096471Z remote: Compressing objects: 15% (185/1228) 2023-08-31T21:56:07.7109530Z remote: Compressing objects: 16% (197/1228) 2023-08-31T21:56:07.7151911Z remote: Compressing objects: 17% (209/1228) 2023-08-31T21:56:07.7184448Z remote: Compressing objects: 18% (222/1228) 2023-08-31T21:56:07.7208043Z remote: Compressing objects: 19% (234/1228) 2023-08-31T21:56:07.7209076Z remote: Compressing objects: 20% (246/1228) 2023-08-31T21:56:07.7220643Z remote: Compressing objects: 21% (258/1228) 2023-08-31T21:56:07.7221026Z remote: Compressing objects: 22% (271/1228) 2023-08-31T21:56:07.7234777Z remote: Compressing objects: 23% (283/1228) 2023-08-31T21:56:07.7253104Z remote: Compressing objects: 24% (295/1228) 2023-08-31T21:56:07.7267511Z remote: Compressing objects: 25% (307/1228) 2023-08-31T21:56:07.7285743Z remote: Compressing objects: 26% (320/1228) 2023-08-31T21:56:07.7306767Z remote: Compressing objects: 27% (332/1228) 2023-08-31T21:56:07.7307820Z remote: Compressing objects: 28% (344/1228) 2023-08-31T21:56:07.7308777Z remote: Compressing objects: 29% (357/1228) 2023-08-31T21:56:07.7309758Z remote: Compressing objects: 30% (369/1228) 2023-08-31T21:56:07.7310744Z remote: Compressing objects: 31% (381/1228) 2023-08-31T21:56:07.7324311Z remote: Compressing objects: 32% (393/1228) 2023-08-31T21:56:07.7344912Z remote: Compressing objects: 33% (406/1228) 2023-08-31T21:56:07.7361322Z remote: Compressing objects: 34% (418/1228) 2023-08-31T21:56:07.7361648Z remote: Compressing objects: 35% (430/1228) 2023-08-31T21:56:07.8514137Z remote: Compressing objects: 36% (443/1228) 2023-08-31T21:56:07.8549773Z remote: Compressing objects: 37% (455/1228) 2023-08-31T21:56:07.8556123Z remote: Compressing objects: 38% (467/1228) 2023-08-31T21:56:07.8564570Z remote: Compressing objects: 39% (479/1228) 2023-08-31T21:56:07.8567958Z remote: Compressing objects: 40% (492/1228) 2023-08-31T21:56:07.8625400Z remote: Compressing objects: 41% (504/1228) 2023-08-31T21:56:07.8627952Z remote: Compressing objects: 42% (516/1228) 2023-08-31T21:56:07.8628825Z remote: Compressing objects: 43% (529/1228) 2023-08-31T21:56:07.8629250Z remote: Compressing objects: 44% (541/1228) 2023-08-31T21:56:07.8629587Z remote: Compressing objects: 45% (553/1228) 2023-08-31T21:56:07.8629936Z remote: Compressing objects: 46% (565/1228) 2023-08-31T21:56:07.8630282Z remote: Compressing objects: 47% (578/1228) 2023-08-31T21:56:07.8630623Z remote: Compressing objects: 48% (590/1228) 2023-08-31T21:56:07.8630962Z remote: Compressing objects: 49% (602/1228) 2023-08-31T21:56:07.8631501Z remote: Compressing objects: 50% (614/1228) 2023-08-31T21:56:07.8631828Z remote: Compressing objects: 51% (627/1228) 2023-08-31T21:56:07.8632129Z remote: Compressing objects: 52% (639/1228) 2023-08-31T21:56:07.8632439Z remote: Compressing objects: 53% (651/1228) 2023-08-31T21:56:07.8632746Z remote: Compressing objects: 54% (664/1228) 2023-08-31T21:56:07.8635153Z remote: Compressing objects: 55% (676/1228) 2023-08-31T21:56:07.8644652Z remote: Compressing objects: 56% (688/1228) 2023-08-31T21:56:07.8659566Z remote: Compressing objects: 57% (700/1228) 2023-08-31T21:56:07.8673757Z remote: Compressing objects: 58% (713/1228) 2023-08-31T21:56:07.8695978Z remote: Compressing objects: 59% (725/1228) 2023-08-31T21:56:07.8715476Z remote: Compressing objects: 60% (737/1228) 2023-08-31T21:56:07.8738663Z remote: Compressing objects: 61% (750/1228) 2023-08-31T21:56:07.8767123Z remote: Compressing objects: 62% (762/1228) 2023-08-31T21:56:07.8792015Z remote: Compressing objects: 63% (774/1228) 2023-08-31T21:56:07.8822007Z remote: Compressing objects: 64% (786/1228) 2023-08-31T21:56:07.8833882Z remote: Compressing objects: 65% (799/1228) 2023-08-31T21:56:07.8843854Z remote: Compressing objects: 66% (811/1228) 2023-08-31T21:56:07.8868713Z remote: Compressing objects: 67% (823/1228) 2023-08-31T21:56:07.8869140Z remote: Compressing objects: 68% (836/1228) 2023-08-31T21:56:07.8890302Z remote: Compressing objects: 69% (848/1228) 2023-08-31T21:56:07.8913367Z remote: Compressing objects: 70% (860/1228) 2023-08-31T21:56:07.8965110Z remote: Compressing objects: 71% (872/1228) 2023-08-31T21:56:07.9000149Z remote: Compressing objects: 72% (885/1228) 2023-08-31T21:56:07.9019924Z remote: Compressing objects: 73% (897/1228) 2023-08-31T21:56:07.9049605Z remote: Compressing objects: 74% (909/1228) 2023-08-31T21:56:07.9096618Z remote: Compressing objects: 75% (921/1228) 2023-08-31T21:56:07.9139798Z remote: Compressing objects: 76% (934/1228) 2023-08-31T21:56:07.9149699Z remote: Compressing objects: 77% (946/1228) 2023-08-31T21:56:07.9182127Z remote: Compressing objects: 78% (958/1228) 2023-08-31T21:56:07.9207320Z remote: Compressing objects: 79% (971/1228) 2023-08-31T21:56:07.9219061Z remote: Compressing objects: 80% (983/1228) 2023-08-31T21:56:07.9220522Z remote: Compressing objects: 81% (995/1228) 2023-08-31T21:56:07.9222937Z remote: Compressing objects: 82% (1007/1228) 2023-08-31T21:56:07.9223334Z remote: Compressing objects: 83% (1020/1228) 2023-08-31T21:56:07.9223654Z remote: Compressing objects: 84% (1032/1228) 2023-08-31T21:56:07.9223954Z remote: Compressing objects: 85% (1044/1228) 2023-08-31T21:56:07.9226219Z remote: Compressing objects: 86% (1057/1228) 2023-08-31T21:56:07.9226566Z remote: Compressing objects: 87% (1069/1228) 2023-08-31T21:56:07.9226862Z remote: Compressing objects: 88% (1081/1228) 2023-08-31T21:56:07.9227170Z remote: Compressing objects: 89% (1093/1228) 2023-08-31T21:56:07.9227476Z remote: Compressing objects: 90% (1106/1228) 2023-08-31T21:56:07.9227780Z remote: Compressing objects: 91% (1118/1228) 2023-08-31T21:56:07.9237217Z remote: Compressing objects: 92% (1130/1228) 2023-08-31T21:56:07.9237563Z remote: Compressing objects: 93% (1143/1228) 2023-08-31T21:56:07.9237870Z remote: Compressing objects: 94% (1155/1228) 2023-08-31T21:56:07.9238166Z remote: Compressing objects: 95% (1167/1228) 2023-08-31T21:56:07.9238478Z remote: Compressing objects: 96% (1179/1228) 2023-08-31T21:56:07.9238781Z remote: Compressing objects: 97% (1192/1228) 2023-08-31T21:56:07.9239086Z remote: Compressing objects: 98% (1204/1228) 2023-08-31T21:56:07.9239568Z remote: Compressing objects: 99% (1216/1228) 2023-08-31T21:56:07.9239881Z remote: Compressing objects: 100% (1228/1228) 2023-08-31T21:56:07.9240206Z remote: Compressing objects: 100% (1228/1228), done. 2023-08-31T21:56:07.9296180Z Receiving objects: 0% (1/1485) 2023-08-31T21:56:07.9303243Z Receiving objects: 1% (15/1485) 2023-08-31T21:56:07.9345129Z Receiving objects: 2% (30/1485) 2023-08-31T21:56:08.0699056Z Receiving objects: 3% (45/1485) 2023-08-31T21:56:08.0986881Z Receiving objects: 4% (60/1485) 2023-08-31T21:56:08.0988033Z Receiving objects: 5% (75/1485) 2023-08-31T21:56:08.1040483Z Receiving objects: 6% (90/1485) 2023-08-31T21:56:08.1069665Z Receiving objects: 7% (104/1485) 2023-08-31T21:56:08.1072666Z Receiving objects: 8% (119/1485) 2023-08-31T21:56:08.1079614Z Receiving objects: 9% (134/1485) 2023-08-31T21:56:08.1084777Z Receiving objects: 10% (149/1485) 2023-08-31T21:56:08.1091518Z Receiving objects: 11% (164/1485) 2023-08-31T21:56:08.1270402Z Receiving objects: 12% (179/1485) 2023-08-31T21:56:08.1552852Z Receiving objects: 13% (194/1485) 2023-08-31T21:56:08.1578792Z Receiving objects: 14% (208/1485) 2023-08-31T21:56:08.1587795Z Receiving objects: 15% (223/1485) 2023-08-31T21:56:08.1590414Z Receiving objects: 16% (238/1485) 2023-08-31T21:56:08.1594522Z Receiving objects: 17% (253/1485) 2023-08-31T21:56:08.1601040Z Receiving objects: 18% (268/1485) 2023-08-31T21:56:08.1621796Z Receiving objects: 19% (283/1485) 2023-08-31T21:56:08.1623258Z Receiving objects: 20% (297/1485) 2023-08-31T21:56:08.1682304Z Receiving objects: 21% (312/1485) 2023-08-31T21:56:08.1699921Z Receiving objects: 22% (327/1485) 2023-08-31T21:56:08.1708522Z Receiving objects: 23% (342/1485) 2023-08-31T21:56:08.1723396Z Receiving objects: 24% (357/1485) 2023-08-31T21:56:08.2683713Z Receiving objects: 25% (372/1485) 2023-08-31T21:56:08.3537985Z Receiving objects: 26% (387/1485) 2023-08-31T21:56:08.3549548Z Receiving objects: 27% (401/1485) 2023-08-31T21:56:08.4054930Z Receiving objects: 28% (416/1485) 2023-08-31T21:56:08.4095791Z Receiving objects: 29% (431/1485) 2023-08-31T21:56:08.4120108Z Receiving objects: 30% (446/1485) 2023-08-31T21:56:08.4164033Z Receiving objects: 31% (461/1485) 2023-08-31T21:56:08.4249568Z Receiving objects: 32% (476/1485) 2023-08-31T21:56:08.4252159Z Receiving objects: 33% (491/1485) 2023-08-31T21:56:08.4254340Z Receiving objects: 34% (505/1485) 2023-08-31T21:56:08.4256971Z Receiving objects: 35% (520/1485) 2023-08-31T21:56:08.4270258Z Receiving objects: 36% (535/1485) 2023-08-31T21:56:08.4272822Z Receiving objects: 37% (550/1485) 2023-08-31T21:56:08.4359146Z Receiving objects: 38% (565/1485) 2023-08-31T21:56:08.4362795Z Receiving objects: 39% (580/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.4367312Z Receiving objects: 40% (594/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.4368526Z Receiving objects: 41% (609/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.4372481Z Receiving objects: 42% (624/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.4376505Z Receiving objects: 43% (639/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.4378952Z Receiving objects: 44% (654/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8060551Z Receiving objects: 45% (669/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8073531Z Receiving objects: 46% (684/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8087891Z Receiving objects: 47% (698/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8111220Z Receiving objects: 48% (713/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8123833Z Receiving objects: 49% (728/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8136579Z Receiving objects: 50% (743/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8144243Z Receiving objects: 51% (758/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8156569Z Receiving objects: 52% (773/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8165230Z Receiving objects: 53% (788/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8177565Z Receiving objects: 54% (802/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8194826Z Receiving objects: 55% (817/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8207351Z Receiving objects: 56% (832/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8224426Z Receiving objects: 57% (847/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8239259Z Receiving objects: 58% (862/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8254427Z Receiving objects: 59% (877/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8267263Z Receiving objects: 60% (891/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8277028Z Receiving objects: 61% (906/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8282224Z Receiving objects: 62% (921/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8290095Z Receiving objects: 63% (936/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8297453Z Receiving objects: 64% (951/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8411781Z Receiving objects: 65% (966/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8418222Z Receiving objects: 66% (981/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8431088Z Receiving objects: 67% (995/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8440168Z Receiving objects: 68% (1010/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8448823Z Receiving objects: 69% (1025/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8458492Z Receiving objects: 70% (1040/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8463136Z Receiving objects: 71% (1055/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8469575Z Receiving objects: 72% (1070/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8477497Z Receiving objects: 73% (1085/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8486597Z Receiving objects: 74% (1099/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8491341Z Receiving objects: 75% (1114/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8497300Z Receiving objects: 76% (1129/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8503883Z Receiving objects: 77% (1144/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8520096Z Receiving objects: 78% (1159/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8524520Z Receiving objects: 79% (1174/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8534089Z Receiving objects: 80% (1188/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8554612Z Receiving objects: 81% (1203/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8560561Z Receiving objects: 82% (1218/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8565809Z Receiving objects: 83% (1233/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8573836Z Receiving objects: 84% (1248/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8587663Z Receiving objects: 85% (1263/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8594842Z Receiving objects: 86% (1278/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8603237Z Receiving objects: 87% (1292/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8622894Z Receiving objects: 88% (1307/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8676103Z Receiving objects: 89% (1322/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8685678Z Receiving objects: 90% (1337/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8695420Z Receiving objects: 91% (1352/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8703677Z Receiving objects: 92% (1367/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8709105Z Receiving objects: 93% (1382/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8710032Z remote: Total 1485 (delta 219), reused 884 (delta 134), pack-reused 0 2023-08-31T21:56:08.8724945Z Receiving objects: 94% (1396/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8731957Z Receiving objects: 95% (1411/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8739636Z Receiving objects: 96% (1426/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8748945Z Receiving objects: 97% (1441/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8756760Z Receiving objects: 98% (1456/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8762337Z Receiving objects: 99% (1471/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8766231Z Receiving objects: 100% (1485/1485), 14.52 MiB | 29.04 MiB/s 2023-08-31T21:56:08.8766928Z Receiving objects: 100% (1485/1485), 29.08 MiB | 30.70 MiB/s, done. 2023-08-31T21:56:08.8770611Z Resolving deltas: 0% (0/219) 2023-08-31T21:56:08.8774190Z Resolving deltas: 1% (3/219) 2023-08-31T21:56:08.8774642Z Resolving deltas: 2% (5/219) 2023-08-31T21:56:08.8775122Z Resolving deltas: 3% (7/219) 2023-08-31T21:56:08.8775598Z Resolving deltas: 4% (9/219) 2023-08-31T21:56:08.8779328Z Resolving deltas: 5% (11/219) 2023-08-31T21:56:08.8779729Z Resolving deltas: 6% (14/219) 2023-08-31T21:56:08.8780110Z Resolving deltas: 7% (16/219) 2023-08-31T21:56:08.8780477Z Resolving deltas: 8% (18/219) 2023-08-31T21:56:08.8780812Z Resolving deltas: 9% (20/219) 2023-08-31T21:56:08.8781150Z Resolving deltas: 10% (22/219) 2023-08-31T21:56:08.8781478Z Resolving deltas: 11% (25/219) 2023-08-31T21:56:08.8781799Z Resolving deltas: 12% (27/219) 2023-08-31T21:56:08.8782124Z Resolving deltas: 13% (29/219) 2023-08-31T21:56:08.8782464Z Resolving deltas: 14% (31/219) 2023-08-31T21:56:08.8785983Z Resolving deltas: 15% (33/219) 2023-08-31T21:56:08.8786330Z Resolving deltas: 16% (36/219) 2023-08-31T21:56:08.8786667Z Resolving deltas: 17% (38/219) 2023-08-31T21:56:08.8787003Z Resolving deltas: 18% (40/219) 2023-08-31T21:56:08.8787321Z Resolving deltas: 19% (42/219) 2023-08-31T21:56:08.8787643Z Resolving deltas: 20% (44/219) 2023-08-31T21:56:08.8787966Z Resolving deltas: 21% (46/219) 2023-08-31T21:56:08.8788282Z Resolving deltas: 22% (49/219) 2023-08-31T21:56:08.8788604Z Resolving deltas: 23% (51/219) 2023-08-31T21:56:08.8790043Z Resolving deltas: 24% (53/219) 2023-08-31T21:56:08.8790386Z Resolving deltas: 25% (55/219) 2023-08-31T21:56:08.8790695Z Resolving deltas: 26% (57/219) 2023-08-31T21:56:08.8793091Z Resolving deltas: 27% (60/219) 2023-08-31T21:56:08.8793453Z Resolving deltas: 28% (62/219) 2023-08-31T21:56:08.8793795Z Resolving deltas: 29% (64/219) 2023-08-31T21:56:08.8796297Z Resolving deltas: 30% (66/219) 2023-08-31T21:56:08.8799876Z Resolving deltas: 31% (68/219) 2023-08-31T21:56:08.8800231Z Resolving deltas: 32% (71/219) 2023-08-31T21:56:08.8800553Z Resolving deltas: 33% (73/219) 2023-08-31T21:56:08.8800884Z Resolving deltas: 34% (75/219) 2023-08-31T21:56:08.8801209Z Resolving deltas: 35% (77/219) 2023-08-31T21:56:08.8805357Z Resolving deltas: 36% (79/219) 2023-08-31T21:56:08.8805706Z Resolving deltas: 37% (82/219) 2023-08-31T21:56:08.8806035Z Resolving deltas: 38% (84/219) 2023-08-31T21:56:08.8808788Z Resolving deltas: 39% (86/219) 2023-08-31T21:56:08.8809139Z Resolving deltas: 40% (88/219) 2023-08-31T21:56:08.8809472Z Resolving deltas: 41% (90/219) 2023-08-31T21:56:08.8809810Z Resolving deltas: 42% (92/219) 2023-08-31T21:56:08.8810134Z Resolving deltas: 43% (95/219) 2023-08-31T21:56:08.8810475Z Resolving deltas: 44% (97/219) 2023-08-31T21:56:08.8810805Z Resolving deltas: 45% (99/219) 2023-08-31T21:56:08.8811140Z Resolving deltas: 46% (101/219) 2023-08-31T21:56:08.8813186Z Resolving deltas: 47% (103/219) 2023-08-31T21:56:08.8813547Z Resolving deltas: 48% (106/219) 2023-08-31T21:56:08.8813889Z Resolving deltas: 49% (108/219) 2023-08-31T21:56:08.8814223Z Resolving deltas: 50% (110/219) 2023-08-31T21:56:08.8814550Z Resolving deltas: 51% (112/219) 2023-08-31T21:56:08.8816472Z Resolving deltas: 52% (114/219) 2023-08-31T21:56:08.8819880Z Resolving deltas: 53% (117/219) 2023-08-31T21:56:08.8820235Z Resolving deltas: 54% (119/219) 2023-08-31T21:56:08.8820568Z Resolving deltas: 55% (121/219) 2023-08-31T21:56:08.8824625Z Resolving deltas: 56% (123/219) 2023-08-31T21:56:08.8824982Z Resolving deltas: 57% (125/219) 2023-08-31T21:56:08.8825316Z Resolving deltas: 58% (128/219) 2023-08-31T21:56:08.8832602Z Resolving deltas: 59% (130/219) 2023-08-31T21:56:08.8833038Z Resolving deltas: 60% (132/219) 2023-08-31T21:56:08.8835713Z Resolving deltas: 61% (134/219) 2023-08-31T21:56:08.8838092Z Resolving deltas: 62% (136/219) 2023-08-31T21:56:08.8838733Z Resolving deltas: 63% (138/219) 2023-08-31T21:56:08.8839141Z Resolving deltas: 64% (141/219) 2023-08-31T21:56:08.8839493Z Resolving deltas: 65% (143/219) 2023-08-31T21:56:08.8843903Z Resolving deltas: 66% (145/219) 2023-08-31T21:56:08.8844247Z Resolving deltas: 67% (147/219) 2023-08-31T21:56:08.8844615Z Resolving deltas: 68% (149/219) 2023-08-31T21:56:08.8844981Z Resolving deltas: 69% (152/219) 2023-08-31T21:56:08.8845327Z Resolving deltas: 70% (154/219) 2023-08-31T21:56:08.8845655Z Resolving deltas: 71% (156/219) 2023-08-31T21:56:08.8849521Z Resolving deltas: 72% (158/219) 2023-08-31T21:56:08.8849882Z Resolving deltas: 73% (160/219) 2023-08-31T21:56:08.8850221Z Resolving deltas: 74% (163/219) 2023-08-31T21:56:08.8850584Z Resolving deltas: 75% (165/219) 2023-08-31T21:56:08.8850933Z Resolving deltas: 76% (167/219) 2023-08-31T21:56:08.8851282Z Resolving deltas: 77% (169/219) 2023-08-31T21:56:08.8853951Z Resolving deltas: 78% (171/219) 2023-08-31T21:56:08.8854310Z Resolving deltas: 79% (174/219) 2023-08-31T21:56:08.8857601Z Resolving deltas: 80% (176/219) 2023-08-31T21:56:08.8857966Z Resolving deltas: 81% (178/219) 2023-08-31T21:56:08.8858292Z Resolving deltas: 82% (180/219) 2023-08-31T21:56:08.8862845Z Resolving deltas: 83% (182/219) 2023-08-31T21:56:08.8863201Z Resolving deltas: 84% (184/219) 2023-08-31T21:56:08.8863537Z Resolving deltas: 85% (187/219) 2023-08-31T21:56:08.8863867Z Resolving deltas: 86% (189/219) 2023-08-31T21:56:08.8864188Z Resolving deltas: 87% (191/219) 2023-08-31T21:56:08.8864525Z Resolving deltas: 88% (193/219) 2023-08-31T21:56:08.8864844Z Resolving deltas: 89% (195/219) 2023-08-31T21:56:08.8865176Z Resolving deltas: 90% (198/219) 2023-08-31T21:56:08.8865505Z Resolving deltas: 91% (200/219) 2023-08-31T21:56:08.8868525Z Resolving deltas: 92% (202/219) 2023-08-31T21:56:08.8869056Z Resolving deltas: 93% (204/219) 2023-08-31T21:56:08.8869400Z Resolving deltas: 94% (206/219) 2023-08-31T21:56:08.8869722Z Resolving deltas: 95% (209/219) 2023-08-31T21:56:08.8870060Z Resolving deltas: 96% (211/219) 2023-08-31T21:56:08.8870391Z Resolving deltas: 97% (213/219) 2023-08-31T21:56:08.8873993Z Resolving deltas: 98% (215/219) 2023-08-31T21:56:08.8874335Z Resolving deltas: 99% (217/219) 2023-08-31T21:56:08.8874668Z Resolving deltas: 100% (219/219) 2023-08-31T21:56:08.8875009Z Resolving deltas: 100% (219/219), done. 2023-08-31T21:56:08.9246120Z From https://github.com/pytorch/serve 2023-08-31T21:56:08.9247268Z * [new ref] 373298ff00813a60e809f02b4c099a4dff308bf5 -> pull/2562/merge 2023-08-31T21:56:08.9284663Z ##[endgroup] 2023-08-31T21:56:08.9285201Z ##[group]Determining the checkout info 2023-08-31T21:56:08.9285728Z ##[endgroup] 2023-08-31T21:56:08.9286204Z ##[group]Checking out the ref 2023-08-31T21:56:08.9286937Z [command]/usr/bin/git checkout --progress --force refs/remotes/pull/2562/merge 2023-08-31T21:56:09.0990078Z Note: switching to 'refs/remotes/pull/2562/merge'. 2023-08-31T21:56:09.0990327Z 2023-08-31T21:56:09.0990635Z You are in 'detached HEAD' state. You can look around, make experimental 2023-08-31T21:56:09.0991033Z changes and commit them, and you can discard any commits you make in this 2023-08-31T21:56:09.0991410Z state without impacting any branches by switching back to a branch. 2023-08-31T21:56:09.0991617Z 2023-08-31T21:56:09.0991788Z If you want to create a new branch to retain commits you create, you may 2023-08-31T21:56:09.0992220Z do so (now or later) by using -c with the switch command. Example: 2023-08-31T21:56:09.0992420Z 2023-08-31T21:56:09.0992576Z git switch -c 2023-08-31T21:56:09.0992733Z 2023-08-31T21:56:09.0992837Z Or undo this operation with: 2023-08-31T21:56:09.0992989Z 2023-08-31T21:56:09.0993071Z git switch - 2023-08-31T21:56:09.0993195Z 2023-08-31T21:56:09.0993381Z Turn off this advice by setting config variable advice.detachedHead to false 2023-08-31T21:56:09.0993613Z 2023-08-31T21:56:09.0994042Z HEAD is now at 373298f Merge bca84a7c8bf7adc51d92d91b60a3a98f811ce182 into 242895c6b4596c4119ec09d6139e627c5dd696b6 2023-08-31T21:56:09.1022435Z ##[endgroup] 2023-08-31T21:56:09.1051277Z [command]/usr/bin/git log -1 --format='%H' 2023-08-31T21:56:09.1083183Z '373298ff00813a60e809f02b4c099a4dff308bf5' 2023-08-31T21:56:09.1396963Z ##[group]Run s-weigand/setup-conda@v1 2023-08-31T21:56:09.1397199Z with: 2023-08-31T21:56:09.1397394Z update-conda: true 2023-08-31T21:56:09.1397611Z python-version: 3.9 2023-08-31T21:56:09.1397844Z conda-channels: anaconda, conda-forge 2023-08-31T21:56:09.1398086Z activate-conda: true 2023-08-31T21:56:09.1398280Z ##[endgroup] 2023-08-31T21:56:09.1965464Z ##[group]Getting original pythonLocation 2023-08-31T21:56:09.2023979Z [command]/usr/bin/which python 2023-08-31T21:56:09.2063532Z /usr/bin/python 2023-08-31T21:56:09.2087230Z ##[endgroup] 2023-08-31T21:56:09.2091804Z ##[group]Adding conda path to PATH 2023-08-31T21:56:09.2098247Z /usr/share/miniconda 2023-08-31T21:56:09.2108517Z ##[endgroup] 2023-08-31T21:56:09.2113113Z ##[group]Adding conda-channels: 2023-08-31T21:56:09.2115496Z Adding: anaconda 2023-08-31T21:56:09.2131345Z [command]/usr/share/miniconda/bin/conda config --add channels anaconda 2023-08-31T21:56:12.9514379Z Adding: conda-forge 2023-08-31T21:56:12.9530301Z [command]/usr/share/miniconda/bin/conda config --add channels conda-forge 2023-08-31T21:56:13.2476010Z ##[endgroup] 2023-08-31T21:56:13.2479699Z ##[group]Updateing conda: 2023-08-31T21:56:13.2493091Z [command]/usr/share/miniconda/bin/conda update -y -n base -c defaults conda 2023-08-31T21:56:41.5950632Z Collecting package metadata (current_repodata.json): ...working... done 2023-08-31T21:56:47.8712234Z Solving environment: ...working... done 2023-08-31T21:56:48.5334813Z 2023-08-31T21:56:48.5335410Z ## Package Plan ## 2023-08-31T21:56:48.5335745Z 2023-08-31T21:56:48.5336097Z environment location: /usr/share/miniconda 2023-08-31T21:56:48.5336783Z 2023-08-31T21:56:48.5337898Z added / updated specs: 2023-08-31T21:56:48.5338490Z - conda 2023-08-31T21:56:48.5338766Z 2023-08-31T21:56:48.5390916Z 2023-08-31T21:56:48.5391164Z The following packages will be downloaded: 2023-08-31T21:56:48.5391355Z 2023-08-31T21:56:48.5391470Z package | build 2023-08-31T21:56:48.5391913Z ---------------------------|----------------- 2023-08-31T21:56:48.5392280Z certifi-2023.7.22 | py311h06a4308_0 154 KB 2023-08-31T21:56:48.5392653Z conda-23.7.3 | py311h06a4308_0 1.3 MB 2023-08-31T21:56:48.5393031Z conda-package-handling-2.2.0| py311h06a4308_0 278 KB 2023-08-31T21:56:48.5393447Z conda-package-streaming-0.9.0| py311h06a4308_0 33 KB 2023-08-31T21:56:48.5393830Z icu-73.1 | h6a678d5_0 25.9 MB 2023-08-31T21:56:48.5394179Z libcurl-8.1.1 | h251f7ec_2 397 KB 2023-08-31T21:56:48.5394535Z libxml2-2.10.4 | hf1b16e4_1 753 KB 2023-08-31T21:56:48.5394875Z openssl-3.0.10 | h7f8727e_2 5.2 MB 2023-08-31T21:56:48.5395231Z pyopenssl-23.2.0 | py311h06a4308_0 121 KB 2023-08-31T21:56:48.5395571Z requests-2.31.0 | py311h06a4308_0 124 KB 2023-08-31T21:56:48.5395892Z ------------------------------------------------------------ 2023-08-31T21:56:48.5396138Z Total: 34.3 MB 2023-08-31T21:56:48.5396285Z 2023-08-31T21:56:48.5396406Z The following packages will be UPDATED: 2023-08-31T21:56:48.5396561Z 2023-08-31T21:56:48.5396813Z certifi 2023.5.7-py311h06a4308_0 --> 2023.7.22-py311h06a4308_0 2023-08-31T21:56:48.5397232Z conda 23.5.2-py311h06a4308_0 --> 23.7.3-py311h06a4308_0 2023-08-31T21:56:48.5397677Z conda-package-han~ 2.1.0-py311h06a4308_0 --> 2.2.0-py311h06a4308_0 2023-08-31T21:56:48.5398109Z conda-package-str~ 0.8.0-py311h06a4308_0 --> 0.9.0-py311h06a4308_0 2023-08-31T21:56:48.5398511Z icu 58.2-he6710b0_3 --> 73.1-h6a678d5_0 2023-08-31T21:56:48.5403706Z libcurl 8.1.1-h251f7ec_1 --> 8.1.1-h251f7ec_2 2023-08-31T21:56:48.5404385Z libxml2 2.10.3-hcbfbd50_0 --> 2.10.4-hf1b16e4_1 2023-08-31T21:56:48.5404785Z openssl 3.0.9-h7f8727e_0 --> 3.0.10-h7f8727e_2 2023-08-31T21:56:48.5405203Z pyopenssl 23.0.0-py311h06a4308_0 --> 23.2.0-py311h06a4308_0 2023-08-31T21:56:48.5405618Z requests 2.29.0-py311h06a4308_0 --> 2.31.0-py311h06a4308_0 2023-08-31T21:56:48.5405803Z 2023-08-31T21:56:48.5405809Z 2023-08-31T21:56:48.5405815Z 2023-08-31T21:56:48.5405931Z Downloading and Extracting Packages 2023-08-31T21:56:48.5406084Z 2023-08-31T21:56:48.5406465Z pyopenssl-23.2.0 | 121 KB | | 0% 2023-08-31T21:56:48.5406643Z 2023-08-31T21:56:48.5406842Z openssl-3.0.10 | 5.2 MB | | 0%  2023-08-31T21:56:48.5407002Z 2023-08-31T21:56:48.5407008Z 2023-08-31T21:56:48.5407207Z icu-73.1 | 25.9 MB | | 0%  2023-08-31T21:56:48.5407367Z 2023-08-31T21:56:48.5407373Z 2023-08-31T21:56:48.5407384Z 2023-08-31T21:56:48.5407603Z conda-23.7.3 | 1.3 MB | | 0%  2023-08-31T21:56:48.5407769Z 2023-08-31T21:56:48.5407774Z 2023-08-31T21:56:48.5407779Z 2023-08-31T21:56:48.5407784Z 2023-08-31T21:56:48.5415791Z libxml2-2.10.4 | 753 KB | | 0%  2023-08-31T21:56:48.5416272Z 2023-08-31T21:56:48.5416581Z 2023-08-31T21:56:48.5416762Z 2023-08-31T21:56:48.5416904Z 2023-08-31T21:56:48.5417050Z 2023-08-31T21:56:48.5456266Z libcurl-8.1.1 | 397 KB | | 0%  2023-08-31T21:56:48.5566954Z 2023-08-31T21:56:48.5566963Z 2023-08-31T21:56:48.5567184Z 2023-08-31T21:56:48.5567190Z 2023-08-31T21:56:48.5567217Z 2023-08-31T21:56:48.5567223Z 2023-08-31T21:56:48.5567584Z requests-2.31.0 | 124 KB | | 0%  2023-08-31T21:56:48.5567798Z 2023-08-31T21:56:48.5567804Z 2023-08-31T21:56:48.5567810Z 2023-08-31T21:56:48.5567815Z 2023-08-31T21:56:48.5567821Z 2023-08-31T21:56:48.5567848Z 2023-08-31T21:56:48.5567854Z 2023-08-31T21:56:48.5568071Z certifi-2023.7.22 | 154 KB | | 0%  2023-08-31T21:56:48.5568251Z 2023-08-31T21:56:48.5568257Z 2023-08-31T21:56:48.5568262Z 2023-08-31T21:56:48.5568266Z 2023-08-31T21:56:48.5568271Z 2023-08-31T21:56:48.5568282Z 2023-08-31T21:56:48.5568287Z 2023-08-31T21:56:48.5568291Z 2023-08-31T21:56:48.5568525Z conda-package-stream | 33 KB | | 0%  2023-08-31T21:56:48.5568726Z 2023-08-31T21:56:48.5568731Z 2023-08-31T21:56:48.5568736Z 2023-08-31T21:56:48.5568740Z 2023-08-31T21:56:48.5568752Z 2023-08-31T21:56:48.5568763Z 2023-08-31T21:56:48.5568768Z 2023-08-31T21:56:48.5568773Z 2023-08-31T21:56:48.5568777Z 2023-08-31T21:56:48.6362998Z conda-package-handli | 278 KB | | 0%  2023-08-31T21:56:48.6655732Z pyopenssl-23.2.0 | 121 KB | #########2 | 93% 2023-08-31T21:56:48.6656110Z 2023-08-31T21:56:48.6656191Z 2023-08-31T21:56:48.6656273Z 2023-08-31T21:56:48.6656352Z 2023-08-31T21:56:48.6656425Z 2023-08-31T21:56:48.6764886Z libcurl-8.1.1 | 397 KB | 4 | 4%  2023-08-31T21:56:48.6888357Z pyopenssl-23.2.0 | 121 KB | ########## | 100% 2023-08-31T21:56:48.6888662Z 2023-08-31T21:56:48.6888735Z 2023-08-31T21:56:48.6888812Z 2023-08-31T21:56:48.6888882Z 2023-08-31T21:56:48.6888951Z 2023-08-31T21:56:48.6889021Z 2023-08-31T21:56:48.6949334Z requests-2.31.0 | 124 KB | #2 | 13%  2023-08-31T21:56:48.6949644Z 2023-08-31T21:56:48.6949718Z 2023-08-31T21:56:48.6949788Z 2023-08-31T21:56:48.6949875Z 2023-08-31T21:56:48.6953860Z 2023-08-31T21:56:48.7066824Z libcurl-8.1.1 | 397 KB | ########## | 100%  2023-08-31T21:56:48.7067137Z 2023-08-31T21:56:48.7067215Z 2023-08-31T21:56:48.7067285Z 2023-08-31T21:56:48.7103737Z conda-23.7.3 | 1.3 MB | 1 | 1%  2023-08-31T21:56:48.7104038Z 2023-08-31T21:56:48.7104117Z 2023-08-31T21:56:48.7104401Z 2023-08-31T21:56:48.7104483Z 2023-08-31T21:56:48.7104555Z 2023-08-31T21:56:48.7112728Z 2023-08-31T21:56:48.7120050Z requests-2.31.0 | 124 KB | ########## | 100%  2023-08-31T21:56:48.7120357Z 2023-08-31T21:56:48.7124195Z 2023-08-31T21:56:48.7138815Z icu-73.1 | 25.9 MB | | 0%  2023-08-31T21:56:48.7139077Z 2023-08-31T21:56:48.7139150Z 2023-08-31T21:56:48.7139219Z 2023-08-31T21:56:48.7139292Z 2023-08-31T21:56:48.7139362Z 2023-08-31T21:56:48.7139431Z 2023-08-31T21:56:48.7139508Z 2023-08-31T21:56:48.7280692Z certifi-2023.7.22 | 154 KB | # | 10%  2023-08-31T21:56:48.7281247Z 2023-08-31T21:56:48.7281325Z 2023-08-31T21:56:48.7281406Z 2023-08-31T21:56:48.7281485Z 2023-08-31T21:56:48.7281688Z 2023-08-31T21:56:48.7281757Z 2023-08-31T21:56:48.7281827Z 2023-08-31T21:56:48.7381628Z certifi-2023.7.22 | 154 KB | ########## | 100%  2023-08-31T21:56:48.7381950Z 2023-08-31T21:56:48.7406551Z openssl-3.0.10 | 5.2 MB | | 0%  2023-08-31T21:56:48.7406848Z 2023-08-31T21:56:48.7406942Z 2023-08-31T21:56:48.7407015Z 2023-08-31T21:56:48.7407085Z 2023-08-31T21:56:48.7407155Z 2023-08-31T21:56:48.7407227Z 2023-08-31T21:56:48.7407296Z 2023-08-31T21:56:48.7407366Z 2023-08-31T21:56:48.7518629Z conda-package-stream | 33 KB | ####8 | 48%  2023-08-31T21:56:48.7518971Z 2023-08-31T21:56:48.7519045Z 2023-08-31T21:56:48.7519116Z 2023-08-31T21:56:48.7521374Z 2023-08-31T21:56:48.7604262Z libxml2-2.10.4 | 753 KB | 2 | 2%  2023-08-31T21:56:48.7605221Z 2023-08-31T21:56:48.7605523Z 2023-08-31T21:56:48.7605533Z 2023-08-31T21:56:48.7612374Z 2023-08-31T21:56:48.7612502Z 2023-08-31T21:56:48.7612528Z 2023-08-31T21:56:48.7612557Z 2023-08-31T21:56:48.7612670Z 2023-08-31T21:56:48.7612675Z 2023-08-31T21:56:48.7963734Z conda-package-handli | 278 KB | 5 | 6%  2023-08-31T21:56:48.7964275Z 2023-08-31T21:56:48.7965297Z 2023-08-31T21:56:48.7965470Z 2023-08-31T21:56:48.7965612Z 2023-08-31T21:56:48.7965755Z 2023-08-31T21:56:48.7965896Z 2023-08-31T21:56:48.7966033Z 2023-08-31T21:56:48.7966251Z 2023-08-31T21:56:48.8117606Z conda-package-stream | 33 KB | ########## | 100%  2023-08-31T21:56:48.8118030Z 2023-08-31T21:56:48.8120866Z 2023-08-31T21:56:48.8384427Z icu-73.1 | 25.9 MB | #3 | 13%  2023-08-31T21:56:48.8384811Z 2023-08-31T21:56:48.8764243Z openssl-3.0.10 | 5.2 MB | ######## | 81%  2023-08-31T21:56:48.8764879Z 2023-08-31T21:56:48.8764887Z 2023-08-31T21:56:48.8764893Z 2023-08-31T21:56:48.8764898Z 2023-08-31T21:56:48.8764904Z 2023-08-31T21:56:48.8764910Z 2023-08-31T21:56:48.8764915Z 2023-08-31T21:56:48.8764921Z 2023-08-31T21:56:48.8772911Z 2023-08-31T21:56:48.8791385Z conda-package-handli | 278 KB | ########## | 100%  2023-08-31T21:56:48.8791882Z 2023-08-31T21:56:48.8792130Z 2023-08-31T21:56:48.8792140Z 2023-08-31T21:56:48.8792146Z 2023-08-31T21:56:48.8792152Z 2023-08-31T21:56:48.8792157Z 2023-08-31T21:56:48.8792162Z 2023-08-31T21:56:48.8792169Z 2023-08-31T21:56:48.8799429Z 2023-08-31T21:56:48.9118928Z conda-package-handli | 278 KB | ########## | 100%  2023-08-31T21:56:48.9119433Z 2023-08-31T21:56:48.9123519Z 2023-08-31T21:56:48.9700971Z icu-73.1 | 25.9 MB | ###3 | 33%  2023-08-31T21:56:48.9701182Z 2023-08-31T21:56:48.9701189Z 2023-08-31T21:56:48.9701196Z 2023-08-31T21:56:48.9706217Z 2023-08-31T21:56:48.9724463Z libxml2-2.10.4 | 753 KB | ########## | 100%  2023-08-31T21:56:48.9724664Z 2023-08-31T21:56:48.9724797Z 2023-08-31T21:56:48.9724974Z 2023-08-31T21:56:48.9732528Z 2023-08-31T21:56:49.0120771Z libxml2-2.10.4 | 753 KB | ########## | 100%  2023-08-31T21:56:49.0121269Z 2023-08-31T21:56:49.0130005Z 2023-08-31T21:56:49.0516612Z icu-73.1 | 25.9 MB | ##### | 50%  2023-08-31T21:56:49.0517149Z 2023-08-31T21:56:49.0518259Z 2023-08-31T21:56:49.0522792Z 2023-08-31T21:56:49.0528150Z conda-23.7.3 | 1.3 MB | ########## | 100%  2023-08-31T21:56:49.0528519Z 2023-08-31T21:56:49.0528863Z 2023-08-31T21:56:49.0532551Z 2023-08-31T21:56:49.1122345Z conda-23.7.3 | 1.3 MB | ########## | 100%  2023-08-31T21:56:49.1122822Z 2023-08-31T21:56:49.1123738Z 2023-08-31T21:56:49.1469625Z icu-73.1 | 25.9 MB | #######8 | 79%  2023-08-31T21:56:49.1474021Z 2023-08-31T21:56:49.4228828Z openssl-3.0.10 | 5.2 MB | ########## | 100%  2023-08-31T21:56:49.4229054Z 2023-08-31T21:56:49.4229672Z 2023-08-31T21:56:49.4233672Z icu-73.1 | 25.9 MB | ########## | 100%  2023-08-31T21:56:49.4234079Z 2023-08-31T21:56:49.4237128Z 2023-08-31T21:56:49.4327237Z icu-73.1 | 25.9 MB | ########## | 100%  2023-08-31T21:56:49.4327877Z 2023-08-31T21:56:49.4328087Z 2023-08-31T21:56:49.4328356Z  2023-08-31T21:56:49.4328513Z 2023-08-31T21:56:49.4328519Z 2023-08-31T21:56:49.4328682Z  2023-08-31T21:56:49.4329090Z 2023-08-31T21:56:49.4329097Z 2023-08-31T21:56:49.4329103Z 2023-08-31T21:56:49.4329302Z  2023-08-31T21:56:49.4329450Z 2023-08-31T21:56:49.4329456Z 2023-08-31T21:56:49.4329461Z 2023-08-31T21:56:49.4329467Z 2023-08-31T21:56:49.4329940Z  2023-08-31T21:56:49.4330092Z 2023-08-31T21:56:49.4330097Z 2023-08-31T21:56:49.4330102Z 2023-08-31T21:56:49.4330108Z 2023-08-31T21:56:49.4330112Z 2023-08-31T21:56:49.4330300Z  2023-08-31T21:56:49.4330455Z 2023-08-31T21:56:49.4330460Z 2023-08-31T21:56:49.4330475Z 2023-08-31T21:56:49.4330481Z 2023-08-31T21:56:49.4330485Z 2023-08-31T21:56:49.4330490Z 2023-08-31T21:56:49.4330678Z  2023-08-31T21:56:49.4330831Z 2023-08-31T21:56:49.4330837Z 2023-08-31T21:56:49.4330842Z 2023-08-31T21:56:49.4330847Z 2023-08-31T21:56:49.4330852Z 2023-08-31T21:56:49.4330857Z 2023-08-31T21:56:49.4330861Z 2023-08-31T21:56:49.4331048Z  2023-08-31T21:56:49.4331207Z 2023-08-31T21:56:49.4331212Z 2023-08-31T21:56:49.4331217Z 2023-08-31T21:56:49.4331227Z 2023-08-31T21:56:49.4331232Z 2023-08-31T21:56:49.4331237Z 2023-08-31T21:56:49.4331241Z 2023-08-31T21:56:49.4331246Z 2023-08-31T21:56:49.4331440Z  2023-08-31T21:56:49.4331597Z 2023-08-31T21:56:49.4331602Z 2023-08-31T21:56:49.4331607Z 2023-08-31T21:56:49.4331612Z 2023-08-31T21:56:49.4331616Z 2023-08-31T21:56:49.4331627Z 2023-08-31T21:56:49.4331632Z 2023-08-31T21:56:49.4331637Z 2023-08-31T21:56:49.4331642Z 2023-08-31T21:56:49.4331840Z  2023-08-31T21:56:49.4647046Z Preparing transaction: ...working... done 2023-08-31T21:56:49.8002240Z Verifying transaction: ...working... done 2023-08-31T21:56:49.9182616Z Executing transaction: ...working... done 2023-08-31T21:56:51.1099229Z ##[endgroup] 2023-08-31T21:56:51.1100938Z ##[group]Installing conda python 3.9 2023-08-31T21:56:51.1116061Z [command]/usr/share/miniconda/bin/conda create -y -n __setup_conda python=3.9 2023-08-31T21:57:04.8342155Z Collecting package metadata (current_repodata.json): ...working... done 2023-08-31T21:57:05.2376142Z Solving environment: ...working... done 2023-08-31T21:57:05.3064784Z 2023-08-31T21:57:05.3065041Z ## Package Plan ## 2023-08-31T21:57:05.3065280Z 2023-08-31T21:57:05.3065876Z environment location: /usr/share/miniconda/envs/__setup_conda 2023-08-31T21:57:05.3066087Z 2023-08-31T21:57:05.3066259Z added / updated specs: 2023-08-31T21:57:05.3066688Z - python=3.9 2023-08-31T21:57:05.3068085Z 2023-08-31T21:57:05.3068318Z 2023-08-31T21:57:05.3068596Z The following packages will be downloaded: 2023-08-31T21:57:05.3068942Z 2023-08-31T21:57:05.3069467Z package | build 2023-08-31T21:57:05.3071052Z ---------------------------|----------------- 2023-08-31T21:57:05.3071622Z _libgcc_mutex-0.1 | conda_forge 3 KB conda-forge 2023-08-31T21:57:05.3072224Z _openmp_mutex-4.5 | 2_gnu 23 KB conda-forge 2023-08-31T21:57:05.3072939Z bzip2-1.0.8 | h7f98852_4 484 KB conda-forge 2023-08-31T21:57:05.3073369Z ca-certificates-2023.7.22 | hbcca054_0 146 KB conda-forge 2023-08-31T21:57:05.3083446Z ld_impl_linux-64-2.40 | h41732ed_0 688 KB conda-forge 2023-08-31T21:57:05.3084254Z libffi-3.4.2 | h7f98852_5 57 KB conda-forge 2023-08-31T21:57:05.3084734Z libgcc-ng-13.1.0 | he5830b7_0 758 KB conda-forge 2023-08-31T21:57:05.3085146Z libgomp-13.1.0 | he5830b7_0 409 KB conda-forge 2023-08-31T21:57:05.3085533Z libnsl-2.0.0 | h7f98852_0 31 KB conda-forge 2023-08-31T21:57:05.3085910Z libsqlite-3.43.0 | h2797004_0 821 KB conda-forge 2023-08-31T21:57:05.3086483Z libuuid-2.38.1 | h0b41bf4_0 33 KB conda-forge 2023-08-31T21:57:05.3087109Z libzlib-1.2.13 | hd590300_5 60 KB conda-forge 2023-08-31T21:57:05.3087491Z ncurses-6.4 | hcb278e6_0 860 KB conda-forge 2023-08-31T21:57:05.3087855Z openssl-3.1.2 | hd590300_0 2.5 MB conda-forge 2023-08-31T21:57:05.3088247Z pip-23.2.1 | pyhd8ed1ab_0 1.3 MB conda-forge 2023-08-31T21:57:05.3088644Z python-3.9.18 |h0755675_0_cpython 22.7 MB conda-forge 2023-08-31T21:57:05.3089024Z readline-8.2 | h8228510_1 275 KB conda-forge 2023-08-31T21:57:05.3089412Z setuptools-68.1.2 | pyhd8ed1ab_0 451 KB conda-forge 2023-08-31T21:57:05.3091094Z tk-8.6.12 | h27826a3_0 3.3 MB conda-forge 2023-08-31T21:57:05.3091481Z tzdata-2023c | h71feb2d_0 115 KB conda-forge 2023-08-31T21:57:05.3091854Z wheel-0.41.2 | pyhd8ed1ab_0 56 KB conda-forge 2023-08-31T21:57:05.3092254Z xz-5.2.6 | h166bdaf_0 409 KB conda-forge 2023-08-31T21:57:05.3093310Z ------------------------------------------------------------ 2023-08-31T21:57:05.3093584Z Total: 35.4 MB 2023-08-31T21:57:05.3093741Z 2023-08-31T21:57:05.3093887Z The following NEW packages will be INSTALLED: 2023-08-31T21:57:05.3094062Z 2023-08-31T21:57:05.3115756Z _libgcc_mutex conda-forge/linux-64::_libgcc_mutex-0.1-conda_forge 2023-08-31T21:57:05.3116306Z _openmp_mutex conda-forge/linux-64::_openmp_mutex-4.5-2_gnu 2023-08-31T21:57:05.3116749Z bzip2 conda-forge/linux-64::bzip2-1.0.8-h7f98852_4 2023-08-31T21:57:05.3117232Z ca-certificates conda-forge/linux-64::ca-certificates-2023.7.22-hbcca054_0 2023-08-31T21:57:05.3117731Z ld_impl_linux-64 conda-forge/linux-64::ld_impl_linux-64-2.40-h41732ed_0 2023-08-31T21:57:05.3158462Z libffi conda-forge/linux-64::libffi-3.4.2-h7f98852_5 2023-08-31T21:57:05.3159003Z libgcc-ng conda-forge/linux-64::libgcc-ng-13.1.0-he5830b7_0 2023-08-31T21:57:05.3159472Z libgomp conda-forge/linux-64::libgomp-13.1.0-he5830b7_0 2023-08-31T21:57:05.3159911Z libnsl conda-forge/linux-64::libnsl-2.0.0-h7f98852_0 2023-08-31T21:57:05.3160564Z libsqlite conda-forge/linux-64::libsqlite-3.43.0-h2797004_0 2023-08-31T21:57:05.3161013Z libuuid conda-forge/linux-64::libuuid-2.38.1-h0b41bf4_0 2023-08-31T21:57:05.3161445Z libzlib conda-forge/linux-64::libzlib-1.2.13-hd590300_5 2023-08-31T21:57:05.3161869Z ncurses conda-forge/linux-64::ncurses-6.4-hcb278e6_0 2023-08-31T21:57:05.3162301Z openssl conda-forge/linux-64::openssl-3.1.2-hd590300_0 2023-08-31T21:57:05.3162744Z pip conda-forge/noarch::pip-23.2.1-pyhd8ed1ab_0 2023-08-31T21:57:05.3163198Z python conda-forge/linux-64::python-3.9.18-h0755675_0_cpython 2023-08-31T21:57:05.3163648Z readline conda-forge/linux-64::readline-8.2-h8228510_1 2023-08-31T21:57:05.3164096Z setuptools conda-forge/noarch::setuptools-68.1.2-pyhd8ed1ab_0 2023-08-31T21:57:05.3184861Z tk conda-forge/linux-64::tk-8.6.12-h27826a3_0 2023-08-31T21:57:05.3185452Z tzdata conda-forge/noarch::tzdata-2023c-h71feb2d_0 2023-08-31T21:57:05.3185898Z wheel conda-forge/noarch::wheel-0.41.2-pyhd8ed1ab_0 2023-08-31T21:57:05.3186309Z xz conda-forge/linux-64::xz-5.2.6-h166bdaf_0 2023-08-31T21:57:05.3186478Z 2023-08-31T21:57:05.3186485Z 2023-08-31T21:57:05.3186490Z 2023-08-31T21:57:05.3186607Z Downloading and Extracting Packages 2023-08-31T21:57:05.3186767Z 2023-08-31T21:57:05.3186977Z readline-8.2 | 275 KB | | 0% 2023-08-31T21:57:05.3206882Z 2023-08-31T21:57:05.3207184Z libgomp-13.1.0 | 409 KB | | 0%  2023-08-31T21:57:05.3207358Z 2023-08-31T21:57:05.3207596Z 2023-08-31T21:57:05.3253067Z _openmp_mutex-4.5 | 23 KB | | 0%  2023-08-31T21:57:05.3253277Z 2023-08-31T21:57:05.3253284Z 2023-08-31T21:57:05.3253289Z 2023-08-31T21:57:05.3276121Z openssl-3.1.2 | 2.5 MB | | 0%  2023-08-31T21:57:05.3276314Z 2023-08-31T21:57:05.3276320Z 2023-08-31T21:57:05.3276325Z 2023-08-31T21:57:05.3276345Z 2023-08-31T21:57:05.3296317Z ncurses-6.4 | 860 KB | | 0%  2023-08-31T21:57:05.3296502Z 2023-08-31T21:57:05.3296508Z 2023-08-31T21:57:05.3296514Z 2023-08-31T21:57:05.3296519Z 2023-08-31T21:57:05.3296524Z 2023-08-31T21:57:05.3296734Z libuuid-2.38.1 | 33 KB | | 0%  2023-08-31T21:57:05.3296913Z 2023-08-31T21:57:05.3296918Z 2023-08-31T21:57:05.3296923Z 2023-08-31T21:57:05.3296928Z 2023-08-31T21:57:05.3296934Z 2023-08-31T21:57:05.3296938Z 2023-08-31T21:57:05.3297164Z ca-certificates-2023 | 146 KB | | 0%  2023-08-31T21:57:05.3297368Z 2023-08-31T21:57:05.3297373Z 2023-08-31T21:57:05.3297379Z 2023-08-31T21:57:05.3297384Z 2023-08-31T21:57:05.3297388Z 2023-08-31T21:57:05.3297393Z 2023-08-31T21:57:05.3297398Z 2023-08-31T21:57:05.3298980Z setuptools-68.1.2 | 451 KB | | 0%  2023-08-31T21:57:05.3299260Z 2023-08-31T21:57:05.3299341Z 2023-08-31T21:57:05.3299427Z 2023-08-31T21:57:05.3299498Z 2023-08-31T21:57:05.3299568Z 2023-08-31T21:57:05.3299637Z 2023-08-31T21:57:05.3299707Z 2023-08-31T21:57:05.3299776Z 2023-08-31T21:57:05.3300070Z libgcc-ng-13.1.0 | 758 KB | | 0%  2023-08-31T21:57:05.3300316Z 2023-08-31T21:57:05.3300388Z 2023-08-31T21:57:05.3300456Z 2023-08-31T21:57:05.3300525Z 2023-08-31T21:57:05.3300594Z 2023-08-31T21:57:05.3300664Z 2023-08-31T21:57:05.3300732Z 2023-08-31T21:57:05.3300800Z 2023-08-31T21:57:05.3300868Z 2023-08-31T21:57:05.3302413Z ld_impl_linux-64-2.4 | 688 KB | | 0%  2023-08-31T21:57:05.3302690Z 2023-08-31T21:57:05.3302759Z 2023-08-31T21:57:05.3302828Z 2023-08-31T21:57:05.3302908Z 2023-08-31T21:57:05.3302979Z 2023-08-31T21:57:05.3303047Z 2023-08-31T21:57:05.3303115Z 2023-08-31T21:57:05.3303185Z 2023-08-31T21:57:05.3303253Z 2023-08-31T21:57:05.3303321Z 2023-08-31T21:57:05.3303831Z libsqlite-3.43.0 | 821 KB | | 0%  2023-08-31T21:57:05.3304099Z 2023-08-31T21:57:05.3304171Z 2023-08-31T21:57:05.3304241Z 2023-08-31T21:57:05.3304312Z 2023-08-31T21:57:05.3304383Z 2023-08-31T21:57:05.3304451Z 2023-08-31T21:57:05.3304520Z 2023-08-31T21:57:05.3304589Z 2023-08-31T21:57:05.3304659Z 2023-08-31T21:57:05.3304736Z 2023-08-31T21:57:05.3304806Z 2023-08-31T21:57:05.3305123Z _libgcc_mutex-0.1 | 3 KB | | 0%  2023-08-31T21:57:05.3305373Z 2023-08-31T21:57:05.3305452Z 2023-08-31T21:57:05.3305521Z 2023-08-31T21:57:05.3305589Z 2023-08-31T21:57:05.3305659Z 2023-08-31T21:57:05.3305734Z 2023-08-31T21:57:05.3305803Z 2023-08-31T21:57:05.3305871Z 2023-08-31T21:57:05.3305941Z 2023-08-31T21:57:05.3306010Z 2023-08-31T21:57:05.3306763Z 2023-08-31T21:57:05.3306848Z 2023-08-31T21:57:05.3307196Z xz-5.2.6 | 409 KB | | 0%  2023-08-31T21:57:05.3307451Z 2023-08-31T21:57:05.3307521Z 2023-08-31T21:57:05.3307595Z 2023-08-31T21:57:05.3308781Z 2023-08-31T21:57:05.3308862Z 2023-08-31T21:57:05.3308944Z 2023-08-31T21:57:05.3309013Z 2023-08-31T21:57:05.3309083Z 2023-08-31T21:57:05.3309152Z 2023-08-31T21:57:05.3309220Z 2023-08-31T21:57:05.3309288Z 2023-08-31T21:57:05.3309358Z 2023-08-31T21:57:05.3309426Z 2023-08-31T21:57:05.3309756Z bzip2-1.0.8 | 484 KB | | 0%  2023-08-31T21:57:05.3310013Z 2023-08-31T21:57:05.3310089Z 2023-08-31T21:57:05.3310158Z 2023-08-31T21:57:05.3310226Z 2023-08-31T21:57:05.3310295Z 2023-08-31T21:57:05.3310364Z 2023-08-31T21:57:05.3311089Z 2023-08-31T21:57:05.3311181Z 2023-08-31T21:57:05.3311252Z 2023-08-31T21:57:05.3311324Z 2023-08-31T21:57:05.3311394Z 2023-08-31T21:57:05.3311463Z 2023-08-31T21:57:05.3311533Z 2023-08-31T21:57:05.3311608Z 2023-08-31T21:57:05.3311949Z wheel-0.41.2 | 56 KB | | 0%  2023-08-31T21:57:05.3312210Z 2023-08-31T21:57:05.3312286Z 2023-08-31T21:57:05.3312356Z 2023-08-31T21:57:05.3312425Z 2023-08-31T21:57:05.3312494Z 2023-08-31T21:57:05.3312564Z 2023-08-31T21:57:05.3312634Z 2023-08-31T21:57:05.3312703Z 2023-08-31T21:57:05.3312771Z 2023-08-31T21:57:05.3312852Z 2023-08-31T21:57:05.3312923Z 2023-08-31T21:57:05.3312992Z 2023-08-31T21:57:05.3313061Z 2023-08-31T21:57:05.3313129Z 2023-08-31T21:57:05.3313200Z 2023-08-31T21:57:05.3313516Z python-3.9.18 | 22.7 MB | | 0%  2023-08-31T21:57:05.3313777Z 2023-08-31T21:57:05.3313847Z 2023-08-31T21:57:05.3313924Z 2023-08-31T21:57:05.3313994Z 2023-08-31T21:57:05.3314063Z 2023-08-31T21:57:05.3314132Z 2023-08-31T21:57:05.3314203Z 2023-08-31T21:57:05.3314272Z 2023-08-31T21:57:05.3314344Z 2023-08-31T21:57:05.3314422Z 2023-08-31T21:57:05.3314495Z 2023-08-31T21:57:05.3314565Z 2023-08-31T21:57:05.3314634Z 2023-08-31T21:57:05.3314703Z 2023-08-31T21:57:05.3314773Z 2023-08-31T21:57:05.3314842Z 2023-08-31T21:57:05.3315191Z libnsl-2.0.0 | 31 KB | | 0%  2023-08-31T21:57:05.3315449Z 2023-08-31T21:57:05.3315521Z 2023-08-31T21:57:05.3315590Z 2023-08-31T21:57:05.3315660Z 2023-08-31T21:57:05.3315729Z 2023-08-31T21:57:05.3315799Z 2023-08-31T21:57:05.3315869Z 2023-08-31T21:57:05.3315946Z 2023-08-31T21:57:05.3316016Z 2023-08-31T21:57:05.3316095Z 2023-08-31T21:57:05.3316165Z 2023-08-31T21:57:05.3316234Z 2023-08-31T21:57:05.3316303Z 2023-08-31T21:57:05.3316373Z 2023-08-31T21:57:05.3316443Z 2023-08-31T21:57:05.3316511Z 2023-08-31T21:57:05.3316587Z 2023-08-31T21:57:05.3316907Z tzdata-2023c | 115 KB | | 0%  2023-08-31T21:57:05.3317168Z 2023-08-31T21:57:05.3317238Z 2023-08-31T21:57:05.3317306Z 2023-08-31T21:57:05.3317377Z 2023-08-31T21:57:05.3317446Z 2023-08-31T21:57:05.3317515Z 2023-08-31T21:57:05.3317584Z 2023-08-31T21:57:05.3317661Z 2023-08-31T21:57:05.3317837Z 2023-08-31T21:57:05.3317912Z 2023-08-31T21:57:05.3317982Z 2023-08-31T21:57:05.3318053Z 2023-08-31T21:57:05.3318123Z 2023-08-31T21:57:05.3318192Z 2023-08-31T21:57:05.3318261Z 2023-08-31T21:57:05.3318331Z 2023-08-31T21:57:05.3318400Z 2023-08-31T21:57:05.3318470Z 2023-08-31T21:57:05.3318794Z libffi-3.4.2 | 57 KB | | 0%  2023-08-31T21:57:05.3319052Z 2023-08-31T21:57:05.3319122Z 2023-08-31T21:57:05.3319191Z 2023-08-31T21:57:05.3319259Z 2023-08-31T21:57:05.3319329Z 2023-08-31T21:57:05.3319405Z 2023-08-31T21:57:05.3319480Z 2023-08-31T21:57:05.3319549Z 2023-08-31T21:57:05.3319619Z 2023-08-31T21:57:05.3319688Z 2023-08-31T21:57:05.3319757Z 2023-08-31T21:57:05.3319825Z 2023-08-31T21:57:05.3319895Z 2023-08-31T21:57:05.3319964Z 2023-08-31T21:57:05.3320033Z 2023-08-31T21:57:05.3320101Z 2023-08-31T21:57:05.3320171Z 2023-08-31T21:57:05.3320240Z 2023-08-31T21:57:05.3320317Z 2023-08-31T21:57:05.4400249Z ... (more hidden) ... 2023-08-31T21:57:05.4730092Z readline-8.2 | 275 KB | 5 | 6% 2023-08-31T21:57:05.4914565Z readline-8.2 | 275 KB | ########## | 100% 2023-08-31T21:57:05.4914895Z 2023-08-31T21:57:05.4914976Z 2023-08-31T21:57:05.4915055Z 2023-08-31T21:57:05.4959576Z openssl-3.1.2 | 2.5 MB | | 1%  2023-08-31T21:57:05.4959908Z 2023-08-31T21:57:05.4959987Z 2023-08-31T21:57:05.5060304Z _openmp_mutex-4.5 | 23 KB | ######9 | 69%  2023-08-31T21:57:05.5060524Z 2023-08-31T21:57:05.5060749Z 2023-08-31T21:57:05.5060755Z 2023-08-31T21:57:05.5060761Z 2023-08-31T21:57:05.5060766Z 2023-08-31T21:57:05.5061003Z libuuid-2.38.1 | 33 KB | ####8 | 49%  2023-08-31T21:57:05.5061186Z 2023-08-31T21:57:05.5061191Z 2023-08-31T21:57:05.5061197Z 2023-08-31T21:57:05.5062734Z 2023-08-31T21:57:05.5095623Z ncurses-6.4 | 860 KB | 1 | 2%  2023-08-31T21:57:05.5095990Z 2023-08-31T21:57:05.5325452Z libgomp-13.1.0 | 409 KB | 3 | 4%  2023-08-31T21:57:05.5325832Z 2023-08-31T21:57:05.5325912Z 2023-08-31T21:57:05.5325984Z 2023-08-31T21:57:05.5326060Z 2023-08-31T21:57:05.5326130Z 2023-08-31T21:57:05.5326200Z 2023-08-31T21:57:05.5419202Z ca-certificates-2023 | 146 KB | # | 11%  2023-08-31T21:57:05.5419797Z 2023-08-31T21:57:05.5419963Z 2023-08-31T21:57:05.5420070Z 2023-08-31T21:57:05.5420176Z 2023-08-31T21:57:05.5426018Z 2023-08-31T21:57:05.5447752Z libuuid-2.38.1 | 33 KB | ########## | 100%  2023-08-31T21:57:05.5448246Z 2023-08-31T21:57:05.5449098Z 2023-08-31T21:57:05.5449247Z 2023-08-31T21:57:05.5449390Z 2023-08-31T21:57:05.5449576Z 2023-08-31T21:57:05.5449716Z 2023-08-31T21:57:05.5449972Z 2023-08-31T21:57:05.5604645Z setuptools-68.1.2 | 451 KB | 3 | 4%  2023-08-31T21:57:05.5605076Z 2023-08-31T21:57:05.5605617Z 2023-08-31T21:57:05.5605771Z 2023-08-31T21:57:05.5605915Z 2023-08-31T21:57:05.5606056Z 2023-08-31T21:57:05.5606650Z 2023-08-31T21:57:05.5607107Z 2023-08-31T21:57:05.5609370Z 2023-08-31T21:57:05.5718205Z libgcc-ng-13.1.0 | 758 KB | 2 | 2%  2023-08-31T21:57:05.5718677Z 2023-08-31T21:57:05.5722535Z 2023-08-31T21:57:05.5823603Z _openmp_mutex-4.5 | 23 KB | ########## | 100%  2023-08-31T21:57:05.5824000Z 2023-08-31T21:57:05.5824365Z 2023-08-31T21:57:05.5824514Z 2023-08-31T21:57:05.5824657Z 2023-08-31T21:57:05.5824799Z 2023-08-31T21:57:05.5824940Z 2023-08-31T21:57:05.5825115Z 2023-08-31T21:57:05.5825284Z 2023-08-31T21:57:05.5825418Z 2023-08-31T21:57:05.5834787Z ld_impl_linux-64-2.4 | 688 KB | 2 | 2%  2023-08-31T21:57:05.5835146Z 2023-08-31T21:57:05.5835266Z 2023-08-31T21:57:05.5835462Z 2023-08-31T21:57:05.5835710Z 2023-08-31T21:57:05.5837615Z 2023-08-31T21:57:05.5837623Z 2023-08-31T21:57:05.5837848Z 2023-08-31T21:57:05.5837856Z 2023-08-31T21:57:05.5837863Z 2023-08-31T21:57:05.5844464Z 2023-08-31T21:57:05.5880706Z libsqlite-3.43.0 | 821 KB | 1 | 2%  2023-08-31T21:57:05.5881453Z 2023-08-31T21:57:05.5881584Z 2023-08-31T21:57:05.5881719Z 2023-08-31T21:57:05.5881939Z 2023-08-31T21:57:05.5882273Z 2023-08-31T21:57:05.5882417Z 2023-08-31T21:57:05.5882558Z 2023-08-31T21:57:05.5882701Z 2023-08-31T21:57:05.5882841Z 2023-08-31T21:57:05.5883000Z 2023-08-31T21:57:05.5890234Z 2023-08-31T21:57:05.6027297Z _libgcc_mutex-0.1 | 3 KB | ########## | 100%  2023-08-31T21:57:05.6027739Z 2023-08-31T21:57:05.6028088Z 2023-08-31T21:57:05.6028263Z 2023-08-31T21:57:05.6028406Z 2023-08-31T21:57:05.6028547Z 2023-08-31T21:57:05.6028691Z 2023-08-31T21:57:05.6028837Z 2023-08-31T21:57:05.6029033Z 2023-08-31T21:57:05.6029227Z 2023-08-31T21:57:05.6029400Z 2023-08-31T21:57:05.6029634Z 2023-08-31T21:57:05.6029883Z 2023-08-31T21:57:05.6054529Z xz-5.2.6 | 409 KB | 3 | 4%  2023-08-31T21:57:05.6055505Z 2023-08-31T21:57:05.6113221Z libgomp-13.1.0 | 409 KB | ########## | 100%  2023-08-31T21:57:05.6113597Z 2023-08-31T21:57:05.6113720Z 2023-08-31T21:57:05.6113949Z 2023-08-31T21:57:05.6116048Z 2023-08-31T21:57:05.6116194Z 2023-08-31T21:57:05.6116337Z 2023-08-31T21:57:05.6116564Z 2023-08-31T21:57:05.6116768Z 2023-08-31T21:57:05.6116968Z 2023-08-31T21:57:05.6117199Z 2023-08-31T21:57:05.6117401Z 2023-08-31T21:57:05.6117659Z 2023-08-31T21:57:05.6122389Z 2023-08-31T21:57:05.6253896Z bzip2-1.0.8 | 484 KB | 3 | 3%  2023-08-31T21:57:05.6254334Z 2023-08-31T21:57:05.6254732Z 2023-08-31T21:57:05.6254891Z 2023-08-31T21:57:05.6255033Z 2023-08-31T21:57:05.6255177Z 2023-08-31T21:57:05.6255319Z 2023-08-31T21:57:05.6255459Z 2023-08-31T21:57:05.6255592Z 2023-08-31T21:57:05.6255755Z 2023-08-31T21:57:05.6255915Z 2023-08-31T21:57:05.6256149Z 2023-08-31T21:57:05.6256354Z 2023-08-31T21:57:05.6256634Z 2023-08-31T21:57:05.6256839Z 2023-08-31T21:57:05.6355082Z wheel-0.41.2 | 56 KB | ##8 | 28%  2023-08-31T21:57:05.6355513Z 2023-08-31T21:57:05.6356095Z 2023-08-31T21:57:05.6356269Z 2023-08-31T21:57:05.6356427Z 2023-08-31T21:57:05.6356570Z 2023-08-31T21:57:05.6368123Z 2023-08-31T21:57:05.6375915Z ca-certificates-2023 | 146 KB | ########## | 100%  2023-08-31T21:57:05.6376310Z 2023-08-31T21:57:05.6376734Z 2023-08-31T21:57:05.6376899Z 2023-08-31T21:57:05.6377041Z 2023-08-31T21:57:05.6377182Z 2023-08-31T21:57:05.6381121Z 2023-08-31T21:57:05.6445018Z ca-certificates-2023 | 146 KB | ########## | 100%  2023-08-31T21:57:05.6445433Z 2023-08-31T21:57:05.6445829Z 2023-08-31T21:57:05.6445974Z 2023-08-31T21:57:05.6446120Z 2023-08-31T21:57:05.6446420Z 2023-08-31T21:57:05.6446564Z 2023-08-31T21:57:05.6446844Z 2023-08-31T21:57:05.6447696Z 2023-08-31T21:57:05.6447964Z 2023-08-31T21:57:05.6448191Z 2023-08-31T21:57:05.6448361Z 2023-08-31T21:57:05.6448602Z 2023-08-31T21:57:05.6448757Z 2023-08-31T21:57:05.6449002Z 2023-08-31T21:57:05.6449161Z 2023-08-31T21:57:05.6748081Z python-3.9.18 | 22.7 MB | | 0%  2023-08-31T21:57:05.6748512Z 2023-08-31T21:57:05.6748913Z 2023-08-31T21:57:05.6749056Z 2023-08-31T21:57:05.6749205Z 2023-08-31T21:57:05.6749349Z 2023-08-31T21:57:05.6749491Z 2023-08-31T21:57:05.6749635Z 2023-08-31T21:57:05.6749771Z 2023-08-31T21:57:05.6749946Z 2023-08-31T21:57:05.6750090Z 2023-08-31T21:57:05.6750282Z 2023-08-31T21:57:05.6750515Z 2023-08-31T21:57:05.6750715Z 2023-08-31T21:57:05.6750975Z 2023-08-31T21:57:05.6751176Z 2023-08-31T21:57:05.6751379Z 2023-08-31T21:57:05.6757637Z libnsl-2.0.0 | 31 KB | #####2 | 52%  2023-08-31T21:57:05.6758176Z 2023-08-31T21:57:05.6758309Z 2023-08-31T21:57:05.6758497Z 2023-08-31T21:57:05.6760563Z 2023-08-31T21:57:05.6760661Z 2023-08-31T21:57:05.6761141Z 2023-08-31T21:57:05.6761252Z 2023-08-31T21:57:05.6761362Z 2023-08-31T21:57:05.6761504Z 2023-08-31T21:57:05.6761612Z 2023-08-31T21:57:05.6761720Z 2023-08-31T21:57:05.6761862Z 2023-08-31T21:57:05.6761968Z 2023-08-31T21:57:05.6762076Z 2023-08-31T21:57:05.6762185Z 2023-08-31T21:57:05.6762292Z 2023-08-31T21:57:05.6762433Z 2023-08-31T21:57:05.6762540Z 2023-08-31T21:57:05.6769885Z 2023-08-31T21:57:05.6782907Z ... (more hidden) ... 2023-08-31T21:57:05.6783287Z 2023-08-31T21:57:05.6783438Z 2023-08-31T21:57:05.6783546Z 2023-08-31T21:57:05.6783761Z 2023-08-31T21:57:05.6783789Z 2023-08-31T21:57:05.6783849Z 2023-08-31T21:57:05.6783856Z 2023-08-31T21:57:05.6783862Z 2023-08-31T21:57:05.6783867Z 2023-08-31T21:57:05.6783898Z 2023-08-31T21:57:05.6807831Z 2023-08-31T21:57:05.6808059Z 2023-08-31T21:57:05.6808234Z 2023-08-31T21:57:05.6808345Z 2023-08-31T21:57:05.6808467Z 2023-08-31T21:57:05.6808652Z 2023-08-31T21:57:05.6808936Z 2023-08-31T21:57:05.6809354Z tzdata-2023c | 115 KB | #3 | 14%  2023-08-31T21:57:05.6809577Z 2023-08-31T21:57:05.6809584Z 2023-08-31T21:57:05.6809590Z 2023-08-31T21:57:05.6809595Z 2023-08-31T21:57:05.6809601Z 2023-08-31T21:57:05.6809606Z 2023-08-31T21:57:05.6809610Z 2023-08-31T21:57:05.6809615Z 2023-08-31T21:57:05.6809620Z 2023-08-31T21:57:05.6809624Z 2023-08-31T21:57:05.6809628Z 2023-08-31T21:57:05.6809633Z 2023-08-31T21:57:05.6809833Z 2023-08-31T21:57:05.6809838Z 2023-08-31T21:57:05.6809843Z 2023-08-31T21:57:05.6809848Z 2023-08-31T21:57:05.6809852Z 2023-08-31T21:57:05.6809857Z 2023-08-31T21:57:05.7450153Z libffi-3.4.2 | 57 KB | ##8 | 28%  2023-08-31T21:57:05.7450548Z 2023-08-31T21:57:05.7450625Z 2023-08-31T21:57:05.7450715Z 2023-08-31T21:57:05.7450798Z 2023-08-31T21:57:05.7450869Z 2023-08-31T21:57:05.7450938Z 2023-08-31T21:57:05.7451008Z 2023-08-31T21:57:05.7451079Z 2023-08-31T21:57:05.7451157Z 2023-08-31T21:57:05.7451227Z 2023-08-31T21:57:05.7451295Z 2023-08-31T21:57:05.7451365Z 2023-08-31T21:57:05.7451433Z 2023-08-31T21:57:05.7451501Z 2023-08-31T21:57:05.7451571Z 2023-08-31T21:57:05.8128196Z python-3.9.18 | 22.7 MB | #2 | 12%  2023-08-31T21:57:05.8128601Z 2023-08-31T21:57:05.8128680Z 2023-08-31T21:57:05.8128753Z 2023-08-31T21:57:05.8128829Z 2023-08-31T21:57:05.8128922Z 2023-08-31T21:57:05.8129005Z 2023-08-31T21:57:05.8135087Z 2023-08-31T21:57:05.8160595Z setuptools-68.1.2 | 451 KB | ########## | 100%  2023-08-31T21:57:05.8160978Z 2023-08-31T21:57:05.8161053Z 2023-08-31T21:57:05.8161124Z 2023-08-31T21:57:05.8161200Z 2023-08-31T21:57:05.8161270Z 2023-08-31T21:57:05.8161339Z 2023-08-31T21:57:05.8165620Z 2023-08-31T21:57:05.8450298Z setuptools-68.1.2 | 451 KB | ########## | 100%  2023-08-31T21:57:05.8450696Z 2023-08-31T21:57:05.8450773Z 2023-08-31T21:57:05.8450843Z 2023-08-31T21:57:05.8450918Z 2023-08-31T21:57:05.8450988Z 2023-08-31T21:57:05.8451059Z 2023-08-31T21:57:05.8451141Z 2023-08-31T21:57:05.8451213Z 2023-08-31T21:57:05.8451283Z 2023-08-31T21:57:05.8451352Z 2023-08-31T21:57:05.8451421Z 2023-08-31T21:57:05.8451491Z 2023-08-31T21:57:05.8451560Z 2023-08-31T21:57:05.8451628Z 2023-08-31T21:57:05.8451708Z 2023-08-31T21:57:06.1716122Z python-3.9.18 | 22.7 MB | ##4 | 25%  2023-08-31T21:57:06.1716594Z 2023-08-31T21:57:06.1716675Z 2023-08-31T21:57:06.1716747Z 2023-08-31T21:57:06.1716827Z 2023-08-31T21:57:06.1716898Z 2023-08-31T21:57:06.1716968Z 2023-08-31T21:57:06.1717041Z 2023-08-31T21:57:06.1717112Z 2023-08-31T21:57:06.1717186Z 2023-08-31T21:57:06.1717264Z 2023-08-31T21:57:06.1717334Z 2023-08-31T21:57:06.1717626Z 2023-08-31T21:57:06.1717705Z 2023-08-31T21:57:06.1717776Z 2023-08-31T21:57:06.1725013Z 2023-08-31T21:57:06.1778101Z python-3.9.18 | 22.7 MB | ####8 | 48%  2023-08-31T21:57:06.1778514Z 2023-08-31T21:57:06.1778786Z 2023-08-31T21:57:06.1781881Z 2023-08-31T21:57:06.1787032Z openssl-3.1.2 | 2.5 MB | ########## | 100%  2023-08-31T21:57:06.1787378Z 2023-08-31T21:57:06.1787457Z 2023-08-31T21:57:06.1790539Z 2023-08-31T21:57:06.2345288Z openssl-3.1.2 | 2.5 MB | ########## | 100%  2023-08-31T21:57:06.2345658Z 2023-08-31T21:57:06.2345765Z 2023-08-31T21:57:06.2345837Z 2023-08-31T21:57:06.2345917Z 2023-08-31T21:57:06.2345999Z 2023-08-31T21:57:06.2346069Z 2023-08-31T21:57:06.2346138Z 2023-08-31T21:57:06.2352101Z 2023-08-31T21:57:06.2359570Z libgcc-ng-13.1.0 | 758 KB | ########## | 100%  2023-08-31T21:57:06.2359932Z 2023-08-31T21:57:06.2360009Z 2023-08-31T21:57:06.2360106Z 2023-08-31T21:57:06.2360177Z 2023-08-31T21:57:06.2360246Z 2023-08-31T21:57:06.2360316Z 2023-08-31T21:57:06.2360387Z 2023-08-31T21:57:06.2363447Z 2023-08-31T21:57:06.2424441Z libgcc-ng-13.1.0 | 758 KB | ########## | 100%  2023-08-31T21:57:06.2424824Z 2023-08-31T21:57:06.2424908Z 2023-08-31T21:57:06.2424991Z 2023-08-31T21:57:06.2425062Z 2023-08-31T21:57:06.2425131Z 2023-08-31T21:57:06.2425201Z 2023-08-31T21:57:06.2425270Z 2023-08-31T21:57:06.2425340Z 2023-08-31T21:57:06.2425408Z 2023-08-31T21:57:06.2425478Z 2023-08-31T21:57:06.2428659Z 2023-08-31T21:57:06.2711701Z _libgcc_mutex-0.1 | 3 KB | ########## | 100%  2023-08-31T21:57:06.2712544Z 2023-08-31T21:57:06.2712817Z 2023-08-31T21:57:06.2712827Z 2023-08-31T21:57:06.2712833Z 2023-08-31T21:57:06.2712838Z 2023-08-31T21:57:06.2712844Z 2023-08-31T21:57:06.2712853Z 2023-08-31T21:57:06.2712890Z 2023-08-31T21:57:06.2717463Z 2023-08-31T21:57:06.2723065Z ld_impl_linux-64-2.4 | 688 KB | ########## | 100%  2023-08-31T21:57:06.2723454Z 2023-08-31T21:57:06.2723763Z 2023-08-31T21:57:06.2723935Z 2023-08-31T21:57:06.2724075Z 2023-08-31T21:57:06.2724217Z 2023-08-31T21:57:06.2724390Z 2023-08-31T21:57:06.2724604Z 2023-08-31T21:57:06.2724637Z 2023-08-31T21:57:06.2728775Z 2023-08-31T21:57:06.2735705Z ld_impl_linux-64-2.4 | 688 KB | ########## | 100%  2023-08-31T21:57:06.2736093Z 2023-08-31T21:57:06.2736409Z 2023-08-31T21:57:06.2736554Z 2023-08-31T21:57:06.2736701Z 2023-08-31T21:57:06.2736842Z 2023-08-31T21:57:06.2737021Z 2023-08-31T21:57:06.2737199Z 2023-08-31T21:57:06.2737208Z 2023-08-31T21:57:06.2737214Z 2023-08-31T21:57:06.2737259Z 2023-08-31T21:57:06.2737421Z 2023-08-31T21:57:06.2737554Z 2023-08-31T21:57:06.2737641Z 2023-08-31T21:57:06.2737648Z 2023-08-31T21:57:06.2750293Z 2023-08-31T21:57:06.4211978Z python-3.9.18 | 22.7 MB | ######9 | 70%  2023-08-31T21:57:06.4212498Z 2023-08-31T21:57:06.4213170Z 2023-08-31T21:57:06.4213326Z 2023-08-31T21:57:06.4213469Z 2023-08-31T21:57:06.4213641Z 2023-08-31T21:57:06.4213783Z 2023-08-31T21:57:06.4213940Z 2023-08-31T21:57:06.4214131Z 2023-08-31T21:57:06.4214275Z 2023-08-31T21:57:06.4214476Z 2023-08-31T21:57:06.4214709Z 2023-08-31T21:57:06.4220684Z 2023-08-31T21:57:06.4225095Z xz-5.2.6 | 409 KB | ########## | 100%  2023-08-31T21:57:06.4225470Z 2023-08-31T21:57:06.4225789Z 2023-08-31T21:57:06.4225935Z 2023-08-31T21:57:06.4226075Z 2023-08-31T21:57:06.4226234Z 2023-08-31T21:57:06.4226403Z 2023-08-31T21:57:06.4226514Z 2023-08-31T21:57:06.4226803Z 2023-08-31T21:57:06.4226988Z 2023-08-31T21:57:06.4227190Z 2023-08-31T21:57:06.4227197Z 2023-08-31T21:57:06.4231975Z 2023-08-31T21:57:06.4501681Z xz-5.2.6 | 409 KB | ########## | 100%  2023-08-31T21:57:06.4502119Z 2023-08-31T21:57:06.4503085Z 2023-08-31T21:57:06.4503263Z 2023-08-31T21:57:06.4503415Z 2023-08-31T21:57:06.4503546Z 2023-08-31T21:57:06.4503753Z 2023-08-31T21:57:06.4503787Z 2023-08-31T21:57:06.4503922Z 2023-08-31T21:57:06.4504020Z 2023-08-31T21:57:06.4507980Z 2023-08-31T21:57:06.4511297Z libsqlite-3.43.0 | 821 KB | ########## | 100%  2023-08-31T21:57:06.4511624Z 2023-08-31T21:57:06.4511631Z 2023-08-31T21:57:06.4511660Z 2023-08-31T21:57:06.4511752Z 2023-08-31T21:57:06.4511832Z 2023-08-31T21:57:06.4511838Z 2023-08-31T21:57:06.4511861Z 2023-08-31T21:57:06.4511867Z 2023-08-31T21:57:06.4511884Z 2023-08-31T21:57:06.4515941Z 2023-08-31T21:57:06.5570608Z libsqlite-3.43.0 | 821 KB | ########## | 100%  2023-08-31T21:57:06.5570851Z 2023-08-31T21:57:06.5571806Z 2023-08-31T21:57:06.5571813Z 2023-08-31T21:57:06.5571819Z 2023-08-31T21:57:06.5571824Z 2023-08-31T21:57:06.5571830Z 2023-08-31T21:57:06.5571849Z 2023-08-31T21:57:06.5571854Z 2023-08-31T21:57:06.5571882Z 2023-08-31T21:57:06.5571888Z 2023-08-31T21:57:06.5571893Z 2023-08-31T21:57:06.5571898Z 2023-08-31T21:57:06.5575570Z 2023-08-31T21:57:06.5580145Z bzip2-1.0.8 | 484 KB | ########## | 100%  2023-08-31T21:57:06.5580569Z 2023-08-31T21:57:06.5580815Z 2023-08-31T21:57:06.5580848Z 2023-08-31T21:57:06.5580955Z 2023-08-31T21:57:06.5580962Z 2023-08-31T21:57:06.5581011Z 2023-08-31T21:57:06.5581017Z 2023-08-31T21:57:06.5581650Z 2023-08-31T21:57:06.5581658Z 2023-08-31T21:57:06.5581664Z 2023-08-31T21:57:06.5581673Z 2023-08-31T21:57:06.5581678Z 2023-08-31T21:57:06.5585963Z 2023-08-31T21:57:06.5876957Z bzip2-1.0.8 | 484 KB | ########## | 100%  2023-08-31T21:57:06.5877433Z 2023-08-31T21:57:06.5877948Z 2023-08-31T21:57:06.5878091Z 2023-08-31T21:57:06.5878240Z 2023-08-31T21:57:06.5878413Z 2023-08-31T21:57:06.5878556Z 2023-08-31T21:57:06.5878712Z 2023-08-31T21:57:06.5878930Z 2023-08-31T21:57:06.5878988Z 2023-08-31T21:57:06.5879069Z 2023-08-31T21:57:06.5879091Z 2023-08-31T21:57:06.5879097Z 2023-08-31T21:57:06.5879102Z 2023-08-31T21:57:06.5882974Z 2023-08-31T21:57:06.5889222Z wheel-0.41.2 | 56 KB | ########## | 100%  2023-08-31T21:57:06.5889623Z 2023-08-31T21:57:06.5889899Z 2023-08-31T21:57:06.5890060Z 2023-08-31T21:57:06.5890203Z 2023-08-31T21:57:06.5890345Z 2023-08-31T21:57:06.5890516Z 2023-08-31T21:57:06.5890684Z 2023-08-31T21:57:06.5890877Z 2023-08-31T21:57:06.5890969Z 2023-08-31T21:57:06.5891032Z 2023-08-31T21:57:06.5891038Z 2023-08-31T21:57:06.5891055Z 2023-08-31T21:57:06.5891060Z 2023-08-31T21:57:06.5894689Z 2023-08-31T21:57:06.6072360Z wheel-0.41.2 | 56 KB | ########## | 100%  2023-08-31T21:57:06.6072784Z 2023-08-31T21:57:06.6073294Z 2023-08-31T21:57:06.6073442Z 2023-08-31T21:57:06.6073584Z 2023-08-31T21:57:06.6073755Z 2023-08-31T21:57:06.6073896Z 2023-08-31T21:57:06.6074070Z 2023-08-31T21:57:06.6074283Z 2023-08-31T21:57:06.6074292Z 2023-08-31T21:57:06.6074300Z 2023-08-31T21:57:06.6074306Z 2023-08-31T21:57:06.6074311Z 2023-08-31T21:57:06.6074316Z 2023-08-31T21:57:06.6074321Z 2023-08-31T21:57:06.6074326Z 2023-08-31T21:57:06.6078246Z 2023-08-31T21:57:06.6083938Z libnsl-2.0.0 | 31 KB | ########## | 100%  2023-08-31T21:57:06.6084331Z 2023-08-31T21:57:06.6084445Z 2023-08-31T21:57:06.6084642Z 2023-08-31T21:57:06.6084675Z 2023-08-31T21:57:06.6084681Z 2023-08-31T21:57:06.6084780Z 2023-08-31T21:57:06.6084916Z 2023-08-31T21:57:06.6085076Z 2023-08-31T21:57:06.6085083Z 2023-08-31T21:57:06.6085088Z 2023-08-31T21:57:06.6085093Z 2023-08-31T21:57:06.6085098Z 2023-08-31T21:57:06.6085103Z 2023-08-31T21:57:06.6085108Z 2023-08-31T21:57:06.6085113Z 2023-08-31T21:57:06.6089171Z 2023-08-31T21:57:06.6226006Z libnsl-2.0.0 | 31 KB | ########## | 100%  2023-08-31T21:57:06.6226254Z 2023-08-31T21:57:06.6226357Z 2023-08-31T21:57:06.6226376Z 2023-08-31T21:57:06.6226382Z 2023-08-31T21:57:06.6226387Z 2023-08-31T21:57:06.6226392Z 2023-08-31T21:57:06.6226397Z 2023-08-31T21:57:06.6226401Z 2023-08-31T21:57:06.6226406Z 2023-08-31T21:57:06.6226411Z 2023-08-31T21:57:06.6226416Z 2023-08-31T21:57:06.6226420Z 2023-08-31T21:57:06.6226425Z 2023-08-31T21:57:06.6226429Z 2023-08-31T21:57:06.6226433Z 2023-08-31T21:57:06.6226438Z 2023-08-31T21:57:06.6226442Z 2023-08-31T21:57:06.6226447Z 2023-08-31T21:57:06.6230189Z 2023-08-31T21:57:06.6234568Z ... (more hidden) ... 2023-08-31T21:57:06.6234982Z 2023-08-31T21:57:06.6235313Z 2023-08-31T21:57:06.6235458Z 2023-08-31T21:57:06.6235600Z 2023-08-31T21:57:06.6235743Z 2023-08-31T21:57:06.6235903Z 2023-08-31T21:57:06.6236102Z 2023-08-31T21:57:06.6236138Z 2023-08-31T21:57:06.6236144Z 2023-08-31T21:57:06.6236169Z 2023-08-31T21:57:06.6236313Z 2023-08-31T21:57:06.6236334Z 2023-08-31T21:57:06.6236368Z 2023-08-31T21:57:06.6236373Z 2023-08-31T21:57:06.6236378Z 2023-08-31T21:57:06.6236383Z 2023-08-31T21:57:06.6236388Z 2023-08-31T21:57:06.6236393Z 2023-08-31T21:57:06.6236398Z 2023-08-31T21:57:06.6470577Z ... (more hidden) ... 2023-08-31T21:57:06.6470990Z 2023-08-31T21:57:06.6471648Z 2023-08-31T21:57:06.6471804Z 2023-08-31T21:57:06.6472016Z 2023-08-31T21:57:06.6472054Z 2023-08-31T21:57:06.6472169Z 2023-08-31T21:57:06.6472175Z 2023-08-31T21:57:06.6472211Z 2023-08-31T21:57:06.6472217Z 2023-08-31T21:57:06.6472436Z 2023-08-31T21:57:06.6472443Z 2023-08-31T21:57:06.6472449Z 2023-08-31T21:57:06.6472479Z 2023-08-31T21:57:06.6472484Z 2023-08-31T21:57:06.6472489Z 2023-08-31T21:57:06.6472493Z 2023-08-31T21:57:06.6472498Z 2023-08-31T21:57:06.6477182Z 2023-08-31T21:57:06.6481823Z libffi-3.4.2 | 57 KB | ########## | 100%  2023-08-31T21:57:06.6482202Z 2023-08-31T21:57:06.6482643Z 2023-08-31T21:57:06.6482791Z 2023-08-31T21:57:06.6482995Z 2023-08-31T21:57:06.6483154Z 2023-08-31T21:57:06.6483283Z 2023-08-31T21:57:06.6483439Z 2023-08-31T21:57:06.6483658Z 2023-08-31T21:57:06.6483780Z 2023-08-31T21:57:06.6483964Z 2023-08-31T21:57:06.6484086Z 2023-08-31T21:57:06.6484260Z 2023-08-31T21:57:06.6484436Z 2023-08-31T21:57:06.6484558Z 2023-08-31T21:57:06.6484729Z 2023-08-31T21:57:06.6484886Z 2023-08-31T21:57:06.6485042Z 2023-08-31T21:57:06.6487590Z 2023-08-31T21:57:06.9436619Z libffi-3.4.2 | 57 KB | ########## | 100%  2023-08-31T21:57:06.9436918Z 2023-08-31T21:57:06.9436925Z 2023-08-31T21:57:06.9436931Z 2023-08-31T21:57:06.9436936Z 2023-08-31T21:57:06.9436942Z 2023-08-31T21:57:06.9436948Z 2023-08-31T21:57:06.9436963Z 2023-08-31T21:57:06.9436969Z 2023-08-31T21:57:06.9436974Z 2023-08-31T21:57:06.9436979Z 2023-08-31T21:57:06.9436983Z 2023-08-31T21:57:06.9437003Z 2023-08-31T21:57:06.9437008Z 2023-08-31T21:57:06.9437013Z 2023-08-31T21:57:06.9437017Z 2023-08-31T21:57:06.9437022Z 2023-08-31T21:57:06.9437203Z 2023-08-31T21:57:06.9439953Z tzdata-2023c | 115 KB | ########## | 100%  2023-08-31T21:57:06.9440251Z 2023-08-31T21:57:06.9440325Z 2023-08-31T21:57:06.9440400Z 2023-08-31T21:57:06.9440470Z 2023-08-31T21:57:06.9440539Z 2023-08-31T21:57:06.9440609Z 2023-08-31T21:57:06.9440681Z 2023-08-31T21:57:06.9440752Z 2023-08-31T21:57:06.9440820Z 2023-08-31T21:57:06.9440907Z 2023-08-31T21:57:06.9440978Z 2023-08-31T21:57:06.9441054Z 2023-08-31T21:57:06.9441123Z 2023-08-31T21:57:06.9441192Z 2023-08-31T21:57:06.9441262Z 2023-08-31T21:57:06.9441331Z 2023-08-31T21:57:06.9445033Z 2023-08-31T21:57:07.1374883Z tzdata-2023c | 115 KB | ########## | 100%  2023-08-31T21:57:07.1375334Z 2023-08-31T21:57:07.1375413Z 2023-08-31T21:57:07.1375719Z 2023-08-31T21:57:07.1380972Z 2023-08-31T21:57:07.1385529Z ncurses-6.4 | 860 KB | ########## | 100%  2023-08-31T21:57:07.1385871Z 2023-08-31T21:57:07.1385945Z 2023-08-31T21:57:07.1386026Z 2023-08-31T21:57:07.1389020Z 2023-08-31T21:57:07.9301600Z ncurses-6.4 | 860 KB | ########## | 100%  2023-08-31T21:57:07.9303295Z 2023-08-31T21:57:07.9303571Z 2023-08-31T21:57:07.9303581Z 2023-08-31T21:57:07.9303588Z 2023-08-31T21:57:07.9303594Z 2023-08-31T21:57:07.9303600Z 2023-08-31T21:57:07.9303606Z 2023-08-31T21:57:07.9303611Z 2023-08-31T21:57:07.9303616Z 2023-08-31T21:57:07.9303647Z 2023-08-31T21:57:07.9303652Z 2023-08-31T21:57:07.9303657Z 2023-08-31T21:57:07.9303661Z 2023-08-31T21:57:07.9303665Z 2023-08-31T21:57:07.9303679Z 2023-08-31T21:57:07.9304192Z python-3.9.18 | 22.7 MB | ########## | 100%  2023-08-31T21:57:07.9304422Z 2023-08-31T21:57:07.9304428Z 2023-08-31T21:57:07.9304433Z 2023-08-31T21:57:07.9304452Z 2023-08-31T21:57:07.9304458Z 2023-08-31T21:57:07.9304463Z 2023-08-31T21:57:07.9304468Z 2023-08-31T21:57:07.9304472Z 2023-08-31T21:57:07.9304477Z 2023-08-31T21:57:07.9304481Z 2023-08-31T21:57:07.9304485Z 2023-08-31T21:57:07.9304490Z 2023-08-31T21:57:07.9304494Z 2023-08-31T21:57:07.9304498Z 2023-08-31T21:57:07.9304519Z 2023-08-31T21:57:07.9367451Z python-3.9.18 | 22.7 MB | ########## | 100%  2023-08-31T21:57:07.9367878Z 2023-08-31T21:57:07.9368051Z 2023-08-31T21:57:07.9368060Z 2023-08-31T21:57:07.9368067Z 2023-08-31T21:57:07.9368072Z 2023-08-31T21:57:07.9368333Z 2023-08-31T21:57:07.9368340Z 2023-08-31T21:57:07.9368345Z 2023-08-31T21:57:07.9368351Z 2023-08-31T21:57:07.9368355Z 2023-08-31T21:57:07.9368387Z 2023-08-31T21:57:07.9368394Z 2023-08-31T21:57:07.9368399Z 2023-08-31T21:57:07.9368405Z 2023-08-31T21:57:07.9368409Z 2023-08-31T21:57:07.9368414Z 2023-08-31T21:57:07.9368418Z 2023-08-31T21:57:07.9368423Z 2023-08-31T21:57:07.9368441Z 2023-08-31T21:57:07.9368592Z 2023-08-31T21:57:07.9369007Z  2023-08-31T21:57:07.9369271Z 2023-08-31T21:57:07.9369412Z 2023-08-31T21:57:07.9369582Z  2023-08-31T21:57:07.9369727Z 2023-08-31T21:57:07.9369733Z 2023-08-31T21:57:07.9369902Z  2023-08-31T21:57:07.9370040Z 2023-08-31T21:57:07.9370054Z 2023-08-31T21:57:07.9370060Z 2023-08-31T21:57:07.9370351Z  2023-08-31T21:57:07.9370509Z 2023-08-31T21:57:07.9370515Z 2023-08-31T21:57:07.9370520Z 2023-08-31T21:57:07.9370525Z 2023-08-31T21:57:07.9370701Z  2023-08-31T21:57:07.9370897Z 2023-08-31T21:57:07.9370903Z 2023-08-31T21:57:07.9370908Z 2023-08-31T21:57:07.9370913Z 2023-08-31T21:57:07.9370923Z 2023-08-31T21:57:07.9371105Z  2023-08-31T21:57:07.9371261Z 2023-08-31T21:57:07.9371266Z 2023-08-31T21:57:07.9371271Z 2023-08-31T21:57:07.9371276Z 2023-08-31T21:57:07.9371281Z 2023-08-31T21:57:07.9371286Z 2023-08-31T21:57:07.9371473Z  2023-08-31T21:57:07.9371625Z 2023-08-31T21:57:07.9371631Z 2023-08-31T21:57:07.9371636Z 2023-08-31T21:57:07.9371640Z 2023-08-31T21:57:07.9371645Z 2023-08-31T21:57:07.9371650Z 2023-08-31T21:57:07.9371654Z 2023-08-31T21:57:07.9371850Z  2023-08-31T21:57:07.9372007Z 2023-08-31T21:57:07.9372013Z 2023-08-31T21:57:07.9372018Z 2023-08-31T21:57:07.9372022Z 2023-08-31T21:57:07.9372027Z 2023-08-31T21:57:07.9372032Z 2023-08-31T21:57:07.9372036Z 2023-08-31T21:57:07.9372041Z 2023-08-31T21:57:07.9372368Z  2023-08-31T21:57:07.9372532Z 2023-08-31T21:57:07.9372537Z 2023-08-31T21:57:07.9372542Z 2023-08-31T21:57:07.9372547Z 2023-08-31T21:57:07.9372551Z 2023-08-31T21:57:07.9372556Z 2023-08-31T21:57:07.9372560Z 2023-08-31T21:57:07.9372565Z 2023-08-31T21:57:07.9372569Z 2023-08-31T21:57:07.9372774Z  2023-08-31T21:57:07.9372936Z 2023-08-31T21:57:07.9372942Z 2023-08-31T21:57:07.9372947Z 2023-08-31T21:57:07.9372951Z 2023-08-31T21:57:07.9372955Z 2023-08-31T21:57:07.9372960Z 2023-08-31T21:57:07.9372970Z 2023-08-31T21:57:07.9372975Z 2023-08-31T21:57:07.9372979Z 2023-08-31T21:57:07.9372984Z 2023-08-31T21:57:07.9373187Z  2023-08-31T21:57:07.9373346Z 2023-08-31T21:57:07.9373351Z 2023-08-31T21:57:07.9373356Z 2023-08-31T21:57:07.9373360Z 2023-08-31T21:57:07.9373365Z 2023-08-31T21:57:07.9373369Z 2023-08-31T21:57:07.9373380Z 2023-08-31T21:57:07.9373386Z 2023-08-31T21:57:07.9373391Z 2023-08-31T21:57:07.9373395Z 2023-08-31T21:57:07.9373400Z 2023-08-31T21:57:07.9373606Z  2023-08-31T21:57:07.9373861Z 2023-08-31T21:57:07.9373867Z 2023-08-31T21:57:07.9373872Z 2023-08-31T21:57:07.9373877Z 2023-08-31T21:57:07.9373882Z 2023-08-31T21:57:07.9373886Z 2023-08-31T21:57:07.9373890Z 2023-08-31T21:57:07.9373895Z 2023-08-31T21:57:07.9373899Z 2023-08-31T21:57:07.9373903Z 2023-08-31T21:57:07.9373908Z 2023-08-31T21:57:07.9373921Z 2023-08-31T21:57:07.9374215Z  2023-08-31T21:57:07.9374385Z 2023-08-31T21:57:07.9374390Z 2023-08-31T21:57:07.9374394Z 2023-08-31T21:57:07.9374399Z 2023-08-31T21:57:07.9374404Z 2023-08-31T21:57:07.9374408Z 2023-08-31T21:57:07.9374423Z 2023-08-31T21:57:07.9374428Z 2023-08-31T21:57:07.9374432Z 2023-08-31T21:57:07.9374441Z 2023-08-31T21:57:07.9374447Z 2023-08-31T21:57:07.9374452Z 2023-08-31T21:57:07.9374456Z 2023-08-31T21:57:07.9374668Z  2023-08-31T21:57:07.9374834Z 2023-08-31T21:57:07.9374838Z 2023-08-31T21:57:07.9374843Z 2023-08-31T21:57:07.9374848Z 2023-08-31T21:57:07.9374852Z 2023-08-31T21:57:07.9374856Z 2023-08-31T21:57:07.9374861Z 2023-08-31T21:57:07.9374866Z 2023-08-31T21:57:07.9374870Z 2023-08-31T21:57:07.9374874Z 2023-08-31T21:57:07.9374879Z 2023-08-31T21:57:07.9374883Z 2023-08-31T21:57:07.9374888Z 2023-08-31T21:57:07.9374897Z 2023-08-31T21:57:07.9375431Z  2023-08-31T21:57:07.9375598Z 2023-08-31T21:57:07.9375604Z 2023-08-31T21:57:07.9375609Z 2023-08-31T21:57:07.9375613Z 2023-08-31T21:57:07.9375618Z 2023-08-31T21:57:07.9375623Z 2023-08-31T21:57:07.9375627Z 2023-08-31T21:57:07.9375632Z 2023-08-31T21:57:07.9375642Z 2023-08-31T21:57:07.9375647Z 2023-08-31T21:57:07.9375652Z 2023-08-31T21:57:07.9375656Z 2023-08-31T21:57:07.9375661Z 2023-08-31T21:57:07.9375665Z 2023-08-31T21:57:07.9375670Z 2023-08-31T21:57:07.9376067Z  2023-08-31T21:57:07.9376283Z 2023-08-31T21:57:07.9376288Z 2023-08-31T21:57:07.9376292Z 2023-08-31T21:57:07.9376297Z 2023-08-31T21:57:07.9376302Z 2023-08-31T21:57:07.9376307Z 2023-08-31T21:57:07.9376311Z 2023-08-31T21:57:07.9376316Z 2023-08-31T21:57:07.9376320Z 2023-08-31T21:57:07.9376325Z 2023-08-31T21:57:07.9376335Z 2023-08-31T21:57:07.9376340Z 2023-08-31T21:57:07.9376344Z 2023-08-31T21:57:07.9376349Z 2023-08-31T21:57:07.9376399Z 2023-08-31T21:57:07.9376405Z 2023-08-31T21:57:07.9376623Z  2023-08-31T21:57:07.9376853Z 2023-08-31T21:57:07.9376858Z 2023-08-31T21:57:07.9377008Z 2023-08-31T21:57:07.9377014Z 2023-08-31T21:57:07.9377019Z 2023-08-31T21:57:07.9377072Z 2023-08-31T21:57:07.9377077Z 2023-08-31T21:57:07.9377082Z 2023-08-31T21:57:07.9377087Z 2023-08-31T21:57:07.9377091Z 2023-08-31T21:57:07.9377096Z 2023-08-31T21:57:07.9377101Z 2023-08-31T21:57:07.9377105Z 2023-08-31T21:57:07.9377109Z 2023-08-31T21:57:07.9377114Z 2023-08-31T21:57:07.9377118Z 2023-08-31T21:57:07.9377123Z 2023-08-31T21:57:07.9377393Z  2023-08-31T21:57:07.9377605Z 2023-08-31T21:57:07.9377611Z 2023-08-31T21:57:07.9377620Z 2023-08-31T21:57:07.9377625Z 2023-08-31T21:57:07.9377630Z 2023-08-31T21:57:07.9377635Z 2023-08-31T21:57:07.9377639Z 2023-08-31T21:57:07.9377644Z 2023-08-31T21:57:07.9377648Z 2023-08-31T21:57:07.9377652Z 2023-08-31T21:57:07.9377657Z 2023-08-31T21:57:07.9377661Z 2023-08-31T21:57:07.9377665Z 2023-08-31T21:57:07.9377670Z 2023-08-31T21:57:07.9377674Z 2023-08-31T21:57:07.9377682Z 2023-08-31T21:57:07.9377687Z 2023-08-31T21:57:07.9377691Z 2023-08-31T21:57:07.9377959Z  2023-08-31T21:57:07.9378219Z 2023-08-31T21:57:07.9378225Z 2023-08-31T21:57:07.9378372Z  2023-08-31T21:57:07.9378517Z 2023-08-31T21:57:07.9378523Z 2023-08-31T21:57:07.9378654Z  2023-08-31T21:57:08.1402694Z Preparing transaction: ...working... done 2023-08-31T21:57:09.2871512Z Verifying transaction: ...working... done 2023-08-31T21:57:11.3961607Z Executing transaction: ...working... done 2023-08-31T21:57:11.4065273Z # 2023-08-31T21:57:11.4066013Z # To activate this environment, use 2023-08-31T21:57:11.4066522Z # 2023-08-31T21:57:11.4067086Z # $ conda activate __setup_conda 2023-08-31T21:57:11.4067840Z # 2023-08-31T21:57:11.4068260Z # To deactivate an active environment, use 2023-08-31T21:57:11.4068571Z # 2023-08-31T21:57:11.4068831Z # $ conda deactivate 2023-08-31T21:57:11.4068965Z 2023-08-31T21:57:12.4070446Z ##[endgroup] 2023-08-31T21:57:12.4073496Z ##[group]Activating conda __setup_conda 2023-08-31T21:57:12.4073994Z Conda activate script: 2023-08-31T21:57:12.4086741Z [command]/usr/share/miniconda/bin/conda shell.bash activate __setup_conda 2023-08-31T21:57:12.4986711Z PS1='(__setup_conda) ' 2023-08-31T21:57:12.4988039Z export PATH='/usr/share/miniconda/envs/__setup_conda/bin:/usr/share/miniconda/condabin:/usr/share/miniconda/bin:/usr/share/miniconda:/home/runner/.local/bin:/opt/pipx_bin:/home/runner/.cargo/bin:/home/runner/.config/composer/vendor/bin:/usr/local/.ghcup/bin:/home/runner/.dotnet/tools:/snap/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin' 2023-08-31T21:57:12.4989137Z export CONDA_PREFIX='/usr/share/miniconda/envs/__setup_conda' 2023-08-31T21:57:12.4990089Z export CONDA_SHLVL='1' 2023-08-31T21:57:12.4990528Z export CONDA_DEFAULT_ENV='__setup_conda' 2023-08-31T21:57:12.4991034Z export CONDA_PROMPT_MODIFIER='(__setup_conda) ' 2023-08-31T21:57:12.4991466Z export CONDA_EXE='/usr/share/miniconda/bin/conda' 2023-08-31T21:57:12.4991829Z export _CE_M='' 2023-08-31T21:57:12.4992084Z export _CE_CONDA='' 2023-08-31T21:57:12.4992489Z export CONDA_PYTHON_EXE='/usr/share/miniconda/bin/python' 2023-08-31T21:57:12.5166775Z 2023-08-31T21:57:12.5166950Z 2023-08-31T21:57:12.5167380Z Data used for activation: 2023-08-31T21:57:12.5167721Z { 2023-08-31T21:57:12.5167958Z condaPaths: [ 2023-08-31T21:57:12.5169524Z '/usr/share/miniconda', 2023-08-31T21:57:12.5170144Z '/usr/share/miniconda/bin', 2023-08-31T21:57:12.5170653Z '/usr/share/miniconda/condabin', 2023-08-31T21:57:12.5171318Z '/usr/share/miniconda/envs/__setup_conda/bin' 2023-08-31T21:57:12.5171813Z ], 2023-08-31T21:57:12.5172111Z envVars: { 2023-08-31T21:57:12.5172619Z PS1: '(__setup_conda) ', 2023-08-31T21:57:12.5173020Z CONDA_PREFIX: '/usr/share/miniconda/envs/__setup_conda', 2023-08-31T21:57:12.5173449Z CONDA_DEFAULT_ENV: '__setup_conda', 2023-08-31T21:57:12.5201192Z CONDA_PROMPT_MODIFIER: '(__setup_conda) ', 2023-08-31T21:57:12.5201682Z CONDA_EXE: '/usr/share/miniconda/bin/conda', 2023-08-31T21:57:12.5202100Z _CE_M: '', 2023-08-31T21:57:12.5202403Z _CE_CONDA: '', 2023-08-31T21:57:12.5202760Z CONDA_PYTHON_EXE: '/usr/share/miniconda/bin/python' 2023-08-31T21:57:12.5203090Z } 2023-08-31T21:57:12.5203346Z } 2023-08-31T21:57:12.5216165Z ##[endgroup] 2023-08-31T21:57:12.5217638Z ##[endgroup] 2023-08-31T21:57:12.5344336Z ##[group]Run conda --version 2023-08-31T21:57:12.5344712Z conda --version 2023-08-31T21:57:12.5406243Z shell: /usr/bin/bash -e {0} 2023-08-31T21:57:12.5406733Z env: 2023-08-31T21:57:12.5407062Z PS1: (__setup_conda) 2023-08-31T21:57:12.5407414Z CONDA_PREFIX: /usr/share/miniconda/envs/__setup_conda 2023-08-31T21:57:12.5407775Z CONDA_DEFAULT_ENV: __setup_conda 2023-08-31T21:57:12.5408114Z CONDA_PROMPT_MODIFIER: (__setup_conda) 2023-08-31T21:57:12.5408412Z CONDA_EXE: /usr/share/miniconda/bin/conda 2023-08-31T21:57:12.5408762Z _CE_M: 2023-08-31T21:57:12.5409014Z _CE_CONDA: 2023-08-31T21:57:12.5409285Z CONDA_PYTHON_EXE: /usr/share/miniconda/bin/python 2023-08-31T21:57:12.5409602Z ##[endgroup] 2023-08-31T21:57:12.8686612Z conda 23.7.3 2023-08-31T21:57:12.9119867Z ##[group]Run python --version 2023-08-31T21:57:12.9120204Z python --version 2023-08-31T21:57:12.9174042Z shell: /usr/bin/bash -e {0} 2023-08-31T21:57:12.9174288Z env: 2023-08-31T21:57:12.9174559Z PS1: (__setup_conda) 2023-08-31T21:57:12.9174897Z CONDA_PREFIX: /usr/share/miniconda/envs/__setup_conda 2023-08-31T21:57:12.9175204Z CONDA_DEFAULT_ENV: __setup_conda 2023-08-31T21:57:12.9175740Z CONDA_PROMPT_MODIFIER: (__setup_conda) 2023-08-31T21:57:12.9176075Z CONDA_EXE: /usr/share/miniconda/bin/conda 2023-08-31T21:57:12.9176324Z _CE_M: 2023-08-31T21:57:12.9176574Z _CE_CONDA: 2023-08-31T21:57:12.9176890Z CONDA_PYTHON_EXE: /usr/share/miniconda/bin/python 2023-08-31T21:57:12.9177185Z ##[endgroup] 2023-08-31T21:57:12.9268845Z Python 3.9.18 2023-08-31T21:57:12.9387807Z ##[group]Run actions/setup-java@v3 2023-08-31T21:57:12.9388030Z with: 2023-08-31T21:57:12.9388225Z distribution: zulu 2023-08-31T21:57:12.9388430Z java-version: 17 2023-08-31T21:57:12.9388623Z java-package: jdk 2023-08-31T21:57:12.9388825Z check-latest: false 2023-08-31T21:57:12.9389033Z server-id: github 2023-08-31T21:57:12.9389242Z server-username: GITHUB_ACTOR 2023-08-31T21:57:12.9389485Z server-password: GITHUB_TOKEN 2023-08-31T21:57:12.9389718Z overwrite-settings: true 2023-08-31T21:57:12.9389925Z job-status: success 2023-08-31T21:57:12.9390247Z token: *** 2023-08-31T21:57:12.9390457Z env: 2023-08-31T21:57:12.9390647Z PS1: (__setup_conda) 2023-08-31T21:57:12.9390900Z CONDA_PREFIX: /usr/share/miniconda/envs/__setup_conda 2023-08-31T21:57:12.9391168Z CONDA_DEFAULT_ENV: __setup_conda 2023-08-31T21:57:12.9391421Z CONDA_PROMPT_MODIFIER: (__setup_conda) 2023-08-31T21:57:12.9391676Z CONDA_EXE: /usr/share/miniconda/bin/conda 2023-08-31T21:57:12.9391937Z _CE_M: 2023-08-31T21:57:12.9392109Z _CE_CONDA: 2023-08-31T21:57:12.9392351Z CONDA_PYTHON_EXE: /usr/share/miniconda/bin/python 2023-08-31T21:57:12.9392585Z ##[endgroup] 2023-08-31T21:57:13.1514665Z ##[group]Installed distributions 2023-08-31T21:57:13.1549607Z Trying to resolve the latest version from remote 2023-08-31T21:57:13.2263724Z Resolved latest version as 17.0.8+7 2023-08-31T21:57:13.2264356Z Trying to download... 2023-08-31T21:57:13.2265568Z Downloading Java 17.0.8+7 (Zulu) from https://cdn.azul.com/zulu/bin/zulu17.44.17-ca-crac-jdk17.0.8-linux_x64.tar.gz ... 2023-08-31T21:57:14.4605259Z Extracting Java archive... 2023-08-31T21:57:14.4753354Z [command]/usr/bin/tar xz --warning=no-unknown-keyword -C /home/runner/work/_temp/e7e73917-8fa8-4952-be40-1386aabe929e -f /home/runner/work/_temp/c4afb0f3-9763-44b3-ade6-f96dac575913 2023-08-31T21:57:19.1705450Z Java 17.0.8+7 was downloaded 2023-08-31T21:57:19.1705803Z Setting Java 17.0.8+7 as the default 2023-08-31T21:57:19.1723774Z Creating toolchains.xml for JDK version 17 from zulu 2023-08-31T21:57:19.1819268Z Writing to /home/runner/.m2/toolchains.xml 2023-08-31T21:57:19.1820478Z 2023-08-31T21:57:19.1820826Z Java configuration: 2023-08-31T21:57:19.1821068Z Distribution: zulu 2023-08-31T21:57:19.1821284Z Version: 17.0.8+7 2023-08-31T21:57:19.1821874Z Path: /opt/hostedtoolcache/Java_Zulu_jdk/17.0.8-7/x64 2023-08-31T21:57:19.1822167Z 2023-08-31T21:57:19.1823801Z ##[endgroup] 2023-08-31T21:57:19.1838027Z Creating settings.xml with server-id: github 2023-08-31T21:57:19.1855260Z Writing to /home/runner/.m2/settings.xml 2023-08-31T21:57:19.1979491Z ##[group]Run actions/checkout@v3 2023-08-31T21:57:19.1979718Z with: 2023-08-31T21:57:19.1979918Z repository: pytorch/serve 2023-08-31T21:57:19.1980257Z token: *** 2023-08-31T21:57:19.1980452Z ssh-strict: true 2023-08-31T21:57:19.1980666Z persist-credentials: true 2023-08-31T21:57:19.1980877Z clean: true 2023-08-31T21:57:19.1981096Z sparse-checkout-cone-mode: true 2023-08-31T21:57:19.1981316Z fetch-depth: 1 2023-08-31T21:57:19.1981516Z fetch-tags: false 2023-08-31T21:57:19.1981704Z lfs: false 2023-08-31T21:57:19.1981880Z submodules: false 2023-08-31T21:57:19.1982092Z set-safe-directory: true 2023-08-31T21:57:19.1982291Z env: 2023-08-31T21:57:19.1982469Z PS1: (__setup_conda) 2023-08-31T21:57:19.1982725Z CONDA_PREFIX: /usr/share/miniconda/envs/__setup_conda 2023-08-31T21:57:19.1982993Z CONDA_DEFAULT_ENV: __setup_conda 2023-08-31T21:57:19.1983236Z CONDA_PROMPT_MODIFIER: (__setup_conda) 2023-08-31T21:57:19.1983542Z CONDA_EXE: /usr/share/miniconda/bin/conda 2023-08-31T21:57:19.1983922Z _CE_M: 2023-08-31T21:57:19.1984100Z _CE_CONDA: 2023-08-31T21:57:19.1984342Z CONDA_PYTHON_EXE: /usr/share/miniconda/bin/python 2023-08-31T21:57:19.1984651Z JAVA_HOME: /opt/hostedtoolcache/Java_Zulu_jdk/17.0.8-7/x64 2023-08-31T21:57:19.1984959Z JAVA_HOME_17_X64: /opt/hostedtoolcache/Java_Zulu_jdk/17.0.8-7/x64 2023-08-31T21:57:19.1985211Z ##[endgroup] 2023-08-31T21:57:19.3044739Z Syncing repository: pytorch/serve 2023-08-31T21:57:19.3047712Z ##[group]Getting Git version info 2023-08-31T21:57:19.3048383Z Working directory is '/home/runner/work/serve/serve' 2023-08-31T21:57:19.3087379Z [command]/usr/bin/git version 2023-08-31T21:57:19.3130199Z git version 2.41.0 2023-08-31T21:57:19.3159371Z ##[endgroup] 2023-08-31T21:57:19.3175804Z Temporarily overriding HOME='/home/runner/work/_temp/2c760fe7-930b-445f-b57a-9d445e77da2c' before making global git config changes 2023-08-31T21:57:19.3177716Z Adding repository directory to the temporary git global config as a safe directory 2023-08-31T21:57:19.3183174Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/serve/serve 2023-08-31T21:57:19.3227188Z [command]/usr/bin/git config --local --get remote.origin.url 2023-08-31T21:57:19.3252569Z https://github.com/pytorch/serve 2023-08-31T21:57:19.3270150Z ##[group]Removing previously created refs, to avoid conflicts 2023-08-31T21:57:19.3277535Z [command]/usr/bin/git rev-parse --symbolic-full-name --verify --quiet HEAD 2023-08-31T21:57:19.3301113Z HEAD 2023-08-31T21:57:19.3346287Z ##[endgroup] 2023-08-31T21:57:19.3350561Z [command]/usr/bin/git submodule status 2023-08-31T21:57:19.3564528Z ##[group]Cleaning the repository 2023-08-31T21:57:19.3568651Z [command]/usr/bin/git clean -ffdx 2023-08-31T21:57:19.3640659Z [command]/usr/bin/git reset --hard HEAD 2023-08-31T21:57:19.6123073Z HEAD is now at 373298f Merge bca84a7c8bf7adc51d92d91b60a3a98f811ce182 into 242895c6b4596c4119ec09d6139e627c5dd696b6 2023-08-31T21:57:19.6147652Z ##[endgroup] 2023-08-31T21:57:19.6148092Z ##[group]Disabling automatic garbage collection 2023-08-31T21:57:19.6148677Z [command]/usr/bin/git config --local gc.auto 0 2023-08-31T21:57:19.6175933Z ##[endgroup] 2023-08-31T21:57:19.6176325Z ##[group]Setting up auth 2023-08-31T21:57:19.6186677Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2023-08-31T21:57:19.6222635Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2023-08-31T21:57:19.6460407Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2023-08-31T21:57:19.6485429Z http.https://github.com/.extraheader 2023-08-31T21:57:19.6497505Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2023-08-31T21:57:19.6544617Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2023-08-31T21:57:19.6768492Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2023-08-31T21:57:19.6807145Z ##[endgroup] 2023-08-31T21:57:19.6811587Z ##[group]Fetching the repository 2023-08-31T21:57:19.6812689Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +373298ff00813a60e809f02b4c099a4dff308bf5:refs/remotes/pull/2562/merge 2023-08-31T21:57:19.9031580Z remote: Total 0 (delta 0), reused 0 (delta 0), pack-reused 0 2023-08-31T21:57:19.9110947Z ##[endgroup] 2023-08-31T21:57:19.9111463Z ##[group]Determining the checkout info 2023-08-31T21:57:19.9113011Z ##[endgroup] 2023-08-31T21:57:19.9113455Z ##[group]Checking out the ref 2023-08-31T21:57:19.9118219Z [command]/usr/bin/git checkout --progress --force refs/remotes/pull/2562/merge 2023-08-31T21:57:19.9180988Z HEAD is now at 373298f Merge bca84a7c8bf7adc51d92d91b60a3a98f811ce182 into 242895c6b4596c4119ec09d6139e627c5dd696b6 2023-08-31T21:57:19.9184751Z ##[endgroup] 2023-08-31T21:57:19.9222955Z [command]/usr/bin/git log -1 --format='%H' 2023-08-31T21:57:19.9249641Z '373298ff00813a60e809f02b4c099a4dff308bf5' 2023-08-31T21:57:19.9366145Z ##[group]Run python ts_scripts/install_dependencies.py --environment=dev 2023-08-31T21:57:19.9366756Z python ts_scripts/install_dependencies.py --environment=dev 2023-08-31T21:57:19.9423432Z shell: /usr/bin/bash -e {0} 2023-08-31T21:57:19.9423652Z env: 2023-08-31T21:57:19.9423855Z PS1: (__setup_conda) 2023-08-31T21:57:19.9424121Z CONDA_PREFIX: /usr/share/miniconda/envs/__setup_conda 2023-08-31T21:57:19.9424399Z CONDA_DEFAULT_ENV: __setup_conda 2023-08-31T21:57:19.9424654Z CONDA_PROMPT_MODIFIER: (__setup_conda) 2023-08-31T21:57:19.9424917Z CONDA_EXE: /usr/share/miniconda/bin/conda 2023-08-31T21:57:19.9425138Z _CE_M: 2023-08-31T21:57:19.9425317Z _CE_CONDA: 2023-08-31T21:57:19.9425552Z CONDA_PYTHON_EXE: /usr/share/miniconda/bin/python 2023-08-31T21:57:19.9425874Z JAVA_HOME: /opt/hostedtoolcache/Java_Zulu_jdk/17.0.8-7/x64 2023-08-31T21:57:19.9426195Z JAVA_HOME_17_X64: /opt/hostedtoolcache/Java_Zulu_jdk/17.0.8-7/x64 2023-08-31T21:57:19.9426487Z ##[endgroup] 2023-08-31T21:57:19.9900924Z GNU Wget 1.20.3 built on linux-gnu. 2023-08-31T21:57:19.9901144Z 2023-08-31T21:57:19.9901396Z -cares +digest -gpgme +https +ipv6 +iri +large-file -metalink +nls 2023-08-31T21:57:19.9901697Z +ntlm +opie +psl +ssl/openssl 2023-08-31T21:57:19.9901853Z 2023-08-31T21:57:19.9901928Z Wgetrc: 2023-08-31T21:57:19.9902130Z /etc/wgetrc (system) 2023-08-31T21:57:19.9902319Z Locale: 2023-08-31T21:57:19.9902510Z /usr/share/locale 2023-08-31T21:57:19.9902707Z Compile: 2023-08-31T21:57:19.9903018Z gcc -DHAVE_CONFIG_H -DSYSTEM_WGETRC="/etc/wgetrc" 2023-08-31T21:57:19.9903402Z -DLOCALEDIR="/usr/share/locale" -I. -I../../src -I../lib 2023-08-31T21:57:19.9903808Z -I../../lib -Wdate-time -D_FORTIFY_SOURCE=2 -DHAVE_LIBSSL -DNDEBUG 2023-08-31T21:57:19.9904249Z -g -O2 -fdebug-prefix-map=/build/wget-3oF214/wget-1.20.3=. 2023-08-31T21:57:19.9904660Z -fstack-protector-strong -Wformat -Werror=format-security 2023-08-31T21:57:19.9905044Z -DNO_SSLv2 -D_FILE_OFFSET_BITS=64 -g -Wall 2023-08-31T21:57:19.9905267Z Link: 2023-08-31T21:57:19.9905525Z gcc -DHAVE_LIBSSL -DNDEBUG -g -O2 2023-08-31T21:57:19.9905887Z -fdebug-prefix-map=/build/wget-3oF214/wget-1.20.3=. 2023-08-31T21:57:19.9906281Z -fstack-protector-strong -Wformat -Werror=format-security 2023-08-31T21:57:19.9906697Z -DNO_SSLv2 -D_FILE_OFFSET_BITS=64 -g -Wall -Wl,-Bsymbolic-functions 2023-08-31T21:57:19.9907128Z -Wl,-z,relro -Wl,-z,now -lpcre2-8 -luuid -lidn2 -lssl -lcrypto -lz 2023-08-31T21:57:19.9907624Z -lpsl ftp-opie.o openssl.o http-ntlm.o ../lib/libgnu.a 2023-08-31T21:57:19.9907816Z 2023-08-31T21:57:19.9907957Z Copyright (C) 2015 Free Software Foundation, Inc. 2023-08-31T21:57:19.9908245Z License GPLv3+: GNU GPL version 3 or later 2023-08-31T21:57:19.9908555Z . 2023-08-31T21:57:19.9908882Z This is free software: you are free to change and redistribute it. 2023-08-31T21:57:19.9909213Z There is NO WARRANTY, to the extent permitted by law. 2023-08-31T21:57:19.9909401Z 2023-08-31T21:57:19.9909555Z Originally written by Hrvoje Niksic . 2023-08-31T21:57:19.9909965Z Please send bug reports and questions to . 2023-08-31T21:57:20.0420410Z v18.17.1 2023-08-31T21:57:26.7818277Z npm WARN deprecated urix@0.1.0: Please see https://github.com/lydell/urix#deprecated 2023-08-31T21:57:26.8126176Z npm WARN deprecated source-map-url@0.4.1: See https://github.com/lydell/source-map-url#deprecated 2023-08-31T21:57:26.8382120Z npm WARN deprecated resolve-url@0.2.1: https://github.com/lydell/resolve-url#deprecated 2023-08-31T21:57:27.0245130Z npm WARN deprecated source-map-resolve@0.5.3: See https://github.com/lydell/source-map-resolve#deprecated 2023-08-31T21:57:27.0799479Z npm WARN deprecated gulp-header@1.8.12: Removed event-stream from gulp-header 2023-08-31T21:57:27.9131253Z npm WARN deprecated har-validator@5.1.5: this library is no longer supported 2023-08-31T21:57:27.9517193Z npm WARN deprecated uuid@3.4.0: Please upgrade to version 7 or higher. Older versions may use Math.random() in certain circumstances, which is known to be problematic. See https://v8.dev/blog/math-random for details. 2023-08-31T21:57:27.9886911Z npm WARN deprecated uuid@3.4.0: Please upgrade to version 7 or higher. Older versions may use Math.random() in certain circumstances, which is known to be problematic. See https://v8.dev/blog/math-random for details. 2023-08-31T21:57:29.7280408Z 2023-08-31T21:57:29.7281202Z added 245 packages, and changed 112 packages in 9s 2023-08-31T21:57:29.7281677Z 2023-08-31T21:57:29.7282021Z 24 packages are looking for funding 2023-08-31T21:57:29.7282475Z run `npm fund` for details 2023-08-31T21:57:29.7288377Z npm notice 2023-08-31T21:57:29.7289174Z npm notice New minor version of npm available! 9.6.7 -> 9.8.1 2023-08-31T21:57:29.7290015Z npm notice Changelog: 2023-08-31T21:57:29.7290618Z npm notice Run `npm install -g npm@9.8.1` to update! 2023-08-31T21:57:29.7291953Z npm notice 2023-08-31T21:57:29.7509942Z sh: 1: numactl: not found 2023-08-31T21:57:31.0355298Z Reading package lists... 2023-08-31T21:57:31.2681104Z Building dependency tree... 2023-08-31T21:57:31.2703535Z Reading state information... 2023-08-31T21:57:31.4429005Z The following NEW packages will be installed: 2023-08-31T21:57:31.4432720Z numactl 2023-08-31T21:57:31.4613231Z 0 upgraded, 1 newly installed, 0 to remove and 19 not upgraded. 2023-08-31T21:57:31.4613815Z Need to get 38.5 kB of archives. 2023-08-31T21:57:31.4614345Z After this operation, 150 kB of additional disk space will be used. 2023-08-31T21:57:31.4615166Z Get:1 file:/etc/apt/apt-mirrors.txt Mirrorlist [142 B] 2023-08-31T21:57:31.5167596Z Get:2 http://azure.archive.ubuntu.com/ubuntu focal/main amd64 numactl amd64 2.0.12-1 [38.5 kB] 2023-08-31T21:57:31.9394378Z Fetched 38.5 kB in 0s (411 kB/s) 2023-08-31T21:57:31.9803818Z Selecting previously unselected package numactl. 2023-08-31T21:57:31.9987723Z (Reading database ... 2023-08-31T21:57:31.9988140Z (Reading database ... 5% 2023-08-31T21:57:31.9990326Z (Reading database ... 10% 2023-08-31T21:57:31.9990820Z (Reading database ... 15% 2023-08-31T21:57:31.9994921Z (Reading database ... 20% 2023-08-31T21:57:31.9995134Z (Reading database ... 25% 2023-08-31T21:57:31.9995467Z (Reading database ... 30% 2023-08-31T21:57:31.9995693Z (Reading database ... 35% 2023-08-31T21:57:31.9996382Z (Reading database ... 40% 2023-08-31T21:57:32.0000433Z (Reading database ... 45% 2023-08-31T21:57:32.0000804Z (Reading database ... 50% 2023-08-31T21:57:32.0235837Z (Reading database ... 55% 2023-08-31T21:57:32.0463209Z (Reading database ... 60% 2023-08-31T21:57:32.0683415Z (Reading database ... 65% 2023-08-31T21:57:32.1026860Z (Reading database ... 70% 2023-08-31T21:57:32.1592197Z (Reading database ... 75% 2023-08-31T21:57:32.1948340Z (Reading database ... 80% 2023-08-31T21:57:32.2440058Z (Reading database ... 85% 2023-08-31T21:57:32.2746491Z (Reading database ... 90% 2023-08-31T21:57:32.3187041Z (Reading database ... 95% 2023-08-31T21:57:32.3187551Z (Reading database ... 100% 2023-08-31T21:57:32.3188233Z (Reading database ... 228292 files and directories currently installed.) 2023-08-31T21:57:32.3249663Z Preparing to unpack .../numactl_2.0.12-1_amd64.deb ... 2023-08-31T21:57:32.3293318Z Unpacking numactl (2.0.12-1) ... 2023-08-31T21:57:32.3847489Z Setting up numactl (2.0.12-1) ... 2023-08-31T21:57:32.3873513Z Processing triggers for man-db (2.9.1-1) ... 2023-08-31T21:57:34.1900864Z javac 17.0.8 2023-08-31T21:57:34.2144837Z /usr/share/miniconda/condabin/conda 2023-08-31T21:57:58.4473506Z Collecting package metadata (current_repodata.json): ...working... done 2023-08-31T21:58:04.2432990Z Solving environment: ...working... done 2023-08-31T21:58:04.3525082Z 2023-08-31T21:58:04.3525644Z ## Package Plan ## 2023-08-31T21:58:04.3526409Z 2023-08-31T21:58:04.3526788Z environment location: /usr/share/miniconda/envs/__setup_conda 2023-08-31T21:58:04.3527256Z 2023-08-31T21:58:04.3527505Z added / updated specs: 2023-08-31T21:58:04.3528291Z - conda-build 2023-08-31T21:58:04.3528579Z 2023-08-31T21:58:04.3528722Z 2023-08-31T21:58:04.3529070Z The following packages will be downloaded: 2023-08-31T21:58:04.3529591Z 2023-08-31T21:58:04.3529850Z package | build 2023-08-31T21:58:04.3530344Z ---------------------------|----------------- 2023-08-31T21:58:04.3530752Z beautifulsoup4-4.12.2 | pyha770c72_0 112 KB conda-forge 2023-08-31T21:58:04.3531185Z boltons-23.0.0 | pyhd8ed1ab_0 296 KB conda-forge 2023-08-31T21:58:04.3531590Z brotli-python-1.0.9 | py39h5a03fae_9 320 KB conda-forge 2023-08-31T21:58:04.3532011Z certifi-2023.7.22 | pyhd8ed1ab_0 150 KB conda-forge 2023-08-31T21:58:04.3532436Z cffi-1.15.1 | py39he91dace_3 229 KB conda-forge 2023-08-31T21:58:04.3532821Z chardet-5.2.0 | py39hf3d152e_0 219 KB conda-forge 2023-08-31T21:58:04.3533238Z charset-normalizer-3.2.0 | pyhd8ed1ab_0 45 KB conda-forge 2023-08-31T21:58:04.3533647Z click-8.1.7 |unix_pyh707e725_0 82 KB conda-forge 2023-08-31T21:58:04.3534032Z colorama-0.4.6 | pyhd8ed1ab_0 25 KB conda-forge 2023-08-31T21:58:04.3534407Z conda-23.7.3 | py39hf3d152e_0 994 KB conda-forge 2023-08-31T21:58:04.3534796Z conda-build-3.26.1 | py39hf3d152e_0 577 KB conda-forge 2023-08-31T21:58:04.3535193Z conda-index-0.2.3 | pyhd8ed1ab_0 164 KB conda-forge 2023-08-31T21:58:04.3535605Z conda-package-handling-2.2.0| pyh38be061_0 249 KB conda-forge 2023-08-31T21:58:04.3536050Z conda-package-streaming-0.9.0| pyhd8ed1ab_0 19 KB conda-forge 2023-08-31T21:58:04.3536489Z cryptography-41.0.3 | py39hd4f0224_0 1.8 MB conda-forge 2023-08-31T21:58:04.3536896Z filelock-3.12.3 | pyhd8ed1ab_0 15 KB conda-forge 2023-08-31T21:58:04.3537269Z glob2-0.7 | py_0 11 KB conda-forge 2023-08-31T21:58:04.3537641Z icu-73.2 | h59595ed_0 11.5 MB conda-forge 2023-08-31T21:58:04.3538017Z idna-3.4 | pyhd8ed1ab_0 55 KB conda-forge 2023-08-31T21:58:04.3538388Z jinja2-3.1.2 | pyhd8ed1ab_1 99 KB conda-forge 2023-08-31T21:58:04.3538772Z jsonpatch-1.32 | pyhd8ed1ab_0 14 KB conda-forge 2023-08-31T21:58:04.3539146Z jsonpointer-2.0 | py_0 9 KB conda-forge 2023-08-31T21:58:04.3539529Z libarchive-3.6.2 | h039dbb9_1 824 KB conda-forge 2023-08-31T21:58:04.3539902Z libiconv-1.17 | h166bdaf_0 1.4 MB conda-forge 2023-08-31T21:58:04.3540272Z liblief-0.12.3 | h27087fc_0 2.1 MB conda-forge 2023-08-31T21:58:04.3540660Z libstdcxx-ng-13.1.0 | hfd8a6a1_0 3.7 MB conda-forge 2023-08-31T21:58:04.3541032Z libxml2-2.11.5 | h232c23b_1 689 KB conda-forge 2023-08-31T21:58:04.3541394Z lz4-c-1.9.4 | hcb278e6_0 140 KB conda-forge 2023-08-31T21:58:04.3541753Z lzo-2.10 | h516909a_1000 314 KB conda-forge 2023-08-31T21:58:04.3542131Z markupsafe-2.1.3 | py39hd1e30aa_0 23 KB conda-forge 2023-08-31T21:58:04.3542518Z more-itertools-10.1.0 | pyhd8ed1ab_0 52 KB conda-forge 2023-08-31T21:58:04.3542909Z packaging-23.1 | pyhd8ed1ab_0 45 KB conda-forge 2023-08-31T21:58:04.3543293Z patch-2.7.6 | h7f98852_1002 121 KB conda-forge 2023-08-31T21:58:04.3543908Z patchelf-0.17.2 | h58526e2_0 92 KB conda-forge 2023-08-31T21:58:04.3544385Z pkginfo-1.9.6 | pyhd8ed1ab_0 27 KB conda-forge 2023-08-31T21:58:04.3544775Z pluggy-1.3.0 | pyhd8ed1ab_0 22 KB conda-forge 2023-08-31T21:58:04.3545159Z psutil-5.9.5 | py39h72bdee0_0 350 KB conda-forge 2023-08-31T21:58:04.3545533Z py-lief-0.12.3 | py39h5a03fae_0 1.7 MB conda-forge 2023-08-31T21:58:04.3545917Z pycosat-0.6.4 | py39hb9d737c_1 108 KB conda-forge 2023-08-31T21:58:04.3546308Z pycparser-2.21 | pyhd8ed1ab_0 100 KB conda-forge 2023-08-31T21:58:04.3546694Z pyopenssl-23.2.0 | pyhd8ed1ab_1 126 KB conda-forge 2023-08-31T21:58:04.3547071Z pysocks-1.7.1 | pyha2e5f31_6 19 KB conda-forge 2023-08-31T21:58:04.3547467Z python-libarchive-c-5.0 | py39hf3d152e_1 61 KB conda-forge 2023-08-31T21:58:04.3547868Z python_abi-3.9 | 3_cp39 6 KB conda-forge 2023-08-31T21:58:04.3548235Z pytz-2023.3 | pyhd8ed1ab_0 182 KB conda-forge 2023-08-31T21:58:04.3548610Z pyyaml-6.0.1 | py39hd1e30aa_0 174 KB conda-forge 2023-08-31T21:58:04.3549051Z requests-2.31.0 | pyhd8ed1ab_0 55 KB conda-forge 2023-08-31T21:58:04.3549430Z ripgrep-13.0.0 | h2f28480_2 1.7 MB conda-forge 2023-08-31T21:58:04.3549868Z ruamel.yaml-0.17.32 | py39hd1e30aa_0 195 KB conda-forge 2023-08-31T21:58:04.3550264Z ruamel.yaml.clib-0.2.7 | py39h72bdee0_1 140 KB conda-forge 2023-08-31T21:58:04.3550647Z six-1.16.0 | pyh6c4a22f_0 14 KB conda-forge 2023-08-31T21:58:04.3551029Z soupsieve-2.3.2.post1 | pyhd8ed1ab_0 34 KB conda-forge 2023-08-31T21:58:04.3551406Z tomli-2.0.1 | pyhd8ed1ab_0 16 KB conda-forge 2023-08-31T21:58:04.3551778Z toolz-0.12.0 | pyhd8ed1ab_0 48 KB conda-forge 2023-08-31T21:58:04.3552155Z tqdm-4.66.1 | pyhd8ed1ab_0 87 KB conda-forge 2023-08-31T21:58:04.3552526Z urllib3-2.0.4 | pyhd8ed1ab_0 96 KB conda-forge 2023-08-31T21:58:04.3552887Z yaml-0.2.5 | h7f98852_2 87 KB conda-forge 2023-08-31T21:58:04.3553265Z zstandard-0.19.0 | py39hb9d737c_0 671 KB conda-forge 2023-08-31T21:58:04.3553637Z zstd-1.5.5 | hfc55251_0 532 KB conda-forge 2023-08-31T21:58:04.3553959Z ------------------------------------------------------------ 2023-08-31T21:58:04.3554221Z Total: 33.0 MB 2023-08-31T21:58:04.3554388Z 2023-08-31T21:58:04.3554526Z The following NEW packages will be INSTALLED: 2023-08-31T21:58:04.3554705Z 2023-08-31T21:58:04.3555076Z beautifulsoup4 conda-forge/noarch::beautifulsoup4-4.12.2-pyha770c72_0 2023-08-31T21:58:04.3555562Z boltons conda-forge/noarch::boltons-23.0.0-pyhd8ed1ab_0 2023-08-31T21:58:04.3556051Z brotli-python conda-forge/linux-64::brotli-python-1.0.9-py39h5a03fae_9 2023-08-31T21:58:04.3556532Z certifi conda-forge/noarch::certifi-2023.7.22-pyhd8ed1ab_0 2023-08-31T21:58:04.3556986Z cffi conda-forge/linux-64::cffi-1.15.1-py39he91dace_3 2023-08-31T21:58:04.3557428Z chardet conda-forge/linux-64::chardet-5.2.0-py39hf3d152e_0 2023-08-31T21:58:04.3557917Z charset-normalizer conda-forge/noarch::charset-normalizer-3.2.0-pyhd8ed1ab_0 2023-08-31T21:58:04.3558407Z click conda-forge/noarch::click-8.1.7-unix_pyh707e725_0 2023-08-31T21:58:04.3558845Z colorama conda-forge/noarch::colorama-0.4.6-pyhd8ed1ab_0 2023-08-31T21:58:04.3559295Z conda conda-forge/linux-64::conda-23.7.3-py39hf3d152e_0 2023-08-31T21:58:04.3559871Z conda-build conda-forge/linux-64::conda-build-3.26.1-py39hf3d152e_0 2023-08-31T21:58:04.3560422Z conda-index conda-forge/noarch::conda-index-0.2.3-pyhd8ed1ab_0 2023-08-31T21:58:04.3560942Z conda-package-han~ conda-forge/noarch::conda-package-handling-2.2.0-pyh38be061_0 2023-08-31T21:58:04.3561507Z conda-package-str~ conda-forge/noarch::conda-package-streaming-0.9.0-pyhd8ed1ab_0 2023-08-31T21:58:04.3562055Z cryptography conda-forge/linux-64::cryptography-41.0.3-py39hd4f0224_0 2023-08-31T21:58:04.3562533Z filelock conda-forge/noarch::filelock-3.12.3-pyhd8ed1ab_0 2023-08-31T21:58:04.3562951Z glob2 conda-forge/noarch::glob2-0.7-py_0 2023-08-31T21:58:04.3563371Z icu conda-forge/linux-64::icu-73.2-h59595ed_0 2023-08-31T21:58:04.3563787Z idna conda-forge/noarch::idna-3.4-pyhd8ed1ab_0 2023-08-31T21:58:04.3564226Z jinja2 conda-forge/noarch::jinja2-3.1.2-pyhd8ed1ab_1 2023-08-31T21:58:04.3564679Z jsonpatch conda-forge/noarch::jsonpatch-1.32-pyhd8ed1ab_0 2023-08-31T21:58:04.3565145Z jsonpointer conda-forge/noarch::jsonpointer-2.0-py_0 2023-08-31T21:58:04.3565606Z libarchive conda-forge/linux-64::libarchive-3.6.2-h039dbb9_1 2023-08-31T21:58:04.3566054Z libiconv conda-forge/linux-64::libiconv-1.17-h166bdaf_0 2023-08-31T21:58:04.3566871Z liblief conda-forge/linux-64::liblief-0.12.3-h27087fc_0 2023-08-31T21:58:04.3567342Z libstdcxx-ng conda-forge/linux-64::libstdcxx-ng-13.1.0-hfd8a6a1_0 2023-08-31T21:58:04.3567804Z libxml2 conda-forge/linux-64::libxml2-2.11.5-h232c23b_1 2023-08-31T21:58:04.3568226Z lz4-c conda-forge/linux-64::lz4-c-1.9.4-hcb278e6_0 2023-08-31T21:58:04.3568647Z lzo conda-forge/linux-64::lzo-2.10-h516909a_1000 2023-08-31T21:58:04.3569106Z markupsafe conda-forge/linux-64::markupsafe-2.1.3-py39hd1e30aa_0 2023-08-31T21:58:04.3569616Z more-itertools conda-forge/noarch::more-itertools-10.1.0-pyhd8ed1ab_0 2023-08-31T21:58:04.3570096Z packaging conda-forge/noarch::packaging-23.1-pyhd8ed1ab_0 2023-08-31T21:58:04.3570552Z patch conda-forge/linux-64::patch-2.7.6-h7f98852_1002 2023-08-31T21:58:04.3570992Z patchelf conda-forge/linux-64::patchelf-0.17.2-h58526e2_0 2023-08-31T21:58:04.3571427Z pkginfo conda-forge/noarch::pkginfo-1.9.6-pyhd8ed1ab_0 2023-08-31T21:58:04.3571876Z pluggy conda-forge/noarch::pluggy-1.3.0-pyhd8ed1ab_0 2023-08-31T21:58:04.3572336Z psutil conda-forge/linux-64::psutil-5.9.5-py39h72bdee0_0 2023-08-31T21:58:04.3572799Z py-lief conda-forge/linux-64::py-lief-0.12.3-py39h5a03fae_0 2023-08-31T21:58:04.3573252Z pycosat conda-forge/linux-64::pycosat-0.6.4-py39hb9d737c_1 2023-08-31T21:58:04.3573706Z pycparser conda-forge/noarch::pycparser-2.21-pyhd8ed1ab_0 2023-08-31T21:58:04.3574182Z pyopenssl conda-forge/noarch::pyopenssl-23.2.0-pyhd8ed1ab_1 2023-08-31T21:58:04.3574638Z pysocks conda-forge/noarch::pysocks-1.7.1-pyha2e5f31_6 2023-08-31T21:58:04.3575142Z python-libarchive~ conda-forge/linux-64::python-libarchive-c-5.0-py39hf3d152e_1 2023-08-31T21:58:04.3575625Z python_abi conda-forge/linux-64::python_abi-3.9-3_cp39 2023-08-31T21:58:04.3576058Z pytz conda-forge/noarch::pytz-2023.3-pyhd8ed1ab_0 2023-08-31T21:58:04.3576511Z pyyaml conda-forge/linux-64::pyyaml-6.0.1-py39hd1e30aa_0 2023-08-31T21:58:04.3576958Z requests conda-forge/noarch::requests-2.31.0-pyhd8ed1ab_0 2023-08-31T21:58:04.3577418Z ripgrep conda-forge/linux-64::ripgrep-13.0.0-h2f28480_2 2023-08-31T21:58:04.3577894Z ruamel.yaml conda-forge/linux-64::ruamel.yaml-0.17.32-py39hd1e30aa_0 2023-08-31T21:58:04.3578399Z ruamel.yaml.clib conda-forge/linux-64::ruamel.yaml.clib-0.2.7-py39h72bdee0_1 2023-08-31T21:58:04.3578994Z six conda-forge/noarch::six-1.16.0-pyh6c4a22f_0 2023-08-31T21:58:04.3579461Z soupsieve conda-forge/noarch::soupsieve-2.3.2.post1-pyhd8ed1ab_0 2023-08-31T21:58:04.3580028Z tomli conda-forge/noarch::tomli-2.0.1-pyhd8ed1ab_0 2023-08-31T21:58:04.3580462Z toolz conda-forge/noarch::toolz-0.12.0-pyhd8ed1ab_0 2023-08-31T21:58:04.3580895Z tqdm conda-forge/noarch::tqdm-4.66.1-pyhd8ed1ab_0 2023-08-31T21:58:04.3581335Z urllib3 conda-forge/noarch::urllib3-2.0.4-pyhd8ed1ab_0 2023-08-31T21:58:04.3581764Z yaml conda-forge/linux-64::yaml-0.2.5-h7f98852_2 2023-08-31T21:58:04.3582213Z zstandard conda-forge/linux-64::zstandard-0.19.0-py39hb9d737c_0 2023-08-31T21:58:04.3582660Z zstd conda-forge/linux-64::zstd-1.5.5-hfc55251_0 2023-08-31T21:58:04.3582835Z 2023-08-31T21:58:04.3633982Z 2023-08-31T21:58:04.3634241Z 2023-08-31T21:58:04.3636209Z Downloading and Extracting Packages 2023-08-31T21:58:04.3636658Z 2023-08-31T21:58:04.3638171Z libarchive-3.6.2 | 824 KB | | 0% 2023-08-31T21:58:04.3638527Z 2023-08-31T21:58:04.3674391Z ripgrep-13.0.0 | 1.7 MB | | 0%  2023-08-31T21:58:04.3674811Z 2023-08-31T21:58:04.3675236Z 2023-08-31T21:58:04.3679984Z toolz-0.12.0 | 48 KB | | 0%  2023-08-31T21:58:04.3680342Z 2023-08-31T21:58:04.3680710Z 2023-08-31T21:58:04.3680901Z 2023-08-31T21:58:04.3684289Z jinja2-3.1.2 | 99 KB | | 0%  2023-08-31T21:58:04.3684615Z 2023-08-31T21:58:04.3684995Z 2023-08-31T21:58:04.3685149Z 2023-08-31T21:58:04.3685516Z 2023-08-31T21:58:04.3714711Z patchelf-0.17.2 | 92 KB | | 0%  2023-08-31T21:58:04.3715107Z 2023-08-31T21:58:04.3715495Z 2023-08-31T21:58:04.3715646Z 2023-08-31T21:58:04.3715990Z 2023-08-31T21:58:04.3716179Z 2023-08-31T21:58:04.3716778Z libstdcxx-ng-13.1.0 | 3.7 MB | | 0%  2023-08-31T21:58:04.3717137Z 2023-08-31T21:58:04.3717483Z 2023-08-31T21:58:04.3717627Z 2023-08-31T21:58:04.3717965Z 2023-08-31T21:58:04.3718111Z 2023-08-31T21:58:04.3718450Z 2023-08-31T21:58:04.3718867Z jsonpointer-2.0 | 9 KB | | 0%  2023-08-31T21:58:04.3719398Z 2023-08-31T21:58:04.3719543Z 2023-08-31T21:58:04.3719886Z 2023-08-31T21:58:04.3720031Z 2023-08-31T21:58:04.3720370Z 2023-08-31T21:58:04.3720511Z 2023-08-31T21:58:04.3720850Z 2023-08-31T21:58:04.3721243Z markupsafe-2.1.3 | 23 KB | | 0%  2023-08-31T21:58:04.3721772Z 2023-08-31T21:58:04.3721916Z 2023-08-31T21:58:04.3722255Z 2023-08-31T21:58:04.3722398Z 2023-08-31T21:58:04.3722745Z 2023-08-31T21:58:04.3722887Z 2023-08-31T21:58:04.3723226Z 2023-08-31T21:58:04.3723369Z 2023-08-31T21:58:04.3723934Z libxml2-2.11.5 | 689 KB | | 0%  2023-08-31T21:58:04.3724262Z 2023-08-31T21:58:04.3724608Z 2023-08-31T21:58:04.3724761Z 2023-08-31T21:58:04.3725101Z 2023-08-31T21:58:04.3725242Z 2023-08-31T21:58:04.3725620Z 2023-08-31T21:58:04.3725763Z 2023-08-31T21:58:04.3727615Z 2023-08-31T21:58:04.3727777Z 2023-08-31T21:58:04.3728423Z psutil-5.9.5 | 350 KB | | 0%  2023-08-31T21:58:04.3728765Z 2023-08-31T21:58:04.3729112Z 2023-08-31T21:58:04.3729254Z 2023-08-31T21:58:04.3729982Z 2023-08-31T21:58:04.3730131Z 2023-08-31T21:58:04.3730489Z 2023-08-31T21:58:04.3730631Z 2023-08-31T21:58:04.3730970Z 2023-08-31T21:58:04.3731112Z 2023-08-31T21:58:04.3731509Z 2023-08-31T21:58:04.3731903Z pkginfo-1.9.6 | 27 KB | | 0%  2023-08-31T21:58:04.3732445Z 2023-08-31T21:58:04.3732590Z 2023-08-31T21:58:04.3733057Z 2023-08-31T21:58:04.3733200Z 2023-08-31T21:58:04.3733539Z 2023-08-31T21:58:04.3733682Z 2023-08-31T21:58:04.3734019Z 2023-08-31T21:58:04.3734159Z 2023-08-31T21:58:04.3734499Z 2023-08-31T21:58:04.3734640Z 2023-08-31T21:58:04.3735244Z 2023-08-31T21:58:04.3735630Z click-8.1.7 | 82 KB | | 0%  2023-08-31T21:58:04.3736169Z 2023-08-31T21:58:04.3736323Z 2023-08-31T21:58:04.3736665Z 2023-08-31T21:58:04.3736938Z 2023-08-31T21:58:04.3737291Z 2023-08-31T21:58:04.3737435Z 2023-08-31T21:58:04.3737775Z 2023-08-31T21:58:04.3737916Z 2023-08-31T21:58:04.3738252Z 2023-08-31T21:58:04.3738394Z 2023-08-31T21:58:04.3738731Z 2023-08-31T21:58:04.3738871Z 2023-08-31T21:58:04.3739455Z pycosat-0.6.4 | 108 KB | | 0%  2023-08-31T21:58:04.3739791Z 2023-08-31T21:58:04.3740134Z 2023-08-31T21:58:04.3740274Z 2023-08-31T21:58:04.3740613Z 2023-08-31T21:58:04.3740763Z 2023-08-31T21:58:04.3741105Z 2023-08-31T21:58:04.3741245Z 2023-08-31T21:58:04.3741582Z 2023-08-31T21:58:04.3741722Z 2023-08-31T21:58:04.3742060Z 2023-08-31T21:58:04.3742200Z 2023-08-31T21:58:04.3742536Z 2023-08-31T21:58:04.3742678Z 2023-08-31T21:58:04.3743317Z beautifulsoup4-4.12. | 112 KB | | 0%  2023-08-31T21:58:04.3743663Z 2023-08-31T21:58:04.3744097Z 2023-08-31T21:58:04.3744243Z 2023-08-31T21:58:04.3744583Z 2023-08-31T21:58:04.3744729Z 2023-08-31T21:58:04.3745071Z 2023-08-31T21:58:04.3745222Z 2023-08-31T21:58:04.3745563Z 2023-08-31T21:58:04.3745719Z 2023-08-31T21:58:04.3746059Z 2023-08-31T21:58:04.3746204Z 2023-08-31T21:58:04.3746543Z 2023-08-31T21:58:04.3746684Z 2023-08-31T21:58:04.3747022Z 2023-08-31T21:58:04.3747415Z pyyaml-6.0.1 | 174 KB | | 0%  2023-08-31T21:58:04.3747946Z 2023-08-31T21:58:04.3748089Z 2023-08-31T21:58:04.3748426Z 2023-08-31T21:58:04.3748568Z 2023-08-31T21:58:04.3748905Z 2023-08-31T21:58:04.3749045Z 2023-08-31T21:58:04.3749383Z 2023-08-31T21:58:04.3749532Z 2023-08-31T21:58:04.3749871Z 2023-08-31T21:58:04.3750013Z 2023-08-31T21:58:04.3750352Z 2023-08-31T21:58:04.3750494Z 2023-08-31T21:58:04.3750838Z 2023-08-31T21:58:04.3750979Z 2023-08-31T21:58:04.3751316Z 2023-08-31T21:58:04.3751711Z pyopenssl-23.2.0 | 126 KB | | 0%  2023-08-31T21:58:04.3752254Z 2023-08-31T21:58:04.3752397Z 2023-08-31T21:58:04.3752736Z 2023-08-31T21:58:04.3752878Z 2023-08-31T21:58:04.3753214Z 2023-08-31T21:58:04.3753356Z 2023-08-31T21:58:04.3753693Z 2023-08-31T21:58:04.3753850Z 2023-08-31T21:58:04.3754188Z 2023-08-31T21:58:04.3754328Z 2023-08-31T21:58:04.3754665Z 2023-08-31T21:58:04.3754806Z 2023-08-31T21:58:04.3755142Z 2023-08-31T21:58:04.3755283Z 2023-08-31T21:58:04.3755620Z 2023-08-31T21:58:04.3755762Z 2023-08-31T21:58:04.3756358Z conda-23.7.3 | 994 KB | | 0%  2023-08-31T21:58:04.3756692Z 2023-08-31T21:58:04.3757032Z 2023-08-31T21:58:04.3757174Z 2023-08-31T21:58:04.3757512Z 2023-08-31T21:58:04.3757653Z 2023-08-31T21:58:04.3758003Z 2023-08-31T21:58:04.3758146Z 2023-08-31T21:58:04.3758492Z 2023-08-31T21:58:04.3758633Z 2023-08-31T21:58:04.3758969Z 2023-08-31T21:58:04.3759111Z 2023-08-31T21:58:04.3759457Z 2023-08-31T21:58:04.3759597Z 2023-08-31T21:58:04.3759935Z 2023-08-31T21:58:04.3760081Z 2023-08-31T21:58:04.3760420Z 2023-08-31T21:58:04.3760561Z 2023-08-31T21:58:04.3761157Z idna-3.4 | 55 KB | | 0%  2023-08-31T21:58:04.3761488Z 2023-08-31T21:58:04.3761829Z 2023-08-31T21:58:04.3761970Z 2023-08-31T21:58:04.3762412Z 2023-08-31T21:58:04.3762558Z 2023-08-31T21:58:04.3762899Z 2023-08-31T21:58:04.3763040Z 2023-08-31T21:58:04.3763380Z 2023-08-31T21:58:04.3763523Z 2023-08-31T21:58:04.3763861Z 2023-08-31T21:58:04.3764001Z 2023-08-31T21:58:04.3764340Z 2023-08-31T21:58:04.3764483Z 2023-08-31T21:58:04.3764820Z 2023-08-31T21:58:04.3764960Z 2023-08-31T21:58:04.3765309Z 2023-08-31T21:58:04.3765453Z 2023-08-31T21:58:04.3765824Z 2023-08-31T21:58:04.3766248Z more-itertools-10.1. | 52 KB | | 0%  2023-08-31T21:58:04.3767411Z 2023-08-31T21:58:04.3771608Z 2023-08-31T21:58:04.3772048Z 2023-08-31T21:58:04.3772200Z 2023-08-31T21:58:04.3772871Z 2023-08-31T21:58:04.3773039Z 2023-08-31T21:58:04.3773440Z 2023-08-31T21:58:04.3773582Z 2023-08-31T21:58:04.3774047Z 2023-08-31T21:58:04.3774199Z 2023-08-31T21:58:04.3774558Z 2023-08-31T21:58:04.3774704Z 2023-08-31T21:58:04.3775093Z 2023-08-31T21:58:04.3775335Z 2023-08-31T21:58:04.3775676Z 2023-08-31T21:58:04.3775852Z 2023-08-31T21:58:04.3776224Z 2023-08-31T21:58:04.3776398Z 2023-08-31T21:58:04.3776874Z 2023-08-31T21:58:04.5351635Z ... (more hidden) ... 2023-08-31T21:58:04.5378862Z libarchive-3.6.2 | 824 KB | 1 | 2% 2023-08-31T21:58:04.5379236Z 2023-08-31T21:58:04.5379594Z 2023-08-31T21:58:04.5379739Z 2023-08-31T21:58:04.5380106Z 2023-08-31T21:58:04.5567951Z patchelf-0.17.2 | 92 KB | #7 | 17%  2023-08-31T21:58:04.5568397Z 2023-08-31T21:58:04.5568783Z 2023-08-31T21:58:04.5568934Z 2023-08-31T21:58:04.5570416Z 2023-08-31T21:58:04.5619403Z patchelf-0.17.2 | 92 KB | ########## | 100%  2023-08-31T21:58:04.5619832Z 2023-08-31T21:58:04.5761326Z ripgrep-13.0.0 | 1.7 MB | | 1%  2023-08-31T21:58:04.5761873Z 2023-08-31T21:58:04.5762271Z 2023-08-31T21:58:04.5762463Z 2023-08-31T21:58:04.5855859Z jinja2-3.1.2 | 99 KB | #6 | 16%  2023-08-31T21:58:04.5856262Z 2023-08-31T21:58:04.5856640Z 2023-08-31T21:58:04.5856787Z 2023-08-31T21:58:04.5857133Z 2023-08-31T21:58:04.5857320Z 2023-08-31T21:58:04.6014747Z libstdcxx-ng-13.1.0 | 3.7 MB | | 0%  2023-08-31T21:58:04.6015161Z 2023-08-31T21:58:04.6015539Z 2023-08-31T21:58:04.6015697Z 2023-08-31T21:58:04.6016042Z 2023-08-31T21:58:04.6016186Z 2023-08-31T21:58:04.6016564Z 2023-08-31T21:58:04.6162968Z jsonpointer-2.0 | 9 KB | ########## | 100%  2023-08-31T21:58:04.6163404Z 2023-08-31T21:58:04.6163777Z 2023-08-31T21:58:04.6163925Z 2023-08-31T21:58:04.6164291Z 2023-08-31T21:58:04.6164437Z 2023-08-31T21:58:04.6164791Z 2023-08-31T21:58:04.6164971Z 2023-08-31T21:58:04.6324163Z markupsafe-2.1.3 | 23 KB | ######8 | 68%  2023-08-31T21:58:04.6367218Z libarchive-3.6.2 | 824 KB | ########## | 100% 2023-08-31T21:58:04.6367632Z 2023-08-31T21:58:04.6368048Z 2023-08-31T21:58:04.6433324Z toolz-0.12.0 | 48 KB | ###3 | 33%  2023-08-31T21:58:04.6434287Z 2023-08-31T21:58:04.6434443Z 2023-08-31T21:58:04.6434792Z 2023-08-31T21:58:04.6434954Z 2023-08-31T21:58:04.6435302Z 2023-08-31T21:58:04.6437593Z 2023-08-31T21:58:04.6562200Z jsonpointer-2.0 | 9 KB | ########## | 100%  2023-08-31T21:58:04.6562620Z 2023-08-31T21:58:04.6562995Z 2023-08-31T21:58:04.6563143Z 2023-08-31T21:58:04.6563488Z 2023-08-31T21:58:04.6563660Z 2023-08-31T21:58:04.6564003Z 2023-08-31T21:58:04.6566903Z 2023-08-31T21:58:04.6607852Z markupsafe-2.1.3 | 23 KB | ########## | 100%  2023-08-31T21:58:04.6608411Z 2023-08-31T21:58:04.6618762Z 2023-08-31T21:58:04.6618946Z 2023-08-31T21:58:04.6622201Z 2023-08-31T21:58:04.6622370Z 2023-08-31T21:58:04.6622720Z 2023-08-31T21:58:04.6622865Z 2023-08-31T21:58:04.6623682Z 2023-08-31T21:58:04.6660853Z libxml2-2.11.5 | 689 KB | 2 | 2%  2023-08-31T21:58:04.6661247Z 2023-08-31T21:58:04.6661611Z 2023-08-31T21:58:04.6661757Z 2023-08-31T21:58:04.6662117Z 2023-08-31T21:58:04.6662266Z 2023-08-31T21:58:04.6662606Z 2023-08-31T21:58:04.6662748Z 2023-08-31T21:58:04.6663088Z 2023-08-31T21:58:04.6663268Z 2023-08-31T21:58:04.6709827Z psutil-5.9.5 | 350 KB | 4 | 5%  2023-08-31T21:58:04.6710226Z 2023-08-31T21:58:04.6710600Z 2023-08-31T21:58:04.6710782Z 2023-08-31T21:58:04.6885222Z jinja2-3.1.2 | 99 KB | ########## | 100%  2023-08-31T21:58:04.6885863Z 2023-08-31T21:58:04.6886246Z 2023-08-31T21:58:04.6886568Z 2023-08-31T21:58:04.6886919Z 2023-08-31T21:58:04.6887061Z 2023-08-31T21:58:04.6887554Z 2023-08-31T21:58:04.6887710Z 2023-08-31T21:58:04.6888117Z 2023-08-31T21:58:04.6888265Z 2023-08-31T21:58:04.6888622Z 2023-08-31T21:58:04.6888806Z 2023-08-31T21:58:04.6970553Z click-8.1.7 | 82 KB | #9 | 19%  2023-08-31T21:58:04.6970949Z 2023-08-31T21:58:04.6974670Z 2023-08-31T21:58:04.6975166Z toolz-0.12.0 | 48 KB | ########## | 100%  2023-08-31T21:58:04.6977932Z 2023-08-31T21:58:04.6978122Z 2023-08-31T21:58:04.6982174Z 2023-08-31T21:58:04.6982343Z 2023-08-31T21:58:04.6982699Z 2023-08-31T21:58:04.6982846Z 2023-08-31T21:58:04.6989641Z 2023-08-31T21:58:04.6989807Z 2023-08-31T21:58:04.6993008Z 2023-08-31T21:58:04.6993173Z 2023-08-31T21:58:04.7073667Z pkginfo-1.9.6 | 27 KB | #####9 | 59%  2023-08-31T21:58:04.7074096Z 2023-08-31T21:58:04.7074466Z 2023-08-31T21:58:04.7074613Z 2023-08-31T21:58:04.7074964Z 2023-08-31T21:58:04.7075109Z 2023-08-31T21:58:04.7075450Z 2023-08-31T21:58:04.7075606Z 2023-08-31T21:58:04.7075961Z 2023-08-31T21:58:04.7076103Z 2023-08-31T21:58:04.7076443Z 2023-08-31T21:58:04.7076585Z 2023-08-31T21:58:04.7076965Z 2023-08-31T21:58:04.7111233Z pycosat-0.6.4 | 108 KB | #4 | 15%  2023-08-31T21:58:04.7111656Z 2023-08-31T21:58:04.7112741Z 2023-08-31T21:58:04.7112894Z 2023-08-31T21:58:04.7113248Z 2023-08-31T21:58:04.7113395Z 2023-08-31T21:58:04.7115198Z 2023-08-31T21:58:04.7115356Z 2023-08-31T21:58:04.7115704Z 2023-08-31T21:58:04.7115855Z 2023-08-31T21:58:04.7117028Z 2023-08-31T21:58:04.7117206Z 2023-08-31T21:58:04.7118232Z 2023-08-31T21:58:04.7118401Z 2023-08-31T21:58:04.7135946Z beautifulsoup4-4.12. | 112 KB | #4 | 14%  2023-08-31T21:58:04.7136379Z 2023-08-31T21:58:04.7140079Z 2023-08-31T21:58:04.7140249Z 2023-08-31T21:58:04.7140605Z 2023-08-31T21:58:04.7140754Z 2023-08-31T21:58:04.7141098Z 2023-08-31T21:58:04.7141241Z 2023-08-31T21:58:04.7141597Z 2023-08-31T21:58:04.7141741Z 2023-08-31T21:58:04.7142082Z 2023-08-31T21:58:04.7142223Z 2023-08-31T21:58:04.7142587Z 2023-08-31T21:58:04.7142748Z 2023-08-31T21:58:04.7143150Z 2023-08-31T21:58:04.7341011Z pyyaml-6.0.1 | 174 KB | 9 | 9%  2023-08-31T21:58:04.7341456Z 2023-08-31T21:58:04.7359497Z 2023-08-31T21:58:04.7359672Z 2023-08-31T21:58:04.7360028Z 2023-08-31T21:58:04.7360176Z 2023-08-31T21:58:04.7360521Z 2023-08-31T21:58:04.7360665Z 2023-08-31T21:58:04.7361005Z 2023-08-31T21:58:04.7361147Z 2023-08-31T21:58:04.7361488Z 2023-08-31T21:58:04.7361631Z 2023-08-31T21:58:04.7361970Z 2023-08-31T21:58:04.7362130Z 2023-08-31T21:58:04.7362476Z 2023-08-31T21:58:04.7362618Z 2023-08-31T21:58:04.7362974Z 2023-08-31T21:58:04.7402216Z conda-23.7.3 | 994 KB | 1 | 2%  2023-08-31T21:58:04.7402646Z 2023-08-31T21:58:04.7403025Z 2023-08-31T21:58:04.7403189Z 2023-08-31T21:58:04.7403536Z 2023-08-31T21:58:04.7403683Z 2023-08-31T21:58:04.7404026Z 2023-08-31T21:58:04.7404170Z 2023-08-31T21:58:04.7404511Z 2023-08-31T21:58:04.7404655Z 2023-08-31T21:58:04.7405083Z 2023-08-31T21:58:04.7405233Z 2023-08-31T21:58:04.7406038Z 2023-08-31T21:58:04.7406193Z 2023-08-31T21:58:04.7406679Z 2023-08-31T21:58:04.7406866Z 2023-08-31T21:58:04.7485182Z pyopenssl-23.2.0 | 126 KB | #2 | 13%  2023-08-31T21:58:04.7485618Z 2023-08-31T21:58:04.7485990Z 2023-08-31T21:58:04.7486138Z 2023-08-31T21:58:04.7486631Z 2023-08-31T21:58:04.7486783Z 2023-08-31T21:58:04.7487176Z 2023-08-31T21:58:04.7487320Z 2023-08-31T21:58:04.7487660Z 2023-08-31T21:58:04.7487803Z 2023-08-31T21:58:04.7488146Z 2023-08-31T21:58:04.7488524Z 2023-08-31T21:58:04.7488879Z 2023-08-31T21:58:04.7489031Z 2023-08-31T21:58:04.7489375Z 2023-08-31T21:58:04.7489517Z 2023-08-31T21:58:04.7489859Z 2023-08-31T21:58:04.7490001Z 2023-08-31T21:58:04.7490473Z 2023-08-31T21:58:04.7490662Z 2023-08-31T21:58:04.7647198Z ... (more hidden) ... 2023-08-31T21:58:04.7647616Z 2023-08-31T21:58:04.7647989Z 2023-08-31T21:58:04.7648135Z 2023-08-31T21:58:04.7648478Z 2023-08-31T21:58:04.7648623Z 2023-08-31T21:58:04.7648964Z 2023-08-31T21:58:04.7649105Z 2023-08-31T21:58:04.7649455Z 2023-08-31T21:58:04.7649598Z 2023-08-31T21:58:04.7649938Z 2023-08-31T21:58:04.7650079Z 2023-08-31T21:58:04.7650417Z 2023-08-31T21:58:04.7650559Z 2023-08-31T21:58:04.7650896Z 2023-08-31T21:58:04.7651036Z 2023-08-31T21:58:04.7651374Z 2023-08-31T21:58:04.7651516Z 2023-08-31T21:58:04.7651856Z 2023-08-31T21:58:04.7659266Z more-itertools-10.1. | 52 KB | ### | 31%  2023-08-31T21:58:04.7659696Z 2023-08-31T21:58:04.7660054Z 2023-08-31T21:58:04.7660198Z 2023-08-31T21:58:04.7660541Z 2023-08-31T21:58:04.7660696Z 2023-08-31T21:58:04.7661040Z 2023-08-31T21:58:04.7661191Z 2023-08-31T21:58:04.7661532Z 2023-08-31T21:58:04.7661673Z 2023-08-31T21:58:04.7662014Z 2023-08-31T21:58:04.7662155Z 2023-08-31T21:58:04.7662505Z 2023-08-31T21:58:04.7662645Z 2023-08-31T21:58:04.7662986Z 2023-08-31T21:58:04.7663127Z 2023-08-31T21:58:04.7663464Z 2023-08-31T21:58:04.7663651Z 2023-08-31T21:58:04.7825488Z idna-3.4 | 55 KB | ##8 | 29%  2023-08-31T21:58:04.7825964Z 2023-08-31T21:58:04.7826351Z 2023-08-31T21:58:04.7826502Z 2023-08-31T21:58:04.7826851Z 2023-08-31T21:58:04.7827037Z 2023-08-31T21:58:04.7829486Z libstdcxx-ng-13.1.0 | 3.7 MB | ########## | 100%  2023-08-31T21:58:04.7829849Z 2023-08-31T21:58:04.7830205Z 2023-08-31T21:58:04.7830351Z 2023-08-31T21:58:04.7830711Z 2023-08-31T21:58:04.7830878Z 2023-08-31T21:58:04.8298332Z libstdcxx-ng-13.1.0 | 3.7 MB | ########## | 100%  2023-08-31T21:58:04.8298747Z 2023-08-31T21:58:04.8299124Z 2023-08-31T21:58:04.8299546Z 2023-08-31T21:58:04.8299914Z 2023-08-31T21:58:04.8300061Z 2023-08-31T21:58:04.8300404Z 2023-08-31T21:58:04.8300546Z 2023-08-31T21:58:04.8301821Z 2023-08-31T21:58:04.8304782Z libxml2-2.11.5 | 689 KB | ########## | 100%  2023-08-31T21:58:04.8305145Z 2023-08-31T21:58:04.8305498Z 2023-08-31T21:58:04.8305643Z 2023-08-31T21:58:04.8305982Z 2023-08-31T21:58:04.8306135Z 2023-08-31T21:58:04.8306477Z 2023-08-31T21:58:04.8306621Z 2023-08-31T21:58:04.8307665Z 2023-08-31T21:58:04.8646893Z libxml2-2.11.5 | 689 KB | ########## | 100%  2023-08-31T21:58:04.8647325Z 2023-08-31T21:58:04.8650404Z 2023-08-31T21:58:04.8650627Z 2023-08-31T21:58:04.8651036Z 2023-08-31T21:58:04.8651185Z 2023-08-31T21:58:04.8651535Z 2023-08-31T21:58:04.8651696Z 2023-08-31T21:58:04.8652039Z 2023-08-31T21:58:04.8687819Z 2023-08-31T21:58:04.8691567Z psutil-5.9.5 | 350 KB | ########## | 100%  2023-08-31T21:58:04.8691945Z 2023-08-31T21:58:04.8695230Z 2023-08-31T21:58:04.8695392Z 2023-08-31T21:58:04.8695799Z 2023-08-31T21:58:04.8695943Z 2023-08-31T21:58:04.8698527Z 2023-08-31T21:58:04.8698686Z 2023-08-31T21:58:04.8699032Z 2023-08-31T21:58:04.8699183Z 2023-08-31T21:58:04.8852391Z psutil-5.9.5 | 350 KB | ########## | 100%  2023-08-31T21:58:04.8852816Z 2023-08-31T21:58:04.8853439Z 2023-08-31T21:58:04.8853594Z 2023-08-31T21:58:04.8853943Z 2023-08-31T21:58:04.8854086Z 2023-08-31T21:58:04.8854431Z 2023-08-31T21:58:04.8854576Z 2023-08-31T21:58:04.8854917Z 2023-08-31T21:58:04.8855059Z 2023-08-31T21:58:04.8855399Z 2023-08-31T21:58:04.8857545Z 2023-08-31T21:58:04.8866491Z click-8.1.7 | 82 KB | ########## | 100%  2023-08-31T21:58:04.8867129Z 2023-08-31T21:58:04.8867501Z 2023-08-31T21:58:04.8867645Z 2023-08-31T21:58:04.8868000Z 2023-08-31T21:58:04.8868145Z 2023-08-31T21:58:04.8868487Z 2023-08-31T21:58:04.8868631Z 2023-08-31T21:58:04.8869115Z 2023-08-31T21:58:04.8869271Z 2023-08-31T21:58:04.8869618Z 2023-08-31T21:58:04.8872174Z 2023-08-31T21:58:04.9051020Z click-8.1.7 | 82 KB | ########## | 100%  2023-08-31T21:58:04.9051979Z 2023-08-31T21:58:04.9052137Z 2023-08-31T21:58:04.9052487Z 2023-08-31T21:58:04.9052631Z 2023-08-31T21:58:04.9052973Z 2023-08-31T21:58:04.9053119Z 2023-08-31T21:58:04.9053461Z 2023-08-31T21:58:04.9053614Z 2023-08-31T21:58:04.9053954Z 2023-08-31T21:58:04.9056131Z 2023-08-31T21:58:04.9059116Z pkginfo-1.9.6 | 27 KB | ########## | 100%  2023-08-31T21:58:04.9059484Z 2023-08-31T21:58:04.9059838Z 2023-08-31T21:58:04.9059985Z 2023-08-31T21:58:04.9060326Z 2023-08-31T21:58:04.9060468Z 2023-08-31T21:58:04.9060828Z 2023-08-31T21:58:04.9060970Z 2023-08-31T21:58:04.9061308Z 2023-08-31T21:58:04.9061450Z 2023-08-31T21:58:04.9062503Z 2023-08-31T21:58:04.9692255Z pkginfo-1.9.6 | 27 KB | ########## | 100%  2023-08-31T21:58:04.9693223Z 2023-08-31T21:58:04.9693437Z 2023-08-31T21:58:04.9693789Z 2023-08-31T21:58:04.9693941Z 2023-08-31T21:58:04.9694287Z 2023-08-31T21:58:04.9694446Z 2023-08-31T21:58:04.9694791Z 2023-08-31T21:58:04.9694938Z 2023-08-31T21:58:04.9695278Z 2023-08-31T21:58:04.9695422Z 2023-08-31T21:58:04.9695759Z 2023-08-31T21:58:04.9697831Z 2023-08-31T21:58:04.9701989Z pycosat-0.6.4 | 108 KB | ########## | 100%  2023-08-31T21:58:04.9702377Z 2023-08-31T21:58:04.9702737Z 2023-08-31T21:58:04.9702885Z 2023-08-31T21:58:04.9703227Z 2023-08-31T21:58:04.9703370Z 2023-08-31T21:58:04.9703711Z 2023-08-31T21:58:04.9703855Z 2023-08-31T21:58:04.9704205Z 2023-08-31T21:58:04.9704349Z 2023-08-31T21:58:04.9704691Z 2023-08-31T21:58:04.9704846Z 2023-08-31T21:58:04.9706982Z 2023-08-31T21:58:04.9863952Z pycosat-0.6.4 | 108 KB | ########## | 100%  2023-08-31T21:58:04.9864551Z 2023-08-31T21:58:04.9864724Z 2023-08-31T21:58:04.9865076Z 2023-08-31T21:58:04.9865410Z 2023-08-31T21:58:04.9873834Z 2023-08-31T21:58:04.9874014Z 2023-08-31T21:58:04.9874375Z 2023-08-31T21:58:04.9874520Z 2023-08-31T21:58:04.9874863Z 2023-08-31T21:58:04.9875007Z 2023-08-31T21:58:04.9875423Z 2023-08-31T21:58:04.9875569Z 2023-08-31T21:58:04.9876848Z 2023-08-31T21:58:04.9924201Z beautifulsoup4-4.12. | 112 KB | ########## | 100%  2023-08-31T21:58:04.9924611Z 2023-08-31T21:58:04.9924983Z 2023-08-31T21:58:04.9925130Z 2023-08-31T21:58:04.9925689Z 2023-08-31T21:58:04.9925844Z 2023-08-31T21:58:04.9926494Z 2023-08-31T21:58:04.9926641Z 2023-08-31T21:58:04.9926987Z 2023-08-31T21:58:04.9927131Z 2023-08-31T21:58:04.9927472Z 2023-08-31T21:58:04.9927615Z 2023-08-31T21:58:04.9928068Z 2023-08-31T21:58:04.9942297Z 2023-08-31T21:58:05.0544365Z beautifulsoup4-4.12. | 112 KB | ########## | 100%  2023-08-31T21:58:05.0545587Z 2023-08-31T21:58:05.0546280Z 2023-08-31T21:58:05.0546453Z 2023-08-31T21:58:05.0547164Z 2023-08-31T21:58:05.0547312Z 2023-08-31T21:58:05.0547658Z 2023-08-31T21:58:05.0547924Z 2023-08-31T21:58:05.0548275Z 2023-08-31T21:58:05.0548419Z 2023-08-31T21:58:05.0549105Z 2023-08-31T21:58:05.0549251Z 2023-08-31T21:58:05.0549698Z 2023-08-31T21:58:05.0549848Z 2023-08-31T21:58:05.0552448Z 2023-08-31T21:58:05.0572244Z pyyaml-6.0.1 | 174 KB | ########## | 100%  2023-08-31T21:58:05.0572681Z 2023-08-31T21:58:05.0573054Z 2023-08-31T21:58:05.0573203Z 2023-08-31T21:58:05.0573567Z 2023-08-31T21:58:05.0573711Z 2023-08-31T21:58:05.0574106Z 2023-08-31T21:58:05.0574254Z 2023-08-31T21:58:05.0574594Z 2023-08-31T21:58:05.0574738Z 2023-08-31T21:58:05.0575079Z 2023-08-31T21:58:05.0575486Z 2023-08-31T21:58:05.0576335Z 2023-08-31T21:58:05.0576593Z 2023-08-31T21:58:05.0578994Z 2023-08-31T21:58:05.0821807Z pyyaml-6.0.1 | 174 KB | ########## | 100%  2023-08-31T21:58:05.0825792Z 2023-08-31T21:58:05.0825965Z 2023-08-31T21:58:05.0826317Z 2023-08-31T21:58:05.0826464Z 2023-08-31T21:58:05.0826805Z 2023-08-31T21:58:05.0826961Z 2023-08-31T21:58:05.0827302Z 2023-08-31T21:58:05.0827446Z 2023-08-31T21:58:05.0827785Z 2023-08-31T21:58:05.0827926Z 2023-08-31T21:58:05.0828267Z 2023-08-31T21:58:05.0828419Z 2023-08-31T21:58:05.0828760Z 2023-08-31T21:58:05.0828901Z 2023-08-31T21:58:05.0830408Z 2023-08-31T21:58:05.0834448Z pyopenssl-23.2.0 | 126 KB | ########## | 100%  2023-08-31T21:58:05.0834839Z 2023-08-31T21:58:05.0835198Z 2023-08-31T21:58:05.0835346Z 2023-08-31T21:58:05.0835693Z 2023-08-31T21:58:05.0835846Z 2023-08-31T21:58:05.0849396Z 2023-08-31T21:58:05.0849648Z 2023-08-31T21:58:05.0850026Z 2023-08-31T21:58:05.0850170Z 2023-08-31T21:58:05.0850512Z 2023-08-31T21:58:05.0850654Z 2023-08-31T21:58:05.0850997Z 2023-08-31T21:58:05.0851139Z 2023-08-31T21:58:05.0851477Z 2023-08-31T21:58:05.0853594Z 2023-08-31T21:58:05.1503817Z pyopenssl-23.2.0 | 126 KB | ########## | 100%  2023-08-31T21:58:05.1507057Z 2023-08-31T21:58:05.1508578Z ripgrep-13.0.0 | 1.7 MB | ########## | 100%  2023-08-31T21:58:05.1508942Z 2023-08-31T21:58:05.1846009Z ripgrep-13.0.0 | 1.7 MB | ########## | 100%  2023-08-31T21:58:05.1846579Z 2023-08-31T21:58:05.1847223Z 2023-08-31T21:58:05.1847383Z 2023-08-31T21:58:05.1847740Z 2023-08-31T21:58:05.1847886Z 2023-08-31T21:58:05.1848231Z 2023-08-31T21:58:05.1848375Z 2023-08-31T21:58:05.1848778Z 2023-08-31T21:58:05.1848922Z 2023-08-31T21:58:05.1849278Z 2023-08-31T21:58:05.1849422Z 2023-08-31T21:58:05.1849764Z 2023-08-31T21:58:05.1849907Z 2023-08-31T21:58:05.1850280Z 2023-08-31T21:58:05.1850424Z 2023-08-31T21:58:05.1850764Z 2023-08-31T21:58:05.1850907Z 2023-08-31T21:58:05.1851257Z 2023-08-31T21:58:05.1851447Z 2023-08-31T21:58:05.1852068Z ... (more hidden) ... 2023-08-31T21:58:05.1852417Z 2023-08-31T21:58:05.1852763Z 2023-08-31T21:58:05.1852906Z 2023-08-31T21:58:05.1853249Z 2023-08-31T21:58:05.1853401Z 2023-08-31T21:58:05.1853747Z 2023-08-31T21:58:05.1853890Z 2023-08-31T21:58:05.1854233Z 2023-08-31T21:58:05.1854375Z 2023-08-31T21:58:05.1854714Z 2023-08-31T21:58:05.1854855Z 2023-08-31T21:58:05.1855196Z 2023-08-31T21:58:05.1855338Z 2023-08-31T21:58:05.1855679Z 2023-08-31T21:58:05.1855821Z 2023-08-31T21:58:05.1856161Z 2023-08-31T21:58:05.1856303Z 2023-08-31T21:58:05.1856656Z 2023-08-31T21:58:05.1856798Z 2023-08-31T21:58:05.2097522Z ... (more hidden) ... 2023-08-31T21:58:05.2098485Z 2023-08-31T21:58:05.2098645Z 2023-08-31T21:58:05.2099010Z 2023-08-31T21:58:05.2099158Z 2023-08-31T21:58:05.2099501Z 2023-08-31T21:58:05.2099649Z 2023-08-31T21:58:05.2099990Z 2023-08-31T21:58:05.2100135Z 2023-08-31T21:58:05.2100478Z 2023-08-31T21:58:05.2100621Z 2023-08-31T21:58:05.2100971Z 2023-08-31T21:58:05.2101116Z 2023-08-31T21:58:05.2101463Z 2023-08-31T21:58:05.2101608Z 2023-08-31T21:58:05.2101947Z 2023-08-31T21:58:05.2102090Z 2023-08-31T21:58:05.2102474Z 2023-08-31T21:58:05.2102909Z idna-3.4 | 55 KB | ########## | 100%  2023-08-31T21:58:05.2103472Z 2023-08-31T21:58:05.2103618Z 2023-08-31T21:58:05.2103961Z 2023-08-31T21:58:05.2104116Z 2023-08-31T21:58:05.2104459Z 2023-08-31T21:58:05.2104602Z 2023-08-31T21:58:05.2104943Z 2023-08-31T21:58:05.2105085Z 2023-08-31T21:58:05.2105423Z 2023-08-31T21:58:05.2105565Z 2023-08-31T21:58:05.2105913Z 2023-08-31T21:58:05.2106056Z 2023-08-31T21:58:05.2106395Z 2023-08-31T21:58:05.2106537Z 2023-08-31T21:58:05.2106877Z 2023-08-31T21:58:05.2107232Z 2023-08-31T21:58:05.2107575Z 2023-08-31T21:58:05.2244404Z idna-3.4 | 55 KB | ########## | 100%  2023-08-31T21:58:05.2244830Z 2023-08-31T21:58:05.2245391Z 2023-08-31T21:58:05.2245551Z 2023-08-31T21:58:05.2245909Z 2023-08-31T21:58:05.2246255Z 2023-08-31T21:58:05.2246762Z 2023-08-31T21:58:05.2246908Z 2023-08-31T21:58:05.2247252Z 2023-08-31T21:58:05.2247412Z 2023-08-31T21:58:05.2247757Z 2023-08-31T21:58:05.2247904Z 2023-08-31T21:58:05.2248246Z 2023-08-31T21:58:05.2248388Z 2023-08-31T21:58:05.2248727Z 2023-08-31T21:58:05.2248869Z 2023-08-31T21:58:05.2249210Z 2023-08-31T21:58:05.2249352Z 2023-08-31T21:58:05.2249748Z 2023-08-31T21:58:05.2250214Z more-itertools-10.1. | 52 KB | ########## | 100%  2023-08-31T21:58:05.2250789Z 2023-08-31T21:58:05.2250936Z 2023-08-31T21:58:05.2251279Z 2023-08-31T21:58:05.2251423Z 2023-08-31T21:58:05.2251764Z 2023-08-31T21:58:05.2251932Z 2023-08-31T21:58:05.2252273Z 2023-08-31T21:58:05.2252415Z 2023-08-31T21:58:05.2252758Z 2023-08-31T21:58:05.2252900Z 2023-08-31T21:58:05.2253239Z 2023-08-31T21:58:05.2253381Z 2023-08-31T21:58:05.2253772Z 2023-08-31T21:58:05.2253919Z 2023-08-31T21:58:05.2254275Z 2023-08-31T21:58:05.2254418Z 2023-08-31T21:58:05.2254760Z 2023-08-31T21:58:05.2254917Z 2023-08-31T21:58:05.3431625Z more-itertools-10.1. | 52 KB | ########## | 100%  2023-08-31T21:58:05.3432289Z 2023-08-31T21:58:05.3432467Z 2023-08-31T21:58:05.3432819Z 2023-08-31T21:58:05.3432964Z 2023-08-31T21:58:05.3433310Z 2023-08-31T21:58:05.3433453Z 2023-08-31T21:58:05.3433794Z 2023-08-31T21:58:05.3433941Z 2023-08-31T21:58:05.3434284Z 2023-08-31T21:58:05.3434434Z 2023-08-31T21:58:05.3434778Z 2023-08-31T21:58:05.3434921Z 2023-08-31T21:58:05.3435262Z 2023-08-31T21:58:05.3435415Z 2023-08-31T21:58:05.3435760Z 2023-08-31T21:58:05.3438581Z 2023-08-31T21:58:05.3442855Z conda-23.7.3 | 994 KB | ########## | 100%  2023-08-31T21:58:05.3443268Z 2023-08-31T21:58:05.3443628Z 2023-08-31T21:58:05.3443773Z 2023-08-31T21:58:05.3444113Z 2023-08-31T21:58:05.3444267Z 2023-08-31T21:58:05.3444607Z 2023-08-31T21:58:05.3444748Z 2023-08-31T21:58:05.3445098Z 2023-08-31T21:58:05.3445241Z 2023-08-31T21:58:05.3445584Z 2023-08-31T21:58:05.3445728Z 2023-08-31T21:58:05.3446069Z 2023-08-31T21:58:05.3446221Z 2023-08-31T21:58:05.3446761Z 2023-08-31T21:58:05.3446908Z 2023-08-31T21:58:05.3448296Z 2023-08-31T21:58:06.5600103Z conda-23.7.3 | 994 KB | ########## | 100%  2023-08-31T21:58:06.5600662Z 2023-08-31T21:58:06.5602110Z 2023-08-31T21:58:06.5602255Z 2023-08-31T21:58:06.5602405Z 2023-08-31T21:58:06.5602561Z 2023-08-31T21:58:06.5602735Z 2023-08-31T21:58:06.5602878Z 2023-08-31T21:58:06.5603025Z 2023-08-31T21:58:06.5603208Z 2023-08-31T21:58:06.5603403Z 2023-08-31T21:58:06.5603604Z 2023-08-31T21:58:06.5603841Z 2023-08-31T21:58:06.5604044Z 2023-08-31T21:58:06.5604275Z 2023-08-31T21:58:06.5604478Z 2023-08-31T21:58:06.5604793Z 2023-08-31T21:58:06.5605054Z 2023-08-31T21:58:06.5605376Z 2023-08-31T21:58:06.5605733Z 2023-08-31T21:58:06.5606654Z 2023-08-31T21:58:06.5607117Z  2023-08-31T21:58:06.5607483Z 2023-08-31T21:58:06.5607775Z 2023-08-31T21:58:06.5608138Z  2023-08-31T21:58:06.5610436Z 2023-08-31T21:58:06.5611420Z 2023-08-31T21:58:06.5611930Z  2023-08-31T21:58:06.5612254Z 2023-08-31T21:58:06.5612484Z 2023-08-31T21:58:06.5612750Z 2023-08-31T21:58:06.5613208Z  2023-08-31T21:58:06.5613578Z 2023-08-31T21:58:06.5613835Z 2023-08-31T21:58:06.5614082Z 2023-08-31T21:58:06.5614954Z 2023-08-31T21:58:06.5615371Z  2023-08-31T21:58:06.5615884Z 2023-08-31T21:58:06.5616009Z 2023-08-31T21:58:06.5616260Z 2023-08-31T21:58:06.5616862Z 2023-08-31T21:58:06.5617041Z 2023-08-31T21:58:06.5617418Z  2023-08-31T21:58:06.5617714Z 2023-08-31T21:58:06.5669082Z 2023-08-31T21:58:06.5669092Z 2023-08-31T21:58:06.5669111Z 2023-08-31T21:58:06.5669122Z 2023-08-31T21:58:06.5669127Z 2023-08-31T21:58:06.5669393Z  2023-08-31T21:58:06.5669562Z 2023-08-31T21:58:06.5669569Z 2023-08-31T21:58:06.5669576Z 2023-08-31T21:58:06.5669591Z 2023-08-31T21:58:06.5669597Z 2023-08-31T21:58:06.5669603Z 2023-08-31T21:58:06.5669608Z 2023-08-31T21:58:06.5669807Z  2023-08-31T21:58:06.5669955Z 2023-08-31T21:58:06.5669962Z 2023-08-31T21:58:06.5669985Z 2023-08-31T21:58:06.5669999Z 2023-08-31T21:58:06.5670004Z 2023-08-31T21:58:06.5670010Z 2023-08-31T21:58:06.5670016Z 2023-08-31T21:58:06.5670022Z 2023-08-31T21:58:06.5670225Z  2023-08-31T21:58:06.5670377Z 2023-08-31T21:58:06.5670391Z 2023-08-31T21:58:06.5670398Z 2023-08-31T21:58:06.5670403Z 2023-08-31T21:58:06.5670409Z 2023-08-31T21:58:06.5670414Z 2023-08-31T21:58:06.5670419Z 2023-08-31T21:58:06.5670425Z 2023-08-31T21:58:06.5670430Z 2023-08-31T21:58:06.5670630Z  2023-08-31T21:58:06.5670789Z 2023-08-31T21:58:06.5670795Z 2023-08-31T21:58:06.5670801Z 2023-08-31T21:58:06.5670807Z 2023-08-31T21:58:06.5670813Z 2023-08-31T21:58:06.5670818Z 2023-08-31T21:58:06.5670823Z 2023-08-31T21:58:06.5670829Z 2023-08-31T21:58:06.5670834Z 2023-08-31T21:58:06.5670839Z 2023-08-31T21:58:06.5671042Z  2023-08-31T21:58:06.5671213Z 2023-08-31T21:58:06.5671219Z 2023-08-31T21:58:06.5671225Z 2023-08-31T21:58:06.5671231Z 2023-08-31T21:58:06.5671237Z 2023-08-31T21:58:06.5671242Z 2023-08-31T21:58:06.5671253Z 2023-08-31T21:58:06.5671259Z 2023-08-31T21:58:06.5671265Z 2023-08-31T21:58:06.5671271Z 2023-08-31T21:58:06.5671277Z 2023-08-31T21:58:06.5671484Z  2023-08-31T21:58:06.5671645Z 2023-08-31T21:58:06.5671651Z 2023-08-31T21:58:06.5671657Z 2023-08-31T21:58:06.5671663Z 2023-08-31T21:58:06.5671668Z 2023-08-31T21:58:06.5671673Z 2023-08-31T21:58:06.5671679Z 2023-08-31T21:58:06.5671685Z 2023-08-31T21:58:06.5671690Z 2023-08-31T21:58:06.5671695Z 2023-08-31T21:58:06.5671701Z 2023-08-31T21:58:06.5671713Z 2023-08-31T21:58:06.5671912Z  2023-08-31T21:58:06.5672076Z 2023-08-31T21:58:06.5672088Z 2023-08-31T21:58:06.5672095Z 2023-08-31T21:58:06.5672101Z 2023-08-31T21:58:06.5672106Z 2023-08-31T21:58:06.5672119Z 2023-08-31T21:58:06.5672125Z 2023-08-31T21:58:06.5672130Z 2023-08-31T21:58:06.5672135Z 2023-08-31T21:58:06.5672146Z 2023-08-31T21:58:06.5672153Z 2023-08-31T21:58:06.5672159Z 2023-08-31T21:58:06.5672164Z 2023-08-31T21:58:06.5672376Z  2023-08-31T21:58:06.5672542Z 2023-08-31T21:58:06.5672549Z 2023-08-31T21:58:06.5672555Z 2023-08-31T21:58:06.5672560Z 2023-08-31T21:58:06.5672566Z 2023-08-31T21:58:06.5672571Z 2023-08-31T21:58:06.5672577Z 2023-08-31T21:58:06.5672582Z 2023-08-31T21:58:06.5672588Z 2023-08-31T21:58:06.5672593Z 2023-08-31T21:58:06.5672598Z 2023-08-31T21:58:06.5672604Z 2023-08-31T21:58:06.5672610Z 2023-08-31T21:58:06.5672615Z 2023-08-31T21:58:06.5672832Z  2023-08-31T21:58:06.5673167Z 2023-08-31T21:58:06.5673174Z 2023-08-31T21:58:06.5673180Z 2023-08-31T21:58:06.5673187Z 2023-08-31T21:58:06.5673194Z 2023-08-31T21:58:06.5673200Z 2023-08-31T21:58:06.5673207Z 2023-08-31T21:58:06.5673213Z 2023-08-31T21:58:06.5673317Z 2023-08-31T21:58:06.5673324Z 2023-08-31T21:58:06.5673330Z 2023-08-31T21:58:06.5673345Z 2023-08-31T21:58:06.5673351Z 2023-08-31T21:58:06.5673357Z 2023-08-31T21:58:06.5673362Z 2023-08-31T21:58:06.5673586Z  2023-08-31T21:58:06.5673754Z 2023-08-31T21:58:06.5673761Z 2023-08-31T21:58:06.5673777Z 2023-08-31T21:58:06.5673782Z 2023-08-31T21:58:06.5673788Z 2023-08-31T21:58:06.5673793Z 2023-08-31T21:58:06.5673799Z 2023-08-31T21:58:06.5673804Z 2023-08-31T21:58:06.5673810Z 2023-08-31T21:58:06.5673815Z 2023-08-31T21:58:06.5673820Z 2023-08-31T21:58:06.5673826Z 2023-08-31T21:58:06.5673831Z 2023-08-31T21:58:06.5673836Z 2023-08-31T21:58:06.5673841Z 2023-08-31T21:58:06.5673852Z 2023-08-31T21:58:06.5674080Z  2023-08-31T21:58:06.5674250Z 2023-08-31T21:58:06.5674257Z 2023-08-31T21:58:06.5674269Z 2023-08-31T21:58:06.5674275Z 2023-08-31T21:58:06.5674281Z 2023-08-31T21:58:06.5674286Z 2023-08-31T21:58:06.5674292Z 2023-08-31T21:58:06.5674297Z 2023-08-31T21:58:06.5674303Z 2023-08-31T21:58:06.5674308Z 2023-08-31T21:58:06.5674313Z 2023-08-31T21:58:06.5674319Z 2023-08-31T21:58:06.5674324Z 2023-08-31T21:58:06.5674329Z 2023-08-31T21:58:06.5674344Z 2023-08-31T21:58:06.5674350Z 2023-08-31T21:58:06.5674355Z 2023-08-31T21:58:06.5674576Z  2023-08-31T21:58:06.5674750Z 2023-08-31T21:58:06.5674756Z 2023-08-31T21:58:06.5674770Z 2023-08-31T21:58:06.5674776Z 2023-08-31T21:58:06.5674781Z 2023-08-31T21:58:06.5674787Z 2023-08-31T21:58:06.5674792Z 2023-08-31T21:58:06.5674804Z 2023-08-31T21:58:06.5674809Z 2023-08-31T21:58:06.5674815Z 2023-08-31T21:58:06.5674820Z 2023-08-31T21:58:06.5674826Z 2023-08-31T21:58:06.5674831Z 2023-08-31T21:58:06.5674837Z 2023-08-31T21:58:06.5674842Z 2023-08-31T21:58:06.5674852Z 2023-08-31T21:58:06.5674859Z 2023-08-31T21:58:06.5674865Z 2023-08-31T21:58:06.5675098Z  2023-08-31T21:58:06.5675273Z 2023-08-31T21:58:06.5675279Z 2023-08-31T21:58:06.5675378Z  2023-08-31T21:58:06.5675490Z 2023-08-31T21:58:06.5675496Z 2023-08-31T21:58:06.5675596Z  2023-08-31T21:58:06.5675699Z 2023-08-31T21:58:06.5675714Z 2023-08-31T21:58:06.5675720Z 2023-08-31T21:58:06.5675815Z  2023-08-31T21:58:06.5675933Z 2023-08-31T21:58:06.5675940Z 2023-08-31T21:58:06.5675946Z 2023-08-31T21:58:06.5675952Z 2023-08-31T21:58:06.5676056Z  2023-08-31T21:58:06.5676178Z 2023-08-31T21:58:06.5676184Z 2023-08-31T21:58:06.5676190Z 2023-08-31T21:58:06.5676201Z 2023-08-31T21:58:06.5676208Z 2023-08-31T21:58:06.5676314Z  2023-08-31T21:58:06.5676434Z 2023-08-31T21:58:06.5676441Z 2023-08-31T21:58:06.5676447Z 2023-08-31T21:58:06.5676452Z 2023-08-31T21:58:06.5676463Z 2023-08-31T21:58:06.5676469Z 2023-08-31T21:58:06.5676582Z  2023-08-31T21:58:06.5676709Z 2023-08-31T21:58:06.5676716Z 2023-08-31T21:58:06.5676722Z 2023-08-31T21:58:06.5676728Z 2023-08-31T21:58:06.5676733Z 2023-08-31T21:58:06.5676739Z 2023-08-31T21:58:06.5676744Z 2023-08-31T21:58:06.5676861Z  2023-08-31T21:58:06.5676989Z 2023-08-31T21:58:06.5676996Z 2023-08-31T21:58:06.5677001Z 2023-08-31T21:58:06.5677007Z 2023-08-31T21:58:06.5677013Z 2023-08-31T21:58:06.5677018Z 2023-08-31T21:58:06.5677024Z 2023-08-31T21:58:06.5677029Z 2023-08-31T21:58:06.5677148Z  2023-08-31T21:58:06.5677279Z 2023-08-31T21:58:06.5677285Z 2023-08-31T21:58:06.5677291Z 2023-08-31T21:58:06.5677296Z 2023-08-31T21:58:06.5677404Z 2023-08-31T21:58:06.5677410Z 2023-08-31T21:58:06.5677416Z 2023-08-31T21:58:06.5677421Z 2023-08-31T21:58:06.5677427Z 2023-08-31T21:58:06.5677554Z  2023-08-31T21:58:06.5677690Z 2023-08-31T21:58:06.5677778Z 2023-08-31T21:58:06.5677786Z 2023-08-31T21:58:06.5677792Z 2023-08-31T21:58:06.5677798Z 2023-08-31T21:58:06.5677803Z 2023-08-31T21:58:06.5677809Z 2023-08-31T21:58:06.5677814Z 2023-08-31T21:58:06.5677819Z 2023-08-31T21:58:06.5677833Z 2023-08-31T21:58:06.5677957Z  2023-08-31T21:58:06.5678096Z 2023-08-31T21:58:06.5678102Z 2023-08-31T21:58:06.5678108Z 2023-08-31T21:58:06.5678114Z 2023-08-31T21:58:06.5678119Z 2023-08-31T21:58:06.5678124Z 2023-08-31T21:58:06.5678138Z 2023-08-31T21:58:06.5678143Z 2023-08-31T21:58:06.5678149Z 2023-08-31T21:58:06.5678154Z 2023-08-31T21:58:06.5678160Z 2023-08-31T21:58:06.5678293Z  2023-08-31T21:58:06.5678423Z 2023-08-31T21:58:06.5678437Z 2023-08-31T21:58:06.5678449Z 2023-08-31T21:58:06.5678455Z 2023-08-31T21:58:06.5678461Z 2023-08-31T21:58:06.5678467Z 2023-08-31T21:58:06.5678472Z 2023-08-31T21:58:06.5678478Z 2023-08-31T21:58:06.5678484Z 2023-08-31T21:58:06.5678489Z 2023-08-31T21:58:06.5678499Z 2023-08-31T21:58:06.5678506Z 2023-08-31T21:58:06.5678643Z  2023-08-31T21:58:06.5678781Z 2023-08-31T21:58:06.5678788Z 2023-08-31T21:58:06.5678794Z 2023-08-31T21:58:06.5678800Z 2023-08-31T21:58:06.5678805Z 2023-08-31T21:58:06.5678810Z 2023-08-31T21:58:06.5678816Z 2023-08-31T21:58:06.5678821Z 2023-08-31T21:58:06.5678826Z 2023-08-31T21:58:06.5678831Z 2023-08-31T21:58:06.5678837Z 2023-08-31T21:58:06.5678842Z 2023-08-31T21:58:06.5678847Z 2023-08-31T21:58:06.5678988Z  2023-08-31T21:58:06.5679130Z 2023-08-31T21:58:06.5679136Z 2023-08-31T21:58:06.5679142Z 2023-08-31T21:58:06.5679147Z 2023-08-31T21:58:06.5679153Z 2023-08-31T21:58:06.5679158Z 2023-08-31T21:58:06.5679164Z 2023-08-31T21:58:06.5679175Z 2023-08-31T21:58:06.5679181Z 2023-08-31T21:58:06.5679186Z 2023-08-31T21:58:06.5679192Z 2023-08-31T21:58:06.5679197Z 2023-08-31T21:58:06.5679210Z 2023-08-31T21:58:06.5679216Z 2023-08-31T21:58:06.5679358Z  2023-08-31T21:58:06.5679499Z 2023-08-31T21:58:06.5679506Z 2023-08-31T21:58:06.5679512Z 2023-08-31T21:58:06.5679517Z 2023-08-31T21:58:06.5679523Z 2023-08-31T21:58:06.5679536Z 2023-08-31T21:58:06.5679541Z 2023-08-31T21:58:06.5679547Z 2023-08-31T21:58:06.5679553Z 2023-08-31T21:58:06.5679558Z 2023-08-31T21:58:06.5679564Z 2023-08-31T21:58:06.5679569Z 2023-08-31T21:58:06.5679574Z 2023-08-31T21:58:06.5679579Z 2023-08-31T21:58:06.5679585Z 2023-08-31T21:58:06.5679737Z  2023-08-31T21:58:06.5679887Z 2023-08-31T21:58:06.5679894Z 2023-08-31T21:58:06.5679900Z 2023-08-31T21:58:06.5679905Z 2023-08-31T21:58:06.5679911Z 2023-08-31T21:58:06.5679916Z 2023-08-31T21:58:06.5679921Z 2023-08-31T21:58:06.5679932Z 2023-08-31T21:58:06.5679938Z 2023-08-31T21:58:06.5679944Z 2023-08-31T21:58:06.5679949Z 2023-08-31T21:58:06.5679955Z 2023-08-31T21:58:06.5679960Z 2023-08-31T21:58:06.5679965Z 2023-08-31T21:58:06.5679971Z 2023-08-31T21:58:06.5679980Z 2023-08-31T21:58:06.5680140Z  2023-08-31T21:58:06.5680287Z 2023-08-31T21:58:06.5680293Z 2023-08-31T21:58:06.5680299Z 2023-08-31T21:58:06.5680305Z 2023-08-31T21:58:06.5680311Z 2023-08-31T21:58:06.5680316Z 2023-08-31T21:58:06.5680322Z 2023-08-31T21:58:06.5680327Z 2023-08-31T21:58:06.5680332Z 2023-08-31T21:58:06.5680346Z 2023-08-31T21:58:06.5680351Z 2023-08-31T21:58:06.5680356Z 2023-08-31T21:58:06.5680362Z 2023-08-31T21:58:06.5680367Z 2023-08-31T21:58:06.5680373Z 2023-08-31T21:58:06.5680378Z 2023-08-31T21:58:06.5680383Z 2023-08-31T21:58:06.5680551Z  2023-08-31T21:58:06.5680704Z 2023-08-31T21:58:06.5680710Z 2023-08-31T21:58:06.5680716Z 2023-08-31T21:58:06.5680798Z 2023-08-31T21:58:06.5680805Z 2023-08-31T21:58:06.5680811Z 2023-08-31T21:58:06.5680816Z 2023-08-31T21:58:06.5680822Z 2023-08-31T21:58:06.5680827Z 2023-08-31T21:58:06.5680833Z 2023-08-31T21:58:06.5680838Z 2023-08-31T21:58:06.5680934Z 2023-08-31T21:58:06.5680941Z 2023-08-31T21:58:06.5680947Z 2023-08-31T21:58:06.5680953Z 2023-08-31T21:58:06.5680958Z 2023-08-31T21:58:06.5680964Z 2023-08-31T21:58:06.5680969Z 2023-08-31T21:58:06.5681143Z  2023-08-31T21:58:06.5681298Z 2023-08-31T21:58:06.5681304Z 2023-08-31T21:58:06.5681398Z  2023-08-31T21:58:06.5681504Z 2023-08-31T21:58:06.5681511Z 2023-08-31T21:58:06.5681605Z  2023-08-31T21:58:06.5681713Z 2023-08-31T21:58:06.5681720Z 2023-08-31T21:58:06.5681727Z 2023-08-31T21:58:06.5681828Z  2023-08-31T21:58:06.5681932Z 2023-08-31T21:58:06.5681939Z 2023-08-31T21:58:06.5681952Z 2023-08-31T21:58:06.5681958Z 2023-08-31T21:58:06.5682052Z  2023-08-31T21:58:06.5682176Z 2023-08-31T21:58:06.5682182Z 2023-08-31T21:58:06.5682188Z 2023-08-31T21:58:06.5682193Z 2023-08-31T21:58:06.5682199Z 2023-08-31T21:58:06.5682306Z  2023-08-31T21:58:06.5682430Z 2023-08-31T21:58:06.5682437Z 2023-08-31T21:58:06.5682448Z 2023-08-31T21:58:06.5682454Z 2023-08-31T21:58:06.5682460Z 2023-08-31T21:58:06.5682465Z 2023-08-31T21:58:06.5682573Z  2023-08-31T21:58:06.5682695Z 2023-08-31T21:58:06.5682701Z 2023-08-31T21:58:06.5682707Z 2023-08-31T21:58:06.5682713Z 2023-08-31T21:58:06.5682719Z 2023-08-31T21:58:06.5682724Z 2023-08-31T21:58:06.5682730Z 2023-08-31T21:58:06.5682843Z  2023-08-31T21:58:06.5682969Z 2023-08-31T21:58:06.5682975Z 2023-08-31T21:58:06.5682981Z 2023-08-31T21:58:06.5682987Z 2023-08-31T21:58:06.5682992Z 2023-08-31T21:58:06.5682997Z 2023-08-31T21:58:06.5683002Z 2023-08-31T21:58:06.5683008Z 2023-08-31T21:58:06.5683125Z  2023-08-31T21:58:06.5683252Z 2023-08-31T21:58:06.5683258Z 2023-08-31T21:58:06.5683269Z 2023-08-31T21:58:06.5683275Z 2023-08-31T21:58:06.5683281Z 2023-08-31T21:58:06.5683286Z 2023-08-31T21:58:06.5683292Z 2023-08-31T21:58:06.5683304Z 2023-08-31T21:58:06.5683310Z 2023-08-31T21:58:06.5683429Z  2023-08-31T21:58:06.5683558Z 2023-08-31T21:58:06.5683564Z 2023-08-31T21:58:06.5683570Z 2023-08-31T21:58:06.5683576Z 2023-08-31T21:58:06.5683581Z 2023-08-31T21:58:06.5683594Z 2023-08-31T21:58:06.5683600Z 2023-08-31T21:58:06.5683605Z 2023-08-31T21:58:06.5683610Z 2023-08-31T21:58:06.5683615Z 2023-08-31T21:58:06.5683743Z  2023-08-31T21:58:06.5683869Z 2023-08-31T21:58:06.5683876Z 2023-08-31T21:58:06.5683890Z 2023-08-31T21:58:06.5683896Z 2023-08-31T21:58:06.5683903Z 2023-08-31T21:58:06.5683909Z 2023-08-31T21:58:06.5683916Z 2023-08-31T21:58:06.5683923Z 2023-08-31T21:58:06.5683929Z 2023-08-31T21:58:06.5683936Z 2023-08-31T21:58:06.5683942Z 2023-08-31T21:58:06.5684073Z  2023-08-31T21:58:06.5684213Z 2023-08-31T21:58:06.5684220Z 2023-08-31T21:58:06.5684226Z 2023-08-31T21:58:06.5684231Z 2023-08-31T21:58:06.5684237Z 2023-08-31T21:58:06.5684242Z 2023-08-31T21:58:06.5684248Z 2023-08-31T21:58:06.5684253Z 2023-08-31T21:58:06.5684263Z 2023-08-31T21:58:06.5684270Z 2023-08-31T21:58:06.5684275Z 2023-08-31T21:58:06.5684281Z 2023-08-31T21:58:06.5684416Z  2023-08-31T21:58:06.5684553Z 2023-08-31T21:58:06.5684559Z 2023-08-31T21:58:06.5684565Z 2023-08-31T21:58:06.5684571Z 2023-08-31T21:58:06.5684576Z 2023-08-31T21:58:06.5684581Z 2023-08-31T21:58:06.5684587Z 2023-08-31T21:58:06.5684592Z 2023-08-31T21:58:06.5684597Z 2023-08-31T21:58:06.5684602Z 2023-08-31T21:58:06.5684608Z 2023-08-31T21:58:06.5684613Z 2023-08-31T21:58:06.5684618Z 2023-08-31T21:58:06.5684759Z  2023-08-31T21:58:06.5684900Z 2023-08-31T21:58:06.5684906Z 2023-08-31T21:58:06.5684912Z 2023-08-31T21:58:06.5684917Z 2023-08-31T21:58:06.5684923Z 2023-08-31T21:58:06.5685004Z 2023-08-31T21:58:06.5685011Z 2023-08-31T21:58:06.5685017Z 2023-08-31T21:58:06.5685033Z 2023-08-31T21:58:06.5685038Z 2023-08-31T21:58:06.5685044Z 2023-08-31T21:58:06.5685049Z 2023-08-31T21:58:06.5685131Z 2023-08-31T21:58:06.5685138Z 2023-08-31T21:58:06.5685291Z  2023-08-31T21:58:06.5685428Z 2023-08-31T21:58:06.5685444Z 2023-08-31T21:58:06.5685450Z 2023-08-31T21:58:06.5685455Z 2023-08-31T21:58:06.5685461Z 2023-08-31T21:58:06.5685467Z 2023-08-31T21:58:06.5685472Z 2023-08-31T21:58:06.5685478Z 2023-08-31T21:58:06.5685483Z 2023-08-31T21:58:06.5685488Z 2023-08-31T21:58:06.5685494Z 2023-08-31T21:58:06.5685499Z 2023-08-31T21:58:06.5685504Z 2023-08-31T21:58:06.5685510Z 2023-08-31T21:58:06.5685515Z 2023-08-31T21:58:06.5685665Z  2023-08-31T21:58:06.5685809Z 2023-08-31T21:58:06.5685815Z 2023-08-31T21:58:06.5685821Z 2023-08-31T21:58:06.5685826Z 2023-08-31T21:58:06.5685832Z 2023-08-31T21:58:06.5685842Z 2023-08-31T21:58:06.5685849Z 2023-08-31T21:58:06.5685854Z 2023-08-31T21:58:06.5685860Z 2023-08-31T21:58:06.5685865Z 2023-08-31T21:58:06.5685871Z 2023-08-31T21:58:06.5685876Z 2023-08-31T21:58:06.5685882Z 2023-08-31T21:58:06.5685891Z 2023-08-31T21:58:06.5685897Z 2023-08-31T21:58:06.5685914Z 2023-08-31T21:58:06.5686063Z  2023-08-31T21:58:06.5686211Z 2023-08-31T21:58:06.5686218Z 2023-08-31T21:58:06.5686224Z 2023-08-31T21:58:06.5686229Z 2023-08-31T21:58:06.5686235Z 2023-08-31T21:58:06.5686248Z 2023-08-31T21:58:06.5686254Z 2023-08-31T21:58:06.5686259Z 2023-08-31T21:58:06.5686407Z 2023-08-31T21:58:06.5686415Z 2023-08-31T21:58:06.5686420Z 2023-08-31T21:58:06.5686426Z 2023-08-31T21:58:06.5686432Z 2023-08-31T21:58:06.5686437Z 2023-08-31T21:58:06.5686443Z 2023-08-31T21:58:06.5686448Z 2023-08-31T21:58:06.5686453Z 2023-08-31T21:58:06.5686621Z  2023-08-31T21:58:06.5686775Z 2023-08-31T21:58:06.5686787Z 2023-08-31T21:58:06.5686793Z 2023-08-31T21:58:06.5686799Z 2023-08-31T21:58:06.5686804Z 2023-08-31T21:58:06.5686810Z 2023-08-31T21:58:06.5686815Z 2023-08-31T21:58:06.5686821Z 2023-08-31T21:58:06.5686826Z 2023-08-31T21:58:06.5686835Z 2023-08-31T21:58:06.5686842Z 2023-08-31T21:58:06.5686849Z 2023-08-31T21:58:06.5686855Z 2023-08-31T21:58:06.5686860Z 2023-08-31T21:58:06.5686865Z 2023-08-31T21:58:06.5686871Z 2023-08-31T21:58:06.5686884Z 2023-08-31T21:58:06.5686889Z 2023-08-31T21:58:06.5687047Z  2023-08-31T21:58:06.5687203Z 2023-08-31T21:58:06.5687210Z 2023-08-31T21:58:06.5687304Z  2023-08-31T21:58:06.6776759Z Preparing transaction: ...working... done 2023-08-31T21:58:06.9979143Z Verifying transaction: ...working... done 2023-08-31T21:58:08.4000294Z Executing transaction: ...working... done 2023-08-31T21:58:10.0125136Z Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/cpu 2023-08-31T21:58:10.0131093Z Ignoring numpy: markers 'sys_platform == "win32"' don't match your environment 2023-08-31T21:58:10.6000927Z Collecting cython==0.29.34 (from -r requirements/torch_common.txt (line 1)) 2023-08-31T21:58:10.6462125Z Downloading Cython-0.29.34-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.manylinux_2_24_x86_64.whl (2.0 MB) 2023-08-31T21:58:10.6886966Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 49.4 MB/s eta 0:00:00 2023-08-31T21:58:10.7818167Z Collecting wheel==0.40.0 (from -r requirements/torch_common.txt (line 2)) 2023-08-31T21:58:10.7901900Z Downloading wheel-0.40.0-py3-none-any.whl (64 kB) 2023-08-31T21:58:10.7942434Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 64.5/64.5 kB 29.0 MB/s eta 0:00:00 2023-08-31T21:58:11.1331700Z Collecting pillow==9.3.0 (from -r requirements/torch_common.txt (line 3)) 2023-08-31T21:58:11.1436066Z Downloading Pillow-9.3.0-cp39-cp39-manylinux_2_28_x86_64.whl (3.3 MB) 2023-08-31T21:58:11.1707925Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.3/3.3 MB 132.4 MB/s eta 0:00:00 2023-08-31T21:58:11.5347504Z Collecting numpy==1.24.3 (from -r requirements/torch_common.txt (line 4)) 2023-08-31T21:58:11.5462086Z Downloading numpy-1.24.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (17.3 MB) 2023-08-31T21:58:11.6756324Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 17.3/17.3 MB 113.2 MB/s eta 0:00:00 2023-08-31T21:58:11.9085332Z Collecting torch==2.0.1+cpu (from -r requirements/torch_linux.txt (line 4)) 2023-08-31T21:58:11.9179625Z Downloading https://download.pytorch.org/whl/cpu/torch-2.0.1%2Bcpu-cp39-cp39-linux_x86_64.whl (195.4 MB) 2023-08-31T21:58:14.4564262Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 195.4/195.4 MB 5.9 MB/s eta 0:00:00 2023-08-31T21:58:15.3919722Z Collecting torchvision==0.15.2+cpu (from -r requirements/torch_linux.txt (line 5)) 2023-08-31T21:58:15.4023096Z Downloading https://download.pytorch.org/whl/cpu/torchvision-0.15.2%2Bcpu-cp39-cp39-linux_x86_64.whl (1.5 MB) 2023-08-31T21:58:15.4178293Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 112.5 MB/s eta 0:00:00 2023-08-31T21:58:15.5579790Z Collecting torchtext==0.15.2 (from -r requirements/torch_linux.txt (line 6)) 2023-08-31T21:58:15.5668331Z Downloading https://download.pytorch.org/whl/torchtext-0.15.2%2Bcpu-cp39-cp39-linux_x86_64.whl (2.0 MB) 2023-08-31T21:58:15.5864403Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 114.7 MB/s eta 0:00:00 2023-08-31T21:58:15.7472670Z Collecting torchaudio==2.0.2+cpu (from -r requirements/torch_linux.txt (line 7)) 2023-08-31T21:58:15.7564522Z Downloading https://download.pytorch.org/whl/cpu/torchaudio-2.0.2%2Bcpu-cp39-cp39-linux_x86_64.whl (4.1 MB) 2023-08-31T21:58:15.7912482Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.1/4.1 MB 131.4 MB/s eta 0:00:00 2023-08-31T21:58:15.8297163Z Requirement already satisfied: filelock in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from torch==2.0.1+cpu->-r requirements/torch_linux.txt (line 4)) (3.12.3) 2023-08-31T21:58:15.8930862Z Collecting typing-extensions (from torch==2.0.1+cpu->-r requirements/torch_linux.txt (line 4)) 2023-08-31T21:58:15.8933118Z Obtaining dependency information for typing-extensions from https://files.pythonhosted.org/packages/ec/6b/63cc3df74987c36fe26157ee12e09e8f9db4de771e0f3404263117e75b95/typing_extensions-4.7.1-py3-none-any.whl.metadata 2023-08-31T21:58:15.9008679Z Downloading typing_extensions-4.7.1-py3-none-any.whl.metadata (3.1 kB) 2023-08-31T21:58:15.9597465Z Collecting sympy (from torch==2.0.1+cpu->-r requirements/torch_linux.txt (line 4)) 2023-08-31T21:58:15.9716712Z Downloading sympy-1.12-py3-none-any.whl (5.7 MB) 2023-08-31T21:58:16.0153865Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.7/5.7 MB 139.1 MB/s eta 0:00:00 2023-08-31T21:58:16.1151863Z Collecting networkx (from torch==2.0.1+cpu->-r requirements/torch_linux.txt (line 4)) 2023-08-31T21:58:16.1260378Z Downloading networkx-3.1-py3-none-any.whl (2.1 MB) 2023-08-31T21:58:16.1433520Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 136.9 MB/s eta 0:00:00 2023-08-31T21:58:16.1562963Z Requirement already satisfied: jinja2 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from torch==2.0.1+cpu->-r requirements/torch_linux.txt (line 4)) (3.1.2) 2023-08-31T21:58:16.1616594Z Requirement already satisfied: requests in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from torchvision==0.15.2+cpu->-r requirements/torch_linux.txt (line 5)) (2.31.0) 2023-08-31T21:58:16.1730973Z Requirement already satisfied: tqdm in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from torchtext==0.15.2->-r requirements/torch_linux.txt (line 6)) (4.66.1) 2023-08-31T21:58:16.2354331Z Collecting torchdata==0.6.1 (from torchtext==0.15.2->-r requirements/torch_linux.txt (line 6)) 2023-08-31T21:58:16.2445300Z Downloading https://download.pytorch.org/whl/torchdata-0.6.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.6 MB) 2023-08-31T21:58:16.2956052Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.6/4.6 MB 95.7 MB/s eta 0:00:00 2023-08-31T21:58:16.3202514Z Requirement already satisfied: urllib3>=1.25 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from torchdata==0.6.1->torchtext==0.15.2->-r requirements/torch_linux.txt (line 6)) (2.0.4) 2023-08-31T21:58:16.3409375Z Requirement already satisfied: MarkupSafe>=2.0 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from jinja2->torch==2.0.1+cpu->-r requirements/torch_linux.txt (line 4)) (2.1.3) 2023-08-31T21:58:16.3667761Z Requirement already satisfied: charset-normalizer<4,>=2 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from requests->torchvision==0.15.2+cpu->-r requirements/torch_linux.txt (line 5)) (3.2.0) 2023-08-31T21:58:16.3675382Z Requirement already satisfied: idna<4,>=2.5 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from requests->torchvision==0.15.2+cpu->-r requirements/torch_linux.txt (line 5)) (3.4) 2023-08-31T21:58:16.3684123Z Requirement already satisfied: certifi>=2017.4.17 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from requests->torchvision==0.15.2+cpu->-r requirements/torch_linux.txt (line 5)) (2023.7.22) 2023-08-31T21:58:16.4375690Z Collecting mpmath>=0.19 (from sympy->torch==2.0.1+cpu->-r requirements/torch_linux.txt (line 4)) 2023-08-31T21:58:16.4492455Z Downloading mpmath-1.3.0-py3-none-any.whl (536 kB) 2023-08-31T21:58:16.4567585Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 107.9 MB/s eta 0:00:00 2023-08-31T21:58:16.5070566Z Downloading typing_extensions-4.7.1-py3-none-any.whl (33 kB) 2023-08-31T21:58:16.7870345Z Installing collected packages: mpmath, wheel, typing-extensions, sympy, pillow, numpy, networkx, cython, torch, torchvision, torchdata, torchaudio, torchtext 2023-08-31T21:58:17.0995692Z Attempting uninstall: wheel 2023-08-31T21:58:17.1004681Z Found existing installation: wheel 0.41.2 2023-08-31T21:58:17.1044789Z Uninstalling wheel-0.41.2: 2023-08-31T21:58:17.1062052Z Successfully uninstalled wheel-0.41.2 2023-08-31T21:58:34.6541690Z Successfully installed cython-0.29.34 mpmath-1.3.0 networkx-3.1 numpy-1.24.3 pillow-9.3.0 sympy-1.12 torch-2.0.1+cpu torchaudio-2.0.2+cpu torchdata-0.6.1 torchtext-0.15.2+cpu torchvision-0.15.2+cpu typing-extensions-4.7.1 wheel-0.40.0 2023-08-31T21:58:35.4098030Z Requirement already satisfied: pip in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (23.2.1) 2023-08-31T21:58:35.5077913Z Requirement already satisfied: setuptools in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (68.1.2) 2023-08-31T21:58:36.5249887Z Requirement already satisfied: psutil==5.9.5 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from -r requirements/common.txt (line 1)) (5.9.5) 2023-08-31T21:58:36.7035067Z Requirement already satisfied: requests==2.31.0 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from -r requirements/common.txt (line 2)) (2.31.0) 2023-08-31T21:58:36.7624607Z Collecting captum==0.6.0 (from -r requirements/common.txt (line 3)) 2023-08-31T21:58:36.8641181Z Downloading captum-0.6.0-py3-none-any.whl (1.3 MB) 2023-08-31T21:58:36.9003163Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 39.6 MB/s eta 0:00:00 2023-08-31T21:58:36.9087448Z Requirement already satisfied: packaging==23.1 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from -r requirements/common.txt (line 4)) (23.1) 2023-08-31T21:58:36.9540650Z Collecting pynvml==11.4.1 (from -r requirements/common.txt (line 5)) 2023-08-31T21:58:36.9635576Z Downloading pynvml-11.4.1-py3-none-any.whl (46 kB) 2023-08-31T21:58:36.9675351Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47.0/47.0 kB 20.5 MB/s eta 0:00:00 2023-08-31T21:58:37.0326560Z Collecting pyyaml==6.0 (from -r requirements/common.txt (line 6)) 2023-08-31T21:58:37.0430430Z Downloading PyYAML-6.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (661 kB) 2023-08-31T21:58:37.0514081Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 661.8/661.8 kB 108.1 MB/s eta 0:00:00 2023-08-31T21:58:37.0797473Z Collecting mock==5.0.2 (from -r requirements/developer.txt (line 2)) 2023-08-31T21:58:37.0896549Z Downloading mock-5.0.2-py3-none-any.whl (30 kB) 2023-08-31T21:58:37.1665213Z Collecting pytest==7.3.1 (from -r requirements/developer.txt (line 3)) 2023-08-31T21:58:37.1763860Z Downloading pytest-7.3.1-py3-none-any.whl (320 kB) 2023-08-31T21:58:37.1823132Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 320.5/320.5 kB 87.5 MB/s eta 0:00:00 2023-08-31T21:58:37.2555211Z Collecting pylint==2.6.0 (from -r requirements/developer.txt (line 4)) 2023-08-31T21:58:37.2652760Z Downloading pylint-2.6.0-py3-none-any.whl (325 kB) 2023-08-31T21:58:37.2712690Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 325.7/325.7 kB 87.1 MB/s eta 0:00:00 2023-08-31T21:58:37.3107742Z Collecting pytest-mock==3.10.0 (from -r requirements/developer.txt (line 5)) 2023-08-31T21:58:37.3186453Z Downloading pytest_mock-3.10.0-py3-none-any.whl (9.3 kB) 2023-08-31T21:58:37.3527468Z Collecting pytest-cov==4.1.0 (from -r requirements/developer.txt (line 6)) 2023-08-31T21:58:37.3532324Z Obtaining dependency information for pytest-cov==4.1.0 from https://files.pythonhosted.org/packages/a7/4b/8b78d126e275efa2379b1c2e09dc52cf70df16fc3b90613ef82531499d73/pytest_cov-4.1.0-py3-none-any.whl.metadata 2023-08-31T21:58:37.3611785Z Downloading pytest_cov-4.1.0-py3-none-any.whl.metadata (26 kB) 2023-08-31T21:58:38.2028933Z Collecting grpcio==1.54.2 (from -r requirements/developer.txt (line 7)) 2023-08-31T21:58:38.2030816Z Obtaining dependency information for grpcio==1.54.2 from https://files.pythonhosted.org/packages/66/f9/dfa689a7ccd0a5f8b46f35ffa80cae46cd1f4772915170916291125aea0d/grpcio-1.54.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 2023-08-31T21:58:38.2119675Z Downloading grpcio-1.54.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.0 kB) 2023-08-31T21:58:38.5068197Z Collecting protobuf==4.23.1 (from -r requirements/developer.txt (line 8)) 2023-08-31T21:58:38.5069537Z Obtaining dependency information for protobuf==4.23.1 from https://files.pythonhosted.org/packages/73/8b/926449627e192b022f71d2c48b51dbdc1271271e0fa4b809cff2dffab339/protobuf-4.23.1-cp37-abi3-manylinux2014_x86_64.whl.metadata 2023-08-31T21:58:38.5161819Z Downloading protobuf-4.23.1-cp37-abi3-manylinux2014_x86_64.whl.metadata (540 bytes) 2023-08-31T21:58:39.3943828Z Collecting grpcio-tools==1.54.2 (from -r requirements/developer.txt (line 9)) 2023-08-31T21:58:39.3945756Z Obtaining dependency information for grpcio-tools==1.54.2 from https://files.pythonhosted.org/packages/27/24/76c602d92c11628d8505e02dc99b20be7884a53811ed61802ebaa0a41e7e/grpcio_tools-1.54.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 2023-08-31T21:58:39.4035113Z Downloading grpcio_tools-1.54.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.2 kB) 2023-08-31T21:58:39.4628416Z Collecting transformers==4.30.0 (from -r requirements/developer.txt (line 10)) 2023-08-31T21:58:39.4633746Z Obtaining dependency information for transformers==4.30.0 from https://files.pythonhosted.org/packages/e2/72/1af3d38e98fdcceb3876de4567ac395a66c26976e259fe2d46266e052d61/transformers-4.30.0-py3-none-any.whl.metadata 2023-08-31T21:58:39.4720940Z Downloading transformers-4.30.0-py3-none-any.whl.metadata (113 kB) 2023-08-31T21:58:39.4769948Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 113.6/113.6 kB 46.0 MB/s eta 0:00:00 2023-08-31T21:58:39.5035981Z Collecting pyspelling==2.8.2 (from -r requirements/developer.txt (line 11)) 2023-08-31T21:58:39.5126600Z Downloading pyspelling-2.8.2-py3-none-any.whl (44 kB) 2023-08-31T21:58:39.5165258Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44.6/44.6 kB 20.5 MB/s eta 0:00:00 2023-08-31T21:58:39.6407668Z Collecting pygit2==1.12.1 (from -r requirements/developer.txt (line 12)) 2023-08-31T21:58:39.6516377Z Downloading pygit2-1.12.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.9 MB) 2023-08-31T21:58:39.6931090Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.9/4.9 MB 125.2 MB/s eta 0:00:00 2023-08-31T21:58:39.8075671Z Collecting pre-commit==3.3.2 (from -r requirements/developer.txt (line 13)) 2023-08-31T21:58:39.8080513Z Obtaining dependency information for pre-commit==3.3.2 from https://files.pythonhosted.org/packages/45/30/c3d5d192b97de482b9adfa356724dfbb07e293b54d94c3b98dd2e5f24759/pre_commit-3.3.2-py2.py3-none-any.whl.metadata 2023-08-31T21:58:39.8212241Z Downloading pre_commit-3.3.2-py2.py3-none-any.whl.metadata (1.3 kB) 2023-08-31T21:58:39.8542511Z Collecting twine==4.0.2 (from -r requirements/developer.txt (line 14)) 2023-08-31T21:58:39.8628672Z Downloading twine-4.0.2-py3-none-any.whl (36 kB) 2023-08-31T21:58:40.0108637Z Collecting mypy==1.3.0 (from -r requirements/developer.txt (line 15)) 2023-08-31T21:58:40.0227658Z Downloading mypy-1.3.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.2 MB) 2023-08-31T21:58:40.1104541Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.2/12.2 MB 133.7 MB/s eta 0:00:00 2023-08-31T21:58:40.1793856Z Collecting torchpippy==0.1.1 (from -r requirements/developer.txt (line 16)) 2023-08-31T21:58:40.1888853Z Downloading torchpippy-0.1.1-py3-none-any.whl (381 kB) 2023-08-31T21:58:40.1953332Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 381.8/381.8 kB 94.9 MB/s eta 0:00:00 2023-08-31T21:58:40.2188715Z Collecting intel_extension_for_pytorch==2.0.100 (from -r requirements/developer.txt (line 17)) 2023-08-31T21:58:40.2192427Z Obtaining dependency information for intel_extension_for_pytorch==2.0.100 from https://files.pythonhosted.org/packages/71/7c/6c5fb2f746d44ca2a2b04427325579fab52d0e5455ef16085dd1bf05dd67/intel_extension_for_pytorch-2.0.100-cp39-cp39-manylinux2014_x86_64.whl.metadata 2023-08-31T21:58:40.2331071Z Downloading intel_extension_for_pytorch-2.0.100-cp39-cp39-manylinux2014_x86_64.whl.metadata (5.9 kB) 2023-08-31T21:58:40.3080666Z Collecting onnxruntime==1.15.0 (from -r requirements/developer.txt (line 18)) 2023-08-31T21:58:40.3084251Z Obtaining dependency information for onnxruntime==1.15.0 from https://files.pythonhosted.org/packages/a8/98/5fcb055ce4d51eaec19e3d88e77d3026994e5a03567805c6787fc9388dd4/onnxruntime-1.15.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 2023-08-31T21:58:40.3182222Z Downloading onnxruntime-1.15.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.9 kB) 2023-08-31T21:58:40.3934236Z Collecting onnx==1.14.0 (from -r requirements/developer.txt (line 19)) 2023-08-31T21:58:40.4054795Z Downloading onnx-1.14.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.6 MB) 2023-08-31T21:58:40.5256141Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.6/14.6 MB 105.1 MB/s eta 0:00:00 2023-08-31T21:58:40.6494695Z Requirement already satisfied: charset-normalizer<4,>=2 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from requests==2.31.0->-r requirements/common.txt (line 2)) (3.2.0) 2023-08-31T21:58:40.6503913Z Requirement already satisfied: idna<4,>=2.5 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from requests==2.31.0->-r requirements/common.txt (line 2)) (3.4) 2023-08-31T21:58:40.6511596Z Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from requests==2.31.0->-r requirements/common.txt (line 2)) (2.0.4) 2023-08-31T21:58:40.6519004Z Requirement already satisfied: certifi>=2017.4.17 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from requests==2.31.0->-r requirements/common.txt (line 2)) (2023.7.22) 2023-08-31T21:58:40.8949411Z Collecting matplotlib (from captum==0.6.0->-r requirements/common.txt (line 3)) 2023-08-31T21:58:40.8952828Z Obtaining dependency information for matplotlib from https://files.pythonhosted.org/packages/47/b9/6c0daa9b953a80b4e6933bf6a11a2d0633f257e84ee5995c5fd35de564c9/matplotlib-3.7.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 2023-08-31T21:58:40.9044270Z Downloading matplotlib-3.7.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.6 kB) 2023-08-31T21:58:40.9069915Z Requirement already satisfied: numpy in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from captum==0.6.0->-r requirements/common.txt (line 3)) (1.24.3) 2023-08-31T21:58:40.9078069Z Requirement already satisfied: torch>=1.6 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from captum==0.6.0->-r requirements/common.txt (line 3)) (2.0.1+cpu) 2023-08-31T21:58:40.9450879Z Collecting iniconfig (from pytest==7.3.1->-r requirements/developer.txt (line 3)) 2023-08-31T21:58:40.9554224Z Downloading iniconfig-2.0.0-py3-none-any.whl (5.9 kB) 2023-08-31T21:58:40.9588486Z Requirement already satisfied: pluggy<2.0,>=0.12 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from pytest==7.3.1->-r requirements/developer.txt (line 3)) (1.3.0) 2023-08-31T21:58:40.9809238Z Collecting exceptiongroup>=1.0.0rc8 (from pytest==7.3.1->-r requirements/developer.txt (line 3)) 2023-08-31T21:58:40.9814160Z Obtaining dependency information for exceptiongroup>=1.0.0rc8 from https://files.pythonhosted.org/packages/ad/83/b71e58666f156a39fb29417e4c8ca4bc7400c0dd4ed9e8842ab54dc8c344/exceptiongroup-1.1.3-py3-none-any.whl.metadata 2023-08-31T21:58:40.9899045Z Downloading exceptiongroup-1.1.3-py3-none-any.whl.metadata (6.1 kB) 2023-08-31T21:58:40.9931156Z Requirement already satisfied: tomli>=1.0.0 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from pytest==7.3.1->-r requirements/developer.txt (line 3)) (2.0.1) 2023-08-31T21:58:41.0675219Z Collecting astroid<=2.5,>=2.4.0 (from pylint==2.6.0->-r requirements/developer.txt (line 4)) 2023-08-31T21:58:41.0774057Z Downloading astroid-2.5-py3-none-any.whl (220 kB) 2023-08-31T21:58:41.0828948Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 220.3/220.3 kB 73.9 MB/s eta 0:00:00 2023-08-31T21:58:41.1525977Z Collecting isort<6,>=4.2.5 (from pylint==2.6.0->-r requirements/developer.txt (line 4)) 2023-08-31T21:58:41.1604727Z Downloading isort-5.12.0-py3-none-any.whl (91 kB) 2023-08-31T21:58:41.1648797Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 91.2/91.2 kB 39.7 MB/s eta 0:00:00 2023-08-31T21:58:41.1831998Z Collecting mccabe<0.7,>=0.6 (from pylint==2.6.0->-r requirements/developer.txt (line 4)) 2023-08-31T21:58:41.1910552Z Downloading mccabe-0.6.1-py2.py3-none-any.whl (8.6 kB) 2023-08-31T21:58:41.2104100Z Collecting toml>=0.7.1 (from pylint==2.6.0->-r requirements/developer.txt (line 4)) 2023-08-31T21:58:41.2181733Z Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2023-08-31T21:58:41.7496794Z Collecting coverage[toml]>=5.2.1 (from pytest-cov==4.1.0->-r requirements/developer.txt (line 6)) 2023-08-31T21:58:41.7498907Z Obtaining dependency information for coverage[toml]>=5.2.1 from https://files.pythonhosted.org/packages/3b/5c/f4e217d026d0e1faef27dc0b1c7a89798bf5d4b8b013f5b7cceda85efc83/coverage-7.3.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 2023-08-31T21:58:41.7587354Z Downloading coverage-7.3.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (8.1 kB) 2023-08-31T21:58:41.7890859Z Requirement already satisfied: setuptools in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from grpcio-tools==1.54.2->-r requirements/developer.txt (line 9)) (68.1.2) 2023-08-31T21:58:42.1817582Z Requirement already satisfied: filelock in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from transformers==4.30.0->-r requirements/developer.txt (line 10)) (3.12.3) 2023-08-31T21:58:42.2241660Z Collecting huggingface-hub<1.0,>=0.14.1 (from transformers==4.30.0->-r requirements/developer.txt (line 10)) 2023-08-31T21:58:42.2244116Z Obtaining dependency information for huggingface-hub<1.0,>=0.14.1 from https://files.pythonhosted.org/packages/7f/c4/adcbe9a696c135578cabcbdd7331332daad4d49b7c43688bc2d36b3a47d2/huggingface_hub-0.16.4-py3-none-any.whl.metadata 2023-08-31T21:58:42.2320440Z Downloading huggingface_hub-0.16.4-py3-none-any.whl.metadata (12 kB) 2023-08-31T21:58:42.9517125Z Collecting regex!=2019.12.17 (from transformers==4.30.0->-r requirements/developer.txt (line 10)) 2023-08-31T21:58:42.9518430Z Obtaining dependency information for regex!=2019.12.17 from https://files.pythonhosted.org/packages/c0/f4/278e305e02245937579a7952b8a3205116b4d2480a3c03fa11e599b773d6/regex-2023.8.8-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 2023-08-31T21:58:42.9597941Z Downloading regex-2023.8.8-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (40 kB) 2023-08-31T21:58:42.9638971Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.9/40.9 kB 17.3 MB/s eta 0:00:00 2023-08-31T21:58:43.1871252Z Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 (from transformers==4.30.0->-r requirements/developer.txt (line 10)) 2023-08-31T21:58:43.2018835Z Downloading tokenizers-0.13.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (7.8 MB) 2023-08-31T21:58:43.2633852Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.8/7.8 MB 132.4 MB/s eta 0:00:00 2023-08-31T21:58:43.4050457Z Collecting safetensors>=0.3.1 (from transformers==4.30.0->-r requirements/developer.txt (line 10)) 2023-08-31T21:58:43.4055577Z Obtaining dependency information for safetensors>=0.3.1 from https://files.pythonhosted.org/packages/4c/49/d41e7f524bff04e51ebe560ecedb28127d8f4e424f9d250c106c3b7fb637/safetensors-0.3.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 2023-08-31T21:58:43.4147993Z Downloading safetensors-0.3.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.7 kB) 2023-08-31T21:58:43.4179540Z Requirement already satisfied: tqdm>=4.27 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from transformers==4.30.0->-r requirements/developer.txt (line 10)) (4.66.1) 2023-08-31T21:58:43.4254678Z Requirement already satisfied: beautifulsoup4 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from pyspelling==2.8.2->-r requirements/developer.txt (line 11)) (4.12.2) 2023-08-31T21:58:43.4429427Z Collecting html5lib (from pyspelling==2.8.2->-r requirements/developer.txt (line 11)) 2023-08-31T21:58:43.4505272Z Downloading html5lib-1.1-py2.py3-none-any.whl (112 kB) 2023-08-31T21:58:43.4549624Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 112.2/112.2 kB 49.9 MB/s eta 0:00:00 2023-08-31T21:58:43.7235566Z Collecting lxml (from pyspelling==2.8.2->-r requirements/developer.txt (line 11)) 2023-08-31T21:58:43.7236689Z Obtaining dependency information for lxml from https://files.pythonhosted.org/packages/c5/a2/7876f76606725340c989b1c73b5501fc41fb21e50a8597c9ecdb63a05b27/lxml-4.9.3-cp39-cp39-manylinux_2_28_x86_64.whl.metadata 2023-08-31T21:58:43.7332593Z Downloading lxml-4.9.3-cp39-cp39-manylinux_2_28_x86_64.whl.metadata (3.8 kB) 2023-08-31T21:58:43.7633430Z Collecting markdown (from pyspelling==2.8.2->-r requirements/developer.txt (line 11)) 2023-08-31T21:58:43.7635699Z Obtaining dependency information for markdown from https://files.pythonhosted.org/packages/1a/b5/228c1cdcfe138f1a8e01ab1b54284c8b83735476cb22b6ba251656ed13ad/Markdown-3.4.4-py3-none-any.whl.metadata 2023-08-31T21:58:43.7756031Z Downloading Markdown-3.4.4-py3-none-any.whl.metadata (6.9 kB) 2023-08-31T21:58:43.7786464Z Requirement already satisfied: soupsieve>=1.8 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from pyspelling==2.8.2->-r requirements/developer.txt (line 11)) (2.3.2.post1) 2023-08-31T21:58:43.8097011Z Collecting wcmatch>=6.0.3 (from pyspelling==2.8.2->-r requirements/developer.txt (line 11)) 2023-08-31T21:58:43.8099248Z Obtaining dependency information for wcmatch>=6.0.3 from https://files.pythonhosted.org/packages/6d/45/563267247f0b6f7c0f8028ab92bf1664da26179a630f863933033d74ab75/wcmatch-8.5-py3-none-any.whl.metadata 2023-08-31T21:58:43.8173947Z Downloading wcmatch-8.5-py3-none-any.whl.metadata (5.1 kB) 2023-08-31T21:58:43.8242944Z Requirement already satisfied: cffi>=1.9.1 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from pygit2==1.12.1->-r requirements/developer.txt (line 12)) (1.15.1) 2023-08-31T21:58:43.8517622Z Collecting cfgv>=2.0.0 (from pre-commit==3.3.2->-r requirements/developer.txt (line 13)) 2023-08-31T21:58:43.8519944Z Obtaining dependency information for cfgv>=2.0.0 from https://files.pythonhosted.org/packages/c5/55/51844dd50c4fc7a33b653bfaba4c2456f06955289ca770a5dbd5fd267374/cfgv-3.4.0-py2.py3-none-any.whl.metadata 2023-08-31T21:58:43.8595968Z Downloading cfgv-3.4.0-py2.py3-none-any.whl.metadata (8.5 kB) 2023-08-31T21:58:43.9497822Z Collecting identify>=1.0.0 (from pre-commit==3.3.2->-r requirements/developer.txt (line 13)) 2023-08-31T21:58:43.9500007Z Obtaining dependency information for identify>=1.0.0 from https://files.pythonhosted.org/packages/05/66/f65626f8e1fd835941851503f0dac65460b3f1332f7fffc85cbf548d5209/identify-2.5.27-py2.py3-none-any.whl.metadata 2023-08-31T21:58:43.9578803Z Downloading identify-2.5.27-py2.py3-none-any.whl.metadata (4.4 kB) 2023-08-31T21:58:43.9837319Z Collecting nodeenv>=0.11.1 (from pre-commit==3.3.2->-r requirements/developer.txt (line 13)) 2023-08-31T21:58:43.9840873Z Obtaining dependency information for nodeenv>=0.11.1 from https://files.pythonhosted.org/packages/1a/e6/6d2ead760a9ddb35e65740fd5a57e46aadd7b0c49861ab24f94812797a1c/nodeenv-1.8.0-py2.py3-none-any.whl.metadata 2023-08-31T21:58:43.9926119Z Downloading nodeenv-1.8.0-py2.py3-none-any.whl.metadata (21 kB) 2023-08-31T21:58:44.0982812Z Collecting virtualenv>=20.10.0 (from pre-commit==3.3.2->-r requirements/developer.txt (line 13)) 2023-08-31T21:58:44.0985315Z Obtaining dependency information for virtualenv>=20.10.0 from https://files.pythonhosted.org/packages/48/87/0ff871ebe003075d61e1abeab67c21d50edf44dbfdeabd107bef30a9e027/virtualenv-20.24.4-py3-none-any.whl.metadata 2023-08-31T21:58:44.1067817Z Downloading virtualenv-20.24.4-py3-none-any.whl.metadata (4.5 kB) 2023-08-31T21:58:44.1187798Z Requirement already satisfied: pkginfo>=1.8.1 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from twine==4.0.2->-r requirements/developer.txt (line 14)) (1.9.6) 2023-08-31T21:58:44.1433871Z Collecting readme-renderer>=35.0 (from twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:44.1436340Z Obtaining dependency information for readme-renderer>=35.0 from https://files.pythonhosted.org/packages/b5/a2/99fbffc358c2d19700d3a4a038fa451e7ac6a4067a16df4588d068f841e2/readme_renderer-41.0-py3-none-any.whl.metadata 2023-08-31T21:58:44.1515512Z Downloading readme_renderer-41.0-py3-none-any.whl.metadata (2.7 kB) 2023-08-31T21:58:44.1811082Z Collecting requests-toolbelt!=0.9.0,>=0.8.0 (from twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:44.1890365Z Downloading requests_toolbelt-1.0.0-py2.py3-none-any.whl (54 kB) 2023-08-31T21:58:44.1930545Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54.5/54.5 kB 25.9 MB/s eta 0:00:00 2023-08-31T21:58:44.2624415Z Collecting importlib-metadata>=3.6 (from twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:44.2625858Z Obtaining dependency information for importlib-metadata>=3.6 from https://files.pythonhosted.org/packages/cc/37/db7ba97e676af155f5fcb1a35466f446eadc9104e25b83366e8088c9c926/importlib_metadata-6.8.0-py3-none-any.whl.metadata 2023-08-31T21:58:44.2701620Z Downloading importlib_metadata-6.8.0-py3-none-any.whl.metadata (5.1 kB) 2023-08-31T21:58:44.3366442Z Collecting keyring>=15.1 (from twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:44.3368564Z Obtaining dependency information for keyring>=15.1 from https://files.pythonhosted.org/packages/0e/8f/5772801169cf62e8232721034f91f81e33b0cfa6e51d3bf6ff65c503af2a/keyring-24.2.0-py3-none-any.whl.metadata 2023-08-31T21:58:44.3446000Z Downloading keyring-24.2.0-py3-none-any.whl.metadata (20 kB) 2023-08-31T21:58:44.3658672Z Collecting rfc3986>=1.4.0 (from twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:44.3733203Z Downloading rfc3986-2.0.0-py2.py3-none-any.whl (31 kB) 2023-08-31T21:58:44.4686136Z Collecting rich>=12.0.0 (from twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:44.4688454Z Obtaining dependency information for rich>=12.0.0 from https://files.pythonhosted.org/packages/8d/5f/21a93b2ec205f4b79853ff6e838e3c99064d5dbe85ec6b05967506f14af0/rich-13.5.2-py3-none-any.whl.metadata 2023-08-31T21:58:44.4765358Z Downloading rich-13.5.2-py3-none-any.whl.metadata (18 kB) 2023-08-31T21:58:44.5442084Z Requirement already satisfied: typing-extensions>=3.10 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from mypy==1.3.0->-r requirements/developer.txt (line 15)) (4.7.1) 2023-08-31T21:58:44.5616293Z Collecting mypy-extensions>=1.0.0 (from mypy==1.3.0->-r requirements/developer.txt (line 15)) 2023-08-31T21:58:44.5694911Z Downloading mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB) 2023-08-31T21:58:44.6194314Z Collecting coloredlogs (from onnxruntime==1.15.0->-r requirements/developer.txt (line 18)) 2023-08-31T21:58:44.6288571Z Downloading coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB) 2023-08-31T21:58:44.6325697Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46.0/46.0 kB 23.6 MB/s eta 0:00:00 2023-08-31T21:58:44.6520184Z Collecting flatbuffers (from onnxruntime==1.15.0->-r requirements/developer.txt (line 18)) 2023-08-31T21:58:44.6522593Z Obtaining dependency information for flatbuffers from https://files.pythonhosted.org/packages/6f/12/d5c79ee252793ffe845d58a913197bfa02ae9a0b5c9bc3dc4b58d477b9e7/flatbuffers-23.5.26-py2.py3-none-any.whl.metadata 2023-08-31T21:58:44.6607333Z Downloading flatbuffers-23.5.26-py2.py3-none-any.whl.metadata (850 bytes) 2023-08-31T21:58:44.6631989Z Requirement already satisfied: sympy in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from onnxruntime==1.15.0->-r requirements/developer.txt (line 18)) (1.12) 2023-08-31T21:58:44.7562817Z Collecting lazy-object-proxy>=1.4.0 (from astroid<=2.5,>=2.4.0->pylint==2.6.0->-r requirements/developer.txt (line 4)) 2023-08-31T21:58:44.7642022Z Downloading lazy_object_proxy-1.9.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (62 kB) 2023-08-31T21:58:44.7682307Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.1/62.1 kB 28.1 MB/s eta 0:00:00 2023-08-31T21:58:44.8978692Z Collecting wrapt<1.13,>=1.11 (from astroid<=2.5,>=2.4.0->pylint==2.6.0->-r requirements/developer.txt (line 4)) 2023-08-31T21:58:44.9065960Z Downloading wrapt-1.12.1.tar.gz (27 kB) 2023-08-31T21:58:44.9129011Z Preparing metadata (setup.py): started 2023-08-31T21:58:45.0659800Z Preparing metadata (setup.py): finished with status 'done' 2023-08-31T21:58:45.0778808Z Requirement already satisfied: pycparser in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from cffi>=1.9.1->pygit2==1.12.1->-r requirements/developer.txt (line 12)) (2.21) 2023-08-31T21:58:45.2059434Z Collecting fsspec (from huggingface-hub<1.0,>=0.14.1->transformers==4.30.0->-r requirements/developer.txt (line 10)) 2023-08-31T21:58:45.2061295Z Obtaining dependency information for fsspec from https://files.pythonhosted.org/packages/e3/bd/4c0a4619494188a9db5d77e2100ab7d544a42e76b2447869d8e124e981d8/fsspec-2023.6.0-py3-none-any.whl.metadata 2023-08-31T21:58:45.2140256Z Downloading fsspec-2023.6.0-py3-none-any.whl.metadata (6.7 kB) 2023-08-31T21:58:45.3130333Z Collecting zipp>=0.5 (from importlib-metadata>=3.6->twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:45.3133650Z Obtaining dependency information for zipp>=0.5 from https://files.pythonhosted.org/packages/8c/08/d3006317aefe25ea79d3b76c9650afabaf6d63d1c8443b236e7405447503/zipp-3.16.2-py3-none-any.whl.metadata 2023-08-31T21:58:45.3211074Z Downloading zipp-3.16.2-py3-none-any.whl.metadata (3.7 kB) 2023-08-31T21:58:45.3769469Z Collecting jaraco.classes (from keyring>=15.1->twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:45.3772885Z Obtaining dependency information for jaraco.classes from https://files.pythonhosted.org/packages/c7/6b/1bc8fa93ea85146e08f0e0883bc579b7c7328364ed7df90b1628dcb36e10/jaraco.classes-3.3.0-py3-none-any.whl.metadata 2023-08-31T21:58:45.3849617Z Downloading jaraco.classes-3.3.0-py3-none-any.whl.metadata (2.9 kB) 2023-08-31T21:58:45.4141190Z Collecting SecretStorage>=3.2 (from keyring>=15.1->twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:45.4218617Z Downloading SecretStorage-3.3.3-py3-none-any.whl (15 kB) 2023-08-31T21:58:45.4435313Z Collecting jeepney>=0.4.2 (from keyring>=15.1->twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:45.4513076Z Downloading jeepney-0.8.0-py3-none-any.whl (48 kB) 2023-08-31T21:58:45.4557844Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.4/48.4 kB 21.0 MB/s eta 0:00:00 2023-08-31T21:58:45.5353123Z Collecting bleach>=2.1.0 (from readme-renderer>=35.0->twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:45.5428488Z Downloading bleach-6.0.0-py3-none-any.whl (162 kB) 2023-08-31T21:58:45.5478363Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 162.5/162.5 kB 59.0 MB/s eta 0:00:00 2023-08-31T21:58:45.5782438Z Collecting docutils>=0.13.1 (from readme-renderer>=35.0->twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:45.5785081Z Obtaining dependency information for docutils>=0.13.1 from https://files.pythonhosted.org/packages/26/87/f238c0670b94533ac0353a4e2a1a771a0cc73277b88bff23d3ae35a256c1/docutils-0.20.1-py3-none-any.whl.metadata 2023-08-31T21:58:45.5859974Z Downloading docutils-0.20.1-py3-none-any.whl.metadata (2.8 kB) 2023-08-31T21:58:45.6235804Z Collecting Pygments>=2.5.1 (from readme-renderer>=35.0->twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:45.6238050Z Obtaining dependency information for Pygments>=2.5.1 from https://files.pythonhosted.org/packages/43/88/29adf0b44ba6ac85045e63734ae0997d3c58d8b1a91c914d240828d0d73d/Pygments-2.16.1-py3-none-any.whl.metadata 2023-08-31T21:58:45.6316119Z Downloading Pygments-2.16.1-py3-none-any.whl.metadata (2.5 kB) 2023-08-31T21:58:45.7115420Z Collecting markdown-it-py>=2.2.0 (from rich>=12.0.0->twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:45.7117861Z Obtaining dependency information for markdown-it-py>=2.2.0 from https://files.pythonhosted.org/packages/42/d7/1ec15b46af6af88f19b8e5ffea08fa375d433c998b8a7639e76935c14f1f/markdown_it_py-3.0.0-py3-none-any.whl.metadata 2023-08-31T21:58:45.7194232Z Downloading markdown_it_py-3.0.0-py3-none-any.whl.metadata (6.9 kB) 2023-08-31T21:58:45.8228523Z Requirement already satisfied: networkx in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from torch>=1.6->captum==0.6.0->-r requirements/common.txt (line 3)) (3.1) 2023-08-31T21:58:45.8231581Z Requirement already satisfied: jinja2 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from torch>=1.6->captum==0.6.0->-r requirements/common.txt (line 3)) (3.1.2) 2023-08-31T21:58:45.9001660Z Collecting distlib<1,>=0.3.7 (from virtualenv>=20.10.0->pre-commit==3.3.2->-r requirements/developer.txt (line 13)) 2023-08-31T21:58:45.9003979Z Obtaining dependency information for distlib<1,>=0.3.7 from https://files.pythonhosted.org/packages/43/a0/9ba967fdbd55293bacfc1507f58e316f740a3b231fc00e3d86dc39bc185a/distlib-0.3.7-py2.py3-none-any.whl.metadata 2023-08-31T21:58:45.9081450Z Downloading distlib-0.3.7-py2.py3-none-any.whl.metadata (5.1 kB) 2023-08-31T21:58:45.9396247Z Collecting platformdirs<4,>=3.9.1 (from virtualenv>=20.10.0->pre-commit==3.3.2->-r requirements/developer.txt (line 13)) 2023-08-31T21:58:45.9398458Z Obtaining dependency information for platformdirs<4,>=3.9.1 from https://files.pythonhosted.org/packages/14/51/fe5a0d6ea589f0d4a1b97824fb518962ad48b27cd346dcdfa2405187997a/platformdirs-3.10.0-py3-none-any.whl.metadata 2023-08-31T21:58:45.9476798Z Downloading platformdirs-3.10.0-py3-none-any.whl.metadata (11 kB) 2023-08-31T21:58:45.9970152Z Collecting bracex>=2.1.1 (from wcmatch>=6.0.3->pyspelling==2.8.2->-r requirements/developer.txt (line 11)) 2023-08-31T21:58:46.0049307Z Downloading bracex-2.3.post1-py3-none-any.whl (12 kB) 2023-08-31T21:58:46.0670531Z Collecting humanfriendly>=9.1 (from coloredlogs->onnxruntime==1.15.0->-r requirements/developer.txt (line 18)) 2023-08-31T21:58:46.0745842Z Downloading humanfriendly-10.0-py2.py3-none-any.whl (86 kB) 2023-08-31T21:58:46.0789143Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.8/86.8 kB 36.1 MB/s eta 0:00:00 2023-08-31T21:58:46.1057318Z Requirement already satisfied: six>=1.9 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from html5lib->pyspelling==2.8.2->-r requirements/developer.txt (line 11)) (1.16.0) 2023-08-31T21:58:46.1195701Z Collecting webencodings (from html5lib->pyspelling==2.8.2->-r requirements/developer.txt (line 11)) 2023-08-31T21:58:46.1273099Z Downloading webencodings-0.5.1-py2.py3-none-any.whl (11 kB) 2023-08-31T21:58:46.2950693Z Collecting contourpy>=1.0.1 (from matplotlib->captum==0.6.0->-r requirements/common.txt (line 3)) 2023-08-31T21:58:46.2952009Z Obtaining dependency information for contourpy>=1.0.1 from https://files.pythonhosted.org/packages/38/6f/5382bdff9dda60cb17cef6dfa2bad3e6edacffd5c2243e282e851c63f721/contourpy-1.1.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 2023-08-31T21:58:46.3030686Z Downloading contourpy-1.1.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.7 kB) 2023-08-31T21:58:46.3197167Z Collecting cycler>=0.10 (from matplotlib->captum==0.6.0->-r requirements/common.txt (line 3)) 2023-08-31T21:58:46.3273387Z Downloading cycler-0.11.0-py3-none-any.whl (6.4 kB) 2023-08-31T21:58:46.4262650Z Collecting fonttools>=4.22.0 (from matplotlib->captum==0.6.0->-r requirements/common.txt (line 3)) 2023-08-31T21:58:46.4264883Z Obtaining dependency information for fonttools>=4.22.0 from https://files.pythonhosted.org/packages/49/50/2e31753c088d364756daa5bed0dab6a5928ebfd6e6d26f975c8b6d6f754a/fonttools-4.42.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata 2023-08-31T21:58:46.4361459Z Downloading fonttools-4.42.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (150 kB) 2023-08-31T21:58:46.4411560Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.0/151.0 kB 56.3 MB/s eta 0:00:00 2023-08-31T21:58:46.5295272Z Collecting kiwisolver>=1.0.1 (from matplotlib->captum==0.6.0->-r requirements/common.txt (line 3)) 2023-08-31T21:58:46.5297053Z Obtaining dependency information for kiwisolver>=1.0.1 from https://files.pythonhosted.org/packages/c0/a8/841594f11d0b88d8aeb26991bc4dac38baa909dc58d0c4262a4f7893bcbf/kiwisolver-1.4.5-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata 2023-08-31T21:58:46.5374739Z Downloading kiwisolver-1.4.5-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl.metadata (6.4 kB) 2023-08-31T21:58:46.5405148Z Requirement already satisfied: pillow>=6.2.0 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from matplotlib->captum==0.6.0->-r requirements/common.txt (line 3)) (9.3.0) 2023-08-31T21:58:46.6015207Z Collecting pyparsing<3.1,>=2.3.1 (from matplotlib->captum==0.6.0->-r requirements/common.txt (line 3)) 2023-08-31T21:58:46.6090330Z Downloading pyparsing-3.0.9-py3-none-any.whl (98 kB) 2023-08-31T21:58:46.6133250Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.3/98.3 kB 42.0 MB/s eta 0:00:00 2023-08-31T21:58:46.6377240Z Collecting python-dateutil>=2.7 (from matplotlib->captum==0.6.0->-r requirements/common.txt (line 3)) 2023-08-31T21:58:46.6470213Z Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-08-31T21:58:46.6524614Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 76.0 MB/s eta 0:00:00 2023-08-31T21:58:46.7001764Z Collecting importlib-resources>=3.2.0 (from matplotlib->captum==0.6.0->-r requirements/common.txt (line 3)) 2023-08-31T21:58:46.7004104Z Obtaining dependency information for importlib-resources>=3.2.0 from https://files.pythonhosted.org/packages/25/d4/592f53ce2f8dde8be5720851bd0ab71cc2e76c55978e4163ef1ab7e389bb/importlib_resources-6.0.1-py3-none-any.whl.metadata 2023-08-31T21:58:46.7082590Z Downloading importlib_resources-6.0.1-py3-none-any.whl.metadata (4.0 kB) 2023-08-31T21:58:46.7450586Z Requirement already satisfied: mpmath>=0.19 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from sympy->onnxruntime==1.15.0->-r requirements/developer.txt (line 18)) (1.3.0) 2023-08-31T21:58:47.0051591Z Collecting mdurl~=0.1 (from markdown-it-py>=2.2.0->rich>=12.0.0->twine==4.0.2->-r requirements/developer.txt (line 14)) 2023-08-31T21:58:47.0135073Z Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB) 2023-08-31T21:58:47.1331946Z Requirement already satisfied: cryptography>=2.0 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from SecretStorage>=3.2->keyring>=15.1->twine==4.0.2->-r requirements/developer.txt (line 14)) (41.0.3) 2023-08-31T21:58:47.2732132Z Requirement already satisfied: more-itertools in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from jaraco.classes->keyring>=15.1->twine==4.0.2->-r requirements/developer.txt (line 14)) (10.1.0) 2023-08-31T21:58:47.2898168Z Requirement already satisfied: MarkupSafe>=2.0 in /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages (from jinja2->torch>=1.6->captum==0.6.0->-r requirements/common.txt (line 3)) (2.1.3) 2023-08-31T21:58:47.4182949Z Downloading pytest_cov-4.1.0-py3-none-any.whl (21 kB) 2023-08-31T21:58:47.4319847Z Downloading grpcio-1.54.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.1 MB) 2023-08-31T21:58:47.4709647Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.1/5.1 MB 139.7 MB/s eta 0:00:00 2023-08-31T21:58:47.4822969Z Downloading protobuf-4.23.1-cp37-abi3-manylinux2014_x86_64.whl (304 kB) 2023-08-31T21:58:47.4878475Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 304.5/304.5 kB 87.6 MB/s eta 0:00:00 2023-08-31T21:58:47.5019651Z Downloading grpcio_tools-1.54.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.4 MB) 2023-08-31T21:58:47.5210656Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 140.9 MB/s eta 0:00:00 2023-08-31T21:58:47.5330412Z Downloading transformers-4.30.0-py3-none-any.whl (7.2 MB) 2023-08-31T21:58:47.5868906Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.2/7.2 MB 139.6 MB/s eta 0:00:00 2023-08-31T21:58:47.5968348Z Downloading pre_commit-3.3.2-py2.py3-none-any.whl (202 kB) 2023-08-31T21:58:47.6019431Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 202.8/202.8 kB 68.9 MB/s eta 0:00:00 2023-08-31T21:58:47.6139761Z Downloading intel_extension_for_pytorch-2.0.100-cp39-cp39-manylinux2014_x86_64.whl (41.8 MB) 2023-08-31T21:58:48.0243294Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 41.8/41.8 MB 51.8 MB/s eta 0:00:00 2023-08-31T21:58:48.0590138Z Downloading onnxruntime-1.15.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.9 MB) 2023-08-31T21:58:48.1345404Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.9/5.9 MB 81.1 MB/s eta 0:00:00 2023-08-31T21:58:48.1426408Z Downloading cfgv-3.4.0-py2.py3-none-any.whl (7.2 kB) 2023-08-31T21:58:48.1521402Z Downloading exceptiongroup-1.1.3-py3-none-any.whl (14 kB) 2023-08-31T21:58:48.1630432Z Downloading huggingface_hub-0.16.4-py3-none-any.whl (268 kB) 2023-08-31T21:58:48.1684858Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 268.8/268.8 kB 83.5 MB/s eta 0:00:00 2023-08-31T21:58:48.1759386Z Downloading identify-2.5.27-py2.py3-none-any.whl (98 kB) 2023-08-31T21:58:48.1801894Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.8/98.8 kB 42.2 MB/s eta 0:00:00 2023-08-31T21:58:48.1881984Z Downloading importlib_metadata-6.8.0-py3-none-any.whl (22 kB) 2023-08-31T21:58:48.1973255Z Downloading keyring-24.2.0-py3-none-any.whl (37 kB) 2023-08-31T21:58:48.2069831Z Downloading nodeenv-1.8.0-py2.py3-none-any.whl (22 kB) 2023-08-31T21:58:48.2161094Z Downloading readme_renderer-41.0-py3-none-any.whl (14 kB) 2023-08-31T21:58:48.2321737Z Downloading regex-2023.8.8-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (771 kB) 2023-08-31T21:58:48.2415842Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 771.4/771.4 kB 108.9 MB/s eta 0:00:00 2023-08-31T21:58:48.2506703Z Downloading rich-13.5.2-py3-none-any.whl (239 kB) 2023-08-31T21:58:48.2558538Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 239.7/239.7 kB 83.0 MB/s eta 0:00:00 2023-08-31T21:58:48.2675923Z Downloading safetensors-0.3.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB) 2023-08-31T21:58:48.2793372Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 134.2 MB/s eta 0:00:00 2023-08-31T21:58:48.2907557Z Downloading virtualenv-20.24.4-py3-none-any.whl (3.7 MB) 2023-08-31T21:58:48.3194351Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.7/3.7 MB 142.2 MB/s eta 0:00:00 2023-08-31T21:58:48.3274099Z Downloading wcmatch-8.5-py3-none-any.whl (39 kB) 2023-08-31T21:58:48.3366901Z Downloading flatbuffers-23.5.26-py2.py3-none-any.whl (26 kB) 2023-08-31T21:58:48.3490015Z Downloading lxml-4.9.3-cp39-cp39-manylinux_2_28_x86_64.whl (8.0 MB) 2023-08-31T21:58:48.4079568Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.0/8.0 MB 142.4 MB/s eta 0:00:00 2023-08-31T21:58:48.4159094Z Downloading Markdown-3.4.4-py3-none-any.whl (94 kB) 2023-08-31T21:58:48.4206642Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 94.2/94.2 kB 35.9 MB/s eta 0:00:00 2023-08-31T21:58:48.4320205Z Downloading matplotlib-3.7.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.6 MB) 2023-08-31T21:58:48.5142786Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.6/11.6 MB 138.1 MB/s eta 0:00:00 2023-08-31T21:58:48.5278340Z Downloading contourpy-1.1.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (300 kB) 2023-08-31T21:58:48.5338200Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 300.4/300.4 kB 81.2 MB/s eta 0:00:00 2023-08-31T21:58:48.5442086Z Downloading distlib-0.3.7-py2.py3-none-any.whl (468 kB) 2023-08-31T21:58:48.5511497Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 468.9/468.9 kB 103.0 MB/s eta 0:00:00 2023-08-31T21:58:48.5592869Z Downloading docutils-0.20.1-py3-none-any.whl (572 kB) 2023-08-31T21:58:48.5666711Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 572.7/572.7 kB 110.4 MB/s eta 0:00:00 2023-08-31T21:58:48.5782217Z Downloading fonttools-4.42.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.5 MB) 2023-08-31T21:58:48.6107278Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 149.1 MB/s eta 0:00:00 2023-08-31T21:58:48.6190044Z Downloading importlib_resources-6.0.1-py3-none-any.whl (34 kB) 2023-08-31T21:58:48.6312569Z Downloading kiwisolver-1.4.5-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (1.6 MB) 2023-08-31T21:58:48.6479015Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 110.0 MB/s eta 0:00:00 2023-08-31T21:58:48.6555874Z Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB) 2023-08-31T21:58:48.6599990Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 36.0 MB/s eta 0:00:00 2023-08-31T21:58:48.6676955Z Downloading platformdirs-3.10.0-py3-none-any.whl (17 kB) 2023-08-31T21:58:48.6808054Z Downloading Pygments-2.16.1-py3-none-any.whl (1.2 MB) 2023-08-31T21:58:48.6917677Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 134.6 MB/s eta 0:00:00 2023-08-31T21:58:48.6995627Z Downloading zipp-3.16.2-py3-none-any.whl (7.2 kB) 2023-08-31T21:58:48.7089853Z Downloading coverage-7.3.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (228 kB) 2023-08-31T21:58:48.7138714Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 228.6/228.6 kB 78.5 MB/s eta 0:00:00 2023-08-31T21:58:48.7234704Z Downloading fsspec-2023.6.0-py3-none-any.whl (163 kB) 2023-08-31T21:58:48.7281778Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 163.8/163.8 kB 60.8 MB/s eta 0:00:00 2023-08-31T21:58:48.7363792Z Downloading jaraco.classes-3.3.0-py3-none-any.whl (5.9 kB) 2023-08-31T21:58:49.1554487Z Building wheels for collected packages: wrapt 2023-08-31T21:58:49.1560082Z Building wheel for wrapt (setup.py): started 2023-08-31T21:58:49.9591429Z Building wheel for wrapt (setup.py): finished with status 'done' 2023-08-31T21:58:49.9597286Z Created wheel for wrapt: filename=wrapt-1.12.1-cp39-cp39-linux_x86_64.whl size=36968 sha256=f6771be6770123e46f0620d90c9f6a100d17edd9bc454785740ce89a70ec14d1 2023-08-31T21:58:49.9598950Z Stored in directory: /home/runner/.cache/pip/wheels/98/23/68/efe259aaca055e93b08e74fbe512819c69a2155c11ba3c0f10 2023-08-31T21:58:49.9626693Z Successfully built wrapt 2023-08-31T21:58:51.0730085Z Installing collected packages: wrapt, webencodings, tokenizers, safetensors, mccabe, flatbuffers, distlib, zipp, toml, rfc3986, regex, pyyaml, python-dateutil, pyparsing, pynvml, Pygments, protobuf, platformdirs, nodeenv, mypy-extensions, mock, mdurl, lxml, lazy-object-proxy, kiwisolver, jeepney, jaraco.classes, isort, intel_extension_for_pytorch, iniconfig, identify, humanfriendly, html5lib, grpcio, fsspec, fonttools, exceptiongroup, docutils, cycler, coverage, contourpy, cfgv, bracex, bleach, wcmatch, virtualenv, requests-toolbelt, readme-renderer, pytest, pygit2, onnx, mypy, markdown-it-py, importlib-resources, importlib-metadata, huggingface-hub, grpcio-tools, coloredlogs, astroid, transformers, torchpippy, SecretStorage, rich, pytest-mock, pytest-cov, pylint, pre-commit, onnxruntime, matplotlib, markdown, pyspelling, keyring, captum, twine 2023-08-31T21:58:51.5221711Z Attempting uninstall: pyyaml 2023-08-31T21:58:51.5230721Z Found existing installation: PyYAML 6.0.1 2023-08-31T21:58:51.5265905Z Uninstalling PyYAML-6.0.1: 2023-08-31T21:58:51.5278028Z Successfully uninstalled PyYAML-6.0.1 2023-08-31T21:59:05.3868276Z Successfully installed Pygments-2.16.1 SecretStorage-3.3.3 astroid-2.5 bleach-6.0.0 bracex-2.3.post1 captum-0.6.0 cfgv-3.4.0 coloredlogs-15.0.1 contourpy-1.1.0 coverage-7.3.0 cycler-0.11.0 distlib-0.3.7 docutils-0.20.1 exceptiongroup-1.1.3 flatbuffers-23.5.26 fonttools-4.42.1 fsspec-2023.6.0 grpcio-1.54.2 grpcio-tools-1.54.2 html5lib-1.1 huggingface-hub-0.16.4 humanfriendly-10.0 identify-2.5.27 importlib-metadata-6.8.0 importlib-resources-6.0.1 iniconfig-2.0.0 intel_extension_for_pytorch-2.0.100 isort-5.12.0 jaraco.classes-3.3.0 jeepney-0.8.0 keyring-24.2.0 kiwisolver-1.4.5 lazy-object-proxy-1.9.0 lxml-4.9.3 markdown-3.4.4 markdown-it-py-3.0.0 matplotlib-3.7.2 mccabe-0.6.1 mdurl-0.1.2 mock-5.0.2 mypy-1.3.0 mypy-extensions-1.0.0 nodeenv-1.8.0 onnx-1.14.0 onnxruntime-1.15.0 platformdirs-3.10.0 pre-commit-3.3.2 protobuf-4.23.1 pygit2-1.12.1 pylint-2.6.0 pynvml-11.4.1 pyparsing-3.0.9 pyspelling-2.8.2 pytest-7.3.1 pytest-cov-4.1.0 pytest-mock-3.10.0 python-dateutil-2.8.2 pyyaml-6.0 readme-renderer-41.0 regex-2023.8.8 requests-toolbelt-1.0.0 rfc3986-2.0.0 rich-13.5.2 safetensors-0.3.3 tokenizers-0.13.3 toml-0.10.2 torchpippy-0.1.1 transformers-4.30.0 twine-4.0.2 virtualenv-20.24.4 wcmatch-8.5 webencodings-0.5.1 wrapt-1.12.1 zipp-3.16.2 2023-08-31T21:59:05.9001812Z ##[group]Run python test/regression_tests.py --binaries --conda --nightly 2023-08-31T21:59:05.9002213Z python test/regression_tests.py --binaries --conda --nightly 2023-08-31T21:59:05.9059138Z shell: /usr/bin/bash -e {0} 2023-08-31T21:59:05.9059360Z env: 2023-08-31T21:59:05.9059561Z PS1: (__setup_conda) 2023-08-31T21:59:05.9059824Z CONDA_PREFIX: /usr/share/miniconda/envs/__setup_conda 2023-08-31T21:59:05.9060098Z CONDA_DEFAULT_ENV: __setup_conda 2023-08-31T21:59:05.9060355Z CONDA_PROMPT_MODIFIER: (__setup_conda) 2023-08-31T21:59:05.9060632Z CONDA_EXE: /usr/share/miniconda/bin/conda 2023-08-31T21:59:05.9060852Z _CE_M: 2023-08-31T21:59:05.9061027Z _CE_CONDA: 2023-08-31T21:59:05.9061263Z CONDA_PYTHON_EXE: /usr/share/miniconda/bin/python 2023-08-31T21:59:05.9061573Z JAVA_HOME: /opt/hostedtoolcache/Java_Zulu_jdk/17.0.8-7/x64 2023-08-31T21:59:05.9061895Z JAVA_HOME_17_X64: /opt/hostedtoolcache/Java_Zulu_jdk/17.0.8-7/x64 2023-08-31T21:59:05.9062180Z ##[endgroup] 2023-08-31T21:59:41.6983920Z Collecting package metadata (current_repodata.json): ...working... done 2023-08-31T22:00:06.6414899Z Solving environment: ...working... done 2023-08-31T22:00:06.7644568Z 2023-08-31T22:00:06.7644976Z ## Package Plan ## 2023-08-31T22:00:06.7645232Z 2023-08-31T22:00:06.7645494Z environment location: /usr/share/miniconda/envs/__setup_conda 2023-08-31T22:00:06.7645768Z 2023-08-31T22:00:06.7645936Z added / updated specs: 2023-08-31T22:00:06.7646689Z - torch-model-archiver 2023-08-31T22:00:06.7647058Z - torch-workflow-archiver 2023-08-31T22:00:06.7647733Z - torchserve 2023-08-31T22:00:06.7647932Z 2023-08-31T22:00:06.7648004Z 2023-08-31T22:00:06.7648211Z The following packages will be downloaded: 2023-08-31T22:00:06.7648452Z 2023-08-31T22:00:06.7648633Z package | build 2023-08-31T22:00:06.7649012Z ---------------------------|----------------- 2023-08-31T22:00:06.7649518Z freetype-2.12.1 | hca18f0e_1 611 KB conda-forge 2023-08-31T22:00:06.7650013Z lcms2-2.15 | haa2dc70_1 236 KB conda-forge 2023-08-31T22:00:06.7650469Z lerc-4.0.0 | h27087fc_0 275 KB conda-forge 2023-08-31T22:00:06.7650922Z libdeflate-1.18 | h0b41bf4_0 64 KB conda-forge 2023-08-31T22:00:06.7651407Z libjpeg-turbo-2.1.5.1 | h0b41bf4_0 479 KB conda-forge 2023-08-31T22:00:06.7651873Z libpng-1.6.39 | h753d276_0 276 KB conda-forge 2023-08-31T22:00:06.7652333Z libtiff-4.5.1 | h8b53f26_1 407 KB conda-forge 2023-08-31T22:00:06.7652779Z libwebp-base-1.3.1 | hd590300_0 391 KB conda-forge 2023-08-31T22:00:06.7653250Z libxcb-1.15 | h0b41bf4_0 375 KB conda-forge 2023-08-31T22:00:06.7653711Z openjpeg-2.5.0 | hfec8fc6_2 344 KB conda-forge 2023-08-31T22:00:06.7654182Z pillow-10.0.0 | py39haaeba84_0 44.2 MB conda-forge 2023-08-31T22:00:06.7654644Z pthread-stubs-0.4 | h36c2ea0_1001 5 KB conda-forge 2023-08-31T22:00:06.7655192Z torch-model-archiver-0.8.2.dev20230831| py39_0 22 KB pytorch-nightly 2023-08-31T22:00:06.7655776Z torch-workflow-archiver-0.2.10.dev20230831| py39_0 18 KB pytorch-nightly 2023-08-31T22:00:06.7656318Z torchserve-0.8.2.dev20230831| py39_0 22.7 MB pytorch-nightly 2023-08-31T22:00:06.7656811Z xorg-libxau-1.0.11 | hd590300_0 14 KB conda-forge 2023-08-31T22:00:06.7657283Z xorg-libxdmcp-1.1.3 | h7f98852_0 19 KB conda-forge 2023-08-31T22:00:06.7657724Z ------------------------------------------------------------ 2023-08-31T22:00:06.7658063Z Total: 70.4 MB 2023-08-31T22:00:06.7658285Z 2023-08-31T22:00:06.7658666Z The following NEW packages will be INSTALLED: 2023-08-31T22:00:06.7658912Z 2023-08-31T22:00:06.7659347Z freetype conda-forge/linux-64::freetype-2.12.1-hca18f0e_1 2023-08-31T22:00:06.7659877Z lcms2 conda-forge/linux-64::lcms2-2.15-haa2dc70_1 2023-08-31T22:00:06.7660377Z lerc conda-forge/linux-64::lerc-4.0.0-h27087fc_0 2023-08-31T22:00:06.7660897Z libdeflate conda-forge/linux-64::libdeflate-1.18-h0b41bf4_0 2023-08-31T22:00:06.7661458Z libjpeg-turbo conda-forge/linux-64::libjpeg-turbo-2.1.5.1-h0b41bf4_0 2023-08-31T22:00:06.7662017Z libpng conda-forge/linux-64::libpng-1.6.39-h753d276_0 2023-08-31T22:00:06.7662529Z libtiff conda-forge/linux-64::libtiff-4.5.1-h8b53f26_1 2023-08-31T22:00:06.7663061Z libwebp-base conda-forge/linux-64::libwebp-base-1.3.1-hd590300_0 2023-08-31T22:00:06.7663584Z libxcb conda-forge/linux-64::libxcb-1.15-h0b41bf4_0 2023-08-31T22:00:06.7664113Z openjpeg conda-forge/linux-64::openjpeg-2.5.0-hfec8fc6_2 2023-08-31T22:00:06.7664656Z pillow conda-forge/linux-64::pillow-10.0.0-py39haaeba84_0 2023-08-31T22:00:06.7665214Z pthread-stubs conda-forge/linux-64::pthread-stubs-0.4-h36c2ea0_1001 2023-08-31T22:00:06.7665853Z torch-model-archi~ pytorch-nightly/linux-64::torch-model-archiver-0.8.2.dev20230831-py39_0 2023-08-31T22:00:06.7666525Z torch-workflow-ar~ pytorch-nightly/linux-64::torch-workflow-archiver-0.2.10.dev20230831-py39_0 2023-08-31T22:00:06.7667158Z torchserve pytorch-nightly/linux-64::torchserve-0.8.2.dev20230831-py39_0 2023-08-31T22:00:06.7667848Z xorg-libxau conda-forge/linux-64::xorg-libxau-1.0.11-hd590300_0 2023-08-31T22:00:06.7668405Z xorg-libxdmcp conda-forge/linux-64::xorg-libxdmcp-1.1.3-h7f98852_0 2023-08-31T22:00:06.7668686Z 2023-08-31T22:00:06.7668761Z 2023-08-31T22:00:06.7668997Z Proceed ([y]/n)? 2023-08-31T22:00:06.7741656Z 2023-08-31T22:00:06.7741938Z Downloading and Extracting Packages 2023-08-31T22:00:06.7742516Z 2023-08-31T22:00:06.7746678Z freetype-2.12.1 | 611 KB | | 0% 2023-08-31T22:00:06.7760529Z 2023-08-31T22:00:06.7768544Z lcms2-2.15 | 236 KB | | 0%  2023-08-31T22:00:06.7768832Z 2023-08-31T22:00:06.7786902Z 2023-08-31T22:00:06.7791732Z xorg-libxdmcp-1.1.3 | 19 KB | | 0%  2023-08-31T22:00:06.7791932Z 2023-08-31T22:00:06.7791939Z 2023-08-31T22:00:06.7793417Z 2023-08-31T22:00:06.7830089Z openjpeg-2.5.0 | 344 KB | | 0%  2023-08-31T22:00:06.7830313Z 2023-08-31T22:00:06.7830320Z 2023-08-31T22:00:06.7830327Z 2023-08-31T22:00:06.7831891Z 2023-08-31T22:00:06.7851913Z lerc-4.0.0 | 275 KB | | 0%  2023-08-31T22:00:06.7852121Z 2023-08-31T22:00:06.7852129Z 2023-08-31T22:00:06.7852137Z 2023-08-31T22:00:06.7852144Z 2023-08-31T22:00:06.7853785Z 2023-08-31T22:00:06.7856736Z libxcb-1.15 | 375 KB | | 0%  2023-08-31T22:00:06.7856951Z 2023-08-31T22:00:06.7856959Z 2023-08-31T22:00:06.7856965Z 2023-08-31T22:00:06.7856972Z 2023-08-31T22:00:06.7856978Z 2023-08-31T22:00:06.7858438Z 2023-08-31T22:00:06.7861087Z libjpeg-turbo-2.1.5. | 479 KB | | 0%  2023-08-31T22:00:06.7861294Z 2023-08-31T22:00:06.7861301Z 2023-08-31T22:00:06.7861307Z 2023-08-31T22:00:06.7861314Z 2023-08-31T22:00:06.7861319Z 2023-08-31T22:00:06.7861325Z 2023-08-31T22:00:06.7862780Z 2023-08-31T22:00:06.7865456Z torchserve-0.8.2.dev | 22.7 MB | | 0%  2023-08-31T22:00:06.7865679Z 2023-08-31T22:00:06.7865686Z 2023-08-31T22:00:06.7865693Z 2023-08-31T22:00:06.7865699Z 2023-08-31T22:00:06.7865705Z 2023-08-31T22:00:06.7865710Z 2023-08-31T22:00:06.7865716Z 2023-08-31T22:00:06.7867108Z 2023-08-31T22:00:06.7888999Z libpng-1.6.39 | 276 KB | | 0%  2023-08-31T22:00:06.7889294Z 2023-08-31T22:00:06.7889373Z 2023-08-31T22:00:06.7889443Z 2023-08-31T22:00:06.7889771Z 2023-08-31T22:00:06.7889852Z 2023-08-31T22:00:06.7889940Z 2023-08-31T22:00:06.7890013Z 2023-08-31T22:00:06.7890085Z 2023-08-31T22:00:06.7891977Z 2023-08-31T22:00:06.7985872Z pillow-10.0.0 | 44.2 MB | | 0%  2023-08-31T22:00:06.7986194Z 2023-08-31T22:00:06.7986269Z 2023-08-31T22:00:06.7986341Z 2023-08-31T22:00:06.7986418Z 2023-08-31T22:00:06.7986489Z 2023-08-31T22:00:06.7986559Z 2023-08-31T22:00:06.7986630Z 2023-08-31T22:00:06.7986702Z 2023-08-31T22:00:06.7986772Z 2023-08-31T22:00:06.7986856Z 2023-08-31T22:00:06.7987233Z libtiff-4.5.1 | 407 KB | | 0%  2023-08-31T22:00:06.7987498Z 2023-08-31T22:00:06.7987569Z 2023-08-31T22:00:06.7987639Z 2023-08-31T22:00:06.7987708Z 2023-08-31T22:00:06.7987790Z 2023-08-31T22:00:06.7987860Z 2023-08-31T22:00:06.7987932Z 2023-08-31T22:00:06.7988002Z 2023-08-31T22:00:06.7988072Z 2023-08-31T22:00:06.7988142Z 2023-08-31T22:00:06.7988211Z 2023-08-31T22:00:06.7988545Z pthread-stubs-0.4 | 5 KB | | 0%  2023-08-31T22:00:06.7988818Z 2023-08-31T22:00:06.7988889Z 2023-08-31T22:00:06.7988959Z 2023-08-31T22:00:06.7989029Z 2023-08-31T22:00:06.7989100Z 2023-08-31T22:00:06.7989170Z 2023-08-31T22:00:06.7989998Z 2023-08-31T22:00:06.7991528Z 2023-08-31T22:00:06.7991639Z 2023-08-31T22:00:06.7991712Z 2023-08-31T22:00:06.7991782Z 2023-08-31T22:00:06.7991852Z 2023-08-31T22:00:06.7992292Z torch-model-archiver | 22 KB | | 0%  2023-08-31T22:00:06.7992908Z 2023-08-31T22:00:06.7992980Z 2023-08-31T22:00:06.7993052Z 2023-08-31T22:00:06.7993124Z 2023-08-31T22:00:06.7993195Z 2023-08-31T22:00:06.7993264Z 2023-08-31T22:00:06.7993334Z 2023-08-31T22:00:06.7993405Z 2023-08-31T22:00:06.7993475Z 2023-08-31T22:00:06.7993546Z 2023-08-31T22:00:06.7993615Z 2023-08-31T22:00:06.7993700Z 2023-08-31T22:00:06.7993771Z 2023-08-31T22:00:06.7994104Z torch-workflow-archi | 18 KB | | 0%  2023-08-31T22:00:06.7994381Z 2023-08-31T22:00:06.7994454Z 2023-08-31T22:00:06.7994525Z 2023-08-31T22:00:06.7994595Z 2023-08-31T22:00:06.7994665Z 2023-08-31T22:00:06.7994736Z 2023-08-31T22:00:06.7994806Z 2023-08-31T22:00:06.7994876Z 2023-08-31T22:00:06.7994945Z 2023-08-31T22:00:06.7995017Z 2023-08-31T22:00:06.7995087Z 2023-08-31T22:00:06.7995156Z 2023-08-31T22:00:06.7995236Z 2023-08-31T22:00:06.7995308Z 2023-08-31T22:00:06.7995624Z libwebp-base-1.3.1 | 391 KB | | 0%  2023-08-31T22:00:06.7995907Z 2023-08-31T22:00:06.7995987Z 2023-08-31T22:00:06.7996059Z 2023-08-31T22:00:06.7996129Z 2023-08-31T22:00:06.7996199Z 2023-08-31T22:00:06.7996268Z 2023-08-31T22:00:06.7996339Z 2023-08-31T22:00:06.7996409Z 2023-08-31T22:00:06.7996479Z 2023-08-31T22:00:06.7996549Z 2023-08-31T22:00:06.7996619Z 2023-08-31T22:00:06.7996689Z 2023-08-31T22:00:06.7996758Z 2023-08-31T22:00:06.7996845Z 2023-08-31T22:00:06.7996918Z 2023-08-31T22:00:06.7997240Z xorg-libxau-1.0.11 | 14 KB | | 0%  2023-08-31T22:00:06.7997498Z 2023-08-31T22:00:06.7997578Z 2023-08-31T22:00:06.7997650Z 2023-08-31T22:00:06.7997720Z 2023-08-31T22:00:06.7997790Z 2023-08-31T22:00:06.7997860Z 2023-08-31T22:00:06.7997930Z 2023-08-31T22:00:06.7998000Z 2023-08-31T22:00:06.7998070Z 2023-08-31T22:00:06.7998140Z 2023-08-31T22:00:06.7998211Z 2023-08-31T22:00:06.7998280Z 2023-08-31T22:00:06.7998356Z 2023-08-31T22:00:06.7998438Z 2023-08-31T22:00:06.7998510Z 2023-08-31T22:00:06.7998580Z 2023-08-31T22:00:06.8870841Z libdeflate-1.18 | 64 KB | | 0%  2023-08-31T22:00:06.8913856Z 2023-08-31T22:00:06.8913865Z 2023-08-31T22:00:06.8913871Z 2023-08-31T22:00:06.8913878Z 2023-08-31T22:00:06.8914162Z lerc-4.0.0 | 275 KB | ##3 | 23%  2023-08-31T22:00:06.8914540Z 2023-08-31T22:00:06.8914558Z 2023-08-31T22:00:06.8949397Z xorg-libxdmcp-1.1.3 | 19 KB | ########5 | 86%  2023-08-31T22:00:06.8949605Z 2023-08-31T22:00:06.9042227Z lcms2-2.15 | 236 KB | 6 | 7%  2023-08-31T22:00:06.9042657Z 2023-08-31T22:00:06.9095733Z 2023-08-31T22:00:06.9097381Z xorg-libxdmcp-1.1.3 | 19 KB | ########## | 100%  2023-08-31T22:00:06.9289192Z freetype-2.12.1 | 611 KB | 2 | 3% 2023-08-31T22:00:06.9289398Z 2023-08-31T22:00:06.9289405Z 2023-08-31T22:00:06.9289434Z 2023-08-31T22:00:06.9289456Z 2023-08-31T22:00:06.9289463Z 2023-08-31T22:00:06.9321483Z libxcb-1.15 | 375 KB | 4 | 4%  2023-08-31T22:00:06.9321699Z 2023-08-31T22:00:06.9321706Z 2023-08-31T22:00:06.9321712Z 2023-08-31T22:00:06.9321728Z 2023-08-31T22:00:06.9321735Z 2023-08-31T22:00:06.9321740Z 2023-08-31T22:00:06.9354628Z libjpeg-turbo-2.1.5. | 479 KB | 3 | 3%  2023-08-31T22:00:06.9355104Z 2023-08-31T22:00:06.9355268Z 2023-08-31T22:00:06.9355302Z 2023-08-31T22:00:06.9653849Z openjpeg-2.5.0 | 344 KB | 4 | 5%  2023-08-31T22:00:06.9654293Z 2023-08-31T22:00:06.9838099Z lcms2-2.15 | 236 KB | ########## | 100%  2023-08-31T22:00:06.9838308Z 2023-08-31T22:00:06.9838315Z 2023-08-31T22:00:06.9838321Z 2023-08-31T22:00:06.9840242Z 2023-08-31T22:00:06.9890160Z lerc-4.0.0 | 275 KB | ########## | 100%  2023-08-31T22:00:06.9891681Z 2023-08-31T22:00:06.9891841Z 2023-08-31T22:00:06.9892143Z 2023-08-31T22:00:06.9938326Z 2023-08-31T22:00:06.9938339Z 2023-08-31T22:00:06.9938346Z 2023-08-31T22:00:06.9938352Z 2023-08-31T22:00:06.9938358Z 2023-08-31T22:00:06.9993374Z libpng-1.6.39 | 276 KB | 5 | 6%  2023-08-31T22:00:06.9993592Z 2023-08-31T22:00:06.9993600Z 2023-08-31T22:00:06.9993617Z 2023-08-31T22:00:06.9993624Z 2023-08-31T22:00:06.9993630Z 2023-08-31T22:00:06.9993636Z 2023-08-31T22:00:06.9993656Z 2023-08-31T22:00:06.9993663Z 2023-08-31T22:00:06.9993669Z 2023-08-31T22:00:07.0020787Z pillow-10.0.0 | 44.2 MB | | 0%  2023-08-31T22:00:07.0021008Z 2023-08-31T22:00:07.0021016Z 2023-08-31T22:00:07.0021023Z 2023-08-31T22:00:07.0021029Z 2023-08-31T22:00:07.0021035Z 2023-08-31T22:00:07.0021041Z 2023-08-31T22:00:07.0021047Z 2023-08-31T22:00:07.0021053Z 2023-08-31T22:00:07.0021059Z 2023-08-31T22:00:07.0021064Z 2023-08-31T22:00:07.0021070Z 2023-08-31T22:00:07.0021332Z pthread-stubs-0.4 | 5 KB | ########## | 100%  2023-08-31T22:00:07.0021549Z 2023-08-31T22:00:07.0021556Z 2023-08-31T22:00:07.0021563Z 2023-08-31T22:00:07.0021569Z 2023-08-31T22:00:07.0021576Z 2023-08-31T22:00:07.0021583Z 2023-08-31T22:00:07.0021589Z 2023-08-31T22:00:07.0021596Z 2023-08-31T22:00:07.0021602Z 2023-08-31T22:00:07.0021609Z 2023-08-31T22:00:07.0353744Z libtiff-4.5.1 | 407 KB | 3 | 4%  2023-08-31T22:00:07.0354231Z 2023-08-31T22:00:07.0354635Z 2023-08-31T22:00:07.0354780Z 2023-08-31T22:00:07.0354954Z 2023-08-31T22:00:07.0355097Z 2023-08-31T22:00:07.0358605Z 2023-08-31T22:00:07.0360447Z libjpeg-turbo-2.1.5. | 479 KB | ########## | 100%  2023-08-31T22:00:07.0360796Z 2023-08-31T22:00:07.0361012Z 2023-08-31T22:00:07.0362572Z 2023-08-31T22:00:07.0362717Z 2023-08-31T22:00:07.0362861Z 2023-08-31T22:00:07.0363035Z 2023-08-31T22:00:07.0514153Z libjpeg-turbo-2.1.5. | 479 KB | ########## | 100%  2023-08-31T22:00:07.0520774Z freetype-2.12.1 | 611 KB | ########## | 100% 2023-08-31T22:00:07.0666541Z freetype-2.12.1 | 611 KB | ########## | 100% 2023-08-31T22:00:07.0666953Z 2023-08-31T22:00:07.0667366Z 2023-08-31T22:00:07.0667512Z 2023-08-31T22:00:07.0667656Z 2023-08-31T22:00:07.0667800Z 2023-08-31T22:00:07.0667959Z 2023-08-31T22:00:07.0668102Z 2023-08-31T22:00:07.0668244Z 2023-08-31T22:00:07.0668629Z 2023-08-31T22:00:07.0668790Z 2023-08-31T22:00:07.0668985Z 2023-08-31T22:00:07.0669219Z 2023-08-31T22:00:07.0669421Z 2023-08-31T22:00:07.0669695Z 2023-08-31T22:00:07.0786357Z libwebp-base-1.3.1 | 391 KB | 4 | 4%  2023-08-31T22:00:07.0786796Z 2023-08-31T22:00:07.0787202Z 2023-08-31T22:00:07.0791428Z 2023-08-31T22:00:07.0799350Z openjpeg-2.5.0 | 344 KB | ########## | 100%  2023-08-31T22:00:07.0799720Z 2023-08-31T22:00:07.0799939Z 2023-08-31T22:00:07.0818200Z 2023-08-31T22:00:07.0982126Z openjpeg-2.5.0 | 344 KB | ########## | 100%  2023-08-31T22:00:07.0982529Z 2023-08-31T22:00:07.0982928Z 2023-08-31T22:00:07.0983108Z 2023-08-31T22:00:07.0983251Z 2023-08-31T22:00:07.0983396Z 2023-08-31T22:00:07.0983531Z 2023-08-31T22:00:07.0983735Z 2023-08-31T22:00:07.0983933Z 2023-08-31T22:00:07.0984144Z 2023-08-31T22:00:07.1101153Z pillow-10.0.0 | 44.2 MB | 8 | 8%  2023-08-31T22:00:07.1101614Z 2023-08-31T22:00:07.1101954Z 2023-08-31T22:00:07.1102142Z 2023-08-31T22:00:07.1102292Z 2023-08-31T22:00:07.1102439Z 2023-08-31T22:00:07.1102581Z 2023-08-31T22:00:07.1102736Z 2023-08-31T22:00:07.1107802Z 2023-08-31T22:00:07.1113563Z libpng-1.6.39 | 276 KB | ########## | 100%  2023-08-31T22:00:07.1113931Z 2023-08-31T22:00:07.1114174Z 2023-08-31T22:00:07.1114347Z 2023-08-31T22:00:07.1114493Z 2023-08-31T22:00:07.1114636Z 2023-08-31T22:00:07.1114769Z 2023-08-31T22:00:07.1114958Z 2023-08-31T22:00:07.1115372Z 2023-08-31T22:00:07.1115561Z 2023-08-31T22:00:07.1115685Z 2023-08-31T22:00:07.1115858Z 2023-08-31T22:00:07.1116034Z 2023-08-31T22:00:07.1116192Z 2023-08-31T22:00:07.1116349Z 2023-08-31T22:00:07.1116535Z 2023-08-31T22:00:07.1132590Z xorg-libxau-1.0.11 | 14 KB | ########## | 100%  2023-08-31T22:00:07.1132948Z 2023-08-31T22:00:07.1133073Z 2023-08-31T22:00:07.1167009Z 2023-08-31T22:00:07.1169510Z 2023-08-31T22:00:07.1169588Z 2023-08-31T22:00:07.1169610Z 2023-08-31T22:00:07.1169629Z 2023-08-31T22:00:07.1169698Z 2023-08-31T22:00:07.1227308Z libpng-1.6.39 | 276 KB | ########## | 100%  2023-08-31T22:00:07.1227510Z 2023-08-31T22:00:07.1227518Z 2023-08-31T22:00:07.1227534Z 2023-08-31T22:00:07.1227540Z 2023-08-31T22:00:07.1227546Z 2023-08-31T22:00:07.1227552Z 2023-08-31T22:00:07.1227558Z 2023-08-31T22:00:07.1227563Z 2023-08-31T22:00:07.1227569Z 2023-08-31T22:00:07.1227575Z 2023-08-31T22:00:07.1230678Z 2023-08-31T22:00:07.1534826Z pthread-stubs-0.4 | 5 KB | ########## | 100%  2023-08-31T22:00:07.1535308Z 2023-08-31T22:00:07.1535386Z 2023-08-31T22:00:07.1535459Z 2023-08-31T22:00:07.1535529Z 2023-08-31T22:00:07.1535603Z 2023-08-31T22:00:07.1535672Z 2023-08-31T22:00:07.1535743Z 2023-08-31T22:00:07.1535813Z 2023-08-31T22:00:07.1535886Z 2023-08-31T22:00:07.1535966Z 2023-08-31T22:00:07.1536041Z 2023-08-31T22:00:07.1536131Z 2023-08-31T22:00:07.1536204Z 2023-08-31T22:00:07.1536274Z 2023-08-31T22:00:07.1536344Z 2023-08-31T22:00:07.1536456Z 2023-08-31T22:00:07.1541802Z libdeflate-1.18 | 64 KB | ##5 | 25%  2023-08-31T22:00:07.1542123Z 2023-08-31T22:00:07.1542196Z 2023-08-31T22:00:07.1542267Z 2023-08-31T22:00:07.1542340Z 2023-08-31T22:00:07.1542410Z 2023-08-31T22:00:07.1542479Z 2023-08-31T22:00:07.1542549Z 2023-08-31T22:00:07.1542624Z 2023-08-31T22:00:07.1542706Z 2023-08-31T22:00:07.1545209Z 2023-08-31T22:00:07.1550810Z libtiff-4.5.1 | 407 KB | ########## | 100%  2023-08-31T22:00:07.1551094Z 2023-08-31T22:00:07.1551178Z 2023-08-31T22:00:07.1551247Z 2023-08-31T22:00:07.1551318Z 2023-08-31T22:00:07.1551391Z 2023-08-31T22:00:07.1551460Z 2023-08-31T22:00:07.1551529Z 2023-08-31T22:00:07.1551599Z 2023-08-31T22:00:07.1551670Z 2023-08-31T22:00:07.1553400Z 2023-08-31T22:00:07.1869918Z libtiff-4.5.1 | 407 KB | ########## | 100%  2023-08-31T22:00:07.1870260Z 2023-08-31T22:00:07.1870340Z 2023-08-31T22:00:07.1870412Z 2023-08-31T22:00:07.1870483Z 2023-08-31T22:00:07.1870554Z 2023-08-31T22:00:07.1870628Z 2023-08-31T22:00:07.1870715Z 2023-08-31T22:00:07.1870785Z 2023-08-31T22:00:07.1870855Z 2023-08-31T22:00:07.1870926Z 2023-08-31T22:00:07.1870996Z 2023-08-31T22:00:07.1871066Z 2023-08-31T22:00:07.1871135Z 2023-08-31T22:00:07.1874143Z 2023-08-31T22:00:07.1879683Z libwebp-base-1.3.1 | 391 KB | ########## | 100%  2023-08-31T22:00:07.1880015Z 2023-08-31T22:00:07.1880089Z 2023-08-31T22:00:07.1880164Z 2023-08-31T22:00:07.1880244Z 2023-08-31T22:00:07.1880315Z 2023-08-31T22:00:07.1880385Z 2023-08-31T22:00:07.1880456Z 2023-08-31T22:00:07.1880542Z 2023-08-31T22:00:07.1880611Z 2023-08-31T22:00:07.1880681Z 2023-08-31T22:00:07.1880753Z 2023-08-31T22:00:07.1880822Z 2023-08-31T22:00:07.1880892Z 2023-08-31T22:00:07.1882837Z 2023-08-31T22:00:07.2013388Z libwebp-base-1.3.1 | 391 KB | ########## | 100%  2023-08-31T22:00:07.2013728Z 2023-08-31T22:00:07.2013803Z 2023-08-31T22:00:07.2013874Z 2023-08-31T22:00:07.2013949Z 2023-08-31T22:00:07.2014020Z 2023-08-31T22:00:07.2014090Z 2023-08-31T22:00:07.2014159Z 2023-08-31T22:00:07.2014242Z 2023-08-31T22:00:07.2014314Z 2023-08-31T22:00:07.2144032Z pillow-10.0.0 | 44.2 MB | #5 | 15%  2023-08-31T22:00:07.2144374Z 2023-08-31T22:00:07.2144675Z 2023-08-31T22:00:07.2144750Z 2023-08-31T22:00:07.2144822Z 2023-08-31T22:00:07.2146982Z 2023-08-31T22:00:07.2152281Z libxcb-1.15 | 375 KB | ########## | 100%  2023-08-31T22:00:07.2152570Z 2023-08-31T22:00:07.2152642Z 2023-08-31T22:00:07.2152713Z 2023-08-31T22:00:07.2152788Z 2023-08-31T22:00:07.2154542Z 2023-08-31T22:00:07.2305672Z libxcb-1.15 | 375 KB | ########## | 100%  2023-08-31T22:00:07.2306002Z 2023-08-31T22:00:07.2306085Z 2023-08-31T22:00:07.2306156Z 2023-08-31T22:00:07.2306228Z 2023-08-31T22:00:07.2306297Z 2023-08-31T22:00:07.2306369Z 2023-08-31T22:00:07.2306440Z 2023-08-31T22:00:07.2306509Z 2023-08-31T22:00:07.2306580Z 2023-08-31T22:00:07.2306651Z 2023-08-31T22:00:07.2306733Z 2023-08-31T22:00:07.2306803Z 2023-08-31T22:00:07.2306872Z 2023-08-31T22:00:07.2306943Z 2023-08-31T22:00:07.2307053Z 2023-08-31T22:00:07.2327446Z xorg-libxau-1.0.11 | 14 KB | ########## | 100%  2023-08-31T22:00:07.2327785Z 2023-08-31T22:00:07.2327866Z 2023-08-31T22:00:07.2327937Z 2023-08-31T22:00:07.2328008Z 2023-08-31T22:00:07.2328077Z 2023-08-31T22:00:07.2328149Z 2023-08-31T22:00:07.2328219Z 2023-08-31T22:00:07.2328289Z 2023-08-31T22:00:07.2328358Z 2023-08-31T22:00:07.2328440Z 2023-08-31T22:00:07.2328513Z 2023-08-31T22:00:07.2328583Z 2023-08-31T22:00:07.2328652Z 2023-08-31T22:00:07.2328723Z 2023-08-31T22:00:07.2328804Z 2023-08-31T22:00:07.2330932Z 2023-08-31T22:00:07.3013656Z libdeflate-1.18 | 64 KB | ########## | 100%  2023-08-31T22:00:07.3014067Z 2023-08-31T22:00:07.3014143Z 2023-08-31T22:00:07.3014213Z 2023-08-31T22:00:07.3014283Z 2023-08-31T22:00:07.3014354Z 2023-08-31T22:00:07.3014423Z 2023-08-31T22:00:07.3014492Z 2023-08-31T22:00:07.3014561Z 2023-08-31T22:00:07.3014694Z 2023-08-31T22:00:07.4071898Z pillow-10.0.0 | 44.2 MB | ###1 | 32%  2023-08-31T22:00:07.4072176Z 2023-08-31T22:00:07.4072184Z 2023-08-31T22:00:07.4072191Z 2023-08-31T22:00:07.4072211Z 2023-08-31T22:00:07.4072218Z 2023-08-31T22:00:07.4072224Z 2023-08-31T22:00:07.4072230Z 2023-08-31T22:00:07.4072237Z 2023-08-31T22:00:07.4072243Z 2023-08-31T22:00:07.5159544Z pillow-10.0.0 | 44.2 MB | ####2 | 43%  2023-08-31T22:00:07.5159790Z 2023-08-31T22:00:07.5159798Z 2023-08-31T22:00:07.5159805Z 2023-08-31T22:00:07.5160044Z 2023-08-31T22:00:07.5160052Z 2023-08-31T22:00:07.5160059Z 2023-08-31T22:00:07.5160068Z 2023-08-31T22:00:07.5160074Z 2023-08-31T22:00:07.5161950Z 2023-08-31T22:00:07.6287872Z pillow-10.0.0 | 44.2 MB | #####3 | 54%  2023-08-31T22:00:07.6288313Z 2023-08-31T22:00:07.6290431Z 2023-08-31T22:00:07.6292503Z 2023-08-31T22:00:07.6294027Z 2023-08-31T22:00:07.6294173Z 2023-08-31T22:00:07.6294331Z 2023-08-31T22:00:07.6294473Z 2023-08-31T22:00:07.6294617Z 2023-08-31T22:00:07.6294841Z 2023-08-31T22:00:07.7069683Z pillow-10.0.0 | 44.2 MB | ######7 | 68%  2023-08-31T22:00:07.7070204Z 2023-08-31T22:00:07.7070784Z 2023-08-31T22:00:07.7070930Z 2023-08-31T22:00:07.7071074Z 2023-08-31T22:00:07.7071446Z 2023-08-31T22:00:07.7071649Z 2023-08-31T22:00:07.7073115Z 2023-08-31T22:00:07.7073287Z 2023-08-31T22:00:07.7073521Z 2023-08-31T22:00:07.7073717Z 2023-08-31T22:00:07.7073920Z 2023-08-31T22:00:07.7074132Z 2023-08-31T22:00:07.7074858Z torch-model-archiver | 22 KB | ########## | 100%  2023-08-31T22:00:07.7075269Z 2023-08-31T22:00:07.7075443Z 2023-08-31T22:00:07.7075578Z 2023-08-31T22:00:07.7075705Z 2023-08-31T22:00:07.7075920Z 2023-08-31T22:00:07.7076123Z 2023-08-31T22:00:07.7076311Z 2023-08-31T22:00:07.7076472Z 2023-08-31T22:00:07.7076658Z 2023-08-31T22:00:07.7076865Z 2023-08-31T22:00:07.7077082Z 2023-08-31T22:00:07.7077236Z 2023-08-31T22:00:07.7451379Z torch-model-archiver | 22 KB | ########## | 100%  2023-08-31T22:00:07.7452135Z 2023-08-31T22:00:07.7452639Z 2023-08-31T22:00:07.7452784Z 2023-08-31T22:00:07.7452952Z 2023-08-31T22:00:07.7453142Z 2023-08-31T22:00:07.7453301Z 2023-08-31T22:00:07.7453443Z 2023-08-31T22:00:07.7453627Z 2023-08-31T22:00:07.7453869Z 2023-08-31T22:00:08.3938718Z pillow-10.0.0 | 44.2 MB | #######8 | 79%  2023-08-31T22:00:08.3939268Z 2023-08-31T22:00:08.3940140Z 2023-08-31T22:00:08.3940288Z 2023-08-31T22:00:08.3940463Z 2023-08-31T22:00:08.3940605Z 2023-08-31T22:00:08.3940750Z 2023-08-31T22:00:08.3940934Z 2023-08-31T22:00:08.3941046Z 2023-08-31T22:00:08.3941232Z 2023-08-31T22:00:08.3941524Z 2023-08-31T22:00:08.3942234Z 2023-08-31T22:00:08.3942265Z 2023-08-31T22:00:08.3942308Z 2023-08-31T22:00:08.3943318Z torch-workflow-archi | 18 KB | ########## | 100%  2023-08-31T22:00:08.3943988Z 2023-08-31T22:00:08.3943996Z 2023-08-31T22:00:08.3944002Z 2023-08-31T22:00:08.3944032Z 2023-08-31T22:00:08.3944048Z 2023-08-31T22:00:08.3944054Z 2023-08-31T22:00:08.3944061Z 2023-08-31T22:00:08.3944067Z 2023-08-31T22:00:08.3944074Z 2023-08-31T22:00:08.3944079Z 2023-08-31T22:00:08.3944085Z 2023-08-31T22:00:08.3944092Z 2023-08-31T22:00:08.3946808Z 2023-08-31T22:00:08.4520867Z torch-workflow-archi | 18 KB | ########## | 100%  2023-08-31T22:00:08.4521160Z 2023-08-31T22:00:08.4521193Z 2023-08-31T22:00:08.4521201Z 2023-08-31T22:00:08.4521209Z 2023-08-31T22:00:08.4521216Z 2023-08-31T22:00:08.4521224Z 2023-08-31T22:00:08.4521230Z 2023-08-31T22:00:08.4521238Z 2023-08-31T22:00:08.4524711Z 2023-08-31T22:00:08.4530180Z pillow-10.0.0 | 44.2 MB | ########## | 100%  2023-08-31T22:00:08.4530564Z 2023-08-31T22:00:08.4530849Z 2023-08-31T22:00:08.4531000Z 2023-08-31T22:00:08.4531146Z 2023-08-31T22:00:08.4531290Z 2023-08-31T22:00:08.4531466Z 2023-08-31T22:00:08.4531635Z 2023-08-31T22:00:08.4531943Z 2023-08-31T22:00:08.4536823Z 2023-08-31T22:00:10.4431416Z pillow-10.0.0 | 44.2 MB | ########## | 100%  2023-08-31T22:00:10.4431785Z 2023-08-31T22:00:10.4431793Z 2023-08-31T22:00:10.4431800Z 2023-08-31T22:00:10.4431807Z 2023-08-31T22:00:10.4431813Z 2023-08-31T22:00:10.4431824Z 2023-08-31T22:00:10.4431830Z 2023-08-31T22:00:10.4432120Z torchserve-0.8.2.dev | 22.7 MB | ########## | 100%  2023-08-31T22:00:10.4432557Z 2023-08-31T22:00:10.4432566Z 2023-08-31T22:00:10.4432573Z 2023-08-31T22:00:10.4432579Z 2023-08-31T22:00:10.4432585Z 2023-08-31T22:00:10.4432591Z 2023-08-31T22:00:10.4432597Z 2023-08-31T22:00:10.4469947Z torchserve-0.8.2.dev | 22.7 MB | ########## | 100%  2023-08-31T22:00:10.4470502Z 2023-08-31T22:00:10.4470777Z 2023-08-31T22:00:10.4471077Z  2023-08-31T22:00:10.4471348Z 2023-08-31T22:00:10.4471444Z 2023-08-31T22:00:10.4471695Z  2023-08-31T22:00:10.4471919Z 2023-08-31T22:00:10.4471993Z 2023-08-31T22:00:10.4472064Z 2023-08-31T22:00:10.4472312Z  2023-08-31T22:00:10.4472527Z 2023-08-31T22:00:10.4472600Z 2023-08-31T22:00:10.4472670Z 2023-08-31T22:00:10.4472741Z 2023-08-31T22:00:10.4473024Z  2023-08-31T22:00:10.4473251Z 2023-08-31T22:00:10.4473322Z 2023-08-31T22:00:10.4473392Z 2023-08-31T22:00:10.4473462Z 2023-08-31T22:00:10.4473534Z 2023-08-31T22:00:10.4473788Z  2023-08-31T22:00:10.4474013Z 2023-08-31T22:00:10.4474084Z 2023-08-31T22:00:10.4474156Z 2023-08-31T22:00:10.4474226Z 2023-08-31T22:00:10.4474304Z 2023-08-31T22:00:10.4474375Z 2023-08-31T22:00:10.4474636Z  2023-08-31T22:00:10.4475118Z 2023-08-31T22:00:10.4475204Z 2023-08-31T22:00:10.4475276Z 2023-08-31T22:00:10.4475348Z 2023-08-31T22:00:10.4475418Z 2023-08-31T22:00:10.4475488Z 2023-08-31T22:00:10.4475568Z 2023-08-31T22:00:10.4475840Z  2023-08-31T22:00:10.4476070Z 2023-08-31T22:00:10.4476142Z 2023-08-31T22:00:10.4476212Z 2023-08-31T22:00:10.4476284Z 2023-08-31T22:00:10.4476360Z 2023-08-31T22:00:10.4476431Z 2023-08-31T22:00:10.4476501Z 2023-08-31T22:00:10.4476573Z 2023-08-31T22:00:10.4476845Z  2023-08-31T22:00:10.4477080Z 2023-08-31T22:00:10.4477152Z 2023-08-31T22:00:10.4477223Z 2023-08-31T22:00:10.4477294Z 2023-08-31T22:00:10.4477363Z 2023-08-31T22:00:10.4477433Z 2023-08-31T22:00:10.4477505Z 2023-08-31T22:00:10.4477575Z 2023-08-31T22:00:10.4477645Z 2023-08-31T22:00:10.4477971Z  2023-08-31T22:00:10.4478212Z 2023-08-31T22:00:10.4478285Z 2023-08-31T22:00:10.4478359Z 2023-08-31T22:00:10.4478429Z 2023-08-31T22:00:10.4478500Z 2023-08-31T22:00:10.4478580Z 2023-08-31T22:00:10.4478654Z 2023-08-31T22:00:10.4478724Z 2023-08-31T22:00:10.4478796Z 2023-08-31T22:00:10.4478866Z 2023-08-31T22:00:10.4479140Z  2023-08-31T22:00:10.4479374Z 2023-08-31T22:00:10.4479451Z 2023-08-31T22:00:10.4479522Z 2023-08-31T22:00:10.4479592Z 2023-08-31T22:00:10.4479662Z 2023-08-31T22:00:10.4479743Z 2023-08-31T22:00:10.4479812Z 2023-08-31T22:00:10.4479882Z 2023-08-31T22:00:10.4479954Z 2023-08-31T22:00:10.4480026Z 2023-08-31T22:00:10.4480105Z 2023-08-31T22:00:10.4480388Z  2023-08-31T22:00:10.4480623Z 2023-08-31T22:00:10.4480695Z 2023-08-31T22:00:10.4480766Z 2023-08-31T22:00:10.4480836Z 2023-08-31T22:00:10.4480913Z 2023-08-31T22:00:10.4480985Z 2023-08-31T22:00:10.4481055Z 2023-08-31T22:00:10.4481125Z 2023-08-31T22:00:10.4481194Z 2023-08-31T22:00:10.4481266Z 2023-08-31T22:00:10.4481346Z 2023-08-31T22:00:10.4481417Z 2023-08-31T22:00:10.4481687Z  2023-08-31T22:00:10.4481929Z 2023-08-31T22:00:10.4482000Z 2023-08-31T22:00:10.4482070Z 2023-08-31T22:00:10.4482141Z 2023-08-31T22:00:10.4482332Z 2023-08-31T22:00:10.4482421Z 2023-08-31T22:00:10.4482493Z 2023-08-31T22:00:10.4482564Z 2023-08-31T22:00:10.4482636Z 2023-08-31T22:00:10.4482707Z 2023-08-31T22:00:10.4482777Z 2023-08-31T22:00:10.4482848Z 2023-08-31T22:00:10.4482920Z 2023-08-31T22:00:10.4483210Z  2023-08-31T22:00:10.4483459Z 2023-08-31T22:00:10.4483530Z 2023-08-31T22:00:10.4483601Z 2023-08-31T22:00:10.4483671Z 2023-08-31T22:00:10.4483761Z 2023-08-31T22:00:10.4483838Z 2023-08-31T22:00:10.4483911Z 2023-08-31T22:00:10.4483982Z 2023-08-31T22:00:10.4484052Z 2023-08-31T22:00:10.4484121Z 2023-08-31T22:00:10.4484193Z 2023-08-31T22:00:10.4484263Z 2023-08-31T22:00:10.4484333Z 2023-08-31T22:00:10.4484404Z 2023-08-31T22:00:10.4484697Z  2023-08-31T22:00:10.4484934Z 2023-08-31T22:00:10.4485006Z 2023-08-31T22:00:10.4485076Z 2023-08-31T22:00:10.4485153Z 2023-08-31T22:00:10.4485224Z 2023-08-31T22:00:10.4485295Z 2023-08-31T22:00:10.4485364Z 2023-08-31T22:00:10.4485436Z 2023-08-31T22:00:10.4485506Z 2023-08-31T22:00:10.4485589Z 2023-08-31T22:00:10.4485659Z 2023-08-31T22:00:10.4485732Z 2023-08-31T22:00:10.4486202Z 2023-08-31T22:00:10.4486384Z 2023-08-31T22:00:10.4486458Z 2023-08-31T22:00:10.4486846Z  2023-08-31T22:00:10.4487095Z 2023-08-31T22:00:10.4487166Z 2023-08-31T22:00:10.4487399Z 2023-08-31T22:00:10.4487472Z 2023-08-31T22:00:10.4487543Z 2023-08-31T22:00:10.4487614Z 2023-08-31T22:00:10.4487684Z 2023-08-31T22:00:10.4487754Z 2023-08-31T22:00:10.4487825Z 2023-08-31T22:00:10.4487895Z 2023-08-31T22:00:10.4487966Z 2023-08-31T22:00:10.4488038Z 2023-08-31T22:00:10.4488108Z 2023-08-31T22:00:10.4488178Z 2023-08-31T22:00:10.4488249Z 2023-08-31T22:00:10.4488357Z 2023-08-31T22:00:10.4488673Z  2023-08-31T22:00:10.4773418Z Preparing transaction: ...working... done 2023-08-31T22:00:10.6002238Z Verifying transaction: ...working... done 2023-08-31T22:00:10.6933177Z Executing transaction: ...working... done 2023-08-31T22:00:41.1544577Z newman 2023-08-31T22:00:41.1545086Z 2023-08-31T22:00:41.1549629Z management_api_collection 2023-08-31T22:00:41.1555411Z 2023-08-31T22:00:41.1555589Z Iteration 1/82 2023-08-31T22:00:41.1639110Z 2023-08-31T22:00:41.1639841Z → management request 2023-08-31T22:00:41.4113853Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-08-31T22:00:41.4168121Z 200 OK ★ 196ms time ★ 299B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:41.4168729Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:00:41.4169018Z │ { 2023-08-31T22:00:41.4169356Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:00:41.4169772Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:00:41.4170112Z │ o add workers for the model." 2023-08-31T22:00:41.4170356Z │ } 2023-08-31T22:00:41.4198162Z └ 2023-08-31T22:00:41.4198863Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:41.4199563Z 30ms 5ms 10ms 319µs 172ms 6ms 405µs 226ms 2023-08-31T22:00:41.4202785Z 2023-08-31T22:00:41.4400572Z ✓ Successful request 2023-08-31T22:00:41.4466562Z 2023-08-31T22:00:41.4467084Z Iteration 2/82 2023-08-31T22:00:41.4480913Z 2023-08-31T22:00:41.4481558Z → management request 2023-08-31T22:00:41.5272593Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist 2023-08-31T22:00:41.5273689Z 200 OK ★ 73ms time ★ 283B↑ 401B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:41.5274338Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 134B 2023-08-31T22:00:41.5275099Z │ { 2023-08-31T22:00:41.5275921Z │ "status": "Model \"mnist\" Version: 1.0 registered w 2023-08-31T22:00:41.5276590Z │ ith 0 initial workers. Use scale workers API to add wo 2023-08-31T22:00:41.5277501Z │ rkers for the model." 2023-08-31T22:00:41.5277811Z │ } 2023-08-31T22:00:41.5294941Z └ 2023-08-31T22:00:41.5295621Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:41.5296314Z 1ms 1ms (cache) (cache) 68ms 2ms 85µs 74ms 2023-08-31T22:00:41.5296733Z 2023-08-31T22:00:41.5356148Z ✓ Successful request 2023-08-31T22:00:41.5399251Z 2023-08-31T22:00:41.5399728Z Iteration 3/82 2023-08-31T22:00:41.5413286Z 2023-08-31T22:00:41.5413907Z → management request 2023-08-31T22:00:42.2839334Z POST http://localhost:8081/models?url=densenet161.mar&model_name=densenet161 2023-08-31T22:00:42.2840459Z 200 OK ★ 736ms time ★ 295B↑ 407B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:42.2841102Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 140B 2023-08-31T22:00:42.2841657Z │ { 2023-08-31T22:00:42.2842206Z │ "status": "Model \"densenet161\" Version: 1.0 regist 2023-08-31T22:00:42.2842805Z │ ered with 0 initial workers. Use scale workers API to 2023-08-31T22:00:42.2843710Z │ add workers for the model." 2023-08-31T22:00:42.2844006Z │ } 2023-08-31T22:00:42.2858262Z └ 2023-08-31T22:00:42.2858837Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:42.2859496Z 1ms 256µs (cache) (cache) 733ms 1ms 61µs 737ms 2023-08-31T22:00:42.2860172Z 2023-08-31T22:00:42.2914165Z ✓ Successful request 2023-08-31T22:00:42.2951936Z 2023-08-31T22:00:42.2952216Z Iteration 4/82 2023-08-31T22:00:42.2965249Z 2023-08-31T22:00:42.2965567Z → management request 2023-08-31T22:00:42.3096473Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/densenet161.mar&model_name=densenet161 2023-08-31T22:00:42.3097633Z 500 Internal Server Error ★ 7ms time ★ 336B↑ 394B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:42.3098530Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 113B 2023-08-31T22:00:42.3098857Z │ { 2023-08-31T22:00:42.3099102Z │ "code": 500, 2023-08-31T22:00:42.3099407Z │ "type": "InternalServerException", 2023-08-31T22:00:42.3099801Z │ "message": "Model file already exists densenet161.ma 2023-08-31T22:00:42.3100081Z │ r" 2023-08-31T22:00:42.3100275Z │ } 2023-08-31T22:00:42.3116652Z └ 2023-08-31T22:00:42.3117132Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:42.3119018Z 1ms 226µs (cache) (cache) 4ms 1ms 57µs 7ms 2023-08-31T22:00:42.3119450Z 2023-08-31T22:00:42.3177928Z ✓ Successful request 2023-08-31T22:00:42.3213724Z 2023-08-31T22:00:42.3214015Z Iteration 5/82 2023-08-31T22:00:42.3228069Z 2023-08-31T22:00:42.3228414Z → management request 2023-08-31T22:00:42.3581304Z DELETE http://localhost:8081/models/densenet161 2023-08-31T22:00:42.3582253Z 200 OK ★ 29ms time ★ 247B↑ 319B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:42.3583214Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 53B 2023-08-31T22:00:42.3583527Z │ { 2023-08-31T22:00:42.3583859Z │ "status": "Model \"densenet161\" unregistered" 2023-08-31T22:00:42.3584140Z │ } 2023-08-31T22:00:42.3601418Z └ 2023-08-31T22:00:42.3602031Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:42.3602854Z 1ms 877µs 292µs 132µs 25ms 1ms 54µs 30ms 2023-08-31T22:00:42.3603111Z 2023-08-31T22:00:42.3653743Z ✓ Successful request 2023-08-31T22:00:42.3689164Z 2023-08-31T22:00:42.3689412Z Iteration 6/82 2023-08-31T22:00:42.3702560Z 2023-08-31T22:00:42.3702908Z → management request 2023-08-31T22:00:42.3819784Z POST http://localhost:8081/models 2023-08-31T22:00:42.3821918Z 400 Bad Request ★ 4ms time ★ 252B↑ 364B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:42.3824022Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 94B 2023-08-31T22:00:42.3825772Z │ { 2023-08-31T22:00:42.3826033Z │ "code": 400, 2023-08-31T22:00:42.3826325Z │ "type": "BadRequestException", 2023-08-31T22:00:42.3826679Z │ "message": "Parameter url is required." 2023-08-31T22:00:42.3826948Z │ } 2023-08-31T22:00:42.3841897Z └ 2023-08-31T22:00:42.3842582Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:42.3843261Z 3ms 221µs (cache) (cache) 1ms 1ms 47µs 6ms 2023-08-31T22:00:42.3843927Z 2023-08-31T22:00:42.3892784Z ✓ Successful request 2023-08-31T22:00:42.3927517Z 2023-08-31T22:00:42.3927851Z Iteration 7/82 2023-08-31T22:00:42.3940652Z 2023-08-31T22:00:42.3941137Z → management request 2023-08-31T22:00:42.4117839Z DELETE http://localhost:8081/models/mnist 2023-08-31T22:00:42.4121278Z 200 OK ★ 12ms time ★ 241B↑ 313B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:42.4124812Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:00:42.4128055Z │ { 2023-08-31T22:00:42.4128596Z │ "status": "Model \"mnist\" unregistered" 2023-08-31T22:00:42.4129248Z │ } 2023-08-31T22:00:42.4145762Z └ 2023-08-31T22:00:42.4146482Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:42.4147152Z 1ms 605µs 168µs 126µs 9ms 1ms 48µs 12ms 2023-08-31T22:00:42.4170507Z 2023-08-31T22:00:42.4221445Z ✓ Successful request 2023-08-31T22:00:42.4268457Z 2023-08-31T22:00:42.4268801Z Iteration 8/82 2023-08-31T22:00:42.4284913Z 2023-08-31T22:00:42.4285152Z → management request 2023-08-31T22:00:42.4682359Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&handler=invalidHandler 2023-08-31T22:00:42.4683007Z 200 OK ★ 34ms time ★ 306B↑ 401B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:42.4683449Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 134B 2023-08-31T22:00:42.4683741Z │ { 2023-08-31T22:00:42.4684071Z │ "status": "Model \"mnist\" Version: 1.0 registered w 2023-08-31T22:00:42.4684461Z │ ith 0 initial workers. Use scale workers API to add wo 2023-08-31T22:00:42.4684776Z │ rkers for the model." 2023-08-31T22:00:42.4685010Z │ } 2023-08-31T22:00:42.4695076Z └ 2023-08-31T22:00:42.4695510Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:42.4696002Z 1ms 303µs (cache) (cache) 31ms 1ms 44µs 35ms 2023-08-31T22:00:42.4696229Z 2023-08-31T22:00:42.4745198Z ✓ Successful request 2023-08-31T22:00:42.4796382Z 2023-08-31T22:00:42.4796728Z Iteration 9/82 2023-08-31T22:00:42.4802032Z 2023-08-31T22:00:42.4802501Z → management request 2023-08-31T22:00:42.4929699Z DELETE http://localhost:8081/models/mnist 2023-08-31T22:00:42.4932037Z 200 OK ★ 5ms time ★ 241B↑ 313B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:42.4934310Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:00:42.4937335Z │ { 2023-08-31T22:00:42.4937854Z │ "status": "Model \"mnist\" unregistered" 2023-08-31T22:00:42.4938504Z │ } 2023-08-31T22:00:42.4954055Z └ 2023-08-31T22:00:42.4954721Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:42.4955606Z 2ms 337µs (cache) (cache) 3ms 1ms 113µs 7ms 2023-08-31T22:00:42.4955965Z 2023-08-31T22:00:42.4997412Z ✓ Successful request 2023-08-31T22:00:42.5072850Z 2023-08-31T22:00:42.5073165Z Iteration 10/82 2023-08-31T22:00:42.5085629Z 2023-08-31T22:00:42.5086009Z → management request 2023-08-31T22:00:42.5457246Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&handler=invalidHandler 2023-08-31T22:00:42.5458190Z 200 OK ★ 33ms time ★ 306B↑ 401B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:42.5459273Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 134B 2023-08-31T22:00:42.5459776Z │ { 2023-08-31T22:00:42.5460480Z │ "status": "Model \"mnist\" Version: 1.0 registered w 2023-08-31T22:00:42.5461038Z │ ith 0 initial workers. Use scale workers API to add wo 2023-08-31T22:00:42.5461716Z │ rkers for the model." 2023-08-31T22:00:42.5462107Z │ } 2023-08-31T22:00:42.5471228Z └ 2023-08-31T22:00:42.5471823Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:42.5472723Z 1ms 347µs (cache) (cache) 30ms 1ms 46µs 33ms 2023-08-31T22:00:42.5473282Z 2023-08-31T22:00:42.5523690Z ✓ Successful request 2023-08-31T22:00:42.5548811Z 2023-08-31T22:00:42.5549055Z Iteration 11/82 2023-08-31T22:00:42.5561840Z 2023-08-31T22:00:42.5562160Z → management request 2023-08-31T22:00:44.9403312Z PUT http://localhost:8081/models/mnist?min_worker=1&synchronous=true 2023-08-31T22:00:44.9404436Z 500 Internal Server Error ★ 2.3s time ★ 287B↑ 406B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:44.9404917Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 125B 2023-08-31T22:00:44.9405396Z │ { 2023-08-31T22:00:44.9405639Z │ "code": 500, 2023-08-31T22:00:44.9405949Z │ "type": "InternalServerException", 2023-08-31T22:00:44.9406555Z │ "message": "Failed to start workers for model mnist 2023-08-31T22:00:44.9406937Z │ version: null" 2023-08-31T22:00:44.9407238Z │ } 2023-08-31T22:00:44.9424773Z └ 2023-08-31T22:00:44.9425245Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:44.9425800Z 1ms 216µs (cache) (cache) 2.3s 1ms 143µs 2.3s 2023-08-31T22:00:44.9426002Z 2023-08-31T22:00:44.9516423Z ✓ Successful request 2023-08-31T22:00:44.9613940Z 2023-08-31T22:00:44.9614354Z Iteration 12/82 2023-08-31T22:00:44.9627739Z 2023-08-31T22:00:44.9628182Z → management request 2023-08-31T22:00:44.9767377Z DELETE http://localhost:8081/models/mnist 2023-08-31T22:00:44.9768406Z 200 OK ★ 8ms time ★ 241B↑ 313B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:44.9768869Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:00:44.9769155Z │ { 2023-08-31T22:00:44.9769465Z │ "status": "Model \"mnist\" unregistered" 2023-08-31T22:00:44.9769720Z │ } 2023-08-31T22:00:44.9775567Z └ 2023-08-31T22:00:44.9776296Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:44.9776810Z 1ms 699µs 187µs 125µs 4ms 1ms 65µs 8ms 2023-08-31T22:00:44.9777041Z 2023-08-31T22:00:44.9867456Z ✓ Successful request 2023-08-31T22:00:44.9899704Z 2023-08-31T22:00:44.9900017Z Iteration 13/82 2023-08-31T22:00:44.9914767Z 2023-08-31T22:00:44.9915116Z → management request 2023-08-31T22:00:45.0034588Z GET http://localhost:8081/models/squeezenet1_1/all 2023-08-31T22:00:45.0037991Z 200 OK ★ 6ms time ★ 250B↑ 628B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.0041184Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 361B 2023-08-31T22:00:45.0044165Z │ [ 2023-08-31T22:00:45.0044638Z │ { 2023-08-31T22:00:45.0045366Z │ "modelName": "squeezenet1_1", 2023-08-31T22:00:45.0045708Z │ "modelVersion": "1.0", 2023-08-31T22:00:45.0046029Z │ "modelUrl": "squeezenet1_1.mar", 2023-08-31T22:00:45.0046696Z │ "runtime": "python", 2023-08-31T22:00:45.0046978Z │ "minWorkers": 0, 2023-08-31T22:00:45.0047247Z │ "maxWorkers": 0, 2023-08-31T22:00:45.0047504Z │ "batchSize": 1, 2023-08-31T22:00:45.0047811Z │ "maxBatchDelay": 100, 2023-08-31T22:00:45.0048109Z │ "loadedAtStartup": false, 2023-08-31T22:00:45.0048383Z │ "workers": [], 2023-08-31T22:00:45.0048637Z │ "jobQueueStatus": { 2023-08-31T22:00:45.0048938Z │ "remainingCapacity": 100, 2023-08-31T22:00:45.0049233Z │ "pendingRequests": 0 2023-08-31T22:00:45.0049470Z │ } 2023-08-31T22:00:45.0049679Z │ } 2023-08-31T22:00:45.0049883Z │ ] 2023-08-31T22:00:45.0077172Z └ 2023-08-31T22:00:45.0077681Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.0078523Z 1ms 426µs (cache) (cache) 4ms 1ms 66µs 7ms 2023-08-31T22:00:45.0078720Z 2023-08-31T22:00:45.0127059Z ✓ Successful request 2023-08-31T22:00:45.0163007Z 2023-08-31T22:00:45.0163381Z Iteration 14/82 2023-08-31T22:00:45.0180760Z 2023-08-31T22:00:45.0181236Z → management request 2023-08-31T22:00:45.0271948Z GET http://localhost:8081/models/squeezenet1_1/1.0 2023-08-31T22:00:45.0275654Z 200 OK ★ 4ms time ★ 250B↑ 628B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.0278815Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 361B 2023-08-31T22:00:45.0281802Z │ [ 2023-08-31T22:00:45.0282303Z │ { 2023-08-31T22:00:45.0282935Z │ "modelName": "squeezenet1_1", 2023-08-31T22:00:45.0283304Z │ "modelVersion": "1.0", 2023-08-31T22:00:45.0283647Z │ "modelUrl": "squeezenet1_1.mar", 2023-08-31T22:00:45.0283955Z │ "runtime": "python", 2023-08-31T22:00:45.0284230Z │ "minWorkers": 0, 2023-08-31T22:00:45.0284477Z │ "maxWorkers": 0, 2023-08-31T22:00:45.0284732Z │ "batchSize": 1, 2023-08-31T22:00:45.0285005Z │ "maxBatchDelay": 100, 2023-08-31T22:00:45.0285291Z │ "loadedAtStartup": false, 2023-08-31T22:00:45.0285571Z │ "workers": [], 2023-08-31T22:00:45.0285835Z │ "jobQueueStatus": { 2023-08-31T22:00:45.0286125Z │ "remainingCapacity": 100, 2023-08-31T22:00:45.0286593Z │ "pendingRequests": 0 2023-08-31T22:00:45.0286842Z │ } 2023-08-31T22:00:45.0287054Z │ } 2023-08-31T22:00:45.0287247Z │ ] 2023-08-31T22:00:45.0327164Z └ 2023-08-31T22:00:45.0327647Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.0328159Z 1ms 364µs (cache) (cache) 1ms 1ms 90µs 4ms 2023-08-31T22:00:45.0328356Z 2023-08-31T22:00:45.0466247Z ✓ Successful request 2023-08-31T22:00:45.0511146Z 2023-08-31T22:00:45.0511359Z Iteration 15/82 2023-08-31T22:00:45.0529175Z 2023-08-31T22:00:45.0529440Z → management request 2023-08-31T22:00:45.0626403Z GET http://localhost:8081/models/squeezenet1_1 2023-08-31T22:00:45.0626968Z 200 OK ★ 4ms time ★ 246B↑ 628B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.0627381Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 361B 2023-08-31T22:00:45.0627664Z │ [ 2023-08-31T22:00:45.0627876Z │ { 2023-08-31T22:00:45.0628134Z │ "modelName": "squeezenet1_1", 2023-08-31T22:00:45.0628470Z │ "modelVersion": "1.0", 2023-08-31T22:00:45.0628779Z │ "modelUrl": "squeezenet1_1.mar", 2023-08-31T22:00:45.0629084Z │ "runtime": "python", 2023-08-31T22:00:45.0629348Z │ "minWorkers": 0, 2023-08-31T22:00:45.0629608Z │ "maxWorkers": 0, 2023-08-31T22:00:45.0629866Z │ "batchSize": 1, 2023-08-31T22:00:45.0630134Z │ "maxBatchDelay": 100, 2023-08-31T22:00:45.0630449Z │ "loadedAtStartup": false, 2023-08-31T22:00:45.0630724Z │ "workers": [], 2023-08-31T22:00:45.0630984Z │ "jobQueueStatus": { 2023-08-31T22:00:45.0631282Z │ "remainingCapacity": 100, 2023-08-31T22:00:45.0631580Z │ "pendingRequests": 0 2023-08-31T22:00:45.0631814Z │ } 2023-08-31T22:00:45.0632026Z │ } 2023-08-31T22:00:45.0632228Z │ ] 2023-08-31T22:00:45.0652837Z └ 2023-08-31T22:00:45.0653292Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.0653825Z 1ms 330µs (cache) (cache) 1ms 1ms 49µs 4ms 2023-08-31T22:00:45.0654024Z 2023-08-31T22:00:45.0692111Z ✓ Successful request 2023-08-31T22:00:45.0757293Z 2023-08-31T22:00:45.0757764Z Iteration 16/82 2023-08-31T22:00:45.0770064Z 2023-08-31T22:00:45.0770554Z → management request 2023-08-31T22:00:45.0872137Z DELETE http://localhost:8081/models/squeezenet1_1 2023-08-31T22:00:45.0875736Z 200 OK ★ 5ms time ★ 249B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.0878832Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:00:45.0881782Z │ { 2023-08-31T22:00:45.0882354Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:00:45.0883042Z │ } 2023-08-31T22:00:45.0896869Z └ 2023-08-31T22:00:45.0897598Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.0898286Z 1ms 305µs (cache) (cache) 2ms 1ms 49µs 5ms 2023-08-31T22:00:45.0898821Z 2023-08-31T22:00:45.0953657Z ✓ Successful request 2023-08-31T22:00:45.0986646Z 2023-08-31T22:00:45.0986992Z Iteration 17/82 2023-08-31T22:00:45.1000930Z 2023-08-31T22:00:45.1001233Z → management request 2023-08-31T22:00:45.1093483Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&runtime=python4 2023-08-31T22:00:45.1094340Z 400 Bad Request ★ 4ms time ★ 315B↑ 373B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.1094897Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 102B 2023-08-31T22:00:45.1095194Z │ { 2023-08-31T22:00:45.1095512Z │ "code": 400, 2023-08-31T22:00:45.1095881Z │ "type": "BadRequestException", 2023-08-31T22:00:45.1096320Z │ "message": "Invalid RuntimeType value: python4" 2023-08-31T22:00:45.1096665Z │ } 2023-08-31T22:00:45.1108012Z └ 2023-08-31T22:00:45.1108440Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.1109026Z 1ms 216µs (cache) (cache) 1ms 1ms 35µs 4ms 2023-08-31T22:00:45.1109320Z 2023-08-31T22:00:45.1152996Z ✓ Successful request 2023-08-31T22:00:45.1184364Z 2023-08-31T22:00:45.1184470Z Iteration 18/82 2023-08-31T22:00:45.1197484Z 2023-08-31T22:00:45.1314991Z → management request 2023-08-31T22:00:45.1315352Z GET http://localhost:8081/models?limit=&next_page_token= 2023-08-31T22:00:45.1316147Z 200 OK ★ 5ms time ★ 256B↑ 285B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.1317015Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 19B 2023-08-31T22:00:45.1317356Z │ { 2023-08-31T22:00:45.1317596Z │ "models": [] 2023-08-31T22:00:45.1317829Z │ } 2023-08-31T22:00:45.1318007Z └ 2023-08-31T22:00:45.1318424Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.1318915Z 1ms 584µs 163µs 120µs 2ms 1ms 40µs 5ms 2023-08-31T22:00:45.1319105Z 2023-08-31T22:00:45.1405891Z ✓ Successful request 2023-08-31T22:00:45.1437636Z 2023-08-31T22:00:45.1437871Z Iteration 19/82 2023-08-31T22:00:45.1451915Z 2023-08-31T22:00:45.1452259Z → management request 2023-08-31T22:00:45.1880002Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-08-31T22:00:45.1907948Z 200 OK ★ 35ms time ★ 299B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.1908724Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:00:45.1909424Z │ { 2023-08-31T22:00:45.1909832Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:00:45.1910237Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:00:45.1910593Z │ o add workers for the model." 2023-08-31T22:00:45.1910830Z │ } 2023-08-31T22:00:45.1911026Z └ 2023-08-31T22:00:45.1911438Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.1911940Z 1ms 247µs (cache) (cache) 32ms 1ms 37µs 35ms 2023-08-31T22:00:45.1912174Z 2023-08-31T22:00:45.1951157Z ✓ Successful request 2023-08-31T22:00:45.1983363Z 2023-08-31T22:00:45.1983545Z Iteration 20/82 2023-08-31T22:00:45.1997418Z 2023-08-31T22:00:45.1997705Z → management request 2023-08-31T22:00:45.2192941Z PUT http://localhost:8081/models/squeezenet1_1?min_worker=1 2023-08-31T22:00:45.2194129Z 202 Accepted ★ 14ms time ★ 278B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.2194777Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:00:45.2195746Z │ { 2023-08-31T22:00:45.2196524Z │ "status": "Processing worker updates..." 2023-08-31T22:00:45.2196849Z │ } 2023-08-31T22:00:45.2209621Z └ 2023-08-31T22:00:45.2210372Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.2211225Z 1ms 196µs (cache) (cache) 11ms 2ms 38µs 15ms 2023-08-31T22:00:45.2211764Z 2023-08-31T22:00:45.2255459Z ✓ Successful request 2023-08-31T22:00:45.2297993Z 2023-08-31T22:00:45.2298540Z Iteration 21/82 2023-08-31T22:00:45.2310604Z 2023-08-31T22:00:45.2311224Z → management request 2023-08-31T22:00:45.2417292Z PUT http://localhost:8081/models/squeezenet1_1?min_worker=1&synchronous=true 2023-08-31T22:00:45.2418166Z 200 OK ★ 6ms time ★ 295B↑ 329B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.2418912Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 63B 2023-08-31T22:00:45.2419588Z │ { 2023-08-31T22:00:45.2420012Z │ "status": "Workers scaled to 1 for model: squeezenet 2023-08-31T22:00:45.2420308Z │ 1_1" 2023-08-31T22:00:45.2420503Z │ } 2023-08-31T22:00:45.2431986Z └ 2023-08-31T22:00:45.2432655Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.2433404Z 1ms 189µs (cache) (cache) 3ms 1ms 34µs 6ms 2023-08-31T22:00:45.2433773Z 2023-08-31T22:00:45.2520749Z ✓ Successful request 2023-08-31T22:00:45.2558594Z 2023-08-31T22:00:45.2558991Z Iteration 22/82 2023-08-31T22:00:45.2571437Z 2023-08-31T22:00:45.2572048Z → management request 2023-08-31T22:00:45.2670357Z PUT http://localhost:8081/models/squeezenet1_1/1.0?min_worker=1&synchronous=true 2023-08-31T22:00:45.2671281Z 200 OK ★ 5ms time ★ 299B↑ 343B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.2672025Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 77B 2023-08-31T22:00:45.2672683Z │ { 2023-08-31T22:00:45.2673097Z │ "status": "Workers scaled to 1 for model: squeezenet 2023-08-31T22:00:45.2673408Z │ 1_1, version: 1.0" 2023-08-31T22:00:45.2673641Z │ } 2023-08-31T22:00:45.2685278Z └ 2023-08-31T22:00:45.2685933Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.2686816Z 1ms 188µs (cache) (cache) 2ms 1ms 34µs 5ms 2023-08-31T22:00:45.2687223Z 2023-08-31T22:00:45.2729476Z ✓ Successful request 2023-08-31T22:00:45.2784142Z 2023-08-31T22:00:45.2784656Z Iteration 23/82 2023-08-31T22:00:45.2796997Z 2023-08-31T22:00:45.2797631Z → management request 2023-08-31T22:00:45.2927237Z PUT http://localhost:8081/models/squeezenet1_1/0.0?min_worker=1&synchronous=true 2023-08-31T22:00:45.2928106Z 404 Not Found ★ 4ms time ★ 299B↑ 405B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.2928923Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 136B 2023-08-31T22:00:45.2929309Z │ { 2023-08-31T22:00:45.2929627Z │ "code": 404, 2023-08-31T22:00:45.2930031Z │ "type": "ModelVersionNotFoundException", 2023-08-31T22:00:45.2930506Z │ "message": "Model version: 0.0 does not exist for mo 2023-08-31T22:00:45.2930895Z │ del: squeezenet1_1" 2023-08-31T22:00:45.2931192Z │ } 2023-08-31T22:00:45.2931463Z └ 2023-08-31T22:00:45.2931947Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.2932517Z 1ms 187µs (cache) (cache) 2ms 1ms 40µs 5ms 2023-08-31T22:00:45.2932816Z 2023-08-31T22:00:45.2980234Z ✓ Successful request 2023-08-31T22:00:45.3068625Z 2023-08-31T22:00:45.3068882Z Iteration 24/82 2023-08-31T22:00:45.3082929Z 2023-08-31T22:00:45.3083285Z → management request 2023-08-31T22:00:45.3236443Z PUT http://localhost:8081/models/squeezenet1_1?min_worker=1&number_gpu=1 2023-08-31T22:00:45.3238490Z 202 Accepted ★ 10ms time ★ 291B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.3240237Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:00:45.3241894Z │ { 2023-08-31T22:00:45.3242301Z │ "status": "Processing worker updates..." 2023-08-31T22:00:45.3242638Z │ } 2023-08-31T22:00:45.3256033Z └ 2023-08-31T22:00:45.3256609Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.3257192Z 1ms 462µs 256µs 520µs 7ms 1ms 36µs 10ms 2023-08-31T22:00:45.3257767Z 2023-08-31T22:00:45.3314562Z ✓ Successful request 2023-08-31T22:00:45.3344068Z 2023-08-31T22:00:45.3344327Z Iteration 25/82 2023-08-31T22:00:45.3356507Z 2023-08-31T22:00:45.3356850Z → management request 2023-08-31T22:00:45.3441307Z PUT http://localhost:8081/models/squeezenet1_1/1.0/set-default 2023-08-31T22:00:45.3443313Z 200 OK ★ 3ms time ★ 281B↑ 359B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.3445026Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 93B 2023-08-31T22:00:45.3446891Z │ { 2023-08-31T22:00:45.3447334Z │ "status": "Default vesion succsesfully updated for m 2023-08-31T22:00:45.3447757Z │ odel \"squeezenet1_1\" to \"1.0\"" 2023-08-31T22:00:45.3448085Z │ } 2023-08-31T22:00:45.3460430Z └ 2023-08-31T22:00:45.3460988Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.3461561Z 1ms 194µs (cache) (cache) 1ms 1ms 37µs 4ms 2023-08-31T22:00:45.3461861Z 2023-08-31T22:00:45.3503896Z ✓ Successful request 2023-08-31T22:00:45.3546032Z 2023-08-31T22:00:45.3546283Z Iteration 26/82 2023-08-31T22:00:45.3549474Z 2023-08-31T22:00:45.3549817Z → management request 2023-08-31T22:00:45.3622170Z PUT http://localhost:8081/models/squeezenet1_1/0.0/set-default 2023-08-31T22:00:45.3624155Z 404 Not Found ★ 3ms time ★ 281B↑ 403B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.3625923Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 134B 2023-08-31T22:00:45.3627489Z │ { 2023-08-31T22:00:45.3627814Z │ "code": 404, 2023-08-31T22:00:45.3628226Z │ "type": "ModelVersionNotFoundException", 2023-08-31T22:00:45.3628699Z │ "message": "Model version 0.0 does not exist for mod 2023-08-31T22:00:45.3629086Z │ el squeezenet1_1" 2023-08-31T22:00:45.3629385Z │ } 2023-08-31T22:00:45.3641558Z └ 2023-08-31T22:00:45.3642118Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.3642716Z 1ms 181µs (cache) (cache) 1ms 1ms 44µs 3ms 2023-08-31T22:00:45.3642991Z 2023-08-31T22:00:45.3685860Z ✓ Successful request 2023-08-31T22:00:45.3716891Z 2023-08-31T22:00:45.3717134Z Iteration 27/82 2023-08-31T22:00:45.3731149Z 2023-08-31T22:00:45.3731498Z → management request 2023-08-31T22:00:45.3887776Z PUT http://localhost:8081/models/squeezenet0_1/1.0/set-default 2023-08-31T22:00:45.3890114Z 404 Not Found ★ 11ms time ★ 281B↑ 370B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.3891954Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 101B 2023-08-31T22:00:45.3893487Z │ { 2023-08-31T22:00:45.3893819Z │ "code": 404, 2023-08-31T22:00:45.3894199Z │ "type": "ModelNotFoundException", 2023-08-31T22:00:45.3894649Z │ "message": "Model not found: squeezenet0_1" 2023-08-31T22:00:45.3894998Z │ } 2023-08-31T22:00:45.3907435Z └ 2023-08-31T22:00:45.3908011Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.3908861Z 1ms 546µs 166µs 810µs 7ms 1ms 47µs 11ms 2023-08-31T22:00:45.3909120Z 2023-08-31T22:00:45.3960611Z ✓ Successful request 2023-08-31T22:00:45.3991203Z 2023-08-31T22:00:45.3991432Z Iteration 28/82 2023-08-31T22:00:45.4005863Z 2023-08-31T22:00:45.4006223Z → management request 2023-08-31T22:00:45.4208679Z DELETE http://localhost:8081/models/squeezenet1_1 2023-08-31T22:00:45.4209419Z 200 OK ★ 15ms time ★ 249B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.4209920Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:00:45.4210290Z │ { 2023-08-31T22:00:45.4210693Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:00:45.4211054Z │ } 2023-08-31T22:00:45.4211305Z └ 2023-08-31T22:00:45.4211786Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.4212629Z 1ms 676µs 168µs 122µs 12ms 1ms 32µs 15ms 2023-08-31T22:00:45.4212931Z 2023-08-31T22:00:45.4249725Z ✓ Successful request 2023-08-31T22:00:45.4291508Z 2023-08-31T22:00:45.4291752Z Iteration 29/82 2023-08-31T22:00:45.4304131Z 2023-08-31T22:00:45.4304436Z → management request 2023-08-31T22:00:45.4761645Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&handler=serve/ts/torch_handler/image_classifier.py:handle 2023-08-31T22:00:45.4762793Z 200 OK ★ 39ms time ★ 357B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.4763322Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:00:45.4763672Z │ { 2023-08-31T22:00:45.4764084Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:00:45.4764565Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:00:45.4764973Z │ o add workers for the model." 2023-08-31T22:00:45.4765299Z │ } 2023-08-31T22:00:45.4765569Z └ 2023-08-31T22:00:45.4766047Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.4766851Z 1ms 200µs (cache) (cache) 36ms 1ms 38µs 39ms 2023-08-31T22:00:45.4767117Z 2023-08-31T22:00:45.4850526Z ✓ Successful request 2023-08-31T22:00:45.4881981Z 2023-08-31T22:00:45.4882279Z Iteration 30/82 2023-08-31T22:00:45.4896637Z 2023-08-31T22:00:45.4897032Z → management request 2023-08-31T22:00:45.5033308Z DELETE http://localhost:8081/models/squeezenet1_1 2023-08-31T22:00:45.5035315Z 200 OK ★ 8ms time ★ 249B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:45.5037039Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:00:45.5038639Z │ { 2023-08-31T22:00:45.5039049Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:00:45.5039405Z │ } 2023-08-31T22:00:45.5052261Z └ 2023-08-31T22:00:45.5052839Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:45.5053450Z 1ms 189µs (cache) (cache) 6ms 1ms 30µs 9ms 2023-08-31T22:00:45.5053730Z 2023-08-31T22:00:45.5095526Z ✓ Successful request 2023-08-31T22:00:45.5124564Z 2023-08-31T22:00:45.5124809Z Iteration 31/82 2023-08-31T22:00:45.5138666Z 2023-08-31T22:00:45.5139013Z → management request 2023-08-31T22:00:47.4752027Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&batch_size=3&initial_workers=3&response_timeout=0 2023-08-31T22:00:47.4755844Z 500 Internal Server Error ★ 1956ms time ★ 349B↑ 413B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:47.4758968Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 132B 2023-08-31T22:00:47.4761957Z │ { 2023-08-31T22:00:47.4762411Z │ "code": 500, 2023-08-31T22:00:47.4764037Z │ "type": "InternalServerException", 2023-08-31T22:00:47.4764599Z │ "message": "Failed to start workers for model squeez 2023-08-31T22:00:47.4765041Z │ enet1_1 version: 1.0" 2023-08-31T22:00:47.4765745Z │ } 2023-08-31T22:00:47.4796020Z └ 2023-08-31T22:00:47.4796852Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:47.4797909Z 1ms 179µs (cache) (cache) 1953ms 1ms 40µs 1956ms 2023-08-31T22:00:47.4798224Z 2023-08-31T22:00:47.4820244Z ✓ Successful request 2023-08-31T22:00:47.4849960Z 2023-08-31T22:00:47.4850596Z Iteration 32/82 2023-08-31T22:00:47.4862712Z 2023-08-31T22:00:47.4863214Z → management request 2023-08-31T22:00:47.5269916Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&response_timeout=0 2023-08-31T22:00:47.5270625Z 200 OK ★ 34ms time ★ 318B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:47.5271054Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:00:47.5271327Z │ { 2023-08-31T22:00:47.5271656Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:00:47.5272053Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:00:47.5272429Z │ o add workers for the model." 2023-08-31T22:00:47.5272669Z │ } 2023-08-31T22:00:47.5272854Z └ 2023-08-31T22:00:47.5273258Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:47.5273735Z 1ms 694µs 253µs 153µs 31ms 1ms 32µs 34ms 2023-08-31T22:00:47.5273925Z 2023-08-31T22:00:47.5315433Z ✓ Successful request 2023-08-31T22:00:47.5355545Z 2023-08-31T22:00:47.5355706Z Iteration 33/82 2023-08-31T22:00:47.5371960Z 2023-08-31T22:00:47.5372238Z → management request 2023-08-31T22:00:47.5490462Z DELETE http://localhost:8081/models/squeezenet1_1 2023-08-31T22:00:47.5491269Z 200 OK ★ 4ms time ★ 249B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:47.5491905Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:00:47.5492341Z │ { 2023-08-31T22:00:47.5492880Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:00:47.5493606Z │ } 2023-08-31T22:00:47.5495147Z └ 2023-08-31T22:00:47.5495840Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:47.5496510Z 1ms 186µs (cache) (cache) 2ms 1ms 31µs 5ms 2023-08-31T22:00:47.5496830Z 2023-08-31T22:00:47.5531479Z ✓ Successful request 2023-08-31T22:00:47.5558769Z 2023-08-31T22:00:47.5558992Z Iteration 34/82 2023-08-31T22:00:47.5572856Z 2023-08-31T22:00:47.5573142Z → management request 2023-08-31T22:00:48.9418288Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&batch_size=2 2023-08-31T22:00:48.9419346Z 200 OK ★ 1379ms time ★ 311B↑ 405B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:48.9420372Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 138B 2023-08-31T22:00:48.9420706Z │ { 2023-08-31T22:00:48.9421052Z │ "status": "Model \"resnet152\" Version: 1.0 register 2023-08-31T22:00:48.9421440Z │ ed with 0 initial workers. Use scale workers API to ad 2023-08-31T22:00:48.9421815Z │ d workers for the model." 2023-08-31T22:00:48.9422057Z │ } 2023-08-31T22:00:48.9433453Z └ 2023-08-31T22:00:48.9434070Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:48.9434852Z 1ms 173µs (cache) (cache) 1377ms 1ms 35µs 1380ms 2023-08-31T22:00:48.9435085Z 2023-08-31T22:00:48.9478520Z ✓ Successful request 2023-08-31T22:00:48.9532773Z 2023-08-31T22:00:48.9533174Z Iteration 35/82 2023-08-31T22:00:48.9544629Z 2023-08-31T22:00:48.9545106Z → management request 2023-08-31T22:00:49.0011724Z DELETE http://localhost:8081/models/resnet152 2023-08-31T22:00:49.0013511Z 200 OK ★ 41ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:49.0015361Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:00:49.0016992Z │ { 2023-08-31T22:00:49.0017310Z │ "status": "Model \"resnet152\" unregistered" 2023-08-31T22:00:49.0017875Z │ } 2023-08-31T22:00:49.0030279Z └ 2023-08-31T22:00:49.0030972Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:49.0031795Z 1ms 216µs (cache) (cache) 38ms 1ms 31µs 41ms 2023-08-31T22:00:49.0032015Z 2023-08-31T22:00:49.0081759Z ✓ Successful request 2023-08-31T22:00:49.0110106Z 2023-08-31T22:00:49.0110264Z Iteration 36/82 2023-08-31T22:00:49.0123855Z 2023-08-31T22:00:49.0124241Z → management request 2023-08-31T22:00:54.0399895Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&batch_size=dd&initial_workers=1 2023-08-31T22:00:54.0400598Z 200 OK ★ 5s time ★ 330B↑ 351B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:54.0402112Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 85B 2023-08-31T22:00:54.0402603Z │ { 2023-08-31T22:00:54.0403230Z │ "status": "Model \"resnet152\" Version: 1.0 register 2023-08-31T22:00:54.0406263Z │ ed with 1 initial workers" 2023-08-31T22:00:54.0406900Z │ } 2023-08-31T22:00:54.0415921Z └ 2023-08-31T22:00:54.0416508Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:54.0417175Z 1ms 173µs (cache) (cache) 5s 1ms 36µs 5s 2023-08-31T22:00:54.0417512Z 2023-08-31T22:00:54.0491525Z ✓ Successful request 2023-08-31T22:00:54.0506453Z 2023-08-31T22:00:54.0506933Z Iteration 37/82 2023-08-31T22:00:54.0510430Z 2023-08-31T22:00:54.0510770Z → management request 2023-08-31T22:00:54.0969006Z DELETE http://localhost:8081/models/resnet152 2023-08-31T22:00:54.0970045Z 200 OK ★ 40ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:54.0970715Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:00:54.0971452Z │ { 2023-08-31T22:00:54.0971861Z │ "status": "Model \"resnet152\" unregistered" 2023-08-31T22:00:54.0972134Z │ } 2023-08-31T22:00:54.0986747Z └ 2023-08-31T22:00:54.0987474Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:54.0988099Z 1ms 192µs (cache) (cache) 37ms 1ms 36µs 40ms 2023-08-31T22:00:54.0988493Z 2023-08-31T22:00:54.1032528Z ✓ Successful request 2023-08-31T22:00:54.1063192Z 2023-08-31T22:00:54.1063551Z Iteration 38/82 2023-08-31T22:00:54.1076128Z 2023-08-31T22:00:54.1076639Z → management request 2023-08-31T22:00:58.2870207Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&batch_size=2&initial_workers=1&max_batch_delay=junk 2023-08-31T22:00:58.2877845Z 200 OK ★ 4.1s time ★ 350B↑ 351B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:58.2878960Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 85B 2023-08-31T22:00:58.2879877Z │ { 2023-08-31T22:00:58.2880315Z │ "status": "Model \"resnet152\" Version: 1.0 register 2023-08-31T22:00:58.2880730Z │ ed with 1 initial workers" 2023-08-31T22:00:58.2881089Z │ } 2023-08-31T22:00:58.2934626Z └ 2023-08-31T22:00:58.2935262Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:58.2935855Z 1ms 185µs (cache) (cache) 4.1s 1ms 37µs 4.1s 2023-08-31T22:00:58.2936125Z 2023-08-31T22:00:58.2999683Z ✓ Successful request 2023-08-31T22:00:58.3038976Z 2023-08-31T22:00:58.3039270Z Iteration 39/82 2023-08-31T22:00:58.3054956Z 2023-08-31T22:00:58.3055427Z → management request 2023-08-31T22:00:58.3581630Z DELETE http://localhost:8081/models/resnet152 2023-08-31T22:00:58.3582318Z 200 OK ★ 47ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:58.3596907Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:00:58.3597228Z │ { 2023-08-31T22:00:58.3597553Z │ "status": "Model \"resnet152\" unregistered" 2023-08-31T22:00:58.3597827Z │ } 2023-08-31T22:00:58.3598006Z └ 2023-08-31T22:00:58.3598427Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:58.3599239Z 1ms 184µs (cache) (cache) 44ms 1ms 36µs 47ms 2023-08-31T22:00:58.3599437Z 2023-08-31T22:00:58.3635146Z ✓ Successful request 2023-08-31T22:00:58.3663380Z 2023-08-31T22:00:58.3663713Z Iteration 40/82 2023-08-31T22:00:58.3676780Z 2023-08-31T22:00:58.3677290Z → management request 2023-08-31T22:00:58.4058067Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&initial_workers=-1 2023-08-31T22:00:58.4061189Z 200 OK ★ 33ms time ★ 318B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:58.4064369Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:00:58.4067395Z │ { 2023-08-31T22:00:58.4067743Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:00:58.4068250Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:00:58.4068650Z │ o add workers for the model." 2023-08-31T22:00:58.4069000Z │ } 2023-08-31T22:00:58.4083445Z └ 2023-08-31T22:00:58.4083998Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:58.4084579Z 1ms 180µs (cache) (cache) 30ms 1ms 32µs 33ms 2023-08-31T22:00:58.4084840Z 2023-08-31T22:00:58.4129654Z ✓ Successful request 2023-08-31T22:00:58.4161301Z 2023-08-31T22:00:58.4163664Z Iteration 41/82 2023-08-31T22:00:58.4173766Z 2023-08-31T22:00:58.4174345Z → management request 2023-08-31T22:00:58.4265106Z DELETE http://localhost:8081/models/squeezenet1_1 2023-08-31T22:00:58.4267911Z 200 OK ★ 4ms time ★ 249B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:58.4268559Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:00:58.4268982Z │ { 2023-08-31T22:00:58.4269485Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:00:58.4269906Z │ } 2023-08-31T22:00:58.4276005Z └ 2023-08-31T22:00:58.4276622Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:58.4277561Z 1ms 183µs (cache) (cache) 2ms 1ms 30µs 4ms 2023-08-31T22:00:58.4277793Z 2023-08-31T22:00:58.4317858Z ✓ Successful request 2023-08-31T22:00:58.4346414Z 2023-08-31T22:00:58.4346721Z Iteration 42/82 2023-08-31T22:00:58.4358483Z 2023-08-31T22:00:58.4358895Z → management request 2023-08-31T22:00:58.7114893Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&synchronous=true 2023-08-31T22:00:58.7127229Z 200 OK ★ 270ms time ★ 308B↑ 405B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:58.7128008Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 138B 2023-08-31T22:00:58.7128529Z │ { 2023-08-31T22:00:58.7130502Z │ "status": "Model \"resnet-18\" Version: 1.0 register 2023-08-31T22:00:58.7131101Z │ ed with 0 initial workers. Use scale workers API to ad 2023-08-31T22:00:58.7131889Z │ d workers for the model." 2023-08-31T22:00:58.7132203Z │ } 2023-08-31T22:00:58.7133746Z └ 2023-08-31T22:00:58.7134160Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:58.7134749Z 1ms 177µs (cache) (cache) 268ms 1ms 40µs 270ms 2023-08-31T22:00:58.7135024Z 2023-08-31T22:00:58.7192949Z ✓ Successful request 2023-08-31T22:00:58.7207590Z 2023-08-31T22:00:58.7208030Z Iteration 43/82 2023-08-31T22:00:58.7221900Z 2023-08-31T22:00:58.7222397Z → management request 2023-08-31T22:00:58.7388683Z DELETE http://localhost:8081/models/resnet-18 2023-08-31T22:00:58.7389191Z 200 OK ★ 11ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:58.7391377Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:00:58.7391930Z │ { 2023-08-31T22:00:58.7392552Z │ "status": "Model \"resnet-18\" unregistered" 2023-08-31T22:00:58.7392838Z │ } 2023-08-31T22:00:58.7404279Z └ 2023-08-31T22:00:58.7404848Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:58.7405878Z 1ms 192µs (cache) (cache) 9ms 1ms 35µs 12ms 2023-08-31T22:00:58.7406449Z 2023-08-31T22:00:58.7462922Z ✓ Successful request 2023-08-31T22:00:58.7502761Z 2023-08-31T22:00:58.7503149Z Iteration 44/82 2023-08-31T22:00:58.7520624Z 2023-08-31T22:00:58.7521103Z → management request 2023-08-31T22:00:59.0307764Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&synchronous=-1 2023-08-31T22:00:59.0308500Z 200 OK ★ 273ms time ★ 306B↑ 405B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.0308996Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 138B 2023-08-31T22:00:59.0309370Z │ { 2023-08-31T22:00:59.0309800Z │ "status": "Model \"resnet-18\" Version: 1.0 register 2023-08-31T22:00:59.0310271Z │ ed with 0 initial workers. Use scale workers API to ad 2023-08-31T22:00:59.0310657Z │ d workers for the model." 2023-08-31T22:00:59.0310999Z │ } 2023-08-31T22:00:59.0321970Z └ 2023-08-31T22:00:59.0322433Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.0323073Z 1ms 182µs (cache) (cache) 271ms 1ms 37µs 273ms 2023-08-31T22:00:59.0323351Z 2023-08-31T22:00:59.0364084Z ✓ Successful request 2023-08-31T22:00:59.0390981Z 2023-08-31T22:00:59.0391293Z Iteration 45/82 2023-08-31T22:00:59.0403847Z 2023-08-31T22:00:59.0404242Z → management request 2023-08-31T22:00:59.0564631Z DELETE http://localhost:8081/models/resnet-18 2023-08-31T22:00:59.0565511Z 200 OK ★ 11ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.0566487Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:00:59.0566809Z │ { 2023-08-31T22:00:59.0567128Z │ "status": "Model \"resnet-18\" unregistered" 2023-08-31T22:00:59.0567405Z │ } 2023-08-31T22:00:59.0578922Z └ 2023-08-31T22:00:59.0579541Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.0580387Z 1ms 178µs (cache) (cache) 9ms 1ms 30µs 11ms 2023-08-31T22:00:59.0580608Z 2023-08-31T22:00:59.0619671Z ✓ Successful request 2023-08-31T22:00:59.0646642Z 2023-08-31T22:00:59.0646984Z Iteration 46/82 2023-08-31T22:00:59.0659250Z 2023-08-31T22:00:59.0659644Z → management request 2023-08-31T22:00:59.3427955Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&synchronous=false 2023-08-31T22:00:59.3428734Z 200 OK ★ 272ms time ★ 309B↑ 405B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.3429224Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 138B 2023-08-31T22:00:59.3429585Z │ { 2023-08-31T22:00:59.3429936Z │ "status": "Model \"resnet-18\" Version: 1.0 register 2023-08-31T22:00:59.3430404Z │ ed with 0 initial workers. Use scale workers API to ad 2023-08-31T22:00:59.3430799Z │ d workers for the model." 2023-08-31T22:00:59.3431139Z │ } 2023-08-31T22:00:59.3441790Z └ 2023-08-31T22:00:59.3442245Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.3442896Z 1ms 179µs (cache) (cache) 269ms 1ms 36µs 272ms 2023-08-31T22:00:59.3443162Z 2023-08-31T22:00:59.3484212Z ✓ Successful request 2023-08-31T22:00:59.3511853Z 2023-08-31T22:00:59.3512291Z Iteration 47/82 2023-08-31T22:00:59.3524798Z 2023-08-31T22:00:59.3525076Z → management request 2023-08-31T22:00:59.3607607Z GET http://localhost:8081/models?limit=1 2023-08-31T22:00:59.3608577Z 200 OK ★ 3ms time ★ 240B↑ 391B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.3609044Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 124B 2023-08-31T22:00:59.3609329Z │ { 2023-08-31T22:00:59.3610887Z │ "nextPageToken": "1", 2023-08-31T22:00:59.3611686Z │ "models": [ 2023-08-31T22:00:59.3612053Z │ { 2023-08-31T22:00:59.3612464Z │ "modelName": "resnet-18", 2023-08-31T22:00:59.3613232Z │ "modelUrl": "resnet-18.mar" 2023-08-31T22:00:59.3613641Z │ } 2023-08-31T22:00:59.3613995Z │ ] 2023-08-31T22:00:59.3614305Z │ } 2023-08-31T22:00:59.3623935Z └ 2023-08-31T22:00:59.3624629Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.3625277Z 1ms 294µs (cache) (cache) 1ms 1ms 30µs 3ms 2023-08-31T22:00:59.3625593Z 2023-08-31T22:00:59.3695550Z ✓ Successful request 2023-08-31T22:00:59.3724244Z 2023-08-31T22:00:59.3724616Z Iteration 48/82 2023-08-31T22:00:59.3739943Z 2023-08-31T22:00:59.3740389Z → management request 2023-08-31T22:00:59.3821921Z GET http://localhost:8081/models?limit=-1 2023-08-31T22:00:59.3825121Z 200 OK ★ 3ms time ★ 241B↑ 367B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.3828183Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 100B 2023-08-31T22:00:59.3831119Z │ { 2023-08-31T22:00:59.3831616Z │ "models": [ 2023-08-31T22:00:59.3832207Z │ { 2023-08-31T22:00:59.3832542Z │ "modelName": "resnet-18", 2023-08-31T22:00:59.3832873Z │ "modelUrl": "resnet-18.mar" 2023-08-31T22:00:59.3833127Z │ } 2023-08-31T22:00:59.3833325Z │ ] 2023-08-31T22:00:59.3833535Z │ } 2023-08-31T22:00:59.3847346Z └ 2023-08-31T22:00:59.3848060Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.3848692Z 1ms 172µs (cache) (cache) 1ms 1ms 27µs 3ms 2023-08-31T22:00:59.3848965Z 2023-08-31T22:00:59.3938393Z ✓ Successful request 2023-08-31T22:00:59.3963940Z 2023-08-31T22:00:59.3964135Z Iteration 49/82 2023-08-31T22:00:59.3976203Z 2023-08-31T22:00:59.3976460Z → management request 2023-08-31T22:00:59.4048916Z GET http://localhost:8081/models?limit=1&next_page_token=1 2023-08-31T22:00:59.4049614Z 200 OK ★ 3ms time ★ 258B↑ 285B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.4050124Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 19B 2023-08-31T22:00:59.4050485Z │ { 2023-08-31T22:00:59.4050801Z │ "models": [] 2023-08-31T22:00:59.4051090Z │ } 2023-08-31T22:00:59.4059665Z └ 2023-08-31T22:00:59.4060182Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.4060813Z 1ms 167µs (cache) (cache) 812µs 1ms 27µs 3ms 2023-08-31T22:00:59.4061349Z 2023-08-31T22:00:59.4098594Z ✓ Successful request 2023-08-31T22:00:59.4124101Z 2023-08-31T22:00:59.4124289Z Iteration 50/82 2023-08-31T22:00:59.4136318Z 2023-08-31T22:00:59.4136565Z → management request 2023-08-31T22:00:59.4211109Z GET http://localhost:8081/models?limit=1&next_page_token=-1 2023-08-31T22:00:59.4212790Z 200 OK ★ 3ms time ★ 259B↑ 391B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.4214464Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 124B 2023-08-31T22:00:59.4216072Z │ { 2023-08-31T22:00:59.4216627Z │ "nextPageToken": "1", 2023-08-31T22:00:59.4216888Z │ "models": [ 2023-08-31T22:00:59.4217116Z │ { 2023-08-31T22:00:59.4217387Z │ "modelName": "resnet-18", 2023-08-31T22:00:59.4217682Z │ "modelUrl": "resnet-18.mar" 2023-08-31T22:00:59.4217936Z │ } 2023-08-31T22:00:59.4218146Z │ ] 2023-08-31T22:00:59.4218339Z │ } 2023-08-31T22:00:59.4229952Z └ 2023-08-31T22:00:59.4230437Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.4230951Z 1ms 170µs (cache) (cache) 948µs 1ms 28µs 3ms 2023-08-31T22:00:59.4269599Z 2023-08-31T22:00:59.4269890Z ✓ Successful request 2023-08-31T22:00:59.4298241Z 2023-08-31T22:00:59.4298391Z Iteration 51/82 2023-08-31T22:00:59.4311900Z 2023-08-31T22:00:59.4312151Z → management request 2023-08-31T22:00:59.4398317Z PUT http://localhost:8081/models/resnet-18?number_gpu=10 2023-08-31T22:00:59.4400316Z 202 Accepted ★ 4ms time ★ 275B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.4402082Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:00:59.4403660Z │ { 2023-08-31T22:00:59.4404060Z │ "status": "Processing worker updates..." 2023-08-31T22:00:59.4404412Z │ } 2023-08-31T22:00:59.4417154Z └ 2023-08-31T22:00:59.4417716Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.4418318Z 1ms 161µs (cache) (cache) 1ms 1ms 27µs 4ms 2023-08-31T22:00:59.4418600Z 2023-08-31T22:00:59.4497507Z ✓ Successful request 2023-08-31T22:00:59.4605065Z 2023-08-31T22:00:59.4605317Z Iteration 52/82 2023-08-31T22:00:59.4619735Z 2023-08-31T22:00:59.4620092Z → management request 2023-08-31T22:00:59.4700877Z PUT http://localhost:8081/models/resnet-18?number_gpu=-1 2023-08-31T22:00:59.4702826Z 202 Accepted ★ 3ms time ★ 275B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.4704538Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:00:59.4706138Z │ { 2023-08-31T22:00:59.4706536Z │ "status": "Processing worker updates..." 2023-08-31T22:00:59.4706886Z │ } 2023-08-31T22:00:59.4720241Z └ 2023-08-31T22:00:59.4720829Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.4721463Z 1ms 180µs (cache) (cache) 1ms 1ms 28µs 3ms 2023-08-31T22:00:59.4721760Z 2023-08-31T22:00:59.4760989Z ✓ Successful request 2023-08-31T22:00:59.4857809Z 2023-08-31T22:00:59.4858067Z Iteration 53/82 2023-08-31T22:00:59.4871929Z 2023-08-31T22:00:59.4872289Z → management request 2023-08-31T22:00:59.4951775Z PUT http://localhost:8081/models/resnet-18?min_worker=1&max_worker=1&synchronous=true 2023-08-31T22:00:59.4953717Z 200 OK ★ 3ms time ★ 304B↑ 325B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.4955412Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 59B 2023-08-31T22:00:59.4957043Z │ { 2023-08-31T22:00:59.4957467Z │ "status": "Workers scaled to 1 for model: resnet-18" 2023-08-31T22:00:59.4957832Z │ } 2023-08-31T22:00:59.4969924Z └ 2023-08-31T22:00:59.4970490Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.4971061Z 1ms 170µs (cache) (cache) 1ms 1ms 29µs 3ms 2023-08-31T22:00:59.4971337Z 2023-08-31T22:00:59.5010720Z ✓ Successful request 2023-08-31T22:00:59.5038510Z 2023-08-31T22:00:59.5038760Z Iteration 54/82 2023-08-31T22:00:59.5052419Z 2023-08-31T22:00:59.5052768Z → management request 2023-08-31T22:00:59.5130679Z PUT http://localhost:8081/models/resnet-18?min_worker=1&max_worker=1&synchronous=false 2023-08-31T22:00:59.5132674Z 202 Accepted ★ 3ms time ★ 305B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.5134386Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:00:59.5135941Z │ { 2023-08-31T22:00:59.5136347Z │ "status": "Processing worker updates..." 2023-08-31T22:00:59.5136974Z │ } 2023-08-31T22:00:59.5149381Z └ 2023-08-31T22:00:59.5149942Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.5150518Z 1ms 170µs (cache) (cache) 1ms 1ms 27µs 3ms 2023-08-31T22:00:59.5150794Z 2023-08-31T22:00:59.5302952Z ✓ Successful request 2023-08-31T22:00:59.5408577Z 2023-08-31T22:00:59.5408841Z Iteration 55/82 2023-08-31T22:00:59.5422742Z 2023-08-31T22:00:59.5423100Z → management request 2023-08-31T22:00:59.5535369Z PUT http://localhost:8081/models/resnet-18?timeout=-1 2023-08-31T22:00:59.5537456Z 202 Accepted ★ 6ms time ★ 272B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.5539211Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:00:59.5540803Z │ { 2023-08-31T22:00:59.5541211Z │ "status": "Processing worker updates..." 2023-08-31T22:00:59.5541564Z │ } 2023-08-31T22:00:59.5553544Z └ 2023-08-31T22:00:59.5554114Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.5554706Z 1ms 190µs (cache) (cache) 4ms 1ms 30µs 6ms 2023-08-31T22:00:59.5554991Z 2023-08-31T22:00:59.5610659Z ✓ Successful request 2023-08-31T22:00:59.5638061Z 2023-08-31T22:00:59.5638314Z Iteration 56/82 2023-08-31T22:00:59.5652086Z 2023-08-31T22:00:59.5652467Z → management request 2023-08-31T22:00:59.5731456Z PUT http://localhost:8081/models/resnet-18?timeout=0 2023-08-31T22:00:59.5733393Z 202 Accepted ★ 3ms time ★ 271B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.5735119Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:00:59.5736693Z │ { 2023-08-31T22:00:59.5737093Z │ "status": "Processing worker updates..." 2023-08-31T22:00:59.5737444Z │ } 2023-08-31T22:00:59.5749355Z └ 2023-08-31T22:00:59.5749911Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.5750534Z 1ms 173µs (cache) (cache) 1ms 1ms 29µs 3ms 2023-08-31T22:00:59.5750812Z 2023-08-31T22:00:59.5854292Z ✓ Successful request 2023-08-31T22:00:59.5891832Z 2023-08-31T22:00:59.5892084Z Iteration 57/82 2023-08-31T22:00:59.5905851Z 2023-08-31T22:00:59.5906206Z → management request 2023-08-31T22:00:59.5978279Z POST http://localhost:8081/models?url=&model_name=resnet-18 2023-08-31T22:00:59.5980252Z 404 Not Found ★ 3ms time ★ 278B↑ 348B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:00:59.5981982Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 80B 2023-08-31T22:00:59.5983611Z │ { 2023-08-31T22:00:59.5983937Z │ "code": 404, 2023-08-31T22:00:59.5984331Z │ "type": "ModelNotFoundException", 2023-08-31T22:00:59.5984723Z │ "message": "empty url" 2023-08-31T22:00:59.5985037Z │ } 2023-08-31T22:00:59.5996956Z └ 2023-08-31T22:00:59.5997523Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:00:59.5998142Z 1ms 337µs (cache) (cache) 1ms 1ms 29µs 3ms 2023-08-31T22:00:59.5998414Z 2023-08-31T22:00:59.6038227Z ✓ Successful request 2023-08-31T22:00:59.6071203Z 2023-08-31T22:00:59.6071459Z Iteration 58/82 2023-08-31T22:00:59.6109856Z 2023-08-31T22:00:59.6110240Z → management request 2023-08-31T22:01:00.2700159Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/invalid-resnet-18.mar&model_name=invalid-resnet18 2023-08-31T22:01:00.2703875Z 400 Bad Request ★ 653ms time ★ 347B↑ 439B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.2707002Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 168B 2023-08-31T22:01:00.2709957Z │ { 2023-08-31T22:01:00.2710400Z │ "code": 400, 2023-08-31T22:01:00.2712064Z │ "type": "DownloadArchiveException", 2023-08-31T22:01:00.2712569Z │ "message": "Failed to download archive from: https:/ 2023-08-31T22:01:00.2713453Z │ /torchserve.pytorch.org/mar_files/invalid-resnet-18.ma 2023-08-31T22:01:00.2715111Z │ r" 2023-08-31T22:01:00.2715589Z │ } 2023-08-31T22:01:00.2732529Z └ 2023-08-31T22:01:00.2733215Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.2733867Z 1ms 588µs 174µs 141µs 650ms 1ms 41µs 653ms 2023-08-31T22:01:00.2734191Z 2023-08-31T22:01:00.2783551Z ✓ Successful request 2023-08-31T22:01:00.2900413Z 2023-08-31T22:01:00.2900824Z Iteration 59/82 2023-08-31T22:01:00.2913388Z 2023-08-31T22:01:00.2913894Z → management request 2023-08-31T22:01:00.3064875Z GET http://localhost:8081/models/invalid_squeezenet1_1 2023-08-31T22:01:00.3068245Z 404 Not Found ★ 5ms time ★ 254B↑ 378B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.3071300Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 109B 2023-08-31T22:01:00.3074122Z │ { 2023-08-31T22:01:00.3074565Z │ "code": 404, 2023-08-31T22:01:00.3075765Z │ "type": "ModelNotFoundException", 2023-08-31T22:01:00.3076265Z │ "message": "Model not found: invalid_squeezenet1_1" 2023-08-31T22:01:00.3076666Z │ } 2023-08-31T22:01:00.3091062Z └ 2023-08-31T22:01:00.3091719Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.3092390Z 1ms 463µs 286µs 181µs 1ms 1ms 31µs 5ms 2023-08-31T22:01:00.3092883Z 2023-08-31T22:01:00.3193273Z ✓ Successful request 2023-08-31T22:01:00.3265183Z 2023-08-31T22:01:00.3265556Z Iteration 60/82 2023-08-31T22:01:00.3281776Z 2023-08-31T22:01:00.3282278Z → management request 2023-08-31T22:01:00.3377606Z GET http://localhost:8081/models/squeezenet1_1/0.0 2023-08-31T22:01:00.3380934Z 404 Not Found ★ 5ms time ★ 250B↑ 370B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.3384010Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 101B 2023-08-31T22:01:00.3386839Z │ { 2023-08-31T22:01:00.3387313Z │ "code": 404, 2023-08-31T22:01:00.3388508Z │ "type": "ModelNotFoundException", 2023-08-31T22:01:00.3389002Z │ "message": "Model not found: squeezenet1_1" 2023-08-31T22:01:00.3389455Z │ } 2023-08-31T22:01:00.3405712Z └ 2023-08-31T22:01:00.3406535Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.3407201Z 1ms 410µs 159µs 117µs 2ms 1ms 30µs 5ms 2023-08-31T22:01:00.3407736Z 2023-08-31T22:01:00.3449707Z ✓ Successful request 2023-08-31T22:01:00.3559862Z 2023-08-31T22:01:00.3560390Z Iteration 61/82 2023-08-31T22:01:00.3576646Z 2023-08-31T22:01:00.3577164Z → management request 2023-08-31T22:01:00.3664836Z GET http://localhost:8081/models?next_page_token=12 2023-08-31T22:01:00.3668106Z 200 OK ★ 4ms time ★ 251B↑ 285B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.3671117Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 19B 2023-08-31T22:01:00.3673990Z │ { 2023-08-31T22:01:00.3674477Z │ "models": [] 2023-08-31T22:01:00.3675600Z │ } 2023-08-31T22:01:00.3689911Z └ 2023-08-31T22:01:00.3690560Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.3691270Z 1ms 400µs 288µs 119µs 1ms 1ms 31µs 4ms 2023-08-31T22:01:00.3691656Z 2023-08-31T22:01:00.3751039Z ✓ Successful request 2023-08-31T22:01:00.3779860Z 2023-08-31T22:01:00.3780227Z Iteration 62/82 2023-08-31T22:01:00.3796567Z 2023-08-31T22:01:00.3796987Z → management request 2023-08-31T22:01:00.3883289Z PUT http://localhost:8081/models/resnet-18?min_worker=1&synchronous=Nan 2023-08-31T22:01:00.3886715Z 202 Accepted ★ 3ms time ★ 290B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.3889861Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:01:00.3892746Z │ { 2023-08-31T22:01:00.3893228Z │ "status": "Processing worker updates..." 2023-08-31T22:01:00.3894096Z │ } 2023-08-31T22:01:00.3920209Z └ 2023-08-31T22:01:00.3920901Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.3921585Z 1ms 175µs (cache) (cache) 1ms 1ms 31µs 3ms 2023-08-31T22:01:00.3921945Z 2023-08-31T22:01:00.3965300Z ✓ Successful request 2023-08-31T22:01:00.3999693Z 2023-08-31T22:01:00.4000062Z Iteration 63/82 2023-08-31T22:01:00.4015189Z 2023-08-31T22:01:00.4015678Z → management request 2023-08-31T22:01:00.4118205Z PUT http://localhost:8081/models/resnet-18?min_worker=nan&synchronous=nan 2023-08-31T22:01:00.4121549Z 202 Accepted ★ 5ms time ★ 292B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.4124615Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:01:00.4127846Z │ { 2023-08-31T22:01:00.4128337Z │ "status": "Processing worker updates..." 2023-08-31T22:01:00.4128808Z │ } 2023-08-31T22:01:00.4144662Z └ 2023-08-31T22:01:00.4145328Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.4146020Z 1ms 175µs (cache) (cache) 3ms 1ms 30µs 5ms 2023-08-31T22:01:00.4146389Z 2023-08-31T22:01:00.4189467Z ✓ Successful request 2023-08-31T22:01:00.4217730Z 2023-08-31T22:01:00.4218094Z Iteration 64/82 2023-08-31T22:01:00.4233105Z 2023-08-31T22:01:00.4233505Z → management request 2023-08-31T22:01:00.4328021Z PUT http://localhost:8081/models/resnet-18 2023-08-31T22:01:00.4331292Z 202 Accepted ★ 4ms time ★ 261B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.4334323Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:01:00.4337215Z │ { 2023-08-31T22:01:00.4337695Z │ "status": "Processing worker updates..." 2023-08-31T22:01:00.4338170Z │ } 2023-08-31T22:01:00.4354070Z └ 2023-08-31T22:01:00.4354714Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.4355425Z 1ms 202µs (cache) (cache) 2ms 1ms 29µs 4ms 2023-08-31T22:01:00.4355791Z 2023-08-31T22:01:00.4398443Z ✓ Successful request 2023-08-31T22:01:00.4432156Z 2023-08-31T22:01:00.4432528Z Iteration 65/82 2023-08-31T22:01:00.4447823Z 2023-08-31T22:01:00.4448230Z → management request 2023-08-31T22:01:00.4537508Z PUT http://localhost:8081/models/resnet181?min_worker=1 2023-08-31T22:01:00.4540855Z 404 Not Found ★ 3ms time ★ 274B↑ 365B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.4543902Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 97B 2023-08-31T22:01:00.4547269Z │ { 2023-08-31T22:01:00.4547682Z │ "code": 404, 2023-08-31T22:01:00.4548188Z │ "type": "ModelNotFoundException", 2023-08-31T22:01:00.4549112Z │ "message": "Model not found: resnet181" 2023-08-31T22:01:00.4549502Z │ } 2023-08-31T22:01:00.4565312Z └ 2023-08-31T22:01:00.4565953Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.4566868Z 1ms 178µs (cache) (cache) 1ms 1ms 28µs 3ms 2023-08-31T22:01:00.4567223Z 2023-08-31T22:01:00.4610967Z ✓ Successful request 2023-08-31T22:01:00.4639100Z 2023-08-31T22:01:00.4639462Z Iteration 66/82 2023-08-31T22:01:00.4654505Z 2023-08-31T22:01:00.4654909Z → management request 2023-08-31T22:01:00.4764933Z PUT http://localhost:8081/models/resnet-18?min_worker=2&max_worker=1 2023-08-31T22:01:00.4768566Z 400 Bad Request ★ 6ms time ★ 287B↑ 381B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.4771667Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 110B 2023-08-31T22:01:00.4774524Z │ { 2023-08-31T22:01:00.4774958Z │ "code": 400, 2023-08-31T22:01:00.4775504Z │ "type": "BadRequestException", 2023-08-31T22:01:00.4776464Z │ "message": "max_worker cannot be less than min_worke 2023-08-31T22:01:00.4776878Z │ r." 2023-08-31T22:01:00.4777312Z │ } 2023-08-31T22:01:00.4793663Z └ 2023-08-31T22:01:00.4794604Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.4795290Z 1ms 435µs 156µs 250µs 3ms 1ms 33µs 6ms 2023-08-31T22:01:00.4795656Z 2023-08-31T22:01:00.4936096Z ✓ Successful request 2023-08-31T22:01:00.5011667Z 2023-08-31T22:01:00.5012033Z Iteration 67/82 2023-08-31T22:01:00.5024273Z 2023-08-31T22:01:00.5024758Z → management request 2023-08-31T22:01:00.5123122Z PUT http://localhost:8081/models/resnet-18?min_worker=1 2023-08-31T22:01:00.5126617Z 202 Accepted ★ 4ms time ★ 274B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.5129809Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:01:00.5132691Z │ { 2023-08-31T22:01:00.5133188Z │ "status": "Processing worker updates..." 2023-08-31T22:01:00.5133690Z │ } 2023-08-31T22:01:00.5149790Z └ 2023-08-31T22:01:00.5150432Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.5151151Z 1ms 431µs 171µs 132µs 1ms 1ms 38µs 5ms 2023-08-31T22:01:00.5151499Z 2023-08-31T22:01:00.5183992Z ✓ Successful request 2023-08-31T22:01:00.5212465Z 2023-08-31T22:01:00.5212806Z Iteration 68/82 2023-08-31T22:01:00.5227836Z 2023-08-31T22:01:00.5228253Z → management request 2023-08-31T22:01:00.5344077Z PUT http://localhost:8081/models/resnet-18?min_worker=0 2023-08-31T22:01:00.5344778Z 202 Accepted ★ 7ms time ★ 274B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.5345296Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:01:00.5345652Z │ { 2023-08-31T22:01:00.5345990Z │ "status": "Processing worker updates..." 2023-08-31T22:01:00.5346262Z │ } 2023-08-31T22:01:00.5353779Z └ 2023-08-31T22:01:00.5354311Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.5354950Z 1ms 174µs (cache) (cache) 5ms 1ms 31µs 7ms 2023-08-31T22:01:00.5355254Z 2023-08-31T22:01:00.5392800Z ✓ Successful request 2023-08-31T22:01:00.5418034Z 2023-08-31T22:01:00.5418229Z Iteration 69/82 2023-08-31T22:01:00.5430239Z 2023-08-31T22:01:00.5430477Z → management request 2023-08-31T22:01:00.5516101Z PUT http://localhost:8081/models/resnet-18?min_worker=-1 2023-08-31T22:01:00.5517006Z 500 Internal Server Error ★ 4ms time ★ 275B↑ 390B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.5517545Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 109B 2023-08-31T22:01:00.5548801Z │ { 2023-08-31T22:01:00.5549208Z │ "code": 500, 2023-08-31T22:01:00.5549628Z │ "type": "IndexOutOfBoundsException", 2023-08-31T22:01:00.5550094Z │ "message": "Index -1 out of bounds for length 0" 2023-08-31T22:01:00.5550432Z │ } 2023-08-31T22:01:00.5550770Z └ 2023-08-31T22:01:00.5551263Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.5551861Z 1ms 183µs (cache) (cache) 2ms 1ms 29µs 4ms 2023-08-31T22:01:00.5552128Z 2023-08-31T22:01:00.5567501Z ✓ Successful request 2023-08-31T22:01:00.5591910Z 2023-08-31T22:01:00.5592094Z Iteration 70/82 2023-08-31T22:01:00.5604095Z 2023-08-31T22:01:00.5604337Z → management request 2023-08-31T22:01:00.5686567Z PUT http://localhost:8081/models/resnet-18?max_worker=-1 2023-08-31T22:01:00.5687291Z 400 Bad Request ★ 3ms time ★ 275B↑ 381B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.5687798Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 110B 2023-08-31T22:01:00.5688156Z │ { 2023-08-31T22:01:00.5688471Z │ "code": 400, 2023-08-31T22:01:00.5688837Z │ "type": "BadRequestException", 2023-08-31T22:01:00.5689279Z │ "message": "max_worker cannot be less than min_worke 2023-08-31T22:01:00.5689631Z │ r." 2023-08-31T22:01:00.5689903Z │ } 2023-08-31T22:01:00.5696991Z └ 2023-08-31T22:01:00.5697514Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.5698394Z 1ms 393µs 146µs 113µs 1ms 1ms 30µs 4ms 2023-08-31T22:01:00.5698679Z 2023-08-31T22:01:00.5727713Z ✓ Successful request 2023-08-31T22:01:00.5751030Z 2023-08-31T22:01:00.5751226Z Iteration 71/82 2023-08-31T22:01:00.5763189Z 2023-08-31T22:01:00.5763449Z → management request 2023-08-31T22:01:00.5844841Z PUT http://localhost:8081/models/invalid_squeezenet1_1/1.0/set-default 2023-08-31T22:01:00.5845524Z 404 Not Found ★ 3ms time ★ 289B↑ 378B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.5846048Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 109B 2023-08-31T22:01:00.5846624Z │ { 2023-08-31T22:01:00.5846944Z │ "code": 404, 2023-08-31T22:01:00.5847317Z │ "type": "ModelNotFoundException", 2023-08-31T22:01:00.5847774Z │ "message": "Model not found: invalid_squeezenet1_1" 2023-08-31T22:01:00.5848134Z │ } 2023-08-31T22:01:00.5855219Z └ 2023-08-31T22:01:00.5855751Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.5856369Z 1ms 379µs 134µs 108µs 1ms 1ms 28µs 4ms 2023-08-31T22:01:00.5856655Z 2023-08-31T22:01:00.5882202Z ✓ Successful request 2023-08-31T22:01:00.5908051Z 2023-08-31T22:01:00.5908202Z Iteration 72/82 2023-08-31T22:01:00.5920813Z 2023-08-31T22:01:00.5921076Z → management request 2023-08-31T22:01:00.6083163Z DELETE http://localhost:8081/models/resnet-18 2023-08-31T22:01:00.6083851Z 200 OK ★ 11ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.6084374Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:01:00.6084744Z │ { 2023-08-31T22:01:00.6085137Z │ "status": "Model \"resnet-18\" unregistered" 2023-08-31T22:01:00.6085497Z │ } 2023-08-31T22:01:00.6094129Z └ 2023-08-31T22:01:00.6094648Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.6095252Z 1ms 363µs 129µs 100µs 9ms 1ms 31µs 11ms 2023-08-31T22:01:00.6095523Z 2023-08-31T22:01:00.6129649Z ✓ Successful request 2023-08-31T22:01:00.6154082Z 2023-08-31T22:01:00.6154430Z Iteration 73/82 2023-08-31T22:01:00.6166596Z 2023-08-31T22:01:00.6166951Z → management request 2023-08-31T22:01:00.6244234Z DELETE http://localhost:8081/models/squeezenet1_1/0.0 2023-08-31T22:01:00.6245149Z 404 Not Found ★ 3ms time ★ 253B↑ 370B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.6246106Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 101B 2023-08-31T22:01:00.6246740Z │ { 2023-08-31T22:01:00.6247101Z │ "code": 404, 2023-08-31T22:01:00.6247575Z │ "type": "ModelNotFoundException", 2023-08-31T22:01:00.6248200Z │ "message": "Model not found: squeezenet1_1" 2023-08-31T22:01:00.6250036Z │ } 2023-08-31T22:01:00.6286761Z └ 2023-08-31T22:01:00.6287263Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.6288077Z 1ms 167µs (cache) (cache) 1ms 1ms 31µs 3ms 2023-08-31T22:01:00.6288277Z 2023-08-31T22:01:00.6298278Z ✓ Successful request 2023-08-31T22:01:00.6324963Z 2023-08-31T22:01:00.6325309Z Iteration 74/82 2023-08-31T22:01:00.6339030Z 2023-08-31T22:01:00.6339359Z → management request 2023-08-31T22:01:00.6794521Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-08-31T22:01:00.6795525Z 200 OK ★ 41ms time ★ 299B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.6796191Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:01:00.6796833Z │ { 2023-08-31T22:01:00.6797341Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:01:00.6797869Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:01:00.6798322Z │ o add workers for the model." 2023-08-31T22:01:00.6798759Z │ } 2023-08-31T22:01:00.6807888Z └ 2023-08-31T22:01:00.6808711Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.6809235Z 1ms 376µs 136µs 106µs 38ms 1ms 32µs 41ms 2023-08-31T22:01:00.6809429Z 2023-08-31T22:01:00.6847164Z ✓ Successful request 2023-08-31T22:01:00.6873285Z 2023-08-31T22:01:00.6873557Z Iteration 75/82 2023-08-31T22:01:00.6885546Z 2023-08-31T22:01:00.6885870Z → management request 2023-08-31T22:01:00.6990567Z DELETE http://localhost:8081/models/squeezenet1_1/?synchronous=true 2023-08-31T22:01:00.6992261Z 200 OK ★ 6ms time ★ 267B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.6995356Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:01:00.6998228Z │ { 2023-08-31T22:01:00.6998791Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:01:00.6999408Z │ } 2023-08-31T22:01:00.7012827Z └ 2023-08-31T22:01:00.7013550Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.7014410Z 1ms 171µs (cache) (cache) 3ms 1ms 28µs 6ms 2023-08-31T22:01:00.7014651Z 2023-08-31T22:01:00.7100746Z ✓ Successful request 2023-08-31T22:01:00.7128281Z 2023-08-31T22:01:00.7128647Z Iteration 76/82 2023-08-31T22:01:00.7143661Z 2023-08-31T22:01:00.7144137Z → management request 2023-08-31T22:01:00.7557105Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-08-31T22:01:00.7557802Z 200 OK ★ 35ms time ★ 299B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.7558250Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:01:00.7558544Z │ { 2023-08-31T22:01:00.7558885Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:01:00.7559306Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:01:00.7559655Z │ o add workers for the model." 2023-08-31T22:01:00.7559913Z │ } 2023-08-31T22:01:00.7560126Z └ 2023-08-31T22:01:00.7560530Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.7561023Z 1ms 167µs (cache) (cache) 33ms 1ms 31µs 35ms 2023-08-31T22:01:00.7561221Z 2023-08-31T22:01:00.7591750Z ✓ Successful request 2023-08-31T22:01:00.7617088Z 2023-08-31T22:01:00.7617233Z Iteration 77/82 2023-08-31T22:01:00.7619277Z 2023-08-31T22:01:00.7619498Z → management request 2023-08-31T22:01:00.7707982Z DELETE http://localhost:8081/models/squeezenet1_1/?synchronous=nan 2023-08-31T22:01:00.7708605Z 200 OK ★ 4ms time ★ 266B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.7709160Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:01:00.7709460Z │ { 2023-08-31T22:01:00.7709864Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:01:00.7710205Z │ } 2023-08-31T22:01:00.7720458Z └ 2023-08-31T22:01:00.7720904Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.7721797Z 1ms 169µs (cache) (cache) 2ms 1ms 29µs 4ms 2023-08-31T22:01:00.7722082Z 2023-08-31T22:01:00.7792984Z ✓ Successful request 2023-08-31T22:01:00.7835421Z 2023-08-31T22:01:00.7835823Z Iteration 78/82 2023-08-31T22:01:00.7852261Z 2023-08-31T22:01:00.7852687Z → management request 2023-08-31T22:01:00.8243252Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-08-31T22:01:00.8244057Z 200 OK ★ 33ms time ★ 299B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.8244657Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:01:00.8245218Z │ { 2023-08-31T22:01:00.8245977Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:01:00.8246864Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:01:00.8247233Z │ o add workers for the model." 2023-08-31T22:01:00.8247542Z │ } 2023-08-31T22:01:00.8247726Z └ 2023-08-31T22:01:00.8248140Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.8248637Z 1ms 167µs (cache) (cache) 30ms 1ms 30µs 33ms 2023-08-31T22:01:00.8248833Z 2023-08-31T22:01:00.8292188Z ✓ Successful request 2023-08-31T22:01:00.8320191Z 2023-08-31T22:01:00.8320550Z Iteration 79/82 2023-08-31T22:01:00.8335537Z 2023-08-31T22:01:00.8336012Z → management request 2023-08-31T22:01:00.8424968Z DELETE http://localhost:8081/models/squeezenet1_1/?timeout=true 2023-08-31T22:01:00.8428277Z 200 OK ★ 4ms time ★ 263B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.8431305Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:01:00.8434196Z │ { 2023-08-31T22:01:00.8434759Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:01:00.8435424Z │ } 2023-08-31T22:01:00.8498848Z └ 2023-08-31T22:01:00.8499655Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.8500510Z 1ms 166µs (cache) (cache) 2ms 1ms 29µs 4ms 2023-08-31T22:01:00.8500743Z 2023-08-31T22:01:00.8538496Z ✓ Successful request 2023-08-31T22:01:00.8566030Z 2023-08-31T22:01:00.8566583Z Iteration 80/82 2023-08-31T22:01:00.8581767Z 2023-08-31T22:01:00.8582242Z → management request 2023-08-31T22:01:00.9001445Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-08-31T22:01:00.9002487Z 200 OK ★ 33ms time ★ 299B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.9003404Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:01:00.9003734Z │ { 2023-08-31T22:01:00.9004068Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:01:00.9004483Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:01:00.9004813Z │ o add workers for the model." 2023-08-31T22:01:00.9005097Z │ } 2023-08-31T22:01:00.9005274Z └ 2023-08-31T22:01:00.9005680Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.9006178Z 4ms 170µs (cache) (cache) 30ms 1ms 41µs 36ms 2023-08-31T22:01:00.9006531Z 2023-08-31T22:01:00.9036438Z ✓ Successful request 2023-08-31T22:01:00.9064857Z 2023-08-31T22:01:00.9065503Z Iteration 81/82 2023-08-31T22:01:00.9080637Z 2023-08-31T22:01:00.9081122Z → management request 2023-08-31T22:01:00.9171082Z DELETE http://localhost:8081/models/squeezenet1_1/?timeout=true&synchronous=-1 2023-08-31T22:01:00.9174379Z 200 OK ★ 4ms time ★ 278B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.9177401Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:01:00.9180308Z │ { 2023-08-31T22:01:00.9180875Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:01:00.9181499Z │ } 2023-08-31T22:01:00.9219536Z └ 2023-08-31T22:01:00.9220440Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.9220961Z 1ms 168µs (cache) (cache) 2ms 1ms 28µs 4ms 2023-08-31T22:01:00.9221159Z 2023-08-31T22:01:00.9258779Z ✓ Successful request 2023-08-31T22:01:00.9284743Z 2023-08-31T22:01:00.9284937Z Iteration 82/82 2023-08-31T22:01:00.9297564Z 2023-08-31T22:01:00.9298098Z → management request 2023-08-31T22:01:00.9373453Z DELETE http://localhost:8081/models/invalid_squeezenet1_1 2023-08-31T22:01:00.9375541Z 404 Not Found ★ 3ms time ★ 257B↑ 378B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:00.9377350Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 109B 2023-08-31T22:01:00.9379034Z │ { 2023-08-31T22:01:00.9379609Z │ "code": 404, 2023-08-31T22:01:00.9379996Z │ "type": "ModelNotFoundException", 2023-08-31T22:01:00.9380410Z │ "message": "Model not found: invalid_squeezenet1_1" 2023-08-31T22:01:00.9380735Z │ } 2023-08-31T22:01:00.9390568Z └ 2023-08-31T22:01:00.9391050Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:00.9391717Z 1ms 167µs (cache) (cache) 1ms 1ms 28µs 3ms 2023-08-31T22:01:00.9391993Z 2023-08-31T22:01:00.9431276Z ✓ Successful request 2023-08-31T22:01:01.1784551Z 2023-08-31T22:01:01.1785274Z ┌─────────────────────────┬────────────────────┬────────────────────┐ 2023-08-31T22:01:01.1785742Z │ │ executed │ failed │ 2023-08-31T22:01:01.1786167Z ├─────────────────────────┼────────────────────┼────────────────────┤ 2023-08-31T22:01:01.1786547Z │ iterations │ 82 │ 0 │ 2023-08-31T22:01:01.1786931Z ├─────────────────────────┼────────────────────┼────────────────────┤ 2023-08-31T22:01:01.1787299Z │ requests │ 82 │ 0 │ 2023-08-31T22:01:01.1787725Z ├─────────────────────────┼────────────────────┼────────────────────┤ 2023-08-31T22:01:01.1788091Z │ test-scripts │ 82 │ 0 │ 2023-08-31T22:01:01.1788471Z ├─────────────────────────┼────────────────────┼────────────────────┤ 2023-08-31T22:01:01.1788854Z │ prerequest-scripts │ 0 │ 0 │ 2023-08-31T22:01:01.1789481Z ├─────────────────────────┼────────────────────┼────────────────────┤ 2023-08-31T22:01:01.1789834Z │ assertions │ 82 │ 0 │ 2023-08-31T22:01:01.1790232Z ├─────────────────────────┴────────────────────┴────────────────────┤ 2023-08-31T22:01:01.1790604Z │ total run duration: 19.7s │ 2023-08-31T22:01:01.1790989Z ├───────────────────────────────────────────────────────────────────┤ 2023-08-31T22:01:01.1791360Z │ total data received: 8.02kB (approx) │ 2023-08-31T22:01:01.1791774Z ├───────────────────────────────────────────────────────────────────┤ 2023-08-31T22:01:01.1792350Z │ average response time: 221ms [min: 3ms, max: 5s, s.d.: 790ms] │ 2023-08-31T22:01:01.1792754Z ├───────────────────────────────────────────────────────────────────┤ 2023-08-31T22:01:01.1793152Z │ average DNS lookup time: 4ms [min: 129µs, max: 10ms, s.d.: 5ms] │ 2023-08-31T22:01:01.1793565Z ├───────────────────────────────────────────────────────────────────┤ 2023-08-31T22:01:01.1793962Z │ average first byte time: 219ms [min: 812µs, max: 5s, s.d.: 790ms] │ 2023-08-31T22:01:01.1794362Z └───────────────────────────────────────────────────────────────────┘ 2023-08-31T22:01:01.2712758Z Current date and time : 2023-08-31 21:59:07 2023-08-31T22:01:01.2713910Z ## In directory: /home/runner/work/serve/serve; Executing command: conda install -c pytorch-nightly torchserve torch-model-archiver torch-workflow-archiver 2023-08-31T22:01:01.2714642Z ## Starting generate_mars, mar_config:/home/runner/work/serve/serve/ts_scripts/../ts_scripts/mar_config.json, model_store_dir:/home/runner/work/serve/serve/ts_scripts/../model_store_gen 2023-08-31T22:01:01.2715098Z 2023-08-31T22:01:01.2716237Z ## In directory: /home/runner/work/serve/serve | Executing command: torch-model-archiver --model-name fastrcnn --version 1.0 --model-file examples/object_detector/fast-rcnn/model.py --serialized-file /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fasterrcnn_resnet50_fpn_coco-258fb6c6.pth --handler object_detector --extra-files examples/object_detector/index_to_name.json --archive-format zip-store --export-path /home/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-08-31T22:01:01.2717118Z 2023-08-31T22:01:01.2717297Z ## fastrcnn.mar is generated. 2023-08-31T22:01:01.2717523Z 2023-08-31T22:01:01.2718586Z ## In directory: /home/runner/work/serve/serve | Executing command: torch-model-archiver --model-name alexnet --version 1.0 --model-file examples/image_classifier/alexnet/model.py --serialized-file /home/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet-owt-7be5be79.pth --handler image_classifier --extra-files examples/image_classifier/index_to_name.json --archive-format zip-store --export-path /home/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-08-31T22:01:01.2719322Z 2023-08-31T22:01:01.2719492Z ## alexnet.mar is generated. 2023-08-31T22:01:01.2723416Z 2023-08-31T22:01:01.2724967Z ## In directory: /home/runner/work/serve/serve | Executing command: torch-model-archiver --model-name densenet161 --version 1.0 --model-file examples/image_classifier/densenet_161/model.py --serialized-file /home/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161-8d451a50.pth --handler image_classifier --extra-files examples/image_classifier/index_to_name.json --archive-format zip-store --export-path /home/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-08-31T22:01:01.2725755Z 2023-08-31T22:01:01.2725955Z ## densenet161.mar is generated. 2023-08-31T22:01:01.2726186Z 2023-08-31T22:01:01.2727465Z ## In directory: /home/runner/work/serve/serve | Executing command: torch-model-archiver --model-name mnist --version 1.0 --model-file examples/image_classifier/mnist/mnist.py --serialized-file examples/image_classifier/mnist/mnist_cnn.pt --handler examples/image_classifier/mnist/mnist_handler.py --archive-format zip-store --export-path /home/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-08-31T22:01:01.2729402Z 2023-08-31T22:01:01.2730531Z ## mnist.mar is generated. 2023-08-31T22:01:01.2730774Z 2023-08-31T22:01:01.2731875Z ## In directory: /home/runner/work/serve/serve | Executing command: torch-model-archiver --model-name resnet-152-batch --version 1.0 --model-file examples/image_classifier/resnet_152_batch/model.py --serialized-file /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet152-394f9c45.pth --handler image_classifier --extra-files examples/image_classifier/index_to_name.json --archive-format zip-store --export-path /home/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-08-31T22:01:01.2732622Z 2023-08-31T22:01:01.2732865Z ## resnet-152-batch.mar is generated. 2023-08-31T22:01:01.2733098Z 2023-08-31T22:01:01.2734157Z ## In directory: /home/runner/work/serve/serve | Executing command: torch-model-archiver --model-name resnet-18 --version 1.0 --model-file examples/image_classifier/resnet_18/model.py --serialized-file /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet18-f37072fd.pth --handler image_classifier --extra-files examples/image_classifier/index_to_name.json --archive-format zip-store --export-path /home/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-08-31T22:01:01.2735894Z 2023-08-31T22:01:01.2736146Z ## resnet-18.mar is generated. 2023-08-31T22:01:01.2736363Z 2023-08-31T22:01:01.2737430Z ## In directory: /home/runner/work/serve/serve | Executing command: torch-model-archiver --model-name squeezenet1_1 --version 1.0 --model-file examples/image_classifier/squeezenet/model.py --serialized-file /home/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1-b8a52dc0.pth --handler image_classifier --extra-files examples/image_classifier/index_to_name.json --archive-format zip-store --export-path /home/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-08-31T22:01:01.2738150Z 2023-08-31T22:01:01.2738326Z ## squeezenet1_1.mar is generated. 2023-08-31T22:01:01.2738541Z 2023-08-31T22:01:01.2739742Z ## In directory: /home/runner/work/serve/serve | Executing command: torch-model-archiver --model-name vgg16 --version 1.0 --model-file examples/image_classifier/vgg_16/model.py --serialized-file /home/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16-397923af.pth --handler examples/image_classifier/vgg_16/vgg_handler.py --extra-files examples/image_classifier/index_to_name.json --archive-format zip-store --export-path /home/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-08-31T22:01:01.2741105Z 2023-08-31T22:01:01.2741283Z ## vgg16.mar is generated. 2023-08-31T22:01:01.2741515Z 2023-08-31T22:01:01.2743072Z ## In directory: /home/runner/work/serve/serve | Executing command: torch-model-archiver --model-name deeplabv3_resnet_101_eager --version 1.0 --model-file examples/image_segmenter/deeplabv3/model.py --serialized-file /home/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet101_coco-586e9e4e.pth --handler image_segmenter --extra-files examples/image_segmenter/deeplabv3/deeplabv3.py,examples/image_segmenter/deeplabv3/intermediate_layer_getter.py,examples/image_segmenter/deeplabv3/fcn.py --archive-format zip-store --export-path /home/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-08-31T22:01:01.2779108Z 2023-08-31T22:01:01.2779325Z ## deeplabv3_resnet_101_eager.mar is generated. 2023-08-31T22:01:01.2779513Z 2023-08-31T22:01:01.2780736Z ## In directory: /home/runner/work/serve/serve | Executing command: torch-model-archiver --model-name fcn_resnet_101 --version 1.0 --model-file examples/image_segmenter/fcn/model.py --serialized-file /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet101_coco-7ecb50ca.pth --handler image_segmenter --extra-files examples/image_segmenter/fcn/fcn.py,examples/image_segmenter/fcn/intermediate_layer_getter.py --archive-format zip-store --export-path /home/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-08-31T22:01:01.2781724Z 2023-08-31T22:01:01.2781823Z ## fcn_resnet_101.mar is generated. 2023-08-31T22:01:01.2781978Z 2023-08-31T22:01:01.2782999Z ## In directory: /home/runner/work/serve/serve | Executing command: torch-model-archiver --model-name maskrcnn --version 1.0 --model-file examples/object_detector/maskrcnn/model.py --serialized-file /home/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn_resnet50_fpn_coco-bf2d0c1e.pth --handler object_detector --extra-files examples/object_detector/index_to_name.json --archive-format zip-store --export-path /home/runner/work/serve/serve/ts_scripts/../model_store_gen --force 2023-08-31T22:01:01.2783648Z 2023-08-31T22:01:01.2783754Z ## maskrcnn.mar is generated. 2023-08-31T22:01:01.2783900Z 2023-08-31T22:01:01.2784003Z ## Starting gen_mar: model_store 2023-08-31T22:01:01.2784153Z 2023-08-31T22:01:01.2784253Z ## Create symlink for mar files 2023-08-31T22:01:01.2784400Z 2023-08-31T22:01:01.2784737Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-08-31T22:01:01.2785228Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-08-31T22:01:01.2785692Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-08-31T22:01:01.2786161Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-08-31T22:01:01.2786636Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-08-31T22:01:01.2787258Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-08-31T22:01:01.2787731Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-08-31T22:01:01.2788187Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-08-31T22:01:01.2788645Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-08-31T22:01:01.2789109Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-08-31T22:01:01.2789622Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-08-31T22:01:01.2789990Z ## Starting TorchServe 2023-08-31T22:01:01.2790250Z ## Console logs redirected to file: ts_console.log 2023-08-31T22:01:01.2790763Z ## In directory: /home/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs 2023-08-31T22:01:01.2791127Z ## Successfully started TorchServe 2023-08-31T22:01:01.2791365Z ## Stopping TorchServe 2023-08-31T22:01:01.2791888Z ## In directory: /home/runner/work/serve/serve/test | Executing command: ['torchserve', '--stop'] 2023-08-31T22:01:01.2792222Z ## Successfully stopped TorchServe 2023-08-31T22:01:01.2792466Z ## Starting gen_mar: model_store 2023-08-31T22:01:01.2792604Z 2023-08-31T22:01:03.1641647Z newman 2023-08-31T22:01:03.1642074Z 2023-08-31T22:01:03.1644030Z inference 2023-08-31T22:01:03.1648530Z 2023-08-31T22:01:03.1648752Z Iteration 1/24 2023-08-31T22:01:03.1670425Z 2023-08-31T22:01:03.1670934Z → Model Zoo - Register Model 2023-08-31T22:01:11.4524279Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/my_text_classifier_v4.mar&model_name=my_text_classifier&initial_workers=1&synchronous=true 2023-08-31T22:01:11.4531065Z 200 OK ★ 8.2s time ★ 388B↑ 360B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:11.4537846Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 94B 2023-08-31T22:01:11.4542653Z │ { 2023-08-31T22:01:11.4543239Z │ "status": "Model \"my_text_classifier\" Version: 1.0 2023-08-31T22:01:11.4544095Z │ registered with 1 initial workers" 2023-08-31T22:01:11.4544683Z │ } 2023-08-31T22:01:11.4630113Z └ 2023-08-31T22:01:11.4630869Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:11.4631582Z 24ms 5ms 13ms 310µs 8.2s 10ms 398µs 8.2s 2023-08-31T22:01:11.4631951Z 2023-08-31T22:01:11.4844577Z ✓ Successful POST request 2023-08-31T22:01:11.4975329Z 2023-08-31T22:01:11.4975913Z → Model Zoo - Inference Model 2023-08-31T22:01:11.6102238Z POST http://localhost:8080/predictions/my_text_classifier 2023-08-31T22:01:11.6107331Z 200 OK ★ 97ms time ★ 353B↑ 373B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:01:11.6111446Z ┌ ↑ file ★ 76B 2023-08-31T22:01:11.6114948Z │ 2023-08-31T22:01:11.6119905Z └ 2023-08-31T22:01:11.6123786Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 138B 2023-08-31T22:01:11.6127730Z │ { 2023-08-31T22:01:11.6128240Z │ "World": 0.029119664803147316, 2023-08-31T22:01:11.6128908Z │ "Sports": 2.943157232948579e-05, 2023-08-31T22:01:11.6129844Z │ "Business": 0.9074352383613586, 2023-08-31T22:01:11.6130196Z │ "Sci/Tec": 0.06341569125652313 2023-08-31T22:01:11.6130438Z │ } 2023-08-31T22:01:11.6156389Z └ 2023-08-31T22:01:11.6157097Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:11.6157789Z 6ms 1ms 33ms 369µs 54ms 6ms 80µs 103ms 2023-08-31T22:01:11.6158147Z 2023-08-31T22:01:11.6253939Z ✓ Successful POST request 2023-08-31T22:01:11.6267151Z ✓ Test expected JSON response 2023-08-31T22:01:11.6336258Z 2023-08-31T22:01:11.6339294Z → Model Zoo - Unregister model 2023-08-31T22:01:11.7157397Z DELETE http://localhost:8081/models/my_text_classifier 2023-08-31T22:01:11.7160145Z 200 OK ★ 75ms time ★ 254B↑ 326B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:11.7162588Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 60B 2023-08-31T22:01:11.7164729Z │ { 2023-08-31T22:01:11.7165282Z │ "status": "Model \"my_text_classifier\" unregistered 2023-08-31T22:01:11.7165940Z │ " 2023-08-31T22:01:11.7166466Z │ } 2023-08-31T22:01:11.7183104Z └ 2023-08-31T22:01:11.7183784Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:11.7184695Z 1ms 594µs (cache) (cache) 71ms 2ms 77µs 76ms 2023-08-31T22:01:11.7185045Z 2023-08-31T22:01:11.7234611Z ✓ Successful DELETE request 2023-08-31T22:01:11.7283877Z 2023-08-31T22:01:11.7284388Z → Model Zoo - Model Metrics 2023-08-31T22:01:11.7539752Z GET http://localhost:8082/metrics 2023-08-31T22:01:11.7540578Z 200 OK ★ 20ms time ★ 233B↑ 3.84kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:11.7541617Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 3.55kB 2023-08-31T22:01:11.7542225Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:01:11.7543110Z │ c with unit: Count 2023-08-31T22:01:11.7543857Z │ # TYPE Requests2XX counter 2023-08-31T22:01:11.7544795Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 3.0 2023-08-31T22:01:11.7545351Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:01:11.7546175Z │ c with unit: Count 2023-08-31T22:01:11.7546605Z │ # TYPE Requests5XX counter 2023-08-31T22:01:11.7547470Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:01:11.7547996Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:01:11.7548894Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:01:11.7549644Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:11.7550562Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:01:11.7551003Z │ -190",} 23938.584 2023-08-31T22:01:11.7551874Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:01:11.7552353Z │ ic with unit: Milliseconds 2023-08-31T22:01:11.7553178Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:01:11.7553696Z │ WorkerLoadTime{WorkerName="W-9000-my_text_classifier_1 2023-08-31T22:01:11.7554578Z │ .0",Level="Host",Hostname="fv-az628-190",} 3273.0 2023-08-31T22:01:11.7555098Z │ # HELP ts_inference_requests_total Torchserve promethe 2023-08-31T22:01:11.7555938Z │ us counter metric with unit: Count 2023-08-31T22:01:11.7556427Z │ # TYPE ts_inference_requests_total counter 2023-08-31T22:01:11.7557305Z │ ts_inference_requests_total{model_name="my_text_classi 2023-08-31T22:01:11.7557828Z │ fier",model_version="default",hostname="fv-az628-190", 2023-08-31T22:01:11.7558634Z │ } 1.0 2023-08-31T22:01:11.7559117Z │ # HELP Requests4XX Torchserve prometheus counter metri 2023-08-31T22:01:11.7559953Z │ c with unit: Count 2023-08-31T22:01:11.7560374Z │ # TYPE Requests4XX counter 2023-08-31T22:01:11.7561242Z │ # HELP GPUMemoryUsed Torchserve prometheus gauge metri 2023-08-31T22:01:11.7561712Z │ c with unit: Megabytes 2023-08-31T22:01:11.7562509Z │ # TYPE GPUMemoryUsed gauge 2023-08-31T22:01:11.7563014Z │ # HELP DiskUsage Torchserve prometheus gauge metric wi 2023-08-31T22:01:11.7563841Z │ th unit: Gigabytes 2023-08-31T22:01:11.7564250Z │ # TYPE DiskUsage gauge 2023-08-31T22:01:11.7565096Z │ DiskUsage{Level="Host",Hostname="fv-az628-190",} 70.05 2023-08-31T22:01:11.7565512Z │ 369186401367 2023-08-31T22:01:11.7566451Z │ # HELP ts_queue_latency_microseconds Torchserve promet 2023-08-31T22:01:11.7566971Z │ heus counter metric with unit: Microseconds 2023-08-31T22:01:11.7567863Z │ # TYPE ts_queue_latency_microseconds counter 2023-08-31T22:01:11.7568373Z │ ts_queue_latency_microseconds{model_name="my_text_clas 2023-08-31T22:01:11.7569289Z │ sifier",model_version="default",hostname="fv-az628-190 2023-08-31T22:01:11.7569726Z │ ",} 103.1 2023-08-31T22:01:11.7570578Z │ # HELP MemoryAvailable Torchserve prometheus gauge met 2023-08-31T22:01:11.7571046Z │ ric with unit: Megabytes 2023-08-31T22:01:11.7571868Z │ # TYPE MemoryAvailable gauge 2023-08-31T22:01:11.7572382Z │ MemoryAvailable{Level="Host",Hostname="fv-az628-190",} 2023-08-31T22:01:11.7573179Z │ 5470.21484375 2023-08-31T22:01:11.7573659Z │ # HELP PredictionTime Torchserve prometheus gauge metr 2023-08-31T22:01:11.7574482Z │ ic with unit: ms 2023-08-31T22:01:11.7574914Z │ # TYPE PredictionTime gauge 2023-08-31T22:01:11.7575771Z │ PredictionTime{ModelName="my_text_classifier",Level="M 2023-08-31T22:01:11.7576265Z │ odel",Hostname="fv-az628-190",} 20.91 2023-08-31T22:01:11.7577134Z │ # HELP HandlerTime Torchserve prometheus gauge metric 2023-08-31T22:01:11.7577565Z │ with un 2023-08-31T22:01:11.7578340Z │ (showing 2.05kB/3.55kB) 2023-08-31T22:01:11.7578762Z └ 2023-08-31T22:01:11.7579693Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:11.7580337Z 1ms 657µs 184µs 244µs 16ms 1ms 59µs 20ms 2023-08-31T22:01:11.7581056Z 2023-08-31T22:01:11.7659800Z ✓ Successful GET request 2023-08-31T22:01:11.7697613Z 2023-08-31T22:01:11.7698102Z Iteration 2/24 2023-08-31T22:01:11.7712587Z 2023-08-31T22:01:11.7712937Z → Model Zoo - Register Model 2023-08-31T22:01:18.2392644Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/my_text_classifier_scripted_v3.mar&model_name=my_text_classifier_scripted&initial_workers=1&synchronous=true 2023-08-31T22:01:18.2393976Z 200 OK ★ 6.4s time ★ 406B↑ 370B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:18.2394681Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 103B 2023-08-31T22:01:18.2397650Z │ { 2023-08-31T22:01:18.2398489Z │ "status": "Model \"my_text_classifier_scripted\" Ver 2023-08-31T22:01:18.2399101Z │ sion: 1.0 registered with 1 initial workers" 2023-08-31T22:01:18.2401567Z │ } 2023-08-31T22:01:18.2401908Z └ 2023-08-31T22:01:18.2450821Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:18.2451364Z 1ms 358µs (cache) (cache) 6.4s 2ms 89µs 6.4s 2023-08-31T22:01:18.2451564Z 2023-08-31T22:01:18.2493966Z ✓ Successful POST request 2023-08-31T22:01:18.2557772Z 2023-08-31T22:01:18.2558242Z → Model Zoo - Inference Model 2023-08-31T22:01:18.3234445Z POST http://localhost:8080/predictions/my_text_classifier_scripted 2023-08-31T22:01:18.3238010Z 200 OK ★ 59ms time ★ 362B↑ 372B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:01:18.3241404Z ┌ ↑ file ★ 76B 2023-08-31T22:01:18.3245093Z │ 2023-08-31T22:01:18.3248311Z └ 2023-08-31T22:01:18.3251550Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 137B 2023-08-31T22:01:18.3254567Z │ { 2023-08-31T22:01:18.3255081Z │ "World": 0.04559723287820816, 2023-08-31T22:01:18.3255928Z │ "Sports": 0.0003771767660509795, 2023-08-31T22:01:18.3256289Z │ "Business": 0.08623101562261581, 2023-08-31T22:01:18.3256584Z │ "Sci/Tec": 0.8677946329116821 2023-08-31T22:01:18.3256817Z │ } 2023-08-31T22:01:18.3290616Z └ 2023-08-31T22:01:18.3291754Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:18.3292320Z 2ms 331µs (cache) (cache) 55ms 2ms 53µs 61ms 2023-08-31T22:01:18.3292526Z 2023-08-31T22:01:18.3355014Z ✓ Successful POST request 2023-08-31T22:01:18.3361689Z ✓ Test expected JSON response 2023-08-31T22:01:18.3433615Z 2023-08-31T22:01:18.3434119Z → Model Zoo - Unregister model 2023-08-31T22:01:18.4181929Z DELETE http://localhost:8081/models/my_text_classifier_scripted 2023-08-31T22:01:18.4182971Z 200 OK ★ 69ms time ★ 263B↑ 335B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:18.4183942Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 69B 2023-08-31T22:01:18.4184278Z │ { 2023-08-31T22:01:18.4184626Z │ "status": "Model \"my_text_classifier_scripted\" unr 2023-08-31T22:01:18.4184929Z │ egistered" 2023-08-31T22:01:18.4185150Z │ } 2023-08-31T22:01:18.4213188Z └ 2023-08-31T22:01:18.4228830Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:18.4229580Z 1ms 304µs (cache) (cache) 66ms 1ms 49µs 70ms 2023-08-31T22:01:18.4229953Z 2023-08-31T22:01:18.4268767Z ✓ Successful DELETE request 2023-08-31T22:01:18.4322385Z 2023-08-31T22:01:18.4322908Z → Model Zoo - Model Metrics 2023-08-31T22:01:18.4426241Z GET http://localhost:8082/metrics 2023-08-31T22:01:18.4428162Z 200 OK ★ 5ms time ★ 233B↑ 4.54kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:18.4434764Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 4.25kB 2023-08-31T22:01:18.4438156Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:01:18.4438504Z │ c with unit: Count 2023-08-31T22:01:18.4438821Z │ # TYPE Requests2XX counter 2023-08-31T22:01:18.4439176Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 7.0 2023-08-31T22:01:18.4439562Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:01:18.4439868Z │ c with unit: Count 2023-08-31T22:01:18.4440437Z │ # TYPE Requests5XX counter 2023-08-31T22:01:18.4440809Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:01:18.4441196Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:01:18.4441561Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:01:18.4441940Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:18.4442316Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:01:18.4442612Z │ -190",} 23938.584 2023-08-31T22:01:18.4442924Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:18.4443477Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:01:18.4443786Z │ "fv-az628-190",} 52504.044 2023-08-31T22:01:18.4444122Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:01:18.4444443Z │ ic with unit: Milliseconds 2023-08-31T22:01:18.4444727Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:01:18.4445066Z │ WorkerLoadTime{WorkerName="W-9000-my_text_classifier_1 2023-08-31T22:01:18.4445442Z │ .0",Level="Host",Hostname="fv-az628-190",} 3273.0 2023-08-31T22:01:18.4445802Z │ WorkerLoadTime{WorkerName="W-9001-my_text_classifier_s 2023-08-31T22:01:18.4446152Z │ cripted_1.0",Level="Host",Hostname="fv-az628-190",} 26 2023-08-31T22:01:18.4446662Z │ 26.0 2023-08-31T22:01:18.4446980Z │ # HELP ts_inference_requests_total Torchserve promethe 2023-08-31T22:01:18.4447324Z │ us counter metric with unit: Count 2023-08-31T22:01:18.4447652Z │ # TYPE ts_inference_requests_total counter 2023-08-31T22:01:18.4448011Z │ ts_inference_requests_total{model_name="my_text_classi 2023-08-31T22:01:18.4448393Z │ fier",model_version="default",hostname="fv-az628-190", 2023-08-31T22:01:18.4448658Z │ } 1.0 2023-08-31T22:01:18.4448963Z │ ts_inference_requests_total{model_name="my_text_classi 2023-08-31T22:01:18.4449336Z │ fier_scripted",model_version="default",hostname="fv-az 2023-08-31T22:01:18.4449615Z │ 628-190",} 1.0 2023-08-31T22:01:18.4449954Z │ # HELP Requests4XX Torchserve prometheus counter metri 2023-08-31T22:01:18.4450264Z │ c with unit: Count 2023-08-31T22:01:18.4450535Z │ # TYPE Requests4XX counter 2023-08-31T22:01:18.4450872Z │ # HELP GPUMemoryUsed Torchserve prometheus gauge metri 2023-08-31T22:01:18.4451180Z │ c with unit: Megabytes 2023-08-31T22:01:18.4451454Z │ # TYPE GPUMemoryUsed gauge 2023-08-31T22:01:18.4451795Z │ # HELP DiskUsage Torchserve prometheus gauge metric wi 2023-08-31T22:01:18.4452090Z │ th unit: Gigabytes 2023-08-31T22:01:18.4452355Z │ # TYPE DiskUsage gauge 2023-08-31T22:01:18.4452688Z │ DiskUsage{Level="Host",Hostname="fv-az628-190",} 70.05 2023-08-31T22:01:18.4452960Z │ 369186401367 2023-08-31T22:01:18.4453282Z │ # HELP ts_queue_latency_microseconds Torchserve promet 2023-08-31T22:01:18.4453635Z │ heus counter metric with unit: Microseconds 2023-08-31T22:01:18.4453983Z │ # TYPE ts_queue_latency_microseconds counter 2023-08-31T22:01:18.4454345Z │ ts_queue_latency_microseconds{model_name="my_text_clas 2023-08-31T22:01:18.4454721Z │ sifier",model_version="default",hostname="fv-az628-190 2023-08-31T22:01:18.4454990Z │ ",} 103.1 2023-08-31T22:01:18.4455292Z │ ts_queue_latency_microseconds{model_name="my_text_clas 2023-08-31T22:01:18.4455561Z │ sifi 2023-08-31T22:01:18.4455800Z │ (showing 2.05kB/4.25kB) 2023-08-31T22:01:18.4460465Z └ 2023-08-31T22:01:18.4461071Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:18.4463701Z 1ms 263µs (cache) (cache) 2ms 1ms 48µs 5ms 2023-08-31T22:01:18.4464090Z 2023-08-31T22:01:18.4524181Z ✓ Successful GET request 2023-08-31T22:01:18.4594203Z 2023-08-31T22:01:18.4594688Z Iteration 3/24 2023-08-31T22:01:18.4609513Z 2023-08-31T22:01:18.4609991Z → Model Zoo - Register Model 2023-08-31T22:01:20.2744789Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&initial_workers=1&synchronous=true 2023-08-31T22:01:20.2747740Z 200 OK ★ 1807ms time ★ 334B↑ 355B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:20.2750065Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 89B 2023-08-31T22:01:20.2752083Z │ { 2023-08-31T22:01:20.2753029Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:01:20.2753430Z │ stered with 1 initial workers" 2023-08-31T22:01:20.2753676Z │ } 2023-08-31T22:01:20.2773300Z └ 2023-08-31T22:01:20.2774158Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:20.2774708Z 1ms 350µs (cache) (cache) 1804ms 1ms 50µs 1808ms 2023-08-31T22:01:20.2775189Z 2023-08-31T22:01:20.2830632Z ✓ Successful POST request 2023-08-31T22:01:20.2912659Z 2023-08-31T22:01:20.2913146Z → Model Zoo - Inference Model 2023-08-31T22:01:20.3763645Z POST http://localhost:8080/predictions/squeezenet1_1 2023-08-31T22:01:20.3764703Z 200 OK ★ 77ms time ★ 111.25kB↑ 409B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:01:20.3765601Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:01:20.3766941Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:01:20.3767889Z └ 2023-08-31T22:01:20.3769359Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 174B 2023-08-31T22:01:20.3770180Z │ { 2023-08-31T22:01:20.3770953Z │ "tabby": 0.27850738167762756, 2023-08-31T22:01:20.3771319Z │ "lynx": 0.25299158692359924, 2023-08-31T22:01:20.3771612Z │ "tiger_cat": 0.24496474862098694, 2023-08-31T22:01:20.3771933Z │ "Egyptian_cat": 0.21722468733787537, 2023-08-31T22:01:20.3772221Z │ "cougar": 0.002217544475570321 2023-08-31T22:01:20.3772510Z │ } 2023-08-31T22:01:20.3793683Z └ 2023-08-31T22:01:20.3794154Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:20.3794671Z 2ms 519µs (cache) (cache) 74ms 1ms 52µs 79ms 2023-08-31T22:01:20.3794870Z 2023-08-31T22:01:20.3846650Z ✓ Successful POST request 2023-08-31T22:01:20.3851379Z ✓ Test expected JSON response 2023-08-31T22:01:20.3900189Z 2023-08-31T22:01:20.3900737Z → Model Zoo - Unregister model 2023-08-31T22:01:20.4060992Z DELETE http://localhost:8081/models/squeezenet1_1 2023-08-31T22:01:20.4064441Z 200 OK ★ 10ms time ★ 249B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:20.4067553Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:01:20.4070525Z │ { 2023-08-31T22:01:20.4071093Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:01:20.4088680Z │ } 2023-08-31T22:01:20.4106351Z └ 2023-08-31T22:01:20.4106896Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:20.4107409Z 1ms 265µs (cache) (cache) 8ms 1ms 136µs 11ms 2023-08-31T22:01:20.4107608Z 2023-08-31T22:01:20.4157599Z ✓ Successful DELETE request 2023-08-31T22:01:20.4211284Z 2023-08-31T22:01:20.4211586Z → Model Zoo - Model Metrics 2023-08-31T22:01:20.4313142Z GET http://localhost:8082/metrics 2023-08-31T22:01:20.4316502Z 200 OK ★ 5ms time ★ 233B↑ 5.15kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:20.4319935Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 4.86kB 2023-08-31T22:01:20.4323110Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:01:20.4323690Z │ c with unit: Count 2023-08-31T22:01:20.4324375Z │ # TYPE Requests2XX counter 2023-08-31T22:01:20.4324801Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 11. 2023-08-31T22:01:20.4325087Z │ 0 2023-08-31T22:01:20.4325409Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:01:20.4325764Z │ c with unit: Count 2023-08-31T22:01:20.4326042Z │ # TYPE Requests5XX counter 2023-08-31T22:01:20.4326555Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:01:20.4326934Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:01:20.4327313Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:01:20.4327720Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:20.4328092Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:01:20.4328393Z │ -190",} 23938.584 2023-08-31T22:01:20.4328721Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:20.4329077Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:01:20.4329393Z │ "fv-az628-190",} 52504.044 2023-08-31T22:01:20.4329723Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:20.4330084Z │ et1_1",model_version="default",hostname="fv-az628-190" 2023-08-31T22:01:20.4330645Z │ ,} 69484.525 2023-08-31T22:01:20.4330978Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:01:20.4331300Z │ ic with unit: Milliseconds 2023-08-31T22:01:20.4331615Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:01:20.4331973Z │ WorkerLoadTime{WorkerName="W-9000-my_text_classifier_1 2023-08-31T22:01:20.4332328Z │ .0",Level="Host",Hostname="fv-az628-190",} 3273.0 2023-08-31T22:01:20.4332705Z │ WorkerLoadTime{WorkerName="W-9002-squeezenet1_1_1.0",L 2023-08-31T22:01:20.4333062Z │ evel="Host",Hostname="fv-az628-190",} 1772.0 2023-08-31T22:01:20.4333423Z │ WorkerLoadTime{WorkerName="W-9001-my_text_classifier_s 2023-08-31T22:01:20.4333786Z │ cripted_1.0",Level="Host",Hostname="fv-az628-190",} 26 2023-08-31T22:01:20.4334039Z │ 26.0 2023-08-31T22:01:20.4334362Z │ # HELP ts_inference_requests_total Torchserve promethe 2023-08-31T22:01:20.4334708Z │ us counter metric with unit: Count 2023-08-31T22:01:20.4335036Z │ # TYPE ts_inference_requests_total counter 2023-08-31T22:01:20.4335406Z │ ts_inference_requests_total{model_name="my_text_classi 2023-08-31T22:01:20.4335775Z │ fier",model_version="default",hostname="fv-az628-190", 2023-08-31T22:01:20.4336039Z │ } 1.0 2023-08-31T22:01:20.4336342Z │ ts_inference_requests_total{model_name="my_text_classi 2023-08-31T22:01:20.4336699Z │ fier_scripted",model_version="default",hostname="fv-az 2023-08-31T22:01:20.4336970Z │ 628-190",} 1.0 2023-08-31T22:01:20.4337303Z │ ts_inference_requests_total{model_name="squeezenet1_1" 2023-08-31T22:01:20.4337672Z │ ,model_version="default",hostname="fv-az628-190",} 1.0 2023-08-31T22:01:20.4338047Z │ # HELP Requests4XX Torchserve prometheus counter metri 2023-08-31T22:01:20.4338337Z │ c with unit: Count 2023-08-31T22:01:20.4338614Z │ # TYPE Requests4XX counter 2023-08-31T22:01:20.4338965Z │ # HELP GPUMemoryUsed Torchserve prometheus gauge metri 2023-08-31T22:01:20.4339270Z │ c with unit: Megabytes 2023-08-31T22:01:20.4339547Z │ # TYPE GPUMemoryUsed gauge 2023-08-31T22:01:20.4339907Z │ # HELP DiskUsage Torchserve prometheus gauge metric wi 2023-08-31T22:01:20.4340196Z │ th unit: Gigabytes 2023-08-31T22:01:20.4340458Z │ # TYPE DiskUsage gauge 2023-08-31T22:01:20.4340789Z │ DiskUsage{Level="Host",Hostname="fv-az628-190",} 70.05 2023-08-31T22:01:20.4341046Z │ 36 2023-08-31T22:01:20.4341296Z │ (showing 2.05kB/4.86kB) 2023-08-31T22:01:20.4341825Z └ 2023-08-31T22:01:20.4342391Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:20.4342897Z 1ms 255µs (cache) (cache) 2ms 1ms 57µs 5ms 2023-08-31T22:01:20.4343095Z 2023-08-31T22:01:20.4400416Z ✓ Successful GET request 2023-08-31T22:01:20.4433597Z 2023-08-31T22:01:20.4433754Z Iteration 4/24 2023-08-31T22:01:20.4447956Z 2023-08-31T22:01:20.4448357Z → Model Zoo - Register Model 2023-08-31T22:01:22.4456346Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/squeezenet1_1_scripted.mar&model_name=squeezenet1_1_scripted&initial_workers=1&synchronous=true 2023-08-31T22:01:22.4457545Z 200 OK ★ 1995ms time ★ 393B↑ 364B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:22.4459926Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 98B 2023-08-31T22:01:22.4461741Z │ { 2023-08-31T22:01:22.4462082Z │ "status": "Model \"squeezenet1_1_scripted\" Version: 2023-08-31T22:01:22.4462479Z │ 1.0 registered with 1 initial workers" 2023-08-31T22:01:22.4462747Z │ } 2023-08-31T22:01:22.4482460Z └ 2023-08-31T22:01:22.4483124Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:22.4483720Z 1ms 614µs (cache) (cache) 1991ms 1ms 45µs 1996ms 2023-08-31T22:01:22.4483994Z 2023-08-31T22:01:22.4539567Z ✓ Successful POST request 2023-08-31T22:01:22.4581623Z 2023-08-31T22:01:22.4582028Z → Model Zoo - Inference Model 2023-08-31T22:01:22.5789407Z POST http://localhost:8080/predictions/squeezenet1_1_scripted 2023-08-31T22:01:22.5790469Z 200 OK ★ 114ms time ★ 111.25kB↑ 409B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:01:22.5790927Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:01:22.5791296Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:01:22.5791617Z └ 2023-08-31T22:01:22.5792016Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 174B 2023-08-31T22:01:22.5792393Z │ { 2023-08-31T22:01:22.5792727Z │ "tabby": 0.27850738167762756, 2023-08-31T22:01:22.5793109Z │ "lynx": 0.25299158692359924, 2023-08-31T22:01:22.5793473Z │ "tiger_cat": 0.24496474862098694, 2023-08-31T22:01:22.5793842Z │ "Egyptian_cat": 0.21722468733787537, 2023-08-31T22:01:22.5794205Z │ "cougar": 0.002217544475570321 2023-08-31T22:01:22.5794512Z │ } 2023-08-31T22:01:22.5831402Z └ 2023-08-31T22:01:22.5831907Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:22.5832489Z 2ms 309µs (cache) (cache) 111ms 1ms 39µs 115ms 2023-08-31T22:01:22.5832778Z 2023-08-31T22:01:22.5893291Z ✓ Successful POST request 2023-08-31T22:01:22.5896824Z ✓ Test expected JSON response 2023-08-31T22:01:22.5943796Z 2023-08-31T22:01:22.5944365Z → Model Zoo - Unregister model 2023-08-31T22:01:22.6146385Z DELETE http://localhost:8081/models/squeezenet1_1_scripted 2023-08-31T22:01:22.6147314Z 200 OK ★ 15ms time ★ 258B↑ 330B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:22.6148292Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 64B 2023-08-31T22:01:22.6148606Z │ { 2023-08-31T22:01:22.6148956Z │ "status": "Model \"squeezenet1_1_scripted\" unregist 2023-08-31T22:01:22.6149249Z │ ered" 2023-08-31T22:01:22.6149463Z │ } 2023-08-31T22:01:22.6184418Z └ 2023-08-31T22:01:22.6185150Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:22.6185853Z 1ms 318µs (cache) (cache) 10ms 3ms 43µs 15ms 2023-08-31T22:01:22.6186275Z 2023-08-31T22:01:22.6290364Z ✓ Successful DELETE request 2023-08-31T22:01:22.6335526Z 2023-08-31T22:01:22.6336049Z → Model Zoo - Model Metrics 2023-08-31T22:01:22.6436836Z GET http://localhost:8082/metrics 2023-08-31T22:01:22.6437444Z 200 OK ★ 4ms time ★ 233B↑ 5.82kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:22.6437868Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 5.53kB 2023-08-31T22:01:22.6438583Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:01:22.6438915Z │ c with unit: Count 2023-08-31T22:01:22.6439202Z │ # TYPE Requests2XX counter 2023-08-31T22:01:22.6439561Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 15. 2023-08-31T22:01:22.6439829Z │ 0 2023-08-31T22:01:22.6440157Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:01:22.6440466Z │ c with unit: Count 2023-08-31T22:01:22.6440737Z │ # TYPE Requests5XX counter 2023-08-31T22:01:22.6441088Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:01:22.6441652Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:01:22.6442015Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:01:22.6442391Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:22.6442762Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:01:22.6443053Z │ -190",} 23938.584 2023-08-31T22:01:22.6443377Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:22.6443757Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:01:22.6444071Z │ "fv-az628-190",} 52504.044 2023-08-31T22:01:22.6444394Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:22.6444766Z │ et1_1_scripted",model_version="default",hostname="fv-a 2023-08-31T22:01:22.6445064Z │ z628-190",} 107621.885 2023-08-31T22:01:22.6445374Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:22.6445740Z │ et1_1",model_version="default",hostname="fv-az628-190" 2023-08-31T22:01:22.6446039Z │ ,} 69484.525 2023-08-31T22:01:22.6447362Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:01:22.6447711Z │ ic with unit: Milliseconds 2023-08-31T22:01:22.6448000Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:01:22.6448359Z │ WorkerLoadTime{WorkerName="W-9000-my_text_classifier_1 2023-08-31T22:01:22.6448713Z │ .0",Level="Host",Hostname="fv-az628-190",} 3273.0 2023-08-31T22:01:22.6449107Z │ WorkerLoadTime{WorkerName="W-9002-squeezenet1_1_1.0",L 2023-08-31T22:01:22.6449464Z │ evel="Host",Hostname="fv-az628-190",} 1772.0 2023-08-31T22:01:22.6449809Z │ WorkerLoadTime{WorkerName="W-9001-my_text_classifier_s 2023-08-31T22:01:22.6450175Z │ cripted_1.0",Level="Host",Hostname="fv-az628-190",} 26 2023-08-31T22:01:22.6450441Z │ 26.0 2023-08-31T22:01:22.6450742Z │ WorkerLoadTime{WorkerName="W-9003-squeezenet1_1_script 2023-08-31T22:01:22.6451112Z │ ed_1.0",Level="Host",Hostname="fv-az628-190",} 1832.0 2023-08-31T22:01:22.6451488Z │ # HELP ts_inference_requests_total Torchserve promethe 2023-08-31T22:01:22.6451849Z │ us counter metric with unit: Count 2023-08-31T22:01:22.6452175Z │ # TYPE ts_inference_requests_total counter 2023-08-31T22:01:22.6452529Z │ ts_inference_requests_total{model_name="my_text_classi 2023-08-31T22:01:22.6452903Z │ fier",model_version="default",hostname="fv-az628-190", 2023-08-31T22:01:22.6453167Z │ } 1.0 2023-08-31T22:01:22.6453486Z │ ts_inference_requests_total{model_name="my_text_classi 2023-08-31T22:01:22.6453849Z │ fier_scripted",model_version="default",hostname="fv-az 2023-08-31T22:01:22.6454121Z │ 628-190",} 1.0 2023-08-31T22:01:22.6454438Z │ ts_inference_requests_total{model_name="squeezenet1_1_ 2023-08-31T22:01:22.6454807Z │ scripted",model_version="default",hostname="fv-az628-1 2023-08-31T22:01:22.6455073Z │ 90",} 1.0 2023-08-31T22:01:22.6455382Z │ ts_inference_requests_total{model_name="squeezenet1_1" 2023-08-31T22:01:22.6455756Z │ ,model_version="default",hostname="fv-az628-190",} 1.0 2023-08-31T22:01:22.6456079Z │ (showing 2.05kB/5.53kB) 2023-08-31T22:01:22.6456296Z └ 2023-08-31T22:01:22.6456695Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:22.6457192Z 1ms 244µs (cache) (cache) 2ms 1ms 38µs 5ms 2023-08-31T22:01:22.6457389Z 2023-08-31T22:01:22.6502414Z ✓ Successful GET request 2023-08-31T22:01:22.6533860Z 2023-08-31T22:01:22.6534375Z Iteration 5/24 2023-08-31T22:01:22.6548254Z 2023-08-31T22:01:22.6548637Z → Model Zoo - Register Model 2023-08-31T22:01:25.6063781Z POST http://localhost:8081/models?url=densenet161.mar&model_name=densenet161&initial_workers=1&synchronous=true 2023-08-31T22:01:25.6064955Z 200 OK ★ 2.9s time ★ 330B↑ 353B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:25.6065661Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 87B 2023-08-31T22:01:25.6066467Z │ { 2023-08-31T22:01:25.6066918Z │ "status": "Model \"densenet161\" Version: 1.0 regist 2023-08-31T22:01:25.6067599Z │ ered with 1 initial workers" 2023-08-31T22:01:25.6067839Z │ } 2023-08-31T22:01:25.6085797Z └ 2023-08-31T22:01:25.6088466Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:25.6088980Z 1ms 250µs (cache) (cache) 2.9s 1ms 34µs 2.9s 2023-08-31T22:01:25.6089180Z 2023-08-31T22:01:25.6155176Z ✓ Successful POST request 2023-08-31T22:01:25.6232031Z 2023-08-31T22:01:25.6232580Z → Model Zoo - Inference Model 2023-08-31T22:01:25.8345165Z POST http://localhost:8080/predictions/densenet161 2023-08-31T22:01:25.8346295Z 200 OK ★ 205ms time ★ 111.24kB↑ 418B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:01:25.8346895Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:01:25.8347649Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:01:25.8348037Z └ 2023-08-31T22:01:25.8348509Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 183B 2023-08-31T22:01:25.8349043Z │ { 2023-08-31T22:01:25.8349926Z │ "tabby": 0.46661901473999023, 2023-08-31T22:01:25.8350296Z │ "tiger_cat": 0.46449053287506104, 2023-08-31T22:01:25.8350620Z │ "Egyptian_cat": 0.06614039838314056, 2023-08-31T22:01:25.8350910Z │ "lynx": 0.0012924427865073085, 2023-08-31T22:01:25.8351214Z │ "plastic_bag": 0.00022909774270374328 2023-08-31T22:01:25.8351457Z │ } 2023-08-31T22:01:25.8361362Z └ 2023-08-31T22:01:25.8362009Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:25.8362754Z 2ms 227µs (cache) (cache) 202ms 1ms 34µs 206ms 2023-08-31T22:01:25.8363113Z 2023-08-31T22:01:25.8418615Z ✓ Successful POST request 2023-08-31T22:01:25.8425944Z ✓ Test expected JSON response 2023-08-31T22:01:25.8463239Z 2023-08-31T22:01:25.8463554Z → Model Zoo - Unregister model 2023-08-31T22:01:25.8805016Z DELETE http://localhost:8081/models/densenet161 2023-08-31T22:01:25.8805920Z 200 OK ★ 28ms time ★ 247B↑ 319B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:25.8806754Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 53B 2023-08-31T22:01:25.8807361Z │ { 2023-08-31T22:01:25.8807852Z │ "status": "Model \"densenet161\" unregistered" 2023-08-31T22:01:25.8808227Z │ } 2023-08-31T22:01:25.8825787Z └ 2023-08-31T22:01:25.8826322Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:25.8826878Z 1ms 241µs (cache) (cache) 26ms 1ms 31µs 28ms 2023-08-31T22:01:25.8827086Z 2023-08-31T22:01:25.8870662Z ✓ Successful DELETE request 2023-08-31T22:01:25.8921464Z 2023-08-31T22:01:25.8922825Z → Model Zoo - Model Metrics 2023-08-31T22:01:25.9028441Z GET http://localhost:8082/metrics 2023-08-31T22:01:25.9030292Z 200 OK ★ 4ms time ★ 233B↑ 6.43kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:25.9032350Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 6.13kB 2023-08-31T22:01:25.9034263Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:01:25.9034676Z │ c with unit: Count 2023-08-31T22:01:25.9034967Z │ # TYPE Requests2XX counter 2023-08-31T22:01:25.9035316Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 19. 2023-08-31T22:01:25.9035600Z │ 0 2023-08-31T22:01:25.9035916Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:01:25.9036211Z │ c with unit: Count 2023-08-31T22:01:25.9036489Z │ # TYPE Requests5XX counter 2023-08-31T22:01:25.9037107Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:01:25.9037502Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:01:25.9037864Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:01:25.9038239Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:01:25.9038622Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:01:25.9038896Z │ 197192.539 2023-08-31T22:01:25.9039211Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:25.9039729Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:01:25.9040009Z │ -190",} 23938.584 2023-08-31T22:01:25.9040331Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:25.9040702Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:01:25.9041006Z │ "fv-az628-190",} 52504.044 2023-08-31T22:01:25.9041336Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:25.9041711Z │ et1_1_scripted",model_version="default",hostname="fv-a 2023-08-31T22:01:25.9041999Z │ z628-190",} 107621.885 2023-08-31T22:01:25.9042307Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:25.9042675Z │ et1_1",model_version="default",hostname="fv-az628-190" 2023-08-31T22:01:25.9042957Z │ ,} 69484.525 2023-08-31T22:01:25.9043284Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:01:25.9043612Z │ ic with unit: Milliseconds 2023-08-31T22:01:25.9043901Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:01:25.9044257Z │ WorkerLoadTime{WorkerName="W-9000-my_text_classifier_1 2023-08-31T22:01:25.9044618Z │ .0",Level="Host",Hostname="fv-az628-190",} 3273.0 2023-08-31T22:01:25.9044989Z │ WorkerLoadTime{WorkerName="W-9002-squeezenet1_1_1.0",L 2023-08-31T22:01:25.9045334Z │ evel="Host",Hostname="fv-az628-190",} 1772.0 2023-08-31T22:01:25.9045683Z │ WorkerLoadTime{WorkerName="W-9004-densenet161_1.0",Lev 2023-08-31T22:01:25.9046030Z │ el="Host",Hostname="fv-az628-190",} 2280.0 2023-08-31T22:01:25.9046688Z │ WorkerLoadTime{WorkerName="W-9001-my_text_classifier_s 2023-08-31T22:01:25.9047062Z │ cripted_1.0",Level="Host",Hostname="fv-az628-190",} 26 2023-08-31T22:01:25.9047331Z │ 26.0 2023-08-31T22:01:25.9047647Z │ WorkerLoadTime{WorkerName="W-9003-squeezenet1_1_script 2023-08-31T22:01:25.9048004Z │ ed_1.0",Level="Host",Hostname="fv-az628-190",} 1832.0 2023-08-31T22:01:25.9048375Z │ # HELP ts_inference_requests_total Torchserve promethe 2023-08-31T22:01:25.9048717Z │ us counter metric with unit: Count 2023-08-31T22:01:25.9049064Z │ # TYPE ts_inference_requests_total counter 2023-08-31T22:01:25.9049432Z │ ts_inference_requests_total{model_name="densenet161",m 2023-08-31T22:01:25.9049804Z │ odel_version="default",hostname="fv-az628-190",} 1.0 2023-08-31T22:01:25.9050173Z │ ts_inference_requests_total{model_name="my_text_classi 2023-08-31T22:01:25.9050534Z │ fier",model_version="default",hostname="fv-az628-190", 2023-08-31T22:01:25.9050821Z │ } 1.0 2023-08-31T22:01:25.9051080Z │ ts_inference_requests_tot 2023-08-31T22:01:25.9051353Z │ (showing 2.05kB/6.13kB) 2023-08-31T22:01:25.9059714Z └ 2023-08-31T22:01:25.9061412Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:25.9062078Z 1ms 214µs (cache) (cache) 1ms 1ms 32µs 5ms 2023-08-31T22:01:25.9062468Z 2023-08-31T22:01:25.9117813Z ✓ Successful GET request 2023-08-31T22:01:25.9145849Z 2023-08-31T22:01:25.9146221Z Iteration 6/24 2023-08-31T22:01:25.9159722Z 2023-08-31T22:01:25.9160119Z → Model Zoo - Register Model 2023-08-31T22:01:29.5645201Z POST http://localhost:8081/models?url=alexnet.mar&model_name=alexnet&initial_workers=1&synchronous=true 2023-08-31T22:01:29.5645982Z 200 OK ★ 3.6s time ★ 322B↑ 349B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:29.5648376Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 83B 2023-08-31T22:01:29.5657568Z │ { 2023-08-31T22:01:29.5658447Z │ "status": "Model \"alexnet\" Version: 1.0 registered 2023-08-31T22:01:29.5658889Z │ with 1 initial workers" 2023-08-31T22:01:29.5659196Z │ } 2023-08-31T22:01:29.5662134Z └ 2023-08-31T22:01:29.5662644Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:29.5663213Z 1ms 208µs (cache) (cache) 3.6s 1ms 35µs 3.6s 2023-08-31T22:01:29.5663480Z 2023-08-31T22:01:29.5733654Z ✓ Successful POST request 2023-08-31T22:01:29.5782359Z 2023-08-31T22:01:29.5782771Z → Model Zoo - Inference Model 2023-08-31T22:01:29.6350928Z POST http://localhost:8080/predictions/alexnet 2023-08-31T22:01:29.6356810Z 200 OK ★ 46ms time ★ 111.24kB↑ 403B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:01:29.6357194Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:01:29.6357699Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:01:29.6357958Z └ 2023-08-31T22:01:29.6358450Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 168B 2023-08-31T22:01:29.6358947Z │ { 2023-08-31T22:01:29.6359229Z │ "tabby": 0.318473756313324, 2023-08-31T22:01:29.6359610Z │ "tiger_cat": 0.2579393982887268, 2023-08-31T22:01:29.6359981Z │ "Egyptian_cat": 0.2425483912229538, 2023-08-31T22:01:29.6360345Z │ "lynx": 0.1687936782836914, 2023-08-31T22:01:29.6360694Z │ "tiger": 0.006487966049462557 2023-08-31T22:01:29.6360987Z │ } 2023-08-31T22:01:29.6379293Z └ 2023-08-31T22:01:29.6379870Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:29.6380492Z 2ms 220µs (cache) (cache) 44ms 1ms 36µs 47ms 2023-08-31T22:01:29.6380766Z 2023-08-31T22:01:29.6420671Z ✓ Successful POST request 2023-08-31T22:01:29.6443728Z ✓ Test expected JSON response 2023-08-31T22:01:29.6531996Z 2023-08-31T22:01:29.6532357Z → Model Zoo - Unregister model 2023-08-31T22:01:29.7078206Z DELETE http://localhost:8081/models/alexnet 2023-08-31T22:01:29.7079057Z 200 OK ★ 49ms time ★ 243B↑ 315B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:29.7079792Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 49B 2023-08-31T22:01:29.7081125Z │ { 2023-08-31T22:01:29.7081602Z │ "status": "Model \"alexnet\" unregistered" 2023-08-31T22:01:29.7081986Z │ } 2023-08-31T22:01:29.7090925Z └ 2023-08-31T22:01:29.7092341Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:29.7093042Z 1ms 220µs (cache) (cache) 47ms 1ms 39µs 49ms 2023-08-31T22:01:29.7093504Z 2023-08-31T22:01:29.7142111Z ✓ Successful DELETE request 2023-08-31T22:01:29.7193667Z 2023-08-31T22:01:29.7194173Z → Model Zoo - Model Metrics 2023-08-31T22:01:29.7285039Z GET http://localhost:8082/metrics 2023-08-31T22:01:29.7286024Z 200 OK ★ 4ms time ★ 233B↑ 7kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:29.7286815Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 6.71kB 2023-08-31T22:01:29.7287456Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:01:29.7288004Z │ c with unit: Count 2023-08-31T22:01:29.7288450Z │ # TYPE Requests2XX counter 2023-08-31T22:01:29.7288957Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 23. 2023-08-31T22:01:29.7289412Z │ 0 2023-08-31T22:01:29.7291523Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:01:29.7291979Z │ c with unit: Count 2023-08-31T22:01:29.7292448Z │ # TYPE Requests5XX counter 2023-08-31T22:01:29.7294675Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:01:29.7295281Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:01:29.7295839Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:01:29.7296443Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:01:29.7296951Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:01:29.7297449Z │ 197192.539 2023-08-31T22:01:29.7298605Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:29.7299069Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:01:29.7299389Z │ -190",} 23938.584 2023-08-31T22:01:29.7299715Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:29.7300086Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:01:29.7300411Z │ "fv-az628-190",} 52504.044 2023-08-31T22:01:29.7300744Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:29.7301103Z │ et1_1_scripted",model_version="default",hostname="fv-a 2023-08-31T22:01:29.7301569Z │ z628-190",} 107621.885 2023-08-31T22:01:29.7301893Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:29.7302250Z │ et1_1",model_version="default",hostname="fv-az628-190" 2023-08-31T22:01:29.7302538Z │ ,} 69484.525 2023-08-31T22:01:29.7302857Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:01:29.7303230Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:01:29.7303485Z │ 94.667 2023-08-31T22:01:29.7303812Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:01:29.7304156Z │ ic with unit: Milliseconds 2023-08-31T22:01:29.7304440Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:01:29.7304791Z │ WorkerLoadTime{WorkerName="W-9005-alexnet_1.0",Level=" 2023-08-31T22:01:29.7305126Z │ Host",Hostname="fv-az628-190",} 2255.0 2023-08-31T22:01:29.7305465Z │ WorkerLoadTime{WorkerName="W-9000-my_text_classifier_1 2023-08-31T22:01:29.7305831Z │ .0",Level="Host",Hostname="fv-az628-190",} 3273.0 2023-08-31T22:01:29.7306209Z │ WorkerLoadTime{WorkerName="W-9002-squeezenet1_1_1.0",L 2023-08-31T22:01:29.7306553Z │ evel="Host",Hostname="fv-az628-190",} 1772.0 2023-08-31T22:01:29.7306914Z │ WorkerLoadTime{WorkerName="W-9004-densenet161_1.0",Lev 2023-08-31T22:01:29.7307250Z │ el="Host",Hostname="fv-az628-190",} 2280.0 2023-08-31T22:01:29.7307600Z │ WorkerLoadTime{WorkerName="W-9001-my_text_classifier_s 2023-08-31T22:01:29.7307972Z │ cripted_1.0",Level="Host",Hostname="fv-az628-190",} 26 2023-08-31T22:01:29.7308237Z │ 26.0 2023-08-31T22:01:29.7308556Z │ WorkerLoadTime{WorkerName="W-9003-squeezenet1_1_script 2023-08-31T22:01:29.7308922Z │ ed_1.0",Level="Host",Hostname="fv-az628-190",} 1832.0 2023-08-31T22:01:29.7309291Z │ # HELP ts_inference_requests_total Torchserve promethe 2023-08-31T22:01:29.7309634Z │ us counter metric with unit: Count 2023-08-31T22:01:29.7309962Z │ # TYPE ts_inference_requests_total counter 2023-08-31T22:01:29.7310292Z │ ts_inference_requests_total{model_name 2023-08-31T22:01:29.7310599Z │ (showing 2.05kB/6.71kB) 2023-08-31T22:01:29.7310820Z └ 2023-08-31T22:01:29.7311220Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:29.7311712Z 1ms 242µs (cache) (cache) 1ms 1ms 28µs 4ms 2023-08-31T22:01:29.7311913Z 2023-08-31T22:01:29.7354837Z ✓ Successful GET request 2023-08-31T22:01:29.7391425Z 2023-08-31T22:01:29.7391769Z Iteration 7/24 2023-08-31T22:01:29.7412342Z 2023-08-31T22:01:29.7412650Z → Model Zoo - Register Model 2023-08-31T22:01:36.4618349Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/alexnet_scripted.mar&model_name=alexnet_scripted&initial_workers=1&synchronous=true 2023-08-31T22:01:36.4619531Z 200 OK ★ 6.7s time ★ 381B↑ 358B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:36.4620105Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 92B 2023-08-31T22:01:36.4620529Z │ { 2023-08-31T22:01:36.4621118Z │ "status": "Model \"alexnet_scripted\" Version: 1.0 r 2023-08-31T22:01:36.4622030Z │ egistered with 1 initial workers" 2023-08-31T22:01:36.4622368Z │ } 2023-08-31T22:01:36.4636616Z └ 2023-08-31T22:01:36.4637112Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:36.4637650Z 1ms 208µs (cache) (cache) 6.7s 1ms 32µs 6.7s 2023-08-31T22:01:36.4637855Z 2023-08-31T22:01:36.4692825Z ✓ Successful POST request 2023-08-31T22:01:36.4750673Z 2023-08-31T22:01:36.4750989Z → Model Zoo - Inference Model 2023-08-31T22:01:36.5784789Z POST http://localhost:8080/predictions/alexnet_scripted 2023-08-31T22:01:36.5785975Z 200 OK ★ 96ms time ★ 111.25kB↑ 403B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:01:36.5786888Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:01:36.5787230Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:01:36.5787479Z └ 2023-08-31T22:01:36.5787829Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 168B 2023-08-31T22:01:36.5788505Z │ { 2023-08-31T22:01:36.5788765Z │ "tabby": 0.318473756313324, 2023-08-31T22:01:36.5789056Z │ "tiger_cat": 0.2579393982887268, 2023-08-31T22:01:36.5789354Z │ "Egyptian_cat": 0.2425483912229538, 2023-08-31T22:01:36.5789640Z │ "lynx": 0.1687936782836914, 2023-08-31T22:01:36.5789918Z │ "tiger": 0.006487966049462557 2023-08-31T22:01:36.5790139Z │ } 2023-08-31T22:01:36.5811375Z └ 2023-08-31T22:01:36.5811860Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:36.5812488Z 2ms 246µs (cache) (cache) 94ms 1ms 36µs 98ms 2023-08-31T22:01:36.5814100Z 2023-08-31T22:01:36.5869755Z ✓ Successful POST request 2023-08-31T22:01:36.5875543Z ✓ Test expected JSON response 2023-08-31T22:01:36.5930943Z 2023-08-31T22:01:36.5931367Z → Model Zoo - Unregister model 2023-08-31T22:01:36.6829835Z DELETE http://localhost:8081/models/alexnet_scripted 2023-08-31T22:01:36.6833517Z 200 OK ★ 84ms time ★ 252B↑ 324B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:36.6834395Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 58B 2023-08-31T22:01:36.6834852Z │ { 2023-08-31T22:01:36.6835553Z │ "status": "Model \"alexnet_scripted\" unregistered" 2023-08-31T22:01:36.6835979Z │ } 2023-08-31T22:01:36.6845143Z └ 2023-08-31T22:01:36.6845869Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:36.6847282Z 1ms 234µs (cache) (cache) 81ms 1ms 33µs 84ms 2023-08-31T22:01:36.6847673Z 2023-08-31T22:01:36.6929038Z ✓ Successful DELETE request 2023-08-31T22:01:36.6978618Z 2023-08-31T22:01:36.6979037Z → Model Zoo - Model Metrics 2023-08-31T22:01:36.7080232Z GET http://localhost:8082/metrics 2023-08-31T22:01:36.7082638Z 200 OK ★ 4ms time ★ 233B↑ 7.63kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:36.7085214Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 7.34kB 2023-08-31T22:01:36.7087848Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:01:36.7088359Z │ c with unit: Count 2023-08-31T22:01:36.7089189Z │ # TYPE Requests2XX counter 2023-08-31T22:01:36.7089711Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 27. 2023-08-31T22:01:36.7090519Z │ 0 2023-08-31T22:01:36.7091018Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:01:36.7092131Z │ c with unit: Count 2023-08-31T22:01:36.7092604Z │ # TYPE Requests5XX counter 2023-08-31T22:01:36.7093485Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:01:36.7094034Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:01:36.7094921Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:01:36.7095469Z │ ts_inference_latency_microseconds{model_name="alexnet_ 2023-08-31T22:01:36.7096380Z │ scripted",model_version="default",hostname="fv-az628-1 2023-08-31T22:01:36.7096837Z │ 90",} 90762.505 2023-08-31T22:01:36.7097853Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:01:36.7098397Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:01:36.7099214Z │ 197192.539 2023-08-31T22:01:36.7099698Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:36.7100592Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:01:36.7101051Z │ -190",} 23938.584 2023-08-31T22:01:36.7101903Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:36.7102431Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:01:36.7103261Z │ "fv-az628-190",} 52504.044 2023-08-31T22:01:36.7103757Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:36.7104648Z │ et1_1_scripted",model_version="default",hostname="fv-a 2023-08-31T22:01:36.7105099Z │ z628-190",} 107621.885 2023-08-31T22:01:36.7105932Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:36.7106488Z │ et1_1",model_version="default",hostname="fv-az628-190" 2023-08-31T22:01:36.7107313Z │ ,} 69484.525 2023-08-31T22:01:36.7107781Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:01:36.7108674Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:01:36.7109115Z │ 94.667 2023-08-31T22:01:36.7109963Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:01:36.7110493Z │ ic with unit: Milliseconds 2023-08-31T22:01:36.7111358Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:01:36.7112060Z │ WorkerLoadTime{WorkerName="W-9005-alexnet_1.0",Level=" 2023-08-31T22:01:36.7112473Z │ Host",Hostname="fv-az628-190",} 2255.0 2023-08-31T22:01:36.7112940Z │ WorkerLoadTime{WorkerName="W-9000-my_text_classifier_1 2023-08-31T22:01:36.7113381Z │ .0",Level="Host",Hostname="fv-az628-190",} 3273.0 2023-08-31T22:01:36.7113822Z │ WorkerLoadTime{WorkerName="W-9006-alexnet_scripted_1.0 2023-08-31T22:01:36.7114244Z │ ",Level="Host",Hostname="fv-az628-190",} 1843.0 2023-08-31T22:01:36.7114701Z │ WorkerLoadTime{WorkerName="W-9002-squeezenet1_1_1.0",L 2023-08-31T22:01:36.7115125Z │ evel="Host",Hostname="fv-az628-190",} 1772.0 2023-08-31T22:01:36.7115556Z │ WorkerLoadTime{WorkerName="W-9004-densenet161_1.0",Lev 2023-08-31T22:01:36.7115958Z │ el="Host",Hostname="fv-az628-190",} 2280.0 2023-08-31T22:01:36.7116551Z │ WorkerLoadTime{WorkerName="W-9001-my_text_classifier_s 2023-08-31T22:01:36.7117015Z │ cripted_1.0",Level="Host",Hostname="fv-az628-190",} 26 2023-08-31T22:01:36.7117358Z │ 26.0 2023-08-31T22:01:36.7118015Z │ WorkerLoadTime{WorkerName="W-9003-squeezenet1_1_scri 2023-08-31T22:01:36.7118412Z │ (showing 2.05kB/7.34kB) 2023-08-31T22:01:36.7136767Z └ 2023-08-31T22:01:36.7137310Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:36.7137898Z 1ms 241µs (cache) (cache) 2ms 1ms 31µs 5ms 2023-08-31T22:01:36.7138158Z 2023-08-31T22:01:36.7230856Z ✓ Successful GET request 2023-08-31T22:01:36.7276092Z 2023-08-31T22:01:36.7276286Z Iteration 8/24 2023-08-31T22:01:36.7289180Z 2023-08-31T22:01:36.7289508Z → Model Zoo - Register Model 2023-08-31T22:01:38.9378560Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&initial_workers=1&synchronous=true 2023-08-31T22:01:38.9379475Z 200 OK ★ 2.2s time ★ 326B↑ 351B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:38.9380277Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 85B 2023-08-31T22:01:38.9380668Z │ { 2023-08-31T22:01:38.9381072Z │ "status": "Model \"resnet-18\" Version: 1.0 register 2023-08-31T22:01:38.9381491Z │ ed with 1 initial workers" 2023-08-31T22:01:38.9381814Z │ } 2023-08-31T22:01:38.9384712Z └ 2023-08-31T22:01:38.9385215Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:38.9385794Z 1ms 209µs (cache) (cache) 2.2s 1ms 32µs 2.2s 2023-08-31T22:01:38.9386284Z 2023-08-31T22:01:38.9433376Z ✓ Successful POST request 2023-08-31T22:01:38.9475211Z 2023-08-31T22:01:38.9475518Z → Model Zoo - Inference Model 2023-08-31T22:01:39.0151931Z POST http://localhost:8080/predictions/resnet-18 2023-08-31T22:01:39.0152735Z 200 OK ★ 61ms time ★ 111.24kB↑ 409B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:01:39.0153187Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:01:39.0153556Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:01:39.0153909Z └ 2023-08-31T22:01:39.0154300Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 174B 2023-08-31T22:01:39.0154646Z │ { 2023-08-31T22:01:39.0154980Z │ "tabby": 0.40966367721557617, 2023-08-31T22:01:39.0155348Z │ "tiger_cat": 0.3467045724391937, 2023-08-31T22:01:39.0155729Z │ "Egyptian_cat": 0.13002872467041016, 2023-08-31T22:01:39.0156085Z │ "lynx": 0.023919489234685898, 2023-08-31T22:01:39.0156446Z │ "bucket": 0.011532163247466087 2023-08-31T22:01:39.0156749Z │ } 2023-08-31T22:01:39.0164151Z └ 2023-08-31T22:01:39.0164691Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:39.0165317Z 1ms 218µs (cache) (cache) 58ms 1ms 35µs 62ms 2023-08-31T22:01:39.0165610Z 2023-08-31T22:01:39.0233677Z ✓ Successful POST request 2023-08-31T22:01:39.0236824Z ✓ Test expected JSON response 2023-08-31T22:01:39.0288841Z 2023-08-31T22:01:39.0289589Z → Model Zoo - Unregister model 2023-08-31T22:01:39.0502813Z DELETE http://localhost:8081/models/resnet-18 2023-08-31T22:01:39.0503725Z 200 OK ★ 16ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:39.0504765Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:01:39.0505105Z │ { 2023-08-31T22:01:39.0505419Z │ "status": "Model \"resnet-18\" unregistered" 2023-08-31T22:01:39.0505693Z │ } 2023-08-31T22:01:39.0529020Z └ 2023-08-31T22:01:39.0529728Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:39.0530392Z 1ms 214µs (cache) (cache) 13ms 1ms 25µs 16ms 2023-08-31T22:01:39.0530826Z 2023-08-31T22:01:39.0570004Z ✓ Successful DELETE request 2023-08-31T22:01:39.0614825Z 2023-08-31T22:01:39.0615274Z → Model Zoo - Model Metrics 2023-08-31T22:01:39.0704062Z GET http://localhost:8082/metrics 2023-08-31T22:01:39.0704955Z 200 OK ★ 4ms time ★ 233B↑ 8.22kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:39.0706559Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 7.93kB 2023-08-31T22:01:39.0707168Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:01:39.0707680Z │ c with unit: Count 2023-08-31T22:01:39.0708312Z │ # TYPE Requests2XX counter 2023-08-31T22:01:39.0708767Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 31. 2023-08-31T22:01:39.0709056Z │ 0 2023-08-31T22:01:39.0709388Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:01:39.0709695Z │ c with unit: Count 2023-08-31T22:01:39.0710013Z │ # TYPE Requests5XX counter 2023-08-31T22:01:39.0710370Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:01:39.0710747Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:01:39.0711116Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:01:39.0711492Z │ ts_inference_latency_microseconds{model_name="alexnet_ 2023-08-31T22:01:39.0712116Z │ scripted",model_version="default",hostname="fv-az628-1 2023-08-31T22:01:39.0712431Z │ 90",} 90762.505 2023-08-31T22:01:39.0712747Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:01:39.0713121Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:01:39.0713386Z │ 5157.442 2023-08-31T22:01:39.0713697Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:01:39.0714062Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:01:39.0714327Z │ 197192.539 2023-08-31T22:01:39.0714646Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:39.0715197Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:01:39.0715475Z │ -190",} 23938.584 2023-08-31T22:01:39.0715797Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:39.0716168Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:01:39.0716466Z │ "fv-az628-190",} 52504.044 2023-08-31T22:01:39.0716811Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:39.0717177Z │ et1_1_scripted",model_version="default",hostname="fv-a 2023-08-31T22:01:39.0717472Z │ z628-190",} 107621.885 2023-08-31T22:01:39.0717775Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:39.0718142Z │ et1_1",model_version="default",hostname="fv-az628-190" 2023-08-31T22:01:39.0718422Z │ ,} 69484.525 2023-08-31T22:01:39.0718725Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:01:39.0719085Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:01:39.0719365Z │ 94.667 2023-08-31T22:01:39.0719676Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:01:39.0720009Z │ ic with unit: Milliseconds 2023-08-31T22:01:39.0720304Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:01:39.0720643Z │ WorkerLoadTime{WorkerName="W-9005-alexnet_1.0",Level=" 2023-08-31T22:01:39.0720977Z │ Host",Hostname="fv-az628-190",} 2255.0 2023-08-31T22:01:39.0721337Z │ WorkerLoadTime{WorkerName="W-9007-resnet-18_1.0",Level 2023-08-31T22:01:39.0721674Z │ ="Host",Hostname="fv-az628-190",} 1932.0 2023-08-31T22:01:39.0722012Z │ WorkerLoadTime{WorkerName="W-9000-my_text_classifier_1 2023-08-31T22:01:39.0722371Z │ .0",Level="Host",Hostname="fv-az628-190",} 3273.0 2023-08-31T22:01:39.0722736Z │ WorkerLoadTime{WorkerName="W-9006-alexnet_scripted_1.0 2023-08-31T22:01:39.0723078Z │ ",Level="Host",Hostname="fv-az628-190",} 1843.0 2023-08-31T22:01:39.0723441Z │ WorkerLoadTime{WorkerName="W-9002-squeezenet1_1_1.0",L 2023-08-31T22:01:39.0723799Z │ evel="Host",Hostname="fv-az628-190",} 1772.0 2023-08-31T22:01:39.0724145Z │ WorkerLoadTime{WorkerName="W-9004-densenet161_1.0" 2023-08-31T22:01:39.0724462Z │ (showing 2.05kB/7.93kB) 2023-08-31T22:01:39.0734847Z └ 2023-08-31T22:01:39.0735456Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:39.0738089Z 1ms 316µs (cache) (cache) 1ms 1ms 26µs 4ms 2023-08-31T22:01:39.0738447Z 2023-08-31T22:01:39.0776619Z ✓ Successful GET request 2023-08-31T22:01:39.0823545Z 2023-08-31T22:01:39.0823933Z Iteration 9/24 2023-08-31T22:01:39.0839916Z 2023-08-31T22:01:39.0840421Z → Model Zoo - Register Model 2023-08-31T22:01:41.9317421Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/resnet-18_scripted.mar&model_name=resnet-18_scripted&initial_workers=1&synchronous=true 2023-08-31T22:01:41.9318132Z 200 OK ★ 2.8s time ★ 385B↑ 360B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:41.9318572Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 94B 2023-08-31T22:01:41.9318858Z │ { 2023-08-31T22:01:41.9319194Z │ "status": "Model \"resnet-18_scripted\" Version: 1.0 2023-08-31T22:01:41.9319535Z │ registered with 1 initial workers" 2023-08-31T22:01:41.9319802Z │ } 2023-08-31T22:01:41.9319991Z └ 2023-08-31T22:01:41.9320681Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:41.9321192Z 1ms 314µs (cache) (cache) 2.8s 1ms 32µs 2.8s 2023-08-31T22:01:41.9321392Z 2023-08-31T22:01:41.9400200Z ✓ Successful POST request 2023-08-31T22:01:41.9475183Z 2023-08-31T22:01:41.9475523Z → Model Zoo - Inference Model 2023-08-31T22:01:42.1138113Z POST http://localhost:8080/predictions/resnet-18_scripted 2023-08-31T22:01:42.1141681Z 200 OK ★ 160ms time ★ 111.25kB↑ 409B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:01:42.1144820Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:01:42.1148164Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:01:42.1150839Z └ 2023-08-31T22:01:42.1153725Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 174B 2023-08-31T22:01:42.1156454Z │ { 2023-08-31T22:01:42.1157008Z │ "tabby": 0.40966367721557617, 2023-08-31T22:01:42.1157871Z │ "tiger_cat": 0.3467045724391937, 2023-08-31T22:01:42.1158248Z │ "Egyptian_cat": 0.13002872467041016, 2023-08-31T22:01:42.1158550Z │ "lynx": 0.023919489234685898, 2023-08-31T22:01:42.1158860Z │ "bucket": 0.011532163247466087 2023-08-31T22:01:42.1159098Z │ } 2023-08-31T22:01:42.1181111Z └ 2023-08-31T22:01:42.1181562Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:42.1182208Z 2ms 242µs (cache) (cache) 157ms 1ms 35µs 161ms 2023-08-31T22:01:42.1182481Z 2023-08-31T22:01:42.1265403Z ✓ Successful POST request 2023-08-31T22:01:42.1269507Z ✓ Test expected JSON response 2023-08-31T22:01:42.1312315Z 2023-08-31T22:01:42.1312968Z → Model Zoo - Unregister model 2023-08-31T22:01:42.1599221Z DELETE http://localhost:8081/models/resnet-18_scripted 2023-08-31T22:01:42.1600086Z 200 OK ★ 23ms time ★ 254B↑ 326B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:42.1600725Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 60B 2023-08-31T22:01:42.1601228Z │ { 2023-08-31T22:01:42.1601959Z │ "status": "Model \"resnet-18_scripted\" unregistered 2023-08-31T22:01:42.1602484Z │ " 2023-08-31T22:01:42.1602839Z │ } 2023-08-31T22:01:42.1611380Z └ 2023-08-31T22:01:42.1611953Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:42.1612573Z 1ms 253µs (cache) (cache) 21ms 1ms 28µs 24ms 2023-08-31T22:01:42.1612938Z 2023-08-31T22:01:42.1652653Z ✓ Successful DELETE request 2023-08-31T22:01:42.1696016Z 2023-08-31T22:01:42.1696424Z → Model Zoo - Model Metrics 2023-08-31T22:01:42.1787121Z GET http://localhost:8082/metrics 2023-08-31T22:01:42.1790461Z 200 OK ★ 4ms time ★ 233B↑ 8.86kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:42.1794528Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 8.57kB 2023-08-31T22:01:42.1795254Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:01:42.1795839Z │ c with unit: Count 2023-08-31T22:01:42.1796160Z │ # TYPE Requests2XX counter 2023-08-31T22:01:42.1796556Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 35. 2023-08-31T22:01:42.1797052Z │ 0 2023-08-31T22:01:42.1797382Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:01:42.1797690Z │ c with unit: Count 2023-08-31T22:01:42.1797997Z │ # TYPE Requests5XX counter 2023-08-31T22:01:42.1798346Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:01:42.1798724Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:01:42.1799088Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:01:42.1799464Z │ ts_inference_latency_microseconds{model_name="alexnet_ 2023-08-31T22:01:42.1799868Z │ scripted",model_version="default",hostname="fv-az628-1 2023-08-31T22:01:42.1800148Z │ 90",} 90762.505 2023-08-31T22:01:42.1800467Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:01:42.1800833Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:01:42.1801093Z │ 5157.442 2023-08-31T22:01:42.1801655Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:01:42.1802030Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:01:42.1802306Z │ 197192.539 2023-08-31T22:01:42.1802611Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:42.1802971Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:01:42.1803259Z │ -190",} 23938.584 2023-08-31T22:01:42.1803570Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:42.1803947Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:01:42.1804412Z │ "fv-az628-190",} 52504.044 2023-08-31T22:01:42.1804731Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:42.1805095Z │ et1_1_scripted",model_version="default",hostname="fv-a 2023-08-31T22:01:42.1805384Z │ z628-190",} 107621.885 2023-08-31T22:01:42.1805687Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:42.1806045Z │ et1_1",model_version="default",hostname="fv-az628-190" 2023-08-31T22:01:42.1806637Z │ ,} 69484.525 2023-08-31T22:01:42.1806964Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:01:42.1807314Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:01:42.1807605Z │ -190",} 153779.746 2023-08-31T22:01:42.1807917Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:01:42.1808276Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:01:42.1808549Z │ 94.667 2023-08-31T22:01:42.1808875Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:01:42.1809206Z │ ic with unit: Milliseconds 2023-08-31T22:01:42.1809497Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:01:42.1809846Z │ WorkerLoadTime{WorkerName="W-9005-alexnet_1.0",Level=" 2023-08-31T22:01:42.1810170Z │ Host",Hostname="fv-az628-190",} 2255.0 2023-08-31T22:01:42.1810519Z │ WorkerLoadTime{WorkerName="W-9007-resnet-18_1.0",Level 2023-08-31T22:01:42.1810854Z │ ="Host",Hostname="fv-az628-190",} 1932.0 2023-08-31T22:01:42.1811219Z │ WorkerLoadTime{WorkerName="W-9000-my_text_classifier_1 2023-08-31T22:01:42.1811570Z │ .0",Level="Host",Hostname="fv-az628-190",} 3273.0 2023-08-31T22:01:42.1811931Z │ WorkerLoadTime{WorkerName="W-9006-alexnet_scripted_1.0 2023-08-31T22:01:42.1812284Z │ ",Level="Host",Hostname="fv-az628-190",} 1843.0 2023-08-31T22:01:42.1812574Z │ WorkerLoadTime{WorkerN 2023-08-31T22:01:42.1812844Z │ (showing 2.05kB/8.57kB) 2023-08-31T22:01:42.1813616Z └ 2023-08-31T22:01:42.1814008Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:42.1864911Z 1ms 213µs (cache) (cache) 2ms 1ms 28µs 4ms 2023-08-31T22:01:42.1865114Z 2023-08-31T22:01:42.1865268Z ✓ Successful GET request 2023-08-31T22:01:42.1892111Z 2023-08-31T22:01:42.1892300Z Iteration 10/24 2023-08-31T22:01:42.1906575Z 2023-08-31T22:01:42.1907014Z → Model Zoo - Register Model 2023-08-31T22:01:48.3371532Z POST http://localhost:8081/models?url=vgg16.mar&model_name=vgg16&initial_workers=1&synchronous=true 2023-08-31T22:01:48.3372775Z 200 OK ★ 6.1s time ★ 318B↑ 347B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:48.3373724Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 81B 2023-08-31T22:01:48.3375070Z │ { 2023-08-31T22:01:48.3375414Z │ "status": "Model \"vgg16\" Version: 1.0 registered w 2023-08-31T22:01:48.3375741Z │ ith 1 initial workers" 2023-08-31T22:01:48.3377870Z │ } 2023-08-31T22:01:48.3394260Z └ 2023-08-31T22:01:48.3395037Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:48.3395818Z 1ms 235µs (cache) (cache) 6.1s 1ms 31µs 6.1s 2023-08-31T22:01:48.3396136Z 2023-08-31T22:01:48.3451274Z ✓ Successful POST request 2023-08-31T22:01:48.3577214Z 2023-08-31T22:01:48.3577542Z → Model Zoo - Inference Model 2023-08-31T22:01:48.5779934Z POST http://localhost:8080/predictions/vgg16 2023-08-31T22:01:48.5781423Z 200 OK ★ 214ms time ★ 111.24kB↑ 407B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:01:48.5781979Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:01:48.5782530Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:01:48.5784939Z └ 2023-08-31T22:01:48.5785406Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 172B 2023-08-31T22:01:48.5785859Z │ { 2023-08-31T22:01:48.5786276Z │ "tiger_cat": 0.44697266817092896, 2023-08-31T22:01:48.5786712Z │ "tabby": 0.440879762172699, 2023-08-31T22:01:48.5787087Z │ "Egyptian_cat": 0.05904550850391388, 2023-08-31T22:01:48.5787680Z │ "tiger": 0.020596381276845932, 2023-08-31T22:01:48.5788026Z │ "lynx": 0.009934592060744762 2023-08-31T22:01:48.5788337Z │ } 2023-08-31T22:01:48.5860492Z └ 2023-08-31T22:01:48.5861021Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:48.5862365Z 2ms 236µs (cache) (cache) 208ms 4ms 32µs 215ms 2023-08-31T22:01:48.5862558Z 2023-08-31T22:01:48.5921917Z ✓ Successful POST request 2023-08-31T22:01:48.5929093Z ✓ Test expected JSON response 2023-08-31T22:01:48.5980392Z 2023-08-31T22:01:48.5980956Z → Model Zoo - Unregister model 2023-08-31T22:01:48.7001079Z DELETE http://localhost:8081/models/vgg16 2023-08-31T22:01:48.7002076Z 200 OK ★ 97ms time ★ 241B↑ 313B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:48.7002702Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:01:48.7003549Z │ { 2023-08-31T22:01:48.7004006Z │ "status": "Model \"vgg16\" unregistered" 2023-08-31T22:01:48.7004493Z │ } 2023-08-31T22:01:48.7021070Z └ 2023-08-31T22:01:48.7021638Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:48.7022252Z 1ms 232µs (cache) (cache) 94ms 1ms 30µs 97ms 2023-08-31T22:01:48.7022680Z 2023-08-31T22:01:48.7096212Z ✓ Successful DELETE request 2023-08-31T22:01:48.7138285Z 2023-08-31T22:01:48.7138812Z → Model Zoo - Model Metrics 2023-08-31T22:01:48.7263026Z GET http://localhost:8082/metrics 2023-08-31T22:01:48.7263647Z 200 OK ★ 7ms time ★ 233B↑ 9.43kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:01:48.7265332Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 9.14kB 2023-08-31T22:01:48.7266792Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:01:48.7267165Z │ c with unit: Count 2023-08-31T22:01:48.7267456Z │ # TYPE Requests2XX counter 2023-08-31T22:01:48.7267818Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 39. 2023-08-31T22:01:48.7268117Z │ 0 2023-08-31T22:01:48.7268442Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:01:48.7268757Z │ c with unit: Count 2023-08-31T22:01:48.7269027Z │ # TYPE Requests5XX counter 2023-08-31T22:01:48.7269388Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:01:48.7269771Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:01:48.7270452Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:01:48.7270847Z │ ts_inference_latency_microseconds{model_name="alexnet_ 2023-08-31T22:01:48.7271234Z │ scripted",model_version="default",hostname="fv-az628-1 2023-08-31T22:01:48.7271529Z │ 90",} 90762.505 2023-08-31T22:01:48.7271838Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:01:48.7272208Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:01:48.7272483Z │ 5157.442 2023-08-31T22:01:48.7272788Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:01:48.7273169Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:01:48.7273447Z │ 197192.539 2023-08-31T22:01:48.7273753Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:48.7274123Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:01:48.7274410Z │ -190",} 23938.584 2023-08-31T22:01:48.7274721Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:01:48.7275106Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:01:48.7275420Z │ "fv-az628-190",} 52504.044 2023-08-31T22:01:48.7275747Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:48.7276102Z │ et1_1_scripted",model_version="default",hostname="fv-a 2023-08-31T22:01:48.7276401Z │ z628-190",} 107621.885 2023-08-31T22:01:48.7276719Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:01:48.7277072Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:01:48.7277354Z │ 8.971 2023-08-31T22:01:48.7277830Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:01:48.7278176Z │ et1_1",model_version="default",hostname="fv-az628-190" 2023-08-31T22:01:48.7278454Z │ ,} 69484.525 2023-08-31T22:01:48.7278768Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:01:48.7279116Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:01:48.7279403Z │ -190",} 153779.746 2023-08-31T22:01:48.7279734Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:01:48.7280095Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:01:48.7280354Z │ 94.667 2023-08-31T22:01:48.7280679Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:01:48.7281005Z │ ic with unit: Milliseconds 2023-08-31T22:01:48.7281297Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:01:48.7281651Z │ WorkerLoadTime{WorkerName="W-9005-alexnet_1.0",Level=" 2023-08-31T22:01:48.7281986Z │ Host",Hostname="fv-az628-190",} 2255.0 2023-08-31T22:01:48.7282335Z │ WorkerLoadTime{WorkerName="W-9007-resnet-18_1.0",Level 2023-08-31T22:01:48.7282671Z │ ="Host",Hostname="fv-az628-190",} 1932.0 2023-08-31T22:01:48.7283025Z │ WorkerLoadTime{WorkerName="W-9000-my_text_classifier_1 2023-08-31T22:01:48.7283374Z │ .0",Level="Host",Hostname="fv-az628-190",} 3273.0 2023-08-31T22:01:48.7283649Z │ WorkerLoad 2023-08-31T22:01:48.7283912Z │ (showing 2.05kB/9.14kB) 2023-08-31T22:01:48.7284157Z └ 2023-08-31T22:01:48.7284548Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:01:48.7285042Z 1ms 228µs (cache) (cache) 2ms 4ms 29µs 8ms 2023-08-31T22:01:48.7285242Z 2023-08-31T22:01:48.7346939Z ✓ Successful GET request 2023-08-31T22:01:48.7398710Z 2023-08-31T22:01:48.7399056Z Iteration 11/24 2023-08-31T22:01:48.7417852Z 2023-08-31T22:01:48.7418342Z → Model Zoo - Register Model 2023-08-31T22:02:01.5168230Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/vgg16_scripted.mar&model_name=vgg16_scripted&initial_workers=1&synchronous=true 2023-08-31T22:02:01.5169459Z 200 OK ★ 12.7s time ★ 377B↑ 356B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:01.5169991Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 90B 2023-08-31T22:02:01.5170345Z │ { 2023-08-31T22:02:01.5170754Z │ "status": "Model \"vgg16_scripted\" Version: 1.0 reg 2023-08-31T22:02:01.5171501Z │ istered with 1 initial workers" 2023-08-31T22:02:01.5171851Z │ } 2023-08-31T22:02:01.5187108Z └ 2023-08-31T22:02:01.5187668Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:01.5188242Z 1ms 207µs (cache) (cache) 12.7s 1ms 32µs 12.7s 2023-08-31T22:02:01.5188508Z 2023-08-31T22:02:01.5224725Z ✓ Successful POST request 2023-08-31T22:02:01.5292498Z 2023-08-31T22:02:01.5292991Z → Model Zoo - Inference Model 2023-08-31T22:02:01.8388654Z POST http://localhost:8080/predictions/vgg16_scripted 2023-08-31T22:02:01.8390327Z 200 OK ★ 303ms time ★ 111.25kB↑ 407B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:02:01.8391432Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:02:01.8392356Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:02:01.8393086Z └ 2023-08-31T22:02:01.8393912Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 172B 2023-08-31T22:02:01.8394581Z │ { 2023-08-31T22:02:01.8394967Z │ "tiger_cat": 0.44697266817092896, 2023-08-31T22:02:01.8395338Z │ "tabby": 0.440879762172699, 2023-08-31T22:02:01.8395712Z │ "Egyptian_cat": 0.05904550850391388, 2023-08-31T22:02:01.8396082Z │ "tiger": 0.020596381276845932, 2023-08-31T22:02:01.8396422Z │ "lynx": 0.009934592060744762 2023-08-31T22:02:01.8396726Z │ } 2023-08-31T22:02:01.8418880Z └ 2023-08-31T22:02:01.8419459Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:01.8420050Z 2ms 254µs (cache) (cache) 300ms 1ms 34µs 304ms 2023-08-31T22:02:01.8420369Z 2023-08-31T22:02:01.8472087Z ✓ Successful POST request 2023-08-31T22:02:01.8477333Z ✓ Test expected JSON response 2023-08-31T22:02:01.8525644Z 2023-08-31T22:02:01.8525969Z → Model Zoo - Unregister model 2023-08-31T22:02:02.0848866Z DELETE http://localhost:8081/models/vgg16_scripted 2023-08-31T22:02:02.0849998Z 200 OK ★ 227ms time ★ 250B↑ 322B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:02.0850661Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 56B 2023-08-31T22:02:02.0851186Z │ { 2023-08-31T22:02:02.0852103Z │ "status": "Model \"vgg16_scripted\" unregistered" 2023-08-31T22:02:02.0852458Z │ } 2023-08-31T22:02:02.0865540Z └ 2023-08-31T22:02:02.0866115Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:02.0866775Z 1ms 229µs (cache) (cache) 223ms 2ms 30µs 227ms 2023-08-31T22:02:02.0867127Z 2023-08-31T22:02:02.0922649Z ✓ Successful DELETE request 2023-08-31T22:02:02.0942269Z 2023-08-31T22:02:02.0942776Z → Model Zoo - Model Metrics 2023-08-31T22:02:02.1064241Z GET http://localhost:8082/metrics 2023-08-31T22:02:02.1065905Z 200 OK ★ 6ms time ★ 233B↑ 10.06kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:02.1072369Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 9.76kB 2023-08-31T22:02:02.1073897Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:02:02.1074312Z │ c with unit: Count 2023-08-31T22:02:02.1074594Z │ # TYPE Requests2XX counter 2023-08-31T22:02:02.1074948Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 43. 2023-08-31T22:02:02.1075222Z │ 0 2023-08-31T22:02:02.1075531Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:02:02.1075837Z │ c with unit: Count 2023-08-31T22:02:02.1076110Z │ # TYPE Requests5XX counter 2023-08-31T22:02:02.1076456Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:02:02.1076829Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:02:02.1077226Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:02:02.1077599Z │ ts_inference_latency_microseconds{model_name="alexnet_ 2023-08-31T22:02:02.1077967Z │ scripted",model_version="default",hostname="fv-az628-1 2023-08-31T22:02:02.1078259Z │ 90",} 90762.505 2023-08-31T22:02:02.1078579Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:02.1079229Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:02:02.1079520Z │ 5157.442 2023-08-31T22:02:02.1079832Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:02:02.1080188Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:02:02.1080461Z │ 197192.539 2023-08-31T22:02:02.1080774Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:02.1081140Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:02:02.1081417Z │ -190",} 23938.584 2023-08-31T22:02:02.1081933Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:02.1082299Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:02:02.1082597Z │ "fv-az628-190",} 52504.044 2023-08-31T22:02:02.1082919Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:02:02.1083280Z │ et1_1_scripted",model_version="default",hostname="fv-a 2023-08-31T22:02:02.1083566Z │ z628-190",} 107621.885 2023-08-31T22:02:02.1083894Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:02:02.1084262Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:02:02.1084527Z │ 8.971 2023-08-31T22:02:02.1084829Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:02:02.1085193Z │ et1_1",model_version="default",hostname="fv-az628-190" 2023-08-31T22:02:02.1085467Z │ ,} 69484.525 2023-08-31T22:02:02.1085774Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:02.1086129Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:02:02.1086579Z │ -190",} 153779.746 2023-08-31T22:02:02.1086890Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:02:02.1087250Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:02:02.1087511Z │ 94.667 2023-08-31T22:02:02.1087810Z │ ts_inference_latency_microseconds{model_name="vgg16_sc 2023-08-31T22:02:02.1088188Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:02.1088471Z │ ",} 298182.614 2023-08-31T22:02:02.1088792Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:02:02.1089123Z │ ic with unit: Milliseconds 2023-08-31T22:02:02.1089419Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:02:02.1089772Z │ WorkerLoadTime{WorkerName="W-9005-alexnet_1.0",Level=" 2023-08-31T22:02:02.1090095Z │ Host",Hostname="fv-az628-190",} 2255.0 2023-08-31T22:02:02.1090446Z │ WorkerLoadTime{WorkerName="W-9007-resnet-18_1.0",Level 2023-08-31T22:02:02.1090785Z │ ="Host",Hostname="fv-az628-190", 2023-08-31T22:02:02.1091066Z │ (showing 2.05kB/9.76kB) 2023-08-31T22:02:02.1091516Z └ 2023-08-31T22:02:02.1091927Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:02.1092969Z 1ms 231µs (cache) (cache) 4ms 1ms 27µs 7ms 2023-08-31T22:02:02.1093152Z 2023-08-31T22:02:02.1155445Z ✓ Successful GET request 2023-08-31T22:02:02.1191724Z 2023-08-31T22:02:02.1192140Z Iteration 12/24 2023-08-31T22:02:02.1208813Z 2023-08-31T22:02:02.1209297Z → Model Zoo - Register Model 2023-08-31T22:02:04.0519906Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/mnist_v2.mar&model_name=mnist&initial_workers=1&synchronous=true 2023-08-31T22:02:04.0521204Z 200 OK ★ 1925ms time ★ 362B↑ 347B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:04.0522255Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 81B 2023-08-31T22:02:04.0522592Z │ { 2023-08-31T22:02:04.0522964Z │ "status": "Model \"mnist\" Version: 2.0 registered w 2023-08-31T22:02:04.0523297Z │ ith 1 initial workers" 2023-08-31T22:02:04.0523535Z │ } 2023-08-31T22:02:04.0538306Z └ 2023-08-31T22:02:04.0539085Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:04.0539630Z 1ms 232µs (cache) (cache) 1922ms 2ms 32µs 1926ms 2023-08-31T22:02:04.0540132Z 2023-08-31T22:02:04.0588184Z ✓ Successful POST request 2023-08-31T22:02:04.0632359Z 2023-08-31T22:02:04.0632732Z → Model Zoo - Inference Model 2023-08-31T22:02:04.0908050Z POST http://localhost:8080/predictions/mnist 2023-08-31T22:02:04.0910344Z 200 OK ★ 21ms time ★ 537B↑ 234B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:02:04.0912179Z ┌ ↑ file ★ 272B 2023-08-31T22:02:04.0913882Z │ 2023-08-31T22:02:04.0915326Z └ 2023-08-31T22:02:04.0916904Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 1B 2023-08-31T22:02:04.0918494Z │ 0 2023-08-31T22:02:04.0932255Z └ 2023-08-31T22:02:04.0933189Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:04.0933750Z 2ms 225µs (cache) (cache) 18ms 1ms 27µs 22ms 2023-08-31T22:02:04.0933958Z 2023-08-31T22:02:04.0985497Z ✓ Successful POST request 2023-08-31T22:02:04.1000880Z ✓ Test expected TEXT response 2023-08-31T22:02:04.1043024Z 2023-08-31T22:02:04.1043600Z → Model Zoo - Unregister model 2023-08-31T22:02:04.1235541Z DELETE http://localhost:8081/models/mnist 2023-08-31T22:02:04.1239165Z 200 OK ★ 13ms time ★ 241B↑ 313B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:04.1246503Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:02:04.1249561Z │ { 2023-08-31T22:02:04.1250102Z │ "status": "Model \"mnist\" unregistered" 2023-08-31T22:02:04.1250765Z │ } 2023-08-31T22:02:04.1271071Z └ 2023-08-31T22:02:04.1271741Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:04.1272428Z 2ms 223µs (cache) (cache) 10ms 1ms 27µs 14ms 2023-08-31T22:02:04.1272856Z 2023-08-31T22:02:04.1324447Z ✓ Successful DELETE request 2023-08-31T22:02:04.1394191Z 2023-08-31T22:02:04.1394507Z → Model Zoo - Model Metrics 2023-08-31T22:02:04.1473687Z GET http://localhost:8082/metrics 2023-08-31T22:02:04.1474541Z 200 OK ★ 4ms time ★ 233B↑ 10.62kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:04.1475151Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 10.33kB 2023-08-31T22:02:04.1475795Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:02:04.1476345Z │ c with unit: Count 2023-08-31T22:02:04.1476945Z │ # TYPE Requests2XX counter 2023-08-31T22:02:04.1477511Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 47. 2023-08-31T22:02:04.1477957Z │ 0 2023-08-31T22:02:04.1478423Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:02:04.1478912Z │ c with unit: Count 2023-08-31T22:02:04.1479346Z │ # TYPE Requests5XX counter 2023-08-31T22:02:04.1479956Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:02:04.1480768Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:02:04.1481224Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:02:04.1481612Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:04.1482039Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:02:04.1482326Z │ 5157.442 2023-08-31T22:02:04.1482642Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:02:04.1483003Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:02:04.1483291Z │ 197192.539 2023-08-31T22:02:04.1483607Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:04.1483967Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:02:04.1484262Z │ -190",} 23938.584 2023-08-31T22:02:04.1484606Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:04.1484964Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:02:04.1485287Z │ "fv-az628-190",} 52504.044 2023-08-31T22:02:04.1485620Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:02:04.1485970Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:02:04.1486229Z │ 8.971 2023-08-31T22:02:04.1486981Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:04.1487356Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:02:04.1487640Z │ -190",} 153779.746 2023-08-31T22:02:04.1487961Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:02:04.1488328Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:02:04.1488589Z │ 94.667 2023-08-31T22:02:04.1488898Z │ ts_inference_latency_microseconds{model_name="mnist",m 2023-08-31T22:02:04.1489262Z │ odel_version="default",hostname="fv-az628-190",} 10707 2023-08-31T22:02:04.1489675Z │ .889 2023-08-31T22:02:04.1489980Z │ ts_inference_latency_microseconds{model_name="alexnet_ 2023-08-31T22:02:04.1490348Z │ scripted",model_version="default",hostname="fv-az628-1 2023-08-31T22:02:04.1490625Z │ 90",} 90762.505 2023-08-31T22:02:04.1490938Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:02:04.1491315Z │ et1_1_scripted",model_version="default",hostname="fv-a 2023-08-31T22:02:04.1491614Z │ z628-190",} 107621.885 2023-08-31T22:02:04.1491923Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:02:04.1492291Z │ et1_1",model_version="default",hostname="fv-az628-190" 2023-08-31T22:02:04.1492570Z │ ,} 69484.525 2023-08-31T22:02:04.1492874Z │ ts_inference_latency_microseconds{model_name="vgg16_sc 2023-08-31T22:02:04.1493246Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:04.1493526Z │ ",} 298182.614 2023-08-31T22:02:04.1493849Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:02:04.1494186Z │ ic with unit: Milliseconds 2023-08-31T22:02:04.1494478Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:02:04.1494816Z │ WorkerLoadTime{WorkerName="W-9005-alexnet_1.0",Level=" 2023-08-31T22:02:04.1495102Z │ Host",Hostna 2023-08-31T22:02:04.1495367Z │ (showing 2.05kB/10.33kB) 2023-08-31T22:02:04.1495712Z └ 2023-08-31T22:02:04.1496123Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:04.1496616Z 1ms 213µs (cache) (cache) 1ms 1ms 28µs 4ms 2023-08-31T22:02:04.1496814Z 2023-08-31T22:02:04.1572591Z ✓ Successful GET request 2023-08-31T22:02:04.1614595Z 2023-08-31T22:02:04.1614844Z Iteration 13/24 2023-08-31T22:02:04.1627615Z 2023-08-31T22:02:04.1628012Z → Model Zoo - Register Model 2023-08-31T22:02:06.0605398Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/mnist_scripted_v2.mar&model_name=mnist_scripted&initial_workers=1&synchronous=true 2023-08-31T22:02:06.0606663Z 200 OK ★ 1892ms time ★ 380B↑ 356B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:06.0607185Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 90B 2023-08-31T22:02:06.0607550Z │ { 2023-08-31T22:02:06.0607903Z │ "status": "Model \"mnist_scripted\" Version: 2.0 reg 2023-08-31T22:02:06.0608321Z │ istered with 1 initial workers" 2023-08-31T22:02:06.0608646Z │ } 2023-08-31T22:02:06.0609129Z └ 2023-08-31T22:02:06.0609609Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:06.0610192Z 1ms 214µs (cache) (cache) 1889ms 1ms 32µs 1892ms 2023-08-31T22:02:06.0610459Z 2023-08-31T22:02:06.0649459Z ✓ Successful POST request 2023-08-31T22:02:06.0695119Z 2023-08-31T22:02:06.0695448Z → Model Zoo - Inference Model 2023-08-31T22:02:06.1376322Z POST http://localhost:8080/predictions/mnist_scripted 2023-08-31T22:02:06.1377238Z 200 OK ★ 62ms time ★ 546B↑ 234B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:02:06.1377666Z ┌ ↑ file ★ 272B 2023-08-31T22:02:06.1377980Z │ 2023-08-31T22:02:06.1378245Z └ 2023-08-31T22:02:06.1378644Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 1B 2023-08-31T22:02:06.1378986Z │ 0 2023-08-31T22:02:06.1396215Z └ 2023-08-31T22:02:06.1396726Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:06.1397583Z 1ms 344µs (cache) (cache) 59ms 1ms 32µs 63ms 2023-08-31T22:02:06.1397869Z 2023-08-31T22:02:06.1462586Z ✓ Successful POST request 2023-08-31T22:02:06.1466944Z ✓ Test expected TEXT response 2023-08-31T22:02:06.1505945Z 2023-08-31T22:02:06.1506379Z → Model Zoo - Unregister model 2023-08-31T22:02:06.1744000Z DELETE http://localhost:8081/models/mnist_scripted 2023-08-31T22:02:06.1745017Z 200 OK ★ 19ms time ★ 250B↑ 322B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:06.1746017Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 56B 2023-08-31T22:02:06.1746688Z │ { 2023-08-31T22:02:06.1747016Z │ "status": "Model \"mnist_scripted\" unregistered" 2023-08-31T22:02:06.1747300Z │ } 2023-08-31T22:02:06.1759882Z └ 2023-08-31T22:02:06.1760362Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:06.1761664Z 1ms 218µs (cache) (cache) 11ms 6ms 28µs 19ms 2023-08-31T22:02:06.1761871Z 2023-08-31T22:02:06.1801298Z ✓ Successful DELETE request 2023-08-31T22:02:06.1897045Z 2023-08-31T22:02:06.1897733Z → Model Zoo - Model Metrics 2023-08-31T22:02:06.1979402Z GET http://localhost:8082/metrics 2023-08-31T22:02:06.1982541Z 200 OK ★ 4ms time ★ 233B↑ 11.24kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:06.1985955Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 10.95kB 2023-08-31T22:02:06.1989162Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:02:06.1989507Z │ c with unit: Count 2023-08-31T22:02:06.1989837Z │ # TYPE Requests2XX counter 2023-08-31T22:02:06.1991735Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 51. 2023-08-31T22:02:06.1992260Z │ 0 2023-08-31T22:02:06.1992802Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:02:06.1993427Z │ c with unit: Count 2023-08-31T22:02:06.1993732Z │ # TYPE Requests5XX counter 2023-08-31T22:02:06.1994120Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:02:06.1994503Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:02:06.1994877Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:02:06.1995263Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:06.1995634Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:02:06.1995917Z │ 5157.442 2023-08-31T22:02:06.1996237Z │ ts_inference_latency_microseconds{model_name="mnist_sc 2023-08-31T22:02:06.1996599Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:06.1996912Z │ ",} 58411.041 2023-08-31T22:02:06.1997230Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:02:06.1997601Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:02:06.1997867Z │ 197192.539 2023-08-31T22:02:06.1998180Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:06.1998552Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:02:06.1998834Z │ -190",} 23938.584 2023-08-31T22:02:06.1999147Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:06.1999518Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:02:06.1999838Z │ "fv-az628-190",} 52504.044 2023-08-31T22:02:06.2000175Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:02:06.2000542Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:02:06.2000809Z │ 8.971 2023-08-31T22:02:06.2001108Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:06.2001481Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:02:06.2001765Z │ -190",} 153779.746 2023-08-31T22:02:06.2002078Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:02:06.2002438Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:02:06.2002759Z │ 94.667 2023-08-31T22:02:06.2003354Z │ ts_inference_latency_microseconds{model_name="mnist",m 2023-08-31T22:02:06.2003731Z │ odel_version="default",hostname="fv-az628-190",} 10707 2023-08-31T22:02:06.2003994Z │ .889 2023-08-31T22:02:06.2004286Z │ ts_inference_latency_microseconds{model_name="alexnet_ 2023-08-31T22:02:06.2004656Z │ scripted",model_version="default",hostname="fv-az628-1 2023-08-31T22:02:06.2004951Z │ 90",} 90762.505 2023-08-31T22:02:06.2005270Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:02:06.2005630Z │ et1_1_scripted",model_version="default",hostname="fv-a 2023-08-31T22:02:06.2006088Z │ z628-190",} 107621.885 2023-08-31T22:02:06.2006560Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:02:06.2006917Z │ et1_1",model_version="default",hostname="fv-az628-190" 2023-08-31T22:02:06.2007199Z │ ,} 69484.525 2023-08-31T22:02:06.2007525Z │ ts_inference_latency_microseconds{model_name="vgg16_sc 2023-08-31T22:02:06.2007880Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:06.2008178Z │ ",} 298182.614 2023-08-31T22:02:06.2008512Z │ # HELP WorkerLoadTime Torchserve prometheus gauge met 2023-08-31T22:02:06.2008844Z │ (showing 2.05kB/10.95kB) 2023-08-31T22:02:06.2017443Z └ 2023-08-31T22:02:06.2018011Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:06.2018594Z 1ms 215µs (cache) (cache) 1ms 1ms 28µs 4ms 2023-08-31T22:02:06.2018875Z 2023-08-31T22:02:06.2070066Z ✓ Successful GET request 2023-08-31T22:02:06.2096677Z 2023-08-31T22:02:06.2097070Z Iteration 14/24 2023-08-31T22:02:06.2109665Z 2023-08-31T22:02:06.2110103Z → Model Zoo - Register Model 2023-08-31T22:02:09.9767384Z POST http://localhost:8081/models?url=fastrcnn.mar&model_name=fastrcnn&initial_workers=1&synchronous=true 2023-08-31T22:02:09.9768769Z 200 OK ★ 3.7s time ★ 324B↑ 350B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:09.9769233Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 84B 2023-08-31T22:02:09.9769554Z │ { 2023-08-31T22:02:09.9769903Z │ "status": "Model \"fastrcnn\" Version: 1.0 registere 2023-08-31T22:02:09.9770236Z │ d with 1 initial workers" 2023-08-31T22:02:09.9770478Z │ } 2023-08-31T22:02:09.9770655Z └ 2023-08-31T22:02:09.9771058Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:09.9771554Z 1ms 242µs (cache) (cache) 3.7s 1ms 30µs 3.7s 2023-08-31T22:02:09.9771743Z 2023-08-31T22:02:09.9823607Z ✓ Successful POST request 2023-08-31T22:02:09.9868348Z 2023-08-31T22:02:09.9868909Z → Model Zoo - Inference Model 2023-08-31T22:02:12.3440840Z POST http://localhost:8080/predictions/fastrcnn 2023-08-31T22:02:12.3441993Z 200 OK ★ 2.3s time ★ 289.21kB↑ 3.01kB↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:02:12.3442598Z ┌ ↑ file ★ 288.94kB 2023-08-31T22:02:12.3442992Z │ (showing 2.05kB/288.94kB) 2023-08-31T22:02:12.3443430Z └ 2023-08-31T22:02:12.3444241Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 2.77kB 2023-08-31T22:02:12.3444717Z │ [ 2023-08-31T22:02:12.3445317Z │ { 2023-08-31T22:02:12.3445786Z │ "person": [ 2023-08-31T22:02:12.3446181Z │ 167.39585876464844, 2023-08-31T22:02:12.3446741Z │ 57.20302200317383, 2023-08-31T22:02:12.3447179Z │ 301.3599853515625, 2023-08-31T22:02:12.3447576Z │ 436.7975158691406 2023-08-31T22:02:12.3447938Z │ ], 2023-08-31T22:02:12.3448270Z │ "score": 0.9995200634002686 2023-08-31T22:02:12.3448625Z │ }, 2023-08-31T22:02:12.3448943Z │ { 2023-08-31T22:02:12.3449228Z │ "person": [ 2023-08-31T22:02:12.3449565Z │ 89.54700469970703, 2023-08-31T22:02:12.3449902Z │ 64.83567810058594, 2023-08-31T22:02:12.3450230Z │ 191.42428588867188, 2023-08-31T22:02:12.3450564Z │ 446.7607727050781 2023-08-31T22:02:12.3451406Z │ ], 2023-08-31T22:02:12.3451756Z │ "score": 0.9994968175888062 2023-08-31T22:02:12.3452000Z │ }, 2023-08-31T22:02:12.3452250Z │ { 2023-08-31T22:02:12.3452488Z │ "person": [ 2023-08-31T22:02:12.3452744Z │ 362.3782653808594, 2023-08-31T22:02:12.3453002Z │ 161.84136962890625, 2023-08-31T22:02:12.3453250Z │ 515.5023193359375, 2023-08-31T22:02:12.3453491Z │ 385.28985595703125 2023-08-31T22:02:12.3453728Z │ ], 2023-08-31T22:02:12.3453983Z │ "score": 0.9977062940597534 2023-08-31T22:02:12.3454206Z │ }, 2023-08-31T22:02:12.3454412Z │ { 2023-08-31T22:02:12.3454636Z │ "handbag": [ 2023-08-31T22:02:12.3454888Z │ 67.3762435913086, 2023-08-31T22:02:12.3455453Z │ 277.5755310058594, 2023-08-31T22:02:12.3455710Z │ 111.67390441894531, 2023-08-31T22:02:12.3455963Z │ 400.20672607421875 2023-08-31T22:02:12.3456179Z │ ], 2023-08-31T22:02:12.3456439Z │ "score": 0.992499053478241 2023-08-31T22:02:12.3456674Z │ }, 2023-08-31T22:02:12.3456868Z │ { 2023-08-31T22:02:12.3457091Z │ "handbag": [ 2023-08-31T22:02:12.3457364Z │ 228.68252563476562, 2023-08-31T22:02:12.3457609Z │ 146.00697326660156, 2023-08-31T22:02:12.3457856Z │ 303.55120849609375, 2023-08-31T22:02:12.3458102Z │ 231.08848571777344 2023-08-31T22:02:12.3458318Z │ ], 2023-08-31T22:02:12.3458572Z │ "score": 0.9922404289245605 2023-08-31T22:02:12.3458806Z │ }, 2023-08-31T22:02:12.3459000Z │ { 2023-08-31T22:02:12.3459224Z │ "handbag": [ 2023-08-31T22:02:12.3459468Z │ 379.411376953125, 2023-08-31T22:02:12.3459706Z │ 259.957763671875, 2023-08-31T22:02:12.3459970Z │ 419.0797424316406, 2023-08-31T22:02:12.3460216Z │ 317.9610290527344 2023-08-31T22:02:12.3460425Z │ ], 2023-08-31T22:02:12.3460674Z │ "score": 0.9898614883422852 2023-08-31T22:02:12.3460908Z │ }, 2023-08-31T22:02:12.3461101Z │ { 2023-08-31T22:02:12.3461323Z │ "person": [ 2023-08-31T22:02:12.3461578Z │ 518.4950561523438, 2023-08-31T22:02:12.3461816Z │ 149.73020935058594, 2023-08-31T22:02:12.3462075Z │ 636.6343383789062, 2023-08-31T22:02:12.3462316Z │ 365.4129638671875 2023-08-31T22:02:12.3462528Z │ ], 2023-08-31T22:02:12.3462777Z │ "score": 0.9821106791496277 2023-08-31T22:02:12.3463008Z │ }, 2023-08-31T22:02:12.3463201Z │ { 2023-08-31T22:02:12.3463420Z │ "bench": [ 2023-08-31T22:02:12.3463667Z │ 269.08184814453125, 2023-08-31T22:02:12.3463905Z │ 217.34202575683594, 2023-08-31T22:02:12.3464150Z │ 423.77105712890625, 2023-08-31T22:02:12.3464395Z │ 390.3786315917969 2023-08-31T22:02:12.3464629Z │ ], 2023-08-31T22:02:12.3464865Z │ "score": 0.9573412537574768 2023-08-31T22:02:12.3465096Z │ }, 2023-08-31T22:02:12.3465300Z │ { 2023-08-31T22:02:12.3465514Z │ "person": [ 2023-08-31T22:02:12.3465760Z │ 539.6298217773438, 2023-08-31T22:02:12.3466009Z │ 157.75868225097656, 2023-08-31T22:02:12.3466246Z │ 616.1533813476562, 2023-08-31T22:02:12.3466491Z │ 253.1112823486328 2023-08-31T22:02:12.3466844Z │ ], 2023-08-31T22:02:12.3467091Z │ "score": 0.8995410799980164 2023-08-31T22:02:12.3467322Z │ }, 2023-08-31T22:02:12.3467526Z │ { 2023-08-31T22:02:12.3467739Z │ "person": [ 2023-08-31T22:02:12.3467987Z │ 477.06231689453125, 2023-08-31T22:02:12.3468258Z │ 147.80886840820312, 2023-08-31T22:02:12.3468493Z │ 610.777587890625, 2023-08-31T22:02:12.3468737Z │ 296.83734130859375 2023-08-31T22:02:12.3468960Z │ ], 2023-08-31T22:02:12.3469201Z │ "score": 0.875154435634613 2023-08-31T22:02:12.3469546Z │ }, 2023-08-31T22:02:12.3469751Z │ { 2023-08-31T22:02:12.3469959Z │ "bench": [ 2023-08-31T22:02:12.3470202Z │ 286.08746337890625, 2023-08-31T22:02:12.3470448Z │ 216.53285217285156, 2023-08-31T22:02:12.3470684Z │ 550.7698364257812, 2023-08-31T22:02:12.3470931Z │ 383.1822814941406 2023-08-31T22:02:12.3471157Z │ ], 2023-08-31T22:02:12.3471396Z │ "score": 0.8436452150344849 2023-08-31T22:02:12.3471642Z │ }, 2023-08-31T22:02:12.3471849Z │ { 2023-08-31T22:02:12.3472060Z │ "person": [ 2023-08-31T22:02:12.3472312Z │ 627.4741821289062, 2023-08-31T22:02:12.3472558Z │ 177.05838012695312, 2023-08-31T22:02:12.3472794Z │ 640.0, 2023-08-31T22:02:12.3473028Z │ 247.72152709960938 2023-08-31T22:02:12.3473255Z │ ], 2023-08-31T22:02:12.3473503Z │ "score": 0.8257319927215576 2023-08-31T22:02:12.3473722Z │ }, 2023-08-31T22:02:12.3473931Z │ { 2023-08-31T22:02:12.3474151Z │ "bench": [ 2023-08-31T22:02:12.3474400Z │ 88.7637939453125, 2023-08-31T22:02:12.3474651Z │ 226.16490173339844, 2023-08-31T22:02:12.3474890Z │ 563.614562 2023-08-31T22:02:12.3475138Z │ (showing 2.05kB/2.77kB) 2023-08-31T22:02:12.3543460Z └ 2023-08-31T22:02:12.3543995Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:12.3544541Z 1ms 214µs (cache) (cache) 2.3s 1ms 34µs 2.3s 2023-08-31T22:02:12.3544746Z 2023-08-31T22:02:12.3589795Z ✓ Successful POST request 2023-08-31T22:02:12.3639068Z 2023-08-31T22:02:12.3639382Z → Model Zoo - Unregister model 2023-08-31T22:02:12.4073573Z DELETE http://localhost:8081/models/fastrcnn 2023-08-31T22:02:12.4074470Z 200 OK ★ 38ms time ★ 244B↑ 316B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:12.4074986Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 50B 2023-08-31T22:02:12.4075351Z │ { 2023-08-31T22:02:12.4075745Z │ "status": "Model \"fastrcnn\" unregistered" 2023-08-31T22:02:12.4076122Z │ } 2023-08-31T22:02:12.4088166Z └ 2023-08-31T22:02:12.4088677Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:12.4089250Z 1ms 237µs (cache) (cache) 35ms 2ms 30µs 38ms 2023-08-31T22:02:12.4089505Z 2023-08-31T22:02:12.4133550Z ✓ Successful DELETE request 2023-08-31T22:02:12.4172907Z 2023-08-31T22:02:12.4173226Z → Model Zoo - Model Metrics 2023-08-31T22:02:12.4259239Z GET http://localhost:8082/metrics 2023-08-31T22:02:12.4259888Z 200 OK ★ 3ms time ★ 233B↑ 11.83kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:12.4262164Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 11.54kB 2023-08-31T22:02:12.4264021Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:02:12.4264360Z │ c with unit: Count 2023-08-31T22:02:12.4264642Z │ # TYPE Requests2XX counter 2023-08-31T22:02:12.4265007Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 55. 2023-08-31T22:02:12.4265328Z │ 0 2023-08-31T22:02:12.4265648Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:02:12.4265952Z │ c with unit: Count 2023-08-31T22:02:12.4266231Z │ # TYPE Requests5XX counter 2023-08-31T22:02:12.4266582Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:02:12.4266959Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:02:12.4267602Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:02:12.4267994Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:12.4268364Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:02:12.4268649Z │ 5157.442 2023-08-31T22:02:12.4268967Z │ ts_inference_latency_microseconds{model_name="mnist_sc 2023-08-31T22:02:12.4269328Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:12.4269615Z │ ",} 58411.041 2023-08-31T22:02:12.4269932Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:02:12.4270446Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:02:12.4270713Z │ 197192.539 2023-08-31T22:02:12.4271024Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:12.4271380Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:02:12.4271656Z │ -190",} 23938.584 2023-08-31T22:02:12.4271973Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:12.4272351Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:02:12.4272835Z │ "fv-az628-190",} 52504.044 2023-08-31T22:02:12.4273280Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:02:12.4273739Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:02:12.4274094Z │ 8.971 2023-08-31T22:02:12.4274412Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:12.4274852Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:02:12.4275234Z │ -190",} 153779.746 2023-08-31T22:02:12.4275629Z │ ts_inference_latency_microseconds{model_name="fastrcnn 2023-08-31T22:02:12.4276054Z │ ",model_version="default",hostname="fv-az628-190",} 23 2023-08-31T22:02:12.4276402Z │ 41906.593 2023-08-31T22:02:12.4276784Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:02:12.4277211Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:02:12.4277563Z │ 94.667 2023-08-31T22:02:12.4277947Z │ ts_inference_latency_microseconds{model_name="mnist",m 2023-08-31T22:02:12.4278382Z │ odel_version="default",hostname="fv-az628-190",} 10707 2023-08-31T22:02:12.4278715Z │ .889 2023-08-31T22:02:12.4279034Z │ ts_inference_latency_microseconds{model_name="alexnet_ 2023-08-31T22:02:12.4279403Z │ scripted",model_version="default",hostname="fv-az628-1 2023-08-31T22:02:12.4279759Z │ 90",} 90762.505 2023-08-31T22:02:12.4280140Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:02:12.4280587Z │ et1_1_scripted",model_version="default",hostname="fv-a 2023-08-31T22:02:12.4280969Z │ z628-190",} 107621.885 2023-08-31T22:02:12.4281362Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:02:12.4281786Z │ et1_1",model_version="default",hostname="fv-az628-190" 2023-08-31T22:02:12.4282140Z │ ,} 69484.525 2023-08-31T22:02:12.4282534Z │ ts_inference_latency_microseconds{model_name="vgg16_sc 2023-08-31T22:02:12.4282881Z │ ript 2023-08-31T22:02:12.4283160Z │ (showing 2.05kB/11.54kB) 2023-08-31T22:02:12.4296028Z └ 2023-08-31T22:02:12.4296469Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:12.4296958Z 1ms 220µs (cache) (cache) 1ms 1ms 29µs 4ms 2023-08-31T22:02:12.4297159Z 2023-08-31T22:02:12.4347675Z ✓ Successful GET request 2023-08-31T22:02:12.4373009Z 2023-08-31T22:02:12.4373196Z Iteration 15/24 2023-08-31T22:02:12.4385949Z 2023-08-31T22:02:12.4386215Z → Model Zoo - Register Model 2023-08-31T22:02:15.8508778Z POST http://localhost:8081/models?url=maskrcnn.mar&model_name=maskrcnn&initial_workers=1&synchronous=true 2023-08-31T22:02:15.8509947Z 200 OK ★ 3.4s time ★ 324B↑ 350B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:15.8510672Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 84B 2023-08-31T22:02:15.8511485Z │ { 2023-08-31T22:02:15.8511940Z │ "status": "Model \"maskrcnn\" Version: 1.0 registere 2023-08-31T22:02:15.8512602Z │ d with 1 initial workers" 2023-08-31T22:02:15.8512854Z │ } 2023-08-31T22:02:15.8529428Z └ 2023-08-31T22:02:15.8529923Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:15.8530429Z 1ms 220µs (cache) (cache) 3.4s 1ms 32µs 3.4s 2023-08-31T22:02:15.8530631Z 2023-08-31T22:02:15.8572339Z ✓ Successful POST request 2023-08-31T22:02:15.8614985Z 2023-08-31T22:02:15.8615394Z → Model Zoo - Inference Model 2023-08-31T22:02:18.4485086Z POST http://localhost:8080/predictions/maskrcnn 2023-08-31T22:02:18.4486183Z 200 OK ★ 2.5s time ★ 289.21kB↑ 2.99kB↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:02:18.4486935Z ┌ ↑ file ★ 288.94kB 2023-08-31T22:02:18.4487841Z │ (showing 2.05kB/288.94kB) 2023-08-31T22:02:18.4488139Z └ 2023-08-31T22:02:18.4488477Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 2.75kB 2023-08-31T22:02:18.4488754Z │ [ 2023-08-31T22:02:18.4489486Z │ { 2023-08-31T22:02:18.4489731Z │ "person": [ 2023-08-31T22:02:18.4489987Z │ 169.50636291503906, 2023-08-31T22:02:18.4490252Z │ 49.98552322387695, 2023-08-31T22:02:18.4490501Z │ 300.8945617675781, 2023-08-31T22:02:18.4490737Z │ 442.4544982910156 2023-08-31T22:02:18.4490970Z │ ], 2023-08-31T22:02:18.4491230Z │ "score": 0.9995434880256653 2023-08-31T22:02:18.4491471Z │ }, 2023-08-31T22:02:18.4491670Z │ { 2023-08-31T22:02:18.4491897Z │ "person": [ 2023-08-31T22:02:18.4492146Z │ 90.4118423461914, 2023-08-31T22:02:18.4492412Z │ 66.79048919677734, 2023-08-31T22:02:18.4492667Z │ 194.19305419921875, 2023-08-31T22:02:18.4492957Z │ 437.2776794433594 2023-08-31T22:02:18.4493186Z │ ], 2023-08-31T22:02:18.4493430Z │ "score": 0.9993956089019775 2023-08-31T22:02:18.4493663Z │ }, 2023-08-31T22:02:18.4493868Z │ { 2023-08-31T22:02:18.4494081Z │ "person": [ 2023-08-31T22:02:18.4494346Z │ 362.3172912597656, 2023-08-31T22:02:18.4494601Z │ 158.17355346679688, 2023-08-31T22:02:18.4494841Z │ 521.2589721679688, 2023-08-31T22:02:18.4495085Z │ 385.7226867675781 2023-08-31T22:02:18.4495304Z │ ], 2023-08-31T22:02:18.4495545Z │ "score": 0.9952279329299927 2023-08-31T22:02:18.4495780Z │ }, 2023-08-31T22:02:18.4495986Z │ { 2023-08-31T22:02:18.4496201Z │ "handbag": [ 2023-08-31T22:02:18.4496449Z │ 68.57540893554688, 2023-08-31T22:02:18.4496701Z │ 279.31817626953125, 2023-08-31T22:02:18.4496943Z │ 111.15328979492188, 2023-08-31T22:02:18.4497209Z │ 400.9165954589844 2023-08-31T22:02:18.4497435Z │ ], 2023-08-31T22:02:18.4497672Z │ "score": 0.9938817024230957 2023-08-31T22:02:18.4497905Z │ }, 2023-08-31T22:02:18.4498111Z │ { 2023-08-31T22:02:18.4498325Z │ "person": [ 2023-08-31T22:02:18.4498571Z │ 474.0157165527344, 2023-08-31T22:02:18.4498816Z │ 147.3479766845703, 2023-08-31T22:02:18.4499056Z │ 638.1209716796875, 2023-08-31T22:02:18.4499303Z │ 364.6508483886719 2023-08-31T22:02:18.4499527Z │ ], 2023-08-31T22:02:18.4499761Z │ "score": 0.9897465705871582 2023-08-31T22:02:18.4499995Z │ }, 2023-08-31T22:02:18.4500197Z │ { 2023-08-31T22:02:18.4500408Z │ "handbag": [ 2023-08-31T22:02:18.4500669Z │ 225.59584045410156, 2023-08-31T22:02:18.4500915Z │ 142.9000244140625, 2023-08-31T22:02:18.4501151Z │ 302.48638916015625, 2023-08-31T22:02:18.4501392Z │ 230.3284149169922 2023-08-31T22:02:18.4501633Z │ ], 2023-08-31T22:02:18.4501871Z │ "score": 0.9891214966773987 2023-08-31T22:02:18.4502102Z │ }, 2023-08-31T22:02:18.4502306Z │ { 2023-08-31T22:02:18.4502523Z │ "handbag": [ 2023-08-31T22:02:18.4502769Z │ 380.2604675292969, 2023-08-31T22:02:18.4503018Z │ 259.20123291015625, 2023-08-31T22:02:18.4503268Z │ 419.5366516113281, 2023-08-31T22:02:18.4503502Z │ 318.2773132324219 2023-08-31T22:02:18.4504008Z │ ], 2023-08-31T22:02:18.4504268Z │ "score": 0.9688038229942322 2023-08-31T22:02:18.4504495Z │ }, 2023-08-31T22:02:18.4504707Z │ { 2023-08-31T22:02:18.4504929Z │ "bench": [ 2023-08-31T22:02:18.4505172Z │ 273.4857177734375, 2023-08-31T22:02:18.4505422Z │ 217.4883575439453, 2023-08-31T22:02:18.4505664Z │ 441.0653991699219, 2023-08-31T22:02:18.4505900Z │ 396.24169921875 2023-08-31T22:02:18.4506134Z │ ], 2023-08-31T22:02:18.4506382Z │ "score": 0.9617547988891602 2023-08-31T22:02:18.4506760Z │ }, 2023-08-31T22:02:18.4506960Z │ { 2023-08-31T22:02:18.4507184Z │ "person": [ 2023-08-31T22:02:18.4507421Z │ 541.2896728515625, 2023-08-31T22:02:18.4507673Z │ 156.66119384765625, 2023-08-31T22:02:18.4507920Z │ 619.9386596679688, 2023-08-31T22:02:18.4508152Z │ 249.45323181152344 2023-08-31T22:02:18.4508379Z │ ], 2023-08-31T22:02:18.4508630Z │ "score": 0.8177028298377991 2023-08-31T22:02:18.4508864Z │ }, 2023-08-31T22:02:18.4509077Z │ { 2023-08-31T22:02:18.4509300Z │ "person": [ 2023-08-31T22:02:18.4509537Z │ 362.9620666503906, 2023-08-31T22:02:18.4509782Z │ 163.89923095703125, 2023-08-31T22:02:18.4510032Z │ 500.769775390625, 2023-08-31T22:02:18.4510267Z │ 293.91229248046875 2023-08-31T22:02:18.4510489Z │ ], 2023-08-31T22:02:18.4510737Z │ "score": 0.8016968369483948 2023-08-31T22:02:18.4510959Z │ }, 2023-08-31T22:02:18.4511165Z │ { 2023-08-31T22:02:18.4511384Z │ "chair": [ 2023-08-31T22:02:18.4511637Z │ 455.20855712890625, 2023-08-31T22:02:18.4511883Z │ 207.54010009765625, 2023-08-31T22:02:18.4512129Z │ 491.0853271484375, 2023-08-31T22:02:18.4512359Z │ 274.6475830078125 2023-08-31T22:02:18.4512581Z │ ], 2023-08-31T22:02:18.4512833Z │ "score": 0.7758328914642334 2023-08-31T22:02:18.4513062Z │ }, 2023-08-31T22:02:18.4513258Z │ { 2023-08-31T22:02:18.4513488Z │ "person": [ 2023-08-31T22:02:18.4513733Z │ 549.1538696289062, 2023-08-31T22:02:18.4513966Z │ 177.42056274414062, 2023-08-31T22:02:18.4514202Z │ 640.0, 2023-08-31T22:02:18.4514447Z │ 364.5394287109375 2023-08-31T22:02:18.4514665Z │ ], 2023-08-31T22:02:18.4514914Z │ "score": 0.7176420092582703 2023-08-31T22:02:18.4515147Z │ }, 2023-08-31T22:02:18.4515347Z │ { 2023-08-31T22:02:18.4515567Z │ "person": [ 2023-08-31T22:02:18.4515807Z │ 626.230712890625, 2023-08-31T22:02:18.4516042Z │ 178.6534423828125, 2023-08-31T22:02:18.4516287Z │ 640.0, 2023-08-31T22:02:18.4516509Z │ 24 2023-08-31T22:02:18.4516752Z │ (showing 2.05kB/2.75kB) 2023-08-31T22:02:18.4532288Z └ 2023-08-31T22:02:18.4532728Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:18.4533224Z 2ms 213µs (cache) (cache) 2.5s 1ms 40µs 2.5s 2023-08-31T22:02:18.4533426Z 2023-08-31T22:02:18.4585667Z ✓ Successful POST request 2023-08-31T22:02:18.4673597Z 2023-08-31T22:02:18.4674219Z → Model Zoo - Unregister model 2023-08-31T22:02:18.5194022Z DELETE http://localhost:8081/models/maskrcnn 2023-08-31T22:02:18.5195077Z 200 OK ★ 45ms time ★ 244B↑ 316B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:18.5195753Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 50B 2023-08-31T22:02:18.5196222Z │ { 2023-08-31T22:02:18.5197180Z │ "status": "Model \"maskrcnn\" unregistered" 2023-08-31T22:02:18.5197584Z │ } 2023-08-31T22:02:18.5208155Z └ 2023-08-31T22:02:18.5208726Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:18.5209347Z 1ms 240µs (cache) (cache) 42ms 1ms 33µs 45ms 2023-08-31T22:02:18.5209665Z 2023-08-31T22:02:18.5449764Z ✓ Successful DELETE request 2023-08-31T22:02:18.5566973Z 2023-08-31T22:02:18.5567959Z → Model Zoo - Model Metrics 2023-08-31T22:02:18.5688151Z GET http://localhost:8082/metrics 2023-08-31T22:02:18.5689109Z 200 OK ★ 4ms time ★ 233B↑ 12.42kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:18.5689796Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 12.12kB 2023-08-31T22:02:18.5690401Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:02:18.5690942Z │ c with unit: Count 2023-08-31T22:02:18.5691605Z │ # TYPE Requests2XX counter 2023-08-31T22:02:18.5692262Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 59. 2023-08-31T22:02:18.5692714Z │ 0 2023-08-31T22:02:18.5693397Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:02:18.5693867Z │ c with unit: Count 2023-08-31T22:02:18.5694357Z │ # TYPE Requests5XX counter 2023-08-31T22:02:18.5695532Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:02:18.5696106Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:02:18.5696622Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:02:18.5697137Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:18.5697599Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:02:18.5697961Z │ 5157.442 2023-08-31T22:02:18.5698353Z │ ts_inference_latency_microseconds{model_name="mnist_sc 2023-08-31T22:02:18.5698786Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:18.5699157Z │ ",} 58411.041 2023-08-31T22:02:18.5699567Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:02:18.5700023Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:02:18.5700392Z │ 197192.539 2023-08-31T22:02:18.5700789Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:18.5701247Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:02:18.5701615Z │ -190",} 23938.584 2023-08-31T22:02:18.5702018Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:18.5702464Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:02:18.5702859Z │ "fv-az628-190",} 52504.044 2023-08-31T22:02:18.5703275Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:02:18.5703724Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:02:18.5704058Z │ 8.971 2023-08-31T22:02:18.5704453Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:18.5704882Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:02:18.5705243Z │ -190",} 153779.746 2023-08-31T22:02:18.5705628Z │ ts_inference_latency_microseconds{model_name="fastrcnn 2023-08-31T22:02:18.5706087Z │ ",model_version="default",hostname="fv-az628-190",} 23 2023-08-31T22:02:18.5706432Z │ 41906.593 2023-08-31T22:02:18.5706821Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:02:18.5707262Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:02:18.5707597Z │ 94.667 2023-08-31T22:02:18.5708003Z │ ts_inference_latency_microseconds{model_name="maskrcnn 2023-08-31T22:02:18.5708440Z │ ",model_version="default",hostname="fv-az628-190",} 25 2023-08-31T22:02:18.5708781Z │ 74140.332 2023-08-31T22:02:18.5709172Z │ ts_inference_latency_microseconds{model_name="mnist",m 2023-08-31T22:02:18.5709599Z │ odel_version="default",hostname="fv-az628-190",} 10707 2023-08-31T22:02:18.5709942Z │ .889 2023-08-31T22:02:18.5710325Z │ ts_inference_latency_microseconds{model_name="alexnet_ 2023-08-31T22:02:18.5710787Z │ scripted",model_version="default",hostname="fv-az628-1 2023-08-31T22:02:18.5711176Z │ 90",} 90762.505 2023-08-31T22:02:18.5711577Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:02:18.5712008Z │ et1_1_scripted",model_version="default",hostname="fv-a 2023-08-31T22:02:18.5712391Z │ z628-190",} 107621.885 2023-08-31T22:02:18.5712787Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:02:18.5713141Z │ et1_1", 2023-08-31T22:02:18.5713481Z │ (showing 2.05kB/12.12kB) 2023-08-31T22:02:18.5713959Z └ 2023-08-31T22:02:18.5714470Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:18.5715066Z 3ms 269µs (cache) (cache) 1ms 1ms 51µs 7ms 2023-08-31T22:02:18.5715342Z 2023-08-31T22:02:18.5763807Z ✓ Successful GET request 2023-08-31T22:02:18.5794679Z 2023-08-31T22:02:18.5794972Z Iteration 16/24 2023-08-31T22:02:18.5807922Z 2023-08-31T22:02:18.5808285Z → Model Zoo - Register Model 2023-08-31T22:02:23.0767814Z POST http://localhost:8081/models?url=fcn_resnet_101.mar&model_name=fcn_resnet_101&initial_workers=1&synchronous=true 2023-08-31T22:02:23.0769258Z 200 OK ★ 4.4s time ★ 336B↑ 356B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:23.0769700Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 90B 2023-08-31T22:02:23.0769988Z │ { 2023-08-31T22:02:23.0770314Z │ "status": "Model \"fcn_resnet_101\" Version: 1.0 reg 2023-08-31T22:02:23.0770662Z │ istered with 1 initial workers" 2023-08-31T22:02:23.0770939Z │ } 2023-08-31T22:02:23.0778040Z └ 2023-08-31T22:02:23.0778506Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:23.0779010Z 1ms 206µs (cache) (cache) 4.4s 3ms 51µs 4.4s 2023-08-31T22:02:23.0779210Z 2023-08-31T22:02:23.0836949Z ✓ Successful POST request 2023-08-31T22:02:23.0879618Z 2023-08-31T22:02:23.0880043Z → Model Zoo - Inference Model 2023-08-31T22:02:23.8575520Z POST http://localhost:8080/predictions/fcn_resnet_101 2023-08-31T22:02:23.8576729Z 200 OK ★ 759ms time ★ 289.22kB↑ 2.47MB↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:02:23.8577319Z ┌ ↑ file ★ 288.94kB 2023-08-31T22:02:23.8578134Z │ (showing 2.05kB/288.94kB) 2023-08-31T22:02:23.8578515Z └ 2023-08-31T22:02:23.8581173Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 2.47MB 2023-08-31T22:02:23.8581657Z │ [ 2023-08-31T22:02:23.8582928Z │ [ 2023-08-31T22:02:23.8583278Z │ [ 2023-08-31T22:02:23.8583691Z │ 0.0, 2023-08-31T22:02:23.8584107Z │ 0.9993855953216553 2023-08-31T22:02:23.8584504Z │ ], 2023-08-31T22:02:23.8584920Z │ [ 2023-08-31T22:02:23.8586757Z │ 0.0, 2023-08-31T22:02:23.8587213Z │ 0.9993855953216553 2023-08-31T22:02:23.8587568Z │ ], 2023-08-31T22:02:23.8587959Z │ [ 2023-08-31T22:02:23.8588352Z │ 0.0, 2023-08-31T22:02:23.8588755Z │ 0.9993855953216553 2023-08-31T22:02:23.8589115Z │ ], 2023-08-31T22:02:23.8589480Z │ [ 2023-08-31T22:02:23.8589968Z │ 0.0, 2023-08-31T22:02:23.8590504Z │ 0.9993855953216553 2023-08-31T22:02:23.8590846Z │ ], 2023-08-31T22:02:23.8591206Z │ [ 2023-08-31T22:02:23.8707134Z │ 0.0, 2023-08-31T22:02:23.8707437Z │ 0.9993864297866821 2023-08-31T22:02:23.8707678Z │ ], 2023-08-31T22:02:23.8707895Z │ [ 2023-08-31T22:02:23.8708103Z │ 0.0, 2023-08-31T22:02:23.8708350Z │ 0.9993854761123657 2023-08-31T22:02:23.8708935Z │ ], 2023-08-31T22:02:23.8709145Z │ [ 2023-08-31T22:02:23.8709365Z │ 0.0, 2023-08-31T22:02:23.8709607Z │ 0.9993811845779419 2023-08-31T22:02:23.8709825Z │ ], 2023-08-31T22:02:23.8710043Z │ [ 2023-08-31T22:02:23.8710256Z │ 0.0, 2023-08-31T22:02:23.8710486Z │ 0.9993742108345032 2023-08-31T22:02:23.8710708Z │ ], 2023-08-31T22:02:23.8710916Z │ [ 2023-08-31T22:02:23.8711117Z │ 0.0, 2023-08-31T22:02:23.8711354Z │ 0.9993641972541809 2023-08-31T22:02:23.8711577Z │ ], 2023-08-31T22:02:23.8711791Z │ [ 2023-08-31T22:02:23.8712001Z │ 0.0, 2023-08-31T22:02:23.8712240Z │ 0.9993515610694885 2023-08-31T22:02:23.8712454Z │ ], 2023-08-31T22:02:23.8712658Z │ [ 2023-08-31T22:02:23.8712870Z │ 0.0, 2023-08-31T22:02:23.8713096Z │ 0.9993364214897156 2023-08-31T22:02:23.8713321Z │ ], 2023-08-31T22:02:23.8713529Z │ [ 2023-08-31T22:02:23.8713746Z │ 0.0, 2023-08-31T22:02:23.8713999Z │ 0.9993187189102173 2023-08-31T22:02:23.8714219Z │ ], 2023-08-31T22:02:23.8714425Z │ [ 2023-08-31T22:02:23.8714628Z │ 0.0, 2023-08-31T22:02:23.8714867Z │ 0.9992934465408325 2023-08-31T22:02:23.8715087Z │ ], 2023-08-31T22:02:23.8715281Z │ [ 2023-08-31T22:02:23.8715491Z │ 0.0, 2023-08-31T22:02:23.8715725Z │ 0.9992607235908508 2023-08-31T22:02:23.8715938Z │ ], 2023-08-31T22:02:23.8716191Z │ [ 2023-08-31T22:02:23.8716399Z │ 0.0, 2023-08-31T22:02:23.8716630Z │ 0.9992249011993408 2023-08-31T22:02:23.8717028Z │ ], 2023-08-31T22:02:23.8717237Z │ [ 2023-08-31T22:02:23.8717439Z │ 0.0, 2023-08-31T22:02:23.8717681Z │ 0.9991866946220398 2023-08-31T22:02:23.8717903Z │ ], 2023-08-31T22:02:23.8718101Z │ [ 2023-08-31T22:02:23.8718307Z │ 0.0, 2023-08-31T22:02:23.8718546Z │ 0.9991452693939209 2023-08-31T22:02:23.8718758Z │ ], 2023-08-31T22:02:23.8718966Z │ [ 2023-08-31T22:02:23.8719187Z │ 0.0, 2023-08-31T22:02:23.8719414Z │ 0.9991005659103394 2023-08-31T22:02:23.8719637Z │ ], 2023-08-31T22:02:23.8719845Z │ [ 2023-08-31T22:02:23.8720047Z │ 0.0, 2023-08-31T22:02:23.8720281Z │ 0.9990523457527161 2023-08-31T22:02:23.8720500Z │ ], 2023-08-31T22:02:23.8720696Z │ [ 2023-08-31T22:02:23.8720905Z │ 0.0, 2023-08-31T22:02:23.8721142Z │ 0.9990004897117615 2023-08-31T22:02:23.8721350Z │ ], 2023-08-31T22:02:23.8721550Z │ [ 2023-08-31T22:02:23.8721772Z │ 0.0, 2023-08-31T22:02:23.8722004Z │ 0.998968243598938 2023-08-31T22:02:23.8722229Z │ ], 2023-08-31T22:02:23.8722436Z │ [ 2023-08-31T22:02:23.8722642Z │ 0.0, 2023-08-31T22:02:23.8722864Z │ 0.9989573955535889 2023-08-31T22:02:23.8723079Z │ ], 2023-08-31T22:02:23.8723281Z │ [ 2023-08-31T22:02:23.8723478Z │ 0.0, 2023-08-31T22:02:23.8723706Z │ 0.9989456534385681 2023-08-31T22:02:23.8723940Z │ ], 2023-08-31T22:02:23.8724136Z │ [ 2023-08-31T22:02:23.8724339Z │ 0.0, 2023-08-31T22:02:23.8724570Z │ 0.9989331364631653 2023-08-31T22:02:23.8724777Z │ ], 2023-08-31T22:02:23.8724977Z │ [ 2023-08-31T22:02:23.8725183Z │ 0.0, 2023-08-31T22:02:23.8725406Z │ 0.9989200830459595 2023-08-31T22:02:23.8725620Z │ ], 2023-08-31T22:02:23.8725820Z │ [ 2023-08-31T22:02:23.8726017Z │ 0.0, 2023-08-31T22:02:23.8726246Z │ 0.9989060163497925 2023-08-31T22:02:23.8726590Z │ ], 2023-08-31T22:02:23.8726798Z │ [ 2023-08-31T22:02:23.8727005Z │ 0.0, 2023-08-31T22:02:23.8727240Z │ 0.998891294002533 2023-08-31T22:02:23.8727455Z │ ], 2023-08-31T22:02:23.8727657Z │ [ 2023-08-31T22:02:23.8727865Z │ 0.0, 2023-08-31T22:02:23.8728086Z │ 0.9988754391670227 2023-08-31T22:02:23.8728299Z │ ], 2023-08-31T22:02:23.8728504Z │ [ 2023-08-31T22:02:23.8728702Z │ 0.0, 2023-08-31T22:02:23.8729082Z │ 0.9988815188407898 2023-08-31T22:02:23.8729301Z │ ], 2023-08-31T22:02:23.8729503Z │ [ 2023-08-31T22:02:23.8729701Z │ 0.0, 2023-08-31T22:02:23.8729930Z │ 0.9989089965820312 2023-08-31T22:02:23.8730147Z │ ], 2023-08-31T22:02:23.8730339Z │ [ 2023-08-31T22:02:23.8730545Z │ 0.0, 2023-08-31T22:02:23.8730776Z │ 0.9989352822303772 2023-08-31T22:02:23.8730984Z │ ], 2023-08-31T22:02:23.8731184Z │ [ 2023-08-31T22:02:23.8731391Z │ 0.0, 2023-08-31T22:02:23.8731612Z │ 0.9989607334136963 2023-08-31T22:02:23.8731963Z │ ], 2023-08-31T22:02:23.8732165Z │ [ 2023-08-31T22:02:23.8732362Z │ 0.0, 2023-08-31T22:02:23.8732588Z │ 0.9989848732948303 2023-08-31T22:02:23.8732808Z │ ], 2023-08-31T22:02:23.8732999Z │ [ 2023-08-31T22:02:23.8733207Z │ 0.0, 2023-08-31T22:02:23.8733437Z │ 0.9990076422691345 2023-08-31T22:02:23.8733651Z │ ], 2023-08-31T22:02:23.8733856Z │ [ 2023-08-31T22:02:23.8734084Z │ 0.0, 2023-08-31T22:02:23.8734315Z │ 0.9990293979644775 2023-08-31T22:02:23.8734531Z │ ], 2023-08-31T22:02:23.8734735Z │ [ 2023-08-31T22:02:23.8734932Z │ 0.0, 2023-08-31T22:02:23.8735164Z │ 0.999049723148346 2023-08-31T22:02:23.8735386Z │ ], 2023-08-31T22:02:23.8735581Z │ [ 2023-08-31T22:02:23.8735784Z │ 0.0, 2023-08-31T22:02:23.8736017Z │ 0.999051034450531 2023-08-31T22:02:23.8736231Z │ ], 2023-08-31T22:02:23.8736432Z │ [ 2023-08-31T22:02:23.8736648Z │ 0.0, 2023-08-31T22:02:23.8736871Z │ 0.9990313053131104 2023-08-31T22:02:23.8737083Z │ ], 2023-08-31T22:02:23.8737280Z │ [ 2023-08-31T22:02:23.8737478Z │ 0.0, 2023-08-31T22:02:23.8737708Z │ 0.9990096092224121 2023-08-31T22:02:23.8737926Z │ ], 2023-08-31T22:02:23.8738119Z │ [ 2023-08-31T22:02:23.8738324Z │ 0.0, 2023-08-31T22:02:23.8738554Z │ 0.9989851117134094 2023-08-31T22:02:23.8738818Z │ ], 2023-08-31T22:02:23.8739022Z │ [ 2023-08-31T22:02:23.8854046Z │ 0.0, 2023-08-31T22:02:23.8854560Z │ 0.9989587068557739 2023-08-31T22:02:23.8854797Z │ ], 2023-08-31T22:02:23.8855023Z │ [ 2023-08-31T22:02:23.8855236Z │ 0.0, 2023-08-31T22:02:23.8855469Z │ 0.998929798603 2023-08-31T22:02:23.8855729Z │ (showing 2.05kB/2.47MB) 2023-08-31T22:02:23.8855950Z └ 2023-08-31T22:02:23.8856356Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:23.8856874Z 2ms 227µs (cache) (cache) 754ms 3ms 359µs 760ms 2023-08-31T22:02:23.8857074Z 2023-08-31T22:02:24.1407792Z ✓ Successful POST request 2023-08-31T22:02:24.1514270Z 2023-08-31T22:02:24.1514991Z → Model Zoo - Unregister model 2023-08-31T22:02:24.2052019Z DELETE http://localhost:8081/models/fcn_resnet_101 2023-08-31T22:02:24.2053177Z 200 OK ★ 47ms time ★ 250B↑ 322B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:24.2054168Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 56B 2023-08-31T22:02:24.2054502Z │ { 2023-08-31T22:02:24.2054841Z │ "status": "Model \"fcn_resnet_101\" unregistered" 2023-08-31T22:02:24.2055113Z │ } 2023-08-31T22:02:24.2072852Z └ 2023-08-31T22:02:24.2073480Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:24.2074305Z 2ms 270µs (cache) (cache) 44ms 1ms 54µs 48ms 2023-08-31T22:02:24.2074539Z 2023-08-31T22:02:24.2122325Z ✓ Successful DELETE request 2023-08-31T22:02:24.2167870Z 2023-08-31T22:02:24.2168372Z → Model Zoo - Model Metrics 2023-08-31T22:02:24.2255636Z GET http://localhost:8082/metrics 2023-08-31T22:02:24.2256516Z 200 OK ★ 4ms time ★ 233B↑ 13.04kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:24.2258718Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 12.74kB 2023-08-31T22:02:24.2259720Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:02:24.2260337Z │ c with unit: Count 2023-08-31T22:02:24.2260989Z │ # TYPE Requests2XX counter 2023-08-31T22:02:24.2261423Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 63. 2023-08-31T22:02:24.2261711Z │ 0 2023-08-31T22:02:24.2262037Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:02:24.2262357Z │ c with unit: Count 2023-08-31T22:02:24.2262639Z │ # TYPE Requests5XX counter 2023-08-31T22:02:24.2262985Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:02:24.2263372Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:02:24.2264063Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:02:24.2264445Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:24.2264815Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:02:24.2265103Z │ 5157.442 2023-08-31T22:02:24.2265420Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:02:24.2265799Z │ et_101",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:24.2266088Z │ ",} 744788.113 2023-08-31T22:02:24.2266402Z │ ts_inference_latency_microseconds{model_name="mnist_sc 2023-08-31T22:02:24.2266758Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:24.2267040Z │ ",} 58411.041 2023-08-31T22:02:24.2267351Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:02:24.2267702Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:02:24.2267977Z │ 197192.539 2023-08-31T22:02:24.2268301Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:24.2268665Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:02:24.2268945Z │ -190",} 23938.584 2023-08-31T22:02:24.2269265Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:24.2269637Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:02:24.2269937Z │ "fv-az628-190",} 52504.044 2023-08-31T22:02:24.2270276Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:02:24.2270638Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:02:24.2270890Z │ 8.971 2023-08-31T22:02:24.2271198Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:24.2271555Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:02:24.2271831Z │ -190",} 153779.746 2023-08-31T22:02:24.2272146Z │ ts_inference_latency_microseconds{model_name="fastrcnn 2023-08-31T22:02:24.2272507Z │ ",model_version="default",hostname="fv-az628-190",} 23 2023-08-31T22:02:24.2272792Z │ 41906.593 2023-08-31T22:02:24.2273093Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:02:24.2273452Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:02:24.2273723Z │ 94.667 2023-08-31T22:02:24.2274023Z │ ts_inference_latency_microseconds{model_name="maskrcnn 2023-08-31T22:02:24.2274389Z │ ",model_version="default",hostname="fv-az628-190",} 25 2023-08-31T22:02:24.2274651Z │ 74140.332 2023-08-31T22:02:24.2274944Z │ ts_inference_latency_microseconds{model_name="mnist",m 2023-08-31T22:02:24.2275304Z │ odel_version="default",hostname="fv-az628-190",} 10707 2023-08-31T22:02:24.2275567Z │ .889 2023-08-31T22:02:24.2275860Z │ ts_inference_latency_microseconds{model_name="alexnet_ 2023-08-31T22:02:24.2276217Z │ scripted",model_version="default",hostname="fv-az628-1 2023-08-31T22:02:24.2276505Z │ 90",} 90762.505 2023-08-31T22:02:24.2276820Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:02:24.2277105Z │ et1_1_scripted" 2023-08-31T22:02:24.2277374Z │ (showing 2.05kB/12.74kB) 2023-08-31T22:02:24.2277608Z └ 2023-08-31T22:02:24.2278008Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:24.2278512Z 1ms 213µs (cache) (cache) 1ms 1ms 27µs 4ms 2023-08-31T22:02:24.2278711Z 2023-08-31T22:02:24.2329764Z ✓ Successful GET request 2023-08-31T22:02:24.2357861Z 2023-08-31T22:02:24.2358110Z Iteration 17/24 2023-08-31T22:02:24.2372429Z 2023-08-31T22:02:24.2372810Z → Model Zoo - Register Model 2023-08-31T22:02:30.7343204Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/fcn_resnet_101_scripted.mar&model_name=fcn_resnet_101_scripted&initial_workers=1&synchronous=true 2023-08-31T22:02:30.7344461Z 200 OK ★ 6.4s time ★ 395B↑ 365B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:30.7345148Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 99B 2023-08-31T22:02:30.7347200Z │ { 2023-08-31T22:02:30.7347676Z │ "status": "Model \"fcn_resnet_101_scripted\" Version 2023-08-31T22:02:30.7348253Z │ : 1.0 registered with 1 initial workers" 2023-08-31T22:02:30.7349466Z │ } 2023-08-31T22:02:30.7354574Z └ 2023-08-31T22:02:30.7355066Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:30.7355710Z 1ms 210µs (cache) (cache) 6.4s 1ms 32µs 6.4s 2023-08-31T22:02:30.7356005Z 2023-08-31T22:02:30.7395752Z ✓ Successful POST request 2023-08-31T22:02:30.7435701Z 2023-08-31T22:02:30.7436084Z → Model Zoo - Inference Model 2023-08-31T22:02:31.8352976Z POST http://localhost:8080/predictions/fcn_resnet_101_scripted 2023-08-31T22:02:31.8354145Z 200 OK ★ 1078ms time ★ 289.23kB↑ 2.47MB↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:02:31.8354911Z ┌ ↑ file ★ 288.94kB 2023-08-31T22:02:31.8355412Z │ (showing 2.05kB/288.94kB) 2023-08-31T22:02:31.8355930Z └ 2023-08-31T22:02:31.8356403Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 2.47MB 2023-08-31T22:02:31.8356883Z │ [ 2023-08-31T22:02:31.8359070Z │ [ 2023-08-31T22:02:31.8359551Z │ [ 2023-08-31T22:02:31.8359909Z │ 0.0, 2023-08-31T22:02:31.8360325Z │ 0.9993855953216553 2023-08-31T22:02:31.8360771Z │ ], 2023-08-31T22:02:31.8363198Z │ [ 2023-08-31T22:02:31.8363570Z │ 0.0, 2023-08-31T22:02:31.8364030Z │ 0.9993855953216553 2023-08-31T22:02:31.8364460Z │ ], 2023-08-31T22:02:31.8364792Z │ [ 2023-08-31T22:02:31.8365136Z │ 0.0, 2023-08-31T22:02:31.8365562Z │ 0.9993855953216553 2023-08-31T22:02:31.8365946Z │ ], 2023-08-31T22:02:31.8366511Z │ [ 2023-08-31T22:02:31.8366862Z │ 0.0, 2023-08-31T22:02:31.8367256Z │ 0.9993855953216553 2023-08-31T22:02:31.8367685Z │ ], 2023-08-31T22:02:31.8368474Z │ [ 2023-08-31T22:02:31.8368764Z │ 0.0, 2023-08-31T22:02:31.8369074Z │ 0.9993864297866821 2023-08-31T22:02:31.8369299Z │ ], 2023-08-31T22:02:31.8369510Z │ [ 2023-08-31T22:02:31.8369725Z │ 0.0, 2023-08-31T22:02:31.8369964Z │ 0.9993854761123657 2023-08-31T22:02:31.8370188Z │ ], 2023-08-31T22:02:31.8370394Z │ [ 2023-08-31T22:02:31.8370596Z │ 0.0, 2023-08-31T22:02:31.8370840Z │ 0.9993811845779419 2023-08-31T22:02:31.8371063Z │ ], 2023-08-31T22:02:31.8371276Z │ [ 2023-08-31T22:02:31.8371487Z │ 0.0, 2023-08-31T22:02:31.8371722Z │ 0.9993742108345032 2023-08-31T22:02:31.8371935Z │ ], 2023-08-31T22:02:31.8372141Z │ [ 2023-08-31T22:02:31.8372354Z │ 0.0, 2023-08-31T22:02:31.8372580Z │ 0.9993641972541809 2023-08-31T22:02:31.8372802Z │ ], 2023-08-31T22:02:31.8373008Z │ [ 2023-08-31T22:02:31.8373207Z │ 0.0, 2023-08-31T22:02:31.8373441Z │ 0.9993515610694885 2023-08-31T22:02:31.8373664Z │ ], 2023-08-31T22:02:31.8373862Z │ [ 2023-08-31T22:02:31.8374087Z │ 0.0, 2023-08-31T22:02:31.8374323Z │ 0.9993364214897156 2023-08-31T22:02:31.8374530Z │ ], 2023-08-31T22:02:31.8374735Z │ [ 2023-08-31T22:02:31.8374944Z │ 0.0, 2023-08-31T22:02:31.8375167Z │ 0.9993187189102173 2023-08-31T22:02:31.8375387Z │ ], 2023-08-31T22:02:31.8375593Z │ [ 2023-08-31T22:02:31.8375791Z │ 0.0, 2023-08-31T22:02:31.8376025Z │ 0.9992934465408325 2023-08-31T22:02:31.8376604Z │ ], 2023-08-31T22:02:31.8376811Z │ [ 2023-08-31T22:02:31.8377022Z │ 0.0, 2023-08-31T22:02:31.8377256Z │ 0.9992607235908508 2023-08-31T22:02:31.8377468Z │ ], 2023-08-31T22:02:31.8377677Z │ [ 2023-08-31T22:02:31.8377891Z │ 0.0, 2023-08-31T22:02:31.8378116Z │ 0.9992249011993408 2023-08-31T22:02:31.8378339Z │ ], 2023-08-31T22:02:31.8378544Z │ [ 2023-08-31T22:02:31.8378742Z │ 0.0, 2023-08-31T22:02:31.8378981Z │ 0.9991866946220398 2023-08-31T22:02:31.8379350Z │ ], 2023-08-31T22:02:31.8379544Z │ [ 2023-08-31T22:02:31.8379761Z │ 0.0, 2023-08-31T22:02:31.8379996Z │ 0.9991452693939209 2023-08-31T22:02:31.8380213Z │ ], 2023-08-31T22:02:31.8380409Z │ [ 2023-08-31T22:02:31.8380615Z │ 0.0, 2023-08-31T22:02:31.8380848Z │ 0.9991005659103394 2023-08-31T22:02:31.8381062Z │ ], 2023-08-31T22:02:31.8381264Z │ [ 2023-08-31T22:02:31.8381474Z │ 0.0, 2023-08-31T22:02:31.8381713Z │ 0.9990523457527161 2023-08-31T22:02:31.8381935Z │ ], 2023-08-31T22:02:31.8382143Z │ [ 2023-08-31T22:02:31.8382347Z │ 0.0, 2023-08-31T22:02:31.8382581Z │ 0.9990004897117615 2023-08-31T22:02:31.8382798Z │ ], 2023-08-31T22:02:31.8382993Z │ [ 2023-08-31T22:02:31.8383203Z │ 0.0, 2023-08-31T22:02:31.8383443Z │ 0.998968243598938 2023-08-31T22:02:31.8383664Z │ ], 2023-08-31T22:02:31.8383866Z │ [ 2023-08-31T22:02:31.8384075Z │ 0.0, 2023-08-31T22:02:31.8384314Z │ 0.9989573955535889 2023-08-31T22:02:31.8384567Z │ ], 2023-08-31T22:02:31.8384769Z │ [ 2023-08-31T22:02:31.8384975Z │ 0.0, 2023-08-31T22:02:31.8385198Z │ 0.9989456534385681 2023-08-31T22:02:31.8385420Z │ ], 2023-08-31T22:02:31.8385627Z │ [ 2023-08-31T22:02:31.8385827Z │ 0.0, 2023-08-31T22:02:31.8386062Z │ 0.9989331364631653 2023-08-31T22:02:31.8386279Z │ ], 2023-08-31T22:02:31.8386491Z │ [ 2023-08-31T22:02:31.8386700Z │ 0.0, 2023-08-31T22:02:31.8386935Z │ 0.9989200830459595 2023-08-31T22:02:31.8387145Z │ ], 2023-08-31T22:02:31.8387349Z │ [ 2023-08-31T22:02:31.8387559Z │ 0.0, 2023-08-31T22:02:31.8387783Z │ 0.9989060163497925 2023-08-31T22:02:31.8388004Z │ ], 2023-08-31T22:02:31.8388207Z │ [ 2023-08-31T22:02:31.8388407Z │ 0.0, 2023-08-31T22:02:31.8388642Z │ 0.998891294002533 2023-08-31T22:02:31.8388869Z │ ], 2023-08-31T22:02:31.8389065Z │ [ 2023-08-31T22:02:31.8389289Z │ 0.0, 2023-08-31T22:02:31.8389522Z │ 0.9988754391670227 2023-08-31T22:02:31.8389730Z │ ], 2023-08-31T22:02:31.8389941Z │ [ 2023-08-31T22:02:31.8390148Z │ 0.0, 2023-08-31T22:02:31.8390371Z │ 0.9988815188407898 2023-08-31T22:02:31.8390591Z │ ], 2023-08-31T22:02:31.8390791Z │ [ 2023-08-31T22:02:31.8390991Z │ 0.0, 2023-08-31T22:02:31.8391227Z │ 0.9989089965820312 2023-08-31T22:02:31.8391455Z │ ], 2023-08-31T22:02:31.8391647Z │ [ 2023-08-31T22:02:31.8391858Z │ 0.0, 2023-08-31T22:02:31.8392092Z │ 0.9989352822303772 2023-08-31T22:02:31.8392301Z │ ], 2023-08-31T22:02:31.8392504Z │ [ 2023-08-31T22:02:31.8392717Z │ 0.0, 2023-08-31T22:02:31.8392938Z │ 0.9989607334136963 2023-08-31T22:02:31.8393155Z │ ], 2023-08-31T22:02:31.8393360Z │ [ 2023-08-31T22:02:31.8393558Z │ 0.0, 2023-08-31T22:02:31.8393791Z │ 0.9989848732948303 2023-08-31T22:02:31.8394024Z │ ], 2023-08-31T22:02:31.8394214Z │ [ 2023-08-31T22:02:31.8394429Z │ 0.0, 2023-08-31T22:02:31.8394661Z │ 0.9990076422691345 2023-08-31T22:02:31.8394869Z │ ], 2023-08-31T22:02:31.8395077Z │ [ 2023-08-31T22:02:31.8395284Z │ 0.0, 2023-08-31T22:02:31.8395502Z │ 0.9990293979644775 2023-08-31T22:02:31.8395718Z │ ], 2023-08-31T22:02:31.8395922Z │ [ 2023-08-31T22:02:31.8396118Z │ 0.0, 2023-08-31T22:02:31.8396497Z │ 0.999049723148346 2023-08-31T22:02:31.8396730Z │ ], 2023-08-31T22:02:31.8396929Z │ [ 2023-08-31T22:02:31.8397137Z │ 0.0, 2023-08-31T22:02:31.8397370Z │ 0.999051034450531 2023-08-31T22:02:31.8397583Z │ ], 2023-08-31T22:02:31.8397793Z │ [ 2023-08-31T22:02:31.8398005Z │ 0.0, 2023-08-31T22:02:31.8398226Z │ 0.9990313053131104 2023-08-31T22:02:31.8398447Z │ ], 2023-08-31T22:02:31.8398656Z │ [ 2023-08-31T22:02:31.8398855Z │ 0.0, 2023-08-31T22:02:31.8399221Z │ 0.9990096092224121 2023-08-31T22:02:31.8399442Z │ ], 2023-08-31T22:02:31.8399637Z │ [ 2023-08-31T22:02:31.8399850Z │ 0.0, 2023-08-31T22:02:31.8400082Z │ 0.9989851117134094 2023-08-31T22:02:31.8400290Z │ ], 2023-08-31T22:02:31.8400494Z │ [ 2023-08-31T22:02:31.8400708Z │ 0.0, 2023-08-31T22:02:31.8400939Z │ 0.9989587068557739 2023-08-31T22:02:31.8401158Z │ ], 2023-08-31T22:02:31.8401371Z │ [ 2023-08-31T22:02:31.8401583Z │ 0.0, 2023-08-31T22:02:31.8401812Z │ 0.998929798603 2023-08-31T22:02:31.8402074Z │ (showing 2.05kB/2.47MB) 2023-08-31T22:02:31.8402296Z └ 2023-08-31T22:02:31.8402714Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:31.8403220Z 1ms 217µs (cache) (cache) 1074ms 2ms 5ms 1084ms 2023-08-31T22:02:31.8403420Z 2023-08-31T22:02:32.0765536Z ✓ Successful POST request 2023-08-31T22:02:32.0869169Z 2023-08-31T22:02:32.0870053Z → Model Zoo - Unregister model 2023-08-31T22:02:32.1754750Z DELETE http://localhost:8081/models/fcn_resnet_101_scripted 2023-08-31T22:02:32.1755811Z 200 OK ★ 79ms time ★ 259B↑ 331B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:32.1758819Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 65B 2023-08-31T22:02:32.1767027Z │ { 2023-08-31T22:02:32.1767457Z │ "status": "Model \"fcn_resnet_101_scripted\" unregis 2023-08-31T22:02:32.1767786Z │ tered" 2023-08-31T22:02:32.1767993Z │ } 2023-08-31T22:02:32.1781928Z └ 2023-08-31T22:02:32.1782545Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:32.1783357Z 5ms 286µs (cache) (cache) 76ms 1ms 57µs 83ms 2023-08-31T22:02:32.1783578Z 2023-08-31T22:02:32.1861789Z ✓ Successful DELETE request 2023-08-31T22:02:32.1900734Z 2023-08-31T22:02:32.1901126Z → Model Zoo - Model Metrics 2023-08-31T22:02:32.1983781Z GET http://localhost:8082/metrics 2023-08-31T22:02:32.1984721Z 200 OK ★ 3ms time ★ 233B↑ 13.71kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:32.1985654Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 13.42kB 2023-08-31T22:02:32.1987145Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:02:32.1987647Z │ c with unit: Count 2023-08-31T22:02:32.1988220Z │ # TYPE Requests2XX counter 2023-08-31T22:02:32.1988927Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 67. 2023-08-31T22:02:32.1989220Z │ 0 2023-08-31T22:02:32.1989553Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:02:32.1989861Z │ c with unit: Count 2023-08-31T22:02:32.1990144Z │ # TYPE Requests5XX counter 2023-08-31T22:02:32.1990501Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:02:32.1990874Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:02:32.1991252Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:02:32.1991628Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:32.1992026Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:02:32.1992294Z │ 5157.442 2023-08-31T22:02:32.1992608Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:02:32.1992980Z │ et_101",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:32.1993256Z │ ",} 744788.113 2023-08-31T22:02:32.1993584Z │ ts_inference_latency_microseconds{model_name="mnist_sc 2023-08-31T22:02:32.1993950Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:32.1994219Z │ ",} 58411.041 2023-08-31T22:02:32.1994537Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:02:32.1994904Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:02:32.1995198Z │ 197192.539 2023-08-31T22:02:32.1995500Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:32.1995868Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:02:32.1996323Z │ -190",} 23938.584 2023-08-31T22:02:32.1996630Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:02:32.1996989Z │ et_101_scripted",model_version="default",hostname="fv- 2023-08-31T22:02:32.1997296Z │ az628-190",} 1069558.185 2023-08-31T22:02:32.1997611Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:32.1997979Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:02:32.1998304Z │ "fv-az628-190",} 52504.044 2023-08-31T22:02:32.1998626Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:02:32.1998989Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:02:32.1999258Z │ 8.971 2023-08-31T22:02:32.1999562Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:32.1999912Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:02:32.2000198Z │ -190",} 153779.746 2023-08-31T22:02:32.2000513Z │ ts_inference_latency_microseconds{model_name="fastrcnn 2023-08-31T22:02:32.2000881Z │ ",model_version="default",hostname="fv-az628-190",} 23 2023-08-31T22:02:32.2001162Z │ 41906.593 2023-08-31T22:02:32.2001477Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:02:32.2001827Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:02:32.2002096Z │ 94.667 2023-08-31T22:02:32.2002400Z │ ts_inference_latency_microseconds{model_name="maskrcnn 2023-08-31T22:02:32.2002759Z │ ",model_version="default",hostname="fv-az628-190",} 25 2023-08-31T22:02:32.2003026Z │ 74140.332 2023-08-31T22:02:32.2003333Z │ ts_inference_latency_microseconds{model_name="mnist",m 2023-08-31T22:02:32.2003698Z │ odel_version="default",hostname="fv-az628-190",} 10707 2023-08-31T22:02:32.2003950Z │ .889 2023-08-31T22:02:32.2004255Z │ ts_inference_latency_microseconds{model_name="alexnet_ 2023-08-31T22:02:32.2004529Z │ script 2023-08-31T22:02:32.2004772Z │ (showing 2.05kB/13.42kB) 2023-08-31T22:02:32.2017259Z └ 2023-08-31T22:02:32.2017758Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:32.2019540Z 1ms 213µs (cache) (cache) 1ms 1ms 30µs 3ms 2023-08-31T22:02:32.2019988Z 2023-08-31T22:02:32.2069221Z ✓ Successful GET request 2023-08-31T22:02:32.2095806Z 2023-08-31T22:02:32.2096085Z Iteration 18/24 2023-08-31T22:02:32.2109557Z 2023-08-31T22:02:32.2110160Z → Model Zoo - Register Model 2023-08-31T22:02:36.3971298Z POST http://localhost:8081/models?url=deeplabv3_resnet_101_eager.mar&model_name=deeplabv3_resnet_101_eager&initial_workers=1&synchronous=true 2023-08-31T22:02:36.3972441Z 200 OK ★ 4.1s time ★ 360B↑ 369B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:36.3972960Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 102B 2023-08-31T22:02:36.3973314Z │ { 2023-08-31T22:02:36.3973727Z │ "status": "Model \"deeplabv3_resnet_101_eager\" Vers 2023-08-31T22:02:36.3974180Z │ ion: 1.0 registered with 1 initial workers" 2023-08-31T22:02:36.3974856Z │ } 2023-08-31T22:02:36.3982704Z └ 2023-08-31T22:02:36.3983200Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:36.3983776Z 1ms 211µs (cache) (cache) 4.1s 1ms 32µs 4.1s 2023-08-31T22:02:36.3984040Z 2023-08-31T22:02:36.4023934Z ✓ Successful POST request 2023-08-31T22:02:36.4100292Z 2023-08-31T22:02:36.4101149Z → Model Zoo - Inference Model 2023-08-31T22:02:37.1929329Z POST http://localhost:8080/predictions/deeplabv3_resnet_101_eager 2023-08-31T22:02:37.1930518Z 200 OK ★ 774ms time ★ 289.23kB↑ 2.47MB↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:02:37.1931464Z ┌ ↑ file ★ 288.94kB 2023-08-31T22:02:37.1931819Z │ (showing 2.05kB/288.94kB) 2023-08-31T22:02:37.1932054Z └ 2023-08-31T22:02:37.1932390Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 2.47MB 2023-08-31T22:02:37.1934647Z │ [ 2023-08-31T22:02:37.1935063Z │ [ 2023-08-31T22:02:37.1935603Z │ [ 2023-08-31T22:02:37.1935839Z │ 0.0, 2023-08-31T22:02:37.1936100Z │ 0.9988765120506287 2023-08-31T22:02:37.1936336Z │ ], 2023-08-31T22:02:37.1936538Z │ [ 2023-08-31T22:02:37.1936753Z │ 0.0, 2023-08-31T22:02:37.1937064Z │ 0.9988765120506287 2023-08-31T22:02:37.1937301Z │ ], 2023-08-31T22:02:37.1937510Z │ [ 2023-08-31T22:02:37.1937710Z │ 0.0, 2023-08-31T22:02:37.1937984Z │ 0.9988765120506287 2023-08-31T22:02:37.1938218Z │ ], 2023-08-31T22:02:37.1938411Z │ [ 2023-08-31T22:02:37.1938623Z │ 0.0, 2023-08-31T22:02:37.1938859Z │ 0.9988765120506287 2023-08-31T22:02:37.1939072Z │ ], 2023-08-31T22:02:37.1939273Z │ [ 2023-08-31T22:02:37.1939485Z │ 0.0, 2023-08-31T22:02:37.1939708Z │ 0.9988669157028198 2023-08-31T22:02:37.1939923Z │ ], 2023-08-31T22:02:37.1940124Z │ [ 2023-08-31T22:02:37.1940321Z │ 0.0, 2023-08-31T22:02:37.1940553Z │ 0.998843789100647 2023-08-31T22:02:37.1940799Z │ ], 2023-08-31T22:02:37.1940994Z │ [ 2023-08-31T22:02:37.1941209Z │ 0.0, 2023-08-31T22:02:37.1941446Z │ 0.9988172054290771 2023-08-31T22:02:37.1941662Z │ ], 2023-08-31T22:02:37.1941866Z │ [ 2023-08-31T22:02:37.1942071Z │ 0.0, 2023-08-31T22:02:37.1942294Z │ 0.9987861514091492 2023-08-31T22:02:37.1942507Z │ ], 2023-08-31T22:02:37.1942709Z │ [ 2023-08-31T22:02:37.1942921Z │ 0.0, 2023-08-31T22:02:37.1943158Z │ 0.9987504482269287 2023-08-31T22:02:37.1943379Z │ ], 2023-08-31T22:02:37.1943575Z │ [ 2023-08-31T22:02:37.1943781Z │ 0.0, 2023-08-31T22:02:37.1944014Z │ 0.9987117052078247 2023-08-31T22:02:37.1944224Z │ ], 2023-08-31T22:02:37.1944429Z │ [ 2023-08-31T22:02:37.1944638Z │ 0.0, 2023-08-31T22:02:37.1944859Z │ 0.9986679553985596 2023-08-31T22:02:37.1945085Z │ ], 2023-08-31T22:02:37.1945288Z │ [ 2023-08-31T22:02:37.1945484Z │ 0.0, 2023-08-31T22:02:37.1945730Z │ 0.9986202716827393 2023-08-31T22:02:37.1945954Z │ ], 2023-08-31T22:02:37.1946149Z │ [ 2023-08-31T22:02:37.1946358Z │ 0.0, 2023-08-31T22:02:37.1946597Z │ 0.9985180497169495 2023-08-31T22:02:37.1946818Z │ ], 2023-08-31T22:02:37.1947015Z │ [ 2023-08-31T22:02:37.1947230Z │ 0.0, 2023-08-31T22:02:37.1947466Z │ 0.9983478784561157 2023-08-31T22:02:37.1948028Z │ ], 2023-08-31T22:02:37.1948245Z │ [ 2023-08-31T22:02:37.1948457Z │ 0.0, 2023-08-31T22:02:37.1948688Z │ 0.9981531500816345 2023-08-31T22:02:37.1948905Z │ ], 2023-08-31T22:02:37.1949111Z │ [ 2023-08-31T22:02:37.1949309Z │ 0.0, 2023-08-31T22:02:37.1949540Z │ 0.9979324340820312 2023-08-31T22:02:37.1949770Z │ ], 2023-08-31T22:02:37.1949965Z │ [ 2023-08-31T22:02:37.1950172Z │ 0.0, 2023-08-31T22:02:37.1950408Z │ 0.9976813793182373 2023-08-31T22:02:37.1950618Z │ ], 2023-08-31T22:02:37.1950984Z │ [ 2023-08-31T22:02:37.1951198Z │ 0.0, 2023-08-31T22:02:37.1951426Z │ 0.9973964691162109 2023-08-31T22:02:37.1951647Z │ ], 2023-08-31T22:02:37.1951851Z │ [ 2023-08-31T22:02:37.1952051Z │ 0.0, 2023-08-31T22:02:37.1952284Z │ 0.9970728158950806 2023-08-31T22:02:37.1952502Z │ ], 2023-08-31T22:02:37.1952696Z │ [ 2023-08-31T22:02:37.1952902Z │ 0.0, 2023-08-31T22:02:37.1953153Z │ 0.9967058300971985 2023-08-31T22:02:37.1953363Z │ ], 2023-08-31T22:02:37.1953572Z │ [ 2023-08-31T22:02:37.1953782Z │ 0.0, 2023-08-31T22:02:37.1954007Z │ 0.9964045286178589 2023-08-31T22:02:37.1954228Z │ ], 2023-08-31T22:02:37.1954433Z │ [ 2023-08-31T22:02:37.1954631Z │ 0.0, 2023-08-31T22:02:37.1954867Z │ 0.9961955547332764 2023-08-31T22:02:37.1955085Z │ ], 2023-08-31T22:02:37.1955279Z │ [ 2023-08-31T22:02:37.1955487Z │ 0.0, 2023-08-31T22:02:37.1955719Z │ 0.9959736466407776 2023-08-31T22:02:37.1955944Z │ ], 2023-08-31T22:02:37.1956145Z │ [ 2023-08-31T22:02:37.1956352Z │ 0.0, 2023-08-31T22:02:37.1956578Z │ 0.9957383871078491 2023-08-31T22:02:37.1956798Z │ ], 2023-08-31T22:02:37.1957006Z │ [ 2023-08-31T22:02:37.1957203Z │ 0.0, 2023-08-31T22:02:37.1957434Z │ 0.9954885840415955 2023-08-31T22:02:37.1957653Z │ ], 2023-08-31T22:02:37.1957846Z │ [ 2023-08-31T22:02:37.1958063Z │ 0.0, 2023-08-31T22:02:37.1958298Z │ 0.9952237010002136 2023-08-31T22:02:37.1958505Z │ ], 2023-08-31T22:02:37.1958709Z │ [ 2023-08-31T22:02:37.1958917Z │ 0.0, 2023-08-31T22:02:37.1959142Z │ 0.9949430823326111 2023-08-31T22:02:37.1959362Z │ ], 2023-08-31T22:02:37.1959570Z │ [ 2023-08-31T22:02:37.1959767Z │ 0.0, 2023-08-31T22:02:37.1960002Z │ 0.9946452379226685 2023-08-31T22:02:37.1960224Z │ ], 2023-08-31T22:02:37.1960418Z │ [ 2023-08-31T22:02:37.1960638Z │ 0.0, 2023-08-31T22:02:37.1960873Z │ 0.9945149421691895 2023-08-31T22:02:37.1961080Z │ ], 2023-08-31T22:02:37.1961284Z │ [ 2023-08-31T22:02:37.1961493Z │ 0.0, 2023-08-31T22:02:37.1961723Z │ 0.9945646524429321 2023-08-31T22:02:37.1961943Z │ ], 2023-08-31T22:02:37.1962152Z │ [ 2023-08-31T22:02:37.1962350Z │ 0.0, 2023-08-31T22:02:37.1962584Z │ 0.9946145415306091 2023-08-31T22:02:37.1962816Z │ ], 2023-08-31T22:02:37.1963008Z │ [ 2023-08-31T22:02:37.1963215Z │ 0.0, 2023-08-31T22:02:37.1963448Z │ 0.9946632385253906 2023-08-31T22:02:37.1963655Z │ ], 2023-08-31T22:02:37.1963863Z │ [ 2023-08-31T22:02:37.1964072Z │ 0.0, 2023-08-31T22:02:37.1964299Z │ 0.9947116374969482 2023-08-31T22:02:37.1964517Z │ ], 2023-08-31T22:02:37.1964718Z │ [ 2023-08-31T22:02:37.1964913Z │ 0.0, 2023-08-31T22:02:37.1965143Z │ 0.9947587847709656 2023-08-31T22:02:37.1965360Z │ ], 2023-08-31T22:02:37.1965566Z │ [ 2023-08-31T22:02:37.1965781Z │ 0.0, 2023-08-31T22:02:37.1966013Z │ 0.9948055148124695 2023-08-31T22:02:37.1966222Z │ ], 2023-08-31T22:02:37.1966795Z │ [ 2023-08-31T22:02:37.1967006Z │ 0.0, 2023-08-31T22:02:37.1967240Z │ 0.9948518872261047 2023-08-31T22:02:37.1967452Z │ ], 2023-08-31T22:02:37.1967660Z │ [ 2023-08-31T22:02:37.1967868Z │ 0.0, 2023-08-31T22:02:37.1968270Z │ 0.9948964715003967 2023-08-31T22:02:37.1968505Z │ ], 2023-08-31T22:02:37.1968708Z │ [ 2023-08-31T22:02:37.1968911Z │ 0.0, 2023-08-31T22:02:37.1969149Z │ 0.9949400424957275 2023-08-31T22:02:37.1969368Z │ ], 2023-08-31T22:02:37.1969564Z │ [ 2023-08-31T22:02:37.1969775Z │ 0.0, 2023-08-31T22:02:37.1970011Z │ 0.9949837923049927 2023-08-31T22:02:37.1970222Z │ ], 2023-08-31T22:02:37.1970427Z │ [ 2023-08-31T22:02:37.1970636Z │ 0.0, 2023-08-31T22:02:37.1970862Z │ 0.9950267672538757 2023-08-31T22:02:37.1971217Z │ ], 2023-08-31T22:02:37.1971427Z │ [ 2023-08-31T22:02:37.1971632Z │ 0.0, 2023-08-31T22:02:37.1971865Z │ 0.9950693845748901 2023-08-31T22:02:37.1972084Z │ ], 2023-08-31T22:02:37.1972280Z │ [ 2023-08-31T22:02:37.1972495Z │ 0.0, 2023-08-31T22:02:37.1972724Z │ 0.995111525 2023-08-31T22:02:37.1972978Z │ (showing 2.05kB/2.47MB) 2023-08-31T22:02:37.1990130Z └ 2023-08-31T22:02:37.1994595Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:37.1995114Z 2ms 221µs (cache) (cache) 770ms 3ms 343µs 776ms 2023-08-31T22:02:37.1995320Z 2023-08-31T22:02:37.4286749Z ✓ Successful POST request 2023-08-31T22:02:37.4385076Z 2023-08-31T22:02:37.4385737Z → Model Zoo - Unregister model 2023-08-31T22:02:37.4945179Z DELETE http://localhost:8081/models/deeplabv3_resnet_101_eager 2023-08-31T22:02:37.4946180Z 200 OK ★ 50ms time ★ 262B↑ 334B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:37.4946811Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 68B 2023-08-31T22:02:37.4947201Z │ { 2023-08-31T22:02:37.4948058Z │ "status": "Model \"deeplabv3_resnet_101_eager\" unre 2023-08-31T22:02:37.4948403Z │ gistered" 2023-08-31T22:02:37.4948629Z │ } 2023-08-31T22:02:37.4967632Z └ 2023-08-31T22:02:37.4968433Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:37.4968986Z 1ms 269µs (cache) (cache) 48ms 1ms 53µs 51ms 2023-08-31T22:02:37.4969190Z 2023-08-31T22:02:37.5014380Z ✓ Successful DELETE request 2023-08-31T22:02:37.5052737Z 2023-08-31T22:02:37.5053142Z → Model Zoo - Model Metrics 2023-08-31T22:02:37.5141211Z GET http://localhost:8082/metrics 2023-08-31T22:02:37.5144542Z 200 OK ★ 4ms time ★ 233B↑ 14.41kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:37.5147942Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 14.11kB 2023-08-31T22:02:37.5151118Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:02:37.5151703Z │ c with unit: Count 2023-08-31T22:02:37.5152414Z │ # TYPE Requests2XX counter 2023-08-31T22:02:37.5152819Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 71. 2023-08-31T22:02:37.5153137Z │ 0 2023-08-31T22:02:37.5153473Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:02:37.5153817Z │ c with unit: Count 2023-08-31T22:02:37.5154095Z │ # TYPE Requests5XX counter 2023-08-31T22:02:37.5154449Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:02:37.5154840Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:02:37.5155206Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:02:37.5155586Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:37.5155965Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:02:37.5156233Z │ 5157.442 2023-08-31T22:02:37.5156570Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:02:37.5156944Z │ et_101",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:37.5157221Z │ ",} 744788.113 2023-08-31T22:02:37.5157540Z │ ts_inference_latency_microseconds{model_name="mnist_sc 2023-08-31T22:02:37.5157909Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:37.5158191Z │ ",} 58411.041 2023-08-31T22:02:37.5158806Z │ ts_inference_latency_microseconds{model_name="deeplabv 2023-08-31T22:02:37.5159192Z │ 3_resnet_101_eager",model_version="default",hostname=" 2023-08-31T22:02:37.5159496Z │ fv-az628-190",} 766032.167 2023-08-31T22:02:37.5159818Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:02:37.5160177Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:02:37.5160456Z │ 197192.539 2023-08-31T22:02:37.5160758Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:37.5161126Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:02:37.5161550Z │ -190",} 23938.584 2023-08-31T22:02:37.5161859Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:02:37.5162215Z │ et_101_scripted",model_version="default",hostname="fv- 2023-08-31T22:02:37.5162522Z │ az628-190",} 1069558.185 2023-08-31T22:02:37.5162841Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:37.5163212Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:02:37.5163522Z │ "fv-az628-190",} 52504.044 2023-08-31T22:02:37.5163853Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:02:37.5164206Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:02:37.5164473Z │ 8.971 2023-08-31T22:02:37.5164778Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:37.5165137Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:02:37.5165428Z │ -190",} 153779.746 2023-08-31T22:02:37.5165755Z │ ts_inference_latency_microseconds{model_name="fastrcnn 2023-08-31T22:02:37.5166116Z │ ",model_version="default",hostname="fv-az628-190",} 23 2023-08-31T22:02:37.5166555Z │ 41906.593 2023-08-31T22:02:37.5166868Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:02:37.5167224Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:02:37.5167484Z │ 94.667 2023-08-31T22:02:37.5167805Z │ ts_inference_latency_microseconds{model_name="maskrcnn 2023-08-31T22:02:37.5168161Z │ ",model_version="default",hostname="fv-az628-190",} 25 2023-08-31T22:02:37.5168415Z │ 74140.332 2023-08-31T22:02:37.5168703Z │ ts_inference_latency_microseconds{mode 2023-08-31T22:02:37.5169007Z │ (showing 2.05kB/14.11kB) 2023-08-31T22:02:37.5174702Z └ 2023-08-31T22:02:37.5175512Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:37.5176358Z 1ms 209µs (cache) (cache) 2ms 1ms 28µs 4ms 2023-08-31T22:02:37.5176859Z 2023-08-31T22:02:37.5223601Z ✓ Successful GET request 2023-08-31T22:02:37.5258954Z 2023-08-31T22:02:37.5259259Z Iteration 19/24 2023-08-31T22:02:37.5273150Z 2023-08-31T22:02:37.5273509Z → Model Zoo - Register Model 2023-08-31T22:02:46.2724824Z POST http://localhost:8081/models?url=https://torchserve.s3.amazonaws.com/mar_files/deeplabv3_resnet_101_scripted.mar&model_name=deeplabv3_resnet_101_scripted&initial_workers=1&synchronous=true 2023-08-31T22:02:46.2725744Z 200 OK ★ 8.7s time ★ 412B↑ 372B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:46.2729618Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 105B 2023-08-31T22:02:46.2730174Z │ { 2023-08-31T22:02:46.2730774Z │ "status": "Model \"deeplabv3_resnet_101_scripted\" V 2023-08-31T22:02:46.2733826Z │ ersion: 1.0 registered with 1 initial workers" 2023-08-31T22:02:46.2734249Z │ } 2023-08-31T22:02:46.2750822Z └ 2023-08-31T22:02:46.2751533Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:46.2752243Z 1ms 225µs (cache) (cache) 8.7s 2ms 58µs 8.7s 2023-08-31T22:02:46.2752579Z 2023-08-31T22:02:46.2807661Z ✓ Successful POST request 2023-08-31T22:02:46.2860123Z 2023-08-31T22:02:46.2860557Z → Model Zoo - Inference Model 2023-08-31T22:02:47.3402813Z POST http://localhost:8080/predictions/deeplabv3_resnet_101_scripted 2023-08-31T22:02:47.3404248Z 200 OK ★ 1045ms time ★ 289.24kB↑ 2.47MB↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:02:47.3404816Z ┌ ↑ file ★ 288.94kB 2023-08-31T22:02:47.3405952Z │ (showing 2.05kB/288.94kB) 2023-08-31T22:02:47.3407073Z └ 2023-08-31T22:02:47.3407958Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 2.47MB 2023-08-31T22:02:47.3408458Z │ [ 2023-08-31T22:02:47.3409422Z │ [ 2023-08-31T22:02:47.3409702Z │ [ 2023-08-31T22:02:47.3409934Z │ 0.0, 2023-08-31T22:02:47.3410203Z │ 0.9988765120506287 2023-08-31T22:02:47.3410442Z │ ], 2023-08-31T22:02:47.3410937Z │ [ 2023-08-31T22:02:47.3411158Z │ 0.0, 2023-08-31T22:02:47.3411400Z │ 0.9988765120506287 2023-08-31T22:02:47.3411629Z │ ], 2023-08-31T22:02:47.3411828Z │ [ 2023-08-31T22:02:47.3412038Z │ 0.0, 2023-08-31T22:02:47.3412276Z │ 0.9988765120506287 2023-08-31T22:02:47.3412491Z │ ], 2023-08-31T22:02:47.3412693Z │ [ 2023-08-31T22:02:47.3412904Z │ 0.0, 2023-08-31T22:02:47.3413155Z │ 0.9988765120506287 2023-08-31T22:02:47.3413379Z │ ], 2023-08-31T22:02:47.3413582Z │ [ 2023-08-31T22:02:47.3413783Z │ 0.0, 2023-08-31T22:02:47.3414016Z │ 0.9988669157028198 2023-08-31T22:02:47.3414241Z │ ], 2023-08-31T22:02:47.3414435Z │ [ 2023-08-31T22:02:47.3414642Z │ 0.0, 2023-08-31T22:02:47.3414884Z │ 0.998843789100647 2023-08-31T22:02:47.3415099Z │ ], 2023-08-31T22:02:47.3415302Z │ [ 2023-08-31T22:02:47.3415510Z │ 0.0, 2023-08-31T22:02:47.3415737Z │ 0.9988172054290771 2023-08-31T22:02:47.3415973Z │ ], 2023-08-31T22:02:47.3416173Z │ [ 2023-08-31T22:02:47.3416379Z │ 0.0, 2023-08-31T22:02:47.3416607Z │ 0.9987861514091492 2023-08-31T22:02:47.3416830Z │ ], 2023-08-31T22:02:47.3417026Z │ [ 2023-08-31T22:02:47.3417231Z │ 0.0, 2023-08-31T22:02:47.3417464Z │ 0.9987504482269287 2023-08-31T22:02:47.3417675Z │ ], 2023-08-31T22:02:47.3417879Z │ [ 2023-08-31T22:02:47.3418095Z │ 0.0, 2023-08-31T22:02:47.3418319Z │ 0.9987117052078247 2023-08-31T22:02:47.3418531Z │ ], 2023-08-31T22:02:47.3418737Z │ [ 2023-08-31T22:02:47.3418936Z │ 0.0, 2023-08-31T22:02:47.3419169Z │ 0.9986679553985596 2023-08-31T22:02:47.3419392Z │ ], 2023-08-31T22:02:47.3419586Z │ [ 2023-08-31T22:02:47.3419791Z │ 0.0, 2023-08-31T22:02:47.3420025Z │ 0.9986202716827393 2023-08-31T22:02:47.3420235Z │ ], 2023-08-31T22:02:47.3420443Z │ [ 2023-08-31T22:02:47.3420668Z │ 0.0, 2023-08-31T22:02:47.3420890Z │ 0.9985180497169495 2023-08-31T22:02:47.3421103Z │ ], 2023-08-31T22:02:47.3421306Z │ [ 2023-08-31T22:02:47.3421503Z │ 0.0, 2023-08-31T22:02:47.3421728Z │ 0.9983478784561157 2023-08-31T22:02:47.3422004Z │ ], 2023-08-31T22:02:47.3422196Z │ [ 2023-08-31T22:02:47.3422402Z │ 0.0, 2023-08-31T22:02:47.3422632Z │ 0.9981531500816345 2023-08-31T22:02:47.3422853Z │ ], 2023-08-31T22:02:47.3423056Z │ [ 2023-08-31T22:02:47.3423267Z │ 0.0, 2023-08-31T22:02:47.3423489Z │ 0.9979324340820312 2023-08-31T22:02:47.3423706Z │ ], 2023-08-31T22:02:47.3423907Z │ [ 2023-08-31T22:02:47.3424104Z │ 0.0, 2023-08-31T22:02:47.3424336Z │ 0.9976813793182373 2023-08-31T22:02:47.3424559Z │ ], 2023-08-31T22:02:47.3424751Z │ [ 2023-08-31T22:02:47.3424961Z │ 0.0, 2023-08-31T22:02:47.3425202Z │ 0.9973964691162109 2023-08-31T22:02:47.3425412Z │ ], 2023-08-31T22:02:47.3425632Z │ [ 2023-08-31T22:02:47.3425842Z │ 0.0, 2023-08-31T22:02:47.3426063Z │ 0.9970728158950806 2023-08-31T22:02:47.3426276Z │ ], 2023-08-31T22:02:47.3426481Z │ [ 2023-08-31T22:02:47.3426685Z │ 0.0, 2023-08-31T22:02:47.3426914Z │ 0.9967058300971985 2023-08-31T22:02:47.3427136Z │ ], 2023-08-31T22:02:47.3427333Z │ [ 2023-08-31T22:02:47.3427539Z │ 0.0, 2023-08-31T22:02:47.3427941Z │ 0.9964045286178589 2023-08-31T22:02:47.3428158Z │ ], 2023-08-31T22:02:47.3428362Z │ [ 2023-08-31T22:02:47.3428571Z │ 0.0, 2023-08-31T22:02:47.3428796Z │ 0.9961955547332764 2023-08-31T22:02:47.3429018Z │ ], 2023-08-31T22:02:47.3429219Z │ [ 2023-08-31T22:02:47.3429417Z │ 0.0, 2023-08-31T22:02:47.3429651Z │ 0.9959736466407776 2023-08-31T22:02:47.3429866Z │ ], 2023-08-31T22:02:47.3430059Z │ [ 2023-08-31T22:02:47.3430266Z │ 0.0, 2023-08-31T22:02:47.3430497Z │ 0.9957383871078491 2023-08-31T22:02:47.3430818Z │ ], 2023-08-31T22:02:47.3431019Z │ [ 2023-08-31T22:02:47.3431222Z │ 0.0, 2023-08-31T22:02:47.3431450Z │ 0.9954885840415955 2023-08-31T22:02:47.3431661Z │ ], 2023-08-31T22:02:47.3431859Z │ [ 2023-08-31T22:02:47.3432064Z │ 0.0, 2023-08-31T22:02:47.3432294Z │ 0.9952237010002136 2023-08-31T22:02:47.3432510Z │ ], 2023-08-31T22:02:47.3432714Z │ [ 2023-08-31T22:02:47.3432926Z │ 0.0, 2023-08-31T22:02:47.3433159Z │ 0.9949430823326111 2023-08-31T22:02:47.3433378Z │ ], 2023-08-31T22:02:47.3433575Z │ [ 2023-08-31T22:02:47.3433791Z │ 0.0, 2023-08-31T22:02:47.3434023Z │ 0.9946452379226685 2023-08-31T22:02:47.3434231Z │ ], 2023-08-31T22:02:47.3434431Z │ [ 2023-08-31T22:02:47.3434668Z │ 0.0, 2023-08-31T22:02:47.3434889Z │ 0.9945149421691895 2023-08-31T22:02:47.3435101Z │ ], 2023-08-31T22:02:47.3435301Z │ [ 2023-08-31T22:02:47.3435514Z │ 0.0, 2023-08-31T22:02:47.3435745Z │ 0.9945646524429321 2023-08-31T22:02:47.3435962Z │ ], 2023-08-31T22:02:47.3436155Z │ [ 2023-08-31T22:02:47.3436362Z │ 0.0, 2023-08-31T22:02:47.3436591Z │ 0.9946145415306091 2023-08-31T22:02:47.3436807Z │ ], 2023-08-31T22:02:47.3437012Z │ [ 2023-08-31T22:02:47.3437221Z │ 0.0, 2023-08-31T22:02:47.3437443Z │ 0.9946632385253906 2023-08-31T22:02:47.3437675Z │ ], 2023-08-31T22:02:47.3437878Z │ [ 2023-08-31T22:02:47.3438072Z │ 0.0, 2023-08-31T22:02:47.3438310Z │ 0.9947116374969482 2023-08-31T22:02:47.3438524Z │ ], 2023-08-31T22:02:47.3438715Z │ [ 2023-08-31T22:02:47.3438925Z │ 0.0, 2023-08-31T22:02:47.3439154Z │ 0.9947587847709656 2023-08-31T22:02:47.3439358Z │ ], 2023-08-31T22:02:47.3439556Z │ [ 2023-08-31T22:02:47.3439765Z │ 0.0, 2023-08-31T22:02:47.3439985Z │ 0.9948055148124695 2023-08-31T22:02:47.3440199Z │ ], 2023-08-31T22:02:47.3440411Z │ [ 2023-08-31T22:02:47.3440616Z │ 0.0, 2023-08-31T22:02:47.3440838Z │ 0.9948518872261047 2023-08-31T22:02:47.3441050Z │ ], 2023-08-31T22:02:47.3441252Z │ [ 2023-08-31T22:02:47.3441450Z │ 0.0, 2023-08-31T22:02:47.3441678Z │ 0.9948964715003967 2023-08-31T22:02:47.3441894Z │ ], 2023-08-31T22:02:47.3442085Z │ [ 2023-08-31T22:02:47.3442292Z │ 0.0, 2023-08-31T22:02:47.3442624Z │ 0.9949400424957275 2023-08-31T22:02:47.3442841Z │ ], 2023-08-31T22:02:47.3443041Z │ [ 2023-08-31T22:02:47.3443247Z │ 0.0, 2023-08-31T22:02:47.3443469Z │ 0.9949837923049927 2023-08-31T22:02:47.3443685Z │ ], 2023-08-31T22:02:47.3443889Z │ [ 2023-08-31T22:02:47.3444086Z │ 0.0, 2023-08-31T22:02:47.3444320Z │ 0.9950267672538757 2023-08-31T22:02:47.3444538Z │ ], 2023-08-31T22:02:47.3444733Z │ [ 2023-08-31T22:02:47.3444943Z │ 0.0, 2023-08-31T22:02:47.3445189Z │ 0.9950693845748901 2023-08-31T22:02:47.3445401Z │ ], 2023-08-31T22:02:47.3445600Z │ [ 2023-08-31T22:02:47.3445809Z │ 0.0, 2023-08-31T22:02:47.3446026Z │ 0.995111525 2023-08-31T22:02:47.3446478Z │ (showing 2.05kB/2.47MB) 2023-08-31T22:02:47.3462369Z └ 2023-08-31T22:02:47.3462862Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:47.3463620Z 2ms 266µs (cache) (cache) 1040ms 4ms 357µs 1047ms 2023-08-31T22:02:47.3463825Z 2023-08-31T22:02:47.6383984Z ✓ Successful POST request 2023-08-31T22:02:47.6489194Z 2023-08-31T22:02:47.6489662Z → Model Zoo - Unregister model 2023-08-31T22:02:47.7387907Z DELETE http://localhost:8081/models/deeplabv3_resnet_101_scripted 2023-08-31T22:02:47.7389023Z 200 OK ★ 84ms time ★ 265B↑ 337B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:47.7389758Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 71B 2023-08-31T22:02:47.7390608Z │ { 2023-08-31T22:02:47.7391372Z │ "status": "Model \"deeplabv3_resnet_101_scripted\" u 2023-08-31T22:02:47.7391675Z │ nregistered" 2023-08-31T22:02:47.7391899Z │ } 2023-08-31T22:02:47.7411838Z └ 2023-08-31T22:02:47.7412440Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:47.7413281Z 1ms 266µs (cache) (cache) 81ms 1ms 53µs 85ms 2023-08-31T22:02:47.7413540Z 2023-08-31T22:02:47.7459972Z ✓ Successful DELETE request 2023-08-31T22:02:47.7503100Z 2023-08-31T22:02:47.7503403Z → Model Zoo - Model Metrics 2023-08-31T22:02:47.7586981Z GET http://localhost:8082/metrics 2023-08-31T22:02:47.7587851Z 200 OK ★ 3ms time ★ 233B↑ 15.12kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:47.7588658Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 14.83kB 2023-08-31T22:02:47.7591523Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:02:47.7591872Z │ c with unit: Count 2023-08-31T22:02:47.7592230Z │ # TYPE Requests2XX counter 2023-08-31T22:02:47.7592593Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 75. 2023-08-31T22:02:47.7592864Z │ 0 2023-08-31T22:02:47.7593194Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:02:47.7593502Z │ c with unit: Count 2023-08-31T22:02:47.7593766Z │ # TYPE Requests5XX counter 2023-08-31T22:02:47.7594126Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:02:47.7594529Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:02:47.7594897Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:02:47.7595276Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:47.7595659Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:02:47.7595933Z │ 5157.442 2023-08-31T22:02:47.7596255Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:02:47.7596627Z │ et_101",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:47.7596919Z │ ",} 744788.113 2023-08-31T22:02:47.7597226Z │ ts_inference_latency_microseconds{model_name="mnist_sc 2023-08-31T22:02:47.7597590Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:47.7597866Z │ ",} 58411.041 2023-08-31T22:02:47.7598175Z │ ts_inference_latency_microseconds{model_name="deeplabv 2023-08-31T22:02:47.7598539Z │ 3_resnet_101_eager",model_version="default",hostname=" 2023-08-31T22:02:47.7599094Z │ fv-az628-190",} 766032.167 2023-08-31T22:02:47.7599429Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:02:47.7599794Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:02:47.7600068Z │ 197192.539 2023-08-31T22:02:47.7600371Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:47.7600743Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:02:47.7601031Z │ -190",} 23938.584 2023-08-31T22:02:47.7601355Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:02:47.7601834Z │ et_101_scripted",model_version="default",hostname="fv- 2023-08-31T22:02:47.7602143Z │ az628-190",} 1069558.185 2023-08-31T22:02:47.7602469Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:47.7602825Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:02:47.7603134Z │ "fv-az628-190",} 52504.044 2023-08-31T22:02:47.7603474Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:02:47.7603831Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:02:47.7604100Z │ 8.971 2023-08-31T22:02:47.7604406Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:47.7604756Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:02:47.7605043Z │ -190",} 153779.746 2023-08-31T22:02:47.7605362Z │ ts_inference_latency_microseconds{model_name="fastrcnn 2023-08-31T22:02:47.7605726Z │ ",model_version="default",hostname="fv-az628-190",} 23 2023-08-31T22:02:47.7606003Z │ 41906.593 2023-08-31T22:02:47.7606522Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:02:47.7606899Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:02:47.7607158Z │ 94.667 2023-08-31T22:02:47.7607468Z │ ts_inference_latency_microseconds{model_name="maskrcnn 2023-08-31T22:02:47.7607827Z │ ",model_version="default",hostname="fv-az628-190",} 25 2023-08-31T22:02:47.7608096Z │ 74140.332 2023-08-31T22:02:47.7608378Z │ ts_inference_latency_microseconds{mode 2023-08-31T22:02:47.7608685Z │ (showing 2.05kB/14.83kB) 2023-08-31T22:02:47.7618740Z └ 2023-08-31T22:02:47.7619379Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:47.7620104Z 1ms 209µs (cache) (cache) 1ms 1ms 28µs 4ms 2023-08-31T22:02:47.7620478Z 2023-08-31T22:02:47.7672752Z ✓ Successful GET request 2023-08-31T22:02:47.7701024Z 2023-08-31T22:02:47.7701310Z Iteration 20/24 2023-08-31T22:02:47.7716345Z 2023-08-31T22:02:47.7716702Z → Model Zoo - Register Model 2023-08-31T22:02:51.9200185Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&initial_workers=1&synchronous=true 2023-08-31T22:02:51.9201102Z 200 OK ★ 4.1s time ★ 333B↑ 351B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:51.9201603Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 85B 2023-08-31T22:02:51.9201959Z │ { 2023-08-31T22:02:51.9202412Z │ "status": "Model \"resnet152\" Version: 1.0 register 2023-08-31T22:02:51.9202829Z │ ed with 1 initial workers" 2023-08-31T22:02:51.9203139Z │ } 2023-08-31T22:02:51.9212258Z └ 2023-08-31T22:02:51.9212800Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:51.9213441Z 1ms 208µs (cache) (cache) 4.1s 1ms 34µs 4.1s 2023-08-31T22:02:51.9213734Z 2023-08-31T22:02:51.9260005Z ✓ Successful POST request 2023-08-31T22:02:51.9305496Z 2023-08-31T22:02:51.9306533Z → Model Zoo - Inference Model 2023-08-31T22:02:52.1266030Z POST http://localhost:8080/predictions/resnet152 2023-08-31T22:02:52.1266964Z 200 OK ★ 190ms time ★ 111.24kB↑ 408B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:02:52.1267411Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:02:52.1267790Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:02:52.1268134Z └ 2023-08-31T22:02:52.1268798Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 173B 2023-08-31T22:02:52.1269164Z │ { 2023-08-31T22:02:52.1269498Z │ "tiger_cat": 0.5798623561859131, 2023-08-31T22:02:52.1269877Z │ "tabby": 0.383440762758255, 2023-08-31T22:02:52.1270260Z │ "Egyptian_cat": 0.03421143814921379, 2023-08-31T22:02:52.1270625Z │ "lynx": 0.0005819794605486095, 2023-08-31T22:02:52.1270991Z │ "quilt": 0.0002733195142354816 2023-08-31T22:02:52.1271307Z │ } 2023-08-31T22:02:52.1281009Z └ 2023-08-31T22:02:52.1281590Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:52.1282434Z 1ms 223µs (cache) (cache) 187ms 1ms 43µs 191ms 2023-08-31T22:02:52.1282699Z 2023-08-31T22:02:52.1383783Z ✓ Successful POST request 2023-08-31T22:02:52.1395546Z ✓ Test expected JSON response 2023-08-31T22:02:52.1442947Z 2023-08-31T22:02:52.1443474Z → Model Zoo - Unregister model 2023-08-31T22:02:52.2001220Z DELETE http://localhost:8081/models/resnet152 2023-08-31T22:02:52.2002185Z 200 OK ★ 50ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:52.2002707Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:02:52.2003078Z │ { 2023-08-31T22:02:52.2003467Z │ "status": "Model \"resnet152\" unregistered" 2023-08-31T22:02:52.2003807Z │ } 2023-08-31T22:02:52.2015506Z └ 2023-08-31T22:02:52.2016023Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:52.2016598Z 1ms 234µs (cache) (cache) 48ms 1ms 30µs 51ms 2023-08-31T22:02:52.2016908Z 2023-08-31T22:02:52.2059589Z ✓ Successful DELETE request 2023-08-31T22:02:52.2102470Z 2023-08-31T22:02:52.2103141Z → Model Zoo - Model Metrics 2023-08-31T22:02:52.2206781Z GET http://localhost:8082/metrics 2023-08-31T22:02:52.2207743Z 200 OK ★ 5ms time ★ 233B↑ 15.71kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:52.2209994Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 15.42kB 2023-08-31T22:02:52.2210713Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:02:52.2211292Z │ c with unit: Count 2023-08-31T22:02:52.2211657Z │ # TYPE Requests2XX counter 2023-08-31T22:02:52.2212025Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 79. 2023-08-31T22:02:52.2212341Z │ 0 2023-08-31T22:02:52.2212673Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:02:52.2212987Z │ c with unit: Count 2023-08-31T22:02:52.2213253Z │ # TYPE Requests5XX counter 2023-08-31T22:02:52.2213606Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:02:52.2214026Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:02:52.2214389Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:02:52.2214771Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:52.2215216Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:02:52.2215496Z │ 5157.442 2023-08-31T22:02:52.2215828Z │ ts_inference_latency_microseconds{model_name="resnet15 2023-08-31T22:02:52.2216188Z │ 2",model_version="default",hostname="fv-az628-190",} 1 2023-08-31T22:02:52.2216460Z │ 86024.462 2023-08-31T22:02:52.2216764Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:02:52.2217123Z │ et_101",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:52.2217404Z │ ",} 744788.113 2023-08-31T22:02:52.2217709Z │ ts_inference_latency_microseconds{model_name="mnist_sc 2023-08-31T22:02:52.2218082Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:02:52.2218377Z │ ",} 58411.041 2023-08-31T22:02:52.2218682Z │ ts_inference_latency_microseconds{model_name="deeplabv 2023-08-31T22:02:52.2219042Z │ 3_resnet_101_eager",model_version="default",hostname=" 2023-08-31T22:02:52.2219342Z │ fv-az628-190",} 766032.167 2023-08-31T22:02:52.2219670Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:02:52.2220307Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:02:52.2220597Z │ 197192.539 2023-08-31T22:02:52.2220910Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:52.2221258Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:02:52.2221547Z │ -190",} 23938.584 2023-08-31T22:02:52.2221863Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:02:52.2222209Z │ et_101_scripted",model_version="default",hostname="fv- 2023-08-31T22:02:52.2222518Z │ az628-190",} 1069558.185 2023-08-31T22:02:52.2222841Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:02:52.2223343Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:02:52.2223649Z │ "fv-az628-190",} 52504.044 2023-08-31T22:02:52.2223973Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:02:52.2224341Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:02:52.2224599Z │ 8.971 2023-08-31T22:02:52.2224909Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:02:52.2225267Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:02:52.2225540Z │ -190",} 153779.746 2023-08-31T22:02:52.2225852Z │ ts_inference_latency_microseconds{model_name="fastrcnn 2023-08-31T22:02:52.2226216Z │ ",model_version="default",hostname="fv-az628-190",} 23 2023-08-31T22:02:52.2226477Z │ 41906.593 2023-08-31T22:02:52.2226791Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:02:52.2227150Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:02:52.2227422Z │ 94.667 2023-08-31T22:02:52.2227707Z │ ts_inference_latency_microseconds{mode 2023-08-31T22:02:52.2228003Z │ (showing 2.05kB/15.42kB) 2023-08-31T22:02:52.2239951Z └ 2023-08-31T22:02:52.2240695Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:52.2241540Z 1ms 207µs (cache) (cache) 1ms 3ms 29µs 6ms 2023-08-31T22:02:52.2241793Z 2023-08-31T22:02:52.2297079Z ✓ Successful GET request 2023-08-31T22:02:52.2353154Z 2023-08-31T22:02:52.2353516Z Iteration 21/24 2023-08-31T22:02:52.2370480Z 2023-08-31T22:02:52.2370780Z → Model Zoo - Register Model 2023-08-31T22:02:59.2930997Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/resnet-152-batch_scripted.mar&model_name=resnet-152-batch_scripted&initial_workers=1&synchronous=true 2023-08-31T22:02:59.2932061Z 200 OK ★ 7s time ★ 399B↑ 368B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:59.2932780Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 101B 2023-08-31T22:02:59.2934844Z │ { 2023-08-31T22:02:59.2935354Z │ "status": "Model \"resnet-152-batch_scripted\" Versi 2023-08-31T22:02:59.2935939Z │ on: 1.0 registered with 1 initial workers" 2023-08-31T22:02:59.3047417Z │ } 2023-08-31T22:02:59.3048050Z └ 2023-08-31T22:02:59.3049161Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:59.3049741Z 1ms 211µs (cache) (cache) 7s 2ms 57µs 7s 2023-08-31T22:02:59.3049946Z 2023-08-31T22:02:59.3050117Z ✓ Successful POST request 2023-08-31T22:02:59.3065865Z 2023-08-31T22:02:59.3066183Z → Model Zoo - Inference Model 2023-08-31T22:02:59.8799844Z POST http://localhost:8080/predictions/resnet-152-batch_scripted 2023-08-31T22:02:59.8800855Z 200 OK ★ 567ms time ★ 111.26kB↑ 408B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:02:59.8801804Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:02:59.8802186Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:02:59.8802430Z └ 2023-08-31T22:02:59.8802762Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 173B 2023-08-31T22:02:59.8803028Z │ { 2023-08-31T22:02:59.8803298Z │ "tiger_cat": 0.5798623561859131, 2023-08-31T22:02:59.8803600Z │ "tabby": 0.383440762758255, 2023-08-31T22:02:59.8803891Z │ "Egyptian_cat": 0.03421143814921379, 2023-08-31T22:02:59.8804510Z │ "lynx": 0.0005819794605486095, 2023-08-31T22:02:59.8804806Z │ "quilt": 0.0002733195142354816 2023-08-31T22:02:59.8805040Z │ } 2023-08-31T22:02:59.8820506Z └ 2023-08-31T22:02:59.8820981Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:59.8821527Z 2ms 257µs (cache) (cache) 563ms 2ms 35µs 568ms 2023-08-31T22:02:59.8821724Z 2023-08-31T22:02:59.8879006Z ✓ Successful POST request 2023-08-31T22:02:59.8882253Z ✓ Test expected JSON response 2023-08-31T22:02:59.8922746Z 2023-08-31T22:02:59.8923139Z → Model Zoo - Unregister model 2023-08-31T22:02:59.9835193Z DELETE http://localhost:8081/models/resnet-152-batch_scripted 2023-08-31T22:02:59.9836087Z 200 OK ★ 85ms time ★ 261B↑ 333B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:02:59.9836710Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 67B 2023-08-31T22:02:59.9837276Z │ { 2023-08-31T22:02:59.9837788Z │ "status": "Model \"resnet-152-batch_scripted\" unreg 2023-08-31T22:02:59.9838280Z │ istered" 2023-08-31T22:02:59.9838610Z │ } 2023-08-31T22:02:59.9856052Z └ 2023-08-31T22:02:59.9856692Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:02:59.9857420Z 1ms 219µs (cache) (cache) 83ms 1ms 29µs 85ms 2023-08-31T22:02:59.9857889Z 2023-08-31T22:02:59.9887040Z ✓ Successful DELETE request 2023-08-31T22:02:59.9929680Z 2023-08-31T22:02:59.9930060Z → Model Zoo - Model Metrics 2023-08-31T22:03:00.0017716Z GET http://localhost:8082/metrics 2023-08-31T22:03:00.0021628Z 200 OK ★ 4ms time ★ 233B↑ 16.4kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:00.0022363Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 16.11kB 2023-08-31T22:03:00.0023366Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:03:00.0023845Z │ c with unit: Count 2023-08-31T22:03:00.0024237Z │ # TYPE Requests2XX counter 2023-08-31T22:03:00.0024888Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 83. 2023-08-31T22:03:00.0025500Z │ 0 2023-08-31T22:03:00.0025947Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:03:00.0026265Z │ c with unit: Count 2023-08-31T22:03:00.0026550Z │ # TYPE Requests5XX counter 2023-08-31T22:03:00.0026906Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:03:00.0027285Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:03:00.0027656Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:03:00.0028032Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:03:00.0028449Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:03:00.0028719Z │ 5157.442 2023-08-31T22:03:00.0029034Z │ ts_inference_latency_microseconds{model_name="resnet15 2023-08-31T22:03:00.0029398Z │ 2",model_version="default",hostname="fv-az628-190",} 1 2023-08-31T22:03:00.0029666Z │ 86024.462 2023-08-31T22:03:00.0029992Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:03:00.0030358Z │ et_101",model_version="default",hostname="fv-az628-190 2023-08-31T22:03:00.0030625Z │ ",} 744788.113 2023-08-31T22:03:00.0030936Z │ ts_inference_latency_microseconds{model_name="mnist_sc 2023-08-31T22:03:00.0031303Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:03:00.0031575Z │ ",} 58411.041 2023-08-31T22:03:00.0031885Z │ ts_inference_latency_microseconds{model_name="deeplabv 2023-08-31T22:03:00.0032248Z │ 3_resnet_101_eager",model_version="default",hostname=" 2023-08-31T22:03:00.0032559Z │ fv-az628-190",} 766032.167 2023-08-31T22:03:00.0032883Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:03:00.0033238Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:03:00.0033503Z │ 197192.539 2023-08-31T22:03:00.0033806Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:03:00.0034165Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:03:00.0034732Z │ -190",} 23938.584 2023-08-31T22:03:00.0035051Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:03:00.0035421Z │ et_101_scripted",model_version="default",hostname="fv- 2023-08-31T22:03:00.0035729Z │ az628-190",} 1069558.185 2023-08-31T22:03:00.0036049Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:03:00.0036413Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:03:00.0036719Z │ "fv-az628-190",} 52504.044 2023-08-31T22:03:00.0037054Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:03:00.0037563Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:03:00.0037829Z │ 8.971 2023-08-31T22:03:00.0038135Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:03:00.0038485Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:03:00.0038770Z │ -190",} 153779.746 2023-08-31T22:03:00.0039095Z │ ts_inference_latency_microseconds{model_name="fastrcnn 2023-08-31T22:03:00.0039445Z │ ",model_version="default",hostname="fv-az628-190",} 23 2023-08-31T22:03:00.0039718Z │ 41906.593 2023-08-31T22:03:00.0040024Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:03:00.0040373Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:03:00.0040641Z │ 94.667 2023-08-31T22:03:00.0040927Z │ ts_inference_latency_microseconds{mode 2023-08-31T22:03:00.0041216Z │ (showing 2.05kB/16.11kB) 2023-08-31T22:03:00.0041698Z └ 2023-08-31T22:03:00.0042135Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:00.0042653Z 1ms 207µs (cache) (cache) 1ms 1ms 29µs 4ms 2023-08-31T22:03:00.0042860Z 2023-08-31T22:03:00.0099491Z ✓ Successful GET request 2023-08-31T22:03:00.0128047Z 2023-08-31T22:03:00.0128321Z Iteration 22/24 2023-08-31T22:03:00.0140884Z 2023-08-31T22:03:00.0141257Z → Model Zoo - Register Model 2023-08-31T22:03:08.8942094Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/distill_bert_qa_eager.mar&model_name=distill_bert_qa_eager&initial_workers=1&synchronous=true 2023-08-31T22:03:08.8944411Z 200 OK ★ 8.8s time ★ 391B↑ 363B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:08.8947532Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 97B 2023-08-31T22:03:08.8949935Z │ { 2023-08-31T22:03:08.8950310Z │ "status": "Model \"distill_bert_qa_eager\" Version: 2023-08-31T22:03:08.8950677Z │ 1.0 registered with 1 initial workers" 2023-08-31T22:03:08.8950968Z │ } 2023-08-31T22:03:08.8970369Z └ 2023-08-31T22:03:08.8971096Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:08.8972021Z 1ms 216µs (cache) (cache) 8.8s 2ms 58µs 8.8s 2023-08-31T22:03:08.8972253Z 2023-08-31T22:03:08.9020802Z ✓ Successful POST request 2023-08-31T22:03:08.9081187Z 2023-08-31T22:03:08.9081788Z → Model Zoo - Inference Model 2023-08-31T22:03:09.0339796Z POST http://localhost:8080/predictions/distill_bert_qa_eager 2023-08-31T22:03:09.0341021Z 200 OK ★ 118ms time ★ 359B↑ 247B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:03:09.0341910Z ┌ ↑ file ★ 79B 2023-08-31T22:03:09.0342187Z │ 2023-08-31T22:03:09.0344050Z └ 2023-08-31T22:03:09.0344381Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 13B 2023-08-31T22:03:09.0344855Z │ a nice puppet 2023-08-31T22:03:09.0357659Z └ 2023-08-31T22:03:09.0358240Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:09.0358956Z 2ms 268µs (cache) (cache) 115ms 2ms 36µs 120ms 2023-08-31T22:03:09.0359313Z 2023-08-31T22:03:09.0417364Z ✓ Successful POST request 2023-08-31T22:03:09.0461198Z 2023-08-31T22:03:09.0461759Z → Model Zoo - Unregister model 2023-08-31T22:03:09.1404592Z DELETE http://localhost:8081/models/distill_bert_qa_eager 2023-08-31T22:03:09.1405922Z 200 OK ★ 88ms time ★ 257B↑ 329B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:09.1407407Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 63B 2023-08-31T22:03:09.1409106Z │ { 2023-08-31T22:03:09.1409627Z │ "status": "Model \"distill_bert_qa_eager\" unregiste 2023-08-31T22:03:09.1410117Z │ red" 2023-08-31T22:03:09.1410509Z │ } 2023-08-31T22:03:09.1428629Z └ 2023-08-31T22:03:09.1429248Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:09.1429917Z 1ms 250µs (cache) (cache) 85ms 1ms 31µs 88ms 2023-08-31T22:03:09.1430561Z 2023-08-31T22:03:09.1475007Z ✓ Successful DELETE request 2023-08-31T22:03:09.1528644Z 2023-08-31T22:03:09.1529116Z → Model Zoo - Model Metrics 2023-08-31T22:03:09.1629422Z GET http://localhost:8082/metrics 2023-08-31T22:03:09.1630330Z 200 OK ★ 4ms time ★ 233B↑ 17.05kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:09.1632826Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 16.76kB 2023-08-31T22:03:09.1634791Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:03:09.1635164Z │ c with unit: Count 2023-08-31T22:03:09.1635445Z │ # TYPE Requests2XX counter 2023-08-31T22:03:09.1635803Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 87. 2023-08-31T22:03:09.1636081Z │ 0 2023-08-31T22:03:09.1636398Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:03:09.1636710Z │ c with unit: Count 2023-08-31T22:03:09.1636985Z │ # TYPE Requests5XX counter 2023-08-31T22:03:09.1637356Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:03:09.1637738Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:03:09.1638106Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:03:09.1638477Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:03:09.1638847Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:03:09.1639141Z │ 5157.442 2023-08-31T22:03:09.1639456Z │ ts_inference_latency_microseconds{model_name="resnet15 2023-08-31T22:03:09.1639809Z │ 2",model_version="default",hostname="fv-az628-190",} 1 2023-08-31T22:03:09.1640085Z │ 86024.462 2023-08-31T22:03:09.1640392Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:03:09.1640749Z │ et_101",model_version="default",hostname="fv-az628-190 2023-08-31T22:03:09.1641025Z │ ",} 744788.113 2023-08-31T22:03:09.1641343Z │ ts_inference_latency_microseconds{model_name="mnist_sc 2023-08-31T22:03:09.1641718Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:03:09.1642002Z │ ",} 58411.041 2023-08-31T22:03:09.1642316Z │ ts_inference_latency_microseconds{model_name="deeplabv 2023-08-31T22:03:09.1642670Z │ 3_resnet_101_eager",model_version="default",hostname=" 2023-08-31T22:03:09.1642968Z │ fv-az628-190",} 766032.167 2023-08-31T22:03:09.1643290Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:03:09.1643853Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:03:09.1644132Z │ 197192.539 2023-08-31T22:03:09.1644445Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:03:09.1644805Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:03:09.1645136Z │ -190",} 23938.584 2023-08-31T22:03:09.1645448Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:03:09.1645812Z │ et_101_scripted",model_version="default",hostname="fv- 2023-08-31T22:03:09.1646104Z │ az628-190",} 1069558.185 2023-08-31T22:03:09.1646629Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:03:09.1647004Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:03:09.1647306Z │ "fv-az628-190",} 52504.044 2023-08-31T22:03:09.1647639Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:03:09.1648005Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:03:09.1648272Z │ 8.971 2023-08-31T22:03:09.1648583Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:03:09.1648947Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:03:09.1649235Z │ -190",} 153779.746 2023-08-31T22:03:09.1649540Z │ ts_inference_latency_microseconds{model_name="fastrcnn 2023-08-31T22:03:09.1649899Z │ ",model_version="default",hostname="fv-az628-190",} 23 2023-08-31T22:03:09.1650168Z │ 41906.593 2023-08-31T22:03:09.1650468Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:03:09.1650979Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:03:09.1651245Z │ 94.667 2023-08-31T22:03:09.1651517Z │ ts_inference_latency_microseconds{mode 2023-08-31T22:03:09.1651816Z │ (showing 2.05kB/16.76kB) 2023-08-31T22:03:09.1660573Z └ 2023-08-31T22:03:09.1661333Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:09.1661905Z 1ms 238µs (cache) (cache) 1ms 1ms 29µs 5ms 2023-08-31T22:03:09.1662109Z 2023-08-31T22:03:09.1730585Z ✓ Successful GET request 2023-08-31T22:03:09.1763166Z 2023-08-31T22:03:09.1763468Z Iteration 23/24 2023-08-31T22:03:09.1777248Z 2023-08-31T22:03:09.1777823Z → Model Zoo - Register Model 2023-08-31T22:03:21.2298482Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/bert_token_classification_no_torchscript.mar&model_name=bert_token_classification_no_torchscript&initial_workers=1&synchronous=true 2023-08-31T22:03:21.2299698Z 200 OK ★ 12s time ★ 429B↑ 383B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:21.2300190Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 116B 2023-08-31T22:03:21.2300558Z │ { 2023-08-31T22:03:21.2300956Z │ "status": "Model \"bert_token_classification_no_torc 2023-08-31T22:03:21.2301435Z │ hscript\" Version: 1.0 registered with 1 initial worke 2023-08-31T22:03:21.2301792Z │ rs" 2023-08-31T22:03:21.2302073Z │ } 2023-08-31T22:03:21.2315526Z └ 2023-08-31T22:03:21.2316208Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:21.2316820Z 1ms 205µs (cache) (cache) 12s 1ms 35µs 12s 2023-08-31T22:03:21.2317102Z 2023-08-31T22:03:21.2374644Z ✓ Successful POST request 2023-08-31T22:03:21.2473282Z 2023-08-31T22:03:21.2473621Z → Model Zoo - Inference Model 2023-08-31T22:03:21.4433984Z POST http://localhost:8080/predictions/bert_token_classification_no_torchscript 2023-08-31T22:03:21.4434804Z 200 OK ★ 189ms time ★ 375B↑ 5.45kB↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:03:21.4436886Z ┌ ↑ file ★ 76B 2023-08-31T22:03:21.4438512Z │ 2023-08-31T22:03:21.4439843Z └ 2023-08-31T22:03:21.4442220Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 5.22kB 2023-08-31T22:03:21.4443982Z │ [ 2023-08-31T22:03:21.4444208Z │ [ 2023-08-31T22:03:21.4444419Z │ "[CLS]", 2023-08-31T22:03:21.4444650Z │ "B-LOC" 2023-08-31T22:03:21.4445189Z │ ], 2023-08-31T22:03:21.4445400Z │ [ 2023-08-31T22:03:21.4445628Z │ "bloomberg", 2023-08-31T22:03:21.4445861Z │ "O" 2023-08-31T22:03:21.4446069Z │ ], 2023-08-31T22:03:21.4446399Z │ [ 2023-08-31T22:03:21.4447294Z │ "has", 2023-08-31T22:03:21.4447513Z │ "I-ORG" 2023-08-31T22:03:21.4447726Z │ ], 2023-08-31T22:03:21.4447933Z │ [ 2023-08-31T22:03:21.4448141Z │ "decided", 2023-08-31T22:03:21.4448573Z │ "B-PER" 2023-08-31T22:03:21.4448850Z │ ], 2023-08-31T22:03:21.4449125Z │ [ 2023-08-31T22:03:21.4449635Z │ "to", 2023-08-31T22:03:21.4449931Z │ "O" 2023-08-31T22:03:21.4450206Z │ ], 2023-08-31T22:03:21.4450429Z │ [ 2023-08-31T22:03:21.4450718Z │ "publish", 2023-08-31T22:03:21.4451064Z │ "I-PER" 2023-08-31T22:03:21.4451341Z │ ], 2023-08-31T22:03:21.4451564Z │ [ 2023-08-31T22:03:21.4451844Z │ "a", 2023-08-31T22:03:21.4452129Z │ "I-MISC" 2023-08-31T22:03:21.4452418Z │ ], 2023-08-31T22:03:21.4452653Z │ [ 2023-08-31T22:03:21.4452860Z │ "new", 2023-08-31T22:03:21.4453147Z │ "B-PER" 2023-08-31T22:03:21.4453357Z │ ], 2023-08-31T22:03:21.4453625Z │ [ 2023-08-31T22:03:21.4453859Z │ "report", 2023-08-31T22:03:21.4454077Z │ "O" 2023-08-31T22:03:21.4454284Z │ ], 2023-08-31T22:03:21.4454476Z │ [ 2023-08-31T22:03:21.4454677Z │ "on", 2023-08-31T22:03:21.4454892Z │ "O" 2023-08-31T22:03:21.4455090Z │ ], 2023-08-31T22:03:21.4455283Z │ [ 2023-08-31T22:03:21.4455572Z │ "global", 2023-08-31T22:03:21.4455805Z │ "B-PER" 2023-08-31T22:03:21.4456085Z │ ], 2023-08-31T22:03:21.4456301Z │ [ 2023-08-31T22:03:21.4456587Z │ "economic", 2023-08-31T22:03:21.4456874Z │ "O" 2023-08-31T22:03:21.4473605Z │ ], 2023-08-31T22:03:21.4473951Z │ [ 2023-08-31T22:03:21.4474195Z │ "situation", 2023-08-31T22:03:21.4474508Z │ "B-LOC" 2023-08-31T22:03:21.4474790Z │ ], 2023-08-31T22:03:21.4475014Z │ [ 2023-08-31T22:03:21.4475306Z │ ".", 2023-08-31T22:03:21.4475605Z │ "B-PER" 2023-08-31T22:03:21.4475893Z │ ], 2023-08-31T22:03:21.4476105Z │ [ 2023-08-31T22:03:21.4476316Z │ "[SEP]", 2023-08-31T22:03:21.4476619Z │ "B-PER" 2023-08-31T22:03:21.4476894Z │ ], 2023-08-31T22:03:21.4477128Z │ [ 2023-08-31T22:03:21.4477339Z │ "[PAD]", 2023-08-31T22:03:21.4477635Z │ "I-ORG" 2023-08-31T22:03:21.4478035Z │ ], 2023-08-31T22:03:21.4478264Z │ [ 2023-08-31T22:03:21.4478478Z │ "[PAD]", 2023-08-31T22:03:21.4478698Z │ "B-MISC" 2023-08-31T22:03:21.4479003Z │ ], 2023-08-31T22:03:21.4479224Z │ [ 2023-08-31T22:03:21.4479502Z │ "[PAD]", 2023-08-31T22:03:21.4479801Z │ "B-MISC" 2023-08-31T22:03:21.4480084Z │ ], 2023-08-31T22:03:21.4480320Z │ [ 2023-08-31T22:03:21.4480521Z │ "[PAD]", 2023-08-31T22:03:21.4480733Z │ "B-MISC" 2023-08-31T22:03:21.4480940Z │ ], 2023-08-31T22:03:21.4481128Z │ [ 2023-08-31T22:03:21.4481335Z │ "[PAD]", 2023-08-31T22:03:21.4481567Z │ "B-MISC" 2023-08-31T22:03:21.4481765Z │ ], 2023-08-31T22:03:21.4482046Z │ [ 2023-08-31T22:03:21.4482273Z │ "[PAD]", 2023-08-31T22:03:21.4482556Z │ "B-MISC" 2023-08-31T22:03:21.4482764Z │ ], 2023-08-31T22:03:21.4483032Z │ [ 2023-08-31T22:03:21.4483251Z │ "[PAD]", 2023-08-31T22:03:21.4483647Z │ "B-MISC" 2023-08-31T22:03:21.4483856Z │ ], 2023-08-31T22:03:21.4484054Z │ [ 2023-08-31T22:03:21.4484252Z │ "[PAD]", 2023-08-31T22:03:21.4484466Z │ "B-MISC" 2023-08-31T22:03:21.4484686Z │ ], 2023-08-31T22:03:21.4484878Z │ [ 2023-08-31T22:03:21.4485088Z │ "[PAD]", 2023-08-31T22:03:21.4485303Z │ "B-MISC" 2023-08-31T22:03:21.4485505Z │ ], 2023-08-31T22:03:21.4485704Z │ [ 2023-08-31T22:03:21.4485911Z │ "[PAD]", 2023-08-31T22:03:21.4486118Z │ "B-MISC" 2023-08-31T22:03:21.4486508Z │ ], 2023-08-31T22:03:21.4486713Z │ [ 2023-08-31T22:03:21.4486914Z │ "[PAD]", 2023-08-31T22:03:21.4487352Z │ "B-MISC" 2023-08-31T22:03:21.4487570Z │ ], 2023-08-31T22:03:21.4487767Z │ [ 2023-08-31T22:03:21.4487973Z │ "[PAD]", 2023-08-31T22:03:21.4488187Z │ "B-MISC" 2023-08-31T22:03:21.4488385Z │ ], 2023-08-31T22:03:21.4488582Z │ [ 2023-08-31T22:03:21.4488791Z │ "[PAD]", 2023-08-31T22:03:21.4488999Z │ "B-MISC" 2023-08-31T22:03:21.4489201Z │ ], 2023-08-31T22:03:21.4489400Z │ [ 2023-08-31T22:03:21.4489598Z │ "[PAD]", 2023-08-31T22:03:21.4489815Z │ "B-MISC" 2023-08-31T22:03:21.4490020Z │ ], 2023-08-31T22:03:21.4490347Z │ [ 2023-08-31T22:03:21.4490551Z │ "[PAD]", 2023-08-31T22:03:21.4490761Z │ "B-MISC" 2023-08-31T22:03:21.4490958Z │ ], 2023-08-31T22:03:21.4491154Z │ [ 2023-08-31T22:03:21.4491496Z │ "[PAD]", 2023-08-31T22:03:21.4491707Z │ "B-MISC" 2023-08-31T22:03:21.4491989Z │ ], 2023-08-31T22:03:21.4492211Z │ [ 2023-08-31T22:03:21.4492495Z │ "[PAD]", 2023-08-31T22:03:21.4492829Z │ "B-MISC" 2023-08-31T22:03:21.4493121Z │ ], 2023-08-31T22:03:21.4493398Z │ [ 2023-08-31T22:03:21.4493643Z │ "[PAD]", 2023-08-31T22:03:21.4493857Z │ "B-MISC" 2023-08-31T22:03:21.4494062Z │ ], 2023-08-31T22:03:21.4494253Z │ [ 2023-08-31T22:03:21.4494462Z │ "[PAD]", 2023-08-31T22:03:21.4494675Z │ "B-MISC" 2023-08-31T22:03:21.4494871Z │ ], 2023-08-31T22:03:21.4495065Z │ [ 2023-08-31T22:03:21.4495268Z │ "[PAD]", 2023-08-31T22:03:21.4495471Z │ "B-MISC" 2023-08-31T22:03:21.4495672Z │ ], 2023-08-31T22:03:21.4495883Z │ [ 2023-08-31T22:03:21.4496083Z │ "[PAD]", 2023-08-31T22:03:21.4496296Z │ "B-MISC" 2023-08-31T22:03:21.4496502Z │ ], 2023-08-31T22:03:21.4496691Z │ [ 2023-08-31T22:03:21.4496899Z │ "[PAD]", 2023-08-31T22:03:21.4497112Z │ "B-MISC" 2023-08-31T22:03:21.4497305Z │ ], 2023-08-31T22:03:21.4497503Z │ [ 2023-08-31T22:03:21.4497707Z │ "[PAD]", 2023-08-31T22:03:21.4497910Z │ "B-MISC" 2023-08-31T22:03:21.4498124Z │ ], 2023-08-31T22:03:21.4498321Z │ [ 2023-08-31T22:03:21.4498614Z │ "[PAD]", 2023-08-31T22:03:21.4498849Z │ "B-MISC" 2023-08-31T22:03:21.4499047Z │ ], 2023-08-31T22:03:21.4499315Z │ [ 2023-08-31T22:03:21.4499536Z │ "[PAD]", 2023-08-31T22:03:21.4499748Z │ "B-MISC" 2023-08-31T22:03:21.4500025Z │ ], 2023-08-31T22:03:21.4500251Z │ [ 2023-08-31T22:03:21.4500459Z │ "[PAD]", 2023-08-31T22:03:21.4500679Z │ "B-MISC" 2023-08-31T22:03:21.4500876Z │ ], 2023-08-31T22:03:21.4501072Z │ [ 2023-08-31T22:03:21.4501294Z │ "[PAD]", 2023-08-31T22:03:21.4501501Z │ "B-MISC" 2023-08-31T22:03:21.4501703Z │ ], 2023-08-31T22:03:21.4501901Z │ [ 2023-08-31T22:03:21.4502098Z │ "[PAD]", 2023-08-31T22:03:21.4502310Z │ "B-MISC" 2023-08-31T22:03:21.4502513Z │ ], 2023-08-31T22:03:21.4502699Z │ [ 2023-08-31T22:03:21.4502902Z │ "[PAD]", 2023-08-31T22:03:21.4503117Z │ "B-MISC" 2023-08-31T22:03:21.4503312Z │ ], 2023-08-31T22:03:21.4503518Z │ [ 2023-08-31T22:03:21.4503815Z │ "[PAD]", 2023-08-31T22:03:21.4504037Z │ "B-MISC" 2023-08-31T22:03:21.4504318Z │ ], 2023-08-31T22:03:21.4504532Z │ [ 2023-08-31T22:03:21.4504821Z │ "[PAD]", 2023-08-31T22:03:21.4505063Z │ "B-MISC" 2023-08-31T22:03:21.4505269Z │ ], 2023-08-31T22:03:21.4505470Z │ [ 2023-08-31T22:03:21.4505667Z │ "[PAD]", 2023-08-31T22:03:21.4505883Z │ "B-MISC" 2023-08-31T22:03:21.4506084Z │ ], 2023-08-31T22:03:21.4506270Z │ [ 2023-08-31T22:03:21.4506473Z │ "[PAD]", 2023-08-31T22:03:21.4506697Z │ "B-MISC" 2023-08-31T22:03:21.4506892Z │ ], 2023-08-31T22:03:21.4507085Z │ [ 2023-08-31T22:03:21.4507292Z │ "[PAD]", 2023-08-31T22:03:21.4507496Z │ "B-MISC" 2023-08-31T22:03:21.4507700Z │ ], 2023-08-31T22:03:21.4507984Z │ [ 2023-08-31T22:03:21.4508199Z │ "[PAD]", 2023-08-31T22:03:21.4508448Z │ "B-MISC" 2023-08-31T22:03:21.4508725Z │ ], 2023-08-31T22:03:21.4509092Z │ [ 2023-08-31T22:03:21.4509379Z │ "[PAD]", 2023-08-31T22:03:21.4509667Z │ "B-MISC" 2023-08-31T22:03:21.4509950Z │ ], 2023-08-31T22:03:21.4510159Z │ [ 2023-08-31T22:03:21.4510446Z │ "[PAD]", 2023-08-31T22:03:21.4510732Z │ "B-MISC" 2023-08-31T22:03:21.4510971Z │ ], 2023-08-31T22:03:21.4511160Z │ [ 2023-08-31T22:03:21.4511366Z │ "[PAD]", 2023-08-31T22:03:21.4511578Z │ "B-MISC" 2023-08-31T22:03:21.4511773Z │ ], 2023-08-31T22:03:21.4511968Z │ [ 2023-08-31T22:03:21.4512254Z │ "[PAD]", 2023-08-31T22:03:21.4512611Z │ "B-MISC" 2023-08-31T22:03:21.4512894Z │ ], 2023-08-31T22:03:21.4513123Z │ [ 2023-08-31T22:03:21.4513322Z │ "[PAD]", 2023-08-31T22:03:21.4513536Z │ "B-MISC" 2023-08-31T22:03:21.4513741Z │ ], 2023-08-31T22:03:21.4513934Z │ [ 2023-08-31T22:03:21.4514139Z │ "[PAD]", 2023-08-31T22:03:21.4514428Z │ "B-MISC" 2023-08-31T22:03:21.4514640Z │ ], 2023-08-31T22:03:21.4514911Z │ [ 2023-08-31T22:03:21.4515148Z │ "[PAD]", 2023-08-31T22:03:21.4515439Z │ "B-MISC" 2023-08-31T22:03:21.4515656Z │ ], 2023-08-31T22:03:21.4515942Z │ [ 2023-08-31T22:03:21.4516150Z │ "[PAD]", 2023-08-31T22:03:21.4516355Z │ "B-MISC" 2023-08-31T22:03:21.4516559Z │ ], 2023-08-31T22:03:21.4516759Z │ [ 2023-08-31T22:03:21.4516955Z │ "[PAD]", 2023-08-31T22:03:21.4517167Z │ "B-MISC" 2023-08-31T22:03:21.4517370Z │ ], 2023-08-31T22:03:21.4517556Z │ [ 2023-08-31T22:03:21.4517992Z │ "[PAD]", 2023-08-31T22:03:21.4518282Z │ (showing 2.05kB/5.22kB) 2023-08-31T22:03:21.4518595Z └ 2023-08-31T22:03:21.4519021Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:21.4519606Z 2ms 228µs (cache) (cache) 186ms 2ms 36µs 191ms 2023-08-31T22:03:21.4519881Z 2023-08-31T22:03:21.4603211Z ✓ Successful POST request 2023-08-31T22:03:21.4610326Z ✓ Test expected JSON response 2023-08-31T22:03:21.4671191Z 2023-08-31T22:03:21.4671485Z → Model Zoo - Unregister model 2023-08-31T22:03:21.5947447Z DELETE http://localhost:8081/models/bert_token_classification_no_torchscript 2023-08-31T22:03:21.5950286Z 200 OK ★ 122ms time ★ 276B↑ 348B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:21.5950999Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 82B 2023-08-31T22:03:21.5951945Z │ { 2023-08-31T22:03:21.5952611Z │ "status": "Model \"bert_token_classification_no_torc 2023-08-31T22:03:21.5952961Z │ hscript\" unregistered" 2023-08-31T22:03:21.5953266Z │ } 2023-08-31T22:03:21.5970418Z └ 2023-08-31T22:03:21.5970902Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:21.5971417Z 1ms 241µs (cache) (cache) 119ms 1ms 31µs 122ms 2023-08-31T22:03:21.5971619Z 2023-08-31T22:03:21.6025561Z ✓ Successful DELETE request 2023-08-31T22:03:21.6073332Z 2023-08-31T22:03:21.6073683Z → Model Zoo - Model Metrics 2023-08-31T22:03:21.6170825Z GET http://localhost:8082/metrics 2023-08-31T22:03:21.6172669Z 200 OK ★ 4ms time ★ 233B↑ 17.83kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:21.6174869Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 17.54kB 2023-08-31T22:03:21.6181880Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:03:21.6182239Z │ c with unit: Count 2023-08-31T22:03:21.6182626Z │ # TYPE Requests2XX counter 2023-08-31T22:03:21.6183070Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 91. 2023-08-31T22:03:21.6183456Z │ 0 2023-08-31T22:03:21.6183804Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:03:21.6184110Z │ c with unit: Count 2023-08-31T22:03:21.6184470Z │ # TYPE Requests5XX counter 2023-08-31T22:03:21.6184895Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:03:21.6185361Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:03:21.6186089Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:03:21.6186575Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:03:21.6187026Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:03:21.6187380Z │ 5157.442 2023-08-31T22:03:21.6187707Z │ ts_inference_latency_microseconds{model_name="resnet15 2023-08-31T22:03:21.6188068Z │ 2",model_version="default",hostname="fv-az628-190",} 1 2023-08-31T22:03:21.6188407Z │ 86024.462 2023-08-31T22:03:21.6188730Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:03:21.6189349Z │ et_101",model_version="default",hostname="fv-az628-190 2023-08-31T22:03:21.6189704Z │ ",} 744788.113 2023-08-31T22:03:21.6190071Z │ ts_inference_latency_microseconds{model_name="mnist_sc 2023-08-31T22:03:21.6190501Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:03:21.6190864Z │ ",} 58411.041 2023-08-31T22:03:21.6191227Z │ ts_inference_latency_microseconds{model_name="deeplabv 2023-08-31T22:03:21.6191682Z │ 3_resnet_101_eager",model_version="default",hostname=" 2023-08-31T22:03:21.6192053Z │ fv-az628-190",} 766032.167 2023-08-31T22:03:21.6192452Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:03:21.6192889Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:03:21.6193239Z │ 197192.539 2023-08-31T22:03:21.6193570Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:03:21.6193939Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:03:21.6194299Z │ -190",} 23938.584 2023-08-31T22:03:21.6194699Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:03:21.6195138Z │ et_101_scripted",model_version="default",hostname="fv- 2023-08-31T22:03:21.6195511Z │ az628-190",} 1069558.185 2023-08-31T22:03:21.6195905Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:03:21.6196332Z │ classifier_scripted",model_version="default",hostname= 2023-08-31T22:03:21.6196705Z │ "fv-az628-190",} 52504.044 2023-08-31T22:03:21.6197119Z │ ts_inference_latency_microseconds{model_name="vgg16",m 2023-08-31T22:03:21.6197562Z │ odel_version="default",hostname="fv-az628-190",} 20509 2023-08-31T22:03:21.6197892Z │ 8.971 2023-08-31T22:03:21.6198224Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:03:21.6198664Z │ 8_scripted",model_version="default",hostname="fv-az628 2023-08-31T22:03:21.6199020Z │ -190",} 153779.746 2023-08-31T22:03:21.6199376Z │ ts_inference_latency_microseconds{model_name="fastrcnn 2023-08-31T22:03:21.6199803Z │ ",model_version="default",hostname="fv-az628-190",} 23 2023-08-31T22:03:21.6200158Z │ 41906.593 2023-08-31T22:03:21.6200550Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:03:21.6200972Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:03:21.6201352Z │ 94.667 2023-08-31T22:03:21.6201709Z │ ts_inference_latency_microseconds{mode 2023-08-31T22:03:21.6202069Z │ (showing 2.05kB/17.54kB) 2023-08-31T22:03:21.6220557Z └ 2023-08-31T22:03:21.6221129Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:21.6221713Z 1ms 224µs (cache) (cache) 2ms 1ms 29µs 4ms 2023-08-31T22:03:21.6221988Z 2023-08-31T22:03:21.6305683Z ✓ Successful GET request 2023-08-31T22:03:21.6407071Z 2023-08-31T22:03:21.6412340Z Iteration 24/24 2023-08-31T22:03:21.6414605Z 2023-08-31T22:03:21.6416918Z → Model Zoo - Register Model 2023-08-31T22:03:33.4730238Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/bert_seqc_without_torchscript.mar&model_name=bert_seqc_without_torchscript&initial_workers=1&synchronous=true 2023-08-31T22:03:33.4731435Z 200 OK ★ 11.8s time ★ 407B↑ 372B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:33.4731949Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 105B 2023-08-31T22:03:33.4732314Z │ { 2023-08-31T22:03:33.4732994Z │ "status": "Model \"bert_seqc_without_torchscript\" V 2023-08-31T22:03:33.4733464Z │ ersion: 1.0 registered with 1 initial workers" 2023-08-31T22:03:33.4733820Z │ } 2023-08-31T22:03:33.4741764Z └ 2023-08-31T22:03:33.4742290Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:33.4742904Z 1ms 210µs (cache) (cache) 11.8s 1ms 33µs 11.8s 2023-08-31T22:03:33.4743243Z 2023-08-31T22:03:33.4790707Z ✓ Successful POST request 2023-08-31T22:03:33.4831832Z 2023-08-31T22:03:33.4832160Z → Model Zoo - Inference Model 2023-08-31T22:03:34.3139017Z POST http://localhost:8080/predictions/bert_seqc_without_torchscript 2023-08-31T22:03:34.3140006Z 200 OK ★ 824ms time ★ 364B↑ 246B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:03:34.3140420Z ┌ ↑ file ★ 76B 2023-08-31T22:03:34.3140721Z │ 2023-08-31T22:03:34.3141004Z └ 2023-08-31T22:03:34.3141382Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 12B 2023-08-31T22:03:34.3141755Z │ Not Accepted 2023-08-31T22:03:34.3162329Z └ 2023-08-31T22:03:34.3163024Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:34.3163634Z 1ms 231µs (cache) (cache) 821ms 1ms 34µs 825ms 2023-08-31T22:03:34.3163907Z 2023-08-31T22:03:34.3215476Z ✓ Successful POST request 2023-08-31T22:03:34.3249389Z ✓ Test expected TEXT response 2023-08-31T22:03:34.3276180Z 2023-08-31T22:03:34.3276687Z → Model Zoo - Unregister model 2023-08-31T22:03:34.6702945Z DELETE http://localhost:8081/models/bert_seqc_without_torchscript 2023-08-31T22:03:34.6704083Z 200 OK ★ 335ms time ★ 265B↑ 337B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:34.6704801Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 71B 2023-08-31T22:03:34.6724077Z │ { 2023-08-31T22:03:34.6725109Z │ "status": "Model \"bert_seqc_without_torchscript\" u 2023-08-31T22:03:34.6725476Z │ nregistered" 2023-08-31T22:03:34.6725715Z │ } 2023-08-31T22:03:34.6725924Z └ 2023-08-31T22:03:34.6726639Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:34.6727170Z 1ms 233µs (cache) (cache) 333ms 1ms 33µs 336ms 2023-08-31T22:03:34.6727367Z 2023-08-31T22:03:34.6771450Z ✓ Successful DELETE request 2023-08-31T22:03:34.6805438Z 2023-08-31T22:03:34.6805741Z → Model Zoo - Model Metrics 2023-08-31T22:03:34.6894259Z GET http://localhost:8082/metrics 2023-08-31T22:03:34.6894819Z 200 OK ★ 4ms time ★ 233B↑ 18.54kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:34.6901169Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 18.25kB 2023-08-31T22:03:34.6921630Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:03:34.6921988Z │ c with unit: Count 2023-08-31T22:03:34.6922285Z │ # TYPE Requests2XX counter 2023-08-31T22:03:34.6922636Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 95. 2023-08-31T22:03:34.6922913Z │ 0 2023-08-31T22:03:34.6923504Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:03:34.6923842Z │ c with unit: Count 2023-08-31T22:03:34.6924117Z │ # TYPE Requests5XX counter 2023-08-31T22:03:34.6924469Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:03:34.6924854Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:03:34.6925225Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:03:34.6925608Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:03:34.6925988Z │ et_101",model_version="default",hostname="fv-az628-190 2023-08-31T22:03:34.6926470Z │ ",} 744788.113 2023-08-31T22:03:34.6926800Z │ ts_inference_latency_microseconds{model_name="mnist_sc 2023-08-31T22:03:34.6927176Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:03:34.6927514Z │ ",} 58411.041 2023-08-31T22:03:34.6927840Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:03:34.6928231Z │ 161",model_version="default",hostname="fv-az628-190",} 2023-08-31T22:03:34.6928513Z │ 197192.539 2023-08-31T22:03:34.6928818Z │ ts_inference_latency_microseconds{model_name="my_text_ 2023-08-31T22:03:34.6929189Z │ classifier",model_version="default",hostname="fv-az628 2023-08-31T22:03:34.6929486Z │ -190",} 23938.584 2023-08-31T22:03:34.6929796Z │ ts_inference_latency_microseconds{model_name="fcn_resn 2023-08-31T22:03:34.6930165Z │ et_101_scripted",model_version="default",hostname="fv- 2023-08-31T22:03:34.6930486Z │ az628-190",} 1069558.185 2023-08-31T22:03:34.6930801Z │ ts_inference_latency_microseconds{model_name="fastrcnn 2023-08-31T22:03:34.6931323Z │ ",model_version="default",hostname="fv-az628-190",} 23 2023-08-31T22:03:34.6931598Z │ 41906.593 2023-08-31T22:03:34.6931901Z │ ts_inference_latency_microseconds{model_name="alexnet" 2023-08-31T22:03:34.6932270Z │ ,model_version="default",hostname="fv-az628-190",} 402 2023-08-31T22:03:34.6932540Z │ 94.667 2023-08-31T22:03:34.6932863Z │ ts_inference_latency_microseconds{model_name="alexnet_ 2023-08-31T22:03:34.6933217Z │ scripted",model_version="default",hostname="fv-az628-1 2023-08-31T22:03:34.6933503Z │ 90",} 90762.505 2023-08-31T22:03:34.6933819Z │ ts_inference_latency_microseconds{model_name="squeezen 2023-08-31T22:03:34.6934171Z │ et1_1_scripted",model_version="default",hostname="fv-a 2023-08-31T22:03:34.6934469Z │ z628-190",} 107621.885 2023-08-31T22:03:34.6934783Z │ ts_inference_latency_microseconds{model_name="deeplabv 2023-08-31T22:03:34.6935132Z │ 3_resnet_101_scripted",model_version="default",hostnam 2023-08-31T22:03:34.6935459Z │ e="fv-az628-190",} 1034254.758 2023-08-31T22:03:34.6935794Z │ ts_inference_latency_microseconds{model_name="bert_tok 2023-08-31T22:03:34.6936150Z │ en_classification_no_torchscript",model_version="defau 2023-08-31T22:03:34.6936496Z │ lt",hostname="fv-az628-190",} 185621.163 2023-08-31T22:03:34.6936844Z │ ts_inference_latency_microseconds{model_name="vgg16_sc 2023-08-31T22:03:34.6937218Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:03:34.6937488Z │ ",} 298182.614 2023-08-31T22:03:34.6937797Z │ ts_inference_latency_microseconds{model_name="resnet-1 2023-08-31T22:03:34.6938161Z │ 8",model_version="default",hostname="fv-az628-190",} 5 2023-08-31T22:03:34.6938424Z │ 5157.442 2023-08-31T22:03:34.6938635Z │ t 2023-08-31T22:03:34.6938889Z │ (showing 2.05kB/18.25kB) 2023-08-31T22:03:34.6939102Z └ 2023-08-31T22:03:34.6939503Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:34.6940015Z 1ms 229µs (cache) (cache) 1ms 1ms 29µs 4ms 2023-08-31T22:03:34.6940220Z 2023-08-31T22:03:34.7001897Z ✓ Successful GET request 2023-08-31T22:03:35.3612961Z 2023-08-31T22:03:35.3614150Z ┌─────────────────────────┬─────────────────────┬────────────────────┐ 2023-08-31T22:03:35.3614796Z │ │ executed │ failed │ 2023-08-31T22:03:35.3615734Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:03:35.3616625Z │ iterations │ 24 │ 0 │ 2023-08-31T22:03:35.3617174Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:03:35.3617691Z │ requests │ 96 │ 0 │ 2023-08-31T22:03:35.3618216Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:03:35.3618728Z │ test-scripts │ 96 │ 0 │ 2023-08-31T22:03:35.3668615Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:03:35.3669008Z │ prerequest-scripts │ 0 │ 0 │ 2023-08-31T22:03:35.3669426Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:03:35.3669794Z │ assertions │ 113 │ 0 │ 2023-08-31T22:03:35.3670221Z ├─────────────────────────┴─────────────────────┴────────────────────┤ 2023-08-31T22:03:35.3670605Z │ total run duration: 2m 31.5s │ 2023-08-31T22:03:35.3670997Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:03:35.3671374Z │ total data received: 10.17MB (approx) │ 2023-08-31T22:03:35.3671782Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:03:35.3672181Z │ average response time: 1546ms [min: 3ms, max: 12.7s, s.d.: 2.8s] │ 2023-08-31T22:03:35.3672624Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:03:35.3673024Z │ average DNS lookup time: 17ms [min: 184µs, max: 33ms, s.d.: 13ms] │ 2023-08-31T22:03:35.3673435Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:03:35.3673808Z │ average first byte time: 1542ms [min: 1ms, max: 12.7s, s.d.: 2.8s] │ 2023-08-31T22:03:35.3674246Z └────────────────────────────────────────────────────────────────────┘ 2023-08-31T22:03:37.3722542Z newman 2023-08-31T22:03:37.3723107Z 2023-08-31T22:03:37.3725703Z inference 2023-08-31T22:03:37.3750787Z 2023-08-31T22:03:37.3751418Z → Model Zoo - Register Model 2023-08-31T22:03:43.5047860Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/densenet161_scripted.mar&model_name=densenet161_scripted&initial_workers=1&synchronous=true 2023-08-31T22:03:43.5048970Z 200 OK ★ 6s time ★ 389B↑ 362B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:43.5052073Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 96B 2023-08-31T22:03:43.5053531Z │ { 2023-08-31T22:03:43.5053946Z │ "status": "Model \"densenet161_scripted\" Version: 1 2023-08-31T22:03:43.5054386Z │ .0 registered with 1 initial workers" 2023-08-31T22:03:43.5054713Z │ } 2023-08-31T22:03:43.5131599Z └ 2023-08-31T22:03:43.5132110Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:43.5132995Z 28ms 5ms 9ms 312µs 6s 7ms 408µs 6.1s 2023-08-31T22:03:43.5133267Z 2023-08-31T22:03:43.5333226Z ✓ Successful POST request 2023-08-31T22:03:43.5415858Z 2023-08-31T22:03:43.5416180Z → Model Zoo - Inference Model 2023-08-31T22:03:44.5147938Z POST http://localhost:8080/predictions/densenet161_scripted 2023-08-31T22:03:44.5160535Z 200 OK ★ 959ms time ★ 111.25kB↑ 418B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:03:44.5164474Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:03:44.5167427Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:03:44.5169274Z └ 2023-08-31T22:03:44.5171287Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 183B 2023-08-31T22:03:44.5172962Z │ { 2023-08-31T22:03:44.5173233Z │ "tabby": 0.46661901473999023, 2023-08-31T22:03:44.5173527Z │ "tiger_cat": 0.46449053287506104, 2023-08-31T22:03:44.5173833Z │ "Egyptian_cat": 0.06614039838314056, 2023-08-31T22:03:44.5174129Z │ "lynx": 0.0012924427865073085, 2023-08-31T22:03:44.5174456Z │ "plastic_bag": 0.00022909774270374328 2023-08-31T22:03:44.5174701Z │ } 2023-08-31T22:03:44.5193541Z └ 2023-08-31T22:03:44.5194129Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:44.5194637Z 6ms 1ms 587µs 171µs 954ms 2ms 68µs 965ms 2023-08-31T22:03:44.5194824Z 2023-08-31T22:03:44.5269047Z ✓ Successful POST request 2023-08-31T22:03:44.5283496Z ✓ Test expected JSON response 2023-08-31T22:03:44.5332920Z 2023-08-31T22:03:44.5333586Z → Model Zoo - Unregister model 2023-08-31T22:03:44.5949924Z DELETE http://localhost:8081/models/densenet161_scripted 2023-08-31T22:03:44.5952064Z 200 OK ★ 55ms time ★ 256B↑ 328B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:44.5952806Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 62B 2023-08-31T22:03:44.5953321Z │ { 2023-08-31T22:03:44.5955167Z │ "status": "Model \"densenet161_scripted\" unregister 2023-08-31T22:03:44.5955608Z │ ed" 2023-08-31T22:03:44.5972253Z │ } 2023-08-31T22:03:44.6020410Z └ 2023-08-31T22:03:44.6020891Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:44.6021405Z 1ms 413µs (cache) (cache) 52ms 1ms 76µs 56ms 2023-08-31T22:03:44.6021607Z 2023-08-31T22:03:44.6028742Z ✓ Successful DELETE request 2023-08-31T22:03:44.6078707Z 2023-08-31T22:03:44.6078914Z → Model Zoo - Model Metrics 2023-08-31T22:03:44.6296988Z GET http://localhost:8082/metrics 2023-08-31T22:03:44.6297583Z 200 OK ★ 16ms time ★ 233B↑ 3.86kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:44.6298039Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 3.57kB 2023-08-31T22:03:44.6298453Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:03:44.6298792Z │ c with unit: Count 2023-08-31T22:03:44.6299085Z │ # TYPE Requests2XX counter 2023-08-31T22:03:44.6299437Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 3.0 2023-08-31T22:03:44.6300117Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:03:44.6300441Z │ c with unit: Count 2023-08-31T22:03:44.6300711Z │ # TYPE Requests5XX counter 2023-08-31T22:03:44.6301070Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:03:44.6301460Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:03:44.6301825Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:03:44.6302203Z │ ts_inference_latency_microseconds{model_name="densenet 2023-08-31T22:03:44.6302582Z │ 161_scripted",model_version="default",hostname="fv-az6 2023-08-31T22:03:44.6302898Z │ 28-190",} 936484.719 2023-08-31T22:03:44.6303238Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:03:44.6303573Z │ ic with unit: Milliseconds 2023-08-31T22:03:44.6303869Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:03:44.6304220Z │ WorkerLoadTime{WorkerName="W-9000-densenet161_scripted 2023-08-31T22:03:44.6304611Z │ _1.0",Level="Host",Hostname="fv-az628-190",} 2315.0 2023-08-31T22:03:44.6304979Z │ # HELP ts_inference_requests_total Torchserve promethe 2023-08-31T22:03:44.6305317Z │ us counter metric with unit: Count 2023-08-31T22:03:44.6305657Z │ # TYPE ts_inference_requests_total counter 2023-08-31T22:03:44.6306021Z │ ts_inference_requests_total{model_name="densenet161_sc 2023-08-31T22:03:44.6306398Z │ ripted",model_version="default",hostname="fv-az628-190 2023-08-31T22:03:44.6306682Z │ ",} 1.0 2023-08-31T22:03:44.6307006Z │ # HELP Requests4XX Torchserve prometheus counter metri 2023-08-31T22:03:44.6311680Z │ c with unit: Count 2023-08-31T22:03:44.6311960Z │ # TYPE Requests4XX counter 2023-08-31T22:03:44.6312319Z │ # HELP GPUMemoryUsed Torchserve prometheus gauge metri 2023-08-31T22:03:44.6312644Z │ c with unit: Megabytes 2023-08-31T22:03:44.6312914Z │ # TYPE GPUMemoryUsed gauge 2023-08-31T22:03:44.6313263Z │ # HELP DiskUsage Torchserve prometheus gauge metric wi 2023-08-31T22:03:44.6313571Z │ th unit: Gigabytes 2023-08-31T22:03:44.6313849Z │ # TYPE DiskUsage gauge 2023-08-31T22:03:44.6314185Z │ DiskUsage{Level="Host",Hostname="fv-az628-190",} 70.33 2023-08-31T22:03:44.6314470Z │ 566665649414 2023-08-31T22:03:44.6314785Z │ # HELP ts_queue_latency_microseconds Torchserve promet 2023-08-31T22:03:44.6315147Z │ heus counter metric with unit: Microseconds 2023-08-31T22:03:44.6315503Z │ # TYPE ts_queue_latency_microseconds counter 2023-08-31T22:03:44.6315862Z │ ts_queue_latency_microseconds{model_name="densenet161_ 2023-08-31T22:03:44.6316250Z │ scripted",model_version="default",hostname="fv-az628-1 2023-08-31T22:03:44.6316553Z │ 90",} 138.9 2023-08-31T22:03:44.6316882Z │ # HELP MemoryAvailable Torchserve prometheus gauge met 2023-08-31T22:03:44.6317204Z │ ric with unit: Megabytes 2023-08-31T22:03:44.6317498Z │ # TYPE MemoryAvailable gauge 2023-08-31T22:03:44.6317850Z │ MemoryAvailable{Level="Host",Hostname="fv-az628-190",} 2023-08-31T22:03:44.6318121Z │ 5435.01171875 2023-08-31T22:03:44.6318464Z │ # HELP PredictionTime Torchserve prometheus gauge metr 2023-08-31T22:03:44.6318774Z │ ic with unit: ms 2023-08-31T22:03:44.6319046Z │ # TYPE PredictionTime gauge 2023-08-31T22:03:44.6319403Z │ PredictionTime{ModelName="densenet161_scripted",Level= 2023-08-31T22:03:44.6319757Z │ "Model",Hostname="fv-az628-190",} 933.53 2023-08-31T22:03:44.6320107Z │ # HELP HandlerTime Torchserve prometheus gauge me 2023-08-31T22:03:44.6320430Z │ (showing 2.05kB/3.57kB) 2023-08-31T22:03:44.6320661Z └ 2023-08-31T22:03:44.6321058Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:44.6321573Z 1ms 668µs 185µs 236µs 13ms 1ms 57µs 17ms 2023-08-31T22:03:44.6321766Z 2023-08-31T22:03:44.6384680Z ✓ Successful GET request 2023-08-31T22:03:44.8002647Z 2023-08-31T22:03:44.8003569Z ┌─────────────────────────┬────────────────────┬───────────────────┐ 2023-08-31T22:03:44.8004533Z │ │ executed │ failed │ 2023-08-31T22:03:44.8005139Z ├─────────────────────────┼────────────────────┼───────────────────┤ 2023-08-31T22:03:44.8005736Z │ iterations │ 1 │ 0 │ 2023-08-31T22:03:44.8006731Z ├─────────────────────────┼────────────────────┼───────────────────┤ 2023-08-31T22:03:44.8007297Z │ requests │ 4 │ 0 │ 2023-08-31T22:03:44.8007902Z ├─────────────────────────┼────────────────────┼───────────────────┤ 2023-08-31T22:03:44.8011531Z │ test-scripts │ 4 │ 0 │ 2023-08-31T22:03:44.8012408Z ├─────────────────────────┼────────────────────┼───────────────────┤ 2023-08-31T22:03:44.8012957Z │ prerequest-scripts │ 0 │ 0 │ 2023-08-31T22:03:44.8065101Z ├─────────────────────────┼────────────────────┼───────────────────┤ 2023-08-31T22:03:44.8065502Z │ assertions │ 5 │ 0 │ 2023-08-31T22:03:44.8065941Z ├─────────────────────────┴────────────────────┴───────────────────┤ 2023-08-31T22:03:44.8066324Z │ total run duration: 7.2s │ 2023-08-31T22:03:44.8066735Z ├──────────────────────────────────────────────────────────────────┤ 2023-08-31T22:03:44.8067384Z │ total data received: 3.91kB (approx) │ 2023-08-31T22:03:44.8067799Z ├──────────────────────────────────────────────────────────────────┤ 2023-08-31T22:03:44.8068210Z │ average response time: 1777ms [min: 16ms, max: 6s, s.d.: 2.5s] │ 2023-08-31T22:03:44.8068663Z ├──────────────────────────────────────────────────────────────────┤ 2023-08-31T22:03:44.8069075Z │ average DNS lookup time: 3ms [min: 185µs, max: 9ms, s.d.: 4ms] │ 2023-08-31T22:03:44.8069483Z ├──────────────────────────────────────────────────────────────────┤ 2023-08-31T22:03:44.8069879Z │ average first byte time: 1768ms [min: 13ms, max: 6s, s.d.: 2.5s] │ 2023-08-31T22:03:44.8070327Z └──────────────────────────────────────────────────────────────────┘ 2023-08-31T22:03:47.3416272Z newman 2023-08-31T22:03:47.3416471Z 2023-08-31T22:03:47.3421026Z https_test_collection 2023-08-31T22:03:47.3442616Z 2023-08-31T22:03:47.3443213Z → HTTPS Inference API Description 2023-08-31T22:03:47.6084617Z OPTIONS https://localhost:8443 2023-08-31T22:03:47.6086193Z 200 OK ★ 220ms time ★ 230B↑ 23.67kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:47.6091736Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 23.41kB 2023-08-31T22:03:47.6094439Z │ { 2023-08-31T22:03:47.6095318Z │ "openapi": "3.0.1", 2023-08-31T22:03:47.6095685Z │ "info": { 2023-08-31T22:03:47.6096001Z │ "title": "TorchServe APIs", 2023-08-31T22:03:47.6096368Z │ "description": "TorchServe is a flexible and easy 2023-08-31T22:03:47.6096747Z │ to use tool for serving deep learning models", 2023-08-31T22:03:47.6097063Z │ "version": "0.8.2" 2023-08-31T22:03:47.6097290Z │ }, 2023-08-31T22:03:47.6097525Z │ "paths": { 2023-08-31T22:03:47.6098046Z │ "/": { 2023-08-31T22:03:47.6098296Z │ "options": { 2023-08-31T22:03:47.6098633Z │ "description": "Get openapi description.", 2023-08-31T22:03:47.6098995Z │ "operationId": "apiDescription", 2023-08-31T22:03:47.6099297Z │ "parameters": [], 2023-08-31T22:03:47.6099564Z │ "responses": { 2023-08-31T22:03:47.6099820Z │ "200": { 2023-08-31T22:03:47.6100138Z │ "description": "A openapi 3.0.1 descriptor 2023-08-31T22:03:47.6100450Z │ ", 2023-08-31T22:03:47.6100690Z │ "content": { 2023-08-31T22:03:47.6101144Z │ "application/json": { 2023-08-31T22:03:47.6101426Z │ "schema": { 2023-08-31T22:03:47.6101707Z │ "type": "object", 2023-08-31T22:03:47.6101992Z │ "required": [ 2023-08-31T22:03:47.6102261Z │ "openapi", 2023-08-31T22:03:47.6102526Z │ "info", 2023-08-31T22:03:47.6102787Z │ "paths" 2023-08-31T22:03:47.6103040Z │ ], 2023-08-31T22:03:47.6103317Z │ "properties": { 2023-08-31T22:03:47.6103603Z │ "openapi": { 2023-08-31T22:03:47.6103885Z │ "type": "string" 2023-08-31T22:03:47.6104149Z │ }, 2023-08-31T22:03:47.6104405Z │ "info": { 2023-08-31T22:03:47.6104675Z │ "type": "object" 2023-08-31T22:03:47.6104935Z │ }, 2023-08-31T22:03:47.6105194Z │ "paths": { 2023-08-31T22:03:47.6105493Z │ "type": "object" 2023-08-31T22:03:47.6105736Z │ } 2023-08-31T22:03:47.6105977Z │ } 2023-08-31T22:03:47.6106212Z │ } 2023-08-31T22:03:47.6106438Z │ } 2023-08-31T22:03:47.6106667Z │ } 2023-08-31T22:03:47.6106894Z │ }, 2023-08-31T22:03:47.6107121Z │ "500": { 2023-08-31T22:03:47.6107451Z │ "description": "Internal Server Error", 2023-08-31T22:03:47.6107752Z │ "content": { 2023-08-31T22:03:47.6108026Z │ "application/json": { 2023-08-31T22:03:47.6108306Z │ "schema": { 2023-08-31T22:03:47.6108587Z │ "type": "object", 2023-08-31T22:03:47.6108854Z │ "required": [ 2023-08-31T22:03:47.6109113Z │ "code", 2023-08-31T22:03:47.6109368Z │ "type", 2023-08-31T22:03:47.6109621Z │ "message" 2023-08-31T22:03:47.6109890Z │ ], 2023-08-31T22:03:47.6110162Z │ "properties": { 2023-08-31T22:03:47.6110424Z │ "code": { 2023-08-31T22:03:47.6110714Z │ "type": "integer", 2023-08-31T22:03:47.6111047Z │ "description": "Error code." 2023-08-31T22:03:47.6111329Z │ }, 2023-08-31T22:03:47.6111578Z │ "type": { 2023-08-31T22:03:47.6111946Z │ "type": "string", 2023-08-31T22:03:47.6112277Z │ "description": "Error type." 2023-08-31T22:03:47.6112547Z │ }, 2023-08-31T22:03:47.6112810Z │ "message": { 2023-08-31T22:03:47.6113103Z │ "type": "string", 2023-08-31T22:03:47.6113419Z │ "description": "Error message." 2023-08-31T22:03:47.6113706Z │ } 2023-08-31T22:03:47.6113948Z │ } 2023-08-31T22:03:47.6114191Z │ } 2023-08-31T22:03:47.6114423Z │ } 2023-08-31T22:03:47.6114654Z │ } 2023-08-31T22:03:47.6114868Z │ } 2023-08-31T22:03:47.6115093Z │ } 2023-08-31T22:03:47.6115314Z │ } 2023-08-31T22:03:47.6115518Z │ }, 2023-08-31T22:03:47.6115747Z │ "/ping": { 2023-08-31T22:03:47.6115973Z │ 2023-08-31T22:03:47.6116220Z │ (showing 2.05kB/23.41kB) 2023-08-31T22:03:47.6179144Z └ 2023-08-31T22:03:47.6179614Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:03:47.6180159Z 24ms 8ms 11ms 1ms 135ms 53ms 9ms 564µs 244ms 2023-08-31T22:03:47.6180357Z 2023-08-31T22:03:47.6544124Z ✓ Status code is 200 2023-08-31T22:03:47.6624557Z 2023-08-31T22:03:47.6625020Z → HTTPS Management API Description 2023-08-31T22:03:47.7267359Z OPTIONS https://localhost:8444 2023-08-31T22:03:47.7270206Z 200 OK ★ 59ms time ★ 230B↑ 60.36kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:47.7272785Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 60.09kB 2023-08-31T22:03:47.7275977Z │ { 2023-08-31T22:03:47.7276336Z │ "openapi": "3.0.1", 2023-08-31T22:03:47.7276676Z │ "info": { 2023-08-31T22:03:47.7277039Z │ "title": "TorchServe APIs", 2023-08-31T22:03:47.7277479Z │ "description": "TorchServe is a flexible and easy 2023-08-31T22:03:47.7277983Z │ to use tool for serving deep learning models", 2023-08-31T22:03:47.7278379Z │ "version": "0.8.2" 2023-08-31T22:03:47.7278693Z │ }, 2023-08-31T22:03:47.7278994Z │ "paths": { 2023-08-31T22:03:47.7279300Z │ "/": { 2023-08-31T22:03:47.7279621Z │ "options": { 2023-08-31T22:03:47.7280017Z │ "description": "Get openapi description.", 2023-08-31T22:03:47.7280454Z │ "operationId": "apiDescription", 2023-08-31T22:03:47.7280834Z │ "parameters": [], 2023-08-31T22:03:47.7281175Z │ "responses": { 2023-08-31T22:03:47.7281520Z │ "200": { 2023-08-31T22:03:47.7281915Z │ "description": "A openapi 3.0.1 descriptor 2023-08-31T22:03:47.7282258Z │ ", 2023-08-31T22:03:47.7282575Z │ "content": { 2023-08-31T22:03:47.7282931Z │ "application/json": { 2023-08-31T22:03:47.7283299Z │ "schema": { 2023-08-31T22:03:47.7283669Z │ "type": "object", 2023-08-31T22:03:47.7284032Z │ "required": [ 2023-08-31T22:03:47.7284392Z │ "openapi", 2023-08-31T22:03:47.7284730Z │ "info", 2023-08-31T22:03:47.7285064Z │ "paths" 2023-08-31T22:03:47.7285382Z │ ], 2023-08-31T22:03:47.7285736Z │ "properties": { 2023-08-31T22:03:47.7286103Z │ "openapi": { 2023-08-31T22:03:47.7286617Z │ "type": "string" 2023-08-31T22:03:47.7286969Z │ }, 2023-08-31T22:03:47.7287325Z │ "info": { 2023-08-31T22:03:47.7287679Z │ "type": "object" 2023-08-31T22:03:47.7288003Z │ }, 2023-08-31T22:03:47.7288338Z │ "paths": { 2023-08-31T22:03:47.7288706Z │ "type": "object" 2023-08-31T22:03:47.7289024Z │ } 2023-08-31T22:03:47.7289343Z │ } 2023-08-31T22:03:47.7289889Z │ } 2023-08-31T22:03:47.7290215Z │ } 2023-08-31T22:03:47.7290512Z │ } 2023-08-31T22:03:47.7290810Z │ }, 2023-08-31T22:03:47.7291129Z │ "500": { 2023-08-31T22:03:47.7291518Z │ "description": "Internal Server Error", 2023-08-31T22:03:47.7291904Z │ "content": { 2023-08-31T22:03:47.7292271Z │ "application/json": { 2023-08-31T22:03:47.7292632Z │ "schema": { 2023-08-31T22:03:47.7292976Z │ "type": "object", 2023-08-31T22:03:47.7293349Z │ "required": [ 2023-08-31T22:03:47.7293691Z │ "code", 2023-08-31T22:03:47.7294022Z │ "type", 2023-08-31T22:03:47.7294354Z │ "message" 2023-08-31T22:03:47.7294677Z │ ], 2023-08-31T22:03:47.7295026Z │ "properties": { 2023-08-31T22:03:47.7295369Z │ "code": { 2023-08-31T22:03:47.7295753Z │ "type": "integer", 2023-08-31T22:03:47.7296163Z │ "description": "Error code." 2023-08-31T22:03:47.7296519Z │ }, 2023-08-31T22:03:47.7296846Z │ "type": { 2023-08-31T22:03:47.7297203Z │ "type": "string", 2023-08-31T22:03:47.7298229Z │ "description": "Error type." 2023-08-31T22:03:47.7298505Z │ }, 2023-08-31T22:03:47.7298762Z │ "message": { 2023-08-31T22:03:47.7299050Z │ "type": "string", 2023-08-31T22:03:47.7299528Z │ "description": "Error message." 2023-08-31T22:03:47.7299804Z │ } 2023-08-31T22:03:47.7300041Z │ } 2023-08-31T22:03:47.7300278Z │ } 2023-08-31T22:03:47.7300504Z │ } 2023-08-31T22:03:47.7300738Z │ } 2023-08-31T22:03:47.7300964Z │ } 2023-08-31T22:03:47.7301179Z │ } 2023-08-31T22:03:47.7301409Z │ } 2023-08-31T22:03:47.7301623Z │ }, 2023-08-31T22:03:47.7301844Z │ "/models": { 2023-08-31T22:03:47.7302076Z │ 2023-08-31T22:03:47.7302328Z │ (showing 2.05kB/60.09kB) 2023-08-31T22:03:47.7323049Z └ 2023-08-31T22:03:47.7323584Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:03:47.7324134Z 1ms 1ms 202µs 291µs 25ms 28ms 2ms 87µs 59ms 2023-08-31T22:03:47.7324332Z 2023-08-31T22:03:47.7502669Z ✓ Status code is 200 2023-08-31T22:03:47.7558393Z 2023-08-31T22:03:47.7558835Z → HTTPS Metrics API Description 2023-08-31T22:03:47.8091089Z OPTIONS https://localhost:8445 2023-08-31T22:03:47.8092013Z 200 OK ★ 47ms time ★ 230B↑ 2.82kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:47.8092644Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 2.55kB 2023-08-31T22:03:47.8093292Z │ { 2023-08-31T22:03:47.8093726Z │ "openapi": "3.0.1", 2023-08-31T22:03:47.8094068Z │ "info": { 2023-08-31T22:03:47.8094417Z │ "title": "TorchServe APIs", 2023-08-31T22:03:47.8094861Z │ "description": "TorchServe is a flexible and easy 2023-08-31T22:03:47.8095313Z │ to use tool for serving deep learning models", 2023-08-31T22:03:47.8095698Z │ "version": "0.8.2" 2023-08-31T22:03:47.8095999Z │ }, 2023-08-31T22:03:47.8096304Z │ "paths": { 2023-08-31T22:03:47.8096622Z │ "/metrics": { 2023-08-31T22:03:47.8096933Z │ "get": { 2023-08-31T22:03:47.8097341Z │ "description": "Get TorchServe application met 2023-08-31T22:03:47.8097777Z │ rics in prometheus format.", 2023-08-31T22:03:47.8098156Z │ "operationId": "metrics", 2023-08-31T22:03:47.8098503Z │ "parameters": [ 2023-08-31T22:03:47.8098820Z │ { 2023-08-31T22:03:47.8099140Z │ "in": "query", 2023-08-31T22:03:47.8099488Z │ "name": "name[]", 2023-08-31T22:03:47.8100158Z │ "description": "Names of metrics to filter 2023-08-31T22:03:47.8100527Z │ ", 2023-08-31T22:03:47.8100854Z │ "required": false, 2023-08-31T22:03:47.8101185Z │ "schema": { 2023-08-31T22:03:47.8101536Z │ "type": "string" 2023-08-31T22:03:47.8101856Z │ } 2023-08-31T22:03:47.8102158Z │ } 2023-08-31T22:03:47.8102448Z │ ], 2023-08-31T22:03:47.8102769Z │ "responses": { 2023-08-31T22:03:47.8103097Z │ "200": { 2023-08-31T22:03:47.8103483Z │ "description": "TorchServe application met 2023-08-31T22:03:47.8103991Z │ rics", 2023-08-31T22:03:47.8104314Z │ "content": { 2023-08-31T22:03:47.8104714Z │ "text/plain; version=0.0.4; charset=utf- 2023-08-31T22:03:47.8105044Z │ 8": { 2023-08-31T22:03:47.8105359Z │ "schema": { 2023-08-31T22:03:47.8105713Z │ "type": "object", 2023-08-31T22:03:47.8106056Z │ "required": [ 2023-08-31T22:03:47.8106422Z │ "# HELP", 2023-08-31T22:03:47.8106757Z │ "# TYPE", 2023-08-31T22:03:47.8107093Z │ "metric" 2023-08-31T22:03:47.8107407Z │ ], 2023-08-31T22:03:47.8107751Z │ "properties": { 2023-08-31T22:03:47.8108103Z │ "# HELP": { 2023-08-31T22:03:47.8108457Z │ "type": "string", 2023-08-31T22:03:47.8108862Z │ "description": "Help text for To 2023-08-31T22:03:47.8109229Z │ rchServe metric." 2023-08-31T22:03:47.8109585Z │ }, 2023-08-31T22:03:47.8109913Z │ "# TYPE": { 2023-08-31T22:03:47.8110284Z │ "type": "string", 2023-08-31T22:03:47.8110685Z │ "description": "Type of TorchSer 2023-08-31T22:03:47.8111035Z │ ve metric." 2023-08-31T22:03:47.8111343Z │ }, 2023-08-31T22:03:47.8111726Z │ "metric": { 2023-08-31T22:03:47.8112105Z │ "type": "string", 2023-08-31T22:03:47.8112487Z │ "description": "TorchServe appli 2023-08-31T22:03:47.8112846Z │ cation metric." 2023-08-31T22:03:47.8113165Z │ } 2023-08-31T22:03:47.8113479Z │ } 2023-08-31T22:03:47.8113784Z │ } 2023-08-31T22:03:47.8114091Z │ } 2023-08-31T22:03:47.8114392Z │ } 2023-08-31T22:03:47.8114685Z │ }, 2023-08-31T22:03:47.8114999Z │ "500": { 2023-08-31T22:03:47.8115412Z │ "description": "Internal Server Error", 2023-08-31T22:03:47.8115789Z │ "content": { 2023-08-31T22:03:47.8116142Z │ "application/json": { 2023-08-31T22:03:47.8116498Z │ "schema": { 2023-08-31T22:03:47.8116850Z │ "type": "object", 2023-08-31T22:03:47.8117226Z │ "required": [ 2023-08-31T22:03:47.8118072Z │ "code", 2023-08-31T22:03:47.8118885Z │ "type", 2023-08-31T22:03:47.8119155Z │ "message" 2023-08-31T22:03:47.8119400Z │ ], 2023-08-31T22:03:47.8119676Z │ "properties": { 2023-08-31T22:03:47.8119959Z │ "code": { 2023-08-31T22:03:47.8120194Z │ 2023-08-31T22:03:47.8120454Z │ (showing 2.05kB/2.55kB) 2023-08-31T22:03:47.8120676Z └ 2023-08-31T22:03:47.8121105Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:03:47.8121663Z 1ms 1ms 184µs 583µs 34ms 7ms 1ms 63µs 48ms 2023-08-31T22:03:47.8121856Z 2023-08-31T22:03:47.8259612Z ✓ Status code is 200 2023-08-31T22:03:47.8312061Z 2023-08-31T22:03:47.8312367Z → HTTPS Register Model - SqueezeNet 2023-08-31T22:03:49.7010252Z POST https://localhost:8444/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&initial_workers=1&synchronous=true 2023-08-31T22:03:49.7014168Z 200 OK ★ 1863ms time ★ 334B↑ 355B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:49.7017600Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 89B 2023-08-31T22:03:49.7020709Z │ { 2023-08-31T22:03:49.7021273Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:03:49.7022610Z │ stered with 1 initial workers" 2023-08-31T22:03:49.7023020Z │ } 2023-08-31T22:03:49.7042817Z └ 2023-08-31T22:03:49.7043526Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:03:49.7044533Z 1ms 526µs (cache) (cache) (cache) 1859ms 2ms 79µs 1863ms 2023-08-31T22:03:49.7045004Z 2023-08-31T22:03:49.7111276Z ✓ Successful POST request 2023-08-31T22:03:49.7182314Z 2023-08-31T22:03:49.7182916Z → HTTPS Get SqueezeNet Model Description 2023-08-31T22:03:49.7324328Z GET https://localhost:8444/models/squeezenet1_1 2023-08-31T22:03:49.7325209Z 200 OK ★ 7ms time ★ 246B↑ 843B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:49.7325824Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 576B 2023-08-31T22:03:49.7326655Z │ [ 2023-08-31T22:03:49.7327250Z │ { 2023-08-31T22:03:49.7327764Z │ "modelName": "squeezenet1_1", 2023-08-31T22:03:49.7328200Z │ "modelVersion": "1.0", 2023-08-31T22:03:49.7328685Z │ "modelUrl": "squeezenet1_1.mar", 2023-08-31T22:03:49.7329114Z │ "runtime": "python", 2023-08-31T22:03:49.7329544Z │ "minWorkers": 1, 2023-08-31T22:03:49.7330020Z │ "maxWorkers": 1, 2023-08-31T22:03:49.7331422Z │ "batchSize": 1, 2023-08-31T22:03:49.7331906Z │ "maxBatchDelay": 100, 2023-08-31T22:03:49.7332332Z │ "loadedAtStartup": false, 2023-08-31T22:03:49.7332751Z │ "workers": [ 2023-08-31T22:03:49.7333139Z │ { 2023-08-31T22:03:49.7333646Z │ "id": "9000", 2023-08-31T22:03:49.7334136Z │ "startTime": "2023-08-31T22:03:47.889Z", 2023-08-31T22:03:49.7334632Z │ "status": "READY", 2023-08-31T22:03:49.7335124Z │ "memoryUsage": 0, 2023-08-31T22:03:49.7335609Z │ "pid": 12438, 2023-08-31T22:03:49.7336043Z │ "gpu": false, 2023-08-31T22:03:49.7336534Z │ "gpuUsage": "N/A" 2023-08-31T22:03:49.7336986Z │ } 2023-08-31T22:03:49.7337399Z │ ], 2023-08-31T22:03:49.7337777Z │ "jobQueueStatus": { 2023-08-31T22:03:49.7344575Z │ "remainingCapacity": 100, 2023-08-31T22:03:49.7345524Z │ "pendingRequests": 0 2023-08-31T22:03:49.7345851Z │ } 2023-08-31T22:03:49.7346115Z │ } 2023-08-31T22:03:49.7346315Z │ ] 2023-08-31T22:03:49.7346511Z └ 2023-08-31T22:03:49.7346955Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:03:49.7347492Z 1ms 432µs (cache) (cache) (cache) 5ms 1ms 55µs 8ms 2023-08-31T22:03:49.7347698Z 2023-08-31T22:03:49.7391777Z ✓ Successful GET request 2023-08-31T22:03:49.7440066Z 2023-08-31T22:03:49.7440466Z → HTTPS Scale up Workers - Synchronous 2023-08-31T22:03:49.7550030Z PUT https://localhost:8444/models/squeezenet1_1?min_worker=1&max_worker=1&synchronous=true 2023-08-31T22:03:49.7551001Z 200 OK ★ 5ms time ★ 308B↑ 329B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:49.7551635Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 63B 2023-08-31T22:03:49.7552391Z │ { 2023-08-31T22:03:49.7552822Z │ "status": "Workers scaled to 1 for model: squeezenet 2023-08-31T22:03:49.7553112Z │ 1_1" 2023-08-31T22:03:49.7553363Z │ } 2023-08-31T22:03:49.7581492Z └ 2023-08-31T22:03:49.7582216Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:03:49.7582943Z 1ms 292µs (cache) (cache) (cache) 3ms 1ms 47µs 6ms 2023-08-31T22:03:49.7583323Z 2023-08-31T22:03:49.7638939Z ✓ Successful PUT request 2023-08-31T22:03:49.7702984Z 2023-08-31T22:03:49.7703262Z → HTTPS Scale up Workers - Asynchronous 2023-08-31T22:03:49.7813172Z PUT https://localhost:8444/models/squeezenet1_1?min_worker=1&max_worker=1&synchronous=false 2023-08-31T22:03:49.7816656Z 202 Accepted ★ 5ms time ★ 309B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:49.7819851Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:03:49.7822827Z │ { 2023-08-31T22:03:49.7823370Z │ "status": "Processing worker updates..." 2023-08-31T22:03:49.7824000Z │ } 2023-08-31T22:03:49.7841684Z └ 2023-08-31T22:03:49.7842712Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:03:49.7843458Z 1ms 295µs (cache) (cache) (cache) 3ms 1ms 42µs 5ms 2023-08-31T22:03:49.7843685Z 2023-08-31T22:03:49.7897774Z ✓ Successful PUT request 2023-08-31T22:03:49.7962413Z 2023-08-31T22:03:49.7962919Z → HTTPS - Inference - SqueezeNet 2023-08-31T22:03:49.8717025Z POST https://localhost:8443/predictions/squeezenet1_1 2023-08-31T22:03:49.8718137Z 200 OK ★ 63ms time ★ 111.25kB↑ 409B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:03:49.8718599Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:03:49.8719040Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:03:49.8719403Z └ 2023-08-31T22:03:49.8727239Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 174B 2023-08-31T22:03:49.8730541Z │ { 2023-08-31T22:03:49.8730833Z │ "tabby": 0.27850738167762756, 2023-08-31T22:03:49.8731237Z │ "lynx": 0.25299158692359924, 2023-08-31T22:03:49.8731915Z │ "tiger_cat": 0.24496474862098694, 2023-08-31T22:03:49.8732462Z │ "Egyptian_cat": 0.21722468733787537, 2023-08-31T22:03:49.8732786Z │ "cougar": 0.002217544475570321 2023-08-31T22:03:49.8733012Z │ } 2023-08-31T22:03:49.8752611Z └ 2023-08-31T22:03:49.8753300Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:03:49.8754150Z 5ms 620µs (cache) (cache) (cache) 60ms 1ms 61µs 68ms 2023-08-31T22:03:49.8754603Z 2023-08-31T22:03:49.8829528Z ✓ Status code is 200 2023-08-31T22:03:49.8889005Z 2023-08-31T22:03:49.8889540Z → HTTPS UnRegister Model SqueezeNet 2023-08-31T22:03:49.9072964Z DELETE https://localhost:8444/models/squeezenet1_1 2023-08-31T22:03:49.9076659Z 200 OK ★ 12ms time ★ 249B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:49.9079883Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:03:49.9084082Z │ { 2023-08-31T22:03:49.9084699Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:03:49.9085331Z │ } 2023-08-31T22:03:49.9103776Z └ 2023-08-31T22:03:49.9104543Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:03:49.9105207Z 1ms 323µs (cache) (cache) (cache) 9ms 1ms 143µs 12ms 2023-08-31T22:03:49.9105641Z 2023-08-31T22:03:49.9159346Z ✓ Successful DELETE request 2023-08-31T22:03:50.0882979Z 2023-08-31T22:03:50.0883969Z ┌─────────────────────────┬─────────────────────┬─────────────────────┐ 2023-08-31T22:03:50.0884462Z │ │ executed │ failed │ 2023-08-31T22:03:50.0884877Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:03:50.0885285Z │ iterations │ 1 │ 0 │ 2023-08-31T22:03:50.0885685Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:03:50.0886090Z │ requests │ 9 │ 0 │ 2023-08-31T22:03:50.0886650Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:03:50.0887032Z │ test-scripts │ 9 │ 0 │ 2023-08-31T22:03:50.0887434Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:03:50.0888104Z │ prerequest-scripts │ 0 │ 0 │ 2023-08-31T22:03:50.0888526Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:03:50.0888888Z │ assertions │ 9 │ 0 │ 2023-08-31T22:03:50.0889271Z ├─────────────────────────┴─────────────────────┴─────────────────────┤ 2023-08-31T22:03:50.0889653Z │ total run duration: 2.5s │ 2023-08-31T22:03:50.0890056Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:03:50.0890602Z │ total data received: 87.05kB (approx) │ 2023-08-31T22:03:50.0891005Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:03:50.0891395Z │ average response time: 253ms [min: 5ms, max: 1863ms, s.d.: 572ms] │ 2023-08-31T22:03:50.0891814Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:03:50.0892230Z │ average DNS lookup time: 3ms [min: 184µs, max: 11ms, s.d.: 5ms] │ 2023-08-31T22:03:50.0892654Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:03:50.0893040Z │ average first byte time: 225ms [min: 3ms, max: 1859ms, s.d.: 578ms] │ 2023-08-31T22:03:50.0893546Z └─────────────────────────────────────────────────────────────────────┘ 2023-08-31T22:03:52.0747658Z newman 2023-08-31T22:03:52.0747980Z 2023-08-31T22:03:52.0750192Z management_api_collection 2023-08-31T22:03:52.0754250Z 2023-08-31T22:03:52.0754412Z Iteration 1/82 2023-08-31T22:03:52.0826872Z 2023-08-31T22:03:52.0827361Z → management request 2023-08-31T22:03:52.3411552Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-08-31T22:03:52.3414035Z 200 OK ★ 215ms time ★ 299B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:52.3417790Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:03:52.3419327Z │ { 2023-08-31T22:03:52.3419986Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:03:52.3420403Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:03:52.3420746Z │ o add workers for the model." 2023-08-31T22:03:52.3420986Z │ } 2023-08-31T22:03:52.3496828Z └ 2023-08-31T22:03:52.3497311Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:52.3497810Z 25ms 5ms 10ms 4ms 187ms 6ms 400µs 239ms 2023-08-31T22:03:52.3498000Z 2023-08-31T22:03:52.3709729Z ✓ Successful request 2023-08-31T22:03:52.3777256Z 2023-08-31T22:03:52.3777363Z Iteration 2/82 2023-08-31T22:03:52.3792119Z 2023-08-31T22:03:52.3792295Z → management request 2023-08-31T22:03:52.4384210Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist 2023-08-31T22:03:52.4386376Z 200 OK ★ 52ms time ★ 283B↑ 401B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:52.4388488Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 134B 2023-08-31T22:03:52.4392017Z │ { 2023-08-31T22:03:52.4392380Z │ "status": "Model \"mnist\" Version: 1.0 registered w 2023-08-31T22:03:52.4392780Z │ ith 0 initial workers. Use scale workers API to add wo 2023-08-31T22:03:52.4393100Z │ rkers for the model." 2023-08-31T22:03:52.4393327Z │ } 2023-08-31T22:03:52.4412099Z └ 2023-08-31T22:03:52.4412554Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:52.4413057Z 1ms 1ms (cache) (cache) 48ms 2ms 79µs 53ms 2023-08-31T22:03:52.4413286Z 2023-08-31T22:03:52.4473753Z ✓ Successful request 2023-08-31T22:03:52.4518411Z 2023-08-31T22:03:52.4518563Z Iteration 3/82 2023-08-31T22:03:52.4533979Z 2023-08-31T22:03:52.4534335Z → management request 2023-08-31T22:03:53.1259542Z POST http://localhost:8081/models?url=densenet161.mar&model_name=densenet161 2023-08-31T22:03:53.1260733Z 200 OK ★ 666ms time ★ 295B↑ 407B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:53.1261822Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 140B 2023-08-31T22:03:53.1264226Z │ { 2023-08-31T22:03:53.1264767Z │ "status": "Model \"densenet161\" Version: 1.0 regist 2023-08-31T22:03:53.1265425Z │ ered with 0 initial workers. Use scale workers API to 2023-08-31T22:03:53.1267998Z │ add workers for the model." 2023-08-31T22:03:53.1268402Z │ } 2023-08-31T22:03:53.1279062Z └ 2023-08-31T22:03:53.1279642Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:53.1280261Z 1ms 248µs (cache) (cache) 663ms 1ms 64µs 667ms 2023-08-31T22:03:53.1280604Z 2023-08-31T22:03:53.1333800Z ✓ Successful request 2023-08-31T22:03:53.1370928Z 2023-08-31T22:03:53.1371233Z Iteration 4/82 2023-08-31T22:03:53.1384347Z 2023-08-31T22:03:53.1384684Z → management request 2023-08-31T22:03:53.1512499Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/densenet161.mar&model_name=densenet161 2023-08-31T22:03:53.1513589Z 500 Internal Server Error ★ 6ms time ★ 336B↑ 394B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:53.1514501Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 113B 2023-08-31T22:03:53.1514840Z │ { 2023-08-31T22:03:53.1515075Z │ "code": 500, 2023-08-31T22:03:53.1515393Z │ "type": "InternalServerException", 2023-08-31T22:03:53.1515780Z │ "message": "Model file already exists densenet161.ma 2023-08-31T22:03:53.1516059Z │ r" 2023-08-31T22:03:53.1516275Z │ } 2023-08-31T22:03:53.1531758Z └ 2023-08-31T22:03:53.1532405Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:53.1533232Z 1ms 267µs (cache) (cache) 3ms 1ms 56µs 7ms 2023-08-31T22:03:53.1533455Z 2023-08-31T22:03:53.1583592Z ✓ Successful request 2023-08-31T22:03:53.1622693Z 2023-08-31T22:03:53.1622926Z Iteration 5/82 2023-08-31T22:03:53.1637097Z 2023-08-31T22:03:53.1645764Z → management request 2023-08-31T22:03:53.2021905Z DELETE http://localhost:8081/models/densenet161 2023-08-31T22:03:53.2022918Z 200 OK ★ 32ms time ★ 247B↑ 319B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:53.2023858Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 53B 2023-08-31T22:03:53.2024913Z │ { 2023-08-31T22:03:53.2025764Z │ "status": "Model \"densenet161\" unregistered" 2023-08-31T22:03:53.2026086Z │ } 2023-08-31T22:03:53.2043766Z └ 2023-08-31T22:03:53.2044262Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:53.2045075Z 1ms 950µs 204µs 131µs 28ms 1ms 69µs 32ms 2023-08-31T22:03:53.2045260Z 2023-08-31T22:03:53.2098752Z ✓ Successful request 2023-08-31T22:03:53.2136465Z 2023-08-31T22:03:53.2136699Z Iteration 6/82 2023-08-31T22:03:53.2151193Z 2023-08-31T22:03:53.2151605Z → management request 2023-08-31T22:03:53.2275654Z POST http://localhost:8081/models 2023-08-31T22:03:53.2278879Z 400 Bad Request ★ 4ms time ★ 252B↑ 364B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:53.2282303Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 94B 2023-08-31T22:03:53.2285326Z │ { 2023-08-31T22:03:53.2285581Z │ "code": 400, 2023-08-31T22:03:53.2285883Z │ "type": "BadRequestException", 2023-08-31T22:03:53.2288098Z │ "message": "Parameter url is required." 2023-08-31T22:03:53.2288604Z │ } 2023-08-31T22:03:53.2302221Z └ 2023-08-31T22:03:53.2302865Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:53.2303719Z 3ms 238µs (cache) (cache) 1ms 1ms 49µs 7ms 2023-08-31T22:03:53.2303953Z 2023-08-31T22:03:53.2346222Z ✓ Successful request 2023-08-31T22:03:53.2414253Z 2023-08-31T22:03:53.2414506Z Iteration 7/82 2023-08-31T22:03:53.2428958Z 2023-08-31T22:03:53.2429375Z → management request 2023-08-31T22:03:53.2609628Z DELETE http://localhost:8081/models/mnist 2023-08-31T22:03:53.2611620Z 200 OK ★ 12ms time ★ 241B↑ 313B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:53.2613875Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:03:53.2615567Z │ { 2023-08-31T22:03:53.2615880Z │ "status": "Model \"mnist\" unregistered" 2023-08-31T22:03:53.2616141Z │ } 2023-08-31T22:03:53.2631556Z └ 2023-08-31T22:03:53.2632263Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:53.2632940Z 1ms 538µs 273µs 136µs 9ms 1ms 50µs 13ms 2023-08-31T22:03:53.2633354Z 2023-08-31T22:03:53.2687352Z ✓ Successful request 2023-08-31T22:03:53.2728749Z 2023-08-31T22:03:53.2729176Z Iteration 8/82 2023-08-31T22:03:53.2742001Z 2023-08-31T22:03:53.2742348Z → management request 2023-08-31T22:03:53.3129577Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&handler=invalidHandler 2023-08-31T22:03:53.3130491Z 200 OK ★ 33ms time ★ 306B↑ 401B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:53.3132728Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 134B 2023-08-31T22:03:53.3133053Z │ { 2023-08-31T22:03:53.3133392Z │ "status": "Model \"mnist\" Version: 1.0 registered w 2023-08-31T22:03:53.3133787Z │ ith 0 initial workers. Use scale workers API to add wo 2023-08-31T22:03:53.3134108Z │ rkers for the model." 2023-08-31T22:03:53.3134341Z │ } 2023-08-31T22:03:53.3152993Z └ 2023-08-31T22:03:53.3153730Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:53.3154446Z 1ms 306µs (cache) (cache) 30ms 1ms 45µs 33ms 2023-08-31T22:03:53.3154783Z 2023-08-31T22:03:53.3203738Z ✓ Successful request 2023-08-31T22:03:53.3255752Z 2023-08-31T22:03:53.3255989Z Iteration 9/82 2023-08-31T22:03:53.3260918Z 2023-08-31T22:03:53.3261247Z → management request 2023-08-31T22:03:53.3386701Z DELETE http://localhost:8081/models/mnist 2023-08-31T22:03:53.3387887Z 200 OK ★ 7ms time ★ 241B↑ 313B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:53.3389580Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:03:53.3390012Z │ { 2023-08-31T22:03:53.3390522Z │ "status": "Model \"mnist\" unregistered" 2023-08-31T22:03:53.3390954Z │ } 2023-08-31T22:03:53.3403150Z └ 2023-08-31T22:03:53.3403749Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:53.3404378Z 1ms 332µs (cache) (cache) 3ms 2ms 125µs 7ms 2023-08-31T22:03:53.3404987Z 2023-08-31T22:03:53.3456738Z ✓ Successful request 2023-08-31T22:03:53.3492021Z 2023-08-31T22:03:53.3492353Z Iteration 10/82 2023-08-31T22:03:53.3505111Z 2023-08-31T22:03:53.3505615Z → management request 2023-08-31T22:03:53.3880840Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&handler=invalidHandler 2023-08-31T22:03:53.3881861Z 200 OK ★ 33ms time ★ 306B↑ 401B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:53.3882727Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 134B 2023-08-31T22:03:53.3884841Z │ { 2023-08-31T22:03:53.3885369Z │ "status": "Model \"mnist\" Version: 1.0 registered w 2023-08-31T22:03:53.3886080Z │ ith 0 initial workers. Use scale workers API to add wo 2023-08-31T22:03:53.3886580Z │ rkers for the model." 2023-08-31T22:03:53.3900621Z │ } 2023-08-31T22:03:53.3900821Z └ 2023-08-31T22:03:53.3901400Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:53.3902092Z 1ms 354µs (cache) (cache) 30ms 1ms 46µs 33ms 2023-08-31T22:03:53.3902453Z 2023-08-31T22:03:53.3955335Z ✓ Successful request 2023-08-31T22:03:53.3993111Z 2023-08-31T22:03:53.3993467Z Iteration 11/82 2023-08-31T22:03:53.4005354Z 2023-08-31T22:03:53.4005835Z → management request 2023-08-31T22:03:54.6440322Z PUT http://localhost:8081/models/mnist?min_worker=1&synchronous=true 2023-08-31T22:03:54.6448405Z 500 Internal Server Error ★ 1237ms time ★ 287B↑ 406B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:54.6451956Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 125B 2023-08-31T22:03:54.6455056Z │ { 2023-08-31T22:03:54.6455497Z │ "code": 500, 2023-08-31T22:03:54.6456064Z │ "type": "InternalServerException", 2023-08-31T22:03:54.6459164Z │ "message": "Failed to start workers for model mnist 2023-08-31T22:03:54.6459608Z │ version: null" 2023-08-31T22:03:54.6460052Z │ } 2023-08-31T22:03:54.6480961Z └ 2023-08-31T22:03:54.6481667Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:54.6482326Z 1ms 218µs (cache) (cache) 1235ms 1ms 129µs 1238ms 2023-08-31T22:03:54.6482675Z 2023-08-31T22:03:54.6596413Z ✓ Successful request 2023-08-31T22:03:54.6689506Z 2023-08-31T22:03:54.6690031Z Iteration 12/82 2023-08-31T22:03:54.6703815Z 2023-08-31T22:03:54.6704574Z → management request 2023-08-31T22:03:54.6891302Z DELETE http://localhost:8081/models/mnist 2023-08-31T22:03:54.6891902Z 200 OK ★ 12ms time ★ 241B↑ 313B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:54.6892325Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:03:54.6892606Z │ { 2023-08-31T22:03:54.6892897Z │ "status": "Model \"mnist\" unregistered" 2023-08-31T22:03:54.6893161Z │ } 2023-08-31T22:03:54.6893354Z └ 2023-08-31T22:03:54.6893756Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:54.6894280Z 1ms 664µs 191µs 414µs 8ms 1ms 54µs 12ms 2023-08-31T22:03:54.6894472Z 2023-08-31T22:03:54.6967475Z ✓ Successful request 2023-08-31T22:03:54.7001086Z 2023-08-31T22:03:54.7001689Z Iteration 13/82 2023-08-31T22:03:54.7020765Z 2023-08-31T22:03:54.7021284Z → management request 2023-08-31T22:03:54.7153281Z GET http://localhost:8081/models/squeezenet1_1/all 2023-08-31T22:03:54.7155591Z 200 OK ★ 6ms time ★ 250B↑ 628B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:54.7157460Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 361B 2023-08-31T22:03:54.7159109Z │ [ 2023-08-31T22:03:54.7159412Z │ { 2023-08-31T22:03:54.7159791Z │ "modelName": "squeezenet1_1", 2023-08-31T22:03:54.7160171Z │ "modelVersion": "1.0", 2023-08-31T22:03:54.7160561Z │ "modelUrl": "squeezenet1_1.mar", 2023-08-31T22:03:54.7160928Z │ "runtime": "python", 2023-08-31T22:03:54.7161275Z │ "minWorkers": 0, 2023-08-31T22:03:54.7161842Z │ "maxWorkers": 0, 2023-08-31T22:03:54.7162163Z │ "batchSize": 1, 2023-08-31T22:03:54.7162519Z │ "maxBatchDelay": 100, 2023-08-31T22:03:54.7162886Z │ "loadedAtStartup": false, 2023-08-31T22:03:54.7163238Z │ "workers": [], 2023-08-31T22:03:54.7163568Z │ "jobQueueStatus": { 2023-08-31T22:03:54.7163948Z │ "remainingCapacity": 100, 2023-08-31T22:03:54.7164321Z │ "pendingRequests": 0 2023-08-31T22:03:54.7164651Z │ } 2023-08-31T22:03:54.7164938Z │ } 2023-08-31T22:03:54.7165212Z │ ] 2023-08-31T22:03:54.7180141Z └ 2023-08-31T22:03:54.7180705Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:54.7181291Z 1ms 472µs (cache) (cache) 4ms 1ms 53µs 7ms 2023-08-31T22:03:54.7181565Z 2023-08-31T22:03:54.7229645Z ✓ Successful request 2023-08-31T22:03:54.7285518Z 2023-08-31T22:03:54.7285786Z Iteration 14/82 2023-08-31T22:03:54.7289983Z 2023-08-31T22:03:54.7290358Z → management request 2023-08-31T22:03:54.7379777Z GET http://localhost:8081/models/squeezenet1_1/1.0 2023-08-31T22:03:54.7381859Z 200 OK ★ 4ms time ★ 250B↑ 628B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:54.7383689Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 361B 2023-08-31T22:03:54.7385323Z │ [ 2023-08-31T22:03:54.7385636Z │ { 2023-08-31T22:03:54.7385995Z │ "modelName": "squeezenet1_1", 2023-08-31T22:03:54.7386412Z │ "modelVersion": "1.0", 2023-08-31T22:03:54.7386794Z │ "modelUrl": "squeezenet1_1.mar", 2023-08-31T22:03:54.7387167Z │ "runtime": "python", 2023-08-31T22:03:54.7387517Z │ "minWorkers": 0, 2023-08-31T22:03:54.7387847Z │ "maxWorkers": 0, 2023-08-31T22:03:54.7388176Z │ "batchSize": 1, 2023-08-31T22:03:54.7388532Z │ "maxBatchDelay": 100, 2023-08-31T22:03:54.7388906Z │ "loadedAtStartup": false, 2023-08-31T22:03:54.7389247Z │ "workers": [], 2023-08-31T22:03:54.7389588Z │ "jobQueueStatus": { 2023-08-31T22:03:54.7389984Z │ "remainingCapacity": 100, 2023-08-31T22:03:54.7390345Z │ "pendingRequests": 0 2023-08-31T22:03:54.7390667Z │ } 2023-08-31T22:03:54.7390957Z │ } 2023-08-31T22:03:54.7391234Z │ ] 2023-08-31T22:03:54.7405747Z └ 2023-08-31T22:03:54.7406537Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:54.7407403Z 1ms 348µs (cache) (cache) 1ms 1ms 35µs 4ms 2023-08-31T22:03:54.7407680Z 2023-08-31T22:03:54.7568761Z ✓ Successful request 2023-08-31T22:03:54.7628832Z 2023-08-31T22:03:54.7629068Z Iteration 15/82 2023-08-31T22:03:54.7641555Z 2023-08-31T22:03:54.7641881Z → management request 2023-08-31T22:03:54.7731189Z GET http://localhost:8081/models/squeezenet1_1 2023-08-31T22:03:54.7731904Z 200 OK ★ 4ms time ★ 246B↑ 628B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:54.7732410Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 361B 2023-08-31T22:03:54.7732813Z │ [ 2023-08-31T22:03:54.7733109Z │ { 2023-08-31T22:03:54.7733449Z │ "modelName": "squeezenet1_1", 2023-08-31T22:03:54.7733829Z │ "modelVersion": "1.0", 2023-08-31T22:03:54.7734217Z │ "modelUrl": "squeezenet1_1.mar", 2023-08-31T22:03:54.7734598Z │ "runtime": "python", 2023-08-31T22:03:54.7734938Z │ "minWorkers": 0, 2023-08-31T22:03:54.7735275Z │ "maxWorkers": 0, 2023-08-31T22:03:54.7735637Z │ "batchSize": 1, 2023-08-31T22:03:54.7735995Z │ "maxBatchDelay": 100, 2023-08-31T22:03:54.7736356Z │ "loadedAtStartup": false, 2023-08-31T22:03:54.7736706Z │ "workers": [], 2023-08-31T22:03:54.7737062Z │ "jobQueueStatus": { 2023-08-31T22:03:54.7737433Z │ "remainingCapacity": 100, 2023-08-31T22:03:54.7737805Z │ "pendingRequests": 0 2023-08-31T22:03:54.7738126Z │ } 2023-08-31T22:03:54.7738415Z │ } 2023-08-31T22:03:54.7738685Z │ ] 2023-08-31T22:03:54.7809788Z └ 2023-08-31T22:03:54.7810366Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:54.7811244Z 1ms 307µs (cache) (cache) 1ms 1ms 40µs 4ms 2023-08-31T22:03:54.7811526Z 2023-08-31T22:03:54.7883073Z ✓ Successful request 2023-08-31T22:03:54.7948556Z 2023-08-31T22:03:54.7948803Z Iteration 16/82 2023-08-31T22:03:54.7961098Z 2023-08-31T22:03:54.7961433Z → management request 2023-08-31T22:03:54.8073375Z DELETE http://localhost:8081/models/squeezenet1_1 2023-08-31T22:03:54.8074070Z 200 OK ★ 6ms time ★ 249B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:54.8074584Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:03:54.8074946Z │ { 2023-08-31T22:03:54.8075345Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:03:54.8075700Z │ } 2023-08-31T22:03:54.8085270Z └ 2023-08-31T22:03:54.8085818Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:54.8086611Z 1ms 285µs (cache) (cache) 4ms 1ms 33µs 6ms 2023-08-31T22:03:54.8086900Z 2023-08-31T22:03:54.8138530Z ✓ Successful request 2023-08-31T22:03:54.8175391Z 2023-08-31T22:03:54.8175642Z Iteration 17/82 2023-08-31T22:03:54.8188376Z 2023-08-31T22:03:54.8188757Z → management request 2023-08-31T22:03:54.8276488Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&runtime=python4 2023-08-31T22:03:54.8278531Z 400 Bad Request ★ 4ms time ★ 315B↑ 373B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:54.8280247Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 102B 2023-08-31T22:03:54.8281834Z │ { 2023-08-31T22:03:54.8282152Z │ "code": 400, 2023-08-31T22:03:54.8282532Z │ "type": "BadRequestException", 2023-08-31T22:03:54.8282983Z │ "message": "Invalid RuntimeType value: python4" 2023-08-31T22:03:54.8283341Z │ } 2023-08-31T22:03:54.8296388Z └ 2023-08-31T22:03:54.8296956Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:54.8297574Z 1ms 188µs (cache) (cache) 1ms 1ms 27µs 4ms 2023-08-31T22:03:54.8297847Z 2023-08-31T22:03:54.8343167Z ✓ Successful request 2023-08-31T22:03:54.8375557Z 2023-08-31T22:03:54.8375780Z Iteration 18/82 2023-08-31T22:03:54.8389977Z 2023-08-31T22:03:54.8390336Z → management request 2023-08-31T22:03:54.8489652Z GET http://localhost:8081/models?limit=&next_page_token= 2023-08-31T22:03:54.8491698Z 200 OK ★ 5ms time ★ 256B↑ 285B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:54.8493411Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 19B 2023-08-31T22:03:54.8494915Z │ { 2023-08-31T22:03:54.8495243Z │ "models": [] 2023-08-31T22:03:54.8495545Z │ } 2023-08-31T22:03:54.8508165Z └ 2023-08-31T22:03:54.8508729Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:54.8509304Z 1ms 592µs 162µs 360µs 2ms 1ms 25µs 5ms 2023-08-31T22:03:54.8509817Z 2023-08-31T22:03:54.8604346Z ✓ Successful request 2023-08-31T22:03:54.8635932Z 2023-08-31T22:03:54.8636180Z Iteration 19/82 2023-08-31T22:03:54.8639568Z 2023-08-31T22:03:54.8639918Z → management request 2023-08-31T22:03:54.9042171Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-08-31T22:03:54.9042994Z 200 OK ★ 35ms time ★ 299B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:54.9043497Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:03:54.9043870Z │ { 2023-08-31T22:03:54.9044282Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:03:54.9044754Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:03:54.9045161Z │ o add workers for the model." 2023-08-31T22:03:54.9045483Z │ } 2023-08-31T22:03:54.9081146Z └ 2023-08-31T22:03:54.9081636Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:54.9082241Z 1ms 176µs (cache) (cache) 31ms 2ms 30µs 35ms 2023-08-31T22:03:54.9082503Z 2023-08-31T22:03:54.9123832Z ✓ Successful request 2023-08-31T22:03:54.9153864Z 2023-08-31T22:03:54.9154045Z Iteration 20/82 2023-08-31T22:03:54.9167210Z 2023-08-31T22:03:54.9167453Z → management request 2023-08-31T22:03:54.9275406Z PUT http://localhost:8081/models/squeezenet1_1?min_worker=1 2023-08-31T22:03:54.9276116Z 202 Accepted ★ 4ms time ★ 278B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:54.9276634Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:03:54.9276995Z │ { 2023-08-31T22:03:54.9277374Z │ "status": "Processing worker updates..." 2023-08-31T22:03:54.9277723Z │ } 2023-08-31T22:03:54.9278001Z └ 2023-08-31T22:03:54.9278474Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:54.9279059Z 1ms 165µs (cache) (cache) 1ms 1ms 28µs 4ms 2023-08-31T22:03:54.9279352Z 2023-08-31T22:03:54.9324857Z ✓ Successful request 2023-08-31T22:03:54.9379560Z 2023-08-31T22:03:54.9379818Z Iteration 21/82 2023-08-31T22:03:54.9394557Z 2023-08-31T22:03:54.9394939Z → management request 2023-08-31T22:03:54.9487582Z PUT http://localhost:8081/models/squeezenet1_1?min_worker=1&synchronous=true 2023-08-31T22:03:54.9488317Z 200 OK ★ 3ms time ★ 295B↑ 329B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:54.9488820Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 63B 2023-08-31T22:03:54.9489176Z │ { 2023-08-31T22:03:54.9489588Z │ "status": "Workers scaled to 1 for model: squeezenet 2023-08-31T22:03:54.9489950Z │ 1_1" 2023-08-31T22:03:54.9490231Z │ } 2023-08-31T22:03:54.9492685Z └ 2023-08-31T22:03:54.9493211Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:54.9493788Z 1ms 164µs (cache) (cache) 1ms 1ms 26µs 3ms 2023-08-31T22:03:54.9494088Z 2023-08-31T22:03:54.9566003Z ✓ Successful request 2023-08-31T22:03:54.9595189Z 2023-08-31T22:03:54.9595421Z Iteration 22/82 2023-08-31T22:03:54.9607767Z 2023-08-31T22:03:54.9608143Z → management request 2023-08-31T22:03:54.9692369Z PUT http://localhost:8081/models/squeezenet1_1/1.0?min_worker=1&synchronous=true 2023-08-31T22:03:54.9693417Z 200 OK ★ 3ms time ★ 299B↑ 343B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:54.9693942Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 77B 2023-08-31T22:03:54.9694310Z │ { 2023-08-31T22:03:54.9694774Z │ "status": "Workers scaled to 1 for model: squeezenet 2023-08-31T22:03:54.9695175Z │ 1_1, version: 1.0" 2023-08-31T22:03:54.9695467Z │ } 2023-08-31T22:03:54.9704117Z └ 2023-08-31T22:03:54.9704680Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:54.9705263Z 1ms 165µs (cache) (cache) 1ms 1ms 26µs 4ms 2023-08-31T22:03:54.9705791Z 2023-08-31T22:03:54.9752880Z ✓ Successful request 2023-08-31T22:03:54.9805542Z 2023-08-31T22:03:54.9805801Z Iteration 23/82 2023-08-31T22:03:54.9818137Z 2023-08-31T22:03:54.9818514Z → management request 2023-08-31T22:03:54.9985189Z PUT http://localhost:8081/models/squeezenet1_1/0.0?min_worker=1&synchronous=true 2023-08-31T22:03:54.9985999Z 404 Not Found ★ 3ms time ★ 299B↑ 405B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:54.9986516Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 136B 2023-08-31T22:03:54.9986881Z │ { 2023-08-31T22:03:54.9987196Z │ "code": 404, 2023-08-31T22:03:54.9987597Z │ "type": "ModelVersionNotFoundException", 2023-08-31T22:03:54.9988070Z │ "message": "Model version: 0.0 does not exist for mo 2023-08-31T22:03:54.9988469Z │ del: squeezenet1_1" 2023-08-31T22:03:54.9988764Z │ } 2023-08-31T22:03:54.9996857Z └ 2023-08-31T22:03:54.9997437Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:54.9998057Z 1ms 163µs (cache) (cache) 1ms 1ms 33µs 3ms 2023-08-31T22:03:54.9998327Z 2023-08-31T22:03:55.0058319Z ✓ Successful request 2023-08-31T22:03:55.0154137Z 2023-08-31T22:03:55.0154398Z Iteration 24/82 2023-08-31T22:03:55.0166726Z 2023-08-31T22:03:55.0167076Z → management request 2023-08-31T22:03:55.0262703Z PUT http://localhost:8081/models/squeezenet1_1?min_worker=1&number_gpu=1 2023-08-31T22:03:55.0264560Z 202 Accepted ★ 4ms time ★ 291B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:55.0266267Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:03:55.0267770Z │ { 2023-08-31T22:03:55.0268099Z │ "status": "Processing worker updates..." 2023-08-31T22:03:55.0268357Z │ } 2023-08-31T22:03:55.0281122Z └ 2023-08-31T22:03:55.0281594Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:55.0282084Z 1ms 433µs 266µs 119µs 1ms 1ms 22µs 4ms 2023-08-31T22:03:55.0282314Z 2023-08-31T22:03:55.0329452Z ✓ Successful request 2023-08-31T22:03:55.0368391Z 2023-08-31T22:03:55.0368552Z Iteration 25/82 2023-08-31T22:03:55.0382435Z 2023-08-31T22:03:55.0382702Z → management request 2023-08-31T22:03:55.0474692Z PUT http://localhost:8081/models/squeezenet1_1/1.0/set-default 2023-08-31T22:03:55.0476609Z 200 OK ★ 4ms time ★ 281B↑ 359B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:55.0478317Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 93B 2023-08-31T22:03:55.0479905Z │ { 2023-08-31T22:03:55.0480249Z │ "status": "Default vesion succsesfully updated for m 2023-08-31T22:03:55.0480602Z │ odel \"squeezenet1_1\" to \"1.0\"" 2023-08-31T22:03:55.0480858Z │ } 2023-08-31T22:03:55.0493720Z └ 2023-08-31T22:03:55.0494204Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:55.0494711Z 1ms 189µs (cache) (cache) 1ms 1ms 24µs 4ms 2023-08-31T22:03:55.0494955Z 2023-08-31T22:03:55.0537503Z ✓ Successful request 2023-08-31T22:03:55.0580136Z 2023-08-31T22:03:55.0580271Z Iteration 26/82 2023-08-31T22:03:55.0594046Z 2023-08-31T22:03:55.0594314Z → management request 2023-08-31T22:03:55.0678445Z PUT http://localhost:8081/models/squeezenet1_1/0.0/set-default 2023-08-31T22:03:55.0680516Z 404 Not Found ★ 3ms time ★ 281B↑ 403B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:55.0682275Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 134B 2023-08-31T22:03:55.0683890Z │ { 2023-08-31T22:03:55.0684144Z │ "code": 404, 2023-08-31T22:03:55.0684469Z │ "type": "ModelVersionNotFoundException", 2023-08-31T22:03:55.0684881Z │ "message": "Model version 0.0 does not exist for mod 2023-08-31T22:03:55.0685196Z │ el squeezenet1_1" 2023-08-31T22:03:55.0685431Z │ } 2023-08-31T22:03:55.0698221Z └ 2023-08-31T22:03:55.0698691Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:55.0699479Z 1ms 178µs (cache) (cache) 1ms 1ms 24µs 4ms 2023-08-31T22:03:55.0699673Z 2023-08-31T22:03:55.0764598Z ✓ Successful request 2023-08-31T22:03:55.0795014Z 2023-08-31T22:03:55.0795167Z Iteration 27/82 2023-08-31T22:03:55.0808979Z 2023-08-31T22:03:55.0809240Z → management request 2023-08-31T22:03:55.0902199Z PUT http://localhost:8081/models/squeezenet0_1/1.0/set-default 2023-08-31T22:03:55.0903978Z 404 Not Found ★ 4ms time ★ 281B↑ 370B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:55.0905694Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 101B 2023-08-31T22:03:55.0907235Z │ { 2023-08-31T22:03:55.0907484Z │ "code": 404, 2023-08-31T22:03:55.0907783Z │ "type": "ModelNotFoundException", 2023-08-31T22:03:55.0908148Z │ "message": "Model not found: squeezenet0_1" 2023-08-31T22:03:55.0908418Z │ } 2023-08-31T22:03:55.0921037Z └ 2023-08-31T22:03:55.0921535Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:55.0922031Z 1ms 556µs 172µs 118µs 1ms 1ms 24µs 4ms 2023-08-31T22:03:55.0922229Z 2023-08-31T22:03:55.0998884Z ✓ Successful request 2023-08-31T22:03:55.1013214Z 2023-08-31T22:03:55.1013356Z Iteration 28/82 2023-08-31T22:03:55.1026678Z 2023-08-31T22:03:55.1026891Z → management request 2023-08-31T22:03:55.1199845Z DELETE http://localhost:8081/models/squeezenet1_1 2023-08-31T22:03:55.1203247Z 200 OK ★ 11ms time ★ 249B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:55.1206447Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:03:55.1209368Z │ { 2023-08-31T22:03:55.1209929Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:03:55.1211112Z │ } 2023-08-31T22:03:55.1232400Z └ 2023-08-31T22:03:55.1233060Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:55.1233822Z 1ms 700µs 172µs 419µs 7ms 1ms 28µs 11ms 2023-08-31T22:03:55.1234296Z 2023-08-31T22:03:55.1285454Z ✓ Successful request 2023-08-31T22:03:55.1331513Z 2023-08-31T22:03:55.1331903Z Iteration 29/82 2023-08-31T22:03:55.1347310Z 2023-08-31T22:03:55.1347781Z → management request 2023-08-31T22:03:55.1754093Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&handler=serve/ts/torch_handler/image_classifier.py:handle 2023-08-31T22:03:55.1755084Z 200 OK ★ 34ms time ★ 357B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:55.1755774Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:03:55.1757092Z │ { 2023-08-31T22:03:55.1757562Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:03:55.1758063Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:03:55.1758620Z │ o add workers for the model." 2023-08-31T22:03:55.1759351Z │ } 2023-08-31T22:03:55.1769319Z └ 2023-08-31T22:03:55.1769883Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:55.1770474Z 2ms 182µs (cache) (cache) 31ms 1ms 28µs 35ms 2023-08-31T22:03:55.1770834Z 2023-08-31T22:03:55.1830068Z ✓ Successful request 2023-08-31T22:03:55.1843737Z 2023-08-31T22:03:55.1843869Z Iteration 30/82 2023-08-31T22:03:55.1858072Z 2023-08-31T22:03:55.1858617Z → management request 2023-08-31T22:03:55.1953199Z DELETE http://localhost:8081/models/squeezenet1_1 2023-08-31T22:03:55.1954069Z 200 OK ★ 5ms time ★ 249B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:55.1954972Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:03:55.1955298Z │ { 2023-08-31T22:03:55.1955638Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:03:55.1955911Z │ } 2023-08-31T22:03:55.1968324Z └ 2023-08-31T22:03:55.1968956Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:55.1969914Z 1ms 167µs (cache) (cache) 3ms 1ms 22µs 5ms 2023-08-31T22:03:55.1970324Z 2023-08-31T22:03:55.2010730Z ✓ Successful request 2023-08-31T22:03:55.2037562Z 2023-08-31T22:03:55.2037872Z Iteration 31/82 2023-08-31T22:03:55.2040204Z 2023-08-31T22:03:55.2040538Z → management request 2023-08-31T22:03:57.0648004Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&batch_size=3&initial_workers=3&response_timeout=0 2023-08-31T22:03:57.0649258Z 500 Internal Server Error ★ 1855ms time ★ 349B↑ 413B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:57.0649971Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 132B 2023-08-31T22:03:57.0651730Z │ { 2023-08-31T22:03:57.0652112Z │ "code": 500, 2023-08-31T22:03:57.0652571Z │ "type": "InternalServerException", 2023-08-31T22:03:57.0653066Z │ "message": "Failed to start workers for model squeez 2023-08-31T22:03:57.0653605Z │ enet1_1 version: 1.0" 2023-08-31T22:03:57.0655987Z │ } 2023-08-31T22:03:57.0659298Z └ 2023-08-31T22:03:57.0659799Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:57.0660416Z 1ms 172µs (cache) (cache) 1853ms 1ms 31µs 1856ms 2023-08-31T22:03:57.0660716Z 2023-08-31T22:03:57.0704243Z ✓ Successful request 2023-08-31T22:03:57.0733729Z 2023-08-31T22:03:57.0734319Z Iteration 32/82 2023-08-31T22:03:57.0746320Z 2023-08-31T22:03:57.0746925Z → management request 2023-08-31T22:03:57.1157105Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&response_timeout=0 2023-08-31T22:03:57.1158133Z 200 OK ★ 34ms time ★ 318B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:57.1158781Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:03:57.1161210Z │ { 2023-08-31T22:03:57.1161658Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:03:57.1162441Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:03:57.1162897Z │ o add workers for the model." 2023-08-31T22:03:57.1163250Z │ } 2023-08-31T22:03:57.1163586Z └ 2023-08-31T22:03:57.1164079Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:57.1164666Z 1ms 680µs 274µs 139µs 31ms 1ms 27µs 34ms 2023-08-31T22:03:57.1164919Z 2023-08-31T22:03:57.1207163Z ✓ Successful request 2023-08-31T22:03:57.1235738Z 2023-08-31T22:03:57.1235874Z Iteration 33/82 2023-08-31T22:03:57.1251229Z 2023-08-31T22:03:57.1251760Z → management request 2023-08-31T22:03:57.1351032Z DELETE http://localhost:8081/models/squeezenet1_1 2023-08-31T22:03:57.1354357Z 200 OK ★ 5ms time ★ 249B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:57.1357409Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:03:57.1360283Z │ { 2023-08-31T22:03:57.1360855Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:03:57.1361250Z │ } 2023-08-31T22:03:57.1407014Z └ 2023-08-31T22:03:57.1407527Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:57.1408040Z 1ms 172µs (cache) (cache) 2ms 1ms 25µs 5ms 2023-08-31T22:03:57.1408243Z 2023-08-31T22:03:57.1408680Z ✓ Successful request 2023-08-31T22:03:57.1440410Z 2023-08-31T22:03:57.1440796Z Iteration 34/82 2023-08-31T22:03:57.1457521Z 2023-08-31T22:03:57.1458022Z → management request 2023-08-31T22:03:58.5074258Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&batch_size=2 2023-08-31T22:03:58.5075212Z 200 OK ★ 1356ms time ★ 311B↑ 405B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:58.5075904Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 138B 2023-08-31T22:03:58.5076719Z │ { 2023-08-31T22:03:58.5077149Z │ "status": "Model \"resnet152\" Version: 1.0 register 2023-08-31T22:03:58.5077883Z │ ed with 0 initial workers. Use scale workers API to ad 2023-08-31T22:03:58.5078219Z │ d workers for the model." 2023-08-31T22:03:58.5078461Z │ } 2023-08-31T22:03:58.5089317Z └ 2023-08-31T22:03:58.5089889Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:58.5090570Z 1ms 170µs (cache) (cache) 1353ms 1ms 32µs 1356ms 2023-08-31T22:03:58.5090951Z 2023-08-31T22:03:58.5134098Z ✓ Successful request 2023-08-31T22:03:58.5224962Z 2023-08-31T22:03:58.5225488Z Iteration 35/82 2023-08-31T22:03:58.5237442Z 2023-08-31T22:03:58.5238035Z → management request 2023-08-31T22:03:58.5728723Z DELETE http://localhost:8081/models/resnet152 2023-08-31T22:03:58.5729414Z 200 OK ★ 45ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:03:58.5731680Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:03:58.5732228Z │ { 2023-08-31T22:03:58.5732881Z │ "status": "Model \"resnet152\" unregistered" 2023-08-31T22:03:58.5734415Z │ } 2023-08-31T22:03:58.5753576Z └ 2023-08-31T22:03:58.5754380Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:03:58.5755197Z 1ms 173µs (cache) (cache) 43ms 1ms 30µs 45ms 2023-08-31T22:03:58.5755430Z 2023-08-31T22:03:58.5780489Z ✓ Successful request 2023-08-31T22:03:58.5808866Z 2023-08-31T22:03:58.5809153Z Iteration 36/82 2023-08-31T22:03:58.5821735Z 2023-08-31T22:03:58.5822221Z → management request 2023-08-31T22:04:02.7247859Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&batch_size=dd&initial_workers=1 2023-08-31T22:04:02.7248801Z 200 OK ★ 4.1s time ★ 330B↑ 351B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:02.7254764Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 85B 2023-08-31T22:04:02.7255228Z │ { 2023-08-31T22:04:02.7255931Z │ "status": "Model \"resnet152\" Version: 1.0 register 2023-08-31T22:04:02.7256458Z │ ed with 1 initial workers" 2023-08-31T22:04:02.7257048Z │ } 2023-08-31T22:04:02.7267898Z └ 2023-08-31T22:04:02.7268470Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:02.7269322Z 1ms 177µs (cache) (cache) 4.1s 1ms 33µs 4.1s 2023-08-31T22:04:02.7269663Z 2023-08-31T22:04:02.7342458Z ✓ Successful request 2023-08-31T22:04:02.7358123Z 2023-08-31T22:04:02.7358346Z Iteration 37/82 2023-08-31T22:04:02.7371344Z 2023-08-31T22:04:02.7371678Z → management request 2023-08-31T22:04:02.7917528Z DELETE http://localhost:8081/models/resnet152 2023-08-31T22:04:02.7918490Z 200 OK ★ 49ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:02.7919341Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:04:02.7919796Z │ { 2023-08-31T22:04:02.7920491Z │ "status": "Model \"resnet152\" unregistered" 2023-08-31T22:04:02.7920951Z │ } 2023-08-31T22:04:02.7932471Z └ 2023-08-31T22:04:02.7933203Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:02.7934114Z 1ms 174µs (cache) (cache) 47ms 1ms 29µs 50ms 2023-08-31T22:04:02.7934471Z 2023-08-31T22:04:02.7971199Z ✓ Successful request 2023-08-31T22:04:02.8000638Z 2023-08-31T22:04:02.8001003Z Iteration 38/82 2023-08-31T22:04:02.8013494Z 2023-08-31T22:04:02.8013947Z → management request 2023-08-31T22:04:06.9375203Z POST http://localhost:8081/models?url=resnet-152-batch.mar&model_name=resnet152&batch_size=2&initial_workers=1&max_batch_delay=junk 2023-08-31T22:04:06.9376213Z 200 OK ★ 4.1s time ★ 350B↑ 351B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:06.9376920Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 85B 2023-08-31T22:04:06.9377744Z │ { 2023-08-31T22:04:06.9378181Z │ "status": "Model \"resnet152\" Version: 1.0 register 2023-08-31T22:04:06.9378882Z │ ed with 1 initial workers" 2023-08-31T22:04:06.9379127Z │ } 2023-08-31T22:04:06.9414613Z └ 2023-08-31T22:04:06.9415240Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:06.9415897Z 1ms 178µs (cache) (cache) 4.1s 1ms 32µs 4.1s 2023-08-31T22:04:06.9416369Z 2023-08-31T22:04:06.9464163Z ✓ Successful request 2023-08-31T22:04:06.9496156Z 2023-08-31T22:04:06.9496547Z Iteration 39/82 2023-08-31T22:04:06.9509180Z 2023-08-31T22:04:06.9509672Z → management request 2023-08-31T22:04:07.0064950Z DELETE http://localhost:8081/models/resnet152 2023-08-31T22:04:07.0065976Z 200 OK ★ 50ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:07.0066933Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:04:07.0067253Z │ { 2023-08-31T22:04:07.0067591Z │ "status": "Model \"resnet152\" unregistered" 2023-08-31T22:04:07.0067863Z │ } 2023-08-31T22:04:07.0081085Z └ 2023-08-31T22:04:07.0081870Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:07.0082406Z 1ms 175µs (cache) (cache) 48ms 1ms 30µs 50ms 2023-08-31T22:04:07.0082609Z 2023-08-31T22:04:07.0127689Z ✓ Successful request 2023-08-31T22:04:07.0156601Z 2023-08-31T22:04:07.0157637Z Iteration 40/82 2023-08-31T22:04:07.0175224Z 2023-08-31T22:04:07.0175629Z → management request 2023-08-31T22:04:07.0545541Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1&initial_workers=-1 2023-08-31T22:04:07.0546397Z 200 OK ★ 32ms time ★ 318B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:07.0547000Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:04:07.0547481Z │ { 2023-08-31T22:04:07.0548152Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:04:07.0548690Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:04:07.0549271Z │ o add workers for the model." 2023-08-31T22:04:07.0549657Z │ } 2023-08-31T22:04:07.0556515Z └ 2023-08-31T22:04:07.0557106Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:07.0557783Z 1ms 169µs (cache) (cache) 30ms 1ms 26µs 33ms 2023-08-31T22:04:07.0558122Z 2023-08-31T22:04:07.0594305Z ✓ Successful request 2023-08-31T22:04:07.0625415Z 2023-08-31T22:04:07.0625786Z Iteration 41/82 2023-08-31T22:04:07.0640885Z 2023-08-31T22:04:07.0641356Z → management request 2023-08-31T22:04:07.0731391Z DELETE http://localhost:8081/models/squeezenet1_1 2023-08-31T22:04:07.0733259Z 200 OK ★ 4ms time ★ 249B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:07.0735017Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:04:07.0736637Z │ { 2023-08-31T22:04:07.0736977Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:04:07.0737542Z │ } 2023-08-31T22:04:07.0749922Z └ 2023-08-31T22:04:07.0750390Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:07.0752354Z 1ms 169µs (cache) (cache) 2ms 1ms 24µs 4ms 2023-08-31T22:04:07.0752797Z 2023-08-31T22:04:07.0791004Z ✓ Successful request 2023-08-31T22:04:07.0817889Z 2023-08-31T22:04:07.0818242Z Iteration 42/82 2023-08-31T22:04:07.0829738Z 2023-08-31T22:04:07.0830177Z → management request 2023-08-31T22:04:07.3558169Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&synchronous=true 2023-08-31T22:04:07.3561320Z 200 OK ★ 268ms time ★ 308B↑ 405B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:07.3562958Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 138B 2023-08-31T22:04:07.3564666Z │ { 2023-08-31T22:04:07.3565016Z │ "status": "Model \"resnet-18\" Version: 1.0 register 2023-08-31T22:04:07.3565424Z │ ed with 0 initial workers. Use scale workers API to ad 2023-08-31T22:04:07.3565780Z │ d workers for the model." 2023-08-31T22:04:07.3566027Z │ } 2023-08-31T22:04:07.3579180Z └ 2023-08-31T22:04:07.3579897Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:07.3580820Z 1ms 162µs (cache) (cache) 265ms 1ms 34µs 268ms 2023-08-31T22:04:07.3581045Z 2023-08-31T22:04:07.3625153Z ✓ Successful request 2023-08-31T22:04:07.3656670Z 2023-08-31T22:04:07.3656800Z Iteration 43/82 2023-08-31T22:04:07.3670389Z 2023-08-31T22:04:07.3670871Z → management request 2023-08-31T22:04:07.3829071Z DELETE http://localhost:8081/models/resnet-18 2023-08-31T22:04:07.3829853Z 200 OK ★ 11ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:07.3830511Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:04:07.3831133Z │ { 2023-08-31T22:04:07.3831531Z │ "status": "Model \"resnet-18\" unregistered" 2023-08-31T22:04:07.3842498Z │ } 2023-08-31T22:04:07.3842687Z └ 2023-08-31T22:04:07.3843286Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:07.3844097Z 1ms 171µs (cache) (cache) 9ms 1ms 24µs 11ms 2023-08-31T22:04:07.3844324Z 2023-08-31T22:04:07.3892810Z ✓ Successful request 2023-08-31T22:04:07.3922418Z 2023-08-31T22:04:07.3922875Z Iteration 44/82 2023-08-31T22:04:07.3937768Z 2023-08-31T22:04:07.3938054Z → management request 2023-08-31T22:04:07.6661318Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&synchronous=-1 2023-08-31T22:04:07.6664730Z 200 OK ★ 267ms time ★ 306B↑ 405B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:07.6665607Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 138B 2023-08-31T22:04:07.6666122Z │ { 2023-08-31T22:04:07.6666845Z │ "status": "Model \"resnet-18\" Version: 1.0 register 2023-08-31T22:04:07.6667410Z │ ed with 0 initial workers. Use scale workers API to ad 2023-08-31T22:04:07.6668130Z │ d workers for the model." 2023-08-31T22:04:07.6668542Z │ } 2023-08-31T22:04:07.6672245Z └ 2023-08-31T22:04:07.6672825Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:07.6673676Z 1ms 165µs (cache) (cache) 265ms 1ms 31µs 267ms 2023-08-31T22:04:07.6674041Z 2023-08-31T22:04:07.6714718Z ✓ Successful request 2023-08-31T22:04:07.6741575Z 2023-08-31T22:04:07.6741828Z Iteration 45/82 2023-08-31T22:04:07.6754408Z 2023-08-31T22:04:07.6754741Z → management request 2023-08-31T22:04:07.6950270Z DELETE http://localhost:8081/models/resnet-18 2023-08-31T22:04:07.6951102Z 200 OK ★ 12ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:07.6951943Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:04:07.6952400Z │ { 2023-08-31T22:04:07.6953066Z │ "status": "Model \"resnet-18\" unregistered" 2023-08-31T22:04:07.6953787Z │ } 2023-08-31T22:04:07.6961136Z └ 2023-08-31T22:04:07.6961725Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:07.6962953Z 2ms 177µs (cache) (cache) 10ms 1ms 24µs 14ms 2023-08-31T22:04:07.6963236Z 2023-08-31T22:04:07.7003428Z ✓ Successful request 2023-08-31T22:04:07.7030113Z 2023-08-31T22:04:07.7030469Z Iteration 46/82 2023-08-31T22:04:07.7046998Z 2023-08-31T22:04:07.7047665Z → management request 2023-08-31T22:04:07.9812292Z POST http://localhost:8081/models?url=resnet-18.mar&model_name=resnet-18&synchronous=false 2023-08-31T22:04:07.9813209Z 200 OK ★ 270ms time ★ 309B↑ 405B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:07.9814051Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 138B 2023-08-31T22:04:07.9814497Z │ { 2023-08-31T22:04:07.9815184Z │ "status": "Model \"resnet-18\" Version: 1.0 register 2023-08-31T22:04:07.9815749Z │ ed with 0 initial workers. Use scale workers API to ad 2023-08-31T22:04:07.9816482Z │ d workers for the model." 2023-08-31T22:04:07.9816881Z │ } 2023-08-31T22:04:07.9823139Z └ 2023-08-31T22:04:07.9823715Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:07.9824579Z 1ms 161µs (cache) (cache) 268ms 1ms 32µs 271ms 2023-08-31T22:04:07.9824940Z 2023-08-31T22:04:07.9865324Z ✓ Successful request 2023-08-31T22:04:07.9894039Z 2023-08-31T22:04:07.9894821Z Iteration 47/82 2023-08-31T22:04:07.9906362Z 2023-08-31T22:04:07.9906686Z → management request 2023-08-31T22:04:07.9987142Z GET http://localhost:8081/models?limit=1 2023-08-31T22:04:07.9987995Z 200 OK ★ 3ms time ★ 240B↑ 391B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:07.9988818Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 124B 2023-08-31T22:04:07.9989267Z │ { 2023-08-31T22:04:07.9989883Z │ "nextPageToken": "1", 2023-08-31T22:04:07.9990286Z │ "models": [ 2023-08-31T22:04:07.9990917Z │ { 2023-08-31T22:04:07.9991350Z │ "modelName": "resnet-18", 2023-08-31T22:04:07.9992018Z │ "modelUrl": "resnet-18.mar" 2023-08-31T22:04:07.9992417Z │ } 2023-08-31T22:04:07.9992977Z │ ] 2023-08-31T22:04:07.9993332Z │ } 2023-08-31T22:04:08.0000819Z └ 2023-08-31T22:04:08.0001564Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.0002505Z 1ms 285µs (cache) (cache) 1ms 1ms 26µs 3ms 2023-08-31T22:04:08.0002863Z 2023-08-31T22:04:08.0072519Z ✓ Successful request 2023-08-31T22:04:08.0100468Z 2023-08-31T22:04:08.0100807Z Iteration 48/82 2023-08-31T22:04:08.0114170Z 2023-08-31T22:04:08.0114612Z → management request 2023-08-31T22:04:08.0187588Z GET http://localhost:8081/models?limit=-1 2023-08-31T22:04:08.0188338Z 200 OK ★ 3ms time ★ 241B↑ 367B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.0189162Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 100B 2023-08-31T22:04:08.0189640Z │ { 2023-08-31T22:04:08.0190236Z │ "models": [ 2023-08-31T22:04:08.0190622Z │ { 2023-08-31T22:04:08.0191249Z │ "modelName": "resnet-18", 2023-08-31T22:04:08.0191716Z │ "modelUrl": "resnet-18.mar" 2023-08-31T22:04:08.0192320Z │ } 2023-08-31T22:04:08.0192672Z │ ] 2023-08-31T22:04:08.0193239Z │ } 2023-08-31T22:04:08.0198276Z └ 2023-08-31T22:04:08.0199121Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.0200360Z 989µs 162µs (cache) (cache) 1ms 1ms 24µs 3ms 2023-08-31T22:04:08.0200634Z 2023-08-31T22:04:08.0250959Z ✓ Successful request 2023-08-31T22:04:08.0265338Z 2023-08-31T22:04:08.0265662Z Iteration 49/82 2023-08-31T22:04:08.0280285Z 2023-08-31T22:04:08.0280603Z → management request 2023-08-31T22:04:08.0354407Z GET http://localhost:8081/models?limit=1&next_page_token=1 2023-08-31T22:04:08.0355353Z 200 OK ★ 3ms time ★ 258B↑ 285B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.0355847Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 19B 2023-08-31T22:04:08.0357166Z │ { 2023-08-31T22:04:08.0357710Z │ "models": [] 2023-08-31T22:04:08.0358241Z │ } 2023-08-31T22:04:08.0369800Z └ 2023-08-31T22:04:08.0370355Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.0370951Z 1ms 160µs (cache) (cache) 871µs 995µs 25µs 3ms 2023-08-31T22:04:08.0371212Z 2023-08-31T22:04:08.0410218Z ✓ Successful request 2023-08-31T22:04:08.0439083Z 2023-08-31T22:04:08.0439567Z Iteration 50/82 2023-08-31T22:04:08.0453846Z 2023-08-31T22:04:08.0454303Z → management request 2023-08-31T22:04:08.0528118Z GET http://localhost:8081/models?limit=1&next_page_token=-1 2023-08-31T22:04:08.0528880Z 200 OK ★ 3ms time ★ 259B↑ 391B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.0529703Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 124B 2023-08-31T22:04:08.0530186Z │ { 2023-08-31T22:04:08.0530792Z │ "nextPageToken": "1", 2023-08-31T22:04:08.0531216Z │ "models": [ 2023-08-31T22:04:08.0531800Z │ { 2023-08-31T22:04:08.0532228Z │ "modelName": "resnet-18", 2023-08-31T22:04:08.0532889Z │ "modelUrl": "resnet-18.mar" 2023-08-31T22:04:08.0533295Z │ } 2023-08-31T22:04:08.0533851Z │ ] 2023-08-31T22:04:08.0534199Z │ } 2023-08-31T22:04:08.0538816Z └ 2023-08-31T22:04:08.0539390Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.0540247Z 998µs 158µs (cache) (cache) 1ms 1ms 23µs 3ms 2023-08-31T22:04:08.0540590Z 2023-08-31T22:04:08.0579418Z ✓ Successful request 2023-08-31T22:04:08.0605940Z 2023-08-31T22:04:08.0606258Z Iteration 51/82 2023-08-31T22:04:08.0618074Z 2023-08-31T22:04:08.0618441Z → management request 2023-08-31T22:04:08.0709141Z PUT http://localhost:8081/models/resnet-18?number_gpu=10 2023-08-31T22:04:08.0710039Z 202 Accepted ★ 4ms time ★ 275B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.0710916Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:08.0712783Z │ { 2023-08-31T22:04:08.0713269Z │ "status": "Processing worker updates..." 2023-08-31T22:04:08.0713907Z │ } 2023-08-31T22:04:08.0726454Z └ 2023-08-31T22:04:08.0727143Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.0728025Z 984µs 157µs (cache) (cache) 2ms 1ms 22µs 4ms 2023-08-31T22:04:08.0728370Z 2023-08-31T22:04:08.0967177Z ✓ Successful request 2023-08-31T22:04:08.0996003Z 2023-08-31T22:04:08.0996344Z Iteration 52/82 2023-08-31T22:04:08.1009717Z 2023-08-31T22:04:08.1010169Z → management request 2023-08-31T22:04:08.1105120Z PUT http://localhost:8081/models/resnet-18?number_gpu=-1 2023-08-31T22:04:08.1107390Z 202 Accepted ★ 3ms time ★ 275B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.1109625Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:08.1111607Z │ { 2023-08-31T22:04:08.1112091Z │ "status": "Processing worker updates..." 2023-08-31T22:04:08.1112722Z │ } 2023-08-31T22:04:08.1125377Z └ 2023-08-31T22:04:08.1126021Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.1127406Z 1ms 173µs (cache) (cache) 1ms 1ms 25µs 3ms 2023-08-31T22:04:08.1127779Z 2023-08-31T22:04:08.1172839Z ✓ Successful request 2023-08-31T22:04:08.1239018Z 2023-08-31T22:04:08.1239364Z Iteration 53/82 2023-08-31T22:04:08.1252671Z 2023-08-31T22:04:08.1253110Z → management request 2023-08-31T22:04:08.1332564Z PUT http://localhost:8081/models/resnet-18?min_worker=1&max_worker=1&synchronous=true 2023-08-31T22:04:08.1334844Z 200 OK ★ 3ms time ★ 304B↑ 325B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.1337251Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 59B 2023-08-31T22:04:08.1339173Z │ { 2023-08-31T22:04:08.1339691Z │ "status": "Workers scaled to 1 for model: resnet-18" 2023-08-31T22:04:08.1340329Z │ } 2023-08-31T22:04:08.1352970Z └ 2023-08-31T22:04:08.1353614Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.1354526Z 1ms 170µs (cache) (cache) 1ms 1ms 24µs 3ms 2023-08-31T22:04:08.1354879Z 2023-08-31T22:04:08.1393710Z ✓ Successful request 2023-08-31T22:04:08.1421893Z 2023-08-31T22:04:08.1422220Z Iteration 54/82 2023-08-31T22:04:08.1435466Z 2023-08-31T22:04:08.1435892Z → management request 2023-08-31T22:04:08.1579350Z PUT http://localhost:8081/models/resnet-18?min_worker=1&max_worker=1&synchronous=false 2023-08-31T22:04:08.1648203Z 202 Accepted ★ 9ms time ★ 305B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.1650430Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:08.1652433Z │ { 2023-08-31T22:04:08.1652924Z │ "status": "Processing worker updates..." 2023-08-31T22:04:08.1653561Z │ } 2023-08-31T22:04:08.1678824Z └ 2023-08-31T22:04:08.1689139Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.1689940Z 1ms 192µs (cache) (cache) 1ms 7ms 25µs 10ms 2023-08-31T22:04:08.1690582Z 2023-08-31T22:04:08.1753751Z ✓ Successful request 2023-08-31T22:04:08.1870338Z 2023-08-31T22:04:08.1870687Z Iteration 55/82 2023-08-31T22:04:08.1884234Z 2023-08-31T22:04:08.1884656Z → management request 2023-08-31T22:04:08.1963821Z PUT http://localhost:8081/models/resnet-18?timeout=-1 2023-08-31T22:04:08.1966089Z 202 Accepted ★ 3ms time ★ 272B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.1968364Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:08.1970256Z │ { 2023-08-31T22:04:08.1970748Z │ "status": "Processing worker updates..." 2023-08-31T22:04:08.1971428Z │ } 2023-08-31T22:04:08.1984146Z └ 2023-08-31T22:04:08.1984819Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.1985715Z 1ms 169µs (cache) (cache) 1ms 1ms 23µs 3ms 2023-08-31T22:04:08.1986059Z 2023-08-31T22:04:08.2029405Z ✓ Successful request 2023-08-31T22:04:08.2063630Z 2023-08-31T22:04:08.2063966Z Iteration 56/82 2023-08-31T22:04:08.2077483Z 2023-08-31T22:04:08.2077911Z → management request 2023-08-31T22:04:08.2155416Z PUT http://localhost:8081/models/resnet-18?timeout=0 2023-08-31T22:04:08.2157713Z 202 Accepted ★ 3ms time ★ 271B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.2159739Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:08.2161633Z │ { 2023-08-31T22:04:08.2162126Z │ "status": "Processing worker updates..." 2023-08-31T22:04:08.2162766Z │ } 2023-08-31T22:04:08.2175365Z └ 2023-08-31T22:04:08.2176019Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.2176907Z 1ms 165µs (cache) (cache) 1ms 998µs 23µs 3ms 2023-08-31T22:04:08.2177259Z 2023-08-31T22:04:08.2290544Z ✓ Successful request 2023-08-31T22:04:08.2317882Z 2023-08-31T22:04:08.2318202Z Iteration 57/82 2023-08-31T22:04:08.2331433Z 2023-08-31T22:04:08.2332143Z → management request 2023-08-31T22:04:08.2411238Z POST http://localhost:8081/models?url=&model_name=resnet-18 2023-08-31T22:04:08.2413513Z 404 Not Found ★ 3ms time ★ 278B↑ 348B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.2415521Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 80B 2023-08-31T22:04:08.2417400Z │ { 2023-08-31T22:04:08.2417816Z │ "code": 404, 2023-08-31T22:04:08.2418495Z │ "type": "ModelNotFoundException", 2023-08-31T22:04:08.2418955Z │ "message": "empty url" 2023-08-31T22:04:08.2419551Z │ } 2023-08-31T22:04:08.2432226Z └ 2023-08-31T22:04:08.2432881Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.2433751Z 1ms 336µs (cache) (cache) 1ms 1ms 23µs 3ms 2023-08-31T22:04:08.2434103Z 2023-08-31T22:04:08.2472890Z ✓ Successful request 2023-08-31T22:04:08.2500541Z 2023-08-31T22:04:08.2500874Z Iteration 58/82 2023-08-31T22:04:08.2537882Z 2023-08-31T22:04:08.2538386Z → management request 2023-08-31T22:04:08.8545303Z POST http://localhost:8081/models?url=https://torchserve.pytorch.org/mar_files/invalid-resnet-18.mar&model_name=invalid-resnet18 2023-08-31T22:04:08.8550359Z 400 Bad Request ★ 594ms time ★ 347B↑ 439B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.8551266Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 168B 2023-08-31T22:04:08.8551710Z │ { 2023-08-31T22:04:08.8552312Z │ "code": 400, 2023-08-31T22:04:08.8552780Z │ "type": "DownloadArchiveException", 2023-08-31T22:04:08.8553559Z │ "message": "Failed to download archive from: https:/ 2023-08-31T22:04:08.8554234Z │ /torchserve.pytorch.org/mar_files/invalid-resnet-18.ma 2023-08-31T22:04:08.8554879Z │ r" 2023-08-31T22:04:08.8555235Z │ } 2023-08-31T22:04:08.8555764Z └ 2023-08-31T22:04:08.8556331Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.8557199Z 1ms 564µs 165µs 135µs 591ms 1ms 31µs 594ms 2023-08-31T22:04:08.8557531Z 2023-08-31T22:04:08.8589293Z ✓ Successful request 2023-08-31T22:04:08.8675317Z 2023-08-31T22:04:08.8675679Z Iteration 59/82 2023-08-31T22:04:08.8689279Z 2023-08-31T22:04:08.8689774Z → management request 2023-08-31T22:04:08.8816908Z GET http://localhost:8081/models/invalid_squeezenet1_1 2023-08-31T22:04:08.8819259Z 404 Not Found ★ 4ms time ★ 254B↑ 378B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.8821319Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 109B 2023-08-31T22:04:08.8823190Z │ { 2023-08-31T22:04:08.8823619Z │ "code": 404, 2023-08-31T22:04:08.8824292Z │ "type": "ModelNotFoundException", 2023-08-31T22:04:08.8824827Z │ "message": "Model not found: invalid_squeezenet1_1" 2023-08-31T22:04:08.8825467Z │ } 2023-08-31T22:04:08.8838023Z └ 2023-08-31T22:04:08.8838674Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.8839846Z 1ms 431µs 272µs 121µs 1ms 1ms 24µs 4ms 2023-08-31T22:04:08.8840215Z 2023-08-31T22:04:08.9022296Z ✓ Successful request 2023-08-31T22:04:08.9180782Z 2023-08-31T22:04:08.9181154Z Iteration 60/82 2023-08-31T22:04:08.9193733Z 2023-08-31T22:04:08.9194193Z → management request 2023-08-31T22:04:08.9285288Z GET http://localhost:8081/models/squeezenet1_1/0.0 2023-08-31T22:04:08.9287896Z 404 Not Found ★ 4ms time ★ 250B↑ 370B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.9289988Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 101B 2023-08-31T22:04:08.9291877Z │ { 2023-08-31T22:04:08.9292279Z │ "code": 404, 2023-08-31T22:04:08.9292954Z │ "type": "ModelNotFoundException", 2023-08-31T22:04:08.9293481Z │ "message": "Model not found: squeezenet1_1" 2023-08-31T22:04:08.9294108Z │ } 2023-08-31T22:04:08.9306576Z └ 2023-08-31T22:04:08.9307232Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.9308141Z 1ms 407µs 159µs 114µs 2ms 1ms 25µs 4ms 2023-08-31T22:04:08.9308485Z 2023-08-31T22:04:08.9347470Z ✓ Successful request 2023-08-31T22:04:08.9474269Z 2023-08-31T22:04:08.9474614Z Iteration 61/82 2023-08-31T22:04:08.9487296Z 2023-08-31T22:04:08.9487749Z → management request 2023-08-31T22:04:08.9588944Z GET http://localhost:8081/models?next_page_token=12 2023-08-31T22:04:08.9592482Z 200 OK ★ 5ms time ★ 251B↑ 285B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.9594926Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 19B 2023-08-31T22:04:08.9596771Z │ { 2023-08-31T22:04:08.9597182Z │ "models": [] 2023-08-31T22:04:08.9597766Z │ } 2023-08-31T22:04:08.9610692Z └ 2023-08-31T22:04:08.9611343Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.9612220Z 1ms 377µs 309µs 117µs 3ms 1ms 24µs 5ms 2023-08-31T22:04:08.9612584Z 2023-08-31T22:04:08.9657503Z ✓ Successful request 2023-08-31T22:04:08.9700372Z 2023-08-31T22:04:08.9700696Z Iteration 62/82 2023-08-31T22:04:08.9714189Z 2023-08-31T22:04:08.9714633Z → management request 2023-08-31T22:04:08.9796627Z PUT http://localhost:8081/models/resnet-18?min_worker=1&synchronous=Nan 2023-08-31T22:04:08.9798924Z 202 Accepted ★ 3ms time ★ 290B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:08.9800965Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:08.9802892Z │ { 2023-08-31T22:04:08.9803433Z │ "status": "Processing worker updates..." 2023-08-31T22:04:08.9804063Z │ } 2023-08-31T22:04:08.9828175Z └ 2023-08-31T22:04:08.9828880Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:08.9829792Z 1ms 169µs (cache) (cache) 1ms 1ms 25µs 3ms 2023-08-31T22:04:08.9830148Z 2023-08-31T22:04:08.9869037Z ✓ Successful request 2023-08-31T22:04:08.9897826Z 2023-08-31T22:04:08.9898153Z Iteration 63/82 2023-08-31T22:04:08.9911443Z 2023-08-31T22:04:08.9911863Z → management request 2023-08-31T22:04:09.0077982Z PUT http://localhost:8081/models/resnet-18?min_worker=nan&synchronous=nan 2023-08-31T22:04:09.0080326Z 202 Accepted ★ 12ms time ★ 292B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.0082382Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:09.0084288Z │ { 2023-08-31T22:04:09.0084786Z │ "status": "Processing worker updates..." 2023-08-31T22:04:09.0085458Z │ } 2023-08-31T22:04:09.0098152Z └ 2023-08-31T22:04:09.0098794Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.0099683Z 1ms 165µs (cache) (cache) 10ms 1ms 27µs 12ms 2023-08-31T22:04:09.0100025Z 2023-08-31T22:04:09.0138601Z ✓ Successful request 2023-08-31T22:04:09.0166127Z 2023-08-31T22:04:09.0166944Z Iteration 64/82 2023-08-31T22:04:09.0169705Z 2023-08-31T22:04:09.0170122Z → management request 2023-08-31T22:04:09.0257570Z PUT http://localhost:8081/models/resnet-18 2023-08-31T22:04:09.0259848Z 202 Accepted ★ 4ms time ★ 261B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.0261907Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:09.0263797Z │ { 2023-08-31T22:04:09.0264282Z │ "status": "Processing worker updates..." 2023-08-31T22:04:09.0264910Z │ } 2023-08-31T22:04:09.0277187Z └ 2023-08-31T22:04:09.0277844Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.0279032Z 979µs 165µs (cache) (cache) 2ms 1ms 25µs 4ms 2023-08-31T22:04:09.0279389Z 2023-08-31T22:04:09.0316307Z ✓ Successful request 2023-08-31T22:04:09.0343697Z 2023-08-31T22:04:09.0344024Z Iteration 65/82 2023-08-31T22:04:09.0357264Z 2023-08-31T22:04:09.0357687Z → management request 2023-08-31T22:04:09.0435763Z PUT http://localhost:8081/models/resnet181?min_worker=1 2023-08-31T22:04:09.0438052Z 404 Not Found ★ 3ms time ★ 274B↑ 365B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.0440107Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 97B 2023-08-31T22:04:09.0441995Z │ { 2023-08-31T22:04:09.0442412Z │ "code": 404, 2023-08-31T22:04:09.0443093Z │ "type": "ModelNotFoundException", 2023-08-31T22:04:09.0443632Z │ "message": "Model not found: resnet181" 2023-08-31T22:04:09.0444259Z │ } 2023-08-31T22:04:09.0456744Z └ 2023-08-31T22:04:09.0457432Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.0458320Z 983µs 187µs (cache) (cache) 1ms 1ms 24µs 3ms 2023-08-31T22:04:09.0458681Z 2023-08-31T22:04:09.0496958Z ✓ Successful request 2023-08-31T22:04:09.0524090Z 2023-08-31T22:04:09.0524422Z Iteration 66/82 2023-08-31T22:04:09.0537648Z 2023-08-31T22:04:09.0538106Z → management request 2023-08-31T22:04:09.0625745Z PUT http://localhost:8081/models/resnet-18?min_worker=2&max_worker=1 2023-08-31T22:04:09.0628043Z 400 Bad Request ★ 4ms time ★ 287B↑ 381B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.0630072Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 110B 2023-08-31T22:04:09.0631879Z │ { 2023-08-31T22:04:09.0632287Z │ "code": 400, 2023-08-31T22:04:09.0632962Z │ "type": "BadRequestException", 2023-08-31T22:04:09.0633489Z │ "message": "max_worker cannot be less than min_worke 2023-08-31T22:04:09.0634171Z │ r." 2023-08-31T22:04:09.0634532Z │ } 2023-08-31T22:04:09.0646078Z └ 2023-08-31T22:04:09.0646955Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.0647848Z 1ms 392µs 143µs 242µs 1ms 1ms 25µs 4ms 2023-08-31T22:04:09.0648182Z 2023-08-31T22:04:09.0776199Z ✓ Successful request 2023-08-31T22:04:09.0850954Z 2023-08-31T22:04:09.0851338Z Iteration 67/82 2023-08-31T22:04:09.0863597Z 2023-08-31T22:04:09.0864026Z → management request 2023-08-31T22:04:09.0952684Z PUT http://localhost:8081/models/resnet-18?min_worker=1 2023-08-31T22:04:09.0954937Z 202 Accepted ★ 4ms time ★ 274B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.0956959Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:09.0958787Z │ { 2023-08-31T22:04:09.0959279Z │ "status": "Processing worker updates..." 2023-08-31T22:04:09.0959914Z │ } 2023-08-31T22:04:09.0972609Z └ 2023-08-31T22:04:09.0973320Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.0974213Z 1ms 397µs 147µs 131µs 1ms 1ms 24µs 4ms 2023-08-31T22:04:09.0974553Z 2023-08-31T22:04:09.1012169Z ✓ Successful request 2023-08-31T22:04:09.1039405Z 2023-08-31T22:04:09.1039732Z Iteration 68/82 2023-08-31T22:04:09.1052953Z 2023-08-31T22:04:09.1053643Z → management request 2023-08-31T22:04:09.1191706Z PUT http://localhost:8081/models/resnet-18?min_worker=0 2023-08-31T22:04:09.1192438Z 202 Accepted ★ 8ms time ★ 274B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.1193277Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:09.1193713Z │ { 2023-08-31T22:04:09.1194384Z │ "status": "Processing worker updates..." 2023-08-31T22:04:09.1194804Z │ } 2023-08-31T22:04:09.1195352Z └ 2023-08-31T22:04:09.1195909Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.1197060Z 990µs 162µs (cache) (cache) 6ms 1ms 23µs 8ms 2023-08-31T22:04:09.1197410Z 2023-08-31T22:04:09.1229014Z ✓ Successful request 2023-08-31T22:04:09.1259152Z 2023-08-31T22:04:09.1260154Z Iteration 69/82 2023-08-31T22:04:09.1263308Z 2023-08-31T22:04:09.1263689Z → management request 2023-08-31T22:04:09.1350716Z PUT http://localhost:8081/models/resnet-18?min_worker=-1 2023-08-31T22:04:09.1351521Z 500 Internal Server Error ★ 4ms time ★ 275B↑ 390B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.1352541Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 109B 2023-08-31T22:04:09.1368124Z │ { 2023-08-31T22:04:09.1381677Z │ "code": 500, 2023-08-31T22:04:09.1382471Z │ "type": "IndexOutOfBoundsException", 2023-08-31T22:04:09.1382948Z │ "message": "Index -1 out of bounds for length 0" 2023-08-31T22:04:09.1383289Z │ } 2023-08-31T22:04:09.1383910Z └ 2023-08-31T22:04:09.1384668Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.1385279Z 988µs 159µs (cache) (cache) 1ms 1ms 23µs 4ms 2023-08-31T22:04:09.1385547Z 2023-08-31T22:04:09.1412447Z ✓ Successful request 2023-08-31T22:04:09.1439270Z 2023-08-31T22:04:09.1439445Z Iteration 70/82 2023-08-31T22:04:09.1455523Z 2023-08-31T22:04:09.1456372Z → management request 2023-08-31T22:04:09.1547028Z PUT http://localhost:8081/models/resnet-18?max_worker=-1 2023-08-31T22:04:09.1547639Z 400 Bad Request ★ 3ms time ★ 275B↑ 381B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.1548150Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 110B 2023-08-31T22:04:09.1549381Z │ { 2023-08-31T22:04:09.1549941Z │ "code": 400, 2023-08-31T22:04:09.1550514Z │ "type": "BadRequestException", 2023-08-31T22:04:09.1550967Z │ "message": "max_worker cannot be less than min_worke 2023-08-31T22:04:09.1551325Z │ r." 2023-08-31T22:04:09.1551869Z │ } 2023-08-31T22:04:09.1562975Z └ 2023-08-31T22:04:09.1563528Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.1564099Z 997µs 372µs 143µs 111µs 1ms 1ms 23µs 3ms 2023-08-31T22:04:09.1564365Z 2023-08-31T22:04:09.1602899Z ✓ Successful request 2023-08-31T22:04:09.1629271Z 2023-08-31T22:04:09.1629974Z Iteration 71/82 2023-08-31T22:04:09.1641446Z 2023-08-31T22:04:09.1641870Z → management request 2023-08-31T22:04:09.1721023Z PUT http://localhost:8081/models/invalid_squeezenet1_1/1.0/set-default 2023-08-31T22:04:09.1721835Z 404 Not Found ★ 3ms time ★ 289B↑ 378B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.1722667Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 109B 2023-08-31T22:04:09.1723114Z │ { 2023-08-31T22:04:09.1723708Z │ "code": 404, 2023-08-31T22:04:09.1724162Z │ "type": "ModelNotFoundException", 2023-08-31T22:04:09.1724902Z │ "message": "Model not found: invalid_squeezenet1_1" 2023-08-31T22:04:09.1725371Z │ } 2023-08-31T22:04:09.1731607Z └ 2023-08-31T22:04:09.1732182Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.1733039Z 988µs 354µs 129µs 106µs 1ms 1ms 23µs 3ms 2023-08-31T22:04:09.1733370Z 2023-08-31T22:04:09.1769372Z ✓ Successful request 2023-08-31T22:04:09.1795158Z 2023-08-31T22:04:09.1795665Z Iteration 72/82 2023-08-31T22:04:09.1807642Z 2023-08-31T22:04:09.1807958Z → management request 2023-08-31T22:04:09.1986702Z DELETE http://localhost:8081/models/resnet-18 2023-08-31T22:04:09.1987279Z 200 OK ★ 13ms time ★ 245B↑ 317B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.1987803Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 51B 2023-08-31T22:04:09.1989028Z │ { 2023-08-31T22:04:09.1989692Z │ "status": "Model \"resnet-18\" unregistered" 2023-08-31T22:04:09.1990047Z │ } 2023-08-31T22:04:09.2001185Z └ 2023-08-31T22:04:09.2002020Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.2002592Z 963µs 340µs 122µs 97µs 11ms 991µs 22µs 13ms 2023-08-31T22:04:09.2002852Z 2023-08-31T22:04:09.2040512Z ✓ Successful request 2023-08-31T22:04:09.2066167Z 2023-08-31T22:04:09.2066344Z Iteration 73/82 2023-08-31T22:04:09.2078477Z 2023-08-31T22:04:09.2078792Z → management request 2023-08-31T22:04:09.2153234Z DELETE http://localhost:8081/models/squeezenet1_1/0.0 2023-08-31T22:04:09.2154075Z 404 Not Found ★ 3ms time ★ 253B↑ 370B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.2155083Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 101B 2023-08-31T22:04:09.2167917Z │ { 2023-08-31T22:04:09.2168710Z │ "code": 404, 2023-08-31T22:04:09.2169215Z │ "type": "ModelNotFoundException", 2023-08-31T22:04:09.2169958Z │ "message": "Model not found: squeezenet1_1" 2023-08-31T22:04:09.2170375Z │ } 2023-08-31T22:04:09.2171022Z └ 2023-08-31T22:04:09.2171590Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.2172438Z 993µs 159µs (cache) (cache) 1ms 1ms 26µs 3ms 2023-08-31T22:04:09.2172791Z 2023-08-31T22:04:09.2207260Z ✓ Successful request 2023-08-31T22:04:09.2233759Z 2023-08-31T22:04:09.2233945Z Iteration 74/82 2023-08-31T22:04:09.2246501Z 2023-08-31T22:04:09.2246822Z → management request 2023-08-31T22:04:09.2655675Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-08-31T22:04:09.2656501Z 200 OK ★ 35ms time ★ 299B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.2657006Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:04:09.2657368Z │ { 2023-08-31T22:04:09.2658141Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:04:09.2658630Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:04:09.2659090Z │ o add workers for the model." 2023-08-31T22:04:09.2659589Z │ } 2023-08-31T22:04:09.2660106Z └ 2023-08-31T22:04:09.2660868Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.2661443Z 1ms 364µs 133µs 103µs 32ms 1ms 30µs 35ms 2023-08-31T22:04:09.2661705Z 2023-08-31T22:04:09.2692885Z ✓ Successful request 2023-08-31T22:04:09.2720692Z 2023-08-31T22:04:09.2721048Z Iteration 75/82 2023-08-31T22:04:09.2734733Z 2023-08-31T22:04:09.2735159Z → management request 2023-08-31T22:04:09.2824107Z DELETE http://localhost:8081/models/squeezenet1_1/?synchronous=true 2023-08-31T22:04:09.2826509Z 200 OK ★ 4ms time ★ 267B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.2828717Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:04:09.2830761Z │ { 2023-08-31T22:04:09.2831271Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:04:09.2832077Z │ } 2023-08-31T22:04:09.2844325Z └ 2023-08-31T22:04:09.2844970Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.2846022Z 1ms 171µs (cache) (cache) 2ms 1ms 24µs 4ms 2023-08-31T22:04:09.2846695Z 2023-08-31T22:04:09.2897823Z ✓ Successful request 2023-08-31T22:04:09.2912062Z 2023-08-31T22:04:09.2912382Z Iteration 76/82 2023-08-31T22:04:09.2927063Z 2023-08-31T22:04:09.2927484Z → management request 2023-08-31T22:04:09.3296019Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-08-31T22:04:09.3298351Z 200 OK ★ 32ms time ★ 299B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.3300377Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:04:09.3302260Z │ { 2023-08-31T22:04:09.3302771Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:04:09.3303546Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:04:09.3304336Z │ o add workers for the model." 2023-08-31T22:04:09.3304935Z │ } 2023-08-31T22:04:09.3317219Z └ 2023-08-31T22:04:09.3317868Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.3318737Z 995µs 161µs (cache) (cache) 30ms 1ms 24µs 32ms 2023-08-31T22:04:09.3319087Z 2023-08-31T22:04:09.3356123Z ✓ Successful request 2023-08-31T22:04:09.3383607Z 2023-08-31T22:04:09.3383933Z Iteration 77/82 2023-08-31T22:04:09.3397177Z 2023-08-31T22:04:09.3397598Z → management request 2023-08-31T22:04:09.3483035Z DELETE http://localhost:8081/models/squeezenet1_1/?synchronous=nan 2023-08-31T22:04:09.3485327Z 200 OK ★ 4ms time ★ 266B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.3487686Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:04:09.3489594Z │ { 2023-08-31T22:04:09.3490111Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:04:09.3490839Z │ } 2023-08-31T22:04:09.3502977Z └ 2023-08-31T22:04:09.3503625Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.3504516Z 986µs 157µs (cache) (cache) 2ms 978µs 22µs 4ms 2023-08-31T22:04:09.3504869Z 2023-08-31T22:04:09.3551646Z ✓ Successful request 2023-08-31T22:04:09.3583539Z 2023-08-31T22:04:09.3583899Z Iteration 78/82 2023-08-31T22:04:09.3597837Z 2023-08-31T22:04:09.3598268Z → management request 2023-08-31T22:04:09.3955414Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-08-31T22:04:09.3956239Z 200 OK ★ 32ms time ★ 299B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.3957228Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:04:09.3957666Z │ { 2023-08-31T22:04:09.3958505Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:04:09.3959047Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:04:09.3959930Z │ o add workers for the model." 2023-08-31T22:04:09.3960328Z │ } 2023-08-31T22:04:09.3967731Z └ 2023-08-31T22:04:09.3968311Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.3969377Z 987µs 158µs (cache) (cache) 30ms 1ms 23µs 32ms 2023-08-31T22:04:09.3969746Z 2023-08-31T22:04:09.4009964Z ✓ Successful request 2023-08-31T22:04:09.4031159Z 2023-08-31T22:04:09.4031416Z Iteration 79/82 2023-08-31T22:04:09.4043714Z 2023-08-31T22:04:09.4044029Z → management request 2023-08-31T22:04:09.4127527Z DELETE http://localhost:8081/models/squeezenet1_1/?timeout=true 2023-08-31T22:04:09.4128192Z 200 OK ★ 4ms time ★ 263B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.4128680Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:04:09.4129976Z │ { 2023-08-31T22:04:09.4130633Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:04:09.4131019Z │ } 2023-08-31T22:04:09.4144092Z └ 2023-08-31T22:04:09.4144704Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.4145336Z 1ms 155µs (cache) (cache) 2ms 989µs 22µs 4ms 2023-08-31T22:04:09.4145908Z 2023-08-31T22:04:09.4177789Z ✓ Successful request 2023-08-31T22:04:09.4206190Z 2023-08-31T22:04:09.4206651Z Iteration 80/82 2023-08-31T22:04:09.4218346Z 2023-08-31T22:04:09.4218728Z → management request 2023-08-31T22:04:09.4581337Z POST http://localhost:8081/models?url=squeezenet1_1.mar&model_name=squeezenet1_1 2023-08-31T22:04:09.4582229Z 200 OK ★ 32ms time ★ 299B↑ 409B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.4593722Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 142B 2023-08-31T22:04:09.4594124Z │ { 2023-08-31T22:04:09.4594493Z │ "status": "Model \"squeezenet1_1\" Version: 1.0 regi 2023-08-31T22:04:09.4594968Z │ stered with 0 initial workers. Use scale workers API t 2023-08-31T22:04:09.4595705Z │ o add workers for the model." 2023-08-31T22:04:09.4596022Z │ } 2023-08-31T22:04:09.4596238Z └ 2023-08-31T22:04:09.4596649Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.4597132Z 1ms 154µs (cache) (cache) 29ms 997µs 28µs 32ms 2023-08-31T22:04:09.4597338Z 2023-08-31T22:04:09.4628544Z ✓ Successful request 2023-08-31T22:04:09.4654797Z 2023-08-31T22:04:09.4655054Z Iteration 81/82 2023-08-31T22:04:09.4666908Z 2023-08-31T22:04:09.4667285Z → management request 2023-08-31T22:04:09.4754097Z DELETE http://localhost:8081/models/squeezenet1_1/?timeout=true&synchronous=-1 2023-08-31T22:04:09.4754714Z 200 OK ★ 4ms time ★ 278B↑ 321B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.4755198Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:04:09.4756485Z │ { 2023-08-31T22:04:09.4757099Z │ "status": "Model \"squeezenet1_1\" unregistered" 2023-08-31T22:04:09.4757487Z │ } 2023-08-31T22:04:09.4770468Z └ 2023-08-31T22:04:09.4771092Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.4771717Z 977µs 154µs (cache) (cache) 2ms 1ms 23µs 4ms 2023-08-31T22:04:09.4772302Z 2023-08-31T22:04:09.4804123Z ✓ Successful request 2023-08-31T22:04:09.4831494Z 2023-08-31T22:04:09.4831857Z Iteration 82/82 2023-08-31T22:04:09.4889086Z 2023-08-31T22:04:09.4889564Z → management request 2023-08-31T22:04:09.4953566Z DELETE http://localhost:8081/models/invalid_squeezenet1_1 2023-08-31T22:04:09.4954340Z 404 Not Found ★ 3ms time ★ 257B↑ 378B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:09.4955148Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 109B 2023-08-31T22:04:09.4955587Z │ { 2023-08-31T22:04:09.4956178Z │ "code": 404, 2023-08-31T22:04:09.4956639Z │ "type": "ModelNotFoundException", 2023-08-31T22:04:09.4957421Z │ "message": "Model not found: invalid_squeezenet1_1" 2023-08-31T22:04:09.4957848Z │ } 2023-08-31T22:04:09.4962601Z └ 2023-08-31T22:04:09.4963178Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:09.4964032Z 1ms 158µs (cache) (cache) 942µs 1ms 21µs 3ms 2023-08-31T22:04:09.4964388Z 2023-08-31T22:04:09.4998205Z ✓ Successful request 2023-08-31T22:04:09.6908039Z 2023-08-31T22:04:09.6908894Z ┌─────────────────────────┬─────────────────────┬─────────────────────┐ 2023-08-31T22:04:09.6909997Z │ │ executed │ failed │ 2023-08-31T22:04:09.6910584Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:09.6911496Z │ iterations │ 82 │ 0 │ 2023-08-31T22:04:09.6912049Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:09.6913134Z │ requests │ 82 │ 0 │ 2023-08-31T22:04:09.6913682Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:09.6914545Z │ test-scripts │ 82 │ 0 │ 2023-08-31T22:04:09.6915093Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:09.6916006Z │ prerequest-scripts │ 0 │ 0 │ 2023-08-31T22:04:09.6916575Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:09.6917477Z │ assertions │ 82 │ 0 │ 2023-08-31T22:04:09.6918020Z ├─────────────────────────┴─────────────────────┴─────────────────────┤ 2023-08-31T22:04:09.6918880Z │ total run duration: 17.4s │ 2023-08-31T22:04:09.6919432Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:09.6920292Z │ total data received: 8.02kB (approx) │ 2023-08-31T22:04:09.6920875Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:09.6921744Z │ average response time: 193ms [min: 3ms, max: 4.1s, s.d.: 689ms] │ 2023-08-31T22:04:09.6922313Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:09.6923226Z │ average DNS lookup time: 4ms [min: 122µs, max: 10ms, s.d.: 4ms] │ 2023-08-31T22:04:09.6923799Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:09.6924658Z │ average first byte time: 190ms [min: 871µs, max: 4.1s, s.d.: 689ms] │ 2023-08-31T22:04:09.6925225Z └─────────────────────────────────────────────────────────────────────┘ 2023-08-31T22:04:09.7780560Z ## Create symlink for mar files 2023-08-31T22:04:09.7780961Z 2023-08-31T22:04:09.7781597Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-08-31T22:04:09.7807439Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-08-31T22:04:09.7835517Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-08-31T22:04:09.7836847Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-08-31T22:04:09.7837747Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-08-31T22:04:09.7838599Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-08-31T22:04:09.7839158Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-08-31T22:04:09.7839690Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-08-31T22:04:09.7844217Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-08-31T22:04:09.7844879Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-08-31T22:04:09.7845921Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-08-31T22:04:09.7846622Z ## Starting TorchServe 2023-08-31T22:04:09.7847355Z ## Console logs redirected to file: ts_console.log 2023-08-31T22:04:09.7848136Z ## In directory: /home/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=config.properties 2023-08-31T22:04:09.7849007Z ## Successfully started TorchServe 2023-08-31T22:04:09.7849389Z ## Stopping TorchServe 2023-08-31T22:04:09.7850270Z ## In directory: /home/runner/work/serve/serve/test | Executing command: ['torchserve', '--stop'] 2023-08-31T22:04:09.7850752Z ## Successfully stopped TorchServe 2023-08-31T22:04:09.7851452Z ## Starting gen_mar: model_store 2023-08-31T22:04:09.7851740Z 2023-08-31T22:04:09.7852276Z ## Create symlink for mar files 2023-08-31T22:04:09.7852564Z 2023-08-31T22:04:09.7853352Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-08-31T22:04:09.7853972Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-08-31T22:04:09.7854872Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-08-31T22:04:09.7855482Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-08-31T22:04:09.7856415Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-08-31T22:04:09.7857180Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-08-31T22:04:09.7858102Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-08-31T22:04:09.7858702Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-08-31T22:04:09.7859607Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-08-31T22:04:09.7860226Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-08-31T22:04:09.7861182Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-08-31T22:04:09.7861701Z ## Starting TorchServe 2023-08-31T22:04:09.7862408Z ## Console logs redirected to file: ts_console.log 2023-08-31T22:04:09.7863128Z ## In directory: /home/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=config.properties 2023-08-31T22:04:09.7863981Z ## Successfully started TorchServe 2023-08-31T22:04:09.7864523Z ## Stopping TorchServe 2023-08-31T22:04:09.7865420Z ## In directory: /home/runner/work/serve/serve/test | Executing command: ['torchserve', '--stop'] 2023-08-31T22:04:09.7865897Z ## Successfully stopped TorchServe 2023-08-31T22:04:09.7877476Z ## Starting gen_mar: model_store 2023-08-31T22:04:09.7878761Z 2023-08-31T22:04:09.7878879Z ## Create symlink for mar files 2023-08-31T22:04:09.7879027Z 2023-08-31T22:04:09.7879448Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-08-31T22:04:09.7880144Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-08-31T22:04:09.7880618Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-08-31T22:04:09.7881099Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-08-31T22:04:09.7881581Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-08-31T22:04:09.7882204Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-08-31T22:04:09.7882684Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-08-31T22:04:09.7883140Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-08-31T22:04:09.7883600Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-08-31T22:04:09.7884073Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-08-31T22:04:09.7884598Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-08-31T22:04:09.7884974Z ## Starting TorchServe 2023-08-31T22:04:09.7885234Z ## Console logs redirected to file: ts_console.log 2023-08-31T22:04:09.7885842Z ## In directory: /home/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=resources/config.properties 2023-08-31T22:04:09.7886259Z ## Successfully started TorchServe 2023-08-31T22:04:09.7886700Z ## Stopping TorchServe 2023-08-31T22:04:09.7887131Z ## In directory: /home/runner/work/serve/serve/test | Executing command: ['torchserve', '--stop'] 2023-08-31T22:04:09.7887464Z ## Successfully stopped TorchServe 2023-08-31T22:04:09.7887713Z ## Starting gen_mar: model_store 2023-08-31T22:04:09.7887856Z 2023-08-31T22:04:09.7887963Z ## Create symlink for mar files 2023-08-31T22:04:09.7888111Z 2023-08-31T22:04:09.7888459Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-08-31T22:04:09.7888931Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-08-31T22:04:09.7889390Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-08-31T22:04:09.7889854Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-08-31T22:04:09.7890336Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-08-31T22:04:09.7890957Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-08-31T22:04:09.7891432Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-08-31T22:04:09.7891994Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-08-31T22:04:09.7892463Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-08-31T22:04:09.7892934Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-08-31T22:04:09.7893442Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-08-31T22:04:09.7893908Z ## Starting TorchServe 2023-08-31T22:04:09.7894173Z ## Console logs redirected to file: ts_console.log 2023-08-31T22:04:09.7894749Z ## In directory: /home/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=config.properties 2023-08-31T22:04:09.7895143Z ## Successfully started TorchServe 2023-08-31T22:04:09.7895388Z ## Stopping TorchServe 2023-08-31T22:04:09.7895807Z ## In directory: /home/runner/work/serve/serve/test | Executing command: ['torchserve', '--stop'] 2023-08-31T22:04:09.7896133Z ## Successfully stopped TorchServe 2023-08-31T22:04:09.7896372Z ## Starting gen_mar: model_store 2023-08-31T22:04:09.7896518Z 2023-08-31T22:04:09.7896619Z ## Create symlink for mar files 2023-08-31T22:04:09.7896765Z 2023-08-31T22:04:09.7897101Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-08-31T22:04:09.7897566Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-08-31T22:04:09.7898022Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-08-31T22:04:11.7579210Z newman 2023-08-31T22:04:11.7579669Z 2023-08-31T22:04:11.7582198Z kf_api_test_collection 2023-08-31T22:04:11.7650516Z 2023-08-31T22:04:11.7651203Z → Model Zoo - Register Model 2023-08-31T22:04:13.8412550Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&initial_workers=1&synchronous=true 2023-08-31T22:04:13.8414659Z 200 OK ★ 2s time ★ 318B↑ 347B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:13.8417974Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 81B 2023-08-31T22:04:13.8419196Z │ { 2023-08-31T22:04:13.8419716Z │ "status": "Model \"mnist\" Version: 1.0 registered w 2023-08-31T22:04:13.8421839Z │ ith 1 initial workers" 2023-08-31T22:04:13.8422232Z │ } 2023-08-31T22:04:13.8495734Z └ 2023-08-31T22:04:13.8496294Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:13.8496920Z 25ms 5ms 12ms 309µs 2s 6ms 404µs 2s 2023-08-31T22:04:13.8497245Z 2023-08-31T22:04:13.8723498Z ✓ Successful POST request 2023-08-31T22:04:13.8820339Z 2023-08-31T22:04:13.8820726Z → Model Zoo - Inference Model 2023-08-31T22:04:13.9282067Z POST http://localhost:8080/v1/models/mnist:predict 2023-08-31T22:04:13.9283060Z 200 OK ★ 31ms time ★ 680B↑ 266B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:04:13.9283619Z ┌ ↑ file ★ 409B 2023-08-31T22:04:13.9284549Z │ 2023-08-31T22:04:13.9284981Z └ 2023-08-31T22:04:13.9285456Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 32B 2023-08-31T22:04:13.9285960Z │ { 2023-08-31T22:04:13.9286542Z │ "predictions": [ 2023-08-31T22:04:13.9287007Z │ 2 2023-08-31T22:04:13.9287412Z │ ] 2023-08-31T22:04:13.9287780Z │ } 2023-08-31T22:04:13.9304621Z └ 2023-08-31T22:04:13.9305264Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:13.9305936Z 5ms 1ms 638µs 194µs 26ms 2ms 62µs 36ms 2023-08-31T22:04:13.9306292Z 2023-08-31T22:04:13.9388729Z ✓ Successful POST request 2023-08-31T22:04:13.9398236Z ✓ Test expected JSON response 2023-08-31T22:04:13.9467981Z 2023-08-31T22:04:13.9469088Z → Model Zoo - Explanations Model 2023-08-31T22:04:14.0620955Z POST http://localhost:8080/v1/models/mnist:explain 2023-08-31T22:04:14.0622084Z 200 OK ★ 108ms time ★ 680B↑ 25.37kB↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:04:14.0623029Z ┌ ↑ file ★ 409B 2023-08-31T22:04:14.0623467Z │ 2023-08-31T22:04:14.0624048Z └ 2023-08-31T22:04:14.0624584Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 25.14kB 2023-08-31T22:04:14.0625208Z │ { 2023-08-31T22:04:14.0625622Z │ "explanations": [ 2023-08-31T22:04:14.0626220Z │ [ 2023-08-31T22:04:14.0626957Z │ [ 2023-08-31T22:04:14.0627545Z │ [ 2023-08-31T22:04:14.0627963Z │ 0.0045709488094799865, 2023-08-31T22:04:14.0628584Z │ 0.0062169697863459486, 2023-08-31T22:04:14.0629001Z │ 0.00819756531514988, 2023-08-31T22:04:14.0629637Z │ 0.0095635745877803, 2023-08-31T22:04:14.0630064Z │ 0.00899927465460433, 2023-08-31T22:04:14.0630672Z │ 0.009673474917979114, 2023-08-31T22:04:14.0631122Z │ 0.0075999053756171595, 2023-08-31T22:04:14.0631745Z │ 0.006361381003027799, 2023-08-31T22:04:14.0632152Z │ 0.005768829241605456, 2023-08-31T22:04:14.0632750Z │ 0.0043944659987649685, 2023-08-31T22:04:14.0633169Z │ 0.00494821791873362, 2023-08-31T22:04:14.0633783Z │ 0.005273460516440918, 2023-08-31T22:04:14.0634187Z │ 0.0055237994130085954, 2023-08-31T22:04:14.0634802Z │ 0.0077893556771593325, 2023-08-31T22:04:14.0635209Z │ 0.008759364077070397, 2023-08-31T22:04:14.0635838Z │ 0.004304805086224905, 2023-08-31T22:04:14.0636227Z │ 0.010970578897714597, 2023-08-31T22:04:14.0636833Z │ 0.003248439162843175, 2023-08-31T22:04:14.0637240Z │ 0.005998033334629521, 2023-08-31T22:04:14.0637835Z │ 0.0037543660967432626, 2023-08-31T22:04:14.0638249Z │ 0.0027652909217877513, 2023-08-31T22:04:14.0638871Z │ 0.004314086475688887, 2023-08-31T22:04:14.0639278Z │ 0.001400857513710846, 2023-08-31T22:04:14.0639866Z │ 0.004841846860118744, 2023-08-31T22:04:14.0640276Z │ 0.0006374840694887431, 2023-08-31T22:04:14.0640886Z │ 0.0018558539958855905, 2023-08-31T22:04:14.0641300Z │ -0.0008280457869572395, 2023-08-31T22:04:14.0641903Z │ -0.0 2023-08-31T22:04:14.0642286Z │ ], 2023-08-31T22:04:14.0642855Z │ [ 2023-08-31T22:04:14.0643247Z │ 0.0016625158688088515, 2023-08-31T22:04:14.0643881Z │ 0.004443791923313637, 2023-08-31T22:04:14.0644292Z │ 0.012387840942794784, 2023-08-31T22:04:14.0644894Z │ 0.009450844793672983, 2023-08-31T22:04:14.0645291Z │ 0.016143820725416258, 2023-08-31T22:04:14.0645898Z │ 0.007797501734389601, 2023-08-31T22:04:14.0646423Z │ 0.013942240274888822, 2023-08-31T22:04:14.0647046Z │ 0.007557430275133276, 2023-08-31T22:04:14.0647630Z │ 0.005479090262520989, 2023-08-31T22:04:14.0648263Z │ 0.009751320065987442, 2023-08-31T22:04:14.0648668Z │ 0.004764407040099156, 2023-08-31T22:04:14.0649267Z │ 0.00729214799599424, 2023-08-31T22:04:14.0649687Z │ 0.011797999138020255, 2023-08-31T22:04:14.0650299Z │ 0.006462684996370837, 2023-08-31T22:04:14.0650701Z │ 0.003383213998314431, 2023-08-31T22:04:14.0651295Z │ 0.00922505859894247, 2023-08-31T22:04:14.0651715Z │ 0.001675068899769124, 2023-08-31T22:04:14.0652349Z │ 0.007362305279488393, 2023-08-31T22:04:14.0652743Z │ 0.005270057667078642, 2023-08-31T22:04:14.0653348Z │ 0.005453597964393791, 2023-08-31T22:04:14.0653754Z │ 0.00434272623410652, 2023-08-31T22:04:14.0654369Z │ 0.005856133566453029, 2023-08-31T22:04:14.0654758Z │ 0.012168383941809368, 2023-08-31T22:04:14.0655357Z │ 0.009902719851110844, 2023-08-31T22:04:14.0655767Z │ 0.009813113177048553, 2023-08-31T22:04:14.0656361Z │ 0.0034427582010033465, 2023-08-31T22:04:14.0656780Z │ 0.0022924282873765006, 2023-08-31T22:04:14.0657369Z │ -0.0 2023-08-31T22:04:14.0657745Z │ ], 2023-08-31T22:04:14.0658306Z │ [ 2023-08-31T22:04:14.0658707Z │ 0.011528255202048997, 2023-08-31T22:04:14.0659314Z │ 0.009146989389715171, 2023-08-31T22:04:14.0659707Z │ 0.022265418130421714, 2023-08-31T22:04:14.0660307Z │ 0.017558217008853023, 2023-08-31T22:04:14.0660856Z │ 0.02477055416138399, 2023-08-31T22:04:14.0661471Z │ 0.021412693032702764, 2023-08-31T22:04:14.0661833Z │ 2023-08-31T22:04:14.0662446Z │ (showing 2.05kB/25.14kB) 2023-08-31T22:04:14.0662862Z └ 2023-08-31T22:04:14.0663631Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:14.0664321Z 2ms 397µs (cache) (cache) 105ms 1ms 88µs 109ms 2023-08-31T22:04:14.0664875Z 2023-08-31T22:04:14.0927453Z ✓ Successful POST request 2023-08-31T22:04:14.0961485Z ✓ Test expected JSON response 2023-08-31T22:04:14.1043117Z 2023-08-31T22:04:14.1043666Z → Model Zoo - Unregister model 2023-08-31T22:04:14.1223108Z DELETE http://localhost:8081/models/mnist 2023-08-31T22:04:14.1223912Z 200 OK ★ 12ms time ★ 241B↑ 313B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:14.1224745Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:14.1225287Z │ { 2023-08-31T22:04:14.1225956Z │ "status": "Model \"mnist\" unregistered" 2023-08-31T22:04:14.1226379Z │ } 2023-08-31T22:04:14.1252652Z └ 2023-08-31T22:04:14.1253301Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:14.1254201Z 1ms 260µs (cache) (cache) 9ms 1ms 61µs 12ms 2023-08-31T22:04:14.1254557Z 2023-08-31T22:04:14.1327711Z ✓ Successful DELETE request 2023-08-31T22:04:14.1390634Z 2023-08-31T22:04:14.1391653Z → Model Zoo - Model Metrics 2023-08-31T22:04:14.1644857Z GET http://localhost:8082/metrics 2023-08-31T22:04:14.1649504Z 200 OK ★ 19ms time ★ 233B↑ 3.78kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:14.1650376Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 3.49kB 2023-08-31T22:04:14.1650956Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:04:14.1651945Z │ c with unit: Count 2023-08-31T22:04:14.1652441Z │ # TYPE Requests2XX counter 2023-08-31T22:04:14.1653197Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 4.0 2023-08-31T22:04:14.1653755Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:04:14.1654635Z │ c with unit: Count 2023-08-31T22:04:14.1655079Z │ # TYPE Requests5XX counter 2023-08-31T22:04:14.1655798Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:04:14.1656563Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:04:14.1657329Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:04:14.1657871Z │ ts_inference_latency_microseconds{model_name="mnist",m 2023-08-31T22:04:14.1658604Z │ odel_version="default",hostname="fv-az628-190",} 11648 2023-08-31T22:04:14.1659040Z │ 5.927 2023-08-31T22:04:14.1659727Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:04:14.1660200Z │ ic with unit: Milliseconds 2023-08-31T22:04:14.1660861Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:04:14.1661372Z │ WorkerLoadTime{WorkerName="W-9000-mnist_1.0",Level="Ho 2023-08-31T22:04:14.1662250Z │ st",Hostname="fv-az628-190",} 1793.0 2023-08-31T22:04:14.1662753Z │ # HELP ts_inference_requests_total Torchserve promethe 2023-08-31T22:04:14.1663455Z │ us counter metric with unit: Count 2023-08-31T22:04:14.1663953Z │ # TYPE ts_inference_requests_total counter 2023-08-31T22:04:14.1664673Z │ ts_inference_requests_total{model_name="mnist",model_v 2023-08-31T22:04:14.1665192Z │ ersion="default",hostname="fv-az628-190",} 2.0 2023-08-31T22:04:14.1665929Z │ # HELP Requests4XX Torchserve prometheus counter metri 2023-08-31T22:04:14.1666402Z │ c with unit: Count 2023-08-31T22:04:14.1667041Z │ # TYPE Requests4XX counter 2023-08-31T22:04:14.1667553Z │ # HELP GPUMemoryUsed Torchserve prometheus gauge metri 2023-08-31T22:04:14.1668231Z │ c with unit: Megabytes 2023-08-31T22:04:14.1668665Z │ # TYPE GPUMemoryUsed gauge 2023-08-31T22:04:14.1669363Z │ # HELP DiskUsage Torchserve prometheus gauge metric wi 2023-08-31T22:04:14.1669836Z │ th unit: Gigabytes 2023-08-31T22:04:14.1670458Z │ # TYPE DiskUsage gauge 2023-08-31T22:04:14.1670941Z │ DiskUsage{Level="Host",Hostname="fv-az628-190",} 70.33 2023-08-31T22:04:14.1671574Z │ 826065063477 2023-08-31T22:04:14.1672051Z │ # HELP ts_queue_latency_microseconds Torchserve promet 2023-08-31T22:04:14.1672768Z │ heus counter metric with unit: Microseconds 2023-08-31T22:04:14.1673263Z │ # TYPE ts_queue_latency_microseconds counter 2023-08-31T22:04:14.1674014Z │ ts_queue_latency_microseconds{model_name="mnist",model 2023-08-31T22:04:14.1674535Z │ _version="default",hostname="fv-az628-190",} 1764.8990 2023-08-31T22:04:14.1675166Z │ 000000001 2023-08-31T22:04:14.1675640Z │ # HELP MemoryAvailable Torchserve prometheus gauge met 2023-08-31T22:04:14.1676318Z │ ric with unit: Megabytes 2023-08-31T22:04:14.1676765Z │ # TYPE MemoryAvailable gauge 2023-08-31T22:04:14.1677473Z │ MemoryAvailable{Level="Host",Hostname="fv-az628-190",} 2023-08-31T22:04:14.1677910Z │ 5482.1640625 2023-08-31T22:04:14.1678611Z │ # HELP PredictionTime Torchserve prometheus gauge metr 2023-08-31T22:04:14.1679066Z │ ic with unit: ms 2023-08-31T22:04:14.1679689Z │ # TYPE PredictionTime gauge 2023-08-31T22:04:14.1680194Z │ PredictionTime{ModelName="mnist",Level="Model",Hostnam 2023-08-31T22:04:14.1680859Z │ e="fv-az628-190",} 97.76 2023-08-31T22:04:14.1681355Z │ # HELP HandlerTime Torchserve prometheus gauge metric 2023-08-31T22:04:14.1682012Z │ with unit: ms 2023-08-31T22:04:14.1682436Z │ # TYPE HandlerTime gauge 2023-08-31T22:04:14.1683065Z │ HandlerTime{ModelNam 2023-08-31T22:04:14.1683484Z │ (showing 2.05kB/3.49kB) 2023-08-31T22:04:14.1684103Z └ 2023-08-31T22:04:14.1684662Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:14.1685507Z 1ms 741µs 191µs 132µs 16ms 1ms 63µs 20ms 2023-08-31T22:04:14.1685848Z 2023-08-31T22:04:14.1743739Z ✓ Successful GET request 2023-08-31T22:04:14.3597346Z 2023-08-31T22:04:14.3598201Z ┌─────────────────────────┬───────────────────┬───────────────────┐ 2023-08-31T22:04:14.3599122Z │ │ executed │ failed │ 2023-08-31T22:04:14.3599702Z ├─────────────────────────┼───────────────────┼───────────────────┤ 2023-08-31T22:04:14.3600463Z │ iterations │ 1 │ 0 │ 2023-08-31T22:04:14.3601316Z ├─────────────────────────┼───────────────────┼───────────────────┤ 2023-08-31T22:04:14.3602094Z │ requests │ 5 │ 0 │ 2023-08-31T22:04:14.3602639Z ├─────────────────────────┼───────────────────┼───────────────────┤ 2023-08-31T22:04:14.3603393Z │ test-scripts │ 5 │ 0 │ 2023-08-31T22:04:14.3603928Z ├─────────────────────────┼───────────────────┼───────────────────┤ 2023-08-31T22:04:14.3604677Z │ prerequest-scripts │ 0 │ 0 │ 2023-08-31T22:04:14.3605237Z ├─────────────────────────┼───────────────────┼───────────────────┤ 2023-08-31T22:04:14.3606153Z │ assertions │ 7 │ 0 │ 2023-08-31T22:04:14.3606834Z ├─────────────────────────┴───────────────────┴───────────────────┤ 2023-08-31T22:04:14.3607595Z │ total run duration: 2.4s │ 2023-08-31T22:04:14.3608148Z ├─────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:14.3608923Z │ total data received: 28.78kB (approx) │ 2023-08-31T22:04:14.3609469Z ├─────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:14.3610245Z │ average response time: 440ms [min: 12ms, max: 2s, s.d.: 796ms] │ 2023-08-31T22:04:14.3610815Z ├─────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:14.3611576Z │ average DNS lookup time: 5ms [min: 191µs, max: 12ms, s.d.: 5ms] │ 2023-08-31T22:04:14.3612133Z ├─────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:14.3612919Z │ average first byte time: 432ms [min: 9ms, max: 2s, s.d.: 787ms] │ 2023-08-31T22:04:14.3613480Z └─────────────────────────────────────────────────────────────────┘ 2023-08-31T22:04:16.8351061Z newman 2023-08-31T22:04:16.8351387Z 2023-08-31T22:04:16.8353494Z kf_https_test_collection 2023-08-31T22:04:16.8440842Z 2023-08-31T22:04:16.8441510Z → HTTPS Inference API Description 2023-08-31T22:04:17.0797968Z OPTIONS https://localhost:8443 2023-08-31T22:04:17.0798990Z 200 OK ★ 194ms time ★ 230B↑ 23.67kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:17.0802468Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 23.41kB 2023-08-31T22:04:17.0804166Z │ { 2023-08-31T22:04:17.0804500Z │ "openapi": "3.0.1", 2023-08-31T22:04:17.0804836Z │ "info": { 2023-08-31T22:04:17.0805192Z │ "title": "TorchServe APIs", 2023-08-31T22:04:17.0805627Z │ "description": "TorchServe is a flexible and easy 2023-08-31T22:04:17.0806087Z │ to use tool for serving deep learning models", 2023-08-31T22:04:17.0806749Z │ "version": "0.8.2" 2023-08-31T22:04:17.0807064Z │ }, 2023-08-31T22:04:17.0807362Z │ "paths": { 2023-08-31T22:04:17.0807672Z │ "/": { 2023-08-31T22:04:17.0807986Z │ "options": { 2023-08-31T22:04:17.0808382Z │ "description": "Get openapi description.", 2023-08-31T22:04:17.0808819Z │ "operationId": "apiDescription", 2023-08-31T22:04:17.0809209Z │ "parameters": [], 2023-08-31T22:04:17.0809577Z │ "responses": { 2023-08-31T22:04:17.0809898Z │ "200": { 2023-08-31T22:04:17.0810298Z │ "description": "A openapi 3.0.1 descriptor 2023-08-31T22:04:17.0810639Z │ ", 2023-08-31T22:04:17.0810955Z │ "content": { 2023-08-31T22:04:17.0811314Z │ "application/json": { 2023-08-31T22:04:17.0811677Z │ "schema": { 2023-08-31T22:04:17.0812034Z │ "type": "object", 2023-08-31T22:04:17.0812378Z │ "required": [ 2023-08-31T22:04:17.0812976Z │ "openapi", 2023-08-31T22:04:17.0813313Z │ "info", 2023-08-31T22:04:17.0813644Z │ "paths" 2023-08-31T22:04:17.0813957Z │ ], 2023-08-31T22:04:17.0814305Z │ "properties": { 2023-08-31T22:04:17.0814666Z │ "openapi": { 2023-08-31T22:04:17.0815024Z │ "type": "string" 2023-08-31T22:04:17.0815386Z │ }, 2023-08-31T22:04:17.0815720Z │ "info": { 2023-08-31T22:04:17.0816081Z │ "type": "object" 2023-08-31T22:04:17.0816404Z │ }, 2023-08-31T22:04:17.0816736Z │ "paths": { 2023-08-31T22:04:17.0817097Z │ "type": "object" 2023-08-31T22:04:17.0817416Z │ } 2023-08-31T22:04:17.0817733Z │ } 2023-08-31T22:04:17.0818045Z │ } 2023-08-31T22:04:17.0818353Z │ } 2023-08-31T22:04:17.0818661Z │ } 2023-08-31T22:04:17.0818958Z │ }, 2023-08-31T22:04:17.0819269Z │ "500": { 2023-08-31T22:04:17.0819657Z │ "description": "Internal Server Error", 2023-08-31T22:04:17.0820036Z │ "content": { 2023-08-31T22:04:17.0820393Z │ "application/json": { 2023-08-31T22:04:17.0820744Z │ "schema": { 2023-08-31T22:04:17.0821106Z │ "type": "object", 2023-08-31T22:04:17.0821465Z │ "required": [ 2023-08-31T22:04:17.0821807Z │ "code", 2023-08-31T22:04:17.0822137Z │ "type", 2023-08-31T22:04:17.0822467Z │ "message" 2023-08-31T22:04:17.0822787Z │ ], 2023-08-31T22:04:17.0823131Z │ "properties": { 2023-08-31T22:04:17.0823471Z │ "code": { 2023-08-31T22:04:17.0823834Z │ "type": "integer", 2023-08-31T22:04:17.0824250Z │ "description": "Error code." 2023-08-31T22:04:17.0824603Z │ }, 2023-08-31T22:04:17.0824925Z │ "type": { 2023-08-31T22:04:17.0825285Z │ "type": "string", 2023-08-31T22:04:17.0825683Z │ "description": "Error type." 2023-08-31T22:04:17.0826037Z │ }, 2023-08-31T22:04:17.0826887Z │ "message": { 2023-08-31T22:04:17.0827896Z │ "type": "string", 2023-08-31T22:04:17.0828240Z │ "description": "Error message." 2023-08-31T22:04:17.0828516Z │ } 2023-08-31T22:04:17.0828753Z │ } 2023-08-31T22:04:17.0828993Z │ } 2023-08-31T22:04:17.0829216Z │ } 2023-08-31T22:04:17.0829445Z │ } 2023-08-31T22:04:17.0829670Z │ } 2023-08-31T22:04:17.0829888Z │ } 2023-08-31T22:04:17.0830106Z │ } 2023-08-31T22:04:17.0830440Z │ }, 2023-08-31T22:04:17.0830661Z │ "/ping": { 2023-08-31T22:04:17.0830884Z │ 2023-08-31T22:04:17.0831142Z │ (showing 2.05kB/23.41kB) 2023-08-31T22:04:17.0881815Z └ 2023-08-31T22:04:17.0882300Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:17.0882849Z 24ms 8ms 9ms 580µs 120ms 48ms 6ms 582µs 218ms 2023-08-31T22:04:17.0883047Z 2023-08-31T22:04:17.1247209Z ✓ Status code is 200 2023-08-31T22:04:17.1327554Z 2023-08-31T22:04:17.1328182Z → HTTPS Management API Description 2023-08-31T22:04:17.1961881Z OPTIONS https://localhost:8444 2023-08-31T22:04:17.1965709Z 200 OK ★ 57ms time ★ 230B↑ 60.36kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:17.1969933Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 60.09kB 2023-08-31T22:04:17.1974849Z │ { 2023-08-31T22:04:17.1975425Z │ "openapi": "3.0.1", 2023-08-31T22:04:17.1976284Z │ "info": { 2023-08-31T22:04:17.1976677Z │ "title": "TorchServe APIs", 2023-08-31T22:04:17.1977055Z │ "description": "TorchServe is a flexible and easy 2023-08-31T22:04:17.1977447Z │ to use tool for serving deep learning models", 2023-08-31T22:04:17.1977753Z │ "version": "0.8.2" 2023-08-31T22:04:17.1977991Z │ }, 2023-08-31T22:04:17.1978221Z │ "paths": { 2023-08-31T22:04:17.1978442Z │ "/": { 2023-08-31T22:04:17.1978713Z │ "options": { 2023-08-31T22:04:17.1979045Z │ "description": "Get openapi description.", 2023-08-31T22:04:17.1979404Z │ "operationId": "apiDescription", 2023-08-31T22:04:17.1979700Z │ "parameters": [], 2023-08-31T22:04:17.1979975Z │ "responses": { 2023-08-31T22:04:17.1980230Z │ "200": { 2023-08-31T22:04:17.1980545Z │ "description": "A openapi 3.0.1 descriptor 2023-08-31T22:04:17.1980813Z │ ", 2023-08-31T22:04:17.1981053Z │ "content": { 2023-08-31T22:04:17.1981332Z │ "application/json": { 2023-08-31T22:04:17.1981632Z │ "schema": { 2023-08-31T22:04:17.1981912Z │ "type": "object", 2023-08-31T22:04:17.1982179Z │ "required": [ 2023-08-31T22:04:17.1982454Z │ "openapi", 2023-08-31T22:04:17.1982716Z │ "info", 2023-08-31T22:04:17.1982964Z │ "paths" 2023-08-31T22:04:17.1983202Z │ ], 2023-08-31T22:04:17.1983491Z │ "properties": { 2023-08-31T22:04:17.1983766Z │ "openapi": { 2023-08-31T22:04:17.1984057Z │ "type": "string" 2023-08-31T22:04:17.1984319Z │ }, 2023-08-31T22:04:17.1984568Z │ "info": { 2023-08-31T22:04:17.1984848Z │ "type": "object" 2023-08-31T22:04:17.1985107Z │ }, 2023-08-31T22:04:17.1985365Z │ "paths": { 2023-08-31T22:04:17.1985633Z │ "type": "object" 2023-08-31T22:04:17.1985902Z │ } 2023-08-31T22:04:17.1986140Z │ } 2023-08-31T22:04:17.1986369Z │ } 2023-08-31T22:04:17.1986602Z │ } 2023-08-31T22:04:17.1986831Z │ } 2023-08-31T22:04:17.1987070Z │ }, 2023-08-31T22:04:17.1987303Z │ "500": { 2023-08-31T22:04:17.1987958Z │ "description": "Internal Server Error", 2023-08-31T22:04:17.1988271Z │ "content": { 2023-08-31T22:04:17.1988560Z │ "application/json": { 2023-08-31T22:04:17.1988842Z │ "schema": { 2023-08-31T22:04:17.1989118Z │ "type": "object", 2023-08-31T22:04:17.1989391Z │ "required": [ 2023-08-31T22:04:17.1989661Z │ "code", 2023-08-31T22:04:17.1989919Z │ "type", 2023-08-31T22:04:17.1990169Z │ "message" 2023-08-31T22:04:17.1990427Z │ ], 2023-08-31T22:04:17.1990848Z │ "properties": { 2023-08-31T22:04:17.1991119Z │ "code": { 2023-08-31T22:04:17.1991412Z │ "type": "integer", 2023-08-31T22:04:17.1991740Z │ "description": "Error code." 2023-08-31T22:04:17.1992015Z │ }, 2023-08-31T22:04:17.1992276Z │ "type": { 2023-08-31T22:04:17.1992573Z │ "type": "string", 2023-08-31T22:04:17.1992888Z │ "description": "Error type." 2023-08-31T22:04:17.1993168Z │ }, 2023-08-31T22:04:17.1993435Z │ "message": { 2023-08-31T22:04:17.1993724Z │ "type": "string", 2023-08-31T22:04:17.1994038Z │ "description": "Error message." 2023-08-31T22:04:17.1994321Z │ } 2023-08-31T22:04:17.1994564Z │ } 2023-08-31T22:04:17.1994793Z │ } 2023-08-31T22:04:17.1995039Z │ } 2023-08-31T22:04:17.1995267Z │ } 2023-08-31T22:04:17.1995482Z │ } 2023-08-31T22:04:17.1995702Z │ } 2023-08-31T22:04:17.1995920Z │ } 2023-08-31T22:04:17.1996127Z │ }, 2023-08-31T22:04:17.1996357Z │ "/models": { 2023-08-31T22:04:17.1996584Z │ 2023-08-31T22:04:17.1996829Z │ (showing 2.05kB/60.09kB) 2023-08-31T22:04:17.1999053Z └ 2023-08-31T22:04:17.1999538Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:17.2000063Z 1ms 1ms 235µs 307µs 26ms 25ms 2ms 87µs 57ms 2023-08-31T22:04:17.2000257Z 2023-08-31T22:04:17.2172863Z ✓ Status code is 200 2023-08-31T22:04:17.2230158Z 2023-08-31T22:04:17.2230762Z → HTTPS Metrics API Description 2023-08-31T22:04:17.2752617Z OPTIONS https://localhost:8445 2023-08-31T22:04:17.2756311Z 200 OK ★ 46ms time ★ 230B↑ 2.82kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:17.2760183Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 2.55kB 2023-08-31T22:04:17.2764541Z │ { 2023-08-31T22:04:17.2765049Z │ "openapi": "3.0.1", 2023-08-31T22:04:17.2767554Z │ "info": { 2023-08-31T22:04:17.2767976Z │ "title": "TorchServe APIs", 2023-08-31T22:04:17.2768560Z │ "description": "TorchServe is a flexible and easy 2023-08-31T22:04:17.2769695Z │ to use tool for serving deep learning models", 2023-08-31T22:04:17.2770059Z │ "version": "0.8.2" 2023-08-31T22:04:17.2770303Z │ }, 2023-08-31T22:04:17.2770535Z │ "paths": { 2023-08-31T22:04:17.2770781Z │ "/metrics": { 2023-08-31T22:04:17.2771027Z │ "get": { 2023-08-31T22:04:17.2771367Z │ "description": "Get TorchServe application met 2023-08-31T22:04:17.2771703Z │ rics in prometheus format.", 2023-08-31T22:04:17.2772010Z │ "operationId": "metrics", 2023-08-31T22:04:17.2772292Z │ "parameters": [ 2023-08-31T22:04:17.2772531Z │ { 2023-08-31T22:04:17.2772814Z │ "in": "query", 2023-08-31T22:04:17.2773092Z │ "name": "name[]", 2023-08-31T22:04:17.2773421Z │ "description": "Names of metrics to filter 2023-08-31T22:04:17.2773696Z │ ", 2023-08-31T22:04:17.2773945Z │ "required": false, 2023-08-31T22:04:17.2774200Z │ "schema": { 2023-08-31T22:04:17.2774471Z │ "type": "string" 2023-08-31T22:04:17.2775008Z │ } 2023-08-31T22:04:17.2775239Z │ } 2023-08-31T22:04:17.2775465Z │ ], 2023-08-31T22:04:17.2775707Z │ "responses": { 2023-08-31T22:04:17.2775950Z │ "200": { 2023-08-31T22:04:17.2776274Z │ "description": "TorchServe application met 2023-08-31T22:04:17.2776553Z │ rics", 2023-08-31T22:04:17.2776799Z │ "content": { 2023-08-31T22:04:17.2777114Z │ "text/plain; version=0.0.4; charset=utf- 2023-08-31T22:04:17.2777380Z │ 8": { 2023-08-31T22:04:17.2777633Z │ "schema": { 2023-08-31T22:04:17.2778051Z │ "type": "object", 2023-08-31T22:04:17.2778338Z │ "required": [ 2023-08-31T22:04:17.2778608Z │ "# HELP", 2023-08-31T22:04:17.2778864Z │ "# TYPE", 2023-08-31T22:04:17.2779128Z │ "metric" 2023-08-31T22:04:17.2779380Z │ ], 2023-08-31T22:04:17.2779661Z │ "properties": { 2023-08-31T22:04:17.2779945Z │ "# HELP": { 2023-08-31T22:04:17.2780241Z │ "type": "string", 2023-08-31T22:04:17.2780565Z │ "description": "Help text for To 2023-08-31T22:04:17.2780866Z │ rchServe metric." 2023-08-31T22:04:17.2781122Z │ }, 2023-08-31T22:04:17.2781372Z │ "# TYPE": { 2023-08-31T22:04:17.2781657Z │ "type": "string", 2023-08-31T22:04:17.2781980Z │ "description": "Type of TorchSer 2023-08-31T22:04:17.2782270Z │ ve metric." 2023-08-31T22:04:17.2782500Z │ }, 2023-08-31T22:04:17.2782758Z │ "metric": { 2023-08-31T22:04:17.2783047Z │ "type": "string", 2023-08-31T22:04:17.2783365Z │ "description": "TorchServe appli 2023-08-31T22:04:17.2783646Z │ cation metric." 2023-08-31T22:04:17.2783891Z │ } 2023-08-31T22:04:17.2784136Z │ } 2023-08-31T22:04:17.2784372Z │ } 2023-08-31T22:04:17.2784604Z │ } 2023-08-31T22:04:17.2784821Z │ } 2023-08-31T22:04:17.2785046Z │ }, 2023-08-31T22:04:17.2785282Z │ "500": { 2023-08-31T22:04:17.2785591Z │ "description": "Internal Server Error", 2023-08-31T22:04:17.2785897Z │ "content": { 2023-08-31T22:04:17.2786183Z │ "application/json": { 2023-08-31T22:04:17.2786456Z │ "schema": { 2023-08-31T22:04:17.2786750Z │ "type": "object", 2023-08-31T22:04:17.2787033Z │ "required": [ 2023-08-31T22:04:17.2787285Z │ "code", 2023-08-31T22:04:17.2787537Z │ "type", 2023-08-31T22:04:17.2787793Z │ "message" 2023-08-31T22:04:17.2788044Z │ ], 2023-08-31T22:04:17.2788308Z │ "properties": { 2023-08-31T22:04:17.2788601Z │ "code": { 2023-08-31T22:04:17.2788844Z │ 2023-08-31T22:04:17.2789090Z │ (showing 2.05kB/2.55kB) 2023-08-31T22:04:17.2789326Z └ 2023-08-31T22:04:17.2789778Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:17.2790308Z 1ms 1ms 185µs 607µs 37ms 3ms 2ms 69µs 46ms 2023-08-31T22:04:17.2790509Z 2023-08-31T22:04:17.2944433Z ✓ Status code is 200 2023-08-31T22:04:17.2999853Z 2023-08-31T22:04:17.3000468Z → HTTPS Register Model - Mnist 2023-08-31T22:04:19.1839702Z POST https://localhost:8444/models?url=mnist.mar&model_name=mnist&initial_workers=1&synchronous=true 2023-08-31T22:04:19.1845698Z 200 OK ★ 1876ms time ★ 318B↑ 347B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:19.1846207Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 81B 2023-08-31T22:04:19.1846872Z │ { 2023-08-31T22:04:19.1847544Z │ "status": "Model \"mnist\" Version: 1.0 registered w 2023-08-31T22:04:19.1848069Z │ ith 1 initial workers" 2023-08-31T22:04:19.1848383Z │ } 2023-08-31T22:04:19.1864078Z └ 2023-08-31T22:04:19.1864617Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:19.1865242Z 1ms 518µs (cache) (cache) (cache) 1873ms 2ms 77µs 1877ms 2023-08-31T22:04:19.1865517Z 2023-08-31T22:04:19.1913470Z ✓ Successful POST request 2023-08-31T22:04:19.1981626Z 2023-08-31T22:04:19.1982067Z → HTTPS Get Mnist Model Description 2023-08-31T22:04:19.2122025Z GET https://localhost:8444/models/mnist 2023-08-31T22:04:19.2122703Z 200 OK ★ 8ms time ★ 238B↑ 827B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:19.2123333Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 560B 2023-08-31T22:04:19.2123819Z │ [ 2023-08-31T22:04:19.2124034Z │ { 2023-08-31T22:04:19.2124280Z │ "modelName": "mnist", 2023-08-31T22:04:19.2124607Z │ "modelVersion": "1.0", 2023-08-31T22:04:19.2125081Z │ "modelUrl": "mnist.mar", 2023-08-31T22:04:19.2125374Z │ "runtime": "python", 2023-08-31T22:04:19.2125724Z │ "minWorkers": 1, 2023-08-31T22:04:19.2126062Z │ "maxWorkers": 1, 2023-08-31T22:04:19.2126499Z │ "batchSize": 1, 2023-08-31T22:04:19.2126844Z │ "maxBatchDelay": 100, 2023-08-31T22:04:19.2127213Z │ "loadedAtStartup": false, 2023-08-31T22:04:19.2127561Z │ "workers": [ 2023-08-31T22:04:19.2127867Z │ { 2023-08-31T22:04:19.2128182Z │ "id": "9000", 2023-08-31T22:04:19.2128595Z │ "startTime": "2023-08-31T22:04:17.380Z", 2023-08-31T22:04:19.2128968Z │ "status": "READY", 2023-08-31T22:04:19.2129318Z │ "memoryUsage": 0, 2023-08-31T22:04:19.2129648Z │ "pid": 12799, 2023-08-31T22:04:19.2129973Z │ "gpu": false, 2023-08-31T22:04:19.2130307Z │ "gpuUsage": "N/A" 2023-08-31T22:04:19.2130608Z │ } 2023-08-31T22:04:19.2130909Z │ ], 2023-08-31T22:04:19.2131255Z │ "jobQueueStatus": { 2023-08-31T22:04:19.2131630Z │ "remainingCapacity": 100, 2023-08-31T22:04:19.2131997Z │ "pendingRequests": 0 2023-08-31T22:04:19.2132313Z │ } 2023-08-31T22:04:19.2132543Z │ } 2023-08-31T22:04:19.2132809Z │ ] 2023-08-31T22:04:19.2146943Z └ 2023-08-31T22:04:19.2147388Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:19.2148014Z 1ms 404µs (cache) (cache) (cache) 5ms 1ms 55µs 8ms 2023-08-31T22:04:19.2148315Z 2023-08-31T22:04:19.2198829Z ✓ Successful GET request 2023-08-31T22:04:19.2248358Z 2023-08-31T22:04:19.2248780Z → HTTPS Scale up Workers - Synchronous for Mnist 2023-08-31T22:04:23.0487672Z PUT https://localhost:8444/models/mnist?min_worker=5&max_worker=5&synchronous=true 2023-08-31T22:04:23.0491307Z 200 OK ★ 3.8s time ★ 300B↑ 321B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:23.0494645Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:04:23.0497758Z │ { 2023-08-31T22:04:23.0498312Z │ "status": "Workers scaled to 5 for model: mnist" 2023-08-31T22:04:23.0500735Z │ } 2023-08-31T22:04:23.0522317Z └ 2023-08-31T22:04:23.0523051Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:23.0523881Z 1ms 300µs (cache) (cache) (cache) 3.8s 1ms 57µs 3.8s 2023-08-31T22:04:23.0525280Z 2023-08-31T22:04:23.0584906Z ✓ Successful PUT request 2023-08-31T22:04:23.0648671Z 2023-08-31T22:04:23.0649232Z → HTTPS Scale up Workers - Asynchronous for Mnist 2023-08-31T22:04:23.0759205Z PUT https://localhost:8444/models/mnist?min_worker=6&max_worker=6&synchronous=false 2023-08-31T22:04:23.0807318Z 202 Accepted ★ 5ms time ★ 301B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:23.0808457Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:23.0809035Z │ { 2023-08-31T22:04:23.0809795Z │ "status": "Processing worker updates..." 2023-08-31T22:04:23.0810114Z │ } 2023-08-31T22:04:23.0810320Z └ 2023-08-31T22:04:23.0810767Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:23.0811312Z 1ms 309µs (cache) (cache) (cache) 2ms 1ms 44µs 6ms 2023-08-31T22:04:23.0811511Z 2023-08-31T22:04:23.0834496Z ✓ Successful PUT request 2023-08-31T22:04:23.0938333Z 2023-08-31T22:04:23.0938712Z → HTTPS - Inference - Mnist_KF 2023-08-31T22:04:23.2083901Z POST https://localhost:8443/v1/models/mnist:predict 2023-08-31T22:04:23.2089553Z 200 OK ★ 102ms time ★ 680B↑ 266B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:04:23.2089910Z ┌ ↑ file ★ 409B 2023-08-31T22:04:23.2090295Z │ 2023-08-31T22:04:23.2090517Z └ 2023-08-31T22:04:23.2090920Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 32B 2023-08-31T22:04:23.2091232Z │ { 2023-08-31T22:04:23.2091539Z │ "predictions": [ 2023-08-31T22:04:23.2091860Z │ 2 2023-08-31T22:04:23.2092148Z │ ] 2023-08-31T22:04:23.2092372Z │ } 2023-08-31T22:04:23.2112048Z └ 2023-08-31T22:04:23.2112979Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:23.2113564Z 6ms 529µs (cache) (cache) (cache) 99ms 1ms 53µs 107ms 2023-08-31T22:04:23.2113780Z 2023-08-31T22:04:23.2177978Z ✓ Status code is 200 2023-08-31T22:04:23.2281016Z 2023-08-31T22:04:23.2281383Z → HTTPS - Explanations - Mnist_KF 2023-08-31T22:04:23.5225846Z POST https://localhost:8443/v1/models/mnist:explain 2023-08-31T22:04:23.5227074Z 200 OK ★ 287ms time ★ 680B↑ 25.37kB↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:04:23.5227583Z ┌ ↑ file ★ 409B 2023-08-31T22:04:23.5233315Z │ 2023-08-31T22:04:23.5235006Z └ 2023-08-31T22:04:23.5237443Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 25.14kB 2023-08-31T22:04:23.5239309Z │ { 2023-08-31T22:04:23.5239593Z │ "explanations": [ 2023-08-31T22:04:23.5239918Z │ [ 2023-08-31T22:04:23.5240127Z │ [ 2023-08-31T22:04:23.5240352Z │ [ 2023-08-31T22:04:23.5240649Z │ 0.0045709488094799865, 2023-08-31T22:04:23.5240920Z │ 0.0062169697863459486, 2023-08-31T22:04:23.5241182Z │ 0.00819756531514988, 2023-08-31T22:04:23.5241444Z │ 0.0095635745877803, 2023-08-31T22:04:23.5241702Z │ 0.00899927465460433, 2023-08-31T22:04:23.5241992Z │ 0.009673474917979114, 2023-08-31T22:04:23.5242258Z │ 0.0075999053756171595, 2023-08-31T22:04:23.5242525Z │ 0.006361381003027799, 2023-08-31T22:04:23.5242769Z │ 0.005768829241605456, 2023-08-31T22:04:23.5243034Z │ 0.0043944659987649685, 2023-08-31T22:04:23.5243295Z │ 0.00494821791873362, 2023-08-31T22:04:23.5243546Z │ 0.005273460516440918, 2023-08-31T22:04:23.5243820Z │ 0.0055237994130085954, 2023-08-31T22:04:23.5244079Z │ 0.0077893556771593325, 2023-08-31T22:04:23.5244325Z │ 0.008759364077070397, 2023-08-31T22:04:23.5244580Z │ 0.004304805086224905, 2023-08-31T22:04:23.5244832Z │ 0.010970578897714597, 2023-08-31T22:04:23.5245090Z │ 0.003248439162843175, 2023-08-31T22:04:23.5245329Z │ 0.005998033334629521, 2023-08-31T22:04:23.5245584Z │ 0.0037543660967432626, 2023-08-31T22:04:23.5245839Z │ 0.0027652909217877513, 2023-08-31T22:04:23.5246094Z │ 0.004314086475688887, 2023-08-31T22:04:23.5246656Z │ 0.001400857513710846, 2023-08-31T22:04:23.5246924Z │ 0.004841846860118744, 2023-08-31T22:04:23.5247168Z │ 0.0006374840694887431, 2023-08-31T22:04:23.5247424Z │ 0.0018558539958855905, 2023-08-31T22:04:23.5247691Z │ -0.0008280457869572395, 2023-08-31T22:04:23.5247929Z │ -0.0 2023-08-31T22:04:23.5248415Z │ ], 2023-08-31T22:04:23.5248652Z │ [ 2023-08-31T22:04:23.5248891Z │ 0.0016625158688088515, 2023-08-31T22:04:23.5249155Z │ 0.004443791923313637, 2023-08-31T22:04:23.5249409Z │ 0.012387840942794784, 2023-08-31T22:04:23.5249649Z │ 0.009450844793672983, 2023-08-31T22:04:23.5249906Z │ 0.016143820725416258, 2023-08-31T22:04:23.5250156Z │ 0.007797501734389601, 2023-08-31T22:04:23.5250397Z │ 0.013942240274888822, 2023-08-31T22:04:23.5250819Z │ 0.007557430275133276, 2023-08-31T22:04:23.5251073Z │ 0.005479090262520989, 2023-08-31T22:04:23.5251317Z │ 0.009751320065987442, 2023-08-31T22:04:23.5251555Z │ 0.004764407040099156, 2023-08-31T22:04:23.5251804Z │ 0.00729214799599424, 2023-08-31T22:04:23.5252062Z │ 0.011797999138020255, 2023-08-31T22:04:23.5252303Z │ 0.006462684996370837, 2023-08-31T22:04:23.5252576Z │ 0.003383213998314431, 2023-08-31T22:04:23.5252827Z │ 0.00922505859894247, 2023-08-31T22:04:23.5253077Z │ 0.001675068899769124, 2023-08-31T22:04:23.5253323Z │ 0.007362305279488393, 2023-08-31T22:04:23.5253565Z │ 0.005270057667078642, 2023-08-31T22:04:23.5253802Z │ 0.005453597964393791, 2023-08-31T22:04:23.5254050Z │ 0.00434272623410652, 2023-08-31T22:04:23.5254298Z │ 0.005856133566453029, 2023-08-31T22:04:23.5254531Z │ 0.012168383941809368, 2023-08-31T22:04:23.5254789Z │ 0.009902719851110844, 2023-08-31T22:04:23.5255035Z │ 0.009813113177048553, 2023-08-31T22:04:23.5255276Z │ 0.0034427582010033465, 2023-08-31T22:04:23.5255539Z │ 0.0022924282873765006, 2023-08-31T22:04:23.5255774Z │ -0.0 2023-08-31T22:04:23.5255999Z │ ], 2023-08-31T22:04:23.5256208Z │ [ 2023-08-31T22:04:23.5256450Z │ 0.011528255202048997, 2023-08-31T22:04:23.5256714Z │ 0.009146989389715171, 2023-08-31T22:04:23.5256951Z │ 0.022265418130421714, 2023-08-31T22:04:23.5257194Z │ 0.017558217008853023, 2023-08-31T22:04:23.5257444Z │ 0.02477055416138399, 2023-08-31T22:04:23.5257693Z │ 0.021412693032702764, 2023-08-31T22:04:23.5257915Z │ 2023-08-31T22:04:23.5258178Z │ (showing 2.05kB/25.14kB) 2023-08-31T22:04:23.5330173Z └ 2023-08-31T22:04:23.5330729Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:23.5331315Z 2ms 311µs (cache) (cache) (cache) 284ms 1ms 151µs 289ms 2023-08-31T22:04:23.5331529Z 2023-08-31T22:04:23.5346708Z ✓ Status code is 200 2023-08-31T22:04:23.5498350Z 2023-08-31T22:04:23.5498653Z → HTTPS UnRegister Model Mnist 2023-08-31T22:04:23.6126947Z DELETE https://localhost:8444/models/mnist 2023-08-31T22:04:23.6127927Z 200 OK ★ 56ms time ★ 241B↑ 313B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:23.6128511Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:23.6128868Z │ { 2023-08-31T22:04:23.6129263Z │ "status": "Model \"mnist\" unregistered" 2023-08-31T22:04:23.6129603Z │ } 2023-08-31T22:04:23.6145655Z └ 2023-08-31T22:04:23.6146192Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:23.6146832Z 1ms 351µs (cache) (cache) (cache) 53ms 1ms 75µs 57ms 2023-08-31T22:04:23.6147158Z 2023-08-31T22:04:23.6260955Z ✓ Successful DELETE request 2023-08-31T22:04:23.8123887Z 2023-08-31T22:04:23.8124893Z ┌─────────────────────────┬─────────────────────┬────────────────────┐ 2023-08-31T22:04:23.8125567Z │ │ executed │ failed │ 2023-08-31T22:04:23.8126227Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:23.8127001Z │ iterations │ 1 │ 0 │ 2023-08-31T22:04:23.8127573Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:23.8128080Z │ requests │ 10 │ 0 │ 2023-08-31T22:04:23.8128636Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:23.8223155Z │ test-scripts │ 10 │ 0 │ 2023-08-31T22:04:23.8223600Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:23.8224337Z │ prerequest-scripts │ 0 │ 0 │ 2023-08-31T22:04:23.8224760Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:23.8225131Z │ assertions │ 10 │ 0 │ 2023-08-31T22:04:23.8225536Z ├─────────────────────────┴─────────────────────┴────────────────────┤ 2023-08-31T22:04:23.8225942Z │ total run duration: 6.7s │ 2023-08-31T22:04:23.8226383Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:23.8226770Z │ total data received: 112kB (approx) │ 2023-08-31T22:04:23.8227167Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:23.8227566Z │ average response time: 644ms [min: 5ms, max: 3.8s, s.d.: 1186ms] │ 2023-08-31T22:04:23.8227980Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:23.8228418Z │ average DNS lookup time: 3ms [min: 185µs, max: 9ms, s.d.: 4ms] │ 2023-08-31T22:04:23.8228831Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:23.8229230Z │ average first byte time: 621ms [min: 2ms, max: 3.8s, s.d.: 1195ms] │ 2023-08-31T22:04:23.8229638Z └────────────────────────────────────────────────────────────────────┘ 2023-08-31T22:04:25.7796923Z newman 2023-08-31T22:04:25.7797497Z 2023-08-31T22:04:25.7802713Z kfv2_api_test_collection 2023-08-31T22:04:25.7873233Z 2023-08-31T22:04:25.7873922Z → Model Zoo - Register Model 2023-08-31T22:04:27.8445747Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&initial_workers=1&synchronous=true 2023-08-31T22:04:27.8449663Z 200 OK ★ 2s time ★ 318B↑ 347B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:27.8452495Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 81B 2023-08-31T22:04:27.8454082Z │ { 2023-08-31T22:04:27.8454585Z │ "status": "Model \"mnist\" Version: 1.0 registered w 2023-08-31T22:04:27.8455607Z │ ith 1 initial workers" 2023-08-31T22:04:27.8456002Z │ } 2023-08-31T22:04:27.8530475Z └ 2023-08-31T22:04:27.8531065Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:27.8531917Z 25ms 5ms 15ms 311µs 1982ms 9ms 416µs 2s 2023-08-31T22:04:27.8532260Z 2023-08-31T22:04:27.8739370Z ✓ Successful POST request 2023-08-31T22:04:27.8831635Z 2023-08-31T22:04:27.8832026Z → Model Zoo - Inference Model 2023-08-31T22:04:27.9554657Z POST http://localhost:8080/v2/models/mnist/infer 2023-08-31T22:04:27.9555629Z 200 OK ★ 59ms time ★ 7kB↑ 490B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:04:27.9556398Z ┌ ↑ file ★ 6.73kB 2023-08-31T22:04:27.9556855Z │ (showing 2.05kB/6.73kB) 2023-08-31T22:04:27.9557487Z └ 2023-08-31T22:04:27.9557995Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 255B 2023-08-31T22:04:27.9558622Z │ { 2023-08-31T22:04:27.9559109Z │ "id": "d3b15cad-50a2-4eaf-80ce-8b0a428bd298", 2023-08-31T22:04:27.9559831Z │ "model_name": "mnist", 2023-08-31T22:04:27.9560271Z │ "model_version": "1.0", 2023-08-31T22:04:27.9560881Z │ "outputs": [ 2023-08-31T22:04:27.9561262Z │ { 2023-08-31T22:04:27.9561865Z │ "name": "input-0", 2023-08-31T22:04:27.9562291Z │ "datatype": "INT64", 2023-08-31T22:04:27.9562902Z │ "data": [ 2023-08-31T22:04:27.9563289Z │ 1 2023-08-31T22:04:27.9563885Z │ ], 2023-08-31T22:04:27.9564268Z │ "shape": [ 2023-08-31T22:04:27.9564861Z │ 1 2023-08-31T22:04:27.9565227Z │ ] 2023-08-31T22:04:27.9565786Z │ } 2023-08-31T22:04:27.9566150Z │ ] 2023-08-31T22:04:27.9566854Z │ } 2023-08-31T22:04:27.9575821Z └ 2023-08-31T22:04:27.9576424Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:27.9577330Z 6ms 1ms 630µs 202µs 53ms 2ms 61µs 64ms 2023-08-31T22:04:27.9577719Z 2023-08-31T22:04:27.9655064Z ✓ Successful POST request 2023-08-31T22:04:27.9664674Z ✓ Test expected JSON response 2023-08-31T22:04:27.9731003Z 2023-08-31T22:04:27.9731386Z → Model Zoo - Explanations Model 2023-08-31T22:04:28.0081410Z POST http://localhost:8080/v2/models/mnist/explain 2023-08-31T22:04:28.0082329Z 200 OK ★ 27ms time ★ 7kB↑ 14.04kB↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:04:28.0083089Z ┌ ↑ file ★ 6.73kB 2023-08-31T22:04:28.0083572Z │ (showing 2.05kB/6.73kB) 2023-08-31T22:04:28.0084179Z └ 2023-08-31T22:04:28.0084655Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 13.8kB 2023-08-31T22:04:28.0085275Z │ { 2023-08-31T22:04:28.0085748Z │ "id": "d3b15cad-50a2-4eaf-80ce-8b0a428bd298", 2023-08-31T22:04:28.0086561Z │ "model_name": "mnist", 2023-08-31T22:04:28.0087010Z │ "model_version": "1.0", 2023-08-31T22:04:28.0087619Z │ "outputs": [ 2023-08-31T22:04:28.0088001Z │ { 2023-08-31T22:04:28.0088606Z │ "name": "input-0", 2023-08-31T22:04:28.0089059Z │ "datatype": "FP64", 2023-08-31T22:04:28.0089667Z │ "data": [ 2023-08-31T22:04:28.0090058Z │ -0.0, 2023-08-31T22:04:28.0090628Z │ -0.0, 2023-08-31T22:04:28.0091012Z │ -0.0, 2023-08-31T22:04:28.0091583Z │ -0.0, 2023-08-31T22:04:28.0091960Z │ -0.0, 2023-08-31T22:04:28.0092524Z │ -0.0, 2023-08-31T22:04:28.0092892Z │ -0.0, 2023-08-31T22:04:28.0093730Z │ -0.0, 2023-08-31T22:04:28.0094132Z │ -0.0, 2023-08-31T22:04:28.0094718Z │ -0.0, 2023-08-31T22:04:28.0095101Z │ -0.0, 2023-08-31T22:04:28.0095678Z │ -0.0, 2023-08-31T22:04:28.0096041Z │ -0.0, 2023-08-31T22:04:28.0096610Z │ -0.0, 2023-08-31T22:04:28.0096979Z │ -0.0, 2023-08-31T22:04:28.0097542Z │ -0.0, 2023-08-31T22:04:28.0097916Z │ 0.0, 2023-08-31T22:04:28.0098499Z │ -0.0, 2023-08-31T22:04:28.0098866Z │ -0.0, 2023-08-31T22:04:28.0099431Z │ 0.0, 2023-08-31T22:04:28.0099972Z │ -0.0, 2023-08-31T22:04:28.0100546Z │ 0.0, 2023-08-31T22:04:28.0100906Z │ -0.0, 2023-08-31T22:04:28.0101476Z │ -0.0, 2023-08-31T22:04:28.0101845Z │ -0.0, 2023-08-31T22:04:28.0102412Z │ -0.0, 2023-08-31T22:04:28.0102771Z │ -0.0, 2023-08-31T22:04:28.0103339Z │ 0.0, 2023-08-31T22:04:28.0103714Z │ -0.0, 2023-08-31T22:04:28.0104293Z │ -0.0, 2023-08-31T22:04:28.0104664Z │ -0.0, 2023-08-31T22:04:28.0105231Z │ -0.0, 2023-08-31T22:04:28.0105587Z │ -0.0, 2023-08-31T22:04:28.0106158Z │ -0.0, 2023-08-31T22:04:28.0106525Z │ -0.0, 2023-08-31T22:04:28.0107097Z │ 0.0, 2023-08-31T22:04:28.0107463Z │ -0.0, 2023-08-31T22:04:28.0108034Z │ 0.0, 2023-08-31T22:04:28.0108410Z │ -0.0, 2023-08-31T22:04:28.0108968Z │ -0.0, 2023-08-31T22:04:28.0109338Z │ -0.0, 2023-08-31T22:04:28.0109907Z │ 0.0, 2023-08-31T22:04:28.0110294Z │ 0.0, 2023-08-31T22:04:28.0110856Z │ 0.0, 2023-08-31T22:04:28.0111231Z │ 0.0, 2023-08-31T22:04:28.0111802Z │ 0.0, 2023-08-31T22:04:28.0112160Z │ 0.0, 2023-08-31T22:04:28.0112730Z │ 0.0, 2023-08-31T22:04:28.0113103Z │ 0.0, 2023-08-31T22:04:28.0113671Z │ 0.0, 2023-08-31T22:04:28.0114045Z │ -0.0, 2023-08-31T22:04:28.0114631Z │ -0.0, 2023-08-31T22:04:28.0115006Z │ 0.0, 2023-08-31T22:04:28.0115562Z │ 0.0, 2023-08-31T22:04:28.0115932Z │ -0.0, 2023-08-31T22:04:28.0116502Z │ 0.0, 2023-08-31T22:04:28.0116858Z │ -0.0, 2023-08-31T22:04:28.0117428Z │ -0.0, 2023-08-31T22:04:28.0117797Z │ -0.0, 2023-08-31T22:04:28.0118365Z │ -0.0, 2023-08-31T22:04:28.0118728Z │ -0.0, 2023-08-31T22:04:28.0119297Z │ 0.0, 2023-08-31T22:04:28.0119669Z │ 0.0, 2023-08-31T22:04:28.0120228Z │ 0.0, 2023-08-31T22:04:28.0120614Z │ 0.0, 2023-08-31T22:04:28.0121181Z │ 0.0, 2023-08-31T22:04:28.0121549Z │ 0.0, 2023-08-31T22:04:28.0122106Z │ 0.0, 2023-08-31T22:04:28.0122471Z │ 0.0, 2023-08-31T22:04:28.0123048Z │ 0.0, 2023-08-31T22:04:28.0123406Z │ -0.0, 2023-08-31T22:04:28.0123976Z │ -0.0, 2023-08-31T22:04:28.0124349Z │ -0.0, 2023-08-31T22:04:28.0125080Z │ 0.0, 2023-08-31T22:04:28.0125462Z │ -0.0, 2023-08-31T22:04:28.0126035Z │ 0.0, 2023-08-31T22:04:28.0126596Z │ 0.0, 2023-08-31T22:04:28.0127171Z │ 0.0, 2023-08-31T22:04:28.0127543Z │ -0.0, 2023-08-31T22:04:28.0128113Z │ -0.0, 2023-08-31T22:04:28.0128478Z │ -0.0, 2023-08-31T22:04:28.0129047Z │ 0.0, 2023-08-31T22:04:28.0129415Z │ -0.0, 2023-08-31T22:04:28.0129986Z │ 0.0, 2023-08-31T22:04:28.0130348Z │ -0.0, 2023-08-31T22:04:28.0130916Z │ -0.0, 2023-08-31T22:04:28.0131305Z │ -0.0, 2023-08-31T22:04:28.0131863Z │ -0.0, 2023-08-31T22:04:28.0132233Z │ 0.0, 2023-08-31T22:04:28.0132804Z │ 0.0, 2023-08-31T22:04:28.0133183Z │ 0.0, 2023-08-31T22:04:28.0133741Z │ 0.0, 2023-08-31T22:04:28.0134111Z │ 0.0, 2023-08-31T22:04:28.0134681Z │ 0.0, 2023-08-31T22:04:28.0135034Z │ 0.0, 2023-08-31T22:04:28.0135618Z │ -0.0, 2023-08-31T22:04:28.0135989Z │ -0.0, 2023-08-31T22:04:28.0136557Z │ 0.0, 2023-08-31T22:04:28.0136917Z │ 0.0, 2023-08-31T22:04:28.0137482Z │ -0.0, 2023-08-31T22:04:28.0137854Z │ -0.0, 2023-08-31T22:04:28.0138411Z │ -0.0, 2023-08-31T22:04:28.0138778Z │ -0.0, 2023-08-31T22:04:28.0139344Z │ -0.0, 2023-08-31T22:04:28.0139706Z │ 0.0, 2023-08-31T22:04:28.0140275Z │ 0.0, 2023-08-31T22:04:28.0140644Z │ -0.0, 2023-08-31T22:04:28.0141222Z │ -0.0, 2023-08-31T22:04:28.0141735Z │ -0.0, 2023-08-31T22:04:28.0142313Z │ 0.0, 2023-08-31T22:04:28.0142681Z │ 0.0, 2023-08-31T22:04:28.0143241Z │ 0.0, 2023-08-31T22:04:28.0143609Z │ -0.0, 2023-08-31T22:04:28.0144178Z │ -0.0, 2023-08-31T22:04:28.0144552Z │ -0.0, 2023-08-31T22:04:28.0145114Z │ -0.0, 2023-08-31T22:04:28.0145482Z │ 0.0, 2023-08-31T22:04:28.0146068Z │ 0.0, 2023-08-31T22:04:28.0146433Z │ 0.0, 2023-08-31T22:04:28.0147008Z │ 0.0, 2023-08-31T22:04:28.0147536Z │ 0.0, 2023-08-31T22:04:28.0148482Z │ 0.0, 2023-08-31T22:04:28.0148692Z │ -0.0, 2023-08-31T22:04:28.0148955Z │ -0.004054752832008137, 2023-08-31T22:04:28.0149238Z │ -0.00022612877744168094, 2023-08-31T22:04:28.0149502Z │ -0.0001273413677900525, 2023-08-31T22:04:28.0149770Z │ 0.005648369216900588, 2023-08-31T22:04:28.0150028Z │ 0.008904783847147995, 2023-08-31T22:04:28.0150293Z │ 0.002638536812407069, 2023-08-31T22:04:28.0150519Z │ 2023-08-31T22:04:28.0150771Z │ (showing 2.05kB/13.8kB) 2023-08-31T22:04:28.0150983Z └ 2023-08-31T22:04:28.0151391Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:28.0151899Z 2ms 429µs (cache) (cache) 24ms 1ms 74µs 28ms 2023-08-31T22:04:28.0152118Z 2023-08-31T22:04:28.0244955Z ✓ Successful POST request 2023-08-31T22:04:28.0271295Z ✓ Test expected JSON response 2023-08-31T22:04:28.0333124Z 2023-08-31T22:04:28.0333511Z → Model Zoo - Unregister model 2023-08-31T22:04:28.0504114Z DELETE http://localhost:8081/models/mnist 2023-08-31T22:04:28.0504872Z 200 OK ★ 11ms time ★ 241B↑ 313B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:28.0505691Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:28.0506180Z │ { 2023-08-31T22:04:28.0506850Z │ "status": "Model \"mnist\" unregistered" 2023-08-31T22:04:28.0507293Z │ } 2023-08-31T22:04:28.0534007Z └ 2023-08-31T22:04:28.0534644Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:28.0535517Z 1ms 263µs (cache) (cache) 9ms 1ms 60µs 12ms 2023-08-31T22:04:28.0535871Z 2023-08-31T22:04:28.0611073Z ✓ Successful DELETE request 2023-08-31T22:04:28.0688562Z 2023-08-31T22:04:28.0689312Z → Model Zoo - Model Metrics 2023-08-31T22:04:28.0921494Z GET http://localhost:8082/metrics 2023-08-31T22:04:28.0922356Z 200 OK ★ 16ms time ★ 233B↑ 3.76kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:28.0923167Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 3.47kB 2023-08-31T22:04:28.0923744Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:04:28.0924428Z │ c with unit: Count 2023-08-31T22:04:28.0924872Z │ # TYPE Requests2XX counter 2023-08-31T22:04:28.0925577Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 4.0 2023-08-31T22:04:28.0926624Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:04:28.0927327Z │ c with unit: Count 2023-08-31T22:04:28.0927755Z │ # TYPE Requests5XX counter 2023-08-31T22:04:28.0928487Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:04:28.0929028Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:04:28.0929762Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:04:28.0930317Z │ ts_inference_latency_microseconds{model_name="mnist",m 2023-08-31T22:04:28.0931063Z │ odel_version="default",hostname="fv-az628-190",} 62935 2023-08-31T22:04:28.0931492Z │ .837 2023-08-31T22:04:28.0932168Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:04:28.0932658Z │ ic with unit: Milliseconds 2023-08-31T22:04:28.0933311Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:04:28.0933821Z │ WorkerLoadTime{WorkerName="W-9000-mnist_1.0",Level="Ho 2023-08-31T22:04:28.0934515Z │ st",Hostname="fv-az628-190",} 1796.0 2023-08-31T22:04:28.0935036Z │ # HELP ts_inference_requests_total Torchserve promethe 2023-08-31T22:04:28.0935728Z │ us counter metric with unit: Count 2023-08-31T22:04:28.0936222Z │ # TYPE ts_inference_requests_total counter 2023-08-31T22:04:28.0936927Z │ ts_inference_requests_total{model_name="mnist",model_v 2023-08-31T22:04:28.0937441Z │ ersion="default",hostname="fv-az628-190",} 2.0 2023-08-31T22:04:28.0938179Z │ # HELP Requests4XX Torchserve prometheus counter metri 2023-08-31T22:04:28.0938646Z │ c with unit: Count 2023-08-31T22:04:28.0939267Z │ # TYPE Requests4XX counter 2023-08-31T22:04:28.0939775Z │ # HELP GPUMemoryUsed Torchserve prometheus gauge metri 2023-08-31T22:04:28.0940448Z │ c with unit: Megabytes 2023-08-31T22:04:28.0940886Z │ # TYPE GPUMemoryUsed gauge 2023-08-31T22:04:28.0941583Z │ # HELP DiskUsage Torchserve prometheus gauge metric wi 2023-08-31T22:04:28.0942040Z │ th unit: Gigabytes 2023-08-31T22:04:28.0942658Z │ # TYPE DiskUsage gauge 2023-08-31T22:04:28.0943416Z │ DiskUsage{Level="Host",Hostname="fv-az628-190",} 70.33 2023-08-31T22:04:28.0944059Z │ 908081054688 2023-08-31T22:04:28.0944540Z │ # HELP ts_queue_latency_microseconds Torchserve promet 2023-08-31T22:04:28.0945261Z │ heus counter metric with unit: Microseconds 2023-08-31T22:04:28.0945758Z │ # TYPE ts_queue_latency_microseconds counter 2023-08-31T22:04:28.0946494Z │ ts_queue_latency_microseconds{model_name="mnist",model 2023-08-31T22:04:28.0947029Z │ _version="default",hostname="fv-az628-190",} 236.9 2023-08-31T22:04:28.0947767Z │ # HELP MemoryAvailable Torchserve prometheus gauge met 2023-08-31T22:04:28.0948242Z │ ric with unit: Megabytes 2023-08-31T22:04:28.0948889Z │ # TYPE MemoryAvailable gauge 2023-08-31T22:04:28.0949392Z │ MemoryAvailable{Level="Host",Hostname="fv-az628-190",} 2023-08-31T22:04:28.0950025Z │ 5476.88671875 2023-08-31T22:04:28.0950509Z │ # HELP PredictionTime Torchserve prometheus gauge metr 2023-08-31T22:04:28.0951170Z │ ic with unit: ms 2023-08-31T22:04:28.0951624Z │ # TYPE PredictionTime gauge 2023-08-31T22:04:28.0952323Z │ PredictionTime{ModelName="mnist",Level="Model",Hostnam 2023-08-31T22:04:28.0952783Z │ e="fv-az628-190",} 19.5 2023-08-31T22:04:28.0953479Z │ # HELP HandlerTime Torchserve prometheus gauge metric 2023-08-31T22:04:28.0953930Z │ with unit: ms 2023-08-31T22:04:28.0954546Z │ # TYPE HandlerTime gauge 2023-08-31T22:04:28.0955185Z │ HandlerTime{ModelName="mnist",Leve 2023-08-31T22:04:28.0955858Z │ (showing 2.05kB/3.47kB) 2023-08-31T22:04:28.0956265Z └ 2023-08-31T22:04:28.0957028Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:28.0957666Z 1ms 653µs 192µs 125µs 13ms 1ms 61µs 17ms 2023-08-31T22:04:28.0958199Z 2023-08-31T22:04:28.1039229Z ✓ Successful GET request 2023-08-31T22:04:28.2725525Z 2023-08-31T22:04:28.2731624Z ┌─────────────────────────┬─────────────────────┬─────────────────────┐ 2023-08-31T22:04:28.2732863Z │ │ executed │ failed │ 2023-08-31T22:04:28.2733477Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:28.2734253Z │ iterations │ 1 │ 0 │ 2023-08-31T22:04:28.2734827Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:28.2735596Z │ requests │ 5 │ 0 │ 2023-08-31T22:04:28.2736164Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:28.2736921Z │ test-scripts │ 5 │ 0 │ 2023-08-31T22:04:28.2737478Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:28.2738270Z │ prerequest-scripts │ 0 │ 0 │ 2023-08-31T22:04:28.2738839Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:28.2739605Z │ assertions │ 7 │ 0 │ 2023-08-31T22:04:28.2740160Z ├─────────────────────────┴─────────────────────┴─────────────────────┤ 2023-08-31T22:04:28.2740892Z │ total run duration: 2.3s │ 2023-08-31T22:04:28.2741451Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:28.2742233Z │ total data received: 17.65kB (approx) │ 2023-08-31T22:04:28.2742799Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:28.2743571Z │ average response time: 425ms [min: 11ms, max: 2s, s.d.: 794ms] │ 2023-08-31T22:04:28.2744157Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:28.2744937Z │ average DNS lookup time: 6ms [min: 192µs, max: 15ms, s.d.: 7ms] │ 2023-08-31T22:04:28.2745513Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:28.2746315Z │ average first byte time: 416ms [min: 9ms, max: 1982ms, s.d.: 783ms] │ 2023-08-31T22:04:28.2746903Z └─────────────────────────────────────────────────────────────────────┘ 2023-08-31T22:04:30.7963573Z newman 2023-08-31T22:04:30.7963886Z 2023-08-31T22:04:30.7966159Z kfv2_https_test_collection 2023-08-31T22:04:30.7988196Z 2023-08-31T22:04:30.7988652Z → HTTPS Inference API Description 2023-08-31T22:04:31.0347694Z OPTIONS https://localhost:8443 2023-08-31T22:04:31.0351342Z 200 OK ★ 191ms time ★ 230B↑ 23.67kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:31.0358109Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 23.41kB 2023-08-31T22:04:31.0361672Z │ { 2023-08-31T22:04:31.0362553Z │ "openapi": "3.0.1", 2023-08-31T22:04:31.0362872Z │ "info": { 2023-08-31T22:04:31.0363178Z │ "title": "TorchServe APIs", 2023-08-31T22:04:31.0363536Z │ "description": "TorchServe is a flexible and easy 2023-08-31T22:04:31.0363927Z │ to use tool for serving deep learning models", 2023-08-31T22:04:31.0364589Z │ "version": "0.8.2" 2023-08-31T22:04:31.0364818Z │ }, 2023-08-31T22:04:31.0365055Z │ "paths": { 2023-08-31T22:04:31.0365294Z │ "/": { 2023-08-31T22:04:31.0365529Z │ "options": { 2023-08-31T22:04:31.0365866Z │ "description": "Get openapi description.", 2023-08-31T22:04:31.0366391Z │ "operationId": "apiDescription", 2023-08-31T22:04:31.0366709Z │ "parameters": [], 2023-08-31T22:04:31.0366994Z │ "responses": { 2023-08-31T22:04:31.0367253Z │ "200": { 2023-08-31T22:04:31.0367582Z │ "description": "A openapi 3.0.1 descriptor 2023-08-31T22:04:31.0367852Z │ ", 2023-08-31T22:04:31.0368084Z │ "content": { 2023-08-31T22:04:31.0368376Z │ "application/json": { 2023-08-31T22:04:31.0368664Z │ "schema": { 2023-08-31T22:04:31.0368940Z │ "type": "object", 2023-08-31T22:04:31.0369223Z │ "required": [ 2023-08-31T22:04:31.0369508Z │ "openapi", 2023-08-31T22:04:31.0369779Z │ "info", 2023-08-31T22:04:31.0370071Z │ "paths" 2023-08-31T22:04:31.0370317Z │ ], 2023-08-31T22:04:31.0370580Z │ "properties": { 2023-08-31T22:04:31.0370865Z │ "openapi": { 2023-08-31T22:04:31.0371159Z │ "type": "string" 2023-08-31T22:04:31.0371432Z │ }, 2023-08-31T22:04:31.0371689Z │ "info": { 2023-08-31T22:04:31.0371967Z │ "type": "object" 2023-08-31T22:04:31.0372223Z │ }, 2023-08-31T22:04:31.0372481Z │ "paths": { 2023-08-31T22:04:31.0372753Z │ "type": "object" 2023-08-31T22:04:31.0373009Z │ } 2023-08-31T22:04:31.0373241Z │ } 2023-08-31T22:04:31.0373478Z │ } 2023-08-31T22:04:31.0373720Z │ } 2023-08-31T22:04:31.0373955Z │ } 2023-08-31T22:04:31.0374186Z │ }, 2023-08-31T22:04:31.0374422Z │ "500": { 2023-08-31T22:04:31.0374732Z │ "description": "Internal Server Error", 2023-08-31T22:04:31.0375034Z │ "content": { 2023-08-31T22:04:31.0375317Z │ "application/json": { 2023-08-31T22:04:31.0375591Z │ "schema": { 2023-08-31T22:04:31.0375870Z │ "type": "object", 2023-08-31T22:04:31.0376313Z │ "required": [ 2023-08-31T22:04:31.0376576Z │ "code", 2023-08-31T22:04:31.0376827Z │ "type", 2023-08-31T22:04:31.0377084Z │ "message" 2023-08-31T22:04:31.0377322Z │ ], 2023-08-31T22:04:31.0377600Z │ "properties": { 2023-08-31T22:04:31.0377880Z │ "code": { 2023-08-31T22:04:31.0378164Z │ "type": "integer", 2023-08-31T22:04:31.0378492Z │ "description": "Error code." 2023-08-31T22:04:31.0378893Z │ }, 2023-08-31T22:04:31.0379148Z │ "type": { 2023-08-31T22:04:31.0379420Z │ "type": "string", 2023-08-31T22:04:31.0379734Z │ "description": "Error type." 2023-08-31T22:04:31.0380009Z │ }, 2023-08-31T22:04:31.0380259Z │ "message": { 2023-08-31T22:04:31.0380559Z │ "type": "string", 2023-08-31T22:04:31.0380887Z │ "description": "Error message." 2023-08-31T22:04:31.0381159Z │ } 2023-08-31T22:04:31.0381390Z │ } 2023-08-31T22:04:31.0381626Z │ } 2023-08-31T22:04:31.0381849Z │ } 2023-08-31T22:04:31.0382075Z │ } 2023-08-31T22:04:31.0382301Z │ } 2023-08-31T22:04:31.0382515Z │ } 2023-08-31T22:04:31.0382735Z │ } 2023-08-31T22:04:31.0382951Z │ }, 2023-08-31T22:04:31.0383186Z │ "/ping": { 2023-08-31T22:04:31.0383407Z │ 2023-08-31T22:04:31.0383667Z │ (showing 2.05kB/23.41kB) 2023-08-31T22:04:31.0443599Z └ 2023-08-31T22:04:31.0444073Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:31.0444608Z 24ms 8ms 9ms 1ms 125ms 40ms 5ms 570µs 215ms 2023-08-31T22:04:31.0444824Z 2023-08-31T22:04:31.0812138Z ✓ Status code is 200 2023-08-31T22:04:31.0888788Z 2023-08-31T22:04:31.0889685Z → HTTPS Management API Description 2023-08-31T22:04:31.1563983Z OPTIONS https://localhost:8444 2023-08-31T22:04:31.1565073Z 200 OK ★ 60ms time ★ 230B↑ 60.36kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:31.1566075Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 60.09kB 2023-08-31T22:04:31.1569817Z │ { 2023-08-31T22:04:31.1570279Z │ "openapi": "3.0.1", 2023-08-31T22:04:31.1570794Z │ "info": { 2023-08-31T22:04:31.1571522Z │ "title": "TorchServe APIs", 2023-08-31T22:04:31.1571911Z │ "description": "TorchServe is a flexible and easy 2023-08-31T22:04:31.1572290Z │ to use tool for serving deep learning models", 2023-08-31T22:04:31.1572612Z │ "version": "0.8.2" 2023-08-31T22:04:31.1572847Z │ }, 2023-08-31T22:04:31.1573082Z │ "paths": { 2023-08-31T22:04:31.1573315Z │ "/": { 2023-08-31T22:04:31.1573547Z │ "options": { 2023-08-31T22:04:31.1573912Z │ "description": "Get openapi description.", 2023-08-31T22:04:31.1574270Z │ "operationId": "apiDescription", 2023-08-31T22:04:31.1574575Z │ "parameters": [], 2023-08-31T22:04:31.1574837Z │ "responses": { 2023-08-31T22:04:31.1575087Z │ "200": { 2023-08-31T22:04:31.1575412Z │ "description": "A openapi 3.0.1 descriptor 2023-08-31T22:04:31.1575670Z │ ", 2023-08-31T22:04:31.1575909Z │ "content": { 2023-08-31T22:04:31.1576198Z │ "application/json": { 2023-08-31T22:04:31.1576489Z │ "schema": { 2023-08-31T22:04:31.1576770Z │ "type": "object", 2023-08-31T22:04:31.1577060Z │ "required": [ 2023-08-31T22:04:31.1577326Z │ "openapi", 2023-08-31T22:04:31.1577590Z │ "info", 2023-08-31T22:04:31.1577845Z │ "paths" 2023-08-31T22:04:31.1578079Z │ ], 2023-08-31T22:04:31.1578687Z │ "properties": { 2023-08-31T22:04:31.1578983Z │ "openapi": { 2023-08-31T22:04:31.1579308Z │ "type": "string" 2023-08-31T22:04:31.1579564Z │ }, 2023-08-31T22:04:31.1579826Z │ "info": { 2023-08-31T22:04:31.1580105Z │ "type": "object" 2023-08-31T22:04:31.1580354Z │ }, 2023-08-31T22:04:31.1580621Z │ "paths": { 2023-08-31T22:04:31.1580906Z │ "type": "object" 2023-08-31T22:04:31.1581299Z │ } 2023-08-31T22:04:31.1581537Z │ } 2023-08-31T22:04:31.1581774Z │ } 2023-08-31T22:04:31.1582000Z │ } 2023-08-31T22:04:31.1582223Z │ } 2023-08-31T22:04:31.1582447Z │ }, 2023-08-31T22:04:31.1582672Z │ "500": { 2023-08-31T22:04:31.1582993Z │ "description": "Internal Server Error", 2023-08-31T22:04:31.1583314Z │ "content": { 2023-08-31T22:04:31.1583646Z │ "application/json": { 2023-08-31T22:04:31.1583922Z │ "schema": { 2023-08-31T22:04:31.1584203Z │ "type": "object", 2023-08-31T22:04:31.1584482Z │ "required": [ 2023-08-31T22:04:31.1584735Z │ "code", 2023-08-31T22:04:31.1584991Z │ "type", 2023-08-31T22:04:31.1585244Z │ "message" 2023-08-31T22:04:31.1585486Z │ ], 2023-08-31T22:04:31.1585776Z │ "properties": { 2023-08-31T22:04:31.1586051Z │ "code": { 2023-08-31T22:04:31.1586327Z │ "type": "integer", 2023-08-31T22:04:31.1586655Z │ "description": "Error code." 2023-08-31T22:04:31.1586937Z │ }, 2023-08-31T22:04:31.1587182Z │ "type": { 2023-08-31T22:04:31.1587466Z │ "type": "string", 2023-08-31T22:04:31.1587795Z │ "description": "Error type." 2023-08-31T22:04:31.1588058Z │ }, 2023-08-31T22:04:31.1588321Z │ "message": { 2023-08-31T22:04:31.1588608Z │ "type": "string", 2023-08-31T22:04:31.1588932Z │ "description": "Error message." 2023-08-31T22:04:31.1589204Z │ } 2023-08-31T22:04:31.1589439Z │ } 2023-08-31T22:04:31.1589673Z │ } 2023-08-31T22:04:31.1589895Z │ } 2023-08-31T22:04:31.1590132Z │ } 2023-08-31T22:04:31.1590351Z │ } 2023-08-31T22:04:31.1590567Z │ } 2023-08-31T22:04:31.1590784Z │ } 2023-08-31T22:04:31.1590999Z │ }, 2023-08-31T22:04:31.1591219Z │ "/models": { 2023-08-31T22:04:31.1591439Z │ 2023-08-31T22:04:31.1591691Z │ (showing 2.05kB/60.09kB) 2023-08-31T22:04:31.1611155Z └ 2023-08-31T22:04:31.1611693Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:31.1612391Z 1ms 1ms 200µs 290µs 35ms 19ms 2ms 86µs 60ms 2023-08-31T22:04:31.1612591Z 2023-08-31T22:04:31.1791854Z ✓ Status code is 200 2023-08-31T22:04:31.1846223Z 2023-08-31T22:04:31.1847049Z → HTTPS Metrics API Description 2023-08-31T22:04:31.2386411Z OPTIONS https://localhost:8445 2023-08-31T22:04:31.2390145Z 200 OK ★ 48ms time ★ 230B↑ 2.82kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:31.2394102Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 2.55kB 2023-08-31T22:04:31.2398402Z │ { 2023-08-31T22:04:31.2398981Z │ "openapi": "3.0.1", 2023-08-31T22:04:31.2399832Z │ "info": { 2023-08-31T22:04:31.2400198Z │ "title": "TorchServe APIs", 2023-08-31T22:04:31.2400578Z │ "description": "TorchServe is a flexible and easy 2023-08-31T22:04:31.2400965Z │ to use tool for serving deep learning models", 2023-08-31T22:04:31.2401618Z │ "version": "0.8.2" 2023-08-31T22:04:31.2401860Z │ }, 2023-08-31T22:04:31.2402099Z │ "paths": { 2023-08-31T22:04:31.2402352Z │ "/metrics": { 2023-08-31T22:04:31.2402591Z │ "get": { 2023-08-31T22:04:31.2402927Z │ "description": "Get TorchServe application met 2023-08-31T22:04:31.2403264Z │ rics in prometheus format.", 2023-08-31T22:04:31.2403560Z │ "operationId": "metrics", 2023-08-31T22:04:31.2403839Z │ "parameters": [ 2023-08-31T22:04:31.2404089Z │ { 2023-08-31T22:04:31.2404515Z │ "in": "query", 2023-08-31T22:04:31.2404785Z │ "name": "name[]", 2023-08-31T22:04:31.2405115Z │ "description": "Names of metrics to filter 2023-08-31T22:04:31.2405371Z │ ", 2023-08-31T22:04:31.2405621Z │ "required": false, 2023-08-31T22:04:31.2405889Z │ "schema": { 2023-08-31T22:04:31.2406148Z │ "type": "string" 2023-08-31T22:04:31.2406533Z │ } 2023-08-31T22:04:31.2406775Z │ } 2023-08-31T22:04:31.2406994Z │ ], 2023-08-31T22:04:31.2407238Z │ "responses": { 2023-08-31T22:04:31.2407494Z │ "200": { 2023-08-31T22:04:31.2407808Z │ "description": "TorchServe application met 2023-08-31T22:04:31.2408084Z │ rics", 2023-08-31T22:04:31.2408333Z │ "content": { 2023-08-31T22:04:31.2408667Z │ "text/plain; version=0.0.4; charset=utf- 2023-08-31T22:04:31.2408927Z │ 8": { 2023-08-31T22:04:31.2409174Z │ "schema": { 2023-08-31T22:04:31.2409474Z │ "type": "object", 2023-08-31T22:04:31.2409751Z │ "required": [ 2023-08-31T22:04:31.2410022Z │ "# HELP", 2023-08-31T22:04:31.2410285Z │ "# TYPE", 2023-08-31T22:04:31.2410537Z │ "metric" 2023-08-31T22:04:31.2410785Z │ ], 2023-08-31T22:04:31.2411059Z │ "properties": { 2023-08-31T22:04:31.2411349Z │ "# HELP": { 2023-08-31T22:04:31.2411638Z │ "type": "string", 2023-08-31T22:04:31.2411971Z │ "description": "Help text for To 2023-08-31T22:04:31.2412255Z │ rchServe metric." 2023-08-31T22:04:31.2412532Z │ }, 2023-08-31T22:04:31.2412791Z │ "# TYPE": { 2023-08-31T22:04:31.2413081Z │ "type": "string", 2023-08-31T22:04:31.2413402Z │ "description": "Type of TorchSer 2023-08-31T22:04:31.2413700Z │ ve metric." 2023-08-31T22:04:31.2413939Z │ }, 2023-08-31T22:04:31.2414189Z │ "metric": { 2023-08-31T22:04:31.2414470Z │ "type": "string", 2023-08-31T22:04:31.2414799Z │ "description": "TorchServe appli 2023-08-31T22:04:31.2415074Z │ cation metric." 2023-08-31T22:04:31.2415320Z │ } 2023-08-31T22:04:31.2415562Z │ } 2023-08-31T22:04:31.2415804Z │ } 2023-08-31T22:04:31.2416036Z │ } 2023-08-31T22:04:31.2416266Z │ } 2023-08-31T22:04:31.2416483Z │ }, 2023-08-31T22:04:31.2416718Z │ "500": { 2023-08-31T22:04:31.2417035Z │ "description": "Internal Server Error", 2023-08-31T22:04:31.2417328Z │ "content": { 2023-08-31T22:04:31.2417609Z │ "application/json": { 2023-08-31T22:04:31.2417891Z │ "schema": { 2023-08-31T22:04:31.2418165Z │ "type": "object", 2023-08-31T22:04:31.2418452Z │ "required": [ 2023-08-31T22:04:31.2418712Z │ "code", 2023-08-31T22:04:31.2418965Z │ "type", 2023-08-31T22:04:31.2419219Z │ "message" 2023-08-31T22:04:31.2419468Z │ ], 2023-08-31T22:04:31.2419735Z │ "properties": { 2023-08-31T22:04:31.2420000Z │ "code": { 2023-08-31T22:04:31.2420381Z │ 2023-08-31T22:04:31.2420648Z │ (showing 2.05kB/2.55kB) 2023-08-31T22:04:31.2421639Z └ 2023-08-31T22:04:31.2422107Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:31.2422635Z 1ms 1ms 184µs 300µs 33ms 10ms 2ms 67µs 48ms 2023-08-31T22:04:31.2422835Z 2023-08-31T22:04:31.2575250Z ✓ Status code is 200 2023-08-31T22:04:31.2668446Z 2023-08-31T22:04:31.2668875Z → HTTPS Register Model - Mnist 2023-08-31T22:04:33.1396545Z POST https://localhost:8444/models?url=mnist.mar&model_name=mnist&initial_workers=1&synchronous=true 2023-08-31T22:04:33.1397332Z 200 OK ★ 1865ms time ★ 318B↑ 347B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:33.1401965Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 81B 2023-08-31T22:04:33.1403771Z │ { 2023-08-31T22:04:33.1404114Z │ "status": "Model \"mnist\" Version: 1.0 registered w 2023-08-31T22:04:33.1404493Z │ ith 1 initial workers" 2023-08-31T22:04:33.1404737Z │ } 2023-08-31T22:04:33.1422531Z └ 2023-08-31T22:04:33.1423041Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:33.1423589Z 1ms 536µs (cache) (cache) (cache) 1862ms 1ms 84µs 1866ms 2023-08-31T22:04:33.1423803Z 2023-08-31T22:04:33.1474225Z ✓ Successful POST request 2023-08-31T22:04:33.1547990Z 2023-08-31T22:04:33.1548301Z → HTTPS Get Mnist Model Description 2023-08-31T22:04:33.1677558Z GET https://localhost:8444/models/mnist 2023-08-31T22:04:33.1679413Z 200 OK ★ 7ms time ★ 238B↑ 827B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:33.1681701Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 560B 2023-08-31T22:04:33.1683421Z │ [ 2023-08-31T22:04:33.1683655Z │ { 2023-08-31T22:04:33.1683911Z │ "modelName": "mnist", 2023-08-31T22:04:33.1684189Z │ "modelVersion": "1.0", 2023-08-31T22:04:33.1684514Z │ "modelUrl": "mnist.mar", 2023-08-31T22:04:33.1684808Z │ "runtime": "python", 2023-08-31T22:04:33.1685081Z │ "minWorkers": 1, 2023-08-31T22:04:33.1685334Z │ "maxWorkers": 1, 2023-08-31T22:04:33.1685588Z │ "batchSize": 1, 2023-08-31T22:04:33.1685862Z │ "maxBatchDelay": 100, 2023-08-31T22:04:33.1686148Z │ "loadedAtStartup": false, 2023-08-31T22:04:33.1686544Z │ "workers": [ 2023-08-31T22:04:33.1686774Z │ { 2023-08-31T22:04:33.1687010Z │ "id": "9000", 2023-08-31T22:04:33.1687353Z │ "startTime": "2023-08-31T22:04:31.325Z", 2023-08-31T22:04:33.1687654Z │ "status": "READY", 2023-08-31T22:04:33.1687922Z │ "memoryUsage": 0, 2023-08-31T22:04:33.1688186Z │ "pid": 13011, 2023-08-31T22:04:33.1688439Z │ "gpu": false, 2023-08-31T22:04:33.1688690Z │ "gpuUsage": "N/A" 2023-08-31T22:04:33.1688929Z │ } 2023-08-31T22:04:33.1689148Z │ ], 2023-08-31T22:04:33.1689405Z │ "jobQueueStatus": { 2023-08-31T22:04:33.1689880Z │ "remainingCapacity": 100, 2023-08-31T22:04:33.1690271Z │ "pendingRequests": 0 2023-08-31T22:04:33.1690675Z │ } 2023-08-31T22:04:33.1690969Z │ } 2023-08-31T22:04:33.1691249Z │ ] 2023-08-31T22:04:33.1708265Z └ 2023-08-31T22:04:33.1708872Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:33.1709509Z 1ms 399µs (cache) (cache) (cache) 4ms 1ms 56µs 7ms 2023-08-31T22:04:33.1709812Z 2023-08-31T22:04:33.1766760Z ✓ Successful GET request 2023-08-31T22:04:33.1815213Z 2023-08-31T22:04:33.1815666Z → HTTPS Scale up Workers - Synchronous for Mnist 2023-08-31T22:04:36.9433123Z PUT https://localhost:8444/models/mnist?min_worker=5&max_worker=5&synchronous=true 2023-08-31T22:04:36.9436947Z 200 OK ★ 3.7s time ★ 300B↑ 321B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:36.9440530Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 55B 2023-08-31T22:04:36.9443749Z │ { 2023-08-31T22:04:36.9444365Z │ "status": "Workers scaled to 5 for model: mnist" 2023-08-31T22:04:36.9445238Z │ } 2023-08-31T22:04:36.9465098Z └ 2023-08-31T22:04:36.9465840Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:36.9466558Z 1ms 293µs (cache) (cache) (cache) 3.7s 1ms 56µs 3.7s 2023-08-31T22:04:36.9466886Z 2023-08-31T22:04:36.9524069Z ✓ Successful PUT request 2023-08-31T22:04:36.9598345Z 2023-08-31T22:04:36.9599028Z → HTTPS Scale up Workers - Asynchronous for Mnist 2023-08-31T22:04:36.9707451Z PUT https://localhost:8444/models/mnist?min_worker=6&max_worker=6&synchronous=false 2023-08-31T22:04:36.9718618Z 202 Accepted ★ 5ms time ★ 301B↑ 319B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:36.9721996Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:36.9725059Z │ { 2023-08-31T22:04:36.9725579Z │ "status": "Processing worker updates..." 2023-08-31T22:04:36.9726096Z │ } 2023-08-31T22:04:36.9754020Z └ 2023-08-31T22:04:36.9754774Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:36.9755496Z 1ms 311µs (cache) (cache) (cache) 2ms 1ms 47µs 6ms 2023-08-31T22:04:36.9755869Z 2023-08-31T22:04:36.9844058Z ✓ Successful PUT request 2023-08-31T22:04:36.9911002Z 2023-08-31T22:04:36.9911557Z → HTTPS - Inference - Mnist_KF 2023-08-31T22:04:37.0943629Z POST https://localhost:8443/v2/models/mnist/infer 2023-08-31T22:04:37.0947332Z 200 OK ★ 91ms time ★ 7kB↑ 490B↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:04:37.0950663Z ┌ ↑ file ★ 6.73kB 2023-08-31T22:04:37.0953790Z │ (showing 2.05kB/6.73kB) 2023-08-31T22:04:37.0956570Z └ 2023-08-31T22:04:37.0959687Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 255B 2023-08-31T22:04:37.0962622Z │ { 2023-08-31T22:04:37.0963177Z │ "id": "d3b15cad-50a2-4eaf-80ce-8b0a428bd298", 2023-08-31T22:04:37.0965494Z │ "model_name": "mnist", 2023-08-31T22:04:37.0965931Z │ "model_version": "1.0", 2023-08-31T22:04:37.0966480Z │ "outputs": [ 2023-08-31T22:04:37.0969235Z │ { 2023-08-31T22:04:37.0969496Z │ "name": "input-0", 2023-08-31T22:04:37.0969778Z │ "datatype": "INT64", 2023-08-31T22:04:37.0970024Z │ "data": [ 2023-08-31T22:04:37.0970259Z │ 1 2023-08-31T22:04:37.0970480Z │ ], 2023-08-31T22:04:37.0970732Z │ "shape": [ 2023-08-31T22:04:37.0970961Z │ 1 2023-08-31T22:04:37.0971181Z │ ] 2023-08-31T22:04:37.0971385Z │ } 2023-08-31T22:04:37.0971589Z │ ] 2023-08-31T22:04:37.0971789Z │ } 2023-08-31T22:04:37.0991327Z └ 2023-08-31T22:04:37.0992046Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:37.0993009Z 5ms 537µs (cache) (cache) (cache) 87ms 1ms 56µs 96ms 2023-08-31T22:04:37.0993452Z 2023-08-31T22:04:37.1073260Z ✓ Status code is 200 2023-08-31T22:04:37.1133891Z 2023-08-31T22:04:37.1134441Z → HTTPS - Explanations - Mnist_KF 2023-08-31T22:04:37.2912343Z POST https://localhost:8443/v2/models/mnist/explain 2023-08-31T22:04:37.2968655Z 200 OK ★ 170ms time ★ 7kB↑ 14.04kB↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:04:37.2972135Z ┌ ↑ file ★ 6.73kB 2023-08-31T22:04:37.2976603Z │ (showing 2.05kB/6.73kB) 2023-08-31T22:04:37.2979652Z └ 2023-08-31T22:04:37.2983210Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 13.8kB 2023-08-31T22:04:37.2986272Z │ { 2023-08-31T22:04:37.2986809Z │ "id": "d3b15cad-50a2-4eaf-80ce-8b0a428bd298", 2023-08-31T22:04:37.2989267Z │ "model_name": "mnist", 2023-08-31T22:04:37.2989697Z │ "model_version": "1.0", 2023-08-31T22:04:37.2991067Z │ "outputs": [ 2023-08-31T22:04:37.2991541Z │ { 2023-08-31T22:04:37.2992035Z │ "name": "input-0", 2023-08-31T22:04:37.2992578Z │ "datatype": "FP64", 2023-08-31T22:04:37.2993043Z │ "data": [ 2023-08-31T22:04:37.2993402Z │ -0.0, 2023-08-31T22:04:37.2993741Z │ -0.0, 2023-08-31T22:04:37.2994160Z │ -0.0, 2023-08-31T22:04:37.2996484Z │ -0.0, 2023-08-31T22:04:37.2996854Z │ -0.0, 2023-08-31T22:04:37.3000054Z │ -0.0, 2023-08-31T22:04:37.3000521Z │ -0.0, 2023-08-31T22:04:37.3000943Z │ -0.0, 2023-08-31T22:04:37.3001292Z │ -0.0, 2023-08-31T22:04:37.3001891Z │ -0.0, 2023-08-31T22:04:37.3002283Z │ -0.0, 2023-08-31T22:04:37.3004680Z │ -0.0, 2023-08-31T22:04:37.3005016Z │ -0.0, 2023-08-31T22:04:37.3005325Z │ -0.0, 2023-08-31T22:04:37.3005685Z │ -0.0, 2023-08-31T22:04:37.3006908Z │ -0.0, 2023-08-31T22:04:37.3007363Z │ 0.0, 2023-08-31T22:04:37.3007840Z │ -0.0, 2023-08-31T22:04:37.3008478Z │ -0.0, 2023-08-31T22:04:37.3008982Z │ 0.0, 2023-08-31T22:04:37.3009457Z │ -0.0, 2023-08-31T22:04:37.3009899Z │ 0.0, 2023-08-31T22:04:37.3010305Z │ -0.0, 2023-08-31T22:04:37.3010708Z │ -0.0, 2023-08-31T22:04:37.3011049Z │ -0.0, 2023-08-31T22:04:37.3011380Z │ -0.0, 2023-08-31T22:04:37.3011702Z │ -0.0, 2023-08-31T22:04:37.3012030Z │ 0.0, 2023-08-31T22:04:37.3012359Z │ -0.0, 2023-08-31T22:04:37.3012691Z │ -0.0, 2023-08-31T22:04:37.3013028Z │ -0.0, 2023-08-31T22:04:37.3013363Z │ -0.0, 2023-08-31T22:04:37.3013692Z │ -0.0, 2023-08-31T22:04:37.3014016Z │ -0.0, 2023-08-31T22:04:37.3014331Z │ -0.0, 2023-08-31T22:04:37.3014662Z │ 0.0, 2023-08-31T22:04:37.3014988Z │ -0.0, 2023-08-31T22:04:37.3015316Z │ 0.0, 2023-08-31T22:04:37.3015672Z │ -0.0, 2023-08-31T22:04:37.3016007Z │ -0.0, 2023-08-31T22:04:37.3016334Z │ -0.0, 2023-08-31T22:04:37.3016666Z │ 0.0, 2023-08-31T22:04:37.3017004Z │ 0.0, 2023-08-31T22:04:37.3017328Z │ 0.0, 2023-08-31T22:04:37.3017654Z │ 0.0, 2023-08-31T22:04:37.3017981Z │ 0.0, 2023-08-31T22:04:37.3018297Z │ 0.0, 2023-08-31T22:04:37.3018625Z │ 0.0, 2023-08-31T22:04:37.3018964Z │ 0.0, 2023-08-31T22:04:37.3019291Z │ 0.0, 2023-08-31T22:04:37.3019619Z │ -0.0, 2023-08-31T22:04:37.3019941Z │ -0.0, 2023-08-31T22:04:37.3020270Z │ 0.0, 2023-08-31T22:04:37.3020605Z │ 0.0, 2023-08-31T22:04:37.3020888Z │ -0.0, 2023-08-31T22:04:37.3021197Z │ 0.0, 2023-08-31T22:04:37.3021504Z │ -0.0, 2023-08-31T22:04:37.3021807Z │ -0.0, 2023-08-31T22:04:37.3022116Z │ -0.0, 2023-08-31T22:04:37.3022417Z │ -0.0, 2023-08-31T22:04:37.3022719Z │ -0.0, 2023-08-31T22:04:37.3023024Z │ 0.0, 2023-08-31T22:04:37.3023342Z │ 0.0, 2023-08-31T22:04:37.3023815Z │ 0.0, 2023-08-31T22:04:37.3024137Z │ 0.0, 2023-08-31T22:04:37.3024443Z │ 0.0, 2023-08-31T22:04:37.3024746Z │ 0.0, 2023-08-31T22:04:37.3025047Z │ 0.0, 2023-08-31T22:04:37.3025413Z │ 0.0, 2023-08-31T22:04:37.3025753Z │ 0.0, 2023-08-31T22:04:37.3026077Z │ -0.0, 2023-08-31T22:04:37.3026405Z │ -0.0, 2023-08-31T22:04:37.3026729Z │ -0.0, 2023-08-31T22:04:37.3027075Z │ 0.0, 2023-08-31T22:04:37.3027406Z │ -0.0, 2023-08-31T22:04:37.3027858Z │ 0.0, 2023-08-31T22:04:37.3028194Z │ 0.0, 2023-08-31T22:04:37.3028516Z │ 0.0, 2023-08-31T22:04:37.3028849Z │ -0.0, 2023-08-31T22:04:37.3029170Z │ -0.0, 2023-08-31T22:04:37.3029499Z │ -0.0, 2023-08-31T22:04:37.3029788Z │ 0.0, 2023-08-31T22:04:37.3030080Z │ -0.0, 2023-08-31T22:04:37.3030375Z │ 0.0, 2023-08-31T22:04:37.3030681Z │ -0.0, 2023-08-31T22:04:37.3031009Z │ -0.0, 2023-08-31T22:04:37.3031320Z │ -0.0, 2023-08-31T22:04:37.3031628Z │ -0.0, 2023-08-31T22:04:37.3031918Z │ 0.0, 2023-08-31T22:04:37.3032212Z │ 0.0, 2023-08-31T22:04:37.3032506Z │ 0.0, 2023-08-31T22:04:37.3032809Z │ 0.0, 2023-08-31T22:04:37.3033151Z │ 0.0, 2023-08-31T22:04:37.3033479Z │ 0.0, 2023-08-31T22:04:37.3033838Z │ 0.0, 2023-08-31T22:04:37.3034497Z │ -0.0, 2023-08-31T22:04:37.3034836Z │ -0.0, 2023-08-31T22:04:37.3035170Z │ 0.0, 2023-08-31T22:04:37.3035534Z │ 0.0, 2023-08-31T22:04:37.3035854Z │ -0.0, 2023-08-31T22:04:37.3036228Z │ -0.0, 2023-08-31T22:04:37.3036573Z │ -0.0, 2023-08-31T22:04:37.3036940Z │ -0.0, 2023-08-31T22:04:37.3037303Z │ -0.0, 2023-08-31T22:04:37.3037633Z │ 0.0, 2023-08-31T22:04:37.3037995Z │ 0.0, 2023-08-31T22:04:37.3038336Z │ -0.0, 2023-08-31T22:04:37.3038682Z │ -0.0, 2023-08-31T22:04:37.3039047Z │ -0.0, 2023-08-31T22:04:37.3039410Z │ 0.0, 2023-08-31T22:04:37.3039807Z │ 0.0, 2023-08-31T22:04:37.3040157Z │ 0.0, 2023-08-31T22:04:37.3040519Z │ -0.0, 2023-08-31T22:04:37.3040865Z │ -0.0, 2023-08-31T22:04:37.3041240Z │ -0.0, 2023-08-31T22:04:37.3041579Z │ -0.0, 2023-08-31T22:04:37.3041911Z │ 0.0, 2023-08-31T22:04:37.3042252Z │ 0.0, 2023-08-31T22:04:37.3042607Z │ 0.0, 2023-08-31T22:04:37.3042986Z │ 0.0, 2023-08-31T22:04:37.3043315Z │ 0.0, 2023-08-31T22:04:37.3043674Z │ 0.0, 2023-08-31T22:04:37.3044058Z │ -0.0, 2023-08-31T22:04:37.3044483Z │ -0.004054752832008137, 2023-08-31T22:04:37.3044893Z │ -0.00022612877744168094, 2023-08-31T22:04:37.3045316Z │ -0.0001273413677900525, 2023-08-31T22:04:37.3045736Z │ 0.005648369216900588, 2023-08-31T22:04:37.3046146Z │ 0.008904783847147995, 2023-08-31T22:04:37.3048609Z │ 0.002638536812407069, 2023-08-31T22:04:37.3048842Z │ 2023-08-31T22:04:37.3049096Z │ (showing 2.05kB/13.8kB) 2023-08-31T22:04:37.3076738Z └ 2023-08-31T22:04:37.3077464Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:37.3078181Z 2ms 312µs (cache) (cache) (cache) 167ms 1ms 141µs 172ms 2023-08-31T22:04:37.3078527Z 2023-08-31T22:04:37.3184677Z ✓ Status code is 200 2023-08-31T22:04:37.3265741Z 2023-08-31T22:04:37.3266175Z → HTTPS UnRegister Model Mnist 2023-08-31T22:04:37.3895653Z DELETE https://localhost:8444/models/mnist 2023-08-31T22:04:37.3898074Z 200 OK ★ 57ms time ★ 241B↑ 313B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:37.3900014Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:37.3901721Z │ { 2023-08-31T22:04:37.3902383Z │ "status": "Model \"mnist\" unregistered" 2023-08-31T22:04:37.3902739Z │ } 2023-08-31T22:04:37.3918838Z └ 2023-08-31T22:04:37.3919442Z prepare wait dns-lookup tcp-handshake ssl-handshake transfer-start download process total 2023-08-31T22:04:37.3920075Z 1ms 353µs (cache) (cache) (cache) 54ms 1ms 76µs 58ms 2023-08-31T22:04:37.3920365Z 2023-08-31T22:04:37.4015617Z ✓ Successful DELETE request 2023-08-31T22:04:37.5798666Z 2023-08-31T22:04:37.5799462Z ┌─────────────────────────┬─────────────────────┬────────────────────┐ 2023-08-31T22:04:37.5800389Z │ │ executed │ failed │ 2023-08-31T22:04:37.5800918Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:37.5801408Z │ iterations │ 1 │ 0 │ 2023-08-31T22:04:37.5801909Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:37.5802381Z │ requests │ 10 │ 0 │ 2023-08-31T22:04:37.5802850Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:37.5803302Z │ test-scripts │ 10 │ 0 │ 2023-08-31T22:04:37.5803772Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:37.5804219Z │ prerequest-scripts │ 0 │ 0 │ 2023-08-31T22:04:37.5804697Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:37.5805159Z │ assertions │ 10 │ 0 │ 2023-08-31T22:04:37.5805623Z ├─────────────────────────┴─────────────────────┴────────────────────┤ 2023-08-31T22:04:37.5806068Z │ total run duration: 6.6s │ 2023-08-31T22:04:37.5806688Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:37.5807178Z │ total data received: 100.89kB (approx) │ 2023-08-31T22:04:37.5807668Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:37.5808147Z │ average response time: 624ms [min: 5ms, max: 3.7s, s.d.: 1172ms] │ 2023-08-31T22:04:37.5808627Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:37.5809099Z │ average DNS lookup time: 3ms [min: 184µs, max: 9ms, s.d.: 4ms] │ 2023-08-31T22:04:37.5809593Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:37.5810061Z │ average first byte time: 600ms [min: 2ms, max: 3.7s, s.d.: 1182ms] │ 2023-08-31T22:04:37.5810567Z └────────────────────────────────────────────────────────────────────┘ 2023-08-31T22:04:37.6685346Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-08-31T22:04:37.6686476Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-08-31T22:04:37.6687410Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-08-31T22:04:37.6688266Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-08-31T22:04:37.6688828Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-08-31T22:04:37.6689376Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-08-31T22:04:37.6690114Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-08-31T22:04:37.6690720Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-08-31T22:04:37.6691185Z ## Starting TorchServe 2023-08-31T22:04:37.6691529Z ## Console logs redirected to file: ts_console.log 2023-08-31T22:04:37.6692211Z ## In directory: /home/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=config.properties 2023-08-31T22:04:37.6692686Z ## Successfully started TorchServe 2023-08-31T22:04:37.6693003Z ## Stopping TorchServe 2023-08-31T22:04:37.6693507Z ## In directory: /home/runner/work/serve/serve/test | Executing command: ['torchserve', '--stop'] 2023-08-31T22:04:37.6693918Z ## Successfully stopped TorchServe 2023-08-31T22:04:37.6694287Z ## Starting gen_mar: model_store 2023-08-31T22:04:37.6694520Z 2023-08-31T22:04:37.6694691Z ## Create symlink for mar files 2023-08-31T22:04:37.6694912Z 2023-08-31T22:04:37.6695342Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-08-31T22:04:37.6695903Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-08-31T22:04:37.6696432Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-08-31T22:04:37.6696976Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-08-31T22:04:37.6697533Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-08-31T22:04:37.6698242Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-08-31T22:04:37.6698802Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-08-31T22:04:37.6699328Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-08-31T22:04:37.6699996Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-08-31T22:04:37.6700555Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-08-31T22:04:37.6701143Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-08-31T22:04:37.6704275Z ## Starting TorchServe 2023-08-31T22:04:37.6704649Z ## Console logs redirected to file: ts_console.log 2023-08-31T22:04:37.6705411Z ## In directory: /home/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=resources/config_kf.properties 2023-08-31T22:04:37.6705906Z ## Successfully started TorchServe 2023-08-31T22:04:37.6706217Z ## Stopping TorchServe 2023-08-31T22:04:37.6706718Z ## In directory: /home/runner/work/serve/serve/test | Executing command: ['torchserve', '--stop'] 2023-08-31T22:04:37.6707127Z ## Successfully stopped TorchServe 2023-08-31T22:04:37.6707449Z ## Starting gen_mar: model_store 2023-08-31T22:04:37.6707674Z 2023-08-31T22:04:37.6707847Z ## Create symlink for mar files 2023-08-31T22:04:37.6708060Z 2023-08-31T22:04:37.6708475Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-08-31T22:04:37.6709910Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-08-31T22:04:37.6710652Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-08-31T22:04:37.6711195Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-08-31T22:04:37.6711862Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-08-31T22:04:37.6712569Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-08-31T22:04:37.6713124Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-08-31T22:04:37.6714332Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-08-31T22:04:37.6714805Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-08-31T22:04:37.6715285Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-08-31T22:04:37.6715790Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-08-31T22:04:37.6716168Z ## Starting TorchServe 2023-08-31T22:04:37.6716442Z ## Console logs redirected to file: ts_console.log 2023-08-31T22:04:37.6717019Z ## In directory: /home/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=config.properties 2023-08-31T22:04:37.6717421Z ## Successfully started TorchServe 2023-08-31T22:04:37.6717661Z ## Stopping TorchServe 2023-08-31T22:04:37.6718076Z ## In directory: /home/runner/work/serve/serve/test | Executing command: ['torchserve', '--stop'] 2023-08-31T22:04:37.6718405Z ## Successfully stopped TorchServe 2023-08-31T22:04:37.6718656Z ## Starting gen_mar: model_store 2023-08-31T22:04:37.6718805Z 2023-08-31T22:04:37.6718908Z ## Create symlink for mar files 2023-08-31T22:04:37.6719059Z 2023-08-31T22:04:37.6719385Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-08-31T22:04:37.6719960Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-08-31T22:04:37.6720425Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-08-31T22:04:37.6720890Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-08-31T22:04:37.6721359Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-08-31T22:04:37.6721978Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-08-31T22:04:37.6722453Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-08-31T22:04:37.6722903Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-08-31T22:04:37.6723363Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-08-31T22:04:37.6723841Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-08-31T22:04:37.6724354Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-08-31T22:04:37.6724722Z ## Starting TorchServe 2023-08-31T22:04:37.6725063Z ## Console logs redirected to file: ts_console.log 2023-08-31T22:04:37.6725661Z ## In directory: /home/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=resources/config_kfv2.properties 2023-08-31T22:04:37.6726078Z ## Successfully started TorchServe 2023-08-31T22:04:37.6726557Z ## Stopping TorchServe 2023-08-31T22:04:37.6726972Z ## In directory: /home/runner/work/serve/serve/test | Executing command: ['torchserve', '--stop'] 2023-08-31T22:04:37.6727298Z ## Successfully stopped TorchServe 2023-08-31T22:04:37.6727549Z ## Starting gen_mar: model_store 2023-08-31T22:04:37.6727697Z 2023-08-31T22:04:37.6727801Z ## Create symlink for mar files 2023-08-31T22:04:37.6727949Z 2023-08-31T22:04:37.6728288Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-08-31T22:04:37.6728746Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-08-31T22:04:37.6729207Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-08-31T22:04:37.6729669Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-08-31T22:04:37.6730158Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-08-31T22:04:37.6730770Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-08-31T22:04:39.5552248Z newman 2023-08-31T22:04:39.5552760Z 2023-08-31T22:04:39.5559920Z explanation_api_test_collection 2023-08-31T22:04:39.5643583Z 2023-08-31T22:04:39.5644301Z → Model Zoo - Register Model 2023-08-31T22:04:41.6060803Z POST http://localhost:8081/models?url=mnist.mar&model_name=mnist&initial_workers=1&synchronous=true 2023-08-31T22:04:41.6066220Z 200 OK ★ 1991ms time ★ 318B↑ 347B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:41.6073134Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 81B 2023-08-31T22:04:41.6077723Z │ { 2023-08-31T22:04:41.6078394Z │ "status": "Model \"mnist\" Version: 1.0 registered w 2023-08-31T22:04:41.6079273Z │ ith 1 initial workers" 2023-08-31T22:04:41.6079561Z │ } 2023-08-31T22:04:41.6161683Z └ 2023-08-31T22:04:41.6162715Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:41.6163456Z 33ms 5ms 10ms 315µs 1963ms 9ms 614µs 2s 2023-08-31T22:04:41.6163838Z 2023-08-31T22:04:41.6378303Z ✓ Successful POST request 2023-08-31T22:04:41.6521538Z 2023-08-31T22:04:41.6522083Z → Model Zoo - Explanations Model 2023-08-31T22:04:41.8502002Z POST http://localhost:8080/explanations/mnist 2023-08-31T22:04:41.8505838Z 200 OK ★ 184ms time ★ 538B↑ 23.2kB↓ size ★ 8↑ 6↓ headers ★ 0 cookies 2023-08-31T22:04:41.8509230Z ┌ ↑ file ★ 272B 2023-08-31T22:04:41.8514161Z │ 2023-08-31T22:04:41.8517009Z └ 2023-08-31T22:04:41.8520756Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 22.97kB 2023-08-31T22:04:41.8523836Z │ [ 2023-08-31T22:04:41.8524261Z │ [ 2023-08-31T22:04:41.8526797Z │ [ 2023-08-31T22:04:41.8527215Z │ -0.0003991946089794494, 2023-08-31T22:04:41.8528008Z │ -0.00019002193921936338, 2023-08-31T22:04:41.8528457Z │ -0.0008597193691251238, 2023-08-31T22:04:41.8528911Z │ -0.0003293673251109883, 2023-08-31T22:04:41.8529365Z │ -0.0009114926824955455, 2023-08-31T22:04:41.8529895Z │ -0.00017816126120841235, 2023-08-31T22:04:41.8530294Z │ -0.0005801029763709036, 2023-08-31T22:04:41.8530662Z │ -5.752933195733148e-05, 2023-08-31T22:04:41.8531104Z │ -0.00013036398384421601, 2023-08-31T22:04:41.8533521Z │ -3.622338451945031e-05, 2023-08-31T22:04:41.8533910Z │ 1.2628147466899818e-05, 2023-08-31T22:04:41.8535506Z │ -3.151637799887452e-05, 2023-08-31T22:04:41.8535920Z │ -7.0583658642244e-05, 2023-08-31T22:04:41.8536367Z │ -6.872772299590947e-05, 2023-08-31T22:04:41.8536745Z │ -7.877435466195057e-05, 2023-08-31T22:04:41.8537111Z │ -0.00013302452645204123, 2023-08-31T22:04:41.8537546Z │ -3.925601128445582e-05, 2023-08-31T22:04:41.8539968Z │ -0.0002292956447368447, 2023-08-31T22:04:41.8540393Z │ 1.7131027059075313e-05, 2023-08-31T22:04:41.8542847Z │ -0.00038463539952013353, 2023-08-31T22:04:41.8543233Z │ -0.0005095516367698776, 2023-08-31T22:04:41.8543633Z │ -0.0003988011282894086, 2023-08-31T22:04:41.8544007Z │ -0.0008459621366117649, 2023-08-31T22:04:41.8544360Z │ -0.0005034792019998062, 2023-08-31T22:04:41.8544731Z │ -0.0006029827126692656, 2023-08-31T22:04:41.8545304Z │ -0.00017686121496277734, 2023-08-31T22:04:41.8553536Z │ -0.00015337620578451488, 2023-08-31T22:04:41.8554493Z │ -0.0 2023-08-31T22:04:41.8554809Z │ ], 2023-08-31T22:04:41.8555030Z │ [ 2023-08-31T22:04:41.8555281Z │ -0.00045936710060920475, 2023-08-31T22:04:41.8555548Z │ -0.0006972019901282023, 2023-08-31T22:04:41.8555803Z │ -0.0006564254725485991, 2023-08-31T22:04:41.8556055Z │ -0.0006832954384728106, 2023-08-31T22:04:41.8556303Z │ -0.00043800715331628986, 2023-08-31T22:04:41.8556564Z │ -0.0006188234562762232, 2023-08-31T22:04:41.8556834Z │ 8.717650630260812e-06, 2023-08-31T22:04:41.8557087Z │ -0.0003930582923649171, 2023-08-31T22:04:41.8557344Z │ -0.00010256520504491494, 2023-08-31T22:04:41.8557594Z │ -0.00018236537083077386, 2023-08-31T22:04:41.8557843Z │ -0.000549194245914528, 2023-08-31T22:04:41.8558101Z │ 4.519843155942155e-05, 2023-08-31T22:04:41.8558356Z │ -0.0004397758015917212, 2023-08-31T22:04:41.8558602Z │ -0.0003280012468261429, 2023-08-31T22:04:41.8558861Z │ -0.00038462539119044103, 2023-08-31T22:04:41.8559134Z │ -0.0007280317791011647, 2023-08-31T22:04:41.8559371Z │ -0.0003807702304066053, 2023-08-31T22:04:41.8559615Z │ -0.0006797485466426452, 2023-08-31T22:04:41.8559860Z │ -0.0009410588634806274, 2023-08-31T22:04:41.8560096Z │ -0.0005321378507669765, 2023-08-31T22:04:41.8560342Z │ -0.0010959788067948224, 2023-08-31T22:04:41.8560586Z │ -0.0009239372954278377, 2023-08-31T22:04:41.8561082Z │ -0.0007882727083260442, 2023-08-31T22:04:41.8561329Z │ -0.0007635523579529204, 2023-08-31T22:04:41.8561573Z │ -0.0003335174007565436, 2023-08-31T22:04:41.8561821Z │ 5.101227298844628e-05, 2023-08-31T22:04:41.8562066Z │ 7.699820023676234e-05, 2023-08-31T22:04:41.8562298Z │ -0.0 2023-08-31T22:04:41.8562518Z │ ], 2023-08-31T22:04:41.8562722Z │ [ 2023-08-31T22:04:41.8562960Z │ -0.001316506109096002, 2023-08-31T22:04:41.8563215Z │ -0.0009519237745712524, 2023-08-31T22:04:41.8563605Z │ -0.002100062911074037, 2023-08-31T22:04:41.8563856Z │ -0.0007986435125464551, 2023-08-31T22:04:41.8564103Z │ -0.0015434156468430407, 2023-08-31T22:04:41.8564337Z │ -0.0008677097780603294, 2023-08-31T22:04:41.8564579Z │ -0.0006676297301614521, 2023-08-31T22:04:41.8564822Z │ -0.001015837370319211, 2023-08-31T22:04:41.8565061Z │ -0.0006892680837356767, 2023-08-31T22:04:41.8565317Z │ -0.0010906413414161688, 2023-08-31T22:04:41.8565563Z │ -0.0009184822710580872, 2023-08-31T22:04:41.8565803Z │ -0.001018668862295483, 2023-08-31T22:04:41.8566031Z │ - 2023-08-31T22:04:41.8566437Z │ (showing 2.05kB/22.97kB) 2023-08-31T22:04:41.8578656Z └ 2023-08-31T22:04:41.8579103Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:41.8579606Z 6ms 1ms 638µs 193µs 178ms 2ms 71µs 189ms 2023-08-31T22:04:41.8579795Z 2023-08-31T22:04:41.8819924Z ✓ Successful POST request 2023-08-31T22:04:41.8857014Z ✓ Test expected JSON response 2023-08-31T22:04:41.8931288Z 2023-08-31T22:04:41.8931853Z → Model Zoo - Unregister model 2023-08-31T22:04:41.9113131Z DELETE http://localhost:8081/models/mnist 2023-08-31T22:04:41.9113996Z 200 OK ★ 12ms time ★ 241B↑ 313B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:41.9114629Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 47B 2023-08-31T22:04:41.9115109Z │ { 2023-08-31T22:04:41.9115627Z │ "status": "Model \"mnist\" unregistered" 2023-08-31T22:04:41.9116944Z │ } 2023-08-31T22:04:41.9141131Z └ 2023-08-31T22:04:41.9141842Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:41.9142470Z 1ms 423µs (cache) (cache) 9ms 1ms 74µs 12ms 2023-08-31T22:04:41.9142870Z 2023-08-31T22:04:41.9218635Z ✓ Successful DELETE request 2023-08-31T22:04:41.9284950Z 2023-08-31T22:04:41.9285370Z → Model Zoo - Model Metrics 2023-08-31T22:04:41.9506669Z GET http://localhost:8082/metrics 2023-08-31T22:04:41.9507400Z 200 OK ★ 17ms time ★ 233B↑ 3.76kB↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:41.9508178Z ┌ ↓ text/plain ★ text ★ plain ★ utf8 ★ 3.47kB 2023-08-31T22:04:41.9508718Z │ # HELP Requests2XX Torchserve prometheus counter metri 2023-08-31T22:04:41.9509053Z │ c with unit: Count 2023-08-31T22:04:41.9511028Z │ # TYPE Requests2XX counter 2023-08-31T22:04:41.9511392Z │ Requests2XX{Level="Host",Hostname="fv-az628-190",} 3.0 2023-08-31T22:04:41.9511798Z │ # HELP Requests5XX Torchserve prometheus counter metri 2023-08-31T22:04:41.9512137Z │ c with unit: Count 2023-08-31T22:04:41.9512413Z │ # TYPE Requests5XX counter 2023-08-31T22:04:41.9512759Z │ # HELP ts_inference_latency_microseconds Torchserve pr 2023-08-31T22:04:41.9513142Z │ ometheus counter metric with unit: Microseconds 2023-08-31T22:04:41.9513515Z │ # TYPE ts_inference_latency_microseconds counter 2023-08-31T22:04:41.9513912Z │ ts_inference_latency_microseconds{model_name="mnist",m 2023-08-31T22:04:41.9514293Z │ odel_version="default",hostname="fv-az628-190",} 16390 2023-08-31T22:04:41.9514563Z │ 2.277 2023-08-31T22:04:41.9514880Z │ # HELP WorkerLoadTime Torchserve prometheus gauge metr 2023-08-31T22:04:41.9515200Z │ ic with unit: Milliseconds 2023-08-31T22:04:41.9515488Z │ # TYPE WorkerLoadTime gauge 2023-08-31T22:04:41.9516139Z │ WorkerLoadTime{WorkerName="W-9000-mnist_1.0",Level="Ho 2023-08-31T22:04:41.9516498Z │ st",Hostname="fv-az628-190",} 1785.0 2023-08-31T22:04:41.9516862Z │ # HELP ts_inference_requests_total Torchserve promethe 2023-08-31T22:04:41.9517198Z │ us counter metric with unit: Count 2023-08-31T22:04:41.9517529Z │ # TYPE ts_inference_requests_total counter 2023-08-31T22:04:41.9517900Z │ ts_inference_requests_total{model_name="mnist",model_v 2023-08-31T22:04:41.9518262Z │ ersion="default",hostname="fv-az628-190",} 1.0 2023-08-31T22:04:41.9518626Z │ # HELP Requests4XX Torchserve prometheus counter metri 2023-08-31T22:04:41.9519102Z │ c with unit: Count 2023-08-31T22:04:41.9519381Z │ # TYPE Requests4XX counter 2023-08-31T22:04:41.9519724Z │ # HELP GPUMemoryUsed Torchserve prometheus gauge metri 2023-08-31T22:04:41.9520039Z │ c with unit: Megabytes 2023-08-31T22:04:41.9520315Z │ # TYPE GPUMemoryUsed gauge 2023-08-31T22:04:41.9520650Z │ # HELP DiskUsage Torchserve prometheus gauge metric wi 2023-08-31T22:04:41.9520967Z │ th unit: Gigabytes 2023-08-31T22:04:41.9521235Z │ # TYPE DiskUsage gauge 2023-08-31T22:04:41.9521562Z │ DiskUsage{Level="Host",Hostname="fv-az628-190",} 70.33 2023-08-31T22:04:41.9521836Z │ 99429321289 2023-08-31T22:04:41.9522164Z │ # HELP ts_queue_latency_microseconds Torchserve promet 2023-08-31T22:04:41.9522528Z │ heus counter metric with unit: Microseconds 2023-08-31T22:04:41.9522876Z │ # TYPE ts_queue_latency_microseconds counter 2023-08-31T22:04:41.9523238Z │ ts_queue_latency_microseconds{model_name="mnist",model 2023-08-31T22:04:41.9523618Z │ _version="default",hostname="fv-az628-190",} 102.9 2023-08-31T22:04:41.9523987Z │ # HELP MemoryAvailable Torchserve prometheus gauge met 2023-08-31T22:04:41.9524315Z │ ric with unit: Megabytes 2023-08-31T22:04:41.9524609Z │ # TYPE MemoryAvailable gauge 2023-08-31T22:04:41.9524958Z │ MemoryAvailable{Level="Host",Hostname="fv-az628-190",} 2023-08-31T22:04:41.9525251Z │ 5472.33984375 2023-08-31T22:04:41.9525596Z │ # HELP PredictionTime Torchserve prometheus gauge metr 2023-08-31T22:04:41.9525906Z │ ic with unit: ms 2023-08-31T22:04:41.9526183Z │ # TYPE PredictionTime gauge 2023-08-31T22:04:41.9526707Z │ PredictionTime{ModelName="mnist",Level="Model",Hostnam 2023-08-31T22:04:41.9527022Z │ e="fv-az628-190",} 158.33 2023-08-31T22:04:41.9527358Z │ # HELP HandlerTime Torchserve prometheus gauge metric 2023-08-31T22:04:41.9527665Z │ with unit: ms 2023-08-31T22:04:41.9527932Z │ # TYPE HandlerTime gauge 2023-08-31T22:04:41.9528225Z │ HandlerTime{ModelName="mnist",Le 2023-08-31T22:04:41.9528542Z │ (showing 2.05kB/3.47kB) 2023-08-31T22:04:41.9531557Z └ 2023-08-31T22:04:41.9531971Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:41.9532472Z 1ms 668µs 186µs 248µs 13ms 1ms 67µs 18ms 2023-08-31T22:04:41.9532663Z 2023-08-31T22:04:41.9698926Z ✓ Successful GET request 2023-08-31T22:04:42.1306464Z 2023-08-31T22:04:42.1307478Z ┌─────────────────────────┬─────────────────────┬─────────────────────┐ 2023-08-31T22:04:42.1324308Z │ │ executed │ failed │ 2023-08-31T22:04:42.1325054Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:42.1325743Z │ iterations │ 1 │ 0 │ 2023-08-31T22:04:42.1329936Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:42.1330364Z │ requests │ 4 │ 0 │ 2023-08-31T22:04:42.1330807Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:42.1331200Z │ test-scripts │ 4 │ 0 │ 2023-08-31T22:04:42.1331599Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:42.1331984Z │ prerequest-scripts │ 0 │ 0 │ 2023-08-31T22:04:42.1332673Z ├─────────────────────────┼─────────────────────┼─────────────────────┤ 2023-08-31T22:04:42.1333069Z │ assertions │ 5 │ 0 │ 2023-08-31T22:04:42.1333465Z ├─────────────────────────┴─────────────────────┴─────────────────────┤ 2023-08-31T22:04:42.1333845Z │ total run duration: 2.4s │ 2023-08-31T22:04:42.1334242Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:42.1334633Z │ total data received: 26.56kB (approx) │ 2023-08-31T22:04:42.1335208Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:42.1335619Z │ average response time: 551ms [min: 12ms, max: 1991ms, s.d.: 834ms] │ 2023-08-31T22:04:42.1336042Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:42.1336449Z │ average DNS lookup time: 4ms [min: 186µs, max: 10ms, s.d.: 4ms] │ 2023-08-31T22:04:42.1336892Z ├─────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:42.1337288Z │ average first byte time: 541ms [min: 9ms, max: 1963ms, s.d.: 824ms] │ 2023-08-31T22:04:42.1337699Z └─────────────────────────────────────────────────────────────────────┘ 2023-08-31T22:04:44.0738864Z newman 2023-08-31T22:04:44.0739203Z 2023-08-31T22:04:44.0741345Z management_api_collection 2023-08-31T22:04:44.0745505Z 2023-08-31T22:04:44.0745673Z Iteration 1/11 2023-08-31T22:04:44.0809482Z 2023-08-31T22:04:44.0810093Z → workflow management request 2023-08-31T22:04:50.9153374Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/densenet_wf.war 2023-08-31T22:04:50.9154554Z 200 OK ★ 6.7s time ★ 321B↑ 347B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:50.9157594Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 81B 2023-08-31T22:04:50.9158920Z │ { 2023-08-31T22:04:50.9159489Z │ "status": "Workflow densenet has been registered and 2023-08-31T22:04:50.9160706Z │ scaled successfully." 2023-08-31T22:04:50.9161027Z │ } 2023-08-31T22:04:50.9239087Z └ 2023-08-31T22:04:50.9239885Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:50.9240752Z 24ms 5ms 8ms 3ms 6.7s 6ms 411µs 6.8s 2023-08-31T22:04:50.9240986Z 2023-08-31T22:04:50.9437157Z ✓ Successful request 2023-08-31T22:04:50.9503442Z 2023-08-31T22:04:50.9503994Z Iteration 2/11 2023-08-31T22:04:50.9517768Z 2023-08-31T22:04:50.9518493Z → workflow management request 2023-08-31T22:04:50.9661967Z GET http://localhost:8081/workflows 2023-08-31T22:04:50.9663101Z 200 OK ★ 8ms time ★ 235B↑ 423B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:50.9663764Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 156B 2023-08-31T22:04:50.9665506Z │ { 2023-08-31T22:04:50.9665902Z │ "workflows": [ 2023-08-31T22:04:50.9666502Z │ { 2023-08-31T22:04:50.9666872Z │ "workflowName": "densenet", 2023-08-31T22:04:50.9667323Z │ "workflowUrl": "https://torchserve.s3.amazonaws. 2023-08-31T22:04:50.9667681Z │ com/war_files/densenet_wf.war" 2023-08-31T22:04:50.9667923Z │ } 2023-08-31T22:04:50.9668134Z │ ] 2023-08-31T22:04:50.9668335Z │ } 2023-08-31T22:04:50.9686930Z └ 2023-08-31T22:04:50.9687615Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:50.9688335Z 1ms 991µs (cache) (cache) 4ms 1ms 79µs 8ms 2023-08-31T22:04:50.9688679Z 2023-08-31T22:04:50.9743122Z ✓ Successful request 2023-08-31T22:04:50.9783252Z 2023-08-31T22:04:50.9783781Z Iteration 3/11 2023-08-31T22:04:50.9797061Z 2023-08-31T22:04:50.9797704Z → workflow management request 2023-08-31T22:04:50.9903187Z GET http://localhost:8081/workflows/densenet 2023-08-31T22:04:50.9904001Z 200 OK ★ 5ms time ★ 244B↑ 559B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:50.9904658Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 292B 2023-08-31T22:04:50.9905169Z │ [ 2023-08-31T22:04:50.9905944Z │ { 2023-08-31T22:04:50.9906419Z │ "workflowName": "densenet", 2023-08-31T22:04:50.9907000Z │ "workflowUrl": "https://torchserve.s3.amazonaws.co 2023-08-31T22:04:50.9907530Z │ m/war_files/densenet_wf.war", 2023-08-31T22:04:50.9907944Z │ "minWorkers": 1, 2023-08-31T22:04:50.9908375Z │ "maxWorkers": 1, 2023-08-31T22:04:50.9908833Z │ "batchSize": 1, 2023-08-31T22:04:50.9910175Z │ "maxBatchDelay": 50, 2023-08-31T22:04:50.9910748Z │ "workflowDag": "{pre_processing=[densenet], densen 2023-08-31T22:04:50.9911224Z │ et=[post_processing]}" 2023-08-31T22:04:50.9911613Z │ } 2023-08-31T22:04:50.9912025Z │ ] 2023-08-31T22:04:50.9919092Z └ 2023-08-31T22:04:50.9919621Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:50.9920246Z 1ms 236µs (cache) (cache) 2ms 1ms 49µs 5ms 2023-08-31T22:04:50.9920551Z 2023-08-31T22:04:51.0006241Z ✓ Successful request 2023-08-31T22:04:51.0045656Z 2023-08-31T22:04:51.0046025Z Iteration 4/11 2023-08-31T22:04:51.0062317Z 2023-08-31T22:04:51.0062807Z → workflow management request 2023-08-31T22:04:51.0189927Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/densenet_wf.war 2023-08-31T22:04:51.0190951Z 500 Internal Server Error ★ 6ms time ★ 321B↑ 370B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:51.0191621Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 90B 2023-08-31T22:04:51.0192120Z │ { 2023-08-31T22:04:51.0192993Z │ "code": 500, 2023-08-31T22:04:51.0193526Z │ "type": "FileAlreadyExistsException", 2023-08-31T22:04:51.0193993Z │ "message": "densenet_wf.war" 2023-08-31T22:04:51.0194382Z │ } 2023-08-31T22:04:51.0205944Z └ 2023-08-31T22:04:51.0206853Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:51.0207865Z 1ms 254µs (cache) (cache) 3ms 1ms 57µs 7ms 2023-08-31T22:04:51.0208250Z 2023-08-31T22:04:51.0251014Z ✓ Successful request 2023-08-31T22:04:51.0287324Z 2023-08-31T22:04:51.0287758Z Iteration 5/11 2023-08-31T22:04:51.0300482Z 2023-08-31T22:04:51.0301113Z → workflow management request 2023-08-31T22:04:51.1217779Z DELETE http://localhost:8081/workflows/densenet 2023-08-31T22:04:51.1218863Z 200 OK ★ 86ms time ★ 247B↑ 319B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:51.1219508Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 53B 2023-08-31T22:04:51.1220316Z │ { 2023-08-31T22:04:51.1221506Z │ "status": "Workflow \"densenet\" unregistered" 2023-08-31T22:04:51.1221940Z │ } 2023-08-31T22:04:51.1234943Z └ 2023-08-31T22:04:51.1235574Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:51.1236238Z 1ms 933µs 298µs 416µs 81ms 1ms 64µs 86ms 2023-08-31T22:04:51.1236632Z 2023-08-31T22:04:51.1286548Z ✓ Successful request 2023-08-31T22:04:51.1327595Z 2023-08-31T22:04:51.1327985Z Iteration 6/11 2023-08-31T22:04:51.1329692Z 2023-08-31T22:04:51.1330057Z → workflow management request 2023-08-31T22:04:51.1968431Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/does_not_exist.war 2023-08-31T22:04:51.1970453Z 400 Bad Request ★ 58ms time ★ 324B↑ 441B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:51.1972583Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 170B 2023-08-31T22:04:51.1974402Z │ { 2023-08-31T22:04:51.1974655Z │ "code": 400, 2023-08-31T22:04:51.1974966Z │ "type": "DownloadArchiveException", 2023-08-31T22:04:51.1977178Z │ "message": "Failed to download archive from: https:/ 2023-08-31T22:04:51.1977879Z │ /torchserve.s3.amazonaws.com/war_files/does_not_exist. 2023-08-31T22:04:51.1978382Z │ war" 2023-08-31T22:04:51.1978605Z │ } 2023-08-31T22:04:51.1993587Z └ 2023-08-31T22:04:51.1994112Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:51.1994623Z 1ms 222µs (cache) (cache) 55ms 1ms 58µs 58ms 2023-08-31T22:04:51.1994823Z 2023-08-31T22:04:51.2038938Z ✓ Successful request 2023-08-31T22:04:51.2075996Z 2023-08-31T22:04:51.2076377Z Iteration 7/11 2023-08-31T22:04:51.2088891Z 2023-08-31T22:04:51.2089433Z → workflow management request 2023-08-31T22:04:51.2200482Z GET http://localhost:8081/workflows/does_not_exist 2023-08-31T22:04:51.2201371Z 404 Not Found ★ 6ms time ★ 250B↑ 377B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:51.2202179Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 108B 2023-08-31T22:04:51.2203646Z │ { 2023-08-31T22:04:51.2204058Z │ "code": 404, 2023-08-31T22:04:51.2204632Z │ "type": "WorkflowNotFoundException", 2023-08-31T22:04:51.2205048Z │ "message": "Workflow not found: does_not_exist" 2023-08-31T22:04:51.2205326Z │ } 2023-08-31T22:04:51.2220023Z └ 2023-08-31T22:04:51.2220676Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:51.2221490Z 1ms 512µs 265µs 134µs 2ms 1ms 46µs 6ms 2023-08-31T22:04:51.2221694Z 2023-08-31T22:04:51.2293046Z ✓ Successful request 2023-08-31T22:04:51.2337461Z 2023-08-31T22:04:51.2337810Z Iteration 8/11 2023-08-31T22:04:51.2350309Z 2023-08-31T22:04:51.2350752Z → workflow management request 2023-08-31T22:04:51.2469786Z DELETE http://localhost:8081/workflows/does_not_exist 2023-08-31T22:04:51.2470655Z 404 Not Found ★ 5ms time ★ 253B↑ 377B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:51.2471267Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 108B 2023-08-31T22:04:51.2471667Z │ { 2023-08-31T22:04:51.2472035Z │ "code": 404, 2023-08-31T22:04:51.2472482Z │ "type": "WorkflowNotFoundException", 2023-08-31T22:04:51.2472976Z │ "message": "Workflow not found: does_not_exist" 2023-08-31T22:04:51.2498735Z │ } 2023-08-31T22:04:51.2498958Z └ 2023-08-31T22:04:51.2499366Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:51.2499848Z 1ms 505µs 266µs 113µs 2ms 1ms 43µs 5ms 2023-08-31T22:04:51.2500042Z 2023-08-31T22:04:51.2545281Z ✓ Successful request 2023-08-31T22:04:51.2618112Z 2023-08-31T22:04:51.2618278Z Iteration 9/11 2023-08-31T22:04:51.2633479Z 2023-08-31T22:04:51.2633987Z → workflow management request 2023-08-31T22:04:51.2742473Z POST http://localhost:8081/workflows?url=malformed_url,? 2023-08-31T22:04:51.2743414Z 404 Not Found ★ 5ms time ★ 275B↑ 396B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:51.2744231Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 127B 2023-08-31T22:04:51.2744565Z │ { 2023-08-31T22:04:51.2744811Z │ "code": 404, 2023-08-31T22:04:51.2745173Z │ "type": "WorkflowNotFoundException", 2023-08-31T22:04:51.2745595Z │ "message": "Workflow not found in workflow store: ma 2023-08-31T22:04:51.2745910Z │ lformed_url,?" 2023-08-31T22:04:51.2746123Z │ } 2023-08-31T22:04:51.2761552Z └ 2023-08-31T22:04:51.2762024Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:51.2762537Z 1ms 643µs 280µs 113µs 1ms 1ms 41µs 5ms 2023-08-31T22:04:51.2762728Z 2023-08-31T22:04:51.2818434Z ✓ Successful request 2023-08-31T22:04:51.2853971Z 2023-08-31T22:04:51.2854312Z Iteration 10/11 2023-08-31T22:04:51.2866839Z 2023-08-31T22:04:51.2867231Z → workflow management request 2023-08-31T22:04:52.6146188Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/custom_python_dep.war 2023-08-31T22:04:52.6150002Z 500 Internal Server Error ★ 1322ms time ★ 327B↑ 531B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:52.6153411Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 250B 2023-08-31T22:04:52.6156628Z │ { 2023-08-31T22:04:52.6157044Z │ "code": 500, 2023-08-31T22:04:52.6157492Z │ "type": "WorkflowException", 2023-08-31T22:04:52.6157938Z │ "message": "Workflow custom_python_dep has failed to 2023-08-31T22:04:52.6158407Z │ register. Failures: [Workflow Node custom_python_dep_ 2023-08-31T22:04:52.6158876Z │ _custom_python_dep failed to register. Details: Model 2023-08-31T22:04:52.6159316Z │ not found at: custom_python_dep.mar]" 2023-08-31T22:04:52.6159646Z │ } 2023-08-31T22:04:52.6176351Z └ 2023-08-31T22:04:52.6176849Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:52.6177385Z 2ms 616µs 165µs 107µs 1318ms 2ms 54µs 1324ms 2023-08-31T22:04:52.6177574Z 2023-08-31T22:04:52.6234884Z ✓ Successful request 2023-08-31T22:04:52.6274265Z 2023-08-31T22:04:52.6274652Z Iteration 11/11 2023-08-31T22:04:52.6290206Z 2023-08-31T22:04:52.6290618Z → workflow management request 2023-08-31T22:04:53.9419692Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/loading-memory-error.war 2023-08-31T22:04:53.9420696Z 500 Internal Server Error ★ 1306ms time ★ 330B↑ 543B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:04:53.9421767Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 262B 2023-08-31T22:04:53.9426625Z │ { 2023-08-31T22:04:53.9426926Z │ "code": 500, 2023-08-31T22:04:53.9427224Z │ "type": "WorkflowException", 2023-08-31T22:04:53.9427621Z │ "message": "Workflow loading-memory-error has failed 2023-08-31T22:04:53.9428068Z │ to register. Failures: [Workflow Node loading-memory- 2023-08-31T22:04:53.9428464Z │ error__loading-memory-error failed to register. Detail 2023-08-31T22:04:53.9428847Z │ s: Model not found at: loading-memory-error.mar]" 2023-08-31T22:04:53.9429130Z │ } 2023-08-31T22:04:53.9446422Z └ 2023-08-31T22:04:53.9447106Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:04:53.9448061Z 1ms 584µs 2ms 138µs 1301ms 1ms 173µs 1306ms 2023-08-31T22:04:53.9448438Z 2023-08-31T22:04:53.9505601Z ✓ Successful request 2023-08-31T22:04:54.1241031Z 2023-08-31T22:04:54.1242047Z ┌─────────────────────────┬─────────────────────┬────────────────────┐ 2023-08-31T22:04:54.1242730Z │ │ executed │ failed │ 2023-08-31T22:04:54.1243338Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:54.1243802Z │ iterations │ 11 │ 0 │ 2023-08-31T22:04:54.1244631Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:54.1245083Z │ requests │ 11 │ 0 │ 2023-08-31T22:04:54.1245551Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:54.1246029Z │ test-scripts │ 11 │ 0 │ 2023-08-31T22:04:54.1246744Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:54.1247221Z │ prerequest-scripts │ 0 │ 0 │ 2023-08-31T22:04:54.1247707Z ├─────────────────────────┼─────────────────────┼────────────────────┤ 2023-08-31T22:04:54.1248148Z │ assertions │ 11 │ 0 │ 2023-08-31T22:04:54.1248611Z ├─────────────────────────┴─────────────────────┴────────────────────┤ 2023-08-31T22:04:54.1249067Z │ total run duration: 9.8s │ 2023-08-31T22:04:54.1249554Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:54.1250009Z │ total data received: 1.7kB (approx) │ 2023-08-31T22:04:54.1250488Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:54.1250952Z │ average response time: 872ms [min: 5ms, max: 6.7s, s.d.: 1935ms] │ 2023-08-31T22:04:54.1251603Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:54.1252088Z │ average DNS lookup time: 4ms [min: 165µs, max: 8ms, s.d.: 3ms] │ 2023-08-31T22:04:54.1252573Z ├────────────────────────────────────────────────────────────────────┤ 2023-08-31T22:04:54.1253027Z │ average first byte time: 867ms [min: 1ms, max: 6.7s, s.d.: 1929ms] │ 2023-08-31T22:04:54.1253507Z └────────────────────────────────────────────────────────────────────┘ 2023-08-31T22:04:56.0834815Z newman 2023-08-31T22:04:56.0835334Z 2023-08-31T22:04:56.0838093Z workflow_inference 2023-08-31T22:04:56.0842450Z 2023-08-31T22:04:56.0842691Z Iteration 1/3 2023-08-31T22:04:56.0862591Z 2023-08-31T22:04:56.0863126Z → Workflow - Register Workflow 2023-08-31T22:05:02.9948136Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/densenet_wf.war 2023-08-31T22:05:02.9949540Z 200 OK ★ 6.8s time ★ 321B↑ 347B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:05:02.9952969Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 81B 2023-08-31T22:05:02.9954136Z │ { 2023-08-31T22:05:02.9954730Z │ "status": "Workflow densenet has been registered and 2023-08-31T22:05:02.9955651Z │ scaled successfully." 2023-08-31T22:05:02.9955952Z │ } 2023-08-31T22:05:03.0033706Z └ 2023-08-31T22:05:03.0034305Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:05:03.0035132Z 24ms 5ms 9ms 337µs 6.8s 6ms 407µs 6.8s 2023-08-31T22:05:03.0035411Z 2023-08-31T22:05:03.0244699Z ✓ Successful POST request 2023-08-31T22:05:03.0328136Z 2023-08-31T22:05:03.0328572Z → Workflow - Inference 2023-08-31T22:05:03.3190706Z POST http://localhost:8080/wfpredict/densenet 2023-08-31T22:05:03.3191853Z 200 OK ★ 274ms time ★ 111.24kB↑ 450B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:05:03.3192517Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:05:03.3194249Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:05:03.3194684Z └ 2023-08-31T22:05:03.3196012Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 183B 2023-08-31T22:05:03.3196431Z │ { 2023-08-31T22:05:03.3197263Z │ "tabby": 0.46661901473999023, 2023-08-31T22:05:03.3197649Z │ "tiger_cat": 0.46449053287506104, 2023-08-31T22:05:03.3197965Z │ "Egyptian_cat": 0.06614039838314056, 2023-08-31T22:05:03.3198248Z │ "lynx": 0.0012924427865073085, 2023-08-31T22:05:03.3198552Z │ "plastic_bag": 0.00022909774270374328 2023-08-31T22:05:03.3198794Z │ } 2023-08-31T22:05:03.3217746Z └ 2023-08-31T22:05:03.3218562Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:05:03.3219427Z 5ms 1ms 566µs 178µs 268ms 2ms 66µs 279ms 2023-08-31T22:05:03.3219635Z 2023-08-31T22:05:03.3296052Z ✓ Successful request 2023-08-31T22:05:03.3305503Z ✓ Test expected JSON response 2023-08-31T22:05:03.3352122Z 2023-08-31T22:05:03.3352501Z → Workflow - Unregister 2023-08-31T22:05:03.4236236Z DELETE http://localhost:8081/workflows/densenet 2023-08-31T22:05:03.4237250Z 200 OK ★ 82ms time ★ 247B↑ 319B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:05:03.4237947Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 53B 2023-08-31T22:05:03.4238770Z │ { 2023-08-31T22:05:03.4239183Z │ "status": "Workflow \"densenet\" unregistered" 2023-08-31T22:05:03.4239472Z │ } 2023-08-31T22:05:03.4255469Z └ 2023-08-31T22:05:03.4256053Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:05:03.4256752Z 1ms 501µs (cache) (cache) 79ms 1ms 78µs 83ms 2023-08-31T22:05:03.4257047Z 2023-08-31T22:05:03.4313314Z ✓ Successful DELETE request 2023-08-31T22:05:03.4350916Z 2023-08-31T22:05:03.4351258Z Iteration 2/3 2023-08-31T22:05:03.4364714Z 2023-08-31T22:05:03.4365117Z → Workflow - Register Workflow 2023-08-31T22:05:08.6092291Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/timeout-retry-test.war 2023-08-31T22:05:08.6092975Z 200 OK ★ 5.1s time ★ 328B↑ 347B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:05:08.6095747Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 81B 2023-08-31T22:05:08.6096530Z │ { 2023-08-31T22:05:08.6097071Z │ "status": "Workflow densenet has been registered and 2023-08-31T22:05:08.6097719Z │ scaled successfully." 2023-08-31T22:05:08.6097984Z │ } 2023-08-31T22:05:08.6113658Z └ 2023-08-31T22:05:08.6114254Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:05:08.6115160Z 1ms 231µs (cache) (cache) 5.1s 1ms 71µs 5.1s 2023-08-31T22:05:08.6115528Z 2023-08-31T22:05:08.6174745Z ✓ Successful POST request 2023-08-31T22:05:08.6225540Z 2023-08-31T22:05:08.6225919Z → Workflow - Inference 2023-08-31T22:05:20.6483711Z POST http://localhost:8080/wfpredict/densenet 2023-08-31T22:05:20.6487981Z 500 Internal Server Error ★ 12s time ★ 111.24kB↑ 383B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:05:20.6494810Z ┌ ↑ file ★ 110.97kB 2023-08-31T22:05:20.6499872Z │ (showing 2.05kB/110.97kB) 2023-08-31T22:05:20.6502847Z └ 2023-08-31T22:05:20.6508366Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 102B 2023-08-31T22:05:20.6508694Z │ { 2023-08-31T22:05:20.6508923Z │ "code": 500, 2023-08-31T22:05:20.6509236Z │ "type": "InternalServerException", 2023-08-31T22:05:20.6509604Z │ "message": "Error executing pre_processing" 2023-08-31T22:05:20.6509863Z │ } 2023-08-31T22:05:20.6537103Z └ 2023-08-31T22:05:20.6537604Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:05:20.6538129Z 2ms 349µs (cache) (cache) 12s 3ms 96µs 12s 2023-08-31T22:05:20.6538319Z 2023-08-31T22:05:20.6627657Z ✓ Successful request 2023-08-31T22:05:20.6703394Z 2023-08-31T22:05:20.6703897Z → Workflow - Unregister 2023-08-31T22:05:20.7508597Z DELETE http://localhost:8081/workflows/densenet 2023-08-31T22:05:20.7509557Z 200 OK ★ 73ms time ★ 247B↑ 319B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:05:20.7510583Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 53B 2023-08-31T22:05:20.7511709Z │ { 2023-08-31T22:05:20.7512586Z │ "status": "Workflow \"densenet\" unregistered" 2023-08-31T22:05:20.7512938Z │ } 2023-08-31T22:05:20.7530841Z └ 2023-08-31T22:05:20.7531484Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:05:20.7532275Z 1ms 338µs (cache) (cache) 69ms 2ms 52µs 74ms 2023-08-31T22:05:20.7532634Z 2023-08-31T22:05:20.7582775Z ✓ Successful DELETE request 2023-08-31T22:05:20.7628830Z 2023-08-31T22:05:20.7629231Z Iteration 3/3 2023-08-31T22:05:20.7643543Z 2023-08-31T22:05:20.7644107Z → Workflow - Register Workflow 2023-08-31T22:05:25.9440986Z POST http://localhost:8081/workflows?url=https://torchserve.s3.amazonaws.com/war_files/dog_breed_wf.war 2023-08-31T22:05:25.9442120Z 200 OK ★ 5.1s time ★ 322B↑ 351B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:05:25.9442798Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 85B 2023-08-31T22:05:25.9443654Z │ { 2023-08-31T22:05:25.9444107Z │ "status": "Workflow dog_breed_wf has been registered 2023-08-31T22:05:25.9444456Z │ and scaled successfully." 2023-08-31T22:05:25.9444707Z │ } 2023-08-31T22:05:25.9466868Z └ 2023-08-31T22:05:25.9467567Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:05:25.9468241Z 1ms 299µs (cache) (cache) 5.1s 2ms 52µs 5.1s 2023-08-31T22:05:25.9468551Z 2023-08-31T22:05:25.9528520Z ✓ Successful POST request 2023-08-31T22:05:25.9602563Z 2023-08-31T22:05:25.9603523Z → Workflow - Inference 2023-08-31T22:05:26.3350006Z POST http://localhost:8080/wfpredict/dog_breed_wf 2023-08-31T22:05:26.3351448Z 200 OK ★ 364ms time ★ 77.75kB↑ 470B↓ size ★ 8↑ 7↓ headers ★ 0 cookies 2023-08-31T22:05:26.3352003Z ┌ ↑ file ★ 77.47kB 2023-08-31T22:05:26.3352863Z │ (showing 2.05kB/77.47kB) 2023-08-31T22:05:26.3353162Z └ 2023-08-31T22:05:26.3355069Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 203B 2023-08-31T22:05:26.3355567Z │ { 2023-08-31T22:05:26.3356112Z │ "Cardigan_welsh_corgi": 0.6281962394714355, 2023-08-31T22:05:26.3356442Z │ "Briard": 0.2746281921863556, 2023-08-31T22:05:26.3356769Z │ "Icelandic_sheepdog": 0.0745360404253006, 2023-08-31T22:05:26.3357092Z │ "Tibetan_mastiff": 0.01554573979228735, 2023-08-31T22:05:26.3357724Z │ "Chow_chow": 0.002062039216980338 2023-08-31T22:05:26.3357962Z │ } 2023-08-31T22:05:26.3377271Z └ 2023-08-31T22:05:26.3378051Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:05:26.3378741Z 3ms 755µs 471µs 496µs 359ms 1ms 65µs 366ms 2023-08-31T22:05:26.3378943Z 2023-08-31T22:05:26.3467826Z ✓ Successful request 2023-08-31T22:05:26.3477692Z ✓ Test expected JSON response 2023-08-31T22:05:26.3530201Z 2023-08-31T22:05:26.3530657Z → Workflow - Unregister 2023-08-31T22:05:26.4200853Z DELETE http://localhost:8081/workflows/dog_breed_wf 2023-08-31T22:05:26.4201927Z 200 OK ★ 60ms time ★ 251B↑ 323B↓ size ★ 7↑ 7↓ headers ★ 0 cookies 2023-08-31T22:05:26.4202916Z ┌ ↓ application/json ★ text ★ json ★ utf8 ★ 57B 2023-08-31T22:05:26.4203240Z │ { 2023-08-31T22:05:26.4203578Z │ "status": "Workflow \"dog_breed_wf\" unregistered" 2023-08-31T22:05:26.4203908Z │ } 2023-08-31T22:05:26.4223732Z └ 2023-08-31T22:05:26.4224373Z prepare wait dns-lookup tcp-handshake transfer-start download process total 2023-08-31T22:05:26.4225227Z 2ms 410µs (cache) (cache) 57ms 1ms 50µs 62ms 2023-08-31T22:05:26.4225460Z 2023-08-31T22:05:26.4279785Z ✓ Successful DELETE request 2023-08-31T22:05:26.6017791Z 2023-08-31T22:05:26.6018772Z ┌─────────────────────────┬───────────────────┬──────────────────┐ 2023-08-31T22:05:26.6019439Z │ │ executed │ failed │ 2023-08-31T22:05:26.6020071Z ├─────────────────────────┼───────────────────┼──────────────────┤ 2023-08-31T22:05:26.6020849Z │ iterations │ 3 │ 0 │ 2023-08-31T22:05:26.6021387Z ├─────────────────────────┼───────────────────┼──────────────────┤ 2023-08-31T22:05:26.6021862Z │ requests │ 9 │ 0 │ 2023-08-31T22:05:26.6023057Z ├─────────────────────────┼───────────────────┼──────────────────┤ 2023-08-31T22:05:26.6023532Z │ test-scripts │ 9 │ 0 │ 2023-08-31T22:05:26.6024446Z ├─────────────────────────┼───────────────────┼──────────────────┤ 2023-08-31T22:05:26.6024842Z │ prerequest-scripts │ 0 │ 0 │ 2023-08-31T22:05:26.6025243Z ├─────────────────────────┼───────────────────┼──────────────────┤ 2023-08-31T22:05:26.6025929Z │ assertions │ 11 │ 0 │ 2023-08-31T22:05:26.6026337Z ├─────────────────────────┴───────────────────┴──────────────────┤ 2023-08-31T22:05:26.6026723Z │ total run duration: 30.3s │ 2023-08-31T22:05:26.6027108Z ├────────────────────────────────────────────────────────────────┤ 2023-08-31T22:05:26.6027501Z │ total data received: 898B (approx) │ 2023-08-31T22:05:26.6027898Z ├────────────────────────────────────────────────────────────────┤ 2023-08-31T22:05:26.6028473Z │ average response time: 3.3s [min: 60ms, max: 12s, s.d.: 4s] │ 2023-08-31T22:05:26.6028880Z ├────────────────────────────────────────────────────────────────┤ 2023-08-31T22:05:26.6029282Z │ average DNS lookup time: 4ms [min: 471µs, max: 9ms, s.d.: 4ms] │ 2023-08-31T22:05:26.6029846Z ├────────────────────────────────────────────────────────────────┤ 2023-08-31T22:05:26.6030255Z │ average first byte time: 3.3s [min: 57ms, max: 12s, s.d.: 4s] │ 2023-08-31T22:05:26.6030722Z └────────────────────────────────────────────────────────────────┘ 2023-08-31T22:05:33.0234554Z /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages/grpc_tools/protoc.py:21: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html 2023-08-31T22:05:33.0235404Z import pkg_resources 2023-08-31T22:05:33.4262726Z ============================= test session starts ============================== 2023-08-31T22:05:33.4263797Z platform linux -- Python 3.9.18, pytest-7.3.1, pluggy-1.3.0 -- /usr/share/miniconda/envs/__setup_conda/bin/python 2023-08-31T22:05:33.4264347Z cachedir: .pytest_cache 2023-08-31T22:05:33.4264821Z rootdir: /home/runner/work/serve/serve 2023-08-31T22:05:33.4265772Z plugins: mock-3.10.0, cov-4.1.0 2023-08-31T22:05:40.4635922Z collecting ... collected 109 items 2023-08-31T22:05:40.4636476Z 2023-08-31T22:05:40.4650705Z test_distributed_inference_handler.py::test_large_model_inference SKIPPED [ 0%] 2023-08-31T22:06:06.1180115Z test_example_dcgan.py::test_model_archive_creation PASSED [ 1%] 2023-08-31T22:06:08.7606696Z test_example_dcgan.py::test_model_register_unregister PASSED [ 2%] 2023-08-31T22:06:11.1986262Z test_example_dcgan.py::test_image_generation_without_any_input_constraints PASSED [ 3%] 2023-08-31T22:06:16.1637137Z test_example_dcgan.py::test_image_generation_with_input_constraints PASSED [ 4%] 2023-08-31T22:06:26.3035107Z test_example_intel_extension_for_pytorch.py::test_single_worker_affinity PASSED [ 5%] 2023-08-31T22:06:38.4340805Z test_example_intel_extension_for_pytorch.py::test_multi_worker_affinity PASSED [ 6%] 2023-08-31T22:06:56.9918947Z test_example_intel_extension_for_pytorch.py::test_worker_scale_up_affinity PASSED [ 7%] 2023-08-31T22:07:15.5407776Z test_example_intel_extension_for_pytorch.py::test_worker_scale_down_affinity PASSED [ 8%] 2023-08-31T22:07:22.3102622Z test_example_micro_batching.py::test_single_example_inference[yaml_config] PASSED [ 9%] 2023-08-31T22:07:22.9341342Z test_example_micro_batching.py::test_multi_example_inference[4-yaml_config] PASSED [ 10%] 2023-08-31T22:07:26.0914786Z test_example_micro_batching.py::test_multi_example_inference[4-no_config] 2023-08-31T22:07:26,087 [INFO ] W-9001-image_classifier_1.0 ACCESS_LOG - /127.0.0.1:34592 "POST /predictions/image_classifier HTTP/1.1" 200 148 2023-08-31T22:07:26.0915724Z 2023-08-31T22:07:26,087 [INFO ] W-9001-image_classifier_1.0-stdout MODEL_METRICS - PredictionTime.ms:44.72|#ModelName:image_classifier,Level:Model|#hostname:fv-az628-190,requestID:92763011-2e96-4d14-86c4-e4a2506c4b47,timestamp:1693519646 2023-08-31T22:07:26.0916775Z 2023-08-31T22:07:26,087 [INFO ] W-9001-image_classifier_1.0 TS_METRICS - Requests2XX.Count:1.0|#Level:Host|#hostname:fv-az628-190,timestamp:1693519646 2023-08-31T22:07:26.0917577Z 2023-08-31T22:07:26,088 [INFO ] W-9001-image_classifier_1.0 TS_METRICS - ts_inference_latency_microseconds.Microseconds:147282.065|#model_name:image_classifier,model_version:default|#hostname:fv-az628-190,timestamp:1693519646 2023-08-31T22:07:26.0918419Z 2023-08-31T22:07:26,088 [INFO ] W-9001-image_classifier_1.0 TS_METRICS - ts_queue_latency_microseconds.Microseconds:100648.693|#model_name:image_classifier,model_version:default|#hostname:fv-az628-190,timestamp:1693519646 2023-08-31T22:07:26.0919113Z 2023-08-31T22:07:26,088 [DEBUG] W-9001-image_classifier_1.0 org.pytorch.serve.job.Job - Waiting time ns: 100648693, Backend time ns: 47214968 2023-08-31T22:07:26.0919746Z 2023-08-31T22:07:26,088 [INFO ] W-9001-image_classifier_1.0 TS_METRICS - QueueTime.Milliseconds:100.0|#Level:Host|#hostname:fv-az628-190,timestamp:1693519646 2023-08-31T22:07:26.0920364Z 2023-08-31T22:07:26,088 [DEBUG] W-9001-image_classifier_1.0 org.pytorch.serve.wlm.WorkerThread - sent a reply, jobdone: true 2023-08-31T22:07:26.0920966Z 2023-08-31T22:07:26,088 [INFO ] W-9001-image_classifier_1.0 org.pytorch.serve.wlm.WorkerThread - Backend response time: 45 2023-08-31T22:07:26.0921612Z 2023-08-31T22:07:26,088 [INFO ] W-9001-image_classifier_1.0 TS_METRICS - WorkerThreadTime.Milliseconds:3.0|#Level:Host|#hostname:fv-az628-190,timestamp:1693519646 2023-08-31T22:07:26.0951300Z PASSED [ 11%] 2023-08-31T22:07:26.2477365Z test_example_micro_batching.py::test_single_example_inference[no_config] PASSED [ 11%] 2023-08-31T22:07:28.6737677Z test_example_micro_batching.py::test_multi_example_inference[16-no_config] PASSED [ 12%] 2023-08-31T22:07:36.0310751Z test_example_micro_batching.py::test_multi_example_inference[16-yaml_config] PASSED [ 13%] 2023-08-31T22:07:48.6586919Z test_example_scriptable_tokenzier.py::test_handler PASSED [ 14%] 2023-08-31T22:08:08.5681974Z test_example_scriptable_tokenzier.py::test_inference_with_untrained_model_and_sample_text PASSED [ 15%] 2023-08-31T22:08:24.7594093Z test_example_scriptable_tokenzier.py::test_inference_with_untrained_model_and_empty_string PASSED [ 16%] 2023-08-31T22:09:16.1893751Z test_example_scriptable_tokenzier.py::test_inference_with_pretrained_model PASSED [ 17%] 2023-08-31T22:11:47.3233714Z test_gRPC_inference_api.py::test_inference_apis PASSED [ 18%] 2023-08-31T22:11:51.0649515Z test_gRPC_inference_api.py::test_inference_stream_apis PASSED [ 19%] 2023-08-31T22:12:00.3105396Z test_gRPC_management_apis.py::test_management_apis PASSED [ 20%] 2023-08-31T22:12:03.9168248Z test_handler.py::test_mnist_model_register_and_inference_on_valid_model PASSED [ 21%] 2023-08-31T22:12:05.2499760Z test_handler.py::test_mnist_model_register_using_non_existent_handler_with_nonzero_workers 2023-08-31T22:12:03,912 [INFO ] epollEventLoopGroup-3-3 org.pytorch.serve.wlm.ModelManager - Model mnist unregistered. 2023-08-31T22:12:05.2500619Z 2023-08-31T22:12:03,912 [INFO ] epollEventLoopGroup-3-3 ACCESS_LOG - /127.0.0.1:44022 "DELETE /models/mnist HTTP/1.1" 200 23 2023-08-31T22:12:05.2506153Z 2023-08-31T22:12:03,913 [INFO ] epollEventLoopGroup-3-3 TS_METRICS - Requests2XX.Count:1.0|#Level:Host|#hostname:fv-az628-190,timestamp:1693519923 2023-08-31T22:12:05.2506653Z PASSED [ 22%] 2023-08-31T22:12:14.2895372Z test_handler.py::test_mnist_model_register_scale_inference_with_non_existent_handler PASSED [ 22%] 2023-08-31T22:12:20.0255609Z test_handler.py::test_mnist_model_register_and_inference_on_valid_model_explain PASSED [ 23%] 2023-08-31T22:12:25.9249728Z test_handler.py::test_kserve_mnist_model_register_and_inference_on_valid_model PASSED [ 24%] 2023-08-31T22:12:29.7010330Z test_handler.py::test_kserve_mnist_model_register_scale_inference_with_non_existent_handler PASSED [ 25%] 2023-08-31T22:12:35.3973106Z test_handler.py::test_kserve_mnist_model_register_and_inference_on_valid_model_explain PASSED [ 26%]2023-08-31T22:12:35,393 [INFO ] epollEventLoopGroup-3-3 org.pytorch.serve.wlm.ModelManager - Model mnist unregistered. 2023-08-31T22:12:35.3974195Z 2023-08-31T22:12:35,393 [INFO ] epollEventLoopGroup-3-3 ACCESS_LOG - /127.0.0.1:54028 "DELETE /models/mnist HTTP/1.1" 200 14 2023-08-31T22:12:35.3975086Z 2023-08-31T22:12:35,393 [INFO ] epollEventLoopGroup-3-3 TS_METRICS - Requests2XX.Count:1.0|#Level:Host|#hostname:fv-az628-190,timestamp:1693519955 2023-08-31T22:12:35.4041236Z 2023-08-31T22:12:52.3363948Z test_handler.py::test_huggingface_bert_batch_inference PASSED [ 27%] 2023-08-31T22:12:52.3380518Z test_handler.py::test_MMF_activity_recognition_model_register_and_inference_on_valid_model SKIPPED [ 28%] 2023-08-31T22:12:52.3543862Z test_handler.py::test_huggingface_bert_model_parallel_inference PASSED [ 29%] 2023-08-31T22:13:00.2797559Z test_handler.py::test_echo_stream_inference PASSED [ 30%] 2023-08-31T22:13:02.2201199Z test_metrics.py::test_logs_created PASSED [ 31%] 2023-08-31T22:13:05.4487802Z test_metrics.py::test_logs_startup_cfg_created_snapshot_enabled PASSED [ 32%] 2023-08-31T22:13:08.7487684Z test_metrics.py::test_logs_startup_cfg_created_snapshot_disabled PASSED [ 33%] 2023-08-31T22:13:12.0447802Z test_metrics.py::test_metrics_startup_cfg_created_snapshot_enabled PASSED [ 33%] 2023-08-31T22:13:15.2127759Z test_metrics.py::test_metrics_startup_cfg_created_snapshot_disabled PASSED [ 34%] 2023-08-31T22:13:20.7743626Z test_metrics.py::test_log_location_var_snapshot_disabled PASSED [ 35%] 2023-08-31T22:13:41.3241559Z test_metrics.py::test_log_location_var_snapshot_enabled PASSED [ 36%] 2023-08-31T22:13:42.5277523Z test_metrics.py::test_async_logging PASSED [ 37%] 2023-08-31T22:13:47.9736094Z test_metrics.py::test_async_logging_non_boolean PASSED [ 38%] 2023-08-31T22:13:51.2865451Z test_metrics.py::test_metrics_location_var_snapshot_disabled PASSED [ 39%] 2023-08-31T22:13:56.9999482Z test_metrics.py::test_metrics_location_var_snapshot_enabled PASSED [ 40%] 2023-08-31T22:14:05.8857595Z test_metrics.py::test_log_location_and_metric_location_vars_snapshot_enabled PASSED [ 41%] 2023-08-31T22:14:07.0712712Z test_metrics.py::test_log_location_var_snapshot_disabled_custom_path_read_only PASSED [ 42%] 2023-08-31T22:14:12.6395411Z test_metrics.py::test_metrics_location_var_snapshot_enabled_rdonly_dir PASSED [ 43%] 2023-08-31T22:14:23.3250928Z test_metrics.py::test_metrics_log_mode PASSED [ 44%] 2023-08-31T22:14:31.7962762Z test_metrics.py::test_metrics_prometheus_mode PASSED [ 44%] 2023-08-31T22:14:40.4201185Z test_metrics.py::test_collect_system_metrics_when_not_disabled PASSED [ 45%] 2023-08-31T22:14:48.7631792Z test_metrics.py::test_disable_system_metrics_using_config_properties PASSED [ 46%] 2023-08-31T22:14:57.5263137Z test_metrics.py::test_disable_system_metrics_using_environment_variable PASSED [ 47%] 2023-08-31T22:14:58.8066726Z test_metrics_kf.py::test_logs_created PASSED [ 48%] 2023-08-31T22:15:02.0649402Z test_metrics_kf.py::test_logs_startup_cfg_created_snapshot_enabled PASSED [ 49%] 2023-08-31T22:15:05.2327688Z test_metrics_kf.py::test_logs_startup_cfg_created_snapshot_disabled PASSED [ 50%] 2023-08-31T22:15:08.4032581Z test_metrics_kf.py::test_metrics_startup_cfg_created_snapshot_enabled PASSED [ 51%] 2023-08-31T22:15:11.6167716Z test_metrics_kf.py::test_metrics_startup_cfg_created_snapshot_disabled PASSED [ 52%] 2023-08-31T22:15:17.0163905Z test_metrics_kf.py::test_log_location_var_snapshot_disabled PASSED [ 53%] 2023-08-31T22:15:35.7209368Z test_metrics_kf.py::test_log_location_var_snapshot_enabled PASSED [ 54%] 2023-08-31T22:15:36.9167682Z test_metrics_kf.py::test_async_logging PASSED [ 55%] 2023-08-31T22:15:42.3419246Z test_metrics_kf.py::test_async_logging_non_boolean PASSED [ 55%] 2023-08-31T22:15:45.7563630Z test_metrics_kf.py::test_metrics_location_var_snapshot_disabled PASSED [ 56%] 2023-08-31T22:15:49.4263324Z test_metrics_kf.py::test_metrics_location_var_snapshot_enabled PASSED [ 57%] 2023-08-31T22:15:56.2628480Z test_metrics_kf.py::test_log_location_and_metric_location_vars_snapshot_enabled PASSED [ 58%] 2023-08-31T22:15:57.4447831Z test_metrics_kf.py::test_log_location_var_snapshot_disabled_custom_path_read_only PASSED [ 59%] 2023-08-31T22:16:03.1648801Z test_metrics_kf.py::test_metrics_location_var_snapshot_enabled_rdonly_dir PASSED [ 60%] 2023-08-31T22:16:21.0499053Z test_model_archiver.py::test_multiple_model_versions_registration PASSED [ 61%] 2023-08-31T22:16:46.0770688Z test_model_archiver.py::test_duplicate_model_registration_using_local_url_followed_by_http_url PASSED [ 62%] 2023-08-31T22:17:01.7922813Z test_model_archiver.py::test_duplicate_model_registration_using_http_url_followed_by_local_url PASSED [ 63%] 2023-08-31T22:17:04.6201605Z test_model_archiver.py::test_model_archiver_to_regenerate_model_mar_without_force PASSED [ 64%] 2023-08-31T22:17:10.1668772Z test_model_archiver.py::test_model_archiver_to_regenerate_model_mar_with_force PASSED [ 65%] 2023-08-31T22:17:10.2379686Z test_model_archiver.py::test_model_archiver_without_handler_flag PASSED [ 66%] 2023-08-31T22:17:10.3050884Z test_model_archiver.py::test_model_archiver_without_model_name_flag PASSED [ 66%] 2023-08-31T22:17:13.0902030Z test_model_archiver.py::test_model_archiver_without_model_file_flag PASSED [ 67%] 2023-08-31T22:17:15.6289871Z test_model_archiver.py::test_model_archiver_without_serialized_flag PASSED [ 68%] 2023-08-31T22:17:15.6949638Z test_onnx.py::test_convert_to_onnx PASSED [ 69%] 2023-08-31T22:17:15.7758707Z test_onnx.py::test_model_packaging_and_start PASSED [ 70%] 2023-08-31T22:17:15.8568530Z test_onnx.py::test_model_start PASSED [ 71%] 2023-08-31T22:17:15.8757384Z test_onnx.py::test_inference PASSED [ 72%] 2023-08-31T22:17:15.9493660Z test_onnx.py::test_stop PASSED [ 73%] 2023-08-31T22:17:50.6043674Z test_pytorch_profiler.py::test_profiler_default_and_custom_handler[/home/runner/work/serve/serve/test/pytest/profiler_utils/resnet_custom.py] 2023-08-31T22:17:41,777 [INFO ] epollEventLoopGroup-3-1 ACCESS_LOG - /127.0.0.1:40412 "POST /models?model_name=resnet152&url=resnet-152-batch.mar&batch_size=4&max_batch_delay=5000&initial_workers=3&synchronous=true HTTP/1.1" 200 9968 2023-08-31T22:17:50.6044628Z 2023-08-31T22:17:41,777 [INFO ] epollEventLoopGroup-3-1 TS_METRICS - Requests2XX.Count:1.0|#Level:Host|#hostname:fv-az628-190,timestamp:1693520261 2023-08-31T22:17:50.6056273Z PASSED [ 74%] 2023-08-31T22:18:23.6524167Z test_pytorch_profiler.py::test_profiler_default_and_custom_handler[image_classifier] PASSED [ 75%] 2023-08-31T22:18:56.8544802Z test_pytorch_profiler.py::test_profiler_arguments_override[/home/runner/work/serve/serve/test/pytest/profiler_utils/resnet_profiler_override.py] PASSED [ 76%] 2023-08-31T22:19:28.9657844Z test_pytorch_profiler.py::test_batch_input[/home/runner/work/serve/serve/test/pytest/profiler_utils/resnet_profiler_override.py] PASSED [ 77%] 2023-08-31T22:19:30.2703468Z test_sm_mme_requirements.py::test_no_model_loaded PASSED [ 77%] 2023-08-31T22:19:30.2713963Z test_sm_mme_requirements.py::test_oom_on_model_load SKIPPED (Test to...) [ 78%] 2023-08-31T22:19:30.2723171Z test_sm_mme_requirements.py::test_oom_on_invoke SKIPPED (Test to be ...) [ 79%] 2023-08-31T22:19:35.7816300Z test_snapshot.py::test_snapshot_created_on_start_and_stop PASSED [ 80%] 2023-08-31T22:19:49.9114029Z test_snapshot.py::test_snapshot_created_on_management_api_invoke PASSED [ 81%] 2023-08-31T22:19:54.0244449Z test_snapshot.py::test_start_from_snapshot PASSED [ 82%] 2023-08-31T22:19:58.2495974Z test_snapshot.py::test_start_from_latest PASSED [ 83%] 2023-08-31T22:20:00.2128531Z test_snapshot.py::test_start_from_read_only_snapshot PASSED [ 84%] 2023-08-31T22:20:05.5873990Z test_snapshot.py::test_no_config_snapshots_cli_option PASSED [ 85%] 2023-08-31T22:20:06.8629323Z test_snapshot.py::test_start_from_default PASSED [ 86%] 2023-08-31T22:20:09.2343719Z test_snapshot.py::test_start_from_non_existing_snapshot PASSED [ 87%] 2023-08-31T22:20:09.3873188Z test_snapshot.py::test_torchserve_init_with_non_existent_model_store PASSED [ 88%] 2023-08-31T22:20:26.4878061Z test_snapshot.py::test_restart_torchserve_with_last_snapshot_with_model_mar_removed PASSED [ 88%] 2023-08-31T22:20:48.1127144Z test_snapshot.py::test_replace_mar_file_with_dummy PASSED [ 89%] 2023-08-31T22:21:29.7018905Z test_snapshot.py::test_restart_torchserve_with_one_of_model_mar_removed PASSED [ 90%] 2023-08-31T22:21:31.0805118Z test_torch_compile.py::TestTorchCompile::test_archive_model_artifacts PASSED [ 91%] 2023-08-31T22:21:41.1680308Z test_torch_compile.py::TestTorchCompile::test_start_torchserve PASSED [ 92%] 2023-08-31T22:21:41.2447649Z test_torch_compile.py::TestTorchCompile::test_server_status PASSED [ 93%] 2023-08-31T22:21:41.2847631Z test_torch_compile.py::TestTorchCompile::test_registered_model PASSED [ 94%] 2023-08-31T22:21:59.9431637Z test_torch_compile.py::TestTorchCompile::test_serve_inference PASSED [ 95%] 2023-08-31T22:21:59.9443334Z test_torch_xla.py::TestTorchXLA::test_archive_model_artifacts SKIPPED [ 96%] 2023-08-31T22:21:59.9452948Z test_torch_xla.py::TestTorchXLA::test_start_torchserve SKIPPED (PyTo...) [ 97%] 2023-08-31T22:21:59.9461578Z test_torch_xla.py::TestTorchXLA::test_server_status SKIPPED (PyTorch...) [ 98%] 2023-08-31T22:21:59.9470178Z test_torch_xla.py::TestTorchXLA::test_registered_model SKIPPED (PyTo...) [ 99%] 2023-08-31T22:21:59.9514813Z test_torch_xla.py::TestTorchXLA::test_serve_inference SKIPPED (PyTor...) [100%] 2023-08-31T22:21:59.9515029Z 2023-08-31T22:21:59.9516662Z =============================== warnings summary =============================== 2023-08-31T22:21:59.9516977Z test_torch_compile.py:11 2023-08-31T22:21:59.9517487Z /home/runner/work/serve/serve/test/pytest/test_torch_compile.py:11: DeprecationWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html 2023-08-31T22:21:59.9517981Z from pkg_resources import packaging 2023-08-31T22:21:59.9518142Z 2023-08-31T22:21:59.9518648Z ../../../../../../../usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages/pkg_resources/__init__.py:2871 2023-08-31T22:21:59.9519366Z /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages/pkg_resources/__init__.py:2871: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('mpl_toolkits')`. 2023-08-31T22:21:59.9520271Z Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages 2023-08-31T22:21:59.9520783Z declare_namespace(pkg) 2023-08-31T22:21:59.9520918Z 2023-08-31T22:21:59.9521086Z test/pytest/test_example_scriptable_tokenzier.py::test_handler 2023-08-31T22:21:59.9522068Z /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages/torch/jit/_recursive.py:266: UserWarning: 'batch_first' was found in ScriptModule constants, but was not actually set in __init__. Consider removing it. 2023-08-31T22:21:59.9522676Z warnings.warn("'{}' was found in ScriptModule constants, " 2023-08-31T22:21:59.9522873Z 2023-08-31T22:21:59.9523031Z test/pytest/test_example_scriptable_tokenzier.py::test_handler 2023-08-31T22:21:59.9523835Z /usr/share/miniconda/envs/__setup_conda/lib/python3.9/site-packages/torch/nn/modules/module.py:1501: UserWarning: The PyTorch API of nested tensors is in prototype stage and will change in the near future. (Triggered internally at ../aten/src/ATen/NestedTensorImpl.cpp:177.) 2023-08-31T22:21:59.9524525Z return forward_call(*args, **kwargs) 2023-08-31T22:21:59.9524681Z 2023-08-31T22:21:59.9524833Z test/pytest/test_example_scriptable_tokenzier.py::test_handler 2023-08-31T22:21:59.9525400Z /home/runner/work/serve/serve/test/pytest/../../examples/text_classification_with_scriptable_tokenizer/handler.py:97: UserWarning: Implicit dimension choice for softmax has been deprecated. Change the call to include dim=X as an argument. 2023-08-31T22:21:59.9525873Z data = F.softmax(data) 2023-08-31T22:21:59.9526010Z 2023-08-31T22:21:59.9526527Z -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2023-08-31T22:21:59.9526905Z ============ 100 passed, 9 skipped, 5 warnings in 986.53s (0:16:26) ============ 2023-08-31T22:22:00.4341721Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-08-31T22:22:00.4342864Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-08-31T22:22:00.4343774Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-08-31T22:22:00.4344412Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-08-31T22:22:00.4345303Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-08-31T22:22:00.4345836Z ## Starting TorchServe 2023-08-31T22:22:00.4346447Z ## Console logs redirected to file: ts_console.log 2023-08-31T22:22:00.4347372Z ## In directory: /home/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --ncs --ts-config=config.properties 2023-08-31T22:22:00.4348154Z ## Successfully started TorchServe 2023-08-31T22:22:00.4348546Z ## Stopping TorchServe 2023-08-31T22:22:00.4349327Z ## In directory: /home/runner/work/serve/serve/test | Executing command: ['torchserve', '--stop'] 2023-08-31T22:22:00.4349812Z ## Successfully stopped TorchServe 2023-08-31T22:22:00.4350411Z ## Starting gen_mar: model_store 2023-08-31T22:22:00.4350706Z 2023-08-31T22:22:00.4351151Z ## Create symlink for mar files 2023-08-31T22:22:00.4351441Z 2023-08-31T22:22:00.4352137Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-08-31T22:22:00.4352766Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-08-31T22:22:00.4353577Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-08-31T22:22:00.4354193Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-08-31T22:22:00.4355021Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-08-31T22:22:00.4355795Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-08-31T22:22:00.4356622Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-08-31T22:22:00.4357439Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-08-31T22:22:00.4358738Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-08-31T22:22:00.4359457Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-08-31T22:22:00.4360024Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-08-31T22:22:00.4360765Z ## Starting TorchServe 2023-08-31T22:22:00.4361391Z ## Console logs redirected to file: ts_console.log 2023-08-31T22:22:00.4362136Z ## In directory: /home/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --workflow-store=model_store --ncs 2023-08-31T22:22:00.4363151Z ## Successfully started TorchServe 2023-08-31T22:22:00.4364000Z ## Stopping TorchServe 2023-08-31T22:22:00.4364807Z ## In directory: /home/runner/work/serve/serve/test | Executing command: ['torchserve', '--stop'] 2023-08-31T22:22:00.4365561Z ## Successfully stopped TorchServe 2023-08-31T22:22:00.4365965Z ## Starting gen_mar: model_store 2023-08-31T22:22:00.4366593Z 2023-08-31T22:22:00.4366843Z ## Create symlink for mar files 2023-08-31T22:22:00.4367340Z 2023-08-31T22:22:00.4367864Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-18.mar, model_store/resnet-18.mar successfully. 2023-08-31T22:22:00.4368719Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/maskrcnn.mar, model_store/maskrcnn.mar successfully. 2023-08-31T22:22:00.4369342Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/mnist.mar, model_store/mnist.mar successfully. 2023-08-31T22:22:00.4370156Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fcn_resnet_101.mar, model_store/fcn_resnet_101.mar successfully. 2023-08-31T22:22:00.4370809Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/densenet161.mar, model_store/densenet161.mar successfully. 2023-08-31T22:22:00.4371798Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/resnet-152-batch.mar, model_store/resnet-152-batch.mar successfully. 2023-08-31T22:22:00.4372425Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/vgg16.mar, model_store/vgg16.mar successfully. 2023-08-31T22:22:00.4373233Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/fastrcnn.mar, model_store/fastrcnn.mar successfully. 2023-08-31T22:22:00.4373963Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/alexnet.mar, model_store/alexnet.mar successfully. 2023-08-31T22:22:00.4374792Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/squeezenet1_1.mar, model_store/squeezenet1_1.mar successfully. 2023-08-31T22:22:00.4375477Z ## Symlink /home/runner/work/serve/serve/ts_scripts/../model_store_gen/deeplabv3_resnet_101_eager.mar, model_store/deeplabv3_resnet_101_eager.mar successfully. 2023-08-31T22:22:00.4376203Z ## Starting TorchServe 2023-08-31T22:22:00.4376610Z ## Console logs redirected to file: ts_console.log 2023-08-31T22:22:00.4377544Z ## In directory: /home/runner/work/serve/serve/test | Executing command: torchserve --start --model-store=model_store --workflow-store=model_store --ncs 2023-08-31T22:22:00.4378098Z ## Successfully started TorchServe 2023-08-31T22:22:00.4378699Z ## Stopping TorchServe 2023-08-31T22:22:00.4379274Z ## In directory: /home/runner/work/serve/serve/test | Executing command: ['torchserve', '--stop'] 2023-08-31T22:22:00.4380273Z ## Successfully stopped TorchServe 2023-08-31T22:22:00.4380520Z ## Started regression tests 2023-08-31T22:22:00.4380760Z ## Started densenet mar creation 2023-08-31T22:22:00.4382208Z ## In directory: /tmp/workspace/model_store | Executing command: torch-model-archiver --model-name densenet161_v1 --version 1.1 --model-file /home/runner/work/serve/serve/ts_scripts/../examples/image_classifier/densenet_161/model.py --serialized-file /tmp/workspace/model_store/densenet161-8d451a50.pth --extra-files /home/runner/work/serve/serve/ts_scripts/../examples/image_classifier/index_to_name.json --handler image_classifier --force 2023-08-31T22:22:00.4382982Z ## Started regression pytests 2023-08-31T22:22:00.4383431Z ## In directory: /home/runner/work/serve/serve/test/pytest | Executing command: python -m pytest -v ./ 2023-08-31T22:22:00.4383894Z Removing file : management_pb2.py 2023-08-31T22:22:00.4384156Z Removing file : management_pb2_grpc.py 2023-08-31T22:22:00.4384413Z Removing file : inference_pb2_grpc.py 2023-08-31T22:22:00.4384662Z Removing file : inference_pb2.py 2023-08-31T22:22:00.4384992Z ## Deleting model_store_gen_dir: /home/runner/work/serve/serve/ts_scripts/../model_store_gen 2023-08-31T22:22:00.4385211Z 2023-08-31T22:22:00.6777787Z Post job cleanup. 2023-08-31T22:22:00.8625290Z [command]/usr/bin/git version 2023-08-31T22:22:00.8732831Z git version 2.41.0 2023-08-31T22:22:00.8791710Z Temporarily overriding HOME='/home/runner/work/_temp/920b810c-ac67-45d7-b284-964f9f2d8992' before making global git config changes 2023-08-31T22:22:00.8796481Z Adding repository directory to the temporary git global config as a safe directory 2023-08-31T22:22:00.8805349Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/serve/serve 2023-08-31T22:22:00.8857379Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2023-08-31T22:22:00.8896708Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2023-08-31T22:22:00.9231762Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2023-08-31T22:22:00.9257063Z http.https://github.com/.extraheader 2023-08-31T22:22:00.9272065Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2023-08-31T22:22:00.9305852Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2023-08-31T22:22:00.9688654Z Post job cleanup. 2023-08-31T22:22:01.1531517Z Post job cleanup. 2023-08-31T22:22:01.2576469Z [command]/usr/bin/git version 2023-08-31T22:22:01.2623282Z git version 2.41.0 2023-08-31T22:22:01.2667230Z Temporarily overriding HOME='/home/runner/work/_temp/cb6faac9-543c-4ebc-8cca-dc43398e3f4e' before making global git config changes 2023-08-31T22:22:01.2668488Z Adding repository directory to the temporary git global config as a safe directory 2023-08-31T22:22:01.2674309Z [command]/usr/bin/git config --global --add safe.directory /home/runner/work/serve/serve 2023-08-31T22:22:01.2713761Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2023-08-31T22:22:01.2748976Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2023-08-31T22:22:01.2977433Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2023-08-31T22:22:01.3013491Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2023-08-31T22:22:01.3498661Z Cleaning up orphan processes