v0.3.0 🐋 #1390

tianweidut announced in Announcements

tianweidut
Oct 18, 2022
Maintainer

🧭 Major features and enhancements

feat(dataset): support user-raw data format type for dataset (feat(dataset): support user-raw data format type for dataset #918) @tianweidut
feat(datastore): add write-ahead log for data store (feat(datastore): add write ahead log for data store #935) @xuchuan
feat(datastore): data store server naive implementation (feat(datastore): data store server naive implementation #900) @xuchuan
refactor(dataset): dataset meets datastore (refactor(dataset): dataset meets datastore #903) @tianweidut
feat(job): custom job scheduler (feat(job): custom job scheduler #880) @goldenxinxing
example(example):add custom mnist example (example(example):add custom mnist example #1301) @goldenxinxing
feat(datastore): support complex column types (feat(datastore): support complex column types #1277) @xuchuan
feat(test):add e2e test for client cmd (feat(test):add test for client cmd #1199) @goldenxinxing
enhance(sdk): export starwhale package functions, classes, and consts directly (enhance(sdk): export starwhale package functions, classes and consts directly #1269) @tianweidut
feat(console): role privilege component (feat(console): role privilege component #1246) @waynelwz
example: refactor text classification for ag_news dataset (example: refactor text classification for ag_news dataset #1189) @tianweidut
feat(job): tune eval info classification UI for standalone (feat(job): tune eval info classification ui for standalone #1219) @tianweidut
example: refactor PennFudanPed example with new API (example: refactor PennFudanPed example with new api #1167) @tianweidut
example: refactor cifar10 example (example: refactor cifar10 example #1177) @tianweidut
example: refactor nmt example (example: refactor nmt example #1196) @tianweidut
example: refactor speech command example (example: refactor speech command example #1187) @tianweidut
feat(console): viewer with segment/bbox/audio/text (feat(console): viewer with segment/bbox/audio/text #1202) @waynelwz
feat(controller): support aliyun oss (feat(controller): support aliyun oss #1157) @jialeicui
feat(controller): support version alias for model/dataset/runtime (feat(controller): support version alias for model/dataset/runtime #1186) @dreamlandliu
feat(datastore): support custom object type by @xuchuan in feat(datastore): support custom object type #1126
feat(console): datastore type js SDK (feat: datastore type js sdk #1102) @waynelwz
refactor(bootstrap): bye bootstrap (refactor(bootstrap): bye bootstrap #968) @tianweidut
feat(console): refactor dataset/eval by datastore API (feat: refector dataset/eva by datastore api #1055) @waynelwz
feat(console): dataset viewer for mnist bytes (feat: datasete viewer for mnist bytes #1036) @waynelwz
feat(dataset): add swcli dataset diff command (feat(dataset): add swcli dataset diff command #1051) @tianweidut
feat(dataset): standalone simple object store for dataset versioning (feat(dataset): standalone simple object store for dataset versioning #971) @tianweidut
feat(dataset): support Link type for dataset (feat(dataset): support Link type for dataset #944) @tianweidut
feat(dataset): support swcli dataset summary command (feat(dataset): support swcli dataset summary command #916) @tianweidut
feat(controller): support resource pool (feat(controller): support resource pool #961) @jialeicui
feat(controller): support dataset copy (feat(controller): support dataset copy #922) @anda-ren
feat(controller): add new job impl for controller (feat(controller): add new job impl for controller #907) @goldenxinxing
feat(console): support selecting resource pool when creating job (feat(console): support selecting resource pool when create job #985) @jialeicui
feat(console): support sign up with a third-party account (feat(console): support sign up with third-party account #911) @jialeicui
feat(console): log in with third-party account (feat(console): log in with third-party account #914) @jialeicui
enhance(console) move webpack to vite, new layout (enhancement: webpack to vite, new layout #926) @waynelwz

🧮 More features and enhancements

enhance(console): evaluation result with all store tables (enhance(console): evaluation result with all store tables #1241) @waynelwz
enhance(job): refactor sw-docker-entrypiont with split swmp and swrt workdir (enhance(job): refactor sw-docker-entrypiont with split swmp and swrt workdir #1293) @tianweidut
enhance(controller): make init container compatible with both minio and aliyun oss (enhance(controller): make init container compatible with both minio and aliyun oss #890) @anda-ren
enhance(dataset): add X-SW-UPLOAD-DATA-URI header for dataset copy (enhance(dataset): add X-SW-UPLOAD-DATA-URI header for dataset copy #928) @tianweidut
enhance(dataset): tune dataset meta schema fields with swds_bin_offset and swds_bin_size (enhance(dataset): tune dataset meta schema fields with swds_bin_offset and swds_bin_size #1037) @tianweidut
enhance(dataset): tune s3 file read return type as bytes type (enhance(dataset): tune s3 file read return type as bytes type #1040) @tianweidut
enhance(datastore): add more log for remote data store table update (enhance(datastore): add more log for remote data store table update #1071) @tianweidut
enhance(datastore): support SW_OBJECT_STORE_KEY_PREFIX env to unify dataset process (enhance(datastore): support SW_OBJECT_STORE_KEY_PREFIX env to unify dataset process #917) @tianweidut
enhance(datastore): support keepNone in query (enhance(datastore): support keepNone in query #1054) @xuchuan
enhance(datastore): support raw result output for query and scan (enhance(datastore): support raw result output for query and scan #1079) @xuchuan
enhance(datastore): tune TableWriter run thread exception handler (enhance(datastore): tune TableWriter run thread exception handler #1080) @tianweidut
enhance(datastore): tune datastore storage dir by swcli config (enhance(datastore): tune datastore storage dir by swcli config #902) @tianweidut
enhance(docker): tune sw-docker-entrypoint for debug (enhance(docker): tune sw-docker-entrypoint for debug #1068) @tianweidut
enhance(job): simplify job eval cmd (enhance(job): simplify job eval cmd #956) @goldenxinxing
enhance(sdk): set label str type and update mnist example (enhance(sdk): set label str type and update mnist example #1024) @tianweidut
feat(console): new layout and new login page (feat(console): new layout and new login page #898) @waynelwz
feat(console): new overview page & refactor auth (feat(console): new overview page & refactor auth #933) @waynelwz
feat(console): new version project creating modal (feat(console): new version project creating modal #901) @jialeicui
feat(console): owner and description of the project (feat(console): owner and description of project #905) @dreamlandliu
feat(console): privacy of project & project overview statistics (feat(console): privacy of project & project overview statistics #947) @dreamlandliu
feat(console): support email register (feat(console): support email register #921) @jialeicui
feat(console): support resetting password via email (feat(console): support resetting password via email #930) @jialeicui
feat(controller): create a user with password and salt (feat(controller): create user with password and salt #1090) @dreamlandliu
feat(controller): get resource pools api (feat(controller): get resource pools api #978) @jialeicui
feat(controller): Support link auth in controller (feat(controller): Support link auth in controller #999) @anda-ren
feat(controller): make controller dataset schema free (feat(controller): make controller dataset schema free #1034) @anda-ren
feat(controller): populate runtime image to task (feat(controller): populate runtime image to task #1038) @anda-ren
feat(controller): support delayed deletion for failed tasks (feat(controller): support delayed deletion for failed tasks #1002) @jialeicui
feat(controller): support new job/dataset/datastore/runtime (feat(controller): support new job/dataset/datastore/runtime #969) @goldenxinxing
feat(dataset): support dataset build to use the specific runtime environment with --runtime argument (feat(dataset): support dataset build to use the specific runtime environment with --runtime argument #1062) @tianweidut
feat(dataset): support dataset copy with .auth_env file (feat(dataset): support dataset copy with .auth_env file #959) @tianweidut
feat(dataset): support dataset copy with datastore meta load/dump (feat(dataset): support dataset copy with datastore meta load/dump #915) @tianweidut
feat(dataset): support dataset data append-only mode (feat(dataset): support dataset data append only mode #1004) @tianweidut
feat(dataset): support dataset mime_type config (feat(dataset): support dataset mime_type config #1033) @tianweidut
feat(datastore): support RemoteDataStore and make LocalDataStore work with multi-processing (feat(datastore): support RemoteDataStore and make LocalDataStore work with multi processing #909) @xuchuan
feat(datastore): do not compress write-ahead log file in case compression fails (feat(datastore): do not compress write ahead log file in case compression fails #992) @xuchuan
feat(model): support --runtime argument for model build and auto restore runtime (feat(model): support --runtime argument for model build and auto restore runtime #1064) @tianweidut
refactor(client): change misleading fuse to LocalFS (refactor(client): change misleading fuse to LocalFS #963) @tianweidut
refactor(client): replace object asdict method with ASDictMixin class (refactor(client): replace object asdict method with ASDictMixin class #1041) @tianweidut
refactor(console): dataset ui (refactor(console): dataset ui #955) @waynelwz
refactor(controller): clean controller legacy code (refactor(controller): clean controller legacy code #1081) @anda-ren
refactor(controller): modify parameter of token getter from userName to userId (refactor(controller): modify parameter of token getter from userName to userId #904) @anda-ren
refactor(dataset): tune dataset code organization (refactor(dataset): tune dataset code organization #966) @tianweidut
refactor(controller): clean k8s task scheduler code (refactor(controller): clean k8s task scheduler code #1092) @anda-ren
refactor(client): job scheduler (refactor(client): job scheduler #1042) @goldenxinxing
enhance(client): add http_retry decorator (enhance(client): add http_retry decorator #1104) @tianweidut
enhance(datastore): make scan atomic (enhance(datastore): make scan atomic #1119) @xuchuan
feat(console): support runtime revert (feat(console): support runtime revert #1108) @waynelwz
feat(datastore): support list tables by @xuchuan in feat(datastore): support list tables #1135
chore(datastore): allow nonexisting table when query or scan by @jialeicui in chore(datastore): allow non existing table when query or scan #1128
chore(controller): make database name configurable by @jialeicui in chore(controller): make database name configurable #1133
feat(client):history cmd support json format (feat(client):history cmd support json format #1200) @goldenxinxing
feat(console): support fullscreen & card layout ( feat(console): support fullscreen & card layout #1174) @waynelwz
feat(dataset): add mask propteries for Dataset Image type (feat(dataset): add mask propteries for Dataset Image type #1225) @tianweidut
feat(console): add job actions (feat(console): add job actions #1220) @waynelwz
feat(console): support default view with all runs (feat(console): support default view with all runs #1233) @waynelwz
feat(client): support auto-fast-tag for model/dataset/runtime (feat(client): support auto-fast-tag for model/dataset/runtime #1203) @tianweidut
enhance(console): support getting token for swcli login (enhance(console): support getting token for swcli login #1238) @jialeicui
enhance(client): add only_standalone decorator for cli view (enhance(client): add only_standalone decorator for cli view #1258) @tianweidut
enhance(client): tune model/dataset/model not-found info output (enhance(client): tune model/dataset/model not-found info output #1259) @tianweidut
enhance(controller): tune imagePullPolicy for worker container (enhance(controller): tune imagePullPolicy for worker container #1257) @anda-ren
feat(client): support force remove for model/dataset/runtime/eval (feat(client): support force remove for model/dataset/runtime/eval #1261) @tianweidut
feat(controller): add file system support for StorageAccessService by @xuchuan in feat(controller): add file system support for StorageAccessService #1127
example: speech commands dataset support remote link (example: speech commands dataset support remote link #1287) @tianweidut
feat: add system setting API (feat: add system setting api #1328) @anda-ren
doc: add guides zh-docs (doc: add guides zh-docs #1336) @tianweidut
doc: add python SDK zh-doc (doc: add python sdk zh-doc #1333) @tianweidut
doc: update zh-doc for example and cli (doc: update zh-doc for example and cli #1304) @tianweidut
chore(client): support specifying docker image env in runtime.yaml (chore(client): support specifying docker image env in runtime.yaml #1386) @jialeicui
chore(client): use sys.ver when python version not specified in runtime.yaml (chore(client): use sys.ver when python version not specified in runtime.yaml #1338) @jialeicui
enhance(console): make dag layout fitable (enhance(console): make dag layout fitable #1326) @waynelwz
feat(console): job run with multi task config & yaml editor (feat(console): job run with multi task config & yaml editor #1310) @waynelwz
feat(console): show version / update setting page (feat(console): show version / update setting page #1319) @waynelwz
feat(console): system settings config (feat(console): system settings config #1329) @waynelwz
feat(controller): support realtime log (feat(controller): support realtime log #1316) @jialeicui
fix(client):add step scheduler for eval (fix(client):add step scheduler for eval #1318) @goldenxinxing
ci: add auto publish script (ci: add auto publish script #1286) @anda-ren
enhance(console): version selector with alias/duration locals (enhance(console): version selector with alias/duration locals #1296) @waynelwz
optimize: dag/eva layout/table render (optimize: dag/eva layout/table render #1303) @waynelwz
chore(controller): controller and mysql use utc time (chore(controller): controller and mysql use utc time #1263) @jialeicui
enhance(example): tune pfp example ppl results (enhance(example): tune pfp example ppl results #1270) @tianweidut
enhance(console): eval result with summary and add alias support (enhance(console): eval result with summary and add alias support #1275) @waynelwz
feat(controller): add job status to evaluation summary (feat(controller): add job status to evaluation summary #1273) @dreamlandliu
feat(controller): show version in the controller
feat(controller): add system role and project roles in the response of getting current user (feat(controller): add system role and project roles in the response of getting current user #1271) @dreamlandliu
refactor(controller): refactor storage env related code (refactor(controller): refactor storage env related code #1249) @anda-ren
enhance(console): match with client as_mask (update(console): match with client as_mask #1210) @waynelwz
enhance(console): use name as list column (update(console): use name as list column #1214) @waynelwz
chore(controller): use static constants instead of enum in order to support future complex types (chore(controller): use static constants instead of enum in order to support future complex types #1184) @xuchuan
chore(datastore): make ObjectStore a proxy of StorageAccessService (chore(datastore): make ObjectStore a proxy of StorageAccessService #1170) @xuchuan
chore(datastore): reduce memory usage by using schema name as the key… (chore(datastore): reduce memory usage by using schema name as the key… #1134) @xuchuan
chore(datastore): use explicit typing in the query instead of guessing type from actual column value (chore(datastore): use explicit typing in query instead of guessing type from actual column value #1195) @xuchuan
feat(dataset): support annotations and data type for dataset (feat(dataset): support annotations and data type for dataset #1130) @tianweidut
ci(ut-controller): codecov report for java (ci(ut-controller): codecov report for java #1123) @anda-ren
enhance(controller): add user name dup validation when create new user (enhance(controller): add user name dup validation when create new user #1088) @anda-ren
feat(controller): user info contains email(if exists) (feat(controller): user info contains email(if exists) #1073) @dreamlandliu

🛎️ Bug fixes

fix(test): use microsecond as name to create tmp user (fix(test): use microsecond as name to create tmp user #1076) @dreamlandliu
bug(dataset): fix dataset rows diff error (bug(dataset): fix dataset rows diff error #1204) @tianweidut
fix(ci): increase minikube memory limit to 4G (fix(ci): increase minikube memory limit to 4G #1221) @anda-ren
fix(client):remove exit logic (fix(client):remove exit logic #1217) @goldenxinxing
fix(console): The project‘s account name changed when editing a project #1139 owner when editing project (fix(console): #1139 owner when editing project #1213) @waynelwz
fix(console): Customer view problem #1179 The display of evaluation results #1181 (fix(console): #1179 #1181 #1208) @waynelwz
fix(controller): can not work with minio when disabling the chunked encoding config (fix(controller): can not work with minio when disable the chunkedEncoding config #1224) @jialeicui
fix(dataset): support link type reflect (bug(dataset): support link type reflect #1276) @tianweidut
fix(client): terminal execute process on failure (fix(client): terminal execute process on failure #1349) @goldenxinxing
fix(client): unit test works with macOS (fix(client): unit test works with macos #1351) @jialeicui
fix(controller): fix job status is unknown occasionally (fix(controller): fix job status is unknown occasionally #1347) @anda-ren
fix(docker): add python-dev in base image (fix(docker): add python-dev in base image #1352) @jialeicui
bug(client): fix pathlib.unlink missing_ok argument error in python3.7 (bug(client): fix pathlib.unlink missing_ok argument error in python3.7 #1342) @tianweidut
chore(client): make client ut stable (chore(client): make client ut stable #1337) @jialeicui
fix(evaluation):add request and limit for step (fix(evaluation):add request and limit for step #1335) @goldenxinxing
fix(console): change token key in URL param (fix(console): change token key in url param #1309) @jialeicui
fix(controller): add unique index on project name (fix(controller): add unique index on project name #1272) @dreamlandliu
fix(controller): delay deletion of the failed job now works (fix(controller): delay deletion of failed job now works #1285) @jialeicui
fix(controller): untar error at job container (fix(controller): untar error at job container #1294) @goldenxinxing
fix(controller): set datastore api param 'ignoreNonExistingTable'=true (fix(controller):set datastore api param 'ignoreNonExistingTable'=true #1297) @goldenxinxing
fix(controller): split dir for swmp and swrt (fix(controller):split dir for swmp and swrt #1292) @goldenxinxing
bug(runtime): fix dockerize tag tuple typo (bug(runtime): fix dockerize tag tuple typo #1251) @tianweidut
fix(controller): oss list all keys (fix(controller): oss list all keys #1256) @jialeicui
fix(controller): the project description cannot be set to empty (fix(controller): the project description cannot be set to empty #1268) @dreamlandliu
fix(client)：remove base64 encode/decode ppl result (fix(client)：remove base64 encode/decode ppl result #1252) @goldenxinxing
fix(controller): fix gpu failure (fix(controller): fix gpu failure #1253) @anda-ren
bug(client): fix model/dataset/runtime info command (bug(client): fix model/dataset/runtime info command #1242) @tianweidut
bug(client): fix datastore atexit dump test error (ci(client): fix datastore atexit dump test error #1236) @tianweidut
fix(controller): dataset does not show when using aliyun oss (fix(controller): dataset not show when using aliyun oss #1240) @jialeicui
fix(controller): guest user has permission to see the resource in the dataset (fix(controller): guest user has permission to see the resource in dataset #1244) @jialeicui
fix(datastore): fix copyTo/setBytes function of SwByteBuffer (fix(datastore): fix copyTo/setBytes function of SwByteBuffer #1232) @jialeicui
fix(controller): show a security message in English (fix(controller): show security message in English #1218) @dreamlandliu
fix(datastore): can not load wal after restart (fix(datastore): can not load wal after restart #1223) @jialeicui
fix(datastore): datastore table list out of bound error when invoking scan API (fix(datastore): datastore table list out of bound error when invoke scan api #1231) @goldenxinxing
test(controller): add unit tests (test(controller): add unit tests #1222) @dreamlandliu
fix(client): add the label for the container and cancel by label (fix(client): add label for container and cancel by label #1172) @goldenxinxing
fix(client):exit error code when failed (fix(client):exit error code when failed #1192) @goldenxinxing
fix(client): task failed but status is a success (fix(client):task failed but status is success #1194) @goldenxinxing
fix(console): User adding problem #1140 list not refresh after add (fix(console): #1140 list not refresh after add #1175) @waynelwz
fix(console): can not reset password (fix(console): can not reset password #1150) @jialeicui
fix(controller): rename job dataset mapper name (fix(controller): rename job dataset mapper name #1153) @goldenxinxing
fix(controller): sql syntax error of list object counts (fix(controller): sql syntax error of list object counts #1152) @dreamlandliu
fix(controller): try to fix no cmp log bug (fix(controller): try to fix no cmp log bug #1163) @anda-ren
fix(controller): use type string name other than category (fix(controller): use type string name other than category #1191) @jialeicui
fix(datastore): add ignoreNonExistingTable option for scan table (fix(datastore): add ignoreNonExistingTable option for scan table #1154) @jialeicui
fix(docker): fix jar building after adding java.header for checkstyle (fix(docker): fix jar building after adding java.header for checkstyle #1148) @jialeicui
fix(controller): Change the field of task table (fix: Change the field of task table #1173) @anda-ren
fix(console): edit project using PUT method in overview page (fix(console): edit project use PUT method in overview page #1101) @jialeicui
fix(model): eval cmd bug (fix(model): eval cmd bug #949) @goldenxinxing
fix(client): cmp results use multi table in datastore (fix(client): cmp results use multi table in datastore #1030) @goldenxinxing
fix(client): dataset copy error when the current instance is not local (fix(client): dataset copy error when current instance is not local #1091) @goldenxinxing
fix(client): fix wrong uri of head request (fix(client): fix wrong uri of head request #899) @jialeicui
fix(client): support docker run mode at standalone (fix(client): support docker run mode at standalone #1083) @goldenxinxing
fix(client):move auc to new table (fix(client):move auc to new table #1048) @goldenxinxing
fix(console): keep state unique without local persist (fix(console): keep state unique without local persist #936) @waynelwz
fix(console): fix bug & add pytest for project api (fix(console): fix bug & add pytest for project api #970) @dreamlandliu
fix(console): new password input disabled when the user changes password (fix(console): new password input disabled when user changes password #894) @jialeicui
fix(controller): add alter script for job (fix(controller): add alter script for job #913) @goldenxinxing
fix(controller): dataset upload issues (fix(controller): dataset upload issues #1007) @jialeicui
fix(controller): do not cache unfinished evaluation (fix(controller): do not cache unfinished evaluation #1074) @jialeicui
fix(controller): evaluation counts include all of jobs (fix(controller): evaluation counts include all of jobs #1069) @dreamlandliu
fix(controller): exception that occurs when the register_info does not exist (fix(controller): exception that occurs when the register_info does not exist #1082) @dreamlandliu
fix(controller): fix dataset link auth error (fix(controller): fix dataset link auth error #1013) @anda-ren
fix(controller): fix dataset uri download error (fix(controller): fix dataset uri download error #1028) @anda-ren
fix(controller): fix dataset/model copy error (fix(controller): fix dataset/model copy error #1014) @anda-ren
fix(controller): fix integeration test bugs (fix(controller): fix integeration test bugs #1025) @anda-ren
fix(controller): fix integration test error (fix(controller): fix integration test error #1049) @anda-ren
fix(controller): fix log missing bug (fix(controller): fix log missing bug #1045) @anda-ren
fix(controller): fix log overwrite error (fix(controller): fix log overwrite error #1058) @anda-ren
fix(controller): fix the problem of generating empty WAL files when DataStore uses object storage (fix(controller): fix the problem of generating empty WAL files when DataStore uses object storage #1029) @jialeicui
fix(controller): fix wal init error (fix(controller): fix wal init error #1060) @anda-ren
fix(controller): flyway not support mysql8.0 (fix(controller): flyway not support mysql8.0 #1003) @goldenxinxing
fix(controller): job list bug (fix(controller): job list bug #1008) @goldenxinxing
fix(controller): make resource pool feature compatible with the old data (fix(controller): make resource pool feature compatible with the old data #986) @jialeicui
fix(controller): prevent losing data after finding the eval_jobs.yaml file (fix(controller): prevent losing data after finding the eval_jobs.yaml file #1010) @jialeicui
fix(controller): project maintainer/guest can get the role list (fix(controller): project maintainer/guest can get the role list #1067) @dreamlandliu
fix(controller): resolve env overwritten (fix(controller): resolve env overwritten #1019) @jialeicui
fix(controller): tune step trigger condition (fix(controller): tune step trigger condition #1047) @goldenxinxing
fix(controller): use the manifest field as the runtime image (fix(controller): use manifest field as the runtime image #1046) @jialeicui
fix(controller): verify object id when converting object URL (fix(controller): verify object id when converting object url #1050) @dreamlandliu
fix(controller):image name typo (fix(controller):image name typo #1012) @goldenxinxing
fix(dataset): add default s3 region for s3 link auth (fix(dataset): add default s3 region for s3 link auth #1011) @tianweidut
fix(datastore): add retrying to WAL reading (fix(datastore): add retrying to WAL reading #1053) @xuchuan
fix(datastore): close inputstream after using s3.get (fix(datastore): close inputstream after using s3.get #1044) @jialeicui
fix(datastore): keep retrying to write WAL even if terminated (fix(datastore): keep retrying to write WAL even if terminated #1052) @xuchuan
fix(datastore):revert datastore exit logic (fix(datastore):revert datastore exit logic #1096) @goldenxinxing
fix(datastore):uniform column name pattern (fix(datastore):uniform column name pattern #1077) @goldenxinxing
fix(docker) :entry point typo (fix(docker) :entry point typo #1066) @goldenxinxing
fix(docker): change entrypoint of starwhale from swmp to swmp/src (fix(docker): change entrypoint of starwhale from swmp to swmp/src #1032) @jialeicui
fix(docker): entrypoint default value format (fix(docker): entrypoint default value format #1018) @jialeicui
fix(docker): fix wrong python version string parsed by awk (fix(docker): fix wrong python version string parsed by awk #1075) @jialeicui

🌱 Small bug fixes, doc updates, and add tests

fix(example): use new version swcli in mnist demo (fix(example): use new version swcli in mnist demo #1084) @jialeicui
fix(controller): mapper name error with Upper case (fix(controller): mapper name error with Upper case #1151) @goldenxinxing
fix(controller): fix e2e failing (fix(controller): fix e2e failing #1201) @anda-ren
fix(controller): remove duplicate mapper file (fix(controller): remove duplicate mapper file #1149) @jialeicui
enhance(controller): data provider in job support virtual host path (enhance(controller): data provider in job support virtual host path #1182) @jialeicui
enhance(controller): support virtual host path configuration (enhance(controller): support virtual host path configuration #1178) @jialeicui
enhance(controller): use s3 multipart upload for huge file (enhance(controller): use s3 multipart upload for huge file #1158) @xuchuan
enhance(datastore): compatible with ali oss (enhance(datastore): compatible with ali oss #1132) @jialeicui
chore(controller): add test for JobMapper,JobSwdsVersionMapper,ProjectMapper (chore(controller): add test for JobMapper,JobSwdsVersionMapper,ProjectMapper #1235) @anda-ren
chore(client): add ut for client runtime (chore(client): add ut for client runtime #1230) @tianweidut
chore(console): multi optimizations of ui and interactive (chore(console): multi optimizations of ui and interactive #1262) @waynelwz
ci: local e2e test (ci: local e2e test #1362) @anda-ren
enhance(client): tune runtime process logger with the external swcli verbose setting (enhance(client): tune runtime process logger with the external swcli verbose setting #1380) @tianweidut
example: update pytorch runtime example for python3.7-3.10 (example: update pytorch runtime example for python3.7-3.10 #1383) @tianweidut
doc: add contribute docs (doc: add contribute docs #1350) @tianweidut
fix(e2e): update task num when run eval on cloud (fix(e2e): update task num when run eval on cloud #1345) @goldenxinxing
bug(client): fix mypy exclude typo and some code lint error (bug(client): fix mypy exclude typo and some code lint error #1343) @tianweidut
chore: thin server base image size (chore: thin server base image size #1339) @anda-ren
doc(eval): update eval doc (doc(eval): update eval doc #1340) @goldenxinxing
test(controller): unit test for bundle/runtime/swmp/swds managers and services and fix some bugs (test(controller): unit test for bundle/runtime/swmp/swds managers and services and fix some bugs #1323) @dreamlandliu
feat(console): multi of tiny update, locales/iconfont/evaluation images, etc (feat(console): multi of tiny update, locales/iconfont/evaluation images, etc #1315) @waynelwz
chore(console): interactive optimize (chore(console): interactive optimize #1334) @waynelwz
chore(controller): add dev info to pod label (chore(controller): add dev info to pod label #1307) @jialeicui
fix(console): remove tsc from package (fix(console): remove tsc from package #1331) @jialeicui
fix(console): some button text capitalization (fix(console): some button text capitalization #1317) @xuchuan
fix(console): update runtime info after selection changes (fix(console): update runtime info after selection changes #1324) @jialeicui
fix(e2e):add memory for e2e (fix(e2e):add memory for e2e #1321) @goldenxinxing
refactor: make step config available for UI (refactor: make step config availabel for UI #1308) @anda-ren
update(console): logo (update(console): logo #1314) @waynelwz
chore(ci): force config python3.10 micro version for client ci (chore(ci): force config python3.10 micro version for client ci #1305) @tianweidut
chore(controller): make host path for pip cache optional (chore(controller): make host path for pip cache optional #1306) @jialeicui
ci: set fixed python3.10 version to workaround mypy error (ci: set fixed python3.10 version to workaround mypy error #1298) @tianweidut
test(controller): unit test for dataset and runtime controller (test(controller): unit test for dataset and runtime controller #1299) @dreamlandliu
chore(dataset): refactor dataset process name to handler (chore(dataset): refactor dataset process name to handler #1278) @tianweidut
chore(example): upgrade pytorch runtime starwhale version (chore(example): upgrade pytorch runtime starwhale version #1282) @tianweidut
chore(model): refactor model ppl to handler (chore(model): refactor model ppl to handler #1279) @tianweidut
refactor(console): combine systemRole & projectRole in current user (refactor(console): combine systemRole & projectRole in current user #1288) @waynelwz
test(controller): unit test for swmp controller and converter (test(controller): unit test for swmp controller and convertor #1290) @dreamlandliu
refactor(datastore): remove wrapper project and eval_version useless env (refactor(datastore): remove wrapper project and eval_version useless env #1274) @tianweidut
enhance(example): update example code with device converter (enhance(example): update example code with device converter #1264) @tianweidut
enhance(runtime): runtime quickstart will create workdir automatically (enhance(runtime): runtime quickstart will create workdir automatically #1254) @tianweidut
feat(console): Member management problem #1171 component with privilege (feat(console): #1171 component with privilege #1260) @waynelwz
chore(example): upgrade pytorch runtime dependencies (chore(example): upgrade pytorch runtime dependencies #1250) @tianweidut
test(controller): add unit tests (test(controller): add unit tests #1234) @dreamlandliu
fix(client): fix dataset size info in cloud (fix(client): fix dataset size info in cloud #1237) @jialeicui
fix(client): raise exception when error (bug(client): fix failed job status exception raise #1248) @goldenxinxing
fix(client):job info error at cloud instance (fix(client):job info error at cloud instance #1226) @goldenxinxing
chore(ci): alter e2e trigger condition (chore(ci): alter e2e trigger condition #1206) @anda-ren
chore(controller): add UT for K8S related code (chore(controller): add UT for K8S related code #1216) @anda-ren
chore(controller): rename Test** to **Test (chore(controller): rename Test** to **Test #1207) @anda-ren
chroe(ci): remove e2e condition of filter (chroe(ci): remove e2e condition of filter #1209) @anda-ren
chore(client):Remove redundant URI parse logic (chore(client):Remove redundant URI parse logic #1145) @goldenxinxing
chore(controller): add java checkstyle (chore(controller): add checkstyle #1146) @xuchuan
chore(controller): add mybatis test framework (chore(controller): add mybatis test framework #1183) @anda-ren
chore(controller): add test for some mappers (chore(controller): add test for some mappers #1197) @anda-ren
chore(controller): add unit test for StorageAccessServiceS3 (chore(controller): add unit test for StorageAccessServiceS3 #1155) @xuchuan
chore(controller): make controller UT report more accurate (chore(controller): make controller UT report more accurate #1185) @anda-ren
chore(deploy): add storage type in config (chore(deploy): add storage type in config #1193) @jialeicui
ci(e2e): restore broken e2e test (ci(e2e): restore broken e2e test #1131) @anda-ren
ut(controller): add unit test for bug 1164 (ut(controller): add unit test for bug 1164 #1169) @anda-ren
test(controller): add UT, remove wal from jacoco report, adjust UT ci (test(controller): add UT, remove wal from jacoco report, adjust UT ci #1147) @anda-ren
test(controller): unit test for project classes and some tiny change (test(controller): unit test for project classes and some tiny change #1137) @dreamlandliu
test(controller): unit test for user classes and some tiny change (test(controller): unit test for user classes and some tiny change #1159) @dreamlandliu
test(controller): unit tests and some tiny changes (test(controller): unit tests and some tiny changes #1176) @dreamlandliu
fix(controller): fix bug with a syntax error in MySQL by @dreamlandliu in fix（controller): fix bug with syntax error in mysql #1129
chore(console): no error message when no evaluation result by @jialeicui in chore(console): no error message when no evaluation result #1144
bug(client): fix model eval info output (bug(client): fix model eval info output #1110) @goldenxinxing
chore(console): fix descendant dom warning (chore(console): fix descendant dom warning #1100) @jialeicui
doc: update cov badge for readme (doc: update cov badge for readme #1094) @tianweidut
fix(console): Member button should go to Overview page (fix(console): Member button should go to Overview page #1124) @waynelwz
fix(console): model/dataset/runtime revert (fix(console): model/dataset/runtime revert #1112) @waynelwz
fix(console): password input tabindex to -1 (fix(console): password input tabindex to -1 #1125) @waynelwz
fix(console): prevent extra interceptors in strict mode (fix(console): prevent extra interceptors in strict mode #1122) @waynelwz
fix(controller): fix bug of reverting version - add version_order field for version history (fix(controller): fix bug of reverting version - add version_order field for version history #1120) @dreamlandliu
fix(controller): fix flyway sql for version order (fix(controller): fix flyway sql for version order #1121) @dreamlandliu
fix(controller): fix task start time null bug (fix(controller): fix task start time null bug #1111) @anda-ren
fix(controller): try to fix wal ut TempDir not deleted error (fix(controller): try to fix wal ut TempDir not deleted error #1113) @anda-ren
refactor(controller): remove email field of user (refactor(controller): remove email field of user #1107) @anda-ren
refactor(controller): rename manifest field of runtime to image (refactor(controller): rename manifest field of runtime to image #1105) @anda-ren
refactor(controller): the versionUrl is required for revert requests (refactor(controller): the versionUrl is required for revert requests #1109) @dreamlandliu
test(controller): add pytest for management of role (test(controller): add pytest for management of role #991) @dreamlandliu
test(controller): pytest for role permission apis (test(controller): pytest for role permission apis #1006) @dreamlandliu
test(controller): pytest for user api (test(controller): pytest for user api #1017) @dreamlandliu
update(console): project editing api (update(console): project editing api #984) @waynelwz
fix(sdk): single execute status bug (fix(sdk): single execute status bug #1085) @goldenxinxing
fix(sdk): single task execute status bug again (fix(sdk): single task execute status bug again #1087) @goldenxinxing
fix(sdk): task execute at cloud store failed (fix(sdk): task execute at cloud store failed #1070) @goldenxinxing
fix(ci): fix auth token issue in the pull request (fix(ci): fix auth token issue in pull request #1078) @jialeicui
fix(ci): js heap out of memory (fix(ci): js heap out of memory #998) @goldenxinxing
feat(client): add SW_TOKEN env for instance_uri sw_token (feat(client): add SW_TOKEN env for instance_uri sw_token #1016) @tianweidut
feat(client): add --token argument for swcli instance login command (feat(client): add --token argument for swcli instance login command #895) @tianweidut
example: update example for NumPy dependencies (example: update example for numpy dependencies #1021) @tianweidut
chore(deploy): inject instance URL for controller (chore(deploy): inject instance url for controller #1026) @jialeicui
chore(deploy): remove useless result-uploader container (chore(deploy): remove useless result-uploader container #1043) @jialeicui
chore(docker): optimize docker build ppl (chore(docker): optimize docker build ppl #1056) @jialeicui
ci(datastore): fix datastore test for scantable (ci(datastore): fix datastore test for scantable #1022) @tianweidut
ci(standalone): replace standalone test coverage viewer with codecov (ci(standalone): replace standalone test coverage viewer with codecov #1093) @tianweidut
doc: enable doc i18n (doc: enable doc i18n #892) @tianweidut
enhance(client): use destructor instead of atexit (enhance(client): use destructor instead of atexit #1057) @xuchuan
chore(console): fix login route and add trigger for new token storage (chore(console): fix login route and add trigger for new token storage #1099) @jialeicui
chore(console): fix typos (chore(console): fix typos #931) @jialeicui
chore(console): update icon fonts (chore(console): update icon fonts #919) @jialeicui
chore(controller): catch exception when heading model/dataset/runtime (chore(controller): catch exception when heading model/dataset/runtime #1000) @dreamlandliu
chore(controller): remove useless cmd from job template (chore(controller): remove useless cmd from job template #1023) @jialeicui
chore(controller): use offical awscli to support arm64 arch device (chore(controller): use offical awscli to support arm64 arch device #996) @jialeicui
chore(dataset): remove dataset batch_size argument (chore(dataset): remove dataset batch_size argument #910) @tianweidut
chore(dataset): remove useless dataset render-fuse-json command (chore(dataset): remove useless dataset render-fuse-json command #954) @tianweidut
chore(dataset): remove useless mode field in dataset.yaml (chore(dataset): remove useless mode field in dataset.yaml #993) @tianweidut
chore(chart): support creating PV automatically for development (chore(chart): support creating PV automatically for development #965) @jialeicui
chore(client): add typing hint for python lambda (chore(client): add typing hint for python lambda #945) @tianweidut
chore(client): remove deprecated abstractproperty (chore(client): remove deprecated abstractproperty #927) @tianweidut
bug(dataset): fix dataset label size calculate (bug(dataset): fix dataset label size calculate #1027) @tianweidut
bug(dataset): fix ppl loader data encode typo (bug(dataset): fix ppl loader data encode typo #1039) @tianweidut
bug(datastore): fix datastore resp format typo (bug(datastore): fix datastore resp format typo #1020) @tianweidut
bug(datastore): fix scan table path argument error (bug(datastore): fix scan table path argument error #908) @tianweidut
ci(example): add lint for example code (ci(example): add lint for example code #1289) @tianweidut

⚙️ Who Contributes

@anda-ren, @dreamlandliu, @goldenxinxing, @jialeicui, @tianweidut, @waynelwz, and @xuchuan

This discussion was created from the release v0.3.0 🐋.

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment