{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":561401129,"defaultBranch":"dev","name":"spark-rapids-tools","ownerLogin":"NVIDIA","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2022-11-03T15:58:22.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/1728152?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1726003530.0","currentOid":""},"activityList":{"items":[{"before":"9613aa14614532293b09b9c2bf728eb61ad96349","after":"1e2e7c16c69ac2a851a4fd6644d79f99763ef92f","ref":"refs/heads/main","pushedAt":"2024-09-10T21:25:48.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"nvauto","name":"Jenkins Automation","path":"/nvauto","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/70000568?s=80&v=4"},"commit":{"message":"Update changelogs\n\nSigned-off-by: spark-rapids <70000568+nvauto@users.noreply.github.com>","shortMessageHtmlLink":"Update changelogs"}},{"before":"71601e13de68821a3e6829dec73f82135b28cad3","after":"df44de8df83989cab70edbcb3da59e544f3387c5","ref":"refs/heads/dev","pushedAt":"2024-09-10T21:25:32.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"nvauto","name":"Jenkins Automation","path":"/nvauto","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/70000568?s=80&v=4"},"commit":{"message":"Update dev-version by jenkins-spark-rapids-tools-auto-release-90\n\nSigned-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>","shortMessageHtmlLink":"Update dev-version by jenkins-spark-rapids-tools-auto-release-90"}},{"before":"7b017102c8b9320b666d248b2ee1daf805710d98","after":"9613aa14614532293b09b9c2bf728eb61ad96349","ref":"refs/heads/main","pushedAt":"2024-09-10T20:44:59.000Z","pushType":"push","commitsCount":3,"pusher":{"login":"nvauto","name":"Jenkins Automation","path":"/nvauto","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/70000568?s=80&v=4"},"commit":{"message":"Merge dev into main\n\nSigned-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>","shortMessageHtmlLink":"Merge dev into main"}},{"before":"27466143f9715b5f3c3e3a4ca40b443dbd8bac7d","after":"71601e13de68821a3e6829dec73f82135b28cad3","ref":"refs/heads/dev","pushedAt":"2024-09-10T20:12:05.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"parthosa","name":"Partho Sarthi","path":"/parthosa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13639815?s=80&v=4"},"commit":{"message":"Add end-to-end behavioural tests for the python CLI (#1313)\n\n* Add python e2e tests with behave\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Add e2e test for HDFS platform\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Updates tests, docs and fix styling\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Remove unused subprocess\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Remove separate tox env for github actions\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Update docs\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Refactor feature files\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Address review comments\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Improve current file path calculation\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Address review feedbacks\r\n- Add E2E_TOOLS prefix\r\n- Fail if HDFS already running\r\n- Add verbose output\r\n- Move util functions to class\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Update docs about verbose mode\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Fix logger\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Fix flake8\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Address review comments\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n---------\r\n\r\nSigned-off-by: Partho Sarthi ","shortMessageHtmlLink":"Add end-to-end behavioural tests for the python CLI (#1313)"}},{"before":"4747d149dd7d5b75e38e841b6a4aad3a9f21f01a","after":"27466143f9715b5f3c3e3a4ca40b443dbd8bac7d","ref":"refs/heads/dev","pushedAt":"2024-09-06T23:41:18.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"leewyang","name":"Lee Yang","path":"/leewyang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3676078?s=80&v=4"},"commit":{"message":"Add documentation for qualx plugins (#1337)\n\nSigned-off-by: Lee Yang ","shortMessageHtmlLink":"Add documentation for qualx plugins (#1337)"}},{"before":"0a915743c083477f5a2c42cdeb8a4c2ac261f8f6","after":"7b017102c8b9320b666d248b2ee1daf805710d98","ref":"refs/heads/main","pushedAt":"2024-09-06T20:58:42.000Z","pushType":"push","commitsCount":11,"pusher":{"login":"nvauto","name":"Jenkins Automation","path":"/nvauto","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/70000568?s=80&v=4"},"commit":{"message":"Update version by jenkins-spark-rapids-tools-auto-release-88\n\nSigned-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>","shortMessageHtmlLink":"Update version by jenkins-spark-rapids-tools-auto-release-88"}},{"before":"20d0c32b7d7400add366c8fde77ed21b25bb6c31","after":"4747d149dd7d5b75e38e841b6a4aad3a9f21f01a","ref":"refs/heads/dev","pushedAt":"2024-09-06T18:49:10.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"amahussein","name":"Ahmed Hussein","path":"/amahussein","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/50450311?s=80&v=4"},"commit":{"message":"Allow spark dependency to be configured dynamically (#1326)\n\n* Allow spark dependency to be configured dynamically\r\n\r\nSigned-off-by: Ahmed Hussein \r\n\r\nFixes #1316\r\n\r\nAllow user-tools to pick the SPARK dependencies based on a runtime\r\nenv_var. The value format follows the same format of `buildver` in the\r\nscala pom file.\r\nCurrently 333 and 350 (default) are supported.\r\nIf user specifies an invalid value, there will be a warning message,\r\nthen the process fails running the java cmd.\r\n\r\n**Changes**\r\n\r\n- Add dependency key to the platform config-file\r\n- A platform can define its own default dependency versions using\r\n `activeBuildVer` key\r\n- Add a default `RUNTIME_BUILDVER` in the `__init__.py` to allow\r\n upgrades of spark release during official releases\r\n- Read an env_var `RAPIDS_USER_TOOLS_RUNTIME_BUILDVER` to pick the\r\n correct dependency.\r\n- Currently, only `333` and `350` are supported. Default is `350`\r\n\r\n* remove value used to test\r\n\r\nSigned-off-by: Ahmed Hussein \r\n\r\n* Change behavior to give precedence to the rnv_var\r\n\r\nSigned-off-by: Ahmed Hussein \r\n\r\n* rename env_var and raise error for invalid dep version\r\n\r\nSigned-off-by: Ahmed Hussein \r\n\r\n* Rename buildver to spark_dep\r\n\r\nSigned-off-by: Ahmed Hussein \r\n\r\n---------\r\n\r\nSigned-off-by: Ahmed Hussein ","shortMessageHtmlLink":"Allow spark dependency to be configured dynamically (#1326)"}},{"before":"12adc3fd5cdb9816a9b212d3202c80044963e0b9","after":"20d0c32b7d7400add366c8fde77ed21b25bb6c31","ref":"refs/heads/dev","pushedAt":"2024-09-06T18:45:14.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"amahussein","name":"Ahmed Hussein","path":"/amahussein","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/50450311?s=80&v=4"},"commit":{"message":"[FEA] Add total core seconds in Qualification core tool output (#1320)\n\n* add total core sec in core tool output csv\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* fix test failure\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* changed total core seconds order in csv\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* remove storing total core ms as a variable in appbase\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* revert unit test change\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* debug tests\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* debug tests\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* round up total core sec\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* updated test results\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* chage executor info add time to long type\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* address review feedback\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n---------\r\n\r\nSigned-off-by: cindyyuanjiang ","shortMessageHtmlLink":"[FEA] Add total core seconds in Qualification core tool output (#1320)"}},{"before":"4f2d6e018d29c2471d0da304361199a9ffcc2b6b","after":"12adc3fd5cdb9816a9b212d3202c80044963e0b9","ref":"refs/heads/dev","pushedAt":"2024-09-06T18:16:25.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"amahussein","name":"Ahmed Hussein","path":"/amahussein","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/50450311?s=80&v=4"},"commit":{"message":"Add support to MaxBy and MinBy in Qualification tool (#1335)\n\nSigned-off-by: Ahmed Hussein \r\n\r\nFixes #1329\r\n\r\n- Add `MaxBy` and `MinBy` to the supported expressions CSV files\r\n- Update the score sheets\r\n- Remove the override from the `override_supported_configs.json`\r\n- Add a unit test to verify that `min_by` and `max_by` are marked as\r\n supported when appearing in hashAggregate","shortMessageHtmlLink":"Add support to MaxBy and MinBy in Qualification tool (#1335)"}},{"before":"277e9511401761b23cb55ccc19c71bbf8617d13b","after":"4f2d6e018d29c2471d0da304361199a9ffcc2b6b","ref":"refs/heads/dev","pushedAt":"2024-09-06T15:49:17.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"amahussein","name":"Ahmed Hussein","path":"/amahussein","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/50450311?s=80&v=4"},"commit":{"message":"Add safeguards to prevent older attempts from generating metrics output in Scala Tool (#1324)\n\n* Add safeguards to prevent older attempts from generating qual summary output\r\n* Adding synchronization on the reporting and autotuner level (#54)\r\n* Fix failing scala unit tests by providing unique app IDs in test (#53)\r\n* Ignore test for event logs with same app Id and attempt Id\r\n\r\n---------\r\n\r\nSigned-off-by: Partho Sarthi \r\nSigned-off-by: Ahmed Hussein (amahussein) \r\nCo-authored-by: Ahmed Hussein (amahussein) ","shortMessageHtmlLink":"Add safeguards to prevent older attempts from generating metrics outp…"}},{"before":"ca97bc1cc201504aa3a69043c832d915ba1b19e1","after":"277e9511401761b23cb55ccc19c71bbf8617d13b","ref":"refs/heads/dev","pushedAt":"2024-09-06T15:03:21.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"amahussein","name":"Ahmed Hussein","path":"/amahussein","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/50450311?s=80&v=4"},"commit":{"message":"Follow-up 1318: Fix QualX fallback with default speedup and duration columns (#1330)\n\n* Handle fallbacks from QualX\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Fix comment\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Remove try-except for ScanTblError\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n---------\r\n\r\nSigned-off-by: Partho Sarthi ","shortMessageHtmlLink":"Follow-up 1318: Fix QualX fallback with default speedup and duration …"}},{"before":"75b9444b082af05a74b3253c1d274cb62384e1ab","after":"ca97bc1cc201504aa3a69043c832d915ba1b19e1","ref":"refs/heads/dev","pushedAt":"2024-09-06T14:30:16.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"amahussein","name":"Ahmed Hussein","path":"/amahussein","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/50450311?s=80&v=4"},"commit":{"message":"Sync up DAYTIME and YEARMONTH fields with CSV plugin files (#1328)\n\nSigned-off-by: Ahmed Hussein \r\n\r\nFixes #1327\r\n\r\nReset the `DAYTIME` and `YEARMONTH` columns in the CSV files to avoid noise in the diff report.\r\nThis change also syncs up the supported operators with the plugin\r\nversion which adds `min_by` and `max_by`","shortMessageHtmlLink":"Sync up DAYTIME and YEARMONTH fields with CSV plugin files (#1328)"}},{"before":"b94b7ee615fd7310ea735836b817e2475b260f20","after":"75b9444b082af05a74b3253c1d274cb62384e1ab","ref":"refs/heads/dev","pushedAt":"2024-09-05T17:34:07.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"leewyang","name":"Lee Yang","path":"/leewyang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3676078?s=80&v=4"},"commit":{"message":"Updated models for EMR NDS-H dataset (#1331)\n\nSigned-off-by: Lee Yang ","shortMessageHtmlLink":"Updated models for EMR NDS-H dataset (#1331)"}},{"before":"8a63490934cfbb2d27bf2f2f5c3189232dcab131","after":"b94b7ee615fd7310ea735836b817e2475b260f20","ref":"refs/heads/dev","pushedAt":"2024-09-05T05:12:42.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"pxLi","name":"Peixin","path":"/pxLi","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/8086184?s=80&v=4"},"commit":{"message":"Update signoff usage (#1332)\n\nSigned-off-by: Peixin Li ","shortMessageHtmlLink":"Update signoff usage (#1332)"}},{"before":"a224a0f28c184c6b10065f46fb2b6a674f6ec20a","after":"0a915743c083477f5a2c42cdeb8a4c2ac261f8f6","ref":"refs/heads/main","pushedAt":"2024-09-04T01:06:40.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"nvauto","name":"Jenkins Automation","path":"/nvauto","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/70000568?s=80&v=4"},"commit":{"message":"Update changelogs\n\nSigned-off-by: spark-rapids <70000568+nvauto@users.noreply.github.com>","shortMessageHtmlLink":"Update changelogs"}},{"before":"d9b7a52ddfc8128318023f0019cd5db79d431185","after":"8a63490934cfbb2d27bf2f2f5c3189232dcab131","ref":"refs/heads/dev","pushedAt":"2024-09-04T01:06:26.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"nvauto","name":"Jenkins Automation","path":"/nvauto","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/70000568?s=80&v=4"},"commit":{"message":"Update dev-version by jenkins-spark-rapids-tools-auto-release-87\n\nSigned-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>","shortMessageHtmlLink":"Update dev-version by jenkins-spark-rapids-tools-auto-release-87"}},{"before":"0a70190e06b9be568ec430aefa7c33fcd9b8486c","after":"a224a0f28c184c6b10065f46fb2b6a674f6ec20a","ref":"refs/heads/main","pushedAt":"2024-09-03T21:01:27.000Z","pushType":"push","commitsCount":22,"pusher":{"login":"nvauto","name":"Jenkins Automation","path":"/nvauto","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/70000568?s=80&v=4"},"commit":{"message":"Update version by jenkins-spark-rapids-tools-auto-release-84\n\nSigned-off-by: spark-rapids automation <70000568+nvauto@users.noreply.github.com>","shortMessageHtmlLink":"Update version by jenkins-spark-rapids-tools-auto-release-84"}},{"before":"7df6cb383ed7307ce8e0229ef2a1129300c17485","after":"d9b7a52ddfc8128318023f0019cd5db79d431185","ref":"refs/heads/dev","pushedAt":"2024-08-30T19:49:20.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"amahussein","name":"Ahmed Hussein","path":"/amahussein","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/50450311?s=80&v=4"},"commit":{"message":"Remove legacy SpeedupFactor from core output files (#1318)\n\n* Remove legacy SpeedupFactor from core output files\r\n\r\nSigned-off-by: Ahmed Hussein \r\n\r\nContributes to #1199\r\n\r\nRemove legacy speedup columns from core tools output files. This does\r\nnot address removing fields from AppSummaryInfo which requires extensive\r\ncode cleanup\r\n\r\n- `rapids_4_spark_qualification_output.csv`\r\n - `Estimated GPU Speedup`\r\n - `Task Speedup Factor`\r\n - `Recommendation`\r\n- `rapids_4_spark_qualification_output_execs.csv`\r\n - `Task Speedup Factor`\r\n- `rapids_4_spark_qualification_output_stages.csv`\r\n - `Average Speedup Factor`\r\n- `rapids_4_spark_qualification_output_persql.csv`\r\n - `Recommendation`\r\n - `Estimated GPU Speedup`\r\n\r\n* remove legacy speedup from qualx reports\r\n\r\nSigned-off-by: Lee Yang \r\n\r\n---------\r\n\r\nSigned-off-by: Lee Yang \r\nCo-authored-by: Lee Yang ","shortMessageHtmlLink":"Remove legacy SpeedupFactor from core output files (#1318)"}},{"before":"9710ff862b8231b11313f031157a0f0332fbbbbe","after":"7df6cb383ed7307ce8e0229ef2a1129300c17485","ref":"refs/heads/dev","pushedAt":"2024-08-30T16:45:40.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"amahussein","name":"Ahmed Hussein","path":"/amahussein","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/50450311?s=80&v=4"},"commit":{"message":"Mark decimalsum as supported in Qualification tool (#1323)\n\nSigned-off-by: Ahmed Hussein \r\n\r\nFixes #1322\r\n\r\nThis code change marks `decimalsum` as supported in the Qualification\r\ntool.\r\n`decimalsum` is a new operator specific to EMR and the RAPIDS plugin converts\r\nit to `gpudecimal128sum`\r\n\r\n**Changes**\r\n\r\n- update the supportedExprs.csv\r\n- update the score sheets. Eventhough, this is only specific to EMR, it\r\n is preferred to add it to other CSPs in case the platform was not\r\ndefined correctly by the user (which is a common case)\r\n- added a new UT.","shortMessageHtmlLink":"Mark decimalsum as supported in Qualification tool (#1323)"}},{"before":"e5df3292ae6ca69b7f3a7a9409c275e7ccf7ae8b","after":"9710ff862b8231b11313f031157a0f0332fbbbbe","ref":"refs/heads/dev","pushedAt":"2024-08-28T20:37:31.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"cindyyuanjiang","name":"Cindy Jiang","path":"/cindyyuanjiang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47068112?s=80&v=4"},"commit":{"message":"[DOC] spark_rapids CLI help cmd still shows cost savings (#1317)\n\n* improve spark_rapids -- --help results\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* remove unused arg\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* addressed review feedback\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* custom model file is only local for now\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n---------\r\n\r\nSigned-off-by: cindyyuanjiang ","shortMessageHtmlLink":"[DOC] spark_rapids CLI help cmd still shows cost savings (#1317)"}},{"before":"822a3490d9432e90f1b171c3ee161933c2902b89","after":"e5df3292ae6ca69b7f3a7a9409c275e7ccf7ae8b","ref":"refs/heads/dev","pushedAt":"2024-08-27T20:24:22.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"nartal1","name":"Niranjan Artal","path":"/nartal1","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/50492963?s=80&v=4"},"commit":{"message":"Mark SMJ as unsupported operator for corner cases in left join (#1309)\n\n* Mark SMJ as unsupported operator for corner cases in left join\r\n\r\nSigned-off-by: Niranjan Artal \r\n\r\n* addressed review comments\r\n---------\r\n\r\nSigned-off-by: Niranjan Artal ","shortMessageHtmlLink":"Mark SMJ as unsupported operator for corner cases in left join (#1309)"}},{"before":"e4e1b0d9d4e9d96c3fac384ce516bccce5cb6090","after":"822a3490d9432e90f1b171c3ee161933c2902b89","ref":"refs/heads/dev","pushedAt":"2024-08-27T20:10:25.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"cindyyuanjiang","name":"Cindy Jiang","path":"/cindyyuanjiang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47068112?s=80&v=4"},"commit":{"message":"added cli shorthands (#1312)\n\nSigned-off-by: cindyyuanjiang ","shortMessageHtmlLink":"added cli shorthands (#1312)"}},{"before":"7c47e51de7e40194a407f235d768d7f4d4624761","after":"e4e1b0d9d4e9d96c3fac384ce516bccce5cb6090","ref":"refs/heads/dev","pushedAt":"2024-08-26T23:57:55.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"parthosa","name":"Partho Sarthi","path":"/parthosa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13639815?s=80&v=4"},"commit":{"message":"Raise error for enum creation from invalid string values (#1300)\n\n* Handle invalid enums\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Include KeyError in except block\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Handle GpuDevice enum initialization\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Fix return types\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n---------\r\n\r\nSigned-off-by: Partho Sarthi ","shortMessageHtmlLink":"Raise error for enum creation from invalid string values (#1300)"}},{"before":"72f7e572c2d696a698b1d575ba6315b0343297d4","after":"7c47e51de7e40194a407f235d768d7f4d4624761","ref":"refs/heads/dev","pushedAt":"2024-08-23T14:29:10.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"amahussein","name":"Ahmed Hussein","path":"/amahussein","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/50450311?s=80&v=4"},"commit":{"message":"Remove arguments and code related to the html-report (#1311)\n\nSigned-off-by: Ahmed Hussein \r\n\r\nFixes #1310\r\n\r\n- Remove argument html-report from Core tools\r\n- Remove mvn task that copies the UI resources into the jar resources\r\n- Remove copyrights related to the JS sources\r\n- Remove the scala code that generate the html report","shortMessageHtmlLink":"Remove arguments and code related to the html-report (#1311)"}},{"before":"2a88516c8230cecf8ac97c00dcb18b5889d40785","after":"72f7e572c2d696a698b1d575ba6315b0343297d4","ref":"refs/heads/dev","pushedAt":"2024-08-22T19:49:21.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"amahussein","name":"Ahmed Hussein","path":"/amahussein","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/50450311?s=80&v=4"},"commit":{"message":"Append HADOOP_CONF_DIR to the tools CLASSPATH execution cmd (#1308)\n\n* Append HADOOP_CONF_DIR to the tools CLASSPATH execution cmd\r\n\r\nSigned-off-by: Ahmed Hussein \r\n\r\nFixes #1253\r\nFixes #1283\r\nFixes #1302\r\nFixes #1303\r\n\r\nThis change includes the following:\r\n\r\n* The wrapper gets Hadoop's configuration directory from the environment variables. The first valid directory is added to the java cmd CLASSPATH. The order of available hadoop configuration directories are:\r\n\r\n 1. `HADOOP_CONF_DIR`\r\n 2. `HADOOP_HOME/conf`\r\n 3. `HADOOP_HOME/etc/hadoop`\r\n\r\nSigned-off-by: Ahmed Hussein \r\n\r\n* Add default argument for HDFS handler\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Add HADOOP_HOME/conf to the list of hadoop conf directories\r\n\r\n* Enforce output folder to be local in tools arguments.\r\nThis PR also enforces URI to the `--output-folder` argument to the java cmd. This is required to prevent the core tools from storing the output-folder on the remote storage in case HDFS defines a default FileSystem.\r\n\r\nSigned-off-by: Ahmed Hussein \r\n\r\n---------\r\nSigned-off-by: Ahmed Hussein \r\nCo-authored-by: Partho Sarthi ","shortMessageHtmlLink":"Append HADOOP_CONF_DIR to the tools CLASSPATH execution cmd (#1308)"}},{"before":"055f088e626bacce5d611eb3a6a1946010f66c8c","after":"2a88516c8230cecf8ac97c00dcb18b5889d40785","ref":"refs/heads/dev","pushedAt":"2024-08-22T18:29:57.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"cindyyuanjiang","name":"Cindy Jiang","path":"/cindyyuanjiang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/47068112?s=80&v=4"},"commit":{"message":"Handle SparkRapidsBuildInfoEvent in GPU event logs (#1203)\n\n* catch SparkRapidsBuildInfoEvent and extract info, wip\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* get spark rapids runtime info and add to runtime properties\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* add support in Prof tool\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* revert some previous changes\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* refactor implementation of sparkrapidsbuildinfo\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* fixed style\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* remove unused code\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* remove unused imports\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* addressed review feedback\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* addressed review feedback\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* fixed scala style\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* add new SparkRapidsBuildInfoEvent.scala file\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* removed unused code\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* added tests\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* updated test case and remove static files\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n* removed static eventlog file\r\n\r\nSigned-off-by: cindyyuanjiang \r\n\r\n---------\r\n\r\nSigned-off-by: cindyyuanjiang ","shortMessageHtmlLink":"Handle SparkRapidsBuildInfoEvent in GPU event logs (#1203)"}},{"before":"1b5f869f25dce64a2e9829c4da2d1034b76c96f7","after":"055f088e626bacce5d611eb3a6a1946010f66c8c","ref":"refs/heads/dev","pushedAt":"2024-08-20T19:03:14.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"parthosa","name":"Partho Sarthi","path":"/parthosa","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/13639815?s=80&v=4"},"commit":{"message":"Enable recursive search for event logs by default and optional `--no-recursion` flag (#1297)\n\n* Recursively search for event log files\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Add argument to disable recursion\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Minor refactor\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Fix root directory processing when recursion is disabled\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Improve checking of databricks event log dir and add private access modifier\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Remove docs related to event log sizes\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n* Resolve merge conflicts\r\n\r\nSigned-off-by: Partho Sarthi \r\n\r\n---------\r\n\r\nSigned-off-by: Partho Sarthi ","shortMessageHtmlLink":"Enable recursive search for event logs by default and optional `--no-…"}},{"before":"52e3577b0bf24184b43b6f3e79cc88fe34675ac5","after":"1b5f869f25dce64a2e9829c4da2d1034b76c96f7","ref":"refs/heads/dev","pushedAt":"2024-08-20T17:55:12.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"tgravescs","name":"Thomas Graves","path":"/tgravescs","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/4563792?s=80&v=4"},"commit":{"message":"Qualification tool support filtering by a filesystem time range (#1299)\n\n\r\n* Add filtering by date/time options for newer and older\r\n\r\n---------\r\n\r\nSigned-off-by: Thomas Graves ","shortMessageHtmlLink":"Qualification tool support filtering by a filesystem time range (#1299)"}},{"before":"b30ca6d884f9e355d49023dd4da3f7a2ab1cb679","after":"52e3577b0bf24184b43b6f3e79cc88fe34675ac5","ref":"refs/heads/dev","pushedAt":"2024-08-19T20:33:06.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"leewyang","name":"Lee Yang","path":"/leewyang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/3676078?s=80&v=4"},"commit":{"message":"Fix key error and cross-join error during qualx evaluate (#1298)\n\n* Fix evaluate bugs\r\n* fix formatting\r\n\r\n---------\r\n\r\nSigned-off-by: Lee Yang ","shortMessageHtmlLink":"Fix key error and cross-join error during qualx evaluate (#1298)"}},{"before":"820fb256f1ca71ffa5bb4078419823f0b7c96785","after":"b30ca6d884f9e355d49023dd4da3f7a2ab1cb679","ref":"refs/heads/dev","pushedAt":"2024-08-19T17:26:18.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"nartal1","name":"Niranjan Artal","path":"/nartal1","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/50492963?s=80&v=4"},"commit":{"message":"Skip generating timeline for stages that do not have completion time (#1290)\n\nSigned-off-by: Niranjan Artal ","shortMessageHtmlLink":"Skip generating timeline for stages that do not have completion time (#…"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEsomysgA","startCursor":null,"endCursor":null}},"title":"Activity · NVIDIA/spark-rapids-tools"}