{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":485548415,"defaultBranch":"main","name":"Daft","ownerLogin":"Eventual-Inc","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2022-04-25T22:02:29.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/98941975?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1726177448.0","currentOid":""},"activityList":{"items":[{"before":"ca46fd736bb933ec412bd6844085d23da4047a0a","after":"1a06fa495695e4909b0462e3ad1ce6df5af299d0","ref":"refs/heads/colin/swordfish-joins","pushedAt":"2024-09-13T18:44:18.000Z","pushType":"push","commitsCount":7,"pusher":{"login":"colin-ho","name":"Colin Ho","path":"/colin-ho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/77712970?s=80&v=4"},"commit":{"message":"Merge branch 'main' into colin/swordfish-joins","shortMessageHtmlLink":"Merge branch 'main' into colin/swordfish-joins"}},{"before":"68dd0c2672863082c4b94cfc904d0b1ccab3cd4d","after":"eb67a8c6cba4d3e3ca9335518b99bc21522ae133","ref":"refs/heads/colin/casting","pushedAt":"2024-09-13T18:43:16.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"colin-ho","name":"Colin Ho","path":"/colin-ho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/77712970?s=80&v=4"},"commit":{"message":"revise matrix","shortMessageHtmlLink":"revise matrix"}},{"before":"8563ab9bbb7bbb7f284aa583800c0913d7f1c4e2","after":"ecbdb1285c0326e713d184d48726e57d13ebd7f1","ref":"refs/heads/colin/swordfish-writes","pushedAt":"2024-09-13T18:37:40.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"colin-ho","name":"Colin Ho","path":"/colin-ho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/77712970?s=80&v=4"},"commit":{"message":"from arrow","shortMessageHtmlLink":"from arrow"}},{"before":"7cc69b93858f24ae1a9e690c51fd6a5ebd2518ab","after":"8563ab9bbb7bbb7f284aa583800c0913d7f1c4e2","ref":"refs/heads/colin/swordfish-writes","pushedAt":"2024-09-13T17:41:55.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"colin-ho","name":"Colin Ho","path":"/colin-ho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/77712970?s=80&v=4"},"commit":{"message":"remove prints","shortMessageHtmlLink":"remove prints"}},{"before":"44f47a5441397c07a98972e3c500f001ba979c56","after":"94990c0fd710dd4a5bc4eeb0f25520d5234412e8","ref":"refs/heads/ronnie/rustfmt","pushedAt":"2024-09-13T07:37:31.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"raunakab","name":"Raunak Bhagat","path":"/raunakab","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39634949?s=80&v=4"},"commit":{"message":"Update Cargo.lock","shortMessageHtmlLink":"Update Cargo.lock"}},{"before":"943a76ca476265de741f065423bdcba0e6c60461","after":"44f47a5441397c07a98972e3c500f001ba979c56","ref":"refs/heads/ronnie/rustfmt","pushedAt":"2024-09-13T06:18:34.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"raunakab","name":"Raunak Bhagat","path":"/raunakab","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39634949?s=80&v=4"},"commit":{"message":"Remove unused deps from daft-csv Cargo.toml","shortMessageHtmlLink":"Remove unused deps from daft-csv Cargo.toml"}},{"before":"205f27bc9b95cc8ec455f9bf01a26b7627f37eaa","after":"943a76ca476265de741f065423bdcba0e6c60461","ref":"refs/heads/ronnie/rustfmt","pushedAt":"2024-09-13T06:13:09.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"raunakab","name":"Raunak Bhagat","path":"/raunakab","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/39634949?s=80&v=4"},"commit":{"message":"Edit rustfmt config file; remove dead daft-csv compression.rs file","shortMessageHtmlLink":"Edit rustfmt config file; remove dead daft-csv compression.rs file"}},{"before":"bab6a51e44f9085f3195226162cbdf9aec9d02a7","after":"7cc69b93858f24ae1a9e690c51fd6a5ebd2518ab","ref":"refs/heads/colin/swordfish-writes","pushedAt":"2024-09-13T03:39:03.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"colin-ho","name":"Colin Ho","path":"/colin-ho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/77712970?s=80&v=4"},"commit":{"message":"reset context","shortMessageHtmlLink":"reset context"}},{"before":"b9a2feb5c673a2569e544630911efdcfc93cc006","after":"bab6a51e44f9085f3195226162cbdf9aec9d02a7","ref":"refs/heads/colin/swordfish-writes","pushedAt":"2024-09-13T02:48:07.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"colin-ho","name":"Colin Ho","path":"/colin-ho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/77712970?s=80&v=4"},"commit":{"message":"cleanup","shortMessageHtmlLink":"cleanup"}},{"before":"a24d327831df29ba78a98e99331dcf83ea732981","after":"5f339f8fba9819b1fd2a3de6d36b1f550d5e769a","ref":"refs/heads/kevin/iceberg-partitioned-writes","pushedAt":"2024-09-13T00:51:11.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"kevinzwang","name":"Kev Wang","path":"/kevinzwang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20215378?s=80&v=4"},"commit":{"message":"start review changes","shortMessageHtmlLink":"start review changes"}},{"before":"62e820dfbab2d3a740625287f42040bda5817036","after":"a24d327831df29ba78a98e99331dcf83ea732981","ref":"refs/heads/kevin/iceberg-partitioned-writes","pushedAt":"2024-09-13T00:08:08.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"kevinzwang","name":"Kev Wang","path":"/kevinzwang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20215378?s=80&v=4"},"commit":{"message":"remove unnecessary match","shortMessageHtmlLink":"remove unnecessary match"}},{"before":"cf9314c48a994a9a0c9e515736db88d0495f30d7","after":"62e820dfbab2d3a740625287f42040bda5817036","ref":"refs/heads/kevin/iceberg-partitioned-writes","pushedAt":"2024-09-12T23:31:50.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"kevinzwang","name":"Kev Wang","path":"/kevinzwang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20215378?s=80&v=4"},"commit":{"message":"add partitioning tests","shortMessageHtmlLink":"add partitioning tests"}},{"before":"df0f2f49d12df2b995d4cdcfcbabe74ff6626505","after":"b9a2feb5c673a2569e544630911efdcfc93cc006","ref":"refs/heads/colin/swordfish-writes","pushedAt":"2024-09-12T21:58:17.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"colin-ho","name":"Colin Ho","path":"/colin-ho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/77712970?s=80&v=4"},"commit":{"message":"undo blockign sink changes","shortMessageHtmlLink":"undo blockign sink changes"}},{"before":"5fb67c24a0719520aac30ad4b88d472cd3452b94","after":"df0f2f49d12df2b995d4cdcfcbabe74ff6626505","ref":"refs/heads/colin/swordfish-writes","pushedAt":"2024-09-12T21:52:59.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"colin-ho","name":"Colin Ho","path":"/colin-ho","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/77712970?s=80&v=4"},"commit":{"message":"rehaul","shortMessageHtmlLink":"rehaul"}},{"before":null,"after":"cf9314c48a994a9a0c9e515736db88d0495f30d7","ref":"refs/heads/kevin/iceberg-partitioned-writes","pushedAt":"2024-09-12T21:44:08.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"kevinzwang","name":"Kev Wang","path":"/kevinzwang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20215378?s=80&v=4"},"commit":{"message":"[FEAT] Iceberg partitioned writes","shortMessageHtmlLink":"[FEAT] Iceberg partitioned writes"}},{"before":"805fbced7a0cfe511f1632b0512d75611deaadc8","after":"6594d872acd6d18d72284e0e9c93ba161be7d0a6","ref":"refs/heads/main","pushedAt":"2024-09-12T21:02:40.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"universalmind303","name":"Cory Grinstead","path":"/universalmind303","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21327470?s=80&v=4"},"commit":{"message":"[FEAT]: sql count(*) (#2832)\n\nadds support for sql `count(*)`\r\n\r\ncloses https://github.com/Eventual-Inc/Daft/issues/2742","shortMessageHtmlLink":"[FEAT]: sql count(*) (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2520545159\" data-permission-text=\"Title is private\" data-url=\"https://github.com/Eventual-Inc/Daft/issues/2832\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/Eventual-Inc/Daft/pull/2832/hovercard\" href=\"https://github.com/Eventual-Inc/Daft/pull/2832\">#2832</a>)"}},{"before":"264f51a15127df21b2f36df60f14452b8846e6a4","after":null,"ref":"refs/heads/kevin/delta-unsafe-rename","pushedAt":"2024-09-12T18:01:23.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"kevinzwang","name":"Kev Wang","path":"/kevinzwang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20215378?s=80&v=4"}},{"before":"2e35d5b0ed7b9eca6383bc6df9d63ab266853102","after":"805fbced7a0cfe511f1632b0512d75611deaadc8","ref":"refs/heads/main","pushedAt":"2024-09-12T18:01:21.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"kevinzwang","name":"Kev Wang","path":"/kevinzwang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20215378?s=80&v=4"},"commit":{"message":"[FEAT] Delta lake allow unsafe rename for local writes (#2824)\n\nI don't know a good way to test this since we believe this issue only\r\narises when you mount a fabric table onto the local filesystem. However\r\nit is a pretty change that should not affect any existing behavior. I\r\nwill verify that it works with our users once it is released.","shortMessageHtmlLink":"[FEAT] Delta lake allow unsafe rename for local writes (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2515189228\" data-permission-text=\"Title is private\" data-url=\"https://github.com/Eventual-Inc/Daft/issues/2824\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/Eventual-Inc/Daft/pull/2824/hovercard\" href=\"https://github.com/Eventual-Inc/Daft/pull/2824\">#2824</a>)"}},{"before":"8aad04c6ae2449413615eaddf386490333c6d545","after":"2e35d5b0ed7b9eca6383bc6df9d63ab266853102","ref":"refs/heads/main","pushedAt":"2024-09-12T15:48:10.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"universalmind303","name":"Cory Grinstead","path":"/universalmind303","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/21327470?s=80&v=4"},"commit":{"message":"[CHORE]: Move jq out of core (#2828)","shortMessageHtmlLink":"[CHORE]: Move jq out of core (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2517682283\" data-permission-text=\"Title is private\" data-url=\"https://github.com/Eventual-Inc/Daft/issues/2828\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/Eventual-Inc/Daft/pull/2828/hovercard\" href=\"https://github.com/Eventual-Inc/Daft/pull/2828\">#2828</a>)"}},{"before":"cf5320cef7656a7ca6c4664dafc06112175657db","after":null,"ref":"refs/heads/sammy/setup-python-for-uv","pushedAt":"2024-09-12T08:17:09.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"samster25","name":"Sammy Sidhu","path":"/samster25","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2550285?s=80&v=4"}},{"before":"c2d7d087b3f4af9004c9578fa27bbb7e1a223d40","after":"8aad04c6ae2449413615eaddf386490333c6d545","ref":"refs/heads/main","pushedAt":"2024-09-12T08:17:08.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"samster25","name":"Sammy Sidhu","path":"/samster25","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2550285?s=80&v=4"},"commit":{"message":"[CHORE] Install Python before using uv (#2840)","shortMessageHtmlLink":"[CHORE] Install Python before using uv (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2521681499\" data-permission-text=\"Title is private\" data-url=\"https://github.com/Eventual-Inc/Daft/issues/2840\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/Eventual-Inc/Daft/pull/2840/hovercard\" href=\"https://github.com/Eventual-Inc/Daft/pull/2840\">#2840</a>)"}},{"before":"5b7ed4d6c8bf234e1cb110337b652585ebc74a89","after":"cf5320cef7656a7ca6c4664dafc06112175657db","ref":"refs/heads/sammy/setup-python-for-uv","pushedAt":"2024-09-12T08:16:24.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"samster25","name":"Sammy Sidhu","path":"/samster25","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2550285?s=80&v=4"},"commit":{"message":"reduntant py version","shortMessageHtmlLink":"reduntant py version"}},{"before":null,"after":"5b7ed4d6c8bf234e1cb110337b652585ebc74a89","ref":"refs/heads/sammy/setup-python-for-uv","pushedAt":"2024-09-12T08:15:36.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"samster25","name":"Sammy Sidhu","path":"/samster25","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2550285?s=80&v=4"},"commit":{"message":"Install Python before using uv","shortMessageHtmlLink":"Install Python before using uv"}},{"before":null,"after":"310e3fc748bdc482d59825e92bd968dd6dc1f195","ref":"refs/heads/sammy/defer_register_super_type","pushedAt":"2024-09-11T23:38:32.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"samster25","name":"Sammy Sidhu","path":"/samster25","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/2550285?s=80&v=4"},"commit":{"message":"Defer Register of Super Type","shortMessageHtmlLink":"Defer Register of Super Type"}},{"before":"7048b9770a83af6133e4b088edd78161c2fad83f","after":"c2d7d087b3f4af9004c9578fa27bbb7e1a223d40","ref":"refs/heads/main","pushedAt":"2024-09-11T21:30:45.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"desmondcheongzx","name":"Desmond Cheong","path":"/desmondcheongzx","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9080227?s=80&v=4"},"commit":{"message":"[CHORE] Decouple Ray tensor types from main Daft logic (#2829)\n\nPrior to this PR, Ray data extension tensor types are handled in Daft's\r\nimporting logic from Arrow. This PR moves this logic to Ray runner code\r\nwhen creating a partition set from a Ray dataset.","shortMessageHtmlLink":"[CHORE] Decouple Ray tensor types from main Daft logic (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2518054728\" data-permission-text=\"Title is private\" data-url=\"https://github.com/Eventual-Inc/Daft/issues/2829\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/Eventual-Inc/Daft/pull/2829/hovercard\" href=\"https://github.com/Eventual-Inc/Daft/pull/2829\">#2829</a>)"}},{"before":"43d15c431f65a28ab7f381dc9c3065eeb683cdd4","after":null,"ref":"refs/heads/dependabot/pip/boto3-1.35.14","pushedAt":"2024-09-11T19:13:18.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"}},{"before":null,"after":"24a0bbb0a2577e372af0adbcd2f87cc53ac97e73","ref":"refs/heads/dependabot/pip/boto3-1.35.16","pushedAt":"2024-09-11T19:13:12.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"},"commit":{"message":"Bump boto3 from 1.34.51 to 1.35.16\n\nBumps [boto3](https://github.com/boto/boto3) from 1.34.51 to 1.35.16.\n- [Release notes](https://github.com/boto/boto3/releases)\n- [Commits](https://github.com/boto/boto3/compare/1.34.51...1.35.16)\n\n---\nupdated-dependencies:\n- dependency-name: boto3\n  dependency-type: direct:development\n  update-type: version-update:semver-minor\n...\n\nSigned-off-by: dependabot[bot] <support@github.com>","shortMessageHtmlLink":"Bump boto3 from 1.34.51 to 1.35.16"}},{"before":"97e651da511a40869da1ca61d82ad55020f6bc50","after":null,"ref":"refs/heads/kevin/deltalake-v0.19","pushedAt":"2024-09-11T19:11:51.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"kevinzwang","name":"Kev Wang","path":"/kevinzwang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20215378?s=80&v=4"}},{"before":"4582192a77857b6c748ec256979cb52594e3b4dd","after":"7048b9770a83af6133e4b088edd78161c2fad83f","ref":"refs/heads/main","pushedAt":"2024-09-11T19:11:50.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"kevinzwang","name":"Kev Wang","path":"/kevinzwang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20215378?s=80&v=4"},"commit":{"message":"[CHORE] Ensure compatibility with deltalake version v0.19 (#2827)\n\nDeltalake v0.19 changes their `_convert_pa_schema_to_delta` function to\r\ntake in a `schema_conversion_mode` instead of `large_dtypes`. Pyarrow\r\nalso needed to be upgraded to v16.0.0 as well to be compatible with the\r\nnew version of deltalake\r\n\r\nThe difference between this PR and #2754 is that it still maintains\r\ncompatibility with older deltalake versions.\r\n\r\nThe reason why this PR also includes a change to arrow2 is because\r\nstarting in version 0.19, deltalake uses arrow-rs by default instead of\r\npyarrow to write files when calling `deltalake.write_deltalake`. We do\r\nnot actually use this functionality but our tests do, and arrow-rs\r\nwrites map arrays in a way that does not conform to the parquet spec. I\r\nfigured it would be good to just add that compatibility in there just in\r\ncase some user is using `arrow-rs` to write their parquet files.\r\n\r\nHowever, there are also other issues with deltalake's rust writer,\r\nincluding improper encoding of partitioned binary columns, so we will\r\nuse their pyarrow writer for testing.","shortMessageHtmlLink":"[CHORE] Ensure compatibility with deltalake version v0.19 (<a class=\"issue-link js-issue-link\" data-error-text=\"Failed to load title\" data-id=\"2517402319\" data-permission-text=\"Title is private\" data-url=\"https://github.com/Eventual-Inc/Daft/issues/2827\" data-hovercard-type=\"pull_request\" data-hovercard-url=\"/Eventual-Inc/Daft/pull/2827/hovercard\" href=\"https://github.com/Eventual-Inc/Daft/pull/2827\">#2827</a>)"}},{"before":"0ba95d026b2c19eed82a89c4d1018c5f19e423ca","after":"97e651da511a40869da1ca61d82ad55020f6bc50","ref":"refs/heads/kevin/deltalake-v0.19","pushedAt":"2024-09-11T18:53:51.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"kevinzwang","name":"Kev Wang","path":"/kevinzwang","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/20215378?s=80&v=4"},"commit":{"message":"fix renamed file import","shortMessageHtmlLink":"fix renamed file import"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0xM1QxODo0NDoxOC4wMDAwMDBazwAAAAS1yuBe","startCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0xM1QxODo0NDoxOC4wMDAwMDBazwAAAAS1yuBe","endCursor":"Y3Vyc29yOnYyOpK7MjAyNC0wOS0xMVQxODo1Mzo1MS4wMDAwMDBazwAAAASzkJDk"}},"title":"Activity · Eventual-Inc/Daft"}