v1.35.2

1.35.2 (2024-10-04)

Bug Fixes

• bigquery validations for partition column and type (#5168) (a2af47a)
• change retl check to source category (#5167) (3ed1302)

v1.35.1

1.35.1 (2024-10-03)

Miscellaneous

• remove panic on NewDatabaseSQLStats Register from various reports (#5163) (af83259)

v1.35.0

1.35.0 (2024-10-01)

Features

• add reason for discards [PIPE-1473] (#5088) (f835aa7)
• bq configurable partitions (#5133) (9544374)
• redshift serverless (#5144) (e37b0e9)

Bug Fixes

• add messageId, rudderId and type based on new schema (#5140) (f6f6dfa)
• remove legacy hosted code which changes connectionToken (#5126) (100b3d9)
• wrong filtering while killing dangling connections (#5142) (0536285)

Miscellaneous

• add db.sql stat collector (#5146) (61e947c)
• add gitleaks scan (#5036) (5bda381)
• change scylla strategy to single table (#5115) (7e56e43)
• emit event_delivery_time metric at staging file level (#5136) (23f943e)
• jit secrets (#4995) (615833e)
• no full vacuum for various reports tables (#5120) (6e8b03e)
• optimise config backend revisionId calls (#5139) (62143dc)
• revert "chore: trim eventNames sent to reporting if length exceeds 50 characters" (#5155) (17c5ad7)
• revert setting max idle connections for jobsdb (#5151) (ef57540)
• schema and record assertions in warehouse integration test (#5091) (336b876)
• sync release v1.34.0 to main branch (#5113) (336b876)
• trim eventNames sent to reporting if length exceeds 50 characters (#5138) (33b5f63)
• users context traits and populate users fields (#5135) (243a4a7)

v1.35.0-rc.3

1.35.0-rc.3 (2024-10-01)

Features

• add reason for discards [PIPE-1473] (#5088) (f835aa7)
• bq configurable partitions (#5133) (9544374)
• redshift serverless (#5144) (e37b0e9)

Bug Fixes

• add messageId, rudderId and type based on new schema (#5140) (f6f6dfa)
• remove legacy hosted code which changes connectionToken (#5126) (100b3d9)
• wrong filtering while killing dangling connections (#5142) (0536285)

Miscellaneous

• add db.sql stat collector (#5146) (61e947c)
• add gitleaks scan (#5036) (5bda381)
• change scylla strategy to single table (#5115) (7e56e43)
• emit event_delivery_time metric at staging file level (#5136) (23f943e)
• jit secrets (#4995) (615833e)
• no full vacuum for various reports tables (#5120) (6e8b03e)
• optimise config backend revisionId calls (#5139) (62143dc)
• revert "chore: trim eventNames sent to reporting if length exceeds 50 characters" (#5155) (17c5ad7)
• revert setting max idle connections for jobsdb (#5151) (ef57540)
• schema and record assertions in warehouse integration test (#5091) (336b876)
• sync release v1.34.0 to main branch (#5113) (336b876)
• trim eventNames sent to reporting if length exceeds 50 characters (#5138) (33b5f63)
• users context traits and populate users fields (#5135) (243a4a7)

v1.35.0-rc.2

1.35.0-rc.2 (2024-10-01)

Features

• add reason for discards [PIPE-1473] (#5088) (f835aa7)
• bq configurable partitions (#5133) (9544374)
• redshift serverless (#5144) (e37b0e9)

Bug Fixes

• add messageId, rudderId and type based on new schema (#5140) (f6f6dfa)
• remove legacy hosted code which changes connectionToken (#5126) (100b3d9)
• wrong filtering while killing dangling connections (#5142) (0536285)

Miscellaneous

• add db.sql stat collector (#5146) (61e947c)
• add gitleaks scan (#5036) (5bda381)
• change scylla strategy to single table (#5115) (7e56e43)
• emit event_delivery_time metric at staging file level (#5136) (23f943e)
• jit secrets (#4995) (615833e)
• no full vacuum for various reports tables (#5120) (6e8b03e)
• optimise config backend revisionId calls (#5139) (62143dc)
• revert setting max idle connections for jobsdb (#5151) (ef57540)
• schema and record assertions in warehouse integration test (#5091) (336b876)
• sync release v1.34.0 to main branch (#5113) (336b876)
• trim eventNames sent to reporting if length exceeds 50 characters (#5138) (33b5f63)
• users context traits and populate users fields (#5135) (243a4a7)

v1.35.0-rc.1

1.35.0-rc.1 (2024-09-30)

Features

• add reason for discards [PIPE-1473] (#5088) (f835aa7)
• bq configurable partitions (#5133) (9544374)
• redshift serverless (#5144) (e37b0e9)

Bug Fixes

• add messageId, rudderId and type based on new schema (#5140) (f6f6dfa)
• remove legacy hosted code which changes connectionToken (#5126) (100b3d9)
• wrong filtering while killing dangling connections (#5142) (0536285)

Miscellaneous

• add gitleaks scan (#5036) (5bda381)
• change scylla strategy to single table (#5115) (7e56e43)
• emit event_delivery_time metric at staging file level (#5136) (23f943e)
• jit secrets (#4995) (615833e)
• no full vacuum for various reports tables (#5120) (6e8b03e)
• optimise config backend revisionId calls (#5139) (62143dc)
• schema and record assertions in warehouse integration test (#5091) (336b876)
• sync release v1.34.0 to main branch (#5113) (336b876)
• trim eventNames sent to reporting if length exceeds 50 characters (#5138) (33b5f63)
• users context traits and populate users fields (#5135) (243a4a7)

v1.34.1

1.34.1 (2024-09-23)

Miscellaneous

• set maxIdleConns for jobsdb handles and emit (*sql.DB).Stats (#5123) (2aafc50)

v1.34.0

1.34.0 (2024-09-18)

Features

• enable retention period for warehouse uploads (#5045) (b4f18d2)

Bug Fixes

• datalake spark flaky test (#5075) (57dd8c1)
• each router handle stores the entire connections map (#5109) (dfbfa78)
• error reporting lag and pii handle (#5028) (40a5446)
• gateway internal batch endpoint stats (#5089) (bbaaabd)
• prevent badgerdb hang when closing without prior operations (#5074) (9a4b843)
• replace counter with gauge cron tracker alert (#5084) (dc7d6ef)
• reporting from warehouse module for failing uploads (#5044) (ec92f31)
• revert support for webhook headers (#5064) (df7e02f)
• webhook integration tests (#5061) (b4f18d2)

Miscellaneous

• add trufflehog scan step before image push (#5035) (b4f18d2)
• delete load files post successful upload (#5050) (d9c5c79)
• deps upgrade (#5081) (6493beb)
• deps: bump the go-deps group across 1 directory with 4 updates (#5090) (63c4033)
• deps: bump the go-deps group across 1 directory with 6 updates (#5058) (b4f18d2)
• deps: bump the go-deps group with 2 updates (#5059) (b4f18d2)
• for bigquery FORCE_RUN_INTEGRATION_TESTS (#5060) (ff271e5)
• include transformationId in transformer client metrics (#5055) (b4f18d2)
• make scylla hosts as slice (#5107) (0ada31f)
• passing dependency for asyncdestinationmanager (#5080) (f6271a0)
• propogate source category to router (#5085) (f41b9d1)
• refine error extractor (#5049) (b4f18d2)
• remove multiGzipWriter (#5016) (b4f18d2)
• remove workspace table (#4952) (b4f18d2)
• sample events based on stage of failure (#4999) (b4f18d2)
• send connection config to router transform (#4903) (b4f18d2)
• sync 1.33.1 to master (#5071) (b4f18d2)
• sync release 1.33.x to master (#5047) (#5102) (b4f18d2)
• sync release v1.33.0 to main branch (#5054) (b4f18d2)
• trino hive cursor error (#5024) (b4f18d2)
• update router reports payload behind a flag, emit stats to observe sizes (#5067) (7d74183)
• update webhook test cases (#5053) (b4f18d2)
• upgrade go to 1.23.0 (#5052) (b4f18d2)

v1.34.0-rc.3

1.34.0-rc.3 (2024-09-18)

Features

• enable retention period for warehouse uploads (#5045) (b4f18d2)

Bug Fixes

• datalake spark flaky test (#5075) (57dd8c1)
• each router handle stores the entire connections map (#5109) (dfbfa78)
• error reporting lag and pii handle (#5028) (40a5446)
• gateway internal batch endpoint stats (#5089) (bbaaabd)
• prevent badgerdb hang when closing without prior operations (#5074) (9a4b843)
• replace counter with gauge cron tracker alert (#5084) (dc7d6ef)
• reporting from warehouse module for failing uploads (#5044) (ec92f31)
• revert support for webhook headers (#5064) (df7e02f)
• webhook integration tests (#5061) (b4f18d2)

Miscellaneous

• add trufflehog scan step before image push (#5035) (b4f18d2)
• delete load files post successful upload (#5050) (d9c5c79)
• deps upgrade (#5081) (6493beb)
• deps: bump the go-deps group across 1 directory with 4 updates (#5090) (63c4033)
• deps: bump the go-deps group across 1 directory with 6 updates (#5058) (b4f18d2)
• deps: bump the go-deps group with 2 updates (#5059) (b4f18d2)
• for bigquery FORCE_RUN_INTEGRATION_TESTS (#5060) (ff271e5)
• include transformationId in transformer client metrics (#5055) (b4f18d2)
• make scylla hosts as slice (#5107) (0ada31f)
• passing dependency for asyncdestinationmanager (#5080) (f6271a0)
• propogate source category to router (#5085) (f41b9d1)
• refine error extractor (#5049) (b4f18d2)
• remove multiGzipWriter (#5016) (b4f18d2)
• remove workspace table (#4952) (b4f18d2)
• sample events based on stage of failure (#4999) (b4f18d2)
• send connection config to router transform (#4903) (b4f18d2)
• sync 1.33.1 to master (#5071) (b4f18d2)
• sync release 1.33.x to master (#5047) (#5102) (b4f18d2)
• sync release v1.33.0 to main branch (#5054) (b4f18d2)
• trino hive cursor error (#5024) (b4f18d2)
• update router reports payload behind a flag, emit stats to observe sizes (#5067) (7d74183)
• update webhook test cases (#5053) (b4f18d2)
• upgrade go to 1.23.0 (#5052) (b4f18d2)

v1.34.0-rc.2

1.34.0-rc.2 (2024-09-17)

Features

• enable retention period for warehouse uploads (#5045) (b4f18d2)

Bug Fixes

• datalake spark flaky test (#5075) (57dd8c1)
• error reporting lag and pii handle (#5028) (40a5446)
• gateway internal batch endpoint stats (#5089) (bbaaabd)
• prevent badgerdb hang when closing without prior operations (#5074) (9a4b843)
• replace counter with gauge cron tracker alert (#5084) (dc7d6ef)
• reporting from warehouse module for failing uploads (#5044) (ec92f31)
• revert support for webhook headers (#5064) (df7e02f)
• webhook integration tests (#5061) (b4f18d2)

Miscellaneous

• add trufflehog scan step before image push (#5035) (b4f18d2)
• delete load files post successful upload (#5050) (d9c5c79)
• deps upgrade (#5081) (6493beb)
• deps: bump the go-deps group across 1 directory with 4 updates (#5090) (63c4033)
• deps: bump the go-deps group across 1 directory with 6 updates (#5058) (b4f18d2)
• deps: bump the go-deps group with 2 updates (#5059) (b4f18d2)
• for bigquery FORCE_RUN_INTEGRATION_TESTS (#5060) (ff271e5)
• include transformationId in transformer client metrics (#5055) (b4f18d2)
• make scylla hosts as slice (#5107) (0ada31f)
• passing dependency for asyncdestinationmanager (#5080) (f6271a0)
• propogate source category to router (#5085) (f41b9d1)
• refine error extractor (#5049) (b4f18d2)
• remove multiGzipWriter (#5016) (b4f18d2)
• remove workspace table (#4952) (b4f18d2)
• sample events based on stage of failure (#4999) (b4f18d2)
• send connection config to router transform (#4903) (b4f18d2)
• sync 1.33.1 to master (#5071) (b4f18d2)
• sync release 1.33.x to master (#5047) (#5102) (b4f18d2)
• sync release v1.33.0 to main branch (#5054) (b4f18d2)
• trino hive cursor error (#5024) (b4f18d2)
• update router reports payload behind a flag, emit stats to observe sizes (#5067) (7d74183)
• update webhook test cases (#5053) (b4f18d2)
• upgrade go to 1.23.0 (#5052) (b4f18d2)