-
Notifications
You must be signed in to change notification settings - Fork 4
/
CHANGELOG
278 lines (235 loc) · 9.92 KB
/
CHANGELOG
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
Version 0.27.0 (2024-12-19)
---------------------------
Redshift: use zstd compression encoding instead text255 with the columns for enum fields (#215)
Version 0.26.0 (2024-11-25)
---------------------------
Preserve original field order when merging parquet Fields (#213)
Version 0.25.0 (2024-10-01)
---------------------------
Prepend underscore for parquet fields starting with number
Version 0.24.0 (2024-08-02)
---------------------------
Limit JSON depth of the schema in the validateSchema (#207)
Version 0.23.0 (2024-05-08)
---------------------------
Vector instead of List for parquet types and values (#205)
Omit parquet field for a schema with no nested fields (#205)
Version 0.22.2 (2024-03-25)
---------------------------
Upgrade dependencies
Version 0.22.1 (2024-02-16)
---------------------------
Fix casting required null field in struct (#200)
Version 0.22.0 (2024-02-14)
---------------------------
Fix treating no type change as incompatible (#197)
Version 0.21.0 (2023-10-13)
---------------------------
Cast to parquet without FieldValue intermediate
Version 0.20.0 (2023-09-05)
---------------------------
Improve foldMapMergeRedshiftSchemas signature (#192)
Version 0.19.4 (2023-07-06)
---------------------------
Fix recovery table name of shred model (#189)
Version 0.19.3 (2023-06-21)
---------------------------
Remove unreachable block
Allow type narrowing from VARCHAR to other types in redshift (#184)
Fix CI (#178)
Remove redundant Product type from redshift (#181)
Version 0.19.2 (2023-06-07)
---------------------------
Allow numeric type narrowing in redshift (#179)
Version 0.19.1 (2023-06-06)
---------------------------
Ignore encoding changes during redshift migrations (#175)
Version 0.19.0 (2023-06-02)
---------------------------
Refactor Redshift migrations (#173)
Version 0.18.2 (2023-05-05)
---------------------------
Drop not null constraint in parquet migrations, when required field is added from new version (#170)
Version 0.18.1 (2023-05-03)
---------------------------
Avoid field name collisions after snakeCase and other normalizations in parquet (#164)
Drop not null constraint in parquet migrations, when required field is removed from new version (close #168)
Version 0.18.0 (2023-04-13)
---------------------------
Allow supersededBy and supersedes properties in a schema (#155)
Version 0.17.1 (2023-03-08)
---------------------------
Parquet : Changing non-null to nullable (and vice versa) should yield nullable (#151)
Version 0.17.0 (2023-01-12)
---------------------------
Update license to 2023 (#147)
Bump jackson-databind to 2.14.1 (#146)
Bump scala-collection-compat to 2.9.0 (#145)
Bump cats-parse to 0.3.9 (#144)
Bump json-schema-validator to 1.0.76 (#143)
Bump circe to 0.14.3 (#142)
Bump iglu-scala-core to 1.1.2 (#141)
Update links in Readme (#131)
SelfSyntaxChecker validate schema names and vendors (#139)
Version 0.16.0 (2022-12-08)
---------------------------
Detect schema version drift in parquet schemas (#133)
Version 0.15.2 (2022-11-17)
---------------------------
Rename license file for GitHub (#130)
Redshift: Fix schemas with additionalProperties object getting duplicate columns (#134)
Bump sbt-tpolecat to 0.4.1 (#129)
Fix flaky FieldValueSpec test (#129)
Version 0.15.1 (2022-08-12)
---------------------------
Bump scalacheck to 1.16.0 (#127)
Bump specs2 to 4.15.0 (#127)
Bump scala-collection-compat to 2.8.1 (#127)
Bump cats-parse to 0.3.8 (#127)
Bump json-schema-validator to 1.0.72 (#127)
Bump circe-generic to 0.14.2 (#127)
Bump iglu-core-json4s to 1.1.0 (#127)
Bump jackson-databind to 2.13.2.1 (#127)
Version 0.15.0 (2022-05-18)
---------------------------
Redshift AddColumn migration should never be NOT NULL (#123)
Fix Redshift column type for enum with a max length (#121)
Add Parquet schema AST (#119)
Utils for oneOf/anyOf properties to become fields of storage ASTs (#120)
Version 0.14.5 (2022-04-27)
---------------------------
SelfSyntaxChecker should validate against a more permissive version of jsonschema v4 (#117)
Version 0.14.4 (2022-01-21)
---------------------------
Update copyright notices to 2022 (#113)
Raise SelfSyntaxChecker lint level to Error (#109)
Version 0.14.3 (2021-11-19)
---------------------------
Redshift: don't attempt to alter columns with unsupported encoding (#110)
Version 0.14.2 (2021-09-22)
---------------------------
BigQuery: handle disallowed characters in properties (#45)
Linting: check for characters disallowed in different DBs (#106)
Version 0.14.1 (2021-08-04)
---------------------------
Fix ScalaDoc publishing (#100)
Move ALTER TYPE statements out of transaction block (#101)
Version 0.14.0 (2021-08-02)
---------------------------
Automate the creation of release PR (#93)
Bump specs2 to 4.12.3 (#91)
Bump cats-parse to 0.3.4 (#90)
Bump scala-collection-compat to 2.5.0 (#89)
Redshift: update table in-place when increasing maxLength of a field or adding new longer enum value (#83)
Fix non-exhaustive match when casting value (#85)
Remove Type.Bytes for BigQuery (#86)
Bump kind-projector to 0.13.0 (#79)
Bump scala versions to 2.12.14 and 2.13.6 (#78)
Bump circe to 0.14.1 (#77)
Bump sbt-scoverage to 1.8.2 (#98)
Bump sbt-coveralls to 1.3.1 (#99)
Bump sbt to 1.5.5 (#97)
SelfSyntaxChecker returns SchemaPointer in the wrong order (#75)
Version 0.13.0 (2021-04-21)
---------------------------
Extend copyright to 2021 (#73)
Bump jackson-databind to 2.10.5.1 (#71)
BigQuery: cast a null of nullable array type into an empty array (#70)
Redshift: fix PrimaryKeyTable being rendered as list of characters (#64)
Migrate to Sonatype (#69)
Extract json4s into a separate module (#67)
Bump sbt to 1.5.0 (#66)
Bump kind-project to 0.11.3 (#74)
Redshift: add a test spec for handling sum types (#68)
Get rid of FGE JSON Schema validator (#65)
Version 0.12.0 (2020-11-03)
---------------------------
Migrate from Travis to GH actions (#62)
Redshift: switch to text255 encoding for enums (#36)
Redshift: extend default VARCHAR length for arrays to 65535 (#54)
Handle too big maximum for integer (#56)
Make FlatData.getString function configurable (#57)
Bump Scala to 2.12.12 (#59)
Bump sbt to 1.4.1 (#58)
Version 0.11.0 (2020-06-09)
---------------------------
Add Scala 2.13 support (#52)
Add SchemaList.until function (#53)
Bump iglu-core to 1.0.0 (#50)
Version 0.10.0 (2020-02-06)
---------------------------
Add data-flattening algorithm (#9)
Refactor JsonSchema-to-Redsfhit transformation using new schema flattener (snowplow/iglu#213)
Add VersionTree (#7)
Add Sonatype credentials to .travis.yml (#4)
Add Bintray credentials to .travis.yml (#3)
Add CI/CD to project (#2)
Bump iglu-core to 0.5.0 (#8)
Move into schema-ddl repo (#1)
Version 0.9.0 (2019-01-16)
--------------------------
Bump sbt-bintray to 0.5.4 (snowplow/iglu#470)
Bump SBT to 1.2.8 (snowplow/iglu#466)
Fix nullable array casting into string in BigQuery AST (snowplow/iglu#461)
Bump iglu-core to 0.4.0 (snowplow/iglu#456)
Rename Product type to Union in jsonschema (snowplow/iglu#387)
Add support for BigQuery numeric type (snowplow/iglu#426)
Add JSON Pointers to linter messages (snowplow/iglu#330)
Add circe support (snowplow/iglu#455)
Port to cats (snowplow/iglu#454)
Bump Scala to 2.12.8 (snowplow/iglu#453)
Version 0.8.0 (2018-08-24)
--------------------------
Bump iglu-core-json4s to 0.3.0 (snowplow/iglu#384)
Bump SBT to 1.1.6 (snowplow/iglu#334)
Add BigQuery table Schema AST (snowplow/iglu#169)
Add quickstart guide to README.md (snowplow/iglu#393)
Version 0.7.0 (2018-02-07)
--------------------------
Add linter for missing schema versions (snowplow/iglu#307)
Add support for ZSTD encoding (snowplow/iglu#237)
Version 0.6.0 (2017-12-27)
--------------------------
Add linter for upper maxLength (snowplow/iglu#220)
Add check that root of JSON Schema has type object (snowplow/iglu#224)
Add linter for optional fields (snowplow/iglu#252)
Bump iglu-core-json4s to 0.2.0 (snowplow/iglu#297)
Generate fixed length for 'email' fields (snowplow/iglu#257)
Add support for 'date' format (snowplow/iglu#256)
Add uuid format (snowplow/iglu#305)
Add Scala 2.12 support (snowplow/iglu#288)
Version 0.5.0 (2016-10-05)
--------------------------
Add severity levels to linter (snowplow/iglu#215)
Version 0.4.0 (2016-08-01)
--------------------------
Change Redshift encoding for boolean to runlength (snowplow/iglu#173)
Add JSON Schema AST (snowplow/iglu#172)
Initial commit (snowplow/iglu#158)
Version 0.3.1 (2016-05-14)
--------------------------
Fixed incorrect type suggestion for integer with null (snowplow-archive/schema-ddl#50)
Added handling an object with no properties or patternProperties specified as VARCHAR (snowplow-archive/schema-ddl#56)
Added handling of anything-* schemas as tables without custom columns (snowplow-archive/schema-ddl#43)
Version 0.3.0 (2016-02-08)
--------------------------
Removed OpenJDK from .travis.yml (snowplow-archive/schema-ddl#48)
Added Java interop (snowplow-archive/schema-ddl#45)
Added recognition of multipleOf == 1 as integer (snowplow-archive/schema-ddl#42)
Fixed nullable string with minLength == maxLength resulted to VARCHAR (snowplow-archive/schema-ddl#40)
Fixed recognition of Decimal with multipleOf (snowplow-archive/schema-ddl#41)
Version 0.2.0 (2015-09-14)
--------------------------
Added Scala 2.11 support (snowplow-archive/schema-ddl#28)
Added compression encodings (snowplow-archive/schema-ddl#29)
Default varchar size changed to 4096 (snowplow-archive/schema-ddl#30)
Added initial test suite (snowplow-archive/schema-ddl#31)
Now handling an object without a "properties" field if "patternProperties" defined (snowplow-archive/schema-ddl#32)
Now handling an object without a "properties" field if "additionalProperties" set to "false" (snowplow-archive/schema-ddl#33)
Fixed handling enums containing different types (snowplow-archive/schema-ddl#34)
Fixed ignoring maxLength for a type enum (snowplow-archive/schema-ddl#35)
Now handling nested non-required properties (snowplow-archive/schema-ddl#36)
Added COMMENT ON in Redshift DDL (snowplow-archive/schema-ddl#38)
Version 0.1.0 (2015-07-29)
--------------------------
Initial release