0.0.7

Highlights

Spark 3.4 compatibility and testing against 3.3.2 and 3.2.3, new functions (array sorting functions, string comparators, collection functions, and more)

What's Changed

New things and bugfixes

• Update references to 0.0.6 by @alfonsorr in #325
• Added spark 3.2.3 as base 3.2 version and 3.2.2 as test only by @alfonsorr in #326
• feat: [+] #329 add spark 3.3.2 by @eruizalo in #331
• feat: [+] #337 array_sort of structs & equals null safe functions by @eruizalo in #338
• feat: [+] MatchBuilder column fun & AND/OR aggregate functions by @eruizalo in #336
• hotfix: [-] delete auto-merged tests that should not be there by @eruizalo in #347
• feat: [+] collection functions (issue #64) by @eruizalo in #287
• Issue-235: Fix Documentation not showing up on the website by @Amalicia in #343
• Issue-272: Add String Comparison operators by @Amalicia in #355
• Added spark 3.4 to the project by @alfonsorr in #346

Dependencies and CI

• feat: [+] mvn release sequential by @eruizalo in #324
• Dependabot:(deps): Bump dawidd6/action-download-artifact from 2.24.3 to 2.25.0 by @dependabot in #328
• ci: [~] dependabot now will never execute publish doc by @eruizalo in #330
• Dependabot:(deps): Bump gregsdennis/dependencies-action from 1.2.3 to 1.2.4 by @dependabot in #335
• Dependabot:(deps): Bump dawidd6/action-download-artifact from 2.25.0 to 2.26.0 by @dependabot in #334
• ScalaSteward: Update scalafmt-core from 3.7.1 to 3.7.2 by @scala-steward in #333
• Dependabot:(deps): Bump dawidd6/action-download-artifact from 2.26.0 to 2.26.1 by @dependabot in #341
• Dependabot:(deps): Bump peter-evans/create-or-update-comment from 2 to 3 by @dependabot in #342
• ScalaSteward: Update scalafmt-core from 3.7.2 to 3.7.3 by @scala-steward in #339
• Dependabot:(deps): Bump dawidd6/action-download-artifact from 2.26.1 to 2.27.0 by @dependabot in #345
• ScalaSteward: Update scala-collection-compat from 2.8.1 to 2.9.0 by @scala-steward in #348
• ScalaSteward: Update scala-collection-compat from 2.9.0 to 2.10.0 by @scala-steward in #350
• Dependabot:(deps): Bump coursier/setup-action from 1.3.0 to 1.3.2 by @dependabot in #349
• ScalaSteward: Update sbt-ci-release from 1.5.11 to 1.5.12 by @scala-steward in #353

Full Changelog: v0.0.6...v0.0.7

Thanks to all doric team and @Amalicia for your contribution!

v0.0.6

Highlights

• This release contains more methods for Doric, including unary functions, array_sort, and changes in handling struct types that don't interfere with the doric syntax.
• We are also testing against spark 3.3.1. From 2.4.1 to 3.3.1, more than 20 versions we compile and make all our tests!!
• New and exclusive custom aggregation with doric syntax, no serialization involved.
• As usual, fixes to found bugs
• Improvements in our pipelines to test and release the library

What's Changed

New things, bugfixes and CI changes

• Updated documentation references by @alfonsorr in #259
• feat: [+] remaining non aggregate functions (resolves #68) by @eruizalo in #262
• Empty arrays returns the expected datatype by @alfonsorr in #274
• feat: [+] #270 array_sort functions working with lambdas by @eruizalo in #275
• feat: [+] #271 unary functions (-) & (!) by @eruizalo in #276
• fix: [~] issues & feature requests forms by @eruizalo in #268
• feat: [+] pr comment with test summary per spark version by @eruizalo in #277
• feat: [+] #105 improve raiseError with location by @eruizalo in #283
• Fix/issues and feature requests forms by @eruizalo in #285
• debug: github context dump PR comment by @eruizalo in #286
• fix: [~] gh-pages publish failing using git by @eruizalo in #294
• fix: [~] get issue number by @eruizalo in #295
• Ci/publish doc easier & doc for scala 2.13 & gh actions upgrade by @eruizalo in #293
• fix: [~] release ci by @eruizalo in #318
• fix: [+] ci release matrix by @eruizalo in #319
• feat: [+] #307 Add spark 3.3.1 by @eruizalo in #313
• Skip scoverage in scala steward by @alfonsorr in #280
• Feat/296 replace olafurpg setup scala by @eruizalo in #320
• Custom aggregation with doric syntax by @alfonsorr in #312
• fix: [~] child dynamic accessor only for struct columns (issue #265) by @eruizalo in #269

Dependencies updates

• ScalaSteward: Update mdoc, sbt-mdoc from 2.3.2 to 2.3.3 by @scala-steward in #260
• ScalaSteward: Update scalatest from 3.2.12 to 3.2.13 by @scala-steward in #264
• ScalaSteward: Update scalafmt-core from 3.5.8 to 3.5.9 by @scala-steward in #267
• ScalaSteward: Update scalafmt-core from 3.5.9 to 3.6.1 by @scala-steward in #304
• ScalaSteward: Update mdoc, sbt-mdoc from 2.3.3 to 2.3.6 by @scala-steward in #303
• ScalaSteward: Update sbt from 1.7.1 to 1.7.3 by @scala-steward in #302
• ScalaSteward: Update sbt-ci-release from 1.5.10 to 1.5.11 by @scala-steward in #300
• ScalaSteward: Update shapeless from 2.3.9 to 2.3.10 by @scala-steward in #278
• ScalaSteward: Update scalatest from 3.2.13 to 3.2.14 by @scala-steward in #305
• ScalaSteward: Update sbt-scalafmt from 2.4.6 to 2.5.0 by @scala-steward in #310
• ScalaSteward: Update sbt from 1.7.3 to 1.8.0 by @scala-steward in #309
• ScalaSteward: Update scalatest from 3.2.14 to 3.2.15 by @scala-steward in #315
• ScalaSteward: Update sbt from 1.8.0 to 1.8.2 by @scala-steward in #314
• ScalaSteward: Update scalafmt-core from 3.6.1 to 3.7.0 by @scala-steward in #317
• ScalaSteward: Update mdoc, sbt-mdoc from 2.3.6 to 2.3.7 by @scala-steward in #322
• ScalaSteward: Update scalafmt-core from 3.7.0 to 3.7.1 by @scala-steward in #321

CI Dependencies updates

• Dependabot:(deps): Bump jwalton/gh-find-current-pr from 1.3.0 to 1.3.2 by @dependabot in #292
• Dependabot:(deps): Bump JoshuaTheMiller/conditional-build-matrix from 0.1.0 to 1.0.1 by @dependabot in #291
• Dependabot:(deps): Bump dawidd6/action-download-artifact from 2.23.0 to 2.24.0 by @dependabot in #290
• misc: [+] literalCol value getter & git hooks by @eruizalo in #288
• Dependabot:(deps): Bump dawidd6/action-download-artifact from 2.23.0 to 2.24.0 by @dependabot in #298
• Dependabot:(deps): Bump dawidd6/action-download-artifact from 2.24.0 to 2.24.2 by @dependabot in #308
• Dependabot:(deps): Bump dawidd6/action-download-artifact from 2.24.2 to 2.24.3 by @dependabot in #316

Full Changelog: v0.0.5...v0.0.6

v0.0.5

Highlights in 0.0.5

First of all, we had our first external committer, thanks @Amalicia for your work.
Doric 0.0.5 comes with a lot of new staff:

• Support for Product types if you want a struct schema checked. You can choose between dynamic structs DoricColumn[Row] but now you can be more strict with using your case classes like DoricColumn[User]
• Syntax to use sorting functions: sortBy, col.desc etc.
• A lot of math functions, so may that I can put them all here.
• Time columns now can be compared now.
• Doric now works for spark 3.3 and is released for scala 2.13 in 3.2 and 3.3 spark versions.

What's Changed

• feat #212 custom matchers for testing by @eruizalo in #219
• Doric error message now doesn't show the same error multiple times. by @alfonsorr in #226
• Add Comparison Operators to Date Columns by @Amalicia in #230
• Fix/hof structs combined error and improve the resolution of unresolved columns by @alfonsorr in #227
• Prepare doric for spark 3.3.0 by @alfonsorr in #231
• Added Sorting Functions by @Amalicia in #233
• feat: [+] #66 math functions by @eruizalo in #223
• Feature/scala 2.13 for spark 3.3.x and 3.2.x by @alfonsorr in #238
• Support for product types by @jserranohidalgo in #251
• Added apache spark 3.2.2 as main version for 3.2 by @alfonsorr in #256

Dependencies update

• ScalaSteward: Update sourcecode from 0.2.8 to 0.3.0 by @scala-steward in #242
• ScalaSteward: Update sbt from 1.6.2 to 1.7.1 by @scala-steward in #248

Our things (CI and project management)

• feat: [~] label all sparks if doric core modified by @eruizalo in #222
• Action to add the packages to the release page in gh by @alfonsorr in #244
• Added sbt-dependency-submission to update github dependency graph by @alfonsorr in #254
• ci: [+] PR Dependency Check by @eruizalo in #245
• doc: [~] fix codecov badges & add release and first issues badges by @eruizalo in #246

New Contributors

• @Amalicia made their first contribution in #230

Full Changelog: v0.0.4...v0.0.5

v0.0.4

What's Changed

Highlights

• Doric for spark 2.4!!!!! by @alfonsorr in #207
• Dynamic invocations for Row columns and top row by @jserranohidalgo in #211

Dependency updates

• ScalaSteward: Update scalafmt-core from 3.4.3 to 3.5.3 by @scala-steward in #202 , #203 , #208 , #216
• ScalaSteward: Update scalatest from 3.2.11 to 3.2.12 by @scala-steward in #209
• ScalaSteward: Update spark-fast-tests from 1.2.0 to 1.3.0 by @scala-steward in #214
• Delete unused dependencies to be able to port doric to scala 2.11 by @alfonsorr in #204

Rest of changes

• Cats imports fixed by @alfonsorr in #206
• Fixed publishLocal errors in test by @alfonsorr in #217
• ci: [~] delete PRs and forms checkboxes by @eruizalo in #218
• Fix artifact upload by @alfonsorr in #215
• Ready for version 0.0.4 by @alfonsorr in #220

Full Changelog: v0.0.3...v0.0.4

v0.0.3

TLDR

• Cross version of doric tested against all 3.x versions. To use the version of doric related to your spark, use the dependency doric_3-x_2.12 being x the minor version of spark (doric_3-0_2.12, doric_3-1_2.12, doric_3-2_2.12)
• An interpolator to build string columns ds"", creates a string column similar to the s"" scala interpolator.

What's Changed

• Update sbt to 1.6.2 by @scala-steward in #163
• Update mdoc, sbt-mdoc to 2.3.0 by @scala-steward in #160
• Update documentation stable version to 0.0.2 by @alfonsorr in #164
• Update scalafmt-core to 3.4.0 by @scala-steward in #161
• Update scalafmt-core to 3.4.3 by @scala-steward in #172
• Doric doc by @jserranohidalgo in #173
• Update CODEOWNERS by @alfonsorr in #177
• feat: [+] add issue & PR templates & CONTRIBUTING by @eruizalo in #179
• Update mdoc, sbt-mdoc to 2.3.1 by @scala-steward in #178
• Bump JamesIves/github-pages-deploy-action from 4.2.2 to 4.2.5 by @dependabot in #176
• Update spark-sql to 3.1.3 by @scala-steward in #174
• Update navigation.yml by @alfonsorr in #180
• ci: [+] github actions concurrency by @eruizalo in #181
• Update spark-daria, spark-fast-tests to 1.0.1 by @scala-steward in #170
• feat: [+] StringColumn concat interpolator (#165) by @eruizalo in #166
• ci: release executed only if habla repository by @eruizalo in #158
• ci: [+] PR labeler by @eruizalo in #175
• Update spark-fast-tests to 1.2.0 by @scala-steward in #183
• Update spark-daria to 1.2.3 by @scala-steward in #182
• Cross build doric from Spark 3.0 to 3.2 by @alfonsorr in #184
• Single parameter sparkVersion allows 3.x and 3.x.x versions by @alfonsorr in #185
• ci: [+] add spark labels to labeler by @eruizalo in #186
• Bump actions/labeler from 3 to 4 by @dependabot in #188
• Bump actions/checkout from 2 to 3 by @dependabot in #189
• ci: [+] compose actions (issue #152) by @eruizalo in #171
• ci/#159 spark version matrix by @eruizalo in #187
• FIX ci mvn central release by @eruizalo in #192
• ci_fix: fix job mvn_release & improve cache by @eruizalo in #193
• Update sbt-api-mappings to 3.0.2 by @scala-steward in #194
• fix: [~] codecov reports with flags by @eruizalo in #196
• feat_fix: [~] Prepare release 0.0.3 & other fixes by @eruizalo in #195
• Update mdoc, sbt-mdoc to 2.3.2 by @scala-steward in #197
• fix: [~] str interpolator now prints empty if null column (issue #191) by @eruizalo in #199

Full Changelog: v0.0.2...v0.0.3

0.0.2

This version marks a huge leap forward in doric with new functions, new types, and better documentation.
Thanks to @eruizalo for all the hard work to make this release possible.

What's Changed

• Update sbt-scalafmt to 2.4.3 by @scala-steward in #73
• Update sbt to 1.5.5 by @scala-steward in #74
• Bump olafurpg/setup-scala from 10 to 13 by @dependabot in #75
• Update scalafmt-core to 3.0.0 by @scala-steward in #77
• Update scalafmt-core to 3.0.1 by @scala-steward in #79
• Update scala-library to 2.12.15 by @scala-steward in #84
• Update scalafmt-core to 3.0.3 by @scala-steward in #83
• Update scalafmt-core to 3.0.4 by @scala-steward in #85
• Update scalatest to 3.2.10 by @scala-steward in #86
• feat: String functions resolves #71 by @eruizalo in #82
• Match column by type by @alfonsorr in #78
• With columns by @alfonsorr in #87
• site for doric by @alfonsorr in #76
• Update sbt-ci-release to 1.5.9 by @scala-steward in #88
• Documentation by @alfonsorr in #89
• Update scalafmt-core to 3.0.5 by @scala-steward in #90
• Update scalafmt-core to 3.0.6 by @scala-steward in #93
• Update scalafmt-core to 3.0.7 by @scala-steward in #99
• Update mdoc, sbt-mdoc to 2.2.24 by @scala-steward in #98
• Update sbt-ci-release to 1.5.10 by @scala-steward in #96
• #65 Date time functions by @eruizalo in #97
• Created CName for strings that are column names by @alfonsorr in #92
• Update scalafmt-core to 3.0.8 by @scala-steward in #101
• Added division and mod operations for NumericColumns by @alfonsorr in #100
• Update scalafmt-core to 3.1.0 by @scala-steward in #106
• Update scalafmt-core to 3.1.1 by @scala-steward in #107
• new columns and functions by @eruizalo in #104
• feat: add scoverage first step by @eruizalo in #108
• Update sbt-scalafmt to 2.4.4 by @scala-steward in #111
• Fix/codecov reports by @eruizalo in #112
• #71 feat: add concat_ws by @eruizalo in #110
• #68 Non-aggregate functions by @eruizalo in #113
• Update scalafmt-core to 3.1.2 by @scala-steward in #115
• Update scalafmt-core to 3.2.0 by @scala-steward in #117
• Update cats-core to 2.7.0 by @scala-steward in #118
• Bump JamesIves/github-pages-deploy-action from 4.1.6 to 4.1.8 by @dependabot in #125
• Update sbt to 1.5.7 by @scala-steward in #124
• Update sbt-scalafmt to 2.4.5 by @scala-steward in #120
• Update scalafmt-core to 3.2.1 by @scala-steward in #119
• Update sbt to 1.5.8 by @scala-steward in #126
• Test/increase coverage by @eruizalo in #121
• Feat/#60 implemented aggregate functions by @eruizalo in #123
• Update sbt-scalafmt to 2.4.6 by @scala-steward in #128
• Update scalafmt-core to 3.2.2 by @scala-steward in #127
• Update sbt to 1.6.1 by @scala-steward in #131
• Update scalafmt-core to 3.3.0 by @scala-steward in #130
• Custom types by @alfonsorr in #95
• Update scalafmt-core to 3.3.1 by @scala-steward in #134
• Bump JamesIves/github-pages-deploy-action from 4.1.8 to 4.2.1 by @dependabot in #137
• Make the use of CName less intrusive by @alfonsorr in #136
• ci: reactivate cache by @eruizalo in #140
• Update sbt-scoverage to 1.9.3 by @scala-steward in #139
• Update scalafmt-core to 3.3.2 by @scala-steward in #147
• ci: add worflow_dispatch by @eruizalo in #144
• Bump JamesIves/github-pages-deploy-action from 4.2.1 to 4.2.2 by @dependabot in #141
• Feat/64 collection functions by @eruizalo in #109
• Doc/link to spark functions by @eruizalo in #138
• Update scalatest to 3.2.11 by @scala-steward in #153
• Update scalafmt-core to 3.3.3 by @scala-steward in #148
• Update newtypes-core to 0.2.1 by @scala-steward in #143
• Update sourcecode to 0.2.8 by @scala-steward in #154
• ci: release executed only if habla repository by @eruizalo in #145
• Revert "ci: release executed only if habla repository" by @alfonsorr in #156

New Contributors

• @dependabot made their first contribution in #75
• @eruizalo made their first contribution in #82

Full Changelog: v0.0.1...v0.0.2

First release

* Aggregation semantics (#61)

* * Aggregation semantics
* Splitted semantics in more traits
* Improved implicitConversions with implicit cast (but declared in the plan)
* Added some spark aggregation methods

* * More functions
* rename isValid to isEqual

* * Restriction for function with typeclass