CHANGELOG.md

Change Log

v0.4 (2018-02-01)

Full Changelog

Implemented enhancements:

• Integration with Schema Registry #483

Closed issues:

• KSQL Avro format seems to be incompatible with the avro format expected by Kafka connect. #651
• CSAS execution silently fails #643
• Enhance 'print topic;' to display kafka topics #625
• ksql-server-start will hang when it "Unable to check broker compatibility" #611
• UDF function to search if the value exists in the json array #607
• CSAS: WITH is incompatible with WHERE? #604
• Timestamp field appears not to work in DESCRIBE EXTENDED #603
• EXTRACTJSONFIELD JSON array support #523
• Extend the DESCRIBE statement to more useful information #470

Merged pull requests:

• Update quickstart docs with new output for describe #684 (apurvam)
• Expect ksql-run-class parameters after the class name #683 (rodesai)
• Bump version to 0.4 #682 (apurvam)
• Make sure each Beacon ping includes current time #681 (apovzner)
• Update the start scripts so that the ksql server always generates a gc log #674 (apurvam)
• More informative help output for print-metrics #671 (rodesai)
• Cos integration for KSQL. #663 (hjafarpour)
• Remove suppression of method length check #662 (dguy)
• Allow passing a properties file to the quickstart examples #657 (mimaison)
• enable checkstyle check to avoid star import #654 (dguy)
• update datagen so iteration works properly and add schemas to use for testing #653 (dguy)
• Use PhoneHomeConfig for KSQL Beacon #648 (apovzner)
• updates for line length style check #645 (norwood)
• use EntityUtils instead of manually reading entity #644 (norwood)
• Add ksql-tools #634 (rodesai)
• Tests for cli module plus further tests for refactoring. #626 (dguy)
• Enhance show topics; and print "topic"; #624 (bluemonk3y)
• [BUG] jsonNode array index access for EXTRACTJSONFIELD #610 (robert2d)
• [UDF] JSON Array Contains function #608 (satybald)
• [Minor] Fix Variable initialization #602 (satybald)

v0.3 (2018-01-16)

Full Changelog

Implemented enhancements:

• View Tables Properties for a Stream #516

Fixed bugs:

• Broker compatibility check needs at least one topic to exist #612
• Don't execute create table/create stream as select statements during startup when the entity has been dropped #531
• Don't replay all previous events found on the command topic #454
• CLI should not start up if server is down #360

Closed issues:

• Compilation issue: assembly-plugin group id '113584762' is too big #590
• Quickstart Non-Docker Setup for KSQL encounters error during compilation and cannot find symbol "class ZkUtilsProvider" #582
• Command topic replication factor is not set correctly. #564
• Update Avro docs for tables because of issue 557 #561
• CREATE TABLE examples do not define KEY property yet #559
• Build Failing in all versions #558
• Schema inference for tables #557
• Add avro sample data generation in examples package. #541
• Could not find artifact io.confluent:common:pom:4.0.0-SNAPSHOT #537
• GROUP BY not recognizing SELECT Elements? #512
• Can't find any documentation about ksql in Confluent 4.0.x #502
• join not supported? #493
• LEFT Join statement always return null #491
• Don't start terminated queries on ksql-server startup #482
• Error building kqsl: Non-resolvable parent POM for io.confluent.ksql:ksql-parent:4.0.0-SNAPSHOT #481
• Add system test - Rolling bounces #467
• Add system test - Core Kafka broker failures (one node or complete cluster, hard and soft) #466
• Add system test - lose a stream or rest node (due to OOM or crash) #465
• Make KSQL emit warning message when running against non-compliant AK, CK version #464
• Add basic metrics integration to KSQL #463

Merged pull requests:

• restore assembly configs #621 (aayars)
• remove docker boilerplate now provided by common #618 (aayars)
• create topic if none exist during broker compat test #612 #617 (dguy)
• Fix queries with limit #615 (rodesai)
• Refactoring to use schema type for comparison. #614 (hjafarpour)
• Use Apache commons CSV package for both serializer and deserializer i… #613 (hjafarpour)
• COS packaging for KSQL. #609 (hjafarpour)
• KSQL-473: point quickstart non-docker docs to release tarballs #601 (rodesai)
• Fix code style issues #599 (satybald)
• MINOR: Further code cleanups. #597 (dguy)
• Support avro types for nullable fields generated by Connect. #592 (hjafarpour)
• Fix compilation issue group id '113584762' is too big in assemly-plugin #591 (satybald)
• MINOR: don't allow modification of AggregateAnalysis collections externally #589 (dguy)
• MINOR: remove unused KsqlConfig param from QueryMetadata etc #588 (dguy)
• Fix findbugs errors #587 (ewencp)
• Fix findbugs errors #586 (ewencp)
• KSQL-508: add metrics interceptors instead of replacing #585 (rodesai)
• Tests for commons package. #584 (hjafarpour)
• Ksql 569 serde tests #583 (hjafarpour)
• Skip the '@' character in the beginning of the field name in JSON #581 (hjafarpour)
• KSQL-235: dont block on socket read #579 (rodesai)
• Fixed the issue with BaseMetricsReporter. #578 (hjafarpour)
• Top k udaf #575 (hjafarpour)
• Updated the docs. #574 (hjafarpour)
• Add a column for the 0.3 release to the version compatibility docs #571 (apurvam)
• KSQL-473: add a package module #570 (rodesai)
• The number of replicas for the command topic should be set by 'ksql.s… #565 (hjafarpour)
• Docs improvement. #563 (hjafarpour)
• Schema inference for tables #562 (hjafarpour)
• Remove redundant "for more information" in DESCRIBE EXTENDED output #560 (miguno)
• KSQL-493: Fix producer thread leak #556 (rodesai)
• Minor updates to the non docker quickstart #552 (apurvam)
• Fix quickstart to have the correct schema registry url #551 (apurvam)
• Clarify that Docker clickstream demo requires 5+ GB of RAM #549 (miguno)
• Minor docs improvements #548 (miguno)
• Improve DESCRIBE and EXPLAIN docs (see PR #539) #547 (miguno)
• Docs updates for 0.3 release #546 (apurvam)
• Add ability to specify the schema registry url to the CLI in local mode. #545 (apurvam)
• Added avro producer for data gen for the new schema registry integrat… #544 (hjafarpour)
• Fixed minor style issues in the docs. #543 (hjafarpour)
• Bump ksql version to 0.3 #542 (apurvam)
• Improve docs on DESCRIBE and EXPLAIN #539 (miguno)
• Add tip on configuring artifactory to ensure builds are working #538 (miguno)
• Add ratings example #535 (blueedgenick)
• Add Idle query and error rate metrics #534 (apurvam)
• don't execute dropped streams/tables, but update metastore #532 (dguy)
• KSQL-484 - Add version compatibility table to the docs #526 (joel-hamill)
• Support DESCRIBE EXTENDED, v2 #522 (bluemonk3y)
• Print more informative error messages #514 (rodesai)
• Add metrics which report the number of running queries #513 (apurvam)
• Describe extend functionality #511 (bluemonk3y)
• Don't run terminated queries at startup #482 #508 (dguy)
• Remove outdated roadmap document #507 (miguno)
• Revert commits which broke the docs #501 (apurvam)
• KSQL-476: Use explicit tags for docker image dependencies #500 (aayars)
• add broker compatibility check #499 (dguy)
• fix regression in app id creation #498 (dguy)
• Make doc links point to GH repo #496 (joel-hamill)
• Fixed the regression for stream-table join. Table should always read … #495 (hjafarpour)
• Add list of actual results to CLITest output when it fails #494 (apurvam)
• change replication factor check when creating topics #492 (dguy)
• Add snapshots repo for Confluent dependencies #490 (aayars)
• Ksql 415 schema registry integration #488 (hjafarpour)
• Fix the sporadically failing CLITests #486 (apurvam)
• Hide user name and password command line flags #485 (apurvam)
• Change jenkins slack channel #484 (hjafarpour)
• Don't replay all previous events found on the command topic #454 #480 (dguy)
• Added basic auth capabilities to KSQL Remote cli #477 (apurvam)
• Adding metric-collection for DESCRIBE EXTEND #475 (bluemonk3y)
• Make key property mandatory in CREATE TABLE statement. #473 (hjafarpour)
• DOCS-127 - Add KSQL doc to CP #472 (joel-hamill)
• Add doc for fail.on.deserialization.error #462 (dguy)
• KSQL-351 - Doc error for ksql-server-start #440 (joel-hamill)

v0.2 (2017-11-20)

Full Changelog

Implemented enhancements:

• Ksql 294 drop source correctly #451

Fixed bugs:

• KSQL does not create log directory #359

Closed issues:

• EXTRACTJSONFIELD type #446
• SELECT statements hang in ksql-cli and server mode #442
• Remove duplicate Metastore fixture #437
• Delimited Integration Test #434
• compile failure with some dependency issue #423
• Fix findbugs warnings #412
• Review exception and error reporting #394
• Provide config to use Stream Deserialization Exception handler #384
• Make QueryStreamWriter use threads properly [KSQL-397] #382
• ksql-cli should be able to accept input from STDIN and a filename via an argument #380
• TEST: Add Stream Table - Left-Join integration test #374
• Demo - Grafana 502 error in Data Source #373
• what is the format of Kafka data that ksql require? #364
• refactor integration tests and enhance KSQLContext #340
• Running 'ksql-cli local' on different kafka port from default #334
• rename ksql- modules #331
• Restructure QueuedSchemaKStream #329
• Refactor core into parser, metastore and common #326
• "ksql-cli local" worked very well when first used and after that it started hanging #320
• Question about query #310
• No value present when joining two tables #308
• LEFT JOIN query results in java.lang.String cannot be cast to org.apache.kafka.streams.kstream.Windowed #305
• ksql-cli hangs after server maintenance, WARN No records received after 30 seconds of polling in log #303
• can not load data in grafana #300
• The demo Dashboard don't load the Data #294
• Kafka avro schema data not reflecting from topic #293
• Possible to avoid running tests? #292
• ksql standalone mode error #290
• Compile SqlBase.g4 less SqlBaseBaseVisitor #287
• Creating stream and associated stream with new topic, appears to be attempting to associate with another topic #285
• CREATE STREAM AS SELECT is not exists KEY property #279
• "Query terminated" not appropriate #270
• Clickstream Demo: Recovering from install errors #262
• Need a way to sample a topic #261
• After starting the docker-quickstart, I can't see any Kafka topics #259
• Readme images #164

Merged pull requests:

• Assign query id only to the persistent queries (CSAS/CTAS). We don't … #461 (hjafarpour)
• Clarify that WHERE clause can refer to any column, including implicit columns #460 (miguno)
• Fixed the regression bug for aggregates with no window. #459 (hjafarpour)
• Bump metrics-client version to 4.1.0-SNAPSHOT in master #458 (apurvam)
• use a random free port in KsqlRestClientTest #457 (dguy)
• reset repartition flag after map #450 (dguy)
• KSQL 420 join criteria validation #447 (hjafarpour)
• Ksql 294 drop source correctly #444 (hjafarpour)
• remove duplicate metastore fixture #438 (bluemonk3y)
• Delimited integration test #435 (bluemonk3y)
• add DDLStatement interface, extract command factory, tidy up, test etc #433 (dguy)
• extract QueryAnalyzer from QueryEngine #432 (dguy)
• KSQL-398: integration test covering quickstart scenarios #431 (apurvam)
• Ksql beacon #429 (mageshn)
• findbugs exclusions #428 (dguy)
• clickstream demo CI images #427 (aayars)
• Clarify the deployment modes #426 (miguno)
• Add example for using --exec #425 (miguno)
• fix more findbugs warnings #424 (dguy)
• Added self documentation to the KSQL config public config variables. #422 (hjafarpour)
• remove checkstlye build plugin as it is provided by the parent pom #421 (dguy)
• fix findbugs warnings in ksql-rest #420 (dguy)
• Fixed the regression bug for CSAS/CTAS result type check. #419 (hjafarpour)
• findbugs warnings in ksql-parser #418 (dguy)
• fix findbugs warnings in examples #417 (dguy)
• findbugs warnings in ksql-engine #416 (dguy)
• fix findbugs in ksql-common #415 (dguy)
• fix findbugs warning in cli #414 (dguy)
• fix findbugs in json deserializer #413 (dguy)
• use mapValues instead of map in SchemaKStream.select #411 (dguy)
• new-tests #407 (TheRealHaui)
• Bring back the commented assertions in StatementExecutorTest and aCom… #406 (hjafarpour)
• move functionality out of PhysicalPlanBuilder into other classes and add tests #405 (dguy)
• Removed unused config variable. #404 (hjafarpour)
• add tests for ExpressionFormatter #399 (dguy)
• remove duplicate ExpressionFormatterQueryRewrite class and move some logic to remove instanceof #398 (dguy)
• Make WindowingIntTest more reliable #397 (dguy)
• Moved duplicate exceptions to one function #396 (samupra)
• CODE: pass over looking at exception handling and reporting [KQL-395] #395 (bluemonk3y)
• fix bad serde package declaration #392 (blueedgenick)
• Ksql 383 clean up internal topics for terminated queries #391 (hjafarpour)
• add test for SelectValueMapper #389 (dguy)
• minor tidy ups to get rid of some unchecked warnings etc #387 (dguy)
• Provide config to use Stream Deserialization Exception handler #384 #385 (dguy)
• CODE: rework threading on QueryStreamWriter #383 (bluemonk3y)
• make join test more reliable #381 (dguy)
• Extract SelectValueMapper from SchemaKStream and SchemaKTable #379 (dguy)
• Put window aggregate logic into the various KsqlWindowExpression classes #377 (dguy)
• move the createsink method out of SchemaKStream #376 (dguy)
• TEST: adding stream-table join #375 (bluemonk3y)
• TEST: adding windowing integration tests, updated streams integration util #371 (bluemonk3y)
• Ksql 386 ksql functions non static #370 (hjafarpour)
• remove jackson dependency in ksql-rest-app. #369 (dguy)
• Remove SourceNode as it is redundant #368 (dguy)
• TEST: Refactoring integration tests from 0.1.x #367 (bluemonk3y)
• MINOR: Use streams 1.0 api methods #365 (dguy)
• After bumping the dependency to 4.0.0 we encountered some issues that… #363 (hjafarpour)
• Revert "Ksql 388 fix 400 build issues" #362 (hjafarpour)
• Ksql 388 fix 400 build issues #361 (hjafarpour)
• Extract methods, remove duplication, etc from PhysicalPlanBuilder #356 (dguy)
• Merge 0.1.x into Master #352 (hjafarpour)
• Reverting adminclient singleton temporarily. #351 (hjafarpour)
• Pom cleanup after refactor #350 (hjafarpour)
• skip bad data in json and delimitted deserializer #347 (dguy)
• MINOR: replace window-unit with TimeUnit #346 (dguy)
• Bluemonk3y 0.1.x code 379 started int test refactor #344 (hjafarpour)
• MINOR: ksqlengine tidy up #343 (dguy)
• MINOR: remove unused imports #342 (dguy)
• 0.1.x [340] started integration test refactoring #341 (bluemonk3y)
• Master #339 (hjafarpour)
• Ksql config refactor #338 (hjafarpour)
• MINOR: remove dead code. make field and method access more restricted #337 (dguy)
• No need to set the streams application.id for the rest server. #336 (hjafarpour)
• First step in better testing tools. Added an integration test tool to… #335 (hjafarpour)
• KSQL-378: content-based routing #333 (ybyzek)
• rename ksql-core to ksql-engine #332 (bluemonk3y)
• Extracted Pipeline into QueuePopulatorSchema #330 (bluemonk3y)
• Fixed the drop table issue. #328 (hjafarpour)
• Refactored the package for GenericRow. #327 (hjafarpour)
• refactoring parser, core and common #325 (bluemonk3y)
• Including the streams config properties in the session with CTAS and … #324 (hjafarpour)
• Clarify how streams and tables are stored in topics #323 (miguno)
• 0.1.x bug fix command queue replay hang #321 (bluemonk3y)
• added persistent information for streams and table #319 (bluemonk3y)
• Small code quality improvements #313 (TheRealHaui)
• add-some-unit-tests #312 (TheRealHaui)
• Clarify KSQL works with AK and CP #302 (miguno)
• Update non-docker-clickstream.md #301 (himani1)
• MINOR: fix checkstyle errors and fail build if there are checkstyle violations #298 (dguy)
• Document how to configure the Kafka bootstrap servers #297 (miguno)
• Add upstream project so build are triggered automatically #296 (ewencp)
• Emit succinct error for missing query file #291 (kirktrue)
• Documentation improvements #289 (miguno)
• Add missing word to roadmap #288 (elliotcm)
• remove build-tools copy, use pluginRepository in pom #286 (aayars)
• Fixed a minor error in the syntax guide. #281 (hjafarpour)
• Feature fix misspelled words #280 (juneng603)
• Improvements to syntax guide #277 (miguno)
• Added LIKE examples to syntax guide and examples. #271 (hjafarpour)
• KSQL screencast image #268 (joel-hamill)
• Fix non-docker quickstart examples #257 (joel-hamill)
• Update slack URL #256 (joel-hamill)
• Add screencast #255 (joel-hamill)
• Doc feedback rollup #254 (joel-hamill)
• KSQL-318 - define roadmap #253 (bluemonk3y)
• Improve examples.md #246 (miguno)

* This Change Log was automatically generated by github_changelog_generator