v0.8.83-nightly

What's Changed

Exciting New Features ✨

• feat(function-v2): add tuple() and get() for tuple by @andylokandy in #8372
• feat: add gc status to data metrics and show in processlist by @BohuTANG in #8389

Thoughtful Bug Fix 🔧

• fix(http handler): return session if request.session is null. by @youngsofun in #8399
• fix(processor): try fix incorrect error message by @zhang2014 in #8365

Code Refactor 🎉

• refactor: decouple meta readers from TableContext by @dantengsky in #8395
• refactor(expr): move expressoin test to function-v2 by @andylokandy in #8397

Documentation 📔

• docs: changed order by @soyeric128 in #8378
• docs: IN NOT IN subquery by @soyeric128 in #8394

Full Changelog: v0.8.82-nightly...v0.8.83-nightly

v0.8.82-nightly

What's Changed

Exciting New Features ✨

• feat: config options for bloom filter cache by @dantengsky in #8358
• feat(test): add join tests under large dataset by @xudong963 in #8351
• feat(query): implement array function slice, remove_fist, remove_last by @b41sh in #8326
• feat(input format): scan progress of copy into and streaming load. by @youngsofun in #8375
• feat(meta/management): allow to join a cluster if a meta node has no log by @drmingdrmer in #8384

Thoughtful Bug Fix 🔧

• fix: fix copy Version mismatch bug by @lichuang in #8355
• fix: should ignore StorageNotFound errors in concurrent GC by @dantengsky in #8376

Code Refactor 🎉

• refactor(meta/binary): record every error when joining/leaving by @drmingdrmer in #8371

Build/Testing/CI Infra Changes 🔌

• ci: migrate deprecating set-output commands by @miles170 in #8381

Documentation 📔

• docs: scalar subqueries by @soyeric128 in #8373

New Contributors

• @miles170 made their first contribution in #8381

Full Changelog: v0.8.81-nightly...v0.8.82-nightly

v0.8.81-nightly

What's Changed

Exciting New Features ✨

• feat(parser): Relax the order requirement about the COPY options by @flaneur2020 in #8341
• feat(query): improve count distinct for string type in fucntions-v2. by @RinChanNOWWW in #8347
• feat: Introduce data metrics for table by @Xuanwo in #8363

Thoughtful Bug Fix 🔧

• fix(planner): left join panic by @xudong963 in #8325
• fix(processor): fix throw error when abort and limit by @zhang2014 in #8361
• fix(query): StringSearchLike vector_vector can not match '\n' by @TCeason in #8359
• fix(processor): fix full join panic by @zhang2014 in #8364
• fix: adjust the max io requests with block number not segment number by @BohuTANG in #8367

Code Refactor 🎉

• refactor(storages): remove unused meta from StorageContext by @BohuTANG in #8339
• refactor: re-org mutators by @dantengsky in #8332
• refactor(storage/util): move to sub mod by @BohuTANG in #8344
• refactor: Move in memory data out of storage context by @Xuanwo in #8349
• refactor: Move RuntimeLayer into common-storage by @Xuanwo in #8348
• refactor(query): re-org query crates by @sundy-li in #8336
• refactor(query/service): Move query/service/utils to sub mods by @BohuTANG in #8360
• refactor: use commit_mutation in segment compaction by @dantengsky in #8350

Build/Testing/CI Infra Changes 🔌

• ci: Install cargo machete by @Xuanwo in #8338
• ci: Let's use cargo machete by @Xuanwo in #8343
• ci: Move the slowest task to the end of check list by @Xuanwo in #8346

Documentation 📔

• docs: fix deploy by @soyeric128 in #8335

Full Changelog: v0.8.80-nightly...v0.8.81-nightly

v0.8.80-nightly

What's Changed

Accepted RFCs 🛫

• rfc: Multiple Catalog by @Xuanwo in #8255

Exciting New Features ✨

• refactor(optimizer): use match to replace if else by @xudong963 in #8291
• feat(query): modify function-v2 comparison like by @TCeason in #8280
• feat: Enable jitter for retry operations by @Xuanwo in #8296
• feat: add_source and add_sink to pipeline to simple the usage by @BohuTANG in #8305
• feat: compact segment by @dantengsky in #8261
• feat(http handler): no longer need to call final_uri explicitly. by @youngsofun in #8299
• feat: Add cache operator in common-storage by @Xuanwo in #8306
• feat(query): improve performance of count distinct. by @RinChanNOWWW in #8317
• feat: forbid creation of user with builtin username by @guzzit in #8327
• feat(query): enable gzip_zlib_ng feature to have maximum performance by @sundy-li in #8330
• feat: change adjust max io from max threads to max io requests by @BohuTANG in #8321

Thoughtful Bug Fix 🔧

• fix(storage): support mutation during insertion by @zhyass in #8205
• fix(planner): Fix aggregation in cluster mode by @leiysky in #8309
• fix: Copy Version mismatch bug by @lichuang in #8307
• fix(processor): try fix data lost when resize multi outputs by @zhang2014 in #8319
• fix: "optimize purge" may incorrectly delete data of pending txs by @dantengsky in #8320
• fix: mergify could ignore some tests by @Xuanwo in #8324
• fix: Stateful tests copy from s3 location will hang by @Xuanwo in #8323
• fix(planner): Fix join associate rules by @leiysky in #8312
• fix(processor): try fix lost last message if finish at same time by @zhang2014 in #8333

Code Refactor 🎉

• refactor(meta/service): enable tracing log for databend-meta by @drmingdrmer in #8295
• refactor: optimize get/upsert copied file info by @lichuang in #8282
• refactor(meta/service): try best to leave a cluster by @drmingdrmer in #8298
• refactor: Rename to data operator to make space for cache by @Xuanwo in #8314
• refactor(meta/service): merge two to-meta-server rpc into one by @drmingdrmer in #8308

Documentation 📔

• docs: create table with external location by @soyeric128 in #8329

New Contributors

• @guzzit made their first contribution in #8327

Full Changelog: v0.8.79-nightly...v0.8.80-nightly

v0.8.79-nightly

What's Changed

Exciting New Features ✨

• feat(meta/schema_api): add API list_all_tables by @drmingdrmer in #8254
• feat(http handler): return error when download result of a running query by @youngsofun in #8268
• feat(query): optimize StringSearchLike vector_const by @TCeason in #8220
• feat(query): migrate datetime rounder functions to v2. by @RinChanNOWWW in #8281
• feat: optimize subquery by deleting redundancy join by @xudong963 in #8264

Thoughtful Bug Fix 🔧

• fix: Query version is incorrect by @Xuanwo in #8272
• fix(logic test): print error message for http handler. by @youngsofun in #8284
• fix(processor): support abort for left mark join by @zhang2014 in #8248
• fix: Query startup too slow for reqsign retry by @Xuanwo in #8289
• fix: failed to release the permits on time in the block pruner by @dantengsky in #8294
• fix(meta): import: AsKeySpace::clear() should not entire sled tree by @drmingdrmer in #8288

Code Refactor 🎉

• refactor(expression): fix scalar repeat by @sundy-li in #8275
• refactor(query): improve comparison number with string by @sundy-li in #8293

Build/Testing/CI Infra Changes 🔌

• ci: add ulimit nofile for sqllogic test by @everpcpc in #8283

Documentation 📔

• docs: purge tips by @soyeric128 in #8266
• docs: joins by @soyeric128 in #8265

Full Changelog: v0.8.78-nightly...v0.8.79-nightly

v0.8.78-nightly

What's Changed

Exciting New Features ✨

• feat: add share table query by @lichuang in #8198
• feat(query): migrate real time functions to v2. by @RinChanNOWWW in #8259
• feat(query): migrate date to number functions to v2. by @RinChanNOWWW in #8257

Thoughtful Bug Fix 🔧

• fix(processor): support abort for right mark join by @zhang2014 in #8249
• fix(processor): support abort for right join by @zhang2014 in #8212
• fix(processor): support abort for left join by @zhang2014 in #8245

Full Changelog: v0.8.77-nightly...v0.8.78-nightly

v0.8.77-nightly

What's Changed

Exciting New Features ✨

• feat(query): implement arithmetic functions for Date and Timestamp. by @RinChanNOWWW in #8202
• feat: Retry fuse table write operations by @Xuanwo in #8244

Thoughtful Bug Fix 🔧

• fix(sessions): fix dead lock when force kill sessions by @zhang2014 in #8242

Full Changelog: v0.8.76-nightly...v0.8.77-nightly

v0.8.76-nightly

What's Changed

Exciting New Features ✨

• feat(query): jsonb functions support json string by @b41sh in #8222
• feat: add time to show processlist for the session elapsed how many seconds by @BohuTANG in #8236
• feat(storage): Enable DNS Cache for opendal by @Xuanwo in #8240

Thoughtful Bug Fix 🔧

• fix: Make sure check is called inside global io runtime by @Xuanwo in #8239

Full Changelog: v0.8.75-nightly...v0.8.76-nightly

v0.8.75-nightly

What's Changed

Thoughtful Bug Fix 🔧

• fix: dead lock caused by incorrect semaphore permit control by @dantengsky in #8226

Full Changelog: v0.8.74-nightly...v0.8.75-nightly

v0.8.74-nightly

What's Changed

Exciting New Features ✨

• feat(query): parallel read of ndjson in copy. by @youngsofun in #8199
• feat(expr): add util::eval_function(), a shortcut to call scalar fucntion by @andylokandy in #8214
• feat(planner): optimize right join by @xudong963 in #8204

Thoughtful Bug Fix 🔧

• fix(processor): support abort for semi or anti join by @zhang2014 in #8165

Code Refactor 🎉

• refactor(meta/sled): simplify SledTree APIs by @drmingdrmer in #8203

Full Changelog: v0.8.73-nightly...v0.8.74-nightly