Code

Add Aggregation fuzzer framework#12667

Code

Merged

alamb merged 41 commits intoapache:mainapache/datafusion:mainfrom Rachelint:aggr-fuzzerRachelint/arrow-datafusion:aggr-fuzzerCopy head branch name to clipboardOct 9, 2024

+1,646-63

Commits

Commits on Oct 5, 2024

• impl primitive arrays generator.

  Rachelint

  committed
  6514cd2

• sort out the test record batch generating codes.

  Rachelint

  committed
  1a11133

• draft for DataSetsGenerator.

  Rachelint

  committed
  e0ea349

• tmp

  Rachelint

  committed
  c952bdf

• improve the data generator, and start to impl the session context generator.

  Rachelint

  committed
  214d67f

• impl context generator.

  Rachelint

  committed
  04b4246

• tmp

  Rachelint

  committed
  6b2af7f

• define the AggregationFuzzer.

  Rachelint

  committed
  77d2268

• add ut for data generator.

  Rachelint

  committed
  4bef192

• improve comments for SessionContextGenerator.

  Rachelint

  committed
  e7fbf47

• define GeneratedSessionContextBuilder to reduce repeated codes.

  Rachelint

  committed
  984f6aa

• extract the check equality logic for reusing.

  Rachelint

  committed
  12e3f37

• add ut for SessionContextGenerator.

  Rachelint

  committed
  ca4a40c

• tmp

  Rachelint

  committed
  a4639de

• finish the main logic of AggregationFuzzer.

  Rachelint

  committed
  0cfd035

• try to rewrite some test using the fuzzer.

  Rachelint

  committed
  8271079

• fix header.

  Rachelint

  committed
  d6e358e

• expose table name through AggregationFuzzerBuilder.

  Rachelint

  committed
  2279ab7

• throw err to aggr fuzzer, and expect them then.

  Rachelint

  committed
  7deced4

• switch to Arc<str> to slightly improve performance.

  Rachelint

  committed
  c5d80ce

• throw more errors to fuzzer.

  Rachelint

  committed
  b50ea49

• print task informantion before panic.

  Rachelint

  committed
  7a9118f

• improve comments.

  Rachelint

  committed
  ea6ad89

• support printing generated session context params in error reporting.

  Rachelint

  committed
  3d9bc15

• add todo.

  Rachelint

  committed
  bf7fc82

• add some new fuzz case based on AggregationFuzzer.

  Rachelint

  committed
  2e35985

• fix lint.

  Rachelint

  committed
  0090e6c

• print more information in error report.

  Rachelint

  committed
  90cb038

• fix clippy.

  Rachelint

  committed
  c2dcb60

Commits on Oct 8, 2024

• improve comment of SessionContextGenerator.

  Rachelint

  committed
  d90b92b

• just use fixed data_gen_rounds and ctx_gen_rounds currently, because we will hardly set them.

  Rachelint

  committed
  58c0777

• improve comments for rounds constants.

  Rachelint

  committed
  d5ff6ec

• small improvements.

  Rachelint

  committed
  4b18d53

• select sql from some candidates ranther than fixed one.

  Rachelint

  committed
  fbf3a6e

• make data_gen_rounds able to set again, and add more tests.

  Rachelint

  committed
  79b0734

• add no group cases.

  Rachelint

  committed
  ca36a88

• add fuzz test for basic string aggr.

  Rachelint

  committed
  ea5e80b

• make data_gen_rounds smaller.

  Rachelint

  committed
  7f08f2b

• add comments.

  Rachelint

  committed
  9b0005b

• fix typo.

  Rachelint

  committed
  8040dc3

• fix comment.

  Rachelint

  committed
  5c90a6b