Code

implement faster innerjoin#2612

Code

Merged

bkamins merged 63 commits intoJuliaData:mainJuliaData/DataFrames.jl:mainfrom bkamins:new_faster_innerjoinbkamins/DataFrames.jl:new_faster_innerjoinCopy head branch name to clipboardFeb 13, 2021

+887-17

Commits

Commits on Jan 26, 2021

• implement faster innerjoin

  bkamins

  committed
  1509f63

Commits on Jan 27, 2021

• add handling of sorted tables

  bkamins

  committed
  2b222b7

• fix eltype test

  bkamins

  committed
  0eb911e

Commits on Jan 28, 2021

• use strategy with single index pool in case of duplicates

  bkamins

  committed
  a16b6f2

Commits on Jan 29, 2021

• add tests for innerjoin

  bkamins

  committed
  14652f0

• fast path for PooledArrays

  bkamins

  committed
  6a5b6ca

Commits on Jan 30, 2021

• update handling of PooledArrays and CategoricalArrays

  bkamins

  committed
  c9385da

Commits on Jan 31, 2021

• add more tests

  bkamins

  committed
  b8907ae

Commits on Feb 2, 2021

• Apply suggestions from code review

  Show description for c4d2c46
  

  bkamins

  and

  nalimilan

  authored
  c4d2c46

• Update src/abstractdataframe/join.jl

  bkamins

  authored
  3f8c49f

• add more comments and optimistically try sorted join algorithm

  bkamins

  committed
  e306de1

• fix lookup

  bkamins

  committed
  47fe234

• Apply suggestions from code review

  Show description for c24f678
  

  bkamins

  and

  nalimilan

  authored
  c24f678

Commits on Feb 3, 2021

• use DataAPI.invrefpool

  bkamins

  committed
  928f372

• Merge remote-tracking branch 'origin/new_faster_innerjoin' into new_faster_innerjoin

  bkamins

  committed
  3842c3d

• Merge branch 'main' into new_faster_innerjoin

  bkamins

  authored
  dba0f36

• Apply suggestions from code review

  Show description for 9cf62af
  

  bkamins

  and

  nalimilan

  authored
  9cf62af

• use nothing as sentinel

  bkamins

  committed
  3912ae6

• Apply suggestions from code review

  Show description for 68a8eaa
  

  bkamins

  and

  nalimilan

  authored
  68a8eaa

Commits on Feb 4, 2021

• remove PooledArrays.jl specific code

  bkamins

  committed
  c05410b

• Apply suggestions from code review

  Show description for a8b2702
  

  bkamins

  and

  nalimilan

  authored
  a8b2702

• corrections after the review

  bkamins

  committed
  5ec767f

• Apply suggestions from code review

  Show description for 1db13ef
  

  bkamins

  and

  nalimilan

  authored
  1db13ef

Commits on Feb 5, 2021

• add OnCol

  bkamins

  committed
  7f2d897

• add faster processing of integer columns

  bkamins

  committed
  9208bff

• Apply suggestions from code review

  bkamins

  authored
  1735712

Commits on Feb 6, 2021

• minor changes

  bkamins

  committed
  bb7e8f1

• fix test coverage

  bkamins

  committed
  6d46f1b

• fix test coverage

  bkamins

  committed
  1ef1362

• revert change for better clarity

  bkamins

  committed
  eb50756

• another small fix

  bkamins

  committed
  7cfb5b4

• fix method definition

  bkamins

  committed
  d9dd15f

• Apply suggestions from code review

  bkamins

  authored
  fd03587

• change hash implementation

  bkamins

  committed
  e30f51a

• fix typo

  bkamins

  committed
  6aa95e3

• fix tests

  bkamins

  committed
  bdcaeef

• consistent detection of CategoricalArrays.jl types

  bkamins

  committed
  1150126

• Apply suggestions from code review

  Show description for 0c1e8b6
  

  bkamins

  and

  nalimilan

  authored
  0c1e8b6

• Merge remote-tracking branch 'origin/new_faster_innerjoin' into new_faster_innerjoin

  bkamins

  committed
  ca02cc9

• add hash test

  bkamins

  committed
  558129d

• in printing we might have union

  bkamins

  committed
  cbe214e

• fix typo

  bkamins

  committed
  e01c1fe

• simplify isless and isequal for OnCol

  bkamins

  committed
  f50b9a1

Commits on Feb 7, 2021

• Update test/join.jl

  Show description for a592b09
  

  bkamins

  and

  nalimilan

  authored
  a592b09

• add more tests

  bkamins

  committed
  1515c07

• Merge remote-tracking branch 'origin/new_faster_innerjoin' into new_faster_innerjoin

  bkamins

  committed
  75560b1

• additional tests

  bkamins

  committed
  d8f1fe4

• add innerjoin benchmark

  bkamins

  committed
  bb83527

• more tests to ensure full coverage

  bkamins

  committed
  56c4c5e

• add linebreaks at @info

  bkamins

  committed
  f697177

Commits on Feb 9, 2021

• simplify loop in sorted case

  bkamins

  committed
  fed4570

• use resize!

  bkamins

  committed
  d0fb0b9

Commits on Feb 10, 2021

• add sizehint!

  bkamins

  committed
  020eaae

Commits on Feb 11, 2021

• avoid using internal functions

  bkamins

  committed
  a3de1c2

• improved benchmark design

  bkamins

  committed
  659ec7c

• Revert "avoid using internal functions"

  Show description for 07ecb0a
  bkamins

  committed
  07ecb0a

• fix dict sizehint

  bkamins

  committed
  58bdcf3

• add benchmark runner

  bkamins

  committed
  d7bb989

• Revert "Revert "avoid using internal functions""

  Show description for f9882f8
  bkamins

  committed
  f9882f8

• clean up script

  bkamins

  committed
  8a31d99

• Update test/join.jl

  bkamins

  authored
  91df0e4

Commits on Feb 12, 2021

• improve tests

  bkamins

  committed
  0b21972

Commits on Feb 13, 2021

• Update NEWS.md

  bkamins

  authored
  1a9e664