Code

feat: Zero-copy BufMessageReader#1753

Code

Merged

gatesn merged 101 commits intodevelopspiraldb/vortex:developfrom ngates/zero-copyspiraldb/vortex:ngates/zero-copyCopy head branch name to clipboardDec 30, 2024

+256-247

Commits

Commits on Dec 18, 2024

• Store desired alignment in the array buffer

  gatesn

  committed
  79e6ba2

  Copy full SHA for 79e6ba2

• Buffer alignment

  gatesn

  committed
  33b911c

  Copy full SHA for 33b911c

• Buffer alignment

  gatesn

  committed
  602f509

  Copy full SHA for 602f509

• Buffer alignment

  gatesn

  committed
  b54f546

  Copy full SHA for b54f546

• Buffer alignment

  gatesn

  committed
  7db32d1

  Copy full SHA for 7db32d1

• Buffer alignment

  gatesn

  committed
  7852ff3

  Copy full SHA for 7852ff3

• Buffer alignment

  gatesn

  committed
  1525de5

  Copy full SHA for 1525de5

• Merge branch 'develop' into ngates/buffers

  gatesn

  committed
  83ad2ba

  Copy full SHA for 83ad2ba

• AlignedBufferMut

  gatesn

  committed
  8209d76

  Copy full SHA for 8209d76

• AlignedBufferMut

  gatesn

  committed
  897d063

  Copy full SHA for 897d063

• AlignedBufferMut

  gatesn

  committed
  1ef552e

  Copy full SHA for 1ef552e

• AlignedBufferMut

  gatesn

  committed
  b4cb50a

  Copy full SHA for b4cb50a

• AlignedBufferMut

  gatesn

  committed
  c5ab1ac

  Copy full SHA for c5ab1ac

• AlignedBufferMut

  gatesn

  committed
  59bc34a

  Copy full SHA for 59bc34a

Commits on Dec 19, 2024

• AlignedBufferMut

  gatesn

  committed
  d14bc95

  Copy full SHA for d14bc95

• AlignedBufferMut

  gatesn

  committed
  3baafa7

  Copy full SHA for 3baafa7

• AlignedBufferMut

  gatesn

  committed
  50438aa

  Copy full SHA for 50438aa

• AlignedBufferMut

  gatesn

  committed
  7689fc8

  Copy full SHA for 7689fc8

• AlignedBufferMut

  gatesn

  committed
  6f67551

  Copy full SHA for 6f67551

• Fix transmute

  gatesn

  committed
  3989cca

  Copy full SHA for 3989cca

• Fix transmute

  gatesn

  committed
  1f5eca7

  Copy full SHA for 1f5eca7

• Fix transmute

  gatesn

  committed
  f61bd02

  Copy full SHA for f61bd02

• Fix transmute

  gatesn

  committed
  c75b39a

  Copy full SHA for c75b39a

• Fix transmute

  gatesn

  committed
  f247f1a

  Copy full SHA for f247f1a

• Fix transmute

  gatesn

  committed
  434b635

  Copy full SHA for 434b635

• Fix transmute

  gatesn

  committed
  cf6049f

  Copy full SHA for cf6049f

• Combine into single ScalarBuffer

  gatesn

  committed
  a21f595

  Copy full SHA for a21f595

• Benchmark from_iter

  gatesn

  committed
  6b37397

  Copy full SHA for 6b37397

• Benchmark from_iter

  gatesn

  committed
  3338746

  Copy full SHA for 3338746

• Benchmark from_iter

  gatesn

  committed
  20e4c7e

  Copy full SHA for 20e4c7e

• Rename ScalarBuffer to Buffer

  gatesn

  committed
  f5d3bf0

  Copy full SHA for f5d3bf0

• Improve performance of from_iter

  gatesn

  committed
  12f91ea

  Copy full SHA for 12f91ea

• Improve performance of from_iter

  gatesn

  committed
  baf9bb1

  Copy full SHA for baf9bb1

• Improve performance of from_iter

  gatesn

  committed
  aef3e16

  Copy full SHA for aef3e16

• Improve performance of from_iter

  gatesn

  committed
  e41a3c5

  Copy full SHA for e41a3c5

Commits on Dec 20, 2024

• Remove maybe_null prefix

  gatesn

  committed
  0bfce15

  Copy full SHA for 0bfce15

• Remove maybe_null prefix

  gatesn

  committed
  1bae5c1

  Copy full SHA for 1bae5c1

• Remove maybe_null prefix

  gatesn

  committed
  c680791

  Copy full SHA for c680791

• Remove maybe_null prefix

  gatesn

  committed
  5be44d5

  Copy full SHA for 5be44d5

• Some updates

  gatesn

  committed
  59abd5d

  Copy full SHA for 59abd5d

• Add push benchmark

  gatesn

  committed
  7100a11

  Copy full SHA for 7100a11

• Speed up push

  gatesn

  committed
  1d3f8ae

  Copy full SHA for 1d3f8ae

• Speed up push

  gatesn

  committed
  e7fbef1

  Copy full SHA for e7fbef1

• More things

  gatesn

  committed
  91a7ef7

  Copy full SHA for 91a7ef7

• Migrate to buffer

  gatesn

  committed
  8bf5025

  Copy full SHA for 8bf5025

• Remove copy for ALP decompress

  gatesn

  committed
  6e26355

  Copy full SHA for 6e26355

• Remove copy for ALP decompress

  gatesn

  committed
  0937fdf

  Copy full SHA for 0937fdf

• Remove copy for ALP decompress

  gatesn

  committed
  1706492

  Copy full SHA for 1706492

• Remove copy for ALP decompress

  gatesn

  committed
  6ff25dd

  Copy full SHA for 6ff25dd

• Remove copy for ALP decompress

  gatesn

  committed
  f25637b

  Copy full SHA for f25637b

• Remove copy for ALP decompress

  gatesn

  committed
  840f4c2

  Copy full SHA for 840f4c2

• Remove copy for ALP decompress

  gatesn

  committed
  750d979

  Copy full SHA for 750d979

• Remove copy for ALP decompress

  gatesn

  committed
  2f3da8f

  Copy full SHA for 2f3da8f

• Fix cast bug

  gatesn

  committed
  298b8dd

  Copy full SHA for 298b8dd

• Fix cast bug

  gatesn

  committed
  d199163

  Copy full SHA for d199163

• Fix cast bug

  gatesn

  committed
  8ca57a6

  Copy full SHA for 8ca57a6

• push_n

  gatesn

  committed
  f1b2fc6

  Copy full SHA for f1b2fc6

Commits on Dec 21, 2024

• Merge develop

  gatesn

  committed
  afc1d32

  Copy full SHA for afc1d32

• Lint

  gatesn

  committed
  82fd044

  Copy full SHA for 82fd044

• Lint

  gatesn

  committed
  4c64819

  Copy full SHA for 4c64819

• Docs|

  gatesn

  committed
  852b573

  Copy full SHA for 852b573

• Docs|

  gatesn

  committed
  3a1c28c

  Copy full SHA for 3a1c28c

• Make Miri happy by borrowing the uninit region

  gatesn

  committed
  302ed43

  Copy full SHA for 302ed43

• More tests

  gatesn

  committed
  343eaad

  Copy full SHA for 343eaad

• More tests

  gatesn

  committed
  da06bd1

  Copy full SHA for da06bd1

• More tests

  gatesn

  committed
  f4b65eb

  Copy full SHA for f4b65eb

• Add some assertions

  gatesn

  committed
  898c8a5

  Copy full SHA for 898c8a5

• Remove vortex-dtype dependency

  gatesn

  committed
  af63176

  Copy full SHA for af63176

• impl Bytes

  gatesn

  committed
  3d894d6

  Copy full SHA for 3d894d6

• BufMessageReader

  gatesn

  committed
  3c1c088

  Copy full SHA for 3c1c088

• Zero-copy IO

  gatesn

  committed
  92b9946

  Copy full SHA for 92b9946

• Zero-copy IO

  gatesn

  committed
  68d5324

  Copy full SHA for 68d5324

Commits on Dec 26, 2024

• fix typo

  lwwmanning

  committed
  92f66f8

  Copy full SHA for 92f66f8

• fix ALP compress to not copy

  lwwmanning

  committed
  0f734d7

  Copy full SHA for 0f734d7

• trivial optimization

  lwwmanning

  committed
  ca84348

  Copy full SHA for ca84348

• remove unnecessary allocations in bitpacking compress

  lwwmanning

  committed
  ce9c8fd

  Copy full SHA for ce9c8fd

• nits

  lwwmanning

  committed
  3c1735a

  Copy full SHA for 3c1735a

• more nits

  lwwmanning

  committed
  885eb4b

  Copy full SHA for 885eb4b

• fixup locks

  lwwmanning

  committed
  530c69c

  Copy full SHA for 530c69c

Commits on Dec 29, 2024

• Zero-copy IO

  gatesn

  committed
  4b51cf4

  Copy full SHA for 4b51cf4

• Zero-copy IO

  gatesn

  committed
  eba9a69

  Copy full SHA for eba9a69

• Zero-copy IO

  gatesn

  committed
  768c692

  Copy full SHA for 768c692

• Zero-copy IO

  gatesn

  committed
  2f46737

  Copy full SHA for 2f46737

• Zero-copy IO

  gatesn

  committed
  039ed78

  Copy full SHA for 039ed78

• Zero-copy IO

  gatesn

  committed
  aec6081

  Copy full SHA for aec6081

• Zero-copy IO

  gatesn

  committed
  6dafbdc

  Copy full SHA for 6dafbdc

• Zero-copy IO

  gatesn

  committed
  3107465

  Copy full SHA for 3107465

• Zero-copy IO

  gatesn

  committed
  120b1c7

  Copy full SHA for 120b1c7

• Zero-copy IO

  gatesn

  committed
  d31f847

  Copy full SHA for d31f847

• Zero-copy IO

  gatesn

  committed
  bb55c11

  Copy full SHA for bb55c11

• Appease Miri

  gatesn

  committed
  978a2fb

  Copy full SHA for 978a2fb

Commits on Dec 30, 2024

• Merge remote-tracking branch 'origin/develop' into ngates/buffers

  lwwmanning

  committed
  cdf2bf9

  Copy full SHA for cdf2bf9

• merge

  gatesn

  committed
  f9da114

  Copy full SHA for f9da114

• merge

  gatesn

  committed
  cf561d6

  Copy full SHA for cf561d6

• merge

  gatesn

  committed
  99c38de

  Copy full SHA for 99c38de

• primitive slice

  gatesn

  committed
  b5a33e9

  Copy full SHA for b5a33e9

• primitive slice

  gatesn

  committed
  b2095db

  Copy full SHA for b2095db

• Merge branch 'develop' into ngates/zero-copy

  gatesn

  committed
  7aeef63

  Copy full SHA for 7aeef63

• BufMut

  gatesn

  committed
  2ae5f16

  Copy full SHA for 2ae5f16

• Fix docs

  gatesn

  committed
  83d0eb4

  Copy full SHA for 83d0eb4

• Add a couple of tests

  gatesn

  committed
  fa0b435

  Copy full SHA for fa0b435