Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add RollingSum operator to updateBy() #2903

Merged
merged 140 commits into from
Feb 2, 2023
Merged

Add RollingSum operator to updateBy() #2903

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
140 commits
Select commit Hold shift + click to select a range
326f0a4
added UpdateByCumulativeOperator class, tests still pass
lbooker42 Aug 4, 2022
d8f941c
adding in windowed operators, tests still passing
lbooker42 Aug 4, 2022
6ddc5ed
wip
lbooker42 Aug 5, 2022
c8d3224
WIP, good save point. ZeroKey working, bucketed not
lbooker42 Aug 10, 2022
a4707c7
zerokey working well, bucketed upcoming
lbooker42 Aug 10, 2022
3347af1
append-only zerokey supported for windowed operators
lbooker42 Aug 10, 2022
cce7e86
WIP, but all cum tests passing, windowed static only
lbooker42 Aug 11, 2022
97d85b9
rewrote to use PartitionBy as engine for bucketed updateBy
lbooker42 Aug 12, 2022
8036eaf
added Partioned helper
lbooker42 Aug 12, 2022
ec4a4f4
merged upstream
lbooker42 Aug 12, 2022
493e1f3
little hacky, but all cumulative static tests running
lbooker42 Aug 12, 2022
6cc64f5
all static tests running (bucked TBD)
lbooker42 Aug 12, 2022
1b2d25a
very messy, but working
lbooker42 Aug 17, 2022
35d50ff
merged upstream
lbooker42 Aug 26, 2022
cc74901
Big refactor to simplify processing
lbooker42 Aug 29, 2022
d434d21
bugfix
lbooker42 Aug 29, 2022
d075b50
WIP, COB
lbooker42 Aug 29, 2022
9721286
Tests passing, time to optimize
lbooker42 Aug 30, 2022
7e15bc4
WIP
lbooker42 Aug 31, 2022
924edce
WIP
lbooker42 Sep 7, 2022
86ecfce
Tests passing for all operations, including RollingSum (time and tick…
lbooker42 Sep 12, 2022
63bc130
Added Pairwise floating point storage and tests (100% coverage)
lbooker42 Sep 13, 2022
82a865c
added Double versions of the pairwise structures
lbooker42 Sep 13, 2022
5f7adfb
Merge branch 'main' into lab-updateby-ops
lbooker42 Sep 14, 2022
3c9fbb4
refactor the pairwise to use a list of dirty indices instead of bitset
lbooker42 Sep 15, 2022
dfa8f29
added replicated ring buffers and tests
lbooker42 Sep 15, 2022
89e51ef
refactoring WIP, everything is broken
lbooker42 Sep 16, 2022
4405b3f
huge refactor almost complete, most tests passing
lbooker42 Sep 23, 2022
4df71be
huge refactor near complete, all cumulative tests passing
lbooker42 Sep 27, 2022
02d6b27
Massive refactor complete, tests passing, performance TBD
lbooker42 Sep 28, 2022
81270bd
merged upstream
lbooker42 Oct 11, 2022
f3e9eae
Addressed some PR comments, more to do
lbooker42 Oct 11, 2022
8182926
Add'l PR comments addressed and spotless applied
lbooker42 Oct 12, 2022
2d22372
Tests pass and a few bugs fixed
lbooker42 Oct 13, 2022
0c6a726
Refactored the windowed operators to chunk-process data
lbooker42 Oct 14, 2022
d578a31
Enabled multi-column input operators, lightened ZeroKey creation
lbooker42 Oct 19, 2022
f09651f
WIP commit, tests passing again
lbooker42 Oct 25, 2022
907181e
single threaded caching implemented and working
lbooker42 Oct 26, 2022
fa568dd
Trying parallel population
lbooker42 Nov 1, 2022
51a6e73
Addressed BooleanSparseArraySource reinterpreted as ByteSource not al…
lbooker42 Nov 3, 2022
cabf485
Implemented UGP parallel/serial task helper
lbooker42 Nov 3, 2022
34e8840
tiny edits
lbooker42 Nov 3, 2022
75fe1ab
More documentation
lbooker42 Nov 9, 2022
5d7a2b6
Add'l documentation
lbooker42 Nov 11, 2022
a35b4d4
More bug fixes, close of week checkin
lbooker42 Nov 11, 2022
a7fc819
Add prepareForParallelPopulation to dense array sources.
lbooker42 Nov 18, 2022
301266d
Refactored JobScheduler as a top-level interface and the impl's as to…
lbooker42 Nov 18, 2022
0789b15
Added interruption of tasks for JobScheduler on error
lbooker42 Nov 18, 2022
4fbd434
merged with master
lbooker42 Nov 22, 2022
3c6ee65
fixed addUpdateListener() calls
lbooker42 Nov 22, 2022
a12b218
Addressed (some) PR comments
lbooker42 Nov 23, 2022
79848df
Cleanup after error inside PhasedUpdateProcessor
lbooker42 Nov 29, 2022
da57bdd
Minor change
lbooker42 Nov 29, 2022
2055992
Removed @ConcurrentMethod decorators and changed python wrapper to au…
lbooker42 Dec 2, 2022
9935d85
Removed @ConcurrentMethod decorators and changed python wrapper to au…
lbooker42 Dec 2, 2022
1d88c0a
WIP
lbooker42 Dec 6, 2022
52f1f88
spotless
lbooker42 Dec 6, 2022
738a18c
FinalDefault misapplication corrected
lbooker42 Dec 6, 2022
0166829
Adjusted imports
lbooker42 Dec 6, 2022
ea5c63e
Corrected caching bug
lbooker42 Dec 6, 2022
e48d1d8
Cherry picked changes from rcaudy
lbooker42 Dec 14, 2022
faffb1d
synced with main
lbooker42 Dec 16, 2022
5ed31ff
Corrected build errors and removed replication of ObjectRingBuffer an…
lbooker42 Dec 19, 2022
d853cd1
modified RingBuffer to throw exception on add() when full and growing…
lbooker42 Dec 19, 2022
e1d96cc
changed dense ArraySources per PR comments
lbooker42 Dec 19, 2022
7268828
Renamed 'TimeScale' to 'WindowScale' to better represent the Ticks/Ti…
lbooker42 Dec 29, 2022
58844ce
Fxed a bug in Fwd Time windows (when timestamp was modified)
lbooker42 Dec 30, 2022
647708d
RingBuffer documentation and renamed InverseRowRedirectionImpl.java
lbooker42 Jan 3, 2023
0a69b50
Cleanup and spotless apply
lbooker42 Jan 3, 2023
1bcc109
Low hanging fruit resolved, more work ahead
lbooker42 Jan 3, 2023
26ae4b7
Added new base operator constructor for specifying timestamp column. …
lbooker42 Jan 4, 2023
5813d96
Refactored UpdateByRedirectionHelper and operators to use rowRedirect…
lbooker42 Jan 4, 2023
4db151f
Corrected off-by-one error in UpdateBy row redirection
lbooker42 Jan 4, 2023
0acdaae
JobScheduler simplifications
lbooker42 Jan 4, 2023
a13dfb4
Removed magic numbers, replaced with descriptive constants
lbooker42 Jan 4, 2023
e5107d3
Moved UpdateBy classes, working version of clear output Object column…
lbooker42 Jan 6, 2023
15966dc
More cleanup
lbooker42 Jan 6, 2023
a5b1885
merged with main
lbooker42 Jan 6, 2023
9ab165e
Cleanup in dense array sources
lbooker42 Jan 6, 2023
a02d726
Cleaned up unnecessary changes to PartitionBy signatures
lbooker42 Jan 6, 2023
2224a49
spotless applied, whitespace changes
lbooker42 Jan 6, 2023
9ac4219
more spotless
lbooker42 Jan 6, 2023
c72934c
Mid-review changes.
lbooker42 Jan 7, 2023
40cb862
Mid-review changes and addressing PR comments.
lbooker42 Jan 10, 2023
2c6b517
Spotless whitespace
lbooker42 Jan 10, 2023
0f466e7
Compilation failure fixes
lbooker42 Jan 10, 2023
c2228d7
Merge branch 'main' into lab-updateby-ops
lbooker42 Jan 10, 2023
275450c
More compilation fixes.
lbooker42 Jan 10, 2023
5af2472
Sketchy python changes
lbooker42 Jan 10, 2023
3733bec
Use BitSet instead of Trove sets
lbooker42 Jan 10, 2023
75e2b14
JobScheduler WIP (incomplete)
lbooker42 Jan 11, 2023
9b5f295
Rewrite of UpdateByWindowTicks for accuracy and efficiency
lbooker42 Jan 12, 2023
9d57d85
Bug fixes for forward looking rolling window
lbooker42 Jan 13, 2023
2b4b7f3
Changes to UpdateByWindowTime, plus cleanup
lbooker42 Jan 13, 2023
0214830
Large update, JobScheduler changes and tests plus maintenance of vali…
lbooker42 Jan 17, 2023
bed69d8
Far too large of commit, apologies
lbooker42 Jan 19, 2023
d7d59c0
Address PR comments
lbooker42 Jan 19, 2023
31c9ce1
merged with main
lbooker42 Jan 20, 2023
d98dd59
Changes to UpdateByWindowTime
lbooker42 Jan 23, 2023
cf1438f
Merge branch 'main' into lab-updateby-ops
lbooker42 Jan 23, 2023
3e97585
Cleanup in ring buffers and tests
lbooker42 Jan 23, 2023
825db35
More ring and pairwise buffer cleanup
lbooker42 Jan 24, 2023
3e95809
Properly replicated PairwiseDoubleRingBuffer, cleanup of repeated code
lbooker42 Jan 24, 2023
20d15c5
More cleanup on RingBuffer/PairwiseBuffer classes
lbooker42 Jan 25, 2023
4e3854a
Implemented timestamp column modification check
lbooker42 Jan 25, 2023
ea478b7
UpdateBy operation spec changes
lbooker42 Jan 26, 2023
cecfd48
Bug fixes to Pairwise ring buffers
lbooker42 Jan 26, 2023
aaf7c58
UpdateBy corrections and optimizations. Tests passing.
lbooker42 Jan 26, 2023
e7fea28
Merge branch 'main' into lab-updateby-ops
lbooker42 Jan 26, 2023
1a259e4
Optimizing when to consider modified rows.
lbooker42 Jan 26, 2023
60e4624
PairwiseBuffer simplification, bug fix
lbooker42 Jan 26, 2023
f77d57d
UpdateBy operator cleanup
lbooker42 Jan 27, 2023
65f02a4
Low hanging fruit exhausted
lbooker42 Jan 27, 2023
03db0c5
Re-cleaning the operators.
lbooker42 Jan 27, 2023
2856868
Fixed a race condition, can't seem to repro the failure.
lbooker42 Jan 28, 2023
9421854
Addressing simple PR comments.
lbooker42 Jan 30, 2023
6d046fa
Spotless and ZeroKey bug fix.
lbooker42 Jan 30, 2023
7ac5dbd
More updates, but resource leak is back
lbooker42 Jan 31, 2023
f5ed591
1. Improve bucket and listener descriptions
rcaudy Jan 31, 2023
34677e5
Merge pull request #1 from rcaudy/rwc-updatebyerrors
lbooker42 Jan 31, 2023
dfe50f0
UpdateBy Operator unification
lbooker42 Jan 31, 2023
3b14a30
Merge branch 'lab-updateby-ops' of github.com:lbooker42/deephaven-cor…
lbooker42 Jan 31, 2023
aafbdf8
Reconciled with error handler. Still has debug code!
lbooker42 Jan 31, 2023
da2853e
Final PR comments addressed, still bug-finding code present.
lbooker42 Jan 31, 2023
d17ce5a
1. Rip out most of the debug logging/instrumentation
rcaudy Jan 31, 2023
536c32c
Minor cleanup to visibility
rcaudy Jan 31, 2023
e868d94
EvalNugget "improvement" ?
rcaudy Jan 31, 2023
5cf3459
Merge pull request #2 from rcaudy/rwc-updatebyerrors2
lbooker42 Feb 1, 2023
9165143
Minor comments
lbooker42 Feb 1, 2023
e0c5af4
Merge remote-tracking branch 'origin/lab-updateby-ops' into lab-updat…
lbooker42 Feb 1, 2023
090b0e9
Merge-related bug fix
lbooker42 Feb 1, 2023
ff5ef49
Added TODO and linked the created tickets
lbooker42 Feb 1, 2023
51c484d
TestTableValidator changes
lbooker42 Feb 1, 2023
dd37fe5
Spotless fix
lbooker42 Feb 1, 2023
29eab56
merge with main
lbooker42 Feb 1, 2023
8f3f559
Change to EvalNugget to pass unchanged table references
lbooker42 Feb 1, 2023
b9a7cce
Supressed exceptions in EngineCleanup
lbooker42 Feb 1, 2023
761b044
LivenessScopeStack.computeEnclosed and LivenessScopeStack.computeArra…
rcaudy Feb 2, 2023
93bec77
Refactor BucketedPartitionedUpdateByManager a little to put all the "…
rcaudy Feb 2, 2023
5d9bd67
Merge pull request #3 from rcaudy/rwc-ptcleanup
lbooker42 Feb 2, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
191 changes: 0 additions & 191 deletions Base/src/main/java/io/deephaven/base/LongRingBuffer.java
View file
Open in desktop

This file was deleted.

Loading