Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Event Store commit batching using Proto.Actor #659

Merged
merged 119 commits into from
Apr 20, 2022
Merged

Event Store commit batching using Proto.Actor #659

merged 119 commits into from
Apr 20, 2022

Conversation

woksin
Copy link
Contributor

@woksin woksin commented Apr 4, 2022

Summary

Start integrating the Actor Model into the Runtime code with first introducing Proto.Actor into the Event Store. We're taking advantage of the Actor Model to implement batching logic on the write side of the Event Store (committing events) to massively increase the throughput for committing events. This is also built in a way that enables us to in the future be able to scale horizontally through having multiple Runtimes running together in clusters.

In addition we now do benchmarking on key parts of the system and publishing the results on each GitHub release so that we can keep an eye on the current performance.

Changed

  • When committing events the commits will be written and responded in batches which in turn increases the throughput of commits by several times.

@woksin woksin added the patch label Apr 4, 2022
woksin and others added 26 commits April 9, 2022 09:53
…arams attribute. Also make event handler more sophisticated
Make benchmarks run faster by reducing number of events to process
Increase number of events for projection benchmark
Add benchmarks for stream processor state repository
Move Benchmarks and add setup for integration tests
More integration tests + some restructuring
@woksin woksin marked this pull request as ready for review April 20, 2022 12:12
@woksin woksin changed the title Actors Event Store commit batching using Proto.Actor Apr 20, 2022
@woksin woksin merged commit b064249 into master Apr 20, 2022
@woksin woksin deleted the 8.0.1-mithrandir branch April 20, 2022 12:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants