Skip to content

Commit

Permalink
checkpoint: release 1.0.11
Browse files Browse the repository at this point in the history
  • Loading branch information
@vbarda
vbarda committed Sep 23, 2024
1 parent 7d513bc commit 4e8f94f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion libs/checkpoint/pyproject.toml
View file
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[tool.poetry]

Check notice on line 1 in libs/checkpoint/pyproject.toml

View workflow job for this annotation

GitHub Actions / benchmark

Benchmark results 

.........................................
fanout_to_subgraph_10x: Mean +- std dev: 58.8 ms +- 1.1 ms
.........................................
WARNING: the benchmark result may be unstable
* the standard deviation (5.93 ms) is 11% of the mean (55.9 ms)

Try to rerun the benchmark with more runs, values and/or loops.
Run 'python -m pyperf system tune' command to reduce the system jitter.
Use pyperf stats, pyperf dump and pyperf hist to analyze results.
Use --quiet option to hide these warnings.

fanout_to_subgraph_10x_sync: Mean +- std dev: 55.9 ms +- 5.9 ms
.........................................
fanout_to_subgraph_10x_checkpoint: Mean +- std dev: 76.3 ms +- 1.1 ms
.........................................
fanout_to_subgraph_10x_checkpoint_sync: Mean +- std dev: 80.5 ms +- 0.5 ms
.........................................
fanout_to_subgraph_100x: Mean +- std dev: 561 ms +- 22 ms
.........................................
fanout_to_subgraph_100x_sync: Mean +- std dev: 500 ms +- 6 ms
.........................................
fanout_to_subgraph_100x_checkpoint: Mean +- std dev: 760 ms +- 17 ms
.........................................
fanout_to_subgraph_100x_checkpoint_sync: Mean +- std dev: 782 ms +- 6 ms
.........................................
react_agent_10x: Mean +- std dev: 41.5 ms +- 3.2 ms
.........................................
react_agent_10x_sync: Mean +- std dev: 29.8 ms +- 0.2 ms
.........................................
react_agent_10x_checkpoint: Mean +- std dev: 53.0 ms +- 1.3 ms
.........................................
react_agent_10x_checkpoint_sync: Mean +- std dev: 42.6 ms +- 3.2 ms
.........................................
react_agent_100x: Mean +- std dev: 413 ms +- 8 ms
.........................................
react_agent_100x_sync: Mean +- std dev: 331 ms +- 3 ms
.........................................
react_agent_100x_checkpoint: Mean +- std dev: 928 ms +- 13 ms
.........................................
react_agent_100x_checkpoint_sync: Mean +- std dev: 826 ms +- 12 ms
.........................................
wide_state_25x300: Mean +- std dev: 20.4 ms +- 0.4 ms
.........................................
wide_state_25x300_sync: Mean +- std dev: 12.7 ms +- 0.3 ms
.........................................
wide_state_25x300_checkpoint: Mean +- std dev: 239 ms +- 8 ms
.........................................
wide_state_25x300_checkpoint_sync: Mean +- std dev: 237 ms +- 13 ms
.........................................
wide_state_15x600: Mean +- std dev: 23.6 ms +- 0.4 ms
.........................................
WARNING: the benchmark result may be unstable
* the maximum (23.5 ms) is 58% greater than the mean (14.9 ms)

Try to rerun the benchmark with more runs, values and/or loops.
Run 'python -m pyperf system tune' command to reduce the system jitter.
Use pyperf stats, pyperf dump and pyperf hist to analyze results.
Use --quiet option to hide these warnings.

wide_state_15x600_sync: Mean +- std dev: 14.9 ms +- 1.3 ms
.........................................
wide_state_15x600_checkpoint: Mean +- std dev: 416 ms +- 10 ms
.........................................
wide_state_15x600_checkpoint_sync: Mean +- std dev: 418 ms +- 18 ms
.........................................
wide_state_9x1200: Mean +- std dev: 23.5 ms +- 0.3 ms
.........................................
wide_state_9x1200_sync: Mean +- std dev: 14.6 ms +- 0.1 ms
.........................................
wide_state_9x1200_checkpoint: Mean +- std dev: 270 ms +- 10 ms
.........................................
wide_state_9x1200_checkpoint_sync: Mean +- std dev: 266 ms +- 14 ms

Check notice on line 1 in libs/checkpoint/pyproject.toml

View workflow job for this annotation

GitHub Actions / benchmark

Comparison against main 

+-----------------------------------------+---------+-----------------------+
| Benchmark                               | main    | changes               |
+=========================================+=========+=======================+
| fanout_to_subgraph_100x_checkpoint      | 851 ms  | 760 ms: 1.12x faster  |
+-----------------------------------------+---------+-----------------------+
| fanout_to_subgraph_10x_sync             | 59.3 ms | 55.9 ms: 1.06x faster |
+-----------------------------------------+---------+-----------------------+
| fanout_to_subgraph_100x                 | 592 ms  | 561 ms: 1.05x faster  |
+-----------------------------------------+---------+-----------------------+
| react_agent_100x_checkpoint             | 970 ms  | 928 ms: 1.04x faster  |
+-----------------------------------------+---------+-----------------------+
| react_agent_10x_checkpoint_sync         | 44.3 ms | 42.6 ms: 1.04x faster |
+-----------------------------------------+---------+-----------------------+
| react_agent_100x_checkpoint_sync        | 860 ms  | 826 ms: 1.04x faster  |
+-----------------------------------------+---------+-----------------------+
| fanout_to_subgraph_100x_checkpoint_sync | 810 ms  | 782 ms: 1.04x faster  |
+-----------------------------------------+---------+-----------------------+
| react_agent_10x                         | 43.0 ms | 41.5 ms: 1.03x faster |
+-----------------------------------------+---------+-----------------------+
| fanout_to_subgraph_10x_checkpoint       | 79.0 ms | 76.3 ms: 1.03x faster |
+-----------------------------------------+---------+-----------------------+
| fanout_to_subgraph_10x_checkpoint_sync  | 83.2 ms | 80.5 ms: 1.03x faster |
+-----------------------------------------+---------+-----------------------+
| wide_state_9x1200_sync                  | 15.0 ms | 14.6 ms: 1.02x faster |
+-----------------------------------------+---------+-----------------------+
| react_agent_10x_checkpoint              | 54.2 ms | 53.0 ms: 1.02x faster |
+-----------------------------------------+---------+-----------------------+
| fanout_to_subgraph_100x_sync            | 511 ms  | 500 ms: 1.02x faster  |
+-----------------------------------------+---------+-----------------------+
| fanout_to_subgraph_10x                  | 60.1 ms | 58.8 ms: 1.02x faster |
+-----------------------------------------+---------+-----------------------+
| wide_state_25x300_checkpoint_sync       | 242 ms  | 237 ms: 1.02x faster  |
+-----------------------------------------+---------+-----------------------+
| react_agent_100x                        | 421 ms  | 413 ms: 1.02x faster  |
+-----------------------------------------+---------+-----------------------+
| wide_state_9x1200_checkpoint_sync       | 271 ms  | 266 ms: 1.02x faster  |
+-----------------------------------------+---------+-----------------------+
| wide_state_25x300_sync                  | 13.0 ms | 12.7 ms: 1.02x faster |
+-----------------------------------------+---------+-----------------------+
| react_agent_100x_sync                   | 337 ms  | 331 ms: 1.02x faster  |
+-----------------------------------------+---------+-----------------------+
| wide_state_9x1200                       | 23.9 ms | 23.5 ms: 1.02x faster |
+-----------------------------------------+---------+-----------------------+
| react_agent_10x_sync                    | 30.2 ms | 29.8 ms: 1.01x faster |
+-----------------------------------------+---------+-----------------------+
| wide_state_25x300                       | 20.6 ms | 20.4 ms: 1.01x faster |
+-----------------------------------------+---------+-----------------------+
| wide_state_15x600                       | 23.9 ms | 23.6 ms: 1.01x faster |
+-----------------------------------------+---------+-----------------------+
| wide_state_25x300_checkpoint            | 241 ms  | 239 ms: 1.01x faster  |
+-----------------------------------------+---------+-----------------------+
| Geometric mean                          | (ref)   | 1.03x faster          |
+---------------------------------------
name = "langgraph-checkpoint"
version = "1.0.10"
version = "1.0.11"
description = "Library with base interfaces for LangGraph checkpoint savers."
authors = []
license = "MIT"
Expand Down

0 comments on commit 4e8f94f

Please sign in to comment.