[Bug][Go SDK]: Checkpointing should "split" restrictions to claimed positions. #24966
Closed
1 of 15 tasks
Labels
Milestone
What happened?
The Go SDK doesn't currently handle process continuations correctly when partial work has been done.
The correct behavior is that any claimed positions are assumed to be processed by the primary, leaving the rest to the residual. That is, it should be possible for a DoFn to eventually process all of a restriction a single position at a time, by always returning process continuation delays after each claimed restriction.
At present, the original restriction is what is used, instead splitting the restriction at the claimed position boundary, leading to infinite processing.
Related #24931 which rendered these independent by element.
Issue Priority
Priority: 1 (data loss / total loss of function)
Issue Components
The text was updated successfully, but these errors were encountered: