Skip to content

Commit

Permalink
[fix] Propagate RollingBatch predict output code to request outputs (… (
Browse files Browse the repository at this point in the history
#2495)

Co-authored-by: David Thomas <dthmasp@amazon.com>
  • Loading branch information
siddvenk and davidthomas426 authored Oct 25, 2024
1 parent ec2590f commit 82ef649
Showing 1 changed file with 5 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -174,6 +174,11 @@ public void run() {
BytesSupplier err = BytesSupplier.wrap(JsonUtils.GSON.toJson(out));
for (Request req : list) {
req.last = true;

// Note: This will only change the HTTP response code if the first chunk
// has not yet been sent
req.output.setCode(code);

req.data.appendContent(err, true);
}
list.clear();
Expand Down

0 comments on commit 82ef649

Please sign in to comment.