Code

feature: massive logs streaming#424

Code

Merged

saikonen merged 16 commits intomasterNetflix/metaflow-service:masterfrom feature/alternative-massive-logs-approachNetflix/metaflow-service:feature/alternative-massive-logs-approachCopy head branch name to clipboardJun 12, 2024

+291-56

Commits

Commits on May 30, 2024

• wip: testing

  saikonen

  committed
  0b88447

  Copy full SHA for 0b88447

Commits on Jun 4, 2024

• add log streaming download to api

  saikonen

  committed
  162dd08

  Copy full SHA for 162dd08

Commits on Jun 5, 2024

• local dev improvements

  saikonen

  committed
  5269933

  Copy full SHA for 5269933

• wip: first working draft of log streaming

  saikonen

  committed
  f6b6b71

  Copy full SHA for f6b6b71

• implement naive log reverse

  saikonen

  committed
  8d3c91a

  Copy full SHA for 8d3c91a

• skip fetch if log files exist on disk.

  saikonen

  committed
  f429e4d

  Copy full SHA for f429e4d

• add support for legacy logs

  saikonen

  committed
  c608c58

  Copy full SHA for c608c58

• move log dump temp folder under cache_data

  saikonen

  committed
  43710f7

  Copy full SHA for 43710f7

Commits on Jun 6, 2024

• fix page count

  saikonen

  committed
  98fa93a

  Copy full SHA for 98fa93a

• fix raw log stitching

  saikonen

  committed
  c1dff94

  Copy full SHA for c1dff94

• lint

  saikonen

  committed
  28bc2a6

  Copy full SHA for 28bc2a6

• fix tests

  saikonen

  committed
  1800648

  Copy full SHA for 1800648

Commits on Jun 12, 2024

• add GC to log blob downloads

  saikonen

  committed
  a352e4d

  Copy full SHA for a352e4d

• styles

  saikonen

  committed
  3fca55e

  Copy full SHA for 3fca55e

• fix handling logs for running tasks

  saikonen

  committed
  7da2935

  Copy full SHA for 7da2935

• cleanup

  saikonen

  committed
  06950fd

  Copy full SHA for 06950fd