Code

Loki integration #2#2306

Code

Merged

buixor merged 74 commits intocrowdsecurity:mastercrowdsecurity/crowdsec:masterfrom lperdereau:lokilperdereau/crowdsec:lokiCopy head branch name to clipboardNov 22, 2023

+1,420-4

Commits

Commits on Oct 15, 2023

• loki draft.

  

  athoune

  authored and

  lperdereau

  committed
  343724b

  Copy full SHA for 343724b

• Ready and Read once.

  

  athoune

  authored and

  lperdereau

  committed
  bc6f327

  Copy full SHA for bc6f327

• Prometheus counter. Better URL handling. Streamin acquisition.

  

  athoune

  authored and

  lperdereau

  committed
  437c2af

  Copy full SHA for 437c2af

• Test and fix config.

  

  athoune

  authored and

  lperdereau

  committed
  01646c7

  Copy full SHA for 01646c7

• Stream test draft.

  

  athoune

  authored and

  lperdereau

  committed
  7037463

  Copy full SHA for 7037463

• Push log to Loki.

  

  athoune

  authored and

  lperdereau

  committed
  b17711e

  Copy full SHA for b17711e

• Fix: specific entry unmarshal

  

  athoune

  authored and

  lperdereau

  committed
  bd28c2c

  Copy full SHA for bd28c2c

• Since.

  

  athoune

  authored and

  lperdereau

  committed
  5937d6c

  Copy full SHA for 5937d6c

• Handling empty JSON. Does it really happen?

  

  athoune

  authored and

  lperdereau

  committed
  6632bca

  Copy full SHA for 6632bca

• Lazy query. More error.

  

  athoune

  authored and

  lperdereau

  committed
  92e3ea5

  Copy full SHA for 92e3ea5

• Read loop.

  

  athoune

  authored and

  lperdereau

  committed
  6c21382

  Copy full SHA for 6c21382

• Simpler JSON.

  

  athoune

  authored and

  lperdereau

  committed
  4570046

  Copy full SHA for 4570046

• OK, it's this test logs, not an old run.

  

  athoune

  authored and

  lperdereau

  committed
  c46fb2b

  Copy full SHA for c46fb2b

• DSN.

  

  athoune

  authored and

  lperdereau

  committed
  c2b3d75

  Copy full SHA for c2b3d75

• Tenant ID.

  

  athoune

  authored and

  lperdereau

  committed
  d99feef

  Copy full SHA for d99feef

• Bring your own headers.

  

  athoune

  authored and

  lperdereau

  committed
  94d0f55

  Copy full SHA for 94d0f55

• Authorization

  

  athoune

  authored and

  lperdereau

  committed
  856da41

  Copy full SHA for 856da41

• Fix: unsanitized user input

  

  athoune

  authored and

  lperdereau

  committed
  17224b8

  Copy full SHA for 17224b8

• More interface implementation

  

  athoune

  authored and

  lperdereau

  committed
  c11cbcc

  Copy full SHA for c11cbcc

• Date or Duration diff

  

  athoune

  authored and

  lperdereau

  committed
  5edcdb6

  Copy full SHA for 5edcdb6

• Specific time.Time type for YAML parsing.

  

  athoune

  authored and

  lperdereau

  committed
  48431f2

  Copy full SHA for 48431f2

• Loky query is mandatory

  

  athoune

  authored and

  lperdereau

  committed
  bf138b9

  Copy full SHA for bf138b9

• Fix: parse JSON loki response.

  

  athoune

  authored and

  lperdereau

  committed
  d8d63a2

  Copy full SHA for d8d63a2

• Play this test.

  

  athoune

  authored and

  lperdereau

  committed
  ea860b1

  Copy full SHA for ea860b1

• OneShot has its test

  

  athoune

  authored and

  lperdereau

  committed
  6bf80ee

  Copy full SHA for 6bf80ee

• FeedLoki routine.

  

  athoune

  authored and

  lperdereau

  committed
  a81d52a

  Copy full SHA for a81d52a

• Paginate Loki query.

  

  athoune

  authored and

  lperdereau

  committed
  d7a1c6a

  Copy full SHA for d7a1c6a

• Explicit loki error.

  

  athoune

  authored and

  lperdereau

  committed
  4f1aae7

  Copy full SHA for 4f1aae7

• Wait for ready is a parameter.

  

  athoune

  authored and

  lperdereau

  committed
  195adba

  Copy full SHA for 195adba

• Better wait. Defer Close.

  

  athoune

  authored and

  lperdereau

  committed
  0dad75b

  Copy full SHA for 0dad75b

• Default config mode is tail.

  

  athoune

  authored and

  lperdereau

  committed
  24f67c0

  Copy full SHA for 24f67c0

• Fix: New request error handling.

  

  athoune

  authored and

  lperdereau

  committed
  e57150a

  Copy full SHA for e57150a

• Fix: path can be / or empty

  

  athoune

  authored and

  lperdereau

  committed
  1d7bce7

  Copy full SHA for 1d7bce7

• Fix: unreachable return

  

  athoune

  authored and

  lperdereau

  committed
  ae718e0

  Copy full SHA for ae718e0

• Forever loop over loki websocket can be stopped.

  

  athoune

  authored and

  lperdereau

  committed
  066d2a1

  Copy full SHA for 066d2a1

• Close the websocket.

  

  athoune

  authored and

  lperdereau

  committed
  3471ce0

  Copy full SHA for 3471ce0

• Don't buffer before reading JSON. JSON draining looks far better.

  

  athoune

  authored and

  lperdereau

  committed
  1c88584

  Copy full SHA for 1c88584

• Fix: it's ok to stop the connection.

  

  athoune

  authored and

  lperdereau

  committed
  caa7db0

  Copy full SHA for caa7db0

• Better error report, and more logical variable place.

  

  athoune

  authored and

  lperdereau

  committed
  473b64b

  Copy full SHA for 473b64b

• Websocket can be closed.

  

  athoune

  authored and

  lperdereau

  committed
  4bfb138

  Copy full SHA for 4bfb138

• Stop the loki tailing.

  

  athoune

  authored and

  lperdereau

  committed
  4bbe1c7

  Copy full SHA for 4bbe1c7

• Loki is now registered as an acquisition module.

  

  athoune

  authored and

  lperdereau

  committed
  4edd25f

  Copy full SHA for 4edd25f

• Fix: it's a StreamingAcquisition error, not an ugly copy/paste error from OneShotAcquisition function.

  

  athoune

  authored and

  lperdereau

  committed
  e76d58c

  Copy full SHA for e76d58c

• Fix: don't break the loop, retry.

  

  athoune

  authored and

  lperdereau

  committed
  be95db0

  Copy full SHA for be95db0

• use a dedicated package for loki queries

  

  blotus

  authored and

  lperdereau

  committed
  47d85e3

  Copy full SHA for 47d85e3

• fix potential null deref

  

  blotus

  authored and

  lperdereau

  committed
  3f56a07

  Copy full SHA for 3f56a07

• properly build URL

  

  blotus

  authored and

  lperdereau

  committed
  2195509

  Copy full SHA for 2195509

• linting

  

  blotus

  authored and

  lperdereau

  committed
  8f3a20b

  Copy full SHA for 8f3a20b

• fix: Update

  lperdereau

  committed
  3dadf68

  Copy full SHA for 3dadf68

• fix: Patch auth and since DSN

  lperdereau

  committed
  945a381

  Copy full SHA for 945a381

• fix: Add uniq id

  lperdereau

  committed
  784703a

  Copy full SHA for 784703a

• fix: Update auth yaml config

  lperdereau

  committed
  810f525

  Copy full SHA for 810f525

• fix: Add https to dsn

  lperdereau

  committed
  2017e6b

  Copy full SHA for 2017e6b

• feat: Add to detect test

  lperdereau

  committed
  9520670

  Copy full SHA for 9520670

• fix: Add loki readiness probe to CI

  lperdereau

  committed
  5acf6a8

  Copy full SHA for 5acf6a8

• fix: Path health command for loki

  lperdereau

  committed
  8d05565

  Copy full SHA for 8d05565

• fix: Patch loki acquisition

  lperdereau

  committed
  fc33f8d

  Copy full SHA for fc33f8d

• fix: Update go-cs-lib/cstest

  lperdereau

  committed
  a3e4199

  Copy full SHA for a3e4199

• fix: Update go.mod and go.sum

  lperdereau

  committed
  efc6213

  Copy full SHA for efc6213

• feat: Add delay for on tail request

  lperdereau

  committed
  e750412

  Copy full SHA for e750412

• feat: Refactor Tail and add metrics

  lperdereau

  committed
  a3eff54

  Copy full SHA for a3eff54

Commits on Oct 16, 2023

• Merge branch 'master' into loki

  buixor

  authored
  1a8c127

  Copy full SHA for 1a8c127

Commits on Oct 17, 2023

• improve bubble up errors and fix a few logging messages

  buixor

  committed
  755ca02

  Copy full SHA for 755ca02

• improve bubble up errors and fix a few logging messages

  buixor

  committed
  9341d3f

  Copy full SHA for 9341d3f

• Merge branch 'master' into loki

  buixor

  authored
  f39c61e

  Copy full SHA for f39c61e

Commits on Oct 18, 2023

• Merge branch 'master' into loki

  buixor

  authored
  a54090b

  Copy full SHA for a54090b

• use query_range instead of tail

  

  blotus

  authored and

  lperdereau

  committed
  5029450

  Copy full SHA for 5029450

• fix tests

  

  blotus

  authored and

  lperdereau

  committed
  4146fb1

  Copy full SHA for 4146fb1

• don't defer in a select

  

  blotus

  authored and

  lperdereau

  committed
  a6bfb05

  Copy full SHA for a6bfb05

• add support for modular ticker, and ensure we use the same tomb so acquisition failure can bubble up

  

  buixor

  authored and

  lperdereau

  committed
  d4e088a

  Copy full SHA for d4e088a

Commits on Oct 19, 2023

• just a bit of logging

  buixor

  committed
  593de90

  Copy full SHA for 593de90

Commits on Nov 22, 2023

• Merge branch 'master' into loki

  blotus

  authored
  e85d98e

  Copy full SHA for e85d98e

• skip tests on windows

  buixor

  committed
  0dab9eb

  Copy full SHA for 0dab9eb

• fix test

  buixor

  committed
  695a104

  Copy full SHA for 695a104