Code

feat: Add model_load_time metric#397

Code

Merged

indrajit96 merged 17 commits intomaintriton-inference-server/core:mainfrom ibhosale_metricstriton-inference-server/core:ibhosale_metricsCopy head branch name to clipboardOct 21, 2024

+74-2

Commits

Commits on Oct 11, 2024

• Model Load time added

  indrajit96

  committed
  79adcfc

  Copy full SHA for 79adcfc

Commits on Oct 14, 2024

• Add nv_load_time per model P0 metric

  indrajit96

  committed
  09a13d5

  Copy full SHA for 09a13d5

• Fix typo and pre-commit

  indrajit96

  committed
  2c09ad1

  Copy full SHA for 2c09ad1

• Add unit to Metric

  indrajit96

  committed
  c34d91b

  Copy full SHA for c34d91b

• Review comments and unit fixed

  indrajit96

  committed
  b7986bd

  Copy full SHA for b7986bd

• Update TRITON_ENABLE_METRICS block

  indrajit96

  committed
  a0bf378

  Copy full SHA for a0bf378

• Pre-commit whitespace and comments fixed

  indrajit96

  committed
  9802664

  Copy full SHA for 9802664

Commits on Oct 15, 2024

• Add CalculateAndReportLoadTime to reduce size of OnLoadFinal

  indrajit96

  committed
  319bc04

  Copy full SHA for 319bc04

• Fix .h file

  indrajit96

  committed
  1b30d28

  Copy full SHA for 1b30d28

Commits on Oct 16, 2024

• Change name of metric to nv_model_load_duration_secs

  indrajit96

  committed
  867716d

  Copy full SHA for 867716d

Commits on Oct 17, 2024

• Fix review comments

  indrajit96

  committed
  c592506

  Copy full SHA for c592506

• Move location of metric reporting to fix double counting in multiple versions

  indrajit96

  committed
  3952575

  Copy full SHA for 3952575

• Add if def

  indrajit96

  committed
  89c0ca4

  Copy full SHA for 89c0ca4

Commits on Oct 18, 2024

• Fix version issues

  indrajit96

  committed
  aaaa478

  Copy full SHA for aaaa478

• Guard caller of ReportModelLoadTime

  indrajit96

  committed
  56244ae

  Copy full SHA for 56244ae

• Merge branch 'main' into ibhosale_metrics

  indrajit96

  authored
  d78b4ff

  Copy full SHA for d78b4ff

Commits on Oct 19, 2024

• Update CalculateAndReportLoadTime() signature

  indrajit96

  committed
  121120d

  Copy full SHA for 121120d