Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] Prometheus Metrics #1461

Closed
wants to merge 23 commits into from
Closed

[WIP] Prometheus Metrics #1461

wants to merge 23 commits into from

Commits on Sep 17, 2024

  1. add promethus client to server

    @binarycrayon
    binarycrayon committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    e7fb547 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Add basic config stats

    @binarycrayon
    binarycrayon committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    a5b4ef7 View commit details
    Browse the repository at this point in the history

  2. add metrics

    @blacker521
    blacker521 committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    11f3112 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #1 from blacker521/metrics 

    add metrics
    @binarycrayon
    binarycrayon authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    5888680 View commit details
    Browse the repository at this point in the history

  4. copyright and Code formatting with pre-commit

    @binarycrayon
    binarycrayon committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    1910268 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. a working setup for prometheus and grafana

    @binarycrayon
    binarycrayon committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    a0b5b39 View commit details
    Browse the repository at this point in the history

  2. label metric names with sglang prefix

    @binarycrayon
    binarycrayon committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    410c3b8 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2024

  1. Add default value to metrics types

    @binarycrayon
    binarycrayon committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    651b10a View commit details
    Browse the repository at this point in the history

  2. Add console logger

    @binarycrayon
    binarycrayon committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    36ab821 View commit details
    Browse the repository at this point in the history

  3. refactor to tp worker

    @binarycrayon
    binarycrayon committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    4772039 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into metrics

    @binarycrayon
    binarycrayon authored Sep 22, 2024
    Configuration menu
    Copy the full SHA
    98b3b24 View commit details
    Browse the repository at this point in the history

  5. integrate token usage metrics

    @binarycrayon
    binarycrayon committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    613d411 View commit details
    Browse the repository at this point in the history

  6. clean up code and revert unintended changes

    @binarycrayon
    binarycrayon committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    681976d View commit details
    Browse the repository at this point in the history

  7. code formatting

    @binarycrayon
    binarycrayon committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    ed4997e View commit details
    Browse the repository at this point in the history

  8. fix typo

    @binarycrayon
    binarycrayon committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    029316b View commit details
    Browse the repository at this point in the history

  9. grafana dashboard

    @binarycrayon
    binarycrayon committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    7cdbd85 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. adjust stats and log requests

    @binarycrayon
    binarycrayon committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    576007b View commit details
    Browse the repository at this point in the history

  2. revert the log print edit as this is out of the scope of this pr

    @binarycrayon
    binarycrayon committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    b3f6b26 View commit details
    Browse the repository at this point in the history

  3. update dashboard example

    @binarycrayon
    binarycrayon committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    e5434f2 View commit details
    Browse the repository at this point in the history

  4. add back missing gauge stats

    @binarycrayon
    binarycrayon committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    f663cde View commit details
    Browse the repository at this point in the history

  5. adjust how request stats are collected

    @binarycrayon
    binarycrayon committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    dcd946e View commit details
    Browse the repository at this point in the history

  6. adjust dashboard

    @binarycrayon
    binarycrayon committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    103040e View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2024

  1. Merge branch 'main' into metrics

    @binarycrayon
    binarycrayon authored Sep 28, 2024
    Configuration menu
    Copy the full SHA
    0e5c202 View commit details
    Browse the repository at this point in the history