Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Gcplog targetmanager #3083

Merged
merged 22 commits into from
Jan 19, 2021
Merged

Gcplog targetmanager #3083

merged 22 commits into from
Jan 19, 2021

Commits on Jan 18, 2021

  1. Add new target manager(PubsubTarget) for promtail 

    Lets you to scrape log entries from pubsub topic and
send it to lok

- Basic `Target` and `TargetManager`
- Minimum config to make it work
    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    5919ad4 View commit details
    Browse the repository at this point in the history

  2. make the receive loop on pubsub manager work

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    ce9ebcb View commit details
    Browse the repository at this point in the history

  3. Add mmock pubsub server for testing

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    17ee7ee View commit details
    Browse the repository at this point in the history

  4. Remove debugging logs

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    47a34d2 View commit details
    Browse the repository at this point in the history

  5. Minor changes to messages pushing into loki

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    f82477d View commit details
    Browse the repository at this point in the history

  6. Basic formatter to convert GCP log entry to loki log entry

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    9b7e55a View commit details
    Browse the repository at this point in the history

  7. Reverting go.mod, go.sum and vendors to master branch

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    3e8aee6 View commit details
    Browse the repository at this point in the history

  8. only pubsub dependencies

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    0065f8f View commit details
    Browse the repository at this point in the history

  9. rebuild proto

    @slim-bean @kavirajk
    slim-bean authored and kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    1d515ae View commit details
    Browse the repository at this point in the history

  10. Fix protobuf diffs

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    4fdeae0 View commit details
    Browse the repository at this point in the history

  11. Remove debug printfs

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    90fd495 View commit details
    Browse the repository at this point in the history

  12. Add basic formatter for GCP log entry 

    - Create uniq label to create stream without out-of-order timestamp
- extract instance id and timestamp from log entry
    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    9fd19fd View commit details
    Browse the repository at this point in the history

  13. - Small fixes to formatter 

    - Config changes on pubsub manager for testing
    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    293b3a1 View commit details
    Browse the repository at this point in the history

  14. - Formatting changes 

    - Rewrite timestamp to avoid out-of-order errors on loki
- Minor config changes to Pubsub Target manager
    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    5f55541 View commit details
    Browse the repository at this point in the history

  15. Fix target formatter tests

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    e6f534b View commit details
    Browse the repository at this point in the history

  16. PR remarks

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    a4911cd View commit details
    Browse the repository at this point in the history

  17. Minor refactoring and following changes 

    - Rename Pubsub* entities to Gcplog*
- Rename pubsub package into gcplog
- Add flag `KeepIncomingTimestamp` to toggle between either keeping incoming timestamps or rewriting with current timestamp
- Tests for gcplog target
- Docs and basic metrics to gcplog target
    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    8f2a6d1 View commit details
    Browse the repository at this point in the history

  18. Add docs for cloud configure for gcplog.

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    2778df9 View commit details
    Browse the repository at this point in the history

  19. Add docs for cloud configure for gcplog.

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    ba33ee5 View commit details
    Browse the repository at this point in the history

  20. Review feedback

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    2da55a9 View commit details
    Browse the repository at this point in the history

  21. Checkin generated files

    @kavirajk
    kavirajk committed Jan 18, 2021
    Configuration menu
    Copy the full SHA
    8a0851b View commit details
    Browse the repository at this point in the history

Commits on Jan 19, 2021

  1. Making linters happy

    @kavirajk
    kavirajk committed Jan 19, 2021
    Configuration menu
    Copy the full SHA
    7d0a4c7 View commit details
    Browse the repository at this point in the history