Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix 30 seconds delay issue #156

Merged
merged 10 commits into from
Sep 4, 2023
Merged

Conversation

CharityKathure
Copy link
Contributor

@CharityKathure CharityKathure commented Aug 21, 2023

Description

The container output is 30 seconds behind the contents of the file causing problems when viewing the container output through Azure Log Analytics, as Log Analytics gets an inaccurate "Time-Generated" timestamp, making ordering in Log Analytics wrong, therefore making viewing the logs and troubleshooting confusing and very difficult.

image

Change/ Fix

Reduce waitable time from 30 seconds

Testing

  • Deploy the new binary after change

  • Run this query in log analytics:

ContainerLog | where ContainerID in ('58b89a9a51a97a77cb9e0bcf5326ce326bcfc422cf96655fc5fced1374f2e73f') | extend LoglineEntry = parse_json(LogEntry) | extend LogEntryDetails = parse_json(LoglineEntry.LogEntry) | extend LogSource = LoglineEntry.Source | extend InFileDate = case(LogSource contains "File", todatetime(substring(LogEntryDetails.Logline, 0, 19)), LogEntryDetails.Time) | project LogSource, TimeGenerated, InFileDate, TimeDifference = toint(datetime_diff('second',TimeGenerated, InFileDate)), LogEntryDetails, LogEntry | where InFileDate != "" and LogSource contains "File" | distinct TimeGenerated, InFileDate;

Testing Results:
Log analytics timestamp shows no delay
image

@CharityKathure CharityKathure changed the title User/ckathure/fix 30sec delay Fix 30 seconds delay issue Aug 21, 2023
@CharityKathure CharityKathure linked an issue Aug 21, 2023 that may be closed by this pull request
@CharityKathure CharityKathure marked this pull request as ready for review August 29, 2023 01:46
Copy link
Member

@profnandaa profnandaa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't know why the initial one was set to 30 seconds wait; there could have been a reason. Perhaps we can consider making this configurable.

LogMonitor/src/LogMonitor/LogFileMonitor.cpp Show resolved Hide resolved
profnandaa
profnandaa previously approved these changes Aug 29, 2023
@CharityKathure CharityKathure merged commit 1632af0 into main Sep 4, 2023
7 checks passed
CharityKathure added a commit that referenced this pull request Dec 7, 2023
* reduce file monitor wait time

---------

Co-authored-by: Charity Kathure <ckathure@microsoft.com>
CharityKathure added a commit that referenced this pull request Dec 7, 2023
* identify the ProviderGuid failing with 1168

* Onboard repo to Secure Development Tools Azure DevOps (#152)

* resolve c:// monitor fix merge conflicts

* Fix 30 seconds delay issue (#156)

* reduce file monitor wait time

* resolve event log failure fix merge conflicts

---------

Co-authored-by: Bob Sira <sbobfitz2@gmail.com>
Co-authored-by: Tina Murimi <christine.murimi@gmail.com>
Co-authored-by: Charity Kathure <ckathure@microsoft.com>
@CharityKathure CharityKathure deleted the user/ckathure/fix-30sec-delay branch May 8, 2024 13:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] 30 second delay
4 participants