Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Configure anomaly detection time shift using scheduled events #111634

Closed
valeriy42 opened this issue Aug 6, 2024 · 1 comment
Closed

[ML] Configure anomaly detection time shift using scheduled events #111634

valeriy42 opened this issue Aug 6, 2024 · 1 comment
Assignees
Labels
>enhancement :ml Machine learning Team:ML Meta label for the ML team v9.0.0

Comments

@valeriy42
Copy link
Contributor

Description

Daylight saving time events are causing a burst of false positives in anomaly detection jobs due to a sudden time shift. To remedy the situation, we allow users to configure an explicit time shift for detectors using customer_rule action force_time_shift implemented in #110974.

However, since the DST events occur regularly and multiple jobs are usually affected, we need to allow users to control the explicit time shift using scheduled events.

To this end, we need to extend the POST calendars API to allow fine grade configuration:

POST _ml/calendars/dst-germany
{
	"events" : [
    	{"description": "Summer 2025 ", "start_time": 1513814400000, "end_time": 1513818000000, skip_results: true, skip_model_update: false, force_time_shift:3600},
{"description": "Winter 2025", "start_time": 1514160000000, "end_time": 1514163600000, skip_results: true, skip_model_update: false, force_time_shift:-3600}
	]
}

Internally, the calendar events should be converted to detection rules as it happens already, but with finer configuration.

Additionally, the detection rules corresponding to the past calendar events should be removed from the job configuration, in order to keep the configuration of long-running jobs slim.

@valeriy42 valeriy42 added >enhancement needs:triage Requires assignment of a team area label :ml Machine learning v8.16.0 and removed needs:triage Requires assignment of a team area label labels Aug 6, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

@elasticsearchmachine elasticsearchmachine added the Team:ML Meta label for the ML team label Aug 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement :ml Machine learning Team:ML Meta label for the ML team v9.0.0
Projects
None yet
Development

No branches or pull requests

4 participants