Alerts Enhancements : Skip alert & tolernaces about openobserve HOT 3 OPEN

I need a clarification for the 2nd case, is it alerts or reports? I cannot find an option to schedule alerts based on cron.

@iamsiddhant05 Scheduling alerts based on cron is actually possible through API, it is not yet included in the frontend though. For ref - #2935. I think, it should be done for both the alerts and reports.

from openobserve.

For the first case, the steps seem to be straightforward.

1. Check the alert queue if there is a pending alert of the same id
2. If found, pull it out of the queue, audit log it, and add the new alert.
3. If not found continue to add the new alert.

I need a clarification for the 2nd case, is it alerts or reports? I cannot find an option to schedule alerts based on cron.

from openobserve.

@oasisk I am thinking this issue, we can simple add a timeout for the search request then it will auto canceled if it over x minutes. for example:

1. the alert run every 5 minutes.
2. we set the req.timeout=300 (s) when we fire the search request. https://github.com/openobserve/openobserve/blob/main/src/service/alerts/mod.rs#L467
3. it will auto canceled if it over 5 mins.

from openobserve.