[kwlug-disc] Prometheus for multiple server monitoring?

[Jonathan Poole]

That can be tuned Khalid - have a look at these parameters.  Implement hysteresis by adding a for clause to delay the alert trigger, use keep_firing_for to smooth out transient drops or group alert manager notifications to reduce the spam.  It was a steep learning curve for me moving to the stack but it’s highly configurable and confusing - but once you nail down a few tactics it’ll come quick. 

Sent from my iPhone

On May 23, 2026, at 5:40 PM, Khalid Baheyeldin <kb at 2bits.com> wrote:


On Fri, May 22, 2026 at 9:19 PM Adam Glauser <adamglauser at gmail.com <mailto:adamglauser at gmail.com> > wrote:
In your case, I think the Targets are the black box-exporter services. They are responding, so are considered up, even though the SSH service they are monitoring is down (probe_status=0)

That makes perfect sense.
Blackbox Exporter is up, but whatever it is monitoring is down.

I had to struggle to customize the email messages, and finally got that figured out.
Though they are only HTML (not plain text).

Another thing is that it reports an outage immediately.
Nagios4 made sure that the outage persists before it reported it, tuning out network glitches and such. 

And Nagios4 had the concept of flapping, when a service keeps going down then up.
It is not reported as down, rather it is flagged as flapping. 
I can't find something like that in Prometheus. 

_______________________________________________

kwlug-disc mailing list

To unsubscribe, send an email to kwlug-disc-leave at kwlug.org

with the subject "unsubscribe", or email

kwlug-disc-owner at kwlug.org to contact a human being.



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.kwlug.org/pipermail/kwlug-disc_kwlug.org/attachments/20260523/f8bdc3b6/attachment.htm>