Alert History
Last Updated: Sat Jun 8 11:20:39 GMT 2024
Nagios® Core™ 4.4.9 - www.nagios.org
Logged in as guest
View Status Detail For All Hosts
View Notifications For All Hosts
All Hosts and Services

Earlier Archive
Earlier Archive
Log File Navigation
Wed Jun 5 00:00:00 GMT 2024
to
Thu Jun 6 00:00:00 GMT 2024		 More Recent Archive
More Recent Archive

File: /var/log/nagios/archives/nagios-06-06-2024-00.log
State type options:
History detail level for all hosts:
Hide Flapping Alerts
Hide Downtime Alerts
Hide Process Messages
Older Entries First


June 05, 2024 23:00

Service Ok[06-05-2024 23:56:04] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Service Ok[06-05-2024 23:55:57] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;3;SSH OK - OpenSSH_9.3 (protocol 2.0)
Service Critical[06-05-2024 23:55:04] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 23:54:56] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 23:53:46] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Up[06-05-2024 23:16:15] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok[06-05-2024 23:16:15] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Host Down[06-05-2024 23:15:45] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 23:15:15] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 23:13:45] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Service Critical[06-05-2024 23:12:44] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.

June 05, 2024 22:00

Service Ok[06-05-2024 22:52:14] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;HARD;1;PROCS OK: 0 processes with STATE = Z
Host Up[06-05-2024 22:44:35] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-05-2024 22:43:36] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 22:42:49] SERVICE ALERT: bvmhost-p09-03.iad2.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Service Critical[06-05-2024 22:42:44] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-05-2024 22:42:06] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 22:42:05] SERVICE ALERT: bvmhost-p09-03.iad2.fedoraproject.org;Total Processes;OK;SOFT;2;PROCS OK: 5412 processes
Service Critical[06-05-2024 22:41:49] SERVICE ALERT: bvmhost-p09-03.iad2.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CRITICAL - Plugin timed out
Service Critical[06-05-2024 22:41:01] SERVICE ALERT: bvmhost-p09-03.iad2.fedoraproject.org;Total Processes;CRITICAL;SOFT;1;CRITICAL - Plugin timed out
Host Up[06-05-2024 22:26:05] HOST ALERT: buildhw-a64-06.iad2.fedoraproject.org;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 0.36 ms
Host Up[06-05-2024 22:26:05] HOST ALERT: buildhw-a64-05.iad2.fedoraproject.org;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 0.32 ms
Host Up[06-05-2024 22:26:04] HOST ALERT: buildhw-a64-04.iad2.fedoraproject.org;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 0.34 ms
Host Up[06-05-2024 22:26:04] HOST ALERT: buildhw-a64-03.iad2.fedoraproject.org;UP;HARD;1;PING OK - Packet loss = 0%, RTA = 0.26 ms
Program Start[06-05-2024 22:24:30] Nagios 4.4.9 starting... (PID=122316)
Program End[06-05-2024 22:24:30] Caught SIGTERM, shutting down...
Program End[06-05-2024 22:24:30] Caught SIGTERM, shutting down...
Program End[06-05-2024 22:24:30] Caught SIGTERM, shutting down...
Service Ok[06-05-2024 22:22:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Service Critical[06-05-2024 22:21:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Up[06-05-2024 22:20:33] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok[06-05-2024 22:20:26] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Host Down[06-05-2024 22:19:56] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 22:19:26] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host stopped flapping[06-05-2024 22:03:52] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)

June 05, 2024 21:00

Service Ok[06-05-2024 21:55:25] SERVICE ALERT: bvmhost-p09-02.iad2.fedoraproject.org;Total Processes;OK;SOFT;2;PROCS OK: 3289 processes
Service Ok[06-05-2024 21:54:59] SERVICE ALERT: bvmhost-p09-02.iad2.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Service Critical[06-05-2024 21:54:25] SERVICE ALERT: bvmhost-p09-02.iad2.fedoraproject.org;Total Processes;CRITICAL;SOFT;1;CRITICAL - Plugin timed out
Service Critical[06-05-2024 21:53:59] SERVICE ALERT: bvmhost-p09-02.iad2.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CRITICAL - Plugin timed out
Service Ok[06-05-2024 21:49:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;OK;SOFT;3;PROCS OK: 541 processes
Service Critical[06-05-2024 21:48:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;CRITICAL;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-05-2024 21:48:51] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host started flapping[06-05-2024 21:48:51] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STARTED; Host appears to have started flapping (22.8% change > 20.0% threshold)
Service Ok[06-05-2024 21:48:51] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;2;0 mail(s) in queue
Host Down[06-05-2024 21:48:21] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 21:48:16] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;3;SSH OK - OpenSSH_9.3 (protocol 2.0)
Service Critical[06-05-2024 21:47:51] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 21:47:28] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 21:47:16] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Host Up[06-05-2024 21:47:15] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-05-2024 21:46:15] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 21:46:06] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-05-2024 21:40:19] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;OK;SOFT;2;HTTP OK: Status line output matched "HTTP/1.0 401 Unauthorized" - 303 bytes in 0.005 second response time
Service Critical[06-05-2024 21:39:19] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Up[06-05-2024 21:33:39] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.52 ms
Host Down[06-05-2024 21:32:38] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 21:31:26] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 21:30:14] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 21:20:03] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.40 ms
Host Down[06-05-2024 21:19:02] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 21:17:50] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 21:16:38] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%

June 05, 2024 20:00

Host Up[06-05-2024 20:56:27] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.60 ms
Host started flapping[06-05-2024 20:56:27] HOST FLAPPING ALERT: buildhw-a64-23.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (21.4% change > 20.0% threshold)
Host Down[06-05-2024 20:55:26] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:54:14] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:53:02] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 20:43:27] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 102208 bytes in 0.492 second response time
Service Ok[06-05-2024 20:43:16] SERVICE ALERT: worker06.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 101893 bytes in 0.322 second response time
Service Ok[06-05-2024 20:43:15] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 102126 bytes in 2.848 second response time
Service Ok[06-05-2024 20:43:13] SERVICE ALERT: proxy09.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 102450 bytes in 1.566 second response time
Service Ok[06-05-2024 20:43:12] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 102450 bytes in 1.527 second response time
Service Ok[06-05-2024 20:43:11] SERVICE ALERT: worker05.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 102135 bytes in 0.396 second response time
Service Critical[06-05-2024 20:42:27] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.121 second response time
Service Critical[06-05-2024 20:42:16] SERVICE ALERT: worker06.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.005 second response time
Service Critical[06-05-2024 20:42:12] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Proxy Error - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 781 bytes in 6.535 second response time
Service Critical[06-05-2024 20:42:11] SERVICE ALERT: proxy09.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 4.606 second response time
Service Critical[06-05-2024 20:42:11] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 24.479 second response time
Service Critical[06-05-2024 20:42:11] SERVICE ALERT: worker05.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 6.173 second response time
Service Ok[06-05-2024 20:40:02] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 103412 bytes in 1.122 second response time
Service Ok[06-05-2024 20:39:58] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 103097 bytes in 5.811 second response time
Service Ok[06-05-2024 20:39:57] SERVICE ALERT: proxy36.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 103413 bytes in 6.509 second response time
Service Ok[06-05-2024 20:39:54] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 103612 bytes in 2.099 second response time
Service Ok[06-05-2024 20:39:54] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 103296 bytes in 1.656 second response time
Service Critical[06-05-2024 20:39:00] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Proxy Error - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 781 bytes in 15.452 second response time
Service Critical[06-05-2024 20:38:52] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 5.318 second response time
Service Critical[06-05-2024 20:38:52] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 13.492 second response time
Service Critical[06-05-2024 20:38:52] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 14.634 second response time
Service Critical[06-05-2024 20:38:51] SERVICE ALERT: proxy36.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 4.608 second response time
Host Down[06-05-2024 20:36:04] HOST ALERT: buildhw-a64-06.iad2.fedoraproject.org;DOWN;HARD;8;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:36:04] HOST ALERT: buildhw-a64-05.iad2.fedoraproject.org;DOWN;HARD;8;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:36:03] HOST ALERT: buildhw-a64-04.iad2.fedoraproject.org;DOWN;HARD;8;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:36:03] HOST ALERT: buildhw-a64-03.iad2.fedoraproject.org;DOWN;HARD;8;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 20:34:57] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 101352 bytes in 2.844 second response time
Service Ok[06-05-2024 20:34:55] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 101351 bytes in 0.612 second response time
Service Ok[06-05-2024 20:34:55] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 101352 bytes in 2.645 second response time
Service Ok[06-05-2024 20:34:54] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 101356 bytes in 1.201 second response time
Host Down[06-05-2024 20:34:52] HOST ALERT: buildhw-a64-06.iad2.fedoraproject.org;DOWN;SOFT;7;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:34:52] HOST ALERT: buildhw-a64-05.iad2.fedoraproject.org;DOWN;SOFT;7;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:34:51] HOST ALERT: buildhw-a64-04.iad2.fedoraproject.org;DOWN;SOFT;7;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:34:51] HOST ALERT: buildhw-a64-03.iad2.fedoraproject.org;DOWN;SOFT;7;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 20:34:41] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 100383 bytes in 0.525 second response time
Service Ok[06-05-2024 20:34:41] SERVICE ALERT: proxy04.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 100383 bytes in 0.497 second response time
Service Ok[06-05-2024 20:34:41] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 100389 bytes in 0.445 second response time
Service Ok[06-05-2024 20:34:41] SERVICE ALERT: worker01.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 100068 bytes in 0.342 second response time
Service Critical[06-05-2024 20:33:54] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 10.639 second response time
Service Critical[06-05-2024 20:33:54] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.663 second response time
Service Critical[06-05-2024 20:33:53] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 600 bytes in 13.395 second response time
Service Critical[06-05-2024 20:33:52] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 3.149 second response time
Service Critical[06-05-2024 20:33:41] SERVICE ALERT: proxy04.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 3.081 second response time
Service Critical[06-05-2024 20:33:41] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 9.996 second response time
Service Critical[06-05-2024 20:33:41] SERVICE ALERT: worker01.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 3.130 second response time
Service Critical[06-05-2024 20:33:41] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 600 bytes in 2.551 second response time
Host Down[06-05-2024 20:33:40] HOST ALERT: buildhw-a64-06.iad2.fedoraproject.org;DOWN;SOFT;6;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:33:40] HOST ALERT: buildhw-a64-05.iad2.fedoraproject.org;DOWN;SOFT;6;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:33:39] HOST ALERT: buildhw-a64-04.iad2.fedoraproject.org;DOWN;SOFT;6;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:33:39] HOST ALERT: buildhw-a64-03.iad2.fedoraproject.org;DOWN;SOFT;6;PING CRITICAL - Packet loss = 100%
Service Critical[06-05-2024 20:32:31] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 3.892 second response time
Host Down[06-05-2024 20:32:28] HOST ALERT: buildhw-a64-05.iad2.fedoraproject.org;DOWN;SOFT;5;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:32:28] HOST ALERT: buildhw-a64-06.iad2.fedoraproject.org;DOWN;SOFT;5;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:32:27] HOST ALERT: buildhw-a64-04.iad2.fedoraproject.org;DOWN;SOFT;5;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:32:27] HOST ALERT: buildhw-a64-03.iad2.fedoraproject.org;DOWN;SOFT;5;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:31:16] HOST ALERT: buildhw-a64-06.iad2.fedoraproject.org;DOWN;SOFT;4;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:31:16] HOST ALERT: buildhw-a64-05.iad2.fedoraproject.org;DOWN;SOFT;4;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:31:15] HOST ALERT: buildhw-a64-04.iad2.fedoraproject.org;DOWN;SOFT;4;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:31:15] HOST ALERT: buildhw-a64-03.iad2.fedoraproject.org;DOWN;SOFT;4;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:30:04] HOST ALERT: buildhw-a64-06.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:30:04] HOST ALERT: buildhw-a64-05.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:30:03] HOST ALERT: buildhw-a64-04.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:30:03] HOST ALERT: buildhw-a64-03.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:28:52] HOST ALERT: buildhw-a64-06.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:28:52] HOST ALERT: buildhw-a64-05.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:28:51] HOST ALERT: buildhw-a64-03.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:28:51] HOST ALERT: buildhw-a64-04.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:27:40] HOST ALERT: buildhw-a64-06.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:27:40] HOST ALERT: buildhw-a64-05.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:27:39] HOST ALERT: buildhw-a64-04.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:27:39] HOST ALERT: buildhw-a64-03.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Program Start[06-05-2024 20:27:27] Nagios 4.4.9 starting... (PID=29596)
Program End[06-05-2024 20:27:27] Caught SIGTERM, shutting down...
Program End[06-05-2024 20:27:27] Caught SIGTERM, shutting down...
Host Up[06-05-2024 20:17:51] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.43 ms
Host Down[06-05-2024 20:16:50] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;4;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:15:38] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:14:26] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 20:13:14] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 20:04:36] SERVICE ALERT: proxy11.fedoraproject.org;http-waiverdb;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5974 bytes in 5.743 second response time
Service Warning[06-05-2024 20:03:30] SERVICE ALERT: proxy11.fedoraproject.org;http-waiverdb;WARNING;SOFT;1;HTTP WARNING: HTTP/1.1 200 OK - 5974 bytes in 37.333 second response time

June 05, 2024 19:00

Host stopped flapping[06-05-2024 19:43:01] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Up[06-05-2024 19:15:52] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-05-2024 19:14:45] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.

June 05, 2024 18:00

Host Up[06-05-2024 18:19:15] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-05-2024 18:18:15] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 18:12:00] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi2;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 14236 bytes in 0.024 second response time
Service Critical[06-05-2024 18:11:00] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi2;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Warning[06-05-2024 18:09:19] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi2;WARNING;SOFT;1;HTTP WARNING: HTTP/1.1 200 OK - 14239 bytes in 34.032 second response time
Host Up[06-05-2024 18:08:20] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.61 ms
Host Up[06-05-2024 18:08:01] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.67 ms
Host started flapping[06-05-2024 18:08:01] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.9% change > 20.0% threshold)
Host Down[06-05-2024 18:07:19] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 18:07:00] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%

June 05, 2024 17:00

Service Ok[06-05-2024 17:59:25] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk Space /boot;OK;SOFT;3;DISK OK - free space: /boot 702 MiB (73.19% inode=100%):
Service Ok[06-05-2024 17:58:54] SERVICE ALERT: bvmhost-p09-03.iad2.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Service Ok[06-05-2024 17:58:46] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Service Critical[06-05-2024 17:58:25] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk Space /boot;CRITICAL;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 17:57:54] SERVICE ALERT: bvmhost-p09-03.iad2.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 17:57:45] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-05-2024 17:56:57] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.75 ms
Service Critical[06-05-2024 17:56:55] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk Space /boot;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-05-2024 17:56:49] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.86 ms
Host Down[06-05-2024 17:55:56] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 17:55:48] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 17:48:03] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.36 ms
Host Down[06-05-2024 17:47:02] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 17:31:14] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Service Critical[06-05-2024 17:30:14] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.

June 05, 2024 16:00

Service Ok[06-05-2024 16:16:21] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;2;0 mail(s) in queue
Service Ok[06-05-2024 16:16:15] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Host Up[06-05-2024 16:15:56] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-05-2024 16:15:45] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 16:15:21] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 16:15:15] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.

June 05, 2024 15:00

Service Ok[06-05-2024 15:53:51] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;2;0 mail(s) in queue
Service Ok[06-05-2024 15:53:45] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Service Critical[06-05-2024 15:52:51] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 15:52:45] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 15:47:09] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;OK;HARD;1;RABBITMQ_QUEUE OK - messages OK (0) messages_ready OK (0) messages_unacknowledged OK (0) consumers OK (1) All queues under the thresholds
Host stopped flapping[06-05-2024 15:42:21] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Warning[06-05-2024 15:37:09] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;WARNING;HARD;3;RABBITMQ_QUEUE WARNING - messages WARNING (36), messages_ready OK (26) messages_unacknowledged OK (10) consumers OK (1)
Service Ok[06-05-2024 15:36:12] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue amqp_to_zmq;OK;SOFT;2;RABBITMQ_QUEUE OK - messages OK (0) messages_ready OK (0) messages_unacknowledged OK (0) consumers OK (1) All queues under the thresholds
Service Warning[06-05-2024 15:36:08] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;WARNING;SOFT;2;RABBITMQ_QUEUE WARNING - messages WARNING (77), messages_ready OK (67) messages_unacknowledged OK (10) consumers OK (1)
Service Critical[06-05-2024 15:35:12] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue amqp_to_zmq;CRITICAL;SOFT;1;RABBITMQ_QUEUE CRITICAL - messages CRITICAL (138), messages_ready OK (113) messages_unacknowledged OK (25) consumers OK (1)
Service Warning[06-05-2024 15:35:08] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;WARNING;SOFT;1;RABBITMQ_QUEUE WARNING - messages WARNING (57), messages_ready OK (47) messages_unacknowledged OK (10) consumers OK (1)
Host Up[06-05-2024 15:24:37] HOST ALERT: internetx-gw;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 101.46 ms
Host Down[06-05-2024 15:23:35] HOST ALERT: internetx-gw;DOWN;SOFT;1;PING CRITICAL - Packet loss = 66%, RTA = 5165.30 ms
Service Ok[06-05-2024 15:22:48] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 248.98 ms
Host Up[06-05-2024 15:21:51] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.27 ms
Service Warning[06-05-2024 15:21:42] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 245.65 ms
Host Up[06-05-2024 15:21:28] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host started flapping[06-05-2024 15:21:28] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STARTED; Host appears to have started flapping (21.2% change > 20.0% threshold)
Host Down[06-05-2024 15:20:50] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 15:20:28] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-05-2024 15:19:38] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 15:15:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;OK;SOFT;2;PROCS OK: 537 processes
Service Critical[06-05-2024 15:14:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 15:14:54] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;OK;SOFT;3;The last build 7532722 for copr-ping succeeded, took 874 seconds, elapsed since the last stop 18 seconds
Service Warning[06-05-2024 15:13:54] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;WARNING;SOFT;2;2421 seconds since the last successful build, allowed 2160 seconds
Service Warning[06-05-2024 15:12:54] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;WARNING;SOFT;1;2361 seconds since the last successful build, allowed 2160 seconds
Service Ok[06-05-2024 15:11:21] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;2;0 mail(s) in queue
Host Up[06-05-2024 15:11:15] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok[06-05-2024 15:11:15] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Host Down[06-05-2024 15:10:45] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 15:10:21] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 15:10:15] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 15:09:00] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 235.82 ms
Service Warning[06-05-2024 15:07:54] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 235.78 ms
Service Ok[06-05-2024 15:05:45] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 98380 bytes in 1.272 second response time
Service Critical[06-05-2024 15:04:43] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Proxy Error - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 781 bytes in 0.438 second response time
Host stopped flapping[06-05-2024 15:04:27] HOST FLAPPING ALERT: buildhw-a64-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)

June 05, 2024 14:00

Service Ok[06-05-2024 14:58:45] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Service Critical[06-05-2024 14:57:45] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 14:56:46] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 235.81 ms
Host stopped flapping[06-05-2024 14:55:45] HOST FLAPPING ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Warning[06-05-2024 14:55:40] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 235.80 ms
Host stopped flapping[06-05-2024 14:50:19] HOST FLAPPING ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host stopped flapping[06-05-2024 14:50:19] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok[06-05-2024 14:44:32] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 239.36 ms
Service Warning[06-05-2024 14:43:24] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 239.55 ms
Service Ok[06-05-2024 14:31:41] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;HARD;1;PING OK - Packet loss = 16%, RTA = 259.86 ms
Host stopped flapping[06-05-2024 14:27:44] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STOPPED; Host appears to have stopped flapping (4.3% change < 5.0% threshold)
Service Ok[06-05-2024 14:22:16] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 241.90 ms
Service Warning[06-05-2024 14:21:34] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;HARD;3;PING WARNING - Packet loss = 28%, RTA = 246.26 ms
Service Warning[06-05-2024 14:21:11] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 239.73 ms
Host stopped flapping[06-05-2024 14:20:37] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Warning[06-05-2024 14:20:26] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;2;PING WARNING - Packet loss = 28%, RTA = 244.57 ms
Service Warning[06-05-2024 14:19:19] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 246.04 ms
Service Ok[06-05-2024 14:18:44] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Service Ok[06-05-2024 14:18:40] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;OK;SOFT;2;DISK OK - free space: / 92699 MiB (91.50% inode=100%):
Service Critical[06-05-2024 14:17:44] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 14:17:40] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-05-2024 14:17:34] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host started flapping[06-05-2024 14:17:34] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STARTED; Host appears to have started flapping (21.8% change > 20.0% threshold)
Host Down[06-05-2024 14:16:26] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 14:16:14] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Host Down[06-05-2024 14:15:43] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 14:15:13] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-05-2024 14:12:26] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Up[06-05-2024 14:12:08] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.78 ms
Host Down[06-05-2024 14:11:26] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-05-2024 14:11:07] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 14:10:03] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 240.01 ms
Service Warning[06-05-2024 14:08:56] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 239.93 ms
Service Ok[06-05-2024 14:07:47] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;3;PING OK - Packet loss = 0%, RTA = 239.93 ms
Service Warning[06-05-2024 14:06:39] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;2;PING WARNING - Packet loss = 44%, RTA = 239.89 ms
Service Warning[06-05-2024 14:05:29] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 239.82 ms

June 05, 2024 13:00

Service Ok[06-05-2024 13:54:21] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 239.81 ms
Service Warning[06-05-2024 13:53:13] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 239.80 ms
Host Up[06-05-2024 13:29:27] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.44 ms
Host Down[06-05-2024 13:28:26] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 13:20:45] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.68 ms
Host started flapping[06-05-2024 13:20:45] HOST FLAPPING ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (20.9% change > 20.0% threshold)
Host Down[06-05-2024 13:19:44] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 25%, RTA = 5438.12 ms
Host Up[06-05-2024 13:18:15] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.30 ms
Host started flapping[06-05-2024 13:18:15] HOST FLAPPING ALERT: buildhw-a64-23.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (21.3% change > 20.0% threshold)
Host Down[06-05-2024 13:17:14] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 13:16:15] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Host Down[06-05-2024 13:16:02] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 13:15:56] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-05-2024 13:15:44] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-05-2024 13:15:19] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.60 ms
Host started flapping[06-05-2024 13:15:19] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (21.3% change > 20.0% threshold)
Host Up[06-05-2024 13:15:19] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.80 ms
Host started flapping[06-05-2024 13:15:19] HOST FLAPPING ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (24.2% change > 20.0% threshold)
Service Critical[06-05-2024 13:15:14] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-05-2024 13:14:50] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 13:14:18] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 62%, RTA = 6310.93 ms
Host Down[06-05-2024 13:14:18] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 37%, RTA = 5609.63 ms
Service Ok[06-05-2024 13:10:35] SERVICE ALERT: proxy14.fedoraproject.org;Check fedmsg-gateway consumers exceptions;OK;SOFT;2;OK: fedmsg consumer GatewayConsumer exceptions value is 0
Service Critical[06-05-2024 13:09:34] SERVICE ALERT: proxy14.fedoraproject.org;Check fedmsg-gateway consumers exceptions;CRITICAL;SOFT;1;CHECK_NRPE: Error - Could not connect to 8.43.85.67: Connection reset by peer
Host Up[06-05-2024 13:09:11] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.01 ms
Host Down[06-05-2024 13:08:10] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 13:08:10] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.95 ms
Host Down[06-05-2024 13:07:09] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 13:05:57] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%

June 05, 2024 12:00

Service Ok[06-05-2024 12:48:10] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 245.85 ms
Service Warning[06-05-2024 12:47:04] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 247.58 ms
Host Up[06-05-2024 12:45:37] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.91 ms
Host started flapping[06-05-2024 12:45:37] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (22.9% change > 20.0% threshold)
Host Down[06-05-2024 12:44:36] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 12:34:39] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.60 ms
Host stopped flapping[06-05-2024 12:34:34] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)
Host Down[06-05-2024 12:33:38] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 12:32:26] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 12:31:14] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 12:28:31] HOST ALERT: internetx-gw;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 97.19 ms
Host Down[06-05-2024 12:27:30] HOST ALERT: internetx-gw;DOWN;SOFT;1;PING CRITICAL - Packet loss = 75%, RTA = 6401.45 ms
Host Up[06-05-2024 12:14:37] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.70 ms
Host Up[06-05-2024 12:14:35] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host started flapping[06-05-2024 12:14:35] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STARTED; Host appears to have started flapping (21.7% change > 20.0% threshold)
Host Down[06-05-2024 12:14:34] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-05-2024 12:14:25] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.90 ms
Host Up[06-05-2024 12:14:23] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 91%, RTA = 0.92 ms
Host Down[06-05-2024 12:13:36] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 45%, RTA = 8255.86 ms
Host Down[06-05-2024 12:13:24] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 12:13:11] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 12:12:25] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 12:05:04] SERVICE ALERT: copr-be.aws.fedoraproject.org;http-copr.fedorainfracloud.org;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 25499 bytes in 0.283 second response time
Host Up[06-05-2024 12:04:04] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Unknown[06-05-2024 12:04:03] SERVICE ALERT: copr-be.aws.fedoraproject.org;http-copr.fedorainfracloud.org;UNKNOWN;SOFT;1;check_http: Invalid hostname/address - copr.fedorainfracloud.org
Host Down[06-05-2024 12:03:04] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.

June 05, 2024 11:00

Service Ok[06-05-2024 11:54:08] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;OK;SOFT;3;RABBITMQ_QUEUE OK - messages OK (0) messages_ready OK (0) messages_unacknowledged OK (0) consumers OK (1) All queues under the thresholds
Service Warning[06-05-2024 11:53:07] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;WARNING;SOFT;2;RABBITMQ_QUEUE WARNING - messages WARNING (16), messages_ready OK (6) messages_unacknowledged OK (10) consumers OK (1)
Service Warning[06-05-2024 11:52:07] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;WARNING;SOFT;1;RABBITMQ_QUEUE WARNING - messages WARNING (57), messages_ready OK (47) messages_unacknowledged OK (10) consumers OK (1)
Service stopped flapping[06-05-2024 11:50:53] SERVICE FLAPPING ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;STOPPED; Service appears to have stopped flapping (3.9% change < 5.0% threshold)
Host stopped flapping[06-05-2024 11:15:56] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok[06-05-2024 11:13:43] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Host stopped flapping[06-05-2024 11:12:59] HOST FLAPPING ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Critical[06-05-2024 11:12:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.

June 05, 2024 10:00

Host Up[06-05-2024 10:25:05] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.14 ms
Host Down[06-05-2024 10:24:04] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 10:23:09] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 18337 bytes in 0.093 second response time
Service Ok[06-05-2024 10:23:01] SERVICE ALERT: proxy14.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 3767 bytes in 0.026 second response time
Service Ok[06-05-2024 10:20:53] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;OK;HARD;1;HTTP OK: HTTP/1.1 302 Found - 475 bytes in 0.023 second response time
Service started flapping[06-05-2024 10:20:53] SERVICE FLAPPING ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;STARTED; Service appears to have started flapping (23.6% change >= 20.0% threshold)
Service Ok[06-05-2024 10:20:26] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-hotspot.txt;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 413 bytes in 0.016 second response time
Service Ok[06-05-2024 10:20:14] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 2.858 second response time
Service Ok[06-05-2024 10:20:12] SERVICE ALERT: proxy14.fedoraproject.org;http-docs.fedoraproject.org;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 20308 bytes in 0.047 second response time
Service Ok[06-05-2024 10:18:56] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;OK;SOFT;8;HTTP OK: HTTP/1.1 200 OK - 99315 bytes in 0.446 second response time
Service Ok[06-05-2024 10:18:44] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 6236 bytes in 0.192 second response time
Service Ok[06-05-2024 10:18:38] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;OK;SOFT;8;HTTP OK: HTTP/1.1 200 OK - 19441 bytes in 0.171 second response time
Service Warning[06-05-2024 10:18:09] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;WARNING;HARD;8;HTTP WARNING: HTTP/1.1 200 OK - 18337 bytes in 34.097 second response time
Service Critical[06-05-2024 10:17:56] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;7;CRITICAL - Socket timeout
Service Ok[06-05-2024 10:17:55] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 34047 bytes in 2.824 second response time
Service Ok[06-05-2024 10:17:51] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 534 bytes in 12.772 second response time
Service Ok[06-05-2024 10:17:51] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 29282 bytes in 9.047 second response time
Service Critical[06-05-2024 10:17:44] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:17:38] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;7;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:16:52] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;4;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:16:42] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:16:39] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:16:15] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;6;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:16:03] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:15:57] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;6;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:15:11] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;3;CRITICAL - Socket timeout
Service Ok[06-05-2024 10:15:01] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;OK;SOFT;8;HTTP OK: HTTP/1.1 200 OK - 29282 bytes in 14.264 second response time
Service Ok[06-05-2024 10:14:58] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;OK;SOFT;6;HTTP OK: HTTP/1.1 200 OK - 534 bytes in 26.781 second response time
Service Ok[06-05-2024 10:14:39] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 233.02 ms
Service Critical[06-05-2024 10:14:34] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;5;CRITICAL - Socket timeout
Service Ok[06-05-2024 10:14:22] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 6236 bytes in 3.064 second response time
Service Critical[06-05-2024 10:14:16] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;5;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:13:46] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;CRITICAL;SOFT;7;CRITICAL - Socket timeout
Service Ok[06-05-2024 10:13:34] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Service Warning[06-05-2024 10:13:33] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 233.59 ms
Service Critical[06-05-2024 10:13:31] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;CRITICAL;SOFT;5;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:13:30] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Ok[06-05-2024 10:13:20] SERVICE ALERT: proxy35.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 7.757 second response time
Service Critical[06-05-2024 10:13:19] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:12:53] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:12:35] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;4;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:12:35] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;HARD;8;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:12:34] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 10:12:12] SERVICE ALERT: proxy35.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:12:05] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;CRITICAL;SOFT;6;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:11:50] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;CRITICAL;SOFT;4;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:11:49] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:11:38] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:11:12] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:10:54] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;3;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:10:54] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;7;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:10:53] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;CRITICAL;HARD;3;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:10:24] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;CRITICAL;SOFT;5;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:10:09] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;CRITICAL;SOFT;3;CRITICAL - Cannot make SSL connection.
Service Ok[06-05-2024 10:10:07] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;OK;SOFT;7;HTTP OK: HTTP/1.1 200 OK - 34047 bytes in 11.956 second response time
Service Ok[06-05-2024 10:09:57] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;OK;SOFT;6;HTTP OK: HTTP/1.1 200 OK - 6236 bytes in 5.569 second response time
Service Critical[06-05-2024 10:09:31] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:09:13] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:09:13] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;6;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:09:12] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:09:05] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:08:55] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;6;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:08:51] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;5;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:08:43] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;CRITICAL;SOFT;4;CRITICAL - Socket timeout
Service Ok[06-05-2024 10:08:35] SERVICE ALERT: proxy39.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 5.108 second response time
Service Critical[06-05-2024 10:07:50] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:07:32] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:07:32] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;5;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:07:31] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:07:30] SERVICE ALERT: proxy39.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'your Fedora Account' not found on 'https://id.fedoraproject.org:443/' - 771 bytes in 21.007 second response time
Service Critical[06-05-2024 10:07:24] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-05-2024 10:07:21] SERVICE ALERT: proxy04.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5427 bytes in 10.217 second response time
Service Critical[06-05-2024 10:07:14] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;5;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:07:10] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;4;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:07:02] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;CRITICAL;SOFT;3;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:06:11] SERVICE ALERT: proxy04.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'your Fedora Account' not found on 'https://id.fedoraproject.org:443/' - 771 bytes in 22.600 second response time
Service Critical[06-05-2024 10:05:51] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;4;CRITICAL - Socket timeout
Service Ok[06-05-2024 10:05:50] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;OK;SOFT;3;HTTP OK: HTTP/1.1 302 Found - 475 bytes in 10.101 second response time
Service Ok[06-05-2024 10:05:43] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 534 bytes in 3.245 second response time
Service Critical[06-05-2024 10:05:33] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;4;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:05:29] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;3;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:05:21] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:05:12] SERVICE ALERT: proxy14.fedoraproject.org;http-docs.fedoraproject.org;CRITICAL;HARD;3;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:05:11] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;CRITICAL;HARD;3;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:04:40] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:04:40] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:04:10] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;3;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:03:52] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;3;CRITICAL - Socket timeout
Service Ok[06-05-2024 10:03:49] SERVICE ALERT: noc02.fedoraproject.org;mail_queue;OK;SOFT;2;0 mail(s) in queue
Service Critical[06-05-2024 10:03:48] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:03:40] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:03:31] SERVICE ALERT: proxy14.fedoraproject.org;http-docs.fedoraproject.org;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:03:30] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:02:59] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:02:59] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Warning[06-05-2024 10:02:49] SERVICE ALERT: noc02.fedoraproject.org;mail_queue;WARNING;SOFT;1;2 mail(s) in queue
Service Critical[06-05-2024 10:02:29] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:02:11] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:02:07] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;1;CRITICAL - Cannot make SSL connection.
Service Ok[06-05-2024 10:01:59] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 29282 bytes in 5.267 second response time
Service Critical[06-05-2024 10:01:50] SERVICE ALERT: proxy14.fedoraproject.org;http-docs.fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:01:49] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-05-2024 10:01:43] SERVICE ALERT: proxy09.fedoraproject.org;http-fedoraproject.org;OK;SOFT;3;HTTP OK: HTTP/1.1 302 Found - 475 bytes in 0.182 second response time
Service Critical[06-05-2024 10:00:54] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 10:00:48] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Warning[06-05-2024 10:00:43] SERVICE ALERT: proxy09.fedoraproject.org;http-fedoraproject.org;WARNING;SOFT;2;HTTP WARNING: HTTP/1.1 302 Found - 475 bytes in 37.520 second response time
Service Critical[06-05-2024 10:00:30] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;1;CRITICAL - Socket timeout

June 05, 2024 09:00

Service Ok[06-05-2024 09:59:07] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 18337 bytes in 14.274 second response time
Service Critical[06-05-2024 09:59:05] SERVICE ALERT: proxy09.fedoraproject.org;http-fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-05-2024 09:58:49] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 34060 bytes in 6.951 second response time
Service Warning[06-05-2024 09:57:52] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;WARNING;SOFT;4;HTTP WARNING: HTTP/1.1 200 OK - 18337 bytes in 37.359 second response time
Service Ok[06-05-2024 09:57:43] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;OK;HARD;1;HTTP OK: HTTP/1.1 302 Found - 475 bytes in 24.325 second response time
Service Warning[06-05-2024 09:57:42] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;WARNING;SOFT;4;HTTP WARNING: HTTP/1.1 200 OK - 34061 bytes in 39.520 second response time
Service Ok[06-05-2024 09:56:18] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 534 bytes in 10.612 second response time
Service Critical[06-05-2024 09:56:15] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;3;CRITICAL - Socket timeout
Service Ok[06-05-2024 09:56:07] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 6236 bytes in 3.036 second response time
Service Warning[06-05-2024 09:56:02] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;WARNING;SOFT;3;HTTP WARNING: HTTP/1.1 200 OK - 34061 bytes in 37.737 second response time
Service Ok[06-05-2024 09:55:51] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 19409 bytes in 5.512 second response time
Service Critical[06-05-2024 09:55:26] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-hotspot.txt;CRITICAL;HARD;3;CRITICAL - Socket timeout
Service Ok[06-05-2024 09:55:09] SERVICE ALERT: proxy14.fedoraproject.org;http-docs.fedoraproject.org;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 20308 bytes in 9.084 second response time
Service Ok[06-05-2024 09:55:08] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 16.921 second response time
Service Critical[06-05-2024 09:55:07] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:55:04] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:54:46] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:54:34] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:54:25] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:53:59] SERVICE ALERT: proxy14.fedoraproject.org;http-docs.fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:53:51] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:53:45] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-hotspot.txt;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:53:26] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-05-2024 09:53:23] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 6236 bytes in 28.939 second response time
Host Up[06-05-2024 09:53:13] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1783.67 ms
Service Critical[06-05-2024 09:53:04] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:53:01] SERVICE ALERT: proxy14.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;HARD;3;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:52:53] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:52:44] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:52:18] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;CRITICAL;HARD;3;CRITICAL - Socket timeout
Host Down[06-05-2024 09:52:10] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 37%, RTA = 5953.76 ms
Service Critical[06-05-2024 09:52:04] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-hotspot.txt;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:51:54] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-05-2024 09:51:23] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 19454 bytes in 5.444 second response time
Service Critical[06-05-2024 09:51:20] SERVICE ALERT: proxy14.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Ok[06-05-2024 09:51:09] SERVICE ALERT: proxy39.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 4.749 second response time
Service Ok[06-05-2024 09:51:06] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;3;PROCS OK: 0 processes with STATE = Z
Service Ok[06-05-2024 09:51:04] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;3;PROCS OK: 1 process with command name 'rsyslogd'
Host Down[06-05-2024 09:51:02] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 60%, RTA = 8239.44 ms
Service Critical[06-05-2024 09:50:37] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:50:18] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:50:06] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 09:50:04] SERVICE ALERT: proxy39.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:50:04] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 09:49:39] SERVICE ALERT: proxy14.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:48:56] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:48:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 09:48:34] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 09:47:32] SERVICE ALERT: proxy06.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 5.187 second response time
Service Ok[06-05-2024 09:47:10] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 4.339 second response time
Service Critical[06-05-2024 09:46:27] SERVICE ALERT: proxy06.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'your Fedora Account' not found on 'https://id.fedoraproject.org:443/' - 771 bytes in 19.258 second response time
Service Warning[06-05-2024 09:46:06] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;WARNING;SOFT;1;HTTP WARNING: HTTP/1.1 200 OK - 5427 bytes in 33.534 second response time
Service Ok[06-05-2024 09:42:58] SERVICE ALERT: proxy14.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 3767 bytes in 6.702 second response time
Service Ok[06-05-2024 09:42:18] SERVICE ALERT: proxy14.fedoraproject.org;http-docs.fedoraproject.org;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 20308 bytes in 2.117 second response time
Service Warning[06-05-2024 09:41:51] SERVICE ALERT: proxy14.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;WARNING;SOFT;1;HTTP WARNING: HTTP/1.1 200 OK - 3767 bytes in 33.499 second response time
Service Critical[06-05-2024 09:41:16] SERVICE ALERT: proxy14.fedoraproject.org;http-docs.fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host stopped flapping[06-05-2024 09:41:03] HOST FLAPPING ALERT: buildhw-a64-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Up[06-05-2024 09:40:56] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.89 ms
Host started flapping[06-05-2024 09:40:56] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (21.1% change > 20.0% threshold)
Service Ok[06-05-2024 09:40:19] SERVICE ALERT: openqa-a64-worker01.iad2.fedoraproject.org;Rsyslogd Process;OK;HARD;1;PROCS OK: 1 process with command name 'rsyslogd'
Service Ok[06-05-2024 09:40:18] SERVICE ALERT: openqa-a64-worker01.iad2.fedoraproject.org;mail_queue;OK;HARD;1;0 mail(s) in queue
Host Down[06-05-2024 09:39:55] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 09:38:00] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 706.80 ms
Host started flapping[06-05-2024 09:38:00] HOST FLAPPING ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.7% change > 20.0% threshold)
Host Down[06-05-2024 09:36:58] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 09:35:42] SERVICE ALERT: proxy09.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 3.446 second response time
Service Critical[06-05-2024 09:34:38] SERVICE ALERT: proxy09.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'your Fedora Account' not found on 'https://id.fedoraproject.org:443/' - 771 bytes in 15.592 second response time
Host Up[06-05-2024 09:31:48] HOST ALERT: openqa-a64-worker01.iad2.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Critical[06-05-2024 09:30:49] SERVICE ALERT: openqa-a64-worker01.iad2.fedoraproject.org;Rsyslogd Process;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 09:30:48] SERVICE ALERT: openqa-a64-worker01.iad2.fedoraproject.org;mail_queue;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-05-2024 09:30:48] HOST ALERT: openqa-a64-worker01.iad2.fedoraproject.org;DOWN;SOFT;3;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-05-2024 09:29:18] HOST ALERT: openqa-a64-worker01.iad2.fedoraproject.org;DOWN;SOFT;2;(Host check timed out after 30.01 seconds)
Service Ok[06-05-2024 09:28:08] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;OK;SOFT;4;HTTP OK: Status line output matched "HTTP/1.0 401 Unauthorized" - 303 bytes in 0.007 second response time
Host Down[06-05-2024 09:27:48] HOST ALERT: openqa-a64-worker01.iad2.fedoraproject.org;DOWN;SOFT;1;(Host check timed out after 30.01 seconds)
Service Critical[06-05-2024 09:27:08] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;3;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:25:58] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-05-2024 09:24:48] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-05-2024 09:24:12] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue amqp_to_zmq;OK;SOFT;2;RABBITMQ_QUEUE OK - messages OK (0) messages_ready OK (0) messages_unacknowledged OK (0) consumers OK (1) All queues under the thresholds
Service Ok[06-05-2024 09:24:04] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 100655 bytes in 11.146 second response time
Service Ok[06-05-2024 09:23:58] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 100339 bytes in 4.848 second response time
Service Ok[06-05-2024 09:23:57] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 100661 bytes in 4.751 second response time
Service Ok[06-05-2024 09:23:38] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;OK;SOFT;2;HTTP OK: Status line output matched "HTTP/1.0 401 Unauthorized" - 303 bytes in 0.005 second response time
Service Warning[06-05-2024 09:23:12] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue amqp_to_zmq;WARNING;SOFT;1;RABBITMQ_QUEUE WARNING - messages WARNING (91), messages_ready OK (66) messages_unacknowledged OK (25) consumers OK (1)
Service Critical[06-05-2024 09:22:53] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 13.383 second response time
Service Critical[06-05-2024 09:22:53] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 601 bytes in 15.843 second response time
Service Critical[06-05-2024 09:22:53] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 15.651 second response time
Service Ok[06-05-2024 09:22:52] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 101081 bytes in 18.606 second response time
Service Ok[06-05-2024 09:22:49] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 101081 bytes in 15.927 second response time
Service Ok[06-05-2024 09:22:47] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 100999 bytes in 14.382 second response time
Service Ok[06-05-2024 09:22:46] SERVICE ALERT: proxy36.fedoraproject.org;http-koschei;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 100999 bytes in 13.027 second response time
Service Ok[06-05-2024 09:22:45] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 100999 bytes in 11.966 second response time
Service Ok[06-05-2024 09:22:44] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 100999 bytes in 10.972 second response time
Service Ok[06-05-2024 09:22:40] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 101003 bytes in 7.661 second response time
Service Ok[06-05-2024 09:22:38] SERVICE ALERT: worker01.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 100912 bytes in 5.460 second response time
Service Critical[06-05-2024 09:22:38] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-05-2024 09:22:38] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 100912 bytes in 4.905 second response time
Service Ok[06-05-2024 09:22:38] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 101234 bytes in 4.805 second response time
Service Ok[06-05-2024 09:22:37] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 100912 bytes in 4.733 second response time
Host Up[06-05-2024 09:21:48] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1468.31 ms
Service Ok[06-05-2024 09:21:40] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 101096 bytes in 8.049 second response time
Service Ok[06-05-2024 09:21:37] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 100780 bytes in 5.790 second response time
Service Ok[06-05-2024 09:21:37] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 101102 bytes in 5.596 second response time
Service Critical[06-05-2024 09:21:33] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 7.115 second response time
Service Critical[06-05-2024 09:21:33] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 6.176 second response time
Service Critical[06-05-2024 09:21:33] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 8.102 second response time
Service Critical[06-05-2024 09:21:33] SERVICE ALERT: proxy36.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 8.138 second response time
Service Critical[06-05-2024 09:21:33] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 8.284 second response time
Service Critical[06-05-2024 09:21:33] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 8.552 second response time
Service Critical[06-05-2024 09:21:33] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 599 bytes in 3.117 second response time
Service Critical[06-05-2024 09:21:33] SERVICE ALERT: worker01.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 6.080 second response time
Service Critical[06-05-2024 09:21:33] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 8.703 second response time
Service Critical[06-05-2024 09:21:33] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 4.857 second response time
Service Critical[06-05-2024 09:21:33] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 600 bytes in 1.443 second response time
Service Ok[06-05-2024 09:21:27] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 101220 bytes in 8.647 second response time
Service Ok[06-05-2024 09:21:27] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 101220 bytes in 7.898 second response time
Service Ok[06-05-2024 09:21:09] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 100509 bytes in 29.038 second response time
Host Down[06-05-2024 09:20:46] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Critical[06-05-2024 09:20:32] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 29.819 second response time
Service Critical[06-05-2024 09:20:31] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 601 bytes in 16.063 second response time
Service Critical[06-05-2024 09:20:31] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 601 bytes in 15.463 second response time
Service Critical[06-05-2024 09:20:31] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 23.361 second response time
Service Critical[06-05-2024 09:20:30] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 964 bytes in 15.028 second response time
Service Ok[06-05-2024 09:20:29] SERVICE ALERT: proxy12.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 3.372 second response time
Service Critical[06-05-2024 09:20:28] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 642 bytes in 15.020 second response time
Service Critical[06-05-2024 09:20:27] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9398 bytes in 2.614 second response time
Service Critical[06-05-2024 09:20:27] SERVICE ALERT: worker01.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 642 bytes in 15.021 second response time
Service Critical[06-05-2024 09:20:26] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.676 second response time
Service Critical[06-05-2024 09:20:25] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.686 second response time
Service Critical[06-05-2024 09:20:25] SERVICE ALERT: proxy36.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.653 second response time
Service Critical[06-05-2024 09:20:24] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.503 second response time
Service Critical[06-05-2024 09:20:24] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.236 second response time
Service Critical[06-05-2024 09:20:24] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 642 bytes in 15.021 second response time
Service Critical[06-05-2024 09:20:19] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.106 second response time
Service Critical[06-05-2024 09:20:19] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.090 second response time
Service Ok[06-05-2024 09:19:48] SERVICE ALERT: proxy04.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 2.576 second response time
Service Critical[06-05-2024 09:19:40] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.080 second response time
Service Critical[06-05-2024 09:19:26] SERVICE ALERT: proxy12.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'your Fedora Account' not found on 'https://id.fedoraproject.org:443/' - 771 bytes in 17.962 second response time
Service Critical[06-05-2024 09:19:24] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 39.449 second response time
Service Critical[06-05-2024 09:19:24] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 40.008 second response time
Service Critical[06-05-2024 09:19:24] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 35.669 second response time
Service Critical[06-05-2024 09:19:24] SERVICE ALERT: proxy36.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 31.942 second response time
Service Critical[06-05-2024 09:19:24] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 37.688 second response time
Service Critical[06-05-2024 09:19:24] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 34.919 second response time
Service Warning[06-05-2024 09:19:19] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;WARNING;SOFT;2;HTTP WARNING: HTTP/1.1 200 OK - 101220 bytes in 35.169 second response time
Service Warning[06-05-2024 09:19:19] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;WARNING;SOFT;2;HTTP WARNING: HTTP/1.1 200 OK - 101220 bytes in 34.604 second response time
Service Warning[06-05-2024 09:19:16] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;WARNING;SOFT;2;HTTP WARNING: HTTP/1.1 200 OK - 101226 bytes in 31.882 second response time
Service Warning[06-05-2024 09:19:15] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;WARNING;SOFT;2;HTTP WARNING: HTTP/1.1 200 OK - 101226 bytes in 31.281 second response time
Service Warning[06-05-2024 09:19:15] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;WARNING;SOFT;2;HTTP WARNING: HTTP/1.1 200 OK - 101225 bytes in 30.645 second response time
Service Ok[06-05-2024 09:19:13] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 100903 bytes in 28.903 second response time
Service Ok[06-05-2024 09:19:12] SERVICE ALERT: worker01.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 100903 bytes in 27.687 second response time
Service Ok[06-05-2024 09:19:09] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 100903 bytes in 25.063 second response time
Service Ok[06-05-2024 09:19:08] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 100903 bytes in 23.984 second response time
Service Ok[06-05-2024 09:19:02] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 100828 bytes in 23.979 second response time
Service Ok[06-05-2024 09:19:00] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 100828 bytes in 22.265 second response time
Service Ok[06-05-2024 09:18:55] SERVICE ALERT: proxy40.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 100828 bytes in 16.717 second response time
Service Ok[06-05-2024 09:18:51] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 101152 bytes in 14.032 second response time
Service Ok[06-05-2024 09:18:46] SERVICE ALERT: proxy34.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 101151 bytes in 10.371 second response time
Service Critical[06-05-2024 09:18:45] SERVICE ALERT: proxy04.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'your Fedora Account' not found on 'https://id.fedoraproject.org:443/' - 771 bytes in 16.408 second response time
Service Ok[06-05-2024 09:18:45] SERVICE ALERT: proxy32.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 101151 bytes in 9.675 second response time
Service Ok[06-05-2024 09:18:43] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 101151 bytes in 7.861 second response time
Service Ok[06-05-2024 09:18:40] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 101151 bytes in 5.308 second response time
Service Critical[06-05-2024 09:17:49] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.633 second response time
Service Critical[06-05-2024 09:17:48] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.688 second response time
Service Critical[06-05-2024 09:17:46] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.515 second response time
Service Critical[06-05-2024 09:17:45] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.646 second response time
Service Critical[06-05-2024 09:17:44] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 14.008 second response time
Service Critical[06-05-2024 09:17:44] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Proxy Error - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 781 bytes in 10.060 second response time
Service Critical[06-05-2024 09:17:44] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.005 second response time
Service Critical[06-05-2024 09:17:44] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 14.362 second response time
Service Critical[06-05-2024 09:17:44] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 601 bytes in 16.386 second response time
Service Critical[06-05-2024 09:17:44] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 601 bytes in 16.042 second response time
Service Critical[06-05-2024 09:17:44] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 15.822 second response time
Service Critical[06-05-2024 09:17:44] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 600 bytes in 17.178 second response time
Service Critical[06-05-2024 09:17:44] SERVICE ALERT: worker01.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 19.319 second response time
Service Critical[06-05-2024 09:17:44] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 11.293 second response time
Service Critical[06-05-2024 09:17:38] SERVICE ALERT: proxy40.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.830 second response time
Service Critical[06-05-2024 09:17:38] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.782 second response time
Service Critical[06-05-2024 09:17:38] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.803 second response time
Service Critical[06-05-2024 09:17:37] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.561 second response time
Service Critical[06-05-2024 09:17:36] SERVICE ALERT: proxy34.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.833 second response time
Service Critical[06-05-2024 09:17:35] SERVICE ALERT: proxy32.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.660 second response time
Service Critical[06-05-2024 09:17:35] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.622 second response time
Service Critical[06-05-2024 09:17:34] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.214 second response time
Service Critical[06-05-2024 09:16:44] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 26.457 second response time
Service Critical[06-05-2024 09:16:36] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.758 second response time
Service Critical[06-05-2024 09:16:36] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.577 second response time
Service Critical[06-05-2024 09:16:36] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.575 second response time
Service Critical[06-05-2024 09:16:35] SERVICE ALERT: proxy34.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.830 second response time
Service Critical[06-05-2024 09:16:35] SERVICE ALERT: proxy32.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.664 second response time
Service Critical[06-05-2024 09:16:35] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.621 second response time
Service Critical[06-05-2024 09:16:34] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.135 second response time
Service Critical[06-05-2024 09:16:28] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.004 second response time
Service Critical[06-05-2024 09:16:25] SERVICE ALERT: worker01.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.004 second response time
Service Critical[06-05-2024 09:15:34] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 29.974 second response time
Service Critical[06-05-2024 09:15:34] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 29.964 second response time
Service Critical[06-05-2024 09:15:34] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 29.964 second response time
Service Critical[06-05-2024 09:15:34] SERVICE ALERT: proxy34.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 29.965 second response time
Service Critical[06-05-2024 09:15:34] SERVICE ALERT: proxy32.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 29.965 second response time
Service Critical[06-05-2024 09:15:34] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 29.965 second response time
Service Critical[06-05-2024 09:15:34] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 29.984 second response time
Service Ok[06-05-2024 09:15:28] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99928 bytes in 24.126 second response time
Service Ok[06-05-2024 09:15:25] SERVICE ALERT: worker01.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99928 bytes in 20.628 second response time
Service Ok[06-05-2024 09:14:56] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;3;SSH OK - OpenSSH_9.3 (protocol 2.0)
Service Critical[06-05-2024 09:14:04] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 21.529 second response time
Service Critical[06-05-2024 09:14:04] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 19.262 second response time
Service Critical[06-05-2024 09:14:04] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 6.648 second response time
Service Critical[06-05-2024 09:14:04] SERVICE ALERT: proxy34.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 22.177 second response time
Service Critical[06-05-2024 09:14:04] SERVICE ALERT: proxy32.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 24.171 second response time
Service Critical[06-05-2024 09:14:04] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 23.077 second response time
Service Critical[06-05-2024 09:14:04] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 12.736 second response time
Service Critical[06-05-2024 09:14:04] SERVICE ALERT: worker01.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 12.995 second response time
Service Critical[06-05-2024 09:14:04] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 13.089 second response time
Service Critical[06-05-2024 09:13:56] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Ok[06-05-2024 09:13:44] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Service Ok[06-05-2024 09:12:58] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99927 bytes in 9.954 second response time
Service Ok[06-05-2024 09:12:52] SERVICE ALERT: proxy36.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99927 bytes in 5.048 second response time
Service Ok[06-05-2024 09:12:51] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99927 bytes in 3.838 second response time
Service Ok[06-05-2024 09:12:51] SERVICE ALERT: worker01.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99611 bytes in 3.602 second response time
Service Ok[06-05-2024 09:12:51] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99611 bytes in 3.507 second response time
Service Critical[06-05-2024 09:12:46] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-05-2024 09:12:45] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99896 bytes in 10.808 second response time
Service Critical[06-05-2024 09:12:44] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 09:12:43] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99896 bytes in 8.539 second response time
Service Ok[06-05-2024 09:12:42] SERVICE ALERT: proxy34.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99896 bytes in 7.817 second response time
Service Ok[06-05-2024 09:12:41] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99896 bytes in 6.918 second response time
Service Ok[06-05-2024 09:12:40] SERVICE ALERT: proxy32.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99622 bytes in 5.901 second response time
Service Ok[06-05-2024 09:12:38] SERVICE ALERT: proxy04.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99896 bytes in 4.451 second response time
Service Critical[06-05-2024 09:11:48] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 13.582 second response time
Service Critical[06-05-2024 09:11:47] SERVICE ALERT: proxy36.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 10.397 second response time
Service Critical[06-05-2024 09:11:47] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 13.275 second response time
Service Critical[06-05-2024 09:11:47] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 10.495 second response time
Service Critical[06-05-2024 09:11:47] SERVICE ALERT: worker01.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 9.129 second response time
Service Critical[06-05-2024 09:11:34] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 3.411 second response time
Service Critical[06-05-2024 09:11:34] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 9.477 second response time
Service Critical[06-05-2024 09:11:34] SERVICE ALERT: proxy34.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 11.935 second response time
Service Critical[06-05-2024 09:11:34] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 5.467 second response time
Service Critical[06-05-2024 09:11:34] SERVICE ALERT: proxy32.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 9.973 second response time
Service Critical[06-05-2024 09:11:34] SERVICE ALERT: proxy04.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 592 bytes in 0.138 second response time
Service Ok[06-05-2024 09:11:16] SERVICE ALERT: lists.fedoraproject.org;http-lists.fedoraproject.org;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 56282 bytes in 0.118 second response time
Service Ok[06-05-2024 09:10:25] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 100242 bytes in 8.841 second response time
Service Ok[06-05-2024 09:10:22] SERVICE ALERT: proxy34.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 100242 bytes in 6.869 second response time
Service Critical[06-05-2024 09:10:16] SERVICE ALERT: lists.fedoraproject.org;http-lists.fedoraproject.org;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - string 'Fedora Mailing-Lists' not found on 'https://lists.fedoraproject.org:443/archives/' - 875 bytes in 3.516 second response time
Service Critical[06-05-2024 09:09:16] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.595 second response time
Service Critical[06-05-2024 09:09:15] SERVICE ALERT: proxy34.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.832 second response time
Service Critical[06-05-2024 09:08:14] SERVICE ALERT: proxy34.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 9.175 second response time
Service Critical[06-05-2024 09:08:14] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 8.746 second response time
Service Ok[06-05-2024 09:04:59] SERVICE ALERT: people02.fedoraproject.org;http-cert-people.fedoraproject.org;OK;SOFT;2;SSL OK - Certificate '*.fedorapeople.org' will expire in 177 days on 2024-11-29 23:59 +0000/GMT.
Service Critical[06-05-2024 09:03:59] SERVICE ALERT: people02.fedoraproject.org;http-cert-people.fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout

June 05, 2024 08:00

Host Up[06-05-2024 08:34:44] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.38 ms
Host Up[06-05-2024 08:33:53] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.44 ms
Host Down[06-05-2024 08:33:43] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 81%, RTA = 10360.67 ms
Host Up[06-05-2024 08:33:17] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2322.09 ms
Host Down[06-05-2024 08:32:52] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 08:32:12] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 08:31:07] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;OK;SOFT;2;RABBITMQ_QUEUE OK - messages OK (0) messages_ready OK (0) messages_unacknowledged OK (0) consumers OK (1) All queues under the thresholds
Host Down[06-05-2024 08:31:00] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 80%, RTA = 9212.21 ms
Service Warning[06-05-2024 08:30:07] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;WARNING;SOFT;1;RABBITMQ_QUEUE WARNING - messages WARNING (48), messages_ready OK (38) messages_unacknowledged OK (10) consumers OK (1)
Host Up[06-05-2024 08:12:44] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-05-2024 08:12:34] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;(Host check timed out after 30.01 seconds)
Host Up[06-05-2024 08:06:03] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.56 ms
Host started flapping[06-05-2024 08:06:03] HOST FLAPPING ALERT: buildhw-a64-23.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.6% change > 20.0% threshold)
Host Down[06-05-2024 08:05:02] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host stopped flapping[06-05-2024 08:04:28] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)

June 05, 2024 07:00

Host Up[06-05-2024 07:49:51] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.47 ms
Host Down[06-05-2024 07:48:50] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 07:47:38] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 07:47:06] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 1 process with STATE = Z
Host Up[06-05-2024 07:47:05] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host started flapping[06-05-2024 07:47:05] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STARTED; Host appears to have started flapping (20.3% change > 20.0% threshold)
Service Ok[06-05-2024 07:47:04] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Host Down[06-05-2024 07:46:34] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 07:46:06] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 07:46:04] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-05-2024 07:45:55] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 25%, RTA = 2229.36 ms
Host Down[06-05-2024 07:44:52] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host stopped flapping[06-05-2024 07:42:14] HOST FLAPPING ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok[06-05-2024 07:41:28] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;OK;SOFT;2;HTTP OK: Status line output matched "HTTP/1.0 401 Unauthorized" - 303 bytes in 0.005 second response time
Host stopped flapping[06-05-2024 07:40:35] HOST FLAPPING ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Critical[06-05-2024 07:40:28] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-05-2024 07:32:54] SERVICE ALERT: pkgs01.iad2.fedoraproject.org;http-pkgs-pagure;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 32716 bytes in 12.474 second response time
Service Critical[06-05-2024 07:31:42] SERVICE ALERT: pkgs01.iad2.fedoraproject.org;http-pkgs-pagure;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 200 OK - 32715 bytes in 40.355 second response time
Host Up[06-05-2024 07:31:14] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok[06-05-2024 07:31:14] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Host Down[06-05-2024 07:30:44] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 07:30:14] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 07:12:05] SERVICE ALERT: proxy34.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 104662 bytes in 1.586 second response time
Service Ok[06-05-2024 07:12:05] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 104663 bytes in 2.644 second response time
Service Ok[06-05-2024 07:11:48] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 103858 bytes in 1.483 second response time
Service Ok[06-05-2024 07:11:48] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 103858 bytes in 0.654 second response time
Service Ok[06-05-2024 07:11:46] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 103858 bytes in 1.066 second response time
Service Ok[06-05-2024 07:11:43] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 103859 bytes in 2.815 second response time
Service Ok[06-05-2024 07:11:37] SERVICE ALERT: proxy40.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 103773 bytes in 1.793 second response time
Service Ok[06-05-2024 07:11:34] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 103486 bytes in 0.616 second response time
Service Ok[06-05-2024 07:11:33] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 103171 bytes in 0.476 second response time
Service Ok[06-05-2024 07:11:30] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 103486 bytes in 0.489 second response time
Service Ok[06-05-2024 07:11:30] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 103092 bytes in 3.101 second response time
Service Ok[06-05-2024 07:11:28] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 103097 bytes in 0.369 second response time
Service Ok[06-05-2024 07:11:28] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 103097 bytes in 0.369 second response time
Service Ok[06-05-2024 07:11:27] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 103096 bytes in 0.359 second response time
Service Ok[06-05-2024 07:11:16] SERVICE ALERT: worker06.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 102067 bytes in 0.377 second response time
Service Ok[06-05-2024 07:11:06] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 101268 bytes in 2.958 second response time
Service Ok[06-05-2024 07:11:06] SERVICE ALERT: proxy09.fedoraproject.org;http-koschei;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 101267 bytes in 1.336 second response time
Service Ok[06-05-2024 07:11:05] SERVICE ALERT: worker05.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 100952 bytes in 0.468 second response time
Service Critical[06-05-2024 07:11:04] SERVICE ALERT: proxy34.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.956 second response time
Service Critical[06-05-2024 07:11:02] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.547 second response time
Service Critical[06-05-2024 07:10:47] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.184 second response time
Service Critical[06-05-2024 07:10:47] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.692 second response time
Service Critical[06-05-2024 07:10:45] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.514 second response time
Service Critical[06-05-2024 07:10:40] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.714 second response time
Service Critical[06-05-2024 07:10:36] SERVICE ALERT: proxy40.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.845 second response time
Service Critical[06-05-2024 07:10:34] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.117 second response time
Service Critical[06-05-2024 07:10:33] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.004 second response time
Service Critical[06-05-2024 07:10:30] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.095 second response time
Service Critical[06-05-2024 07:10:28] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9401 bytes in 0.015 second response time
Service Critical[06-05-2024 07:10:28] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9401 bytes in 0.016 second response time
Service Critical[06-05-2024 07:10:27] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9400 bytes in 0.014 second response time
Service Critical[06-05-2024 07:10:27] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9398 bytes in 1.997 second response time
Service Critical[06-05-2024 07:10:15] SERVICE ALERT: worker06.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.006 second response time
Service Critical[06-05-2024 07:10:05] SERVICE ALERT: proxy09.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.650 second response time
Service Critical[06-05-2024 07:10:04] SERVICE ALERT: worker05.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.004 second response time
Service Critical[06-05-2024 07:10:03] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 3.405 second response time
Service Critical[06-05-2024 07:10:00] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.548 second response time
Service Critical[06-05-2024 07:09:46] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.689 second response time
Service Critical[06-05-2024 07:09:45] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.511 second response time
Service Critical[06-05-2024 07:09:38] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.947 second response time
Service Critical[06-05-2024 07:09:35] SERVICE ALERT: proxy40.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.035 second response time
Service Critical[06-05-2024 07:09:30] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.072 second response time
Service Critical[06-05-2024 07:09:28] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9401 bytes in 0.017 second response time
Service Critical[06-05-2024 07:09:28] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9401 bytes in 0.015 second response time
Service Critical[06-05-2024 07:09:27] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9400 bytes in 0.015 second response time
Service Critical[06-05-2024 07:09:25] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.745 second response time
Service Critical[06-05-2024 07:09:15] SERVICE ALERT: worker06.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.005 second response time
Service Critical[06-05-2024 07:09:04] SERVICE ALERT: worker05.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.005 second response time
Service Critical[06-05-2024 07:09:04] SERVICE ALERT: proxy09.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.678 second response time
Service Critical[06-05-2024 07:09:00] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.852 second response time
Service Critical[06-05-2024 07:08:59] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.565 second response time
Service Critical[06-05-2024 07:08:28] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9401 bytes in 0.015 second response time
Service Critical[06-05-2024 07:08:28] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9401 bytes in 0.015 second response time
Service Critical[06-05-2024 07:08:27] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9400 bytes in 0.013 second response time
Service Critical[06-05-2024 07:08:15] SERVICE ALERT: worker06.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.005 second response time
Service Critical[06-05-2024 07:08:04] SERVICE ALERT: worker05.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.005 second response time
Service Critical[06-05-2024 07:08:03] SERVICE ALERT: proxy09.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.184 second response time
Service Critical[06-05-2024 07:07:58] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.768 second response time
Service Critical[06-05-2024 07:07:57] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.772 second response time
Service Critical[06-05-2024 07:07:04] SERVICE ALERT: worker05.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.005 second response time

June 05, 2024 06:00

Host Up[06-05-2024 06:24:42] HOST ALERT: buildvm-ppc64le-01.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.84 ms
Host Down[06-05-2024 06:23:41] HOST ALERT: buildvm-ppc64le-01.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 06:14:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Service Ok[06-05-2024 06:14:34] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Service Critical[06-05-2024 06:13:35] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 06:13:34] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-05-2024 06:11:57] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi2;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 14235 bytes in 0.022 second response time
Service Warning[06-05-2024 06:10:57] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi2;WARNING;SOFT;1;HTTP WARNING: HTTP/1.1 200 OK - 14239 bytes in 34.225 second response time
Host Up[06-05-2024 06:09:41] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.74 ms
Host Down[06-05-2024 06:08:40] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 72%, RTA = 9761.63 ms
Host Up[06-05-2024 06:08:33] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.78 ms
Host Down[06-05-2024 06:07:32] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 06:07:29] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host stopped flapping[06-05-2024 06:07:27] HOST FLAPPING ALERT: buildhw-a64-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)
Host Up[06-05-2024 06:07:14] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.76 ms
Host Down[06-05-2024 06:06:20] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 06:06:17] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 06:06:13] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host stopped flapping[06-05-2024 06:05:46] HOST FLAPPING ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Up[06-05-2024 06:05:35] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.71 ms
Host Down[06-05-2024 06:04:34] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host stopped flapping[06-05-2024 06:03:00] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)

June 05, 2024 05:00

Host Up[06-05-2024 05:56:03] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.48 ms
Host Down[06-05-2024 05:55:01] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host stopped flapping[06-05-2024 05:46:06] HOST FLAPPING ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host stopped flapping[06-05-2024 05:36:09] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)
Host stopped flapping[06-05-2024 05:35:52] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok[06-05-2024 05:13:38] SERVICE ALERT: bvmhost-p09-04.iad2.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Service Ok[06-05-2024 05:13:37] SERVICE ALERT: bvmhost-p09-04.iad2.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Service Critical[06-05-2024 05:12:38] SERVICE ALERT: bvmhost-p09-04.iad2.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 05:12:37] SERVICE ALERT: bvmhost-p09-04.iad2.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.

June 05, 2024 04:00

Service Ok[06-05-2024 04:49:05] SERVICE ALERT: oci-candidate-registry01.iad2.fedoraproject.org;Disk space /srv/registry;OK;HARD;1;DISK OK - free space: /srv/registry 906510 MiB (21.63% inode=97%):
Host Up[06-05-2024 04:44:50] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.12 ms
Host Up[06-05-2024 04:44:23] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.20 ms
Host started flapping[06-05-2024 04:44:23] HOST FLAPPING ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (20.8% change > 20.0% threshold)
Host Down[06-05-2024 04:43:49] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 04:43:22] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 04:37:27] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.39 ms
Host started flapping[06-05-2024 04:37:27] HOST FLAPPING ALERT: buildhw-a64-23.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.4% change > 20.0% threshold)
Host Down[06-05-2024 04:36:26] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 04:35:14] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 04:33:01] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.75 ms
Host Down[06-05-2024 04:31:59] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 04:30:47] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 04:30:46] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.97 ms
Host Up[06-05-2024 04:30:03] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.37 ms
Host Down[06-05-2024 04:29:45] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 04:29:02] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;4;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 04:27:50] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 04:26:38] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 04:25:26] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Warning[06-05-2024 04:22:08] SERVICE ALERT: oci-candidate-registry01.iad2.fedoraproject.org;Disk space /srv/registry;WARNING;HARD;3;DISK WARNING - free space: /srv/registry 810604 MiB (19.80% inode=97%):
Service Warning[06-05-2024 04:21:08] SERVICE ALERT: oci-candidate-registry01.iad2.fedoraproject.org;Disk space /srv/registry;WARNING;SOFT;2;DISK WARNING - free space: /srv/registry 810604 MiB (19.80% inode=97%):
Service Warning[06-05-2024 04:20:08] SERVICE ALERT: oci-candidate-registry01.iad2.fedoraproject.org;Disk space /srv/registry;WARNING;SOFT;1;DISK WARNING - free space: /srv/registry 812096 MiB (19.83% inode=97%):
Host Up[06-05-2024 04:11:06] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.71 ms
Host Down[06-05-2024 04:10:05] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 04:09:18] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;OK;SOFT;2;HTTP OK: Status line output matched "HTTP/1.0 401 Unauthorized" - 303 bytes in 0.006 second response time
Service Critical[06-05-2024 04:08:18] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Up[06-05-2024 04:06:09] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.77 ms
Host Up[06-05-2024 04:05:47] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 91%, RTA = 1.27 ms
Host Down[06-05-2024 04:05:08] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 04:04:35] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 04:03:56] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 04:03:38] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.62 ms
Host Down[06-05-2024 04:02:37] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 04:00:57] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 0%, RTA = 3422.99 ms

June 05, 2024 03:00

Host Down[06-05-2024 03:59:51] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 57%, RTA = 5593.83 ms
Host Up[06-05-2024 03:59:27] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2241.10 ms
Host Down[06-05-2024 03:58:23] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 03:57:41] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.70 ms
Host Down[06-05-2024 03:56:40] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 03:33:11] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.65 ms
Host Down[06-05-2024 03:32:10] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 03:19:55] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 33%, RTA = 1659.27 ms
Host Down[06-05-2024 03:18:53] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 03:18:49] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 16%, RTA = 3063.12 ms
Host Down[06-05-2024 03:17:44] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 03:17:26] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.80 ms
Host started flapping[06-05-2024 03:17:26] HOST FLAPPING ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (21.7% change > 20.0% threshold)
Host Down[06-05-2024 03:16:25] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 03:15:13] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 63%, RTA = 8790.01 ms
Host Up[06-05-2024 03:14:45] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 896.01 ms
Host Down[06-05-2024 03:13:44] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 03:13:12] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.81 ms
Host Down[06-05-2024 03:12:11] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 03:02:32] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.94 ms
Host Down[06-05-2024 03:01:31] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%

June 05, 2024 02:00

Host Up[06-05-2024 02:59:34] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.92 ms
Host Up[06-05-2024 02:58:42] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.99 ms
Host started flapping[06-05-2024 02:58:42] HOST FLAPPING ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.3% change > 20.0% threshold)
Host Down[06-05-2024 02:58:33] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 10%, RTA = 5015.07 ms
Host Up[06-05-2024 02:58:33] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.99 ms
Host Down[06-05-2024 02:57:41] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 02:57:32] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 02:57:00] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.36 ms
Host started flapping[06-05-2024 02:57:00] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.6% change > 20.0% threshold)
Host Down[06-05-2024 02:56:29] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 02:55:59] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 02:42:21] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.80 ms
Host started flapping[06-05-2024 02:42:21] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (24.2% change > 20.0% threshold)
Host Up[06-05-2024 02:41:20] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.17 ms
Host started flapping[06-05-2024 02:41:20] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.9% change > 20.0% threshold)
Host Down[06-05-2024 02:41:20] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 40%, RTA = 7573.81 ms
Host Up[06-05-2024 02:41:20] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1313.21 ms
Host Up[06-05-2024 02:40:48] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.67 ms
Host Down[06-05-2024 02:40:19] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 02:40:17] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 02:39:47] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 83%, RTA = 11270.81 ms
Host Down[06-05-2024 02:38:35] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 02:36:14] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 50%, RTA = 4282.03 ms
Host Down[06-05-2024 02:35:09] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 02:30:08] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.79 ms
Host Up[06-05-2024 02:30:05] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 50%, RTA = 2575.82 ms
Host Down[06-05-2024 02:29:07] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 02:29:02] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 02:12:37] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-05-2024 02:12:06] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-05-2024 02:08:24] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.12 ms
Host started flapping[06-05-2024 02:08:24] HOST FLAPPING ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (21.1% change > 20.0% threshold)
Host Down[06-05-2024 02:07:23] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 44%, RTA = 7130.50 ms

June 05, 2024 01:00

Host Up[06-05-2024 01:41:36] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok[06-05-2024 01:41:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Host Down[06-05-2024 01:41:06] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-05-2024 01:40:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Up[06-05-2024 01:13:32] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 0%, RTA = 4252.39 ms
Host Down[06-05-2024 01:12:23] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 77%, RTA = 7812.17 ms
Service Ok[06-05-2024 01:09:18] SERVICE ALERT: mailman01.iad2.fedoraproject.org;http-mailman-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 55852 bytes in 8.443 second response time
Service Ok[06-05-2024 01:09:12] SERVICE ALERT: lists.fedoraproject.org;http-lists.fedoraproject.org;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 56268 bytes in 5.978 second response time
Service Warning[06-05-2024 01:08:10] SERVICE ALERT: mailman01.iad2.fedoraproject.org;http-mailman-internal;WARNING;SOFT;1;HTTP WARNING: HTTP/1.1 200 OK - 55852 bytes in 32.773 second response time
Service Critical[06-05-2024 01:08:06] SERVICE ALERT: lists.fedoraproject.org;http-lists.fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-05-2024 01:04:47] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 101340 bytes in 0.645 second response time
Service Ok[06-05-2024 01:04:34] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 101340 bytes in 0.803 second response time
Service Ok[06-05-2024 01:04:33] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 101025 bytes in 0.374 second response time
Service Critical[06-05-2024 01:03:46] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 13.211 second response time
Service Critical[06-05-2024 01:03:33] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Proxy Error - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 781 bytes in 4.433 second response time
Service Critical[06-05-2024 01:03:33] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 0.194 second response time
Service Ok[06-05-2024 01:03:30] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 101814 bytes in 7.419 second response time
Service Critical[06-05-2024 01:02:33] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 11.228 second response time
Service Critical[06-05-2024 01:02:23] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 11.405 second response time
Host Up[06-05-2024 01:02:16] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.61 ms
Service Ok[06-05-2024 01:02:15] SERVICE ALERT: worker06.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 101530 bytes in 12.044 second response time
Host Down[06-05-2024 01:01:14] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 18%, RTA = 6659.98 ms
Service Critical[06-05-2024 01:01:03] SERVICE ALERT: worker06.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 18.913 second response time

June 05, 2024 00:00

Host Up[06-05-2024 00:56:59] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.80 ms
Host Up[06-05-2024 00:56:29] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.60 ms
Host Down[06-05-2024 00:55:58] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 00:55:28] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-05-2024 00:37:08] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;OK;SOFT;2;HTTP OK: Status line output matched "HTTP/1.0 401 Unauthorized" - 303 bytes in 0.004 second response time
Service Critical[06-05-2024 00:36:08] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Up[06-05-2024 00:32:39] HOST ALERT: buildvm-ppc64le-07.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.72 ms
Host Down[06-05-2024 00:31:38] HOST ALERT: buildvm-ppc64le-07.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 00:30:15] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.32 ms
Host Down[06-05-2024 00:29:14] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-05-2024 00:28:02] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-05-2024 00:20:36] HOST ALERT: proxy36.fedoraproject.org;UP;SOFT;1;SSH OK - OpenSSH_9.3 (protocol 2.0)
Host Down[06-05-2024 00:19:54] HOST ALERT: proxy36.fedoraproject.org;DOWN;SOFT;2;Server answer: Exceeded MaxStartups
Service Ok[06-05-2024 00:19:52] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 14236 bytes in 0.029 second response time
Host Down[06-05-2024 00:19:36] HOST ALERT: proxy36.fedoraproject.org;DOWN;SOFT;1;Server answer: Exceeded MaxStartups
Service Critical[06-05-2024 00:18:52] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host stopped flapping[06-05-2024 00:07:52] HOST FLAPPING ALERT: buildhw-a64-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (4.0% change < 5.0% threshold)