Nagios History

[05-12-2024 23:52:50] HOST FLAPPING ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Critical

[05-12-2024 23:50:51] SERVICE ALERT: backup01.iad2.fedoraproject.org;Swap-Is-Low;CRITICAL;HARD;4;SWAP CRITICAL - 8% free (583 MB out of 8191 MB)
Service Ok

[05-12-2024 23:41:13] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 247 seconds ago
Service Critical

[05-12-2024 23:40:13] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Warning

[05-12-2024 23:29:48] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;HARD;3;DISK WARNING - free space: / 182067 MiB (11.87% inode=100%):
Service Warning

[05-12-2024 23:28:48] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;SOFT;2;DISK WARNING - free space: / 199985 MiB (13.04% inode=100%):
Service Ok

[05-12-2024 23:28:43] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 6168 seconds ago
Service Warning

[05-12-2024 23:27:48] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;SOFT;1;DISK WARNING - free space: / 201010 MiB (13.11% inode=100%):
Service Critical

[05-12-2024 23:27:43] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 23:23:05] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.87 ms
Host Down

[05-12-2024 23:22:04] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 0%, RTA = 5011.70 ms
Service Ok

[05-12-2024 23:16:13] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 5418 seconds ago
Service Critical

[05-12-2024 23:15:13] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 23:03:43] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 4668 seconds ago
Service Critical

[05-12-2024 23:02:43] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.

[05-12-2024 22:57:48] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;OK;HARD;1;DISK OK - free space: / 251230 MiB (16.39% inode=100%):
Service Ok

[05-12-2024 22:56:54] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;2;0 mail(s) in queue
Host Up

[05-12-2024 22:56:52] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok

[05-12-2024 22:56:51] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;OK;SOFT;2;DISK OK - free space: / 93711 MiB (92.50% inode=100%):
Host Down

[05-12-2024 22:56:07] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 22:55:54] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 22:55:51] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 22:51:13] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 3918 seconds ago
Service Critical

[05-12-2024 22:50:09] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Warning

[05-12-2024 22:45:51] SERVICE ALERT: backup01.iad2.fedoraproject.org;Swap-Is-Low;WARNING;HARD;4;SWAP WARNING - 12% free (980 MB out of 8191 MB)
Service Warning

[05-12-2024 22:44:51] SERVICE ALERT: backup01.iad2.fedoraproject.org;Swap-Is-Low;WARNING;SOFT;3;SWAP WARNING - 12% free (980 MB out of 8191 MB)
Service Warning

[05-12-2024 22:43:51] SERVICE ALERT: backup01.iad2.fedoraproject.org;Swap-Is-Low;WARNING;SOFT;2;SWAP WARNING - 12% free (980 MB out of 8191 MB)
Service Warning

[05-12-2024 22:42:51] SERVICE ALERT: backup01.iad2.fedoraproject.org;Swap-Is-Low;WARNING;SOFT;1;SWAP WARNING - 12% free (980 MB out of 8191 MB)
Service Ok

[05-12-2024 22:38:39] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 3164 seconds ago
Service Critical

[05-12-2024 22:37:39] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 22:32:13] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent fedocal messages;OK;SOFT;2;OK: last fedocal message was 34329 seconds ago
Service Critical

[05-12-2024 22:31:12] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent fedocal messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 22:26:09] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 2414 seconds ago
Service Critical

[05-12-2024 22:25:08] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 22:17:50] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.88 ms
Host started flapping

[05-12-2024 22:17:50] HOST FLAPPING ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (22.6% change > 20.0% threshold)
Host Down

[05-12-2024 22:16:49] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 30%, RTA = 6749.56 ms
Service Ok

[05-12-2024 22:03:38] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 1063 seconds ago
Service Critical

[05-12-2024 22:02:32] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.

[05-12-2024 21:57:48] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;HARD;3;DISK WARNING - free space: / 173410 MiB (11.31% inode=100%):
Service started flapping

[05-12-2024 21:57:48] SERVICE FLAPPING ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;STARTED; Service appears to have started flapping (22.8% change >= 20.0% threshold)
Service Warning

[05-12-2024 21:56:48] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;SOFT;2;DISK WARNING - free space: / 185674 MiB (12.11% inode=100%):
Service Warning

[05-12-2024 21:55:47] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;SOFT;1;DISK WARNING - free space: / 202588 MiB (13.21% inode=100%):
Host Up

[05-12-2024 21:41:44] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 66%, RTA = 4795.73 ms
Host Down

[05-12-2024 21:40:39] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 50%, RTA = 6346.21 ms
Host Up

[05-12-2024 21:39:07] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.31 ms
Host Up

[05-12-2024 21:39:06] HOST ALERT: buildvm-ppc64le-16.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.83 ms
Host Up

[05-12-2024 21:39:03] HOST ALERT: buildvm-ppc64le-13.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.64 ms
Host Down

[05-12-2024 21:38:06] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 21:38:05] HOST ALERT: buildvm-ppc64le-16.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 21:38:02] HOST ALERT: buildvm-ppc64le-13.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 21:34:59] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.16 ms
Host Down

[05-12-2024 21:33:58] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 21:29:42] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent fedocal messages;OK;SOFT;2;OK: last fedocal message was 30578 seconds ago
Service Critical

[05-12-2024 21:28:35] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent fedocal messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 21:25:47] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;OK;HARD;1;DISK OK - free space: / 238436 MiB (15.55% inode=100%):
Host stopped flapping

[05-12-2024 21:24:20] HOST FLAPPING ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok

[05-12-2024 21:21:02] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 15196 seconds ago
Service Critical

[05-12-2024 21:19:55] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 21:08:25] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 14439 seconds ago
Service Critical

[05-12-2024 21:07:24] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.

[05-12-2024 20:55:54] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 13688 seconds ago
Service Critical

[05-12-2024 20:54:53] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 20:40:59] HOST ALERT: internetx-gw;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 98.53 ms
Service Ok

[05-12-2024 20:40:11] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;OK;SOFT;2;OK - database koji (0.006644 sec.)
Host Down

[05-12-2024 20:39:58] HOST ALERT: internetx-gw;DOWN;SOFT;1;PING CRITICAL - Packet loss = 77%, RTA = 5244.76 ms
Service Warning

[05-12-2024 20:39:11] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;WARNING;SOFT;1;WARNING - database koji (4.143955 sec.)
Service Ok

[05-12-2024 20:38:32] SERVICE ALERT: koji02.iad2.fedoraproject.org;http-koji;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 56455 bytes in 0.241 second response time
Service Critical

[05-12-2024 20:37:32] SERVICE ALERT: koji02.iad2.fedoraproject.org;http-koji;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok

[05-12-2024 20:33:23] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 12337 seconds ago
Service Critical

[05-12-2024 20:32:19] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 20:20:49] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 11583 seconds ago
Service Critical

[05-12-2024 20:19:48] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 20:13:07] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;OK;SOFT;2;OK - database koji (0.007862 sec.)
Service Warning

[05-12-2024 20:12:07] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;WARNING;SOFT;1;WARNING - database koji (3.095953 sec.)
Service Ok

[05-12-2024 20:08:18] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 10832 seconds ago
Service Critical

[05-12-2024 20:07:17] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 20:00:32] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.96 ms

[05-12-2024 19:59:31] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 19:49:20] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.37 ms
Host Down

[05-12-2024 19:48:19] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host stopped flapping

[05-12-2024 19:45:44] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok

[05-12-2024 19:35:47] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 8881 seconds ago
Service Critical

[05-12-2024 19:34:46] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 19:23:16] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 8130 seconds ago
Service Critical

[05-12-2024 19:22:15] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 19:10:45] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 7379 seconds ago
Service Critical

[05-12-2024 19:09:40] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 19:07:51] HOST ALERT: buildvm-ppc64le-13.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.81 ms
Host Up

[05-12-2024 19:07:50] HOST ALERT: buildvm-ppc64le-06.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.59 ms
Host Down

[05-12-2024 19:06:50] HOST ALERT: buildvm-ppc64le-13.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 19:06:49] HOST ALERT: buildvm-ppc64le-06.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host stopped flapping

[05-12-2024 19:05:44] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Up

[05-12-2024 19:03:08] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.59 ms
Host Down

[05-12-2024 19:02:07] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 19:01:56] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.75 ms
Host Down

[05-12-2024 19:00:55] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 19:00:55] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%

[05-12-2024 18:58:10] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 6624 seconds ago
Service Critical

[05-12-2024 18:57:10] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 18:45:40] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 5874 seconds ago
Service Critical

[05-12-2024 18:44:40] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 18:33:10] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 5124 seconds ago
Service Critical

[05-12-2024 18:32:09] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 18:30:48] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 0%, RTA = 3629.36 ms
Host Down

[05-12-2024 18:29:42] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Warning

[05-12-2024 18:25:47] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;HARD;3;DISK WARNING - free space: / 189301 MiB (12.35% inode=100%):
Service Warning

[05-12-2024 18:24:47] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;SOFT;2;DISK WARNING - free space: / 207724 MiB (13.55% inode=100%):
Service Warning

[05-12-2024 18:23:47] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;SOFT;1;DISK WARNING - free space: / 226423 MiB (14.77% inode=100%):
Service Ok

[05-12-2024 18:22:47] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;OK;SOFT;3;DISK OK - free space: / 244067 MiB (15.92% inode=100%):
Service Warning

[05-12-2024 18:21:47] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;SOFT;2;DISK WARNING - free space: / 178569 MiB (11.65% inode=100%):
Service Warning

[05-12-2024 18:20:47] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;SOFT;1;DISK WARNING - free space: / 178571 MiB (11.65% inode=100%):
Service Ok

[05-12-2024 18:13:35] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi2;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 14325 bytes in 10.983 second response time
Service Ok

[05-12-2024 18:13:23] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 14324 bytes in 2.461 second response time
Host stopped flapping

[05-12-2024 18:13:20] HOST FLAPPING ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)
Service Warning

[05-12-2024 18:12:24] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi2;WARNING;SOFT;2;HTTP WARNING: HTTP/1.1 200 OK - 14325 bytes in 36.251 second response time
Service Critical

[05-12-2024 18:12:21] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical

[05-12-2024 18:10:47] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi2;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Active Testers' not found on 'https://bodhi.fedoraproject.org:443/' - 9401 bytes in 0.026 second response time
Host Up

[05-12-2024 18:10:44] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.95 ms
Host started flapping

[05-12-2024 18:10:44] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (22.4% change > 20.0% threshold)
Service Critical

[05-12-2024 18:10:40] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - 9400 bytes in 0.014 second response time
Host Down

[05-12-2024 18:09:43] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%

[05-12-2024 17:50:47] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;OK;HARD;1;DISK OK - free space: / 251245 MiB (16.39% inode=100%):
Host Up

[05-12-2024 17:36:29] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.79 ms
Host Down

[05-12-2024 17:35:28] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 0%, RTA = 6132.74 ms
Host Up

[05-12-2024 17:30:46] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1691.21 ms
Host Up

[05-12-2024 17:30:44] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.82 ms
Host started flapping

[05-12-2024 17:30:44] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (24.2% change > 20.0% threshold)
Host Down

[05-12-2024 17:29:43] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 17:29:43] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 17:29:32] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.86 ms
Host Up

[05-12-2024 17:29:31] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.57 ms
Service Ok

[05-12-2024 17:28:50] SERVICE ALERT: bvmhost-p09-03.iad2.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Host Down

[05-12-2024 17:28:31] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 17:28:31] HOST ALERT: bvmhost-p09-03.iad2.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Unreachable

[05-12-2024 17:28:31] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UNREACHABLE;SOFT;1;PING CRITICAL - Packet loss = 16%, RTA = 7240.86 ms
Host Unreachable

[05-12-2024 17:28:31] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UNREACHABLE;SOFT;2;PING CRITICAL - Packet loss = 8%, RTA = 6729.19 ms
Host Unreachable

[05-12-2024 17:28:30] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UNREACHABLE;SOFT;1;PING CRITICAL - Packet loss = 9%, RTA = 6467.57 ms
Host Down

[05-12-2024 17:28:19] HOST ALERT: bvmhost-p09-03.iad2.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down

[05-12-2024 17:28:06] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Critical

[05-12-2024 17:27:49] SERVICE ALERT: bvmhost-p09-03.iad2.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 17:20:39] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 773 seconds ago
Service Critical

[05-12-2024 17:19:38] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 17:07:47] SERVICE ALERT: lists.fedoraproject.org;http-lists.fedoraproject.org;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 56239 bytes in 0.514 second response time
Service Critical

[05-12-2024 17:06:46] SERVICE ALERT: lists.fedoraproject.org;http-lists.fedoraproject.org;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - string 'Fedora Mailing-Lists' not found on 'https://lists.fedoraproject.org:443/archives/' - 879 bytes in 3.529 second response time
Service Ok

[05-12-2024 17:01:04] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Host Up

[05-12-2024 17:00:37] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down

[05-12-2024 17:00:33] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 17:00:03] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout

[05-12-2024 16:58:08] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 2076 seconds ago
Service Critical

[05-12-2024 16:57:05] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 16:49:18] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 0%, RTA = 3020.20 ms
Host Down

[05-12-2024 16:48:13] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 16:47:46] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 91%, RTA = 0.57 ms
Host Down

[05-12-2024 16:46:34] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 75%, RTA = 10864.24 ms
Service Ok

[05-12-2024 16:45:35] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 1323 seconds ago
Host Down

[05-12-2024 16:45:22] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 71%, RTA = 6100.12 ms
Service Critical

[05-12-2024 16:44:34] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 16:43:02] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 12.00 ms
Host Down

[05-12-2024 16:42:01] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 16:37:43] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down

[05-12-2024 16:37:18] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 16:23:04] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 3149 seconds ago
Service Critical

[05-12-2024 16:21:58] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 16:17:05] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent fedocal messages;OK;SOFT;2;OK: last fedocal message was 11821 seconds ago
Service Critical

[05-12-2024 16:16:05] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent fedocal messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 16:14:40] HOST ALERT: buildvm-ppc64le-07.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.69 ms
Host Down

[05-12-2024 16:13:39] HOST ALERT: buildvm-ppc64le-07.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 16:12:54] HOST ALERT: buildvm-ppc64le-16.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.58 ms
Host Down

[05-12-2024 16:11:53] HOST ALERT: buildvm-ppc64le-16.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 16:10:28] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 2393 seconds ago
Service Critical

[05-12-2024 16:09:27] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host stopped flapping

[05-12-2024 16:07:55] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Up

[05-12-2024 16:01:37] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.25 ms
Host stopped flapping

[05-12-2024 16:01:35] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)
Host Down

[05-12-2024 16:00:36] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%

[05-12-2024 15:59:15] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host stopped flapping

[05-12-2024 15:56:19] HOST FLAPPING ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (4.0% change < 5.0% threshold)
Host Up

[05-12-2024 15:55:17] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.52 ms
Host Down

[05-12-2024 15:54:16] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 15:47:57] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 1042 seconds ago
Service Critical

[05-12-2024 15:46:56] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 15:46:50] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.96 ms
Host Down

[05-12-2024 15:45:49] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 15:35:26] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 291 seconds ago
Service Critical

[05-12-2024 15:34:25] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 15:12:55] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 18344 seconds ago
Service Critical

[05-12-2024 15:11:44] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host stopped flapping

[05-12-2024 15:01:48] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)
Service Ok

[05-12-2024 15:00:14] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 17583 seconds ago

[05-12-2024 14:59:13] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 14:41:48] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host started flapping

[05-12-2024 14:41:48] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STARTED; Host appears to have started flapping (22.9% change > 20.0% threshold)
Service Ok

[05-12-2024 14:41:48] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Host Down

[05-12-2024 14:41:17] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 14:40:47] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 14:39:18] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok

[05-12-2024 14:39:17] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Host Down

[05-12-2024 14:38:47] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 14:38:17] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 14:37:43] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;OK;SOFT;2;OK: last hotness message was 16232 seconds ago
Service Critical

[05-12-2024 14:36:42] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent hotness messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 14:32:55] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.00 ms
Host Down

[05-12-2024 14:31:54] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 14:31:35] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.13 ms
Host Up

[05-12-2024 14:31:19] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.84 ms
Host Down

[05-12-2024 14:30:34] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 14:30:18] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 33%, RTA = 5927.22 ms
Host Down

[05-12-2024 14:29:22] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 14:29:10] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 14:29:05] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 46.69 ms
Host Down

[05-12-2024 14:28:04] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 14:27:58] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 14:27:21] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent bugzilla messages;OK;SOFT;2;OK: last bugzilla message was 62592 seconds ago
Service Critical

[05-12-2024 14:26:21] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent bugzilla messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 14:24:51] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent bugzilla messages;OK;SOFT;2;OK: last bugzilla message was 62442 seconds ago
Host Up

[05-12-2024 14:24:15] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.92 ms
Service Critical

[05-12-2024 14:23:50] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent bugzilla messages;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down

[05-12-2024 14:23:14] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 14:22:47] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.90 ms
Host Down

[05-12-2024 14:21:46] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 14:20:38] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.67 ms
Host started flapping

[05-12-2024 14:20:38] HOST FLAPPING ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (24.2% change > 20.0% threshold)
Host Down

[05-12-2024 14:19:37] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 14:19:18] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 0%, RTA = 4107.64 ms
Host started flapping

[05-12-2024 14:19:18] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (22.8% change > 20.0% threshold)
Host Down

[05-12-2024 14:18:10] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 14:17:53] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 137.86 ms
Host Down

[05-12-2024 14:16:58] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 14:16:52] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 14:16:35] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.56 ms
Host started flapping

[05-12-2024 14:16:35] HOST FLAPPING ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.9% change > 20.0% threshold)
Host Down

[05-12-2024 14:15:40] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 14:15:34] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 14:14:26] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.65 ms
Host Down

[05-12-2024 14:13:25] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 14:08:53] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Host Up

[05-12-2024 14:08:03] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.94 ms
Service Critical

[05-12-2024 14:07:53] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Down

[05-12-2024 14:07:02] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 14:05:29] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.48 ms
Host Up

[05-12-2024 14:05:23] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.75 ms
Host Down

[05-12-2024 14:04:28] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 14:04:22] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 14:01:51] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.60 ms
Host started flapping

[05-12-2024 14:01:51] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (21.3% change > 20.0% threshold)
Host Up

[05-12-2024 14:01:43] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.79 ms
Host started flapping

[05-12-2024 14:01:43] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.4% change > 20.0% threshold)
Host Down

[05-12-2024 14:00:50] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 14:00:42] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%

[05-12-2024 13:59:21] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2855.42 ms
Host started flapping

[05-12-2024 13:59:21] HOST FLAPPING ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.6% change > 20.0% threshold)
Host Down

[05-12-2024 13:58:16] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 13:51:51] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 40%, RTA = 3206.90 ms
Host Down

[05-12-2024 13:50:46] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 60%, RTA = 7805.18 ms
Host Up

[05-12-2024 13:43:05] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.40 ms
Host Down

[05-12-2024 13:42:04] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 13:41:55] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 128171 bytes in 5.491 second response time
Host Down

[05-12-2024 13:40:52] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Critical

[05-12-2024 13:40:50] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Proxy Error - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 781 bytes in 0.952 second response time
Host Up

[05-12-2024 13:40:31] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.74 ms
Host Down

[05-12-2024 13:39:30] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 13:37:43] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down

[05-12-2024 13:37:43] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down

[05-12-2024 13:36:13] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host stopped flapping

[05-12-2024 13:25:18] HOST FLAPPING ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host stopped flapping

[05-12-2024 13:25:18] HOST FLAPPING ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host stopped flapping

[05-12-2024 13:18:47] HOST FLAPPING ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Up

[05-12-2024 13:00:39] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.25 ms

[05-12-2024 12:59:38] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host stopped flapping

[05-12-2024 12:39:06] HOST FLAPPING ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Up

[05-12-2024 12:38:19] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 50%, RTA = 4918.79 ms
Host Down

[05-12-2024 12:37:13] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 12:36:47] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Service Ok

[05-12-2024 12:36:44] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;OK;SOFT;2;PROCS OK: 532 processes
Service Ok

[05-12-2024 12:36:43] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Service Critical

[05-12-2024 12:35:47] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 12:35:44] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 12:35:43] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host stopped flapping

[05-12-2024 12:35:41] HOST FLAPPING ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Up

[05-12-2024 12:27:55] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.68 ms
Host Down

[05-12-2024 12:26:54] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host stopped flapping

[05-12-2024 12:24:11] HOST FLAPPING ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)
Service Ok

[05-12-2024 12:14:47] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi2;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 14321 bytes in 0.017 second response time
Service Ok

[05-12-2024 12:14:40] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 14325 bytes in 10.113 second response time
Host stopped flapping

[05-12-2024 12:14:19] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok

[05-12-2024 12:13:59] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi2;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 14321 bytes in 0.019 second response time
Service Ok

[05-12-2024 12:13:47] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 14325 bytes in 16.986 second response time
Service Critical

[05-12-2024 12:13:47] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi2;CRITICAL;SOFT;3;CRITICAL - Socket timeout
Service Critical

[05-12-2024 12:13:30] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical

[05-12-2024 12:12:59] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi2;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 200 OK - 14325 bytes in 40.588 second response time
Service Critical

[05-12-2024 12:12:30] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical

[05-12-2024 12:12:06] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi2;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical

[05-12-2024 12:10:49] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical

[05-12-2024 12:10:25] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi2;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Active Testers' not found on 'https://bodhi.fedoraproject.org:443/' - 9400 bytes in 0.026 second response time
Host stopped flapping

[05-12-2024 12:04:27] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)

[05-12-2024 11:55:25] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.28 ms
Host Down

[05-12-2024 11:54:24] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 11:53:12] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 11:50:18] HOST ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.09 ms
Host started flapping

[05-12-2024 11:50:18] HOST FLAPPING ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (24.2% change > 20.0% threshold)
Host Up

[05-12-2024 11:50:18] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.25 ms
Host started flapping

[05-12-2024 11:50:18] HOST FLAPPING ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.7% change > 20.0% threshold)
Host Down

[05-12-2024 11:49:17] HOST ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 33%, RTA = 6157.93 ms
Host Down

[05-12-2024 11:49:17] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 11:44:06] HOST ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.04 ms
Host Up

[05-12-2024 11:43:47] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.99 ms
Host Down

[05-12-2024 11:43:05] HOST ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 11:42:46] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 11:34:06] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.60 ms
Host Down

[05-12-2024 11:33:05] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 27%, RTA = 6819.37 ms
Host stopped flapping

[05-12-2024 11:12:54] HOST FLAPPING ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Up

[05-12-2024 11:04:05] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.88 ms
Host Down

[05-12-2024 11:03:04] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 0%, RTA = 5638.67 ms
Host Up

[05-12-2024 11:00:41] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.73 ms

[05-12-2024 10:59:40] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 10:54:11] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.76 ms
Host started flapping

[05-12-2024 10:54:11] HOST FLAPPING ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (22.8% change > 20.0% threshold)
Host Down

[05-12-2024 10:53:10] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 70%, RTA = 8539.29 ms
Host Up

[05-12-2024 10:52:54] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.53 ms
Host Down

[05-12-2024 10:52:00] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 10:51:53] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 10:46:39] HOST ALERT: buildvm-ppc64le-13.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.77 ms
Host Down

[05-12-2024 10:45:38] HOST ALERT: buildvm-ppc64le-13.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 10:44:52] SERVICE ALERT: bvmhost-p09-03.iad2.fedoraproject.org;Total Processes;OK;SOFT;2;PROCS OK: 1645 processes
Service Critical

[05-12-2024 10:43:52] SERVICE ALERT: bvmhost-p09-03.iad2.fedoraproject.org;Total Processes;CRITICAL;SOFT;1;CRITICAL - Plugin timed out
Host Up

[05-12-2024 10:39:19] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.86 ms
Host started flapping

[05-12-2024 10:39:19] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (21.8% change > 20.0% threshold)
Host Down

[05-12-2024 10:38:18] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 75%, RTA = 7319.68 ms
Host Up

[05-12-2024 10:37:35] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.49 ms
Host started flapping

[05-12-2024 10:37:35] HOST FLAPPING ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.8% change > 20.0% threshold)
Host Down

[05-12-2024 10:36:34] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 81%, RTA = 10105.74 ms
Host Down

[05-12-2024 10:35:23] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 37%, RTA = 5173.38 ms
Host Up

[05-12-2024 10:31:49] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.98 ms
Host Down

[05-12-2024 10:30:48] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 10:30:37] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.38 ms
Host Up

[05-12-2024 10:30:17] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.67 ms
Host Down

[05-12-2024 10:29:36] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 10:29:36] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 10:29:29] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.67 ms
Host Up

[05-12-2024 10:29:27] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.86 ms
Host Down

[05-12-2024 10:29:16] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 10:28:28] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 10:28:26] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 10:28:24] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 10:27:02] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.94 ms
Host Up

[05-12-2024 10:26:48] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 0%, RTA = 3658.50 ms
Host Down

[05-12-2024 10:26:01] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 10:25:41] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 10:24:29] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%

[05-12-2024 09:53:01] HOST FLAPPING ALERT: buildhw-a64-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (4.0% change < 5.0% threshold)
Host Up

[05-12-2024 09:49:18] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.93 ms
Host started flapping

[05-12-2024 09:49:18] HOST FLAPPING ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.8% change > 20.0% threshold)
Host Up

[05-12-2024 09:48:17] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 186.87 ms
Host started flapping

[05-12-2024 09:48:17] HOST FLAPPING ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.2% change > 20.0% threshold)
Host Down

[05-12-2024 09:48:17] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 66%, RTA = 5143.82 ms
Host Up

[05-12-2024 09:48:15] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.82 ms
Host started flapping

[05-12-2024 09:48:15] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.2% change > 20.0% threshold)
Host Up

[05-12-2024 09:48:12] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.82 ms
Host Down

[05-12-2024 09:47:16] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 09:47:14] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 70%, RTA = 8929.15 ms
Host Down

[05-12-2024 09:47:11] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 09:47:10] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 09:42:00] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.92 ms
Host Down

[05-12-2024 09:40:59] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 63%, RTA = 8851.30 ms
Host Up

[05-12-2024 09:37:54] HOST ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.82 ms
Host started flapping

[05-12-2024 09:37:54] HOST FLAPPING ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.2% change > 20.0% threshold)
Host Down

[05-12-2024 09:36:53] HOST ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 09:22:05] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.04 ms
Host Up

[05-12-2024 09:22:05] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.34 ms
Host Down

[05-12-2024 09:21:04] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 09:21:04] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host stopped flapping

[05-12-2024 09:19:05] HOST FLAPPING ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Up

[05-12-2024 09:17:08] HOST ALERT: openqa-a64-worker01.iad2.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down

[05-12-2024 09:16:08] HOST ALERT: openqa-a64-worker01.iad2.fedoraproject.org;DOWN;SOFT;2;(Host check timed out after 30.01 seconds)
Host Down

[05-12-2024 09:14:38] HOST ALERT: openqa-a64-worker01.iad2.fedoraproject.org;DOWN;SOFT;1;(Host check timed out after 30.00 seconds)
Host Up

[05-12-2024 09:11:42] HOST ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.79 ms
Host Down

[05-12-2024 09:10:41] HOST ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 09:10:29] SERVICE ALERT: bvmhost-p09-02.iad2.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Service Critical

[05-12-2024 09:09:28] SERVICE ALERT: bvmhost-p09-02.iad2.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CRITICAL - Plugin timed out

[05-12-2024 08:46:04] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;OK;SOFT;2;OK - database koji (0.006316 sec.)
Service Warning

[05-12-2024 08:45:04] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;WARNING;SOFT;1;WARNING - database koji (3.969047 sec.)
Service Ok

[05-12-2024 08:39:37] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Service Critical

[05-12-2024 08:38:37] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 08:28:04] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 60%, RTA = 0.31 ms
Host Down

[05-12-2024 08:27:00] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 08:25:48] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 08:24:36] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host stopped flapping

[05-12-2024 08:22:56] HOST FLAPPING ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok

[05-12-2024 08:17:14] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Service Critical

[05-12-2024 08:16:14] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CRITICAL - Plugin timed out
Service Ok

[05-12-2024 08:00:21] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 128641 bytes in 2.300 second response time
Service Ok

[05-12-2024 08:00:21] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 128641 bytes in 3.821 second response time
Service Ok

[05-12-2024 08:00:20] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 128641 bytes in 3.504 second response time
Service Ok

[05-12-2024 08:00:20] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 128641 bytes in 1.392 second response time
Service Ok

[05-12-2024 08:00:20] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 128325 bytes in 1.251 second response time
Service Ok

[05-12-2024 08:00:20] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 128646 bytes in 1.141 second response time
Service Ok

[05-12-2024 08:00:19] SERVICE ALERT: proxy04.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 128641 bytes in 2.100 second response time

[05-12-2024 07:59:25] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.27 ms
Host started flapping

[05-12-2024 07:59:25] HOST FLAPPING ALERT: buildhw-a64-23.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.0% change > 20.0% threshold)
Service Critical

[05-12-2024 07:59:19] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 593 bytes in 0.888 second response time
Service Critical

[05-12-2024 07:59:19] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 26.056 second response time
Service Critical

[05-12-2024 07:59:19] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 599 bytes in 1.435 second response time
Service Critical

[05-12-2024 07:59:19] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 1.948 second response time
Service Critical

[05-12-2024 07:59:17] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 14.609 second response time
Service Critical

[05-12-2024 07:59:17] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 25.229 second response time
Service Critical

[05-12-2024 07:59:17] SERVICE ALERT: proxy04.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 22.193 second response time
Host Down

[05-12-2024 07:58:24] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;4;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 07:57:12] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 07:56:00] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 07:54:48] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 07:49:37] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.53 ms
Service Ok

[05-12-2024 07:49:00] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;OK;SOFT;2;OK - database koji (0.009462 sec.)
Host Down

[05-12-2024 07:48:36] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Warning

[05-12-2024 07:48:00] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;WARNING;SOFT;1;WARNING - database koji (2.110435 sec.)
Host Up

[05-12-2024 07:47:07] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok

[05-12-2024 07:47:07] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Host Down

[05-12-2024 07:46:37] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;(Host check timed out after 30.01 seconds)
Service Critical

[05-12-2024 07:46:07] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 07:45:53] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.84 ms
Host Up

[05-12-2024 07:45:53] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.04 ms
Service Ok

[05-12-2024 07:44:53] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 132981 bytes in 8.061 second response time
Host Down

[05-12-2024 07:44:52] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 07:44:52] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 07:44:05] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.61 ms
Host started flapping

[05-12-2024 07:44:05] HOST FLAPPING ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (21.4% change > 20.0% threshold)
Service Critical

[05-12-2024 07:43:45] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.777 second response time
Host Down

[05-12-2024 07:43:04] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 07:41:59] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.03 ms
Host Down

[05-12-2024 07:40:58] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 60%, RTA = 5493.62 ms
Host Up

[05-12-2024 07:39:26] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.81 ms
Host Down

[05-12-2024 07:38:24] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 07:37:12] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 07:06:58] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;OK;SOFT;2;OK - database koji (0.007624 sec.)
Service Warning

[05-12-2024 07:05:58] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;WARNING;SOFT;1;WARNING - database koji (3.416554 sec.)
Service Ok

[05-12-2024 07:04:26] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Service Critical

[05-12-2024 07:03:26] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 07:03:22] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 233.09 ms
Service Warning

[05-12-2024 07:02:15] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 233.10 ms

[05-12-2024 06:50:37] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 241.50 ms
Service Warning

[05-12-2024 06:49:31] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 44%, RTA = 241.61 ms
Host Up

[05-12-2024 06:49:20] HOST ALERT: buildvm-ppc64le-09.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.65 ms
Host Down

[05-12-2024 06:48:19] HOST ALERT: buildvm-ppc64le-09.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 06:47:56] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.65 ms
Host started flapping

[05-12-2024 06:47:56] HOST FLAPPING ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (22.4% change > 20.0% threshold)
Host Up

[05-12-2024 06:47:53] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.78 ms
Host Down

[05-12-2024 06:46:55] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 06:46:52] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 54%, RTA = 7772.10 ms
Host Up

[05-12-2024 06:46:43] HOST ALERT: buildvm-ppc64le-16.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1179.66 ms
Host Up

[05-12-2024 06:46:43] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.47 ms
Host Down

[05-12-2024 06:45:42] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 06:45:41] HOST ALERT: buildvm-ppc64le-16.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 06:45:41] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 06:41:07] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 233.27 ms
Service Warning

[05-12-2024 06:40:00] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 231.62 ms
Host Up

[05-12-2024 06:37:26] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down

[05-12-2024 06:36:26] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 06:34:54] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;OK;SOFT;2;OK - database koji (0.007220 sec.)
Service Critical

[05-12-2024 06:33:54] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;CRITICAL;SOFT;1;CRITICAL - Plugin timed out
Service Ok

[05-12-2024 06:30:51] SERVICE ALERT: koji02.iad2.fedoraproject.org;http-koji;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 56449 bytes in 0.297 second response time
Service Critical

[05-12-2024 06:29:51] SERVICE ALERT: koji02.iad2.fedoraproject.org;http-koji;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok

[05-12-2024 06:28:10] SERVICE ALERT: koji02.iad2.fedoraproject.org;http-koji;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 56449 bytes in 13.528 second response time
Service Ok

[05-12-2024 06:27:44] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;OK;SOFT;2;OK - database koji (0.028536 sec.)
Service Warning

[05-12-2024 06:26:56] SERVICE ALERT: koji02.iad2.fedoraproject.org;http-koji;WARNING;SOFT;1;HTTP WARNING: HTTP/1.1 200 OK - 56451 bytes in 33.718 second response time
Service Critical

[05-12-2024 06:26:44] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;CRITICAL;SOFT;1;CRITICAL - Plugin timed out
Service Ok

[05-12-2024 06:19:08] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 14321 bytes in 0.019 second response time
Service Ok

[05-12-2024 06:18:52] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 232.00 ms
Service Critical

[05-12-2024 06:18:08] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Warning

[05-12-2024 06:17:45] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 231.22 ms
Service Ok

[05-12-2024 06:16:49] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 14324 bytes in 1.405 second response time
Service Ok

[05-12-2024 06:16:18] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi2;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 14324 bytes in 9.754 second response time
Service Critical

[05-12-2024 06:15:48] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical

[05-12-2024 06:15:08] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi2;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok

[05-12-2024 06:13:42] SERVICE ALERT: koji01.iad2.fedoraproject.org;http-koji;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 56446 bytes in 3.063 second response time
Service Warning

[05-12-2024 06:12:39] SERVICE ALERT: koji01.iad2.fedoraproject.org;http-koji;WARNING;SOFT;1;HTTP WARNING: HTTP/1.1 200 OK - 56457 bytes in 32.003 second response time
Host Up

[05-12-2024 06:10:32] HOST ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 33%, RTA = 2324.80 ms
Host Down

[05-12-2024 06:09:29] HOST ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 40%, RTA = 7283.50 ms
Host Up

[05-12-2024 06:09:23] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 20%, RTA = 2655.24 ms
Host Down

[05-12-2024 06:08:19] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 06:08:19] HOST ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 06:07:34] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 244.85 ms
Host Up

[05-12-2024 06:06:44] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.26 ms
Service Warning

[05-12-2024 06:06:28] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 244.48 ms
Host Down

[05-12-2024 06:05:43] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 06:03:20] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;OK;SOFT;2;HTTP OK: Status line output matched "HTTP/1.0 401 Unauthorized" - 303 bytes in 7.373 second response time
Service Critical

[05-12-2024 06:02:13] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;1;CRITICAL - Socket timeout

[05-12-2024 05:56:35] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 231.85 ms
Service Warning

[05-12-2024 05:55:29] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 231.63 ms
Service Ok

[05-12-2024 05:51:56] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Service Critical

[05-12-2024 05:50:56] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 05:47:19] SERVICE ALERT: proxy32.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 34059 bytes in 0.906 second response time
Service Critical

[05-12-2024 05:46:18] SERVICE ALERT: proxy32.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'MediaWiki is free software' not found on 'https://fedoraproject.org:443/wiki/Special:Version' - 3060 bytes in 0.560 second response time
Service Ok

[05-12-2024 05:45:26] SERVICE ALERT: proxy39.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 34105 bytes in 1.915 second response time
Service Ok

[05-12-2024 05:45:18] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;3;PING OK - Packet loss = 0%, RTA = 244.67 ms
Service Critical

[05-12-2024 05:44:25] SERVICE ALERT: proxy39.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'MediaWiki is free software' not found on 'https://fedoraproject.org:443/wiki/Special:Version' - 3077 bytes in 1.340 second response time
Service Warning

[05-12-2024 05:44:12] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;2;PING WARNING - Packet loss = 28%, RTA = 244.94 ms
Service Warning

[05-12-2024 05:43:04] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 244.72 ms
Service Ok

[05-12-2024 05:41:53] SERVICE ALERT: proxy34.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 34052 bytes in 1.434 second response time
Service Critical

[05-12-2024 05:40:51] SERVICE ALERT: proxy34.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'MediaWiki is free software' not found on 'https://fedoraproject.org:443/wiki/Special:Version' - 3077 bytes in 0.748 second response time
Host Up

[05-12-2024 05:40:50] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.75 ms
Host Up

[05-12-2024 05:40:50] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.07 ms
Host Up

[05-12-2024 05:40:50] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.92 ms
Host Down

[05-12-2024 05:39:49] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 77%, RTA = 7905.86 ms
Host Down

[05-12-2024 05:39:49] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 77%, RTA = 8096.33 ms
Host Down

[05-12-2024 05:39:49] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 66%, RTA = 7519.84 ms
Service Ok

[05-12-2024 05:39:39] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 34004 bytes in 0.178 second response time
Service Critical

[05-12-2024 05:38:39] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'MediaWiki is free software' not found on 'https://fedoraproject.org:443/wiki/Special:Version' - 3070 bytes in 0.031 second response time
Host Up

[05-12-2024 05:38:13] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.68 ms
Host Down

[05-12-2024 05:37:12] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 05:37:01] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.88 ms
Host Down

[05-12-2024 05:36:00] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 62%, RTA = 6472.74 ms
Host Down

[05-12-2024 05:36:00] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 37%, RTA = 5415.78 ms
Service Ok

[05-12-2024 05:34:37] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Service Ok

[05-12-2024 05:34:24] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;2;0 mail(s) in queue
Service Ok

[05-12-2024 05:34:22] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 231.63 ms
Service Critical

[05-12-2024 05:33:37] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 05:33:24] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Warning

[05-12-2024 05:33:16] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 231.76 ms
Service Ok

[05-12-2024 05:28:20] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 244.45 ms
Service Warning

[05-12-2024 05:27:13] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 241.50 ms
Host stopped flapping

[05-12-2024 05:20:53] HOST FLAPPING ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok

[05-12-2024 05:14:04] SERVICE ALERT: proxy30.fedoraproject.org;http-fedoraproject.org-wiki;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 19457 bytes in 3.811 second response time
Service Critical

[05-12-2024 05:13:00] SERVICE ALERT: proxy30.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Proxy Error - string 'Looking for help' not found on 'https://fedoraproject.org:443/wiki/Fedora_Project_Wiki' - 773 bytes in 1.000 second response time
Service Ok

[05-12-2024 05:12:08] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 232.23 ms
Service Ok

[05-12-2024 05:11:56] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 245.09 ms
Service Warning

[05-12-2024 05:11:02] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 231.77 ms
Host stopped flapping

[05-12-2024 05:10:53] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Warning

[05-12-2024 05:10:47] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 44%, RTA = 245.22 ms
Host stopped flapping

[05-12-2024 05:05:27] HOST FLAPPING ALERT: buildvm-ppc64le-13.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)

[05-12-2024 04:59:41] HOST FLAPPING ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)
Service Ok

[05-12-2024 04:56:05] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 245.00 ms
Service Warning

[05-12-2024 04:54:57] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 244.63 ms
Host stopped flapping

[05-12-2024 04:54:41] HOST FLAPPING ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host stopped flapping

[05-12-2024 04:49:41] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok

[05-12-2024 04:48:41] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 129683 bytes in 3.027 second response time
Service Ok

[05-12-2024 04:48:18] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 129335 bytes in 1.735 second response time
Service Ok

[05-12-2024 04:48:17] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 129340 bytes in 0.756 second response time
Service Ok

[05-12-2024 04:48:17] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 129020 bytes in 0.505 second response time
Service Ok

[05-12-2024 04:48:02] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 127974 bytes in 10.072 second response time
Service Ok

[05-12-2024 04:47:52] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 127507 bytes in 13.129 second response time
Service Ok

[05-12-2024 04:47:43] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 127403 bytes in 3.681 second response time
Service Critical

[05-12-2024 04:47:38] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.569 second response time
Service Ok

[05-12-2024 04:47:20] SERVICE ALERT: proxy35.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 128457 bytes in 17.212 second response time
Service Critical

[05-12-2024 04:47:17] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 8.380 second response time
Service Critical

[05-12-2024 04:47:17] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 600 bytes in 16.710 second response time
Service Critical

[05-12-2024 04:47:17] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 16.498 second response time
Service Ok

[05-12-2024 04:47:10] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 128462 bytes in 8.625 second response time
Service Ok

[05-12-2024 04:47:09] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 128140 bytes in 8.727 second response time
Service Critical

[05-12-2024 04:46:52] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 14.672 second response time
Service Critical

[05-12-2024 04:46:39] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 2.041 second response time
Service Critical

[05-12-2024 04:46:39] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 2.043 second response time
Service Ok

[05-12-2024 04:46:36] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 127388 bytes in 13.717 second response time
Service Critical

[05-12-2024 04:46:03] SERVICE ALERT: proxy35.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.552 second response time
Service Critical

[05-12-2024 04:46:01] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9401 bytes in 0.017 second response time
Service Critical

[05-12-2024 04:46:00] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.005 second response time
Service Critical

[05-12-2024 04:46:00] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.004 second response time
Service Critical

[05-12-2024 04:46:00] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9400 bytes in 0.014 second response time
Service Critical

[05-12-2024 04:45:38] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 15.011 second response time
Service Critical

[05-12-2024 04:45:37] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 24.775 second response time
Service Critical

[05-12-2024 04:45:37] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 10.687 second response time
Host stopped flapping

[05-12-2024 04:45:30] HOST FLAPPING ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Critical

[05-12-2024 04:45:22] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 10.602 second response time
Service Ok

[05-12-2024 04:43:48] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 244.39 ms
Service Warning

[05-12-2024 04:42:40] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 244.71 ms
Service Ok

[05-12-2024 04:39:38] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 248.88 ms
Service Warning

[05-12-2024 04:38:32] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 249.35 ms
Service Ok

[05-12-2024 04:37:23] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 249.09 ms
Service Warning

[05-12-2024 04:36:17] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 248.86 ms
Host Up

[05-12-2024 04:33:25] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.29 ms
Host Down

[05-12-2024 04:32:24] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 04:31:12] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 04:30:00] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host stopped flapping

[05-12-2024 04:20:31] HOST FLAPPING ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok

[05-12-2024 04:20:09] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 120563 bytes in 2.599 second response time
Service Ok

[05-12-2024 04:20:09] SERVICE ALERT: worker06.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 120247 bytes in 1.347 second response time
Service Ok

[05-12-2024 04:20:08] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 120569 bytes in 1.042 second response time
Service Ok

[05-12-2024 04:20:02] SERVICE ALERT: proxy35.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 120897 bytes in 3.094 second response time
Service Ok

[05-12-2024 04:20:01] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 120903 bytes in 2.117 second response time
Service Ok

[05-12-2024 04:20:00] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 120902 bytes in 1.256 second response time
Service Ok

[05-12-2024 04:20:00] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 120581 bytes in 1.164 second response time
Service Ok

[05-12-2024 04:20:00] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 120581 bytes in 1.092 second response time
Service Ok

[05-12-2024 04:19:57] SERVICE ALERT: proxy32.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 120897 bytes in 2.292 second response time
Service Ok

[05-12-2024 04:19:49] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 120897 bytes in 9.184 second response time
Service Ok

[05-12-2024 04:19:26] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 120109 bytes in 9.051 second response time
Service Ok

[05-12-2024 04:19:23] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 120109 bytes in 6.252 second response time
Service Ok

[05-12-2024 04:19:12] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 120344 bytes in 23.198 second response time
Service Ok

[05-12-2024 04:19:12] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 120344 bytes in 22.823 second response time
Service Ok

[05-12-2024 04:19:10] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 120344 bytes in 21.501 second response time
Service Ok

[05-12-2024 04:19:10] SERVICE ALERT: proxy40.fedoraproject.org;http-koschei;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 120344 bytes in 21.169 second response time
Service Ok

[05-12-2024 04:19:09] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 120344 bytes in 19.802 second response time
Service Ok

[05-12-2024 04:19:07] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 120344 bytes in 18.803 second response time
Service Ok

[05-12-2024 04:19:07] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 120344 bytes in 18.666 second response time
Service Critical

[05-12-2024 04:19:07] SERVICE ALERT: worker06.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.005 second response time
Service Ok

[05-12-2024 04:19:07] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 120344 bytes in 18.366 second response time
Service Critical

[05-12-2024 04:19:07] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9401 bytes in 0.020 second response time
Service Critical

[05-12-2024 04:19:07] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.524 second response time
Service Ok

[05-12-2024 04:19:07] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 120027 bytes in 17.905 second response time
Service Critical

[05-12-2024 04:18:59] SERVICE ALERT: proxy35.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 24.755 second response time
Service Critical

[05-12-2024 04:18:59] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 600 bytes in 20.431 second response time
Service Critical

[05-12-2024 04:18:59] SERVICE ALERT: proxy110.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 601 bytes in 26.477 second response time
Service Critical

[05-12-2024 04:18:59] SERVICE ALERT: worker04.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 25.703 second response time
Service Critical

[05-12-2024 04:18:59] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 21.159 second response time
Service Critical

[05-12-2024 04:18:55] SERVICE ALERT: proxy32.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Warning

[05-12-2024 04:18:40] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;WARNING;SOFT;2;HTTP WARNING: HTTP/1.1 200 OK - 120340 bytes in 33.472 second response time
Service Critical

[05-12-2024 04:18:17] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 37.913 second response time
Service Critical

[05-12-2024 04:18:17] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 28.620 second response time
Service Warning

[05-12-2024 04:18:07] SERVICE ALERT: worker06.ocp.iad2.fedoraproject.org;http-koschei-internal;WARNING;SOFT;3;HTTP WARNING: HTTP/1.1 200 OK - 119055 bytes in 36.151 second response time
Service Warning

[05-12-2024 04:18:07] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;WARNING;SOFT;3;HTTP WARNING: HTTP/1.1 200 OK - 119378 bytes in 36.113 second response time
Service Warning

[05-12-2024 04:18:06] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;WARNING;SOFT;3;HTTP WARNING: HTTP/1.1 200 OK - 119372 bytes in 37.049 second response time
Service Ok

[05-12-2024 04:17:54] SERVICE ALERT: proxy04.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 119372 bytes in 25.651 second response time
Service Ok

[05-12-2024 04:17:53] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 119372 bytes in 24.085 second response time
Service Critical

[05-12-2024 04:17:49] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 26.295 second response time
Service Critical

[05-12-2024 04:17:49] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 28.449 second response time
Service Critical

[05-12-2024 04:17:49] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 20.538 second response time
Service Critical

[05-12-2024 04:17:49] SERVICE ALERT: proxy40.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 19.173 second response time
Service Critical

[05-12-2024 04:17:49] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 31.255 second response time
Service Critical

[05-12-2024 04:17:49] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 21.939 second response time
Service Critical

[05-12-2024 04:17:49] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 21.985 second response time
Service Critical

[05-12-2024 04:17:49] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 26.741 second response time
Service Critical

[05-12-2024 04:17:49] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 19.991 second response time
Service Ok

[05-12-2024 04:17:38] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 119414 bytes in 11.636 second response time
Service Ok

[05-12-2024 04:17:38] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 119092 bytes in 10.915 second response time
Service Critical

[05-12-2024 04:17:07] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 24.505 second response time
Service Ok

[05-12-2024 04:16:48] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 119422 bytes in 15.185 second response time
Service Critical

[05-12-2024 04:16:39] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 20.122 second response time
Service Critical

[05-12-2024 04:16:31] SERVICE ALERT: worker06.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.005 second response time
Service Critical

[05-12-2024 04:16:31] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9401 bytes in 0.015 second response time
Service Critical

[05-12-2024 04:16:30] SERVICE ALERT: proxy40.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.822 second response time
Service Critical

[05-12-2024 04:16:29] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 0.521 second response time
Service Critical

[05-12-2024 04:16:29] SERVICE ALERT: proxy04.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.105 second response time
Service Critical

[05-12-2024 04:16:29] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.083 second response time
Service Critical

[05-12-2024 04:16:29] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.004 second response time
Service Critical

[05-12-2024 04:16:28] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.544 second response time
Service Critical

[05-12-2024 04:16:27] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.147 second response time
Service Critical

[05-12-2024 04:16:27] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9396 bytes in 0.097 second response time
Service Critical

[05-12-2024 04:16:27] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9400 bytes in 0.013 second response time
Service Critical

[05-12-2024 04:16:27] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.004 second response time
Service Critical

[05-12-2024 04:16:23] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.845 second response time
Service Ok

[05-12-2024 04:15:34] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;OK;SOFT;3;OK - database koji (0.109872 sec.)
Service Critical

[05-12-2024 04:15:33] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9398 bytes in 2.877 second response time
Host stopped flapping

[05-12-2024 04:15:32] HOST FLAPPING ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Critical

[05-12-2024 04:15:31] SERVICE ALERT: worker06.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.0 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 8962 bytes in 0.005 second response time
Service Critical

[05-12-2024 04:15:31] SERVICE ALERT: proxy101.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9401 bytes in 0.015 second response time
Host stopped flapping

[05-12-2024 04:15:30] HOST FLAPPING ALERT: buildvm-ppc64le-16.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Critical

[05-12-2024 04:15:29] SERVICE ALERT: proxy40.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 26.863 second response time
Service Critical

[05-12-2024 04:15:29] SERVICE ALERT: proxy06.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 24.254 second response time
Service Critical

[05-12-2024 04:15:29] SERVICE ALERT: proxy04.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 28.095 second response time
Service Critical

[05-12-2024 04:15:29] SERVICE ALERT: proxy03.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 26.179 second response time
Service Critical

[05-12-2024 04:15:29] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 28.236 second response time
Service Critical

[05-12-2024 04:15:27] SERVICE ALERT: proxy39.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 35.128 second response time
Service Critical

[05-12-2024 04:15:27] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 24.880 second response time
Service Critical

[05-12-2024 04:15:27] SERVICE ALERT: proxy12.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 595 bytes in 23.481 second response time
Service Critical

[05-12-2024 04:15:27] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 600 bytes in 23.249 second response time
Service Critical

[05-12-2024 04:15:27] SERVICE ALERT: worker03.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 25.675 second response time
Service Critical

[05-12-2024 04:15:21] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.841 second response time
Service Critical

[05-12-2024 04:15:19] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 1.957 second response time
Service Warning

[05-12-2024 04:14:34] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;WARNING;SOFT;2;WARNING - database koji (5.429253 sec.)
Service Critical

[05-12-2024 04:14:30] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 9397 bytes in 2.610 second response time
Service Critical

[05-12-2024 04:14:19] SERVICE ALERT: proxy37.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 3.717 second response time
Service Critical

[05-12-2024 04:14:17] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 4.769 second response time
Service Critical

[05-12-2024 04:13:28] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;CRITICAL;SOFT;1;CRITICAL - Plugin timed out
Service Ok

[05-12-2024 04:07:18] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;OK;SOFT;2;OK - database koji (1.458338 sec.)
Service Warning

[05-12-2024 04:06:17] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;WARNING;SOFT;1;WARNING - database koji (4.344021 sec.)
Service Ok

[05-12-2024 04:05:13] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;OK;SOFT;4;OK - database koji (0.028452 sec.)
Service Critical

[05-12-2024 04:04:13] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;CRITICAL;SOFT;3;CRITICAL - Plugin timed out
Service Critical

[05-12-2024 04:03:03] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;CRITICAL;SOFT;2;CRITICAL - Plugin timed out
Service Warning

[05-12-2024 04:01:53] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;WARNING;SOFT;1;WARNING - database koji (6.088305 sec.)
Service Ok

[05-12-2024 04:01:30] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 241.97 ms
Service Warning

[05-12-2024 04:00:25] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 242.17 ms

[05-12-2024 03:56:34] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent rpm sign messages;OK;HARD;1;OK: last org.fedoraproject.prod.buildsys.rpm.sign message was 0 seconds ago
Service Ok

[05-12-2024 03:55:47] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;OK;SOFT;3;OK - database koji (0.007647 sec.)
Service Critical

[05-12-2024 03:54:46] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;CRITICAL;SOFT;2;CRITICAL - Plugin timed out
Service Warning

[05-12-2024 03:54:40] SERVICE ALERT: db01.iad2.fedoraproject.org;Disk_Space_/;WARNING;HARD;3;DISK WARNING - free space: / 74971 MiB (10.52% inode=100%):
Service Warning

[05-12-2024 03:53:36] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;WARNING;SOFT;1;WARNING - database koji (4.398263 sec.)
Service Ok

[05-12-2024 03:46:08] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 117461 bytes in 1.631 second response time
Host Up

[05-12-2024 03:45:53] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.65 ms
Service Critical

[05-12-2024 03:45:06] SERVICE ALERT: proxy02.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Proxy Error - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 781 bytes in 0.443 second response time
Host Down

[05-12-2024 03:44:52] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 03:35:53] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.78 ms
Host started flapping

[05-12-2024 03:35:53] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (22.1% change > 20.0% threshold)
Host Up

[05-12-2024 03:34:52] HOST ALERT: bvmhost-p09-03.iad2.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Unreachable

[05-12-2024 03:34:52] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UNREACHABLE;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 03:34:41] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.26 ms
Host Down

[05-12-2024 03:34:40] HOST ALERT: bvmhost-p09-03.iad2.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down

[05-12-2024 03:34:28] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 03:34:10] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.58 ms
Host Down

[05-12-2024 03:33:09] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 75%, RTA = 7466.27 ms
Host Down

[05-12-2024 03:32:01] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 03:30:27] HOST ALERT: buildvm-ppc64le-13.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.67 ms
Host started flapping

[05-12-2024 03:30:27] HOST FLAPPING ALERT: buildvm-ppc64le-13.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (20.3% change > 20.0% threshold)
Host Down

[05-12-2024 03:29:26] HOST ALERT: buildvm-ppc64le-13.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 03:26:50] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 81.56 ms
Host Down

[05-12-2024 03:25:49] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 03:24:52] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.57 ms
Host Up

[05-12-2024 03:24:17] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.53 ms
Host started flapping

[05-12-2024 03:24:17] HOST FLAPPING ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (20.3% change > 20.0% threshold)
Host Down

[05-12-2024 03:23:51] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 03:23:16] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 03:22:39] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 03:22:29] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1691.77 ms
Host Down

[05-12-2024 03:21:26] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Warning

[05-12-2024 03:20:47] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;HARD;3;DISK WARNING - free space: / 229974 MiB (15.00% inode=100%):
Service Ok

[05-12-2024 03:19:52] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;3;PING OK - Packet loss = 16%, RTA = 233.55 ms
Service Warning

[05-12-2024 03:19:47] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;SOFT;2;DISK WARNING - free space: / 229982 MiB (15.00% inode=100%):
Service Warning

[05-12-2024 03:18:47] SERVICE ALERT: db-datanommer02.iad2.fedoraproject.org;Disk_Space_/;WARNING;SOFT;1;DISK WARNING - free space: / 229982 MiB (15.00% inode=100%):
Service Warning

[05-12-2024 03:18:44] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;2;PING WARNING - Packet loss = 44%, RTA = 234.09 ms
Service Warning

[05-12-2024 03:17:33] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 233.57 ms
Service Critical

[05-12-2024 03:16:33] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent rpm sign messages;CRITICAL;HARD;3;CRIT: no org.fedoraproject.prod.buildsys.rpm.sign messages in 14400 seconds
Host Up

[05-12-2024 03:14:59] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.46 ms
Host Down

[05-12-2024 03:13:58] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 03:12:38] SERVICE ALERT: proxy11.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 9399 bytes in 7.839 second response time
Service Warning

[05-12-2024 03:11:30] SERVICE ALERT: proxy11.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;WARNING;SOFT;2;HTTP WARNING: HTTP/1.1 200 OK - 9397 bytes in 31.722 second response time
Service Ok

[05-12-2024 03:11:16] SERVICE ALERT: proxy11.fedoraproject.org;http-fedoraproject.org-hotspot.txt;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 414 bytes in 4.183 second response time
Service Ok

[05-12-2024 03:11:16] SERVICE ALERT: proxy11.fedoraproject.org;http-fedoraproject.org;OK;SOFT;2;HTTP OK: HTTP/1.1 302 Found - 475 bytes in 4.943 second response time
Host Up

[05-12-2024 03:11:15] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.40 ms
Host started flapping

[05-12-2024 03:11:15] HOST FLAPPING ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (22.8% change > 20.0% threshold)
Host Up

[05-12-2024 03:10:30] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.28 ms
Host Down

[05-12-2024 03:10:14] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 60%, RTA = 8172.89 ms
Service Critical

[05-12-2024 03:10:12] SERVICE ALERT: proxy11.fedoraproject.org;http-fedoraproject.org-hotspot.txt;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical

[05-12-2024 03:10:11] SERVICE ALERT: proxy11.fedoraproject.org;http-fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical

[05-12-2024 03:09:58] SERVICE ALERT: proxy11.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Down

[05-12-2024 03:09:29] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 03:09:04] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 50%, RTA = 6520.96 ms
Host stopped flapping

[05-12-2024 03:08:08] HOST FLAPPING ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok

[05-12-2024 03:06:25] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 233.59 ms
Service Warning

[05-12-2024 03:05:19] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 233.52 ms
Host Up

[05-12-2024 03:00:38] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.64 ms

[05-12-2024 02:59:37] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 02:58:47] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.70 ms
Host started flapping

[05-12-2024 02:58:47] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.6% change > 20.0% threshold)
Host Down

[05-12-2024 02:57:46] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 02:56:34] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 02:54:49] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.39 ms
Service Critical

[05-12-2024 02:54:40] SERVICE ALERT: db01.iad2.fedoraproject.org;Disk_Space_/;CRITICAL;HARD;3;DISK CRITICAL - free space: / 69175 MiB (9.71% inode=100%):
Host Up

[05-12-2024 02:54:31] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 0%, RTA = 3948.05 ms
Service Ok

[05-12-2024 02:54:10] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 233.55 ms
Host Down

[05-12-2024 02:53:48] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 02:53:23] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Warning

[05-12-2024 02:53:03] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 233.98 ms
Host Up

[05-12-2024 02:46:30] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 0%, RTA = 4091.57 ms
Host Up

[05-12-2024 02:45:31] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.74 ms
Host Down

[05-12-2024 02:45:22] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 02:44:30] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 02:44:26] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.43 ms
Host started flapping

[05-12-2024 02:44:26] HOST FLAPPING ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (21.4% change > 20.0% threshold)
Host Up

[05-12-2024 02:44:18] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.70 ms
Host Up

[05-12-2024 02:44:02] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 3938.05 ms
Host Down

[05-12-2024 02:43:25] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;4;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 02:43:17] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 80%, RTA = 9566.54 ms
Host Down

[05-12-2024 02:42:56] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 63%, RTA = 9200.90 ms
Host Down

[05-12-2024 02:42:13] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 75%, RTA = 6934.96 ms
Host Down

[05-12-2024 02:41:05] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 02:40:32] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.58 ms
Host Up

[05-12-2024 02:40:30] HOST ALERT: buildvm-ppc64le-16.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.75 ms
Host started flapping

[05-12-2024 02:40:30] HOST FLAPPING ALERT: buildvm-ppc64le-16.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.2% change > 20.0% threshold)
Host Down

[05-12-2024 02:39:53] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 57%, RTA = 5429.28 ms
Host Down

[05-12-2024 02:39:31] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 02:39:29] HOST ALERT: buildvm-ppc64le-16.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 50%, RTA = 7647.27 ms
Service Ok

[05-12-2024 02:29:16] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 244.24 ms
Service Warning

[05-12-2024 02:28:10] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 244.58 ms
Service Warning

[05-12-2024 02:26:32] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent rpm sign messages;WARNING;HARD;3;WARN: last org.fedoraproject.prod.buildsys.rpm.sign message was 11509 seconds ago
Service Warning

[05-12-2024 02:25:32] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent rpm sign messages;WARNING;SOFT;2;WARN: last org.fedoraproject.prod.buildsys.rpm.sign message was 11449 seconds ago
Service Warning

[05-12-2024 02:24:32] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent rpm sign messages;WARNING;SOFT;1;WARN: last org.fedoraproject.prod.buildsys.rpm.sign message was 11389 seconds ago
Host Up

[05-12-2024 02:14:20] HOST ALERT: buildvm-ppc64le-16.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.56 ms
Host Up

[05-12-2024 02:14:20] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.61 ms
Host Down

[05-12-2024 02:13:19] HOST ALERT: buildvm-ppc64le-16.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 02:13:19] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 02:09:19] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.62 ms
Host Up

[05-12-2024 02:09:15] HOST ALERT: buildvm-ppc64le-13.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.85 ms
Host Down

[05-12-2024 02:08:18] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 25%, RTA = 7237.71 ms
Host Up

[05-12-2024 02:08:14] HOST ALERT: bvmhost-p09-02.iad2.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Unreachable

[05-12-2024 02:08:14] HOST ALERT: buildvm-ppc64le-13.iad2.fedoraproject.org;UNREACHABLE;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 02:08:11] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2065.79 ms
Host Down

[05-12-2024 02:08:07] HOST ALERT: bvmhost-p09-02.iad2.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 02:08:05] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.13 ms
Host Down

[05-12-2024 02:07:44] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 02:07:37] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.00 ms
Host Down

[05-12-2024 02:07:04] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 02:06:36] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 02:05:52] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 02:05:24] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 02:04:47] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.76 ms
Host Down

[05-12-2024 02:04:40] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 02:03:46] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 02:01:54] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 233.41 ms
Service Warning

[05-12-2024 02:00:48] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 233.93 ms

[05-12-2024 01:58:32] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;OK;HARD;1;OK - database koji (0.007712 sec.)
Host Up

[05-12-2024 01:55:43] HOST ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.85 ms
Host Down

[05-12-2024 01:54:42] HOST ALERT: buildvm-ppc64le-11.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 01:54:03] HOST ALERT: db-koji01.iad2.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Critical

[05-12-2024 01:53:42] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;CRITICAL;HARD;4;CRITICAL - Plugin timed out
Host Down

[05-12-2024 01:53:02] HOST ALERT: db-koji01.iad2.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 01:52:32] SERVICE ALERT: db-koji01.iad2.fedoraproject.org;Check Koji DB;CRITICAL;SOFT;1;CRITICAL - Plugin timed out
Host stopped flapping

[05-12-2024 01:51:54] HOST FLAPPING ALERT: openqa-p09-worker02.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Up

[05-12-2024 01:39:34] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.56 ms
Host started flapping

[05-12-2024 01:39:34] HOST FLAPPING ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.6% change > 20.0% threshold)
Host Down

[05-12-2024 01:38:33] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 01:37:44] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 91%, RTA = 2.07 ms
Host started flapping

[05-12-2024 01:37:44] HOST FLAPPING ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (24.2% change > 20.0% threshold)
Host Down

[05-12-2024 01:37:21] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 01:36:32] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 01:36:21] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 60%, RTA = 3820.56 ms
Host Down

[05-12-2024 01:35:16] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 01:32:15] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 0%, RTA = 3214.46 ms
Host Up

[05-12-2024 01:31:21] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.26 ms
Host Down

[05-12-2024 01:31:09] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 01:30:42] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 111099 bytes in 5.165 second response time
Host Down

[05-12-2024 01:30:20] HOST ALERT: buildvm-ppc64le-10.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 01:29:57] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Service Ok

[05-12-2024 01:29:39] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 233.35 ms
Service Critical

[05-12-2024 01:29:37] SERVICE ALERT: proxy30.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Proxy Error - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 781 bytes in 1.231 second response time
Host Down

[05-12-2024 01:28:45] HOST ALERT: buildvm-ppc64le-12.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 83%, RTA = 10666.40 ms
Service Warning

[05-12-2024 01:28:32] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 233.82 ms
Service Ok

[05-12-2024 01:27:24] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;3;PING OK - Packet loss = 16%, RTA = 233.43 ms
Service Ok

[05-12-2024 01:27:01] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 241.34 ms
Service Warning

[05-12-2024 01:26:18] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;2;PING WARNING - Packet loss = 37%, RTA = 233.41 ms
Service Warning

[05-12-2024 01:25:55] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 241.52 ms
Service Warning

[05-12-2024 01:25:09] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 233.73 ms
Service Ok

[05-12-2024 01:24:21] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;OK;SOFT;2;DISK OK - free space: / 93725 MiB (92.51% inode=100%):
Service Ok

[05-12-2024 01:24:17] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Host Up

[05-12-2024 01:24:14] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok

[05-12-2024 01:24:14] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;OK;SOFT;2;PROCS OK: 535 processes
Host Down

[05-12-2024 01:23:44] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 01:23:21] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 01:23:17] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 01:23:14] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 01:22:07] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Service Ok

[05-12-2024 01:21:54] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;2;0 mail(s) in queue
Service Critical

[05-12-2024 01:21:07] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 01:20:54] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 01:20:13] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.31 ms
Host started flapping

[05-12-2024 01:20:13] HOST FLAPPING ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (24.2% change > 20.0% threshold)
Host Up

[05-12-2024 01:20:05] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 804.50 ms
Host started flapping

[05-12-2024 01:20:05] HOST FLAPPING ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.7% change > 20.0% threshold)
Host Down

[05-12-2024 01:19:12] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 01:19:04] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 50%, RTA = 7762.31 ms
Host Up

[05-12-2024 01:14:01] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.22 ms
Host Down

[05-12-2024 01:13:00] HOST ALERT: buildvm-ppc64le-14.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up

[05-12-2024 01:11:54] HOST ALERT: openqa-p09-worker02.iad2.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host started flapping

[05-12-2024 01:11:54] HOST FLAPPING ALERT: openqa-p09-worker02.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.3% change > 20.0% threshold)
Host Down

[05-12-2024 01:10:54] HOST ALERT: openqa-p09-worker02.iad2.fedoraproject.org;DOWN;SOFT;1;(Host check timed out after 30.01 seconds)
Host Up

[05-12-2024 01:05:24] HOST ALERT: openqa-p09-worker02.iad2.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Up

[05-12-2024 01:04:47] HOST ALERT: buildvm-ppc64le-09.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 91%, RTA = 0.64 ms
Host Down

[05-12-2024 01:04:24] HOST ALERT: openqa-p09-worker02.iad2.fedoraproject.org;DOWN;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up

[05-12-2024 01:03:55] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.81 ms
Host Down

[05-12-2024 01:03:35] HOST ALERT: buildvm-ppc64le-09.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down

[05-12-2024 01:02:54] HOST ALERT: openqa-p09-worker02.iad2.fedoraproject.org;DOWN;SOFT;1;(Host check timed out after 31.01 seconds)
Host Down

[05-12-2024 01:02:54] HOST ALERT: buildvm-ppc64le-15.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 41%, RTA = 7706.64 ms

[05-12-2024 00:48:37] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok

[05-12-2024 00:48:37] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk Space /boot;OK;SOFT;2;DISK OK - free space: /boot 704 MiB (73.36% inode=100%):
Host Down

[05-12-2024 00:48:07] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical

[05-12-2024 00:47:37] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk Space /boot;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host stopped flapping

[05-12-2024 00:38:37] HOST FLAPPING ALERT: buildhw-a64-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)
Service Ok

[05-12-2024 00:29:37] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Service Critical

[05-12-2024 00:28:37] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok

[05-12-2024 00:26:27] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 14325 bytes in 20.260 second response time
Service Critical

[05-12-2024 00:25:07] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Ok

[05-12-2024 00:24:07] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 14321 bytes in 0.021 second response time
Service Critical

[05-12-2024 00:23:26] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical

[05-12-2024 00:23:07] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok

[05-12-2024 00:21:45] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 14325 bytes in 21.063 second response time
Service Critical

[05-12-2024 00:20:24] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-bodhi;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok

[05-12-2024 00:03:12] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 119901 bytes in 3.111 second response time
Service Critical

[05-12-2024 00:02:09] SERVICE ALERT: proxy38.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Proxy Error - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 781 bytes in 0.970 second response time