Alert History
Last Updated: Sat Jun 8 06:14:33 GMT 2024
Nagios® Core™ 4.4.9 - www.nagios.org
Logged in as guest
All Hosts and Services


State type options:
History detail level for all hosts:
Hide Flapping Alerts
Hide Downtime Alerts
Hide Process Messages
Older Entries First



June 07, 2024 23:00

Service Ok[06-07-2024 23:53:23] SERVICE ALERT: proxy37.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 12543 bytes in 0.511 second response time
Host stopped flapping[06-07-2024 23:52:49] HOST FLAPPING ALERT: proxy37.fedoraproject.org;STOPPED; Host appears to have stopped flapping (4.0% change < 5.0% threshold)
Service Ok[06-07-2024 23:51:10] SERVICE ALERT: proxy37.fedoraproject.org;http-odcs;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 16670 bytes in 1.991 second response time
Service Ok[06-07-2024 23:51:09] SERVICE ALERT: proxy37.fedoraproject.org;http-moby-registry;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 535 bytes in 1.519 second response time
Service Ok[06-07-2024 23:49:30] SERVICE ALERT: proxy37.fedoraproject.org;http-fedoraproject.org;OK;SOFT;2;HTTP OK: HTTP/1.1 302 Found - 475 bytes in 0.526 second response time
Host Up[06-07-2024 23:49:28] HOST ALERT: proxy37.fedoraproject.org;UP;SOFT;1;SSH OK - OpenSSH_9.3 (protocol 2.0)
Host started flapping[06-07-2024 23:49:28] HOST FLAPPING ALERT: proxy37.fedoraproject.org;STARTED; Host appears to have started flapping (22.1% change > 20.0% threshold)
Service Ok[06-07-2024 23:49:27] SERVICE ALERT: proxy37.fedoraproject.org;http-fedoraproject.org-hotspot.txt;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 413 bytes in 0.506 second response time
Service Critical[06-07-2024 23:49:03] SERVICE ALERT: proxy37.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;HARD;1;CRITICAL - Socket timeout
Host Down[06-07-2024 23:48:37] HOST ALERT: proxy37.fedoraproject.org;DOWN;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 23:48:30] SERVICE ALERT: proxy37.fedoraproject.org;http-fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 23:48:27] SERVICE ALERT: proxy37.fedoraproject.org;http-fedoraproject.org-hotspot.txt;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 23:47:22] SERVICE ALERT: proxy37.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 12544 bytes in 13.062 second response time
Host Up[06-07-2024 23:47:20] HOST ALERT: proxy37.fedoraproject.org;UP;SOFT;1;SSH OK - OpenSSH_9.3 (protocol 2.0)
Service Critical[06-07-2024 23:46:49] SERVICE ALERT: proxy37.fedoraproject.org;http-odcs;CRITICAL;HARD;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 23:46:48] SERVICE ALERT: proxy37.fedoraproject.org;http-moby-registry;CRITICAL;HARD;1;CRITICAL - Socket timeout
Host Down[06-07-2024 23:46:19] HOST ALERT: proxy37.fedoraproject.org;DOWN;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 23:46:09] SERVICE ALERT: proxy37.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host stopped flapping[06-07-2024 23:41:39] HOST FLAPPING ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok[06-07-2024 23:38:23] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;2;0 mail(s) in queue
Host Up[06-07-2024 23:37:55] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-07-2024 23:37:28] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 23:37:23] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-07-2024 23:01:58] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-07-2024 23:01:09] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-07-2024 23:00:28] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.


June 07, 2024 22:00

Service Ok[06-07-2024 22:50:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;OK;SOFT;2;PROCS OK: 540 processes
Service Critical[06-07-2024 22:49:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 22:40:05] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent rpm sign messages;CRITICAL;HARD;3;CRIT: no org.fedoraproject.prod.buildsys.rpm.sign messages in 14400 seconds
Service Ok[06-07-2024 22:29:39] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Service Critical[06-07-2024 22:28:39] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 22:27:02] SERVICE ALERT: proxy05.fedoraproject.org;Check MirrorList 2 Cache;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 22:27:02] SERVICE ALERT: proxy05.fedoraproject.org;Check MirrorList 1 Cache;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 22:22:59] SERVICE ALERT: proxy05.fedoraproject.org;Check TicketKey age;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 22:22:58] SERVICE ALERT: proxy05.fedoraproject.org;Check ostree summary age;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 22:15:53] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;2;0 mail(s) in queue
Service Critical[06-07-2024 22:14:53] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 22:13:23] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;3;0 mail(s) in queue
Service Critical[06-07-2024 22:12:23] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 22:10:53] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 22:07:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Service Ok[06-07-2024 22:07:29] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Host Up[06-07-2024 22:06:39] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.69 ms
Host started flapping[06-07-2024 22:06:39] HOST FLAPPING ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.7% change > 20.0% threshold)
Service Critical[06-07-2024 22:06:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 22:06:29] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Up[06-07-2024 22:06:13] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.40 ms
Host Up[06-07-2024 22:06:10] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.64 ms
Host Down[06-07-2024 22:05:38] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-07-2024 22:05:12] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-07-2024 22:05:08] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%


June 07, 2024 21:00

Service Ok[06-07-2024 21:59:23] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;3;0 mail(s) in queue
Service Critical[06-07-2024 21:58:23] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:56:53] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-07-2024 21:50:27] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.16 ms
Host Down[06-07-2024 21:49:26] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 42%, RTA = 5028.38 ms
Service Critical[06-07-2024 21:48:31] SERVICE ALERT: proxy05.fedoraproject.org;Disk_Space_/;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:44:07] SERVICE ALERT: proxy05.fedoraproject.org;Disk Space /boot;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 21:43:05] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;OK;HARD;1;The last build 7559961 for copr-ping succeeded, took 272 seconds, elapsed since the last stop 511 seconds
Service started flapping[06-07-2024 21:43:05] SERVICE FLAPPING ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;STARTED; Service appears to have started flapping (21.1% change >= 20.0% threshold)
Host Down[06-07-2024 21:41:39] HOST ALERT: proxy05.fedoraproject.org;DOWN;HARD;8;(Host check timed out after 30.00 seconds)
Host Down[06-07-2024 21:40:09] HOST ALERT: proxy05.fedoraproject.org;DOWN;SOFT;7;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Warning[06-07-2024 21:40:05] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent rpm sign messages;WARNING;HARD;3;WARN: last org.fedoraproject.prod.buildsys.rpm.sign message was 11317 seconds ago
Service Critical[06-07-2024 21:39:44] SERVICE ALERT: proxy05.fedoraproject.org;Check proxies for oversubscription;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:39:13] SERVICE ALERT: proxy05.fedoraproject.org;vpnclients;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Warning[06-07-2024 21:39:04] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent rpm sign messages;WARNING;SOFT;2;WARN: last org.fedoraproject.prod.buildsys.rpm.sign message was 11256 seconds ago
Host Down[06-07-2024 21:38:39] HOST ALERT: proxy05.fedoraproject.org;DOWN;SOFT;6;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Warning[06-07-2024 21:38:04] SERVICE ALERT: busgateway01.iad2.fedoraproject.org;Check datanommer for recent rpm sign messages;WARNING;SOFT;1;WARN: last org.fedoraproject.prod.buildsys.rpm.sign message was 11196 seconds ago
Host Down[06-07-2024 21:37:09] HOST ALERT: proxy05.fedoraproject.org;DOWN;SOFT;5;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-07-2024 21:35:39] HOST ALERT: proxy05.fedoraproject.org;DOWN;SOFT;4;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:35:31] SERVICE ALERT: proxy05.fedoraproject.org;http-moby-registry;CRITICAL;HARD;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 21:34:53] SERVICE ALERT: proxy05.fedoraproject.org;http-koschei;CRITICAL;HARD;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 21:34:45] SERVICE ALERT: proxy05.fedoraproject.org;http-ipsilon;CRITICAL;HARD;1;CRITICAL - Socket timeout
Host Down[06-07-2024 21:34:09] HOST ALERT: proxy05.fedoraproject.org;DOWN;SOFT;3;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:33:44] SERVICE ALERT: proxy05.fedoraproject.org;http-waiverdb;CRITICAL;HARD;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 21:33:38] SERVICE ALERT: proxy05.fedoraproject.org;http-odcs;CRITICAL;HARD;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 21:33:28] SERVICE ALERT: proxy05.fedoraproject.org;http-fedoraproject.org;CRITICAL;HARD;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 21:33:27] SERVICE ALERT: proxy05.fedoraproject.org;http-fedoraproject.org-hotspot.txt;CRITICAL;HARD;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 21:33:27] SERVICE ALERT: proxy05.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;HARD;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 21:33:27] SERVICE ALERT: proxy05.fedoraproject.org;http-docs.fedoraproject.org;CRITICAL;HARD;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 21:33:21] SERVICE ALERT: proxy05.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;HARD;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 21:33:19] SERVICE ALERT: proxy05.fedoraproject.org;Check fedmsg consumers and producers gateway;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:33:18] SERVICE ALERT: proxy05.fedoraproject.org;proxy05.fedoraproject.org mirrorlist docker container;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:33:18] SERVICE ALERT: proxy05.fedoraproject.org;Check for existence fedmsg-gateway proc;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:33:17] SERVICE ALERT: proxy05.fedoraproject.org;Rsyslogd Process;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:33:16] SERVICE ALERT: proxy05.fedoraproject.org;Check fedmsg-gateway consumers backlog;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:33:16] SERVICE ALERT: proxy05.fedoraproject.org;Check fedmsg-gateway consumers exceptions;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:33:16] SERVICE ALERT: proxy05.fedoraproject.org;Varnish Process;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:33:15] SERVICE ALERT: proxy05.fedoraproject.org;mail_queue;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-07-2024 21:32:39] HOST ALERT: proxy05.fedoraproject.org;DOWN;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:31:42] SERVICE ALERT: proxy05.fedoraproject.org;http-greenwave;CRITICAL;HARD;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 21:31:25] SERVICE ALERT: proxy05.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;HARD;1;CRITICAL - Socket timeout
Host Down[06-07-2024 21:31:09] HOST ALERT: proxy05.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 21:27:57] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Service Critical[06-07-2024 21:26:57] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 21:23:05] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;CRITICAL;HARD;3;Exit status is 4 (non-zero) for build ID 7559553
Service Critical[06-07-2024 21:22:04] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;CRITICAL;SOFT;2;Exit status is 4 (non-zero) for build ID 7559553
Service Critical[06-07-2024 21:21:04] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;CRITICAL;SOFT;1;Exit status is 4 (non-zero) for build ID 7559553
Service Ok[06-07-2024 21:20:12] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue amqp_to_zmq;OK;SOFT;2;RABBITMQ_QUEUE OK - messages OK (1) messages_ready OK (0) messages_unacknowledged OK (1) consumers OK (1) All queues under the thresholds
Service Warning[06-07-2024 21:19:12] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue amqp_to_zmq;WARNING;SOFT;1;RABBITMQ_QUEUE WARNING - messages WARNING (35), messages_ready OK (10) messages_unacknowledged OK (25) consumers OK (1)


June 07, 2024 20:00

Host Up[06-07-2024 20:09:20] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.75 ms
Host Down[06-07-2024 20:08:19] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 62%, RTA = 6517.36 ms
Service Ok[06-07-2024 20:01:04] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;OK;HARD;1;The last build 7556720 for copr-ping succeeded, took 1325 seconds, elapsed since the last stop 538 seconds


June 07, 2024 19:00

Host Up[06-07-2024 19:25:19] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok[06-07-2024 19:25:19] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Host Down[06-07-2024 19:24:49] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 19:24:19] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 19:13:09] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Service Critical[06-07-2024 19:12:09] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Up[06-07-2024 19:05:41] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-07-2024 19:04:53] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.


June 07, 2024 18:00

Service Ok[06-07-2024 18:51:10] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;OK;SOFT;2;HTTP OK: Status line output matched "HTTP/1.0 401 Unauthorized" - 303 bytes in 0.005 second response time
Service Critical[06-07-2024 18:50:10] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 18:49:00] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;OK;SOFT;2;HTTP OK: Status line output matched "HTTP/1.0 401 Unauthorized" - 303 bytes in 0.005 second response time
Service Critical[06-07-2024 18:48:00] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 18:45:23] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;2;0 mail(s) in queue
Service Critical[06-07-2024 18:44:23] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 18:41:04] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;CRITICAL;HARD;3;Exit status is 4 (non-zero) for build ID 7556396
Service Critical[06-07-2024 18:40:04] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;CRITICAL;SOFT;2;Exit status is 4 (non-zero) for build ID 7556396
Service Critical[06-07-2024 18:39:03] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;CRITICAL;SOFT;1;Exit status is 4 (non-zero) for build ID 7556396
Service Ok[06-07-2024 18:38:28] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;OK;SOFT;2;PROCS OK: 552 processes
Service Critical[06-07-2024 18:37:28] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 18:35:27] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Service Critical[06-07-2024 18:34:27] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 18:34:09] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;OK;SOFT;2;RABBITMQ_QUEUE OK - messages OK (0) messages_ready OK (0) messages_unacknowledged OK (0) consumers OK (1) All queues under the thresholds
Service Warning[06-07-2024 18:33:09] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;WARNING;SOFT;1;RABBITMQ_QUEUE WARNING - messages WARNING (18), messages_ready OK (8) messages_unacknowledged OK (10) consumers OK (1)
Service Ok[06-07-2024 18:20:59] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;3;SSH OK - OpenSSH_9.3 (protocol 2.0)
Service Critical[06-07-2024 18:19:59] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 18:18:49] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 18:07:39] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Service Critical[06-07-2024 18:06:39] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 18:05:06] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Service Critical[06-07-2024 18:04:06] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.


June 07, 2024 17:00

Host Up[06-07-2024 17:47:27] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-07-2024 17:47:06] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 17:46:50] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;OK;SOFT;2;HTTP OK: Status line output matched "HTTP/1.0 401 Unauthorized" - 303 bytes in 9.861 second response time
Service Critical[06-07-2024 17:45:40] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 17:29:03] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;OK;HARD;1;The last build 7555967 for copr-ping succeeded, took 1474 seconds, elapsed since the last stop 267 seconds
Host stopped flapping[06-07-2024 17:27:27] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)
Service Ok[06-07-2024 17:19:58] SERVICE ALERT: openqa-p09-worker02.mgmt.iad2.fedoraproject.org;openqa-p09-worker02.mgmt.iad2.fedoraproject.org-https;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 4440 bytes in 0.198 second response time
Service Ok[06-07-2024 17:19:57] SERVICE ALERT: openqa-p09-worker02.mgmt.iad2.fedoraproject.org;openqa-p09-worker02.mgmt.iad2.fedoraproject.org-http;OK;SOFT;2;HTTP OK: HTTP/1.1 301 Moved Permanently - 401 bytes in 7.099 second response time
Service Critical[06-07-2024 17:18:58] SERVICE ALERT: openqa-p09-worker02.mgmt.iad2.fedoraproject.org;openqa-p09-worker02.mgmt.iad2.fedoraproject.org-https;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 17:18:50] SERVICE ALERT: openqa-p09-worker02.mgmt.iad2.fedoraproject.org;openqa-p09-worker02.mgmt.iad2.fedoraproject.org-http;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 17:16:38] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue fedbadges;OK;HARD;1;RABBITMQ_QUEUE OK - messages OK (19560) messages_ready OK (19385) messages_unacknowledged OK (175) consumers OK (7) All queues under the thresholds
Service Ok[06-07-2024 17:12:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Service Critical[06-07-2024 17:11:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-07-2024 17:10:06] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host started flapping[06-07-2024 17:10:06] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STARTED; Host appears to have started flapping (22.4% change > 20.0% threshold)
Service Ok[06-07-2024 17:10:06] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Host Down[06-07-2024 17:09:36] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 17:09:06] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-07-2024 17:05:42] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-07-2024 17:04:59] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 17:03:55] SERVICE ALERT: proxy11.fedoraproject.org;http-docs.fedoraproject.org;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 20308 bytes in 5.881 second response time
Service Critical[06-07-2024 17:02:49] SERVICE ALERT: proxy11.fedoraproject.org;http-docs.fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout


June 07, 2024 16:00

Host stopped flapping[06-07-2024 16:29:29] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)
Service Ok[06-07-2024 16:15:29] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Service Critical[06-07-2024 16:14:29] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 16:14:24] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;3;PING OK - Packet loss = 16%, RTA = 245.95 ms
Host Up[06-07-2024 16:13:19] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host started flapping[06-07-2024 16:13:19] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STARTED; Host appears to have started flapping (23.6% change > 20.0% threshold)
Service Ok[06-07-2024 16:13:19] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Service Warning[06-07-2024 16:13:16] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;2;PING WARNING - Packet loss = 28%, RTA = 245.08 ms
Host Down[06-07-2024 16:12:49] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 16:12:19] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Warning[06-07-2024 16:12:08] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 245.69 ms
Host Up[06-07-2024 16:11:53] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-07-2024 16:10:53] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;(Host check timed out after 30.00 seconds)
Service Ok[06-07-2024 16:10:52] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 243.37 ms
Service Warning[06-07-2024 16:09:46] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 243.53 ms
Service Ok[06-07-2024 16:08:21] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 238.88 ms
Service Warning[06-07-2024 16:07:15] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 238.89 ms
Service Ok[06-07-2024 16:02:53] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;3;0 mail(s) in queue
Service Critical[06-07-2024 16:01:53] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 16:00:23] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.


June 07, 2024 15:00

Service Ok[06-07-2024 15:57:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Service Critical[06-07-2024 15:56:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 15:44:29] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;3;PING OK - Packet loss = 16%, RTA = 235.25 ms
Service Warning[06-07-2024 15:43:20] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;2;PING WARNING - Packet loss = 37%, RTA = 235.34 ms
Service Warning[06-07-2024 15:42:10] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 235.24 ms
Service Ok[06-07-2024 15:38:38] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 257.12 ms
Service Warning[06-07-2024 15:37:32] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 249.54 ms
Service Ok[06-07-2024 15:36:06] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 239.32 ms
Service Warning[06-07-2024 15:35:00] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 239.38 ms
Service Ok[06-07-2024 15:31:01] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 235.37 ms
Service Warning[06-07-2024 15:29:54] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 235.37 ms
Service Ok[06-07-2024 15:26:27] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Service Ok[06-07-2024 15:26:24] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 245.30 ms
Service Critical[06-07-2024 15:25:27] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Warning[06-07-2024 15:25:17] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 243.78 ms
Service Ok[06-07-2024 15:24:04] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;3;PING OK - Packet loss = 16%, RTA = 244.86 ms
Service Ok[06-07-2024 15:23:57] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;HARD;1;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Service Warning[06-07-2024 15:22:56] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;2;PING WARNING - Packet loss = 28%, RTA = 243.96 ms
Service Ok[06-07-2024 15:22:09] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;OK;SOFT;2;RABBITMQ_QUEUE OK - messages OK (0) messages_ready OK (0) messages_unacknowledged OK (0) consumers OK (1) All queues under the thresholds
Service Warning[06-07-2024 15:21:48] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 243.79 ms
Service Warning[06-07-2024 15:21:09] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;WARNING;SOFT;1;RABBITMQ_QUEUE WARNING - messages WARNING (15), messages_ready OK (5) messages_unacknowledged OK (10) consumers OK (1)
Host Up[06-07-2024 15:14:27] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Critical[06-07-2024 15:14:27] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;HARD;3;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 15:13:51] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 239.20 ms
Host Down[06-07-2024 15:13:27] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 15:12:57] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Warning[06-07-2024 15:12:43] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 239.13 ms
Service Ok[06-07-2024 15:04:41] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;OK;SOFT;2;DISK OK - free space: / 92593 MiB (91.39% inode=100%):
Service Critical[06-07-2024 15:03:41] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.


June 07, 2024 14:00

Service Ok[06-07-2024 14:40:37] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;3;PING OK - Packet loss = 16%, RTA = 257.15 ms
Service Ok[06-07-2024 14:40:09] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;OK;SOFT;2;RABBITMQ_QUEUE OK - messages OK (0) messages_ready OK (0) messages_unacknowledged OK (0) consumers OK (1) All queues under the thresholds
Service Warning[06-07-2024 14:39:30] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;2;PING WARNING - Packet loss = 37%, RTA = 259.18 ms
Service Warning[06-07-2024 14:39:09] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue bodhi;WARNING;SOFT;1;RABBITMQ_QUEUE WARNING - messages WARNING (40), messages_ready OK (30) messages_unacknowledged OK (10) consumers OK (1)
Service Warning[06-07-2024 14:38:20] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 251.73 ms
Service Ok[06-07-2024 14:37:11] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 258.69 ms
Service Warning[06-07-2024 14:36:05] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 256.54 ms
Service Ok[06-07-2024 14:28:45] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 234.96 ms
Service Warning[06-07-2024 14:27:39] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 235.00 ms
Service Ok[06-07-2024 14:16:29] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 235.08 ms
Service Warning[06-07-2024 14:15:22] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 234.91 ms


June 07, 2024 13:00

Service Ok[06-07-2024 13:41:34] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;3;PING OK - Packet loss = 0%, RTA = 238.93 ms
Service Ok[06-07-2024 13:41:23] SERVICE ALERT: bvmhost-p09-03.mgmt.iad2.fedoraproject.org.;bvmhost-p09-03.mgmt.iad2.fedoraproject.org.-https;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 4440 bytes in 0.211 second response time
Service Warning[06-07-2024 13:40:26] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;2;PING WARNING - Packet loss = 28%, RTA = 239.02 ms
Service Critical[06-07-2024 13:40:23] SERVICE ALERT: bvmhost-p09-03.mgmt.iad2.fedoraproject.org.;bvmhost-p09-03.mgmt.iad2.fedoraproject.org.-https;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Warning[06-07-2024 13:39:16] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 239.32 ms
Service Ok[06-07-2024 13:34:57] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 252.79 ms
Service Warning[06-07-2024 13:33:50] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 259.51 ms
Service Ok[06-07-2024 13:10:17] SERVICE ALERT: smtp-mm-cc-rdu01.fedoraproject.org;smtp-mm;OK;HARD;1;SMTP OK - 0.586 sec. response time
Service Critical[06-07-2024 13:09:02] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;CRITICAL;HARD;3;Exit status is 4 (non-zero) for build ID 7554855
Service Critical[06-07-2024 13:08:02] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;CRITICAL;SOFT;2;Exit status is 4 (non-zero) for build ID 7554855
Service Critical[06-07-2024 13:07:02] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;CRITICAL;SOFT;1;Exit status is 4 (non-zero) for build ID 7554855
Service Ok[06-07-2024 13:04:51] SERVICE ALERT: proxy11.fedoraproject.org;http-odcs;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 16603 bytes in 6.726 second response time
Service Ok[06-07-2024 13:04:39] SERVICE ALERT: proxy11.fedoraproject.org;http-fedoraproject.org-wiki;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 19441 bytes in 4.106 second response time
Service Ok[06-07-2024 13:04:14] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 234.73 ms
Service Critical[06-07-2024 13:03:45] SERVICE ALERT: proxy11.fedoraproject.org;http-odcs;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Warning[06-07-2024 13:03:35] SERVICE ALERT: proxy11.fedoraproject.org;http-fedoraproject.org-wiki;WARNING;SOFT;1;HTTP WARNING: HTTP/1.1 200 OK - 19408 bytes in 38.820 second response time
Service Warning[06-07-2024 13:03:06] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 234.64 ms
Service Ok[06-07-2024 13:02:41] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 253.84 ms
Service Warning[06-07-2024 13:01:35] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 248.91 ms
Service Critical[06-07-2024 13:00:16] SERVICE ALERT: smtp-mm-cc-rdu01.fedoraproject.org;smtp-mm;CRITICAL;HARD;3;CRITICAL - Socket timeout


June 07, 2024 12:00

Service Critical[06-07-2024 12:59:06] SERVICE ALERT: smtp-mm-cc-rdu01.fedoraproject.org;smtp-mm;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 12:57:56] SERVICE ALERT: smtp-mm-cc-rdu01.fedoraproject.org;smtp-mm;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 12:51:27] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Host Up[06-07-2024 12:51:10] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok[06-07-2024 12:51:09] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Host Down[06-07-2024 12:50:39] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 12:50:26] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 12:50:22] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 250.15 ms
Service Critical[06-07-2024 12:50:09] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Warning[06-07-2024 12:49:15] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 50%, RTA = 248.81 ms
Service Ok[06-07-2024 12:31:58] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 234.84 ms
Service Warning[06-07-2024 12:30:51] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 234.68 ms
Service Ok[06-07-2024 12:18:03] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 246.60 ms
Service Warning[06-07-2024 12:16:57] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 244.54 ms
Service Ok[06-07-2024 12:15:48] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 247.73 ms
Service Warning[06-07-2024 12:14:42] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 245.40 ms
Service Ok[06-07-2024 12:13:57] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Service Critical[06-07-2024 12:12:53] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 12:05:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;OK;SOFT;2;PROCS OK: 551 processes
Service Critical[06-07-2024 12:04:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 12:04:04] SERVICE ALERT: proxy11.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5424 bytes in 4.484 second response time
Service Ok[06-07-2024 12:04:04] SERVICE ALERT: proxy11.fedoraproject.org;http-greenwave;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 29258 bytes in 4.608 second response time
Service Critical[06-07-2024 12:03:00] SERVICE ALERT: proxy11.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 12:02:59] SERVICE ALERT: proxy11.fedoraproject.org;http-greenwave;CRITICAL;SOFT;1;CRITICAL - Socket timeout


June 07, 2024 11:00

Host Up[06-07-2024 11:59:51] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.43 ms
Host Down[06-07-2024 11:58:50] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-07-2024 11:57:38] HOST ALERT: buildhw-a64-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-07-2024 11:48:53] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;OK;SOFT;2;0 mail(s) in queue
Service Critical[06-07-2024 11:47:53] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;mail_queue;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 11:21:23] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Service Critical[06-07-2024 11:20:23] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 11:13:59] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;OK;HARD;1;HTTP OK: HTTP/1.1 302 Found - 475 bytes in 0.022 second response time
Service Ok[06-07-2024 11:13:32] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-hotspot.txt;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 413 bytes in 0.019 second response time
Service Ok[06-07-2024 11:12:52] SERVICE ALERT: proxy14.fedoraproject.org;http-docs.fedoraproject.org;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 20308 bytes in 0.056 second response time
Service Ok[06-07-2024 11:12:47] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 5424 bytes in 0.066 second response time
Service Ok[06-07-2024 11:12:06] SERVICE ALERT: proxy09.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 3609 bytes in 0.193 second response time
Service Ok[06-07-2024 11:10:56] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 16669 bytes in 0.089 second response time
Service Ok[06-07-2024 11:10:52] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 106053 bytes in 0.639 second response time
Service Ok[06-07-2024 11:10:36] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;OK;SOFT;4;HTTP OK: HTTP/1.1 200 OK - 34054 bytes in 0.254 second response time
Service Ok[06-07-2024 11:10:36] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 29258 bytes in 0.118 second response time
Service Ok[06-07-2024 11:10:34] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 5773 bytes in 0.200 second response time
Service Ok[06-07-2024 11:10:25] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 534 bytes in 0.855 second response time
Service Ok[06-07-2024 11:10:22] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 19443 bytes in 1.484 second response time
Service Critical[06-07-2024 11:09:56] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:09:51] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:09:36] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;3;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:09:36] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;CRITICAL;SOFT;4;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:09:34] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:09:25] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:09:20] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Ok[06-07-2024 11:08:28] SERVICE ALERT: proxy09.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 4.453 second response time
Service Critical[06-07-2024 11:08:15] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 11:08:12] SERVICE ALERT: proxy09.fedoraproject.org;http-fedoraproject.org-hotspot.txt;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 413 bytes in 4.991 second response time
Service Critical[06-07-2024 11:08:10] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:07:55] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:07:55] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;CRITICAL;SOFT;3;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:07:53] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:07:52] SERVICE ALERT: proxy14.fedoraproject.org;http-docs.fedoraproject.org;CRITICAL;HARD;3;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:07:47] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;CRITICAL;HARD;3;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:07:44] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:07:39] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:07:24] SERVICE ALERT: proxy09.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:07:07] SERVICE ALERT: proxy09.fedoraproject.org;http-fedoraproject.org-hotspot.txt;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:07:06] SERVICE ALERT: proxy09.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;HARD;3;CRITICAL - Socket timeout
Service Ok[06-07-2024 11:06:34] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 16669 bytes in 2.168 second response time
Service Ok[06-07-2024 11:06:29] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;OK;SOFT;5;HTTP OK: HTTP/1.1 200 OK - 103194 bytes in 5.639 second response time
Service Ok[06-07-2024 11:06:23] SERVICE ALERT: proxy14.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;OK;HARD;1;HTTP OK: HTTP/1.1 200 OK - 3609 bytes in 15.571 second response time
Service Ok[06-07-2024 11:06:18] SERVICE ALERT: proxy11.fedoraproject.org;http-greenwave;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 29258 bytes in 3.017 second response time
Service Ok[06-07-2024 11:06:18] SERVICE ALERT: proxy11.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 15.322 second response time
Service Warning[06-07-2024 11:06:14] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;WARNING;SOFT;1;HTTP WARNING: HTTP/1.1 200 OK - 34054 bytes in 37.529 second response time
Service Critical[06-07-2024 11:06:14] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Ok[06-07-2024 11:06:12] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 5773 bytes in 5.276 second response time
Service Warning[06-07-2024 11:06:11] SERVICE ALERT: proxy14.fedoraproject.org;http-docs.fedoraproject.org;WARNING;SOFT;2;HTTP WARNING: HTTP/1.1 200 OK - 20310 bytes in 33.970 second response time
Service Ok[06-07-2024 11:06:08] SERVICE ALERT: proxy11.fedoraproject.org;http-docs.fedoraproject.org;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 20308 bytes in 4.881 second response time
Service Critical[06-07-2024 11:06:06] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Ok[06-07-2024 11:05:58] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 19442 bytes in 2.430 second response time
Service Ok[06-07-2024 11:05:34] SERVICE ALERT: proxy11.fedoraproject.org;http-fedoraproject.org-hotspot.txt;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 414 bytes in 6.552 second response time
Service Critical[06-07-2024 11:05:31] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Ok[06-07-2024 11:05:27] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 100440 bytes in 7.210 second response time
Service Ok[06-07-2024 11:05:26] SERVICE ALERT: proxy09.fedoraproject.org;http-fedoraproject.org-hotspot.txt;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 413 bytes in 22.036 second response time
Service Critical[06-07-2024 11:05:25] SERVICE ALERT: proxy09.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:05:23] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;4;CRITICAL - Socket timeout
Service Ok[06-07-2024 11:05:17] SERVICE ALERT: proxy06.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 3.449 second response time
Service Warning[06-07-2024 11:05:15] SERVICE ALERT: proxy11.fedoraproject.org;http-greenwave;WARNING;SOFT;1;HTTP WARNING: HTTP/1.1 200 OK - 29258 bytes in 36.802 second response time
Service Critical[06-07-2024 11:05:06] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:05:04] SERVICE ALERT: proxy11.fedoraproject.org;http-docs.fedoraproject.org;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:05:03] SERVICE ALERT: proxy11.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:04:56] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Ok[06-07-2024 11:04:56] SERVICE ALERT: proxy11.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 3610 bytes in 16.527 second response time
Service Ok[06-07-2024 11:04:48] SERVICE ALERT: proxy04.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 7.409 second response time
Service Critical[06-07-2024 11:04:37] SERVICE ALERT: proxy14.fedoraproject.org;http-docs.fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:04:33] SERVICE ALERT: proxy14.fedoraproject.org;http-greenwave;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Warning[06-07-2024 11:04:27] SERVICE ALERT: proxy11.fedoraproject.org;http-fedoraproject.org-hotspot.txt;WARNING;SOFT;2;HTTP WARNING: HTTP/1.1 200 OK - 414 bytes in 39.837 second response time
Service Critical[06-07-2024 11:04:25] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:04:19] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Warning[06-07-2024 11:04:13] SERVICE ALERT: proxy06.fedoraproject.org;http-ipsilon;WARNING;SOFT;1;HTTP WARNING: HTTP/1.1 200 OK - 5427 bytes in 39.812 second response time
Host stopped flapping[06-07-2024 11:04:07] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Critical[06-07-2024 11:04:04] SERVICE ALERT: proxy09.fedoraproject.org;http-fedoraproject.org-hotspot.txt;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:03:50] SERVICE ALERT: proxy14.fedoraproject.org;http-odcs;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:03:44] SERVICE ALERT: proxy09.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:03:42] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;3;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:03:40] SERVICE ALERT: proxy04.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'your Fedora Account' not found on 'https://id.fedoraproject.org:443/' - 771 bytes in 19.430 second response time
Service Critical[06-07-2024 11:03:39] SERVICE ALERT: proxy11.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:03:25] SERVICE ALERT: proxy14.fedoraproject.org;http-waiverdb;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:03:23] SERVICE ALERT: proxy11.fedoraproject.org;http-docs.fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:03:15] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:02:47] SERVICE ALERT: proxy11.fedoraproject.org;http-fedoraproject.org-hotspot.txt;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 11:02:20] SERVICE ALERT: proxy06.fedoraproject.org;http-fedoraproject.org-hotspot.txt;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 414 bytes in 0.142 second response time
Service Critical[06-07-2024 11:02:01] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Warning[06-07-2024 11:01:20] SERVICE ALERT: proxy06.fedoraproject.org;http-fedoraproject.org-hotspot.txt;WARNING;SOFT;1;HTTP WARNING: HTTP/1.1 200 OK - 414 bytes in 36.245 second response time
Service Ok[06-07-2024 11:01:18] SERVICE ALERT: proxy06.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 3609 bytes in 10.455 second response time
Service Ok[06-07-2024 11:01:13] SERVICE ALERT: proxy06.fedoraproject.org;http-fedoraproject.org;OK;SOFT;3;HTTP OK: HTTP/1.1 302 Found - 475 bytes in 5.330 second response time
Service Ok[06-07-2024 11:01:03] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 534 bytes in 6.402 second response time
Service Critical[06-07-2024 11:00:20] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;CRITICAL - Cannot make SSL connection.
Service Critical[06-07-2024 11:00:08] SERVICE ALERT: proxy06.fedoraproject.org;http-fedoraproject.org;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 11:00:07] SERVICE ALERT: proxy06.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;SOFT;2;CRITICAL - Socket timeout


June 07, 2024 10:00

Service Critical[06-07-2024 10:59:56] SERVICE ALERT: proxy14.fedoraproject.org;http-moby-registry;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 10:59:44] SERVICE ALERT: proxy06.fedoraproject.org;http-fedoraproject.org-hotspot.txt;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 414 bytes in 16.135 second response time
Service Ok[06-07-2024 10:59:37] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 34075 bytes in 2.887 second response time
Service Ok[06-07-2024 10:59:20] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 102275 bytes in 7.265 second response time
Service Critical[06-07-2024 10:58:59] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;CRITICAL;HARD;3;CRITICAL - Socket timeout
Service Critical[06-07-2024 10:58:34] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 10:58:32] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-hotspot.txt;CRITICAL;HARD;3;CRITICAL - Socket timeout
Service Critical[06-07-2024 10:58:28] SERVICE ALERT: proxy06.fedoraproject.org;http-fedoraproject.org-hotspot.txt;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 10:58:27] SERVICE ALERT: proxy06.fedoraproject.org;http-fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 10:58:26] SERVICE ALERT: proxy06.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 10:58:13] SERVICE ALERT: proxy14.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 10:57:44] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 8.102 second response time
Service Ok[06-07-2024 10:57:33] SERVICE ALERT: proxy36.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 6.248 second response time
Service Critical[06-07-2024 10:57:18] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 10:56:51] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-hotspot.txt;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 10:56:36] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;2;HTTP CRITICAL: HTTP/1.1 200 OK - 5427 bytes in 40.563 second response time
Service Critical[06-07-2024 10:56:27] SERVICE ALERT: proxy36.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 10:56:07] SERVICE ALERT: proxy14.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;HARD;3;CRITICAL - Socket timeout
Service Ok[06-07-2024 10:56:02] SERVICE ALERT: proxy33.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5426 bytes in 4.816 second response time
Service Critical[06-07-2024 10:55:37] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 10:55:29] SERVICE ALERT: proxy34.fedoraproject.org;http-ipsilon;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 5427 bytes in 10.656 second response time
Service Critical[06-07-2024 10:55:10] SERVICE ALERT: proxy14.fedoraproject.org;http-fedoraproject.org-hotspot.txt;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 10:54:58] SERVICE ALERT: proxy33.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'your Fedora Account' not found on 'https://id.fedoraproject.org:443/' - 771 bytes in 21.685 second response time
Service Critical[06-07-2024 10:54:55] SERVICE ALERT: proxy14.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Critical[06-07-2024 10:54:26] SERVICE ALERT: proxy14.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 10:54:19] SERVICE ALERT: proxy34.fedoraproject.org;http-ipsilon;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'your Fedora Account' not found on 'https://id.fedoraproject.org:443/' - 771 bytes in 20.329 second response time
Service Critical[06-07-2024 10:52:45] SERVICE ALERT: proxy14.fedoraproject.org;http-mirrors.fedoraproject.org-mirrorlist;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host stopped flapping[06-07-2024 10:45:01] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (4.0% change < 5.0% threshold)
Host stopped flapping[06-07-2024 10:44:56] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok[06-07-2024 10:37:55] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk Space /boot;OK;HARD;1;DISK OK - free space: /boot 702 MiB (73.19% inode=100%):
Service Ok[06-07-2024 10:36:31] SERVICE ALERT: bvmhost-p09-02.iad2.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Host stopped flapping[06-07-2024 10:36:07] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)
Service Critical[06-07-2024 10:35:31] SERVICE ALERT: bvmhost-p09-02.iad2.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 10:24:28] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;OK;HARD;1;PROCS OK: 548 processes
Service Ok[06-07-2024 10:19:44] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 233.53 ms
Service Warning[06-07-2024 10:18:38] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 233.26 ms
Host Up[06-07-2024 10:14:58] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host started flapping[06-07-2024 10:14:58] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STARTED; Host appears to have started flapping (22.5% change > 20.0% threshold)
Service Critical[06-07-2024 10:14:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;CRITICAL;HARD;3;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-07-2024 10:13:58] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 10:13:28] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-07-2024 10:08:53] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok[06-07-2024 10:08:53] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;OK;SOFT;2;PROCS OK: 0 processes with STATE = Z
Service Critical[06-07-2024 10:08:25] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk Space /boot;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-07-2024 10:07:53] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 10:07:53] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Zombie Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.


June 07, 2024 09:00

Host stopped flapping[06-07-2024 09:48:12] HOST FLAPPING ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host stopped flapping[06-07-2024 09:47:23] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.9% change < 5.0% threshold)
Service Ok[06-07-2024 09:36:52] SERVICE ALERT: proxy04.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99792 bytes in 0.707 second response time
Service Critical[06-07-2024 09:35:51] SERVICE ALERT: proxy04.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Proxy Error - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 781 bytes in 9.583 second response time
Host Up[06-07-2024 09:29:43] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.59 ms
Host Up[06-07-2024 09:29:07] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.66 ms
Host Down[06-07-2024 09:28:42] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-07-2024 09:28:07] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 238.35 ms
Host Down[06-07-2024 09:28:06] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-07-2024 09:27:38] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99848 bytes in 1.712 second response time
Host Up[06-07-2024 09:27:23] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host started flapping[06-07-2024 09:27:23] HOST FLAPPING ALERT: bvmhost-s390x-01.s390.fedoraproject.org;STARTED; Host appears to have started flapping (21.7% change > 20.0% threshold)
Service Ok[06-07-2024 09:27:04] SERVICE ALERT: proxy11.fedoraproject.org;http-odcs;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 16627 bytes in 3.508 second response time
Service Warning[06-07-2024 09:27:00] SERVICE ALERT: proxy30.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 236.73 ms
Service Critical[06-07-2024 09:26:36] SERVICE ALERT: proxy11.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Down[06-07-2024 09:26:28] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 09:26:00] SERVICE ALERT: proxy11.fedoraproject.org;http-odcs;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Up[06-07-2024 09:22:55] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.95 ms
Host Down[06-07-2024 09:21:54] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 09:20:01] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.78 ms
Host Down[06-07-2024 09:19:00] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Service Ok[06-07-2024 09:17:54] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue toddlers;OK;SOFT;2;RABBITMQ_QUEUE OK - messages OK (1) messages_ready OK (0) messages_unacknowledged OK (1) consumers OK (4) All queues under the thresholds
Host Down[06-07-2024 09:17:48] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Service Warning[06-07-2024 09:16:54] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue toddlers;WARNING;SOFT;1;RABBITMQ_QUEUE WARNING - messages WARNING (11), messages_ready OK (7) messages_unacknowledged OK (4) consumers OK (4)
Host Down[06-07-2024 09:16:36] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 0%, RTA = 5976.12 ms
Host Up[06-07-2024 09:15:58] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-07-2024 09:14:58] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;(Host check timed out after 30.01 seconds)
Service Ok[06-07-2024 09:11:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;OK;SOFT;3;PROCS OK: 551 processes
Service Critical[06-07-2024 09:10:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;CRITICAL;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 09:10:38] SERVICE ALERT: lists.fedoraproject.org;http-lists.fedoraproject.org;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 56255 bytes in 1.757 second response time
Host Up[06-07-2024 09:10:05] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.99 ms
Host Up[06-07-2024 09:09:56] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.90 ms
Service Critical[06-07-2024 09:09:36] SERVICE ALERT: lists.fedoraproject.org;http-lists.fedoraproject.org;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - string 'Fedora Mailing-Lists' not found on 'https://lists.fedoraproject.org:443/archives/' - 879 bytes in 3.515 second response time
Service Critical[06-07-2024 09:09:28] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-07-2024 09:09:04] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-07-2024 09:08:59] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;OK;SOFT;2;SSH OK - OpenSSH_9.3 (protocol 2.0)
Host Down[06-07-2024 09:08:55] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Critical[06-07-2024 09:07:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;SSH-virtservers;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Up[06-07-2024 09:06:29] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2681.93 ms
Host started flapping[06-07-2024 09:06:29] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.9% change > 20.0% threshold)
Host Down[06-07-2024 09:05:24] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%


June 07, 2024 08:00

Host Up[06-07-2024 08:55:20] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 25%, RTA = 4708.39 ms
Host Down[06-07-2024 08:54:12] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Critical[06-07-2024 08:46:38] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue fedbadges;CRITICAL;HARD;3;RABBITMQ_QUEUE CRITICAL - messages CRITICAL (25983), messages_ready OK (25858) messages_unacknowledged OK (125) consumers OK (5)
Service Ok[06-07-2024 08:44:30] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;OK;SOFT;2;HTTP OK: Status line output matched "HTTP/1.0 401 Unauthorized" - 303 bytes in 0.080 second response time
Service Critical[06-07-2024 08:43:30] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Up[06-07-2024 08:41:43] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.70 ms
Host started flapping[06-07-2024 08:41:43] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.9% change > 20.0% threshold)
Host Down[06-07-2024 08:40:42] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 08:30:31] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 3.34 ms
Host Down[06-07-2024 08:29:30] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Warning[06-07-2024 08:26:37] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue fedbadges;WARNING;HARD;3;RABBITMQ_QUEUE WARNING - messages WARNING (21327), messages_ready OK (21202) messages_unacknowledged OK (125) consumers OK (5)
Service Warning[06-07-2024 08:25:37] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue fedbadges;WARNING;SOFT;2;RABBITMQ_QUEUE WARNING - messages WARNING (21114), messages_ready OK (20989) messages_unacknowledged OK (125) consumers OK (5)
Service Warning[06-07-2024 08:24:37] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue fedbadges;WARNING;SOFT;1;RABBITMQ_QUEUE WARNING - messages WARNING (20921), messages_ready OK (20796) messages_unacknowledged OK (125) consumers OK (5)
Host Up[06-07-2024 08:13:12] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.25 ms
Host started flapping[06-07-2024 08:13:12] HOST FLAPPING ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.2% change > 20.0% threshold)
Host Down[06-07-2024 08:12:11] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-07-2024 08:06:25] SERVICE ALERT: bvmhost-p09-03.iad2.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Service Critical[06-07-2024 08:05:25] SERVICE ALERT: bvmhost-p09-03.iad2.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CRITICAL - Plugin timed out
Service Ok[06-07-2024 08:03:33] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 243.33 ms
Service Warning[06-07-2024 08:02:26] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 243.29 ms


June 07, 2024 07:00

Host Up[06-07-2024 07:58:31] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.55 ms
Host Down[06-07-2024 07:57:30] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 75%, RTA = 7490.44 ms
Host Up[06-07-2024 07:54:04] HOST ALERT: internetx-gw;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 96.53 ms
Host Up[06-07-2024 07:53:50] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 0%, RTA = 3410.01 ms
Host started flapping[06-07-2024 07:53:50] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (24.2% change > 20.0% threshold)
Host Down[06-07-2024 07:53:03] HOST ALERT: internetx-gw;DOWN;SOFT;1;PING CRITICAL - Packet loss = 62%, RTA = 6047.36 ms
Host Down[06-07-2024 07:52:43] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 07:52:03] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.12 ms
Host Up[06-07-2024 07:52:00] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.17 ms
Host Down[06-07-2024 07:51:02] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 9%, RTA = 5128.37 ms
Host Down[06-07-2024 07:50:59] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;3;PING CRITICAL - Packet loss = 100%
Host Down[06-07-2024 07:49:47] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-07-2024 07:48:35] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 07:47:32] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.72 ms
Host Down[06-07-2024 07:46:31] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-07-2024 07:27:30] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 16%, RTA = 235.77 ms
Service Warning[06-07-2024 07:26:23] SERVICE ALERT: proxy38.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 235.75 ms
Host Up[06-07-2024 07:24:00] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 37%, RTA = 4122.72 ms
Host Down[06-07-2024 07:22:52] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 66%, RTA = 7375.85 ms
Host Up[06-07-2024 07:22:10] HOST ALERT: buildvm-ppc64le-01.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2523.41 ms
Host Down[06-07-2024 07:21:05] HOST ALERT: buildvm-ppc64le-01.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-07-2024 07:19:53] HOST ALERT: buildvm-ppc64le-01.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 07:19:01] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.05 ms
Host Down[06-07-2024 07:18:00] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 07:16:51] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.82 ms
Service Ok[06-07-2024 07:16:02] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;OK;SOFT;3;The last build 7548751 for copr-ping succeeded, took 910 seconds, elapsed since the last stop 50 seconds
Host Down[06-07-2024 07:15:50] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Warning[06-07-2024 07:15:01] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;WARNING;SOFT;2;2456 seconds since the last successful build, allowed 2160 seconds
Service Warning[06-07-2024 07:13:59] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;WARNING;SOFT;1;2395 seconds since the last successful build, allowed 2160 seconds
Service stopped flapping[06-07-2024 07:03:58] SERVICE FLAPPING ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;STOPPED; Service appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Ok[06-07-2024 07:02:11] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;OK;SOFT;2;DISK OK - free space: / 92618 MiB (91.42% inode=100%):
Service Critical[06-07-2024 07:01:10] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.


June 07, 2024 06:00

Service Ok[06-07-2024 06:41:17] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;OK;SOFT;2;PING OK - Packet loss = 0%, RTA = 244.15 ms
Service Warning[06-07-2024 06:40:10] SERVICE ALERT: proxy31.fedoraproject.org;vpnclients;WARNING;SOFT;1;PING WARNING - Packet loss = 28%, RTA = 244.66 ms
Host Up[06-07-2024 06:14:06] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-07-2024 06:13:06] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host stopped flapping[06-07-2024 06:03:24] HOST FLAPPING ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Up[06-07-2024 06:02:23] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.25 ms
Host Down[06-07-2024 06:01:22] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 06:00:53] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.60 ms
Host Down[06-07-2024 06:00:10] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%


June 07, 2024 05:00

Host Down[06-07-2024 05:59:52] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-07-2024 05:42:13] SERVICE ALERT: proxy31.fedoraproject.org;http-fedoraproject.org-wiki;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 19453 bytes in 2.030 second response time
Service Ok[06-07-2024 05:41:51] SERVICE ALERT: proxy40.fedoraproject.org;http-fedoraproject.org-wiki;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 19440 bytes in 1.027 second response time
Service Ok[06-07-2024 05:41:40] SERVICE ALERT: proxy05.fedoraproject.org;http-fedoraproject.org-wiki;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 19408 bytes in 0.796 second response time
Service Ok[06-07-2024 05:41:33] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 34060 bytes in 0.156 second response time
Service Ok[06-07-2024 05:41:26] SERVICE ALERT: proxy39.fedoraproject.org;http-fedoraproject.org-wiki;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 19453 bytes in 1.886 second response time
Service Critical[06-07-2024 05:41:11] SERVICE ALERT: proxy31.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Looking for help' not found on 'https://fedoraproject.org:443/wiki/Fedora_Project_Wiki' - 2718 bytes in 1.476 second response time
Service Critical[06-07-2024 05:40:50] SERVICE ALERT: proxy40.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Looking for help' not found on 'https://fedoraproject.org:443/wiki/Fedora_Project_Wiki' - 2735 bytes in 0.814 second response time
Service Critical[06-07-2024 05:40:39] SERVICE ALERT: proxy05.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Looking for help' not found on 'https://fedoraproject.org:443/wiki/Fedora_Project_Wiki' - 2736 bytes in 0.548 second response time
Service Critical[06-07-2024 05:40:33] SERVICE ALERT: proxy01.iad2.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'MediaWiki is free software' not found on 'https://fedoraproject.org:443/wiki/Special:Version' - 3088 bytes in 0.023 second response time
Service Critical[06-07-2024 05:40:24] SERVICE ALERT: proxy39.fedoraproject.org;http-fedoraproject.org-wiki;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Looking for help' not found on 'https://fedoraproject.org:443/wiki/Fedora_Project_Wiki' - 2734 bytes in 1.358 second response time
Service Ok[06-07-2024 05:39:51] SERVICE ALERT: proxy31.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 34100 bytes in 2.096 second response time
Service Critical[06-07-2024 05:38:49] SERVICE ALERT: proxy31.fedoraproject.org;http-fedoraproject.org-wiki-non-cached;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'MediaWiki is free software' not found on 'https://fedoraproject.org:443/wiki/Special:Version' - 3060 bytes in 1.473 second response time
Service Ok[06-07-2024 05:15:06] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;3;PROCS OK: 1 process with command name 'rsyslogd'
Host stopped flapping[06-07-2024 05:14:19] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Critical[06-07-2024 05:14:06] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 05:12:36] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.


June 07, 2024 04:00

Host Up[06-07-2024 04:41:07] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Service Ok[06-07-2024 04:41:06] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;OK;SOFT;2;PROCS OK: 1 process with command name 'rsyslogd'
Host stopped flapping[06-07-2024 04:40:39] HOST FLAPPING ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Down[06-07-2024 04:40:36] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 04:40:06] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Rsyslogd Process;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 04:35:50] SERVICE ALERT: vmhost-p09-copr01.rdu-cc.fedoraproject.org;vpnclients;OK;HARD;1;PING OK - Packet loss = 0%, RTA = 9.55 ms
Service Ok[06-07-2024 04:35:41] SERVICE ALERT: vmhost-p09-copr01.rdu-cc.fedoraproject.org;mail_queue;OK;HARD;1;0 mail(s) in queue
Service Ok[06-07-2024 04:35:08] SERVICE ALERT: vmhost-p09-copr01.rdu-cc.fedoraproject.org;Rsyslogd Process;OK;HARD;1;PROCS OK: 1 process with command name 'rsyslogd'
Host Up[06-07-2024 04:28:24] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.00 ms
Host Up[06-07-2024 04:27:50] HOST ALERT: vmhost-p09-copr01.rdu-cc.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-07-2024 04:27:23] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 70%, RTA = 9040.43 ms
Host Down[06-07-2024 04:26:49] HOST ALERT: vmhost-p09-copr01.rdu-cc.fedoraproject.org;DOWN;SOFT;3;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 04:26:32] SERVICE ALERT: vmhost-p09-copr01.rdu-cc.fedoraproject.org;mail_queue;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 04:26:16] SERVICE ALERT: vmhost-p09-copr01.rdu-cc.fedoraproject.org;vpnclients;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 04:25:37] SERVICE ALERT: vmhost-p09-copr01.rdu-cc.fedoraproject.org;Rsyslogd Process;CRITICAL;HARD;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-07-2024 04:25:19] HOST ALERT: vmhost-p09-copr01.rdu-cc.fedoraproject.org;DOWN;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Down[06-07-2024 04:23:49] HOST ALERT: vmhost-p09-copr01.rdu-cc.fedoraproject.org;DOWN;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 04:12:54] SERVICE ALERT: bvmhost-p09-02.iad2.fedoraproject.org;Disk_Space_/;OK;SOFT;2;DISK OK - free space: / 94875 MiB (92.69% inode=100%):
Service Critical[06-07-2024 04:11:54] SERVICE ALERT: bvmhost-p09-02.iad2.fedoraproject.org;Disk_Space_/;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.


June 07, 2024 03:00

Service Ok[06-07-2024 03:53:58] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;OK;HARD;1;The last build 7546671 for copr-ping succeeded, took 844 seconds, elapsed since the last stop 592 seconds
Service started flapping[06-07-2024 03:53:58] SERVICE FLAPPING ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;STARTED; Service appears to have started flapping (21.6% change >= 20.0% threshold)
Host stopped flapping[06-07-2024 03:46:20] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Warning[06-07-2024 03:43:58] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;WARNING;HARD;3;2423 seconds since the last successful build, allowed 2160 seconds
Service Warning[06-07-2024 03:42:57] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;WARNING;SOFT;2;2363 seconds since the last successful build, allowed 2160 seconds
Service Warning[06-07-2024 03:41:57] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;WARNING;SOFT;1;2303 seconds since the last successful build, allowed 2160 seconds
Host Up[06-07-2024 03:39:19] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.51 ms
Host Down[06-07-2024 03:38:18] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 70%, RTA = 8876.65 ms
Service Ok[06-07-2024 03:34:37] SERVICE ALERT: rabbitmq01.iad2.fedoraproject.org;Check queue fedbadges;OK;HARD;1;RABBITMQ_QUEUE OK - messages OK (9347) messages_ready OK (9172) messages_unacknowledged OK (175) consumers OK (7) All queues under the thresholds
Service Ok[06-07-2024 03:27:12] SERVICE ALERT: pagure02.fedoraproject.org;https://pagure.io/fedora-infrastructure/issues;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 224192 bytes in 1.172 second response time
Service Critical[06-07-2024 03:26:10] SERVICE ALERT: pagure02.fedoraproject.org;https://pagure.io/fedora-infrastructure/issues;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Host Up[06-07-2024 03:17:14] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.63 ms
Host Down[06-07-2024 03:16:13] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-07-2024 03:15:01] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 03:14:10] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;UP;SOFT;1;NRPE v4.1.0
Host Down[06-07-2024 03:13:10] HOST ALERT: bvmhost-s390x-01.s390.fedoraproject.org;DOWN;SOFT;1;(Host check timed out after 30.00 seconds)
Host Up[06-07-2024 03:09:59] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.65 ms
Host Down[06-07-2024 03:08:58] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 55%, RTA = 6757.39 ms
Host Down[06-07-2024 03:07:50] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 55%, RTA = 6934.45 ms
Host stopped flapping[06-07-2024 03:07:50] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Up[06-07-2024 03:05:39] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.00 ms
Host Up[06-07-2024 03:04:50] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.67 ms
Host started flapping[06-07-2024 03:04:50] HOST FLAPPING ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (20.5% change > 20.0% threshold)
Host Down[06-07-2024 03:04:38] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-07-2024 03:03:49] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 75%, RTA = 6987.06 ms
Service Ok[06-07-2024 03:00:40] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;OK;HARD;1;DISK OK - free space: / 92630 MiB (91.43% inode=100%):


June 07, 2024 02:00

Host Up[06-07-2024 02:54:27] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.05 ms
Host Down[06-07-2024 02:53:26] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 02:33:15] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.55 ms
Host started flapping[06-07-2024 02:33:15] HOST FLAPPING ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.9% change > 20.0% threshold)
Host stopped flapping[06-07-2024 02:32:42] HOST FLAPPING ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Host Down[06-07-2024 02:32:14] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Critical[06-07-2024 02:30:40] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;CRITICAL;HARD;3;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host stopped flapping[06-07-2024 02:29:41] HOST FLAPPING ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;STOPPED; Host appears to have stopped flapping (3.8% change < 5.0% threshold)
Service Critical[06-07-2024 02:29:10] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;CRITICAL;SOFT;2;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Ok[06-07-2024 02:28:56] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;OK;SOFT;2;PROCS OK: 1 process with command name 'crond', UID = 0 (root)
Service Ok[06-07-2024 02:27:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;OK;SOFT;2;PROCS OK: 539 processes
Service Critical[06-07-2024 02:27:55] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Cron Daemon;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 02:27:40] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Disk_Space_/;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Service Critical[06-07-2024 02:26:58] SERVICE ALERT: bvmhost-s390x-01.s390.fedoraproject.org;Total Processes;CRITICAL;SOFT;1;CHECK_NRPE STATE CRITICAL: Socket timeout after 30 seconds.
Host Up[06-07-2024 02:22:03] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 3.11 ms
Host Down[06-07-2024 02:21:02] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 02:13:09] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.99 ms
Host Down[06-07-2024 02:12:08] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 0%, RTA = 5627.94 ms
Host Up[06-07-2024 02:11:20] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.78 ms
Host Down[06-07-2024 02:10:19] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%


June 07, 2024 01:00

Service Ok[06-07-2024 01:51:57] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;OK;HARD;1;The last build 7546343 for copr-ping succeeded, took 1204 seconds, elapsed since the last stop 111 seconds
Host Up[06-07-2024 01:48:42] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.36 ms
Host Down[06-07-2024 01:47:41] HOST ALERT: buildvm-ppc64le-19.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 0%, RTA = 5507.91 ms
Host Up[06-07-2024 01:45:08] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.08 ms
Host Down[06-07-2024 01:44:07] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 01:42:09] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING WARNING - Packet loss = 91%, RTA = 0.72 ms
Service Warning[06-07-2024 01:41:57] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;WARNING;HARD;3;2303 seconds since the last successful build, allowed 2160 seconds
Host Down[06-07-2024 01:40:57] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 81%, RTA = 10027.16 ms
Service Warning[06-07-2024 01:40:56] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;WARNING;SOFT;2;2242 seconds since the last successful build, allowed 2160 seconds
Service Warning[06-07-2024 01:39:56] SERVICE ALERT: copr-be.aws.fedoraproject.org;The copr-ping package builds;WARNING;SOFT;1;2182 seconds since the last successful build, allowed 2160 seconds
Host Up[06-07-2024 01:32:49] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.34 ms
Host started flapping[06-07-2024 01:32:49] HOST FLAPPING ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (21.8% change > 20.0% threshold)
Host Down[06-07-2024 01:31:48] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-07-2024 01:26:04] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99507 bytes in 2.977 second response time
Service Ok[06-07-2024 01:26:03] SERVICE ALERT: proxy40.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99506 bytes in 1.596 second response time
Service Ok[06-07-2024 01:26:01] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99191 bytes in 0.380 second response time
Service Ok[06-07-2024 01:25:51] SERVICE ALERT: proxy32.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 99537 bytes in 1.447 second response time
Service Critical[06-07-2024 01:25:01] SERVICE ALERT: proxy33.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 9.775 second response time
Service Critical[06-07-2024 01:25:01] SERVICE ALERT: proxy40.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 5.500 second response time
Service Critical[06-07-2024 01:25:01] SERVICE ALERT: worker02.ocp.iad2.fedoraproject.org;http-koschei-internal;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 225 bytes in 2.773 second response time
Service Critical[06-07-2024 01:24:50] SERVICE ALERT: proxy32.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 594 bytes in 5.263 second response time
Service Ok[06-07-2024 01:22:20] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;OK;SOFT;3;HTTP OK: Status line output matched "HTTP/1.0 401 Unauthorized" - 303 bytes in 0.006 second response time
Service Critical[06-07-2024 01:21:20] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;2;CRITICAL - Socket timeout
Service Critical[06-07-2024 01:20:10] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 01:13:33] SERVICE ALERT: lists.fedoraproject.org;http-lists.fedoraproject.org;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 56255 bytes in 1.013 second response time
Service Critical[06-07-2024 01:12:32] SERVICE ALERT: lists.fedoraproject.org;http-lists.fedoraproject.org;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - string 'Fedora Mailing-Lists' not found on 'https://lists.fedoraproject.org:443/archives/' - 872 bytes in 0.012 second response time
Service Ok[06-07-2024 01:08:59] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;OK;SOFT;2;HTTP OK: Status line output matched "HTTP/1.0 401 Unauthorized" - 303 bytes in 0.007 second response time
Service Critical[06-07-2024 01:07:59] SERVICE ALERT: mailman01.iad2.fedoraproject.org;check mailman api;CRITICAL;SOFT;1;CRITICAL - Socket timeout


June 07, 2024 00:00

Host Up[06-07-2024 00:58:56] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.93 ms
Host started flapping[06-07-2024 00:58:56] HOST FLAPPING ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.7% change > 20.0% threshold)
Host Down[06-07-2024 00:57:55] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 00:57:41] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.50 ms
Host started flapping[06-07-2024 00:57:41] HOST FLAPPING ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.2% change > 20.0% threshold)
Host Down[06-07-2024 00:56:40] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 00:54:41] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 64.43 ms
Host started flapping[06-07-2024 00:54:41] HOST FLAPPING ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (24.2% change > 20.0% threshold)
Host Down[06-07-2024 00:53:40] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 00:48:29] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.10 ms
Host Down[06-07-2024 00:47:28] HOST ALERT: buildvm-ppc64le-18.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 00:45:47] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.67 ms
Host started flapping[06-07-2024 00:45:47] HOST FLAPPING ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;STARTED; Host appears to have started flapping (23.6% change > 20.0% threshold)
Host Down[06-07-2024 00:44:46] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 00:42:44] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.01 ms
Host Up[06-07-2024 00:42:43] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 0.98 ms
Host Down[06-07-2024 00:41:43] HOST ALERT: buildvm-ppc64le-20.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-07-2024 00:41:42] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 00:41:37] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 2.55 ms
Host Down[06-07-2024 00:40:36] HOST ALERT: buildvm-ppc64le-17.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 10%, RTA = 5234.29 ms
Host Down[06-07-2024 00:40:30] HOST ALERT: buildvm-ppc64le-21.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Up[06-07-2024 00:31:29] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.99 ms
Host Up[06-07-2024 00:30:51] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.16 ms
Host Down[06-07-2024 00:30:28] HOST ALERT: buildvm-ppc64le-22.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Host Down[06-07-2024 00:29:50] HOST ALERT: buildvm-ppc64le-24.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 55%, RTA = 6764.40 ms
Host Up[06-07-2024 00:29:35] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;UP;SOFT;1;PING OK - Packet loss = 0%, RTA = 1.20 ms
Host Down[06-07-2024 00:28:34] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;2;PING CRITICAL - Packet loss = 100%
Host Down[06-07-2024 00:27:22] HOST ALERT: buildvm-ppc64le-23.iad2.fedoraproject.org;DOWN;SOFT;1;PING CRITICAL - Packet loss = 100%
Service Ok[06-07-2024 00:21:11] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi2;OK;SOFT;3;HTTP OK: HTTP/1.1 200 OK - 14235 bytes in 0.017 second response time
Service Warning[06-07-2024 00:20:11] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi2;WARNING;SOFT;2;HTTP WARNING: HTTP/1.1 200 OK - 14239 bytes in 33.470 second response time
Service Critical[06-07-2024 00:18:38] SERVICE ALERT: proxy10.iad2.fedoraproject.org;http-bodhi2;CRITICAL;SOFT;1;CRITICAL - Socket timeout
Service Ok[06-07-2024 00:05:18] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;OK;SOFT;2;HTTP OK: HTTP/1.1 200 OK - 101512 bytes in 2.456 second response time
Service Critical[06-07-2024 00:04:16] SERVICE ALERT: proxy31.fedoraproject.org;http-koschei;CRITICAL;SOFT;1;HTTP CRITICAL: HTTP/1.1 502 Proxy Error - string 'Package summary' not found on 'https://koschei.fedoraproject.org:443/' - 781 bytes in 1.194 second response time