Current Network Status

CRITICAL

06-20-2024 06:16:21

0d 1h 36m 42s

3/3

FILE_AGE CRITICAL: /etc/httpd/ticketkey_production.tkey is 8015 seconds old and 48 bytes

WARNING

06-20-2024 06:16:26

0d 1h 36m 37s

3/3

FILE_AGE WARNING: /etc/httpd/ticketkey_production.tkey is 4302 seconds old and 48 bytes

WARNING

06-20-2024 06:16:32

0d 1h 36m 31s

3/3

FILE_AGE WARNING: /etc/httpd/ticketkey_production.tkey is 4308 seconds old and 48 bytes

WARNING

06-20-2024 06:16:42

0d 1h 36m 21s

3/3

FILE_AGE WARNING: /etc/httpd/ticketkey_production.tkey is 4321 seconds old and 48 bytes

WARNING

06-20-2024 06:16:57

0d 1h 36m 6s

3/3

FILE_AGE WARNING: /etc/httpd/ticketkey_production.tkey is 4347 seconds old and 48 bytes

WARNING

06-20-2024 06:17:01

0d 1h 36m 2s

3/3

FILE_AGE WARNING: /etc/httpd/ticketkey_production.tkey is 4371 seconds old and 48 bytes

WARNING

06-20-2024 06:18:14

0d 1h 34m 49s

3/3

FILE_AGE WARNING: /etc/httpd/ticketkey_production.tkey is 4440 seconds old and 48 bytes

WARNING

06-20-2024 06:19:20

0d 1h 33m 43s

3/3

FILE_AGE WARNING: /etc/httpd/ticketkey_production.tkey is 4494 seconds old and 48 bytes

proxy37.fedoraproject.org

WARNING

06-20-2024 06:19:34

0d 1h 33m 29s

3/3

FILE_AGE WARNING: /etc/httpd/ticketkey_production.tkey is 4525 seconds old and 48 bytes

06-20-2024 06:27:03

9d 11h 26m 0s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist1/mirrorlist_cache.proto is 531 seconds old and 244343636 bytes

06-20-2024 06:27:03

9d 11h 26m 0s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist2/mirrorlist_cache.proto is 531 seconds old and 244343636 bytes

06-20-2024 06:27:03

9d 9h 26m 0s

1/3

FILE_AGE OK: /srv/web/ostree/summary is 721 seconds old and 31784 bytes

WARNING

06-20-2024 06:29:06

0d 1h 23m 57s

3/3

FILE_AGE WARNING: /etc/httpd/ticketkey_production.tkey is 5064 seconds old and 48 bytes

06-20-2024 06:33:34

132d 5h 19m 29s

1/3

FILE_AGE OK: /srv/web/ostree/summary is 213 seconds old and 31784 bytes

06-20-2024 06:40:54

5d 17h 13m 15s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist2/mirrorlist_cache.proto is 1362 seconds old and 244343636 bytes

06-20-2024 07:00:24

371d 10h 34m 34s

1/3

FILE_AGE OK: /srv/web/ostree/summary is 24 seconds old and 31784 bytes

06-20-2024 07:00:28

21d 8h 52m 35s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist1/mirrorlist_cache.proto is 719 seconds old and 244343637 bytes

06-20-2024 07:00:39

21d 8h 52m 24s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist1/mirrorlist_cache.proto is 730 seconds old and 244343637 bytes

06-20-2024 07:00:39

21d 8h 52m 24s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist1/mirrorlist_cache.proto is 730 seconds old and 244343637 bytes

06-20-2024 07:00:51

21d 8h 52m 12s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist1/mirrorlist_cache.proto is 743 seconds old and 244343637 bytes

06-20-2024 07:00:51

21d 8h 52m 12s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist1/mirrorlist_cache.proto is 742 seconds old and 244343637 bytes

06-20-2024 07:00:55

21d 8h 52m 7s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist1/mirrorlist_cache.proto is 745 seconds old and 244343637 bytes

06-20-2024 07:02:32

19d 8h 51m 31s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist2/mirrorlist_cache.proto is 2660 seconds old and 244343636 bytes

06-20-2024 07:02:38

21d 8h 50m 25s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist1/mirrorlist_cache.proto is 849 seconds old and 244343637 bytes

06-20-2024 07:04:54

21d 8h 48m 9s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist2/mirrorlist_cache.proto is 2803 seconds old and 244343636 bytes

06-20-2024 07:04:54

21d 8h 48m 9s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist2/mirrorlist_cache.proto is 2801 seconds old and 244343636 bytes

06-20-2024 07:05:00

21d 8h 48m 3s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist2/mirrorlist_cache.proto is 2808 seconds old and 244343636 bytes

06-20-2024 07:05:04

21d 8h 47m 59s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist2/mirrorlist_cache.proto is 2812 seconds old and 244343636 bytes

06-20-2024 07:05:05

21d 8h 47m 58s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist2/mirrorlist_cache.proto is 2813 seconds old and 244343636 bytes

06-20-2024 07:05:10

600d 16h 38m 34s

1/3

FILE_AGE OK: /srv/web/ostree/summary is 310 seconds old and 31784 bytes

06-20-2024 07:05:15

371d 10h 34m 5s

1/3

FILE_AGE OK: /srv/web/ostree/summary is 314 seconds old and 31784 bytes

06-20-2024 07:05:16

21d 8h 47m 47s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist2/mirrorlist_cache.proto is 2824 seconds old and 244343636 bytes

06-20-2024 07:05:19

605d 5h 11m 21s

1/3

FILE_AGE OK: /srv/web/ostree/summary is 318 seconds old and 31784 bytes

06-20-2024 07:05:19

21d 8h 47m 44s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist2/mirrorlist_cache.proto is 2827 seconds old and 244343636 bytes

06-20-2024 07:05:20

304d 17h 21m 51s

1/3

FILE_AGE OK: /srv/web/ostree/summary is 320 seconds old and 31784 bytes

06-20-2024 07:05:26

366d 0h 35m 58s

1/3

FILE_AGE OK: /srv/web/ostree/summary is 326 seconds old and 31784 bytes

06-20-2024 07:05:35

433d 3h 1m 17s

1/3

FILE_AGE OK: /srv/web/ostree/summary is 334 seconds old and 31784 bytes

06-20-2024 07:05:36

600d 16h 37m 43s

1/3

FILE_AGE OK: /srv/web/ostree/summary is 335 seconds old and 31784 bytes

06-20-2024 07:13:50

21d 8h 39m 13s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist2/mirrorlist_cache.proto is 3337 seconds old and 244343636 bytes

06-20-2024 07:13:54

21d 8h 39m 9s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist1/mirrorlist_cache.proto is 616 seconds old and 244341936 bytes

copr-fe-dev.aws.fedoraproject.org

06-20-2024 07:14:12

21d 8h 38m 51s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist1/mirrorlist_cache.proto is 633 seconds old and 244341936 bytes

copr-keygen.aws.fedoraproject.org

06-20-2024 07:25:35

371d 12h 4m 7s

1/3

DISK OK - free space: /boot 725 MiB (80.59% inode=99%):

Disk space on Copr Keygen used for GPG keys

06-20-2024 07:25:36

371d 12h 5m 5s

1/3

DISK OK - free space: /var/lib/copr-keygen 7254 MiB (76.24% inode=23%):

06-20-2024 07:29:51

67d 2h 23m 12s

1/3

FILE_AGE OK: /srv/web/ostree/summary is 890 seconds old and 31784 bytes

06-20-2024 07:31:53

21d 14h 21m 10s

1/3

FILE_AGE OK: /srv/mirrorlist/data/mirrorlist1/mirrorlist_cache.proto is 800 seconds old and 244314042 bytes

Disk space on Copr Backend used for build results

06-20-2024 07:33:09

260d 20h 42m 58s

1/3

DISK OK - free space: /var/lib/copr/public_html 14919870 MiB (36.05% inode=92%):

copr-be-dev.aws.fedoraproject.org

Disk space on Copr Backend used for build results

06-20-2024 07:33:11

201d 21h 8m 39s

1/3

DISK OK - free space: /var/lib/copr/public_html 143745 MiB (59.38% inode=98%):

copr-fe-dev.aws.fedoraproject.org

Disk space on Copr Frontend used for the database

06-20-2024 07:33:11

499d 10h 5m 12s

1/3

DISK OK - free space: /srv/copr-fe 10370 MiB (54.73% inode=100%):

copr-keygen.aws.fedoraproject.org

06-20-2024 07:33:12

161d 15h 6m 8s

1/3

DISK OK - free space: /boot 725 MiB (80.58% inode=99%):

copr-keygen-dev.aws.fedoraproject.org

06-20-2024 07:33:13

196d 17h 38m 5s

1/3

DISK OK - free space: / 15165 MiB (79.78% inode=-):

Disk space on Copr Keygen used for GPG keys

06-20-2024 07:33:19

575d 21h 29m 48s

1/3

DISK OK - free space: /var/lib/copr-keygen 1491 MiB (80.23% inode=37%):

copr-dist-git.aws.fedoraproject.org

CRITICAL

06-20-2024 07:35:21

0d 0h 17m 42s

3/3

FILE_AGE CRITICAL: /etc/httpd/ticketkey_production.tkey is 9072 seconds old and 48 bytes

Disk space on Copr DistGit used for imported packages

06-20-2024 07:37:10

86d 0h 45m 52s

1/3

DISK OK - free space: /var/lib/dist-git 1929940 MiB (28.64% inode=88%): / 20849 MiB (26.42% inode=-):

copr-dist-git.aws.fedoraproject.org

06-20-2024 07:37:34

251d 11h 16m 41s

1/3

DISK OK - free space: / 45281 MiB (47.06% inode=-):

copr-fe.aws.fedoraproject.org

06-20-2024 07:37:35

204d 16h 3m 16s

1/3

DISK OK - free space: / 20849 MiB (26.42% inode=-):

06-20-2024 07:37:35

204d 16h 33m 14s

1/3

DISK OK - free space: / 45070 MiB (57.31% inode=-):

Disk space on Copr DistGit used for imported packages

06-20-2024 07:37:36

161d 15h 3m 15s

1/3

DISK OK - free space: /var/lib/dist-git 401844 MiB (84.19% inode=99%): / 74246 MiB (91.99% inode=-):

copr-fe-dev.aws.fedoraproject.org

copr-keygen-dev.aws.fedoraproject.org

06-20-2024 07:37:38

561d 18h 0m 54s

1/3

DISK OK - free space: / 41221 MiB (82.87% inode=-):

06-20-2024 07:37:40

575d 16h 53m 41s

1/3

DISK OK - free space: / 15437 MiB (81.31% inode=-):

copr-fe.aws.fedoraproject.org

06-20-2024 07:42:13

161d 14h 58m 54s

1/3

DISK OK - free space: / 74246 MiB (91.99% inode=-):

Disk space on Copr Frontend used for the database

06-20-2024 07:42:13

13d 12h 44m 21s

1/3

DISK OK - free space: /srv/copr-fe 4530 MiB (23.91% inode=100%):

copr-dist-git.aws.fedoraproject.org

06-20-2024 07:42:24

308d 18h 36m 9s

1/3

DISK OK - free space: /boot 724 MiB (80.53% inode=99%):

copr-keygen-dev.aws.fedoraproject.org

06-20-2024 07:42:27

371d 12h 33m 7s

1/3

DISK OK - free space: /boot 725 MiB (80.57% inode=99%):

06-20-2024 07:42:27

371d 12h 33m 5s

1/3

DISK OK - free space: /boot 725 MiB (80.58% inode=99%):

06-20-2024 07:43:03

0d 15h 11m 5s

1/3

PING OK - Packet loss = 0%, RTA = 233.09 ms

Check proxies for oversubscription

06-20-2024 07:43:21

19d 16h 10m 43s

1/3

HAPROXY SUBS OK: 0.02% subscribed. 4 current of 20480 maxconn.

copr-pulp-dev.aws.fedoraproject.org

06-20-2024 07:43:27

2d 7h 9m 36s

1/3

DISK OK - free space: /boot 109 MiB (22.11% inode=100%):

06-20-2024 07:43:50

2d 7h 29m 13s

1/3

OK: fedmsg consumer(s) and producer(s) initialized

06-20-2024 07:44:01

0d 1h 0m 8s

1/3

PING OK - Packet loss = 0%, RTA = 230.44 ms

06-20-2024 07:44:16

6d 13h 19m 53s

1/3

PING OK - Packet loss = 0%, RTA = 91.73 ms

06-20-2024 07:44:24

6d 13h 29m 44s

1/3

PING OK - Packet loss = 0%, RTA = 78.45 ms

06-20-2024 07:44:37

2d 18h 29m 28s

1/3

PROCS OK: 1 process with regex args 'fedmsg-gateway-3', UID = 438 (fedmsg)

06-20-2024 07:44:40

2d 7h 28m 23s

1/3

PING OK - Packet loss = 0%, RTA = 117.17 ms

proxy30.fedoraproject.org mirrorlist docker container

06-20-2024 07:44:47

5d 15h 49m 19s

1/3

TCP OK - 0.000 second response time on localhost port 18081

aarch64-test01.fedorainfracloud.org

06-20-2024 07:45:19

19d 16h 8m 49s

1/3

PING OK - Packet loss = 0%, RTA = 92.68 ms

06-20-2024 07:45:19

32d 17h 48m 44s

1/3

PROCS OK: 1 process with regex args 'fedmsg-gateway-3', UID = 438 (fedmsg)

Check fedmsg-gateway consumers backlog

06-20-2024 07:45:20

19d 16h 8m 43s

1/3

OK: fedmsg consumer GatewayConsumer backlog value is 0

06-20-2024 07:45:20

19d 16h 8m 43s

1/3

PROCS OK: 1 process with command name 'varnishd', UID = 440 (varnish)

el9-test.fedorainfracloud.org

06-20-2024 07:45:21

4d 18h 8m 46s

1/3

PROCS OK: 1 process with command name 'varnishd', UID = 440 (varnish)

06-20-2024 07:45:22

35d 8h 37m 42s

1/3

PING OK - Packet loss = 0%, RTA = 93.70 ms

Check fedmsg-gateway consumers backlog

06-20-2024 07:45:22

3d 16h 48m 54s

1/3

OK: fedmsg consumer GatewayConsumer backlog value is 0

06-20-2024 07:45:23

2d 7h 27m 40s

1/3

PING OK - Packet loss = 0%, RTA = 117.37 ms

rawhide-test.fedorainfracloud.org

06-20-2024 07:45:40

31d 10h 38m 43s

1/3

PROCS OK: 1 process with command name 'varnishd', UID = 440 (varnish)

copr-fe.aws.fedoraproject.org

06-20-2024 07:45:40

35d 3h 17m 22s

1/3

PING OK - Packet loss = 0%, RTA = 90.32 ms

Rsyslogd Process

06-20-2024 07:46:47

2d 7h 37m 16s

1/3

PROCS OK: 1 process with command name 'rsyslogd'

06-20-2024 07:46:49

204d 16h 11m 57s

1/3

DISK OK - free space: /boot 724 MiB (80.55% inode=99%):

proxy37.fedoraproject.org

06-20-2024 07:46:55

21d 3h 57m 12s

1/3

OK: fedmsg consumer(s) and producer(s) initialized

Check fedmsg-gateway consumers exceptions

06-20-2024 07:47:02

3d 22h 26m 1s

1/3

OK: fedmsg consumer GatewayConsumer exceptions value is 0

proxy37.fedoraproject.org mirrorlist docker container

06-20-2024 07:47:02

3d 22h 26m 1s

1/3

TCP OK - 0.000 second response time on localhost port 18081

Check fedmsg-gateway consumers backlog

06-20-2024 07:47:03

3d 22h 26m 0s

1/3

OK: fedmsg consumer(s) and producer(s) initialized

06-20-2024 07:47:03

3d 22h 26m 0s

1/3

OK: fedmsg consumer GatewayConsumer backlog value is 0

Check proxies for oversubscription

06-20-2024 07:47:03

3d 22h 26m 0s

1/3

PROCS OK: 1 process with regex args 'fedmsg-gateway-3', UID = 437 (fedmsg)

06-20-2024 07:47:03

3d 22h 26m 0s

1/3

HAPROXY SUBS OK: 0.01% subscribed. 2 current of 20480 maxconn.

06-20-2024 07:47:03

3d 22h 26m 0s

1/3

PROCS OK: 1 process with command name 'varnishd', UID = 439 (varnish)

The copr-ping package builds

06-20-2024 07:47:06

8d 2h 45m 56s

1/3

The last build 7629334 for copr-ping succeeded, took 212 seconds, elapsed since the last stop 812 seconds

06-20-2024 07:47:37

4d 8h 15m 26s

1/3

PING OK - Packet loss = 0%, RTA = 95.84 ms

06-20-2024 07:47:55

31d 10h 46m 11s

1/3

PROCS OK: 1 process with regex args 'fedmsg-gateway-3', UID = 438 (fedmsg)

06-20-2024 07:47:56

6d 14h 25m 7s

1/3

PING OK - Packet loss = 0%, RTA = 222.01 ms

06-20-2024 07:47:56

6d 13h 56m 12s

1/3

PING OK - Packet loss = 0%, RTA = 87.09 ms

06-20-2024 07:48:00

31d 10h 46m 8s

1/3

OK: fedmsg consumer(s) and producer(s) initialized