Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6413517 2021-09-29 14:43:58 2021-09-29 14:43:59 2021-09-29 15:13:22 0:29:23 0:20:19 0:09:04 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
fail 6413518 2021-09-29 14:43:58 2021-09-29 14:43:59 2021-09-29 15:17:05 0:33:06 0:22:36 0:10:30 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

timed out waiting for admin_socket to appear after osd.0 restart

pass 6413519 2021-09-29 14:43:58 2021-09-29 14:44:00 2021-09-29 15:14:25 0:30:25 0:21:15 0:09:10 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413520 2021-09-29 14:43:58 2021-09-29 14:44:00 2021-09-29 15:12:53 0:28:53 0:20:41 0:08:12 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413521 2021-09-29 14:43:58 2021-09-29 14:44:00 2021-09-29 15:12:42 0:28:42 0:19:50 0:08:52 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413522 2021-09-29 14:43:58 2021-09-29 14:44:02 2021-09-29 15:13:02 0:29:00 0:20:19 0:08:41 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
fail 6413523 2021-09-29 14:43:58 2021-09-29 14:44:02 2021-09-29 15:14:49 0:30:47 0:21:46 0:09:01 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed on smithi176 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

pass 6413524 2021-09-29 14:43:58 2021-09-29 14:44:03 2021-09-29 15:13:18 0:29:15 0:19:29 0:09:46 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
fail 6413525 2021-09-29 14:43:58 2021-09-29 14:44:04 2021-09-29 15:14:48 0:30:44 0:21:14 0:09:30 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed on smithi096 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

pass 6413526 2021-09-29 14:43:58 2021-09-29 14:44:05 2021-09-29 15:13:00 0:28:55 0:20:35 0:08:20 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
fail 6413527 2021-09-29 14:43:58 2021-09-29 14:44:05 2021-09-29 15:29:01 0:44:56 0:36:12 0:08:44 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

"2021-09-29T15:06:14.130623+0000 mon.a (mon.0) 89 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 31 sec, mon.a has slow ops (SLOW_OPS)" in cluster log

fail 6413528 2021-09-29 14:43:58 2021-09-29 14:44:05 2021-09-29 15:14:31 0:30:26 0:21:49 0:08:37 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed on smithi017 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

pass 6413529 2021-09-29 14:43:58 2021-09-29 14:44:06 2021-09-29 15:14:14 0:30:08 0:19:02 0:11:06 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413530 2021-09-29 14:43:58 2021-09-29 14:44:06 2021-09-29 15:13:14 0:29:08 0:18:53 0:10:15 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413531 2021-09-29 14:43:59 2021-09-29 14:44:06 2021-09-29 15:14:53 0:30:47 0:18:39 0:12:08 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413532 2021-09-29 14:43:59 2021-09-29 14:44:06 2021-09-29 15:12:52 0:28:46 0:20:08 0:08:38 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
fail 6413533 2021-09-29 14:43:59 2021-09-29 14:44:08 2021-09-29 15:14:51 0:30:43 0:21:26 0:09:17 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed on smithi049 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

pass 6413534 2021-09-29 14:43:59 2021-09-29 14:44:08 2021-09-29 15:12:54 0:28:46 0:20:34 0:08:12 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413535 2021-09-29 14:43:59 2021-09-29 14:44:08 2021-09-29 15:11:52 0:27:44 0:19:10 0:08:34 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413536 2021-09-29 14:43:59 2021-09-29 14:44:09 2021-09-29 15:13:49 0:29:40 0:20:25 0:09:15 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
fail 6413537 2021-09-29 14:43:59 2021-09-29 14:44:09 2021-09-29 15:15:09 0:31:00 0:20:50 0:10:10 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed on smithi155 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

pass 6413538 2021-09-29 14:43:59 2021-09-29 14:44:10 2021-09-29 15:12:54 0:28:44 0:19:41 0:09:03 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
fail 6413539 2021-09-29 14:43:59 2021-09-29 14:44:11 2021-09-29 15:29:50 0:45:39 0:36:27 0:09:12 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

"2021-09-29T15:06:19.141941+0000 mon.a (mon.0) 88 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 33 sec, mon.a has slow ops (SLOW_OPS)" in cluster log

fail 6413540 2021-09-29 14:43:59 2021-09-29 14:44:11 2021-09-29 15:15:09 0:30:58 0:20:59 0:09:59 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed on smithi123 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

pass 6413541 2021-09-29 14:43:59 2021-09-29 14:44:11 2021-09-29 15:13:47 0:29:36 0:19:19 0:10:17 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413542 2021-09-29 14:43:59 2021-09-29 14:44:11 2021-09-29 15:13:37 0:29:26 0:18:58 0:10:28 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413543 2021-09-29 14:43:59 2021-09-29 14:44:12 2021-09-29 15:13:51 0:29:39 0:20:03 0:09:36 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413544 2021-09-29 14:43:59 2021-09-29 14:44:12 2021-09-29 15:13:57 0:29:45 0:19:15 0:10:30 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413545 2021-09-29 14:43:59 2021-09-29 14:44:14 2021-09-29 15:15:12 0:30:58 0:21:07 0:09:51 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
fail 6413546 2021-09-29 14:43:59 2021-09-29 14:44:14 2021-09-29 15:14:57 0:30:43 0:22:46 0:07:57 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

timed out waiting for admin_socket to appear after osd.0 restart

pass 6413547 2021-09-29 14:44:02 2021-09-29 14:44:14 2021-09-29 15:12:48 0:28:34 0:20:40 0:07:54 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
fail 6413548 2021-09-29 14:44:02 2021-09-29 14:44:14 2021-09-29 15:39:04 0:54:50 0:46:17 0:08:33 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

"2021-09-29T15:05:29.405600+0000 osd.0 (osd.0) 1 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running" in cluster log

pass 6413549 2021-09-29 14:44:02 2021-09-29 14:44:15 2021-09-29 15:18:29 0:34:14 0:20:12 0:14:02 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413550 2021-09-29 14:44:02 2021-09-29 14:44:15 2021-09-29 15:13:27 0:29:12 0:19:55 0:09:17 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413551 2021-09-29 14:44:02 2021-09-29 14:44:15 2021-09-29 15:14:00 0:29:45 0:20:08 0:09:37 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
fail 6413552 2021-09-29 14:44:02 2021-09-29 14:44:16 2021-09-29 15:13:58 0:29:42 0:20:04 0:09:38 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed on smithi142 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

pass 6413553 2021-09-29 14:44:02 2021-09-29 14:44:16 2021-09-29 15:12:55 0:28:39 0:19:24 0:09:15 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413554 2021-09-29 14:44:02 2021-09-29 14:44:16 2021-09-29 15:13:50 0:29:34 0:20:24 0:09:10 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
fail 6413555 2021-09-29 14:44:02 2021-09-29 14:44:17 2021-09-29 15:15:50 0:31:33 0:21:55 0:09:38 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

timed out waiting for admin_socket to appear after osd.0 restart

pass 6413556 2021-09-29 14:44:02 2021-09-29 14:44:17 2021-09-29 15:13:58 0:29:41 0:19:52 0:09:49 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413557 2021-09-29 14:44:02 2021-09-29 14:44:18 2021-09-29 15:13:41 0:29:23 0:19:41 0:09:42 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413558 2021-09-29 14:44:02 2021-09-29 14:44:20 2021-09-29 15:14:09 0:29:49 0:19:08 0:10:41 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413559 2021-09-29 14:44:02 2021-09-29 14:44:20 2021-09-29 15:14:12 0:29:52 0:19:09 0:10:43 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413560 2021-09-29 14:44:02 2021-09-29 14:44:20 2021-09-29 15:13:26 0:29:06 0:19:01 0:10:05 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413561 2021-09-29 14:44:02 2021-09-29 14:44:21 2021-09-29 15:13:45 0:29:24 0:19:31 0:09:53 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413562 2021-09-29 14:44:03 2021-09-29 14:44:21 2021-09-29 15:13:45 0:29:24 0:19:55 0:09:29 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413563 2021-09-29 14:44:03 2021-09-29 14:44:21 2021-09-29 15:13:44 0:29:23 0:20:23 0:09:00 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
fail 6413564 2021-09-29 14:44:03 2021-09-29 14:44:22 2021-09-29 15:13:51 0:29:29 0:20:46 0:08:43 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed on smithi062 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

pass 6413565 2021-09-29 14:44:03 2021-09-29 14:44:22 2021-09-29 15:14:03 0:29:41 0:19:20 0:10:21 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6413566 2021-09-29 14:44:03 2021-09-29 14:44:22 2021-09-29 15:13:33 0:29:11 0:20:22 0:08:49 smithi master centos 8.3 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1