Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6883393 2022-06-17 03:20:13 2022-06-17 03:20:57 2022-06-17 03:46:19 0:25:22 0:13:54 0:11:28 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_deep_flatten} 1
pass 6883394 2022-06-17 03:20:14 2022-06-17 03:20:57 2022-06-17 04:32:36 1:11:39 0:45:10 0:26:29 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6883395 2022-06-17 03:20:16 2022-06-17 03:20:58 2022-06-17 04:23:21 1:02:23 0:35:34 0:26:49 smithi main krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_default_map_options} 3
pass 6883396 2022-06-17 03:20:17 2022-06-17 03:20:58 2022-06-17 04:23:56 1:02:58 0:40:07 0:22:51 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_fio} 3
fail 6883397 2022-06-17 03:20:18 2022-06-17 03:20:58 2022-06-17 03:55:51 0:34:53 0:23:26 0:11:27 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_data_pool} 3
Failure Reason:

"2022-06-17T03:54:02.403774+0000 mon.a (mon.0) 250 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 6883398 2022-06-17 03:20:19 2022-06-17 03:20:59 2022-06-17 08:21:19 5:00:20 4:50:09 0:10:11 smithi main krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc-rxbounce} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi105 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeq2q9x6p_ -r -- '-g auto -g blockdev -x clone'"

pass 6883399 2022-06-17 03:20:21 2022-06-17 03:20:59 2022-06-17 04:25:47 1:04:48 0:46:07 0:18:41 smithi main krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/backoff thrashosds-health workloads/rbd_fio} 3
fail 6883400 2022-06-17 03:20:22 2022-06-17 03:21:00 2022-06-17 03:30:21 0:09:21 smithi main krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major

pass 6883401 2022-06-17 03:20:23 2022-06-17 03:21:00 2022-06-17 03:56:09 0:35:09 0:13:39 0:21:30 smithi main krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} 1
fail 6883402 2022-06-17 03:20:24 2022-06-17 03:21:01 2022-06-17 04:32:52 1:11:51 0:44:10 0:27:41 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2022-06-17T04:30:05.311706+0000 mon.a (mon.0) 306 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883403 2022-06-17 03:20:25 2022-06-17 03:21:01 2022-06-17 04:32:05 1:11:04 0:46:44 0:24:20 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6883404 2022-06-17 03:20:27 2022-06-17 03:21:01 2022-06-17 04:25:42 1:04:41 0:36:37 0:28:04 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} 3
pass 6883405 2022-06-17 03:20:28 2022-06-17 03:21:02 2022-06-17 04:23:21 1:02:19 0:36:04 0:26:15 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6883406 2022-06-17 03:20:29 2022-06-17 03:21:02 2022-06-17 04:50:03 1:29:01 1:02:00 0:27:01 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6883407 2022-06-17 03:20:31 2022-06-17 03:21:03 2022-06-17 04:28:36 1:07:33 0:39:54 0:27:39 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6883408 2022-06-17 03:20:32 2022-06-17 03:21:03 2022-06-17 04:03:05 0:42:02 0:17:41 0:24:21 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_discard} 1
pass 6883409 2022-06-17 03:20:33 2022-06-17 03:21:04 2022-06-17 04:31:05 1:10:01 0:43:09 0:26:52 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
fail 6883410 2022-06-17 03:20:34 2022-06-17 03:21:04 2022-06-17 04:32:36 1:11:32 0:44:13 0:27:19 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} 3
Failure Reason:

"2022-06-17T04:29:56.908273+0000 mon.a (mon.0) 297 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883411 2022-06-17 03:20:35 2022-06-17 03:21:04 2022-06-17 05:19:14 1:58:10 1:32:34 0:25:36 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6883412 2022-06-17 03:20:37 2022-06-17 03:21:05 2022-06-17 04:52:55 1:31:50 1:04:51 0:26:59 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6883413 2022-06-17 03:20:38 2022-06-17 03:21:05 2022-06-17 04:27:21 1:06:16 0:41:20 0:24:56 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6883414 2022-06-17 03:20:39 2022-06-17 03:21:06 2022-06-17 04:24:45 1:03:39 0:37:35 0:26:04 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6883415 2022-06-17 03:20:40 2022-06-17 03:21:06 2022-06-17 04:24:35 1:03:29 0:36:56 0:26:33 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} 3
pass 6883416 2022-06-17 03:20:41 2022-06-17 03:21:06 2022-06-17 03:46:18 0:25:12 0:13:46 0:11:26 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} 1
pass 6883417 2022-06-17 03:20:43 2022-06-17 03:21:07 2022-06-17 04:15:53 0:54:46 0:33:22 0:21:24 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6883418 2022-06-17 03:20:44 2022-06-17 03:21:07 2022-06-17 04:03:56 0:42:49 0:21:45 0:21:04 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_symlinks} 3
fail 6883419 2022-06-17 03:20:45 2022-06-17 03:21:08 2022-06-17 04:30:03 1:08:55 0:45:03 0:23:52 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

"2022-06-17T04:18:21.184219+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6883420 2022-06-17 03:20:46 2022-06-17 03:21:08 2022-06-17 04:28:47 1:07:39 0:41:01 0:26:38 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_concurrent} 3
pass 6883421 2022-06-17 03:20:47 2022-06-17 03:21:08 2022-06-17 04:14:13 0:53:05 0:30:41 0:22:24 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6883422 2022-06-17 03:20:49 2022-06-17 03:21:09 2022-06-17 04:34:53 1:13:44 0:47:53 0:25:51 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6883423 2022-06-17 03:20:50 2022-06-17 03:21:09 2022-06-17 04:22:00 1:00:51 0:36:22 0:24:29 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_image_read} 3
pass 6883424 2022-06-17 03:20:51 2022-06-17 03:21:10 2022-06-17 03:46:16 0:25:06 0:13:39 0:11:27 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_modprobe} 1
pass 6883425 2022-06-17 03:20:52 2022-06-17 03:21:10 2022-06-17 04:08:07 0:46:57 0:25:21 0:21:36 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6883426 2022-06-17 03:20:53 2022-06-17 03:21:10 2022-06-17 05:09:19 1:48:09 1:22:15 0:25:54 smithi main krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6883427 2022-06-17 03:20:54 2022-06-17 03:21:11 2022-06-17 04:24:26 1:03:15 0:36:15 0:27:00 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_kernel} 3
pass 6883428 2022-06-17 03:20:56 2022-06-17 03:21:11 2022-06-17 04:29:26 1:08:15 0:43:23 0:24:52 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6883429 2022-06-17 03:20:57 2022-06-17 03:21:12 2022-06-17 04:22:50 1:01:38 0:36:58 0:24:40 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6883430 2022-06-17 03:20:58 2022-06-17 03:21:12 2022-06-17 04:29:47 1:08:35 0:41:15 0:27:20 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_map_unmap} 3
pass 6883431 2022-06-17 03:20:59 2022-06-17 04:23:35 2291 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6883432 2022-06-17 03:21:01 2022-06-17 03:21:13 2022-06-17 04:03:02 0:41:49 0:29:51 0:11:58 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_simple_big} 3
pass 6883433 2022-06-17 03:21:02 2022-06-17 03:46:18 813 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_msgr_segments} 1
pass 6883434 2022-06-17 03:21:03 2022-06-17 04:35:59 3120 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
fail 6883435 2022-06-17 03:21:05 2022-06-17 03:21:15 2022-06-17 04:08:03 0:46:48 0:27:17 0:19:31 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

"2022-06-17T04:06:43.908755+0000 mon.a (mon.0) 210 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883436 2022-06-17 03:21:06 2022-06-17 04:26:54 2544 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} 3
pass 6883437 2022-06-17 03:21:07 2022-06-17 03:21:16 2022-06-17 04:25:50 1:04:34 0:37:32 0:27:02 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6883438 2022-06-17 03:21:09 2022-06-17 04:31:04 2675 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
fail 6883439 2022-06-17 03:21:10 2022-06-17 03:21:16 2022-06-17 04:32:49 1:11:33 0:44:02 0:27:31 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

"2022-06-17T04:19:34.711736+0000 mon.a (mon.0) 111 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6883440 2022-06-17 03:21:11 2022-06-17 03:21:17 2022-06-17 04:24:52 1:03:35 0:36:33 0:27:02 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} 3
fail 6883441 2022-06-17 03:21:13 2022-06-17 03:21:17 2022-06-17 04:31:52 1:10:35 0:44:28 0:26:07 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

"2022-06-17T04:30:04.243679+0000 mon.a (mon.0) 230 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6883442 2022-06-17 03:21:14 2022-06-17 03:21:18 2022-06-17 04:31:15 1:09:57 0:44:05 0:25:52 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
Failure Reason:

"2022-06-17T04:29:53.640852+0000 mon.a (mon.0) 254 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883443 2022-06-17 03:21:15 2022-06-17 04:12:51 1556 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} 1
pass 6883444 2022-06-17 03:21:17 2022-06-17 03:24:19 2022-06-17 04:29:51 1:05:32 0:42:41 0:22:51 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6883445 2022-06-17 03:21:18 2022-06-17 03:28:20 2022-06-17 04:24:05 0:55:45 0:35:56 0:19:49 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_namespaces} 3
pass 6883446 2022-06-17 03:21:19 2022-06-17 03:28:20 2022-06-17 05:11:31 1:43:11 1:22:51 0:20:20 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6883447 2022-06-17 03:21:20 2022-06-17 04:49:16 2022-06-17 05:50:57 1:01:41 0:48:19 0:13:22 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6883448 2022-06-17 03:21:22 2022-06-17 04:50:07 2022-06-17 05:20:50 0:30:43 0:18:43 0:12:00 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6883449 2022-06-17 03:21:23 2022-06-17 04:50:47 2022-06-17 05:18:57 0:28:10 0:16:30 0:11:40 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6883450 2022-06-17 03:21:24 2022-06-17 04:51:18 2022-06-17 05:19:19 0:28:01 0:15:14 0:12:47 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_netns} 3
pass 6883451 2022-06-17 03:21:25 2022-06-17 04:52:08 2022-06-17 05:14:15 0:22:07 0:12:20 0:09:47 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_read_only} 1
pass 6883452 2022-06-17 03:21:26 2022-06-17 04:52:59 2022-06-17 05:26:37 0:33:38 0:22:46 0:10:52 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6883453 2022-06-17 03:21:28 2022-06-17 04:53:09 2022-06-17 05:48:08 0:54:59 0:43:20 0:11:39 smithi main krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
pass 6883454 2022-06-17 03:21:29 2022-06-17 04:54:40 2022-06-17 05:21:46 0:27:06 0:15:36 0:11:30 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6883455 2022-06-17 03:21:30 2022-06-17 04:56:21 2022-06-17 05:22:40 0:26:19 0:15:21 0:10:58 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6883456 2022-06-17 03:21:31 2022-06-17 04:56:41 2022-06-17 05:28:48 0:32:07 0:20:29 0:11:38 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_concurrent} 3
pass 6883457 2022-06-17 03:21:32 2022-06-17 04:57:22 2022-06-17 05:23:44 0:26:22 0:15:28 0:10:54 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_huge_tickets} 3
fail 6883458 2022-06-17 03:21:34 2022-06-17 04:58:03 2022-06-17 05:33:15 0:35:12 0:23:04 0:12:08 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2022-06-17T05:21:31.181212+0000 mon.a (mon.0) 112 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log

pass 6883459 2022-06-17 03:21:35 2022-06-17 04:59:23 2022-06-17 05:24:51 0:25:28 0:15:28 0:10:00 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} 3
pass 6883460 2022-06-17 03:21:36 2022-06-17 04:59:24 2022-06-17 05:23:18 0:23:54 0:13:36 0:10:18 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_whole_object_zeroout} 1
pass 6883461 2022-06-17 03:21:37 2022-06-17 05:00:04 2022-06-17 05:33:17 0:33:13 0:23:10 0:10:03 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6883462 2022-06-17 03:21:38 2022-06-17 05:00:05 2022-06-17 05:24:10 0:24:05 0:14:12 0:09:53 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_kernel} 3
pass 6883463 2022-06-17 03:21:40 2022-06-17 05:00:45 2022-06-17 05:30:55 0:30:10 0:20:01 0:10:09 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6883464 2022-06-17 03:21:41 2022-06-17 05:01:16 2022-06-17 05:25:47 0:24:31 0:13:49 0:10:42 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6883465 2022-06-17 03:21:42 2022-06-17 05:02:16 2022-06-17 05:33:08 0:30:52 0:18:55 0:11:57 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} 3
fail 6883466 2022-06-17 03:21:43 2022-06-17 05:03:17 2022-06-17 05:39:08 0:35:51 0:22:35 0:13:16 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

"2022-06-17T05:37:21.126991+0000 mon.a (mon.0) 303 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883467 2022-06-17 03:21:44 2022-06-17 05:05:38 2022-06-17 05:49:26 0:43:48 0:33:03 0:10:45 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_simple_big} 3
pass 6883468 2022-06-17 03:21:45 2022-06-17 05:05:58 2022-06-17 05:29:50 0:23:52 0:12:37 0:11:15 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} 1
pass 6883469 2022-06-17 03:21:47 2022-06-17 05:06:29 2022-06-17 05:44:47 0:38:18 0:25:06 0:13:12 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6883470 2022-06-17 03:21:48 2022-06-17 05:07:09 2022-06-17 05:53:26 0:46:17 0:31:35 0:14:42 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_fio} 3
pass 6883471 2022-06-17 03:21:49 2022-06-17 05:07:40 2022-06-17 05:43:55 0:36:15 0:22:42 0:13:33 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_data_pool} 3
pass 6883472 2022-06-17 03:21:50 2022-06-17 05:08:31 2022-06-17 05:36:28 0:27:57 0:13:05 0:14:52 smithi main krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
pass 6883473 2022-06-17 03:21:51 2022-06-17 05:08:31 2022-06-17 05:48:53 0:40:22 0:25:35 0:14:47 smithi main krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
pass 6883474 2022-06-17 03:21:53 2022-06-17 05:09:12 2022-06-17 05:40:56 0:31:44 0:16:27 0:15:17 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6883475 2022-06-17 03:21:54 2022-06-17 05:09:12 2022-06-17 05:45:10 0:35:58 0:23:44 0:12:14 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6883476 2022-06-17 03:21:55 2022-06-17 05:09:23 2022-06-17 05:40:25 0:31:02 0:15:42 0:15:20 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_fallocate} 3
pass 6883477 2022-06-17 03:21:56 2022-06-17 05:10:53 2022-06-17 05:41:02 0:30:09 0:16:40 0:13:29 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6883478 2022-06-17 03:21:57 2022-06-17 05:11:04 2022-06-17 06:07:11 0:56:07 0:41:55 0:14:12 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6883479 2022-06-17 03:21:59 2022-06-17 05:11:35 2022-06-17 05:43:44 0:32:09 0:18:43 0:13:26 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6883480 2022-06-17 03:22:00 2022-06-17 05:11:55 2022-06-17 05:39:16 0:27:21 0:14:19 0:13:02 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_discard} 1
pass 6883481 2022-06-17 03:22:01 2022-06-17 05:11:56 2022-06-17 05:46:52 0:34:56 0:21:53 0:13:03 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6883482 2022-06-17 03:22:02 2022-06-17 05:12:56 2022-06-17 06:37:52 1:24:56 1:11:58 0:12:58 smithi main krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6883483 2022-06-17 03:22:03 2022-06-17 05:14:17 2022-06-17 05:46:07 0:31:50 0:20:00 0:11:50 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_namespaces} 3
pass 6883484 2022-06-17 03:22:05 2022-06-17 05:14:18 2022-06-17 06:40:22 1:26:04 1:12:34 0:13:30 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6883485 2022-06-17 03:22:06 2022-06-17 05:16:08 2022-06-17 06:14:07 0:57:59 0:43:42 0:14:17 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6883486 2022-06-17 03:22:07 2022-06-17 09:13:39 2022-06-17 09:44:52 0:31:13 0:18:45 0:12:28 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6883487 2022-06-17 03:22:08 2022-06-17 09:14:10 2022-06-17 09:40:15 0:26:05 0:15:53 0:10:12 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6883488 2022-06-17 03:22:09 2022-06-17 09:14:20 2022-06-17 09:40:25 0:26:05 0:14:41 0:11:24 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_netns} 3
pass 6883489 2022-06-17 03:22:11 2022-06-17 09:15:01 2022-06-17 09:38:01 0:23:00 0:12:34 0:10:26 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_huge_image} 1
pass 6883490 2022-06-17 03:22:12 2022-06-17 09:15:01 2022-06-17 09:52:08 0:37:07 0:25:05 0:12:02 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6883491 2022-06-17 03:22:13 2022-06-17 09:16:42 2022-06-17 09:43:12 0:26:30 0:15:41 0:10:49 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6883492 2022-06-17 03:22:14 2022-06-17 09:17:33 2022-06-17 09:46:44 0:29:11 0:16:03 0:13:08 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6883493 2022-06-17 03:22:16 2022-06-17 09:17:53 2022-06-17 09:50:48 0:32:55 0:19:21 0:13:34 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
pass 6883494 2022-06-17 03:22:17 2022-06-17 09:19:24 2022-06-17 09:47:08 0:27:44 0:16:05 0:11:39 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6883495 2022-06-17 03:22:18 2022-06-17 09:19:35 2022-06-17 09:54:00 0:34:25 0:23:32 0:10:53 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6883496 2022-06-17 03:22:19 2022-06-17 09:20:25 2022-06-17 09:46:47 0:26:22 0:15:19 0:11:03 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_image_read} 3
pass 6883497 2022-06-17 03:22:20 2022-06-17 09:21:16 2022-06-17 09:44:57 0:23:41 0:13:26 0:10:15 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} 1
fail 6883498 2022-06-17 03:22:22 2022-06-17 09:21:36 2022-06-17 09:55:52 0:34:16 0:22:56 0:11:20 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2022-06-17T09:54:26.887089+0000 mon.a (mon.0) 260 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883499 2022-06-17 03:22:23 2022-06-17 09:22:07 2022-06-17 09:48:42 0:26:35 0:14:55 0:11:40 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} 3
fail 6883500 2022-06-17 03:22:24 2022-06-17 09:23:17 2022-06-17 09:56:51 0:33:34 0:23:09 0:10:25 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2022-06-17T09:55:37.464422+0000 mon.a (mon.0) 268 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883501 2022-06-17 03:22:25 2022-06-17 09:23:28 2022-06-17 09:51:56 0:28:28 0:16:12 0:12:16 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6883502 2022-06-17 03:22:26 2022-06-17 09:24:09 2022-06-17 09:57:48 0:33:39 0:21:16 0:12:23 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_map_unmap} 3
pass 6883503 2022-06-17 03:22:28 2022-06-17 09:24:09 2022-06-17 09:55:13 0:31:04 0:16:47 0:14:17 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6883504 2022-06-17 03:22:29 2022-06-17 09:25:00 2022-06-17 10:08:28 0:43:28 0:32:07 0:11:21 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} 3
pass 6883505 2022-06-17 03:22:30 2022-06-17 09:25:11 2022-06-17 09:51:07 0:25:56 0:14:25 0:11:31 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_msgr_segments} 1
pass 6883506 2022-06-17 03:22:31 2022-06-17 09:25:21 2022-06-17 10:03:19 0:37:58 0:26:25 0:11:33 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6883507 2022-06-17 03:22:33 2022-06-17 09:25:42 2022-06-17 09:54:16 0:28:34 0:15:53 0:12:41 smithi main krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_rxbounce} 3
fail 6883508 2022-06-17 03:22:34 2022-06-17 09:26:42 2022-06-17 10:04:24 0:37:42 0:23:55 0:13:47 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

"2022-06-17T09:51:23.931137+0000 mon.a (mon.0) 194 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6883509 2022-06-17 03:22:35 2022-06-17 09:28:03 2022-06-17 10:08:01 0:39:58 0:27:57 0:12:01 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_data_pool} 3
fail 6883510 2022-06-17 03:22:36 2022-06-17 09:28:04 2022-06-17 14:32:30 5:04:26 4:52:13 0:12:13 smithi main krbd/singleton/{bluestore-bitmap conf ms_mode$/{secure} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi138 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeox2e0uj0 -r -- '-g auto -g blockdev -x clone'"

pass 6883511 2022-06-17 03:22:37 2022-06-17 09:28:34 2022-06-17 10:54:15 1:25:41 1:12:26 0:13:15 smithi main krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6883512 2022-06-17 03:22:39 2022-06-17 09:29:35 2022-06-17 09:57:09 0:27:34 0:16:32 0:11:02 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6883513 2022-06-17 03:22:40 2022-06-17 09:29:55 2022-06-17 10:04:20 0:34:25 0:23:42 0:10:43 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6883514 2022-06-17 03:22:41 2022-06-17 09:30:36 2022-06-17 09:59:50 0:29:14 0:16:46 0:12:28 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} 3
pass 6883515 2022-06-17 03:22:42 2022-06-17 09:30:57 2022-06-17 09:58:42 0:27:45 0:16:01 0:11:44 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6883516 2022-06-17 03:22:43 2022-06-17 09:33:18 2022-06-17 10:28:06 0:54:48 0:41:24 0:13:24 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6883517 2022-06-17 03:22:45 2022-06-17 09:34:18 2022-06-17 10:06:25 0:32:07 0:18:14 0:13:53 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6883518 2022-06-17 03:22:46 2022-06-17 09:34:39 2022-06-17 09:58:09 0:23:30 0:11:57 0:11:33 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_parent_overlap} 1
pass 6883519 2022-06-17 03:22:47 2022-06-17 09:34:39 2022-06-17 10:08:16 0:33:37 0:20:25 0:13:12 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6883520 2022-06-17 03:22:48 2022-06-17 09:36:50 2022-06-17 10:05:09 0:28:19 0:14:52 0:13:27 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} 3
pass 6883521 2022-06-17 03:22:49 2022-06-17 09:37:41 2022-06-17 10:53:31 1:15:50 1:03:44 0:12:06 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
fail 6883522 2022-06-17 03:22:51 2022-06-17 09:37:41 2022-06-17 10:14:10 0:36:29 0:23:06 0:13:23 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_udev_enumerate} 3
Failure Reason:

"2022-06-17T10:12:18.540764+0000 mon.a (mon.0) 239 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883523 2022-06-17 03:22:52 2022-06-17 09:38:32 2022-06-17 10:12:48 0:34:16 0:20:49 0:13:27 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6883524 2022-06-17 03:22:53 2022-06-17 09:38:52 2022-06-17 10:11:39 0:32:47 0:17:18 0:15:29 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6883525 2022-06-17 03:22:54 2022-06-17 09:39:53 2022-06-17 10:11:55 0:32:02 0:17:27 0:14:35 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} 3
pass 6883526 2022-06-17 03:22:56 2022-06-17 09:40:24 2022-06-17 10:09:47 0:29:23 0:14:54 0:14:29 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} 1
fail 6883527 2022-06-17 03:22:57 2022-06-17 09:40:24 2022-06-17 10:20:30 0:40:06 0:24:57 0:15:09 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

"2022-06-17T10:18:15.264260+0000 mon.a (mon.0) 255 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883528 2022-06-17 03:22:58 2022-06-17 09:40:25 2022-06-17 10:12:02 0:31:37 0:17:17 0:14:20 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6883529 2022-06-17 03:22:59 2022-06-17 09:40:35 2022-06-17 10:12:29 0:31:54 0:17:10 0:14:44 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6883530 2022-06-17 03:23:00 2022-06-17 09:40:56 2022-06-17 10:17:20 0:36:24 0:22:14 0:14:10 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_concurrent} 3
pass 6883531 2022-06-17 03:23:02 2022-06-17 09:41:37 2022-06-17 10:13:02 0:31:25 0:16:29 0:14:56 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6883532 2022-06-17 03:23:03 2022-06-17 09:43:17 2022-06-17 10:21:47 0:38:30 0:26:25 0:12:05 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
fail 6883533 2022-06-17 03:23:04 2022-06-17 09:44:18 2022-06-17 10:22:29 0:38:11 0:24:35 0:13:36 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

"2022-06-17T10:19:57.585187+0000 mon.a (mon.0) 231 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6883534 2022-06-17 03:23:05 2022-06-17 09:44:49 2022-06-17 10:12:03 0:27:14 0:15:29 0:11:45 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_whole_object_zeroout} 1
pass 6883535 2022-06-17 03:23:07 2022-06-17 09:44:49 2022-06-17 10:17:45 0:32:56 0:19:52 0:13:04 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6883536 2022-06-17 03:23:08 2022-06-17 09:45:00 2022-06-17 10:40:58 0:55:58 0:43:15 0:12:43 smithi main krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
pass 6883537 2022-06-17 03:23:09 2022-06-17 09:45:30 2022-06-17 10:14:19 0:28:49 0:15:35 0:13:14 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_kernel} 3
pass 6883538 2022-06-17 03:23:10 2022-06-17 09:46:51 2022-06-17 10:21:39 0:34:48 0:21:14 0:13:34 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
fail 6883539 2022-06-17 03:23:11 2022-06-17 09:46:51 2022-06-17 10:22:41 0:35:50 0:24:07 0:11:43 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2022-06-17T10:20:54.018977+0000 mon.a (mon.0) 255 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6883540 2022-06-17 03:23:13 2022-06-17 09:47:12 2022-06-17 10:21:45 0:34:33 0:20:47 0:13:46 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_map_unmap} 3
fail 6883541 2022-06-17 03:23:14 2022-06-17 09:47:42 2022-06-17 10:26:06 0:38:24 0:24:19 0:14:05 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

"2022-06-17T10:22:55.771493+0000 mon.a (mon.0) 253 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6883542 2022-06-17 03:23:15 2022-06-17 09:48:43 2022-06-17 10:24:25 0:35:42 0:23:33 0:12:09 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_simple_big} 3
Failure Reason:

"2022-06-17T10:23:05.921973+0000 mon.a (mon.0) 252 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883543 2022-06-17 03:23:16 2022-06-17 09:50:54 2022-06-17 10:15:49 0:24:55 0:14:10 0:10:45 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_deep_flatten} 1
pass 6883544 2022-06-17 03:23:17 2022-06-17 09:50:54 2022-06-17 10:31:53 0:40:59 0:29:23 0:11:36 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6883545 2022-06-17 03:23:19 2022-06-17 09:52:05 2022-06-17 10:33:42 0:41:37 0:31:36 0:10:01 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} 3
fail 6883546 2022-06-17 03:23:20 2022-06-17 09:52:15 2022-06-17 10:29:40 0:37:25 0:22:21 0:15:04 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} 3
Failure Reason:

"2022-06-17T10:26:28.358315+0000 mon.a (mon.0) 274 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883547 2022-06-17 03:23:21 2022-06-17 09:54:06 2022-06-17 10:22:06 0:28:00 0:12:59 0:15:01 smithi main krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
pass 6883548 2022-06-17 03:23:22 2022-06-17 09:54:27 2022-06-17 10:34:08 0:39:41 0:24:38 0:15:03 smithi main krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
fail 6883549 2022-06-17 03:23:23 2022-06-17 09:54:27 2022-06-17 10:35:38 0:41:11 0:23:32 0:17:39 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2022-06-17T10:23:56.154900+0000 mon.a (mon.0) 144 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6883550 2022-06-17 03:23:24 2022-06-17 09:55:18 2022-06-17 10:38:14 0:42:56 0:24:05 0:18:51 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2022-06-17T10:35:13.326062+0000 mon.a (mon.0) 353 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6883551 2022-06-17 03:23:26 2022-06-17 09:55:58 2022-06-17 10:30:07 0:34:09 0:16:28 0:17:41 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_fallocate} 3
pass 6883552 2022-06-17 03:23:27 2022-06-17 09:56:29 2022-06-17 10:30:37 0:34:08 0:17:53 0:16:15 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} 3
dead 6883553 2022-06-17 03:23:28 2022-06-17 09:56:30 2022-06-17 10:12:01 0:15:31 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6883554 2022-06-17 03:23:29 2022-06-17 09:57:01 2022-06-17 10:32:57 0:35:56 0:20:31 0:15:25 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6883555 2022-06-17 03:23:30 2022-06-17 09:57:11 2022-06-17 10:26:35 0:29:24 0:13:56 0:15:28 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} 1
pass 6883556 2022-06-17 03:23:31 2022-06-17 09:57:11 2022-06-17 10:35:36 0:38:25 0:22:15 0:16:10 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6883557 2022-06-17 03:23:33 2022-06-17 09:57:52 2022-06-17 10:31:46 0:33:54 0:18:24 0:15:30 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_namespaces} 3
fail 6883558 2022-06-17 03:23:34 2022-06-17 09:58:13 2022-06-17 10:40:10 0:41:57 0:25:23 0:16:34 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

"2022-06-17T10:37:05.240883+0000 mon.a (mon.0) 234 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883559 2022-06-17 03:23:35 2022-06-17 09:58:44 2022-06-17 10:58:50 1:00:06 0:44:24 0:15:42 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6883560 2022-06-17 03:23:36 2022-06-17 09:59:55 2022-06-17 10:39:07 0:39:12 0:25:12 0:14:00 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2022-06-17T10:37:19.487696+0000 mon.a (mon.0) 221 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883561 2022-06-17 03:23:37 2022-06-17 10:03:26 2022-06-17 10:32:33 0:29:07 0:17:23 0:11:44 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6883562 2022-06-17 03:23:39 2022-06-17 10:04:27 2022-06-17 10:31:58 0:27:31 0:16:24 0:11:07 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_netns} 3
pass 6883563 2022-06-17 03:23:40 2022-06-17 10:04:28 2022-06-17 10:28:48 0:24:20 0:13:40 0:10:40 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_huge_image} 1
pass 6883564 2022-06-17 03:23:41 2022-06-17 10:05:18 2022-06-17 10:42:16 0:36:58 0:24:19 0:12:39 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6883565 2022-06-17 03:23:42 2022-06-17 10:06:29 2022-06-17 11:28:56 1:22:27 1:12:41 0:09:46 smithi main krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6883566 2022-06-17 03:23:44 2022-06-17 10:07:50 2022-06-17 10:36:13 0:28:23 0:16:30 0:11:53 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} 3
fail 6883567 2022-06-17 03:23:45 2022-06-17 10:08:10 2022-06-17 10:43:43 0:35:33 0:23:47 0:11:46 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

"2022-06-17T10:30:26.250520+0000 mon.a (mon.0) 118 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6883568 2022-06-17 03:23:46 2022-06-17 10:08:21 2022-06-17 10:40:05 0:31:44 0:20:41 0:11:03 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_concurrent} 3
fail 6883569 2022-06-17 03:23:47 2022-06-17 10:08:31 2022-06-17 10:43:20 0:34:49 0:23:36 0:11:13 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_huge_tickets} 3
Failure Reason:

"2022-06-17T10:41:40.387271+0000 mon.a (mon.0) 307 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883570 2022-06-17 03:23:48 2022-06-17 10:09:52 2022-06-17 10:47:29 0:37:37 0:24:15 0:13:22 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6883571 2022-06-17 03:23:49 2022-06-17 10:11:43 2022-06-17 10:39:29 0:27:46 0:16:07 0:11:39 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
pass 6883572 2022-06-17 03:23:51 2022-06-17 10:12:03 2022-06-17 10:35:28 0:23:25 0:12:20 0:11:05 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_modprobe} 1
pass 6883573 2022-06-17 03:23:52 2022-06-17 10:12:03 2022-06-17 10:47:33 0:35:30 0:24:40 0:10:50 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
fail 6883574 2022-06-17 03:23:53 2022-06-17 10:12:04 2022-06-17 10:47:30 0:35:26 0:24:05 0:11:21 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

"2022-06-17T10:45:52.891961+0000 mon.a (mon.0) 302 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883575 2022-06-17 03:23:54 2022-06-17 10:12:14 2022-06-17 10:46:06 0:33:52 0:21:40 0:12:12 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6883576 2022-06-17 03:23:55 2022-06-17 10:12:35 2022-06-17 10:40:58 0:28:23 0:14:23 0:14:00 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_map_snapshot_io} 3
fail 6883577 2022-06-17 03:23:57 2022-06-17 10:12:55 2022-06-17 10:48:47 0:35:52 0:23:27 0:12:25 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} 3
Failure Reason:

"2022-06-17T10:35:37.093633+0000 mon.a (mon.0) 115 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6883578 2022-06-17 03:23:58 2022-06-17 10:13:06 2022-06-17 10:41:42 0:28:36 0:15:57 0:12:39 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6883579 2022-06-17 03:23:59 2022-06-17 10:14:17 2022-06-17 10:56:03 0:41:46 0:30:05 0:11:41 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_simple_big} 3
pass 6883580 2022-06-17 03:24:00 2022-06-17 10:14:27 2022-06-17 10:40:23 0:25:56 0:12:57 0:12:59 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} 1
pass 6883581 2022-06-17 03:24:01 2022-06-17 10:14:28 2022-06-17 10:57:16 0:42:48 0:28:26 0:14:22 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
fail 6883582 2022-06-17 03:24:03 2022-06-17 10:17:29 2022-06-17 10:52:38 0:35:09 0:22:44 0:12:25 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

"2022-06-17T10:50:38.453877+0000 mon.a (mon.0) 300 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883583 2022-06-17 03:24:04 2022-06-17 10:17:49 2022-06-17 11:00:38 0:42:49 0:27:17 0:15:32 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_data_pool} 3
pass 6883584 2022-06-17 03:24:05 2022-06-17 10:20:41 2022-06-17 10:52:30 0:31:49 0:16:33 0:15:16 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} 3
fail 6883585 2022-06-17 03:24:06 2022-06-17 10:21:41 2022-06-17 10:57:16 0:35:35 0:23:18 0:12:17 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2022-06-17T10:55:34.847168+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6883586 2022-06-17 03:24:07 2022-06-17 10:21:52 2022-06-17 10:54:04 0:32:12 0:17:20 0:14:52 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_fallocate} 3
fail 6883587 2022-06-17 03:24:09 2022-06-17 10:21:52 2022-06-17 10:59:55 0:38:03 0:23:42 0:14:21 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_huge_osdmap} 3
Failure Reason:

"2022-06-17T10:47:02.151536+0000 mon.a (mon.0) 118 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6883588 2022-06-17 03:24:10 2022-06-17 10:22:13 2022-06-17 11:18:03 0:55:50 0:42:25 0:13:25 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6883589 2022-06-17 03:24:11 2022-06-17 10:22:33 2022-06-17 10:56:00 0:33:27 0:19:44 0:13:43 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6883590 2022-06-17 03:24:12 2022-06-17 10:22:43 2022-06-17 10:48:11 0:25:28 0:13:13 0:12:15 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_parent_overlap} 1
pass 6883591 2022-06-17 03:24:13 2022-06-17 10:22:44 2022-06-17 10:57:54 0:35:10 0:20:57 0:14:13 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6883592 2022-06-17 03:24:14 2022-06-17 11:06:09 2022-06-17 12:00:44 0:54:35 0:42:55 0:11:40 smithi main krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 6883593 2022-06-17 03:24:16 2022-06-17 11:07:49 2022-06-17 11:36:16 0:28:27 0:14:33 0:13:54 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_namespaces} 3
pass 6883594 2022-06-17 03:24:17 2022-06-17 11:11:00 2022-06-17 12:26:50 1:15:50 1:04:15 0:11:35 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6883595 2022-06-17 03:24:18 2022-06-17 11:11:11 2022-06-17 12:12:58 1:01:47 0:49:21 0:12:26 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6883596 2022-06-17 03:24:19 2022-06-17 11:11:31 2022-06-17 11:41:42 0:30:11 0:18:06 0:12:05 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6883597 2022-06-17 03:24:21 2022-06-17 11:12:02 2022-06-17 11:40:53 0:28:51 0:16:49 0:12:02 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6883598 2022-06-17 03:24:22 2022-06-17 11:13:32 2022-06-17 11:41:14 0:27:42 0:15:08 0:12:34 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_netns} 3
pass 6883599 2022-06-17 03:24:23 2022-06-17 11:15:33 2022-06-17 11:40:06 0:24:33 0:12:56 0:11:37 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_read_only} 1
pass 6883600 2022-06-17 03:24:24 2022-06-17 11:16:44 2022-06-17 11:50:58 0:34:14 0:23:51 0:10:23 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6883601 2022-06-17 03:24:25 2022-06-17 11:17:24 2022-06-17 11:42:59 0:25:35 0:15:53 0:09:42 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6883602 2022-06-17 03:24:26 2022-06-17 11:17:34 2022-06-17 11:43:43 0:26:09 0:14:34 0:11:35 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6883603 2022-06-17 03:24:27 2022-06-17 11:18:05 2022-06-17 11:51:56 0:33:51 0:20:50 0:13:01 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} 3
pass 6883604 2022-06-17 03:24:29 2022-06-17 11:20:26 2022-06-17 11:46:49 0:26:23 0:14:58 0:11:25 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6883605 2022-06-17 03:24:30 2022-06-17 11:21:26 2022-06-17 11:57:37 0:36:11 0:25:18 0:10:53 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6883606 2022-06-17 03:24:31 2022-06-17 11:21:47 2022-06-17 11:49:56 0:28:09 0:15:21 0:12:48 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_image_read} 3
pass 6883607 2022-06-17 03:24:32 2022-06-17 11:21:57 2022-06-17 11:44:50 0:22:53 0:13:12 0:09:41 smithi main krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} 1
pass 6883608 2022-06-17 03:24:33 2022-06-17 11:21:58 2022-06-17 11:56:30 0:34:32 0:21:23 0:13:09 smithi main krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6883609 2022-06-17 03:24:34 2022-06-17 11:22:28 2022-06-17 11:51:21 0:28:53 0:14:36 0:14:17 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} 3
pass 6883610 2022-06-17 03:24:35 2022-06-17 11:23:59 2022-06-17 11:58:15 0:34:16 0:22:16 0:12:00 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
fail 6883611 2022-06-17 03:24:37 2022-06-17 11:24:09 2022-06-17 12:00:26 0:36:17 0:24:09 0:12:08 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2022-06-17T11:48:16.775363+0000 mon.a (mon.0) 172 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6883612 2022-06-17 03:24:38 2022-06-17 11:25:00 2022-06-17 11:58:47 0:33:47 0:21:00 0:12:47 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_map_unmap} 3
fail 6883613 2022-06-17 03:24:39 2022-06-17 11:25:00 2022-06-17 12:01:07 0:36:07 0:24:34 0:11:33 smithi main krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

"2022-06-17T11:59:07.337984+0000 mon.a (mon.0) 231 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6883614 2022-06-17 03:24:40 2022-06-17 11:25:41 2022-06-17 12:01:43 0:36:02 0:23:50 0:12:12 smithi main krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} 3
Failure Reason:

"2022-06-17T11:59:26.124692+0000 mon.a (mon.0) 269 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log