Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6705053 2022-02-25 03:20:51 2022-02-28 20:28:44 2022-02-28 20:48:03 0:19:19 0:10:23 0:08:56 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_deep_flatten} 1
pass 6705054 2022-02-25 03:20:52 2022-02-28 20:28:44 2022-02-28 21:01:30 0:32:46 0:20:46 0:12:00 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6705055 2022-02-25 03:20:53 2022-02-28 20:29:24 2022-02-28 20:52:58 0:23:34 0:10:24 0:13:10 smithi master krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_default_map_options} 3
pass 6705056 2022-02-25 03:20:54 2022-02-28 20:31:35 2022-02-28 21:16:11 0:44:36 0:28:01 0:16:35 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_fio} 3
pass 6705057 2022-02-25 03:20:54 2022-02-28 20:33:15 2022-02-28 21:05:53 0:32:38 0:18:54 0:13:44 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_data_pool} 3
fail 6705058 2022-02-25 03:20:55 2022-02-28 20:34:16 2022-03-01 01:04:56 4:30:40 4:16:15 0:14:25 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc-rxbounce} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi153 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludem84cdgm1 -r -- '-g auto -g blockdev -x clone'"

pass 6705059 2022-02-25 03:20:56 2022-02-28 20:34:46 2022-02-28 21:33:22 0:58:36 0:43:52 0:14:44 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/backoff thrashosds-health workloads/rbd_fio} 3
fail 6705060 2022-02-25 03:20:57 2022-02-28 20:37:07 2022-02-28 20:46:01 0:08:54 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major

pass 6705061 2022-02-25 03:20:58 2022-02-28 20:37:37 2022-02-28 20:59:15 0:21:38 0:09:16 0:12:22 smithi master krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} 1
pass 6705062 2022-02-25 03:20:58 2022-02-28 20:37:48 2022-02-28 21:01:27 0:23:39 0:12:30 0:11:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_exclusive_option} 3
fail 6705063 2022-02-25 03:20:59 2022-02-28 20:37:58 2022-02-28 21:10:59 0:33:01 0:19:37 0:13:24 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2022-02-28T21:07:43.758654+0000 mon.a (mon.0) 209 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705064 2022-02-25 03:21:00 2022-02-28 20:39:19 2022-02-28 21:01:09 0:21:50 0:11:51 0:09:59 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} 3
pass 6705065 2022-02-25 03:21:01 2022-02-28 20:39:29 2022-02-28 21:02:44 0:23:15 0:11:42 0:11:33 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6705066 2022-02-25 03:21:01 2022-02-28 20:41:09 2022-02-28 21:30:17 0:49:08 0:37:22 0:11:46 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6705067 2022-02-25 03:21:02 2022-02-28 20:42:40 2022-02-28 21:10:12 0:27:32 0:14:27 0:13:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6705068 2022-02-25 03:21:03 2022-02-28 20:49:33 2022-02-28 21:11:38 0:22:05 0:09:51 0:12:14 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_discard} 1
pass 6705069 2022-02-25 03:21:04 2022-02-28 20:49:33 2022-02-28 21:20:55 0:31:22 0:17:13 0:14:09 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6705070 2022-02-25 03:21:04 2022-02-28 20:49:34 2022-02-28 21:16:04 0:26:30 0:11:56 0:14:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} 3
fail 6705071 2022-02-25 03:21:05 2022-02-28 20:49:34 2022-02-28 21:24:01 0:34:27 0:20:14 0:14:13 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

"2022-02-28T21:21:40.099955+0000 mon.a (mon.0) 290 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705072 2022-02-25 03:21:06 2022-02-28 20:49:35 2022-02-28 21:39:14 0:49:39 0:37:37 0:12:02 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6705073 2022-02-25 03:21:07 2022-02-28 20:49:35 2022-02-28 21:19:12 0:29:37 0:15:45 0:13:52 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6705074 2022-02-25 03:21:07 2022-02-28 20:49:35 2022-02-28 21:15:12 0:25:37 0:11:53 0:13:44 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6705075 2022-02-25 03:21:08 2022-02-28 20:49:36 2022-02-28 21:13:06 0:23:30 0:11:46 0:11:44 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} 3
pass 6705076 2022-02-25 03:21:09 2022-02-28 20:49:36 2022-02-28 21:08:00 0:18:24 0:09:11 0:09:13 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} 1
fail 6705077 2022-02-25 03:21:10 2022-02-28 20:49:37 2022-02-28 21:24:25 0:34:48 0:20:39 0:14:09 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

"2022-02-28T21:22:19.850183+0000 mon.a (mon.0) 232 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 6705078 2022-02-25 03:21:11 2022-02-28 20:50:07 2022-02-28 21:24:35 0:34:28 0:20:43 0:13:45 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_udev_symlinks} 3
Failure Reason:

"2022-02-28T21:22:14.436069+0000 mon.a (mon.0) 259 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705079 2022-02-25 03:21:11 2022-02-28 20:51:08 2022-02-28 21:15:29 0:24:21 0:12:20 0:12:01 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6705080 2022-02-25 03:21:12 2022-02-28 20:51:38 2022-02-28 21:20:01 0:28:23 0:16:48 0:11:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_concurrent} 3
pass 6705081 2022-02-25 03:21:13 2022-02-28 20:52:28 2022-02-28 21:16:23 0:23:55 0:12:06 0:11:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6705082 2022-02-25 03:21:14 2022-02-28 20:52:59 2022-02-28 21:24:35 0:31:36 0:18:55 0:12:41 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6705083 2022-02-25 03:21:14 2022-02-28 20:56:04 2022-02-28 21:18:44 0:22:40 0:10:50 0:11:50 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_image_read} 3
pass 6705084 2022-02-25 03:21:15 2022-02-28 20:56:55 2022-02-28 21:18:46 0:21:51 0:08:50 0:13:01 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_modprobe} 1
pass 6705085 2022-02-25 03:21:16 2022-02-28 20:59:25 2022-02-28 21:28:58 0:29:33 0:15:21 0:14:12 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6705086 2022-02-25 03:21:17 2022-02-28 21:01:16 2022-02-28 22:29:59 1:28:43 1:15:44 0:12:59 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
fail 6705087 2022-02-25 03:21:17 2022-02-28 21:01:36 2022-02-28 21:33:04 0:31:28 0:19:05 0:12:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

"2022-02-28T21:30:38.994823+0000 mon.a (mon.0) 242 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705088 2022-02-25 03:21:18 2022-02-28 21:01:37 2022-02-28 21:34:24 0:32:47 0:18:43 0:14:04 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6705089 2022-02-25 03:21:19 2022-02-28 21:02:47 2022-02-28 21:27:36 0:24:49 0:10:42 0:14:07 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
fail 6705090 2022-02-25 03:21:20 2022-02-28 21:02:57 2022-02-28 21:37:44 0:34:47 0:19:33 0:15:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_map_unmap} 3
Failure Reason:

"2022-02-28T21:34:49.305023+0000 mon.a (mon.0) 275 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705091 2022-02-25 03:21:20 2022-03-02 14:58:45 2022-03-02 15:24:17 0:25:32 0:11:51 0:13:41 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6705092 2022-02-25 03:21:21 2022-03-02 15:00:15 2022-03-02 15:34:32 0:34:17 0:22:51 0:11:26 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_simple_big} 3
pass 6705093 2022-02-25 03:21:22 2022-03-02 15:00:36 2022-03-02 15:19:35 0:18:59 0:09:21 0:09:38 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_msgr_segments} 1
pass 6705094 2022-02-25 03:21:23 2022-03-02 15:00:36 2022-03-02 15:39:54 0:39:18 0:28:02 0:11:16 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6705095 2022-02-25 03:21:24 2022-03-02 15:01:47 2022-03-02 15:43:42 0:41:55 0:28:05 0:13:50 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
fail 6705096 2022-02-25 03:21:24 2022-03-02 15:02:37 2022-03-02 15:33:10 0:30:33 0:19:12 0:11:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} 3
Failure Reason:

"2022-03-02T15:30:51.979844+0000 mon.a (mon.0) 254 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705097 2022-02-25 03:21:25 2022-03-02 15:03:38 2022-03-02 15:27:12 0:23:34 0:11:39 0:11:55 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6705098 2022-02-25 03:21:26 2022-03-02 15:05:48 2022-03-02 15:37:29 0:31:41 0:20:07 0:11:34 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
fail 6705099 2022-02-25 03:21:27 2022-03-02 15:06:09 2022-03-02 15:36:43 0:30:34 0:19:30 0:11:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

"2022-03-02T15:35:35.296728+0000 mon.a (mon.0) 321 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705100 2022-02-25 03:21:27 2022-03-02 15:06:59 2022-03-02 15:29:40 0:22:41 0:11:54 0:10:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6705101 2022-02-25 03:21:28 2022-03-02 15:08:20 2022-03-02 15:58:02 0:49:42 0:38:37 0:11:05 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
fail 6705102 2022-02-25 03:21:29 2022-03-02 15:08:20 2022-03-02 15:38:54 0:30:34 0:19:12 0:11:22 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
Failure Reason:

"2022-03-02T15:36:52.282266+0000 mon.a (mon.0) 269 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705103 2022-02-25 03:21:30 2022-03-02 15:09:21 2022-03-02 15:28:40 0:19:19 0:08:52 0:10:27 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} 1
pass 6705104 2022-02-25 03:21:31 2022-03-02 15:09:21 2022-03-02 15:41:50 0:32:29 0:18:13 0:14:16 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6705105 2022-02-25 03:21:31 2022-03-02 15:12:12 2022-03-02 15:34:16 0:22:04 0:11:50 0:10:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_namespaces} 3
pass 6705106 2022-02-25 03:21:32 2022-03-02 15:12:52 2022-03-02 16:43:54 1:31:02 1:16:52 0:14:10 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6705107 2022-02-25 03:21:33 2022-03-02 15:13:03 2022-03-02 16:04:46 0:51:43 0:39:59 0:11:44 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} 3
fail 6705108 2022-02-25 03:21:34 2022-03-02 15:13:03 2022-03-02 15:47:44 0:34:41 0:20:07 0:14:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2022-03-02T15:44:45.002166+0000 mon.a (mon.0) 190 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6705109 2022-02-25 03:21:35 2022-03-02 15:14:03 2022-03-02 15:48:37 0:34:34 0:19:55 0:14:39 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
Failure Reason:

"2022-03-02T15:45:25.079012+0000 mon.a (mon.0) 241 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6705110 2022-02-25 03:21:35 2022-03-02 15:14:24 2022-03-02 15:46:14 0:31:50 0:19:50 0:12:00 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

"2022-03-02T15:44:33.261008+0000 mon.a (mon.0) 305 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705111 2022-02-25 03:21:36 2022-03-02 15:14:34 2022-03-02 15:33:58 0:19:24 0:09:26 0:09:58 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_read_only} 1
pass 6705112 2022-02-25 03:21:37 2022-03-02 15:14:34 2022-03-02 15:48:02 0:33:28 0:19:21 0:14:07 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6705113 2022-02-25 03:21:38 2022-03-02 15:14:35 2022-03-02 16:12:55 0:58:20 0:44:39 0:13:41 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
pass 6705114 2022-02-25 03:21:39 2022-03-02 15:14:35 2022-03-02 15:44:03 0:29:28 0:11:34 0:17:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6705115 2022-02-25 03:21:40 2022-03-02 15:22:37 2022-03-02 15:44:37 0:22:00 0:10:37 0:11:23 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6705116 2022-02-25 03:21:41 2022-03-02 15:23:07 2022-03-02 15:50:07 0:27:00 0:17:14 0:09:46 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

"2022-03-02T15:46:12.801765+0000 osd.3 (osd.3) 3 : cluster [WRN] 2 slow requests (by type [ 'started' : 2 ] most affected pool [ 'rbd' : 2 ])" in cluster log

pass 6705117 2022-02-25 03:21:42 2022-03-02 15:23:07 2022-03-02 15:45:20 0:22:13 0:10:26 0:11:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6705118 2022-02-25 03:21:43 2022-03-02 15:23:48 2022-03-02 15:56:28 0:32:40 0:21:05 0:11:35 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6705119 2022-02-25 03:21:43 2022-03-02 15:24:18 2022-03-02 15:48:41 0:24:23 0:11:01 0:13:22 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} 3
pass 6705120 2022-02-25 03:21:44 2022-03-02 15:27:19 2022-03-02 15:46:25 0:19:06 0:09:24 0:09:42 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_whole_object_zeroout} 1
pass 6705121 2022-02-25 03:21:45 2022-03-02 15:27:19 2022-03-02 15:58:23 0:31:04 0:18:31 0:12:33 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6705122 2022-02-25 03:21:46 2022-03-02 15:29:00 2022-03-02 15:51:13 0:22:13 0:10:32 0:11:41 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_kernel} 3
pass 6705123 2022-02-25 03:21:47 2022-03-02 15:29:40 2022-03-02 15:58:04 0:28:24 0:16:05 0:12:19 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6705124 2022-02-25 03:21:47 2022-03-02 15:30:11 2022-03-02 15:52:18 0:22:07 0:10:27 0:11:40 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6705125 2022-02-25 03:21:48 2022-03-02 15:30:11 2022-03-02 15:58:31 0:28:20 0:15:46 0:12:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} 3
pass 6705126 2022-02-25 03:21:49 2022-03-02 15:33:12 2022-03-02 15:59:42 0:26:30 0:13:55 0:12:35 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6705127 2022-02-25 03:21:50 2022-03-02 15:34:22 2022-03-02 16:10:36 0:36:14 0:24:45 0:11:29 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_simple_big} 3
pass 6705128 2022-02-25 03:21:50 2022-03-02 15:34:43 2022-03-02 15:53:38 0:18:55 0:10:03 0:08:52 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} 1
pass 6705129 2022-02-25 03:21:51 2022-03-02 15:34:43 2022-03-02 16:06:50 0:32:07 0:20:50 0:11:17 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6705130 2022-02-25 03:21:52 2022-03-02 15:34:43 2022-03-02 16:16:17 0:41:34 0:28:37 0:12:57 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_fio} 3
pass 6705131 2022-02-25 03:21:53 2022-03-02 15:36:44 2022-03-02 16:06:54 0:30:10 0:19:04 0:11:06 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_data_pool} 3
pass 6705132 2022-02-25 03:21:54 2022-03-02 15:37:34 2022-03-02 15:58:11 0:20:37 0:09:48 0:10:49 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
pass 6705133 2022-02-25 03:21:54 2022-03-02 15:38:45 2022-03-02 16:10:22 0:31:37 0:21:30 0:10:07 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
pass 6705134 2022-02-25 03:21:55 2022-03-02 15:38:55 2022-03-02 16:04:06 0:25:11 0:11:55 0:13:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} 3
fail 6705135 2022-02-25 03:21:56 2022-03-02 15:39:56 2022-03-02 16:13:28 0:33:32 0:19:33 0:13:59 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2022-03-02T16:10:21.728236+0000 mon.a (mon.0) 288 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6705136 2022-02-25 03:21:57 2022-03-02 15:41:56 2022-03-02 16:10:27 0:28:31 0:11:22 0:17:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_fallocate} 3
fail 6705137 2022-02-25 03:21:57 2022-03-02 15:43:47 2022-03-02 16:15:28 0:31:41 0:19:25 0:12:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_huge_osdmap} 3
Failure Reason:

"2022-03-02T16:13:05.406139+0000 mon.a (mon.0) 266 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705138 2022-02-25 03:21:58 2022-03-02 15:44:07 2022-03-02 16:34:15 0:50:08 0:37:21 0:12:47 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6705139 2022-02-25 03:21:59 2022-03-02 15:44:38 2022-03-02 16:12:27 0:27:49 0:14:06 0:13:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6705140 2022-02-25 03:22:00 2022-03-02 15:44:58 2022-03-02 16:09:01 0:24:03 0:09:44 0:14:19 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_discard} 1
pass 6705141 2022-02-25 03:22:01 2022-03-02 15:45:29 2022-03-02 16:15:55 0:30:26 0:17:47 0:12:39 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6705142 2022-02-25 03:22:01 2022-03-02 17:35:07 2022-03-02 19:11:46 1:36:39 1:22:25 0:14:14 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
fail 6705143 2022-02-25 03:22:02 2022-03-02 17:37:18 2022-03-02 18:07:42 0:30:24 0:19:17 0:11:07 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_namespaces} 3
Failure Reason:

"2022-03-02T18:06:23.540761+0000 mon.a (mon.0) 312 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705144 2022-02-25 03:22:03 2022-03-02 17:37:48 2022-03-02 19:12:47 1:34:59 1:21:37 0:13:22 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6705145 2022-02-25 03:22:04 2022-03-02 17:38:49 2022-03-02 18:28:53 0:50:04 0:37:38 0:12:26 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6705146 2022-02-25 03:22:05 2022-03-02 17:39:39 2022-03-02 18:11:29 0:31:50 0:19:28 0:12:22 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2022-03-02T18:08:37.675381+0000 mon.a (mon.0) 258 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705147 2022-02-25 03:22:05 2022-03-02 17:39:40 2022-03-02 18:03:58 0:24:18 0:12:08 0:12:10 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6705148 2022-02-25 03:22:06 2022-03-02 17:40:20 2022-03-02 18:02:49 0:22:29 0:11:05 0:11:24 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_netns} 3
pass 6705149 2022-02-25 03:22:07 2022-03-02 17:41:21 2022-03-02 17:59:45 0:18:24 0:09:05 0:09:19 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_huge_image} 1
pass 6705150 2022-02-25 03:22:08 2022-03-02 17:41:21 2022-03-02 18:22:52 0:41:31 0:22:31 0:19:00 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
fail 6705151 2022-02-25 03:22:09 2022-03-02 17:49:22 2022-03-02 18:20:27 0:31:05 0:19:18 0:11:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_symlinks} 3
Failure Reason:

"2022-03-02T18:18:58.629405+0000 mon.a (mon.0) 255 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6705152 2022-02-25 03:22:09 2022-03-02 17:50:53 2022-03-02 18:20:23 0:29:30 0:19:16 0:10:14 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

"2022-03-02T18:08:20.312327+0000 mon.a (mon.0) 118 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6705153 2022-02-25 03:22:10 2022-03-02 17:51:03 2022-03-02 18:20:07 0:29:04 0:15:31 0:13:33 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
fail 6705154 2022-02-25 03:22:11 2022-03-02 17:54:34 2022-03-02 18:25:02 0:30:28 0:19:13 0:11:15 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_huge_tickets} 3
Failure Reason:

"2022-03-02T18:23:08.998299+0000 mon.a (mon.0) 226 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6705155 2022-02-25 03:22:12 2022-03-02 17:56:09 2022-03-02 18:26:55 0:30:46 0:19:29 0:11:17 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2022-03-02T18:24:43.766346+0000 mon.a (mon.0) 269 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705156 2022-02-25 03:22:13 2022-03-02 17:57:29 2022-03-02 18:21:10 0:23:41 0:10:42 0:12:59 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_image_read} 3
pass 6705157 2022-02-25 03:22:13 2022-03-02 17:59:50 2022-03-02 18:22:20 0:22:30 0:09:00 0:13:30 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} 1
fail 6705158 2022-02-25 03:22:14 2022-03-02 18:02:21 2022-03-02 18:32:22 0:30:01 0:19:27 0:10:34 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2022-03-02T18:30:30.454630+0000 mon.a (mon.0) 240 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705159 2022-02-25 03:22:15 2022-03-02 18:02:51 2022-03-02 18:25:53 0:23:02 0:10:25 0:12:37 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} 3
pass 6705160 2022-02-25 03:22:16 2022-03-02 18:04:01 2022-03-02 18:33:36 0:29:35 0:17:28 0:12:07 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6705161 2022-02-25 03:22:17 2022-03-02 18:05:52 2022-03-02 18:29:28 0:23:36 0:10:36 0:13:00 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_map_snapshot_io} 3
fail 6705162 2022-02-25 03:22:18 2022-03-02 18:07:53 2022-03-02 18:41:22 0:33:29 0:19:18 0:14:11 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_map_unmap} 3
Failure Reason:

"2022-03-02T18:39:49.708881+0000 mon.a (mon.0) 258 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705163 2022-02-25 03:22:18 2022-03-02 18:11:33 2022-03-02 18:35:35 0:24:02 0:11:27 0:12:35 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6705164 2022-02-25 03:22:19 2022-03-02 18:13:34 2022-03-02 18:56:00 0:42:26 0:25:08 0:17:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} 3
pass 6705165 2022-02-25 03:22:20 2022-03-02 18:20:15 2022-03-02 18:39:34 0:19:19 0:08:59 0:10:20 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_msgr_segments} 1
pass 6705166 2022-02-25 03:22:21 2022-03-02 18:20:16 2022-03-02 18:53:47 0:33:31 0:23:50 0:09:41 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6705167 2022-02-25 03:22:22 2022-03-02 18:20:26 2022-03-02 18:42:02 0:21:36 0:11:34 0:10:02 smithi master krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_rxbounce} 3
pass 6705168 2022-02-25 03:22:22 2022-03-02 18:20:36 2022-03-02 19:00:49 0:40:13 0:27:56 0:12:17 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_fio} 3
fail 6705169 2022-02-25 03:22:23 2022-03-02 18:21:17 2022-03-02 18:52:30 0:31:13 0:19:36 0:11:37 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_data_pool} 3
Failure Reason:

"2022-03-02T18:50:43.024404+0000 mon.a (mon.0) 237 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6705170 2022-02-25 03:22:24 2022-03-02 18:22:57 2022-03-02 23:33:22 5:10:25 4:56:45 0:13:40 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{legacy-rxbounce} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi162 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeer17gt5m -r -- '-g auto -g blockdev -x clone'"

pass 6705171 2022-02-25 03:22:25 2022-03-02 18:25:08 2022-03-02 19:55:38 1:30:30 1:18:44 0:11:46 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6705172 2022-02-25 03:22:26 2022-03-02 18:25:58 2022-03-02 18:48:22 0:22:24 0:11:34 0:10:50 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6705173 2022-02-25 03:22:27 2022-03-02 18:26:59 2022-03-02 18:58:24 0:31:25 0:18:36 0:12:49 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6705174 2022-02-25 03:22:27 2022-03-02 18:29:01 2022-03-02 18:53:21 0:24:20 0:12:03 0:12:17 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} 3
pass 6705175 2022-02-25 03:22:28 2022-03-02 18:29:31 2022-03-02 18:53:49 0:24:18 0:11:24 0:12:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6705176 2022-02-25 03:22:29 2022-03-02 18:30:02 2022-03-02 19:19:51 0:49:49 0:37:28 0:12:21 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6705177 2022-02-25 03:22:30 2022-03-02 18:32:32 2022-03-02 18:59:16 0:26:44 0:14:14 0:12:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6705178 2022-02-25 03:22:31 2022-03-02 18:33:43 2022-03-02 18:55:49 0:22:06 0:08:50 0:13:16 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_parent_overlap} 1
pass 6705179 2022-02-25 03:22:31 2022-03-02 18:35:43 2022-03-02 19:06:14 0:30:31 0:17:52 0:12:39 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6705180 2022-02-25 03:22:32 2022-03-02 18:38:04 2022-03-02 19:14:14 0:36:10 0:23:31 0:12:39 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} 3
pass 6705181 2022-02-25 03:22:33 2022-03-02 18:40:44 2022-03-02 20:07:18 1:26:34 1:15:26 0:11:08 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6705182 2022-02-25 03:22:34 2022-03-02 18:41:25 2022-03-02 19:33:40 0:52:15 0:40:32 0:11:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6705183 2022-02-25 03:22:35 2022-03-02 18:42:05 2022-03-02 19:14:01 0:31:56 0:15:22 0:16:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
fail 6705184 2022-02-25 03:22:35 2022-03-02 18:48:27 2022-03-02 19:24:09 0:35:42 0:19:14 0:16:28 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
Failure Reason:

"2022-03-02T19:22:06.330242+0000 mon.a (mon.0) 243 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6705185 2022-02-25 03:22:36 2022-03-02 18:51:17 2022-03-02 19:22:00 0:30:43 0:19:17 0:11:26 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

"2022-03-02T19:20:42.728309+0000 mon.a (mon.0) 257 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705186 2022-02-25 03:22:37 2022-03-02 18:52:38 2022-03-02 19:11:45 0:19:07 0:09:03 0:10:04 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} 1
pass 6705187 2022-02-25 03:22:38 2022-03-02 18:52:38 2022-03-02 19:31:24 0:38:46 0:26:53 0:11:53 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6705188 2022-02-25 03:22:39 2022-03-02 18:53:29 2022-03-02 19:17:21 0:23:52 0:11:13 0:12:39 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6705189 2022-02-25 03:22:39 2022-03-02 18:53:49 2022-03-02 19:15:48 0:21:59 0:10:44 0:11:15 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6705190 2022-02-25 03:22:40 2022-03-02 18:54:00 2022-03-02 19:27:44 0:33:44 0:19:19 0:14:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

"2022-03-02T19:24:48.886209+0000 mon.a (mon.0) 246 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705191 2022-02-25 03:22:41 2022-03-02 18:56:00 2022-03-02 19:19:13 0:23:13 0:10:50 0:12:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} 3
fail 6705192 2022-02-25 03:22:42 2022-03-02 18:56:31 2022-03-02 19:27:56 0:31:25 0:19:35 0:11:50 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2022-03-02T19:16:23.582949+0000 mon.a (mon.0) 122 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6705193 2022-02-25 03:22:43 2022-03-03 22:09:08 2022-03-03 22:34:56 0:25:48 0:11:36 0:14:12 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_image_read} 3
pass 6705194 2022-02-25 03:22:43 2022-03-03 22:10:38 2022-03-03 22:29:41 0:19:03 0:10:46 0:08:17 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_whole_object_zeroout} 1
pass 6705195 2022-02-25 03:22:44 2022-03-03 22:10:38 2022-03-03 22:36:55 0:26:17 0:14:59 0:11:18 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6705196 2022-02-25 03:22:45 2022-03-03 22:11:20 2022-03-03 23:01:30 0:50:10 0:38:12 0:11:58 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
pass 6705197 2022-02-25 03:22:46 2022-03-03 22:11:50 2022-03-03 22:35:39 0:23:49 0:10:56 0:12:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_kernel} 3
pass 6705198 2022-02-25 03:22:47 2022-03-03 22:12:01 2022-03-03 22:40:29 0:28:28 0:16:26 0:12:02 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
fail 6705199 2022-02-25 03:22:47 2022-03-03 22:12:51 2022-03-03 22:46:12 0:33:21 0:19:43 0:13:38 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2022-03-03T22:34:19.121241+0000 mon.a (mon.0) 119 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6705200 2022-02-25 03:22:48 2022-03-03 22:14:02 2022-03-03 22:41:32 0:27:30 0:15:59 0:11:31 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_map_unmap} 3
pass 6705201 2022-02-25 03:22:49 2022-03-03 22:14:12 2022-03-03 22:41:07 0:26:55 0:13:25 0:13:30 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6705202 2022-02-25 03:22:50 2022-03-03 22:14:13 2022-03-03 22:53:59 0:39:46 0:23:56 0:15:50 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_simple_big} 3
pass 6705203 2022-02-25 03:22:51 2022-03-03 22:18:23 2022-03-03 22:40:20 0:21:57 0:09:44 0:12:13 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_deep_flatten} 1
pass 6705204 2022-02-25 03:22:51 2022-03-03 22:18:44 2022-03-03 22:56:03 0:37:19 0:25:17 0:12:02 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
fail 6705205 2022-02-25 03:22:52 2022-03-03 22:18:44 2022-03-03 22:50:53 0:32:09 0:19:56 0:12:13 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} 3
Failure Reason:

"2022-03-03T22:47:47.276759+0000 mon.a (mon.0) 195 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

dead 6705206 2022-02-25 03:22:53 2022-03-03 22:19:14 2022-03-03 23:27:50 1:08:36 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} 3
Failure Reason:

Error reimaging machines: Timeout opening channel.

pass 6705207 2022-02-25 03:22:54 2022-03-03 22:20:45 2022-03-03 22:42:34 0:21:49 0:09:20 0:12:29 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
pass 6705208 2022-02-25 03:22:55 2022-03-03 22:21:15 2022-03-03 22:55:13 0:33:58 0:20:59 0:12:59 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
pass 6705209 2022-02-25 03:22:55 2022-03-03 22:21:46 2022-03-03 22:47:11 0:25:25 0:11:53 0:13:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6705210 2022-02-25 03:22:56 2022-03-03 22:22:16 2022-03-03 22:52:34 0:30:18 0:19:09 0:11:09 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6705211 2022-02-25 03:22:57 2022-03-03 22:23:07 2022-03-03 22:47:44 0:24:37 0:11:53 0:12:44 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_fallocate} 3
fail 6705212 2022-02-25 03:22:58 2022-03-03 22:23:57 2022-03-03 22:56:17 0:32:20 0:19:31 0:12:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} 3
Failure Reason:

"2022-03-03T22:53:18.998860+0000 mon.a (mon.0) 248 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705213 2022-02-25 03:22:59 2022-03-03 22:24:48 2022-03-03 23:13:59 0:49:11 0:36:58 0:12:13 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6705214 2022-02-25 03:22:59 2022-03-03 22:26:18 2022-03-03 22:53:09 0:26:51 0:14:27 0:12:24 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6705215 2022-02-25 03:23:00 2022-03-03 22:26:59 2022-03-03 22:48:02 0:21:03 0:10:21 0:10:42 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} 1
pass 6705216 2022-02-25 03:23:01 2022-03-03 22:26:59 2022-03-03 22:53:37 0:26:38 0:15:51 0:10:47 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
fail 6705217 2022-02-25 03:23:02 2022-03-03 22:28:10 2022-03-03 22:58:31 0:30:21 0:19:08 0:11:13 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_namespaces} 3
Failure Reason:

"2022-03-03T22:57:14.796421+0000 mon.a (mon.0) 271 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705218 2022-02-25 03:23:03 2022-03-03 22:28:50 2022-03-04 00:04:42 1:35:52 1:24:16 0:11:36 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6705219 2022-02-25 03:23:03 2022-03-03 22:29:01 2022-03-03 23:19:47 0:50:46 0:38:11 0:12:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6705220 2022-02-25 03:23:04 2022-03-03 22:29:51 2022-03-03 23:01:47 0:31:56 0:19:18 0:12:38 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2022-03-03T23:00:22.931550+0000 mon.a (mon.0) 222 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705221 2022-02-25 03:23:05 2022-03-03 22:30:52 2022-03-03 22:52:39 0:21:47 0:11:54 0:09:53 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6705222 2022-02-25 03:23:06 2022-03-03 22:31:02 2022-03-03 22:53:58 0:22:56 0:11:13 0:11:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_netns} 3
pass 6705223 2022-02-25 03:23:07 2022-03-03 22:32:33 2022-03-03 22:52:23 0:19:50 0:09:19 0:10:31 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_huge_image} 1
pass 6705224 2022-02-25 03:23:07 2022-03-03 22:32:33 2022-03-03 23:05:19 0:32:46 0:20:23 0:12:23 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6705225 2022-02-25 03:23:08 2022-03-03 22:33:54 2022-03-04 00:05:27 1:31:33 1:17:32 0:14:01 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6705226 2022-02-25 03:23:09 2022-03-03 22:35:04 2022-03-03 22:59:28 0:24:24 0:12:03 0:12:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} 3
fail 6705227 2022-02-25 03:23:10 2022-03-03 22:35:44 2022-03-03 23:07:05 0:31:21 0:19:32 0:11:49 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

"2022-03-03T23:04:14.921889+0000 mon.a (mon.0) 343 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6705228 2022-02-25 03:23:11 2022-03-03 22:35:45 2022-03-03 23:04:36 0:28:51 0:16:18 0:12:33 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_concurrent} 3
pass 6705229 2022-02-25 03:23:11 2022-03-03 22:37:05 2022-03-03 22:59:42 0:22:37 0:11:14 0:11:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6705230 2022-02-25 03:23:12 2022-03-03 22:38:06 2022-03-03 23:09:05 0:30:59 0:18:56 0:12:03 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6705231 2022-02-25 03:23:13 2022-03-03 22:38:46 2022-03-03 23:04:14 0:25:28 0:12:18 0:13:10 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
pass 6705232 2022-02-25 03:23:14 2022-03-03 22:39:57 2022-03-03 22:59:22 0:19:25 0:08:45 0:10:40 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_modprobe} 1
pass 6705233 2022-02-25 03:23:14 2022-03-03 22:39:57 2022-03-03 23:12:22 0:32:25 0:20:20 0:12:05 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6705234 2022-02-25 03:23:15 2022-03-03 22:40:37 2022-03-03 23:04:16 0:23:39 0:11:58 0:11:41 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_kernel} 3
pass 6705235 2022-02-25 03:23:16 2022-03-03 22:40:38 2022-03-03 23:12:10 0:31:32 0:18:09 0:13:23 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6705236 2022-02-25 03:23:17 2022-03-03 22:41:08 2022-03-03 23:03:01 0:21:53 0:10:34 0:11:19 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6705237 2022-02-25 03:23:18 2022-03-03 22:41:39 2022-03-03 23:09:23 0:27:44 0:16:36 0:11:08 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} 3
pass 6705238 2022-02-25 03:23:18 2022-03-03 22:41:59 2022-03-03 23:05:58 0:23:59 0:12:31 0:11:28 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6705239 2022-02-25 03:23:19 2022-03-03 22:42:39 2022-03-03 23:16:36 0:33:57 0:23:26 0:10:31 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_simple_big} 3
pass 6705240 2022-02-25 03:23:20 2022-03-03 22:43:10 2022-03-03 23:04:34 0:21:24 0:09:58 0:11:26 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} 1
pass 6705241 2022-02-25 03:23:21 2022-03-03 22:43:10 2022-03-03 23:24:06 0:40:56 0:26:28 0:14:28 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6705242 2022-02-25 03:23:21 2022-03-03 22:44:31 2022-03-03 23:27:00 0:42:29 0:28:20 0:14:09 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_fio} 3
pass 6705243 2022-02-25 03:23:22 2022-03-03 22:45:21 2022-03-03 23:25:42 0:40:21 0:26:39 0:13:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_data_pool} 3
pass 6705244 2022-02-25 03:23:23 2022-03-03 22:46:12 2022-03-03 23:10:35 0:24:23 0:11:51 0:12:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6705245 2022-02-25 03:23:24 2022-03-03 22:46:22 2022-03-03 23:20:11 0:33:49 0:18:31 0:15:18 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
dead 6705246 2022-02-25 03:23:25 2022-03-03 22:47:12 2022-03-03 23:02:44 0:15:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6705247 2022-02-25 03:23:25 2022-03-03 22:47:33 2022-03-03 23:11:44 0:24:11 0:11:40 0:12:31 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_huge_osdmap} 3
fail 6705248 2022-02-25 03:23:26 2022-03-03 22:47:53 2022-03-03 23:19:50 0:31:57 0:19:12 0:12:45 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

"2022-03-03T23:17:11.125089+0000 mon.a (mon.0) 235 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705249 2022-02-25 03:23:27 2022-03-03 22:48:24 2022-03-03 23:16:24 0:28:00 0:14:31 0:13:29 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6705250 2022-02-25 03:23:28 2022-03-03 22:50:54 2022-03-03 23:10:51 0:19:57 0:08:56 0:11:01 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_parent_overlap} 1
pass 6705251 2022-02-25 03:23:29 2022-03-03 22:50:54 2022-03-03 23:18:04 0:27:10 0:15:33 0:11:37 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6705252 2022-02-25 03:23:29 2022-03-03 22:52:35 2022-03-03 23:42:22 0:49:47 0:38:38 0:11:09 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 6705253 2022-02-25 03:23:30 2022-03-03 22:52:45 2022-03-03 23:16:49 0:24:04 0:11:43 0:12:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_namespaces} 3
pass 6705254 2022-02-25 03:23:31 2022-03-03 22:53:16 2022-03-04 00:23:33 1:30:17 1:16:38 0:13:39 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
fail 6705255 2022-02-25 03:23:31 2022-03-03 22:53:16 2022-03-03 23:25:07 0:31:51 0:19:22 0:12:29 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_enumerate} 3
Failure Reason:

"2022-03-03T23:23:36.586369+0000 mon.a (mon.0) 257 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705256 2022-02-25 03:23:32 2022-03-03 22:53:47 2022-03-03 23:21:37 0:27:50 0:15:10 0:12:40 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6705257 2022-02-25 03:23:33 2022-03-03 22:54:07 2022-03-03 23:21:29 0:27:22 0:13:09 0:14:13 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6705258 2022-02-25 03:23:34 2022-03-03 22:54:07 2022-03-03 23:22:47 0:28:40 0:14:35 0:14:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_netns} 3
pass 6705259 2022-02-25 03:23:34 2022-03-03 22:55:18 2022-03-03 23:19:09 0:23:51 0:10:22 0:13:29 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_read_only} 1
pass 6705260 2022-02-25 03:23:35 2022-03-03 22:55:38 2022-03-03 23:33:34 0:37:56 0:23:57 0:13:59 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
fail 6705261 2022-02-25 03:23:36 2022-03-03 22:56:09 2022-03-03 23:27:37 0:31:28 0:19:52 0:11:36 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_symlinks} 3
Failure Reason:

"2022-03-03T23:26:18.024748+0000 mon.a (mon.0) 207 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705262 2022-02-25 03:23:37 2022-03-03 22:56:19 2022-03-03 23:20:13 0:23:54 0:10:27 0:13:27 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6705263 2022-02-25 03:23:38 2022-03-03 22:58:40 2022-03-03 23:27:08 0:28:28 0:15:23 0:13:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} 3
pass 6705264 2022-02-25 03:23:38 2022-03-03 22:59:30 2022-03-03 23:23:14 0:23:44 0:10:38 0:13:06 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_huge_tickets} 3
fail 6705265 2022-02-25 03:23:39 2022-03-03 22:59:50 2022-03-03 23:33:14 0:33:24 0:19:44 0:13:40 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2022-03-03T23:19:42.033137+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6705266 2022-02-25 03:23:40 2022-03-03 23:01:31 2022-03-03 23:26:18 0:24:47 0:10:58 0:13:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_image_read} 3
pass 6705267 2022-02-25 03:23:41 2022-03-03 23:01:51 2022-03-03 23:23:14 0:21:23 0:09:48 0:11:35 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} 1
pass 6705268 2022-02-25 03:23:41 2022-03-03 23:01:52 2022-03-03 23:32:29 0:30:37 0:17:21 0:13:16 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6705269 2022-02-25 03:23:42 2022-03-03 23:03:02 2022-03-03 23:24:24 0:21:22 0:10:37 0:10:45 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} 3
pass 6705270 2022-02-25 03:23:43 2022-03-03 23:03:03 2022-03-03 23:32:08 0:29:05 0:15:58 0:13:07 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
fail 6705271 2022-02-25 03:23:44 2022-03-03 23:04:23 2022-03-03 23:36:27 0:32:04 0:19:46 0:12:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2022-03-03T23:35:20.588966+0000 mon.a (mon.0) 251 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6705272 2022-02-25 03:23:45 2022-03-03 23:04:23 2022-03-03 23:32:19 0:27:56 0:16:00 0:11:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_map_unmap} 3
pass 6705273 2022-02-25 03:23:45 2022-03-03 23:04:44 2022-03-03 23:30:54 0:26:10 0:13:38 0:12:32 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
fail 6705274 2022-02-25 03:23:46 2022-03-03 23:05:24 2022-03-03 23:37:28 0:32:04 0:19:56 0:12:08 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} 3
Failure Reason:

"2022-03-03T23:35:16.453696+0000 mon.a (mon.0) 339 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log