Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6412225 2021-09-28 22:18:03 2021-09-28 22:18:55 2021-09-28 22:38:30 0:19:35 0:09:15 0:10:20 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_deep_flatten} 1
pass 6412226 2021-09-28 22:18:12 2021-09-28 22:18:55 2021-09-28 22:53:56 0:35:01 0:20:50 0:14:11 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6412227 2021-09-28 22:18:13 2021-09-28 22:20:16 2021-09-28 23:00:23 0:40:07 0:28:19 0:11:48 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_fio} 3
pass 6412228 2021-09-28 22:18:14 2021-09-28 22:20:59 2021-09-28 22:51:42 0:30:43 0:17:58 0:12:45 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_data_pool} 3
fail 6412229 2021-09-28 22:18:15 2021-09-28 22:22:10 2021-09-29 03:03:31 4:41:21 4:27:00 0:14:21 smithi master ubuntu 20.04 krbd/singleton/{bluestore-bitmap conf ms_mode$/{prefer-crc} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi098 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude9c2_y7og -r -- '-g auto -g blockdev -x clone'"

pass 6412230 2021-09-28 22:18:16 2021-09-28 22:23:50 2021-09-28 23:20:15 0:56:25 0:43:58 0:12:27 smithi master ubuntu 20.04 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/backoff thrashosds-health workloads/rbd_fio} 3
fail 6412231 2021-09-28 22:18:17 2021-09-28 22:24:21 2021-09-28 22:32:54 0:08:33 smithi master ubuntu 20.04 krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major

pass 6412232 2021-09-28 22:18:18 2021-09-28 22:24:41 2021-09-28 22:42:01 0:17:20 0:08:34 0:08:46 smithi master ubuntu 20.04 krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} 1
fail 6412233 2021-09-28 22:18:19 2021-09-28 22:24:42 2021-09-28 22:58:03 0:33:21 0:19:13 0:14:08 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2021-09-28T22:56:43.972993+0000 mon.a (mon.0) 314 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

fail 6412234 2021-09-28 22:18:20 2021-09-28 22:26:32 2021-09-28 23:00:15 0:33:43 0:19:41 0:14:02 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2021-09-28T22:46:47.739239+0000 mon.a (mon.0) 130 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6412235 2021-09-28 22:18:21 2021-09-28 22:26:33 2021-09-28 22:59:34 0:33:01 0:19:01 0:14:00 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} 3
Failure Reason:

"2021-09-28T22:57:48.895894+0000 mon.a (mon.0) 278 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log

pass 6412236 2021-09-28 22:18:22 2021-09-28 22:28:03 2021-09-28 22:51:50 0:23:47 0:11:37 0:12:10 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6412237 2021-09-28 22:18:23 2021-09-28 22:28:14 2021-09-28 23:20:12 0:51:58 0:37:02 0:14:56 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6412238 2021-09-28 22:18:24 2021-09-28 22:29:55 2021-09-28 22:58:35 0:28:40 0:13:56 0:14:44 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6412239 2021-09-28 22:18:25 2021-09-28 22:31:05 2021-09-28 22:50:29 0:19:24 0:09:34 0:09:50 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_discard} 1
pass 6412240 2021-09-28 22:18:26 2021-09-28 22:31:05 2021-09-28 23:02:08 0:31:03 0:17:26 0:13:37 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6412241 2021-09-28 22:18:27 2021-09-28 22:32:26 2021-09-28 22:56:19 0:23:53 0:11:43 0:12:10 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} 3
pass 6412242 2021-09-28 22:18:28 2021-09-28 22:32:46 2021-09-29 00:13:19 1:40:33 1:25:52 0:14:41 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6412243 2021-09-28 22:18:29 2021-09-28 22:33:07 2021-09-28 23:21:52 0:48:45 0:35:25 0:13:20 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6412244 2021-09-28 22:18:30 2021-09-28 22:33:57 2021-09-28 23:05:56 0:31:59 0:17:43 0:14:16 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6412245 2021-09-28 22:18:31 2021-09-28 22:34:08 2021-09-28 23:00:27 0:26:19 0:12:41 0:13:38 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6412246 2021-09-28 22:18:32 2021-09-28 22:34:58 2021-09-28 22:59:23 0:24:25 0:12:11 0:12:14 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} 3
pass 6412247 2021-09-28 22:18:33 2021-09-28 22:35:39 2021-09-28 22:55:24 0:19:45 0:08:52 0:10:53 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} 1
pass 6412248 2021-09-28 22:18:34 2021-09-28 22:35:39 2021-09-28 23:11:41 0:36:02 0:23:59 0:12:03 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6412249 2021-09-28 22:18:35 2021-09-28 22:36:10 2021-09-28 23:01:15 0:25:05 0:11:58 0:13:07 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_symlinks} 3
fail 6412250 2021-09-28 22:18:36 2021-09-28 22:37:30 2021-09-28 23:09:29 0:31:59 0:19:02 0:12:57 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

"2021-09-28T23:07:18.855185+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6412251 2021-09-28 22:18:37 2021-09-28 22:37:41 2021-09-28 22:45:07 0:07:26 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_concurrent} 3
Failure Reason:

Command failed on smithi119 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master'

fail 6412252 2021-09-28 22:18:38 2021-09-28 22:37:42 2021-09-28 23:09:57 0:32:15 0:19:25 0:12:50 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} 3
Failure Reason:

"2021-09-28T23:07:50.403164+0000 mon.a (mon.0) 293 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412253 2021-09-28 22:18:39 2021-09-28 22:38:33 2021-09-28 23:09:28 0:30:55 0:18:40 0:12:15 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6412254 2021-09-28 22:18:40 2021-09-28 22:40:03 2021-09-28 23:03:48 0:23:45 0:10:40 0:13:05 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_image_read} 3
pass 6412255 2021-09-28 22:18:41 2021-09-28 22:40:24 2021-09-28 23:00:22 0:19:58 0:08:55 0:11:03 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_modprobe} 1
pass 6412256 2021-09-28 22:18:42 2021-09-28 22:40:54 2021-09-28 23:09:27 0:28:33 0:15:36 0:12:57 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6412257 2021-09-28 22:18:43 2021-09-28 22:41:45 2021-09-29 00:11:38 1:29:53 1:17:16 0:12:37 smithi master ubuntu 20.04 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
fail 6412258 2021-09-28 22:18:44 2021-09-28 22:42:06 2021-09-28 23:18:01 0:35:55 0:19:34 0:16:21 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

"2021-09-28T23:06:07.060381+0000 mon.a (mon.0) 129 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY)" in cluster log

fail 6412259 2021-09-28 22:18:45 2021-09-28 22:43:46 2021-09-28 23:17:45 0:33:59 0:19:22 0:14:37 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2021-09-28T23:04:20.461832+0000 mon.a (mon.0) 193 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6412260 2021-09-28 22:18:46 2021-09-28 22:43:57 2021-09-28 23:16:33 0:32:36 0:18:57 0:13:39 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2021-09-28T23:15:09.404720+0000 mon.a (mon.0) 326 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6412261 2021-09-28 22:18:47 2021-09-28 22:45:18 2021-09-28 23:13:43 0:28:25 0:15:18 0:13:07 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_unmap} 3
pass 6412262 2021-09-28 22:18:48 2021-09-28 22:46:18 2021-09-28 23:11:49 0:25:31 0:11:32 0:13:59 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6412263 2021-09-28 22:18:49 2021-09-28 22:46:39 2021-09-28 23:25:10 0:38:31 0:23:58 0:14:33 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_simple_big} 3
pass 6412264 2021-09-28 22:18:50 2021-09-28 22:47:40 2021-09-28 23:06:39 0:18:59 0:08:50 0:10:09 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_msgr_segments} 1
pass 6412265 2021-09-28 22:18:51 2021-09-28 22:47:40 2021-09-28 23:25:36 0:37:56 0:24:49 0:13:07 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6412266 2021-09-28 22:18:52 2021-09-28 22:48:00 2021-09-28 23:30:19 0:42:19 0:28:42 0:13:37 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
fail 6412267 2021-09-28 22:18:53 2021-09-28 22:48:51 2021-09-28 23:23:16 0:34:25 0:19:19 0:15:06 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} 3
Failure Reason:

"2021-09-28T23:21:39.101690+0000 mon.a (mon.0) 276 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412268 2021-09-28 22:18:54 2021-09-28 22:51:12 2021-09-28 23:15:34 0:24:22 0:11:41 0:12:41 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6412269 2021-09-28 22:18:55 2021-09-28 22:51:52 2021-09-28 23:23:28 0:31:36 0:18:56 0:12:40 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
fail 6412270 2021-09-28 22:18:56 2021-09-28 22:51:53 2021-09-28 23:25:07 0:33:14 0:19:09 0:14:05 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

"2021-09-28T23:23:00.595244+0000 mon.a (mon.0) 300 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6412271 2021-09-28 22:18:57 2021-09-28 22:53:03 2021-09-28 23:17:42 0:24:39 0:11:23 0:13:16 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} 3
fail 6412272 2021-09-28 22:18:58 2021-09-28 22:54:04 2021-09-28 23:25:33 0:31:29 0:19:22 0:12:07 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

"2021-09-28T23:23:46.413263+0000 mon.a (mon.0) 322 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412273 2021-09-28 22:18:59 2021-09-28 22:54:14 2021-09-28 23:22:35 0:28:21 0:14:33 0:13:48 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6412274 2021-09-28 22:19:00 2021-09-28 22:54:24 2021-09-28 23:14:27 0:20:03 0:09:03 0:11:00 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} 1
fail 6412275 2021-09-28 22:19:01 2021-09-28 22:54:35 2021-09-28 23:27:58 0:33:23 0:18:15 0:15:08 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2021-09-28T23:25:51.432705+0000 mon.a (mon.0) 248 : cluster [WRN] Health check failed: 5 osds down (OSD_DOWN)" in cluster log

pass 6412276 2021-09-28 22:19:02 2021-09-28 22:56:25 2021-09-28 23:27:35 0:31:10 0:11:59 0:19:11 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_namespaces} 3
pass 6412277 2021-09-28 22:19:03 2021-09-28 22:56:36 2021-09-29 00:24:41 1:28:05 1:15:12 0:12:53 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
fail 6412278 2021-09-28 22:19:04 2021-09-28 22:57:06 2021-09-28 23:29:30 0:32:24 0:19:32 0:12:52 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} 3
Failure Reason:

"2021-09-28T23:18:06.881691+0000 mon.a (mon.0) 135 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6412279 2021-09-28 22:19:05 2021-09-28 22:58:07 2021-09-28 23:27:29 0:29:22 0:16:53 0:12:29 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
fail 6412280 2021-09-28 22:19:06 2021-09-28 22:58:07 2021-09-28 23:30:07 0:32:00 0:19:23 0:12:37 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
Failure Reason:

"2021-09-28T23:18:36.843456+0000 mon.a (mon.0) 159 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6412281 2021-09-28 22:19:07 2021-09-28 22:58:37 2021-09-28 23:24:18 0:25:41 0:11:32 0:14:09 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netns} 3
pass 6412282 2021-09-28 22:19:08 2021-09-28 22:58:48 2021-09-28 23:18:24 0:19:36 0:09:15 0:10:21 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_read_only} 1
pass 6412283 2021-09-28 22:19:09 2021-09-28 22:58:48 2021-09-28 23:31:10 0:32:22 0:18:04 0:14:18 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6412284 2021-09-28 22:19:10 2021-09-28 22:59:28 2021-09-28 23:50:58 0:51:30 0:37:31 0:13:59 smithi master ubuntu 20.04 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
pass 6412285 2021-09-28 22:19:11 2021-09-28 22:59:39 2021-09-28 23:25:53 0:26:14 0:12:38 0:13:36 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6412286 2021-09-28 22:19:12 2021-09-28 23:00:19 2021-09-28 23:26:06 0:25:47 0:11:22 0:14:25 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6412287 2021-09-28 22:19:13 2021-09-28 23:00:30 2021-09-29 03:14:11 4:13:41 3:59:44 0:13:57 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

Command failed (workunit test rbd/concurrent.sh) on smithi142 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=84379239c065eab5d8e5ce78b9ef546a60428aff TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh'

pass 6412288 2021-09-28 22:19:14 2021-09-28 23:00:30 2021-09-28 23:26:38 0:26:08 0:11:45 0:14:23 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6412289 2021-09-28 22:19:15 2021-09-28 23:00:31 2021-09-28 23:37:09 0:36:38 0:21:26 0:15:12 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
fail 6412290 2021-09-28 22:19:16 2021-09-28 23:01:21 2021-09-28 23:35:53 0:34:32 0:20:05 0:14:27 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

"2021-09-28T23:32:57.756905+0000 mon.a (mon.0) 233 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412291 2021-09-28 22:19:17 2021-09-28 23:02:12 2021-09-28 23:23:03 0:20:51 0:09:09 0:11:42 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_whole_object_zeroout} 1
pass 6412292 2021-09-28 22:19:18 2021-09-28 23:03:52 2021-09-28 23:37:48 0:33:56 0:18:50 0:15:06 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6412293 2021-09-28 22:19:19 2021-09-28 23:06:03 2021-09-28 23:28:23 0:22:20 0:10:08 0:12:12 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_kernel} 3
pass 6412294 2021-09-28 22:19:20 2021-09-28 23:06:43 2021-09-28 23:39:08 0:32:25 0:16:03 0:16:22 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
fail 6412295 2021-09-28 22:19:21 2021-09-28 23:09:34 2021-09-28 23:42:55 0:33:21 0:19:46 0:13:35 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2021-09-28T23:30:21.876810+0000 mon.a (mon.0) 155 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6412296 2021-09-28 22:19:22 2021-09-28 23:09:35 2021-09-28 23:39:08 0:29:33 0:15:48 0:13:45 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} 3
fail 6412297 2021-09-28 22:19:23 2021-09-28 23:09:35 2021-09-28 23:43:16 0:33:41 0:19:18 0:14:23 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

"2021-09-28T23:30:52.993180+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6412298 2021-09-28 22:19:24 2021-09-28 23:09:35 2021-09-28 23:43:21 0:33:46 0:19:15 0:14:31 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_simple_big} 3
Failure Reason:

"2021-09-28T23:40:56.948667+0000 mon.a (mon.0) 229 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412299 2021-09-28 22:19:25 2021-09-28 23:10:07 2021-09-28 23:29:06 0:18:59 0:09:41 0:09:18 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} 1
pass 6412300 2021-09-28 22:19:26 2021-09-28 23:10:07 2021-09-28 23:47:20 0:37:13 0:22:55 0:14:18 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6412301 2021-09-28 22:19:27 2021-09-28 23:11:48 2021-09-28 23:52:59 0:41:11 0:29:11 0:12:00 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_fio} 3
pass 6412302 2021-09-28 22:19:28 2021-09-28 23:11:58 2021-09-28 23:43:09 0:31:11 0:18:04 0:13:07 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_data_pool} 3
pass 6412303 2021-09-28 22:19:29 2021-09-28 23:13:49 2021-09-28 23:36:27 0:22:38 0:09:35 0:13:03 smithi master ubuntu 20.04 krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
pass 6412304 2021-09-28 22:19:30 2021-09-28 23:14:19 2021-09-28 23:48:24 0:34:05 0:20:48 0:13:17 smithi master ubuntu 20.04 krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
pass 6412305 2021-09-28 22:19:31 2021-09-28 23:14:29 2021-09-28 23:39:03 0:24:34 0:11:37 0:12:57 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6412306 2021-09-28 22:19:32 2021-09-28 23:15:40 2021-09-28 23:49:54 0:34:14 0:19:39 0:14:35 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6412307 2021-09-28 22:19:33 2021-09-28 23:16:40 2021-09-28 23:41:12 0:24:32 0:11:23 0:13:09 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_fallocate} 3
pass 6412308 2021-09-28 22:19:34 2021-09-28 23:17:51 2021-09-28 23:43:41 0:25:50 0:11:49 0:14:01 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6412309 2021-09-28 22:19:35 2021-09-28 23:17:51 2021-09-29 00:08:22 0:50:31 0:37:38 0:12:53 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6412310 2021-09-28 22:19:36 2021-09-28 23:18:13 2021-09-28 23:47:50 0:29:37 0:13:50 0:15:47 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6412311 2021-09-28 22:19:37 2021-09-28 23:20:13 2021-09-28 23:39:56 0:19:43 0:09:33 0:10:10 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_discard} 1
pass 6412312 2021-09-28 22:19:38 2021-09-28 23:20:13 2021-09-28 23:49:45 0:29:32 0:17:27 0:12:05 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6412313 2021-09-28 22:19:39 2021-09-28 23:20:14 2021-09-29 00:51:43 1:31:29 1:18:36 0:12:53 smithi master ubuntu 20.04 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6412314 2021-09-28 22:19:40 2021-09-28 23:21:54 2021-09-28 23:46:42 0:24:48 0:12:01 0:12:47 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_namespaces} 3
pass 6412315 2021-09-28 22:19:41 2021-09-28 23:22:45 2021-09-29 00:57:26 1:34:41 1:20:59 0:13:42 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6412316 2021-09-28 22:19:42 2021-09-28 23:23:25 2021-09-29 00:11:07 0:47:42 0:35:07 0:12:35 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6412317 2021-09-28 22:19:43 2021-09-28 23:23:36 2021-09-28 23:56:07 0:32:31 0:19:13 0:13:18 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2021-09-28T23:54:29.376034+0000 mon.a (mon.0) 264 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412318 2021-09-28 22:19:44 2021-09-28 23:24:36 2021-09-28 23:50:37 0:26:01 0:11:57 0:14:04 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6412319 2021-09-28 22:19:45 2021-09-28 23:25:17 2021-09-28 23:49:19 0:24:02 0:11:19 0:12:43 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netns} 3
pass 6412320 2021-09-28 22:19:46 2021-09-28 23:25:17 2021-09-28 23:42:32 0:17:15 0:08:50 0:08:25 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_huge_image} 1
pass 6412321 2021-09-28 22:19:47 2021-09-28 23:25:17 2021-09-29 00:03:17 0:38:00 0:23:40 0:14:20 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6412322 2021-09-28 22:19:48 2021-09-28 23:25:38 2021-09-28 23:50:39 0:25:01 0:12:10 0:12:51 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6412323 2021-09-28 22:19:49 2021-09-28 23:25:38 2021-09-28 23:51:43 0:26:05 0:11:30 0:14:35 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6412324 2021-09-28 22:19:50 2021-09-28 23:25:58 2021-09-28 23:53:39 0:27:41 0:15:49 0:11:52 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
fail 6412325 2021-09-28 22:19:51 2021-09-28 23:26:09 2021-09-29 00:00:40 0:34:31 0:19:31 0:15:00 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_huge_tickets} 3
Failure Reason:

"2021-09-28T23:58:13.751421+0000 mon.a (mon.0) 332 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412326 2021-09-28 22:19:52 2021-09-28 23:26:39 2021-09-28 23:59:08 0:32:29 0:18:50 0:13:39 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6412327 2021-09-28 22:19:53 2021-09-28 23:27:30 2021-09-28 23:56:39 0:29:09 0:11:02 0:18:07 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_image_read} 3
pass 6412328 2021-09-28 22:19:54 2021-09-28 23:27:40 2021-09-28 23:47:22 0:19:42 0:08:45 0:10:57 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} 1
fail 6412329 2021-09-28 22:19:55 2021-09-28 23:28:00 2021-09-29 00:01:48 0:33:48 0:19:41 0:14:07 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2021-09-28T23:48:44.760277+0000 mon.a (mon.0) 138 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6412330 2021-09-28 22:19:56 2021-09-28 23:28:31 2021-09-29 00:00:34 0:32:03 0:19:30 0:12:33 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

"2021-09-28T23:59:02.640039+0000 mon.a (mon.0) 276 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412331 2021-09-28 22:19:57 2021-09-28 23:29:11 2021-09-28 23:59:04 0:29:53 0:17:30 0:12:23 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6412332 2021-09-28 22:19:58 2021-09-28 23:29:42 2021-09-28 23:53:30 0:23:48 0:10:11 0:13:37 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_snapshot_io} 3
fail 6412333 2021-09-28 22:19:59 2021-09-28 23:30:13 2021-09-29 00:01:55 0:31:42 0:19:30 0:12:12 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_unmap} 3
Failure Reason:

"2021-09-29T00:00:54.978961+0000 mon.a (mon.0) 244 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412334 2021-09-28 22:20:00 2021-09-28 23:30:23 2021-09-28 23:54:52 0:24:29 0:11:33 0:12:56 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6412335 2021-09-28 22:20:01 2021-09-28 23:31:13 2021-09-29 00:13:32 0:42:19 0:25:15 0:17:04 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} 3
pass 6412336 2021-09-28 22:20:02 2021-09-28 23:35:54 2021-09-28 23:55:13 0:19:19 0:08:56 0:10:23 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_msgr_segments} 1
pass 6412337 2021-09-28 22:20:03 2021-09-28 23:35:55 2021-09-29 00:14:48 0:38:53 0:23:31 0:15:22 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6412338 2021-09-28 22:20:04 2021-09-28 23:36:35 2021-09-29 00:18:56 0:42:21 0:28:42 0:13:39 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_fio} 3
pass 6412339 2021-09-28 22:20:05 2021-09-28 23:37:16 2021-09-29 00:13:58 0:36:42 0:22:12 0:14:30 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_data_pool} 3
fail 6412340 2021-09-28 22:20:06 2021-09-28 23:37:56 2021-09-29 00:15:00 0:37:04 0:19:22 0:17:42 smithi master ubuntu 20.04 krbd/singleton/{bluestore-bitmap conf ms_mode$/{prefer-crc} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

"2021-09-29T00:02:02.932305+0000 mon.a (mon.0) 91 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6412341 2021-09-28 22:20:07 2021-09-28 23:39:07 2021-09-29 01:15:09 1:36:02 1:22:39 0:13:23 smithi master ubuntu 20.04 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6412342 2021-09-28 22:20:08 2021-09-28 23:39:17 2021-09-29 00:04:56 0:25:39 0:11:30 0:14:09 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6412343 2021-09-28 22:20:09 2021-09-28 23:39:17 2021-09-29 00:12:48 0:33:31 0:18:19 0:15:12 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
fail 6412344 2021-09-28 22:20:10 2021-09-28 23:42:35 2021-09-29 00:14:23 0:31:48 0:19:49 0:11:59 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

"2021-09-29T00:12:49.853008+0000 mon.a (mon.0) 315 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412345 2021-09-28 22:20:12 2021-09-28 23:43:05 2021-09-29 00:06:36 0:23:31 0:12:11 0:11:20 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6412346 2021-09-28 22:20:13 2021-09-28 23:43:15 2021-09-29 00:36:37 0:53:22 0:41:01 0:12:21 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
fail 6412347 2021-09-28 22:20:15 2021-09-28 23:43:26 2021-09-29 00:14:52 0:31:26 0:19:20 0:12:06 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
Failure Reason:

"2021-09-29T00:13:13.481377+0000 mon.a (mon.0) 270 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412348 2021-09-28 22:20:16 2021-09-28 23:43:26 2021-09-29 00:03:20 0:19:54 0:09:19 0:10:35 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_parent_overlap} 1
pass 6412349 2021-09-28 22:20:17 2021-09-28 23:43:46 2021-09-29 00:20:49 0:37:03 0:20:02 0:17:01 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6412350 2021-09-28 22:20:18 2021-09-28 23:46:47 2021-09-29 00:10:56 0:24:09 0:11:34 0:12:35 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} 3
pass 6412351 2021-09-28 22:20:19 2021-09-28 23:47:28 2021-09-29 01:19:01 1:31:33 1:18:30 0:13:03 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6412352 2021-09-28 22:20:20 2021-09-28 23:47:28 2021-09-29 00:39:51 0:52:23 0:38:27 0:13:56 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6412353 2021-09-28 22:20:21 2021-09-28 23:47:58 2021-09-29 00:18:30 0:30:32 0:16:30 0:14:02 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
fail 6412354 2021-09-28 22:20:22 2021-09-28 23:48:29 2021-09-29 00:21:30 0:33:01 0:19:02 0:13:59 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
Failure Reason:

"2021-09-29T00:10:14.201796+0000 mon.a (mon.0) 114 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6412355 2021-09-28 22:20:23 2021-09-28 23:49:19 2021-09-29 00:13:24 0:24:05 0:11:27 0:12:38 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} 3
pass 6412356 2021-09-28 22:20:24 2021-09-28 23:49:50 2021-09-29 00:09:20 0:19:30 0:09:28 0:10:02 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} 1
fail 6412357 2021-09-28 22:20:25 2021-09-28 23:50:00 2021-09-29 00:17:56 0:27:56 0:12:42 0:15:14 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

Command failed on smithi049 with status 151: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 20000 -K -U pool_client.0 image_client.0'

pass 6412358 2021-09-28 22:20:26 2021-09-28 23:50:40 2021-09-29 00:16:05 0:25:25 0:11:32 0:13:53 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6412359 2021-09-28 22:20:27 2021-09-28 23:50:41 2021-09-29 00:16:25 0:25:44 0:10:56 0:14:48 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
dead 6412360 2021-09-28 22:20:28 2021-09-28 23:51:01 2021-09-29 02:55:38 3:04:37 2:49:50 0:14:47 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

SSH connection to smithi173 was lost: 'sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0'

pass 6412361 2021-09-28 22:20:29 2021-09-28 23:51:42 2021-09-29 00:17:31 0:25:49 0:11:02 0:14:47 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} 3
fail 6412362 2021-09-28 22:20:30 2021-09-28 23:51:52 2021-09-29 00:26:03 0:34:11 0:19:37 0:14:34 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2021-09-29T00:24:15.003348+0000 mon.a (mon.0) 229 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6412363 2021-09-28 22:20:31 2021-09-28 23:53:02 2021-09-29 00:26:56 0:33:54 0:19:19 0:14:35 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

"2021-09-29T00:24:44.985770+0000 mon.a (mon.0) 221 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412364 2021-09-28 22:20:32 2021-09-28 23:53:33 2021-09-29 00:12:48 0:19:15 0:09:10 0:10:05 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_whole_object_zeroout} 1
pass 6412365 2021-09-28 22:20:33 2021-09-28 23:53:33 2021-09-29 00:21:29 0:27:56 0:14:28 0:13:28 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6412366 2021-09-28 22:20:34 2021-09-28 23:53:44 2021-09-29 00:44:44 0:51:00 0:37:07 0:13:53 smithi master ubuntu 20.04 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
pass 6412367 2021-09-28 22:20:35 2021-09-28 23:54:54 2021-09-29 00:19:37 0:24:43 0:10:23 0:14:20 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_kernel} 3
pass 6412368 2021-09-28 22:20:36 2021-09-28 23:56:15 2021-09-29 00:31:49 0:35:34 0:16:22 0:19:12 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
fail 6412369 2021-09-28 22:20:37 2021-09-28 23:56:45 2021-09-29 00:30:36 0:33:51 0:19:13 0:14:38 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2021-09-29T00:28:53.234878+0000 mon.a (mon.0) 349 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412370 2021-09-28 22:20:38 2021-09-28 23:59:06 2021-09-29 00:26:47 0:27:41 0:15:17 0:12:24 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_unmap} 3
pass 6412371 2021-09-28 22:20:39 2021-09-28 23:59:16 2021-09-29 00:25:49 0:26:33 0:12:16 0:14:17 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6412372 2021-09-28 22:20:40 2021-09-29 00:00:37 2021-09-29 00:40:46 0:40:09 0:25:57 0:14:12 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_simple_big} 3
pass 6412373 2021-09-28 22:20:41 2021-09-29 00:00:47 2021-09-29 00:20:05 0:19:18 0:09:29 0:09:49 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_deep_flatten} 1
dead 6412374 2021-09-28 22:20:42 2021-09-29 00:00:49 2021-09-29 00:09:18 0:08:29 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
Failure Reason:

SSH connection to smithi058 was lost: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master'

pass 6412375 2021-09-28 22:20:44 2021-09-29 00:01:19 2021-09-29 00:43:14 0:41:55 0:28:08 0:13:47 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} 3
fail 6412376 2021-09-28 22:20:45 2021-09-29 00:02:00 2021-09-29 00:09:18 0:07:18 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} 3
Failure Reason:

Command failed on smithi037 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master'

pass 6412377 2021-09-28 22:20:46 2021-09-29 00:02:10 2021-09-29 00:24:55 0:22:45 0:09:54 0:12:51 smithi master ubuntu 20.04 krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
pass 6412378 2021-09-28 22:20:47 2021-09-29 00:03:20 2021-09-29 00:39:03 0:35:43 0:20:52 0:14:51 smithi master ubuntu 20.04 krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
pass 6412379 2021-09-28 22:20:48 2021-09-29 00:03:21 2021-09-29 00:28:40 0:25:19 0:11:39 0:13:40 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6412380 2021-09-28 22:20:49 2021-09-29 00:05:02 2021-09-29 00:38:00 0:32:58 0:19:24 0:13:34 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6412381 2021-09-28 22:20:50 2021-09-29 00:06:43 2021-09-29 00:32:33 0:25:50 0:11:19 0:14:31 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_fallocate} 3
dead 6412382 2021-09-28 22:20:51 2021-09-29 00:08:24 2021-09-29 00:18:53 0:10:29 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} 3
Failure Reason:

SSH connection to smithi058 was lost: 'sudo lsb_release -is'

dead 6412383 2021-09-28 22:20:52 2021-09-29 00:09:24 2021-09-29 00:17:49 0:08:25 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

SSH connection to smithi037 was lost: 'rm -f /tmp/linux-image.deb && echo linux-image-5.15.0-rc2-ceph-g252e7632c17c_5.15.0-rc2-ceph-g252e7632c17c-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/wip-rxbounce/252e7632c17cf8c47a8c1197b07ad2edfa8bd851/ubuntu/focal/flavors/default/pool/main/l/linux-5.15.0-rc2-ceph-g252e7632c17c/ --input-file=-'

fail 6412384 2021-09-28 22:20:53 2021-09-29 00:09:35 2021-09-29 00:42:37 0:33:02 0:19:13 0:13:49 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
Failure Reason:

"2021-09-29T00:30:14.034501+0000 mon.a (mon.0) 194 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6412385 2021-09-28 22:20:54 2021-09-29 00:11:05 2021-09-29 00:17:46 0:06:41 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} 1
Failure Reason:

Command failed on smithi037 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master'

pass 6412386 2021-09-28 22:20:55 2021-09-29 00:11:05 2021-09-29 00:40:49 0:29:44 0:16:23 0:13:21 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6412387 2021-09-28 22:20:56 2021-09-29 00:11:16 2021-09-29 00:37:11 0:25:55 0:12:05 0:13:50 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_namespaces} 3
pass 6412388 2021-09-28 22:20:58 2021-09-29 00:11:46 2021-09-29 01:48:27 1:36:41 1:22:26 0:14:15 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
fail 6412389 2021-09-28 22:20:59 2021-09-29 00:12:57 2021-09-29 00:46:59 0:34:02 0:19:11 0:14:51 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} 3
Failure Reason:

"2021-09-29T00:33:53.801687+0000 mon.a (mon.0) 112 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6412390 2021-09-28 22:21:00 2021-09-29 00:13:29 2021-09-29 00:47:46 0:34:17 0:19:42 0:14:35 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2021-09-29T00:35:28.781863+0000 mon.a (mon.0) 201 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6412391 2021-09-28 22:21:01 2021-09-29 00:13:29 2021-09-29 00:39:20 0:25:51 0:12:07 0:13:44 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6412392 2021-09-28 22:21:02 2021-09-29 00:13:40 2021-09-29 00:40:03 0:26:23 0:11:52 0:14:31 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netns} 3
pass 6412393 2021-09-28 22:21:03 2021-09-29 00:14:00 2021-09-29 00:33:23 0:19:23 0:09:06 0:10:17 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_huge_image} 1
pass 6412394 2021-09-28 22:21:04 2021-09-29 00:14:00 2021-09-29 00:47:44 0:33:44 0:21:07 0:12:37 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6412395 2021-09-28 22:21:05 2021-09-29 00:14:31 2021-09-29 01:39:10 1:24:39 1:09:28 0:15:11 smithi master ubuntu 20.04 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6412396 2021-09-28 22:21:06 2021-09-29 00:14:51 2021-09-29 00:40:24 0:25:33 0:12:41 0:12:52 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6412397 2021-09-28 22:21:07 2021-09-29 00:15:03 2021-09-29 00:40:23 0:25:20 0:11:48 0:13:32 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6412398 2021-09-28 22:21:08 2021-09-29 00:15:03 2021-09-29 00:45:43 0:30:40 0:16:04 0:14:36 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_concurrent} 3
pass 6412399 2021-09-28 22:21:09 2021-09-29 00:16:13 2021-09-29 00:40:00 0:23:47 0:10:45 0:13:02 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6412400 2021-09-28 22:21:10 2021-09-29 00:16:34 2021-09-29 00:49:18 0:32:44 0:19:10 0:13:34 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6412401 2021-09-28 22:21:11 2021-09-29 00:17:34 2021-09-29 00:41:15 0:23:41 0:11:02 0:12:39 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
pass 6412402 2021-09-28 22:21:12 2021-09-29 00:18:54 2021-09-29 00:35:19 0:16:25 0:08:44 0:07:41 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_modprobe} 1
pass 6412403 2021-09-28 22:21:13 2021-09-29 00:18:54 2021-09-29 00:50:54 0:32:00 0:18:05 0:13:55 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6412404 2021-09-28 22:21:14 2021-09-29 00:18:55 2021-09-29 00:42:46 0:23:51 0:10:37 0:13:14 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_kernel} 3
fail 6412405 2021-09-28 22:21:15 2021-09-29 00:19:05 2021-09-29 00:54:44 0:35:39 0:19:40 0:15:59 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2021-09-29T00:52:12.622019+0000 mon.a (mon.0) 224 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412406 2021-09-28 22:21:16 2021-09-29 00:19:45 2021-09-29 00:43:35 0:23:50 0:10:17 0:13:33 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6412407 2021-09-28 22:21:17 2021-09-29 00:20:07 2021-09-29 00:50:56 0:30:49 0:16:22 0:14:27 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} 3
pass 6412408 2021-09-28 22:21:18 2021-09-29 00:20:58 2021-09-29 00:45:37 0:24:39 0:11:50 0:12:49 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6412409 2021-09-28 22:21:19 2021-09-29 00:21:38 2021-09-29 00:59:34 0:37:56 0:25:16 0:12:40 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_simple_big} 3
pass 6412410 2021-09-28 22:21:20 2021-09-29 00:21:39 2021-09-29 00:44:04 0:22:25 0:09:13 0:13:12 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} 1
fail 6412411 2021-09-28 22:21:22 2021-09-29 00:24:49 2021-09-29 00:56:42 0:31:53 0:18:21 0:13:32 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

"2021-09-29T00:45:25.834427+0000 mon.a (mon.0) 116 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6412412 2021-09-28 22:21:23 2021-09-29 00:25:00 2021-09-29 00:59:10 0:34:10 0:19:12 0:14:58 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

"2021-09-29T00:56:30.729737+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6412413 2021-09-28 22:21:24 2021-09-29 00:25:50 2021-09-29 00:58:53 0:33:03 0:19:38 0:13:25 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_data_pool} 3
Failure Reason:

"2021-09-29T00:56:37.684979+0000 mon.a (mon.0) 281 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412414 2021-09-28 22:21:25 2021-09-29 00:26:11 2021-09-29 00:52:23 0:26:12 0:11:22 0:14:50 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6412415 2021-09-28 22:21:26 2021-09-29 00:26:51 2021-09-29 00:58:18 0:31:27 0:18:59 0:12:28 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6412416 2021-09-28 22:21:27 2021-09-29 00:27:02 2021-09-29 00:54:21 0:27:19 0:11:33 0:15:46 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_fallocate} 3
pass 6412417 2021-09-28 22:21:28 2021-09-29 00:28:42 2021-09-29 00:56:06 0:27:24 0:11:54 0:15:30 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6412418 2021-09-28 22:21:29 2021-09-29 00:30:43 2021-09-29 01:28:57 0:58:14 0:39:13 0:19:01 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6412419 2021-09-28 22:21:30 2021-09-29 00:31:54 2021-09-29 01:00:48 0:28:54 0:14:04 0:14:50 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6412420 2021-09-28 22:21:31 2021-09-29 00:32:34 2021-09-29 00:51:59 0:19:25 0:09:18 0:10:07 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_parent_overlap} 1
pass 6412421 2021-09-28 22:21:32 2021-09-29 00:32:35 2021-09-29 01:04:13 0:31:38 0:15:16 0:16:22 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6412422 2021-09-28 22:21:33 2021-09-29 00:36:46 2021-09-29 01:28:43 0:51:57 0:40:20 0:11:37 smithi master ubuntu 20.04 krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 6412423 2021-09-28 22:21:34 2021-09-29 00:37:16 2021-09-29 01:01:34 0:24:18 0:11:23 0:12:55 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_namespaces} 3
pass 6412424 2021-09-28 22:21:35 2021-09-29 00:38:07 2021-09-29 02:08:45 1:30:38 1:16:19 0:14:19 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6412425 2021-09-28 22:21:36 2021-09-29 00:39:07 2021-09-29 01:30:22 0:51:15 0:39:32 0:11:43 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_enumerate} 3
fail 6412426 2021-09-28 22:21:37 2021-09-29 00:39:07 2021-09-29 01:13:11 0:34:04 0:19:32 0:14:32 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2021-09-29T01:11:44.178149+0000 mon.a (mon.0) 291 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412427 2021-09-28 22:21:39 2021-09-29 00:39:28 2021-09-29 01:07:45 0:28:17 0:13:32 0:14:45 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6412428 2021-09-28 22:21:40 2021-09-29 00:39:58 2021-09-29 01:08:02 0:28:04 0:12:34 0:15:30 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netns} 3
pass 6412429 2021-09-28 22:21:41 2021-09-29 00:40:09 2021-09-29 00:59:26 0:19:17 0:09:04 0:10:13 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_read_only} 1
pass 6412430 2021-09-28 22:21:42 2021-09-29 00:40:09 2021-09-29 01:19:42 0:39:33 0:24:31 0:15:02 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6412431 2021-09-28 22:21:43 2021-09-29 00:40:09 2021-09-29 01:08:01 0:27:52 0:12:48 0:15:04 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6412432 2021-09-28 22:21:44 2021-09-29 00:40:30 2021-09-29 01:03:57 0:23:27 0:11:01 0:12:26 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6412433 2021-09-28 22:21:45 2021-09-29 00:40:31 2021-09-29 01:14:22 0:33:51 0:19:34 0:14:17 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

"2021-09-29T01:12:26.763789+0000 mon.a (mon.0) 241 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412434 2021-09-28 22:21:46 2021-09-29 00:40:51 2021-09-29 01:07:09 0:26:18 0:11:51 0:14:27 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_huge_tickets} 3
fail 6412435 2021-09-28 22:21:47 2021-09-29 00:40:51 2021-09-29 01:14:47 0:33:56 0:20:18 0:13:38 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2021-09-29T01:03:07.285359+0000 mon.a (mon.0) 144 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6412436 2021-09-28 22:21:48 2021-09-29 00:41:22 2021-09-29 01:08:01 0:26:39 0:11:36 0:15:03 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_image_read} 3
pass 6412437 2021-09-28 22:21:49 2021-09-29 00:42:42 2021-09-29 01:04:36 0:21:54 0:09:46 0:12:08 smithi master ubuntu 20.04 krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} 1
fail 6412438 2021-09-28 22:21:50 2021-09-29 00:42:53 2021-09-29 01:16:45 0:33:52 0:19:36 0:14:16 smithi master ubuntu 20.04 krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2021-09-29T01:14:19.638482+0000 mon.a (mon.0) 296 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6412439 2021-09-28 22:21:51 2021-09-29 00:43:23 2021-09-29 01:07:21 0:23:58 0:11:01 0:12:57 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} 3
pass 6412440 2021-09-28 22:21:52 2021-09-29 00:43:43 2021-09-29 01:13:42 0:29:59 0:16:19 0:13:40 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
fail 6412441 2021-09-28 22:21:53 2021-09-29 00:44:14 2021-09-29 01:16:36 0:32:22 0:19:41 0:12:41 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2021-09-29T01:15:33.600497+0000 mon.a (mon.0) 227 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6412442 2021-09-28 22:21:54 2021-09-29 00:44:54 2021-09-29 01:13:14 0:28:20 0:15:25 0:12:55 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_unmap} 3
pass 6412443 2021-09-28 22:21:55 2021-09-29 00:45:45 2021-09-29 01:12:00 0:26:15 0:12:34 0:13:41 smithi master ubuntu 20.04 krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6412444 2021-09-28 22:21:56 2021-09-29 00:45:45 2021-09-29 01:26:23 0:40:38 0:27:44 0:12:54 smithi master ubuntu 20.04 krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} 3