Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6743993 2022-03-18 03:20:40 2022-03-29 11:43:46 2022-03-29 12:02:55 0:19:09 0:10:08 0:09:01 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_deep_flatten} 1
pass 6743994 2022-03-18 03:20:41 2022-03-29 11:43:47 2022-03-29 12:13:40 0:29:53 0:19:16 0:10:37 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6743995 2022-03-18 03:20:42 2022-03-29 11:44:07 2022-03-29 12:06:55 0:22:48 0:10:48 0:12:00 smithi master krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_default_map_options} 3
pass 6743996 2022-03-18 03:20:43 2022-03-29 11:45:18 2022-03-29 12:26:21 0:41:03 0:28:52 0:12:11 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_fio} 3
pass 6743997 2022-03-18 03:20:43 2022-03-29 11:46:48 2022-03-29 12:17:09 0:30:21 0:19:02 0:11:19 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_data_pool} 3
fail 6743998 2022-03-18 03:20:44 2022-03-29 11:46:59 2022-03-29 16:30:50 4:43:51 4:30:14 0:13:37 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{legacy} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi159 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludek4s3iw3m -r -- '-g auto -g blockdev -x clone'"

pass 6743999 2022-03-18 03:20:45 2022-03-29 11:48:49 2022-03-29 12:38:53 0:50:04 0:38:09 0:11:55 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_fio} 3
fail 6744000 2022-03-18 03:20:46 2022-03-29 11:49:20 2022-03-29 11:59:15 0:09:55 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major

pass 6744001 2022-03-18 03:20:47 2022-03-29 11:51:10 2022-03-29 12:11:13 0:20:03 0:09:22 0:10:41 smithi master krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} 1
fail 6744002 2022-03-18 03:20:47 2022-03-29 11:51:51 2022-03-29 12:21:21 0:29:30 0:19:37 0:09:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2022-03-29T12:19:51.497972+0000 mon.a (mon.0) 216 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6744003 2022-03-18 03:20:48 2022-03-29 11:52:01 2022-03-29 12:22:16 0:30:15 0:19:51 0:10:24 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2022-03-29T12:20:53.434328+0000 mon.a (mon.0) 275 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744004 2022-03-18 03:20:49 2022-03-29 11:52:41 2022-03-29 12:18:38 0:25:57 0:12:11 0:13:46 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} 3
pass 6744005 2022-03-18 03:20:50 2022-03-29 11:54:22 2022-03-29 12:18:07 0:23:45 0:11:51 0:11:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6744006 2022-03-18 03:20:51 2022-03-29 11:54:43 2022-03-29 12:44:24 0:49:41 0:37:40 0:12:01 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6744007 2022-03-18 03:20:51 2022-03-29 11:54:43 2022-03-29 12:22:35 0:27:52 0:14:18 0:13:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6744008 2022-03-18 03:20:52 2022-03-29 11:56:24 2022-03-29 12:15:45 0:19:21 0:10:19 0:09:02 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_discard} 1
pass 6744009 2022-03-18 03:20:53 2022-03-29 11:56:24 2022-03-29 12:26:42 0:30:18 0:18:21 0:11:57 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6744010 2022-03-18 03:20:54 2022-03-29 11:56:34 2022-03-29 12:20:11 0:23:37 0:12:33 0:11:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} 3
pass 6744011 2022-03-18 03:20:54 2022-03-29 11:56:55 2022-03-29 13:37:12 1:40:17 1:27:42 0:12:35 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6744012 2022-03-18 03:20:55 2022-03-29 11:57:25 2022-03-29 12:46:13 0:48:48 0:38:09 0:10:39 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6744013 2022-03-18 03:20:56 2022-03-29 11:58:36 2022-03-29 12:24:22 0:25:46 0:15:32 0:10:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6744014 2022-03-18 03:20:57 2022-03-29 11:59:06 2022-03-29 12:25:05 0:25:59 0:12:18 0:13:41 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6744015 2022-03-18 03:20:58 2022-03-29 12:01:07 2022-03-29 12:26:18 0:25:11 0:12:15 0:12:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} 3
pass 6744016 2022-03-18 03:20:58 2022-03-29 12:02:47 2022-03-29 12:23:56 0:21:09 0:10:10 0:10:59 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} 1
pass 6744017 2022-03-18 03:20:59 2022-03-29 12:02:57 2022-03-29 12:37:32 0:34:35 0:21:40 0:12:55 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6744018 2022-03-18 03:21:00 2022-03-29 12:05:28 2022-03-29 12:32:38 0:27:10 0:13:22 0:13:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_symlinks} 3
fail 6744019 2022-03-18 03:21:01 2022-03-29 12:06:29 2022-03-29 12:38:28 0:31:59 0:19:42 0:12:17 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

"2022-03-29T12:35:52.985504+0000 mon.a (mon.0) 292 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744020 2022-03-18 03:21:01 2022-03-29 12:06:49 2022-03-29 12:35:06 0:28:17 0:17:11 0:11:06 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_concurrent} 3
fail 6744021 2022-03-18 03:21:02 2022-03-29 12:06:59 2022-03-29 12:40:43 0:33:44 0:20:30 0:13:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} 3
Failure Reason:

"2022-03-29T12:38:04.717885+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744022 2022-03-18 03:21:03 2022-03-29 12:09:00 2022-03-29 12:43:32 0:34:32 0:20:20 0:14:12 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6744023 2022-03-18 03:21:04 2022-03-29 12:11:21 2022-03-29 12:37:16 0:25:55 0:11:34 0:14:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_image_read} 3
pass 6744024 2022-03-18 03:21:05 2022-03-29 12:13:41 2022-03-29 12:37:32 0:23:51 0:09:56 0:13:55 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_modprobe} 1
pass 6744025 2022-03-18 03:21:06 2022-03-29 12:13:42 2022-03-29 12:41:25 0:27:43 0:15:34 0:12:09 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6744026 2022-03-18 03:21:06 2022-03-29 12:13:52 2022-03-29 13:45:25 1:31:33 1:15:42 0:15:51 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
fail 6744027 2022-03-18 03:21:07 2022-03-29 12:15:53 2022-03-29 12:53:29 0:37:36 0:20:06 0:17:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

"2022-03-29T12:50:49.456006+0000 mon.a (mon.0) 311 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6744028 2022-03-18 03:21:08 2022-03-29 12:17:13 2022-03-29 12:51:36 0:34:23 0:19:46 0:14:37 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2022-03-29T12:50:10.916511+0000 mon.a (mon.0) 292 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744029 2022-03-18 03:21:09 2022-03-29 12:18:14 2022-03-29 12:44:54 0:26:40 0:11:23 0:15:17 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
fail 6744030 2022-03-18 03:21:10 2022-03-29 12:18:44 2022-03-29 12:54:28 0:35:44 0:19:53 0:15:51 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_map_unmap} 3
Failure Reason:

"2022-03-29T12:51:28.307362+0000 mon.a (mon.0) 259 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6744031 2022-03-18 03:21:10 2022-03-29 12:19:05 2022-03-29 12:46:35 0:27:30 0:12:29 0:15:01 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
fail 6744032 2022-03-18 03:21:11 2022-03-29 12:19:05 2022-03-29 12:55:46 0:36:41 0:20:07 0:16:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_simple_big} 3
Failure Reason:

"2022-03-29T12:52:40.942645+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744033 2022-03-18 03:21:12 2022-03-29 12:20:16 2022-03-29 12:44:29 0:24:13 0:09:30 0:14:43 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_msgr_segments} 1
pass 6744034 2022-03-18 03:21:13 2022-03-29 12:21:26 2022-03-29 13:01:28 0:40:02 0:24:42 0:15:20 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6744035 2022-03-18 03:21:13 2022-03-29 12:22:07 2022-03-29 13:06:33 0:44:26 0:28:34 0:15:52 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
fail 6744036 2022-03-18 03:21:14 2022-03-29 12:22:17 2022-03-29 12:57:44 0:35:27 0:19:46 0:15:41 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} 3
Failure Reason:

"2022-03-29T12:44:30.886905+0000 mon.a (mon.0) 116 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6744037 2022-03-18 03:21:15 2022-03-29 12:22:17 2022-03-29 12:50:56 0:28:39 0:12:05 0:16:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6744038 2022-03-18 03:21:16 2022-03-29 12:22:38 2022-03-29 12:58:02 0:35:24 0:19:01 0:16:23 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
fail 6744039 2022-03-18 03:21:17 2022-03-29 12:24:29 2022-03-29 12:59:22 0:34:53 0:19:34 0:15:19 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

"2022-03-29T12:57:21.192641+0000 mon.a (mon.0) 250 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744040 2022-03-18 03:21:17 2022-03-29 12:25:09 2022-03-29 12:52:39 0:27:30 0:11:54 0:15:36 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6744041 2022-03-18 03:21:18 2022-03-29 12:26:20 2022-03-29 13:20:07 0:53:47 0:38:52 0:14:55 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
fail 6744042 2022-03-18 03:21:19 2022-03-29 12:26:30 2022-03-29 13:00:46 0:34:16 0:20:24 0:13:52 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
Failure Reason:

"2022-03-29T12:48:24.089162+0000 mon.a (mon.0) 154 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6744043 2022-03-18 03:21:20 2022-03-29 12:26:50 2022-03-29 12:52:00 0:25:10 0:10:49 0:14:21 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} 1
pass 6744044 2022-03-18 03:21:21 2022-03-29 12:26:51 2022-03-29 12:58:50 0:31:59 0:18:29 0:13:30 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6744045 2022-03-18 03:21:21 2022-03-29 12:27:11 2022-03-29 12:56:54 0:29:43 0:12:00 0:17:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_namespaces} 3
pass 6744046 2022-03-18 03:21:22 2022-03-29 12:32:42 2022-03-29 13:58:40 1:25:58 1:14:07 0:11:51 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6744047 2022-03-18 03:21:23 2022-03-29 12:33:13 2022-03-29 13:26:52 0:53:39 0:40:36 0:13:03 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6744048 2022-03-18 03:21:24 2022-03-29 12:35:13 2022-03-29 13:05:00 0:29:47 0:15:43 0:14:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6744049 2022-03-18 03:21:25 2022-03-29 12:37:24 2022-03-29 13:03:45 0:26:21 0:13:19 0:13:02 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
fail 6744050 2022-03-18 03:21:26 2022-03-29 12:37:35 2022-03-29 13:11:33 0:33:58 0:19:51 0:14:07 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

"2022-03-29T12:58:09.395665+0000 mon.a (mon.0) 116 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6744051 2022-03-18 03:21:26 2022-03-29 12:37:35 2022-03-29 12:59:42 0:22:07 0:09:56 0:12:11 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_read_only} 1
pass 6744052 2022-03-18 03:21:27 2022-03-29 12:38:35 2022-03-29 13:08:32 0:29:57 0:18:25 0:11:32 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6744053 2022-03-18 03:21:28 2022-03-29 12:38:56 2022-03-29 13:31:32 0:52:36 0:39:50 0:12:46 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
pass 6744054 2022-03-18 03:21:29 2022-03-29 12:39:46 2022-03-29 13:04:18 0:24:32 0:11:57 0:12:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6744055 2022-03-18 03:21:30 2022-03-29 12:40:47 2022-03-29 13:02:11 0:21:24 0:11:08 0:10:16 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6744056 2022-03-18 03:21:30 2022-03-29 12:40:47 2022-03-29 16:37:24 3:56:37 3:44:54 0:11:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

Command failed (workunit test rbd/concurrent.sh) on smithi189 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=27f5c9b2c60950ed271953872565cbef096d9090 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh'

pass 6744057 2022-03-18 03:21:31 2022-03-29 12:41:28 2022-03-29 13:05:01 0:23:33 0:11:01 0:12:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6744058 2022-03-18 03:21:32 2022-03-29 12:43:38 2022-03-29 13:16:14 0:32:36 0:21:20 0:11:16 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6744059 2022-03-18 03:21:33 2022-03-29 12:44:29 2022-03-29 13:09:12 0:24:43 0:11:32 0:13:11 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} 3
pass 6744060 2022-03-18 03:21:34 2022-03-29 12:44:59 2022-03-29 13:04:15 0:19:16 0:09:48 0:09:28 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_whole_object_zeroout} 1
pass 6744061 2022-03-18 03:21:34 2022-03-29 12:44:59 2022-03-29 13:17:59 0:33:00 0:18:58 0:14:02 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6744062 2022-03-18 03:21:35 2022-03-29 12:46:20 2022-03-29 13:08:06 0:21:46 0:10:41 0:11:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_kernel} 3
pass 6744063 2022-03-18 03:21:36 2022-03-29 12:46:40 2022-03-29 13:19:28 0:32:48 0:16:54 0:15:54 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6744064 2022-03-18 03:21:37 2022-03-29 12:51:01 2022-03-29 13:12:56 0:21:55 0:10:37 0:11:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6744065 2022-03-18 03:21:37 2022-03-29 12:51:42 2022-03-29 13:20:20 0:28:38 0:15:52 0:12:46 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} 3
fail 6744066 2022-03-18 03:21:38 2022-03-29 12:52:42 2022-03-29 13:24:11 0:31:29 0:19:57 0:11:32 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

"2022-03-29T13:21:29.696871+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6744067 2022-03-18 03:21:39 2022-03-29 12:52:53 2022-03-29 13:23:29 0:30:36 0:19:42 0:10:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_simple_big} 3
Failure Reason:

"2022-03-29T13:22:05.440470+0000 mon.a (mon.0) 316 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744068 2022-03-18 03:21:40 2022-03-29 12:53:33 2022-03-29 13:15:44 0:22:11 0:09:58 0:12:13 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} 1
pass 6744069 2022-03-18 03:21:41 2022-03-29 12:54:33 2022-03-29 13:29:09 0:34:36 0:22:42 0:11:54 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6744070 2022-03-18 03:21:42 2022-03-29 12:55:54 2022-03-29 13:39:18 0:43:24 0:28:57 0:14:27 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_fio} 3
pass 6744071 2022-03-18 03:21:42 2022-03-29 12:57:11 2022-03-29 13:29:14 0:32:03 0:18:51 0:13:12 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_data_pool} 3
pass 6744072 2022-03-18 03:21:43 2022-03-29 12:57:52 2022-03-29 13:19:09 0:21:17 0:09:28 0:11:49 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
pass 6744073 2022-03-18 03:21:44 2022-03-29 12:57:52 2022-03-29 13:33:37 0:35:45 0:22:03 0:13:42 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
pass 6744074 2022-03-18 03:21:45 2022-03-29 12:58:12 2022-03-29 13:22:33 0:24:21 0:12:29 0:11:52 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6744075 2022-03-18 03:21:46 2022-03-29 12:58:53 2022-03-29 13:31:24 0:32:31 0:20:07 0:12:24 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6744076 2022-03-18 03:21:46 2022-03-29 12:59:24 2022-03-29 13:23:50 0:24:26 0:11:52 0:12:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_fallocate} 3
pass 6744077 2022-03-18 03:21:47 2022-03-29 13:00:25 2022-03-29 13:24:51 0:24:26 0:12:21 0:12:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6744078 2022-03-18 03:21:48 2022-03-29 13:00:55 2022-03-29 13:49:00 0:48:05 0:37:35 0:10:30 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
fail 6744079 2022-03-18 03:21:49 2022-03-29 13:01:36 2022-03-29 13:33:53 0:32:17 0:19:32 0:12:45 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
Failure Reason:

"2022-03-29T13:31:17.139440+0000 mon.a (mon.0) 197 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744080 2022-03-18 03:21:49 2022-03-29 13:02:16 2022-03-29 13:23:37 0:21:21 0:09:46 0:11:35 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_discard} 1
pass 6744081 2022-03-18 03:21:50 2022-03-29 13:03:46 2022-03-29 13:34:24 0:30:38 0:18:45 0:11:53 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6744082 2022-03-18 03:21:51 2022-03-29 13:04:17 2022-03-29 14:36:14 1:31:57 1:19:54 0:12:03 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6744083 2022-03-18 03:21:52 2022-03-29 13:04:27 2022-03-29 13:28:33 0:24:06 0:12:46 0:11:20 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_namespaces} 3
pass 6744084 2022-03-18 03:21:53 2022-03-29 13:05:08 2022-03-29 14:40:50 1:35:42 1:25:10 0:10:32 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
dead 6744085 2022-03-18 03:21:54 2022-03-29 13:05:08 2022-03-29 13:20:59 0:15:51 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_enumerate} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

fail 6744086 2022-03-18 03:21:54 2022-03-29 13:05:48 2022-03-29 13:38:50 0:33:02 0:19:46 0:13:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2022-03-29T13:35:59.558117+0000 mon.a (mon.0) 242 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744087 2022-03-18 03:21:55 2022-03-29 13:06:39 2022-03-29 13:31:40 0:25:01 0:12:25 0:12:36 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6744088 2022-03-18 03:21:56 2022-03-29 13:08:09 2022-03-29 13:32:18 0:24:09 0:12:04 0:12:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_netns} 3
pass 6744089 2022-03-18 03:21:57 2022-03-29 13:08:40 2022-03-29 13:30:57 0:22:17 0:10:19 0:11:58 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_huge_image} 1
pass 6744090 2022-03-18 03:21:58 2022-03-29 13:09:20 2022-03-29 13:47:26 0:38:06 0:24:06 0:14:00 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6744091 2022-03-18 03:21:58 2022-03-29 13:11:41 2022-03-29 13:36:25 0:24:44 0:13:11 0:11:33 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6744092 2022-03-18 03:21:59 2022-03-29 13:13:01 2022-03-29 13:40:12 0:27:11 0:12:08 0:15:03 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6744093 2022-03-18 03:22:00 2022-03-29 13:15:52 2022-03-29 13:44:05 0:28:13 0:16:24 0:11:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
pass 6744094 2022-03-18 03:22:01 2022-03-29 13:16:23 2022-03-29 13:39:44 0:23:21 0:11:39 0:11:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6744095 2022-03-18 03:22:02 2022-03-29 13:18:03 2022-03-29 13:51:48 0:33:45 0:19:54 0:13:51 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6744096 2022-03-18 03:22:02 2022-03-29 13:19:34 2022-03-29 13:43:47 0:24:13 0:11:49 0:12:24 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_image_read} 3
pass 6744097 2022-03-18 03:22:03 2022-03-29 13:20:14 2022-03-29 13:41:43 0:21:29 0:09:54 0:11:35 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} 1
fail 6744098 2022-03-18 03:22:04 2022-03-29 13:20:15 2022-03-29 13:54:04 0:33:49 0:20:30 0:13:19 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2022-03-29T13:41:19.007205+0000 mon.a (mon.0) 180 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6744099 2022-03-18 03:22:05 2022-03-29 13:20:25 2022-03-29 13:46:00 0:25:35 0:12:26 0:13:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} 3
pass 6744100 2022-03-18 03:22:06 2022-03-29 13:20:35 2022-03-29 13:52:20 0:31:45 0:18:59 0:12:46 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
fail 6744101 2022-03-18 03:22:06 2022-03-29 13:21:16 2022-03-29 13:54:12 0:32:56 0:19:44 0:13:12 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2022-03-29T13:41:37.740539+0000 mon.a (mon.0) 118 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6744102 2022-03-18 03:22:07 2022-03-29 13:22:36 2022-03-29 13:51:31 0:28:55 0:16:24 0:12:31 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_map_unmap} 3
pass 6744103 2022-03-18 03:22:08 2022-03-29 13:23:37 2022-03-29 13:47:16 0:23:39 0:12:21 0:11:18 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6744104 2022-03-18 03:22:09 2022-03-29 13:23:47 2022-03-29 14:01:27 0:37:40 0:25:48 0:11:52 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} 3
pass 6744105 2022-03-18 03:22:10 2022-03-29 13:23:58 2022-03-29 13:45:15 0:21:17 0:10:56 0:10:21 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_msgr_segments} 1
pass 6744106 2022-03-18 03:22:11 2022-03-29 13:25:14 2022-03-29 14:02:34 0:37:20 0:23:12 0:14:08 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6744107 2022-03-18 03:22:11 2022-03-29 13:26:54 2022-03-29 13:54:03 0:27:09 0:11:45 0:15:24 smithi master krbd/ms_modeless/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_rxbounce} 3
pass 6744108 2022-03-18 03:22:12 2022-03-29 13:28:35 2022-03-29 14:12:58 0:44:23 0:27:52 0:16:31 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_fio} 3
pass 6744109 2022-03-18 03:22:13 2022-03-29 13:29:15 2022-03-29 14:06:43 0:37:28 0:23:17 0:14:11 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_data_pool} 3
fail 6744110 2022-03-18 03:22:14 2022-03-29 13:29:16 2022-03-29 18:46:02 5:16:46 4:58:08 0:18:38 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi204 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excluden9d_maja -r -- '-g auto -g blockdev -x clone'"

pass 6744111 2022-03-18 03:22:15 2022-03-29 13:31:26 2022-03-29 15:09:27 1:38:01 1:23:15 0:14:46 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6744112 2022-03-18 03:22:15 2022-03-29 13:31:37 2022-03-29 13:59:11 0:27:34 0:12:24 0:15:10 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6744113 2022-03-18 03:22:16 2022-03-29 13:31:47 2022-03-29 14:07:55 0:36:08 0:19:28 0:16:40 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6744114 2022-03-18 03:22:17 2022-03-29 13:32:28 2022-03-29 14:01:04 0:28:36 0:12:27 0:16:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} 3
pass 6744115 2022-03-18 03:22:18 2022-03-29 13:33:38 2022-03-29 13:59:27 0:25:49 0:12:15 0:13:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6744116 2022-03-18 03:22:19 2022-03-29 13:33:59 2022-03-29 14:26:39 0:52:40 0:38:45 0:13:55 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6744117 2022-03-18 03:22:19 2022-03-29 13:34:29 2022-03-29 14:03:59 0:29:30 0:15:53 0:13:37 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6744118 2022-03-18 03:22:20 2022-03-29 13:36:30 2022-03-29 13:59:33 0:23:03 0:10:20 0:12:43 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_parent_overlap} 1
dead 6744119 2022-03-18 03:22:21 2022-03-29 13:36:30 2022-03-29 14:44:13 1:07:43 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
Failure Reason:

Error reimaging machines: Timeout opening channel.

pass 6744120 2022-03-18 03:22:22 2022-03-29 13:37:20 2022-03-29 14:03:01 0:25:41 0:12:05 0:13:36 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} 3
pass 6744121 2022-03-18 03:22:23 2022-03-29 13:39:01 2022-03-29 15:05:33 1:26:32 1:13:08 0:13:24 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
fail 6744122 2022-03-18 03:22:23 2022-03-29 13:39:21 2022-03-29 14:11:35 0:32:14 0:19:37 0:12:37 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_enumerate} 3
Failure Reason:

"2022-03-29T13:58:06.186538+0000 mon.a (mon.0) 187 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6744123 2022-03-18 03:22:24 2022-03-29 13:39:52 2022-03-29 14:06:27 0:26:35 0:15:31 0:11:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6744124 2022-03-18 03:22:25 2022-03-29 13:40:22 2022-03-29 14:07:26 0:27:04 0:13:55 0:13:09 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6744125 2022-03-18 03:22:26 2022-03-29 13:43:53 2022-03-29 14:07:54 0:24:01 0:11:59 0:12:02 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} 3
pass 6744126 2022-03-18 03:22:26 2022-03-29 13:44:13 2022-03-29 14:03:42 0:19:29 0:09:48 0:09:41 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} 1
pass 6744127 2022-03-18 03:22:27 2022-03-29 13:44:13 2022-03-29 14:25:04 0:40:51 0:27:23 0:13:28 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
fail 6744128 2022-03-18 03:22:28 2022-03-29 13:45:34 2022-03-29 14:19:32 0:33:58 0:19:42 0:14:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_symlinks} 3
Failure Reason:

"2022-03-29T14:16:29.784524+0000 mon.a (mon.0) 181 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744129 2022-03-18 03:22:29 2022-03-29 13:46:04 2022-03-29 14:10:56 0:24:52 0:11:08 0:13:44 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6744130 2022-03-18 03:22:30 2022-03-29 13:47:25 2022-03-29 14:17:29 0:30:04 0:16:41 0:13:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_concurrent} 3
pass 6744131 2022-03-18 03:22:30 2022-03-29 13:47:35 2022-03-29 14:11:31 0:23:56 0:11:03 0:12:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} 3
fail 6744132 2022-03-18 03:22:31 2022-03-29 13:48:16 2022-03-29 14:22:24 0:34:08 0:20:06 0:14:02 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2022-03-29T14:19:42.705169+0000 mon.a (mon.0) 309 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744133 2022-03-18 03:22:32 2022-03-29 13:49:06 2022-03-29 14:15:47 0:26:41 0:11:23 0:15:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_image_read} 3
pass 6744134 2022-03-18 03:22:33 2022-03-29 13:51:37 2022-03-29 14:14:09 0:22:32 0:09:45 0:12:47 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_whole_object_zeroout} 1
pass 6744135 2022-03-18 03:22:34 2022-03-29 13:51:57 2022-03-29 14:19:45 0:27:48 0:14:53 0:12:55 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6744136 2022-03-18 03:22:34 2022-03-29 13:52:28 2022-03-29 14:43:46 0:51:18 0:38:45 0:12:33 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
pass 6744137 2022-03-18 03:22:35 2022-03-29 13:52:58 2022-03-29 14:17:36 0:24:38 0:11:20 0:13:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_kernel} 3
pass 6744138 2022-03-18 03:22:36 2022-03-29 13:54:09 2022-03-29 14:21:36 0:27:27 0:16:16 0:11:11 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
fail 6744139 2022-03-18 03:22:37 2022-03-29 13:54:09 2022-03-29 14:25:49 0:31:40 0:20:15 0:11:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2022-03-29T14:24:00.168828+0000 mon.a (mon.0) 222 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744140 2022-03-18 03:22:38 2022-03-29 13:54:19 2022-03-29 14:26:47 0:32:28 0:16:28 0:16:00 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_map_unmap} 3
fail 6744141 2022-03-18 03:22:38 2022-03-29 13:58:50 2022-03-29 14:30:47 0:31:57 0:19:41 0:12:16 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

"2022-03-29T14:17:59.101038+0000 mon.a (mon.0) 111 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6744142 2022-03-18 03:22:39 2022-03-29 13:59:21 2022-03-29 14:31:09 0:31:48 0:19:46 0:12:02 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_simple_big} 3
Failure Reason:

"2022-03-29T14:18:42.250070+0000 mon.a (mon.0) 161 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6744143 2022-03-18 03:22:40 2022-03-29 13:59:31 2022-03-29 14:20:35 0:21:04 0:10:46 0:10:18 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_deep_flatten} 1
pass 6744144 2022-03-18 03:22:41 2022-03-29 13:59:31 2022-03-29 14:38:43 0:39:12 0:26:30 0:12:42 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6744145 2022-03-18 03:22:42 2022-03-29 14:01:12 2022-03-29 14:41:03 0:39:51 0:28:44 0:11:07 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} 3
pass 6744146 2022-03-18 03:22:43 2022-03-29 14:01:32 2022-03-29 14:34:22 0:32:50 0:19:44 0:13:06 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} 3
pass 6744147 2022-03-18 03:22:43 2022-03-29 14:02:43 2022-03-29 14:26:50 0:24:07 0:10:38 0:13:29 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
pass 6744148 2022-03-18 03:22:44 2022-03-29 14:03:03 2022-03-29 14:37:52 0:34:49 0:21:49 0:13:00 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
fail 6744149 2022-03-18 03:22:45 2022-03-29 14:03:44 2022-03-29 14:35:26 0:31:42 0:20:09 0:11:33 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2022-03-29T14:23:29.524134+0000 mon.a (mon.0) 119 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6744150 2022-03-18 03:22:46 2022-03-29 14:04:04 2022-03-29 14:38:50 0:34:46 0:19:44 0:15:02 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6744151 2022-03-18 03:22:47 2022-03-29 14:06:35 2022-03-29 14:28:19 0:21:44 0:11:46 0:09:58 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_fallocate} 3
pass 6744152 2022-03-18 03:22:47 2022-03-29 14:06:45 2022-03-29 14:31:07 0:24:22 0:12:16 0:12:06 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6744153 2022-03-18 03:22:48 2022-03-29 14:07:35 2022-03-29 14:57:36 0:50:01 0:37:35 0:12:26 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6744154 2022-03-18 03:22:49 2022-03-29 14:07:56 2022-03-29 14:33:35 0:25:39 0:14:15 0:11:24 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6744155 2022-03-18 03:22:50 2022-03-29 14:07:56 2022-03-29 14:32:22 0:24:26 0:09:57 0:14:29 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} 1
pass 6744156 2022-03-18 03:22:51 2022-03-29 14:10:59 2022-03-29 14:39:12 0:28:13 0:17:04 0:11:09 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
fail 6744157 2022-03-18 03:22:51 2022-03-29 14:11:39 2022-03-29 14:43:00 0:31:21 0:19:46 0:11:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_namespaces} 3
Failure Reason:

"2022-03-29T14:41:47.317931+0000 mon.a (mon.0) 195 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744158 2022-03-18 03:22:52 2022-03-29 14:11:39 2022-03-29 15:50:38 1:38:59 1:25:11 0:13:48 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6744159 2022-03-18 03:22:53 2022-03-29 14:13:00 2022-03-29 15:04:26 0:51:26 0:38:13 0:13:13 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6744160 2022-03-18 03:22:54 2022-03-29 14:14:10 2022-03-29 14:50:00 0:35:50 0:19:41 0:16:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2022-03-29T14:37:36.665081+0000 mon.a (mon.0) 117 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6744161 2022-03-18 03:22:55 2022-03-29 14:15:51 2022-03-29 14:43:35 0:27:44 0:12:15 0:15:29 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6744162 2022-03-18 03:22:55 2022-03-29 14:17:31 2022-03-29 14:41:29 0:23:58 0:11:31 0:12:27 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_netns} 3
pass 6744163 2022-03-18 03:22:56 2022-03-29 14:17:42 2022-03-29 14:38:30 0:20:48 0:09:15 0:11:33 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_huge_image} 1
pass 6744164 2022-03-18 03:22:57 2022-03-29 14:17:42 2022-03-29 14:52:47 0:35:05 0:21:10 0:13:55 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6744165 2022-03-18 03:22:58 2022-03-29 14:19:33 2022-03-29 15:51:20 1:31:47 1:20:11 0:11:36 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
fail 6744166 2022-03-18 03:22:59 2022-03-29 14:19:53 2022-03-29 14:53:10 0:33:17 0:19:44 0:13:33 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} 3
Failure Reason:

"2022-03-29T14:40:51.145438+0000 mon.a (mon.0) 166 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6744167 2022-03-18 03:22:59 2022-03-29 14:21:44 2022-03-29 14:45:48 0:24:04 0:12:06 0:11:58 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6744168 2022-03-18 03:23:00 2022-03-29 14:22:34 2022-03-29 14:52:29 0:29:55 0:16:08 0:13:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_concurrent} 3
pass 6744169 2022-03-18 03:23:01 2022-03-29 14:25:05 2022-03-29 14:47:18 0:22:13 0:11:08 0:11:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6744170 2022-03-18 03:23:02 2022-03-29 14:25:55 2022-03-29 14:58:56 0:33:01 0:20:05 0:12:56 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6744171 2022-03-18 03:23:03 2022-03-29 14:26:46 2022-03-29 14:48:44 0:21:58 0:11:18 0:10:40 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
pass 6744172 2022-03-18 03:23:03 2022-03-29 14:26:56 2022-03-29 14:46:16 0:19:20 0:09:34 0:09:46 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_modprobe} 1
pass 6744173 2022-03-18 03:23:04 2022-03-29 14:26:56 2022-03-29 14:58:16 0:31:20 0:20:12 0:11:08 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6744174 2022-03-18 03:23:05 2022-03-29 14:26:57 2022-03-29 14:49:56 0:22:59 0:11:43 0:11:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_kernel} 3
pass 6744175 2022-03-18 03:23:06 2022-03-29 14:28:27 2022-03-29 15:00:10 0:31:43 0:19:06 0:12:37 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6744176 2022-03-18 03:23:07 2022-03-29 14:30:58 2022-03-29 14:52:38 0:21:40 0:11:15 0:10:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_map_snapshot_io} 3
fail 6744177 2022-03-18 03:23:08 2022-03-29 14:31:08 2022-03-29 15:02:48 0:31:40 0:19:46 0:11:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} 3
Failure Reason:

"2022-03-29T14:49:20.377407+0000 mon.a (mon.0) 119 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6744178 2022-03-18 03:23:08 2022-03-29 14:31:18 2022-03-29 14:57:24 0:26:06 0:12:50 0:13:16 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6744179 2022-03-18 03:23:09 2022-03-29 14:33:39 2022-03-29 15:10:00 0:36:21 0:23:58 0:12:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_simple_big} 3
pass 6744180 2022-03-18 03:23:10 2022-03-29 14:34:29 2022-03-29 14:55:53 0:21:24 0:10:42 0:10:42 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} 1
pass 6744181 2022-03-18 03:23:11 2022-03-29 14:34:30 2022-03-29 15:14:45 0:40:15 0:26:58 0:13:17 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6744182 2022-03-18 03:23:12 2022-03-29 14:35:30 2022-03-29 15:16:10 0:40:40 0:29:02 0:11:38 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_fio} 3
pass 6744183 2022-03-18 03:23:12 2022-03-29 14:36:21 2022-03-29 15:18:04 0:41:43 0:24:50 0:16:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_data_pool} 3
pass 6744184 2022-03-18 03:23:13 2022-03-29 14:38:01 2022-03-29 15:09:09 0:31:08 0:14:13 0:16:55 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6744185 2022-03-18 03:23:14 2022-03-29 14:38:52 2022-03-29 15:14:22 0:35:30 0:20:28 0:15:02 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
fail 6744186 2022-03-18 03:23:15 2022-03-29 14:38:52 2022-03-29 15:14:57 0:36:05 0:20:34 0:15:31 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

"2022-03-29T15:12:59.054066+0000 mon.a (mon.0) 292 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744187 2022-03-18 03:23:16 2022-03-29 14:39:12 2022-03-29 15:10:32 0:31:20 0:13:16 0:18:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_huge_osdmap} 3
fail 6744188 2022-03-18 03:23:16 2022-03-29 14:40:53 2022-03-29 15:16:35 0:35:42 0:20:36 0:15:06 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

"2022-03-29T15:15:14.481183+0000 mon.a (mon.0) 286 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744189 2022-03-18 03:23:17 2022-03-29 14:41:03 2022-03-29 15:13:18 0:32:15 0:16:05 0:16:10 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6744190 2022-03-18 03:23:18 2022-03-29 14:41:34 2022-03-29 15:06:23 0:24:49 0:10:35 0:14:14 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_parent_overlap} 1
pass 6744191 2022-03-18 03:23:19 2022-03-29 14:41:34 2022-03-29 15:14:20 0:32:46 0:16:46 0:16:00 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6744192 2022-03-18 03:23:20 2022-03-29 14:43:05 2022-03-29 15:39:41 0:56:36 0:41:06 0:15:30 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 6744193 2022-03-18 03:23:20 2022-03-29 14:43:45 2022-03-29 15:12:02 0:28:17 0:12:30 0:15:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_namespaces} 3
pass 6744194 2022-03-18 03:23:21 2022-03-29 14:43:55 2022-03-29 16:14:22 1:30:27 1:15:06 0:15:21 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
fail 6744195 2022-03-18 03:23:22 2022-03-29 14:44:36 2022-03-29 15:21:17 0:36:41 0:20:22 0:16:19 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_enumerate} 3
Failure Reason:

"2022-03-29T15:18:24.439491+0000 mon.a (mon.0) 227 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744196 2022-03-18 03:23:23 2022-03-29 14:45:56 2022-03-29 15:17:05 0:31:09 0:16:05 0:15:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6744197 2022-03-18 03:23:24 2022-03-29 14:47:27 2022-03-29 15:16:30 0:29:03 0:14:36 0:14:27 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6744198 2022-03-18 03:23:25 2022-03-29 14:48:47 2022-03-29 15:15:26 0:26:39 0:11:43 0:14:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_netns} 3
pass 6744199 2022-03-18 03:23:25 2022-03-29 14:49:58 2022-03-29 15:11:14 0:21:16 0:10:04 0:11:12 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_read_only} 1
pass 6744200 2022-03-18 03:23:26 2022-03-29 14:49:58 2022-03-29 15:28:08 0:38:10 0:23:45 0:14:25 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6744201 2022-03-18 03:23:27 2022-03-29 14:50:08 2022-03-29 15:22:18 0:32:10 0:12:42 0:19:28 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6744202 2022-03-18 03:23:28 2022-03-29 14:52:39 2022-03-29 15:22:09 0:29:30 0:11:30 0:18:00 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6744203 2022-03-18 03:23:29 2022-03-29 14:52:39 2022-03-29 18:56:34 4:03:55 3:45:50 0:18:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

Command failed (workunit test rbd/concurrent.sh) on smithi092 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=27f5c9b2c60950ed271953872565cbef096d9090 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh'

pass 6744204 2022-03-18 03:23:29 2022-03-29 14:52:50 2022-03-29 15:22:33 0:29:43 0:11:39 0:18:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6744205 2022-03-18 03:23:30 2022-03-29 14:53:20 2022-03-29 15:33:28 0:40:08 0:21:51 0:18:17 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
fail 6744206 2022-03-18 03:23:31 2022-03-29 14:56:02 2022-03-29 15:33:14 0:37:12 0:19:42 0:17:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

"2022-03-29T15:30:27.162119+0000 mon.a (mon.0) 261 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6744207 2022-03-18 03:23:32 2022-03-29 14:57:33 2022-03-29 15:23:16 0:25:43 0:10:05 0:15:38 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} 1
fail 6744208 2022-03-18 03:23:33 2022-03-29 14:57:43 2022-03-29 15:31:40 0:33:57 0:19:48 0:14:09 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2022-03-29T15:20:06.968245+0000 mon.a (mon.0) 182 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6744209 2022-03-18 03:23:33 2022-03-29 14:58:23 2022-03-29 15:25:14 0:26:51 0:11:10 0:15:41 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} 3
pass 6744210 2022-03-18 03:23:34 2022-03-29 14:59:04 2022-03-29 15:29:45 0:30:41 0:17:13 0:13:28 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6744211 2022-03-18 03:23:35 2022-03-29 15:00:14 2022-03-29 15:24:21 0:24:07 0:10:57 0:13:10 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6744212 2022-03-18 03:23:36 2022-03-29 15:02:55 2022-03-29 15:32:47 0:29:52 0:16:25 0:13:27 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_map_unmap} 3
pass 6744213 2022-03-18 03:23:37 2022-03-29 15:04:36 2022-03-29 15:29:46 0:25:10 0:12:38 0:12:32 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6744214 2022-03-18 03:23:38 2022-03-29 15:05:36 2022-03-29 15:43:46 0:38:10 0:27:01 0:11:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} 3