Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6373131 2021-09-03 03:20:41 2021-09-12 15:19:04 2021-09-12 15:37:13 0:18:09 0:07:38 0:10:31 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_deep_flatten} 1
pass 6373132 2021-09-03 03:20:41 2021-09-12 15:19:04 2021-09-12 15:54:46 0:35:42 0:18:53 0:16:49 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6373133 2021-09-03 03:20:42 2021-09-12 15:25:35 2021-09-12 16:07:33 0:41:58 0:24:14 0:17:44 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_fio} 3
pass 6373134 2021-09-03 03:20:43 2021-09-12 15:32:26 2021-09-12 16:00:05 0:27:39 0:14:20 0:13:19 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_data_pool} 3
fail 6373135 2021-09-03 03:20:44 2021-09-12 15:34:57 2021-09-12 19:33:56 3:58:59 3:44:50 0:14:09 gibba master krbd/singleton/{bluestore-bitmap conf ms_mode$/{legacy} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Command failed on gibba031 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludek672p4ct -r -- '-g auto -g blockdev -x clone'"

pass 6373136 2021-09-03 03:20:44 2021-09-12 15:36:37 2021-09-12 16:27:40 0:51:03 0:38:34 0:12:29 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_fio} 3
fail 6373137 2021-09-03 03:20:45 2021-09-12 15:38:38 2021-09-12 15:45:54 0:07:16 gibba master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major

pass 6373138 2021-09-03 03:20:46 2021-09-12 15:38:48 2021-09-12 15:55:54 0:17:06 0:06:39 0:10:27 gibba master krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} 1
fail 6373139 2021-09-03 03:20:46 2021-09-12 15:38:48 2021-09-12 16:23:58 0:45:10 0:16:52 0:28:18 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2021-09-12T16:21:39.785326+0000 mon.a (mon.0) 225 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373140 2021-09-03 03:20:47 2021-09-12 15:54:50 2021-09-12 16:22:59 0:28:09 0:15:38 0:12:31 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6373141 2021-09-03 03:20:48 2021-09-12 15:56:00 2021-09-12 16:21:19 0:25:19 0:09:00 0:16:19 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} 3
fail 6373142 2021-09-03 03:20:48 2021-09-12 16:00:11 2021-09-12 16:36:50 0:36:39 0:16:56 0:19:43 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_huge_osdmap} 3
Failure Reason:

"2021-09-12T16:34:48.064381+0000 mon.a (mon.0) 260 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373143 2021-09-03 03:20:49 2021-09-12 16:07:42 2021-09-12 16:59:21 0:51:39 0:35:15 0:16:24 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6373144 2021-09-03 03:20:50 2021-09-12 16:12:13 2021-09-12 16:44:35 0:32:22 0:11:21 0:21:01 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6373145 2021-09-03 03:20:50 2021-09-12 16:21:24 2021-09-12 16:40:03 0:18:39 0:07:09 0:11:30 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_discard} 1
pass 6373146 2021-09-03 03:20:51 2021-09-12 16:23:04 2021-09-12 16:51:19 0:28:15 0:15:36 0:12:39 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6373147 2021-09-03 03:20:52 2021-09-12 16:24:05 2021-09-12 16:48:53 0:24:48 0:09:27 0:15:21 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} 3
pass 6373148 2021-09-03 03:20:52 2021-09-12 16:27:45 2021-09-12 17:50:34 1:22:49 1:06:01 0:16:48 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6373149 2021-09-03 03:20:53 2021-09-12 16:33:26 2021-09-12 17:05:52 0:32:26 0:16:37 0:15:49 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6373150 2021-09-03 03:20:54 2021-09-12 16:36:57 2021-09-12 17:11:45 0:34:48 0:13:57 0:20:51 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6373151 2021-09-03 03:20:54 2021-09-12 16:44:38 2021-09-12 17:12:09 0:27:31 0:10:42 0:16:49 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6373152 2021-09-03 03:20:55 2021-09-12 16:48:59 2021-09-12 17:12:37 0:23:38 0:08:59 0:14:39 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} 3
pass 6373153 2021-09-03 03:20:56 2021-09-12 16:51:29 2021-09-12 17:08:29 0:17:00 0:06:52 0:10:08 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} 1
pass 6373154 2021-09-03 03:20:56 2021-09-12 16:51:30 2021-09-12 17:32:43 0:41:13 0:20:51 0:20:22 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6373155 2021-09-03 03:20:57 2021-09-12 16:59:31 2021-09-12 17:27:09 0:27:38 0:09:33 0:18:05 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_symlinks} 3
fail 6373156 2021-09-03 03:20:58 2021-09-12 17:06:02 2021-09-12 17:40:56 0:34:54 0:16:58 0:17:56 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

"2021-09-12T17:39:10.266068+0000 mon.a (mon.0) 243 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6373157 2021-09-03 03:20:58 2021-09-12 17:11:52 2021-09-12 17:41:24 0:29:32 0:16:59 0:12:33 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_concurrent} 3
Failure Reason:

"2021-09-12T17:29:08.205914+0000 mon.a (mon.0) 192 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373158 2021-09-03 03:20:59 2021-09-12 17:12:13 2021-09-12 17:33:55 0:21:42 0:08:05 0:13:37 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6373159 2021-09-03 03:21:00 2021-09-12 17:12:43 2021-09-12 17:44:04 0:31:21 0:20:19 0:11:02 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6373160 2021-09-03 03:21:00 2021-09-12 17:12:53 2021-09-12 17:46:23 0:33:30 0:08:08 0:25:22 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_image_read} 3
pass 6373161 2021-09-03 03:21:01 2021-09-12 17:27:15 2021-09-12 17:44:21 0:17:06 0:06:21 0:10:45 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_modprobe} 1
fail 6373162 2021-09-03 03:21:02 2021-09-12 17:27:15 2021-09-12 17:59:58 0:32:43 0:14:12 0:18:31 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2021-09-12T17:49:28.885525+0000 mon.a (mon.0) 120 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373163 2021-09-03 03:21:02 2021-09-12 17:32:46 2021-09-12 18:45:10 1:12:24 0:58:56 0:13:28 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6373164 2021-09-03 03:21:03 2021-09-12 17:33:57 2021-09-12 18:02:22 0:28:25 0:08:28 0:19:57 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_kernel} 3
pass 6373165 2021-09-03 03:21:04 2021-09-12 17:41:28 2021-09-12 18:13:20 0:31:52 0:17:37 0:14:15 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6373166 2021-09-03 03:21:04 2021-09-12 17:44:08 2021-09-12 18:05:35 0:21:27 0:07:33 0:13:54 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6373167 2021-09-03 03:21:05 2021-09-12 17:46:29 2021-09-12 18:15:51 0:29:22 0:12:40 0:16:42 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_unmap} 3
pass 6373168 2021-09-03 03:21:06 2021-09-12 17:50:39 2021-09-12 18:20:56 0:30:17 0:09:59 0:20:18 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6373169 2021-09-03 03:21:06 2021-09-12 18:00:01 2021-09-12 18:37:42 0:37:41 0:23:20 0:14:21 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_simple_big} 3
pass 6373170 2021-09-03 03:21:07 2021-09-12 18:02:31 2021-09-12 18:19:41 0:17:10 0:06:49 0:10:21 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_msgr_segments} 1
pass 6373171 2021-09-03 03:21:08 2021-09-12 18:02:31 2021-09-12 18:40:53 0:38:22 0:22:37 0:15:45 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
fail 6373172 2021-09-03 03:21:08 2021-09-12 18:05:42 2021-09-12 18:42:35 0:36:53 0:17:07 0:19:46 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

"2021-09-12T18:40:34.979708+0000 mon.a (mon.0) 323 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6373173 2021-09-03 03:21:09 2021-09-12 18:13:23 2021-09-12 18:45:01 0:31:38 0:16:45 0:14:53 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} 3
Failure Reason:

"2021-09-12T18:43:09.128053+0000 mon.a (mon.0) 243 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373174 2021-09-03 03:21:10 2021-09-12 18:15:54 2021-09-12 18:42:12 0:26:18 0:08:56 0:17:22 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6373175 2021-09-03 03:21:10 2021-09-12 18:21:04 2021-09-12 19:03:00 0:41:56 0:13:56 0:28:00 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
fail 6373176 2021-09-03 03:21:11 2021-09-12 18:37:46 2021-09-12 19:10:09 0:32:23 0:17:01 0:15:22 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

"2021-09-12T18:57:25.658052+0000 mon.a (mon.0) 188 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373177 2021-09-03 03:21:12 2021-09-12 18:40:57 2021-09-12 19:03:30 0:22:33 0:09:01 0:13:32 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} 3
fail 6373178 2021-09-03 03:21:12 2021-09-12 18:42:17 2021-09-12 19:11:36 0:29:19 0:16:43 0:12:36 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

"2021-09-12T19:09:39.186554+0000 mon.a (mon.0) 335 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6373179 2021-09-03 03:21:13 2021-09-12 18:42:38 2021-09-12 19:14:07 0:31:29 0:16:56 0:14:33 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
Failure Reason:

"2021-09-12T19:12:06.975602+0000 mon.a (mon.0) 268 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6373180 2021-09-03 03:21:14 2021-09-12 18:45:08 2021-09-12 19:02:18 0:17:10 0:06:35 0:10:35 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} 1
fail 6373181 2021-09-03 03:21:14 2021-09-12 18:45:08 2021-09-12 19:14:29 0:29:21 0:17:46 0:11:35 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2021-09-12T19:02:09.502692+0000 mon.a (mon.0) 290 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373182 2021-09-03 03:21:15 2021-09-12 18:45:19 2021-09-12 19:22:44 0:37:25 0:09:08 0:28:17 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_namespaces} 3
pass 6373183 2021-09-03 03:21:16 2021-09-12 19:01:51 2021-09-12 20:12:49 1:10:58 0:59:04 0:11:54 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6373184 2021-09-03 03:21:17 2021-09-12 19:01:51 2021-09-12 19:34:12 0:32:21 0:18:45 0:13:36 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6373185 2021-09-03 03:21:18 2021-09-12 19:03:01 2021-09-12 19:30:42 0:27:41 0:14:22 0:13:19 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6373186 2021-09-03 03:21:18 2021-09-12 19:03:32 2021-09-12 19:33:08 0:29:36 0:11:41 0:17:55 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
fail 6373187 2021-09-03 03:21:19 2021-09-12 19:10:13 2021-09-12 19:40:44 0:30:31 0:16:58 0:13:33 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

"2021-09-12T19:39:19.635223+0000 mon.a (mon.0) 283 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373188 2021-09-03 03:21:20 2021-09-12 19:11:43 2021-09-12 19:31:02 0:19:19 0:07:18 0:12:01 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_read_only} 1
pass 6373189 2021-09-03 03:21:21 2021-09-12 19:14:14 2021-09-12 19:45:34 0:31:20 0:18:12 0:13:08 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6373190 2021-09-03 03:21:21 2021-09-12 19:14:34 2021-09-12 20:18:01 1:03:27 0:42:03 0:21:24 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
pass 6373191 2021-09-03 03:21:22 2021-09-12 19:22:45 2021-09-12 19:51:49 0:29:04 0:08:52 0:20:12 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} 3
fail 6373192 2021-09-03 03:21:23 2021-09-12 19:30:46 2021-09-12 20:02:30 0:31:44 0:17:06 0:14:38 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

"2021-09-12T20:00:42.078126+0000 mon.a (mon.0) 191 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6373193 2021-09-03 03:21:23 2021-09-12 19:33:18 2021-09-12 20:02:57 0:29:39 0:16:52 0:12:47 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

"2021-09-12T20:01:20.612354+0000 mon.a (mon.0) 237 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373194 2021-09-03 03:21:24 2021-09-12 19:33:58 2021-09-12 19:53:30 0:19:32 0:07:55 0:11:37 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6373195 2021-09-03 03:21:25 2021-09-12 19:34:18 2021-09-12 20:15:44 0:41:26 0:23:31 0:17:55 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
fail 6373196 2021-09-03 03:21:25 2021-09-12 19:40:50 2021-09-12 20:14:48 0:33:58 0:16:43 0:17:15 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

"2021-09-12T20:12:53.967565+0000 mon.a (mon.0) 299 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373197 2021-09-03 03:21:26 2021-09-12 19:45:40 2021-09-12 20:08:56 0:23:16 0:06:40 0:16:36 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_whole_object_zeroout} 1
pass 6373198 2021-09-03 03:21:27 2021-09-12 19:51:51 2021-09-12 20:22:42 0:30:51 0:16:26 0:14:25 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6373199 2021-09-03 03:21:27 2021-09-12 19:53:32 2021-09-12 20:21:32 0:28:00 0:08:04 0:19:56 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_kernel} 3
pass 6373200 2021-09-03 03:21:28 2021-09-12 20:02:33 2021-09-12 20:30:16 0:27:43 0:15:30 0:12:13 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6373201 2021-09-03 03:21:29 2021-09-12 20:03:13 2021-09-12 20:32:06 0:28:53 0:08:08 0:20:45 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6373202 2021-09-03 03:21:30 2021-09-12 20:12:54 2021-09-12 20:39:54 0:27:00 0:12:49 0:14:11 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} 3
pass 6373203 2021-09-03 03:21:30 2021-09-12 20:14:55 2021-09-12 20:38:53 0:23:58 0:11:51 0:12:07 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6373204 2021-09-03 03:21:31 2021-09-12 20:15:45 2021-09-12 20:57:13 0:41:28 0:27:05 0:14:23 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_simple_big} 3
pass 6373205 2021-09-03 03:21:32 2021-09-12 20:18:06 2021-09-12 20:35:13 0:17:07 0:07:06 0:10:01 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} 1
fail 6373206 2021-09-03 03:21:32 2021-09-12 20:18:06 2021-09-12 20:48:49 0:30:43 0:15:54 0:14:49 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

fail 6373207 2021-09-03 03:21:33 2021-09-12 20:21:37 2021-09-12 20:51:58 0:30:21 0:16:55 0:13:26 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_fio} 3
Failure Reason:

"2021-09-12T20:39:31.654336+0000 mon.a (mon.0) 119 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373208 2021-09-03 03:21:34 2021-09-12 20:22:47 2021-09-12 20:57:29 0:34:42 0:14:46 0:19:56 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_data_pool} 3
pass 6373209 2021-09-03 03:21:34 2021-09-12 20:30:18 2021-09-12 20:49:21 0:19:03 0:07:06 0:11:57 gibba master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
pass 6373210 2021-09-03 03:21:35 2021-09-12 20:32:08 2021-09-12 21:06:27 0:34:19 0:18:36 0:15:43 gibba master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
pass 6373211 2021-09-03 03:21:36 2021-09-12 20:35:19 2021-09-12 21:00:10 0:24:51 0:09:08 0:15:43 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} 3
fail 6373212 2021-09-03 03:21:36 2021-09-12 20:39:00 2021-09-12 21:09:16 0:30:16 0:17:15 0:13:01 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2021-09-12T20:57:03.454349+0000 mon.a (mon.0) 140 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373213 2021-09-03 03:21:37 2021-09-12 20:40:00 2021-09-12 21:10:45 0:30:45 0:09:16 0:21:29 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_fallocate} 3
fail 6373214 2021-09-03 03:21:38 2021-09-12 20:49:31 2021-09-12 21:20:57 0:31:26 0:16:56 0:14:30 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_huge_osdmap} 3
Failure Reason:

"2021-09-12T21:18:23.026226+0000 mon.a (mon.0) 201 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373215 2021-09-03 03:21:38 2021-09-12 20:52:02 2021-09-12 21:44:37 0:52:35 0:35:50 0:16:45 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6373216 2021-09-03 03:21:39 2021-09-12 20:57:23 2021-09-12 21:20:41 0:23:18 0:11:26 0:11:52 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6373217 2021-09-03 03:21:40 2021-09-12 20:57:33 2021-09-12 21:14:27 0:16:54 0:06:57 0:09:57 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_discard} 1
pass 6373218 2021-09-03 03:21:40 2021-09-12 20:57:33 2021-09-12 21:27:21 0:29:48 0:16:33 0:13:15 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6373219 2021-09-03 03:21:41 2021-09-12 21:00:14 2021-09-12 22:15:49 1:15:35 0:58:13 0:17:22 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
fail 6373220 2021-09-03 03:21:42 2021-09-12 21:06:35 2021-09-12 21:38:24 0:31:49 0:16:45 0:15:04 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_namespaces} 3
Failure Reason:

"2021-09-12T21:35:42.207176+0000 mon.a (mon.0) 224 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6373221 2021-09-03 03:21:42 2021-09-12 21:09:25 2021-09-12 21:39:58 0:30:33 0:16:51 0:13:42 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

"2021-09-12T21:27:14.569517+0000 mon.a (mon.0) 115 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373222 2021-09-03 03:21:43 2021-09-12 21:10:46 2021-09-12 21:47:55 0:37:09 0:16:30 0:20:39 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6373223 2021-09-03 03:21:44 2021-09-12 21:20:47 2021-09-12 21:46:17 0:25:30 0:13:59 0:11:31 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6373224 2021-09-03 03:21:44 2021-09-12 21:21:07 2021-09-12 21:48:36 0:27:29 0:10:30 0:16:59 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6373225 2021-09-03 03:21:45 2021-09-12 21:27:28 2021-09-12 22:00:58 0:33:30 0:09:26 0:24:04 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netns} 3
pass 6373226 2021-09-03 03:21:46 2021-09-12 21:40:00 2021-09-12 21:56:59 0:16:59 0:06:29 0:10:30 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_huge_image} 1
fail 6373227 2021-09-03 03:21:46 2021-09-12 21:40:00 2021-09-12 22:17:53 0:37:53 0:20:48 0:17:05 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
Failure Reason:

"2021-09-12T22:01:45.322660+0000 mon.a (mon.0) 123 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6373228 2021-09-03 03:21:47 2021-09-12 21:44:41 2021-09-12 22:15:34 0:30:53 0:17:11 0:13:42 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_symlinks} 3
Failure Reason:

"2021-09-12T22:14:02.951531+0000 mon.a (mon.0) 274 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373229 2021-09-03 03:21:48 2021-09-12 21:46:21 2021-09-12 22:09:09 0:22:48 0:08:38 0:14:10 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6373230 2021-09-03 03:21:48 2021-09-12 21:48:02 2021-09-12 22:13:48 0:25:46 0:13:04 0:12:42 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
fail 6373231 2021-09-03 03:21:49 2021-09-12 21:48:42 2021-09-12 22:30:14 0:41:32 0:17:01 0:24:31 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_huge_tickets} 3
Failure Reason:

"2021-09-12T22:28:38.742801+0000 mon.a (mon.0) 314 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373232 2021-09-03 03:21:50 2021-09-12 22:01:04 2021-09-12 22:42:26 0:41:22 0:20:20 0:21:02 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6373233 2021-09-03 03:21:51 2021-09-12 22:09:15 2021-09-12 22:35:07 0:25:52 0:08:16 0:17:36 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_image_read} 3
pass 6373234 2021-09-03 03:21:51 2021-09-12 22:13:56 2021-09-12 22:31:03 0:17:07 0:06:37 0:10:30 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} 1
pass 6373235 2021-09-03 03:21:52 2021-09-12 22:13:56 2021-09-12 22:47:09 0:33:13 0:19:30 0:13:43 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
fail 6373236 2021-09-03 03:21:53 2021-09-12 22:15:56 2021-09-12 22:46:57 0:31:01 0:16:54 0:14:07 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

"2021-09-12T22:34:24.345127+0000 mon.a (mon.0) 154 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373237 2021-09-03 03:21:53 2021-09-12 22:17:57 2021-09-12 22:59:10 0:41:13 0:16:38 0:24:35 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6373238 2021-09-03 03:21:54 2021-09-12 22:30:19 2021-09-12 22:54:16 0:23:57 0:07:52 0:16:05 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6373239 2021-09-03 03:21:55 2021-09-12 22:35:09 2021-09-12 23:07:41 0:32:32 0:12:51 0:19:41 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_unmap} 3
pass 6373240 2021-09-03 03:21:55 2021-09-12 22:42:30 2021-09-12 23:08:08 0:25:38 0:10:05 0:15:33 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6373241 2021-09-03 03:21:56 2021-09-12 22:47:01 2021-09-12 23:24:23 0:37:22 0:25:42 0:11:40 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} 3
pass 6373242 2021-09-03 03:21:57 2021-09-12 22:47:12 2021-09-12 23:11:33 0:24:21 0:06:51 0:17:30 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_msgr_segments} 1
pass 6373243 2021-09-03 03:21:57 2021-09-12 22:54:23 2021-09-12 23:36:27 0:42:04 0:25:14 0:16:50 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6373244 2021-09-03 03:21:58 2021-09-12 22:59:13 2021-09-12 23:44:53 0:45:40 0:25:12 0:20:28 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_fio} 3
fail 6373245 2021-09-03 03:21:59 2021-09-12 23:07:45 2021-09-12 23:37:26 0:29:41 0:17:06 0:12:35 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_data_pool} 3
Failure Reason:

"2021-09-12T23:34:42.367531+0000 mon.a (mon.0) 285 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6373246 2021-09-03 03:21:59 2021-09-12 23:08:15 2021-09-12 23:42:17 0:34:02 0:16:38 0:17:24 gibba master krbd/singleton/{bluestore-bitmap conf ms_mode$/{legacy} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

"2021-09-12T23:40:46.418241+0000 mon.a (mon.0) 202 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373247 2021-09-03 03:22:00 2021-09-12 23:13:06 2021-09-13 00:39:42 1:26:36 1:02:17 0:24:19 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6373248 2021-09-03 03:22:01 2021-09-12 23:24:28 2021-09-12 23:57:35 0:33:07 0:08:52 0:24:15 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6373249 2021-09-03 03:22:01 2021-09-12 23:36:30 2021-09-13 00:02:27 0:25:57 0:13:42 0:12:15 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6373250 2021-09-03 03:22:02 2021-09-12 23:37:30 2021-09-13 00:03:16 0:25:46 0:09:25 0:16:21 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} 3
pass 6373251 2021-09-03 03:22:03 2021-09-12 23:42:21 2021-09-13 00:06:09 0:23:48 0:08:43 0:15:05 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6373252 2021-09-03 03:22:03 2021-09-12 23:45:02 2021-09-13 00:46:55 1:01:53 0:36:44 0:25:09 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6373253 2021-09-03 03:22:04 2021-09-12 23:57:43 2021-09-13 00:25:46 0:28:03 0:11:21 0:16:42 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6373254 2021-09-03 03:22:05 2021-09-13 00:02:34 2021-09-13 00:19:33 0:16:59 0:06:54 0:10:05 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_parent_overlap} 1
fail 6373255 2021-09-03 03:22:05 2021-09-13 00:02:34 2021-09-13 00:30:31 0:27:57 0:14:50 0:13:07 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
Failure Reason:

"2021-09-13T00:20:02.495337+0000 mon.a (mon.0) 122 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373256 2021-09-03 03:22:06 2021-09-13 00:03:25 2021-09-13 00:25:26 0:22:01 0:08:27 0:13:34 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} 3
pass 6373257 2021-09-03 03:22:07 2021-09-13 00:06:15 2021-09-13 01:36:40 1:30:25 0:58:40 0:31:45 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
fail 6373258 2021-09-03 03:22:07 2021-09-13 00:25:27 2021-09-13 00:57:00 0:31:33 0:19:35 0:11:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_enumerate} 3
Failure Reason:

"2021-09-13T00:44:18.217214+0000 osd.5 (osd.5) 3 : cluster [WRN] slow request osd_op(client.4990.0:7 2.3 2:d8328d9b:::rbd_header.137ec0cac96e:head [create,call rbd.create in=59b] snapc 0=[] ondisk+write+known_if_redirected e22) initiated 2021-09-13T00:43:48.159205+0000 currently waiting for sub ops" in cluster log

pass 6373259 2021-09-03 03:22:08 2021-09-13 00:25:48 2021-09-13 00:55:38 0:29:50 0:14:00 0:15:50 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
fail 6373260 2021-09-03 03:22:09 2021-09-13 00:30:38 2021-09-13 01:08:58 0:38:20 0:16:51 0:21:29 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
Failure Reason:

"2021-09-13T01:06:23.087524+0000 mon.a (mon.0) 217 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373261 2021-09-03 03:22:09 2021-09-13 00:39:50 2021-09-13 01:08:08 0:28:18 0:08:58 0:19:20 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} 3
pass 6373262 2021-09-03 03:22:10 2021-09-13 00:47:01 2021-09-13 01:04:11 0:17:10 0:06:45 0:10:25 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} 1
fail 6373263 2021-09-03 03:22:11 2021-09-13 00:47:01 2021-09-13 01:24:54 0:37:53 0:16:58 0:20:55 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

"2021-09-13T01:23:05.862736+0000 mon.a (mon.0) 333 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373264 2021-09-03 03:22:11 2021-09-13 00:55:42 2021-09-13 01:17:59 0:22:17 0:08:56 0:13:21 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6373265 2021-09-03 03:22:12 2021-09-13 00:57:03 2021-09-13 01:27:28 0:30:25 0:08:08 0:22:17 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6373266 2021-09-03 03:22:13 2021-09-13 01:08:14 2021-09-13 01:33:59 0:25:45 0:13:08 0:12:37 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_concurrent} 3
pass 6373267 2021-09-03 03:22:13 2021-09-13 01:09:04 2021-09-13 01:37:13 0:28:09 0:07:59 0:20:10 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} 3
fail 6373268 2021-09-03 03:22:14 2021-09-13 01:18:06 2021-09-13 01:53:56 0:35:50 0:16:55 0:18:55 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2021-09-13T01:51:47.063944+0000 mon.a (mon.0) 226 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6373269 2021-09-03 03:22:15 2021-09-13 01:24:57 2021-09-13 01:56:49 0:31:52 0:16:53 0:14:59 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

"2021-09-13T01:44:04.277568+0000 mon.a (mon.0) 112 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373270 2021-09-03 03:22:15 2021-09-13 01:27:37 2021-09-13 01:44:41 0:17:04 0:07:07 0:09:57 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_whole_object_zeroout} 1
pass 6373271 2021-09-03 03:22:16 2021-09-13 01:27:37 2021-09-13 01:59:19 0:31:42 0:13:25 0:18:17 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6373272 2021-09-03 03:22:17 2021-09-13 01:34:08 2021-09-13 02:26:01 0:51:53 0:37:20 0:14:33 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
pass 6373273 2021-09-03 03:22:17 2021-09-13 01:36:49 2021-09-13 01:56:26 0:19:37 0:07:58 0:11:39 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_kernel} 3
pass 6373274 2021-09-03 03:22:18 2021-09-13 01:37:19 2021-09-13 02:21:06 0:43:47 0:15:10 0:28:37 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
fail 6373275 2021-09-03 03:22:19 2021-09-13 01:54:01 2021-09-13 02:25:43 0:31:42 0:16:53 0:14:49 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2021-09-13T02:13:03.694167+0000 mon.a (mon.0) 119 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373276 2021-09-03 03:22:19 2021-09-13 01:56:32 2021-09-13 02:21:50 0:25:18 0:12:49 0:12:29 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_unmap} 3
pass 6373277 2021-09-03 03:22:20 2021-09-13 01:56:52 2021-09-13 02:22:32 0:25:40 0:12:20 0:13:20 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6373278 2021-09-03 03:22:21 2021-09-13 01:59:23 2021-09-13 02:58:24 0:59:01 0:26:10 0:32:51 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_simple_big} 3
pass 6373279 2021-09-03 03:22:21 2021-09-13 02:21:15 2021-09-13 02:38:15 0:17:00 0:07:06 0:09:54 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_deep_flatten} 1
pass 6373280 2021-09-03 03:22:22 2021-09-13 02:21:16 2021-09-13 02:59:09 0:37:53 0:25:15 0:12:38 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6373281 2021-09-03 03:22:23 2021-09-13 02:21:56 2021-09-13 02:57:49 0:35:53 0:24:21 0:11:32 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} 3
pass 6373282 2021-09-03 03:22:23 2021-09-13 02:22:36 2021-09-13 02:52:42 0:30:06 0:14:57 0:15:09 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} 3
pass 6373283 2021-09-03 03:22:24 2021-09-13 02:25:47 2021-09-13 02:43:17 0:17:30 0:07:00 0:10:30 gibba master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
pass 6373284 2021-09-03 03:22:25 2021-09-13 02:26:07 2021-09-13 03:14:30 0:48:23 0:19:03 0:29:20 gibba master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
fail 6373285 2021-09-03 03:22:25 2021-09-13 02:43:19 2021-09-13 03:22:03 0:38:44 0:16:54 0:21:50 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2021-09-13T03:19:37.204435+0000 mon.a (mon.0) 275 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373286 2021-09-03 03:22:26 2021-09-13 02:52:51 2021-09-13 03:22:59 0:30:08 0:14:23 0:15:45 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6373287 2021-09-03 03:22:27 2021-09-13 02:57:52 2021-09-13 03:19:42 0:21:50 0:08:58 0:12:52 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_fallocate} 3
fail 6373288 2021-09-03 03:22:27 2021-09-13 02:58:32 2021-09-13 03:28:24 0:29:52 0:16:44 0:13:08 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} 3
Failure Reason:

"2021-09-13T03:25:40.175731+0000 mon.a (mon.0) 303 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373289 2021-09-03 03:22:28 2021-09-13 02:59:12 2021-09-13 04:01:46 1:02:34 0:35:17 0:27:17 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6373290 2021-09-03 03:22:29 2021-09-13 03:14:34 2021-09-13 03:42:57 0:28:23 0:11:19 0:17:04 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6373291 2021-09-03 03:22:29 2021-09-13 03:19:45 2021-09-13 03:36:43 0:16:58 0:06:52 0:10:06 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} 1
fail 6373292 2021-09-03 03:22:30 2021-09-13 03:19:46 2021-09-13 03:50:14 0:30:28 0:15:56 0:14:32 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

fail 6373293 2021-09-03 03:22:31 2021-09-13 03:23:06 2021-09-13 03:57:21 0:34:15 0:16:46 0:17:29 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_namespaces} 3
Failure Reason:

"2021-09-13T03:54:55.548742+0000 mon.a (mon.0) 205 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6373294 2021-09-03 03:22:31 2021-09-13 03:28:27 2021-09-13 04:52:03 1:23:36 1:04:14 0:19:22 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

"2021-09-13T04:28:00.433965+0000 osd.7 (osd.7) 3 : cluster [WRN] slow request osd_op(client.4419.0:845477 1.0 1:138d794d:::rbd_data.10eb917c5af2.0000000000000e8c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 212992~12288 in=12288b] snapc 0=[] ondisk+write+known_if_redirected e20) initiated 2021-09-13T04:27:30.305789+0000 currently waiting for sub ops" in cluster log

pass 6373295 2021-09-03 03:22:32 2021-09-13 03:36:48 2021-09-13 04:10:11 0:33:23 0:16:21 0:17:02 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6373296 2021-09-03 03:22:33 2021-09-13 03:42:59 2021-09-13 04:19:16 0:36:17 0:16:52 0:19:25 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2021-09-13T04:16:39.444828+0000 mon.a (mon.0) 227 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373297 2021-09-03 03:22:33 2021-09-13 03:50:20 2021-09-13 04:18:31 0:28:11 0:09:57 0:18:14 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6373298 2021-09-03 03:22:34 2021-09-13 03:57:31 2021-09-13 04:20:58 0:23:27 0:08:47 0:14:40 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netns} 3
pass 6373299 2021-09-03 03:22:35 2021-09-13 04:01:52 2021-09-13 04:27:13 0:25:21 0:06:42 0:18:39 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_huge_image} 1
pass 6373300 2021-09-03 03:22:35 2021-09-13 04:10:13 2021-09-13 04:51:47 0:41:34 0:21:26 0:20:08 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
fail 6373301 2021-09-03 03:22:36 2021-09-13 04:18:34 2021-09-13 08:40:35 4:22:01 4:07:16 0:14:45 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
Failure Reason:

Command failed (workunit test suites/ffsb.sh) on gibba035 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9cb2f444fd0eb67fafb7cea2c23f5b7ace201e62 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh'

fail 6373302 2021-09-03 03:22:37 2021-09-13 04:19:25 2021-09-13 04:50:13 0:30:48 0:16:47 0:14:01 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} 3
Failure Reason:

"2021-09-13T04:37:15.820363+0000 mon.a (mon.0) 129 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6373303 2021-09-03 03:22:37 2021-09-13 04:21:05 2021-09-13 04:56:30 0:35:25 0:16:55 0:18:30 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

"2021-09-13T04:54:13.352061+0000 mon.a (mon.0) 254 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373304 2021-09-03 03:22:38 2021-09-13 04:27:16 2021-09-13 05:16:57 0:49:41 0:12:31 0:37:10 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_concurrent} 3
pass 6373305 2021-09-03 03:22:39 2021-09-13 04:51:49 2021-09-13 05:13:08 0:21:19 0:08:08 0:13:11 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6373306 2021-09-03 03:22:39 2021-09-13 04:52:09 2021-09-13 05:29:40 0:37:31 0:21:02 0:16:29 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6373307 2021-09-03 03:22:40 2021-09-13 04:56:40 2021-09-13 05:32:19 0:35:39 0:08:13 0:27:26 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
pass 6373308 2021-09-03 03:22:41 2021-09-13 05:13:12 2021-09-13 05:34:05 0:20:53 0:06:25 0:14:28 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_modprobe} 1
pass 6373309 2021-09-03 03:22:41 2021-09-13 05:17:03 2021-09-13 05:58:58 0:41:55 0:16:53 0:25:02 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6373310 2021-09-03 03:22:42 2021-09-13 05:29:45 2021-09-13 05:51:41 0:21:56 0:07:49 0:14:07 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_kernel} 3
pass 6373311 2021-09-03 03:22:43 2021-09-13 05:32:25 2021-09-13 06:03:16 0:30:51 0:17:14 0:13:37 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6373312 2021-09-03 03:22:43 2021-09-13 05:34:06 2021-09-13 06:10:59 0:36:53 0:07:59 0:28:54 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6373313 2021-09-03 03:22:44 2021-09-13 05:51:48 2021-09-13 06:24:07 0:32:19 0:13:11 0:19:08 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} 3
pass 6373314 2021-09-03 03:22:45 2021-09-13 05:58:59 2021-09-13 06:24:27 0:25:28 0:10:21 0:15:07 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6373315 2021-09-03 03:22:45 2021-09-13 06:03:19 2021-09-13 06:54:49 0:51:30 0:28:41 0:22:49 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_simple_big} 3
pass 6373316 2021-09-03 03:22:46 2021-09-13 06:11:01 2021-09-13 06:43:21 0:32:20 0:07:48 0:24:32 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} 1
fail 6373317 2021-09-03 03:22:46 2021-09-13 06:24:13 2021-09-13 07:03:53 0:39:40 0:16:06 0:23:34 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

fail 6373318 2021-09-03 03:22:47 2021-09-13 06:24:33 2021-09-13 07:12:37 0:48:04 0:16:50 0:31:14 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

"2021-09-13T07:01:11.104456+0000 mon.a (mon.0) 111 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373319 2021-09-03 03:22:48 2021-09-13 06:43:26 2021-09-13 07:26:09 0:42:43 0:18:19 0:24:24 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_data_pool} 3
fail 6373320 2021-09-03 03:22:49 2021-09-13 06:54:58 2021-09-13 07:33:02 0:38:04 0:17:12 0:20:52 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} 3
Failure Reason:

"2021-09-13T07:31:12.661467+0000 mon.a (mon.0) 246 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6373321 2021-09-03 03:22:49 2021-09-13 07:03:59 2021-09-13 07:39:37 0:35:38 0:13:55 0:21:43 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6373322 2021-09-03 03:22:50 2021-09-13 07:12:40 2021-09-13 07:47:25 0:34:45 0:09:21 0:25:24 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_fallocate} 3
pass 6373323 2021-09-03 03:22:51 2021-09-13 07:26:12 2021-09-13 07:54:09 0:27:57 0:09:03 0:18:54 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_huge_osdmap} 3
fail 6373324 2021-09-03 03:22:51 2021-09-13 07:33:13 2021-09-13 08:08:52 0:35:39 0:17:20 0:18:19 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

"2021-09-13T07:57:22.801357+0000 mon.a (mon.0) 112 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373325 2021-09-03 03:22:52 2021-09-13 07:39:44 2021-09-13 08:12:45 0:33:01 0:11:36 0:21:25 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6373326 2021-09-03 03:22:53 2021-09-13 07:47:35 2021-09-13 08:11:19 0:23:44 0:06:32 0:17:12 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_parent_overlap} 1
pass 6373327 2021-09-03 03:22:53 2021-09-13 07:54:16 2021-09-13 08:34:01 0:39:45 0:13:46 0:25:59 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6373328 2021-09-03 03:22:54 2021-09-13 08:08:57 2021-09-13 09:00:42 0:51:45 0:37:08 0:14:37 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 6373329 2021-09-03 03:22:55 2021-09-13 08:11:28 2021-09-13 08:34:00 0:22:32 0:08:51 0:13:41 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_namespaces} 3
pass 6373330 2021-09-03 03:22:55 2021-09-13 08:12:48 2021-09-13 09:45:10 1:32:22 0:58:37 0:33:45 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6373331 2021-09-03 03:22:56 2021-09-13 08:34:01 2021-09-13 09:07:23 0:33:22 0:21:29 0:11:53 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6373332 2021-09-03 03:22:57 2021-09-13 08:34:11 2021-09-13 09:05:44 0:31:33 0:13:52 0:17:41 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6373333 2021-09-03 03:22:57 2021-09-13 08:40:42 2021-09-13 09:25:52 0:45:10 0:11:42 0:33:28 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
fail 6373334 2021-09-03 03:22:58 2021-09-13 09:00:44 2021-09-13 09:34:53 0:34:09 0:16:59 0:17:10 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

"2021-09-13T09:22:35.856179+0000 mon.a (mon.0) 130 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6373335 2021-09-03 03:22:59 2021-09-13 09:05:45 2021-09-13 09:24:31 0:18:46 0:07:11 0:11:35 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_read_only} 1
pass 6373336 2021-09-03 03:22:59 2021-09-13 09:07:26 2021-09-13 09:59:51 0:52:25 0:23:07 0:29:18 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6373337 2021-09-03 03:23:00 2021-09-13 09:24:38 2021-09-13 09:47:11 0:22:33 0:09:05 0:13:28 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6373338 2021-09-03 03:23:01 2021-09-13 09:25:58 2021-09-13 10:06:33 0:40:35 0:08:09 0:32:26 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6373339 2021-09-03 03:23:01 2021-09-13 09:45:20 2021-09-13 10:12:31 0:27:11 0:13:09 0:14:02 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} 3
pass 6373340 2021-09-03 03:23:02 2021-09-13 09:47:21 2021-09-13 10:19:02 0:31:41 0:07:51 0:23:50 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6373341 2021-09-03 03:23:03 2021-09-13 09:59:52 2021-09-13 10:39:55 0:40:03 0:22:24 0:17:39 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6373342 2021-09-03 03:23:03 2021-09-13 10:06:43 2021-09-13 10:33:46 0:27:03 0:08:43 0:18:20 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_image_read} 3
pass 6373343 2021-09-03 03:23:04 2021-09-13 10:12:34 2021-09-13 10:29:24 0:16:50 0:07:08 0:09:42 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} 1
pass 6373344 2021-09-03 03:23:05 2021-09-13 10:12:35 2021-09-13 10:46:19 0:33:44 0:15:17 0:18:27 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6373345 2021-09-03 03:23:05 2021-09-13 10:19:06 2021-09-13 10:55:05 0:35:59 0:07:58 0:28:01 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} 3
pass 6373346 2021-09-03 03:23:06 2021-09-13 10:33:47 2021-09-13 11:07:04 0:33:17 0:15:45 0:17:32 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6373347 2021-09-03 03:23:07 2021-09-13 10:39:58 2021-09-13 11:05:40 0:25:42 0:08:03 0:17:39 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6373348 2021-09-03 03:23:07 2021-09-13 10:46:29 2021-09-13 11:20:19 0:33:50 0:12:59 0:20:51 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_unmap} 3
pass 6373349 2021-09-03 03:23:08 2021-09-13 10:55:11 2021-09-13 11:30:53 0:35:42 0:13:29 0:22:13 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6373350 2021-09-03 03:23:09 2021-09-13 11:05:42 2021-09-13 11:46:21 0:40:39 0:27:20 0:13:19 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} 3