Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6443998 2021-10-15 03:21:00 2021-10-16 02:17:21 2021-10-16 02:35:21 0:18:00 0:07:41 0:10:19 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_deep_flatten} 1
pass 6443999 2021-10-15 03:21:01 2021-10-16 02:22:27 2021-10-16 03:16:30 0:54:03 0:21:51 0:32:12 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6444000 2021-10-15 03:21:02 2021-10-16 02:25:35 2021-10-16 03:39:40 1:14:05 0:24:52 0:49:13 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_fio} 3
pass 6444001 2021-10-15 03:21:03 2021-10-16 02:30:24 2021-10-16 03:01:09 0:30:45 0:15:32 0:15:13 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_data_pool} 3
fail 6444002 2021-10-15 03:21:04 2021-10-16 02:33:55 2021-10-16 07:21:27 4:47:32 3:43:43 1:03:49 gibba master krbd/singleton/{bluestore-bitmap conf ms_mode$/{prefer-crc} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Command failed on gibba032 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude1o5td4ca -r -- '-g auto -g blockdev -x clone'"

pass 6444003 2021-10-15 03:21:05 2021-10-16 02:34:36 2021-10-16 03:28:39 0:54:03 0:38:53 0:15:10 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/backoff thrashosds-health workloads/rbd_fio} 3
fail 6444004 2021-10-15 03:21:06 2021-10-16 02:34:53 2021-10-16 02:40:52 0:05:59 gibba master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major

pass 6444005 2021-10-15 03:21:07 2021-10-16 02:35:22 2021-10-16 02:53:23 0:18:01 0:07:25 0:10:36 gibba master krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} 1
pass 6444006 2021-10-15 03:21:07 2021-10-16 02:38:47 2021-10-16 04:16:54 1:38:07 0:09:47 1:28:20 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6444007 2021-10-15 03:21:08 2021-10-16 02:40:45 2021-10-16 03:10:46 0:30:01 0:15:55 0:14:06 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6444008 2021-10-15 03:21:09 2021-10-16 02:40:53 2021-10-16 04:16:59 1:36:06 0:09:26 1:26:40 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} 3
fail 6444009 2021-10-15 03:21:10 2021-10-16 02:43:30 2021-10-16 03:23:32 0:40:02 0:17:19 0:22:43 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_huge_osdmap} 3
Failure Reason:

"2021-10-16T03:22:41.258827+0000 mon.a (mon.0) 235 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6444010 2021-10-15 03:21:11 2021-10-16 02:53:24 2021-10-16 03:57:27 1:04:03 0:35:55 0:28:08 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6444011 2021-10-15 03:21:12 2021-10-16 02:56:51 2021-10-16 03:28:53 0:32:02 0:11:45 0:20:17 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6444012 2021-10-15 03:21:13 2021-10-16 03:04:36 2021-10-16 03:22:36 0:18:00 0:08:17 0:09:43 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_discard} 1
pass 6444013 2021-10-15 03:21:14 2021-10-16 03:06:54 2021-10-16 03:44:56 0:38:02 0:16:19 0:21:43 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6444014 2021-10-15 03:21:15 2021-10-16 03:10:47 2021-10-16 03:50:49 0:40:02 0:10:51 0:29:11 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} 3
pass 6444015 2021-10-15 03:21:16 2021-10-16 03:16:31 2021-10-16 05:00:38 1:44:07 1:08:18 0:35:49 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6444016 2021-10-15 03:21:17 2021-10-16 03:22:38 2021-10-16 03:54:39 0:32:01 0:19:53 0:12:08 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6444017 2021-10-15 03:21:17 2021-10-16 03:23:33 2021-10-16 03:55:34 0:32:01 0:15:00 0:17:01 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6444018 2021-10-15 03:21:19 2021-10-16 03:24:02 2021-10-16 04:35:10 1:11:08 0:11:11 0:59:57 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6444019 2021-10-15 03:21:20 2021-10-16 03:28:40 2021-10-16 04:12:42 0:44:02 0:09:34 0:34:28 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} 3
pass 6444020 2021-10-15 03:21:21 2021-10-16 03:28:54 2021-10-16 03:50:54 0:22:00 0:06:59 0:15:01 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} 1
pass 6444021 2021-10-15 03:21:22 2021-10-16 03:39:41 2021-10-16 04:17:43 0:38:02 0:22:11 0:15:51 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
fail 6444022 2021-10-15 03:21:23 2021-10-16 03:44:57 2021-10-16 05:45:04 2:00:07 0:17:44 1:42:23 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_symlinks} 3
Failure Reason:

"2021-10-16T05:42:23.729337+0000 mon.b (mon.0) 282 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444023 2021-10-15 03:21:23 2021-10-16 03:50:50 2021-10-16 04:36:53 0:46:03 0:08:57 0:37:06 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6444024 2021-10-15 03:21:24 2021-10-16 03:50:56 2021-10-16 04:20:57 0:30:01 0:13:29 0:16:32 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_concurrent} 3
pass 6444025 2021-10-15 03:21:25 2021-10-16 03:54:40 2021-10-16 04:18:41 0:24:01 0:08:43 0:15:18 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6444026 2021-10-15 03:21:26 2021-10-16 03:55:35 2021-10-16 04:51:38 0:56:03 0:23:00 0:33:03 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6444027 2021-10-15 03:21:27 2021-10-16 03:57:29 2021-10-16 04:41:31 0:44:02 0:09:19 0:34:43 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_image_read} 3
pass 6444028 2021-10-15 03:21:28 2021-10-16 03:57:48 2021-10-16 04:15:48 0:18:00 0:06:58 0:11:02 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_modprobe} 1
pass 6444029 2021-10-15 03:21:28 2021-10-16 04:11:49 2021-10-16 05:04:35 0:52:46 0:16:17 0:36:29 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6444030 2021-10-15 03:21:29 2021-10-16 04:12:44 2021-10-16 06:42:53 2:30:09 1:01:40 1:28:29 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6444031 2021-10-15 03:21:30 2021-10-16 04:15:49 2021-10-16 04:39:50 0:24:01 0:08:45 0:15:16 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_kernel} 3
pass 6444032 2021-10-15 03:21:31 2021-10-16 04:16:55 2021-10-16 06:17:02 2:00:07 0:18:45 1:41:22 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6444033 2021-10-15 03:21:32 2021-10-16 04:17:01 2021-10-16 04:39:01 0:22:00 0:08:24 0:13:36 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
fail 6444034 2021-10-15 03:21:32 2021-10-16 04:17:44 2021-10-16 05:09:47 0:52:03 0:17:33 0:34:30 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_unmap} 3
Failure Reason:

"2021-10-16T04:56:50.542988+0000 mon.b (mon.0) 166 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6444035 2021-10-15 03:21:33 2021-10-16 04:18:42 2021-10-16 04:58:44 0:40:02 0:11:00 0:29:02 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6444036 2021-10-15 03:21:34 2021-10-16 04:20:58 2021-10-16 05:15:01 0:54:03 0:25:16 0:28:47 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_simple_big} 3
pass 6444037 2021-10-15 03:21:35 2021-10-16 04:35:12 2021-10-16 04:52:26 0:17:14 0:06:58 0:10:16 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_msgr_segments} 1
pass 6444038 2021-10-15 03:21:36 2021-10-16 04:35:13 2021-10-16 05:14:36 0:39:23 0:23:55 0:15:28 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
fail 6444039 2021-10-15 03:21:37 2021-10-16 04:36:54 2021-10-16 05:28:57 0:52:03 0:17:17 0:34:46 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

"2021-10-16T05:27:54.040874+0000 mon.b (mon.0) 166 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444040 2021-10-15 03:21:37 2021-10-16 04:37:23 2021-10-16 05:45:56 1:08:33 0:19:19 0:49:14 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} 3
pass 6444041 2021-10-15 03:21:38 2021-10-16 04:39:02 2021-10-16 05:27:05 0:48:03 0:09:08 0:38:55 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6444042 2021-10-15 03:21:39 2021-10-16 04:39:51 2021-10-16 05:17:53 0:38:02 0:14:21 0:23:41 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
fail 6444043 2021-10-15 03:21:40 2021-10-16 04:41:32 2021-10-16 05:27:34 0:46:02 0:17:30 0:28:32 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

"2021-10-16T05:26:22.032530+0000 mon.b (mon.0) 324 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444044 2021-10-15 03:21:41 2021-10-16 04:51:40 2021-10-16 06:41:46 1:50:06 0:09:20 1:40:46 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6444045 2021-10-15 03:21:42 2021-10-16 04:58:45 2021-10-16 05:56:48 0:58:03 0:36:50 0:21:13 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6444046 2021-10-15 03:21:43 2021-10-16 05:00:39 2021-10-16 06:34:44 1:34:05 0:12:22 1:21:43 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6444047 2021-10-15 03:21:44 2021-10-16 05:09:48 2021-10-16 05:27:48 0:18:00 0:07:13 0:10:47 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} 1
fail 6444048 2021-10-15 03:21:44 2021-10-16 05:14:38 2021-10-16 05:46:06 0:31:28 0:16:23 0:15:05 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2021-10-16T05:34:02.363277+0000 mon.a (mon.0) 251 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6444049 2021-10-15 03:21:45 2021-10-16 05:15:02 2021-10-16 06:37:06 1:22:04 0:09:09 1:12:55 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_namespaces} 3
pass 6444050 2021-10-15 03:21:46 2021-10-16 05:16:49 2021-10-16 06:38:52 1:22:03 1:00:21 0:21:42 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6444051 2021-10-15 03:21:47 2021-10-16 05:17:54 2021-10-16 06:19:57 1:02:03 0:22:51 0:39:12 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} 3
fail 6444052 2021-10-15 03:21:48 2021-10-16 05:25:30 2021-10-16 06:25:02 0:59:32 0:17:16 0:42:16 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2021-10-16T06:24:09.721124+0000 mon.a (mon.0) 204 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444053 2021-10-15 03:21:49 2021-10-16 05:27:06 2021-10-16 05:51:06 0:24:00 0:12:40 0:11:20 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
fail 6444054 2021-10-15 03:21:49 2021-10-16 05:27:35 2021-10-16 07:11:40 1:44:05 0:17:27 1:26:38 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

"2021-10-16T07:09:00.313087+0000 mon.b (mon.0) 293 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444055 2021-10-15 03:21:50 2021-10-16 05:27:49 2021-10-16 05:45:49 0:18:00 0:07:18 0:10:42 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_read_only} 1
pass 6444056 2021-10-15 03:21:51 2021-10-16 05:28:58 2021-10-16 06:12:59 0:44:01 0:18:28 0:25:33 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6444057 2021-10-15 03:21:52 2021-10-16 05:45:05 2021-10-16 07:05:09 1:20:04 0:39:26 0:40:38 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
pass 6444058 2021-10-15 03:21:53 2021-10-16 05:45:50 2021-10-16 06:11:51 0:26:01 0:09:19 0:16:42 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6444059 2021-10-15 03:21:54 2021-10-16 05:51:08 2021-10-16 06:59:11 1:08:03 0:08:39 0:59:24 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6444060 2021-10-15 03:21:55 2021-10-16 05:55:54 2021-10-16 07:05:36 1:09:42 0:17:15 0:52:27 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

"2021-10-16T07:03:54.257785+0000 mon.a (mon.0) 242 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444061 2021-10-15 03:21:55 2021-10-16 05:56:49 2021-10-16 07:22:53 1:26:04 0:08:18 1:17:46 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6444062 2021-10-15 03:21:56 2021-10-16 06:11:52 2021-10-16 07:01:54 0:50:02 0:24:46 0:25:16 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
fail 6444063 2021-10-15 03:21:57 2021-10-16 06:13:01 2021-10-16 07:09:03 0:56:02 0:17:08 0:38:54 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

"2021-10-16T06:57:32.835809+0000 mon.b (mon.0) 111 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6444064 2021-10-15 03:21:58 2021-10-16 06:17:03 2021-10-16 06:33:03 0:16:00 0:07:09 0:08:51 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_whole_object_zeroout} 1
pass 6444065 2021-10-15 03:21:59 2021-10-16 06:19:58 2021-10-16 07:04:00 0:44:02 0:17:41 0:26:21 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6444066 2021-10-15 03:21:59 2021-10-16 06:33:04 2021-10-16 07:25:06 0:52:02 0:08:20 0:43:42 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_kernel} 3
fail 6444067 2021-10-15 03:22:00 2021-10-16 06:34:45 2021-10-16 07:52:49 1:18:04 0:17:24 1:00:40 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2021-10-16T07:39:59.102706+0000 mon.b (mon.0) 189 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6444068 2021-10-15 03:22:01 2021-10-16 06:36:19 2021-10-16 07:37:39 1:01:20 0:17:33 0:43:47 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2021-10-16T07:36:10.479060+0000 mon.a (mon.0) 198 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444069 2021-10-15 03:22:02 2021-10-16 06:37:07 2021-10-16 07:29:10 0:52:03 0:13:19 0:38:44 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} 3
fail 6444070 2021-10-15 03:22:03 2021-10-16 06:41:47 2021-10-16 07:13:48 0:32:01 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

Could not reconnect to ubuntu@gibba001.front.sepia.ceph.com

pass 6444071 2021-10-15 03:22:04 2021-10-16 06:42:54 2021-10-16 07:40:56 0:58:02 0:28:15 0:29:47 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_simple_big} 3
pass 6444072 2021-10-15 03:22:05 2021-10-16 06:59:12 2021-10-16 07:17:12 0:18:00 0:07:46 0:10:14 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} 1
fail 6444073 2021-10-15 03:22:05 2021-10-16 07:01:55 2021-10-16 07:49:57 0:48:02 0:16:32 0:31:30 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

"2021-10-16T07:38:43.177426+0000 mon.a (mon.0) 152 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6444074 2021-10-15 03:22:06 2021-10-16 07:04:01 2021-10-16 08:02:03 0:58:02 0:24:33 0:33:29 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_fio} 3
pass 6444075 2021-10-15 03:22:07 2021-10-16 07:05:11 2021-10-16 07:41:11 0:36:00 0:16:01 0:19:59 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_data_pool} 3
pass 6444076 2021-10-15 03:22:08 2021-10-16 07:08:34 2021-10-16 07:28:45 0:20:11 0:07:30 0:12:41 gibba master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
fail 6444077 2021-10-15 03:22:09 2021-10-16 07:09:04 2021-10-16 08:29:08 1:20:04 0:17:29 1:02:35 gibba master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
Failure Reason:

"2021-10-16T08:27:38.476478+0000 mon.b (mon.0) 148 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6444078 2021-10-15 03:22:10 2021-10-16 07:09:44 2021-10-16 08:54:00 1:44:16 0:17:43 1:26:33 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2021-10-16T08:52:11.084487+0000 mon.a (mon.0) 220 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6444079 2021-10-15 03:22:11 2021-10-16 07:11:42 2021-10-16 08:05:44 0:54:02 0:17:17 0:36:45 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2021-10-16T08:04:52.892765+0000 mon.b (mon.0) 150 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444080 2021-10-15 03:22:11 2021-10-16 07:13:50 2021-10-16 07:41:50 0:28:00 0:09:29 0:18:31 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_fallocate} 3
pass 6444081 2021-10-15 03:22:12 2021-10-16 07:17:13 2021-10-16 08:01:15 0:44:02 0:09:32 0:34:30 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6444082 2021-10-15 03:22:13 2021-10-16 07:22:54 2021-10-16 08:26:58 1:04:04 0:36:29 0:27:35 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6444083 2021-10-15 03:22:14 2021-10-16 07:25:07 2021-10-16 07:51:08 0:26:01 0:12:13 0:13:48 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6444084 2021-10-15 03:22:15 2021-10-16 07:29:11 2021-10-16 07:47:11 0:18:00 0:07:33 0:10:27 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_discard} 1
pass 6444085 2021-10-15 03:22:16 2021-10-16 07:40:58 2021-10-16 08:18:59 0:38:01 0:18:15 0:19:46 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6444086 2021-10-15 03:22:17 2021-10-16 07:41:12 2021-10-16 08:57:16 1:16:04 1:03:59 0:12:05 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6444087 2021-10-15 03:22:18 2021-10-16 07:41:51 2021-10-16 08:37:54 0:56:03 0:09:34 0:46:29 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_namespaces} 3
fail 6444088 2021-10-15 03:22:18 2021-10-16 07:47:12 2021-10-16 08:19:13 0:32:01 0:17:26 0:14:35 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

"2021-10-16T08:08:02.400762+0000 mon.a (mon.0) 123 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6444089 2021-10-15 03:22:19 2021-10-16 07:49:59 2021-10-16 08:21:59 0:32:00 0:19:33 0:12:27 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6444090 2021-10-15 03:22:20 2021-10-16 07:51:09 2021-10-16 08:25:10 0:34:01 0:14:24 0:19:37 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6444091 2021-10-15 03:22:21 2021-10-16 07:52:50 2021-10-16 09:18:54 1:26:04 0:11:13 1:14:51 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6444092 2021-10-15 03:22:22 2021-10-16 08:01:16 2021-10-16 08:25:16 0:24:00 0:09:01 0:14:59 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netns} 3
pass 6444093 2021-10-15 03:22:22 2021-10-16 08:02:04 2021-10-16 08:18:04 0:16:00 0:06:53 0:09:07 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_huge_image} 1
fail 6444094 2021-10-15 03:22:23 2021-10-16 08:05:45 2021-10-16 08:57:47 0:52:02 0:21:25 0:30:37 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
Failure Reason:

"2021-10-16T08:41:38.867202+0000 mon.b (mon.0) 296 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6444095 2021-10-15 03:22:24 2021-10-16 09:44:15 2021-10-16 10:14:49 0:30:34 0:10:02 0:20:32 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_symlinks} 3
fail 6444096 2021-10-15 03:22:25 2021-10-16 09:45:19 2021-10-16 10:21:21 0:36:02 0:17:01 0:19:01 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

"2021-10-16T10:09:29.163105+0000 mon.b (mon.0) 130 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6444097 2021-10-15 03:22:26 2021-10-16 09:52:12 2021-10-16 11:22:17 1:30:05 0:12:53 1:17:12 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
pass 6444098 2021-10-15 03:22:28 2021-10-16 09:53:20 2021-10-16 10:25:21 0:32:01 0:08:39 0:23:22 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6444099 2021-10-15 03:22:29 2021-10-16 09:53:36 2021-10-16 10:37:11 0:43:35 0:22:32 0:21:03 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6444100 2021-10-15 03:22:29 2021-10-16 09:53:52 2021-10-16 10:37:53 0:44:01 0:09:14 0:34:47 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_image_read} 3
pass 6444101 2021-10-15 03:22:30 2021-10-16 10:01:04 2021-10-16 10:17:04 0:16:00 0:07:13 0:08:47 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} 1
pass 6444102 2021-10-15 03:22:31 2021-10-16 10:03:58 2021-10-16 11:09:49 1:05:51 0:19:55 0:45:56 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
fail 6444103 2021-10-15 03:22:32 2021-10-16 10:05:23 2021-10-16 10:55:25 0:50:02 0:17:10 0:32:52 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

"2021-10-16T10:42:51.312789+0000 mon.a (mon.0) 112 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6444104 2021-10-15 03:22:33 2021-10-16 10:07:17 2021-10-16 10:51:19 0:44:02 0:18:03 0:25:59 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6444105 2021-10-15 03:22:33 2021-10-16 10:16:59 2021-10-16 10:45:00 0:28:01 0:08:03 0:19:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_snapshot_io} 3
fail 6444106 2021-10-15 03:22:34 2021-10-16 10:17:05 2021-10-16 11:45:10 1:28:05 0:17:06 1:10:59 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_unmap} 3
Failure Reason:

"2021-10-16T11:44:16.503052+0000 mon.b (mon.0) 365 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN)" in cluster log

pass 6444107 2021-10-15 03:22:35 2021-10-16 10:21:22 2021-10-16 12:29:28 2:08:06 0:10:55 1:57:11 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6444108 2021-10-15 03:22:36 2021-10-16 10:23:16 2021-10-16 11:31:19 1:08:03 0:25:05 0:42:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} 3
pass 6444109 2021-10-15 03:22:37 2021-10-16 10:25:22 2021-10-16 10:41:22 0:16:00 0:06:52 0:09:08 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_msgr_segments} 1
pass 6444110 2021-10-15 03:22:38 2021-10-16 10:36:32 2021-10-16 11:16:20 0:39:48 0:26:35 0:13:13 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6444111 2021-10-15 03:22:38 2021-10-16 10:37:12 2021-10-16 11:21:01 0:43:49 0:24:32 0:19:17 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_fio} 3
pass 6444112 2021-10-15 03:22:39 2021-10-16 10:37:55 2021-10-16 11:59:58 1:22:03 0:18:55 1:03:08 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_data_pool} 3
fail 6444113 2021-10-15 03:22:40 2021-10-16 10:41:24 2021-10-16 11:23:25 0:42:01 0:16:50 0:25:11 gibba master krbd/singleton/{bluestore-bitmap conf ms_mode$/{secure} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

"2021-10-16T11:22:41.471771+0000 mon.b (mon.0) 240 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444114 2021-10-15 03:22:41 2021-10-16 10:43:43 2021-10-16 12:00:48 1:17:05 1:01:44 0:15:21 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6444115 2021-10-15 03:22:42 2021-10-16 10:45:01 2021-10-16 11:45:04 1:00:03 0:09:25 0:50:38 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6444116 2021-10-15 03:22:43 2021-10-16 10:47:34 2021-10-16 11:17:38 0:30:04 0:14:38 0:15:26 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
fail 6444117 2021-10-15 03:22:44 2021-10-16 10:48:10 2021-10-16 11:50:12 1:02:02 0:17:13 0:44:49 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

"2021-10-16T11:48:55.983427+0000 mon.b (mon.0) 193 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6444118 2021-10-15 03:22:44 2021-10-16 10:50:25 2021-10-16 11:59:19 1:08:54 0:09:27 0:59:27 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6444119 2021-10-15 03:22:45 2021-10-16 10:51:20 2021-10-16 12:09:24 1:18:04 0:36:34 0:41:30 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6444120 2021-10-15 03:22:46 2021-10-16 10:54:03 2021-10-16 12:20:07 1:26:04 0:11:53 1:14:11 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6444121 2021-10-15 03:22:47 2021-10-16 10:55:26 2021-10-16 11:13:26 0:18:00 0:07:10 0:10:50 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_parent_overlap} 1
pass 6444122 2021-10-15 03:22:48 2021-10-16 10:57:10 2021-10-16 11:37:11 0:40:01 0:14:44 0:25:17 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6444123 2021-10-15 03:22:49 2021-10-16 11:13:27 2021-10-16 11:39:28 0:26:01 0:09:24 0:16:37 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} 3
pass 6444124 2021-10-15 03:22:50 2021-10-16 11:22:18 2021-10-16 12:48:22 1:26:04 1:00:42 0:25:22 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
fail 6444125 2021-10-15 03:22:50 2021-10-16 11:23:26 2021-10-16 12:11:28 0:48:02 0:10:02 0:38:00 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_enumerate} 3
Failure Reason:

Command failed (workunit test rbd/krbd_udev_enumerate.sh) on gibba020 with status 134: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4cb57b753999caf76cc355bfd7adc03f47001c02 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_udev_enumerate.sh'

pass 6444126 2021-10-15 03:22:51 2021-10-16 11:31:20 2021-10-16 12:47:24 1:16:04 0:14:56 1:01:08 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6444127 2021-10-15 03:22:52 2021-10-16 11:37:12 2021-10-16 12:07:13 0:30:01 0:12:35 0:17:26 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6444128 2021-10-15 03:22:53 2021-10-16 11:38:01 2021-10-16 12:32:01 0:54:00 0:09:08 0:44:52 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} 3
pass 6444129 2021-10-15 03:22:54 2021-10-16 11:39:29 2021-10-16 11:57:29 0:18:00 0:07:58 0:10:02 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} 1
pass 6444130 2021-10-15 03:22:55 2021-10-16 11:45:05 2021-10-16 12:31:07 0:46:02 0:29:34 0:16:28 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6444131 2021-10-15 03:22:56 2021-10-16 11:45:11 2021-10-16 12:21:12 0:36:01 0:09:28 0:26:33 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6444132 2021-10-15 03:22:56 2021-10-16 11:50:13 2021-10-16 13:12:17 1:22:04 0:08:22 1:13:42 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6444133 2021-10-15 03:22:57 2021-10-16 11:57:31 2021-10-16 12:29:31 0:32:00 0:17:19 0:14:41 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

"2021-10-16T12:17:19.095133+0000 mon.b (mon.0) 142 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6444134 2021-10-15 03:22:58 2021-10-16 11:59:59 2021-10-16 12:22:00 0:22:01 0:08:31 0:13:30 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6444135 2021-10-15 03:22:59 2021-10-16 12:07:14 2021-10-16 12:45:15 0:38:01 0:23:25 0:14:36 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
fail 6444136 2021-10-15 03:23:00 2021-10-16 12:09:25 2021-10-16 12:57:26 0:48:01 0:17:11 0:30:50 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

"2021-10-16T12:55:24.798513+0000 mon.a (mon.0) 279 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444137 2021-10-15 03:23:01 2021-10-16 12:10:55 2021-10-16 13:00:41 0:49:46 0:07:07 0:42:39 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_whole_object_zeroout} 1
pass 6444138 2021-10-15 03:23:02 2021-10-16 12:11:29 2021-10-16 12:45:30 0:34:01 0:13:53 0:20:08 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6444139 2021-10-15 03:23:03 2021-10-16 12:20:08 2021-10-16 13:10:10 0:50:02 0:37:43 0:12:19 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
pass 6444140 2021-10-15 03:23:04 2021-10-16 12:21:13 2021-10-16 12:53:14 0:32:01 0:08:24 0:23:37 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_kernel} 3
pass 6444141 2021-10-15 03:23:04 2021-10-16 12:22:01 2021-10-16 12:58:02 0:36:01 0:16:13 0:19:48 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6444142 2021-10-15 03:23:05 2021-10-16 12:29:29 2021-10-16 14:05:34 1:36:05 0:08:09 1:27:56 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6444143 2021-10-15 03:23:06 2021-10-16 12:29:32 2021-10-16 12:55:33 0:26:01 0:13:18 0:12:43 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_unmap} 3
pass 6444144 2021-10-15 03:23:07 2021-10-16 12:31:08 2021-10-16 13:15:10 0:44:02 0:14:35 0:29:27 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6444145 2021-10-15 03:23:08 2021-10-16 12:43:29 2021-10-16 13:23:44 0:40:15 0:27:19 0:12:56 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_simple_big} 3
pass 6444146 2021-10-15 03:23:09 2021-10-16 12:44:30 2021-10-16 13:01:47 0:17:17 0:07:42 0:09:35 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_deep_flatten} 1
pass 6444147 2021-10-15 03:23:09 2021-10-16 12:44:30 2021-10-16 13:35:10 0:50:40 0:29:54 0:20:46 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6444148 2021-10-15 03:23:10 2021-10-16 12:45:17 2021-10-16 14:03:20 1:18:03 0:24:54 0:53:09 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} 3
pass 6444149 2021-10-15 03:23:11 2021-10-16 12:45:32 2021-10-16 13:13:32 0:28:00 0:15:48 0:12:12 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} 3
pass 6444150 2021-10-15 03:23:12 2021-10-16 12:47:25 2021-10-16 13:19:26 0:32:01 0:07:22 0:24:39 gibba master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
pass 6444151 2021-10-15 03:23:13 2021-10-16 12:48:23 2021-10-16 13:44:26 0:56:03 0:19:14 0:36:49 gibba master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
fail 6444152 2021-10-15 03:23:14 2021-10-16 12:53:15 2021-10-16 13:27:16 0:34:01 0:17:42 0:16:19 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2021-10-16T13:15:15.825664+0000 mon.b (mon.0) 195 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6444153 2021-10-15 03:23:15 2021-10-16 12:53:51 2021-10-16 13:40:21 0:46:30 0:15:07 0:31:23 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6444154 2021-10-15 03:23:15 2021-10-16 12:55:34 2021-10-16 13:17:35 0:22:01 0:09:14 0:12:47 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_fallocate} 3
fail 6444155 2021-10-15 03:23:16 2021-10-16 12:57:28 2021-10-16 13:45:30 0:48:02 0:17:14 0:30:48 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} 3
Failure Reason:

"2021-10-16T13:44:04.312878+0000 mon.b (mon.0) 289 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444156 2021-10-15 03:23:17 2021-10-16 12:58:03 2021-10-16 13:58:06 1:00:03 0:36:43 0:23:20 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6444157 2021-10-15 03:23:18 2021-10-16 13:10:13 2021-10-16 13:34:13 0:24:00 0:11:54 0:12:06 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6444158 2021-10-15 03:23:19 2021-10-16 13:12:18 2021-10-16 13:30:18 0:18:00 0:07:37 0:10:23 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} 1
fail 6444159 2021-10-15 03:23:20 2021-10-16 13:13:04 2021-10-16 13:56:19 0:43:15 0:14:18 0:28:57 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2021-10-16T13:46:01.537609+0000 mon.a (mon.0) 118 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6444160 2021-10-15 03:23:21 2021-10-16 13:13:33 2021-10-16 13:47:34 0:34:01 0:12:24 0:21:37 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_namespaces} 3
pass 6444161 2021-10-15 03:23:22 2021-10-16 13:15:11 2021-10-16 14:57:16 1:42:05 1:09:45 0:32:20 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6444162 2021-10-15 03:23:23 2021-10-16 13:17:36 2021-10-16 14:05:38 0:48:02 0:19:36 0:28:26 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6444163 2021-10-15 03:23:23 2021-10-16 13:19:28 2021-10-16 15:07:33 1:48:05 0:17:14 1:30:51 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2021-10-16T15:06:45.341633+0000 mon.a (mon.0) 301 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444164 2021-10-15 03:23:24 2021-10-16 13:27:17 2021-10-16 14:25:20 0:58:03 0:10:54 0:47:09 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6444165 2021-10-15 03:23:25 2021-10-16 13:29:06 2021-10-16 14:05:10 0:36:04 0:09:06 0:26:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netns} 3
pass 6444166 2021-10-15 03:23:26 2021-10-16 13:30:20 2021-10-16 14:14:21 0:44:01 0:07:09 0:36:52 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_huge_image} 1
pass 6444167 2021-10-15 03:23:27 2021-10-16 13:34:14 2021-10-16 14:16:16 0:42:02 0:23:23 0:18:39 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6444168 2021-10-15 03:23:27 2021-10-16 13:43:48 2021-10-16 15:11:28 1:27:40 1:03:18 0:24:22 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6444169 2021-10-15 03:23:28 2021-10-16 13:44:27 2021-10-16 14:10:28 0:26:01 0:09:55 0:16:06 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6444170 2021-10-15 03:23:29 2021-10-16 13:45:31 2021-10-16 15:21:36 1:36:05 0:08:48 1:27:17 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6444171 2021-10-15 03:23:30 2021-10-16 13:47:36 2021-10-16 14:29:37 0:42:01 0:13:03 0:28:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_concurrent} 3
pass 6444172 2021-10-15 03:23:31 2021-10-16 13:56:20 2021-10-16 14:25:49 0:29:29 0:08:59 0:20:30 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6444173 2021-10-15 03:23:32 2021-10-16 13:58:07 2021-10-16 15:08:11 1:10:04 0:23:04 0:47:00 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6444174 2021-10-15 03:23:32 2021-10-16 14:03:22 2021-10-16 14:25:22 0:22:00 0:08:55 0:13:05 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
pass 6444175 2021-10-15 03:23:33 2021-10-16 14:04:32 2021-10-16 14:21:44 0:17:12 0:07:46 0:09:26 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_modprobe} 1
pass 6444176 2021-10-15 03:23:34 2021-10-16 14:04:32 2021-10-16 14:53:04 0:48:32 0:19:45 0:28:47 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
fail 6444177 2021-10-15 03:23:35 2021-10-16 14:05:35 2021-10-16 15:01:38 0:56:03 0:17:59 0:38:04 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

"2021-10-16T14:58:46.755014+0000 mon.b (mon.0) 286 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6444178 2021-10-15 03:23:36 2021-10-16 14:05:39 2021-10-16 14:37:40 0:32:01 0:17:18 0:14:43 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2021-10-16T14:26:38.460987+0000 mon.b (mon.0) 205 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6444179 2021-10-15 03:23:37 2021-10-16 14:10:29 2021-10-16 14:52:31 0:42:02 0:08:17 0:33:45 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6444180 2021-10-15 03:23:38 2021-10-16 14:14:22 2021-10-16 14:40:23 0:26:01 0:13:30 0:12:31 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} 3
pass 6444181 2021-10-15 03:23:38 2021-10-16 14:16:17 2021-10-16 15:30:21 1:14:04 0:11:09 1:02:55 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6444182 2021-10-15 03:23:39 2021-10-16 14:21:44 2021-10-16 15:11:36 0:49:52 0:26:31 0:23:21 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_simple_big} 3
pass 6444183 2021-10-15 03:23:40 2021-10-16 14:25:15 2021-10-16 15:09:30 0:44:15 0:07:00 0:37:15 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} 1
pass 6444184 2021-10-15 03:23:41 2021-10-16 14:25:21 2021-10-16 15:49:26 1:24:05 0:30:04 0:54:01 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6444185 2021-10-15 03:23:42 2021-10-16 14:25:23 2021-10-16 15:49:28 1:24:05 0:25:20 0:58:45 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_fio} 3
pass 6444186 2021-10-15 03:23:42 2021-10-16 14:29:38 2021-10-16 15:11:40 0:42:02 0:19:30 0:22:32 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_data_pool} 3
pass 6444187 2021-10-15 03:23:43 2021-10-16 14:37:43 2021-10-16 15:15:44 0:38:01 0:10:07 0:27:54 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6444188 2021-10-15 03:23:44 2021-10-16 14:40:25 2021-10-16 15:38:28 0:58:03 0:14:35 0:43:28 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
fail 6444189 2021-10-15 03:23:45 2021-10-16 14:52:20 2021-10-16 15:58:53 1:06:33 0:17:16 0:49:17 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

"2021-10-16T15:57:53.187166+0000 mon.a (mon.0) 210 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444190 2021-10-15 03:23:46 2021-10-16 14:52:32 2021-10-16 15:18:33 0:26:01 0:09:30 0:16:31 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6444191 2021-10-15 03:23:47 2021-10-16 14:57:17 2021-10-16 16:01:21 1:04:04 0:36:51 0:27:13 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6444192 2021-10-15 03:23:48 2021-10-16 15:01:39 2021-10-16 15:41:41 0:40:02 0:12:05 0:27:57 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6444193 2021-10-15 03:23:48 2021-10-16 15:07:35 2021-10-16 15:25:35 0:18:00 0:07:24 0:10:36 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_parent_overlap} 1
fail 6444194 2021-10-15 03:23:49 2021-10-16 15:08:12 2021-10-16 16:30:17 1:22:05 0:17:24 1:04:41 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2021-10-16T16:28:45.329424+0000 mon.a (mon.0) 236 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444195 2021-10-15 03:23:50 2021-10-16 15:11:42 2021-10-16 16:09:45 0:58:03 0:40:05 0:17:58 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 6444196 2021-10-15 03:23:51 2021-10-16 15:15:45 2021-10-16 15:41:46 0:26:01 0:09:32 0:16:29 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_namespaces} 3
pass 6444197 2021-10-15 03:23:52 2021-10-16 15:18:34 2021-10-16 17:40:43 2:22:09 1:03:07 1:19:02 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
fail 6444198 2021-10-15 03:23:52 2021-10-16 15:21:38 2021-10-16 15:55:39 0:34:01 0:17:41 0:16:20 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_enumerate} 3
Failure Reason:

"2021-10-16T15:53:26.685990+0000 mon.b (mon.0) 182 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444199 2021-10-15 03:23:53 2021-10-16 15:25:36 2021-10-16 16:05:38 0:40:02 0:14:50 0:25:12 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6444200 2021-10-15 03:23:54 2021-10-16 15:29:34 2021-10-16 16:05:17 0:35:43 0:12:33 0:23:10 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6444201 2021-10-15 03:23:55 2021-10-16 15:30:22 2021-10-16 16:04:24 0:34:02 0:09:22 0:24:40 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netns} 3
pass 6444202 2021-10-15 03:23:56 2021-10-16 15:38:29 2021-10-16 16:12:30 0:34:01 0:07:44 0:26:17 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_read_only} 1
pass 6444203 2021-10-15 03:23:57 2021-10-16 15:39:56 2021-10-16 16:26:20 0:46:24 0:25:51 0:20:33 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6444204 2021-10-15 03:23:57 2021-10-16 15:41:42 2021-10-16 16:09:43 0:28:01 0:09:30 0:18:31 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6444205 2021-10-15 03:23:59 2021-10-16 15:41:47 2021-10-16 16:49:51 1:08:04 0:09:13 0:58:51 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6444206 2021-10-15 03:24:00 2021-10-16 15:48:57 2021-10-16 16:28:51 0:39:54 0:13:03 0:26:51 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} 3
dead 6444207 2021-10-15 03:24:01 2021-10-16 15:49:27 2021-10-16 16:17:28 0:28:01 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_huge_tickets}
Failure Reason:

reached maximum tries (100) after waiting for 600 seconds

fail 6444208 2021-10-15 03:24:02 2021-10-16 15:49:30 2021-10-16 17:29:39 1:40:09 0:17:57 1:22:12 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2021-10-16T17:26:54.753401+0000 mon.a (mon.0) 215 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6444209 2021-10-15 03:24:03 2021-10-16 15:55:40 2021-10-16 17:27:46 1:32:06 0:17:34 1:14:32 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

"2021-10-16T17:26:30.423703+0000 mon.a (mon.0) 216 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6444210 2021-10-15 03:24:03 2021-10-16 16:01:22 2021-10-16 16:19:22 0:18:00 0:07:31 0:10:29 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} 1
pass 6444211 2021-10-15 03:24:04 2021-10-16 16:03:30 2021-10-16 16:33:59 0:30:29 0:16:15 0:14:14 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6444212 2021-10-15 03:24:05 2021-10-16 16:04:25 2021-10-16 16:30:26 0:26:01 0:08:45 0:17:16 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} 3
pass 6444213 2021-10-15 03:24:06 2021-10-16 16:04:40 2021-10-16 16:34:37 0:29:57 0:16:37 0:13:20 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
fail 6444214 2021-10-15 03:24:07 2021-10-16 16:05:20 2021-10-16 17:01:23 0:56:03 0:17:29 0:38:34 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2021-10-16T16:48:35.149232+0000 mon.a (mon.0) 134 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6444215 2021-10-15 03:24:07 2021-10-16 16:05:39 2021-10-16 16:33:40 0:28:01 0:13:23 0:14:38 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_unmap} 3
pass 6444216 2021-10-15 03:24:08 2021-10-16 16:09:44 2021-10-16 16:59:47 0:50:03 0:12:16 0:37:47 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6444217 2021-10-15 03:24:09 2021-10-16 16:09:46 2021-10-16 17:29:52 1:20:06 0:28:37 0:51:29 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} 3