Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6360906 2021-08-27 03:20:39 2021-08-28 15:20:17 2021-08-28 15:37:18 0:17:01 0:07:05 0:09:56 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_deep_flatten} 1
pass 6360907 2021-08-27 03:20:39 2021-08-28 15:20:17 2021-08-28 15:50:12 0:29:55 0:18:42 0:11:13 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6360908 2021-08-27 03:20:40 2021-08-28 15:20:57 2021-08-28 16:01:03 0:40:06 0:24:40 0:15:26 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_fio} 3
pass 6360909 2021-08-27 03:20:41 2021-08-28 15:25:58 2021-08-28 15:56:10 0:30:12 0:15:19 0:14:53 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_data_pool} 3
fail 6360910 2021-08-27 03:20:42 2021-08-28 15:28:59 2021-08-28 19:34:58 4:05:59 3:47:13 0:18:46 gibba master krbd/singleton/{bluestore-bitmap conf ms_mode$/{secure} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Command failed on gibba036 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude25oheb7w -r -- '-g auto -g blockdev -x clone'"

pass 6360911 2021-08-27 03:20:42 2021-08-28 15:35:40 2021-08-28 16:28:29 0:52:49 0:40:44 0:12:05 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_fio} 3
fail 6360912 2021-08-27 03:20:43 2021-08-28 15:37:20 2021-08-28 15:57:32 0:20:12 gibba master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major

pass 6360913 2021-08-27 03:20:44 2021-08-28 15:50:22 2021-08-28 16:07:29 0:17:07 0:06:33 0:10:34 gibba master krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} 1
fail 6360914 2021-08-27 03:20:44 2021-08-28 15:50:22 2021-08-28 16:23:16 0:32:54 0:17:01 0:15:53 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2021-08-28T16:22:17.321674+0000 mon.a (mon.0) 235 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6360915 2021-08-27 03:20:45 2021-08-28 15:56:13 2021-08-28 16:26:15 0:30:02 0:14:59 0:15:03 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6360916 2021-08-27 03:20:46 2021-08-28 16:01:05 2021-08-28 16:28:51 0:27:46 0:09:06 0:18:40 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} 3
pass 6360917 2021-08-27 03:20:47 2021-08-28 16:09:46 2021-08-28 16:45:25 0:35:39 0:09:12 0:26:27 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6360918 2021-08-27 03:20:48 2021-08-28 16:26:18 2021-08-28 17:15:51 0:49:33 0:35:39 0:13:54 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6360919 2021-08-27 03:20:48 2021-08-28 16:28:38 2021-08-28 16:52:06 0:23:28 0:11:30 0:11:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6360920 2021-08-27 03:20:49 2021-08-28 16:28:59 2021-08-28 16:45:50 0:16:51 0:07:20 0:09:31 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_discard} 1
fail 6360921 2021-08-27 03:20:50 2021-08-28 16:28:59 2021-08-28 17:12:39 0:43:40 0:15:02 0:28:38 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
Failure Reason:

"2021-08-28T17:01:51.939745+0000 mon.a (mon.0) 122 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6360922 2021-08-27 03:20:51 2021-08-28 16:45:31 2021-08-28 17:13:27 0:27:56 0:09:26 0:18:30 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} 3
pass 6360923 2021-08-27 03:20:51 2021-08-28 16:52:12 2021-08-28 18:31:46 1:39:34 1:08:07 0:31:27 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6360924 2021-08-27 03:20:52 2021-08-28 17:12:44 2021-08-28 17:40:39 0:27:55 0:16:39 0:11:16 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6360925 2021-08-27 03:20:53 2021-08-28 17:13:35 2021-08-28 17:45:10 0:31:35 0:16:53 0:14:42 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2021-08-28T17:42:22.731197+0000 mon.a (mon.0) 209 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6360926 2021-08-27 03:20:54 2021-08-28 17:15:55 2021-08-28 18:03:40 0:47:45 0:11:19 0:36:26 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6360927 2021-08-27 03:20:54 2021-08-28 17:40:29 2021-08-28 18:01:52 0:21:23 0:09:08 0:12:15 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} 3
pass 6360928 2021-08-27 03:20:55 2021-08-28 17:40:49 2021-08-28 17:57:52 0:17:03 0:07:01 0:10:02 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} 1
pass 6360929 2021-08-27 03:20:56 2021-08-28 17:40:49 2021-08-28 18:31:04 0:50:15 0:21:00 0:29:15 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
fail 6360930 2021-08-27 03:20:57 2021-08-28 17:58:01 2021-08-28 18:31:11 0:33:10 0:17:04 0:16:06 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_symlinks} 3
Failure Reason:

"2021-08-28T18:30:05.650122+0000 mon.a (mon.0) 269 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6360931 2021-08-27 03:20:57 2021-08-28 18:02:02 2021-08-28 18:24:51 0:22:49 0:08:29 0:14:20 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6360932 2021-08-27 03:20:58 2021-08-28 18:03:43 2021-08-28 18:50:10 0:46:27 0:12:24 0:34:03 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_concurrent} 3
pass 6360933 2021-08-27 03:20:59 2021-08-28 18:24:55 2021-08-28 18:52:13 0:27:18 0:09:13 0:18:05 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6360934 2021-08-27 03:20:59 2021-08-28 18:31:06 2021-08-28 19:04:16 0:33:10 0:22:12 0:10:58 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6360935 2021-08-27 03:21:00 2021-08-28 18:31:17 2021-08-28 18:52:52 0:21:35 0:09:29 0:12:06 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_image_read} 3
pass 6360936 2021-08-27 03:21:01 2021-08-28 18:31:47 2021-08-28 18:48:39 0:16:52 0:07:43 0:09:09 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_modprobe} 1
pass 6360937 2021-08-27 03:21:02 2021-08-28 18:31:47 2021-08-28 19:17:23 0:45:36 0:15:03 0:30:33 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6360938 2021-08-27 03:21:02 2021-08-28 18:50:19 2021-08-28 20:03:35 1:13:16 1:00:29 0:12:47 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6360939 2021-08-27 03:21:03 2021-08-28 18:52:20 2021-08-28 19:14:07 0:21:47 0:08:30 0:13:17 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_kernel} 3
fail 6360940 2021-08-27 03:21:04 2021-08-28 18:53:00 2021-08-28 19:33:34 0:40:34 0:17:10 0:23:24 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2021-08-28T19:32:04.990032+0000 mon.a (mon.0) 195 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6360941 2021-08-27 03:21:05 2021-08-28 19:04:22 2021-08-28 19:31:35 0:27:13 0:08:04 0:19:09 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
fail 6360942 2021-08-27 03:21:05 2021-08-28 19:12:33 2021-08-28 19:43:21 0:30:48 0:17:09 0:13:39 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_unmap} 3
Failure Reason:

"2021-08-28T19:41:22.523441+0000 mon.a (mon.0) 281 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6360943 2021-08-27 03:21:06 2021-08-28 19:14:14 2021-08-28 19:38:35 0:24:21 0:10:20 0:14:01 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6360944 2021-08-27 03:21:07 2021-08-28 19:17:24 2021-08-28 20:06:50 0:49:26 0:23:54 0:25:32 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_simple_big} 3
dead 6360945 2021-08-27 03:21:08 2021-08-28 19:31:36 2021-08-28 19:51:33 0:19:57 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_msgr_segments} 1
Failure Reason:

Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds

pass 6360946 2021-08-27 03:21:09 2021-08-28 19:33:37 2021-08-28 20:11:48 0:38:11 0:21:04 0:17:07 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
fail 6360947 2021-08-27 03:21:09 2021-08-28 19:38:38 2021-08-28 20:12:25 0:33:47 0:16:57 0:16:50 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

"2021-08-28T20:10:19.679821+0000 mon.a (mon.0) 253 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6360948 2021-08-27 03:21:10 2021-08-28 19:43:29 2021-08-28 20:20:46 0:37:17 0:18:22 0:18:55 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} 3
pass 6360949 2021-08-27 03:21:11 2021-08-28 19:51:51 2021-08-28 20:24:52 0:33:01 0:08:51 0:24:10 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6360950 2021-08-27 03:21:12 2021-08-28 20:03:42 2021-08-28 20:32:03 0:28:21 0:13:58 0:14:23 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6360951 2021-08-27 03:21:12 2021-08-28 20:06:53 2021-08-28 20:33:05 0:26:12 0:09:19 0:16:53 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_fallocate} 3
pass 6360952 2021-08-27 03:21:13 2021-08-28 20:11:54 2021-08-28 20:42:01 0:30:07 0:09:05 0:21:02 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6360953 2021-08-27 03:21:14 2021-08-28 20:20:55 2021-08-28 21:14:09 0:53:14 0:36:14 0:17:00 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6360954 2021-08-27 03:21:15 2021-08-28 20:24:55 2021-08-28 20:55:14 0:30:19 0:11:15 0:19:04 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6360955 2021-08-27 03:21:15 2021-08-28 20:32:06 2021-08-28 20:49:01 0:16:55 0:07:00 0:09:55 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} 1
pass 6360956 2021-08-27 03:21:16 2021-08-28 20:32:07 2021-08-28 21:04:19 0:32:12 0:18:30 0:13:42 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6360957 2021-08-27 03:21:17 2021-08-28 20:33:07 2021-08-28 21:03:15 0:30:08 0:09:03 0:21:05 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_namespaces} 3
pass 6360958 2021-08-27 03:21:17 2021-08-28 20:42:08 2021-08-28 22:04:33 1:22:25 0:58:17 0:24:08 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6360959 2021-08-27 03:21:18 2021-08-28 20:55:20 2021-08-28 21:34:35 0:39:15 0:20:26 0:18:49 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} 3
fail 6360960 2021-08-27 03:21:19 2021-08-28 21:03:21 2021-08-28 21:33:30 0:30:09 0:16:50 0:13:19 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2021-08-28T21:20:50.337391+0000 mon.a (mon.0) 116 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6360961 2021-08-27 03:21:20 2021-08-28 21:04:22 2021-08-28 21:37:25 0:33:03 0:11:25 0:21:38 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
fail 6360962 2021-08-27 03:21:20 2021-08-28 21:14:13 2021-08-28 22:02:44 0:48:31 0:16:45 0:31:46 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

"2021-08-28T22:00:04.408936+0000 mon.a (mon.0) 270 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6360963 2021-08-27 03:21:21 2021-08-28 21:33:36 2021-08-28 21:50:33 0:16:57 0:07:15 0:09:42 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_read_only} 1
fail 6360964 2021-08-27 03:21:22 2021-08-28 21:33:36 2021-08-28 22:01:49 0:28:13 0:16:12 0:12:01 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

pass 6360965 2021-08-27 03:21:23 2021-08-28 21:34:37 2021-08-28 22:30:39 0:56:02 0:42:14 0:13:48 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
pass 6360966 2021-08-27 03:21:23 2021-08-28 21:37:27 2021-08-28 22:23:02 0:45:35 0:08:58 0:36:37 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6360967 2021-08-27 03:21:24 2021-08-28 22:01:50 2021-08-28 22:23:51 0:22:01 0:08:06 0:13:55 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6360968 2021-08-27 03:21:25 2021-08-28 22:04:41 2021-08-28 22:48:14 0:43:33 0:12:53 0:30:40 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_concurrent} 3
pass 6360969 2021-08-27 03:21:25 2021-08-28 22:23:03 2021-08-28 22:42:57 0:19:54 0:08:05 0:11:49 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6360970 2021-08-27 03:21:26 2021-08-28 22:23:53 2021-08-28 23:02:01 0:38:08 0:22:02 0:16:06 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6360971 2021-08-27 03:21:27 2021-08-28 22:29:04 2021-08-28 22:49:52 0:20:48 0:08:48 0:12:00 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} 3
pass 6360972 2021-08-27 03:21:28 2021-08-28 22:30:45 2021-08-28 22:47:38 0:16:53 0:07:07 0:09:46 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_whole_object_zeroout} 1
pass 6360973 2021-08-27 03:21:28 2021-08-28 22:30:45 2021-08-28 23:12:17 0:41:32 0:17:10 0:24:22 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6360974 2021-08-27 03:21:29 2021-08-28 22:43:07 2021-08-28 23:07:23 0:24:16 0:08:13 0:16:03 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_kernel} 3
pass 6360975 2021-08-27 03:21:30 2021-08-28 22:48:17 2021-08-28 23:15:06 0:26:49 0:14:50 0:11:59 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6360976 2021-08-27 03:21:31 2021-08-28 22:49:58 2021-08-28 23:21:21 0:31:23 0:08:11 0:23:12 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6360977 2021-08-27 03:21:31 2021-08-28 23:02:09 2021-08-28 23:30:38 0:28:29 0:12:54 0:15:35 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} 3
pass 6360978 2021-08-27 03:21:32 2021-08-28 23:07:30 2021-08-28 23:35:27 0:27:57 0:11:08 0:16:49 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6360979 2021-08-27 03:21:33 2021-08-28 23:12:21 2021-08-28 23:52:25 0:40:04 0:26:49 0:13:15 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_simple_big} 3
pass 6360980 2021-08-27 03:21:34 2021-08-28 23:15:12 2021-08-28 23:32:23 0:17:11 0:06:56 0:10:15 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} 1
dead 6360981 2021-08-27 03:21:34 2021-08-28 23:15:12 2021-08-28 23:39:27 0:24:15 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds

fail 6360982 2021-08-27 03:21:35 2021-08-28 23:21:23 2021-08-28 23:59:56 0:38:33 0:16:51 0:21:42 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_fio} 3
Failure Reason:

"2021-08-28T23:57:16.843851+0000 mon.a (mon.0) 214 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6360983 2021-08-27 03:21:36 2021-08-28 23:30:44 2021-08-29 00:00:45 0:30:01 0:14:44 0:15:17 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_data_pool} 3
pass 6360984 2021-08-27 03:21:37 2021-08-28 23:35:35 2021-08-28 23:56:37 0:21:02 0:07:02 0:14:00 gibba master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
fail 6360985 2021-08-27 03:21:38 2021-08-28 23:39:46 2021-08-29 00:21:33 0:41:47 0:16:59 0:24:48 gibba master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
Failure Reason:

"2021-08-29T00:19:07.335636+0000 mon.a (mon.0) 262 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6360986 2021-08-27 03:21:38 2021-08-28 23:52:27 2021-08-29 00:25:48 0:33:21 0:17:02 0:16:19 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2021-08-29T00:23:07.162045+0000 mon.a (mon.0) 325 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6360987 2021-08-27 03:21:39 2021-08-28 23:56:38 2021-08-29 00:28:00 0:31:22 0:15:44 0:15:38 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6360988 2021-08-27 03:21:40 2021-08-29 00:00:49 2021-08-29 00:40:36 0:39:47 0:08:42 0:31:05 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_fallocate} 3
pass 6360989 2021-08-27 03:21:41 2021-08-29 00:21:41 2021-08-29 00:46:47 0:25:06 0:09:06 0:16:00 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6360990 2021-08-27 03:21:41 2021-08-29 00:25:52 2021-08-29 01:15:22 0:49:30 0:35:09 0:14:21 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6360991 2021-08-27 03:21:42 2021-08-29 00:28:02 2021-08-29 01:03:50 0:35:48 0:11:19 0:24:29 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6360992 2021-08-27 03:21:43 2021-08-29 00:40:44 2021-08-29 01:04:05 0:23:21 0:06:52 0:16:29 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_discard} 1
pass 6360993 2021-08-27 03:21:44 2021-08-29 00:46:55 2021-08-29 01:33:02 0:46:07 0:17:15 0:28:52 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6360994 2021-08-27 03:21:44 2021-08-29 01:03:57 2021-08-29 02:17:21 1:13:24 1:02:01 0:11:23 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6360995 2021-08-27 03:21:45 2021-08-29 01:04:07 2021-08-29 01:36:37 0:32:30 0:09:14 0:23:16 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_namespaces} 3
pass 6360996 2021-08-27 03:21:46 2021-08-29 01:15:29 2021-08-29 02:48:25 1:32:56 1:02:58 0:29:58 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6360997 2021-08-27 03:21:47 2021-08-29 01:33:11 2021-08-29 02:03:48 0:30:37 0:16:09 0:14:28 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6360998 2021-08-27 03:21:47 2021-08-29 01:36:42 2021-08-29 02:29:14 0:52:32 0:14:18 0:38:14 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6360999 2021-08-27 03:21:48 2021-08-29 02:03:55 2021-08-29 02:38:27 0:34:32 0:10:12 0:24:20 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6361000 2021-08-27 03:21:49 2021-08-29 02:17:27 2021-08-29 02:48:26 0:30:59 0:08:45 0:22:14 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netns} 3
pass 6361001 2021-08-27 03:21:50 2021-08-29 02:29:18 2021-08-29 02:53:39 0:24:21 0:06:22 0:17:59 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_huge_image} 1
pass 6361002 2021-08-27 03:21:50 2021-08-29 02:38:29 2021-08-29 03:21:42 0:43:13 0:20:54 0:22:19 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6361003 2021-08-27 03:21:51 2021-08-29 02:48:31 2021-08-29 03:09:41 0:21:10 0:09:47 0:11:23 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6361004 2021-08-27 03:21:52 2021-08-29 02:48:31 2021-08-29 03:14:53 0:26:22 0:08:56 0:17:26 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6361005 2021-08-27 03:21:53 2021-08-29 02:53:42 2021-08-29 03:32:50 0:39:08 0:12:44 0:26:24 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
fail 6361006 2021-08-27 03:21:53 2021-08-29 03:09:44 2021-08-29 03:44:05 0:34:21 0:16:58 0:17:23 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_huge_tickets} 3
Failure Reason:

"2021-08-29T03:41:24.001737+0000 mon.a (mon.0) 212 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6361007 2021-08-27 03:21:54 2021-08-29 03:14:54 2021-08-29 03:55:04 0:40:10 0:20:51 0:19:19 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6361008 2021-08-27 03:21:55 2021-08-29 03:21:45 2021-08-29 03:54:33 0:32:48 0:10:37 0:22:11 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_image_read} 3
pass 6361009 2021-08-27 03:21:56 2021-08-29 03:32:57 2021-08-29 03:59:01 0:26:04 0:06:31 0:19:33 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} 1
pass 6361010 2021-08-27 03:21:56 2021-08-29 03:44:09 2021-08-29 04:25:57 0:41:48 0:19:05 0:22:43 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6361011 2021-08-27 03:21:57 2021-08-29 03:54:40 2021-08-29 04:16:25 0:21:45 0:08:00 0:13:45 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} 3
fail 6361012 2021-08-27 03:21:58 2021-08-29 03:55:10 2021-08-29 04:28:22 0:33:12 0:16:59 0:16:13 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2021-08-29T04:27:17.422903+0000 mon.a (mon.0) 269 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6361013 2021-08-27 03:21:59 2021-08-29 03:59:11 2021-08-29 04:35:48 0:36:37 0:07:51 0:28:46 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_snapshot_io} 3
fail 6361014 2021-08-27 03:21:59 2021-08-29 04:16:33 2021-08-29 04:55:17 0:38:44 0:17:12 0:21:32 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_unmap} 3
Failure Reason:

"2021-08-29T04:53:46.210555+0000 mon.a (mon.0) 288 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6361015 2021-08-27 03:22:00 2021-08-29 04:26:05 2021-08-29 04:59:05 0:33:00 0:10:12 0:22:48 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6361016 2021-08-27 03:22:01 2021-08-29 04:35:57 2021-08-29 05:34:16 0:58:19 0:25:48 0:32:31 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} 3
pass 6361017 2021-08-27 03:22:02 2021-08-29 04:55:19 2021-08-29 05:12:11 0:16:52 0:06:56 0:09:56 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_msgr_segments} 1
pass 6361018 2021-08-27 03:22:02 2021-08-29 04:55:19 2021-08-29 05:36:27 0:41:08 0:25:48 0:15:20 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
fail 6361019 2021-08-27 03:22:03 2021-08-29 04:59:10 2021-08-29 06:03:34 1:04:24 0:16:59 0:47:25 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

"2021-08-29T06:01:36.703965+0000 mon.a (mon.0) 298 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6361020 2021-08-27 03:22:04 2021-08-29 12:35:36 2021-08-29 14:58:14 2:22:38 0:18:05 2:04:33 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_data_pool} 3
fail 6361021 2021-08-27 03:22:05 2021-08-29 14:29:19 2021-08-29 15:27:38 0:58:19 0:16:53 0:41:26 gibba master krbd/singleton/{bluestore-bitmap conf ms_mode$/{secure} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

"2021-08-29T15:25:03.212442+0000 mon.a (mon.0) 197 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6361022 2021-08-27 03:22:05 2021-08-29 14:58:23 2021-08-29 16:34:47 1:36:24 0:57:29 0:38:55 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6361023 2021-08-27 03:22:06 2021-08-29 15:27:46 2021-08-29 16:54:00 1:26:14 0:08:59 1:17:15 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6361024 2021-08-27 03:22:07 2021-08-29 16:34:54 2021-08-29 17:19:17 0:44:23 0:13:55 0:30:28 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6361025 2021-08-27 03:22:08 2021-08-29 16:54:06 2021-08-29 17:38:30 0:44:24 0:09:19 0:35:05 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} 3
pass 6361026 2021-08-27 03:22:08 2021-08-29 17:19:20 2021-08-29 17:58:05 0:38:45 0:09:04 0:29:41 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_huge_osdmap} 3
fail 6361027 2021-08-27 03:22:09 2021-08-29 17:38:32 2021-08-29 18:25:17 0:46:45 0:16:51 0:29:54 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

"2021-08-29T18:13:38.267181+0000 mon.a (mon.0) 180 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6361028 2021-08-27 03:22:10 2021-08-29 17:58:06 2021-08-29 18:48:19 0:50:13 0:11:52 0:38:21 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6361029 2021-08-27 03:22:11 2021-08-29 18:25:19 2021-08-29 18:42:17 0:16:58 0:06:54 0:10:04 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_parent_overlap} 1
pass 6361030 2021-08-27 03:22:12 2021-08-29 18:25:19 2021-08-29 19:13:37 0:48:18 0:14:44 0:33:34 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6361031 2021-08-27 03:22:12 2021-08-29 18:48:22 2021-08-29 19:33:01 0:44:39 0:09:04 0:35:35 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} 3
pass 6361032 2021-08-27 03:22:13 2021-08-29 19:13:46 2021-08-29 20:42:16 1:28:30 0:59:15 0:29:15 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6361033 2021-08-27 03:22:14 2021-08-29 19:33:09 2021-08-29 21:13:30 1:40:21 0:19:13 1:21:08 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6361034 2021-08-27 03:22:15 2021-08-29 20:42:17 2021-08-29 21:38:44 0:56:27 0:14:15 0:42:12 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6361035 2021-08-27 03:22:16 2021-08-29 21:13:33 2021-08-29 22:01:52 0:48:19 0:12:06 0:36:13 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6361036 2021-08-27 03:22:16 2021-08-29 21:38:46 2021-08-29 22:23:09 0:44:23 0:09:47 0:34:36 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} 3
pass 6361037 2021-08-27 03:22:17 2021-08-29 22:01:59 2021-08-29 22:19:08 0:17:09 0:06:47 0:10:22 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} 1
pass 6361038 2021-08-27 03:22:18 2021-08-29 22:01:59 2021-08-29 23:02:23 1:00:24 0:28:29 0:31:55 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6361039 2021-08-27 03:22:19 2021-08-29 22:23:11 2021-08-29 23:23:36 1:00:25 0:08:48 0:51:37 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6361040 2021-08-27 03:22:19 2021-08-29 23:02:26 2021-08-29 23:42:54 0:40:28 0:08:00 0:32:28 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6361041 2021-08-27 03:22:20 2021-08-29 23:23:39 2021-08-30 00:08:09 0:44:30 0:12:47 0:31:43 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_concurrent} 3
pass 6361042 2021-08-27 03:22:21 2021-08-29 23:43:01 2021-08-30 00:27:24 0:44:23 0:08:14 0:36:09 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} 3
fail 6361043 2021-08-27 03:22:22 2021-08-30 00:08:14 2021-08-30 00:58:37 0:50:23 0:19:31 0:30:52 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2021-08-30T00:57:11.267732+0000 mon.a (mon.0) 203 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6361044 2021-08-27 03:22:22 2021-08-30 00:27:26 2021-08-30 01:17:32 0:50:06 0:08:14 0:41:52 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_image_read} 3
pass 6361045 2021-08-27 03:22:23 2021-08-30 00:58:40 2021-08-30 01:15:37 0:16:57 0:06:38 0:10:19 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_whole_object_zeroout} 1
pass 6361046 2021-08-27 03:22:24 2021-08-30 00:58:40 2021-08-30 01:42:44 0:44:04 0:12:45 0:31:19 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6361047 2021-08-27 03:22:25 2021-08-30 01:17:32 2021-08-30 02:31:58 1:14:26 0:37:00 0:37:26 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
pass 6361048 2021-08-27 03:22:25 2021-08-30 01:42:46 2021-08-30 02:51:09 1:08:23 0:07:49 1:00:34 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_kernel} 3
pass 6361049 2021-08-27 03:22:26 2021-08-30 02:32:01 2021-08-30 03:18:24 0:46:23 0:14:59 0:31:24 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
fail 6361050 2021-08-27 03:22:27 2021-08-30 02:51:14 2021-08-30 03:47:39 0:56:25 0:16:48 0:39:37 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2021-08-30T03:45:00.184239+0000 mon.a (mon.0) 233 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6361051 2021-08-27 03:22:28 2021-08-30 03:18:27 2021-08-30 04:12:40 0:54:13 0:12:57 0:41:16 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_unmap} 3
fail 6361052 2021-08-27 03:22:28 2021-08-30 03:47:41 2021-08-30 04:41:51 0:54:10 0:17:00 0:37:10 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

"2021-08-30T04:29:00.252486+0000 mon.a (mon.0) 174 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6361053 2021-08-27 03:22:29 2021-08-30 04:12:44 2021-08-30 05:18:53 1:06:09 0:26:34 0:39:35 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_simple_big} 3
pass 6361054 2021-08-27 03:22:30 2021-08-30 04:41:57 2021-08-30 04:59:09 0:17:12 0:07:16 0:09:56 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_deep_flatten} 1
pass 6361055 2021-08-27 03:22:30 2021-08-30 04:41:58 2021-08-30 05:56:13 1:14:15 0:26:07 0:48:08 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6361056 2021-08-27 03:22:31 2021-08-30 05:19:02 2021-08-30 06:33:28 1:14:26 0:24:23 0:50:03 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} 3
pass 6361057 2021-08-27 03:22:32 2021-08-30 05:56:16 2021-08-30 07:00:37 1:04:21 0:15:16 0:49:05 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} 3
pass 6361058 2021-08-27 03:22:33 2021-08-30 06:33:31 2021-08-30 07:19:51 0:46:20 0:07:12 0:39:08 gibba master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
pass 6361059 2021-08-27 03:22:34 2021-08-30 07:00:45 2021-08-30 07:51:09 0:50:24 0:19:08 0:31:16 gibba master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
fail 6361060 2021-08-27 03:22:34 2021-08-30 07:19:57 2021-08-30 08:20:23 1:00:26 0:17:03 0:43:23 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2021-08-30T08:18:34.135717+0000 mon.a (mon.0) 240 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6361061 2021-08-27 03:22:35 2021-08-30 07:51:11 2021-08-30 08:49:21 0:58:10 0:17:09 0:41:01 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2021-08-30T08:47:44.782613+0000 mon.a (mon.0) 241 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6361062 2021-08-27 03:22:36 2021-08-30 08:20:24 2021-08-30 15:08:02 6:47:38 0:09:11 6:38:27 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_fallocate} 3
pass 6361063 2021-08-27 03:22:36 2021-08-30 14:38:48 2021-08-30 15:10:06 0:31:18 0:09:19 0:21:59 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6361064 2021-08-27 03:22:37 2021-08-30 14:38:48 2021-08-30 15:36:14 0:57:26 0:35:48 0:21:38 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6361065 2021-08-27 03:22:38 2021-08-30 14:38:48 2021-08-30 15:12:10 0:33:22 0:11:46 0:21:36 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6361066 2021-08-27 03:22:39 2021-08-30 14:38:48 2021-08-30 14:58:06 0:19:18 0:07:33 0:11:45 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} 1
pass 6361067 2021-08-27 03:22:40 2021-08-30 14:38:49 2021-08-30 15:14:08 0:35:19 0:14:35 0:20:44 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6361068 2021-08-27 03:22:40 2021-08-30 14:38:49 2021-08-30 15:10:21 0:31:32 0:09:19 0:22:13 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_namespaces} 3
fail 6361069 2021-08-27 03:22:41 2021-08-30 14:45:22 2021-08-30 15:20:31 0:35:09 0:17:06 0:18:03 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

"2021-08-30T15:17:33.338100+0000 mon.a (mon.0) 244 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6361070 2021-08-27 03:22:42 2021-08-30 14:45:22 2021-08-30 15:20:24 0:35:02 0:17:42 0:17:20 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6361071 2021-08-27 03:22:43 2021-08-30 14:45:22 2021-08-30 15:29:21 0:43:59 0:17:16 0:26:43 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2021-08-30T15:27:53.150017+0000 mon.a (mon.0) 215 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6361072 2021-08-27 03:22:43 2021-08-30 14:58:14 2021-08-30 15:34:15 0:36:01 0:10:54 0:25:07 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6361073 2021-08-27 03:22:44 2021-08-30 15:08:05 2021-08-30 15:31:22 0:23:17 0:08:43 0:14:34 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netns} 3
pass 6361074 2021-08-27 03:22:45 2021-08-30 15:10:15 2021-08-30 15:29:30 0:19:15 0:07:37 0:11:38 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_huge_image} 1
fail 6361075 2021-08-27 03:22:46 2021-08-30 15:10:26 2021-08-30 15:41:28 0:31:02 0:16:03 0:14:59 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

"2021-08-30T15:29:21.315991+0000 mon.a (mon.0) 313 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6361076 2021-08-27 03:22:46 2021-08-30 15:12:16 2021-08-30 16:21:27 1:09:11 0:56:09 0:13:02 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6361077 2021-08-27 03:22:47 2021-08-30 15:14:17 2021-08-30 15:41:40 0:27:23 0:09:28 0:17:55 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6361078 2021-08-27 03:22:48 2021-08-30 15:20:29 2021-08-30 15:41:46 0:21:17 0:08:22 0:12:55 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6361079 2021-08-27 03:22:49 2021-08-30 15:20:39 2021-08-30 15:54:34 0:33:55 0:12:45 0:21:10 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_concurrent} 3
fail 6361080 2021-08-27 03:22:49 2021-08-30 15:29:30 2021-08-30 16:00:42 0:31:12 0:17:03 0:14:09 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_huge_tickets} 3
Failure Reason:

"2021-08-30T15:48:51.974332+0000 mon.a (mon.0) 197 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6361081 2021-08-27 03:22:50 2021-08-30 15:31:31 2021-08-30 16:07:37 0:36:06 0:21:03 0:15:03 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6361082 2021-08-27 03:22:51 2021-08-30 15:34:21 2021-08-30 15:55:26 0:21:05 0:08:15 0:12:50 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
pass 6361083 2021-08-27 03:22:52 2021-08-30 15:36:22 2021-08-30 15:53:28 0:17:06 0:06:28 0:10:38 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_modprobe} 1
pass 6361084 2021-08-27 03:22:52 2021-08-30 15:36:22 2021-08-30 16:08:28 0:32:06 0:16:15 0:15:51 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6361085 2021-08-27 03:22:53 2021-08-30 15:41:33 2021-08-30 16:02:58 0:21:25 0:08:27 0:12:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_kernel} 3
pass 6361086 2021-08-27 03:22:54 2021-08-30 15:41:43 2021-08-30 16:09:08 0:27:25 0:16:22 0:11:03 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6361087 2021-08-27 03:22:55 2021-08-30 15:41:54 2021-08-30 16:13:45 0:31:51 0:07:53 0:23:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6361088 2021-08-27 03:22:55 2021-08-30 15:54:35 2021-08-30 16:20:43 0:26:08 0:12:57 0:13:11 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} 3
pass 6361089 2021-08-27 03:22:56 2021-08-30 15:55:36 2021-08-30 16:21:41 0:26:05 0:10:02 0:16:03 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6361090 2021-08-27 03:22:57 2021-08-30 16:00:46 2021-08-30 16:38:09 0:37:23 0:23:45 0:13:38 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_simple_big} 3
pass 6361091 2021-08-27 03:22:58 2021-08-30 16:03:07 2021-08-30 16:20:12 0:17:05 0:06:48 0:10:17 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} 1
fail 6361092 2021-08-27 03:22:58 2021-08-30 16:03:07 2021-08-30 16:34:46 0:31:39 0:16:00 0:15:39 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

fail 6361093 2021-08-27 03:22:59 2021-08-30 16:07:38 2021-08-30 16:37:49 0:30:11 0:16:54 0:13:17 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

"2021-08-30T16:36:11.130179+0000 mon.a (mon.0) 201 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6361094 2021-08-27 03:23:00 2021-08-30 16:08:38 2021-08-30 16:40:31 0:31:53 0:18:11 0:13:42 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_data_pool} 3
pass 6361095 2021-08-27 03:23:01 2021-08-30 16:09:19 2021-08-30 16:34:57 0:25:38 0:08:48 0:16:50 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6361096 2021-08-27 03:23:01 2021-08-30 16:13:49 2021-08-30 16:45:58 0:32:09 0:13:40 0:18:29 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6361097 2021-08-27 03:23:02 2021-08-30 16:20:50 2021-08-30 16:42:41 0:21:51 0:09:29 0:12:22 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_fallocate} 3
pass 6361098 2021-08-27 03:23:03 2021-08-30 16:21:31 2021-08-30 16:42:58 0:21:27 0:09:12 0:12:15 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6361099 2021-08-27 03:23:04 2021-08-30 16:21:51 2021-08-30 17:22:59 1:01:08 0:35:51 0:25:17 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6361100 2021-08-27 03:23:04 2021-08-30 16:34:53 2021-08-30 17:03:05 0:28:12 0:14:06 0:14:06 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6361101 2021-08-27 03:23:05 2021-08-30 16:35:03 2021-08-30 16:54:53 0:19:50 0:07:00 0:12:50 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_parent_overlap} 1
pass 6361102 2021-08-27 03:23:06 2021-08-30 16:38:03 2021-08-30 17:05:34 0:27:31 0:14:20 0:13:11 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6361103 2021-08-27 03:23:06 2021-08-30 16:38:14 2021-08-30 17:33:33 0:55:19 0:42:42 0:12:37 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 6361104 2021-08-27 03:23:07 2021-08-30 16:38:24 2021-08-30 16:59:29 0:21:05 0:09:10 0:11:55 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_namespaces} 3
pass 6361105 2021-08-27 03:23:08 2021-08-30 16:38:24 2021-08-30 17:55:43 1:17:19 1:00:12 0:17:07 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6361106 2021-08-27 03:23:09 2021-08-30 16:40:35 2021-08-30 17:17:53 0:37:18 0:20:04 0:17:14 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6361107 2021-08-27 03:23:09 2021-08-30 16:42:45 2021-08-30 17:12:17 0:29:32 0:14:24 0:15:08 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6361108 2021-08-27 03:23:10 2021-08-30 16:43:06 2021-08-30 17:11:11 0:28:05 0:11:56 0:16:09 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6361109 2021-08-27 03:23:11 2021-08-30 16:46:06 2021-08-30 17:22:45 0:36:39 0:09:17 0:27:22 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netns} 3
pass 6361110 2021-08-27 03:23:12 2021-08-30 16:59:38 2021-08-30 17:16:53 0:17:15 0:07:14 0:10:01 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_read_only} 1
pass 6361111 2021-08-27 03:23:13 2021-08-30 16:59:38 2021-08-30 17:40:17 0:40:39 0:23:19 0:17:20 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6361112 2021-08-27 03:23:14 2021-08-30 17:03:09 2021-08-30 17:28:52 0:25:43 0:09:38 0:16:05 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6361113 2021-08-27 03:23:14 2021-08-30 17:05:40 2021-08-30 17:32:27 0:26:47 0:08:06 0:18:41 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6361114 2021-08-27 03:23:15 2021-08-30 17:11:21 2021-08-30 17:43:33 0:32:12 0:16:57 0:15:15 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

"2021-08-30T17:40:58.959209+0000 mon.a (mon.0) 274 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6361115 2021-08-27 03:23:16 2021-08-30 17:12:21 2021-08-30 17:39:12 0:26:51 0:08:13 0:18:38 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6361116 2021-08-27 03:23:17 2021-08-30 17:18:02 2021-08-30 17:58:01 0:39:59 0:22:48 0:17:11 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
fail 6361117 2021-08-27 03:23:17 2021-08-30 17:22:53 2021-08-30 17:52:12 0:29:19 0:16:59 0:12:20 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

"2021-08-30T17:50:10.353831+0000 mon.a (mon.0) 310 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6361118 2021-08-27 03:23:18 2021-08-30 17:23:03 2021-08-30 17:40:10 0:17:07 0:07:09 0:09:58 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} 1
fail 6361119 2021-08-27 03:23:19 2021-08-30 17:23:04 2021-08-30 17:58:11 0:35:07 0:17:08 0:17:59 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2021-08-30T17:45:59.915782+0000 mon.a (mon.0) 133 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6361120 2021-08-27 03:23:20 2021-08-30 17:28:55 2021-08-30 17:53:51 0:24:56 0:08:27 0:16:29 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} 3
pass 6361121 2021-08-27 03:23:20 2021-08-30 17:32:35 2021-08-30 18:02:48 0:30:13 0:15:58 0:14:15 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6361122 2021-08-27 03:23:21 2021-08-30 17:33:36 2021-08-30 18:00:27 0:26:51 0:08:10 0:18:41 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6361123 2021-08-27 03:23:22 2021-08-30 17:39:17 2021-08-30 18:05:32 0:26:15 0:12:51 0:13:24 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_unmap} 3
pass 6361124 2021-08-27 03:23:22 2021-08-30 17:40:17 2021-08-30 18:08:32 0:28:15 0:11:37 0:16:38 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
fail 6361125 2021-08-27 03:23:23 2021-08-30 17:43:38 2021-08-30 18:23:26 0:39:48 0:17:10 0:22:38 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} 3
Failure Reason:

"2021-08-30T18:20:44.674058+0000 mon.a (mon.0) 274 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log