Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6659926 2022-02-03 22:45:12 2022-02-04 01:45:04 2022-02-04 02:06:46 0:21:42 0:09:52 0:11:50 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_deep_flatten} 1
dead 6659927 2022-02-03 22:45:13 2022-02-04 01:47:14 2022-02-04 01:48:58 0:01:44 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi038

pass 6659928 2022-02-03 22:45:14 2022-02-04 01:47:35 2022-02-04 02:28:40 0:41:05 0:28:13 0:12:52 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_fio} 3
pass 6659929 2022-02-03 22:45:15 2022-02-04 01:49:05 2022-02-04 02:18:12 0:29:07 0:18:41 0:10:26 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_data_pool} 3
pass 6659930 2022-02-03 22:45:16 2022-02-04 01:49:16 2022-02-04 02:10:51 0:21:35 0:11:21 0:10:14 smithi master krbd/rxbounce/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/krbd_rxbounce} 3
fail 6659931 2022-02-03 22:45:17 2022-02-04 01:49:36 2022-02-04 06:33:29 4:43:53 4:27:30 0:16:23 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{legacy-rxbounce} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi080 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludehtcm4ge6 -r -- '-g auto -g blockdev -x clone'"

pass 6659932 2022-02-03 22:45:18 2022-02-04 01:52:57 2022-02-04 02:45:50 0:52:53 0:40:53 0:12:00 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/backoff thrashosds-health workloads/rbd_fio} 3
fail 6659933 2022-02-03 22:45:19 2022-02-04 01:53:37 2022-02-04 02:02:03 0:08:26 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major

pass 6659934 2022-02-03 22:45:20 2022-02-04 01:54:18 2022-02-04 02:13:44 0:19:26 0:08:44 0:10:42 smithi master krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} 1
pass 6659935 2022-02-03 22:45:21 2022-02-04 01:54:18 2022-02-04 02:19:26 0:25:08 0:11:18 0:13:50 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6659936 2022-02-03 22:45:22 2022-02-04 01:54:28 2022-02-04 02:26:30 0:32:02 0:19:26 0:12:36 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6659937 2022-02-03 22:45:24 2022-02-04 01:54:49 2022-02-04 02:18:57 0:24:08 0:11:31 0:12:37 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} 3
pass 6659938 2022-02-03 22:45:25 2022-02-04 01:55:09 2022-02-04 02:18:53 0:23:44 0:11:37 0:12:07 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6659939 2022-02-03 22:45:26 2022-02-04 01:55:40 2022-02-04 02:46:47 0:51:07 0:37:36 0:13:31 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6659940 2022-02-03 22:45:27 2022-02-04 01:57:20 2022-02-04 02:22:58 0:25:38 0:13:50 0:11:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6659941 2022-02-03 22:45:28 2022-02-04 01:57:31 2022-02-04 02:18:15 0:20:44 0:09:17 0:11:27 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_discard} 1
pass 6659942 2022-02-03 22:45:29 2022-02-04 01:59:01 2022-02-04 02:29:18 0:30:17 0:18:17 0:12:00 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6659943 2022-02-03 22:45:30 2022-02-04 01:59:11 2022-02-04 02:20:37 0:21:26 0:12:01 0:09:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} 3
pass 6659944 2022-02-03 22:45:31 2022-02-04 01:59:12 2022-02-04 03:37:05 1:37:53 1:26:53 0:11:00 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6659945 2022-02-03 22:45:32 2022-02-04 01:59:22 2022-02-04 02:47:51 0:48:29 0:36:47 0:11:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6659946 2022-02-03 22:45:33 2022-02-04 01:59:43 2022-02-04 02:32:28 0:32:45 0:19:48 0:12:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2022-02-04T02:30:44.443330+0000 mon.a (mon.0) 274 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6659947 2022-02-03 22:45:34 2022-02-04 02:00:23 2022-02-04 02:26:46 0:26:23 0:12:25 0:13:58 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6659948 2022-02-03 22:45:35 2022-02-04 02:00:24 2022-02-04 02:25:13 0:24:49 0:11:16 0:13:33 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} 3
pass 6659949 2022-02-03 22:45:36 2022-02-04 02:01:24 2022-02-04 02:20:44 0:19:20 0:08:42 0:10:38 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} 1
fail 6659950 2022-02-03 22:45:37 2022-02-04 02:01:24 2022-02-04 02:33:41 0:32:17 0:19:56 0:12:21 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

"2022-02-04T02:31:23.902079+0000 mon.a (mon.0) 282 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6659951 2022-02-03 22:45:38 2022-02-04 02:02:05 2022-02-04 02:33:38 0:31:33 0:19:24 0:12:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_udev_symlinks} 3
Failure Reason:

"2022-02-04T02:31:31.828962+0000 mon.a (mon.0) 249 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6659952 2022-02-03 22:45:39 2022-02-04 02:02:05 2022-02-04 02:26:04 0:23:59 0:10:31 0:13:28 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6659953 2022-02-03 22:45:40 2022-02-04 02:02:45 2022-02-04 02:32:32 0:29:47 0:15:08 0:14:39 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_concurrent} 3
pass 6659954 2022-02-03 22:45:41 2022-02-04 02:06:16 2022-02-04 02:28:40 0:22:24 0:10:21 0:12:03 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6659955 2022-02-03 22:45:42 2022-02-04 02:07:07 2022-02-04 02:41:44 0:34:37 0:19:22 0:15:15 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6659956 2022-02-03 22:45:43 2022-02-04 02:07:37 2022-02-04 02:31:33 0:23:56 0:10:11 0:13:45 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_image_read} 3
pass 6659957 2022-02-03 22:45:44 2022-02-04 02:07:57 2022-02-04 02:29:25 0:21:28 0:08:22 0:13:06 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_modprobe} 1
pass 6659958 2022-02-03 22:45:45 2022-02-04 02:07:58 2022-02-04 02:36:06 0:28:08 0:14:59 0:13:09 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6659959 2022-02-03 22:45:46 2022-02-04 02:08:28 2022-02-04 03:35:45 1:27:17 1:13:33 0:13:44 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
fail 6659960 2022-02-03 22:45:47 2022-02-04 02:09:39 2022-02-04 02:42:19 0:32:40 0:19:17 0:13:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

"2022-02-04T02:39:59.562015+0000 mon.a (mon.0) 233 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6659961 2022-02-03 22:45:47 2022-02-04 02:10:59 2022-02-04 02:44:03 0:33:04 0:17:36 0:15:28 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6659962 2022-02-03 22:45:49 2022-02-04 02:13:30 2022-02-04 02:33:18 0:19:48 0:09:49 0:09:59 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6659963 2022-02-03 22:45:49 2022-02-04 02:13:50 2022-02-04 02:39:37 0:25:47 0:15:09 0:10:38 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_map_unmap} 3
pass 6659964 2022-02-03 22:45:50 2022-02-04 02:14:21 2022-02-04 02:38:47 0:24:26 0:11:47 0:12:39 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6659965 2022-02-03 22:45:51 2022-02-04 02:17:31 2022-02-04 02:51:36 0:34:05 0:22:50 0:11:15 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_simple_big} 3
pass 6659966 2022-02-03 22:45:52 2022-02-04 02:18:22 2022-02-04 02:37:22 0:19:00 0:08:56 0:10:04 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_msgr_segments} 1
pass 6659967 2022-02-03 22:45:53 2022-02-04 02:18:22 2022-02-04 02:53:10 0:34:48 0:23:16 0:11:32 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6659968 2022-02-03 22:45:54 2022-02-04 02:19:03 2022-02-04 02:58:20 0:39:17 0:28:14 0:11:03 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
pass 6659969 2022-02-03 22:45:55 2022-02-04 02:19:03 2022-02-04 02:53:30 0:34:27 0:23:39 0:10:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} 3
pass 6659970 2022-02-03 22:45:56 2022-02-04 02:19:33 2022-02-04 02:43:32 0:23:59 0:11:45 0:12:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6659971 2022-02-03 22:45:57 2022-02-04 02:20:04 2022-02-04 02:50:16 0:30:12 0:19:31 0:10:41 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6659972 2022-02-03 22:45:58 2022-02-04 02:20:44 2022-02-04 02:42:17 0:21:33 0:12:02 0:09:31 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_fallocate} 3
pass 6659973 2022-02-03 22:45:59 2022-02-04 02:20:45 2022-02-04 02:43:59 0:23:14 0:11:39 0:11:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6659974 2022-02-03 22:46:00 2022-02-04 02:22:35 2022-02-04 03:10:33 0:47:58 0:37:56 0:10:02 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6659975 2022-02-03 22:46:01 2022-02-04 02:23:06 2022-02-04 02:51:05 0:27:59 0:13:57 0:14:02 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6659976 2022-02-03 22:46:02 2022-02-04 02:25:16 2022-02-04 02:44:41 0:19:25 0:08:29 0:10:56 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} 1
pass 6659977 2022-02-03 22:46:03 2022-02-04 02:25:17 2022-02-04 02:55:25 0:30:08 0:18:40 0:11:28 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6659978 2022-02-03 22:46:04 2022-02-04 02:26:07 2022-02-04 02:50:00 0:23:53 0:10:57 0:12:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_namespaces} 3
pass 6659979 2022-02-03 22:46:05 2022-02-04 02:26:27 2022-02-04 03:50:22 1:23:55 1:12:22 0:11:33 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6659980 2022-02-03 22:46:06 2022-02-04 02:26:38 2022-02-04 03:19:15 0:52:37 0:39:22 0:13:15 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6659981 2022-02-03 22:46:07 2022-02-04 02:26:49 2022-02-04 02:58:18 0:31:29 0:15:41 0:15:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6659982 2022-02-03 22:46:09 2022-02-04 02:28:49 2022-02-04 02:54:27 0:25:38 0:12:46 0:12:52 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6659983 2022-02-03 22:46:10 2022-02-04 02:28:50 2022-02-04 02:55:17 0:26:27 0:11:59 0:14:28 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_netns} 3
pass 6659984 2022-02-03 22:46:11 2022-02-04 02:32:34 2022-02-04 02:55:17 0:22:43 0:09:54 0:12:49 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_read_only} 1
pass 6659985 2022-02-03 22:46:12 2022-02-04 02:32:35 2022-02-04 03:00:26 0:27:51 0:17:29 0:10:22 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6659986 2022-02-03 22:46:13 2022-02-04 02:32:35 2022-02-04 03:33:04 1:00:29 0:48:47 0:11:42 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
pass 6659987 2022-02-03 22:46:14 2022-02-04 02:33:25 2022-02-04 02:57:21 0:23:56 0:11:26 0:12:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6659988 2022-02-03 22:46:15 2022-02-04 02:33:46 2022-02-04 02:54:57 0:21:11 0:10:59 0:10:12 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6659989 2022-02-03 22:46:16 2022-02-04 02:33:46 2022-02-04 06:25:51 3:52:05 3:37:53 0:14:12 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

Command failed (workunit test rbd/concurrent.sh) on smithi151 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=239f3b058ecd10b05894b75aab82b58c444cda60 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh'

pass 6659990 2022-02-03 22:46:17 2022-02-04 02:36:07 2022-02-04 02:58:08 0:22:01 0:10:51 0:11:10 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6659991 2022-02-03 22:46:18 2022-02-04 02:36:07 2022-02-04 03:08:01 0:31:54 0:20:00 0:11:54 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6659992 2022-02-03 22:46:19 2022-02-04 02:38:48 2022-02-04 03:00:04 0:21:16 0:11:09 0:10:07 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} 3
pass 6659993 2022-02-03 22:46:20 2022-02-04 02:38:48 2022-02-04 02:57:56 0:19:08 0:10:03 0:09:05 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_whole_object_zeroout} 1
pass 6659994 2022-02-03 22:46:21 2022-02-04 02:38:48 2022-02-04 03:11:05 0:32:17 0:19:23 0:12:54 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6659995 2022-02-03 22:46:22 2022-02-04 02:39:39 2022-02-04 03:05:59 0:26:20 0:10:48 0:15:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_kernel} 3
pass 6659996 2022-02-03 22:46:23 2022-02-04 02:41:50 2022-02-04 03:11:28 0:29:38 0:15:40 0:13:58 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
fail 6659997 2022-02-03 22:46:24 2022-02-04 02:42:20 2022-02-04 03:13:43 0:31:23 0:19:17 0:12:06 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2022-02-04T03:12:27.027582+0000 mon.a (mon.0) 327 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6659998 2022-02-03 22:46:25 2022-02-04 02:42:20 2022-02-04 03:11:13 0:28:53 0:15:12 0:13:41 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} 3
fail 6659999 2022-02-03 22:46:26 2022-02-04 02:43:41 2022-02-04 03:15:26 0:31:45 0:19:18 0:12:27 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

"2022-02-04T03:02:59.588991+0000 mon.a (mon.0) 171 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6660000 2022-02-03 22:46:27 2022-02-04 02:44:01 2022-02-04 03:23:02 0:39:01 0:25:12 0:13:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_simple_big} 3
pass 6660001 2022-02-03 22:46:28 2022-02-04 02:44:12 2022-02-04 03:05:53 0:21:41 0:09:13 0:12:28 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} 1
pass 6660002 2022-02-03 22:46:29 2022-02-04 02:44:12 2022-02-04 03:19:36 0:35:24 0:21:25 0:13:59 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6660003 2022-02-03 22:46:30 2022-02-04 02:45:52 2022-02-04 03:26:32 0:40:40 0:28:50 0:11:50 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_fio} 3
pass 6660004 2022-02-03 22:46:31 2022-02-04 02:46:53 2022-02-04 03:18:00 0:31:07 0:18:15 0:12:52 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_data_pool} 3
pass 6660005 2022-02-03 22:46:32 2022-02-04 02:47:53 2022-02-04 03:08:14 0:20:21 0:09:13 0:11:08 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
pass 6660006 2022-02-03 22:46:33 2022-02-04 02:48:34 2022-02-04 03:21:52 0:33:18 0:21:11 0:12:07 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
fail 6660007 2022-02-03 22:46:34 2022-02-04 02:50:04 2022-02-04 03:19:55 0:29:51 0:19:23 0:10:28 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2022-02-04T03:18:29.779159+0000 mon.a (mon.0) 211 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6660008 2022-02-03 22:46:35 2022-02-04 02:50:25 2022-02-04 03:22:54 0:32:29 0:19:23 0:13:06 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2022-02-04T03:20:13.601033+0000 mon.a (mon.0) 212 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660009 2022-02-03 22:46:36 2022-02-04 02:51:05 2022-02-04 03:13:06 0:22:01 0:11:26 0:10:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_fallocate} 3
pass 6660010 2022-02-03 22:46:37 2022-02-04 02:51:46 2022-02-04 03:15:24 0:23:38 0:11:20 0:12:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6660011 2022-02-03 22:46:38 2022-02-04 02:53:16 2022-02-04 03:43:41 0:50:25 0:37:08 0:13:17 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6660012 2022-02-03 22:46:39 2022-02-04 02:53:37 2022-02-04 03:19:51 0:26:14 0:13:27 0:12:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6660013 2022-02-03 22:46:40 2022-02-04 02:54:27 2022-02-04 03:13:29 0:19:02 0:09:33 0:09:29 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_discard} 1
pass 6660014 2022-02-03 22:46:41 2022-02-04 02:54:27 2022-02-04 03:24:17 0:29:50 0:17:19 0:12:31 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6660015 2022-02-03 22:46:42 2022-02-04 02:54:38 2022-02-04 04:26:29 1:31:51 1:20:36 0:11:15 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6660016 2022-02-03 22:46:43 2022-02-04 02:54:58 2022-02-04 03:19:58 0:25:00 0:11:33 0:13:27 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_namespaces} 3
pass 6660017 2022-02-03 22:46:43 2022-02-04 02:55:19 2022-02-04 04:25:37 1:30:18 1:18:05 0:12:13 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6660018 2022-02-03 22:46:44 2022-02-04 02:55:29 2022-02-04 03:45:21 0:49:52 0:36:49 0:13:03 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6660019 2022-02-03 22:46:45 2022-02-04 02:57:30 2022-02-04 03:26:06 0:28:36 0:15:18 0:13:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6660020 2022-02-03 22:46:46 2022-02-04 02:58:00 2022-02-04 03:22:11 0:24:11 0:12:21 0:11:50 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6660021 2022-02-03 22:46:47 2022-02-04 02:58:10 2022-02-04 03:21:54 0:23:44 0:11:15 0:12:29 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_netns} 3
pass 6660022 2022-02-03 22:46:48 2022-02-04 02:58:21 2022-02-04 03:17:38 0:19:17 0:09:07 0:10:10 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_huge_image} 1
pass 6660023 2022-02-03 22:46:49 2022-02-04 02:58:21 2022-02-04 03:35:35 0:37:14 0:24:32 0:12:42 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6660024 2022-02-03 22:46:50 2022-02-04 03:00:12 2022-02-04 03:22:40 0:22:28 0:11:29 0:10:59 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6660025 2022-02-03 22:46:51 2022-02-04 03:00:32 2022-02-04 03:24:07 0:23:35 0:10:41 0:12:54 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6660026 2022-02-03 22:46:52 2022-02-04 03:02:43 2022-02-04 03:30:35 0:27:52 0:15:07 0:12:45 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
pass 6660027 2022-02-03 22:46:53 2022-02-04 03:05:03 2022-02-04 03:26:34 0:21:31 0:10:13 0:11:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6660028 2022-02-03 22:46:54 2022-02-04 03:05:04 2022-02-04 03:38:11 0:33:07 0:19:03 0:14:04 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6660029 2022-02-03 22:46:55 2022-02-04 03:06:04 2022-02-04 03:29:31 0:23:27 0:10:22 0:13:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_image_read} 3
pass 6660030 2022-02-03 22:46:56 2022-02-04 03:08:05 2022-02-04 03:27:56 0:19:51 0:08:34 0:11:17 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} 1
pass 6660031 2022-02-03 22:46:57 2022-02-04 03:08:05 2022-02-04 03:42:06 0:34:01 0:19:36 0:14:25 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6660032 2022-02-03 22:46:58 2022-02-04 03:10:36 2022-02-04 03:32:34 0:21:58 0:10:40 0:11:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} 3
pass 6660033 2022-02-03 22:46:59 2022-02-04 03:11:06 2022-02-04 03:40:39 0:29:33 0:18:52 0:10:41 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6660034 2022-02-03 22:47:00 2022-02-04 03:11:17 2022-02-04 03:32:53 0:21:36 0:09:50 0:11:46 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6660035 2022-02-03 22:47:01 2022-02-04 03:11:37 2022-02-04 03:40:35 0:28:58 0:15:10 0:13:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_map_unmap} 3
pass 6660036 2022-02-03 22:47:02 2022-02-04 03:13:07 2022-02-04 03:37:12 0:24:05 0:11:26 0:12:39 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6660037 2022-02-03 22:47:03 2022-02-04 03:13:38 2022-02-04 03:49:02 0:35:24 0:24:38 0:10:46 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} 3
pass 6660038 2022-02-03 22:47:04 2022-02-04 03:13:48 2022-02-04 03:34:35 0:20:47 0:08:57 0:11:50 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_msgr_segments} 1
pass 6660039 2022-02-03 22:47:04 2022-02-04 03:15:29 2022-02-04 03:49:10 0:33:41 0:22:30 0:11:11 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6660040 2022-02-03 22:47:05 2022-02-04 03:15:29 2022-02-04 03:55:04 0:39:35 0:27:52 0:11:43 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_fio} 3
pass 6660041 2022-02-03 22:47:06 2022-02-04 03:17:40 2022-02-04 03:50:19 0:32:39 0:21:57 0:10:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_data_pool} 3
fail 6660042 2022-02-03 22:47:07 2022-02-04 03:18:10 2022-02-04 03:51:19 0:33:09 0:19:16 0:13:53 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{legacy} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

"2022-02-04T03:38:12.826570+0000 mon.a (mon.0) 102 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6660043 2022-02-03 22:47:08 2022-02-04 03:19:41 2022-02-04 04:50:50 1:31:09 1:18:05 0:13:04 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6660044 2022-02-03 22:47:09 2022-02-04 03:20:01 2022-02-04 03:43:17 0:23:16 0:12:02 0:11:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6660045 2022-02-03 22:47:10 2022-02-04 03:20:01 2022-02-04 03:49:25 0:29:24 0:18:23 0:11:01 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6660046 2022-02-03 22:47:11 2022-02-04 03:20:02 2022-02-04 03:43:35 0:23:33 0:11:38 0:11:55 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} 3
pass 6660047 2022-02-03 22:47:12 2022-02-04 03:21:52 2022-02-04 03:43:59 0:22:07 0:10:53 0:11:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6660048 2022-02-03 22:47:13 2022-02-04 03:22:03 2022-02-04 04:12:22 0:50:19 0:38:14 0:12:05 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6660049 2022-02-03 22:47:14 2022-02-04 03:22:13 2022-02-04 03:48:46 0:26:33 0:13:31 0:13:02 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6660050 2022-02-03 22:47:15 2022-02-04 03:22:44 2022-02-04 03:42:07 0:19:23 0:08:54 0:10:29 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_parent_overlap} 1
pass 6660051 2022-02-03 22:47:16 2022-02-04 03:22:44 2022-02-04 03:53:39 0:30:55 0:17:06 0:13:49 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6660052 2022-02-03 22:47:17 2022-02-04 03:23:04 2022-02-04 03:46:47 0:23:43 0:10:51 0:12:52 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} 3
pass 6660053 2022-02-03 22:47:18 2022-02-04 03:23:05 2022-02-04 04:49:52 1:26:47 1:13:44 0:13:03 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
fail 6660054 2022-02-03 22:47:19 2022-02-04 03:24:16 2022-02-04 03:56:02 0:31:46 0:19:21 0:12:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_enumerate} 3
Failure Reason:

"2022-02-04T03:53:18.562982+0000 mon.a (mon.0) 241 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660055 2022-02-03 22:47:20 2022-02-04 03:24:26 2022-02-04 03:52:05 0:27:39 0:15:18 0:12:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
fail 6660056 2022-02-03 22:47:21 2022-02-04 03:26:06 2022-02-04 03:56:22 0:30:16 0:19:14 0:11:02 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
Failure Reason:

"2022-02-04T03:54:55.385102+0000 mon.a (mon.0) 333 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6660057 2022-02-03 22:47:22 2022-02-04 03:26:37 2022-02-04 03:58:12 0:31:35 0:19:24 0:12:11 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

"2022-02-04T03:54:58.264892+0000 mon.a (mon.0) 230 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660058 2022-02-03 22:47:23 2022-02-04 03:26:37 2022-02-04 03:47:01 0:20:24 0:09:32 0:10:52 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} 1
fail 6660059 2022-02-03 22:47:24 2022-02-04 03:26:37 2022-02-04 03:57:46 0:31:09 0:19:14 0:11:55 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

"2022-02-04T03:56:23.657491+0000 mon.a (mon.0) 229 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660060 2022-02-03 22:47:25 2022-02-04 03:28:18 2022-02-04 03:51:04 0:22:46 0:11:32 0:11:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6660061 2022-02-03 22:47:26 2022-02-04 03:29:39 2022-02-04 03:52:09 0:22:30 0:10:19 0:12:11 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6660062 2022-02-03 22:47:27 2022-02-04 03:30:39 2022-02-04 04:02:12 0:31:33 0:18:48 0:12:45 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

"2022-02-04T04:00:28.918685+0000 mon.a (mon.0) 281 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660063 2022-02-03 22:47:28 2022-02-04 03:33:14 2022-02-04 03:56:19 0:23:05 0:10:09 0:12:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} 3
fail 6660064 2022-02-03 22:47:29 2022-02-04 03:34:44 2022-02-04 04:07:09 0:32:25 0:19:15 0:13:10 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2022-02-04T04:04:15.067091+0000 mon.a (mon.0) 286 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660065 2022-02-03 22:47:30 2022-02-04 03:35:45 2022-02-04 03:57:54 0:22:09 0:10:50 0:11:19 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_image_read} 3
pass 6660066 2022-02-03 22:47:31 2022-02-04 03:35:55 2022-02-04 03:56:46 0:20:51 0:09:00 0:11:51 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_whole_object_zeroout} 1
pass 6660067 2022-02-03 22:47:32 2022-02-04 03:37:06 2022-02-04 04:02:54 0:25:48 0:14:25 0:11:23 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6660068 2022-02-03 22:47:32 2022-02-04 03:37:16 2022-02-04 04:26:24 0:49:08 0:36:53 0:12:15 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
pass 6660069 2022-02-03 22:47:34 2022-02-04 03:38:17 2022-02-04 03:58:55 0:20:38 0:10:06 0:10:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_kernel} 3
pass 6660070 2022-02-03 22:47:34 2022-02-04 03:39:27 2022-02-04 04:07:56 0:28:29 0:16:08 0:12:21 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6660071 2022-02-03 22:47:35 2022-02-04 03:40:18 2022-02-04 04:02:00 0:21:42 0:10:53 0:10:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6660072 2022-02-03 22:47:36 2022-02-04 03:40:38 2022-02-04 04:08:14 0:27:36 0:15:44 0:11:52 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_map_unmap} 3
fail 6660073 2022-02-03 22:47:37 2022-02-04 03:40:48 2022-02-04 04:11:39 0:30:51 0:19:23 0:11:28 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

"2022-02-04T04:10:08.274889+0000 mon.a (mon.0) 272 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6660074 2022-02-03 22:47:38 2022-02-04 03:42:09 2022-02-04 04:15:01 0:32:52 0:19:16 0:13:36 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_simple_big} 3
Failure Reason:

"2022-02-04T04:01:33.012171+0000 mon.a (mon.0) 115 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6660075 2022-02-03 22:47:39 2022-02-04 03:43:19 2022-02-04 04:02:50 0:19:31 0:09:05 0:10:26 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy} tasks/krbd_deep_flatten} 1
pass 6660076 2022-02-03 22:47:40 2022-02-04 03:43:20 2022-02-04 04:19:14 0:35:54 0:23:54 0:12:00 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6660077 2022-02-03 22:47:41 2022-02-04 03:43:40 2022-02-04 04:23:46 0:40:06 0:28:14 0:11:52 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} 3
pass 6660078 2022-02-03 22:47:42 2022-02-04 03:43:51 2022-02-04 04:15:33 0:31:42 0:19:38 0:12:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} 3
pass 6660079 2022-02-03 22:47:43 2022-02-04 03:44:01 2022-02-04 04:05:11 0:21:10 0:09:20 0:11:50 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
pass 6660080 2022-02-03 22:47:44 2022-02-04 03:45:31 2022-02-04 04:20:37 0:35:06 0:21:21 0:13:45 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
pass 6660081 2022-02-03 22:47:45 2022-02-04 03:46:52 2022-02-04 04:12:49 0:25:57 0:11:45 0:14:12 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6660082 2022-02-03 22:47:46 2022-02-04 03:48:53 2022-02-04 04:21:35 0:32:42 0:20:02 0:12:40 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6660083 2022-02-03 22:47:47 2022-02-04 03:49:03 2022-02-04 04:10:57 0:21:54 0:11:10 0:10:44 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_fallocate} 3
pass 6660084 2022-02-03 22:47:48 2022-02-04 03:49:13 2022-02-04 04:12:54 0:23:41 0:11:50 0:11:51 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6660085 2022-02-03 22:47:49 2022-02-04 03:49:34 2022-02-04 04:40:08 0:50:34 0:38:26 0:12:08 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6660086 2022-02-03 22:47:50 2022-02-04 03:50:24 2022-02-04 04:15:57 0:25:33 0:14:12 0:11:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6660087 2022-02-03 22:47:51 2022-02-04 03:50:24 2022-02-04 04:12:31 0:22:07 0:10:02 0:12:05 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} 1
pass 6660088 2022-02-03 22:47:52 2022-02-04 03:50:25 2022-02-04 04:18:29 0:28:04 0:16:40 0:11:24 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc-rxbounce} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6660089 2022-02-03 22:47:52 2022-02-04 03:51:05 2022-02-04 04:16:38 0:25:33 0:12:01 0:13:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/krbd_namespaces} 3
pass 6660090 2022-02-03 22:47:54 2022-02-04 03:51:26 2022-02-04 05:23:09 1:31:43 1:20:28 0:11:15 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6660091 2022-02-03 22:47:54 2022-02-04 03:51:26 2022-02-04 04:40:07 0:48:41 0:36:48 0:11:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6660092 2022-02-03 22:47:55 2022-02-04 03:52:06 2022-02-04 04:23:53 0:31:47 0:19:15 0:12:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2022-02-04T04:20:55.727548+0000 mon.a (mon.0) 238 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660093 2022-02-03 22:47:56 2022-02-04 03:52:17 2022-02-04 04:16:27 0:24:10 0:11:54 0:12:16 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6660094 2022-02-03 22:47:57 2022-02-04 03:53:47 2022-02-04 04:16:39 0:22:52 0:10:57 0:11:55 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_udev_netns} 3
pass 6660095 2022-02-03 22:47:58 2022-02-04 03:55:08 2022-02-04 04:15:15 0:20:07 0:08:36 0:11:31 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc} tasks/krbd_huge_image} 1
pass 6660096 2022-02-03 22:47:59 2022-02-04 03:56:08 2022-02-04 04:32:05 0:35:57 0:22:03 0:13:54 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6660097 2022-02-03 22:48:00 2022-02-04 03:56:29 2022-02-04 05:28:08 1:31:39 1:19:08 0:12:31 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc-rxbounce} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
fail 6660098 2022-02-03 22:48:01 2022-02-04 03:56:29 2022-02-04 04:30:27 0:33:58 0:19:38 0:14:20 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} 3
Failure Reason:

"2022-02-04T04:17:04.188405+0000 mon.a (mon.0) 119 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6660099 2022-02-03 22:48:02 2022-02-04 03:56:49 2022-02-04 04:31:18 0:34:29 0:19:51 0:14:38 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

"2022-02-04T04:28:22.935100+0000 mon.a (mon.0) 223 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660100 2022-02-03 22:48:03 2022-02-04 03:57:50 2022-02-04 04:26:07 0:28:17 0:16:03 0:12:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_concurrent} 3
fail 6660101 2022-02-03 22:48:04 2022-02-04 03:58:00 2022-02-04 04:29:46 0:31:46 0:19:46 0:12:00 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_huge_tickets} 3
Failure Reason:

"2022-02-04T04:28:31.093830+0000 mon.a (mon.0) 262 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660102 2022-02-03 22:48:05 2022-02-04 03:58:21 2022-02-04 04:30:30 0:32:09 0:19:57 0:12:12 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6660103 2022-02-03 22:48:06 2022-02-04 03:59:01 2022-02-04 04:23:21 0:24:20 0:11:03 0:13:17 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
pass 6660104 2022-02-03 22:48:07 2022-02-04 04:02:02 2022-02-04 04:21:12 0:19:10 0:09:08 0:10:02 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_modprobe} 1
pass 6660105 2022-02-03 22:48:08 2022-02-04 04:02:22 2022-02-04 04:32:09 0:29:47 0:19:34 0:10:13 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
fail 6660106 2022-02-03 22:48:09 2022-02-04 04:02:53 2022-02-04 04:32:36 0:29:43 0:19:31 0:10:12 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

"2022-02-04T04:20:36.765784+0000 mon.a (mon.0) 113 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6660107 2022-02-03 22:48:10 2022-02-04 04:03:03 2022-02-04 04:37:03 0:34:00 0:19:35 0:14:25 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6660108 2022-02-03 22:48:11 2022-02-04 04:05:14 2022-02-04 04:30:24 0:25:10 0:10:06 0:15:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6660109 2022-02-03 22:48:12 2022-02-04 04:07:14 2022-02-04 04:37:54 0:30:40 0:15:43 0:14:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} 3
pass 6660110 2022-02-03 22:48:13 2022-02-04 04:08:05 2022-02-04 04:35:43 0:27:38 0:12:13 0:15:25 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6660111 2022-02-03 22:48:14 2022-02-04 04:08:15 2022-02-04 04:48:50 0:40:35 0:23:59 0:16:36 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_simple_big} 3
pass 6660112 2022-02-03 22:48:15 2022-02-04 04:11:06 2022-02-04 04:35:01 0:23:55 0:09:44 0:14:11 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} 1
pass 6660113 2022-02-03 22:48:16 2022-02-04 04:11:46 2022-02-04 04:52:25 0:40:39 0:26:35 0:14:04 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6660114 2022-02-03 22:48:17 2022-02-04 04:12:27 2022-02-04 04:56:45 0:44:18 0:30:00 0:14:18 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_fio} 3
pass 6660115 2022-02-03 22:48:18 2022-02-04 04:12:37 2022-02-04 04:50:24 0:37:47 0:24:39 0:13:08 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_data_pool} 3
pass 6660116 2022-02-03 22:48:19 2022-02-04 04:12:57 2022-02-04 04:39:02 0:26:05 0:12:36 0:13:29 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6660117 2022-02-03 22:48:20 2022-02-04 04:12:58 2022-02-04 04:46:35 0:33:37 0:19:53 0:13:44 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6660118 2022-02-03 22:48:21 2022-02-04 04:15:08 2022-02-04 04:41:12 0:26:04 0:12:57 0:13:07 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_fallocate} 3
pass 6660119 2022-02-03 22:48:22 2022-02-04 04:15:39 2022-02-04 04:41:24 0:25:45 0:13:01 0:12:44 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6660120 2022-02-03 22:48:23 2022-02-04 04:15:59 2022-02-04 05:07:21 0:51:22 0:37:51 0:13:31 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6660121 2022-02-03 22:48:24 2022-02-04 04:16:30 2022-02-04 04:42:07 0:25:37 0:15:00 0:10:37 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6660122 2022-02-03 22:48:25 2022-02-04 04:16:40 2022-02-04 04:38:23 0:21:43 0:10:22 0:11:21 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc$/{crc-rxbounce} tasks/krbd_parent_overlap} 1
pass 6660123 2022-02-03 22:48:26 2022-02-04 04:16:40 2022-02-04 04:46:29 0:29:49 0:17:17 0:12:32 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6660124 2022-02-03 22:48:27 2022-02-04 04:16:40 2022-02-04 05:07:57 0:51:17 0:37:59 0:13:18 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 6660125 2022-02-03 22:48:28 2022-02-04 04:18:31 2022-02-04 04:40:56 0:22:25 0:11:03 0:11:22 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/krbd_namespaces} 3
pass 6660126 2022-02-03 22:48:29 2022-02-04 04:19:21 2022-02-04 05:50:35 1:31:14 1:12:48 0:18:26 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy} msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6660127 2022-02-03 22:48:30 2022-02-04 04:20:42 2022-02-04 05:18:15 0:57:33 0:40:25 0:17:08 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6660128 2022-02-03 22:48:31 2022-02-04 04:21:42 2022-02-04 04:54:43 0:33:01 0:15:13 0:17:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6660129 2022-02-03 22:48:32 2022-02-04 04:23:23 2022-02-04 04:51:55 0:28:32 0:12:54 0:15:38 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6660130 2022-02-03 22:48:33 2022-02-04 04:23:53 2022-02-04 04:51:30 0:27:37 0:11:58 0:15:39 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/krbd_udev_netns} 3
pass 6660131 2022-02-03 22:48:34 2022-02-04 04:24:04 2022-02-04 04:46:54 0:22:50 0:09:27 0:13:23 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy$/{legacy-rxbounce} tasks/krbd_read_only} 1
pass 6660132 2022-02-03 22:48:35 2022-02-04 04:24:04 2022-02-04 05:01:08 0:37:04 0:22:26 0:14:38 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6660133 2022-02-03 22:48:36 2022-02-04 04:25:45 2022-02-04 04:52:22 0:26:37 0:11:54 0:14:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6660134 2022-02-03 22:48:37 2022-02-04 04:26:15 2022-02-04 04:50:38 0:24:23 0:11:21 0:13:02 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6660135 2022-02-03 22:48:38 2022-02-04 04:26:25 2022-02-04 04:56:08 0:29:43 0:16:02 0:13:41 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} 3
pass 6660136 2022-02-03 22:48:39 2022-02-04 04:26:36 2022-02-04 04:51:21 0:24:45 0:10:23 0:14:22 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/few tasks/rbd_huge_tickets} 3
fail 6660137 2022-02-03 22:48:39 2022-02-04 04:29:57 2022-02-04 05:00:10 0:30:13 0:19:17 0:10:56 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy$/{legacy-rxbounce} msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2022-02-04T04:58:47.519527+0000 mon.a (mon.0) 228 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6660138 2022-02-03 22:48:40 2022-02-04 04:30:27 2022-02-04 05:00:06 0:29:39 0:19:18 0:10:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy} msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

"2022-02-04T04:58:40.530393+0000 mon.a (mon.0) 244 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660139 2022-02-03 22:48:41 2022-02-04 04:30:37 2022-02-04 04:51:57 0:21:20 0:09:36 0:11:44 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} 1
pass 6660140 2022-02-03 22:48:42 2022-02-04 04:30:38 2022-02-04 05:00:53 0:30:15 0:17:39 0:12:36 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6660141 2022-02-03 22:48:43 2022-02-04 04:31:28 2022-02-04 04:53:46 0:22:18 0:09:56 0:12:22 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} 3
pass 6660142 2022-02-03 22:48:44 2022-02-04 04:32:09 2022-02-04 04:59:48 0:27:39 0:16:04 0:11:35 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
fail 6660143 2022-02-03 22:48:45 2022-02-04 04:32:19 2022-02-04 05:04:03 0:31:44 0:19:32 0:12:12 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

"2022-02-04T05:01:15.476293+0000 mon.a (mon.0) 256 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660144 2022-02-03 22:48:46 2022-02-04 04:32:39 2022-02-04 05:00:40 0:28:01 0:15:18 0:12:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy$/{legacy-rxbounce} msgr-failures/few tasks/rbd_map_unmap} 3
pass 6660145 2022-02-03 22:48:47 2022-02-04 04:35:10 2022-02-04 04:59:18 0:24:08 0:11:46 0:12:22 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc} msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6660146 2022-02-03 22:48:48 2022-02-04 04:35:50 2022-02-04 05:14:55 0:39:05 0:26:12 0:12:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} 3