Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6527772 2021-11-26 05:17:40 2021-11-27 07:06:43 2021-11-27 07:26:09 0:19:26 0:09:33 0:09:53 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_deep_flatten} 1
pass 6527773 2021-11-26 05:17:41 2021-11-27 07:06:43 2021-11-27 07:36:45 0:30:02 0:19:34 0:10:28 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6527774 2021-11-26 05:17:42 2021-11-27 07:06:43 2021-11-27 07:47:02 0:40:19 0:28:15 0:12:04 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_fio} 3
pass 6527775 2021-11-26 05:17:43 2021-11-27 07:07:04 2021-11-27 07:35:42 0:28:38 0:17:37 0:11:01 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_data_pool} 3
fail 6527776 2021-11-26 05:17:44 2021-11-27 07:07:34 2021-11-27 11:12:27 4:04:53 3:51:11 0:13:42 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi146 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude54rniuih -r -- '-g auto -g blockdev -x clone'"

pass 6527777 2021-11-26 05:17:45 2021-11-27 07:09:45 2021-11-27 08:00:17 0:50:32 0:38:54 0:11:38 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/backoff thrashosds-health workloads/rbd_fio} 3
fail 6527778 2021-11-26 05:17:45 2021-11-27 07:10:06 2021-11-27 07:20:01 0:09:55 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major

pass 6527779 2021-11-26 05:17:46 2021-11-27 07:12:36 2021-11-27 07:32:05 0:19:29 0:08:31 0:10:58 smithi master krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} 1
pass 6527780 2021-11-26 05:17:47 2021-11-27 07:12:36 2021-11-27 07:35:04 0:22:28 0:11:15 0:11:13 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6527781 2021-11-26 05:17:48 2021-11-27 07:12:57 2021-11-27 07:42:42 0:29:45 0:18:08 0:11:37 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6527782 2021-11-26 05:17:49 2021-11-27 07:14:57 2021-11-27 07:38:20 0:23:23 0:10:44 0:12:39 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} 3
pass 6527783 2021-11-26 05:17:50 2021-11-27 07:16:08 2021-11-27 07:39:10 0:23:02 0:11:15 0:11:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6527784 2021-11-26 05:17:51 2021-11-27 07:16:18 2021-11-27 08:06:07 0:49:49 0:36:54 0:12:55 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6527785 2021-11-26 05:17:51 2021-11-27 07:17:59 2021-11-27 07:43:19 0:25:20 0:13:18 0:12:02 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6527786 2021-11-26 05:17:52 2021-11-27 07:19:09 2021-11-27 07:39:06 0:19:57 0:09:09 0:10:48 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_discard} 1
pass 6527787 2021-11-26 05:17:53 2021-11-27 07:19:30 2021-11-27 07:48:26 0:28:56 0:16:30 0:12:26 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
dead 6527788 2021-11-26 05:17:54 2021-11-27 07:20:00 2021-11-27 07:35:43 0:15:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

fail 6527789 2021-11-26 05:17:55 2021-11-27 07:20:41 2021-11-27 08:42:26 1:21:45 1:09:07 0:12:38 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

"2021-11-27T08:17:49.650394+0000 osd.3 (osd.3) 3 : cluster [WRN] slow request osd_op(client.4337.0:564325 2.3 2:c5c76775:::rbd_data.1129d429516d.00000000000009bb:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2727936~16384 in=16384b] snapc 0=[] RETRY=12 ondisk+retry+write+known_if_redirected e20) initiated 2021-11-27T08:17:19.512338+0000 currently waiting for sub ops" in cluster log

pass 6527790 2021-11-26 05:17:56 2021-11-27 07:22:11 2021-11-27 08:07:26 0:45:15 0:33:22 0:11:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6527791 2021-11-26 05:17:56 2021-11-27 07:23:12 2021-11-27 07:49:07 0:25:55 0:14:39 0:11:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6527792 2021-11-26 05:17:57 2021-11-27 07:23:12 2021-11-27 07:46:10 0:22:58 0:11:33 0:11:25 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6527793 2021-11-26 05:17:58 2021-11-27 07:24:12 2021-11-27 07:46:40 0:22:28 0:10:50 0:11:38 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} 3
pass 6527794 2021-11-26 05:17:59 2021-11-27 07:24:43 2021-11-27 07:44:05 0:19:22 0:08:50 0:10:32 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} 1
pass 6527795 2021-11-26 05:18:00 2021-11-27 07:24:43 2021-11-27 07:59:32 0:34:49 0:22:03 0:12:46 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6527796 2021-11-26 05:18:01 2021-11-27 07:25:24 2021-11-27 07:48:11 0:22:47 0:11:19 0:11:28 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6527797 2021-11-26 05:18:01 2021-11-27 07:26:14 2021-11-27 07:49:57 0:23:43 0:10:26 0:13:17 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6527798 2021-11-26 05:18:02 2021-11-27 07:27:15 2021-11-27 07:57:05 0:29:50 0:14:58 0:14:52 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_concurrent} 3
pass 6527799 2021-11-26 05:18:03 2021-11-27 07:29:55 2021-11-27 07:53:00 0:23:05 0:10:10 0:12:55 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6527800 2021-11-26 05:18:04 2021-11-27 07:30:16 2021-11-27 08:02:17 0:32:01 0:18:10 0:13:51 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6527801 2021-11-26 05:18:05 2021-11-27 07:32:06 2021-11-27 07:54:48 0:22:42 0:10:20 0:12:22 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_image_read} 3
pass 6527802 2021-11-26 05:18:05 2021-11-27 07:33:07 2021-11-27 07:53:03 0:19:56 0:08:53 0:11:03 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_modprobe} 1
pass 6527803 2021-11-26 05:18:06 2021-11-27 07:33:07 2021-11-27 08:03:23 0:30:16 0:15:46 0:14:30 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6527804 2021-11-26 05:18:07 2021-11-27 07:35:08 2021-11-27 08:43:29 1:08:21 0:56:19 0:12:02 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6527805 2021-11-26 05:18:08 2021-11-27 07:35:08 2021-11-27 07:57:45 0:22:37 0:10:43 0:11:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_kernel} 3
pass 6527806 2021-11-26 05:18:09 2021-11-27 07:35:18 2021-11-27 08:03:31 0:28:13 0:16:39 0:11:34 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6527807 2021-11-26 05:18:09 2021-11-27 07:35:19 2021-11-27 07:58:03 0:22:44 0:10:38 0:12:06 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
dead 6527808 2021-11-26 05:18:10 2021-11-27 07:35:49 2021-11-27 07:50:58 0:15:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_unmap} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6527809 2021-11-26 05:18:11 2021-11-27 07:36:00 2021-11-27 07:58:32 0:22:32 0:11:16 0:11:16 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6527810 2021-11-26 05:18:12 2021-11-27 07:36:50 2021-11-27 08:12:22 0:35:32 0:22:50 0:12:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_simple_big} 3
pass 6527811 2021-11-26 05:18:13 2021-11-27 07:38:11 2021-11-27 07:57:50 0:19:39 0:08:52 0:10:47 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_msgr_segments} 1
pass 6527812 2021-11-26 05:18:13 2021-11-27 07:38:11 2021-11-27 08:14:32 0:36:21 0:25:00 0:11:21 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6527813 2021-11-26 05:18:14 2021-11-27 07:38:21 2021-11-27 08:18:55 0:40:34 0:28:50 0:11:44 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
pass 6527814 2021-11-26 05:18:15 2021-11-27 07:39:12 2021-11-27 08:14:10 0:34:58 0:22:29 0:12:29 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} 3
pass 6527815 2021-11-26 05:18:16 2021-11-27 07:40:12 2021-11-27 08:04:25 0:24:13 0:11:20 0:12:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6527816 2021-11-26 05:18:17 2021-11-27 07:41:43 2021-11-27 08:10:53 0:29:10 0:17:38 0:11:32 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6527817 2021-11-26 05:18:18 2021-11-27 07:42:43 2021-11-27 08:07:17 0:24:34 0:13:41 0:10:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_fallocate} 3
pass 6527818 2021-11-26 05:18:18 2021-11-27 07:43:24 2021-11-27 08:05:56 0:22:32 0:11:09 0:11:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6527819 2021-11-26 05:18:19 2021-11-27 07:44:14 2021-11-27 08:34:14 0:50:00 0:36:59 0:13:01 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6527820 2021-11-26 05:18:20 2021-11-27 07:46:15 2021-11-27 08:12:56 0:26:41 0:14:12 0:12:29 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6527821 2021-11-26 05:18:21 2021-11-27 07:46:45 2021-11-27 08:07:45 0:21:00 0:09:03 0:11:57 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} 1
pass 6527822 2021-11-26 05:18:22 2021-11-27 07:46:46 2021-11-27 08:17:07 0:30:21 0:17:39 0:12:42 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6527823 2021-11-26 05:18:22 2021-11-27 07:47:06 2021-11-27 08:10:26 0:23:20 0:10:50 0:12:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_namespaces} 3
pass 6527824 2021-11-26 05:18:23 2021-11-27 07:48:17 2021-11-27 08:56:32 1:08:15 0:56:56 0:11:19 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6527825 2021-11-26 05:18:24 2021-11-27 07:48:27 2021-11-27 08:35:16 0:46:49 0:35:40 0:11:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6527826 2021-11-26 05:18:25 2021-11-27 07:49:17 2021-11-27 08:13:34 0:24:17 0:13:43 0:10:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6527827 2021-11-26 05:18:26 2021-11-27 07:49:48 2021-11-27 08:14:09 0:24:21 0:12:04 0:12:17 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
dead 6527828 2021-11-26 05:18:27 2021-11-27 07:49:58 2021-11-27 08:06:19 0:16:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6527829 2021-11-26 05:18:27 2021-11-27 07:51:19 2021-11-27 08:13:09 0:21:50 0:08:56 0:12:54 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_read_only} 1
pass 6527830 2021-11-26 05:18:28 2021-11-27 07:53:09 2021-11-27 08:21:50 0:28:41 0:18:09 0:10:32 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6527831 2021-11-26 05:18:29 2021-11-27 07:53:10 2021-11-27 08:43:02 0:49:52 0:36:30 0:13:22 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
pass 6527832 2021-11-26 05:18:30 2021-11-27 07:54:50 2021-11-27 08:22:34 0:27:44 0:11:04 0:16:40 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6527833 2021-11-26 05:18:31 2021-11-27 07:57:11 2021-11-27 08:20:17 0:23:06 0:10:43 0:12:23 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6527834 2021-11-26 05:18:32 2021-11-27 07:57:52 2021-11-27 08:24:10 0:26:18 0:15:24 0:10:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_concurrent} 3
pass 6527835 2021-11-26 05:18:32 2021-11-27 07:58:12 2021-11-27 08:20:37 0:22:25 0:10:16 0:12:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6527836 2021-11-26 05:18:33 2021-11-27 07:58:42 2021-11-27 08:30:47 0:32:05 0:20:12 0:11:53 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6527837 2021-11-26 05:18:34 2021-11-27 07:58:43 2021-11-27 08:21:31 0:22:48 0:10:58 0:11:50 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} 3
pass 6527838 2021-11-26 05:18:35 2021-11-27 07:59:33 2021-11-27 08:20:49 0:21:16 0:09:15 0:12:01 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_whole_object_zeroout} 1
pass 6527839 2021-11-26 05:18:36 2021-11-27 07:59:33 2021-11-27 08:30:37 0:31:04 0:18:09 0:12:55 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6527840 2021-11-26 05:18:36 2021-11-27 08:00:24 2021-11-27 08:24:23 0:23:59 0:10:18 0:13:41 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_kernel} 3
pass 6527841 2021-11-26 05:18:37 2021-11-27 08:02:25 2021-11-27 08:29:26 0:27:01 0:15:27 0:11:34 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6527842 2021-11-26 05:18:38 2021-11-27 08:03:25 2021-11-27 08:25:42 0:22:17 0:09:54 0:12:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6527843 2021-11-26 05:18:39 2021-11-27 08:03:35 2021-11-27 08:31:25 0:27:50 0:15:25 0:12:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} 3
pass 6527844 2021-11-26 05:18:40 2021-11-27 08:04:26 2021-11-27 08:26:57 0:22:31 0:11:35 0:10:56 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6527845 2021-11-26 05:18:40 2021-11-27 08:04:46 2021-11-27 08:41:39 0:36:53 0:25:08 0:11:45 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_simple_big} 3
pass 6527846 2021-11-26 05:18:41 2021-11-27 08:05:57 2021-11-27 08:26:07 0:20:10 0:09:20 0:10:50 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} 1
pass 6527847 2021-11-26 05:18:42 2021-11-27 08:05:57 2021-11-27 08:40:45 0:34:48 0:23:13 0:11:35 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
dead 6527848 2021-11-26 05:18:43 2021-11-27 08:06:17 2021-11-27 08:21:28 0:15:11 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_fio} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6527849 2021-11-26 05:18:44 2021-11-27 08:06:28 2021-11-27 08:35:29 0:29:01 0:17:40 0:11:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_data_pool} 3
pass 6527850 2021-11-26 05:18:44 2021-11-27 08:07:18 2021-11-27 08:27:15 0:19:57 0:09:27 0:10:30 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
pass 6527851 2021-11-26 05:18:45 2021-11-27 08:07:19 2021-11-27 08:39:27 0:32:08 0:20:56 0:11:12 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
pass 6527852 2021-11-26 05:18:46 2021-11-27 08:07:29 2021-11-27 08:32:41 0:25:12 0:11:33 0:13:39 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6527853 2021-11-26 05:18:47 2021-11-27 08:10:30 2021-11-27 08:40:55 0:30:25 0:18:20 0:12:05 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6527854 2021-11-26 05:18:48 2021-11-27 08:11:00 2021-11-27 08:35:13 0:24:13 0:10:47 0:13:26 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_fallocate} 3
pass 6527855 2021-11-26 05:18:49 2021-11-27 08:12:31 2021-11-27 08:35:12 0:22:41 0:11:24 0:11:17 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6527856 2021-11-26 05:18:49 2021-11-27 08:13:01 2021-11-27 09:01:26 0:48:25 0:36:39 0:11:46 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6527857 2021-11-26 05:18:50 2021-11-27 08:13:42 2021-11-27 08:38:38 0:24:56 0:13:08 0:11:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6527858 2021-11-26 05:18:51 2021-11-27 08:14:12 2021-11-27 08:34:24 0:20:12 0:09:34 0:10:38 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_discard} 1
pass 6527859 2021-11-26 05:18:52 2021-11-27 08:14:12 2021-11-27 08:42:29 0:28:17 0:16:42 0:11:35 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6527860 2021-11-26 05:18:53 2021-11-27 08:14:13 2021-11-27 09:33:03 1:18:50 1:05:31 0:13:19 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6527861 2021-11-26 05:18:54 2021-11-27 08:14:33 2021-11-27 08:39:19 0:24:46 0:10:57 0:13:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_namespaces} 3
pass 6527862 2021-11-26 05:18:54 2021-11-27 08:17:14 2021-11-27 09:32:47 1:15:33 1:04:09 0:11:24 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6527863 2021-11-26 05:18:55 2021-11-27 08:19:04 2021-11-27 09:04:52 0:45:48 0:32:58 0:12:50 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6527864 2021-11-26 05:18:56 2021-11-27 08:20:25 2021-11-27 08:44:28 0:24:03 0:13:50 0:10:13 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6527865 2021-11-26 05:18:57 2021-11-27 08:20:45 2021-11-27 08:43:46 0:23:01 0:11:20 0:11:41 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
dead 6527866 2021-11-26 05:18:58 2021-11-27 08:21:36 2021-11-27 08:36:49 0:15:13 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netns} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6527867 2021-11-26 05:18:59 2021-11-27 08:21:46 2021-11-27 08:43:01 0:21:15 0:08:52 0:12:23 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_huge_image} 1
pass 6527868 2021-11-26 05:18:59 2021-11-27 08:21:46 2021-11-27 08:54:38 0:32:52 0:20:18 0:12:34 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6527869 2021-11-26 05:19:00 2021-11-27 08:21:57 2021-11-27 08:49:56 0:27:59 0:13:41 0:14:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6527870 2021-11-26 05:19:01 2021-11-27 08:22:37 2021-11-27 08:46:15 0:23:38 0:10:47 0:12:51 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6527871 2021-11-26 05:19:02 2021-11-27 08:24:18 2021-11-27 08:50:21 0:26:03 0:14:50 0:11:13 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
pass 6527872 2021-11-26 05:19:03 2021-11-27 08:24:28 2021-11-27 08:47:59 0:23:31 0:10:01 0:13:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6527873 2021-11-26 05:19:04 2021-11-27 08:56:56 1094 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6527874 2021-11-26 05:19:04 2021-11-27 08:26:59 2021-11-27 08:49:29 0:22:30 0:10:30 0:12:00 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_image_read} 3
pass 6527875 2021-11-26 05:19:05 2021-11-27 08:27:20 2021-11-27 08:47:16 0:19:56 0:09:00 0:10:56 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} 1
pass 6527876 2021-11-26 05:19:06 2021-11-27 08:27:20 2021-11-27 08:59:40 0:32:20 0:18:02 0:14:18 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6527877 2021-11-26 05:19:07 2021-11-27 08:29:31 2021-11-27 08:53:01 0:23:30 0:10:16 0:13:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} 3
pass 6527878 2021-11-26 05:19:08 2021-11-27 08:30:01 2021-11-27 08:58:55 0:28:54 0:16:58 0:11:56 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6527879 2021-11-26 05:19:08 2021-11-27 08:30:42 2021-11-27 08:52:37 0:21:55 0:09:56 0:11:59 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6527880 2021-11-26 05:19:09 2021-11-27 08:30:52 2021-11-27 08:58:19 0:27:27 0:15:24 0:12:03 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_unmap} 3
pass 6527881 2021-11-26 05:19:10 2021-11-27 08:31:32 2021-11-27 08:54:54 0:23:22 0:11:02 0:12:20 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6527882 2021-11-26 05:19:11 2021-11-27 08:32:43 2021-11-27 09:10:21 0:37:38 0:24:30 0:13:08 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} 3
pass 6527883 2021-11-26 05:19:12 2021-11-27 08:34:23 2021-11-27 08:54:20 0:19:57 0:09:11 0:10:46 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_msgr_segments} 1
pass 6527884 2021-11-26 05:19:12 2021-11-27 08:34:24 2021-11-27 09:09:16 0:34:52 0:22:32 0:12:20 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6527885 2021-11-26 05:19:13 2021-11-27 08:35:14 2021-11-27 09:13:17 0:38:03 0:27:42 0:10:21 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_fio} 3
pass 6527886 2021-11-26 05:19:14 2021-11-27 08:35:15 2021-11-27 09:09:23 0:34:08 0:22:01 0:12:07 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_data_pool} 3
fail 6527887 2021-11-26 05:19:15 2021-11-27 08:35:25 2021-11-27 13:22:12 4:46:47 4:34:09 0:12:38 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi166 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludev3d49cc_ -r -- '-g auto -g blockdev -x clone'"

dead 6527888 2021-11-26 05:19:16 2021-11-27 08:35:35 2021-11-27 08:52:04 0:16:29 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6527889 2021-11-26 05:19:17 2021-11-27 08:37:06 2021-11-27 08:59:49 0:22:43 0:10:55 0:11:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6527890 2021-11-26 05:19:18 2021-11-27 08:37:16 2021-11-27 09:07:13 0:29:57 0:17:39 0:12:18 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6527891 2021-11-26 05:19:18 2021-11-27 08:38:47 2021-11-27 09:01:38 0:22:51 0:11:16 0:11:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} 3
pass 6527892 2021-11-26 05:19:19 2021-11-27 08:39:27 2021-11-27 09:03:29 0:24:02 0:11:14 0:12:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6527893 2021-11-26 05:19:20 2021-11-27 08:39:28 2021-11-27 09:29:03 0:49:35 0:36:55 0:12:40 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6527894 2021-11-26 05:19:21 2021-11-27 08:40:48 2021-11-27 09:06:56 0:26:08 0:13:46 0:12:22 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6527895 2021-11-26 05:19:22 2021-11-27 08:40:59 2021-11-27 09:01:30 0:20:31 0:08:59 0:11:32 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_parent_overlap} 1
pass 6527896 2021-11-26 05:19:23 2021-11-27 08:41:49 2021-11-27 09:12:37 0:30:48 0:17:27 0:13:21 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6527897 2021-11-26 05:19:23 2021-11-27 08:42:29 2021-11-27 09:04:43 0:22:14 0:10:52 0:11:22 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} 3
pass 6527898 2021-11-26 05:19:24 2021-11-27 08:42:30 2021-11-27 09:51:24 1:08:54 0:56:57 0:11:57 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6527899 2021-11-26 05:19:25 2021-11-27 08:43:10 2021-11-27 09:32:28 0:49:18 0:36:26 0:12:52 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6527900 2021-11-26 05:19:26 2021-11-27 08:43:11 2021-11-27 09:09:57 0:26:46 0:14:33 0:12:13 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6527901 2021-11-26 05:19:27 2021-11-27 08:43:31 2021-11-27 09:07:57 0:24:26 0:12:31 0:11:55 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6527902 2021-11-26 05:19:28 2021-11-27 08:43:51 2021-11-27 09:08:18 0:24:27 0:11:39 0:12:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} 3
pass 6527903 2021-11-26 05:19:28 2021-11-27 08:44:32 2021-11-27 09:05:38 0:21:06 0:09:22 0:11:44 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} 1
pass 6527904 2021-11-26 05:19:29 2021-11-27 08:45:42 2021-11-27 09:24:21 0:38:39 0:26:43 0:11:56 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6527905 2021-11-26 05:19:30 2021-11-27 08:46:23 2021-11-27 09:10:00 0:23:37 0:10:44 0:12:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6527906 2021-11-26 05:19:31 2021-11-27 08:48:03 2021-11-27 09:11:47 0:23:44 0:10:15 0:13:29 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6527907 2021-11-26 05:19:32 2021-11-27 08:49:34 2021-11-27 09:17:21 0:27:47 0:15:21 0:12:26 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_concurrent} 3
pass 6527908 2021-11-26 05:19:33 2021-11-27 08:50:04 2021-11-27 09:12:21 0:22:17 0:10:07 0:12:10 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} 3
dead 6527909 2021-11-26 05:19:33 2021-11-27 08:50:25 2021-11-27 09:07:17 0:16:52 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6527910 2021-11-26 05:19:34 2021-11-27 08:52:15 2021-11-27 09:15:00 0:22:45 0:10:41 0:12:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_image_read} 3
pass 6527911 2021-11-26 05:19:35 2021-11-27 08:52:46 2021-11-27 09:11:59 0:19:13 0:09:03 0:10:10 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_whole_object_zeroout} 1
pass 6527912 2021-11-26 05:19:36 2021-11-27 08:52:46 2021-11-27 09:17:53 0:25:07 0:13:29 0:11:38 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6527913 2021-11-26 05:19:37 2021-11-27 08:53:06 2021-11-27 09:43:30 0:50:24 0:36:45 0:13:39 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
pass 6527914 2021-11-26 05:19:38 2021-11-27 08:54:47 2021-11-27 09:15:06 0:20:19 0:09:50 0:10:29 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_kernel} 3
pass 6527915 2021-11-26 05:19:38 2021-11-27 08:54:57 2021-11-27 09:22:39 0:27:42 0:15:36 0:12:06 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6527916 2021-11-26 05:19:39 2021-11-27 08:56:38 2021-11-27 09:16:59 0:20:21 0:10:03 0:10:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6527917 2021-11-26 05:19:40 2021-11-27 08:56:59 2021-11-27 09:25:08 0:28:09 0:15:23 0:12:46 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_unmap} 3
pass 6527918 2021-11-26 05:19:41 2021-11-27 08:58:29 2021-11-27 09:25:12 0:26:43 0:12:22 0:14:21 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6527919 2021-11-26 05:19:42 2021-11-27 08:59:00 2021-11-27 09:35:49 0:36:49 0:24:38 0:12:11 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_simple_big} 3
pass 6527920 2021-11-26 05:19:42 2021-11-27 08:59:50 2021-11-27 09:19:17 0:19:27 0:09:43 0:09:44 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_deep_flatten} 1
pass 6527921 2021-11-26 05:19:43 2021-11-27 08:59:51 2021-11-27 09:34:33 0:34:42 0:23:42 0:11:00 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6527922 2021-11-26 05:19:44 2021-11-27 08:59:51 2021-11-27 09:40:48 0:40:57 0:28:52 0:12:05 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} 3
pass 6527923 2021-11-26 05:19:45 2021-11-27 09:01:02 2021-11-27 09:31:13 0:30:11 0:18:37 0:11:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} 3
pass 6527924 2021-11-26 05:19:46 2021-11-27 09:01:32 2021-11-27 09:21:05 0:19:33 0:09:35 0:09:58 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
pass 6527925 2021-11-26 05:19:47 2021-11-27 09:01:32 2021-11-27 09:33:40 0:32:08 0:20:49 0:11:19 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
pass 6527926 2021-11-26 05:19:48 2021-11-27 09:01:43 2021-11-27 09:25:30 0:23:47 0:11:22 0:12:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6527927 2021-11-26 05:19:48 2021-11-27 09:03:33 2021-11-27 09:34:41 0:31:08 0:18:21 0:12:47 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6527928 2021-11-26 05:19:49 2021-11-27 09:04:44 2021-11-27 09:27:19 0:22:35 0:10:46 0:11:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_fallocate} 3
pass 6527929 2021-11-26 05:19:50 2021-11-27 09:04:54 2021-11-27 09:27:30 0:22:36 0:11:27 0:11:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6527930 2021-11-26 05:19:51 2021-11-27 09:05:45 2021-11-27 09:55:08 0:49:23 0:36:56 0:12:27 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6527931 2021-11-26 05:19:52 2021-11-27 09:07:05 2021-11-27 09:31:17 0:24:12 0:13:21 0:10:51 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
dead 6527932 2021-11-26 05:19:53 2021-11-27 09:07:16 2021-11-27 09:22:35 0:15:19 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} 1
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6527933 2021-11-26 05:19:53 2021-11-27 09:07:36 2021-11-27 09:34:04 0:26:28 0:15:10 0:11:18 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6527934 2021-11-26 05:19:54 2021-11-27 09:08:06 2021-11-27 09:30:28 0:22:22 0:11:16 0:11:06 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_namespaces} 3
fail 6527935 2021-11-26 05:19:55 2021-11-27 09:08:27 2021-11-27 10:25:23 1:16:56 1:04:27 0:12:29 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

"2021-11-27T10:16:32.366641+0000 osd.7 (osd.7) 3 : cluster [WRN] slow request osd_op(client.4331.0:806934 2.5 2:bd6daac8:::rbd_data.11202b02d3fa.0000000000000084:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2502656~12288 in=12288b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected e21) initiated 2021-11-27T10:16:02.150853+0000 currently waiting for sub ops" in cluster log

pass 6527936 2021-11-26 05:19:56 2021-11-27 09:09:17 2021-11-27 09:55:41 0:46:24 0:33:28 0:12:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6527937 2021-11-26 05:19:57 2021-11-27 09:09:28 2021-11-27 09:36:26 0:26:58 0:14:20 0:12:38 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6527938 2021-11-26 05:19:57 2021-11-27 09:09:58 2021-11-27 09:34:03 0:24:05 0:11:17 0:12:48 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6527939 2021-11-26 05:19:58 2021-11-27 09:10:08 2021-11-27 09:32:40 0:22:32 0:10:40 0:11:52 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netns} 3
pass 6527940 2021-11-26 05:19:59 2021-11-27 09:10:29 2021-11-27 09:31:48 0:21:19 0:09:08 0:12:11 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_huge_image} 1
pass 6527941 2021-11-26 05:20:00 2021-11-27 09:10:29 2021-11-27 09:43:57 0:33:28 0:20:32 0:12:56 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6527942 2021-11-26 05:20:01 2021-11-27 09:11:50 2021-11-27 10:26:21 1:14:31 1:02:28 0:12:03 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6527943 2021-11-26 05:20:02 2021-11-27 09:12:30 2021-11-27 09:34:38 0:22:08 0:11:10 0:10:58 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6527944 2021-11-26 05:20:02 2021-11-27 09:12:40 2021-11-27 09:35:47 0:23:07 0:10:31 0:12:36 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6527945 2021-11-26 05:20:03 2021-11-27 09:13:21 2021-11-27 09:41:13 0:27:52 0:15:14 0:12:38 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_concurrent} 3
pass 6527946 2021-11-26 05:20:04 2021-11-27 09:15:01 2021-11-27 09:37:09 0:22:08 0:10:26 0:11:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6527947 2021-11-26 05:20:05 2021-11-27 09:15:12 2021-11-27 09:47:00 0:31:48 0:18:31 0:13:17 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6527948 2021-11-26 05:20:06 2021-11-27 09:17:02 2021-11-27 09:40:48 0:23:46 0:10:18 0:13:28 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
pass 6527949 2021-11-26 05:20:06 2021-11-27 09:17:23 2021-11-27 09:36:53 0:19:30 0:08:58 0:10:32 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_modprobe} 1
pass 6527950 2021-11-26 05:20:07 2021-11-27 09:17:23 2021-11-27 09:49:04 0:31:41 0:17:57 0:13:44 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
fail 6527951 2021-11-26 05:20:08 2021-11-27 09:17:53 2021-11-27 09:29:04 0:11:11 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

Command failed on smithi007 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master'

dead 6527952 2021-11-26 05:20:09 2021-11-27 09:21:14 2021-11-27 09:28:59 0:07:45 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

SSH connection to smithi007 was lost: 'rm -f /tmp/linux-image.deb && echo linux-image-5.15.0-ceph-gf5eb49a83306_5.15.0-ceph-gf5eb49a83306-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/f5eb49a833068d749eae10a5af8402397de67377/ubuntu/focal/flavors/default/pool/main/l/linux-5.15.0-ceph-gf5eb49a83306/ --input-file=-'

dead 6527953 2021-11-26 05:20:10 2021-11-27 09:21:15 2021-11-27 09:37:49 0:16:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_snapshot_io} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6527954 2021-11-26 05:20:11 2021-11-27 09:22:45 2021-11-27 09:50:37 0:27:52 0:14:59 0:12:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} 3
pass 6527955 2021-11-26 05:20:11 2021-11-27 09:24:26 2021-11-27 09:47:28 0:23:02 0:11:25 0:11:37 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6527956 2021-11-26 05:20:12 2021-11-27 09:25:16 2021-11-27 10:00:20 0:35:04 0:23:14 0:11:50 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_simple_big} 3
pass 6527957 2021-11-26 05:20:13 2021-11-27 09:25:17 2021-11-27 09:45:13 0:19:56 0:09:05 0:10:51 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} 1
pass 6527958 2021-11-26 05:20:14 2021-11-27 09:25:17 2021-11-27 10:02:19 0:37:02 0:25:58 0:11:04 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6527959 2021-11-26 05:20:15 2021-11-27 09:25:37 2021-11-27 10:05:55 0:40:18 0:27:40 0:12:38 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_fio} 3
pass 6527960 2021-11-26 05:20:15 2021-11-27 09:27:28 2021-11-27 10:01:36 0:34:08 0:22:35 0:11:33 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_data_pool} 3
pass 6527961 2021-11-26 05:20:16 2021-11-27 09:27:38 2021-11-27 09:51:34 0:23:56 0:10:40 0:13:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6527962 2021-11-26 05:20:17 2021-11-27 09:29:09 2021-11-27 09:57:27 0:28:18 0:17:58 0:10:20 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6527963 2021-11-26 05:20:18 2021-11-27 09:29:09 2021-11-27 09:52:29 0:23:20 0:11:06 0:12:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_fallocate} 3
pass 6527964 2021-11-26 05:20:19 2021-11-27 09:30:30 2021-11-27 09:53:46 0:23:16 0:11:14 0:12:02 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6527965 2021-11-26 05:20:19 2021-11-27 09:31:20 2021-11-27 10:19:17 0:47:57 0:37:06 0:10:51 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6527966 2021-11-26 05:20:20 2021-11-27 09:31:21 2021-11-27 09:59:50 0:28:29 0:13:36 0:14:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6527967 2021-11-26 05:20:21 2021-11-27 09:32:31 2021-11-27 09:51:58 0:19:27 0:09:05 0:10:22 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_parent_overlap} 1
pass 6527968 2021-11-26 05:20:22 2021-11-27 09:32:31 2021-11-27 09:58:52 0:26:21 0:15:42 0:10:39 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6527969 2021-11-26 05:20:23 2021-11-27 09:32:42 2021-11-27 10:20:37 0:47:55 0:36:52 0:11:03 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 6527970 2021-11-26 05:20:23 2021-11-27 09:32:52 2021-11-27 09:55:39 0:22:47 0:10:57 0:11:50 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_namespaces} 3
pass 6527971 2021-11-26 05:20:24 2021-11-27 09:33:13 2021-11-27 10:44:00 1:10:47 0:57:25 0:13:22 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6527972 2021-11-26 05:20:25 2021-11-27 09:33:43 2021-11-27 10:26:04 0:52:21 0:39:47 0:12:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6527973 2021-11-26 05:20:26 2021-11-27 09:34:03 2021-11-27 10:02:12 0:28:09 0:15:44 0:12:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6527974 2021-11-26 05:20:27 2021-11-27 09:34:14 2021-11-27 09:58:45 0:24:31 0:12:25 0:12:06 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6527975 2021-11-26 05:20:28 2021-11-27 09:34:34 2021-11-27 09:58:43 0:24:09 0:11:13 0:12:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netns} 3
pass 6527976 2021-11-26 05:20:28 2021-11-27 09:34:45 2021-11-27 09:56:42 0:21:57 0:09:51 0:12:06 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_read_only} 1
pass 6527977 2021-11-26 05:20:29 2021-11-27 09:34:45 2021-11-27 10:09:52 0:35:07 0:21:41 0:13:26 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6527978 2021-11-26 05:20:30 2021-11-27 09:35:55 2021-11-27 09:57:58 0:22:03 0:10:53 0:11:10 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6527979 2021-11-26 05:20:31 2021-11-27 09:35:56 2021-11-27 09:58:56 0:23:00 0:10:25 0:12:35 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6527980 2021-11-26 05:20:32 2021-11-27 09:36:26 2021-11-27 10:02:55 0:26:29 0:15:15 0:11:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

"2021-11-27T10:00:44.305166+0000 mon.a (mon.0) 146 : cluster [WRN] Health check failed: 0 slow ops, oldest one blocked for 31 sec, osd.5 has slow ops (SLOW_OPS)" in cluster log

pass 6527981 2021-11-26 05:20:32 2021-11-27 09:36:57 2021-11-27 09:59:18 0:22:21 0:10:03 0:12:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_huge_tickets} 3
dead 6527982 2021-11-26 05:20:33 2021-11-27 09:37:17 2021-11-27 09:53:06 0:15:49 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6527983 2021-11-26 05:20:34 2021-11-27 09:38:07 2021-11-27 10:04:21 0:26:14 0:10:34 0:15:40 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_image_read} 3
pass 6527984 2021-11-26 05:20:35 2021-11-27 09:40:58 2021-11-27 10:00:39 0:19:41 0:09:04 0:10:37 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} 1
pass 6527985 2021-11-26 05:20:36 2021-11-27 09:40:58 2021-11-27 10:07:29 0:26:31 0:15:34 0:10:57 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6527986 2021-11-26 05:20:36 2021-11-27 09:41:19 2021-11-27 10:05:18 0:23:59 0:10:33 0:13:26 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} 3
pass 6527987 2021-11-26 05:20:37 2021-11-27 09:43:29 2021-11-27 10:11:27 0:27:58 0:15:40 0:12:18 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6527988 2021-11-26 05:20:38 2021-11-27 09:43:30 2021-11-27 10:05:49 0:22:19 0:10:20 0:11:59 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6527989 2021-11-26 05:20:39 2021-11-27 09:43:40 2021-11-27 10:12:08 0:28:28 0:15:08 0:13:20 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_unmap} 3
pass 6527990 2021-11-26 05:20:40 2021-11-27 09:44:01 2021-11-27 10:13:55 0:29:54 0:14:07 0:15:47 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6527991 2021-11-26 05:20:40 2021-11-27 09:46:52 2021-11-27 10:25:36 0:38:44 0:25:53 0:12:51 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} 3