Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6660534 2022-02-04 03:21:11 2022-02-04 12:49:19 2022-02-04 13:08:38 0:19:19 0:09:38 0:09:41 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_deep_flatten} 1
pass 6660535 2022-02-04 03:21:12 2022-02-04 12:49:19 2022-02-04 13:20:38 0:31:19 0:19:24 0:11:55 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6660536 2022-02-04 03:21:13 2022-02-04 12:51:00 2022-02-04 13:31:05 0:40:05 0:28:14 0:11:51 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_fio} 3
pass 6660537 2022-02-04 03:21:14 2022-02-04 12:51:40 2022-02-04 13:21:02 0:29:22 0:18:47 0:10:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_data_pool} 3
fail 6660538 2022-02-04 03:21:14 2022-02-04 12:51:41 2022-02-04 17:48:27 4:56:46 4:39:02 0:17:44 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi170 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludefdzrnq0l -r -- '-g auto -g blockdev -x clone'"

pass 6660539 2022-02-04 03:21:15 2022-02-04 12:57:22 2022-02-04 13:46:55 0:49:33 0:38:38 0:10:55 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/backoff thrashosds-health workloads/rbd_fio} 3
fail 6660540 2022-02-04 03:21:16 2022-02-04 12:57:22 2022-02-04 13:05:19 0:07:57 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major

pass 6660541 2022-02-04 03:21:17 2022-02-04 12:58:03 2022-02-04 13:17:23 0:19:20 0:09:09 0:10:11 smithi master krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} 1
fail 6660542 2022-02-04 03:21:18 2022-02-04 12:58:33 2022-02-04 13:31:01 0:32:28 0:19:43 0:12:45 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

"2022-02-04T13:29:14.261610+0000 mon.a (mon.0) 287 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660543 2022-02-04 03:21:18 2022-02-04 12:58:44 2022-02-04 13:31:19 0:32:35 0:19:22 0:13:13 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6660544 2022-02-04 03:21:19 2022-02-04 12:59:54 2022-02-04 13:24:21 0:24:27 0:11:44 0:12:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} 3
pass 6660545 2022-02-04 03:21:20 2022-02-04 13:00:44 2022-02-04 13:24:13 0:23:29 0:11:45 0:11:44 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6660546 2022-02-04 03:21:21 2022-02-04 13:00:55 2022-02-04 13:51:48 0:50:53 0:37:47 0:13:06 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6660547 2022-02-04 03:21:21 2022-02-04 13:01:15 2022-02-04 13:28:07 0:26:52 0:14:20 0:12:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6660548 2022-02-04 03:21:22 2022-02-04 13:02:06 2022-02-04 13:23:13 0:21:07 0:09:39 0:11:28 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_discard} 1
pass 6660549 2022-02-04 03:21:23 2022-02-04 13:02:06 2022-02-04 13:31:46 0:29:40 0:17:39 0:12:01 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6660550 2022-02-04 03:21:24 2022-02-04 13:02:07 2022-02-04 13:26:05 0:23:58 0:12:16 0:11:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} 3
pass 6660551 2022-02-04 03:21:25 2022-02-04 13:02:27 2022-02-04 14:40:10 1:37:43 1:24:55 0:12:48 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6660552 2022-02-04 03:21:25 2022-02-04 13:02:48 2022-02-04 13:57:52 0:55:04 0:36:58 0:18:06 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6660553 2022-02-04 03:21:26 2022-02-04 13:04:58 2022-02-04 13:32:51 0:27:53 0:14:39 0:13:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6660554 2022-02-04 03:21:27 2022-02-04 13:05:29 2022-02-04 13:31:08 0:25:39 0:11:50 0:13:49 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6660555 2022-02-04 03:21:28 2022-02-04 13:05:39 2022-02-04 13:31:41 0:26:02 0:11:04 0:14:58 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} 3
pass 6660556 2022-02-04 03:21:28 2022-02-04 13:06:09 2022-02-04 13:29:21 0:23:12 0:09:01 0:14:11 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} 1
fail 6660557 2022-02-04 03:21:29 2022-02-04 13:06:10 2022-02-04 13:40:12 0:34:02 0:19:18 0:14:44 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

"2022-02-04T13:37:35.668109+0000 mon.a (mon.0) 237 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660558 2022-02-04 03:21:30 2022-02-04 13:06:30 2022-02-04 13:33:27 0:26:57 0:12:40 0:14:17 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6660559 2022-02-04 03:21:31 2022-02-04 13:07:50 2022-02-04 13:32:21 0:24:31 0:12:17 0:12:14 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6660560 2022-02-04 03:21:32 2022-02-04 13:08:11 2022-02-04 13:38:50 0:30:39 0:15:21 0:15:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_concurrent} 3
pass 6660561 2022-02-04 03:21:32 2022-02-04 13:30:04 2022-02-04 13:55:51 0:25:47 0:11:39 0:14:08 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6660562 2022-02-04 03:21:33 2022-02-04 13:30:25 2022-02-04 14:09:12 0:38:47 0:19:17 0:19:30 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6660563 2022-02-04 03:21:34 2022-02-04 13:31:05 2022-02-04 13:58:47 0:27:42 0:10:52 0:16:50 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_image_read} 3
pass 6660564 2022-02-04 03:21:35 2022-02-04 13:31:15 2022-02-04 13:56:47 0:25:32 0:08:58 0:16:34 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_modprobe} 1
pass 6660565 2022-02-04 03:21:35 2022-02-04 13:31:16 2022-02-04 14:02:42 0:31:26 0:15:36 0:15:50 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6660566 2022-02-04 03:21:36 2022-02-04 13:31:16 2022-02-04 15:02:51 1:31:35 1:15:12 0:16:23 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
fail 6660567 2022-02-04 03:21:37 2022-02-04 13:31:16 2022-02-04 14:06:48 0:35:32 0:19:23 0:16:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

"2022-02-04T14:04:36.156863+0000 mon.a (mon.0) 298 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6660568 2022-02-04 03:21:38 2022-02-04 13:31:27 2022-02-04 14:09:04 0:37:37 0:20:06 0:17:31 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2022-02-04T13:56:40.798100+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6660569 2022-02-04 03:21:39 2022-02-04 13:31:27 2022-02-04 13:59:41 0:28:14 0:10:57 0:17:17 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6660570 2022-02-04 03:21:39 2022-02-04 13:31:37 2022-02-04 14:05:53 0:34:16 0:16:34 0:17:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_unmap} 3
pass 6660571 2022-02-04 03:21:40 2022-02-04 13:31:48 2022-02-04 14:01:35 0:29:47 0:12:19 0:17:28 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6660572 2022-02-04 03:21:41 2022-02-04 13:31:48 2022-02-04 14:14:39 0:42:51 0:24:32 0:18:19 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_simple_big} 3
pass 6660573 2022-02-04 03:21:42 2022-02-04 13:32:28 2022-02-04 13:57:42 0:25:14 0:09:04 0:16:10 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_msgr_segments} 1
pass 6660574 2022-02-04 03:21:43 2022-02-04 13:32:29 2022-02-04 14:12:23 0:39:54 0:23:11 0:16:43 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6660575 2022-02-04 03:21:43 2022-02-04 13:32:59 2022-02-04 14:19:07 0:46:08 0:28:24 0:17:44 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
fail 6660576 2022-02-04 03:21:44 2022-02-04 13:33:30 2022-02-04 14:10:59 0:37:29 0:19:28 0:18:01 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} 3
Failure Reason:

"2022-02-04T14:08:46.567568+0000 mon.a (mon.0) 205 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660577 2022-02-04 03:21:45 2022-02-04 13:33:30 2022-02-04 14:02:21 0:28:51 0:10:56 0:17:55 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6660578 2022-02-04 03:21:46 2022-02-04 13:35:11 2022-02-04 14:11:30 0:36:19 0:19:16 0:17:03 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6660579 2022-02-04 03:21:46 2022-02-04 13:35:41 2022-02-04 14:05:33 0:29:52 0:12:25 0:17:27 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_fallocate} 3
pass 6660580 2022-02-04 03:21:47 2022-02-04 13:36:01 2022-02-04 14:03:53 0:27:52 0:11:51 0:16:01 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} 3
fail 6660581 2022-02-04 03:21:48 2022-02-04 13:36:32 2022-02-04 14:12:19 0:35:47 0:19:55 0:15:52 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

"2022-02-04T14:00:27.116050+0000 mon.a (mon.0) 129 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6660582 2022-02-04 03:21:49 2022-02-04 13:37:02 2022-02-04 14:08:23 0:31:21 0:14:21 0:17:00 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6660583 2022-02-04 03:21:49 2022-02-04 13:38:53 2022-02-04 14:01:58 0:23:05 0:08:42 0:14:23 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} 1
pass 6660584 2022-02-04 03:21:50 2022-02-04 13:38:53 2022-02-04 14:13:46 0:34:53 0:19:14 0:15:39 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6660585 2022-02-04 03:21:51 2022-02-04 13:40:13 2022-02-04 14:06:22 0:26:09 0:11:15 0:14:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_namespaces} 3
pass 6660586 2022-02-04 03:21:52 2022-02-04 13:42:54 2022-02-04 15:07:24 1:24:30 1:12:12 0:12:18 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
fail 6660587 2022-02-04 03:21:53 2022-02-04 13:43:55 2022-02-04 14:18:38 0:34:43 0:19:27 0:15:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} 3
Failure Reason:

"2022-02-04T14:15:51.832658+0000 mon.a (mon.0) 228 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

pass 6660588 2022-02-04 03:21:53 2022-02-04 13:47:06 2022-02-04 14:20:19 0:33:13 0:15:09 0:18:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
fail 6660589 2022-02-04 03:21:54 2022-02-04 13:51:57 2022-02-04 14:23:07 0:31:10 0:19:12 0:11:58 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
Failure Reason:

"2022-02-04T14:21:45.288329+0000 mon.a (mon.0) 215 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660590 2022-02-04 03:21:55 2022-02-04 13:53:28 2022-02-04 14:17:36 0:24:08 0:11:17 0:12:51 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netns} 3
pass 6660591 2022-02-04 03:21:56 2022-02-04 13:55:59 2022-02-04 14:15:20 0:19:21 0:09:07 0:10:14 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_read_only} 1
pass 6660592 2022-02-04 03:21:57 2022-02-04 13:55:59 2022-02-04 14:27:14 0:31:15 0:17:43 0:13:32 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6660593 2022-02-04 03:21:57 2022-02-04 13:57:39 2022-02-04 14:48:08 0:50:29 0:38:16 0:12:13 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
pass 6660594 2022-02-04 03:21:58 2022-02-04 13:58:00 2022-02-04 14:20:15 0:22:15 0:11:48 0:10:27 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6660595 2022-02-04 03:21:59 2022-02-04 13:58:50 2022-02-04 14:21:50 0:23:00 0:10:42 0:12:18 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6660596 2022-02-04 03:22:00 2022-02-04 13:59:51 2022-02-04 14:29:20 0:29:29 0:15:57 0:13:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_concurrent} 3
pass 6660597 2022-02-04 03:22:00 2022-02-04 14:01:41 2022-02-04 14:25:24 0:23:43 0:11:08 0:12:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6660598 2022-02-04 03:22:01 2022-02-04 14:02:02 2022-02-04 14:35:42 0:33:40 0:21:22 0:12:18 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6660599 2022-02-04 03:22:02 2022-02-04 14:02:12 2022-02-04 14:25:51 0:23:39 0:11:43 0:11:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} 3
pass 6660600 2022-02-04 03:22:03 2022-02-04 14:02:22 2022-02-04 14:23:35 0:21:13 0:10:17 0:10:56 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_whole_object_zeroout} 1
pass 6660601 2022-02-04 03:22:04 2022-02-04 14:02:43 2022-02-04 14:33:29 0:30:46 0:19:00 0:11:46 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6660602 2022-02-04 03:22:04 2022-02-04 14:03:54 2022-02-04 14:26:32 0:22:38 0:10:28 0:12:10 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_kernel} 3
pass 6660603 2022-02-04 03:22:05 2022-02-04 14:04:54 2022-02-04 14:33:05 0:28:11 0:16:23 0:11:48 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6660604 2022-02-04 03:22:06 2022-02-04 14:05:35 2022-02-04 14:29:51 0:24:16 0:10:40 0:13:36 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6660605 2022-02-04 03:22:07 2022-02-04 14:05:55 2022-02-04 14:33:51 0:27:56 0:15:07 0:12:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} 3
fail 6660606 2022-02-04 03:22:08 2022-02-04 14:06:26 2022-02-04 14:38:09 0:31:43 0:19:17 0:12:26 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

"2022-02-04T14:36:14.929884+0000 mon.a (mon.0) 217 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660607 2022-02-04 03:22:08 2022-02-04 14:06:56 2022-02-04 14:46:01 0:39:05 0:24:14 0:14:51 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_simple_big} 3
pass 6660608 2022-02-04 03:22:09 2022-02-04 14:08:27 2022-02-04 14:29:46 0:21:19 0:09:23 0:11:56 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} 1
pass 6660609 2022-02-04 03:22:10 2022-02-04 14:08:27 2022-02-04 14:42:27 0:34:00 0:20:24 0:13:36 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6660610 2022-02-04 03:22:11 2022-02-04 14:09:08 2022-02-04 14:51:35 0:42:27 0:28:00 0:14:27 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_fio} 3
pass 6660611 2022-02-04 03:22:11 2022-02-04 14:09:18 2022-02-04 14:42:44 0:33:26 0:19:03 0:14:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_data_pool} 3
pass 6660612 2022-02-04 03:22:12 2022-02-04 14:11:09 2022-02-04 14:33:08 0:21:59 0:09:05 0:12:54 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
pass 6660613 2022-02-04 03:22:13 2022-02-04 14:45:57 1305 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
pass 6660614 2022-02-04 03:22:14 2022-02-04 14:12:29 2022-02-04 14:37:50 0:25:21 0:12:29 0:12:52 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6660615 2022-02-04 03:22:15 2022-02-04 14:12:30 2022-02-04 14:43:29 0:30:59 0:18:29 0:12:30 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6660616 2022-02-04 03:22:16 2022-02-04 14:13:50 2022-02-04 14:38:47 0:24:57 0:11:27 0:13:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_fallocate} 3
fail 6660617 2022-02-04 03:22:16 2022-02-04 14:14:41 2022-02-04 14:47:17 0:32:36 0:19:32 0:13:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_huge_osdmap} 3
Failure Reason:

"2022-02-04T14:34:15.826357+0000 mon.a (mon.0) 117 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6660618 2022-02-04 03:22:17 2022-02-04 14:15:21 2022-02-04 14:47:21 0:32:00 0:19:12 0:12:48 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

"2022-02-04T14:45:28.773885+0000 mon.a (mon.0) 188 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660619 2022-02-04 03:22:18 2022-02-04 14:17:43 2022-02-04 14:44:07 0:26:24 0:13:56 0:12:28 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6660620 2022-02-04 03:22:19 2022-02-04 14:18:43 2022-02-04 14:38:48 0:20:05 0:09:44 0:10:21 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_discard} 1
pass 6660621 2022-02-04 03:22:20 2022-02-04 14:19:14 2022-02-04 14:50:50 0:31:36 0:17:19 0:14:17 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6660622 2022-02-04 03:22:20 2022-02-04 14:20:24 2022-02-04 15:47:53 1:27:29 1:16:30 0:10:59 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6660623 2022-02-04 03:22:21 2022-02-04 14:20:25 2022-02-04 14:47:59 0:27:34 0:11:29 0:16:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_namespaces} 3
pass 6660624 2022-02-04 03:22:22 2022-02-04 14:21:56 2022-02-04 15:54:21 1:32:25 1:19:17 0:13:08 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6660625 2022-02-04 03:22:23 2022-02-04 14:22:16 2022-02-04 15:11:48 0:49:32 0:36:41 0:12:51 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6660626 2022-02-04 03:22:24 2022-02-04 14:22:16 2022-02-04 14:54:53 0:32:37 0:19:14 0:13:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2022-02-04T14:53:31.030457+0000 mon.a (mon.0) 251 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660627 2022-02-04 03:22:24 2022-02-04 14:23:17 2022-02-04 14:47:59 0:24:42 0:11:48 0:12:54 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6660628 2022-02-04 03:22:25 2022-02-04 14:24:17 2022-02-04 14:49:07 0:24:50 0:11:19 0:13:31 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netns} 3
pass 6660629 2022-02-04 03:22:26 2022-02-04 14:25:28 2022-02-04 14:46:11 0:20:43 0:09:43 0:11:00 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_huge_image} 1
pass 6660630 2022-02-04 03:22:27 2022-02-04 14:25:28 2022-02-04 15:01:22 0:35:54 0:22:48 0:13:06 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6660631 2022-02-04 03:22:28 2022-02-04 14:25:59 2022-02-04 14:50:16 0:24:17 0:12:14 0:12:03 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6660632 2022-02-04 03:22:28 2022-02-04 14:26:39 2022-02-04 14:50:58 0:24:19 0:10:53 0:13:26 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6660633 2022-02-04 03:22:29 2022-02-04 14:26:59 2022-02-04 14:54:49 0:27:50 0:15:16 0:12:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
pass 6660634 2022-02-04 03:22:30 2022-02-04 14:27:20 2022-02-04 14:50:52 0:23:32 0:10:34 0:12:58 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6660635 2022-02-04 03:22:31 2022-02-04 14:29:20 2022-02-04 15:01:53 0:32:33 0:19:27 0:13:06 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6660636 2022-02-04 03:22:32 2022-02-04 14:30:01 2022-02-04 14:53:48 0:23:47 0:11:27 0:12:20 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_image_read} 3
pass 6660637 2022-02-04 03:22:33 2022-02-04 14:31:51 2022-02-04 14:52:31 0:20:40 0:08:46 0:11:54 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} 1
fail 6660638 2022-02-04 03:22:33 2022-02-04 14:31:52 2022-02-04 14:59:10 0:27:18 0:16:10 0:11:08 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

Command failed on smithi198 with status 151: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.0 image_client.0'

pass 6660639 2022-02-04 03:22:34 2022-02-04 14:31:52 2022-02-04 14:54:48 0:22:56 0:10:09 0:12:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} 3
pass 6660640 2022-02-04 03:22:35 2022-02-04 14:45:01 2022-02-04 15:19:33 0:34:32 0:19:43 0:14:49 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6660641 2022-02-04 03:22:36 2022-02-04 14:46:02 2022-02-04 15:13:30 0:27:28 0:14:59 0:12:29 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6660642 2022-02-04 03:22:37 2022-02-04 14:46:02 2022-02-04 15:19:37 0:33:35 0:20:23 0:13:12 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_unmap} 3
pass 6660643 2022-02-04 03:22:37 2022-02-04 14:46:12 2022-02-04 15:13:38 0:27:26 0:14:32 0:12:54 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6660644 2022-02-04 03:22:38 2022-02-04 14:46:13 2022-02-04 15:32:44 0:46:31 0:26:27 0:20:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} 3
pass 6660645 2022-02-04 03:22:39 2022-02-04 14:46:43 2022-02-04 15:13:54 0:27:11 0:12:46 0:14:25 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_msgr_segments} 1
pass 6660646 2022-02-04 03:22:40 2022-02-04 14:46:43 2022-02-04 15:32:56 0:46:13 0:23:00 0:23:13 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6660647 2022-02-04 03:22:41 2022-02-04 14:47:24 2022-02-04 15:37:06 0:49:42 0:28:52 0:20:50 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_fio} 3
pass 6660648 2022-02-04 03:22:41 2022-02-04 14:47:24 2022-02-04 15:30:52 0:43:28 0:23:21 0:20:07 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_data_pool} 3
fail 6660649 2022-02-04 03:22:42 2022-02-04 14:47:45 2022-02-04 20:01:41 5:13:56 4:52:57 0:20:59 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi043 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude_t_zugad -r -- '-g auto -g blockdev -x clone'"

pass 6660650 2022-02-04 03:22:43 2022-02-04 14:47:55 2022-02-04 16:34:05 1:46:10 1:22:45 0:23:25 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6660651 2022-02-04 03:22:44 2022-02-04 14:48:05 2022-02-04 15:21:45 0:33:40 0:11:38 0:22:02 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6660652 2022-02-04 03:22:44 2022-02-04 14:48:06 2022-02-04 15:32:15 0:44:09 0:19:09 0:25:00 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
fail 6660653 2022-02-04 03:22:45 2022-02-04 14:48:06 2022-02-04 15:30:25 0:42:19 0:19:12 0:23:07 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

"2022-02-04T15:18:50.224025+0000 mon.a (mon.0) 178 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

dead 6660654 2022-02-04 03:22:46 2022-02-04 14:48:16 2022-02-04 15:08:58 0:20:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_huge_osdmap} 3
Failure Reason:

SSH connection to smithi131 was lost: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

dead 6660655 2022-02-04 03:22:47 2022-02-04 14:49:17 2022-02-04 14:49:19 0:00:02 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

Error reimaging machines: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/host/248/task

fail 6660656 2022-02-04 03:22:48 2022-02-04 14:49:17 2022-02-04 15:08:59 0:19:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
Failure Reason:

Command failed on smithi176 with status 2: 'dpkg-deb -c /tmp/linux-image.deb'

pass 6660657 2022-02-04 03:22:49 2022-02-04 14:49:38 2022-02-04 15:21:17 0:31:39 0:09:04 0:22:35 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_parent_overlap} 1
pass 6660658 2022-02-04 03:22:49 2022-02-04 14:50:08 2022-02-04 15:31:39 0:41:31 0:17:01 0:24:30 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6660659 2022-02-04 03:22:50 2022-02-04 14:50:08 2022-02-04 15:26:01 0:35:53 0:11:58 0:23:55 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} 3
pass 6660660 2022-02-04 03:22:51 2022-02-04 14:50:19 2022-02-04 16:29:05 1:38:46 1:14:43 0:24:03 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6660661 2022-02-04 03:22:52 2022-02-04 14:50:59 2022-02-04 15:58:32 1:07:33 0:42:42 0:24:51 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6660662 2022-02-04 03:22:53 2022-02-04 14:50:59 2022-02-04 15:30:40 0:39:41 0:15:45 0:23:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6660663 2022-02-04 03:22:53 2022-02-04 14:51:00 2022-02-04 15:29:26 0:38:26 0:13:02 0:25:24 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6660664 2022-02-04 03:22:54 2022-02-04 14:51:00 2022-02-04 15:26:44 0:35:44 0:11:49 0:23:55 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} 3
pass 6660665 2022-02-04 03:22:55 2022-02-04 14:51:20 2022-02-04 15:24:24 0:33:04 0:09:37 0:23:27 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} 1
pass 6660666 2022-02-04 03:22:56 2022-02-04 14:51:21 2022-02-04 15:43:59 0:52:38 0:28:02 0:24:36 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6660667 2022-02-04 03:22:56 2022-02-04 14:51:41 2022-02-04 15:29:07 0:37:26 0:12:33 0:24:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6660668 2022-02-04 03:22:57 2022-02-04 14:52:31 2022-02-04 15:29:40 0:37:09 0:12:38 0:24:31 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6660669 2022-02-04 03:22:58 2022-02-04 14:53:52 2022-02-04 15:34:26 0:40:34 0:18:09 0:22:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_concurrent} 3
pass 6660670 2022-02-04 03:22:59 2022-02-04 14:54:52 2022-02-04 15:28:24 0:33:32 0:11:45 0:21:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} 3
fail 6660671 2022-02-04 03:23:00 2022-02-04 14:54:53 2022-02-04 15:38:31 0:43:38 0:20:44 0:22:54 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2022-02-04T15:35:27.887722+0000 mon.a (mon.0) 207 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660672 2022-02-04 03:23:00 2022-02-04 14:55:03 2022-02-04 15:30:25 0:35:22 0:12:51 0:22:31 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_image_read} 3
pass 6660673 2022-02-04 03:23:01 2022-02-04 14:59:14 2022-02-04 15:29:50 0:30:36 0:10:56 0:19:40 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_whole_object_zeroout} 1
pass 6660674 2022-02-04 03:23:02 2022-02-04 14:59:24 2022-02-04 15:34:45 0:35:21 0:15:16 0:20:05 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6660675 2022-02-04 03:23:03 2022-02-04 15:01:25 2022-02-04 15:55:49 0:54:24 0:37:16 0:17:08 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
pass 6660676 2022-02-04 03:23:04 2022-02-04 15:01:55 2022-02-04 15:30:27 0:28:32 0:11:08 0:17:24 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_kernel} 3
pass 6660677 2022-02-04 03:23:04 2022-02-04 15:02:56 2022-02-04 15:34:51 0:31:55 0:15:32 0:16:23 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6660678 2022-02-04 03:23:05 2022-02-04 15:07:27 2022-02-04 15:33:14 0:25:47 0:10:53 0:14:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6660679 2022-02-04 03:23:06 2022-02-04 15:09:07 2022-02-04 15:37:06 0:27:59 0:15:13 0:12:46 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_unmap} 3
pass 6660680 2022-02-04 03:23:07 2022-02-04 15:09:08 2022-02-04 15:37:21 0:28:13 0:12:18 0:15:55 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6660681 2022-02-04 03:23:08 2022-02-04 15:11:58 2022-02-04 15:51:05 0:39:07 0:24:25 0:14:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_simple_big} 3
pass 6660682 2022-02-04 03:23:09 2022-02-04 15:13:39 2022-02-04 15:37:10 0:23:31 0:10:13 0:13:18 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_deep_flatten} 1
pass 6660683 2022-02-04 03:23:09 2022-02-04 15:13:39 2022-02-04 15:51:25 0:37:46 0:24:13 0:13:33 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6660684 2022-02-04 03:23:10 2022-02-04 15:14:00 2022-02-04 16:01:19 0:47:19 0:29:04 0:18:15 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} 3
pass 6660685 2022-02-04 03:23:11 2022-02-04 15:19:41 2022-02-04 15:55:13 0:35:32 0:23:02 0:12:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} 3
pass 6660686 2022-02-04 03:23:12 2022-02-04 15:19:41 2022-02-04 15:43:01 0:23:20 0:10:32 0:12:48 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
pass 6660687 2022-02-04 03:23:13 2022-02-04 15:19:41 2022-02-04 15:59:33 0:39:52 0:25:01 0:14:51 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
pass 6660688 2022-02-04 03:23:14 2022-02-04 15:21:52 2022-02-04 15:51:37 0:29:45 0:15:07 0:14:38 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_exclusive_option} 3
fail 6660689 2022-02-04 03:23:14 2022-02-04 15:26:03 2022-02-04 16:00:23 0:34:20 0:21:12 0:13:08 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2022-02-04T15:57:23.012247+0000 mon.a (mon.0) 257 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660690 2022-02-04 03:23:15 2022-02-04 15:26:53 2022-02-04 15:54:07 0:27:14 0:12:32 0:14:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_fallocate} 3
fail 6660691 2022-02-04 03:23:16 2022-02-04 15:28:34 2022-02-04 16:09:59 0:41:25 0:19:55 0:21:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} 3
Failure Reason:

"2022-02-04T16:07:31.525637+0000 mon.a (mon.0) 217 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660692 2022-02-04 03:23:17 2022-02-04 15:29:14 2022-02-04 16:28:02 0:58:48 0:37:45 0:21:03 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6660693 2022-02-04 03:23:17 2022-02-04 15:29:35 2022-02-04 16:03:34 0:33:59 0:14:01 0:19:58 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6660694 2022-02-04 03:23:18 2022-02-04 15:29:45 2022-02-04 15:56:59 0:27:14 0:09:51 0:17:23 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} 1
pass 6660695 2022-02-04 03:23:19 2022-02-04 15:29:45 2022-02-04 16:05:48 0:36:03 0:15:44 0:20:19 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6660696 2022-02-04 03:23:20 2022-02-04 15:30:26 2022-02-04 16:02:13 0:31:47 0:12:31 0:19:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_namespaces} 3
pass 6660697 2022-02-04 03:23:20 2022-02-04 15:30:26 2022-02-04 17:10:12 1:39:46 1:19:52 0:19:54 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6660698 2022-02-04 03:23:21 2022-02-04 15:30:36 2022-02-04 16:28:24 0:57:48 0:36:58 0:20:50 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6660699 2022-02-04 03:23:22 2022-02-04 15:30:47 2022-02-04 16:06:15 0:35:28 0:15:55 0:19:33 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6660700 2022-02-04 03:23:23 2022-02-04 15:30:57 2022-02-04 16:03:28 0:32:31 0:12:31 0:20:00 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6660701 2022-02-04 03:23:24 2022-02-04 15:31:48 2022-02-04 16:04:21 0:32:33 0:11:38 0:20:55 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netns} 3
pass 6660702 2022-02-04 03:23:24 2022-02-04 15:32:18 2022-02-04 16:01:41 0:29:23 0:09:36 0:19:47 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_huge_image} 1
pass 6660703 2022-02-04 03:23:25 2022-02-04 15:32:18 2022-02-04 16:14:54 0:42:36 0:21:19 0:21:17 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6660704 2022-02-04 03:23:26 2022-02-04 15:32:49 2022-02-04 17:14:39 1:41:50 1:22:12 0:19:38 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6660705 2022-02-04 03:23:27 2022-02-04 15:32:59 2022-02-04 16:04:36 0:31:37 0:12:12 0:19:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} 3
fail 6660706 2022-02-04 03:23:28 2022-02-04 15:33:19 2022-02-04 16:13:59 0:40:40 0:20:38 0:20:02 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

"2022-02-04T16:11:58.736973+0000 mon.a (mon.0) 306 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660707 2022-02-04 03:23:28 2022-02-04 15:34:30 2022-02-04 16:10:11 0:35:41 0:16:38 0:19:03 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_concurrent} 3
fail 6660708 2022-02-04 03:23:29 2022-02-04 15:34:50 2022-02-04 16:14:29 0:39:39 0:20:04 0:19:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_huge_tickets} 3
Failure Reason:

"2022-02-04T16:11:39.399705+0000 mon.a (mon.0) 234 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660709 2022-02-04 03:23:30 2022-02-04 15:35:01 2022-02-04 16:12:42 0:37:41 0:19:39 0:18:02 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6660710 2022-02-04 03:23:31 2022-02-04 15:37:11 2022-02-04 16:05:12 0:28:01 0:11:34 0:16:27 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
pass 6660711 2022-02-04 03:23:32 2022-02-04 15:37:12 2022-02-04 16:02:22 0:25:10 0:09:16 0:15:54 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_modprobe} 1
pass 6660712 2022-02-04 03:23:33 2022-02-04 15:37:12 2022-02-04 16:14:49 0:37:37 0:21:13 0:16:24 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
fail 6660713 2022-02-04 03:23:33 2022-02-04 15:37:22 2022-02-04 16:14:04 0:36:42 0:20:02 0:16:40 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

"2022-02-04T16:01:58.283328+0000 mon.a (mon.0) 141 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6660714 2022-02-04 03:23:34 2022-02-04 15:38:33 2022-02-04 16:12:29 0:33:56 0:17:42 0:16:14 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6660715 2022-02-04 03:23:35 2022-02-04 15:43:04 2022-02-04 16:06:23 0:23:19 0:10:22 0:12:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6660716 2022-02-04 03:23:36 2022-02-04 15:44:04 2022-02-04 16:15:28 0:31:24 0:15:28 0:15:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} 3
pass 6660717 2022-02-04 03:23:37 2022-02-04 15:47:55 2022-02-04 16:16:28 0:28:33 0:12:13 0:16:20 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6660718 2022-02-04 03:23:37 2022-02-04 15:51:06 2022-02-04 16:28:52 0:37:46 0:24:50 0:12:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_simple_big} 3
pass 6660719 2022-02-04 03:23:38 2022-02-04 15:51:26 2022-02-04 16:15:23 0:23:57 0:10:48 0:13:09 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} 1
pass 6660720 2022-02-04 03:23:39 2022-02-04 15:51:47 2022-02-04 16:33:38 0:41:51 0:26:33 0:15:18 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6660721 2022-02-04 03:23:40 2022-02-04 15:54:07 2022-02-04 16:36:30 0:42:23 0:28:48 0:13:35 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_fio} 3
pass 6660722 2022-02-04 03:23:41 2022-02-04 15:54:28 2022-02-04 16:32:53 0:38:25 0:23:59 0:14:26 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_data_pool} 3
fail 6660723 2022-02-04 03:23:41 2022-02-04 15:55:18 2022-02-04 16:29:49 0:34:31 0:19:50 0:14:41 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} 3
Failure Reason:

"2022-02-04T16:27:04.815846+0000 mon.a (mon.0) 221 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660724 2022-02-04 03:23:42 2022-02-04 15:55:59 2022-02-04 16:30:18 0:34:19 0:19:42 0:14:37 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6660725 2022-02-04 03:23:43 2022-02-04 15:58:39 2022-02-04 16:23:18 0:24:39 0:11:34 0:13:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_fallocate} 3
pass 6660726 2022-02-04 03:23:44 2022-02-04 15:59:40 2022-02-04 16:25:49 0:26:09 0:11:45 0:14:24 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_huge_osdmap} 3
fail 6660727 2022-02-04 03:23:45 2022-02-04 16:00:30 2022-02-04 16:36:57 0:36:27 0:19:47 0:16:40 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

"2022-02-04T16:23:27.270777+0000 mon.a (mon.0) 183 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6660728 2022-02-04 03:23:45 2022-02-04 16:01:21 2022-02-04 16:30:59 0:29:38 0:15:03 0:14:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6660729 2022-02-04 03:23:46 2022-02-04 16:01:41 2022-02-04 16:27:40 0:25:59 0:09:21 0:16:38 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_parent_overlap} 1
fail 6660730 2022-02-04 03:23:47 2022-02-04 16:02:22 2022-02-04 16:38:03 0:35:41 0:19:46 0:15:55 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2022-02-04T16:36:19.145838+0000 mon.a (mon.0) 203 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660731 2022-02-04 03:23:48 2022-02-04 16:02:32 2022-02-04 16:55:55 0:53:23 0:36:50 0:16:33 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 6660732 2022-02-04 03:23:49 2022-02-04 16:02:32 2022-02-04 16:29:53 0:27:21 0:11:58 0:15:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_namespaces} 3
pass 6660733 2022-02-04 03:23:49 2022-02-04 16:02:33 2022-02-04 17:31:57 1:29:24 1:14:51 0:14:33 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6660734 2022-02-04 03:23:50 2022-02-04 16:02:43 2022-02-04 17:00:44 0:58:01 0:42:15 0:15:46 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6660735 2022-02-04 03:23:51 2022-02-04 16:02:43 2022-02-04 16:34:34 0:31:51 0:16:13 0:15:38 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
fail 6660736 2022-02-04 03:23:52 2022-02-04 16:02:54 2022-02-04 16:39:24 0:36:30 0:19:50 0:16:40 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
Failure Reason:

"2022-02-04T16:37:44.164231+0000 mon.a (mon.0) 253 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6660737 2022-02-04 03:23:53 2022-02-04 16:03:34 2022-02-04 16:40:28 0:36:54 0:19:30 0:17:24 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

"2022-02-04T16:38:18.788023+0000 mon.a (mon.0) 303 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660738 2022-02-04 03:23:53 2022-02-04 16:04:24 2022-02-04 16:30:00 0:25:36 0:10:02 0:15:34 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_read_only} 1
pass 6660739 2022-02-04 03:23:54 2022-02-04 16:04:45 2022-02-04 16:43:26 0:38:41 0:22:14 0:16:27 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6660740 2022-02-04 03:23:55 2022-02-04 16:05:15 2022-02-04 16:33:19 0:28:04 0:12:12 0:15:52 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6660741 2022-02-04 03:23:56 2022-02-04 16:05:56 2022-02-04 16:31:32 0:25:36 0:10:44 0:14:52 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6660742 2022-02-04 03:23:57 2022-02-04 16:06:16 2022-02-04 16:40:39 0:34:23 0:19:20 0:15:03 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

"2022-02-04T16:28:49.874285+0000 mon.a (mon.0) 139 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6660743 2022-02-04 03:23:57 2022-02-04 16:06:26 2022-02-04 16:36:40 0:30:14 0:10:50 0:19:24 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6660744 2022-02-04 03:23:58 2022-02-04 16:10:07 2022-02-04 16:43:37 0:33:30 0:19:55 0:13:35 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6660745 2022-02-04 03:23:59 2022-02-04 16:10:17 2022-02-04 16:35:54 0:25:37 0:11:14 0:14:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_image_read} 3
pass 6660746 2022-02-04 03:24:00 2022-02-04 16:10:38 2022-02-04 16:31:38 0:21:00 0:09:43 0:11:17 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} 1
fail 6660747 2022-02-04 03:24:01 2022-02-04 16:10:38 2022-02-04 16:48:13 0:37:35 0:19:32 0:18:03 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

"2022-02-04T16:45:04.378852+0000 mon.a (mon.0) 257 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660748 2022-02-04 03:24:01 2022-02-04 16:12:39 2022-02-04 16:38:22 0:25:43 0:10:49 0:14:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} 3
fail 6660749 2022-02-04 03:24:02 2022-02-04 16:12:49 2022-02-04 16:49:42 0:36:53 0:19:58 0:16:55 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2022-02-04T16:47:21.003644+0000 mon.a (mon.0) 262 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6660750 2022-02-04 03:24:03 2022-02-04 16:14:10 2022-02-04 16:39:32 0:25:22 0:10:47 0:14:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6660751 2022-02-04 03:24:04 2022-02-04 16:14:10 2022-02-04 16:45:45 0:31:35 0:15:52 0:15:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_unmap} 3
fail 6660752 2022-02-04 03:24:05 2022-02-04 16:14:30 2022-02-04 16:50:18 0:35:48 0:19:40 0:16:08 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

"2022-02-04T16:36:55.677121+0000 mon.a (mon.0) 124 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6660753 2022-02-04 03:24:06 2022-02-04 16:14:51 2022-02-04 16:57:13 0:42:22 0:27:23 0:14:59 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} 3