Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6426570 2021-10-08 03:20:52 2021-10-08 19:39:10 2021-10-08 20:00:26 0:21:16 0:07:48 0:13:28 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_deep_flatten} 1
pass 6426571 2021-10-08 03:20:53 2021-10-08 19:39:10 2021-10-08 20:23:31 0:44:21 0:19:55 0:24:26 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
dead 6426572 2021-10-08 03:20:54 2021-10-08 19:50:12 2021-10-08 19:54:10 0:03:58 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_fio} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426573 2021-10-08 03:20:54 2021-10-08 19:50:15 2021-10-08 20:20:30 0:30:15 0:15:52 0:14:23 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_data_pool} 3
dead 6426574 2021-10-08 03:20:55 2021-10-08 19:51:16 2021-10-08 20:07:20 0:16:04 gibba master krbd/singleton/{bluestore-bitmap conf ms_mode$/{crc} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426575 2021-10-08 03:20:56 2021-10-08 19:52:16 2021-10-08 20:49:29 0:57:13 0:42:40 0:14:33 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/backoff thrashosds-health workloads/rbd_fio} 3
dead 6426576 2021-10-08 03:20:56 2021-10-08 19:54:17 2021-10-08 20:00:15 0:05:58 gibba master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426577 2021-10-08 03:20:57 2021-10-08 19:56:17 2021-10-08 20:14:37 0:18:20 0:07:05 0:11:15 gibba master krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} 1
pass 6426578 2021-10-08 03:20:58 2021-10-08 19:57:28 2021-10-08 20:21:40 0:24:12 0:09:51 0:14:21 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_exclusive_option} 3
fail 6426579 2021-10-08 03:20:59 2021-10-08 20:00:28 2021-10-08 20:36:41 0:36:13 0:17:36 0:18:37 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2021-10-08T20:35:11.183045+0000 mon.a (mon.0) 320 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

dead 6426580 2021-10-08 03:20:59 2021-10-08 20:07:30 2021-10-08 20:11:27 0:03:57 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426581 2021-10-08 03:21:00 2021-10-08 20:07:30 2021-10-08 20:17:28 0:09:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_huge_osdmap} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426582 2021-10-08 03:21:01 2021-10-08 20:13:31 2021-10-08 20:32:41 0:19:10 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426583 2021-10-08 03:21:02 2021-10-08 20:17:42 2021-10-08 20:45:54 0:28:12 0:14:20 0:13:52 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
dead 6426584 2021-10-08 03:21:02 2021-10-08 20:20:32 2021-10-08 20:24:30 0:03:58 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_discard} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426585 2021-10-08 03:21:03 2021-10-08 20:20:33 2021-10-08 20:49:03 0:28:30 0:15:41 0:12:49 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6426586 2021-10-08 03:21:04 2021-10-08 20:21:43 2021-10-08 20:46:50 0:25:07 0:10:23 0:14:44 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} 3
dead 6426587 2021-10-08 03:21:05 2021-10-08 20:23:34 2021-10-08 20:47:58 0:24:24 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426588 2021-10-08 03:21:05 2021-10-08 20:32:55 2021-10-08 21:09:49 0:36:54 0:20:40 0:16:14 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6426589 2021-10-08 03:21:06 2021-10-08 20:36:46 2021-10-08 21:17:19 0:40:33 0:17:49 0:22:44 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2021-10-08T21:15:15.180260+0000 mon.a (mon.0) 239 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6426590 2021-10-08 03:21:07 2021-10-08 20:45:58 2021-10-08 21:10:18 0:24:20 0:11:33 0:12:47 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
dead 6426591 2021-10-08 03:21:07 2021-10-08 20:46:59 2021-10-08 20:52:07 0:05:08 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426592 2021-10-08 03:21:08 2021-10-08 20:48:09 2021-10-08 21:03:22 0:15:13 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} 1
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

fail 6426593 2021-10-08 03:21:09 2021-10-08 20:48:19 2021-10-08 21:20:24 0:32:05 0:17:46 0:14:19 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

"2021-10-08T21:17:56.243375+0000 mon.a (mon.0) 345 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6426594 2021-10-08 03:21:10 2021-10-08 20:49:10 2021-10-08 21:12:49 0:23:39 0:09:53 0:13:46 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_symlinks} 3
dead 6426595 2021-10-08 03:21:10 2021-10-08 20:49:30 2021-10-08 20:58:08 0:08:38 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426596 2021-10-08 03:21:11 2021-10-08 20:54:11 2021-10-08 21:27:39 0:33:28 0:13:10 0:20:18 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_concurrent} 3
dead 6426597 2021-10-08 03:21:12 2021-10-08 20:58:22 2021-10-08 21:07:30 0:09:08 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426598 2021-10-08 03:21:13 2021-10-08 21:03:33 2021-10-08 21:13:31 0:09:58 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426599 2021-10-08 03:21:13 2021-10-08 21:09:34 2021-10-08 21:31:06 0:21:32 0:08:51 0:12:41 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_image_read} 3
pass 6426600 2021-10-08 03:21:14 2021-10-08 21:09:54 2021-10-08 21:27:46 0:17:52 0:07:02 0:10:50 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_modprobe} 1
pass 6426601 2021-10-08 03:21:15 2021-10-08 21:10:25 2021-10-08 21:42:12 0:31:47 0:15:34 0:16:13 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
dead 6426602 2021-10-08 03:21:15 2021-10-08 21:12:55 2021-10-08 21:28:47 0:15:52 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426603 2021-10-08 03:21:16 2021-10-08 21:13:46 2021-10-08 21:38:35 0:24:49 0:08:44 0:16:05 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_kernel} 3
fail 6426604 2021-10-08 03:21:17 2021-10-08 21:17:26 2021-10-08 21:51:36 0:34:10 0:17:31 0:16:39 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2021-10-08T21:49:23.040290+0000 mon.a (mon.0) 270 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6426605 2021-10-08 03:21:18 2021-10-08 21:20:27 2021-10-08 21:49:05 0:28:38 0:08:23 0:20:15 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
dead 6426606 2021-10-08 03:21:18 2021-10-08 21:27:48 2021-10-08 21:31:46 0:03:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_unmap} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426607 2021-10-08 03:21:19 2021-10-08 21:27:49 2021-10-08 21:44:10 0:16:21 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426608 2021-10-08 03:21:20 2021-10-08 21:29:09 2021-10-08 22:10:32 0:41:23 0:25:55 0:15:28 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_simple_big} 3
pass 6426609 2021-10-08 03:21:21 2021-10-08 21:31:10 2021-10-08 21:48:58 0:17:48 0:07:04 0:10:44 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_msgr_segments} 1
pass 6426610 2021-10-08 03:21:21 2021-10-08 21:32:00 2021-10-08 22:14:01 0:42:01 0:23:19 0:18:42 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
fail 6426611 2021-10-08 03:21:22 2021-10-08 21:38:41 2021-10-08 22:19:40 0:40:59 0:25:03 0:15:56 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

"2021-10-08T22:06:57.335292+0000 osd.7 (osd.7) 3 : cluster [WRN] slow request osd_op(client.4419.0:246586 2.5 2:a27b4bc1:::rbd_data.1109ce52fac.0000000000000006:head [set-alloc-hint object_size 4194304 write_size 4194304,write 876544~4096 in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e24) initiated 2021-10-08T22:06:27.305509+0000 currently waiting for sub ops" in cluster log

dead 6426612 2021-10-08 03:21:23 2021-10-08 21:42:22 2021-10-08 21:48:20 0:05:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426613 2021-10-08 03:21:23 2021-10-08 21:44:23 2021-10-08 22:03:34 0:19:11 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_exclusive_option} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426614 2021-10-08 03:21:24 2021-10-08 21:48:33 2021-10-08 22:14:31 0:25:58 0:14:02 0:11:56 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
dead 6426615 2021-10-08 03:21:25 2021-10-08 21:49:14 2021-10-08 21:54:21 0:05:07 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426616 2021-10-08 03:21:26 2021-10-08 21:50:24 2021-10-08 22:12:51 0:22:27 0:09:38 0:12:49 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} 3
dead 6426617 2021-10-08 03:21:26 2021-10-08 21:51:45 2021-10-08 22:00:23 0:08:38 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426618 2021-10-08 03:21:27 2021-10-08 21:56:26 2021-10-08 22:06:24 0:09:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426619 2021-10-08 03:21:28 2021-10-08 22:02:27 2021-10-08 22:20:46 0:18:19 0:06:57 0:11:22 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} 1
fail 6426620 2021-10-08 03:21:29 2021-10-08 22:03:47 2021-10-08 22:35:37 0:31:50 0:16:26 0:15:24 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

pass 6426621 2021-10-08 03:21:29 2021-10-08 22:06:38 2021-10-08 22:31:54 0:25:16 0:09:07 0:16:09 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_namespaces} 3
pass 6426622 2021-10-08 03:21:30 2021-10-08 22:10:39 2021-10-08 23:24:22 1:13:43 0:58:38 0:15:05 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
fail 6426623 2021-10-08 03:21:31 2021-10-08 22:12:59 2021-10-08 22:43:27 0:30:28 0:17:07 0:13:21 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} 3
Failure Reason:

"2021-10-08T22:31:50.845770+0000 mon.a (mon.0) 166 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6426624 2021-10-08 03:21:32 2021-10-08 22:14:10 2021-10-08 22:42:00 0:27:50 0:14:42 0:13:08 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6426625 2021-10-08 03:21:32 2021-10-08 22:14:40 2021-10-08 22:42:55 0:28:15 0:11:39 0:16:36 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
dead 6426626 2021-10-08 03:21:33 2021-10-08 22:19:51 2021-10-08 22:24:48 0:04:57 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426627 2021-10-08 03:21:34 2021-10-08 22:20:51 2021-10-08 22:40:02 0:19:11 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_read_only} 1
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426628 2021-10-08 03:21:35 2021-10-08 22:25:02 2021-10-08 23:01:21 0:36:19 0:18:04 0:18:15 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6426629 2021-10-08 03:21:35 2021-10-08 22:32:03 2021-10-08 23:30:50 0:58:47 0:43:57 0:14:50 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
dead 6426630 2021-10-08 03:21:36 2021-10-08 22:35:44 2021-10-08 22:44:22 0:08:38 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426631 2021-10-08 03:21:37 2021-10-08 22:40:25 2021-10-08 23:03:19 0:22:54 0:08:53 0:14:01 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6426632 2021-10-08 03:21:38 2021-10-08 22:42:05 2021-10-08 23:56:18 1:14:13 1:01:43 0:12:30 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_concurrent} 3
pass 6426633 2021-10-08 03:21:38 2021-10-08 22:43:05 2021-10-08 23:04:35 0:21:30 0:08:41 0:12:49 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_huge_tickets} 3
dead 6426634 2021-10-08 03:21:39 2021-10-08 22:43:36 2021-10-08 22:50:24 0:06:48 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426635 2021-10-08 03:21:40 2021-10-08 22:46:26 2021-10-08 22:56:25 0:09:59 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426636 2021-10-08 03:21:40 2021-10-08 22:52:27 2021-10-08 23:11:38 0:19:11 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_whole_object_zeroout} 1
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426637 2021-10-08 03:21:41 2021-10-08 22:56:38 2021-10-08 23:30:40 0:34:02 0:17:16 0:16:46 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6426638 2021-10-08 03:21:42 2021-10-08 23:01:29 2021-10-08 23:24:43 0:23:14 0:08:43 0:14:31 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_kernel} 3
pass 6426639 2021-10-08 03:21:43 2021-10-08 23:03:20 2021-10-08 23:31:57 0:28:37 0:15:37 0:13:00 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
dead 6426640 2021-10-08 03:21:43 2021-10-08 23:04:40 2021-10-08 23:15:58 0:11:18 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426641 2021-10-08 03:21:44 2021-10-08 23:12:01 2021-10-08 23:21:59 0:09:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426642 2021-10-08 03:21:45 2021-10-08 23:18:02 2021-10-08 23:37:13 0:19:11 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426643 2021-10-08 03:21:46 2021-10-08 23:22:13 2021-10-09 00:05:42 0:43:29 0:29:03 0:14:26 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_simple_big} 3
dead 6426644 2021-10-08 03:21:46 2021-10-08 23:24:23 2021-10-08 23:28:21 0:03:58 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba027

fail 6426645 2021-10-08 03:21:47 2021-10-08 23:24:24 2021-10-08 23:54:02 0:29:38 0:16:24 0:13:14 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

"2021-10-08T23:41:49.568055+0000 mon.a (mon.0) 250 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6426646 2021-10-08 03:21:48 2021-10-08 23:24:44 2021-10-09 00:08:03 0:43:19 0:24:52 0:18:27 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_fio} 3
pass 6426647 2021-10-08 03:21:48 2021-10-08 23:30:45 2021-10-08 23:58:12 0:27:27 0:15:51 0:11:36 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_data_pool} 3
dead 6426648 2021-10-08 03:21:49 2021-10-08 23:30:55 2021-10-08 23:34:53 0:03:58 gibba master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba027

fail 6426649 2021-10-08 03:21:50 2021-10-08 23:30:56 2021-10-09 00:01:24 0:30:28 0:17:19 0:13:09 gibba master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
Failure Reason:

"2021-10-08T23:49:43.685769+0000 mon.a (mon.0) 201 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

dead 6426650 2021-10-08 03:21:51 2021-10-08 23:32:06 2021-10-08 23:52:26 0:20:20 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

dead 6426651 2021-10-08 03:21:51 2021-10-08 23:37:27 2021-10-08 23:56:36 0:19:09 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426652 2021-10-08 03:21:52 2021-10-08 23:52:39 2021-10-09 00:15:13 0:22:34 0:09:10 0:13:24 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_fallocate} 3
fail 6426653 2021-10-08 03:21:53 2021-10-08 23:54:09 2021-10-09 00:25:38 0:31:29 0:17:20 0:14:09 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_huge_osdmap} 3
Failure Reason:

"2021-10-09T00:23:44.460942+0000 mon.a (mon.0) 323 : cluster [WRN] Health check failed: 2 osds down (OSD_DOWN)" in cluster log

dead 6426654 2021-10-08 03:21:54 2021-10-08 23:56:20 2021-10-09 00:11:51 0:15:31 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426655 2021-10-08 03:21:54 2021-10-08 23:56:50 2021-10-09 00:21:35 0:24:45 0:11:55 0:12:50 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6426656 2021-10-08 03:21:55 2021-10-08 23:58:22 2021-10-09 00:15:20 0:16:58 0:07:38 0:09:20 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_discard} 1
pass 6426657 2021-10-08 03:21:56 2021-10-08 23:58:22 2021-10-09 00:28:37 0:30:15 0:16:17 0:13:58 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6426658 2021-10-08 03:21:57 2021-10-09 00:01:33 2021-10-09 01:17:05 1:15:32 0:59:24 0:16:08 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6426659 2021-10-08 03:21:57 2021-10-09 00:05:44 2021-10-09 00:29:22 0:23:38 0:10:02 0:13:36 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_namespaces} 3
dead 6426660 2021-10-08 03:21:58 2021-10-09 00:08:04 2021-10-09 00:27:05 0:19:01 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426661 2021-10-08 03:21:59 2021-10-09 00:12:05 2021-10-09 00:46:35 0:34:30 0:20:21 0:14:09 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_enumerate} 3
fail 6426662 2021-10-08 03:22:00 2021-10-09 00:15:16 2021-10-09 00:50:55 0:35:39 0:17:32 0:18:07 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
Failure Reason:

"2021-10-09T00:49:17.146717+0000 mon.a (mon.0) 223 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6426663 2021-10-08 03:22:00 2021-10-09 00:21:37 2021-10-09 00:48:49 0:27:12 0:10:44 0:16:28 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
dead 6426664 2021-10-08 03:22:01 2021-10-09 00:25:48 2021-10-09 00:42:18 0:16:30 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netns} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426665 2021-10-08 03:22:02 2021-10-09 00:27:18 2021-10-09 00:44:32 0:17:14 0:07:20 0:09:54 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_huge_image} 1
fail 6426666 2021-10-08 03:22:03 2021-10-09 00:27:18 2021-10-09 01:01:57 0:34:39 0:21:13 0:13:26 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
Failure Reason:

"2021-10-09T00:46:15.694408+0000 mon.a (mon.0) 294 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6426667 2021-10-08 03:22:03 2021-10-09 00:28:39 2021-10-09 00:52:46 0:24:07 0:09:45 0:14:22 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_symlinks} 3
dead 6426668 2021-10-08 03:22:04 2021-10-09 00:29:29 2021-10-09 00:57:31 0:28:02 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426669 2021-10-08 03:22:05 2021-10-09 00:42:31 2021-10-09 01:11:55 0:29:24 0:13:09 0:16:15 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
fail 6426670 2021-10-08 03:22:06 2021-10-09 00:46:42 2021-10-09 01:18:05 0:31:23 0:17:31 0:13:52 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_huge_tickets} 3
Failure Reason:

"2021-10-09T01:16:52.808718+0000 mon.a (mon.0) 259 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6426671 2021-10-08 03:22:06 2021-10-09 00:48:52 2021-10-09 01:24:03 0:35:11 0:21:19 0:13:52 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6426672 2021-10-08 03:22:07 2021-10-09 00:51:03 2021-10-09 01:14:08 0:23:05 0:08:52 0:14:13 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_image_read} 3
pass 6426673 2021-10-08 03:22:08 2021-10-09 00:52:53 2021-10-09 01:10:06 0:17:13 0:07:03 0:10:10 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} 1
dead 6426674 2021-10-08 03:22:09 2021-10-09 00:52:54 2021-10-09 01:12:44 0:19:50 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

fail 6426675 2021-10-08 03:22:09 2021-10-09 00:57:44 2021-10-09 01:31:10 0:33:26 0:17:23 0:16:03 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} 3
Failure Reason:

"2021-10-09T01:19:12.369417+0000 mon.a (mon.0) 171 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6426676 2021-10-08 03:22:10 2021-10-09 01:02:05 2021-10-09 01:41:10 0:39:05 0:17:17 0:21:48 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2021-10-09T01:39:21.318230+0000 mon.a (mon.0) 268 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6426677 2021-10-08 03:22:11 2021-10-09 01:11:57 2021-10-09 01:34:11 0:22:14 0:08:30 0:13:44 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6426678 2021-10-08 03:22:11 2021-10-09 01:12:57 2021-10-09 01:39:36 0:26:39 0:13:35 0:13:04 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_unmap} 3
pass 6426679 2021-10-08 03:22:12 2021-10-09 01:14:17 2021-10-09 01:40:25 0:26:08 0:10:52 0:15:16 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6426680 2021-10-08 03:22:13 2021-10-09 01:17:08 2021-10-09 01:59:09 0:42:01 0:28:54 0:13:07 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} 3
dead 6426681 2021-10-08 03:22:14 2021-10-09 01:18:09 2021-10-09 01:33:09 0:15:00 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_msgr_segments} 1
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426682 2021-10-08 03:22:14 2021-10-09 01:18:09 2021-10-09 02:01:22 0:43:13 0:25:14 0:17:59 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6426683 2021-10-08 03:22:15 2021-10-09 01:24:10 2021-10-09 02:08:23 0:44:13 0:25:13 0:19:00 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_fio} 3
fail 6426684 2021-10-08 03:22:16 2021-10-09 01:31:21 2021-10-09 02:03:24 0:32:03 0:17:10 0:14:53 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_data_pool} 3
Failure Reason:

"2021-10-09T01:51:21.781301+0000 mon.a (mon.0) 126 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

dead 6426685 2021-10-08 03:22:17 2021-10-09 01:34:12 2021-10-09 01:54:42 0:20:30 gibba master krbd/singleton/{bluestore-bitmap conf ms_mode$/{prefer-crc} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426686 2021-10-08 03:22:17 2021-10-09 01:39:43 2021-10-09 02:51:57 1:12:14 0:58:40 0:13:34 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6426687 2021-10-08 03:22:18 2021-10-09 01:40:33 2021-10-09 02:02:18 0:21:45 0:09:29 0:12:16 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6426688 2021-10-08 03:22:19 2021-10-09 01:41:13 2021-10-09 02:21:59 0:40:46 0:14:30 0:26:16 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
fail 6426689 2021-10-08 03:22:20 2021-10-09 01:54:55 2021-10-09 02:28:29 0:33:34 0:17:24 0:16:10 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} 3
Failure Reason:

"2021-10-09T02:26:39.504250+0000 mon.a (mon.0) 221 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6426690 2021-10-08 03:22:20 2021-10-09 01:59:16 2021-10-09 02:22:41 0:23:25 0:09:28 0:13:57 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_huge_osdmap} 3
fail 6426691 2021-10-08 03:22:21 2021-10-09 02:01:26 2021-10-09 02:31:41 0:30:15 0:17:37 0:12:38 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

"2021-10-09T02:29:54.347763+0000 mon.a (mon.0) 187 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6426692 2021-10-08 03:22:22 2021-10-09 02:02:27 2021-10-09 02:26:30 0:24:03 0:11:51 0:12:12 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
dead 6426693 2021-10-08 03:22:23 2021-10-09 02:03:27 2021-10-09 02:18:28 0:15:01 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_parent_overlap} 1
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426694 2021-10-08 03:22:23 2021-10-09 02:03:27 2021-10-09 02:35:41 0:32:14 0:16:02 0:16:12 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6426695 2021-10-08 03:22:24 2021-10-09 02:08:28 2021-10-09 02:43:14 0:34:46 0:08:56 0:25:50 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} 3
pass 6426696 2021-10-08 03:22:25 2021-10-09 02:22:00 2021-10-09 03:34:07 1:12:07 0:59:38 0:12:29 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6426697 2021-10-08 03:22:26 2021-10-09 02:22:51 2021-10-09 03:01:51 0:39:00 0:22:40 0:16:20 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6426698 2021-10-08 03:22:26 2021-10-09 02:26:31 2021-10-09 02:55:32 0:29:01 0:14:33 0:14:28 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
fail 6426699 2021-10-08 03:22:27 2021-10-09 02:28:32 2021-10-09 03:00:47 0:32:15 0:17:26 0:14:49 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
Failure Reason:

"2021-10-09T02:59:03.431849+0000 mon.a (mon.0) 360 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6426700 2021-10-08 03:22:28 2021-10-09 02:31:43 2021-10-09 03:05:00 0:33:17 0:17:22 0:15:55 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

"2021-10-09T02:52:59.334891+0000 mon.a (mon.0) 114 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

dead 6426701 2021-10-08 03:22:29 2021-10-09 02:35:43 2021-10-09 02:50:44 0:15:01 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} 1
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

fail 6426702 2021-10-08 03:22:30 2021-10-09 02:35:44 2021-10-09 03:12:35 0:36:51 0:17:12 0:19:39 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

"2021-10-09T03:00:18.560845+0000 mon.a (mon.0) 142 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6426703 2021-10-08 03:22:31 2021-10-09 02:43:15 2021-10-09 03:13:17 0:30:02 0:09:22 0:20:40 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6426704 2021-10-08 03:22:32 2021-10-09 02:52:06 2021-10-09 03:16:56 0:24:50 0:08:21 0:16:29 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6426705 2021-10-08 03:22:33 2021-10-09 02:55:37 2021-10-09 03:29:49 0:34:12 0:17:26 0:16:46 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

"2021-10-09T03:28:14.626930+0000 mon.a (mon.0) 334 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6426706 2021-10-08 03:22:33 2021-10-09 03:00:48 2021-10-09 03:23:16 0:22:28 0:08:33 0:13:55 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} 3
fail 6426707 2021-10-08 03:22:34 2021-10-09 03:01:58 2021-10-09 03:34:15 0:32:17 0:17:21 0:14:56 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

"2021-10-09T03:32:24.625279+0000 mon.a (mon.0) 300 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6426708 2021-10-08 03:22:35 2021-10-09 03:05:09 2021-10-09 03:33:45 0:28:36 0:09:11 0:19:25 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_image_read} 3
dead 6426709 2021-10-08 03:22:36 2021-10-09 03:12:40 2021-10-09 03:27:37 0:14:57 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_whole_object_zeroout} 1
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426710 2021-10-08 03:22:36 2021-10-09 03:12:40 2021-10-09 03:38:39 0:25:59 0:13:38 0:12:21 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6426711 2021-10-08 03:22:37 2021-10-09 03:13:21 2021-10-09 04:06:21 0:53:00 0:37:03 0:15:57 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
pass 6426712 2021-10-08 03:22:38 2021-10-09 03:17:01 2021-10-09 03:44:40 0:27:39 0:08:28 0:19:11 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_kernel} 3
pass 6426713 2021-10-08 03:22:39 2021-10-09 03:23:22 2021-10-09 03:56:59 0:33:37 0:15:32 0:18:05 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6426714 2021-10-08 03:22:39 2021-10-09 03:29:54 2021-10-09 03:55:12 0:25:18 0:08:23 0:16:55 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6426715 2021-10-08 03:22:40 2021-10-09 03:33:54 2021-10-09 03:59:28 0:25:34 0:13:39 0:11:55 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_unmap} 3
fail 6426716 2021-10-08 03:22:41 2021-10-09 03:34:15 2021-10-09 04:03:31 0:29:16 0:17:30 0:11:46 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

"2021-10-09T04:02:10.112024+0000 mon.a (mon.0) 308 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

fail 6426717 2021-10-08 03:22:42 2021-10-09 03:34:25 2021-10-09 04:08:04 0:33:39 0:17:33 0:16:06 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_simple_big} 3
Failure Reason:

"2021-10-09T03:56:11.469196+0000 mon.a (mon.0) 111 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

dead 6426718 2021-10-08 03:22:42 2021-10-09 03:38:46 2021-10-09 03:53:46 0:15:00 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_deep_flatten} 1
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426719 2021-10-08 03:22:43 2021-10-09 03:38:46 2021-10-09 04:24:03 0:45:17 0:27:33 0:17:44 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6426720 2021-10-08 03:22:44 2021-10-09 03:44:47 2021-10-09 04:32:38 0:47:51 0:25:09 0:22:42 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} 3
fail 6426721 2021-10-08 03:22:45 2021-10-09 03:55:19 2021-10-09 04:04:26 0:09:07 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} 3
Failure Reason:

Command failed on gibba011 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/master'

dead 6426722 2021-10-08 03:22:45 2021-10-09 03:57:09 2021-10-09 04:01:07 0:03:58 gibba master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426723 2021-10-08 03:22:46 2021-10-09 03:57:09 2021-10-09 04:30:42 0:33:33 0:19:40 0:13:53 gibba master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
pass 6426724 2021-10-08 03:22:47 2021-10-09 03:59:30 2021-10-09 04:24:45 0:25:15 0:09:30 0:15:45 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6426725 2021-10-08 03:22:48 2021-10-09 04:03:41 2021-10-09 04:31:37 0:27:56 0:15:17 0:12:39 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6426726 2021-10-08 03:22:48 2021-10-09 04:04:32 2021-10-09 04:27:41 0:23:09 0:09:22 0:13:47 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_fallocate} 3
fail 6426727 2021-10-08 03:22:49 2021-10-09 04:06:23 2021-10-09 04:37:14 0:30:51 0:17:24 0:13:27 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} 3
Failure Reason:

"2021-10-09T04:35:09.377737+0000 mon.a (mon.0) 232 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 6426728 2021-10-08 03:22:50 2021-10-09 04:08:13 2021-10-09 05:11:22 1:03:09 0:35:51 0:27:18 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6426729 2021-10-08 03:22:51 2021-10-09 04:24:05 2021-10-09 04:48:02 0:23:57 0:11:38 0:12:19 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
dead 6426730 2021-10-08 03:22:51 2021-10-09 04:24:46 2021-10-09 04:28:43 0:03:57 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba027

fail 6426731 2021-10-08 03:22:52 2021-10-09 04:24:46 2021-10-09 04:57:03 0:32:17 0:16:26 0:15:51 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

dead 6426732 2021-10-08 03:22:53 2021-10-09 04:27:47 2021-10-09 04:44:33 0:16:46 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_namespaces} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

fail 6426733 2021-10-08 03:22:54 2021-10-09 04:29:37 2021-10-09 04:59:56 0:30:19 0:17:16 0:13:03 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

"2021-10-09T04:48:43.717398+0000 mon.a (mon.0) 108 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6426734 2021-10-08 03:22:54 2021-10-09 04:30:48 2021-10-09 05:04:58 0:34:10 0:20:02 0:14:08 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6426735 2021-10-08 03:22:55 2021-10-09 04:31:38 2021-10-09 04:59:55 0:28:17 0:14:30 0:13:47 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6426736 2021-10-08 03:22:56 2021-10-09 04:32:38 2021-10-09 05:00:23 0:27:45 0:10:36 0:17:09 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
dead 6426737 2021-10-08 03:22:57 2021-10-09 04:37:19 2021-10-09 04:59:46 0:22:27 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netns} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

dead 6426738 2021-10-08 03:22:57 2021-10-09 04:44:50 2021-10-09 04:48:48 0:03:58 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_huge_image} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426739 2021-10-08 03:22:58 2021-10-09 04:44:51 2021-10-09 05:23:29 0:38:38 0:22:42 0:15:56 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6426740 2021-10-08 03:22:59 2021-10-09 04:48:11 2021-10-09 06:06:20 1:18:09 0:58:15 0:19:54 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
dead 6426741 2021-10-08 03:23:00 2021-10-09 04:57:13 2021-10-09 05:15:04 0:17:51 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

fail 6426742 2021-10-08 03:23:00 2021-10-09 05:00:04 2021-10-09 05:29:24 0:29:20 0:17:39 0:11:41 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

"2021-10-09T05:17:46.360483+0000 mon.a (mon.0) 141 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6426743 2021-10-08 03:23:01 2021-10-09 05:00:04 2021-10-09 05:25:12 0:25:08 0:13:10 0:11:58 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_concurrent} 3
pass 6426744 2021-10-08 03:23:02 2021-10-09 05:00:04 2021-10-09 05:21:41 0:21:37 0:08:50 0:12:47 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6426745 2021-10-08 03:23:03 2021-10-09 05:00:24 2021-10-09 05:38:20 0:37:56 0:21:29 0:16:27 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6426746 2021-10-08 03:23:04 2021-10-09 05:05:05 2021-10-09 05:32:40 0:27:35 0:08:46 0:18:49 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
dead 6426747 2021-10-08 03:23:04 2021-10-09 05:11:26 2021-10-09 05:15:24 0:03:58 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_modprobe} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426748 2021-10-08 03:23:05 2021-10-09 05:11:27 2021-10-09 05:30:17 0:18:50 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426749 2021-10-08 03:23:06 2021-10-09 05:15:17 2021-10-09 05:41:02 0:25:45 0:08:26 0:17:19 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_kernel} 3
pass 6426750 2021-10-08 03:23:07 2021-10-09 05:21:48 2021-10-09 05:52:54 0:31:06 0:17:10 0:13:56 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6426751 2021-10-08 03:23:08 2021-10-09 05:23:39 2021-10-09 05:44:36 0:20:57 0:08:27 0:12:30 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6426752 2021-10-08 03:23:08 2021-10-09 05:25:19 2021-10-09 05:54:34 0:29:15 0:13:23 0:15:52 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} 3
dead 6426753 2021-10-08 03:23:09 2021-10-09 05:29:30 2021-10-09 05:45:31 0:16:01 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426754 2021-10-08 03:23:10 2021-10-09 05:30:31 2021-10-09 06:09:59 0:39:28 0:25:42 0:13:46 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_simple_big} 3
dead 6426755 2021-10-08 03:23:11 2021-10-09 05:32:41 2021-10-09 05:36:39 0:03:58 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba027

fail 6426756 2021-10-08 03:23:11 2021-10-09 05:32:41 2021-10-09 06:05:39 0:32:58 0:16:18 0:16:40 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

"2021-10-09T05:54:51.007722+0000 mon.a (mon.0) 144 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6426757 2021-10-08 03:23:12 2021-10-09 05:38:22 2021-10-09 06:10:16 0:31:54 0:17:19 0:14:35 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

"2021-10-09T05:58:07.011066+0000 mon.a (mon.0) 131 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6426759 2021-10-08 03:23:13 2021-10-09 05:41:03 2021-10-09 06:15:57 0:34:54 0:19:30 0:15:24 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_data_pool} 3
dead 6426761 2021-10-08 03:23:14 2021-10-09 05:44:44 2021-10-09 06:00:44 0:16:00 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426763 2021-10-08 03:23:15 2021-10-09 05:45:44 2021-10-09 06:18:13 0:32:29 0:14:09 0:18:20 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6426764 2021-10-08 03:23:15 2021-10-09 05:52:55 2021-10-09 06:15:50 0:22:55 0:09:36 0:13:19 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_fallocate} 3
dead 6426765 2021-10-08 03:23:16 2021-10-09 05:54:36 2021-10-09 06:04:54 0:10:18 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_huge_osdmap} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426766 2021-10-08 03:23:17 2021-10-09 06:00:57 2021-10-09 06:20:08 0:19:11 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

fail 6426767 2021-10-08 03:23:18 2021-10-09 06:05:08 2021-10-09 06:34:50 0:29:42 0:17:16 0:12:26 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
Failure Reason:

"2021-10-09T06:22:53.511525+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6426768 2021-10-08 03:23:19 2021-10-09 06:05:48 2021-10-09 06:23:29 0:17:41 0:07:08 0:10:33 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_parent_overlap} 1
dead 6426769 2021-10-08 03:23:19 2021-10-09 06:06:28 2021-10-09 06:10:56 0:04:28 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426770 2021-10-08 03:23:20 2021-10-09 06:06:59 2021-10-09 07:01:23 0:54:24 0:38:50 0:15:34 gibba master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 6426771 2021-10-08 03:23:21 2021-10-09 06:10:09 2021-10-09 06:31:24 0:21:15 0:09:41 0:11:34 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_namespaces} 3
dead 6426772 2021-10-08 03:23:22 2021-10-09 06:10:20 2021-10-09 06:16:57 0:06:37 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426773 2021-10-08 03:23:22 2021-10-09 06:13:00 2021-10-09 06:51:04 0:38:04 0:23:16 0:14:48 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6426774 2021-10-08 03:23:23 2021-10-09 06:15:51 2021-10-09 06:43:19 0:27:28 0:14:39 0:12:49 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
fail 6426775 2021-10-08 03:23:24 2021-10-09 06:16:01 2021-10-09 06:47:36 0:31:35 0:17:17 0:14:18 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
Failure Reason:

"2021-10-09T06:46:23.432527+0000 mon.a (mon.0) 262 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

dead 6426776 2021-10-08 03:23:25 2021-10-09 06:18:22 2021-10-09 06:22:59 0:04:37 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426777 2021-10-08 03:23:25 2021-10-09 06:19:02 2021-10-09 06:35:23 0:16:21 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_read_only} 1
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426778 2021-10-08 03:23:26 2021-10-09 06:20:22 2021-10-09 07:00:15 0:39:53 0:24:32 0:15:21 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
dead 6426779 2021-10-08 03:23:27 2021-10-09 06:23:13 2021-10-09 06:29:01 0:05:48 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_symlinks} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426780 2021-10-08 03:23:28 2021-10-09 06:25:04 2021-10-09 06:35:02 0:09:58 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba027

dead 6426781 2021-10-08 03:23:28 2021-10-09 06:31:05 2021-10-09 09:14:44 2:43:39 2:30:56 0:12:43 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

SSH connection to gibba036 was lost: 'sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0'

pass 6426782 2021-10-08 03:23:29 2021-10-09 06:31:25 2021-10-09 06:56:02 0:24:37 0:08:26 0:16:11 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_huge_tickets} 3
dead 6426783 2021-10-08 03:23:30 2021-10-09 06:34:56 2021-10-09 06:50:36 0:15:40 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

fail 6426784 2021-10-08 03:23:31 2021-10-09 06:35:36 2021-10-09 07:11:18 0:35:42 0:17:13 0:18:29 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

"2021-10-09T06:59:38.364162+0000 mon.a (mon.0) 176 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

dead 6426785 2021-10-08 03:23:31 2021-10-09 06:42:17 2021-10-09 06:46:15 0:03:58 gibba master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba027

pass 6426786 2021-10-08 03:23:32 2021-10-09 06:42:17 2021-10-09 07:10:40 0:28:23 0:15:59 0:12:24 gibba master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6426787 2021-10-08 03:23:33 2021-10-09 06:43:28 2021-10-09 07:08:44 0:25:16 0:08:27 0:16:49 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} 3
dead 6426788 2021-10-08 03:23:34 2021-10-09 06:47:39 2021-10-09 07:05:49 0:18:10 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6426789 2021-10-08 03:23:34 2021-10-09 06:50:49 2021-10-09 07:12:23 0:21:34 0:08:10 0:13:24 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6426790 2021-10-08 03:23:35 2021-10-09 06:51:10 2021-10-09 07:21:20 0:30:10 0:13:17 0:16:53 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_unmap} 3
pass 6426791 2021-10-08 03:23:36 2021-10-09 06:56:11 2021-10-09 07:25:31 0:29:20 0:11:56 0:17:24 gibba master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6426792 2021-10-08 03:23:37 2021-10-09 07:00:21 2021-10-09 07:44:45 0:44:24 0:29:56 0:14:28 gibba master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} 3