Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7548722 2024-02-06 08:20:06 2024-02-07 11:46:23 2024-02-07 12:27:00 0:40:37 0:22:21 0:18:16 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

"2024-02-07T12:20:00.000195+0000 mon.a (mon.0) 1021 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 2 pool(s) do not have an application enabled" in cluster log

fail 7548723 2024-02-06 08:20:07 2024-02-07 11:52:44 2024-02-07 12:18:14 0:25:30 0:15:44 0:09:46 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_host_drain} 3
Failure Reason:

"2024-02-07T12:11:57.188303+0000 mon.a (mon.0) 248 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7548724 2024-02-06 08:20:08 2024-02-07 11:58:51 2024-02-07 12:41:21 0:42:30 0:32:43 0:09:47 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1707308581.3131835 mon.smithi047 (mon.0) 689 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log

fail 7548725 2024-02-06 08:20:09 2024-02-07 12:00:12 2024-02-07 12:46:02 0:45:50 0:34:37 0:11:13 smithi main centos 9.stream orch:cephadm/mgr-nfs-upgrade/{0-centos_9.stream 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} 2
Failure Reason:

"2024-02-07T12:19:28.182128+0000 mon.smithi174 (mon.0) 491 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 7548726 2024-02-06 08:20:10 2024-02-07 12:00:52 2024-02-07 12:54:37 0:53:45 0:43:13 0:10:32 smithi main ubuntu 22.04 orch:cephadm/nfs/{cluster/{1-node} conf/{client mds mon osd} overrides/ignorelist_health supported-random-distros$/{ubuntu_latest} tasks/nfs} 1
pass 7548727 2024-02-06 08:20:10 2024-02-07 12:03:39 2024-02-07 12:25:07 0:21:28 0:11:29 0:09:59 smithi main centos 9.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/off orchestrator_cli} 2
fail 7548728 2024-02-06 08:20:11 2024-02-07 12:03:50 2024-02-07 12:38:52 0:35:02 0:25:32 0:09:30 smithi main centos 9.stream orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-02-07T12:19:35.645380+0000 mon.a (mon.0) 191 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7548729 2024-02-06 08:20:12 2024-02-07 12:03:50 2024-02-07 12:31:13 0:27:23 0:17:09 0:10:14 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-02-07T12:21:23.116840+0000 mon.smithi029 (mon.0) 266 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7548730 2024-02-06 08:20:13 2024-02-07 12:03:51 2024-02-07 12:24:38 0:20:47 0:11:22 0:09:25 smithi main centos 9.stream orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_9.stream_runc} 1-start 2-services/basic 3-final} 1
fail 7548731 2024-02-06 08:20:14 2024-02-07 12:03:51 2024-02-07 12:24:57 0:21:06 0:11:22 0:09:44 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-02-07T12:20:24.995977+0000 mon.a (mon.0) 190 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7548732 2024-02-06 08:20:14 2024-02-07 12:03:51 2024-02-07 13:11:22 1:07:31 0:57:34 0:09:57 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-02-07T12:30:00.000165+0000 mon.a (mon.0) 1043 : cluster 3 [WRN] OSD_DOWN: 1 osds down" in cluster log

fail 7548733 2024-02-06 08:20:15 2024-02-07 12:04:12 2024-02-07 13:01:17 0:57:05 0:47:23 0:09:42 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} 2
Failure Reason:

"2024-02-07T12:19:14.252813+0000 mon.a (mon.0) 168 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 7548734 2024-02-06 08:20:16 2024-02-07 12:04:22 2024-02-07 12:27:18 0:22:56 0:13:06 0:09:50 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
pass 7548735 2024-02-06 08:20:17 2024-02-07 12:04:22 2024-02-07 12:39:36 0:35:14 0:23:57 0:11:17 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} 2
fail 7548736 2024-02-06 08:20:18 2024-02-07 12:07:37 2024-02-07 12:32:50 0:25:13 0:16:11 0:09:02 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

"2024-02-07T12:23:53.551579+0000 mon.smithi017 (mon.0) 262 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548737 2024-02-06 08:20:19 2024-02-07 12:07:47 2024-02-07 12:37:57 0:30:10 0:19:11 0:10:59 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

"2024-02-07T12:28:24.830540+0000 mon.smithi110 (mon.0) 255 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548738 2024-02-06 08:20:19 2024-02-07 12:08:18 2024-02-07 12:37:47 0:29:29 0:18:39 0:10:50 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-02-07T12:33:20.053950+0000 mon.a (mon.0) 890 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7548739 2024-02-06 08:20:20 2024-02-07 12:08:38 2024-02-07 12:39:37 0:30:59 0:20:49 0:10:10 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-02-07T12:29:53.629654+0000 mon.smithi012 (mon.0) 254 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7548740 2024-02-06 08:20:21 2024-02-07 12:09:49 2024-02-07 12:48:56 0:39:07 0:25:15 0:13:52 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 2
fail 7548741 2024-02-06 08:20:22 2024-02-07 12:13:00 2024-02-07 12:56:45 0:43:45 0:30:59 0:12:46 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-02-07T12:40:00.000125+0000 mon.a (mon.0) 908 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log

fail 7548742 2024-02-06 08:20:23 2024-02-07 12:13:50 2024-02-07 13:25:48 1:11:58 1:01:21 0:10:37 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

"2024-02-07T12:35:51.603505+0000 mon.a (mon.0) 181 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7548743 2024-02-06 08:20:23 2024-02-07 12:14:11 2024-02-07 12:41:37 0:27:26 0:15:20 0:12:06 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-02-07T12:33:31.715100+0000 mon.smithi033 (mon.0) 265 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7548744 2024-02-06 08:20:24 2024-02-07 12:16:11 2024-02-07 12:43:40 0:27:29 0:13:35 0:13:54 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_orch_cli} 1
fail 7548745 2024-02-06 08:20:25 2024-02-07 12:19:32 2024-02-07 16:10:11 3:50:39 3:36:33 0:14:06 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi098 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=44458ccedb18241cc2e17f10cdab3d1385399261 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

fail 7548746 2024-02-06 08:20:26 2024-02-07 12:19:33 2024-02-07 12:42:47 0:23:14 0:13:17 0:09:57 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

"2024-02-07T12:35:43.161027+0000 mon.smithi081 (mon.0) 264 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548747 2024-02-06 08:20:27 2024-02-07 12:19:33 2024-02-07 13:10:22 0:50:49 0:38:35 0:12:14 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_orch_cli_mon} 5
Failure Reason:

"2024-02-07T12:44:47.238575+0000 mon.a (mon.0) 348 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,e" in cluster log

pass 7548748 2024-02-06 08:20:28 2024-02-07 12:19:33 2024-02-07 12:53:26 0:33:53 0:22:30 0:11:23 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
fail 7548749 2024-02-06 08:20:28 2024-02-07 12:19:34 2024-02-07 12:44:31 0:24:57 0:14:46 0:10:11 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-02-07T12:35:57.798419+0000 mon.smithi159 (mon.0) 264 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548750 2024-02-06 08:20:29 2024-02-07 12:19:34 2024-02-07 12:52:12 0:32:38 0:20:51 0:11:47 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-02-07T12:41:18.142616+0000 mon.smithi105 (mon.0) 253 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548751 2024-02-06 08:20:30 2024-02-07 12:19:34 2024-02-07 13:19:04 0:59:30 0:50:07 0:09:23 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
Failure Reason:

"2024-02-07T12:41:06.086733+0000 mon.a (mon.0) 180 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7548752 2024-02-06 08:20:31 2024-02-07 12:19:35 2024-02-07 12:49:33 0:29:58 0:18:21 0:11:37 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} 3
Failure Reason:

"2024-02-07T12:44:19.636452+0000 mon.a (mon.0) 191 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7548753 2024-02-06 08:20:32 2024-02-07 12:19:35 2024-02-07 12:47:31 0:27:56 0:18:06 0:09:50 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

"2024-02-07T12:36:57.728302+0000 mon.smithi084 (mon.0) 262 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548754 2024-02-06 08:20:33 2024-02-07 12:19:36 2024-02-07 12:41:32 0:21:56 0:11:56 0:10:00 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-02-07T12:36:40.575822+0000 mon.a (mon.0) 247 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7548755 2024-02-06 08:20:33 2024-02-07 12:19:36 2024-02-07 13:11:31 0:51:55 0:41:35 0:10:20 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} 2
Failure Reason:

"2024-02-07T12:36:42.602698+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 7548756 2024-02-06 08:20:34 2024-02-07 12:19:36 2024-02-07 12:53:44 0:34:08 0:23:42 0:10:26 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} 2
fail 7548757 2024-02-06 08:20:35 2024-02-07 12:19:47 2024-02-07 12:47:33 0:27:46 0:16:31 0:11:15 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} 3
Failure Reason:

"2024-02-07T12:40:00.000133+0000 mon.a (mon.0) 361 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s)" in cluster log

fail 7548758 2024-02-06 08:20:36 2024-02-07 12:19:47 2024-02-07 12:49:21 0:29:34 0:15:17 0:14:17 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

"2024-02-07T12:40:36.028330+0000 mon.smithi067 (mon.0) 263 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548759 2024-02-06 08:20:37 2024-02-07 12:24:08 2024-02-07 13:07:52 0:43:44 0:32:42 0:11:02 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1707310031.1780024 mon.smithi148 (mon.0) 706 : cluster [WRN] Replacing daemon mds.cephfs.smithi148.okavyl as rank 0 with standby daemon mds.cephfs.smithi148.nrbdsx" in cluster log

fail 7548760 2024-02-06 08:20:38 2024-02-07 12:24:39 2024-02-07 12:48:17 0:23:38 0:12:40 0:10:58 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/repave-all} 2
Failure Reason:

"2024-02-07T12:42:03.631950+0000 mon.smithi164 (mon.0) 264 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7548761 2024-02-06 08:20:38 2024-02-07 12:25:09 2024-02-07 12:53:41 0:28:32 0:14:56 0:13:36 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
fail 7548762 2024-02-06 08:20:39 2024-02-07 12:27:50 2024-02-07 13:04:28 0:36:38 0:19:18 0:17:20 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/basic 3-final} 2
Failure Reason:

"2024-02-07T12:54:59.443116+0000 mon.smithi017 (mon.0) 255 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548763 2024-02-06 08:20:40 2024-02-07 12:35:01 2024-02-07 13:55:44 1:20:43 1:08:58 0:11:45 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-02-07T13:20:00.000254+0000 mon.a (mon.0) 2835 : cluster 3 [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets" in cluster log

fail 7548764 2024-02-06 08:20:41 2024-02-07 12:35:01 2024-02-07 13:37:55 1:02:54 0:52:53 0:10:01 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
Failure Reason:

"2024-02-07T13:00:00.086466+0000 mon.a (mon.0) 1108 : cluster 3 [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets" in cluster log

pass 7548765 2024-02-06 08:20:42 2024-02-07 12:35:02 2024-02-07 12:56:26 0:21:24 0:12:15 0:09:09 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_adoption} 1
fail 7548766 2024-02-06 08:20:43 2024-02-07 12:35:02 2024-02-07 12:59:05 0:24:03 0:13:28 0:10:35 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/client-keyring 3-final} 2
Failure Reason:

"2024-02-07T12:52:38.602157+0000 mon.smithi049 (mon.0) 259 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7548767 2024-02-06 08:20:44 2024-02-07 12:35:02 2024-02-07 12:56:12 0:21:10 0:11:35 0:09:35 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_ca_signed_key} 2
fail 7548768 2024-02-06 08:20:45 2024-02-07 12:35:03 2024-02-07 13:16:35 0:41:32 0:32:42 0:08:50 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
Failure Reason:

"2024-02-07T12:56:15.392664+0000 mon.a (mon.0) 179 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7548769 2024-02-06 08:20:46 2024-02-07 12:35:03 2024-02-07 13:02:50 0:27:47 0:14:35 0:13:12 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/iscsi 3-final} 2
Failure Reason:

"2024-02-07T12:56:23.071868+0000 mon.smithi121 (mon.0) 265 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7548770 2024-02-06 08:20:47 2024-02-07 12:39:44 2024-02-07 13:09:39 0:29:55 0:15:23 0:14:32 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_cephadm} 1
fail 7548771 2024-02-06 08:20:48 2024-02-07 12:48:53 2024-02-07 13:58:24 1:09:31 0:59:12 0:10:19 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
Failure Reason:

"2024-02-07T13:20:00.000185+0000 mon.a (mon.0) 1204 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set" in cluster log

fail 7548772 2024-02-06 08:20:48 2024-02-07 12:49:03 2024-02-07 13:22:20 0:33:17 0:22:11 0:11:06 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/jaeger 3-final} 2
Failure Reason:

"2024-02-07T13:12:06.082847+0000 mon.smithi137 (mon.0) 253 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548773 2024-02-06 08:20:49 2024-02-07 12:50:33 2024-02-07 13:20:10 0:29:37 0:20:43 0:08:54 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rm-zap-add} 2
Failure Reason:

"2024-02-07T13:11:29.947600+0000 mon.smithi033 (mon.0) 253 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7548774 2024-02-06 08:20:50 2024-02-07 12:50:34 2024-02-07 13:26:17 0:35:43 0:25:00 0:10:43 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} 2
fail 7548775 2024-02-06 08:20:51 2024-02-07 12:50:34 2024-02-07 13:08:13 0:17:39 0:08:31 0:09:08 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_cephadm_repos} 1
Failure Reason:

Command failed (workunit test cephadm/test_repos.sh) on smithi189 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=44458ccedb18241cc2e17f10cdab3d1385399261 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh'

fail 7548776 2024-02-06 08:20:52 2024-02-07 12:50:34 2024-02-07 16:40:38 3:50:04 3:37:48 0:12:16 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi165 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=44458ccedb18241cc2e17f10cdab3d1385399261 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

pass 7548777 2024-02-06 08:20:53 2024-02-07 12:50:35 2024-02-07 13:11:17 0:20:42 0:11:48 0:08:54 smithi main centos 9.stream orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_9.stream_runc} 2-node-mgr agent/on orchestrator_cli} 2
fail 7548778 2024-02-06 08:20:53 2024-02-07 12:50:35 2024-02-07 13:15:37 0:25:02 0:14:55 0:10:07 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/mirror 3-final} 2
Failure Reason:

"2024-02-07T13:07:26.368956+0000 mon.smithi174 (mon.0) 264 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7548779 2024-02-06 08:20:54 2024-02-07 12:50:36 2024-02-07 13:20:08 0:29:32 0:20:15 0:09:17 smithi main ubuntu 22.04 orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_22.04} 1-start 2-services/rgw 3-final} 1
fail 7548780 2024-02-06 08:20:55 2024-02-07 12:50:36 2024-02-07 13:14:23 0:23:47 0:12:24 0:11:23 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/classic start} 3
Failure Reason:

"2024-02-07T13:10:00.000130+0000 mon.a (mon.0) 610 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log

fail 7548781 2024-02-06 08:20:56 2024-02-07 12:50:36 2024-02-07 13:54:36 1:04:00 0:53:45 0:10:15 smithi main centos 9.stream orch:cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} 2
Failure Reason:

"2024-02-07T13:07:11.917665+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 7548782 2024-02-06 08:20:57 2024-02-07 12:50:37 2024-02-07 13:13:33 0:22:56 0:13:58 0:08:58 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_cephadm_timeout} 1
fail 7548783 2024-02-06 08:20:57 2024-02-07 12:50:37 2024-02-07 13:16:33 0:25:56 0:16:03 0:09:53 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} 2
Failure Reason:

"2024-02-07T13:08:31.278874+0000 mon.smithi110 (mon.0) 262 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7548784 2024-02-06 08:20:58 2024-02-07 12:50:37 2024-02-07 13:16:33 0:25:56 0:15:46 0:10:10 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 2
fail 7548785 2024-02-06 08:20:59 2024-02-07 12:50:38 2024-02-07 13:29:25 0:38:47 0:30:09 0:08:38 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
Failure Reason:

"2024-02-07T13:20:00.000112+0000 mon.a (mon.0) 1458 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set" in cluster log

fail 7548786 2024-02-06 08:21:00 2024-02-07 12:50:38 2024-02-07 13:52:14 1:01:36 0:52:30 0:09:06 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} 2
Failure Reason:

"2024-02-07T13:20:00.001057+0000 mon.a (mon.0) 2075 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled" in cluster log

fail 7548787 2024-02-06 08:21:01 2024-02-07 12:50:38 2024-02-07 13:23:14 0:32:36 0:22:00 0:10:36 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} 2
Failure Reason:

"2024-02-07T13:12:29.983793+0000 mon.smithi161 (mon.0) 253 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548788 2024-02-06 08:21:01 2024-02-07 12:50:39 2024-02-07 13:14:30 0:23:51 0:14:20 0:09:31 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_extra_daemon_features} 2
Failure Reason:

"2024-02-07T13:12:47.323958+0000 mon.a (mon.0) 27 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s)" in cluster log

fail 7548789 2024-02-06 08:21:02 2024-02-07 12:50:39 2024-02-07 13:14:42 0:24:03 0:14:20 0:09:43 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-ops/rm-zap-flag} 2
Failure Reason:

"2024-02-07T13:08:34.967716+0000 mon.smithi131 (mon.0) 265 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548790 2024-02-06 08:21:03 2024-02-07 12:50:39 2024-02-07 13:18:57 0:28:18 0:16:16 0:12:02 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} 2
Failure Reason:

"2024-02-07T13:11:20.309211+0000 mon.smithi071 (mon.0) 266 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548791 2024-02-06 08:21:04 2024-02-07 12:53:30 2024-02-07 13:38:19 0:44:49 0:32:18 0:12:31 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} 2
Failure Reason:

"2024-02-07T13:16:42.961666+0000 mon.a (mon.0) 182 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7548792 2024-02-06 08:21:05 2024-02-07 12:53:50 2024-02-07 13:27:55 0:34:05 0:22:38 0:11:27 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_host_drain} 3
Failure Reason:

"2024-02-07T13:16:33.659016+0000 mon.a (mon.0) 197 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7548793 2024-02-06 08:21:06 2024-02-07 12:53:51 2024-02-07 13:39:31 0:45:40 0:33:23 0:12:17 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

"1707311990.394204 mon.smithi106 (mon.0) 711 : cluster [WRN] Replacing daemon mds.cephfs.smithi106.utzjic as rank 0 with standby daemon mds.cephfs.smithi106.rggnwj" in cluster log

fail 7548794 2024-02-06 08:21:06 2024-02-07 12:56:22 2024-02-07 13:23:49 0:27:27 0:17:08 0:10:19 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} 2
Failure Reason:

"2024-02-07T13:13:45.433276+0000 mon.smithi078 (mon.0) 264 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548795 2024-02-06 08:21:07 2024-02-07 12:56:32 2024-02-07 14:05:24 1:08:52 0:49:00 0:19:52 smithi main ubuntu 22.04 orch:cephadm/thrash/{0-distro/ubuntu_22.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
Failure Reason:

"2024-02-07T13:27:07.691257+0000 mon.a (mon.0) 182 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

pass 7548796 2024-02-06 08:21:08 2024-02-07 13:05:54 2024-02-07 13:28:37 0:22:43 0:14:01 0:08:42 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_iscsi_container/{centos_9.stream test_iscsi_container}} 1
fail 7548797 2024-02-06 08:21:09 2024-02-07 13:05:54 2024-02-07 13:38:40 0:32:46 0:23:23 0:09:23 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} 2
Failure Reason:

"2024-02-07T13:23:58.900188+0000 mon.a (mon.0) 173 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7548798 2024-02-06 08:21:10 2024-02-07 13:05:54 2024-02-07 13:39:30 0:33:36 0:24:12 0:09:24 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} 2
Failure Reason:

"2024-02-07T13:26:05.961193+0000 mon.smithi121 (mon.0) 251 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548799 2024-02-06 08:21:10 2024-02-07 13:05:54 2024-02-07 13:29:21 0:23:27 0:14:02 0:09:25 smithi main centos 9.stream orch:cephadm/osds/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-ops/rm-zap-wait} 2
Failure Reason:

"2024-02-07T13:23:16.198542+0000 mon.smithi105 (mon.0) 265 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548800 2024-02-06 08:21:11 2024-02-07 13:05:55 2024-02-07 13:35:59 0:30:04 0:18:44 0:11:20 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_monitoring_stack_basic} 3
Failure Reason:

"2024-02-07T13:32:05.763203+0000 mon.a (mon.0) 580 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7548801 2024-02-06 08:21:12 2024-02-07 13:05:55 2024-02-07 13:37:17 0:31:22 0:15:06 0:16:16 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

"2024-02-07T13:29:10.515583+0000 mon.smithi001 (mon.0) 268 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548802 2024-02-06 08:21:13 2024-02-07 13:11:26 2024-02-07 13:37:46 0:26:20 0:11:14 0:15:06 smithi main centos 9.stream orch:cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} 3
Failure Reason:

"2024-02-07T13:32:31.770541+0000 mon.a (mon.0) 192 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7548803 2024-02-06 08:21:14 2024-02-07 13:17:24 2024-02-07 14:09:17 0:51:53 0:38:01 0:13:52 smithi main ubuntu 20.04 orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} 2
Failure Reason:

"2024-02-07T13:38:54.672610+0000 mon.a (mon.0) 172 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log

pass 7548804 2024-02-06 08:21:14 2024-02-07 13:21:15 2024-02-07 13:56:41 0:35:26 0:25:49 0:09:37 smithi main ubuntu 22.04 orch:cephadm/smoke/{0-distro/ubuntu_22.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
fail 7548805 2024-02-06 08:21:15 2024-02-07 13:21:15 2024-02-07 13:28:20 0:07:05 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
Failure Reason:

Command failed on smithi189 with status 1: 'sudo yum install -y kernel'

fail 7548806 2024-02-06 08:21:16 2024-02-07 13:21:16 2024-02-07 13:36:27 0:15:11 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

Failed to reconnect to smithi189

fail 7548807 2024-02-06 08:21:17 2024-02-07 13:21:16 2024-02-07 13:47:25 0:26:09 0:14:31 0:11:38 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs 3-final} 2
Failure Reason:

"2024-02-07T13:39:00.893045+0000 mon.smithi003 (mon.0) 263 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7548808 2024-02-06 08:21:18 2024-02-07 13:21:17 2024-02-07 13:51:49 0:30:32 0:20:10 0:10:22 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/on mon_election/connectivity task/test_orch_cli} 1
fail 7548809 2024-02-06 08:21:19 2024-02-07 13:21:17 2024-02-07 17:10:46 3:49:29 3:36:34 0:12:55 smithi main centos 9.stream orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi072 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=44458ccedb18241cc2e17f10cdab3d1385399261 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh'

fail 7548810 2024-02-06 08:21:19 2024-02-07 13:21:17 2024-02-07 13:51:56 0:30:39 0:20:30 0:10:09 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} 2
Failure Reason:

"2024-02-07T13:43:22.105432+0000 mon.smithi033 (mon.0) 254 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548811 2024-02-06 08:21:20 2024-02-07 13:21:18 2024-02-07 13:57:21 0:36:03 0:24:16 0:11:47 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_orch_cli_mon} 5
Failure Reason:

"2024-02-07T13:52:30.837747+0000 mon.a (mon.0) 1494 : cluster 3 [WRN] MON_DOWN: 1/4 mons down, quorum a,c,b" in cluster log

fail 7548812 2024-02-06 08:21:21 2024-02-07 13:21:18 2024-02-07 14:05:41 0:44:23 0:32:43 0:11:40 smithi main ubuntu 22.04 orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
Failure Reason:

"2024-02-07T13:44:08.200183+0000 mon.a (mon.0) 179 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log

fail 7548813 2024-02-06 08:21:22 2024-02-07 13:21:19 2024-02-07 13:53:28 0:32:09 0:21:40 0:10:29 smithi main ubuntu 22.04 orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} 2
Failure Reason:

"2024-02-07T13:43:22.190367+0000 mon.smithi154 (mon.0) 253 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548814 2024-02-06 08:21:23 2024-02-07 13:21:19 2024-02-07 13:45:20 0:24:01 0:13:42 0:10:19 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nvmeof 3-final} 2
Failure Reason:

"2024-02-07T13:38:59.979769+0000 mon.smithi110 (mon.0) 268 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

fail 7548815 2024-02-06 08:21:24 2024-02-07 13:21:19 2024-02-07 13:29:09 0:07:50 smithi main centos 9.stream orch:cephadm/thrash/{0-distro/centos_9.stream_runc 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
Failure Reason:

Command failed on smithi175 with status 1: 'sudo yum install -y kernel'

fail 7548816 2024-02-06 08:21:24 2024-02-07 13:21:20 2024-02-07 13:37:15 0:15:55 smithi main centos 9.stream orch:cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_rgw_multisite} 3
Failure Reason:

Failed to reconnect to smithi175

fail 7548817 2024-02-06 08:21:25 2024-02-07 13:21:20 2024-02-07 13:49:17 0:27:57 0:18:10 0:09:47 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} 2
Failure Reason:

"2024-02-07T13:38:48.112353+0000 mon.smithi131 (mon.0) 265 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log

pass 7548818 2024-02-06 08:21:26 2024-02-07 13:21:20 2024-02-07 13:54:58 0:33:38 0:23:17 0:10:21 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} 2
fail 7548819 2024-02-06 08:21:27 2024-02-07 13:21:21 2024-02-07 14:00:28 0:39:07 0:21:10 0:17:57 smithi main ubuntu 22.04 orch:cephadm/workunits/{0-distro/ubuntu_22.04 agent/off mon_election/classic task/test_set_mon_crush_locations} 3
Failure Reason:

"2024-02-07T13:50:47.174663+0000 mon.a (mon.0) 200 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

fail 7548820 2024-02-06 08:21:28 2024-02-07 13:28:42 2024-02-07 14:08:11 0:39:29 0:20:57 0:18:32 smithi main ubuntu 22.04 orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/rgw 3-final} 2
Failure Reason:

"2024-02-07T13:57:48.531273+0000 mon.smithi081 (mon.0) 255 : cluster 3 [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)" in cluster log