| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| lflores | 2024-02-13 17:16:45 | 2024-02-13 20:33:37 | 2024-02-14 08:46:34 | 12:12:57 | rados | wip-yuri10-testing-2024-02-08-0854-pacific | smithi | 0e714d9 | 13 | 53 | 1 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 7558694 |
|
2024-02-13 17:18:51 | 2024-02-13 20:33:37 | 2024-02-13 21:27:09 | 0:53:32 | 0:42:45 | 0:10:47 | smithi | main | centos | 8.stream | rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} | 2 |
Failure Reason:
"2024-02-13T21:20:00.000218+0000 mon.a (mon.0) 3123 : cluster [WRN] pool 'test-rados-api-smithi076-75770-134' with cache_mode readproxy needs hit_set_type to be set but it is not" in cluster log |
||||||||||||||
| fail | 7558695 |
|
2024-02-13 17:18:52 | 2024-02-13 20:33:37 | 2024-02-13 22:25:13 | 1:51:36 | 1:42:16 | 0:09:20 | smithi | main | ubuntu | 18.04 | rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} | 3 |
Failure Reason:
"2024-02-13T21:20:00.000325+0000 mon.a (mon.0) 1403 : cluster [WRN] pg 3.6 is stuck undersized for 3m, current state active+recovering+undersized+degraded+remapped, last acting [0,4]" in cluster log |
||||||||||||||
| dead | 7558696 |
|
2024-02-13 17:18:53 | 2024-02-13 20:33:37 | 2024-02-14 08:46:34 | 12:12:57 | smithi | main | ubuntu | 20.04 | rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} | 1 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 7558697 |
|
2024-02-13 17:18:54 | 2024-02-13 20:33:38 | 2024-02-13 21:21:23 | 0:47:45 | 0:37:27 | 0:10:18 | smithi | main | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
Failure Reason:
"2024-02-13T21:05:34.938667+0000 mon.smithi157 (mon.0) 501 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7558698 |
|
2024-02-13 17:18:55 | 2024-02-13 20:33:38 | 2024-02-13 21:16:39 | 0:43:01 | 0:31:35 | 0:11:26 | smithi | main | ubuntu | 20.04 | rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} | 2 |
Failure Reason:
"2024-02-13T21:09:40.056777+0000 mon.a (mon.0) 506 : cluster [WRN] Health check failed: all OSDs are running pacific or later but require_osd_release < pacific (OSD_UPGRADE_FINISHED)" in cluster log |
||||||||||||||
| pass | 7558699 |
|
2024-02-13 17:18:56 | 2024-02-13 20:34:29 | 2024-02-13 21:07:18 | 0:32:49 | 0:20:56 | 0:11:53 | smithi | main | ubuntu | 20.04 | rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 |
| fail | 7558700 |
|
2024-02-13 17:18:56 | 2024-02-13 20:34:39 | 2024-02-13 21:17:44 | 0:43:05 | 0:33:33 | 0:09:32 | smithi | main | centos | 8.stream | rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} | 1 |
Failure Reason:
"2024-02-13T21:04:04.516735+0000 mon.a (mon.0) 500 : cluster [WRN] Replacing daemon mds.a.smithi097.fryeon as rank 0 with standby daemon mds.user_test_fs.smithi097.tblcmc" in cluster log |
||||||||||||||
| pass | 7558701 |
|
2024-02-13 17:18:57 | 2024-02-13 20:34:39 | 2024-02-13 21:08:09 | 0:33:30 | 0:24:21 | 0:09:09 | smithi | main | ubuntu | 18.04 | rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} | 2 |
| fail | 7558702 |
|
2024-02-13 17:18:58 | 2024-02-13 20:34:50 | 2024-02-13 21:33:32 | 0:58:42 | 0:46:46 | 0:11:56 | smithi | main | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} | 2 |
Failure Reason:
expected string or bytes-like object |
||||||||||||||
| pass | 7558703 |
|
2024-02-13 17:18:59 | 2024-02-13 20:36:21 | 2024-02-13 21:19:13 | 0:42:52 | 0:33:42 | 0:09:10 | smithi | main | rhel | 8.6 | rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} | 2 |
| fail | 7558704 |
|
2024-02-13 17:19:00 | 2024-02-13 20:37:31 | 2024-02-13 21:06:51 | 0:29:20 | 0:19:34 | 0:09:46 | smithi | main | centos | 8.stream | rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} | 1 |
Failure Reason:
"2024-02-13T21:04:49.919283+0000 mon.a (mon.0) 466 : cluster [WRN] Health check failed: cephadm background work is paused (CEPHADM_PAUSED)" in cluster log |
||||||||||||||
| fail | 7558705 |
|
2024-02-13 17:19:01 | 2024-02-13 20:37:42 | 2024-02-13 21:25:19 | 0:47:37 | 0:35:23 | 0:12:14 | smithi | main | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
Failure Reason:
"2024-02-13T21:10:00.000102+0000 mon.smithi023 (mon.0) 541 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data" in cluster log |
||||||||||||||
| pass | 7558706 |
|
2024-02-13 17:19:02 | 2024-02-13 20:39:02 | 2024-02-13 21:27:04 | 0:48:02 | 0:37:58 | 0:10:04 | smithi | main | centos | 8.stream | rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} | 5 |
| fail | 7558707 |
|
2024-02-13 17:19:02 | 2024-02-13 20:39:53 | 2024-02-13 21:12:17 | 0:32:24 | 0:21:59 | 0:10:25 | smithi | main | ubuntu | 20.04 | rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} | 2 |
Failure Reason:
Command failed on smithi017 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.17:/foouser /mnt/foo'" |
||||||||||||||
| fail | 7558708 |
|
2024-02-13 17:19:03 | 2024-02-13 20:40:03 | 2024-02-13 21:21:27 | 0:41:24 | 0:31:02 | 0:10:22 | smithi | main | centos | 8.stream | rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} | 2 |
Failure Reason:
"2024-02-13T21:18:53.844837+0000 mon.a (mon.0) 555 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
| fail | 7558709 |
|
2024-02-13 17:19:04 | 2024-02-13 20:40:14 | 2024-02-13 21:25:44 | 0:45:30 | 0:35:40 | 0:09:50 | smithi | main | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
Failure Reason:
"2024-02-13T21:17:08.552198+0000 mon.smithi060 (mon.0) 464 : cluster [WRN] daemon mds.cephfs.smithi060.bnewex compat changed unexpectedly" in cluster log |
||||||||||||||
| fail | 7558710 |
|
2024-02-13 17:19:05 | 2024-02-13 20:40:34 | 2024-02-13 21:24:00 | 0:43:26 | 0:31:46 | 0:11:40 | smithi | main | centos | 8.stream | rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 |
Failure Reason:
"2024-02-13T21:01:55.823868+0000 mon.smithi153 (mon.0) 329 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
| fail | 7558711 |
|
2024-02-13 17:19:06 | 2024-02-13 20:42:05 | 2024-02-13 21:09:53 | 0:27:48 | 0:17:18 | 0:10:30 | smithi | main | centos | 8.stream | rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} | 3 |
Failure Reason:
'package_manager_version' |
||||||||||||||
| fail | 7558712 |
|
2024-02-13 17:19:07 | 2024-02-13 20:42:35 | 2024-02-13 21:35:13 | 0:52:38 | 0:40:56 | 0:11:42 | smithi | main | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} | 2 |
Failure Reason:
expected string or bytes-like object |
||||||||||||||
| fail | 7558713 |
|
2024-02-13 17:19:07 | 2024-02-13 20:43:15 | 2024-02-13 21:22:25 | 0:39:10 | 0:29:26 | 0:09:44 | smithi | main | centos | 8.stream | rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} | 2 |
Failure Reason:
"2024-02-13T21:02:43.546208+0000 mon.a (mon.0) 381 : cluster [WRN] Health check failed: 1 host (1 osds) down (OSD_HOST_DOWN)" in cluster log |
||||||||||||||
| pass | 7558714 |
|
2024-02-13 17:19:08 | 2024-02-13 20:43:16 | 2024-02-13 21:31:57 | 0:48:41 | 0:39:53 | 0:08:48 | smithi | main | rhel | 8.6 | rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} | 2 |
| fail | 7558715 |
|
2024-02-13 17:19:09 | 2024-02-13 20:44:46 | 2024-02-13 21:31:47 | 0:47:01 | 0:35:05 | 0:11:56 | smithi | main | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
Failure Reason:
"2024-02-13T21:13:51.430700+0000 mon.smithi146 (mon.0) 504 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7558716 |
|
2024-02-13 17:19:10 | 2024-02-13 20:45:57 | 2024-02-13 21:43:38 | 0:57:41 | 0:47:58 | 0:09:43 | smithi | main | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} | 2 |
Failure Reason:
expected string or bytes-like object |
||||||||||||||
| pass | 7558717 |
|
2024-02-13 17:19:11 | 2024-02-13 20:45:57 | 2024-02-13 22:24:34 | 1:38:37 | 1:28:17 | 0:10:20 | smithi | main | ubuntu | 18.04 | rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} | 3 |
| fail | 7558718 |
|
2024-02-13 17:19:12 | 2024-02-13 20:46:48 | 2024-02-13 21:12:08 | 0:25:20 | 0:19:31 | 0:05:49 | smithi | main | rhel | 8.6 | rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} | 2 |
Failure Reason:
"2024-02-13T21:09:54.220298+0000 mon.smithi059 (mon.0) 610 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
| fail | 7558719 |
|
2024-02-13 17:19:13 | 2024-02-13 20:47:08 | 2024-02-13 21:30:05 | 0:42:57 | 0:33:38 | 0:09:19 | smithi | main | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
Failure Reason:
"2024-02-13T21:21:55.364868+0000 mon.smithi047 (mon.0) 449 : cluster [WRN] daemon mds.cephfs.smithi047.aacxqr compat changed unexpectedly" in cluster log |
||||||||||||||
| fail | 7558720 |
|
2024-02-13 17:19:13 | 2024-02-13 20:47:09 | 2024-02-13 21:49:12 | 1:02:03 | 0:52:07 | 0:09:56 | smithi | main | ubuntu | 20.04 | rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} | 2 |
Failure Reason:
"2024-02-13T21:25:12.908655+0000 mon.a (mon.0) 796 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
| fail | 7558721 |
|
2024-02-13 17:19:14 | 2024-02-13 20:47:09 | 2024-02-13 21:26:23 | 0:39:14 | 0:29:34 | 0:09:40 | smithi | main | centos | 8.stream | rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} | 1 |
Failure Reason:
"2024-02-13T21:12:50.234770+0000 mon.a (mon.0) 498 : cluster [WRN] Replacing daemon mds.a.smithi174.nqryxl as rank 0 with standby daemon mds.user_test_fs.smithi174.nsykvs" in cluster log |
||||||||||||||
| pass | 7558722 |
|
2024-02-13 17:19:15 | 2024-02-13 20:47:30 | 2024-02-13 21:21:41 | 0:34:11 | 0:23:58 | 0:10:13 | smithi | main | ubuntu | 18.04 | rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} | 2 |
| fail | 7558723 |
|
2024-02-13 17:19:16 | 2024-02-13 20:48:20 | 2024-02-13 21:30:09 | 0:41:49 | 0:31:34 | 0:10:15 | smithi | main | centos | 8.stream | rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 |
Failure Reason:
"2024-02-13T21:09:30.367697+0000 mon.smithi057 (mon.0) 351 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
| fail | 7558724 |
|
2024-02-13 17:19:16 | 2024-02-13 20:48:21 | 2024-02-13 21:44:07 | 0:55:46 | 0:41:03 | 0:14:43 | smithi | main | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} | 2 |
Failure Reason:
expected string or bytes-like object |
||||||||||||||
| fail | 7558725 |
|
2024-02-13 17:19:17 | 2024-02-13 20:49:11 | 2024-02-13 21:42:34 | 0:53:23 | 0:41:03 | 0:12:20 | smithi | main | ubuntu | 20.04 | rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} | 2 |
Failure Reason:
"2024-02-13T21:22:24.544515+0000 mon.a (mon.0) 757 : cluster [WRN] Health check failed: 17 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
| fail | 7558726 |
|
2024-02-13 17:19:18 | 2024-02-13 20:50:23 | 2024-02-13 21:18:15 | 0:27:52 | 0:17:25 | 0:10:27 | smithi | main | centos | 8.stream | rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} | 1 |
Failure Reason:
"2024-02-13T21:15:57.529200+0000 mon.a (mon.0) 462 : cluster [WRN] Health check failed: cephadm background work is paused (CEPHADM_PAUSED)" in cluster log |
||||||||||||||
| fail | 7558727 |
|
2024-02-13 17:19:19 | 2024-02-13 20:50:53 | 2024-02-13 21:34:29 | 0:43:36 | 0:33:32 | 0:10:04 | smithi | main | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
Failure Reason:
"2024-02-13T21:17:16.028971+0000 mon.smithi038 (mon.0) 322 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
| pass | 7558728 |
|
2024-02-13 17:19:20 | 2024-02-13 20:51:34 | 2024-02-13 21:40:04 | 0:48:30 | 0:37:24 | 0:11:06 | smithi | main | centos | 8.stream | rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} | 5 |
| pass | 7558729 |
|
2024-02-13 17:19:21 | 2024-02-13 20:52:24 | 2024-02-13 21:57:56 | 1:05:32 | 0:56:08 | 0:09:24 | smithi | main | ubuntu | 18.04 | rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} | 3 |
| fail | 7558730 |
|
2024-02-13 17:19:21 | 2024-02-13 20:52:25 | 2024-02-13 21:10:20 | 0:17:55 | 0:07:14 | 0:10:41 | smithi | main | rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} | 2 | ||
Failure Reason:
Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 |
||||||||||||||
| fail | 7558731 |
|
2024-02-13 17:19:22 | 2024-02-13 20:52:35 | 2024-02-13 21:36:35 | 0:44:00 | 0:33:40 | 0:10:20 | smithi | main | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
Failure Reason:
"2024-02-13T21:21:45.455516+0000 mon.smithi117 (mon.0) 502 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7558732 |
|
2024-02-13 17:19:23 | 2024-02-13 20:53:25 | 2024-02-13 21:46:36 | 0:53:11 | 0:44:37 | 0:08:34 | smithi | main | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} | 2 |
Failure Reason:
expected string or bytes-like object |
||||||||||||||
| fail | 7558733 |
|
2024-02-13 17:19:24 | 2024-02-13 20:53:26 | 2024-02-13 21:35:33 | 0:42:07 | 0:31:38 | 0:10:29 | smithi | main | ubuntu | 20.04 | rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} | 2 |
Failure Reason:
"2024-02-13T21:29:07.373669+0000 mon.a (mon.0) 720 : cluster [WRN] Health check failed: all OSDs are running pacific or later but require_osd_release < pacific (OSD_UPGRADE_FINISHED)" in cluster log |
||||||||||||||
| fail | 7558734 |
|
2024-02-13 17:19:25 | 2024-02-13 20:53:26 | 2024-02-13 21:25:22 | 0:31:56 | 0:18:46 | 0:13:10 | smithi | main | ubuntu | 18.04 | rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} | 2 |
Failure Reason:
Command failed on smithi049 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:0e714d9a4bd2a821113e6318adb87bd06cf81ec1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e19cedc-cab4-11ee-95b9-87774f69a715 -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' |
||||||||||||||
| fail | 7558735 |
|
2024-02-13 17:19:25 | 2024-02-13 20:57:35 | 2024-02-13 21:29:13 | 0:31:38 | 0:22:15 | 0:09:23 | smithi | main | centos | 8.stream | rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} | 1 |
Failure Reason:
Command failed (workunit test cephadm/test_cephadm.sh) on smithi188 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bedfc49c6a823fb0ff75911e476e1f3cb464ad3e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' |
||||||||||||||
| fail | 7558736 |
|
2024-02-13 17:19:26 | 2024-02-13 20:58:05 | 2024-02-13 21:37:24 | 0:39:19 | 0:30:07 | 0:09:12 | smithi | main | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
Failure Reason:
Command failed on smithi063 with status 5: 'sudo systemctl stop ceph-a0dea7f4-cab5-11ee-95b9-87774f69a715@mon.smithi063' |
||||||||||||||
| fail | 7558737 |
|
2024-02-13 17:19:27 | 2024-02-13 20:58:05 | 2024-02-13 22:03:51 | 1:05:46 | 0:53:05 | 0:12:41 | smithi | main | centos | 8.stream | rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 |
Failure Reason:
Command failed on smithi016 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 35c063a4-cab5-11ee-95b9-87774f69a715 -e sha1=0e714d9a4bd2a821113e6318adb87bd06cf81ec1 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' |
||||||||||||||
| fail | 7558738 |
|
2024-02-13 17:19:28 | 2024-02-13 21:00:36 | 2024-02-13 21:54:08 | 0:53:32 | 0:43:06 | 0:10:26 | smithi | main | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} | 2 |
Failure Reason:
expected string or bytes-like object |
||||||||||||||
| pass | 7558739 |
|
2024-02-13 17:19:29 | 2024-02-13 21:01:07 | 2024-02-13 21:48:16 | 0:47:09 | 0:41:11 | 0:05:58 | smithi | main | rhel | 8.6 | rados/cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} | 2 |
| pass | 7558740 |
|
2024-02-13 17:19:30 | 2024-02-13 21:01:07 | 2024-02-13 21:38:36 | 0:37:29 | 0:21:01 | 0:16:28 | smithi | main | ubuntu | 20.04 | rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} | 2 |
| fail | 7558741 |
|
2024-02-13 17:19:30 | 2024-02-13 21:06:28 | 2024-02-13 21:47:13 | 0:40:45 | 0:27:28 | 0:13:17 | smithi | main | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
Failure Reason:
Command failed on smithi193 with status 5: 'sudo systemctl stop ceph-fb34e08c-cab6-11ee-95b9-87774f69a715@mon.smithi193' |
||||||||||||||
| fail | 7558742 |
|
2024-02-13 17:19:31 | 2024-02-13 21:19:25 | 2024-02-13 22:18:51 | 0:59:26 | 0:48:33 | 0:10:53 | smithi | main | centos | 8.stream | rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} | 2 |
Failure Reason:
"2024-02-13T21:51:34.745442+0000 mon.a (mon.0) 684 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
| fail | 7558743 |
|
2024-02-13 17:19:32 | 2024-02-13 21:21:46 | 2024-02-13 23:15:03 | 1:53:17 | 1:37:42 | 0:15:35 | smithi | main | ubuntu | 18.04 | rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} | 3 |
Failure Reason:
"2024-02-13T22:30:00.000299+0000 mon.a (mon.0) 2162 : cluster [WRN] osd.2 (root=default,host=smithi037) is down" in cluster log |
||||||||||||||
| fail | 7558744 |
|
2024-02-13 17:19:33 | 2024-02-13 21:27:07 | 2024-02-13 22:03:58 | 0:36:51 | 0:28:14 | 0:08:37 | smithi | main | centos | 8.stream | rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} | 1 |
Failure Reason:
"2024-02-13T21:51:29.427117+0000 mon.a (mon.0) 509 : cluster [WRN] Replacing daemon mds.a.smithi003.emxtnx as rank 0 with standby daemon mds.user_test_fs.smithi003.xatbws" in cluster log |
||||||||||||||
| fail | 7558745 |
|
2024-02-13 17:19:34 | 2024-02-13 21:27:07 | 2024-02-13 22:00:29 | 0:33:22 | 0:23:56 | 0:09:26 | smithi | main | ubuntu | 18.04 | rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} | 2 |
Failure Reason:
"2024-02-13T21:46:04.659551+0000 mon.a (mon.0) 164 : cluster [WRN] mon.c (rank 2) addr [v2:172.21.15.114:3301/0,v1:172.21.15.114:6790/0] is down (out of quorum)" in cluster log |
||||||||||||||
| fail | 7558746 |
|
2024-02-13 17:19:35 | 2024-02-13 21:27:07 | 2024-02-13 22:27:06 | 0:59:59 | 0:46:40 | 0:13:19 | smithi | main | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} | 2 |
Failure Reason:
expected string or bytes-like object |
||||||||||||||
| fail | 7558747 |
|
2024-02-13 17:19:35 | 2024-02-13 21:31:58 | 2024-02-13 22:00:09 | 0:28:11 | 0:17:17 | 0:10:54 | smithi | main | centos | 8.stream | rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} | 1 |
Failure Reason:
"2024-02-13T21:58:01.036844+0000 mon.a (mon.0) 461 : cluster [WRN] Health check failed: cephadm background work is paused (CEPHADM_PAUSED)" in cluster log |
||||||||||||||
| fail | 7558748 |
|
2024-02-13 17:19:36 | 2024-02-13 21:33:19 | 2024-02-13 21:54:32 | 0:21:13 | smithi | main | ubuntu | 18.04 | rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} | 2 | ||
Failure Reason:
Failed to reconnect to smithi177 |
||||||||||||||
| fail | 7558749 |
|
2024-02-13 17:19:37 | 2024-02-13 21:34:29 | 2024-02-13 22:13:48 | 0:39:19 | 0:25:56 | 0:13:23 | smithi | main | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
Failure Reason:
Command failed on smithi081 with status 5: 'sudo systemctl stop ceph-c2db6dba-caba-11ee-95b9-87774f69a715@mon.smithi081' |
||||||||||||||
| pass | 7558750 |
|
2024-02-13 17:19:38 | 2024-02-13 21:38:40 | 2024-02-13 22:25:45 | 0:47:05 | 0:33:28 | 0:13:37 | smithi | main | centos | 8.stream | rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} | 5 |
| pass | 7558751 |
|
2024-02-13 17:19:39 | 2024-02-13 21:40:11 | 2024-02-13 22:16:11 | 0:36:00 | 0:25:39 | 0:10:21 | smithi | main | centos | 8.stream | rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} | 2 |
| fail | 7558752 |
|
2024-02-13 17:19:39 | 2024-02-13 21:40:31 | 2024-02-13 22:18:07 | 0:37:36 | 0:27:10 | 0:10:26 | smithi | main | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
Failure Reason:
Command failed on smithi176 with status 5: 'sudo systemctl stop ceph-0b7d86a2-cabb-11ee-95b9-87774f69a715@mon.smithi176' |
||||||||||||||
| fail | 7558753 |
|
2024-02-13 17:19:40 | 2024-02-13 21:40:52 | 2024-02-13 22:18:51 | 0:37:59 | 0:23:00 | 0:14:59 | smithi | main | centos | 8.stream | rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} | 2 |
Failure Reason:
Command failed on smithi119 with status 5: 'sudo systemctl stop ceph-4bbd2948-cabb-11ee-95b9-87774f69a715@mon.smithi119' |
||||||||||||||
| fail | 7558754 |
|
2024-02-13 17:19:41 | 2024-02-13 21:45:03 | 2024-02-13 22:10:03 | 0:25:00 | 0:12:36 | 0:12:24 | smithi | main | centos | 8.stream | rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} | 3 |
Failure Reason:
'package_manager_version' |
||||||||||||||
| fail | 7558755 |
|
2024-02-13 17:19:42 | 2024-02-13 21:47:03 | 2024-02-13 22:35:31 | 0:48:28 | 0:38:09 | 0:10:19 | smithi | main | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} | 2 |
Failure Reason:
expected string or bytes-like object |
||||||||||||||
| fail | 7558756 |
|
2024-02-13 17:19:43 | 2024-02-13 21:48:24 | 2024-02-13 22:18:25 | 0:30:01 | 0:19:41 | 0:10:20 | smithi | main | ubuntu | 20.04 | rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} | 2 |
Failure Reason:
"2024-02-13T22:10:14.168475+0000 mon.a (mon.0) 595 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
| fail | 7558757 |
|
2024-02-13 17:19:44 | 2024-02-13 21:48:24 | 2024-02-13 22:47:28 | 0:59:04 | 0:40:11 | 0:18:53 | smithi | main | ubuntu | 18.04 | rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} | 2 |
Failure Reason:
"2024-02-13T22:28:13.316375+0000 mon.a (mon.0) 809 : cluster [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
| fail | 7558758 |
|
2024-02-13 17:19:44 | 2024-02-13 21:58:06 | 2024-02-13 22:29:01 | 0:30:55 | 0:20:02 | 0:10:53 | smithi | main | rhel | 8.6 | rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} | 2 |
Failure Reason:
"2024-02-13T22:24:48.450834+0000 mon.smithi112 (mon.0) 631 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log |
||||||||||||||
| fail | 7558759 |
|
2024-02-13 17:19:45 | 2024-02-13 22:01:47 | 2024-02-13 22:44:53 | 0:43:06 | 0:34:22 | 0:08:44 | smithi | main | centos | 8.stream | rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} | 2 |
Failure Reason:
"2024-02-13T22:31:00.937875+0000 mon.smithi106 (mon.0) 370 : cluster [WRN] Health check update: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
| fail | 7558760 |
|
2024-02-13 17:19:46 | 2024-02-13 22:01:47 | 2024-02-13 23:06:06 | 1:04:19 | 0:42:40 | 0:21:39 | smithi | main | centos | 8.stream | rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} | 2 |
Failure Reason:
expected string or bytes-like object |
||||||||||||||
Pulpito