| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| yuriw | 2024-04-29 21:11:23 | 2024-04-29 21:38:27 | 2024-04-30 12:14:33 | 14:36:06 | upgrade | wip-yuriw-testing-20240419.202307-squid | smithi | 1e75c28 | 20 | 44 | 4 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 7679396 |
|
2024-04-29 21:11:53 | 2024-04-29 21:38:27 | 2024-04-29 22:18:56 | 0:40:29 | 0:32:21 | 0:08:08 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 7679397 |
|
2024-04-29 21:11:54 | 2024-04-29 21:39:38 | 2024-04-29 22:51:54 | 1:12:16 | 0:38:41 | 0:33:35 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 |
| fail | 7679398 |
|
2024-04-29 21:11:55 | 2024-04-29 22:31:58 | 2024-04-30 01:38:47 | 3:06:49 | 2:54:49 | 0:12:00 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-04-29T23:13:22.123578+0000 mon.a (mon.0) 315 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7679399 |
|
2024-04-29 21:11:56 | 2024-04-29 22:32:59 | 2024-04-29 23:45:53 | 1:12:54 | 1:05:54 | 0:07:00 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| fail | 7679400 |
|
2024-04-29 21:11:57 | 2024-04-29 22:32:59 | 2024-04-29 23:34:54 | 1:01:55 | 0:51:57 | 0:09:58 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 7679401 |
|
2024-04-29 21:11:58 | 2024-04-29 22:32:59 | 2024-04-29 23:32:16 | 0:59:17 | 0:43:10 | 0:16:07 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 |
| fail | 7679402 |
|
2024-04-29 21:11:59 | 2024-04-29 22:33:00 | 2024-04-29 23:40:53 | 1:07:53 | 0:56:52 | 0:11:01 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7679403 |
|
2024-04-29 21:12:01 | 2024-04-29 22:33:10 | 2024-04-29 23:56:01 | 1:22:51 | 0:57:10 | 0:25:41 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 7679404 |
|
2024-04-29 21:12:02 | 2024-04-29 22:48:23 | 2024-04-29 23:25:07 | 0:36:44 | 0:30:42 | 0:06:02 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7679405 |
|
2024-04-29 21:12:03 | 2024-04-29 22:48:23 | 2024-04-30 01:30:49 | 2:42:26 | 2:33:43 | 0:08:43 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-04-29T23:20:00.000174+0000 mon.a (mon.0) 556 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub,nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7679406 |
|
2024-04-29 21:12:04 | 2024-04-29 22:48:23 | 2024-04-29 23:27:39 | 0:39:16 | 0:31:42 | 0:07:34 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7679407 |
|
2024-04-29 21:12:05 | 2024-04-29 22:48:24 | 2024-04-29 23:23:34 | 0:35:10 | 0:28:25 | 0:06:45 | smithi | main | centos | 9.stream | upgrade/telemetry-upgrade/quincy-x/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks} | 2 |
Failure Reason:
"1714431905.7462623 mon.a (mon.0) 516 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| pass | 7679408 |
|
2024-04-29 21:12:06 | 2024-04-29 22:48:24 | 2024-04-29 23:49:15 | 1:00:51 | 0:45:03 | 0:15:48 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 |
| fail | 7679409 |
|
2024-04-29 21:12:07 | 2024-04-29 22:51:55 | 2024-04-29 23:11:43 | 0:19:48 | 0:09:49 | 0:09:59 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/filestore-remove-check/{0-cluster/{openstack start} 1-ceph-install/quincy 2 - upgrade objectstore/filestore-xfs ubuntu_latest} | 1 |
Failure Reason:
"1714432155.367053 mon.a (mon.0) 63 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7679410 |
|
2024-04-29 21:12:08 | 2024-04-29 22:52:05 | 2024-04-30 01:17:26 | 2:25:21 | 2:04:18 | 0:21:03 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"2024-04-30T00:40:00.000239+0000 mon.a (mon.0) 3361 : cluster 3 [WRN] TELEMETRY_CHANGED: Telemetry requires re-opt-in" in cluster log |
||||||||||||||
| pass | 7679411 |
|
2024-04-29 21:12:09 | 2024-04-29 23:03:47 | 2024-04-29 23:40:42 | 0:36:55 | 0:23:33 | 0:13:22 | smithi | main | centos | 8.stream | upgrade/cephfs/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} | 1 |
| fail | 7679412 |
|
2024-04-29 21:12:10 | 2024-04-29 23:03:48 | 2024-04-30 00:16:48 | 1:13:00 | 1:05:29 | 0:07:31 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| fail | 7679413 |
|
2024-04-29 21:12:11 | 2024-04-29 23:03:48 | 2024-04-30 00:55:12 | 1:51:24 | 1:42:08 | 0:09:16 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"1714433504.9117508 mon.a (mon.0) 669 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7679414 |
|
2024-04-29 21:12:12 | 2024-04-29 23:03:48 | 2024-04-30 02:21:04 | 3:17:16 | 3:10:41 | 0:06:35 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-04-29T23:50:00.000146+0000 mon.a (mon.0) 1390 : cluster 3 [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
| pass | 7679415 |
|
2024-04-29 21:12:13 | 2024-04-29 23:03:49 | 2024-04-29 23:45:12 | 0:41:23 | 0:28:02 | 0:13:21 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 |
| fail | 7679416 |
|
2024-04-29 21:12:14 | 2024-04-29 23:03:59 | 2024-04-30 00:00:04 | 0:56:05 | 0:33:34 | 0:22:31 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7679417 |
|
2024-04-29 21:12:15 | 2024-04-29 23:19:12 | 2024-04-30 03:03:48 | 3:44:36 | 3:33:31 | 0:11:05 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-04-30T00:00:00.000176+0000 mon.a (mon.0) 1398 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| fail | 7679418 |
|
2024-04-29 21:12:16 | 2024-04-29 23:19:12 | 2024-04-29 23:46:17 | 0:27:05 | 0:20:11 | 0:06:54 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"2024-04-29T23:40:00.000173+0000 mon.smithi137 (mon.0) 687 : cluster 3 [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s)" in cluster log |
||||||||||||||
| fail | 7679419 |
|
2024-04-29 21:12:17 | 2024-04-29 23:19:12 | 2024-04-30 00:20:36 | 1:01:24 | 0:52:01 | 0:09:23 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 7679420 |
|
2024-04-29 21:12:18 | 2024-04-29 23:19:13 | 2024-04-30 00:04:14 | 0:45:01 | 0:26:42 | 0:18:19 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 |
| fail | 7679421 |
|
2024-04-29 21:12:20 | 2024-04-29 23:25:14 | 2024-04-30 02:26:28 | 3:01:14 | 2:54:37 | 0:06:37 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-04-30T00:00:00.000126+0000 mon.a (mon.0) 781 : cluster 3 [WRN] OSDMAP_FLAGS: nodeep-scrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7679423 |
|
2024-04-29 21:12:21 | 2024-04-29 23:25:16 | 2024-04-30 00:11:36 | 0:46:20 | 0:31:26 | 0:14:54 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7679425 |
|
2024-04-29 21:12:22 | 2024-04-29 23:34:38 | 2024-04-30 00:17:48 | 0:43:10 | 0:37:06 | 0:06:04 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| fail | 7679427 |
|
2024-04-29 21:12:23 | 2024-04-29 23:34:49 | 2024-04-29 23:54:39 | 0:19:50 | 0:09:11 | 0:10:39 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
cannot pull file with status: requested |
||||||||||||||
| fail | 7679428 |
|
2024-04-29 21:12:24 | 2024-04-29 23:34:49 | 2024-04-30 01:08:10 | 1:33:21 | 1:26:10 | 0:07:11 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"1714434738.6837432 mon.a (mon.0) 656 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| pass | 7679430 |
|
2024-04-29 21:12:25 | 2024-04-29 23:40:21 | 2024-04-30 00:21:46 | 0:41:25 | 0:30:00 | 0:11:25 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 |
| fail | 7679432 |
|
2024-04-29 21:12:26 | 2024-04-29 23:40:41 | 2024-04-30 02:28:07 | 2:47:26 | 2:40:42 | 0:06:44 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-04-30T00:07:43.629512+0000 mon.a (mon.0) 386 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7679434 |
|
2024-04-29 21:12:27 | 2024-04-29 23:45:13 | 2024-04-30 00:32:42 | 0:47:29 | 0:39:51 | 0:07:38 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 7679436 |
|
2024-04-29 21:12:28 | 2024-04-29 23:49:24 | 2024-04-30 00:26:32 | 0:37:08 | 0:31:07 | 0:06:01 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
| fail | 7679438 |
|
2024-04-29 21:12:29 | 2024-04-29 23:49:25 | 2024-04-30 03:11:08 | 3:21:43 | 3:13:21 | 0:08:22 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
"2024-04-30T00:10:00.000196+0000 mon.a (mon.0) 794 : cluster 4 [ERR] MDS_ALL_DOWN: 1 filesystem is offline" in cluster log |
||||||||||||||
| pass | 7679440 |
|
2024-04-29 21:12:30 | 2024-04-29 23:50:06 | 2024-04-30 00:27:04 | 0:36:58 | 0:26:36 | 0:10:22 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 |
| fail | 7679442 |
|
2024-04-29 21:12:31 | 2024-04-29 23:50:07 | 2024-04-30 00:43:32 | 0:53:25 | 0:45:33 | 0:07:52 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 7679444 |
|
2024-04-29 21:12:32 | 2024-04-29 23:50:18 | 2024-04-30 00:23:49 | 0:33:31 | 0:22:08 | 0:11:23 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/iozone}} | 2 |
| dead | 7679446 |
|
2024-04-29 21:12:33 | 2024-04-29 23:50:18 | 2024-04-29 23:55:31 | 0:05:13 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 | ||
Failure Reason:
Error reimaging machines: Expected smithi203's OS to be ubuntu 22.04 but found centos 9 |
||||||||||||||
| fail | 7679448 |
|
2024-04-29 21:12:34 | 2024-04-29 23:50:19 | 2024-04-30 00:35:34 | 0:45:15 | 0:37:30 | 0:07:45 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| fail | 7679450 |
|
2024-04-29 21:12:35 | 2024-04-30 00:04:39 | 2024-04-30 01:01:01 | 0:56:22 | 0:45:57 | 0:10:25 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 7679452 |
|
2024-04-29 21:12:36 | 2024-04-30 00:05:30 | 2024-04-30 00:40:34 | 0:35:04 | 0:24:51 | 0:10:13 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 |
| fail | 7679455 |
|
2024-04-29 21:12:38 | 2024-04-30 00:05:32 | 2024-04-30 00:44:28 | 0:38:56 | 0:32:38 | 0:06:18 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| dead | 7679457 |
|
2024-04-29 21:12:39 | 2024-04-30 00:05:33 | 2024-04-30 12:14:33 | 12:09:00 | smithi | main | centos | 8.stream | upgrade/telemetry-upgrade/pacific-x/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| pass | 7679459 |
|
2024-04-29 21:12:40 | 2024-04-30 00:05:34 | 2024-04-30 00:47:28 | 0:41:54 | 0:29:43 | 0:12:11 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 |
| pass | 7679461 |
|
2024-04-29 21:12:41 | 2024-04-30 00:05:55 | 2024-04-30 00:25:52 | 0:19:57 | 0:10:33 | 0:09:24 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/filestore-remove-check/{0-cluster/{openstack start} 1-ceph-install/quincy 2 - upgrade objectstore/filestore-xfs ubuntu_latest} | 1 |
| dead | 7679463 |
|
2024-04-29 21:12:42 | 2024-04-30 00:05:56 | 2024-04-30 00:11:28 | 0:05:32 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 | ||
Failure Reason:
Error reimaging machines: Expected smithi178's OS to be ubuntu 22.04 but found centos 9 |
||||||||||||||
| fail | 7679465 |
|
2024-04-29 21:12:43 | 2024-04-30 00:05:56 | 2024-04-30 00:51:18 | 0:45:22 | 0:37:50 | 0:07:32 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| pass | 7679467 |
|
2024-04-29 21:12:44 | 2024-04-30 00:05:57 | 2024-04-30 00:33:38 | 0:27:41 | 0:16:22 | 0:11:19 | smithi | main | centos | 8.stream | upgrade/cephfs/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} | 1 |
| fail | 7679469 |
|
2024-04-29 21:12:45 | 2024-04-30 00:05:58 | 2024-04-30 01:41:24 | 1:35:26 | 1:27:49 | 0:07:37 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"1714436679.9215727 mon.a (mon.0) 664 : cluster [WRN] Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log |
||||||||||||||
| fail | 7679471 |
|
2024-04-29 21:12:46 | 2024-04-30 00:05:59 | 2024-04-30 03:19:47 | 3:13:48 | 3:05:31 | 0:08:17 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-04-30T00:30:00.000225+0000 mon.a (mon.0) 1145 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled" in cluster log |
||||||||||||||
| pass | 7679473 |
|
2024-04-29 21:12:47 | 2024-04-30 00:10:41 | 2024-04-30 01:06:07 | 0:55:26 | 0:31:15 | 0:24:11 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/stress_tests/blogbench}} | 2 |
| pass | 7679475 |
|
2024-04-29 21:12:48 | 2024-04-30 00:21:04 | 2024-04-30 00:58:11 | 0:37:07 | 0:25:32 | 0:11:35 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 |
| fail | 7679477 |
|
2024-04-29 21:12:49 | 2024-04-30 00:21:05 | 2024-04-30 01:08:11 | 0:47:06 | 0:39:27 | 0:07:39 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7679479 |
|
2024-04-29 21:12:50 | 2024-04-30 00:21:16 | 2024-04-30 01:17:30 | 0:56:14 | 0:44:51 | 0:11:23 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7679481 |
|
2024-04-29 21:12:51 | 2024-04-30 00:21:37 | 2024-04-30 04:07:44 | 3:46:07 | 3:35:22 | 0:10:45 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
Command failed (workunit test suites/fsstress.sh) on smithi064 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1e75c287b590db4c67b42cb1c95b9323fa8d03bc TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' |
||||||||||||||
| pass | 7679483 |
|
2024-04-29 21:12:53 | 2024-04-30 00:21:37 | 2024-04-30 01:29:37 | 1:08:00 | 0:55:21 | 0:12:39 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/dbench}} | 2 |
| fail | 7679485 |
|
2024-04-29 21:12:54 | 2024-04-30 00:21:38 | 2024-04-30 01:15:58 | 0:54:20 | 0:43:39 | 0:10:41 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 7679487 |
|
2024-04-29 21:12:55 | 2024-04-30 00:21:39 | 2024-04-30 00:59:09 | 0:37:30 | 0:25:09 | 0:12:21 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 |
| fail | 7679489 |
|
2024-04-29 21:12:56 | 2024-04-30 00:21:40 | 2024-04-30 03:22:27 | 3:00:47 | 2:54:23 | 0:06:24 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
"2024-04-30T00:35:35.348956+0000 mon.a (mon.0) 171 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| fail | 7679491 |
|
2024-04-29 21:12:57 | 2024-04-30 00:21:41 | 2024-04-30 00:33:05 | 0:11:24 | 0:04:36 | 0:06:48 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} | 2 |
Failure Reason:
Command failed on smithi193 with status 1: 'sudo yum -y install ceph-radosgw' |
||||||||||||||
| fail | 7679493 |
|
2024-04-29 21:12:58 | 2024-04-30 00:21:42 | 2024-04-30 01:07:45 | 0:46:03 | 0:37:36 | 0:08:27 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
reached maximum tries (51) after waiting for 300 seconds |
||||||||||||||
| fail | 7679495 |
|
2024-04-29 21:12:59 | 2024-04-30 00:21:43 | 2024-04-30 02:17:20 | 1:55:37 | 1:46:05 | 0:09:32 | smithi | main | centos | 9.stream | upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"2024-04-30T00:50:00.000115+0000 mon.a (mon.0) 400 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 28/195 objects degraded (14.359%), 10 pgs degraded" in cluster log |
||||||||||||||
| dead | 7679497 |
|
2024-04-29 21:13:00 | 2024-04-30 00:23:54 | 2024-04-30 00:36:58 | 0:13:04 | 0:03:29 | 0:09:35 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
['hwclock: Cannot access the Hardware Clock via any known method.', 'hwclock: Use the --verbose option to see the details of our search for an access method.'] |
||||||||||||||
| pass | 7679499 |
|
2024-04-29 21:13:01 | 2024-04-30 00:26:35 | 2024-04-30 01:06:17 | 0:39:42 | 0:28:03 | 0:11:39 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 |
| fail | 7679501 |
|
2024-04-29 21:13:02 | 2024-04-30 00:36:58 | 2024-04-30 04:12:22 | 3:35:24 | 3:27:49 | 0:07:35 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-04-30T01:10:00.000164+0000 mon.a (mon.0) 530 : cluster 3 [WRN] PG_DEGRADED: Degraded data redundancy: 10960/97416 objects degraded (11.251%), 5 pgs degraded, 5 pgs undersized" in cluster log |
||||||||||||||
| fail | 7679503 |
|
2024-04-29 21:13:03 | 2024-04-30 00:36:59 | 2024-04-30 01:38:13 | 1:01:14 | 0:51:06 | 0:10:08 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
Command failed on smithi097 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6584d72a-068b-11ef-bc93-c7b262605968 -e sha1=1e75c287b590db4c67b42cb1c95b9323fa8d03bc -- bash -c 'ceph orch ps'" |
||||||||||||||
| fail | 7679505 |
|
2024-04-29 21:13:04 | 2024-04-30 00:37:00 | 2024-04-30 01:27:59 | 0:50:59 | 0:44:39 | 0:06:20 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
Pulpito