| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| teuthology | 2024-03-22 02:08:13 | 2024-03-22 06:14:15 | 2024-03-22 19:01:02 | 12:46:47 | upgrade | squid | smithi | db0330b | 17 | 35 | 2 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 7615984 |
|
2024-03-22 02:08:47 | 2024-03-22 06:13:03 | 2024-03-22 06:49:42 | 0:36:39 | 0:24:44 | 0:11:55 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 |
| pass | 7615985 |
|
2024-03-22 02:08:48 | 2024-03-22 06:14:14 | 2024-03-22 06:34:09 | 0:19:55 | 0:09:04 | 0:10:51 | smithi | main | ubuntu | 20.04 | upgrade/quincy-x/filestore-remove-check/{0-cluster/{openstack start} 1-ceph-install/quincy 2 - upgrade objectstore/filestore-xfs ubuntu_20.04} | 1 |
| fail | 7615986 |
|
2024-03-22 02:08:49 | 2024-03-22 06:14:15 | 2024-03-22 08:09:32 | 1:55:17 | 1:45:58 | 0:09:19 | smithi | main | centos | 9.stream | upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"2024-03-22T07:30:00.000137+0000 mon.a (mon.0) 3136 : cluster 3 [WRN] TELEMETRY_CHANGED: Telemetry requires re-opt-in" in cluster log |
||||||||||||||
| dead | 7615987 |
|
2024-03-22 02:08:50 | 2024-03-22 06:14:25 | 2024-03-22 18:29:59 | 12:15:34 | smithi | main | centos | 8.stream | upgrade/telemetry-upgrade/pacific-x/{0-random-distro$/{centos_8.stream_container_tools_crun} 0-start 1-tasks} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 7615988 |
|
2024-03-22 02:08:51 | 2024-03-22 06:26:05 | 2024-03-22 10:18:06 | 3:52:01 | 3:37:58 | 0:14:03 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
Command failed (workunit test suites/fsstress.sh) on smithi192 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=768f6cd6e95d0c7a626042719c230df59bdba9d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' |
||||||||||||||
| pass | 7615989 |
|
2024-03-22 02:08:52 | 2024-03-22 06:26:46 | 2024-03-22 06:47:54 | 0:21:08 | 0:11:37 | 0:09:31 | smithi | main | centos | 8.stream | upgrade/cephfs/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} | 1 |
| fail | 7615990 |
|
2024-03-22 02:08:53 | 2024-03-22 06:26:46 | 2024-03-22 08:06:19 | 1:39:33 | 1:28:55 | 0:10:38 | smithi | main | centos | 9.stream | upgrade/quincy-x/parallel/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"1711090036.3792474 mon.a (mon.0) 516 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| fail | 7615991 |
|
2024-03-22 02:08:54 | 2024-03-22 06:26:46 | 2024-03-22 07:54:33 | 1:27:47 | 1:11:55 | 0:15:52 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| pass | 7615992 |
|
2024-03-22 02:08:55 | 2024-03-22 06:34:38 | 2024-03-22 07:06:41 | 0:32:03 | 0:20:36 | 0:11:27 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 |
| fail | 7615993 |
|
2024-03-22 02:08:56 | 2024-03-22 06:34:39 | 2024-03-22 07:17:17 | 0:42:38 | 0:33:16 | 0:09:22 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"1711090675.2553716 mon.smithi019 (mon.0) 714 : cluster [WRN] Replacing daemon mds.cephfs.smithi019.bpiaqy as rank 0 with standby daemon mds.cephfs.smithi019.jhoenn" in cluster log |
||||||||||||||
| pass | 7615994 |
|
2024-03-22 02:08:57 | 2024-03-22 06:34:39 | 2024-03-22 07:38:54 | 1:04:15 | 0:53:21 | 0:10:54 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/nautilus centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} 2-clients/kclient 3-workload/stress_tests/dbench}} | 2 |
| fail | 7615995 |
|
2024-03-22 02:08:58 | 2024-03-22 06:34:39 | 2024-03-22 06:53:23 | 0:18:44 | 0:07:17 | 0:11:27 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=quincy |
||||||||||||||
| fail | 7615996 |
|
2024-03-22 02:08:59 | 2024-03-22 06:34:40 | 2024-03-22 09:14:32 | 2:39:52 | 2:28:39 | 0:11:13 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-22T08:40:00.000114+0000 mon.a (mon.0) 7214 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 3 scrub errors" in cluster log |
||||||||||||||
| fail | 7615997 |
|
2024-03-22 02:09:01 | 2024-03-22 06:34:40 | 2024-03-22 07:06:33 | 0:31:53 | 0:21:05 | 0:10:48 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 |
Failure Reason:
Command failed on smithi117 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.27 deep-scrub' |
||||||||||||||
| pass | 7615998 |
|
2024-03-22 02:09:02 | 2024-03-22 06:34:41 | 2024-03-22 07:01:29 | 0:26:48 | 0:17:17 | 0:09:31 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/fsstress}} | 2 |
| fail | 7615999 |
|
2024-03-22 02:09:03 | 2024-03-22 06:34:41 | 2024-03-22 10:05:00 | 3:30:19 | 3:19:54 | 0:10:25 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
Command failed (workunit test suites/fsstress.sh) on smithi090 with status 126: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=768f6cd6e95d0c7a626042719c230df59bdba9d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh' |
||||||||||||||
| fail | 7616000 |
|
2024-03-22 02:09:04 | 2024-03-22 06:34:41 | 2024-03-22 09:00:43 | 2:26:02 | 2:13:43 | 0:12:19 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-22T08:20:00.000131+0000 mon.a (mon.0) 5791 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 7 scrub errors" in cluster log |
||||||||||||||
| fail | 7616001 |
|
2024-03-22 02:09:05 | 2024-03-22 06:34:42 | 2024-03-22 09:53:56 | 3:19:14 | 3:04:55 | 0:14:19 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-22T07:07:17.985710+0000 mon.a (mon.0) 155 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log |
||||||||||||||
| pass | 7616002 |
|
2024-03-22 02:09:06 | 2024-03-22 06:34:42 | 2024-03-22 07:07:42 | 0:33:00 | 0:24:35 | 0:08:25 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 |
| fail | 7616003 |
|
2024-03-22 02:09:07 | 2024-03-22 06:34:43 | 2024-03-22 07:18:39 | 0:43:56 | 0:33:12 | 0:10:44 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"1711090750.1133196 mon.smithi045 (mon.0) 717 : cluster [WRN] Replacing daemon mds.cephfs.smithi045.gnzugm as rank 0 with standby daemon mds.cephfs.smithi144.rojlab" in cluster log |
||||||||||||||
| fail | 7616004 |
|
2024-03-22 02:09:08 | 2024-03-22 06:34:43 | 2024-03-22 09:36:43 | 3:02:00 | 2:50:35 | 0:11:25 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-22T08:10:00.000285+0000 mon.a (mon.0) 5100 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 16 scrub errors" in cluster log |
||||||||||||||
| pass | 7616005 |
|
2024-03-22 02:09:09 | 2024-03-22 06:34:44 | 2024-03-22 07:06:55 | 0:32:11 | 0:19:49 | 0:12:22 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 |
| fail | 7616006 |
|
2024-03-22 02:09:10 | 2024-03-22 06:34:44 | 2024-03-22 10:01:19 | 3:26:35 | 3:14:12 | 0:12:23 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-22T08:50:00.000097+0000 mon.a (mon.0) 6604 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 18 scrub errors" in cluster log |
||||||||||||||
| fail | 7616007 |
|
2024-03-22 02:09:11 | 2024-03-22 06:34:44 | 2024-03-22 10:26:34 | 3:51:50 | 3:38:14 | 0:13:36 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
Command failed (workunit test suites/fsstress.sh) on smithi175 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=768f6cd6e95d0c7a626042719c230df59bdba9d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' |
||||||||||||||
| fail | 7616008 |
|
2024-03-22 02:09:12 | 2024-03-22 06:34:45 | 2024-03-22 09:32:56 | 2:58:11 | 2:47:10 | 0:11:01 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"1711090702.5256677 mon.a (mon.0) 523 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log |
||||||||||||||
| pass | 7616009 |
|
2024-03-22 02:09:14 | 2024-03-22 06:34:45 | 2024-03-22 07:08:43 | 0:33:58 | 0:22:36 | 0:11:22 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/blogbench}} | 2 |
| fail | 7616010 |
|
2024-03-22 02:09:15 | 2024-03-22 06:34:46 | 2024-03-22 07:12:10 | 0:37:24 | 0:21:42 | 0:15:42 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 |
Failure Reason:
Command failed on smithi064 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.15 deep-scrub' |
||||||||||||||
| fail | 7616011 |
|
2024-03-22 02:09:16 | 2024-03-22 06:40:37 | 2024-03-22 07:35:28 | 0:54:51 | 0:44:29 | 0:10:22 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
timeout expired in wait_until_healthy |
||||||||||||||
| fail | 7616012 |
|
2024-03-22 02:09:17 | 2024-03-22 06:41:47 | 2024-03-22 07:25:28 | 0:43:41 | 0:31:28 | 0:12:13 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"1711091188.6883206 mon.smithi081 (mon.0) 681 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| fail | 7616013 |
|
2024-03-22 02:09:18 | 2024-03-22 06:42:18 | 2024-03-22 07:02:21 | 0:20:03 | 0:07:15 | 0:12:48 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=quincy |
||||||||||||||
| fail | 7616014 |
|
2024-03-22 02:09:19 | 2024-03-22 06:44:49 | 2024-03-22 07:23:47 | 0:38:58 | 0:29:44 | 0:09:14 | smithi | main | centos | 9.stream | upgrade/telemetry-upgrade/quincy-x/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks} | 2 |
Failure Reason:
"1711090929.3672369 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| pass | 7616015 |
|
2024-03-22 02:09:20 | 2024-03-22 06:44:49 | 2024-03-22 07:18:47 | 0:33:58 | 0:24:25 | 0:09:33 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 |
| pass | 7616016 |
|
2024-03-22 02:09:21 | 2024-03-22 06:44:49 | 2024-03-22 07:07:16 | 0:22:27 | 0:11:32 | 0:10:55 | smithi | main | centos | 8.stream | upgrade/cephfs/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} | 1 |
| fail | 7616017 |
|
2024-03-22 02:09:22 | 2024-03-22 06:46:20 | 2024-03-22 08:43:37 | 1:57:17 | 1:48:13 | 0:09:04 | smithi | main | centos | 9.stream | upgrade/reef-x/parallel/{0-random-distro$/{centos_9.stream_runc} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
"2024-03-22T08:10:00.000213+0000 mon.a (mon.0) 3494 : cluster 3 [WRN] TELEMETRY_CHANGED: Telemetry requires re-opt-in" in cluster log |
||||||||||||||
| fail | 7616018 |
|
2024-03-22 02:09:23 | 2024-03-22 06:46:21 | 2024-03-22 10:37:06 | 3:50:45 | 3:36:06 | 0:14:39 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
Command failed (workunit test suites/fsstress.sh) on smithi203 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=768f6cd6e95d0c7a626042719c230df59bdba9d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' |
||||||||||||||
| fail | 7616019 |
|
2024-03-22 02:09:24 | 2024-03-22 06:47:31 | 2024-03-22 07:05:36 | 0:18:05 | 0:07:11 | 0:10:54 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/parallel/{0-random-distro$/{ubuntu_22.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} | 2 |
Failure Reason:
Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=quincy |
||||||||||||||
| pass | 7616020 |
|
2024-03-22 02:09:25 | 2024-03-22 06:47:32 | 2024-03-22 07:19:11 | 0:31:39 | 0:20:07 | 0:11:32 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 |
| fail | 7616021 |
|
2024-03-22 02:09:26 | 2024-03-22 06:49:53 | 2024-03-22 09:36:57 | 2:47:04 | 2:37:21 | 0:09:43 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-22T08:30:00.000125+0000 mon.a (mon.0) 5425 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 42 scrub errors" in cluster log |
||||||||||||||
| fail | 7616022 |
|
2024-03-22 02:09:27 | 2024-03-22 06:49:53 | 2024-03-22 09:12:58 | 2:23:05 | 2:12:30 | 0:10:35 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-22T08:30:00.000131+0000 mon.a (mon.0) 5994 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 2 scrub errors" in cluster log |
||||||||||||||
| fail | 7616023 |
|
2024-03-22 02:09:28 | 2024-03-22 06:49:53 | 2024-03-22 07:33:07 | 0:43:14 | 0:32:01 | 0:11:13 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"1711091617.6388516 mon.smithi063 (mon.0) 683 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY)" in cluster log |
||||||||||||||
| pass | 7616024 |
|
2024-03-22 02:09:29 | 2024-03-22 06:50:14 | 2024-03-22 07:19:14 | 0:29:00 | 0:20:15 | 0:08:45 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 |
| fail | 7616025 |
|
2024-03-22 02:09:30 | 2024-03-22 06:50:14 | 2024-03-22 10:39:26 | 3:49:12 | 3:38:56 | 0:10:16 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-22T09:20:00.000187+0000 mon.a (mon.0) 7863 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 1 scrub errors" in cluster log |
||||||||||||||
| fail | 7616026 |
|
2024-03-22 02:09:31 | 2024-03-22 06:50:15 | 2024-03-22 09:49:24 | 2:59:09 | 2:48:35 | 0:10:34 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream_runc 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-22T08:30:00.000155+0000 mon.a (mon.0) 5951 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 9 scrub errors" in cluster log |
||||||||||||||
| dead | 7616027 |
|
2024-03-22 02:09:32 | 2024-03-22 06:50:15 | 2024-03-22 19:01:02 | 12:10:47 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| pass | 7616028 |
|
2024-03-22 02:09:33 | 2024-03-22 06:51:56 | 2024-03-22 07:29:59 | 0:38:03 | 0:24:24 | 0:13:39 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/no}} | 3 |
| fail | 7616029 |
|
2024-03-22 02:09:34 | 2024-03-22 06:54:16 | 2024-03-22 10:07:29 | 3:13:13 | 2:56:03 | 0:17:10 | smithi | main | ubuntu | 22.04 | upgrade/reef-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
"2024-03-22T08:10:00.000161+0000 mon.a (mon.0) 1386 : cluster 3 [WRN] OSDMAP_FLAGS: noscrub flag(s) set" in cluster log |
||||||||||||||
| fail | 7616030 |
|
2024-03-22 02:09:35 | 2024-03-22 07:01:38 | 2024-03-22 07:19:49 | 0:18:11 | 0:07:10 | 0:11:01 | smithi | main | ubuntu | 22.04 | upgrade/quincy-x/stress-split/{0-distro/ubuntu_22.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} | 2 |
Failure Reason:
Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=quincy |
||||||||||||||
| fail | 7616031 |
|
2024-03-22 02:09:36 | 2024-03-22 07:01:58 | 2024-03-22 07:45:07 | 0:43:09 | 0:32:37 | 0:10:32 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
"1711092373.4359963 mon.smithi134 (mon.0) 713 : cluster [WRN] Replacing daemon mds.cephfs.smithi134.yxdtlb as rank 0 with standby daemon mds.cephfs.smithi134.dexlss" in cluster log |
||||||||||||||
| pass | 7616032 |
|
2024-03-22 02:09:38 | 2024-03-22 07:01:59 | 2024-03-22 07:35:37 | 0:33:38 | 0:20:16 | 0:13:22 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} | 3 |
| fail | 7616033 |
|
2024-03-22 02:09:39 | 2024-03-22 07:02:49 | 2024-03-22 10:23:59 | 3:21:10 | 3:06:52 | 0:14:18 | smithi | main | centos | 9.stream | upgrade/reef-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"2024-03-22T09:10:00.000133+0000 mon.a (mon.0) 7334 : cluster 4 [ERR] OSD_SCRUB_ERRORS: 3 scrub errors" in cluster log |
||||||||||||||
| fail | 7616034 |
|
2024-03-22 02:09:40 | 2024-03-22 07:05:40 | 2024-03-22 09:56:30 | 2:50:50 | 2:41:29 | 0:09:21 | smithi | main | centos | 9.stream | upgrade/quincy-x/stress-split/{0-distro/centos_9.stream 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} | 2 |
Failure Reason:
"1711092202.3830187 mon.a (mon.0) 171 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
| fail | 7616035 |
|
2024-03-22 02:09:41 | 2024-03-22 07:05:40 | 2024-03-22 10:55:26 | 3:49:46 | 3:36:55 | 0:12:51 | smithi | main | centos | 9.stream | upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} | 2 |
Failure Reason:
Command failed (workunit test suites/fsstress.sh) on smithi122 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=768f6cd6e95d0c7a626042719c230df59bdba9d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' |
||||||||||||||
| pass | 7616036 |
|
2024-03-22 02:09:42 | 2024-03-22 07:05:41 | 2024-03-22 07:35:01 | 0:29:20 | 0:19:55 | 0:09:25 | smithi | main | centos | 8.stream | upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} | 3 |
| pass | 7616037 |
|
2024-03-22 02:09:43 | 2024-03-22 07:05:41 | 2024-03-22 08:43:19 | 1:37:38 | 1:27:54 | 0:09:44 | smithi | main | centos | 8.stream | upgrade/cephfs/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-clients/fuse-upgrade 3-workload/stress_tests/kernel_untar_build}} | 2 |
Pulpito