Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi046.front.sepia.ceph.com smithi True True 2024-05-11 01:11:17.601373 scheduled_sjust@teuthology centos 9 x86_64 /home/teuthworker/archive/sjust-2024-05-11_00:44:54-crimson-rados:thrash-wip-sjust-crimson-testing-2024-05-09-distro-default-smithi/7702070
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 7696068 2024-05-07 21:40:56 2024-05-08 09:26:19 2024-05-08 10:15:47 0:49:28 0:40:11 0:09:17 smithi main centos 9.stream rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} 2
pass 7696003 2024-05-07 21:20:02 2024-05-08 08:32:27 2024-05-08 09:26:17 0:53:50 0:43:41 0:10:09 smithi main centos 9.stream rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/none extra-conf/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_latest} workloads/c_api_tests_with_defaults} 3
pass 7695959 2024-05-07 21:19:17 2024-05-08 07:44:43 2024-05-08 08:33:00 0:48:17 0:35:46 0:12:31 smithi main ubuntu 22.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/ec extra-conf/none min-compat-client/default msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} 3
pass 7695940 2024-05-07 21:18:57 2024-05-08 07:26:33 2024-05-08 07:47:00 0:20:27 0:10:15 0:10:12 smithi main ubuntu 22.04 rbd/singleton/{all/rbdmap_RBDMAPFILE conf/{disable-pool-app} objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} 1
pass 7695865 2024-05-07 21:17:43 2024-05-07 22:22:57 2024-05-08 00:20:45 1:57:48 1:47:07 0:10:41 smithi main ubuntu 22.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} conf/{disable-pool-app} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} 3
fail 7695824 2024-05-07 21:17:03 2024-05-07 21:38:24 2024-05-07 22:15:14 0:36:50 0:25:38 0:11:12 smithi main centos 9.stream rbd/iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} 3
Failure Reason:

"2024-05-07T21:55:48.005279+0000 mon.a (mon.0) 209 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,c" in cluster log

pass 7695531 2024-05-07 14:16:16 2024-05-08 19:11:50 2024-05-08 19:41:55 0:30:05 0:16:44 0:13:21 smithi main ubuntu 22.04 rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} 2
pass 7695486 2024-05-07 13:34:39 2024-05-07 14:17:22 2024-05-07 15:10:31 0:53:09 0:43:10 0:09:59 smithi main centos 9.stream rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} 2
pass 7695434 2024-05-07 13:33:56 2024-05-07 13:43:18 2024-05-07 14:17:14 0:33:56 0:22:50 0:11:06 smithi main ubuntu 22.04 rgw/website/{clusters/fixed-2 frontend/beast http ignore-pg-availability overrides s3tests-branch tasks/s3tests-website ubuntu_latest} 2
fail 7695363 2024-05-07 03:47:50 2024-05-08 13:28:29 2024-05-08 14:03:28 0:34:59 0:24:30 0:10:29 smithi main centos 9.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

Command failed on smithi046 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 55bdc1be-0d41-11ef-bc97-c7b262605968 -e sha1=8e169ddeb2c550feeba2d26322b0465f6a1bd99d -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

dead 7695351 2024-05-07 03:47:40 2024-05-08 13:22:52 2024-05-08 13:28:15 0:05:23 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/dbench}} 3
Failure Reason:

Error reimaging machines: Expected smithi137's OS to be centos 9 but found ubuntu 22.04

fail 7695301 2024-05-07 03:46:59 2024-05-08 12:49:55 2024-05-08 13:11:36 0:21:41 0:07:40 0:14:01 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/ffsb}} 3
Failure Reason:

Command failed on smithi039 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8e169ddeb2c550feeba2d26322b0465f6a1bd99d pull'

fail 7695271 2024-05-07 03:46:34 2024-05-08 12:21:02 2024-05-08 12:42:53 0:21:51 0:09:06 0:12:45 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/iogen}} 3
Failure Reason:

Command failed on smithi046 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8e169ddeb2c550feeba2d26322b0465f6a1bd99d pull'

fail 7695225 2024-05-07 03:45:56 2024-05-08 11:49:52 2024-05-08 12:16:58 0:27:06 0:12:19 0:14:47 smithi main centos 8.stream fs/upgrade/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-pacific 1-upgrade}} 1
Failure Reason:

ceph version 18.2.2-1306.gbf64272e was not installed, found 16.2.15-0.el8.

fail 7695182 2024-05-07 03:45:21 2024-05-08 11:18:44 2024-05-08 11:36:16 0:17:32 0:07:59 0:09:33 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/postgres}} 3
Failure Reason:

Command failed on smithi032 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8e169ddeb2c550feeba2d26322b0465f6a1bd99d pull'

fail 7695142 2024-05-07 03:44:48 2024-05-08 10:47:21 2024-05-08 11:07:45 0:20:24 0:08:24 0:12:00 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/ffsb}} 3
Failure Reason:

Command failed on smithi027 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8e169ddeb2c550feeba2d26322b0465f6a1bd99d pull'

fail 7695105 2024-05-07 01:14:19 2024-05-07 01:37:21 2024-05-07 03:14:01 1:36:40 1:26:11 0:10:29 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/fs/misc}} 3
Failure Reason:

error during scrub thrashing: rank damage found: {'backtrace'}

pass 7694879 2024-05-06 21:33:07 2024-05-07 11:20:40 2024-05-07 12:04:13 0:43:33 0:32:32 0:11:01 smithi main centos 9.stream powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-distros/centos_latest tasks/rados_api_tests thrashosds-health} 4
pass 7694855 2024-05-06 21:32:43 2024-05-07 10:45:14 2024-05-07 11:21:10 0:35:56 0:23:14 0:12:42 smithi main centos 9.stream powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-distros/centos_latest tasks/snaps-many-objects thrashosds-health} 4
pass 7694828 2024-05-06 21:32:17 2024-05-07 10:15:08 2024-05-07 10:48:02 0:32:54 0:16:34 0:16:20 smithi main ubuntu 22.04 powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health} 4