Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi047.front.sepia.ceph.com smithi True True 2024-05-13 05:40:49.778854 scheduled_teuthology@teuthology x86_64 /home/teuthworker/archive/teuthology-2024-05-09_22:32:02-powercycle-reef-distro-default-smithi/7700344
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7704129 2024-05-12 21:28:26 2024-05-13 00:15:22 2024-05-13 01:25:27 1:10:05 0:59:57 0:10:08 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} 3
Failure Reason:

error during scrub thrashing: rank damage found: {'backtrace'}

pass 7704093 2024-05-12 21:27:48 2024-05-12 23:46:32 2024-05-13 00:15:16 0:28:44 0:14:44 0:14:00 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-3-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/ior-shared-file} 5
pass 7704066 2024-05-12 21:27:20 2024-05-12 23:23:18 2024-05-12 23:48:41 0:25:23 0:15:38 0:09:45 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/multimds_misc} 2
pass 7704028 2024-05-12 21:26:40 2024-05-12 22:57:48 2024-05-12 23:23:42 0:25:54 0:14:48 0:11:06 smithi main centos 9.stream fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} 2
pass 7703995 2024-05-12 21:26:05 2024-05-12 22:31:21 2024-05-12 22:58:45 0:27:24 0:17:12 0:10:12 smithi main ubuntu 22.04 fs/permission/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_misc} 2
fail 7703905 2024-05-12 21:24:28 2024-05-12 21:28:40 2024-05-12 22:17:48 0:49:08 0:39:13 0:09:55 smithi main centos 9.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

fail 7703769 2024-05-12 21:04:36 2024-05-13 01:37:29 2024-05-13 04:01:31 2:24:02 2:13:38 0:10:24 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun

pass 7703213 2024-05-12 05:18:38 2024-05-12 07:23:14 2024-05-12 08:37:31 1:14:17 0:52:38 0:21:39 smithi main centos 8.stream smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/centos_8 tasks/{0-install test/rbd_fsx}} 3
pass 7703151 2024-05-12 05:17:35 2024-05-12 06:31:31 2024-05-12 07:25:45 0:54:14 0:42:13 0:12:01 smithi main ubuntu 20.04 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap s3tests-branch supported-all-distro/ubuntu_20.04 tasks/{0-install test/kclient_workunit_suites_dbench}} 3
pass 7702933 2024-05-11 21:49:06 2024-05-12 01:39:34 2024-05-12 02:20:00 0:40:26 0:16:05 0:24:21 smithi main centos 8.stream krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc$/{crc-rxbounce} msgr-failures/few tasks/krbd_namespaces} 3
pass 7702902 2024-05-11 21:48:34 2024-05-12 00:58:36 2024-05-12 01:44:55 0:46:19 0:23:28 0:22:51 smithi main centos 8.stream krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
pass 7702701 2024-05-11 21:17:23 2024-05-11 21:47:52 2024-05-12 00:59:13 3:11:21 2:59:10 0:12:11 smithi main ubuntu 22.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/compare-mirror-image-alternate-primary-nbd} 2
fail 7702568 2024-05-11 17:18:37 2024-05-11 18:21:58 2024-05-11 18:39:49 0:17:51 0:06:39 0:11:12 smithi main centos 9.stream orch:cephadm/smoke-roleless/{0-distro/centos_9.stream 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} 2
Failure Reason:

Command failed on smithi047 with status 1: 'echo \'# created by cephadm\n/var/log/ceph/{{ fsid }}/*.log {\n rotate 100\n size 10G\n compress\n sharedscripts\n postrotate\n killall -q -1 {{ targets|join(\'"\'"\' \'"\'"\') }} || pkill -1 -x \'"\'"\'{{ targets|join(\'"\'"\'|\'"\'"\') }}\'"\'"\' || true\n endscript\n missingok\n notifempty\n su root root\n}\' > /root/logrotate.conf'

fail 7702538 2024-05-11 17:18:07 2024-05-11 17:59:34 2024-05-11 18:17:01 0:17:27 0:06:25 0:11:02 smithi main centos 9.stream orch:cephadm/smoke/{0-distro/centos_9.stream 0-nvme-loop agent/on fixed-2 mon_election/classic start} 2
Failure Reason:

Command failed on smithi047 with status 1: 'echo \'# created by cephadm\n/var/log/ceph/{{ fsid }}/*.log {\n rotate 100\n size 10G\n compress\n sharedscripts\n postrotate\n killall -q -1 {{ targets|join(\'"\'"\' \'"\'"\') }} || pkill -1 -x \'"\'"\'{{ targets|join(\'"\'"\'|\'"\'"\') }}\'"\'"\' || true\n endscript\n missingok\n notifempty\n su root root\n}\' > /root/logrotate.conf'

dead 7702512 2024-05-11 17:17:40 2024-05-11 17:39:01 2024-05-11 17:59:29 0:20:28 smithi main centos 9.stream orch:cephadm/with-work/{0-distro/centos_9.stream fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
Failure Reason:

Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds

pass 7702486 2024-05-11 09:20:42 2024-05-11 14:00:48 2024-05-11 14:35:09 0:34:21 0:23:23 0:10:58 smithi main ubuntu 22.04 rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_transit 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability s3tests-branch ubuntu_latest} 1
pass 7702452 2024-05-11 09:20:13 2024-05-11 13:34:41 2024-05-11 14:01:35 0:26:54 0:14:29 0:12:25 smithi main centos 9.stream rgw/upgrade/{1-install/quincy/{distro$/{centos_latest} install overrides} 2-setup 3-upgrade-sequence/osds-then-rgws cluster frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides} 2
pass 7702411 2024-05-11 06:03:15 2024-05-11 13:01:16 2024-05-11 13:36:41 0:35:25 0:23:00 0:12:25 smithi main centos 8.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
pass 7702358 2024-05-11 06:02:12 2024-05-11 11:53:34 2024-05-11 13:03:43 1:10:09 0:57:02 0:13:07 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/iogen}} 3
pass 7702325 2024-05-11 06:01:34 2024-05-11 11:08:44 2024-05-11 11:56:39 0:47:55 0:35:48 0:12:07 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/pjd}} 3