Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi133.front.sepia.ceph.com smithi True True 2024-07-27 03:17:32.414199 scheduled_pdonnell@teuthology x86_64 /home/teuthworker/archive/pdonnell-2024-07-26_23:45:44-fs-wip-pdonnell-testing-20240726.202642-debug-distro-default-smithi/7821009
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
waiting 7821009 2024-07-26 23:49:38 2024-07-27 03:17:02 2024-07-27 03:17:33 0:01:07 0:01:07 smithi main centos 9.stream fs/volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}} 2
pass 7820969 2024-07-26 23:48:54 2024-07-27 02:36:47 2024-07-27 03:16:57 0:40:10 0:28:34 0:11:36 smithi main centos 9.stream fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} kclient-overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
pass 7820910 2024-07-26 23:47:50 2024-07-27 01:41:12 2024-07-27 02:37:24 0:56:12 0:44:35 0:11:37 smithi main ubuntu 22.04 fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
fail 7820856 2024-07-26 23:46:51 2024-07-27 00:54:16 2024-07-27 01:41:09 0:46:53 0:36:54 0:09:59 smithi main centos 9.stream fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/blogbench}} 3
Failure Reason:

"2024-07-27T01:29:55.999391+0000 mds.b (mds.0) 29 : cluster [WRN] Scrub error on inode 0x100000007e2 (/volumes/qa/sv_0/882277e1-e1d3-4802-98cd-5c05ed2c2ac3/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-7) see mds.b log and `damage ls` output for details" in cluster log

pass 7820675 2024-07-26 21:35:22 2024-07-27 00:35:13 2024-07-27 00:55:38 0:20:25 0:10:24 0:10:01 smithi main ubuntu 22.04 rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} 3
fail 7820584 2024-07-26 21:33:38 2024-07-26 23:46:23 2024-07-27 00:35:40 0:49:17 0:38:22 0:10:55 smithi main centos 9.stream rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} 2
Failure Reason:

reached maximum tries (51) after waiting for 300 seconds

pass 7820484 2024-07-26 21:31:39 2024-07-26 22:45:35 2024-07-26 23:46:18 1:00:43 0:50:18 0:10:25 smithi main ubuntu 22.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-5} backoff/normal ceph clusters/{fixed-4 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench} 4
fail 7820441 2024-07-26 21:30:46 2024-07-26 22:25:05 2024-07-26 22:46:25 0:21:20 0:11:18 0:10:02 smithi main centos 9.stream rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/off mon_election/classic task/test_ca_signed_key} 2
Failure Reason:

generator didn't yield

fail 7819540 2024-07-26 15:03:29 2024-07-26 15:05:11 2024-07-26 17:37:40 2:32:29 2:16:29 0:16:00 smithi main centos 9.stream fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/snap-schedule} 2
Failure Reason:

Found coredumps on ubuntu@smithi106.front.sepia.ceph.com

pass 7819383 2024-07-26 13:26:07 2024-07-26 19:37:45 2024-07-26 22:25:03 2:47:18 2:38:00 0:09:18 smithi main centos 9.stream rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_latest} workloads/compare-mirror-images-nbd} 2
pass 7819344 2024-07-26 13:25:46 2024-07-26 19:12:33 2024-07-26 19:37:35 0:25:02 0:13:54 0:11:08 smithi main ubuntu 22.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 7819308 2024-07-26 13:25:27 2024-07-26 18:47:32 2024-07-26 19:13:08 0:25:36 0:15:53 0:09:43 smithi main ubuntu 22.04 rados/singleton/{all/mon-config mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} 1
pass 7819196 2024-07-26 13:24:36 2024-07-26 17:36:42 2024-07-26 18:47:23 1:10:41 1:00:20 0:10:21 smithi main ubuntu 22.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/ec extra-conf/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} 3
pass 7819082 2024-07-26 13:23:45 2024-07-26 14:31:26 2024-07-26 15:06:27 0:35:01 0:25:40 0:09:21 smithi main centos 9.stream rbd/cli_v1/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} features/format-1 msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_latest} workloads/rbd_cli_generic} 1
pass 7819060 2024-07-26 13:23:34 2024-07-26 14:04:35 2024-07-26 14:31:16 0:26:41 0:15:19 0:11:22 smithi main ubuntu 22.04 rbd/singleton-bluestore/{all/issue-20295 conf/{disable-pool-app} objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} 4
pass 7819039 2024-07-26 13:23:19 2024-07-26 13:35:43 2024-07-26 14:05:18 0:29:35 0:20:35 0:09:00 smithi main ubuntu 22.04 rbd/basic/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/rbd_python_api_tests_old_format} 1
pass 7818950 2024-07-26 05:39:56 2024-07-26 05:49:05 2024-07-26 07:58:21 2:09:16 1:57:31 0:11:45 smithi main centos 9.stream fs:volumes/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} 2
pass 7818857 2024-07-26 04:23:39 2024-07-26 12:55:35 2024-07-26 13:31:22 0:35:47 0:15:03 0:20:44 smithi main ubuntu 22.04 fs/multiclient/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1-mds-3-client conf/{client mds mgr mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/ior-shared-file} 5
pass 7818828 2024-07-26 04:23:06 2024-07-26 12:17:07 2024-07-26 13:00:58 0:43:51 0:33:01 0:10:50 smithi main centos 9.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_9.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no multimds/yes pg-warn pg_health} tasks/{0-from/reef 1-client 2-upgrade 3-compat_client/no}} 3
fail 7818809 2024-07-26 04:22:44 2024-07-26 11:54:41 2024-07-26 12:17:46 0:23:05 0:10:46 0:12:19 smithi main ubuntu 22.04 fs/32bits/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/fixed-2-ucephfs conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/cfuse_workunit_suites_fsstress} 2
Failure Reason:

No module named 'tasks'