| Name | Machine Type | Up | Locked | Locked Since | Locked By | OS Type | OS Version | Arch | Description |
|---|---|---|---|---|---|---|---|---|---|
| smithi160.front.sepia.ceph.com | smithi | True | True | 2024-05-21 16:47:56.505732 | scheduled_yuriw@teuthology | x86_64 | /home/teuthworker/archive/yuriw-2024-05-20_20:45:46-rados-wip-yuri3-testing-2024-05-20-1050-distro-default-smithi/7716893 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 7717869 |
|
2024-05-21 01:33:20 | 2024-05-21 03:27:12 | 2024-05-21 04:10:15 | 0:43:03 | 0:33:37 | 0:09:26 | smithi | main | centos | 9.stream | fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/pjd}} | 3 |
| fail | 7717498 |
|
2024-05-21 01:05:04 | 2024-05-21 01:05:38 | 2024-05-21 01:40:57 | 0:35:19 | 0:23:43 | 0:11:36 | smithi | main | centos | 9.stream | fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/snap-schedule} | 2 |
Failure Reason:
Test failure: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) |
||||||||||||||
| fail | 7717489 |
|
2024-05-20 23:58:19 | 2024-05-21 01:40:23 | 2024-05-21 03:22:27 | 1:42:04 | 1:31:12 | 0:10:52 | smithi | install-fix | centos | 9.stream | fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/kernel_untar_build}} | 3 |
Failure Reason:
"2024-05-21T02:38:43.568615+0000 mds.b (mds.0) 99 : cluster [WRN] Scrub error on inode 0x1000000e25e (/volumes/qa/sv_1/ac196e04-b1bb-4213-b4ca-de8831ba74ef/client.0/tmp/t/linux-6.5.11/drivers/soc/nuvoton) see mds.b log and `damage ls` output for details" in cluster log |
||||||||||||||
| pass | 7717386 |
|
2024-05-20 23:07:51 | 2024-05-20 23:17:56 | 2024-05-21 01:07:35 | 1:49:39 | 1:38:49 | 0:10:50 | smithi | install-fix | centos | 9.stream | fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} | 2 |
| dead | 7717381 |
|
2024-05-20 23:07:50 | 2024-05-20 23:16:24 | 2024-05-20 23:18:28 | 0:02:04 | smithi | install-fix | centos | 9.stream | fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/pjd}} | 2 | ||
Failure Reason:
Error reimaging machines: Failed to power on smithi192 |
||||||||||||||
| dead | 7717378 |
|
2024-05-20 23:07:49 | 2024-05-20 23:14:43 | 2024-05-20 23:16:17 | 0:01:34 | smithi | install-fix | centos | 9.stream | fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/postgres}} | 3 | ||
Failure Reason:
Error reimaging machines: Failed to power on smithi172 |
||||||||||||||
| waiting | 7716893 |
|
2024-05-20 20:52:23 | 2024-05-21 16:46:36 | 2024-05-21 16:47:57 | 0:04:37 | 0:04:37 | smithi | main | ubuntu | 22.04 | rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} | 1 | |
| fail | 7716844 |
|
2024-05-20 20:51:30 | 2024-05-21 16:18:03 | 2024-05-21 16:47:48 | 0:29:45 | 0:19:06 | 0:10:39 | smithi | main | centos | 9.stream | rados/cephadm/workunits/{0-distro/centos_9.stream agent/on mon_election/connectivity task/test_monitoring_stack_basic} | 3 |
Failure Reason:
"2024-05-21T16:39:52.577823+0000 mon.a (mon.0) 593 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)" in cluster log |
||||||||||||||
| pass | 7716696 |
|
2024-05-20 20:48:59 | 2024-05-20 21:45:42 | 2024-05-20 22:15:33 | 0:29:51 | 0:20:13 | 0:09:38 | smithi | main | ubuntu | 22.04 | orch:cephadm/osds/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} | 2 |
| dead | 7716057 |
|
2024-05-20 19:49:39 | 2024-05-21 04:08:14 | 2024-05-21 16:20:22 | 12:12:08 | smithi | main | centos | 9.stream | rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_latest}} | 1 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| fail | 7715981 |
|
2024-05-20 18:43:21 | 2024-05-20 20:23:44 | 2024-05-20 21:40:59 | 1:17:15 | 1:03:37 | 0:13:38 | smithi | install-fix | centos | 9.stream | fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/dbench}} | 3 |
Failure Reason:
"2024-05-20T21:14:35.062989+0000 mds.b (mds.0) 159 : cluster [WRN] Scrub error on inode 0x10000003205 (/volumes/qa/sv_0/85ea2e92-99da-4998-8c16-0193a7f5bcae/client.0/tmp/clients/client3/~dmtmp/ACCESS) see mds.b log and `damage ls` output for details" in cluster log |
||||||||||||||
| pass | 7715934 |
|
2024-05-20 18:42:07 | 2024-05-20 19:39:38 | 2024-05-20 20:27:44 | 0:48:06 | 0:37:37 | 0:10:29 | smithi | install-fix | centos | 9.stream | fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/pjd}} | 3 |
| pass | 7715893 |
|
2024-05-20 18:41:56 | 2024-05-20 18:52:27 | 2024-05-20 19:40:23 | 0:47:56 | 0:38:03 | 0:09:53 | smithi | install-fix | centos | 9.stream | fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/direct_io}} | 3 |
| pass | 7715865 |
|
2024-05-20 18:25:39 | 2024-05-20 22:45:02 | 2024-05-20 23:15:08 | 0:30:06 | 0:19:31 | 0:10:35 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nfs2 3-final} | 2 |
| pass | 7715810 |
|
2024-05-20 18:24:39 | 2024-05-20 22:15:19 | 2024-05-20 22:45:23 | 0:30:04 | 0:19:53 | 0:10:11 | smithi | main | ubuntu | 22.04 | orch:cephadm/smoke-roleless/{0-distro/ubuntu_22.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} | 2 |
| pass | 7715717 |
|
2024-05-20 15:48:32 | 2024-05-20 18:08:01 | 2024-05-20 18:53:08 | 0:45:07 | 0:32:14 | 0:12:53 | smithi | main | centos | 9.stream | fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/suites/pjd}} | 3 |
| fail | 7715632 |
|
2024-05-20 15:47:01 | 2024-05-20 17:06:37 | 2024-05-20 18:10:00 | 1:03:23 | 0:53:58 | 0:09:25 | smithi | main | centos | 9.stream | fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} | 3 |
Failure Reason:
error during scrub thrashing: rank damage found: {'backtrace'} |
||||||||||||||
| pass | 7715545 |
|
2024-05-20 15:45:26 | 2024-05-20 15:47:18 | 2024-05-20 17:06:35 | 1:19:17 | 1:10:39 | 0:08:38 | smithi | main | centos | 9.stream | fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/iogen}} | 3 |
| dead | 7715508 |
|
2024-05-20 15:05:25 | 2024-05-20 15:31:40 | 2024-05-20 15:32:44 | 0:01:04 | smithi | main | centos | 9.stream | orch:cephadm/smoke-roleless/{0-distro/centos_9.stream_runc 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} | 2 | ||
Failure Reason:
Error reimaging machines: Failed to power on smithi184 |
||||||||||||||
| pass | 7715446 |
|
2024-05-20 15:04:25 | 2024-05-20 15:04:25 | 2024-05-20 15:31:45 | 0:27:20 | 0:14:15 | 0:13:05 | smithi | main | centos | 9.stream | orch:cephadm/smb/{0-distro/centos_9.stream tasks/deploy_smb_basic} | 2 |
Pulpito