| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| khiremat | 2022-01-16 11:16:23 | 2022-01-16 11:23:59 | 2022-01-16 21:11:13 | 9:47:14 | fs | wip-khiremat-44574-syslog-warn-ignorelist | smithi | e2ad5f9 | 155 | 20 | 23 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 6621171 |
|
2022-01-16 11:16:32 | 2022-01-16 11:22:39 | 2022-01-16 12:26:12 | 1:03:33 | 0:50:40 | 0:12:53 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} | 2 |
| pass | 6621172 |
|
2022-01-16 11:16:33 | 2022-01-16 11:23:59 | 2022-01-16 11:55:42 | 0:31:43 | 0:20:02 | 0:11:41 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/fsstress validater/lockdep} | 2 |
| pass | 6621173 |
|
2022-01-16 11:16:34 | 2022-01-16 11:24:00 | 2022-01-16 11:48:01 | 0:24:01 | 0:16:25 | 0:07:36 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{yes}} | 3 |
| pass | 6621174 |
|
2022-01-16 11:16:35 | 2022-01-16 11:24:00 | 2022-01-16 12:34:13 | 1:10:13 | 1:03:33 | 0:06:40 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/snaps}} | 2 |
| pass | 6621175 |
|
2022-01-16 11:16:36 | 2022-01-16 11:25:30 | 2022-01-16 12:04:55 | 0:39:25 | 0:32:40 | 0:06:45 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery} | 2 |
| pass | 6621176 |
|
2022-01-16 11:16:37 | 2022-01-16 11:25:51 | 2022-01-16 12:59:39 | 1:33:48 | 1:16:02 | 0:17:46 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} | 3 |
| pass | 6621177 |
|
2022-01-16 11:16:38 | 2022-01-16 11:32:42 | 2022-01-16 13:54:33 | 2:21:51 | 2:10:09 | 0:11:42 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} | 2 |
| pass | 6621178 |
|
2022-01-16 11:16:39 | 2022-01-16 11:32:42 | 2022-01-16 12:23:40 | 0:50:58 | 0:39:01 | 0:11:57 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{no}} | 3 |
| fail | 6621179 |
|
2022-01-16 11:16:40 | 2022-01-16 11:33:44 | 2022-01-16 12:11:54 | 0:38:10 | 0:27:46 | 0:10:24 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} | 2 |
Failure Reason:
'2022-01-16T11:58:35.257846+00:00 smithi058 kernel: [ 969.189326] INFO: task fsstress:29422 blocked for more than 120 seconds. ' in syslog |
||||||||||||||
| pass | 6621180 |
|
2022-01-16 11:16:41 | 2022-01-16 11:33:54 | 2022-01-16 12:09:13 | 0:35:19 | 0:22:13 | 0:13:06 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/damage} | 2 |
| pass | 6621181 |
|
2022-01-16 11:16:42 | 2022-01-16 11:36:25 | 2022-01-16 12:02:21 | 0:25:56 | 0:18:23 | 0:07:33 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/iozone}} | 2 |
| pass | 6621182 |
|
2022-01-16 11:16:43 | 2022-01-16 11:36:25 | 2022-01-16 12:43:16 | 1:06:51 | 0:59:06 | 0:07:45 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{yes}} | 3 |
| fail | 6621183 |
|
2022-01-16 11:16:44 | 2022-01-16 11:37:15 | 2022-01-16 12:11:18 | 0:34:03 | 0:21:12 | 0:12:51 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/pjd}} | 2 |
Failure Reason:
reached maximum tries (90) after waiting for 540 seconds |
||||||||||||||
| pass | 6621184 |
|
2022-01-16 11:16:45 | 2022-01-16 11:37:36 | 2022-01-16 12:13:45 | 0:36:09 | 0:26:15 | 0:09:54 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan} | 2 |
| fail | 6621185 |
|
2022-01-16 11:16:46 | 2022-01-16 11:37:36 | 2022-01-16 12:05:58 | 0:28:22 | 0:14:53 | 0:13:29 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{no}} | 3 |
Failure Reason:
No module named 'tasks.kclient' |
||||||||||||||
| fail | 6621186 |
|
2022-01-16 11:16:47 | 2022-01-16 11:40:27 | 2022-01-16 12:02:32 | 0:22:05 | 0:09:26 | 0:12:39 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/fs/snaps}} | 2 |
Failure Reason:
No module named 'tasks.cephfs.fuse_mount' |
||||||||||||||
| fail | 6621187 |
|
2022-01-16 11:16:48 | 2022-01-16 11:42:17 | 2022-01-16 12:02:28 | 0:20:11 | 0:09:47 | 0:10:24 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{no}} | 3 |
Failure Reason:
"2022-01-16T12:01:24.704672+0000 mon.a (mon.0) 289 : cluster [WRN] Health check failed: Degraded data redundancy: 3/46 objects degraded (6.522%), 2 pgs degraded (PG_DEGRADED)" in cluster log |
||||||||||||||
| fail | 6621188 |
|
2022-01-16 11:16:49 | 2022-01-16 11:42:18 | 2022-01-16 12:01:13 | 0:18:55 | 0:09:14 | 0:09:41 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} | 2 |
Failure Reason:
Command failed on smithi135 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' |
||||||||||||||
| fail | 6621189 |
|
2022-01-16 11:16:50 | 2022-01-16 11:44:59 | 2022-01-16 12:03:35 | 0:18:36 | 0:07:32 | 0:11:04 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} | 2 |
Failure Reason:
Command failed on smithi131 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' |
||||||||||||||
| fail | 6621190 |
|
2022-01-16 11:16:51 | 2022-01-16 11:44:59 | 2022-01-16 12:03:56 | 0:18:57 | 0:07:33 | 0:11:24 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} | 2 |
Failure Reason:
Command failed on smithi060 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-fuse cephfs-java libcephfs_jni1 libcephfs1 librados2 librbd1 python-ceph rbd-fuse python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' |
||||||||||||||
| pass | 6621191 |
|
2022-01-16 11:16:52 | 2022-01-16 11:45:29 | 2022-01-16 12:51:30 | 1:06:01 | 0:54:40 | 0:11:21 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} | 2 |
| pass | 6621192 |
|
2022-01-16 11:16:53 | 2022-01-16 11:45:30 | 2022-01-16 12:16:24 | 0:30:54 | 0:16:45 | 0:14:09 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/iozone}} | 2 |
| pass | 6621193 |
|
2022-01-16 11:16:54 | 2022-01-16 11:48:10 | 2022-01-16 12:24:29 | 0:36:19 | 0:25:15 | 0:11:04 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{no}} | 3 |
| pass | 6621194 |
|
2022-01-16 11:16:55 | 2022-01-16 11:53:01 | 2022-01-16 12:18:47 | 0:25:46 | 0:17:46 | 0:08:00 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub} | 2 |
| pass | 6621195 |
|
2022-01-16 11:16:56 | 2022-01-16 11:53:02 | 2022-01-16 12:19:07 | 0:26:05 | 0:14:53 | 0:11:12 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{yes}} | 3 |
| fail | 6621196 |
|
2022-01-16 11:16:57 | 2022-01-16 11:53:52 | 2022-01-16 12:15:28 | 0:21:36 | 0:11:02 | 0:10:34 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/ffsb}} | 2 |
Failure Reason:
No module named 'tasks' |
||||||||||||||
| pass | 6621197 |
|
2022-01-16 11:16:58 | 2022-01-16 11:55:43 | 2022-01-16 12:37:14 | 0:41:31 | 0:23:34 | 0:17:57 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{yes}} | 3 |
| pass | 6621198 |
|
2022-01-16 11:16:59 | 2022-01-16 12:02:34 | 2022-01-16 13:18:23 | 1:15:49 | 1:08:53 | 0:06:56 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/snaps}} | 2 |
| pass | 6621199 |
|
2022-01-16 11:17:00 | 2022-01-16 12:02:34 | 2022-01-16 14:02:10 | 1:59:36 | 1:48:34 | 0:11:02 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} | 2 |
| pass | 6621200 |
|
2022-01-16 11:17:01 | 2022-01-16 12:03:15 | 2022-01-16 12:34:57 | 0:31:42 | 0:19:49 | 0:11:53 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/fragment} | 2 |
| pass | 6621201 |
|
2022-01-16 11:17:02 | 2022-01-16 12:03:15 | 2022-01-16 12:31:27 | 0:28:12 | 0:17:17 | 0:10:55 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} | 2 |
| pass | 6621202 |
|
2022-01-16 11:17:03 | 2022-01-16 12:03:45 | 2022-01-16 12:30:42 | 0:26:57 | 0:18:01 | 0:08:56 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{no}} | 3 |
| pass | 6621203 |
|
2022-01-16 11:17:04 | 2022-01-16 12:04:56 | 2022-01-16 12:36:07 | 0:31:11 | 0:18:30 | 0:12:41 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair} | 2 |
| pass | 6621204 |
|
2022-01-16 11:17:05 | 2022-01-16 12:06:06 | 2022-01-16 12:33:05 | 0:26:59 | 0:21:01 | 0:05:58 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/iozone}} | 2 |
| pass | 6621205 |
|
2022-01-16 11:17:06 | 2022-01-16 12:06:07 | 2022-01-16 12:39:10 | 0:33:03 | 0:15:30 | 0:17:33 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{no}} | 3 |
| pass | 6621206 |
|
2022-01-16 11:17:07 | 2022-01-16 12:11:28 | 2022-01-16 12:39:17 | 0:27:49 | 0:16:05 | 0:11:44 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/pjd}} | 2 |
| pass | 6621207 |
|
2022-01-16 11:17:08 | 2022-01-16 12:11:58 | 2022-01-16 12:39:58 | 0:28:00 | 0:15:13 | 0:12:47 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{no}} | 3 |
| pass | 6621208 |
|
2022-01-16 11:17:08 | 2022-01-16 12:13:49 | 2022-01-16 13:45:47 | 1:31:58 | 1:18:54 | 0:13:04 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/snaps}} | 2 |
| pass | 6621209 |
|
2022-01-16 11:17:09 | 2022-01-16 12:15:29 | 2022-01-16 12:45:00 | 0:29:31 | 0:22:04 | 0:07:27 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} | 2 |
| fail | 6621210 |
|
2022-01-16 11:17:10 | 2022-01-16 12:15:30 | 2022-01-16 13:02:14 | 0:46:44 | 0:38:50 | 0:07:54 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{yes}} | 3 |
Failure Reason:
"2022-01-16T12:46:29.363332+0000 mds.i (mds.1) 178 : cluster [WRN] Scrub error on inode 0x100000089e0 (/client.0/tmp/t/linux-5.4/samples/mic/mpssd/mpss) see mds.i log and `damage ls` output for details" in cluster log |
||||||||||||||
| pass | 6621211 |
|
2022-01-16 11:17:11 | 2022-01-16 12:16:30 | 2022-01-16 12:44:34 | 0:28:04 | 0:14:37 | 0:13:27 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} | 2 |
| pass | 6621212 |
|
2022-01-16 11:17:12 | 2022-01-16 12:18:51 | 2022-01-16 12:48:42 | 0:29:51 | 0:23:42 | 0:06:09 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} | 2 |
| pass | 6621213 |
|
2022-01-16 11:17:13 | 2022-01-16 12:19:11 | 2022-01-16 13:04:55 | 0:45:44 | 0:30:04 | 0:15:40 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}} | 3 |
| pass | 6621214 |
|
2022-01-16 11:17:14 | 2022-01-16 12:23:42 | 2022-01-16 12:52:43 | 0:29:01 | 0:17:18 | 0:11:43 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/iozone}} | 2 |
| pass | 6621215 |
|
2022-01-16 11:17:15 | 2022-01-16 12:24:33 | 2022-01-16 13:28:14 | 1:03:41 | 0:51:04 | 0:12:37 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}} | 3 |
| pass | 6621216 |
|
2022-01-16 11:17:16 | 2022-01-16 12:26:13 | 2022-01-16 13:00:42 | 0:34:29 | 0:19:26 | 0:15:03 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/iozone}} | 2 |
| pass | 6621217 |
|
2022-01-16 11:17:17 | 2022-01-16 12:29:24 | 2022-01-16 12:56:11 | 0:26:47 | 0:13:16 | 0:13:31 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds_creation_retry} | 2 |
| fail | 6621218 |
|
2022-01-16 11:17:18 | 2022-01-16 12:30:44 | 2022-01-16 14:55:13 | 2:24:29 | 2:18:50 | 0:05:39 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/fs/snaps}} | 2 |
Failure Reason:
'2022-01-16T13:29:39.334266+00:00 smithi037 kernel: INFO: task kcompactd0:72 blocked for more than 120 seconds. ' in syslog |
||||||||||||||
| pass | 6621219 |
|
2022-01-16 11:17:19 | 2022-01-16 12:30:45 | 2022-01-16 12:58:14 | 0:27:29 | 0:18:02 | 0:09:27 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{yes}} | 3 |
| pass | 6621220 |
|
2022-01-16 11:17:20 | 2022-01-16 12:33:05 | 2022-01-16 15:17:06 | 2:44:01 | 2:33:04 | 0:10:57 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} | 2 |
| pass | 6621221 |
|
2022-01-16 11:17:21 | 2022-01-16 12:34:16 | 2022-01-16 13:09:31 | 0:35:15 | 0:22:59 | 0:12:16 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/metrics} | 2 |
| pass | 6621222 |
|
2022-01-16 11:17:22 | 2022-01-16 12:35:06 | 2022-01-16 13:04:38 | 0:29:32 | 0:16:47 | 0:12:45 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} | 2 |
| pass | 6621223 |
|
2022-01-16 11:17:23 | 2022-01-16 12:35:37 | 2022-01-16 13:03:33 | 0:27:56 | 0:16:19 | 0:11:37 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{yes}} | 3 |
| fail | 6621224 |
|
2022-01-16 11:17:24 | 2022-01-16 12:36:17 | 2022-01-16 13:41:47 | 1:05:30 | 0:53:17 | 0:12:13 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{yes}} | 3 |
Failure Reason:
Command failed (workunit test suites/fsx.sh) on smithi023 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e2ad5f90065f18c9489f9c62007d256a0f9bd97e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' |
||||||||||||||
| pass | 6621225 |
|
2022-01-16 11:17:25 | 2022-01-16 12:37:18 | 2022-01-16 13:04:03 | 0:26:45 | 0:19:00 | 0:07:45 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/iozone}} | 2 |
| pass | 6621226 |
|
2022-01-16 11:17:26 | 2022-01-16 12:39:18 | 2022-01-16 13:47:34 | 1:08:16 | 0:57:40 | 0:10:36 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} | 2 |
| pass | 6621227 |
|
2022-01-16 11:17:27 | 2022-01-16 12:39:19 | 2022-01-16 13:29:29 | 0:50:10 | 0:39:00 | 0:11:10 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/clone}} | 2 |
| fail | 6621228 |
|
2022-01-16 11:17:28 | 2022-01-16 12:39:19 | 2022-01-16 13:11:26 | 0:32:07 | 0:21:16 | 0:10:51 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/pjd}} | 2 |
Failure Reason:
reached maximum tries (90) after waiting for 540 seconds |
||||||||||||||
| pass | 6621229 |
|
2022-01-16 11:17:29 | 2022-01-16 12:39:59 | 2022-01-16 14:06:02 | 1:26:03 | 1:10:23 | 0:15:40 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/snaps}} | 2 |
| pass | 6621230 |
|
2022-01-16 11:17:30 | 2022-01-16 12:43:20 | 2022-01-16 13:18:42 | 0:35:22 | 0:26:07 | 0:09:15 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{no}} | 3 |
| pass | 6621231 |
|
2022-01-16 11:17:31 | 2022-01-16 12:44:41 | 2022-01-16 13:08:42 | 0:24:01 | 0:17:23 | 0:06:38 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/openfiletable} | 2 |
| pass | 6621232 |
|
2022-01-16 11:17:32 | 2022-01-16 12:45:01 | 2022-01-16 13:24:20 | 0:39:19 | 0:25:16 | 0:14:03 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{no}} | 3 |
| pass | 6621233 |
|
2022-01-16 11:17:33 | 2022-01-16 12:48:52 | 2022-01-16 13:19:42 | 0:30:50 | 0:21:59 | 0:08:51 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} | 2 |
| fail | 6621234 |
|
2022-01-16 11:17:34 | 2022-01-16 12:50:12 | 2022-01-16 13:23:40 | 0:33:28 | 0:21:55 | 0:11:33 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} | 2 |
Failure Reason:
reached maximum tries (90) after waiting for 540 seconds |
||||||||||||||
| pass | 6621235 |
|
2022-01-16 11:17:35 | 2022-01-16 12:50:13 | 2022-01-16 13:16:29 | 0:26:16 | 0:16:07 | 0:10:09 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{yes}} | 3 |
| pass | 6621236 |
|
2022-01-16 11:17:36 | 2022-01-16 12:50:43 | 2022-01-16 13:20:56 | 0:30:13 | 0:16:35 | 0:13:38 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/iozone}} | 2 |
| pass | 6621237 |
|
2022-01-16 11:17:37 | 2022-01-16 12:51:34 | 2022-01-16 13:17:21 | 0:25:47 | 0:14:09 | 0:11:38 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm} | 2 |
| pass | 6621238 |
|
2022-01-16 11:17:38 | 2022-01-16 12:51:54 | 2022-01-16 13:57:24 | 1:05:30 | 0:53:38 | 0:11:52 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} | 2 |
| pass | 6621239 |
|
2022-01-16 11:17:39 | 2022-01-16 12:51:54 | 2022-01-16 13:24:11 | 0:32:17 | 0:20:46 | 0:11:31 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/fsstress validater/lockdep} | 2 |
| pass | 6621240 |
|
2022-01-16 11:17:40 | 2022-01-16 12:52:45 | 2022-01-16 13:20:25 | 0:27:40 | 0:12:34 | 0:15:06 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/quota} | 2 |
| pass | 6621241 |
|
2022-01-16 11:17:41 | 2022-01-16 12:56:16 | 2022-01-16 13:40:55 | 0:44:39 | 0:36:40 | 0:07:59 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} | 3 |
| pass | 6621242 |
|
2022-01-16 11:17:42 | 2022-01-16 12:58:17 | 2022-01-16 14:18:24 | 1:20:07 | 1:13:09 | 0:06:58 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} | 2 |
| pass | 6621243 |
|
2022-01-16 11:17:43 | 2022-01-16 12:58:57 | 2022-01-16 13:46:39 | 0:47:42 | 0:35:39 | 0:12:03 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{yes}} | 3 |
| pass | 6621244 |
|
2022-01-16 11:17:44 | 2022-01-16 12:58:57 | 2022-01-16 13:29:12 | 0:30:15 | 0:18:37 | 0:11:38 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} | 2 |
| pass | 6621245 |
|
2022-01-16 11:17:45 | 2022-01-16 12:59:48 | 2022-01-16 13:25:14 | 0:25:26 | 0:12:26 | 0:13:00 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} | 2 |
| pass | 6621246 |
|
2022-01-16 11:17:46 | 2022-01-16 13:00:48 | 2022-01-16 13:38:02 | 0:37:14 | 0:24:55 | 0:12:19 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{yes}} | 3 |
| pass | 6621247 |
|
2022-01-16 11:17:47 | 2022-01-16 13:01:49 | 2022-01-16 13:27:16 | 0:25:27 | 0:18:06 | 0:07:21 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/pjd}} | 2 |
| pass | 6621248 |
|
2022-01-16 11:17:48 | 2022-01-16 13:01:49 | 2022-01-16 13:31:52 | 0:30:03 | 0:21:53 | 0:08:10 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/scrub} | 2 |
| pass | 6621249 |
|
2022-01-16 11:17:49 | 2022-01-16 13:02:20 | 2022-01-16 14:48:15 | 1:45:55 | 1:39:22 | 0:06:33 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{yes}} | 3 |
| pass | 6621250 |
|
2022-01-16 11:17:50 | 2022-01-16 13:02:30 | 2022-01-16 14:30:45 | 1:28:15 | 1:16:54 | 0:11:21 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}} | 2 |
| pass | 6621251 |
|
2022-01-16 11:17:51 | 2022-01-16 13:02:30 | 2022-01-16 14:25:50 | 1:23:20 | 1:11:12 | 0:12:08 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} | 2 |
| pass | 6621252 |
|
2022-01-16 11:17:52 | 2022-01-16 13:03:41 | 2022-01-16 13:31:43 | 0:28:02 | 0:16:33 | 0:11:29 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{yes}} | 3 |
| pass | 6621253 |
|
2022-01-16 11:17:53 | 2022-01-16 13:04:11 | 2022-01-16 13:32:24 | 0:28:13 | 0:16:24 | 0:11:49 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/sessionmap} | 2 |
| pass | 6621254 |
|
2022-01-16 11:17:54 | 2022-01-16 13:04:42 | 2022-01-16 13:31:03 | 0:26:21 | 0:16:07 | 0:10:14 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{yes}} | 3 |
| pass | 6621255 |
|
2022-01-16 11:17:55 | 2022-01-16 13:05:02 | 2022-01-16 13:28:10 | 0:23:08 | 0:15:46 | 0:07:22 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} | 2 |
| pass | 6621256 |
|
2022-01-16 11:17:56 | 2022-01-16 13:06:13 | 2022-01-16 13:32:57 | 0:26:44 | 0:17:22 | 0:09:22 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/iozone}} | 2 |
| pass | 6621257 |
|
2022-01-16 11:17:57 | 2022-01-16 13:06:13 | 2022-01-16 13:50:57 | 0:44:44 | 0:31:07 | 0:13:37 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snap-schedule} | 2 |
| pass | 6621258 |
|
2022-01-16 11:17:58 | 2022-01-16 13:08:44 | 2022-01-16 13:38:55 | 0:30:11 | 0:17:30 | 0:12:41 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/pjd}} | 2 |
| pass | 6621259 |
|
2022-01-16 11:17:59 | 2022-01-16 13:09:34 | 2022-01-16 13:40:01 | 0:30:27 | 0:16:57 | 0:13:30 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{yes}} | 3 |
| pass | 6621260 |
|
2022-01-16 11:18:00 | 2022-01-16 13:16:35 | 2022-01-16 13:46:25 | 0:29:50 | 0:20:00 | 0:09:50 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} | 2 |
| pass | 6621261 |
|
2022-01-16 11:18:01 | 2022-01-16 13:16:36 | 2022-01-16 13:54:24 | 0:37:48 | 0:24:54 | 0:12:54 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{no}} | 3 |
| pass | 6621262 |
|
2022-01-16 11:18:02 | 2022-01-16 13:18:26 | 2022-01-16 14:48:39 | 1:30:13 | 1:22:55 | 0:07:18 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} | 2 |
| pass | 6621263 |
|
2022-01-16 11:18:03 | 2022-01-16 13:18:47 | 2022-01-16 14:10:51 | 0:52:04 | 0:41:19 | 0:10:45 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{no}} | 3 |
| pass | 6621264 |
|
2022-01-16 11:18:04 | 2022-01-16 13:19:07 | 2022-01-16 13:49:01 | 0:29:54 | 0:18:10 | 0:11:44 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} | 2 |
| pass | 6621265 |
|
2022-01-16 11:18:05 | 2022-01-16 13:19:48 | 2022-01-16 13:45:17 | 0:25:29 | 0:13:25 | 0:12:04 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} | 2 |
| pass | 6621266 |
|
2022-01-16 11:18:06 | 2022-01-16 13:20:28 | 2022-01-16 13:58:55 | 0:38:27 | 0:31:12 | 0:07:15 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/strays} | 2 |
| pass | 6621267 |
|
2022-01-16 11:18:07 | 2022-01-16 13:20:59 | 2022-01-16 13:47:08 | 0:26:09 | 0:17:34 | 0:08:35 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{no}} | 3 |
| pass | 6621268 |
|
2022-01-16 11:18:08 | 2022-01-16 13:23:49 | 2022-01-16 13:49:23 | 0:25:34 | 0:18:33 | 0:07:01 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/pjd}} | 2 |
| pass | 6621269 |
|
2022-01-16 11:18:09 | 2022-01-16 13:24:20 | 2022-01-16 14:26:28 | 1:02:08 | 0:55:07 | 0:07:01 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} | 2 |
| pass | 6621270 |
|
2022-01-16 11:18:10 | 2022-01-16 13:24:30 | 2022-01-16 13:51:03 | 0:26:33 | 0:15:25 | 0:11:08 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{no}} | 3 |
| pass | 6621271 |
|
2022-01-16 11:18:11 | 2022-01-16 13:25:21 | 2022-01-16 14:34:49 | 1:09:28 | 0:57:04 | 0:12:24 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/snaps}} | 2 |
| pass | 6621272 |
|
2022-01-16 11:18:12 | 2022-01-16 13:27:21 | 2022-01-16 13:59:54 | 0:32:33 | 0:18:48 | 0:13:45 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/test_journal_migration} | 2 |
| pass | 6621273 |
|
2022-01-16 11:18:13 | 2022-01-16 13:28:12 | 2022-01-16 14:36:35 | 1:08:23 | 0:57:45 | 0:10:38 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} | 3 |
| pass | 6621274 |
|
2022-01-16 11:18:14 | 2022-01-16 13:28:22 | 2022-01-16 14:51:20 | 1:22:58 | 1:11:56 | 0:11:02 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} | 2 |
| pass | 6621275 |
|
2022-01-16 11:18:15 | 2022-01-16 13:29:13 | 2022-01-16 13:53:43 | 0:24:30 | 0:12:22 | 0:12:08 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/truncate_delay} | 2 |
| fail | 6621276 |
|
2022-01-16 11:18:16 | 2022-01-16 13:29:33 | 2022-01-16 13:59:00 | 0:29:27 | 0:22:32 | 0:06:55 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} | 2 |
Failure Reason:
reached maximum tries (90) after waiting for 540 seconds |
||||||||||||||
| pass | 6621277 |
|
2022-01-16 11:18:17 | 2022-01-16 13:29:53 | 2022-01-16 14:02:53 | 0:33:00 | 0:26:55 | 0:06:05 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}} | 3 |
| pass | 6621278 |
|
2022-01-16 11:18:18 | 2022-01-16 13:29:54 | 2022-01-16 13:58:36 | 0:28:42 | 0:17:25 | 0:11:17 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/iozone}} | 2 |
| dead | 6621279 |
|
2022-01-16 11:18:19 | 2022-01-16 13:31:04 | 2022-01-16 13:47:53 | 0:16:49 | 0:04:44 | 0:12:05 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/pjd}} | 2 |
Failure Reason:
{'Failure object was': {'smithi125.front.sepia.ceph.com': {'ansible_facts': {}, 'msg': 'The following modules failed to execute: setup\\n', 'failed_modules': {'setup': {'failed': True, 'module_stdout': '', 'module_stderr': '', 'msg': 'MODULE FAILURE\\nSee stdout/stderr for the exact error', 'rc': -13}}, '_ansible_verbose_override': True, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'failed')"} |
||||||||||||||
| pass | 6621280 |
|
2022-01-16 11:18:20 | 2022-01-16 13:31:45 | 2022-01-16 14:53:54 | 1:22:09 | 1:10:37 | 0:11:32 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}} | 3 |
| pass | 6621281 |
|
2022-01-16 11:18:21 | 2022-01-16 13:31:55 | 2022-01-16 15:15:13 | 1:43:18 | 1:31:31 | 0:11:47 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{no}} | 3 |
| pass | 6621282 |
|
2022-01-16 11:18:22 | 2022-01-16 13:32:26 | 2022-01-16 14:51:52 | 1:19:26 | 1:12:23 | 0:07:03 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} | 2 |
| pass | 6621283 |
|
2022-01-16 11:18:23 | 2022-01-16 13:33:06 | 2022-01-16 13:59:45 | 0:26:39 | 0:16:12 | 0:10:27 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/workunit/quota} | 2 |
| pass | 6621284 |
|
2022-01-16 11:18:24 | 2022-01-16 13:36:27 | 2022-01-16 14:04:57 | 0:28:30 | 0:17:06 | 0:11:24 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} | 2 |
| pass | 6621285 |
|
2022-01-16 11:18:25 | 2022-01-16 13:37:38 | 2022-01-16 14:03:49 | 0:26:11 | 0:19:00 | 0:07:11 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{yes}} | 3 |
| pass | 6621286 |
|
2022-01-16 11:18:27 | 2022-01-16 13:38:08 | 2022-01-16 14:03:30 | 0:25:22 | 0:13:17 | 0:12:05 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} | 2 |
| pass | 6621287 |
|
2022-01-16 11:18:28 | 2022-01-16 13:38:58 | 2022-01-16 14:17:38 | 0:38:40 | 0:25:37 | 0:13:03 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{no}} | 3 |
| pass | 6621288 |
|
2022-01-16 11:18:29 | 2022-01-16 13:40:09 | 2022-01-16 14:09:33 | 0:29:24 | 0:17:08 | 0:12:16 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/acls} | 2 |
| pass | 6621289 |
|
2022-01-16 11:18:30 | 2022-01-16 13:41:00 | 2022-01-16 14:05:19 | 0:24:19 | 0:17:40 | 0:06:39 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/pjd}} | 2 |
| pass | 6621290 |
|
2022-01-16 11:18:31 | 2022-01-16 13:41:50 | 2022-01-16 14:09:35 | 0:27:45 | 0:13:20 | 0:14:25 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{yes}} | 3 |
| pass | 6621291 |
|
2022-01-16 11:18:32 | 2022-01-16 13:45:21 | 2022-01-16 14:41:41 | 0:56:20 | 0:44:03 | 0:12:17 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}} | 2 |
| pass | 6621292 |
|
2022-01-16 11:18:33 | 2022-01-16 13:45:52 | 2022-01-16 14:48:28 | 1:02:36 | 0:51:13 | 0:11:23 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/admin} | 2 |
| pass | 6621293 |
|
2022-01-16 11:18:34 | 2022-01-16 13:46:32 | 2022-01-16 15:09:00 | 1:22:28 | 1:11:56 | 0:10:32 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} | 2 |
| pass | 6621294 |
|
2022-01-16 11:18:35 | 2022-01-16 13:46:42 | 2022-01-16 15:00:45 | 1:14:03 | 1:06:20 | 0:07:43 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{yes}} | 3 |
| pass | 6621295 |
|
2022-01-16 11:18:36 | 2022-01-16 13:47:13 | 2022-01-16 14:52:38 | 1:05:25 | 0:58:05 | 0:07:20 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} | 2 |
| pass | 6621296 |
|
2022-01-16 11:18:37 | 2022-01-16 13:47:13 | 2022-01-16 14:17:25 | 0:30:12 | 0:23:43 | 0:06:29 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/snapshot}} | 2 |
| pass | 6621297 |
|
2022-01-16 11:18:38 | 2022-01-16 13:47:44 | 2022-01-16 14:10:41 | 0:22:57 | 0:16:22 | 0:06:35 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} | 2 |
| pass | 6621298 |
|
2022-01-16 11:18:39 | 2022-01-16 13:47:54 | 2022-01-16 14:19:08 | 0:31:14 | 0:17:27 | 0:13:47 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{yes}} | 3 |
| dead | 6621299 |
|
2022-01-16 11:18:40 | 2022-01-16 13:49:25 | 2022-01-16 13:54:30 | 0:05:05 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/iozone}} | 2 | ||
Failure Reason:
Error reimaging machines: Failed to power on smithi168 |
||||||||||||||
| pass | 6621300 |
|
2022-01-16 11:18:41 | 2022-01-16 13:51:05 | 2022-01-16 14:17:23 | 0:26:18 | 0:14:52 | 0:11:26 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{no}} | 3 |
| pass | 6621301 |
|
2022-01-16 11:18:42 | 2022-01-16 13:51:06 | 2022-01-16 14:21:56 | 0:30:50 | 0:16:25 | 0:14:25 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/pjd}} | 2 |
| pass | 6621302 |
|
2022-01-16 11:18:43 | 2022-01-16 13:53:46 | 2022-01-16 14:31:55 | 0:38:09 | 0:25:41 | 0:12:28 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/multifs-auth} | 2 |
| pass | 6621303 |
|
2022-01-16 11:18:44 | 2022-01-16 13:54:27 | 2022-01-16 14:17:36 | 0:23:09 | 0:16:03 | 0:07:06 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} | 2 |
| pass | 6621304 |
|
2022-01-16 11:18:45 | 2022-01-16 13:54:27 | 2022-01-16 14:20:50 | 0:26:23 | 0:15:55 | 0:10:28 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/fsstress validater/lockdep} | 2 |
| dead | 6621305 |
|
2022-01-16 11:18:46 | 2022-01-16 13:54:38 | 2022-01-16 14:01:17 | 0:06:39 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/asok_dump_tree} | 2 | ||
Failure Reason:
Error reimaging machines: Failed to power on smithi168 |
||||||||||||||
| pass | 6621306 |
|
2022-01-16 11:18:47 | 2022-01-16 13:56:48 | 2022-01-16 14:33:52 | 0:37:04 | 0:29:06 | 0:07:58 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} | 3 |
| pass | 6621307 |
|
2022-01-16 11:18:49 | 2022-01-16 13:58:39 | 2022-01-16 15:39:03 | 1:40:24 | 1:33:47 | 0:06:37 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} | 2 |
| fail | 6621308 |
|
2022-01-16 11:18:50 | 2022-01-16 13:59:00 | 2022-01-16 14:56:29 | 0:57:29 | 0:46:17 | 0:11:12 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{no}} | 3 |
Failure Reason:
"2022-01-16T14:39:20.284606+0000 mds.g (mds.2) 56 : cluster [WRN] Scrub error on inode 0x10000008dce (/client.0/tmp/t/linux-5.4/ipc/syscall.c) see mds.g log and `damage ls` output for details" in cluster log |
||||||||||||||
| pass | 6621309 |
|
2022-01-16 11:18:51 | 2022-01-16 13:59:10 | 2022-01-16 14:35:23 | 0:36:13 | 0:23:24 | 0:12:49 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} | 2 |
| pass | 6621310 |
|
2022-01-16 11:18:52 | 2022-01-16 13:59:51 | 2022-01-16 14:25:41 | 0:25:50 | 0:14:15 | 0:11:35 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/auto-repair} | 2 |
| fail | 6621311 |
|
2022-01-16 11:18:53 | 2022-01-16 14:00:01 | 2022-01-16 14:30:36 | 0:30:35 | 0:19:35 | 0:11:00 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} | 2 |
Failure Reason:
reached maximum tries (90) after waiting for 540 seconds |
||||||||||||||
| pass | 6621312 |
|
2022-01-16 11:18:54 | 2022-01-16 14:00:22 | 2022-01-16 14:38:24 | 0:38:02 | 0:25:47 | 0:12:15 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{yes}} | 3 |
| pass | 6621313 |
|
2022-01-16 11:18:55 | 2022-01-16 14:02:12 | 2022-01-16 14:25:07 | 0:22:55 | 0:11:49 | 0:11:06 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/backtrace} | 2 |
| pass | 6621314 |
|
2022-01-16 11:18:56 | 2022-01-16 14:03:03 | 2022-01-16 14:26:07 | 0:23:04 | 0:17:14 | 0:05:50 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/pjd}} | 2 |
| pass | 6621315 |
|
2022-01-16 11:18:57 | 2022-01-16 14:03:03 | 2022-01-16 16:07:10 | 2:04:07 | 1:57:19 | 0:06:48 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{no}} | 3 |
| pass | 6621316 |
|
2022-01-16 11:18:58 | 2022-01-16 14:03:14 | 2022-01-16 15:38:44 | 1:35:30 | 1:25:07 | 0:10:23 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/snaps}} | 2 |
| dead | 6621317 |
|
2022-01-16 11:18:59 | 2022-01-16 14:03:14 | 2022-01-16 14:08:02 | 0:04:48 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} | 2 | ||
Failure Reason:
Error reimaging machines: Failed to power on smithi168 |
||||||||||||||
| pass | 6621318 |
|
2022-01-16 11:19:00 | 2022-01-16 14:03:35 | 2022-01-16 14:31:28 | 0:27:53 | 0:17:15 | 0:10:38 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{no}} | 3 |
| pass | 6621319 |
|
2022-01-16 11:19:01 | 2022-01-16 14:03:55 | 2022-01-16 14:32:26 | 0:28:31 | 0:15:18 | 0:13:13 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{yes}} | 3 |
| pass | 6621320 |
|
2022-01-16 11:19:02 | 2022-01-16 14:05:06 | 2022-01-16 14:27:06 | 0:22:00 | 0:15:27 | 0:06:33 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} | 2 |
| pass | 6621321 |
|
2022-01-16 11:19:03 | 2022-01-16 14:05:26 | 2022-01-16 14:35:51 | 0:30:25 | 0:18:28 | 0:11:57 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/iozone}} | 2 |
| pass | 6621322 |
|
2022-01-16 11:19:04 | 2022-01-16 14:06:07 | 2022-01-16 14:33:41 | 0:27:34 | 0:20:46 | 0:06:48 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-limits} | 2 |
| pass | 6621323 |
|
2022-01-16 11:19:05 | 2022-01-16 14:06:37 | 2022-01-16 14:32:46 | 0:26:09 | 0:15:45 | 0:10:24 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/pjd}} | 2 |
| fail | 6621324 |
|
2022-01-16 11:19:06 | 2022-01-16 14:06:37 | 2022-01-16 14:32:01 | 0:25:24 | 0:16:07 | 0:09:17 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{yes}} | 3 |
Failure Reason:
'2022-01-16T14:28:56.976943+00:00 smithi107 kernel: WARNING: CPU: 3 PID: 45336 at fs/ceph/mds_client.c:4823 ceph_mdsc_close_sessions+0x2a7/0x2c0 [ceph] ' in syslog |
||||||||||||||
| pass | 6621325 |
|
2022-01-16 11:19:07 | 2022-01-16 14:08:18 | 2022-01-16 17:11:28 | 3:03:10 | 2:52:07 | 0:11:03 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/ffsb}} | 2 |
| pass | 6621326 |
|
2022-01-16 11:19:08 | 2022-01-16 14:08:18 | 2022-01-16 14:45:27 | 0:37:09 | 0:24:50 | 0:12:19 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{no}} | 3 |
| pass | 6621327 |
|
2022-01-16 11:19:09 | 2022-01-16 14:09:39 | 2022-01-16 14:34:55 | 0:25:16 | 0:13:32 | 0:11:44 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead} | 2 |
| pass | 6621328 |
|
2022-01-16 11:19:10 | 2022-01-16 14:09:39 | 2022-01-16 15:48:23 | 1:38:44 | 1:31:20 | 0:07:24 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} | 2 |
| pass | 6621329 |
|
2022-01-16 11:19:11 | 2022-01-16 14:10:50 | 2022-01-16 14:46:44 | 0:35:54 | 0:25:12 | 0:10:42 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{yes}} | 3 |
| pass | 6621330 |
|
2022-01-16 11:19:12 | 2022-01-16 14:11:00 | 2022-01-16 14:48:59 | 0:37:59 | 0:19:52 | 0:18:07 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} | 2 |
| pass | 6621331 |
|
2022-01-16 11:19:13 | 2022-01-16 14:17:32 | 2022-01-16 14:59:33 | 0:42:01 | 0:31:01 | 0:11:00 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery} | 2 |
| dead | 6621332 |
|
2022-01-16 11:19:14 | 2022-01-16 14:17:32 | 2022-01-16 14:22:01 | 0:04:29 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} | 2 | ||
Failure Reason:
Error reimaging machines: Failed to power on smithi168 |
||||||||||||||
| pass | 6621333 |
|
2022-01-16 11:19:15 | 2022-01-16 14:17:33 | 2022-01-16 14:57:11 | 0:39:38 | 0:32:43 | 0:06:55 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{whitelist_health whitelist_wrongly_marked_down} tasks/workunit/snaps} | 2 |
| pass | 6621334 |
|
2022-01-16 11:19:16 | 2022-01-16 14:17:43 | 2022-01-16 15:12:42 | 0:54:59 | 0:48:21 | 0:06:38 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volumes/{overrides test/basic}} | 2 |
| pass | 6621335 |
|
2022-01-16 11:19:18 | 2022-01-16 14:17:44 | 2022-01-16 14:42:02 | 0:24:18 | 0:16:42 | 0:07:36 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{yes}} | 3 |
| pass | 6621336 |
|
2022-01-16 11:19:19 | 2022-01-16 14:18:34 | 2022-01-16 14:44:27 | 0:25:53 | 0:17:57 | 0:07:56 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/pjd}} | 2 |
| pass | 6621337 |
|
2022-01-16 11:19:20 | 2022-01-16 14:19:15 | 2022-01-16 15:23:24 | 1:04:09 | 0:50:56 | 0:13:13 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{mon-debug whitelist_health whitelist_wrongly_marked_down} tasks/failover} | 2 |
| pass | 6621338 |
|
2022-01-16 11:19:21 | 2022-01-16 14:20:55 | 2022-01-16 14:53:18 | 0:32:23 | 0:21:33 | 0:10:50 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{no}} | 3 |
| dead | 6621339 |
|
2022-01-16 11:19:22 | 2022-01-16 14:22:06 | 2022-01-16 14:28:45 | 0:06:39 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/snaps}} | 2 | ||
Failure Reason:
Error reimaging machines: Failed to power on smithi168 |
||||||||||||||
| pass | 6621340 |
|
2022-01-16 11:19:23 | 2022-01-16 14:24:17 | 2022-01-16 15:23:06 | 0:58:49 | 0:44:52 | 0:13:57 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{no}} | 3 |
| pass | 6621341 |
|
2022-01-16 11:19:24 | 2022-01-16 14:25:47 | 2022-01-16 16:40:05 | 2:14:18 | 2:03:12 | 0:11:06 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} | 2 |
| pass | 6621342 |
|
2022-01-16 11:19:25 | 2022-01-16 14:25:58 | 2022-01-16 15:03:20 | 0:37:22 | 0:30:57 | 0:06:25 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/data-scan} | 2 |
| pass | 6621343 |
|
2022-01-16 11:19:26 | 2022-01-16 14:26:08 | 2022-01-16 14:47:53 | 0:21:45 | 0:14:46 | 0:06:59 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} | 2 |
| dead | 6621344 |
|
2022-01-16 11:19:27 | 2022-01-16 14:26:29 | 2022-01-16 21:11:13 | 6:44:44 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{no}} | 3 | ||
Failure Reason:
hit max job timeout |
||||||||||||||
| dead | 6621345 |
|
2022-01-16 11:19:28 | 2022-01-16 14:27:09 | 2022-01-16 15:02:00 | 0:34:51 | 0:19:34 | 0:15:17 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/iozone}} | 2 |
Failure Reason:
{'Failure object was': {'smithi122.front.sepia.ceph.com': {'msg': "Failed to download metadata for repo 'apache-arrow': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried", 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['gpg'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} |
||||||||||||||
| pass | 6621346 |
|
2022-01-16 11:19:29 | 2022-01-16 14:30:40 | 2022-01-16 14:57:50 | 0:27:10 | 0:15:14 | 0:11:56 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/pjd}} | 2 |
| dead | 6621347 |
|
2022-01-16 11:19:30 | 2022-01-16 14:30:51 | 2022-01-16 15:01:01 | 0:30:10 | 0:18:52 | 0:11:18 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}} | 3 |
Failure Reason:
{'Failure object was': {'smithi142.front.sepia.ceph.com': {'msg': "Failed to download metadata for repo 'apache-arrow': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried", 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['gpg'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} |
||||||||||||||
| dead | 6621348 |
|
2022-01-16 11:19:31 | 2022-01-16 14:31:31 | 2022-01-16 14:36:00 | 0:04:29 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/exports} | 2 | ||
Failure Reason:
Error reimaging machines: Failed to power on smithi168 |
||||||||||||||
| pass | 6621349 |
|
2022-01-16 11:19:32 | 2022-01-16 14:31:32 | 2022-01-16 15:00:01 | 0:28:29 | 0:17:11 | 0:11:18 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mon 2-workunit/iozone}} | 2 |
| fail | 6621350 |
|
2022-01-16 11:19:33 | 2022-01-16 14:32:02 | 2022-01-16 18:02:28 | 3:30:26 | 3:18:15 | 0:12:11 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{no}} | 3 |
Failure Reason:
Command failed (workunit test suites/ffsb.sh) on smithi025 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e2ad5f90065f18c9489f9c62007d256a0f9bd97e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' |
||||||||||||||
| pass | 6621351 |
|
2022-01-16 11:19:34 | 2022-01-16 14:32:03 | 2022-01-16 14:58:34 | 0:26:31 | 0:15:50 | 0:10:41 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/forward-scrub} | 2 |
| dead | 6621352 |
|
2022-01-16 11:19:35 | 2022-01-16 14:32:33 | 2022-01-16 14:58:07 | 0:25:34 | 0:18:39 | 0:06:55 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} | 2 |
Failure Reason:
{'Failure object was': {'smithi068.front.sepia.ceph.com': {'msg': "Failed to download metadata for repo 'apache-arrow': Yum repo downloading error: Downloading error(s): repodata/643adf304fdc134ebc2389b1becb23f90863766aef2e3a5a52d6a5075754a2b6-primary.xml.gz - Cannot download, all mirrors were already tried without success; repodata/f94fc2cf05be858ad1c9aa4848071b4b53408ca94d60c983d82baca2ce4d1666-filelists.xml.gz - Cannot download, all mirrors were already tried without success", 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['gpg'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} |
||||||||||||||
| dead | 6621353 |
|
2022-01-16 11:19:36 | 2022-01-16 14:32:54 | 2022-01-16 15:00:56 | 0:28:02 | 0:16:23 | 0:11:39 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} | 2 |
Failure Reason:
{'Failure object was': {'smithi153.front.sepia.ceph.com': {'msg': "Failed to download metadata for repo 'apache-arrow': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried", 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['gpg'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} |
||||||||||||||
| dead | 6621354 |
|
2022-01-16 11:19:37 | 2022-01-16 14:33:44 | 2022-01-16 15:01:24 | 0:27:40 | 0:19:52 | 0:07:48 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{yes}} | 3 |
Failure Reason:
{'Failure object was': {'smithi117.front.sepia.ceph.com': {'msg': "Failed to download metadata for repo 'apache-arrow': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried", 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['gpg'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} |
||||||||||||||
| pass | 6621355 |
|
2022-01-16 11:19:38 | 2022-01-16 14:33:55 | 2022-01-16 14:58:37 | 0:24:42 | 0:12:29 | 0:12:13 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} | 2 |
| dead | 6621356 |
|
2022-01-16 11:19:39 | 2022-01-16 14:34:56 | 2022-01-16 15:04:53 | 0:29:57 | 0:18:55 | 0:11:02 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{legacy} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{no}} | 3 |
Failure Reason:
{'Failure object was': {'smithi049.front.sepia.ceph.com': {'msg': "Failed to download metadata for repo 'apache-arrow': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried", 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['gpg'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} |
||||||||||||||
| dead | 6621357 |
|
2022-01-16 11:19:40 | 2022-01-16 14:35:06 | 2022-01-16 15:00:41 | 0:25:35 | 0:19:02 | 0:06:33 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mon 2-workunit/suites/pjd}} | 2 |
Failure Reason:
{'Failure object was': {'smithi043.front.sepia.ceph.com': {'msg': "Failed to download metadata for repo 'apache-arrow': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried", 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['gpg'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} |
||||||||||||||
| pass | 6621358 |
|
2022-01-16 11:19:41 | 2022-01-16 14:35:27 | 2022-01-16 15:01:16 | 0:25:49 | 0:13:10 | 0:12:39 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{yes}} | 3 |
| dead | 6621359 |
|
2022-01-16 11:19:42 | 2022-01-16 14:36:17 | 2022-01-16 15:05:50 | 0:29:33 | 0:17:53 | 0:11:40 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/snaps}} | 2 |
Failure Reason:
{'Failure object was': {'smithi184.front.sepia.ceph.com': {'msg': "Failed to download metadata for repo 'apache-arrow': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried", 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['gpg'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} |
||||||||||||||
| dead | 6621360 |
|
2022-01-16 11:19:43 | 2022-01-16 14:36:38 | 2022-01-16 14:42:47 | 0:06:09 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/journal-repair} | 2 | ||
Failure Reason:
Error reimaging machines: Failed to power on smithi168 |
||||||||||||||
| fail | 6621361 |
|
2022-01-16 11:19:44 | 2022-01-16 14:38:19 | 2022-01-16 18:17:06 | 3:38:47 | 3:27:56 | 0:10:51 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} | 2 |
Failure Reason:
Command failed (workunit test suites/ffsb.sh) on smithi159 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e2ad5f90065f18c9489f9c62007d256a0f9bd97e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' |
||||||||||||||
| dead | 6621362 |
|
2022-01-16 11:19:45 | 2022-01-16 14:38:29 | 2022-01-16 15:06:42 | 0:28:13 | 0:19:19 | 0:08:54 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{no}} | 3 |
Failure Reason:
{'Failure object was': {'smithi059.front.sepia.ceph.com': {'msg': "Failed to download metadata for repo 'apache-arrow': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried", 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['gpg'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} |
||||||||||||||
| dead | 6621363 |
|
2022-01-16 11:19:47 | 2022-01-16 14:41:30 | 2022-01-16 15:09:19 | 0:27:49 | 0:20:19 | 0:07:30 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | rhel | 8.4 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} | 2 |
Failure Reason:
{'Failure object was': {'smithi172.front.sepia.ceph.com': {'msg': "Failed to download metadata for repo 'apache-arrow': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried", 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['gpg'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} |
||||||||||||||
| dead | 6621364 |
|
2022-01-16 11:19:48 | 2022-01-16 14:41:51 | 2022-01-16 15:09:29 | 0:27:38 | 0:16:35 | 0:11:03 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} ms_mode/{crc} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{no}} | 3 |
Failure Reason:
{'Failure object was': {'smithi067.front.sepia.ceph.com': {'msg': "Failed to download metadata for repo 'apache-arrow': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried", 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['gpg'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} |
||||||||||||||
| dead | 6621365 |
|
2022-01-16 11:19:49 | 2022-01-16 14:42:11 | 2022-01-16 15:12:23 | 0:30:12 | 0:18:53 | 0:11:19 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush} | 2 |
Failure Reason:
{'Failure object was': {'smithi097.front.sepia.ceph.com': {'msg': "Failed to download metadata for repo 'apache-arrow': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried", 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['gpg'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} |
||||||||||||||
| dead | 6621366 |
|
2022-01-16 11:19:50 | 2022-01-16 14:43:02 | 2022-01-16 15:16:01 | 0:32:59 | 0:20:00 | 0:12:59 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | centos | 8.3 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/iozone}} | 2 |
Failure Reason:
{'Failure object was': {'smithi120.front.sepia.ceph.com': {'msg': "Failed to download metadata for repo 'apache-arrow': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried", 'results': [], 'rc': 1, 'invocation': {'module_args': {'name': ['gpg'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'invocation')"} |
||||||||||||||
| dead | 6621367 |
|
2022-01-16 11:19:51 | 2022-01-16 14:44:32 | 2022-01-16 14:59:26 | 0:14:54 | 0:03:35 | 0:11:19 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} ms_mode/{secure} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{yes}} | 3 |
Failure Reason:
Failure object was: {'smithi162.front.sepia.ceph.com': {'cache_updated': False, 'stdout': '', 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6361 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'rc': 100, 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': True, 'force_apt_get': False, 'policy_rc_d': None, 'package': ['apt', 'apache2'], 'autoclean': False, 'install_recommends': None, 'name': ['apt', 'apache2'], 'purge': False, 'allow_unauthenticated': False, 'state': 'latest', 'upgrade': None, 'update_cache': None, 'default_release': None, 'only_upgrade': False, 'deb': None, 'cache_valid_time': 0}}, 'cache_update_time': 1642345029, 'msg': '\'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold" --force-yes install \'apache2\'\' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6361 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'stdout_lines': [], 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6361 (apt-get)', 'E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?'], '_ansible_no_log': False, 'changed': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f99b635b8fd843f9aee9fab01b0f8ac29b9e37b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'cache_update_time') |
||||||||||||||
| pass | 6621368 |
|
2022-01-16 11:19:52 | 2022-01-16 14:45:13 | 2022-01-16 15:13:27 | 0:28:14 | 0:16:40 | 0:11:34 | smithi | wip-khiremat-remove-old-kernel-failures-jan-13-1 | ubuntu | 20.04 | fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8.stream} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/mds 2-workunit/suites/pjd}} | 2 |
Pulpito