Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 7075616 2022-10-20 14:34:17 2022-10-20 23:26:45 2022-10-20 23:55:48 0:29:03 0:23:13 0:05:50 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi032 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b0ab0cbe-50d0-11ed-8437-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

fail 7075618 2022-10-20 14:34:18 2022-10-20 23:28:15 2022-10-20 23:57:20 0:29:05 0:15:56 0:13:09 smithi main centos 8.stream fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} 2
Failure Reason:

Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)

fail 7075620 2022-10-20 14:34:20 2022-10-20 23:36:47 2022-10-21 02:25:58 2:49:11 2:36:00 0:13:11 smithi main centos 8.stream fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/snaps}} 2
Failure Reason:

"2022-10-21T00:51:24.054109+0000 mds.f (mds.0) 29 : cluster [WRN] client.4870 isn't responding to mclientcaps(revoke), ino 0x1000000f36c pending pAsxLsXsxFscr issued pAsxLsXsxFsxcrwb, sent 304.986632 seconds ago" in cluster log

fail 7075622 2022-10-20 14:34:21 2022-10-20 23:41:39 2022-10-20 23:59:23 0:17:44 0:11:06 0:06:38 smithi main rhel 8.4 fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} 2
Failure Reason:

Test failure: test_clone_failure_status_failed (tasks.cephfs.test_volumes.TestSubvolumeSnapshotClones)

fail 7075624 2022-10-20 14:34:22 2022-10-20 23:45:20 2022-10-21 00:13:25 0:28:05 0:13:48 0:14:17 smithi main ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports} 2
Failure Reason:

Test failure: test_ephemeral_pin_dist_conf_off (tasks.cephfs.test_exports.TestEphemeralPins)

pass 7075626 2022-10-20 14:34:23 2022-10-20 23:55:52 2022-10-21 00:28:39 0:32:47 0:23:10 0:09:37 smithi main rhel 8.4 fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{no}} 3
pass 7075628 2022-10-20 14:34:24 2022-10-21 00:03:34 2022-10-21 00:39:28 0:35:54 0:22:35 0:13:19 smithi main centos 8.stream fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} 2
fail 7075630 2022-10-20 14:34:25 2022-10-21 00:10:55 2022-10-21 00:30:51 0:19:56 0:10:41 0:09:15 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} 2
Failure Reason:

Test failure: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub)

pass 7075632 2022-10-20 14:34:27 2022-10-21 00:21:07 2022-10-21 01:04:13 0:43:06 0:28:11 0:14:55 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}} 3
fail 7075634 2022-10-20 14:34:28 2022-10-21 00:31:00 2022-10-21 00:49:43 0:18:43 0:11:09 0:07:34 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment} 2
Failure Reason:

Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)

pass 7075636 2022-10-20 14:34:29 2022-10-21 00:32:40 2022-10-21 01:25:52 0:53:12 0:43:29 0:09:43 smithi main ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} 2
pass 7075638 2022-10-20 14:34:30 2022-10-21 00:38:22 2022-10-21 01:07:02 0:28:40 0:17:54 0:10:46 smithi main ubuntu 20.04 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
fail 7075640 2022-10-20 14:34:31 2022-10-21 00:49:54 2022-10-21 01:19:21 0:29:27 0:14:16 0:15:11 smithi main ubuntu 20.04 fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} 2
Failure Reason:

Test failure: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity)

pass 7075642 2022-10-20 14:34:33 2022-10-21 00:56:55 2022-10-21 01:26:09 0:29:14 0:13:48 0:15:26 smithi main ubuntu 20.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
pass 7075644 2022-10-20 14:34:34 2022-10-21 01:04:17 2022-10-21 02:07:43 1:03:26 0:53:59 0:09:27 smithi main ubuntu 20.04 fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
pass 7075646 2022-10-20 14:34:35 2022-10-21 01:07:08 2022-10-21 02:14:05 1:06:57 0:57:17 0:09:40 smithi main rhel 8.4 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} 2
pass 7075648 2022-10-20 14:34:36 2022-10-21 01:10:29 2022-10-21 03:15:46 2:05:17 1:52:30 0:12:47 smithi main ubuntu 20.04 fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind} 2
fail 7075650 2022-10-20 14:34:37 2022-10-21 01:19:31 2022-10-21 01:52:29 0:32:58 0:16:44 0:16:14 smithi main centos 8.stream fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair} 2
Failure Reason:

Test failure: test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair)

pass 7075652 2022-10-20 14:34:39 2022-10-21 01:22:02 2022-10-21 02:16:42 0:54:40 0:36:33 0:18:07 smithi main centos 8.stream fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/iogen} wsync/{no}} 3
pass 7075654 2022-10-20 14:34:40 2022-10-21 01:25:33 2022-10-21 02:47:20 1:21:47 1:10:47 0:11:00 smithi main ubuntu 20.04 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} 2
fail 7075656 2022-10-20 14:34:41 2022-10-21 01:26:04 2022-10-21 01:57:09 0:31:05 0:23:52 0:07:13 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi046 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5d68bd9c-50e1-11ed-8437-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

fail 7075658 2022-10-20 14:34:43 2022-10-21 01:26:15 2022-10-21 02:00:51 0:34:36 0:15:23 0:19:13 smithi main ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-flush} 2
Failure Reason:

Test failure: test_flush (tasks.cephfs.test_flush.TestFlush)

pass 7075661 2022-10-20 14:34:44 2022-10-21 01:44:38 2022-10-21 02:40:01 0:55:23 0:39:03 0:16:20 smithi main centos 8.stream fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
pass 7075662 2022-10-20 14:34:45 2022-10-21 01:46:49 2022-10-21 02:16:01 0:29:12 0:13:02 0:16:10 smithi main ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} 5
fail 7075664 2022-10-20 14:34:46 2022-10-21 01:54:01 2022-10-21 08:38:42 6:44:41 6:34:24 0:10:17 smithi main centos 8.stream fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} 2
Failure Reason:

Command failed (workunit test suites/fsstress.sh) on smithi063 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh'

fail 7075667 2022-10-20 14:34:47 2022-10-21 01:57:12 2022-10-21 02:18:28 0:21:16 0:10:34 0:10:42 smithi main centos 8.stream fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} 2
Failure Reason:

Test failure: test_barrier (tasks.cephfs.test_full.TestClusterFull)

fail 7075668 2022-10-20 14:34:49 2022-10-21 02:00:53 2022-10-21 02:34:10 0:33:17 0:16:59 0:16:18 smithi main centos 8.stream fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} 2
Failure Reason:

Test failure: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc)

pass 7075670 2022-10-20 14:34:50 2022-10-21 02:07:45 2022-10-21 02:40:34 0:32:49 0:23:28 0:09:21 smithi main centos 8.stream fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} 2
fail 7075673 2022-10-20 14:34:51 2022-10-21 02:11:36 2022-10-21 02:44:58 0:33:22 0:24:22 0:09:00 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi046 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 13b29cde-50e8-11ed-8437-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7075675 2022-10-20 14:34:52 2022-10-21 02:14:08 2022-10-21 02:45:44 0:31:36 0:18:20 0:13:16 smithi main ubuntu 20.04 fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{no}} 3
pass 7075677 2022-10-20 14:34:54 2022-10-21 02:16:09 2022-10-21 02:38:08 0:21:59 0:15:34 0:06:25 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds_creation_retry} 2
pass 7075679 2022-10-20 14:34:55 2022-10-21 02:18:10 2022-10-21 02:38:05 0:19:55 0:13:29 0:06:26 smithi main rhel 8.4 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} 2
fail 7075681 2022-10-20 14:34:56 2022-10-21 02:26:01 2022-10-21 03:00:13 0:34:12 0:16:13 0:17:59 smithi main centos 8.stream fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} 2
Failure Reason:

Test failure: test_client_metrics_and_metadata (tasks.cephfs.test_mds_metrics.TestMDSMetrics)

pass 7075682 2022-10-20 14:34:57 2022-10-21 02:31:13 2022-10-21 02:53:13 0:22:00 0:15:06 0:06:54 smithi main rhel 8.4 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 7075684 2022-10-20 14:34:59 2022-10-21 02:38:14 2022-10-21 02:55:06 0:16:52 0:11:20 0:05:32 smithi main centos 8.stream fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs_python} 2
pass 7075686 2022-10-20 14:35:00 2022-10-21 02:39:45 2022-10-21 03:03:35 0:23:50 0:13:37 0:10:13 smithi main ubuntu 20.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
fail 7075688 2022-10-20 14:35:01 2022-10-21 02:40:36 2022-10-21 03:06:42 0:26:06 0:14:28 0:11:38 smithi main ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/multimds_misc} 2
Failure Reason:

Test failure: test_apply_tag (tasks.cephfs.test_multimds_misc.TestScrub2)

pass 7075690 2022-10-20 14:35:03 2022-10-21 02:43:07 2022-10-21 03:12:19 0:29:12 0:20:21 0:08:51 smithi main centos 8.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
pass 7075692 2022-10-20 14:35:04 2022-10-21 02:45:48 2022-10-21 03:08:49 0:23:01 0:16:59 0:06:02 smithi main rhel 8.4 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} 2
pass 7075694 2022-10-20 14:35:05 2022-10-21 02:47:29 2022-10-21 03:14:01 0:26:32 0:13:59 0:12:33 smithi main ubuntu 20.04 fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/pjd} wsync/{no}} 3
fail 7075696 2022-10-20 14:35:06 2022-10-21 02:53:21 2022-10-21 03:14:41 0:21:20 0:09:07 0:12:13 smithi main ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/openfiletable} 2
Failure Reason:

Test failure: test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable)

pass 7075698 2022-10-20 14:35:07 2022-10-21 02:58:22 2022-10-21 03:36:22 0:38:00 0:27:34 0:10:26 smithi main centos 8.stream fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/iozone}} 2
fail 7075700 2022-10-20 14:35:09 2022-10-21 02:59:23 2022-10-21 03:17:42 0:18:19 0:10:27 0:07:52 smithi main centos 8.stream fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} 2
Failure Reason:

Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)

fail 7075702 2022-10-20 14:35:10 2022-10-21 03:00:04 2022-10-21 03:23:05 0:23:01 0:16:17 0:06:44 smithi main centos 8.stream fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
Failure Reason:

Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi085 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh'

pass 7075704 2022-10-20 14:35:11 2022-10-21 03:00:15 2022-10-21 03:26:50 0:26:35 0:16:26 0:10:09 smithi main rhel 8.4 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress traceless/50pc} 2
fail 7075706 2022-10-20 14:35:12 2022-10-21 03:06:46 2022-10-21 07:52:39 4:45:53 4:37:57 0:07:56 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} 2
Failure Reason:

reached maximum tries (60) after waiting for 600 seconds

fail 7075708 2022-10-20 14:35:14 2022-10-21 03:11:58 2022-10-21 10:10:09 6:58:11 6:51:38 0:06:33 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

reached maximum tries (60) after waiting for 600 seconds

dead 7075710 2022-10-20 14:35:15 2022-10-21 03:12:29 2022-10-21 15:21:46 12:09:17 smithi main rhel 8.4 fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/fsstress validater/lockdep} 2
Failure Reason:

hit max job timeout

dead 7075712 2022-10-20 14:35:16 2022-10-21 03:14:10 2022-10-21 15:22:46 12:08:36 smithi main centos 8.stream fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} 2
Failure Reason:

hit max job timeout

dead 7075714 2022-10-20 14:35:17 2022-10-21 03:15:51 2022-10-21 15:25:21 12:09:30 smithi main ubuntu 20.04 fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} 2
Failure Reason:

hit max job timeout

dead 7075716 2022-10-20 14:35:19 2022-10-21 03:17:52 2022-10-21 15:26:40 12:08:48 smithi main ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} 4
Failure Reason:

hit max job timeout

dead 7075718 2022-10-20 14:35:20 2022-10-21 03:17:52 2022-10-21 15:29:43 12:11:51 smithi main centos 8.stream fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} 2
Failure Reason:

hit max job timeout

dead 7075720 2022-10-20 14:35:21 2022-10-21 03:21:54 2022-10-21 15:34:46 12:12:52 smithi main rhel 8.4 fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/direct_io} wsync/{yes}} 3
Failure Reason:

hit max job timeout

dead 7075722 2022-10-20 14:35:23 2022-10-21 03:35:16 2022-10-21 15:43:53 12:08:37 smithi main ubuntu 20.04 fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} 2
Failure Reason:

hit max job timeout

dead 7075724 2022-10-20 14:35:24 2022-10-21 03:36:27 2022-10-21 15:51:59 12:15:32 smithi main ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/pjd}} 2
Failure Reason:

hit max job timeout

dead 7075726 2022-10-20 14:35:25 2022-10-21 03:43:38 2022-10-21 15:59:39 12:16:01 smithi main ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/recovery-fs} 2
Failure Reason:

hit max job timeout

dead 7075729 2022-10-20 14:35:27 2022-10-21 16:28:11 smithi main rhel 8.4 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
Failure Reason:

hit max job timeout

dead 7075730 2022-10-20 14:35:28 2022-10-21 04:20:24 2022-10-21 16:30:28 12:10:04 smithi main centos 8.stream fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
Failure Reason:

hit max job timeout

dead 7075732 2022-10-20 14:35:29 2022-10-21 04:35:07 2022-10-21 16:47:28 12:12:21 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}} 3
Failure Reason:

hit max job timeout

dead 7075734 2022-10-20 14:35:30 2022-10-21 04:58:41 2022-10-21 17:08:06 12:09:25 smithi main ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} 2
Failure Reason:

hit max job timeout

dead 7075736 2022-10-20 14:35:31 2022-10-21 04:59:12 2022-10-21 17:11:48 12:12:36 smithi main ubuntu 20.04 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/ffsb}} 2
Failure Reason:

hit max job timeout

dead 7075738 2022-10-20 14:35:33 2022-10-21 05:27:16 2022-10-21 18:06:25 12:39:09 smithi main centos 8.stream fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} 3
Failure Reason:

hit max job timeout

fail 7075741 2022-10-20 14:35:34 2022-10-21 07:52:46 2022-10-21 20:44:44 12:51:58 11:58:28 0:53:30 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/sessionmap} 2
Failure Reason:

Test failure: test_mount_conn_close (tasks.cephfs.test_sessionmap.TestSessionMap)

pass 7075743 2022-10-20 14:35:35 2022-10-21 10:58:17 2022-10-21 22:14:25 11:16:08 11:07:12 0:08:56 smithi main ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} 2
fail 7075745 2022-10-20 14:35:37 2022-10-21 12:30:20 2022-10-21 20:54:59 8:24:39 5:58:21 2:26:18 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi093 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 620edfc6-5180-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

fail 7075747 2022-10-20 14:35:38 2022-10-21 15:19:43 2022-10-21 20:45:47 5:26:04 5:12:58 0:13:06 smithi main centos 8.stream fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} 2
Failure Reason:

Test failure: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules)

pass 7075749 2022-10-20 14:35:39 2022-10-21 15:22:24 2022-10-21 20:48:33 5:26:09 5:19:55 0:06:14 smithi main rhel 8.4 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/iozone}} 2
fail 7075751 2022-10-20 14:35:40 2022-10-21 15:23:55 2022-10-21 20:46:13 5:22:18 5:11:22 0:10:56 smithi main ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} 2
Failure Reason:

Test failure: test_allow_new_snaps_config (tasks.cephfs.test_snapshots.TestSnapshots)

pass 7075753 2022-10-20 14:35:42 2022-10-21 15:24:36 2022-10-21 21:12:20 5:47:44 5:37:14 0:10:30 smithi main ubuntu 20.04 fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/kernel_untar_build} wsync/{no}} 3
pass 7075755 2022-10-20 14:35:43 2022-10-21 15:24:46 2022-10-21 20:56:04 5:31:18 5:25:00 0:06:18 smithi main rhel 8.4 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} 2
fail 7075757 2022-10-20 14:35:44 2022-10-21 15:24:47 2022-10-21 20:42:23 5:17:36 5:11:48 0:05:48 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/strays} 2
Failure Reason:

Test failure: test_dir_deletion (tasks.cephfs.test_strays.TestStrays)

pass 7075759 2022-10-20 14:35:45 2022-10-21 15:24:58 2022-10-21 20:48:26 5:23:28 5:17:10 0:06:18 smithi main rhel 8.4 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
pass 7075761 2022-10-20 14:35:46 2022-10-21 15:24:59 2022-10-21 20:40:12 5:15:13 5:09:26 0:05:47 smithi main centos 8.stream fs/bugs/client_trim_caps/{begin centos_latest clusters/small-cluster conf/{client mds mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/trim-i24137} 1
fail 7075763 2022-10-20 14:35:48 2022-10-21 15:24:59 2022-10-21 20:45:10 5:20:11 5:13:02 0:07:09 smithi main centos 8.stream fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench distro/centos_latest} 2
Failure Reason:

Command failed on smithi171 with status 5: 'sudo systemctl stop ceph-912bd64c-5180-11ed-8438-001a4aab830c@mon.smithi171'

pass 7075765 2022-10-20 14:35:49 2022-10-21 15:25:10 2022-10-21 20:46:36 5:21:26 5:15:36 0:05:50 smithi main centos 8.stream fs/full/{begin clusters/1-node-1-mds-1-osd conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mgr-osd-full} 1
pass 7075767 2022-10-20 14:35:50 2022-10-21 15:25:10 2022-10-21 20:43:41 5:18:31 5:09:43 0:08:48 smithi main centos 8.stream fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{centos_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client} 2
fail 7075769 2022-10-20 14:35:51 2022-10-21 15:28:32 2022-10-21 20:37:03 5:08:31 4:58:05 0:10:26 smithi main ubuntu 20.04 fs/mirror/{begin cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distros$/{ubuntu_latest} tasks/mirror} 1
Failure Reason:

Test failure: test_add_ancestor_and_child_directory (tasks.cephfs.test_mirroring.TestMirroring)

pass 7075771 2022-10-20 14:35:53 2022-10-21 15:32:43 2022-10-21 23:06:40 7:33:57 7:23:14 0:10:43 smithi main ubuntu 20.04 fs/mirror-ha/{begin cephfs-mirror/three-per-cluster clients/{mirror} cluster/{1-node} objectstore/bluestore-bitmap overrides/{whitelist_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} 1
pass 7075773 2022-10-20 14:35:54 2022-10-21 15:41:14 2022-10-21 21:05:07 5:23:53 5:16:55 0:06:58 smithi main rhel 8.4 fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
fail 7075775 2022-10-20 14:35:55 2022-10-21 15:42:45 2022-10-21 20:45:14 5:02:29 4:37:26 0:25:03 smithi main ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} 5
Failure Reason:

Test failure: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop)

fail 7075777 2022-10-20 14:35:56 2022-10-21 15:57:48 2022-10-21 20:43:48 4:46:00 4:07:24 0:38:36 smithi main ubuntu 20.04 fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} 2
Failure Reason:

Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)

pass 7075779 2022-10-20 14:35:57 2022-10-21 16:26:12 2022-10-21 20:46:03 4:19:51 4:08:27 0:11:24 smithi main ubuntu 20.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
fail 7075781 2022-10-20 14:35:59 2022-10-21 16:41:35 2022-10-21 20:43:03 4:01:28 3:46:46 0:14:42 smithi main ubuntu 20.04 fs/shell/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cephfs-shell} 2
Failure Reason:

Test failure: test_cd_with_args (tasks.cephfs.test_cephfs_shell.TestCD)

pass 7075783 2022-10-20 14:36:00 2022-10-21 16:45:36 2022-10-21 21:12:28 4:26:52 4:01:01 0:25:51 smithi main centos 8.stream fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
fail 7075785 2022-10-20 14:36:01 2022-10-21 17:06:10 2022-10-21 20:38:25 3:32:15 3:23:32 0:08:43 smithi main centos 8.stream fs/top/{begin cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/ignorelist_health supported-random-distros$/{centos_8} tasks/fstop} 1
Failure Reason:

Test failure: test_fstop (tasks.cephfs.test_fstop.TestFSTop)

fail 7075787 2022-10-20 14:36:02 2022-10-21 17:06:40 2022-10-21 20:54:53 3:48:13 3:36:04 0:12:09 smithi main ubuntu 20.04 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_blogbench traceless/50pc} 2
Failure Reason:

"2022-10-21T20:41:24.541348+0000 mon.a (mon.0) 177 : cluster [WRN] Health check failed: Degraded data redundancy: 3/44 objects degraded (6.818%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 7075789 2022-10-20 14:36:03 2022-10-21 17:33:04 2022-10-21 21:01:33 3:28:29 2:50:33 0:37:56 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}} 3
fail 7075791 2022-10-20 14:36:05 2022-10-21 18:04:29 2022-10-21 20:54:53 2:50:24 2:44:43 0:05:41 smithi main centos 8.stream fs/valgrind/{begin centos_latest debug mirror/{cephfs-mirror/one-per-cluster clients/mirror cluster/1-node mount/fuse overrides/whitelist_health tasks/mirror}} 1
Failure Reason:

Test failure: test_add_ancestor_and_child_directory (tasks.cephfs.test_mirroring.TestMirroring)

fail 7075793 2022-10-20 14:36:06 2022-10-21 19:58:54 2022-10-21 20:54:00 0:55:06 0:09:08 0:45:58 smithi main ubuntu 20.04 fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volume-client} 2
Failure Reason:

Test failure: test_15303 (tasks.cephfs.test_volume_client.TestVolumeClient)

pass 7075795 2022-10-20 14:36:07 2022-10-21 20:36:15 2022-10-21 22:32:58 1:56:43 1:49:22 0:07:21 smithi main centos 8.stream fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} 2
fail 7075797 2022-10-20 14:36:08 2022-10-21 20:38:36 2022-10-21 21:01:42 0:23:06 0:11:34 0:11:32 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/test_journal_migration} 2
Failure Reason:

Test failure: test_journal_migration (tasks.cephfs.test_journal_migration.TestJournalMigration)

pass 7075799 2022-10-20 14:36:09 2022-10-21 20:42:27 2022-10-21 21:44:19 1:01:52 0:54:51 0:07:01 smithi main rhel 8.4 fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} 2
fail 7075801 2022-10-20 14:36:11 2022-10-21 20:43:58 2022-10-21 21:28:33 0:44:35 0:35:22 0:09:13 smithi main rhel 8.4 fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/blogbench} wsync/{yes}} 3
Failure Reason:

Command failed on smithi063 with status 1: 'sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp'

pass 7075803 2022-10-20 14:36:12 2022-10-21 20:45:19 2022-10-21 21:14:33 0:29:14 0:18:12 0:11:02 smithi main centos 8.stream fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay} 2
pass 7075805 2022-10-20 14:36:13 2022-10-21 20:45:19 2022-10-21 21:40:39 0:55:20 0:44:53 0:10:27 smithi main centos 8.stream fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} 2
fail 7075807 2022-10-20 14:36:14 2022-10-21 20:46:10 2022-10-21 21:17:37 0:31:27 0:24:11 0:07:16 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi111 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8977ca66-5183-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7075809 2022-10-20 14:36:15 2022-10-21 20:46:31 2022-10-21 21:17:40 0:31:09 0:18:11 0:12:58 smithi main ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/dir-max-entries} 2
pass 7075811 2022-10-20 14:36:17 2022-10-21 20:48:22 2022-10-21 21:13:53 0:25:31 0:19:29 0:06:02 smithi main rhel 8.4 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_fsstress}} 2
pass 7075813 2022-10-20 14:36:18 2022-10-21 20:48:33 2022-10-21 21:09:44 0:21:11 0:14:04 0:07:07 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} 2
pass 7075815 2022-10-20 14:36:19 2022-10-21 20:49:04 2022-10-21 22:17:21 1:28:17 1:20:53 0:07:24 smithi main rhel 8.4 fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/suites/dbench} wsync/{no}} 3
pass 7075817 2022-10-20 14:36:20 2022-10-21 20:49:55 2022-10-21 21:19:12 0:29:17 0:15:29 0:13:48 smithi main ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/trivial_sync}} 2
pass 7075819 2022-10-20 14:36:21 2022-10-21 20:52:36 2022-10-21 21:12:12 0:19:36 0:11:29 0:08:07 smithi main centos 8.stream fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-octopus 1-upgrade}} 1
fail 7075821 2022-10-20 14:36:23 2022-10-21 20:53:37 2022-10-21 21:12:48 0:19:11 0:11:45 0:07:26 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} 2
Failure Reason:

Test failure: test_acls (tasks.cephfs.test_acls.TestACLs)

pass 7075823 2022-10-20 14:36:24 2022-10-21 20:54:08 2022-10-21 21:17:41 0:23:33 0:14:22 0:09:11 smithi main ubuntu 20.04 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 7075825 2022-10-20 14:36:25 2022-10-21 20:54:19 2022-10-21 21:18:46 0:24:27 0:16:07 0:08:20 smithi main rhel 8.4 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 7075827 2022-10-20 14:36:26 2022-10-21 20:55:00 2022-10-21 21:28:00 0:33:00 0:23:22 0:09:38 smithi main centos 8.stream fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} 2
fail 7075829 2022-10-20 14:36:27 2022-10-21 20:55:01 2022-10-21 21:21:20 0:26:19 0:16:41 0:09:38 smithi main centos 8.stream fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/admin} 2
Failure Reason:

Test failure: test_dump_subtrees (tasks.cephfs.test_admin.TestAdminCommandDumpTree)

fail 7075831 2022-10-20 14:36:29 2022-10-21 20:56:12 2022-10-21 21:16:25 0:20:13 0:11:30 0:08:43 smithi main rhel 8.4 fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} 2
Failure Reason:

Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)

pass 7075833 2022-10-20 14:36:30 2022-10-21 21:00:04 2022-10-21 23:08:45 2:08:41 1:56:48 0:11:53 smithi main centos 8.stream fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} 2
pass 7075835 2022-10-20 14:36:31 2022-10-21 21:01:35 2022-10-21 21:25:18 0:23:43 0:11:11 0:12:32 smithi main ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/ior-shared-file} 4
pass 7075837 2022-10-20 14:36:32 2022-10-21 21:03:57 2022-10-21 21:29:51 0:25:54 0:18:58 0:06:56 smithi main centos 8.stream fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}} 2
pass 7075839 2022-10-20 14:36:33 2022-10-21 21:04:58 2022-10-21 22:14:28 1:09:30 0:59:22 0:10:08 smithi main centos 8.stream fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/ffsb} wsync/{yes}} 3
fail 7075841 2022-10-20 14:36:35 2022-10-21 21:05:18 2022-10-21 21:36:02 0:30:44 0:14:35 0:16:09 smithi main ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} 2
Failure Reason:

Test failure: test_rebuild_simple (tasks.cephfs.test_recovery_pool.TestRecoveryPool)

fail 7075843 2022-10-20 14:36:36 2022-10-21 21:09:10 2022-10-21 21:28:26 0:19:16 0:11:53 0:07:23 smithi main centos 8.stream fs/upgrade/upgraded_client/from_nautilus/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-nautilus 1-client-upgrade 2-client-sanity}} 2
Failure Reason:

Test failure: test_newops_getvxattr (tasks.cephfs.test_newops.TestNewOps)

fail 7075845 2022-10-20 14:36:37 2022-10-21 21:09:21 2022-10-21 21:28:37 0:19:16 0:11:58 0:07:18 smithi main rhel 8.4 fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} 2
Failure Reason:

Test failure: test_join_fs_drop (tasks.cephfs.test_failover.TestClusterAffinity)

pass 7075847 2022-10-20 14:36:38 2022-10-21 21:09:51 2022-10-21 22:16:43 1:06:52 1:01:19 0:05:33 smithi main rhel 8.4 fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
pass 7075849 2022-10-20 14:36:40 2022-10-21 21:10:33 2022-10-21 22:17:57 1:07:24 1:01:33 0:05:51 smithi main rhel 8.4 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_dbench traceless/50pc} 2
fail 7075851 2022-10-20 14:36:41 2022-10-21 21:11:34 2022-10-21 21:29:23 0:17:49 0:10:44 0:07:05 smithi main centos 8.stream fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree} 2
Failure Reason:

Test failure: test_basic (tasks.cephfs.test_dump_tree.TestDumpTree)

fail 7075853 2022-10-20 14:36:42 2022-10-21 21:12:25 2022-10-21 21:42:01 0:29:36 0:18:51 0:10:45 smithi main ubuntu 20.04 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} 2
Failure Reason:

Command failed on smithi154 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev'

dead 7075855 2022-10-20 14:36:43 2022-10-21 21:12:36 2022-10-21 21:35:55 0:23:19 0:10:55 0:12:24 smithi main centos 8.stream fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/fsstress validater/lockdep} 2
Failure Reason:

{'smithi110.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'ceph/python3-asyncssh', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': ['dnf', '-y', 'copr', 'enable', 'ceph/python3-asyncssh'], 'delta': '0:00:15.346051', 'end': '2022-10-21 21:31:10.601574', 'failed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y copr enable ceph/python3-asyncssh', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': 'ceph/python3-asyncssh', 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-10-21 21:30:55.255523', 'stderr': 'Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.\nError: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known', 'stderr_lines': ['Enabling a Copr repository. Please note that this repository is not part', 'of the main distribution, and quality may vary.', '', 'The Fedora Project does not exercise any power over the contents of', 'this repository beyond the rules outlined in the Copr FAQ at', '<https://docs.pagure.org/copr.copr/user_documentation.html#what-i-can-build-in-copr>,', 'and packages are not held to any quality or security level.', '', 'Please do not file bug reports about these packages in Fedora', 'Bugzilla. In case of problems, contact the owner of this repository.', 'Error: Failed to connect to https://copr.fedorainfracloud.org/coprs/ceph/python3-asyncssh/repo/epel-8/dnf.repo?arch=x86_64: Name or service not known'], 'stdout': '', 'stdout_lines': []}], 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]}, 'smithi175.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'cmd': ['/bin/pip3', 'install', '-U', 'git+https://github.com/sebastian-philipp/registries-conf-ctl'], 'invocation': {'module_args': {'chdir': None, 'editable': False, 'executable': 'pip3', 'extra_args': None, 'name': ['git+https://github.com/sebastian-philipp/registries-conf-ctl'], 'requirements': None, 'state': 'latest', 'umask': None, 'version': None, 'virtualenv': None, 'virtualenv_command': 'virtualenv', 'virtualenv_python': None, 'virtualenv_site_packages': False}}, 'msg': 'stdout: Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-_8z5oo5m-build\nfatal: unable to access \'https://github.com/sebastian-philipp/registries-conf-ctl/\': Could not resolve host: github.com\n\n:stderr: WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\nCommand "git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-_8z5oo5m-build" failed with error code 128 in None\n'}}

fail 7075857 2022-10-20 14:36:45 2022-10-21 21:13:57 2022-10-21 21:35:43 0:21:46 0:13:26 0:08:20 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} 2
Failure Reason:

Test failure: test_backtrace_repair (tasks.cephfs.test_auto_repair.TestMDSAutoRepair)

fail 7075859 2022-10-20 14:36:46 2022-10-21 21:14:47 2022-10-21 22:28:22 1:13:35 1:05:57 0:07:38 smithi main ubuntu 18.04 fs/upgrade/volumes/import-legacy/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} 2
Failure Reason:

HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f8c9905cba8>: Failed to establish a new connection: [Errno 113] No route to host',))

fail 7075861 2022-10-20 14:36:47 2022-10-21 21:15:08 2022-10-21 21:38:34 0:23:26 0:15:25 0:08:01 smithi main rhel 8.4 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/pjd}} 2
Failure Reason:

Command failed on smithi006 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a'

dead 7075863 2022-10-20 14:36:48 2022-10-21 21:15:49 2022-10-21 21:37:41 0:21:52 0:08:03 0:13:49 smithi main ubuntu 20.04 fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/fs/norstats} wsync/{no}} 3
Failure Reason:

{'smithi045.front.sepia.ceph.com': {'_ansible_no_log': False, 'cache_update_time': 1666387794, 'cache_updated': False, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': True, 'force_apt_get': False, 'install_recommends': None, 'name': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-venv', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'python-dev', 'libfcgi0ldbl', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common', 'libgnutls30'], 'only_upgrade': False, 'package': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-venv', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'python-dev', 'libfcgi0ldbl', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common', 'libgnutls30'], 'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache': None, 'update_cache_retries': 5, 'update_cache_retry_max_delay': 12, 'upgrade': None}}, 'msg': '\'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold" --force-yes install \'qemu-system-x86\' \'git-core\'\' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/g/git/git_2.25.1-1ubuntu3.6_amd64.deb Could not connect to archive.ubuntu.com:80 (91.189.91.38). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (185.125.190.39). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (185.125.190.36). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (91.189.91.39). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (2620:2d:4000:1::19), connection timed out Could not connect to archive.ubuntu.com:80 (2620:2d:4000:1::16), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1562::18), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1562::15), connection timed out\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librados2_15.2.16-0ubuntu0.20.04.1_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librbd1_15.2.16-0ubuntu0.20.04.1_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-block-extra_4.2-3ubuntu6.23_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-common_4.2-3ubuntu6.23_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-x86_4.2-3ubuntu6.23_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-utils_4.2-3ubuntu6.23_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n', 'rc': 100, 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/g/git/git_2.25.1-1ubuntu3.6_amd64.deb Could not connect to archive.ubuntu.com:80 (91.189.91.38). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (185.125.190.39). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (185.125.190.36). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (91.189.91.39). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (2620:2d:4000:1::19), connection timed out Could not connect to archive.ubuntu.com:80 (2620:2d:4000:1::16), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1562::18), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1562::15), connection timed out\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librados2_15.2.16-0ubuntu0.20.04.1_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librbd1_15.2.16-0ubuntu0.20.04.1_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-block-extra_4.2-3ubuntu6.23_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-common_4.2-3ubuntu6.23_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-x86_4.2-3ubuntu6.23_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-utils_4.2-3ubuntu6.23_amd64.deb Unable to connect to archive.ubuntu.com:http:\nE: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?\n', 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/g/git/git_2.25.1-1ubuntu3.6_amd64.deb Could not connect to archive.ubuntu.com:80 (91.189.91.38). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (185.125.190.39). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (185.125.190.36). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (91.189.91.39). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (2620:2d:4000:1::19), connection timed out Could not connect to archive.ubuntu.com:80 (2620:2d:4000:1::16), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1562::18), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1562::15), connection timed out', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librados2_15.2.16-0ubuntu0.20.04.1_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://archive.ubuntu.com/ubuntu/pool/main/c/ceph/librbd1_15.2.16-0ubuntu0.20.04.1_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-block-extra_4.2-3ubuntu6.23_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-common_4.2-3ubuntu6.23_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-system-x86_4.2-3ubuntu6.23_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Failed to fetch http://security.ubuntu.com/ubuntu/pool/main/q/qemu/qemu-utils_4.2-3ubuntu6.23_amd64.deb Unable to connect to archive.ubuntu.com:http:', 'E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?'], 'stdout': 'Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 13 not upgraded.\nNeed to get 18.2 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nIgn:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.6\nErr:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.16-0ubuntu0.20.04.1\n Unable to connect to archive.ubuntu.com:http:\nErr:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.16-0ubuntu0.20.04.1\n Unable to connect to archive.ubuntu.com:http:\nIgn:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.23\nIgn:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.23\nIgn:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.23\nIgn:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.23\nErr:1 http://security.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.6\n Could not connect to archive.ubuntu.com:80 (91.189.91.38). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (185.125.190.39). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (185.125.190.36). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (91.189.91.39). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (2620:2d:4000:1::19), connection timed out Could not connect to archive.ubuntu.com:80 (2620:2d:4000:1::16), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1562::18), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1562::15), connection timed out\nErr:4 http://security.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.23\n Unable to connect to archive.ubuntu.com:http:\nErr:5 http://security.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.23\n Unable to connect to archive.ubuntu.com:http:\nErr:6 http://security.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.23\n Unable to connect to archive.ubuntu.com:http:\nErr:7 http://security.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.23\n Unable to connect to archive.ubuntu.com:http:\n', 'stdout_lines': ['Reading package lists...', 'Building dependency tree...', 'Reading state information...', 'The following additional packages will be installed:', ' librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils', 'Suggested packages:', ' git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk', ' gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap', 'The following NEW packages will be installed:', ' librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86', ' qemu-utils', 'The following packages will be upgraded:', ' git', '1 upgraded, 6 newly installed, 0 to remove and 13 not upgraded.', 'Need to get 18.2 MB of archives.', 'After this operation, 62.7 MB of additional disk space will be used.', 'Ign:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.6', 'Err:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.16-0ubuntu0.20.04.1', ' Unable to connect to archive.ubuntu.com:http:', 'Err:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.16-0ubuntu0.20.04.1', ' Unable to connect to archive.ubuntu.com:http:', 'Ign:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.23', 'Ign:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.23', 'Ign:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.23', 'Ign:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.23', 'Err:1 http://security.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.6', ' Could not connect to archive.ubuntu.com:80 (91.189.91.38). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (185.125.190.39). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (185.125.190.36). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (91.189.91.39). - connect (113: No route to host) Could not connect to archive.ubuntu.com:80 (2620:2d:4000:1::19), connection timed out Could not connect to archive.ubuntu.com:80 (2620:2d:4000:1::16), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1562::18), connection timed out Could not connect to archive.ubuntu.com:80 (2001:67c:1562::15), connection timed out', 'Err:4 http://security.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.23', ' Unable to connect to archive.ubuntu.com:http:', 'Err:5 http://security.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.23', ' Unable to connect to archive.ubuntu.com:http:', 'Err:6 http://security.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.23', ' Unable to connect to archive.ubuntu.com:http:', 'Err:7 http://security.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.23', ' Unable to connect to archive.ubuntu.com:http:']}, 'smithi137.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'cmd': ['/usr/bin/pip3', 'install', '-U', 'git+https://github.com/sebastian-philipp/registries-conf-ctl'], 'invocation': {'module_args': {'chdir': None, 'editable': False, 'executable': 'pip3', 'extra_args': None, 'name': ['git+https://github.com/sebastian-philipp/registries-conf-ctl'], 'requirements': None, 'state': 'latest', 'umask': None, 'version': None, 'virtualenv': None, 'virtualenv_command': 'virtualenv', 'virtualenv_python': None, 'virtualenv_site_packages': False}}, 'msg': "stdout: Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-jb9nktur\n\n:stderr: Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-jb9nktur\n fatal: unable to access 'https://github.com/sebastian-philipp/registries-conf-ctl/': Could not resolve host: github.com\nERROR: Command errored out with exit status 128: git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-jb9nktur Check the logs for full command output.\n"}, 'smithi057.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'cmd': ['/usr/bin/pip3', 'install', '-U', 'git+https://github.com/sebastian-philipp/registries-conf-ctl'], 'invocation': {'module_args': {'chdir': None, 'editable': False, 'executable': 'pip3', 'extra_args': None, 'name': ['git+https://github.com/sebastian-philipp/registries-conf-ctl'], 'requirements': None, 'state': 'latest', 'umask': None, 'version': None, 'virtualenv': None, 'virtualenv_command': 'virtualenv', 'virtualenv_python': None, 'virtualenv_site_packages': False}}, 'msg': "stdout: Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-d156ofl8\n\n:stderr: Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-d156ofl8\n fatal: unable to access 'https://github.com/sebastian-philipp/registries-conf-ctl/': Could not resolve host: github.com\nERROR: Command errored out with exit status 128: git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-d156ofl8 Check the logs for full command output.\n"}}

fail 7075865 2022-10-20 14:36:49 2022-10-21 21:17:41 2022-10-21 21:36:53 0:19:12 0:10:17 0:08:55 smithi main centos 8.stream fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_fsstress} 2
Failure Reason:

HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7ffb576c0b38>: Failed to establish a new connection: [Errno 113] No route to host',))

fail 7075867 2022-10-20 14:36:51 2022-10-21 21:17:41 2022-10-21 21:32:34 0:14:53 0:08:00 0:06:53 smithi main rhel 8.4 fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{rhel_8} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/ino_release_cb} 2
Failure Reason:

Command failed on smithi044 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'

dead 7075869 2022-10-20 14:36:52 2022-10-21 21:17:52 2022-10-21 21:37:20 0:19:28 0:03:45 0:15:43 smithi main ubuntu 20.04 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} 2
Failure Reason:

{'smithi083.front.sepia.ceph.com': {'_ansible_delegated_vars': {'ansible_connection': 'local', 'ansible_host': 'localhost', 'ansible_port': None, 'ansible_user': 'cm'}, '_ansible_no_log': False, 'attempts': 5, 'changed': False, 'cmd': ['/usr/bin/git', 'fetch', '--tags', '--force', 'origin'], 'invocation': {'module_args': {'accept_hostkey': False, 'archive': None, 'archive_prefix': None, 'bare': False, 'clone': True, 'depth': None, 'dest': '/home/teuthworker/.cache/src/keys', 'executable': None, 'force': True, 'gpg_whitelist': [], 'key_file': None, 'recursive': True, 'reference': None, 'refspec': None, 'remote': 'origin', 'repo': 'https://github.com/ceph/keys', 'separate_git_dir': None, 'ssh_opts': None, 'track_submodules': False, 'umask': None, 'update': True, 'verify_commit': False, 'version': 'main'}}, 'msg': "Failed to download remote objects and refs: fatal: unable to access 'https://github.com/ceph/keys/': Could not resolve host: github.com\n"}, 'smithi049.front.sepia.ceph.com': {'_ansible_delegated_vars': {'ansible_connection': 'local', 'ansible_host': 'localhost', 'ansible_port': None, 'ansible_user': 'cm'}, '_ansible_no_log': False, 'attempts': 5, 'changed': False, 'cmd': ['/usr/bin/git', 'fetch', '--tags', '--force', 'origin'], 'invocation': {'module_args': {'accept_hostkey': False, 'archive': None, 'archive_prefix': None, 'bare': False, 'clone': True, 'depth': None, 'dest': '/home/teuthworker/.cache/src/keys', 'executable': None, 'force': True, 'gpg_whitelist': [], 'key_file': None, 'recursive': True, 'reference': None, 'refspec': None, 'remote': 'origin', 'repo': 'https://github.com/ceph/keys', 'separate_git_dir': None, 'ssh_opts': None, 'track_submodules': False, 'umask': None, 'update': True, 'verify_commit': False, 'version': 'main'}}, 'msg': "Failed to download remote objects and refs: fatal: unable to access 'https://github.com/ceph/keys/': Could not resolve host: github.com\n"}}

dead 7075871 2022-10-20 14:36:53 2022-10-21 21:19:13 2022-10-21 21:41:19 0:22:06 0:08:01 0:14:05 smithi main centos 8.stream fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/backtrace} 2
Failure Reason:

{'smithi203.front.sepia.ceph.com': {'_ansible_delegated_vars': {'ansible_connection': 'local', 'ansible_host': 'localhost', 'ansible_port': None, 'ansible_user': 'cm'}, '_ansible_no_log': False, 'attempts': 5, 'changed': False, 'cmd': ['/usr/bin/git', 'fetch', '--tags', '--force', 'origin'], 'invocation': {'module_args': {'accept_hostkey': False, 'archive': None, 'archive_prefix': None, 'bare': False, 'clone': True, 'depth': None, 'dest': '/home/teuthworker/.cache/src/keys', 'executable': None, 'force': True, 'gpg_whitelist': [], 'key_file': None, 'recursive': True, 'reference': None, 'refspec': None, 'remote': 'origin', 'repo': 'https://github.com/ceph/keys', 'separate_git_dir': None, 'ssh_opts': None, 'track_submodules': False, 'umask': None, 'update': True, 'verify_commit': False, 'version': 'main'}}, 'msg': "Failed to download remote objects and refs: fatal: unable to access 'https://github.com/ceph/keys/': Could not resolve host: github.com\n"}, 'smithi088.front.sepia.ceph.com': {'_ansible_delegated_vars': {'ansible_connection': 'local', 'ansible_host': 'localhost', 'ansible_port': None, 'ansible_user': 'cm'}, '_ansible_no_log': False, 'attempts': 5, 'changed': False, 'cmd': ['/usr/bin/git', 'fetch', '--tags', '--force', 'origin'], 'invocation': {'module_args': {'accept_hostkey': False, 'archive': None, 'archive_prefix': None, 'bare': False, 'clone': True, 'depth': None, 'dest': '/home/teuthworker/.cache/src/keys', 'executable': None, 'force': True, 'gpg_whitelist': [], 'key_file': None, 'recursive': True, 'reference': None, 'refspec': None, 'remote': 'origin', 'repo': 'https://github.com/ceph/keys', 'separate_git_dir': None, 'ssh_opts': None, 'track_submodules': False, 'umask': None, 'update': True, 'verify_commit': False, 'version': 'main'}}, 'msg': "Failed to download remote objects and refs: fatal: unable to access 'https://github.com/ceph/keys/': Could not resolve host: github.com\n"}}

dead 7075873 2022-10-20 14:36:54 2022-10-21 21:21:25 2022-10-21 21:40:53 0:19:28 0:13:26 0:06:02 smithi main rhel 8.4 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/ffsb}} 2
Failure Reason:

{'smithi085.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}, 'smithi017.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'comment': None, 'exclusive': False, 'follow': False, 'key': 'https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub', 'key_options': None, 'manage_dir': True, 'path': None, 'state': 'present', 'user': 'ubuntu', 'validate_certs': True}}, 'msg': 'Error getting key from: https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub'}}

fail 7075875 2022-10-20 14:36:55 2022-10-21 21:25:16 2022-10-21 21:35:16 0:10:00 smithi main ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/cap-flush} 2
Failure Reason:

HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri2-testing-2022-10-19-1252-pacific (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f610394fdd8>: Failed to establish a new connection: [Errno 113] No route to host',))

fail 7075877 2022-10-20 14:36:56 2022-10-21 21:25:27 2022-10-21 21:40:31 0:15:04 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi188 with status 1: 'sudo yum install -y kernel'

fail 7075879 2022-10-20 14:36:58 2022-10-21 21:28:09 2022-10-21 21:37:20 0:09:11 smithi main centos 8.stream fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} 2
Failure Reason:

HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2022-10-19-1252-pacific (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f310fb9ce80>: Failed to establish a new connection: [Errno 113] No route to host',))

fail 7075881 2022-10-20 14:36:59 2022-10-21 21:28:40 2022-10-21 21:40:09 0:11:29 smithi main centos 8.stream fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/clone}} 2
Failure Reason:

HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2022-10-19-1252-pacific (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7efd29a96e80>: Failed to establish a new connection: [Errno 113] No route to host',))

fail 7075883 2022-10-20 14:37:00 2022-10-21 21:28:40 2022-10-21 21:40:55 0:12:15 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} 2
Failure Reason:

HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2022-10-19-1252-pacific (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f2eac182dd8>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))

fail 7075885 2022-10-20 14:37:01 2022-10-21 21:29:41 2022-10-21 21:39:50 0:10:09 smithi main centos 8.stream fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{no}} 3
Failure Reason:

HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2022-10-19-1252-pacific (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f7c1d611278>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))

fail 7075887 2022-10-20 14:37:02 2022-10-21 21:30:42 2022-10-21 21:40:28 0:09:46 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} 2
Failure Reason:

HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2022-10-19-1252-pacific (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f1de1e3ae10>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))

fail 7075889 2022-10-20 14:37:04 2022-10-21 21:31:43 2022-10-21 21:41:00 0:09:17 smithi main rhel 8.4 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/iozone}} 2
Failure Reason:

HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2022-10-19-1252-pacific (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f52f7116eb8>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))

fail 7075891 2022-10-20 14:37:05 2022-10-21 21:32:14 2022-10-21 21:41:41 0:09:27 smithi main ubuntu 20.04 fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_untarbuild_blogbench} 2
Failure Reason:

HTTPSConnectionPool(host='shaman.ceph.com', port=443): Max retries exceeded with url: /api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri2-testing-2022-10-19-1252-pacific (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f6bec41ae80>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))

pass 7075893 2022-10-20 14:37:06 2022-10-21 21:32:55 2022-10-21 22:07:28 0:34:33 0:21:53 0:12:40 smithi main ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-3-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} 5
pass 7075895 2022-10-20 14:37:07 2022-10-21 21:35:26 2022-10-21 22:03:04 0:27:38 0:20:57 0:06:41 smithi main centos 8.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
fail 7075897 2022-10-20 14:37:09 2022-10-21 21:35:57 2022-10-21 22:05:06 0:29:09 0:18:22 0:10:47 smithi main centos 8.stream fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} 2
Failure Reason:

Test failure: test_abort_conn (tasks.cephfs.test_client_recovery.TestClientRecovery)

pass 7075899 2022-10-20 14:37:10 2022-10-21 21:36:07 2022-10-21 22:30:15 0:54:08 0:42:37 0:11:31 smithi main ubuntu 20.04 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} 2
pass 7075901 2022-10-20 14:37:11 2022-10-21 21:37:28 2022-10-21 22:13:05 0:35:37 0:28:46 0:06:51 smithi main rhel 8.4 fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 scrub/no standby-replay tasks/{0-check-counter workunit/suites/fsx} wsync/{no}} 3
pass 7075903 2022-10-20 14:37:12 2022-10-21 21:37:49 2022-10-21 22:01:36 0:23:47 0:16:48 0:06:59 smithi main rhel 8.4 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
fail 7075905 2022-10-20 14:37:13 2022-10-21 21:38:30 2022-10-21 22:07:09 0:28:39 0:18:14 0:10:25 smithi main centos 8.stream fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} 2
Failure Reason:

Test failure: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth)

pass 7075907 2022-10-20 14:37:15 2022-10-21 21:39:10 2022-10-21 22:02:58 0:23:48 0:17:04 0:06:44 smithi main rhel 8.4 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 7075909 2022-10-20 14:37:16 2022-10-21 21:40:01 2022-10-21 22:43:44 1:03:43 0:52:22 0:11:21 smithi main centos 8.stream fs/snaps/{begin clusters/1a3s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/workunit/snaps} 2
pass 7075911 2022-10-20 14:37:17 2022-10-21 21:40:32 2022-10-21 22:48:06 1:07:34 0:56:50 0:10:44 smithi main ubuntu 20.04 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_ffsb traceless/50pc} 2
fail 7075913 2022-10-20 14:37:18 2022-10-21 21:40:32 2022-10-21 22:07:19 0:26:47 0:16:03 0:10:44 smithi main ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/damage} 2
Failure Reason:

Test failure: test_damaged_dentry (tasks.cephfs.test_damage.TestDamage)

pass 7075915 2022-10-20 14:37:19 2022-10-21 21:40:43 2022-10-21 23:18:09 1:37:26 1:27:26 0:10:00 smithi main centos 8.stream fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_snaptests}} 2
fail 7075917 2022-10-20 14:37:21 2022-10-21 21:41:04 2022-10-21 22:02:37 0:21:33 0:13:41 0:07:52 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} 2
Failure Reason:

Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)

fail 7075919 2022-10-20 14:37:22 2022-10-21 21:41:04 2022-10-21 22:11:51 0:30:47 0:23:18 0:07:29 smithi main centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi074 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6601f27a-518b-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

pass 7075921 2022-10-20 14:37:23 2022-10-21 21:41:05 2022-10-21 22:44:38 1:03:33 0:57:28 0:06:05 smithi main rhel 8.4 fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/5 tasks/dbench validater/valgrind} 2
dead 7075923 2022-10-20 14:37:25 2022-10-21 21:41:26 2022-10-22 10:52:23 13:10:57 smithi main rhel 8.4 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/fsstress}} 2
Failure Reason:

hit max job timeout

fail 7075925 2022-10-20 14:37:26 2022-10-21 21:41:47 2022-10-21 22:02:14 0:20:27 0:14:24 0:06:03 smithi main rhel 8.4 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/exports} 2
Failure Reason:

Test failure: test_ephemeral_pin_dist_conf_off (tasks.cephfs.test_exports.TestEphemeralPins)

pass 7075927 2022-10-20 14:37:27 2022-10-21 21:42:07 2022-10-21 22:10:48 0:28:41 0:19:38 0:09:03 smithi main centos 8.stream fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsync-tester} wsync/{yes}} 3
fail 7075929 2022-10-20 14:37:29 2022-10-21 21:42:18 2022-10-21 22:08:35 0:26:17 0:14:29 0:11:48 smithi main ubuntu 20.04 fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} 2
Failure Reason:

Test failure: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc)

pass 7075931 2022-10-20 14:37:30 2022-10-21 21:44:39 2022-10-21 22:24:23 0:39:44 0:22:26 0:17:18 smithi main ubuntu 20.04 fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} 2
fail 7075933 2022-10-20 14:37:31 2022-10-21 21:52:23 2022-10-21 22:19:46 0:27:23 0:16:43 0:10:40 smithi main centos 8.stream fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} 2
Failure Reason:

Test failure: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub)

pass 7075935 2022-10-20 14:37:32 2022-10-21 21:56:14 2022-10-21 22:29:58 0:33:44 0:24:25 0:09:19 smithi main centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}} 3
fail 7075937 2022-10-20 14:37:34 2022-10-21 22:00:26 2022-10-21 22:27:30 0:27:04 0:15:21 0:11:43 smithi main ubuntu 20.04 fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment} 2
Failure Reason:

Test failure: test_deep_split (tasks.cephfs.test_fragment.TestFragmentation)

pass 7075939 2022-10-20 14:37:35 2022-10-21 22:01:47 2022-10-21 22:20:47 0:19:00 0:13:24 0:05:36 smithi main rhel 8.4 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/trivial_sync}} 2
pass 7075941 2022-10-20 14:37:36 2022-10-21 22:02:18 2022-10-21 22:24:24 0:22:06 0:14:47 0:07:19 smithi main centos 8.stream fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{faked-ino ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 7075943 2022-10-20 14:37:38 2022-10-21 22:03:08 2022-10-21 22:28:39 0:25:31 0:16:24 0:09:07 smithi main ubuntu 20.04 fs/libcephfs/{begin clusters/1-mds-1-client-coloc conf/{client mds mon osd} distro/{ubuntu_latest} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/libcephfs/{frag test}} 2
pass 7075945 2022-10-20 14:37:39 2022-10-21 22:05:09 2022-10-21 23:52:58 1:47:49 1:40:37 0:07:12 smithi main rhel 8.4 fs/mixed-clients/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} kclient-overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} 2
fail 7075947 2022-10-20 14:37:40 2022-10-21 22:06:31 2022-10-21 22:28:33 0:22:02 0:10:56 0:11:06 smithi main ubuntu 20.04 fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} 4
Failure Reason:

Test failure: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop)

pass 7075949 2022-10-20 14:37:42 2022-10-21 22:07:12 2022-10-21 22:29:51 0:22:39 0:16:22 0:06:17 smithi main rhel 8.4 fs/permission/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
pass 7075951 2022-10-20 14:37:43 2022-10-21 22:07:22 2022-10-21 22:45:21 0:37:59 0:25:55 0:12:04 smithi main ubuntu 20.04 fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/5 scrub/no standby-replay tasks/{0-check-counter workunit/fs/test_o_trunc} wsync/{yes}} 3
fail 7075953 2022-10-20 14:37:44 2022-10-21 22:07:33 2022-10-21 22:26:15 0:18:42 0:10:58 0:07:44 smithi main centos 8.stream fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair} 2
Failure Reason:

Test failure: test_inject_to_empty (tasks.cephfs.test_journal_repair.TestJournalRepair)

pass 7075955 2022-10-20 14:37:45 2022-10-21 22:08:45 2022-10-21 22:35:44 0:26:59 0:18:09 0:08:50 smithi main centos 8.stream fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_suites_pjd}} 2