Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi023.front.sepia.ceph.com smithi True True 2022-03-09 13:10:25.965522 scheduled_teuthology@teuthology ubuntu 20.04 x86_64 teuthology-dev-testing
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 6728191 2022-03-09 12:17:45 2022-03-09 12:38:31 2022-03-09 13:06:34 0:28:03 0:17:19 0:10:44 smithi master centos 8.stream powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} 4
Failure Reason:

SELinux denials found on ubuntu@smithi080.front.sepia.ceph.com: ['type=AVC msg=audit(1646830893.938:42): avc: denied { node_bind } for pid=1801 comm="ping" saddr=172.21.15.80 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1']

pass 6728132 2022-03-09 09:56:00 2022-03-09 10:01:14 2022-03-09 10:42:04 0:40:50 0:25:47 0:15:03 smithi master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
pass 6728081 2022-03-09 06:51:35 2022-03-09 07:12:48 2022-03-09 07:56:16 0:43:28 0:36:30 0:06:58 smithi master rhel 8.4 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} 2
dead 6727287 2022-03-08 22:36:22 2022-03-08 22:41:01 2022-03-09 05:23:04 6:42:03 smithi master ubuntu 20.04 rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} 3
Failure Reason:

hit max job timeout

fail 6727154 2022-03-08 11:59:47 2022-03-08 12:09:03 2022-03-08 12:39:16 0:30:13 0:20:01 0:10:12 smithi master centos 8.stream rbd/mirror-thrash/{base/{openstack} cluster/3-nodes/{base/{install mirror roles} extra/{rbd-mirror} workloads/rbd-mirror-journal-workunit-multipeer} msgr-failures/few objectstore/bluestore-comp-snappy policy/none supported-random-distro$/{centos_8}} 3
Failure Reason:

Command failed (workunit test rbd/rbd_mirror_journal.sh) on smithi137 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3df2df89481efaf0f538fee7574b0c0646580ee7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 USE_CLUSTER3=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_journal.sh'

fail 6727037 2022-03-08 05:17:43 2022-03-09 13:10:25 2022-03-09 14:42:24 1:31:59 1:18:41 0:13:18 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

"2022-03-09T13:44:40.236093+0000 osd.4 (osd.4) 3 : cluster [WRN] slow request osd_op(client.4346.0:187454 2.6 2:7af403a4:::rbd_data.10f17df15357.0000000000001218:head [set-alloc-hint object_size 4194304 write_size 4194304,write 905216~4096 in=4096b] snapc 0=[] ondisk+write+known_if_redirected e22) initiated 2022-03-09T13:44:10.109867+0000 currently waiting for sub ops" in cluster log

pass 6726987 2022-03-08 05:17:05 2022-03-09 11:55:55 2022-03-09 12:38:48 0:42:53 0:30:47 0:12:06 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc$/{crc-rxbounce} msgr-failures/many tasks/rbd_fio} 3
pass 6726961 2022-03-08 05:16:45 2022-03-09 11:26:22 2022-03-09 11:56:33 0:30:11 0:18:44 0:11:27 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc-rxbounce} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6726915 2022-03-08 05:16:08 2022-03-09 10:42:10 2022-03-09 11:26:14 0:44:04 0:30:41 0:13:23 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
pass 6726864 2022-03-08 05:01:14 2022-03-08 05:18:49 2022-03-08 05:58:59 0:40:10 0:28:27 0:11:43 smithi master centos 8.stream smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rbd_api_tests}} 3
pass 6726801 2022-03-08 04:21:42 2022-03-08 11:25:44 2022-03-08 12:09:26 0:43:42 0:32:37 0:11:05 smithi master centos 8.stream fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/fsstress validater/lockdep} 2
pass 6726787 2022-03-08 04:21:31 2022-03-08 10:58:12 2022-03-08 11:25:49 0:27:37 0:21:10 0:06:27 smithi master rhel 8.4 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag prefetch_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mds 2-workunit/suites/fsstress}} 2
pass 6726737 2022-03-08 04:20:50 2022-03-08 10:22:23 2022-03-08 10:58:02 0:35:39 0:29:34 0:06:05 smithi master rhel 8.4 fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/volume-client} 2
pass 6726718 2022-03-08 04:20:34 2022-03-08 09:52:44 2022-03-08 10:20:40 0:27:56 0:16:43 0:11:13 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes standby-replay tasks/{0-check-counter workunit/suites/fsstress} wsync/{yes}} 3
pass 6726682 2022-03-08 04:20:06 2022-03-08 09:25:57 2022-03-08 09:52:38 0:26:41 0:14:58 0:11:43 smithi master ubuntu 20.04 fs/workload/{begin clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no standby-replay tasks/{0-check-counter workunit/suites/iozone} wsync/{no}} 3
pass 6726652 2022-03-08 04:19:41 2022-03-08 09:03:43 2022-03-08 09:26:20 0:22:37 0:12:13 0:10:24 smithi master ubuntu 20.04 fs/32bits/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-ec-root overrides/{faked-ino whitelist_health whitelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} 2
dead 6726586 2022-03-08 04:18:47 2022-03-08 08:19:32 2022-03-08 09:04:20 0:44:48 0:32:17 0:12:31 smithi master ubuntu 20.04 fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu/{latest overrides}} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/fsstress validater/lockdep} 2
Failure Reason:

SSH connection to smithi023 was lost: 'sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0'

pass 6726548 2022-03-08 04:18:16 2022-03-08 07:56:05 2022-03-08 08:20:02 0:23:57 0:17:16 0:06:41 smithi master rhel 8.4 fs/thrash/workloads/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/pjd}} 2
pass 6726513 2022-03-08 03:21:20 2022-03-09 09:01:28 2022-03-09 09:59:31 0:58:03 0:47:41 0:10:22 smithi master centos 8.stream fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{frag prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/1 tasks/{1-thrash/osd 2-workunit/suites/ffsb}} 2
pass 6726488 2022-03-08 03:20:59 2022-03-09 08:37:45 2022-03-09 09:01:47 0:24:02 0:14:17 0:09:45 smithi master centos 8.stream fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/none objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/iozone}} 2