Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi068.front.sepia.ceph.com smithi True True 2020-08-04 00:55:49.443251 scheduled_rzarzynski@teuthology ubuntu 18.04 x86_64 /home/teuthworker/archive/rzarzynski-2020-08-03_21:33:30-rados-wip-bl-reenable-hc-distro-basic-smithi/5285057
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 5285176 2020-08-03 22:43:35 2020-08-03 23:16:11 2020-08-04 00:04:11 0:48:00 0:07:44 0:40:16 smithi master rhel 8.1 kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-flush} 6
Failure Reason:

Command failed on smithi180 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel'

running 5285057 2020-08-03 21:38:08 2020-08-04 00:52:08 2020-08-04 03:00:10 2:08:23 smithi master ubuntu 18.04 rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} 4
pass 5284885 2020-08-03 21:35:37 2020-08-03 23:29:43 2020-08-03 23:49:43 0:20:00 0:14:26 0:05:34 smithi master rhel 8.1 rados/singleton/{all/mon-config-key-caps msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
fail 5284857 2020-08-03 21:35:13 2020-08-03 22:39:42 2020-08-03 23:29:42 0:50:00 0:25:12 0:24:48 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} 3
Failure Reason:

reached maximum tries (180) after waiting for 180 seconds

pass 5284718 2020-08-03 20:29:09 2020-08-03 20:39:52 2020-08-04 00:55:58 4:16:06 0:47:33 3:28:33 smithi master rhel 7.8 kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery} 6
fail 5284499 2020-08-03 19:42:10 2020-08-03 19:45:41 2020-08-03 22:53:44 3:08:03 2:21:14 0:46:49 smithi master ubuntu 18.04 upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} 4
Failure Reason:

"2020-08-03T20:55:53.471946+0000 mds.a (mds.0) 6 : cluster [WRN] evicting unresponsive client smithi097: (44786), after 300.991 seconds" in cluster log

fail 5284352 2020-08-03 17:27:12 2020-08-03 18:15:38 2020-08-03 18:55:38 0:40:00 smithi master centos 7.8 multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{kernel-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep} 3
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=19743)

dead 5284317 2020-08-03 17:26:33 2020-08-03 17:49:21 2020-08-03 19:03:22 1:14:01 smithi master ubuntu 16.04 kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/random/{k-testing supported$/{ubuntu_16.04}} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/backtrace} 6
fail 5284285 2020-08-03 17:26:03 2020-08-03 17:29:04 2020-08-03 18:25:06 0:56:02 smithi master rhel 7.8 kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/random/{k-testing supported$/{rhel_latest}} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_misc} 3
Failure Reason:

Command failed on smithi068 with status 4: 'rm -f /tmp/kernel.x86_64.rpm && echo kernel-4.20.0_ceph_gd4c0c9bb2b1d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://5.chacra.ceph.com/r/kernel/testing/d4c0c9bb2b1d2f91769af32d49121018ffe640fe/centos/7/flavors/default/x86_64/ --input-file=-'

fail 5284265 2020-08-03 15:42:56 2020-08-03 15:44:49 2020-08-03 19:20:54 3:36:05 0:09:56 3:26:09 smithi master rhel 7.8 kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery} 6
Failure Reason:

HTTPSConnectionPool(host='2.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/nautilus/408b1bed6f2fbf18456fa35edf565361a6cfde32/centos/7/flavors/default/repo (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f8ef4b2a358>: Failed to establish a new connection: [Errno 110] Connection timed out',))

pass 5284065 2020-08-03 12:12:05 2020-08-03 12:43:44 2020-08-03 13:25:44 0:42:00 0:25:09 0:16:51 smithi master rhel 8.1 rados:cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_python} 2
fail 5283973 2020-08-03 10:40:18 2020-08-03 10:59:42 2020-08-03 11:55:43 0:56:01 0:29:17 0:26:44 smithi master centos 8.0 rgw:verify/{centos_latest clusters/fixed-2 frontend/beast msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

Command failed (ragweed tests against rgw) on smithi068 with status 1: "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"

fail 5283939 2020-08-03 10:39:47 2020-08-03 10:43:21 2020-08-03 11:21:21 0:38:00 0:28:33 0:09:27 smithi master centos 8.0 rgw:verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/filestore-xfs overrides proto/https rgw_pool_type/replicated sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

Command failed (ragweed tests against rgw) on smithi068 with status 1: "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"

pass 5283858 2020-08-03 08:00:38 2020-08-03 08:01:11 2020-08-03 08:41:11 0:40:00 0:25:00 0:15:00 smithi master rhel 8.1 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_latest} tasks/cfuse_workunit_suites_fsstress} 3
pass 5283839 2020-08-03 07:00:53 2020-08-03 07:10:05 2020-08-03 08:02:05 0:52:00 0:27:53 0:24:07 smithi master smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap tasks/mon_thrash} 3
pass 5283784 2020-08-03 06:56:39 2020-08-03 13:20:25 2020-08-03 13:48:25 0:28:00 0:19:22 0:08:38 smithi master centos 8.1 fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_blogbench.yaml} 2
pass 5283702 2020-08-03 06:55:03 2020-08-03 11:54:03 2020-08-03 12:54:04 1:00:01 0:53:27 0:06:34 smithi master ubuntu 18.04 fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_ffsb.yaml} 2
pass 5283592 2020-08-03 06:53:08 2020-08-03 10:27:13 2020-08-03 10:47:13 0:20:00 0:12:21 0:07:39 smithi master ubuntu 18.04 fs/thrash/{begin.yaml ceph-thrash/mon.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_pjd.yaml} 2
pass 5283511 2020-08-03 06:51:50 2020-08-03 09:44:45 2020-08-03 10:28:45 0:44:00 0:37:03 0:06:57 smithi master rhel 8.1 fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_suites_iogen.yaml} 2
pass 5283468 2020-08-03 06:51:11 2020-08-03 09:19:23 2020-08-03 09:45:23 0:26:00 0:19:00 0:07:00 smithi master centos 8.1 fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_misc_test_o_trunc.yaml} 2