Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi065.front.sepia.ceph.com smithi True True 2020-08-04 17:39:33.191051 scheduled_jdillaman@cube-1 rhel 8.1 x86_64 /home/teuthworker/archive/jdillaman-2020-08-04_12:52:48-rbd-wip-jd-testing-distro-basic-smithi/5286758
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
running 5286758 2020-08-04 16:53:55 2020-08-04 17:38:42 2020-08-04 17:54:42 0:16:59 smithi master rhel 8.1 rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} 3
pass 5286692 2020-08-04 16:53:19 2020-08-04 17:13:01 2020-08-04 17:41:01 0:28:00 0:15:59 0:12:01 smithi master ubuntu 18.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nbd} 3
dead 5286293 2020-08-04 08:00:43 2020-08-04 08:15:09 2020-08-04 08:43:08 0:27:59 0:03:17 0:24:42 smithi master ubuntu 18.04 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} 3
Failure Reason:

{'Failure object was': {'smithi065.front.sepia.ceph.com': {'results': [{'msg': 'Failed to download key at http://download.ceph.com/keys/autobuild.asc: Connection failure: timed out', 'failed': True, 'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, '_ansible_no_log': False, 'changed': False, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc'}, {'invocation': {'module_args': {'file': 'None', 'keyserver': 'None', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True, 'keyring': 'None', 'state': 'present', 'key': 'None', 'data': 'None', 'id': 'None'}}, 'changed': False, '_ansible_no_log': False, 'failed': False, 'item': 'http://download.ceph.com/keys/release.asc', 'ansible_loop_var': 'item', '_ansible_item_label': 'http://download.ceph.com/keys/release.asc'}], 'msg': 'All items completed', 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 199, in represent_list return self.represent_sequence(\'tag:yaml.org,2002:seq\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 92, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'http://download.ceph.com/keys/autobuild.asc')"}

pass 5285942 2020-08-04 05:00:51 2020-08-04 07:01:24 2020-08-04 08:27:26 1:26:02 0:20:06 1:05:56 smithi master ubuntu 18.04 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/rbd_workunit_suites_iozone} 3
pass 5285937 2020-08-04 05:00:46 2020-08-04 06:55:26 2020-08-04 07:57:27 1:02:01 0:33:57 0:28:04 smithi master rhel 8.1 smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} 3
fail 5285707 2020-08-04 02:31:37 2020-08-04 03:26:55 2020-08-04 15:21:13 11:54:18 6:31:49 5:22:29 smithi master rhel 7.8 upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-nautilus 6.1-msgr2 7-final-workload/{rbd-python rgw-swift-ragweed_check snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/rhel_7 thrashosds-health} 5
Failure Reason:

failed to recover before timeout expired

pass 5285698 2020-08-04 02:31:28 2020-08-04 03:12:44 2020-08-04 07:10:50 3:58:06 3:24:44 0:33:22 smithi master ubuntu 16.04 upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-msgr2 4-nautilus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check rgw_swift} objectstore/filestore-xfs supported-all-distro/ubuntu_16.04} 4
pass 5285360 2020-08-04 01:15:08 2020-08-04 02:22:33 2020-08-04 03:28:33 1:06:00 0:52:54 0:13:06 smithi master ubuntu 18.04 fs/traceless/{begin clusters/fixed-2-ucephfs conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} supported-random-distros$/{ubuntu_latest} tasks/cfuse_workunit_suites_dbench traceless/50pc} 2
fail 5285130 2020-08-03 22:42:44 2020-08-03 22:59:01 2020-08-04 02:31:06 3:32:05 0:04:53 3:27:12 smithi master ubuntu 18.04 kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/pool-perm} 6
Failure Reason:

Command failed on smithi143 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.10-256-gf23ff76200-1bionic cephadm=14.2.10-256-gf23ff76200-1bionic ceph-mds=14.2.10-256-gf23ff76200-1bionic ceph-mgr=14.2.10-256-gf23ff76200-1bionic ceph-common=14.2.10-256-gf23ff76200-1bionic ceph-fuse=14.2.10-256-gf23ff76200-1bionic ceph-test=14.2.10-256-gf23ff76200-1bionic radosgw=14.2.10-256-gf23ff76200-1bionic python3-rados=14.2.10-256-gf23ff76200-1bionic python3-rgw=14.2.10-256-gf23ff76200-1bionic python3-cephfs=14.2.10-256-gf23ff76200-1bionic python3-rbd=14.2.10-256-gf23ff76200-1bionic libcephfs2=14.2.10-256-gf23ff76200-1bionic libcephfs-dev=14.2.10-256-gf23ff76200-1bionic librados2=14.2.10-256-gf23ff76200-1bionic librbd1=14.2.10-256-gf23ff76200-1bionic rbd-fuse=14.2.10-256-gf23ff76200-1bionic python3-cephfs=14.2.10-256-gf23ff76200-1bionic cephfs-shell=14.2.10-256-gf23ff76200-1bionic'

dead 5284713 2020-08-03 20:29:03 2020-08-03 20:29:36 2020-08-04 02:15:45 5:46:09 smithi master ubuntu 18.04 kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/random/{k-testing supported$/{ubuntu_latest}} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/client-recovery} 6
fail 5284522 2020-08-03 20:09:10 2020-08-03 20:21:00 2020-08-03 21:05:00 0:44:00 0:05:51 0:38:09 smithi master centos 8.1 kcephfs/recovery/{begin clusters/1-mds-4-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/mds-full} 6
Failure Reason:

Command failed on smithi065 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel'

fail 5284322 2020-08-03 17:26:38 2020-08-03 17:53:11 2020-08-03 18:59:11 1:06:00 smithi master rhel 7.8 kcephfs/cephfs/{begin clusters/1-mds-1-client conf/{client mds mon osd} inline/yes kclient/{mount overrides/{distro/random/{k-testing supported$/{rhel_latest}} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/kclient_workunit_o_trunc} 3
Failure Reason:

Command failed on smithi065 with status 4: 'rm -f /tmp/kernel.x86_64.rpm && echo kernel-4.20.0_ceph_gd4c0c9bb2b1d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://5.chacra.ceph.com/r/kernel/testing/d4c0c9bb2b1d2f91769af32d49121018ffe640fe/centos/7/flavors/default/x86_64/ --input-file=-'

pass 5284196 2020-08-03 14:23:34 2020-08-03 14:24:09 2020-08-03 18:10:15 3:46:06 3:31:19 0:14:47 smithi master ubuntu 18.04 upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_latest} 5
pass 5284075 2020-08-03 12:12:15 2020-08-03 12:49:11 2020-08-03 13:09:10 0:19:59 0:12:07 0:07:52 smithi master ubuntu 18.04 rados:cephadm/smoke/{distro/ubuntu_latest fixed-2 start} 2
pass 5284005 2020-08-03 12:08:31 2020-08-03 12:09:44 2020-08-03 12:51:44 0:42:00 0:22:32 0:19:28 smithi master centos 8.1 kcephfs/multifs/{begin clusters/2-mds-2-client conf/{client mds mon osd} kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable log-config osd-asserts whitelist_health whitelist_wrongly_marked_down} tasks/multifs-basic} 4
fail 5283955 2020-08-03 10:40:02 2020-08-03 10:49:18 2020-08-03 11:25:18 0:36:00 0:27:34 0:08:26 smithi master centos 8.0 rgw:verify/{centos_latest clusters/fixed-2 frontend/civetweb msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile sharding$/{single} striping$/{stripe-equals-chunk} tasks/{0-install cls ragweed reshard s3tests-java s3tests} validater/valgrind} 2
Failure Reason:

Command failed (ragweed tests against rgw) on smithi094 with status 1: "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'"

pass 5283814 2020-08-03 06:57:08 2020-08-03 13:33:32 2020-08-03 14:33:32 1:00:00 0:20:55 0:39:05 smithi master ubuntu 18.04 fs/multiclient/{begin.yaml clusters/1-mds-3-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} distros/ubuntu_latest.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mdtest.yaml} 5
pass 5283759 2020-08-03 06:56:11 2020-08-03 13:07:59 2020-08-03 13:25:58 0:17:59 0:11:35 0:06:24 smithi master ubuntu 18.04 fs/multiclient/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} distros/ubuntu_latest.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mdtest.yaml} 4
pass 5283698 2020-08-03 06:54:59 2020-08-03 11:53:15 2020-08-03 12:19:14 0:25:59 0:15:56 0:10:03 smithi master centos 8.1 fs/thrash/{begin.yaml ceph-thrash/mds.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/none.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} 2
pass 5283662 2020-08-03 06:54:18 2020-08-03 11:39:43 2020-08-03 13:49:46 2:10:03 0:17:50 1:52:13 smithi master ubuntu 18.04 fs/multiclient/{begin.yaml clusters/1-mds-3-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} distros/ubuntu_latest.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cephfs_misc_tests.yaml} 5