Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi091.front.sepia.ceph.com smithi False True 2020-06-18 00:59:31.379315 scheduled_pdonnell@teuthology centos 8 x86_64 Marked down by ceph-cm-ansible due to missing NVMe card 2020-06-18T01:08:53Z
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
dead 5158897 2020-06-18 00:40:07 2020-06-18 00:49:49 2020-06-18 01:13:49 0:24:00 0:04:12 0:19:48 smithi master centos 8.1 multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports} 2
Failure Reason:

{'Failure object was': {'smithi075.front.sepia.ceph.com': {'msg': 'Could not find the requested service nrpe: host', 'invocation': {'module_args': {'name': 'nrpe', 'enabled': True, 'state': 'started', 'daemon_reload': False, 'daemon_reexec': False, 'no_block': False, 'force': 'None', 'masked': 'None', 'user': 'None', 'scope': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'nrpe')", 'smithi091.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'msg': 'Failing rest of playbook due to missing NVMe card'}}

fail 5158877 2020-06-17 22:15:44 2020-06-17 23:11:29 2020-06-17 23:25:28 0:13:59 smithi master rhel 7.8 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-zstd supported-all-distro/rhel_7 thrashosds-health} 3
Failure Reason:

failed to install new kernel version within timeout

fail 5158871 2020-06-17 22:15:39 2020-06-17 23:09:51 2020-06-18 00:09:52 1:00:01 smithi master centos 7.8 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/filestore-xfs supported-all-distro/centos_latest thrashosds-health} 3
Failure Reason:

failed to install new kernel version within timeout

fail 5158864 2020-06-17 22:15:32 2020-06-17 23:07:20 2020-06-17 23:53:20 0:46:00 smithi master ubuntu 16.04 upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade supported-all-distro/ubuntu_16.04} 3
Failure Reason:

failed to install new kernel version within timeout

fail 5158852 2020-06-17 22:15:19 2020-06-17 23:01:38 2020-06-17 23:39:38 0:38:00 smithi master ubuntu 18.04 upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-zlib supported-all-distro/ubuntu_latest thrashosds-health} 3
Failure Reason:

failed to install new kernel version within timeout

fail 5158838 2020-06-17 22:15:04 2020-06-17 22:57:23 2020-06-17 23:11:22 0:13:59 smithi master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml start.yaml} 2
Failure Reason:

failed to install new kernel version within timeout

fail 5158806 2020-06-17 22:14:31 2020-06-17 22:43:27 2020-06-17 22:59:27 0:16:00 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml mode/root.yaml msgr/async-v2only.yaml start.yaml tasks/rados_api_tests.yaml} 2
Failure Reason:

failed to install new kernel version within timeout

fail 5158779 2020-06-17 22:14:05 2020-06-17 22:19:00 2020-06-17 22:34:59 0:15:59 smithi master centos 7.6 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/luminous.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} 3
Failure Reason:

failed to install new kernel version within timeout

fail 5158351 2020-06-17 15:54:12 2020-06-18 00:21:47 2020-06-18 00:45:47 0:24:00 smithi master ubuntu 18.04 upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-msgr2 4-nautilus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check rgw_swift} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest} 4
Failure Reason:

failed to install new kernel version within timeout

fail 5158325 2020-06-17 15:53:21 2020-06-17 23:39:19 2020-06-18 01:01:20 1:22:01 smithi master ubuntu 18.04 upgrade:luminous-x/parallel/{0-cluster/{openstack start} 1-ceph-install/luminous 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-msgr2 4-nautilus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check rgw_swift} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest} 4
Failure Reason:

failed to install new kernel version within timeout

fail 5158308 2020-06-17 15:53:04 2020-06-17 23:25:20 2020-06-18 00:29:20 1:04:00 smithi master ubuntu 18.04 upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/luminous 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 7-final-workload objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} 5
Failure Reason:

failed to install new kernel version within timeout

fail 5158239 2020-06-17 15:50:08 2020-06-17 22:04:47 2020-06-17 22:20:46 0:15:59 smithi master centos 7.8 powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} 4
Failure Reason:

failed to install new kernel version within timeout

fail 5158218 2020-06-17 15:49:50 2020-06-17 21:41:16 2020-06-17 22:05:16 0:24:00 smithi master ubuntu 18.04 powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-few-objects thrashosds-health whitelist_health} 4
Failure Reason:

failed to install new kernel version within timeout

fail 5158207 2020-06-17 15:49:40 2020-06-17 21:33:14 2020-06-17 21:51:13 0:17:59 smithi master centos 7.8 powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_latest tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} 4
Failure Reason:

failed to install new kernel version within timeout

fail 5158200 2020-06-17 15:49:34 2020-06-17 21:25:15 2020-06-17 22:47:17 1:22:02 smithi master rhel 7.8 powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/rhel_7 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} 4
Failure Reason:

failed to install new kernel version within timeout

fail 5158184 2020-06-17 15:49:20 2020-06-17 21:18:51 2020-06-17 21:34:51 0:16:00 smithi master rhel 7.8 powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_7 tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} 4
Failure Reason:

failed to install new kernel version within timeout

fail 5158126 2020-06-17 15:48:30 2020-06-17 20:18:15 2020-06-17 21:24:16 1:06:01 smithi master ubuntu 18.04 powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} 4
Failure Reason:

failed to install new kernel version within timeout

fail 5158111 2020-06-17 15:48:17 2020-06-17 20:04:52 2020-06-17 20:24:52 0:20:00 smithi master centos 7.8 powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/centos_latest tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} 4
Failure Reason:

failed to install new kernel version within timeout

fail 5158104 2020-06-17 15:48:11 2020-06-17 19:56:59 2020-06-17 20:10:59 0:14:00 smithi master rhel 7.8 powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_7 tasks/radosbench thrashosds-health whitelist_health} 4
Failure Reason:

failed to install new kernel version within timeout

fail 5158070 2020-06-17 15:47:41 2020-06-17 19:23:06 2020-06-17 19:59:06 0:36:00 smithi master ubuntu 18.04 powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} 4
Failure Reason:

failed to install new kernel version within timeout