Pulpito

yuriw-2019-11-20_00:34:16-rados-wip-yuri8-testing-2019-11-19-2204-luminous-distro-basic-smithi

User Scheduled Started Updated Runtime Suite Branch Machine Type Revision Pass Fail Dead
yuriw 2019-11-20 00:34:16 2019-11-20 02:04:18 2019-11-20 14:54:58 12:50:40 rados wip-yuri8-testing-2019-11-19-2204-luminous smithi 799645e 150 8 1

Average wait time: 0:16:48

See other runs of suite 'rados' on branch 'wip-yuri8-testing-2019-11-19-2204-luminous'?

See other runs on branch 'wip-yuri8-testing-2019-11-19-2204-luminous'?

See other runs scheduled on 2019-11-20?

See detail view?

Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
 Machine Teuthology Branch OS Type OS Version Description Nodes
pass 4524130 2019-11-20 00:34:32 2019-11-20 02:04:18 2019-11-20 02:22:17 0:17:59 0:06:49 0:11:10 smithi master rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml} 1
fail 4524131 2019-11-20 00:34:33 2019-11-20 02:04:19 2019-11-20 02:24:18 0:19:59 0:07:08 0:12:51 smithi master rados/singleton/{all/mon-seesaw.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-stupid.yaml rados.yaml} 1
Failure Reason:

failed to reach quorum size 2 before timeout expired

pass 4524132 2019-11-20 00:34:34 2019-11-20 02:06:12 2019-11-20 02:44:11 0:37:59 0:20:45 0:17:14 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
pass 4524133 2019-11-20 00:34:35 2019-11-20 02:06:12 2019-11-20 02:32:11 0:25:59 0:11:23 0:14:36 smithi master rados/singleton/{all/osd-backfill.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 4524134 2019-11-20 00:34:36 2019-11-20 02:08:13 2019-11-20 10:00:21 7:52:08 7:37:11 0:14:57 smithi master rados/objectstore/filestore-idempotent-aio-journal.yaml 1
pass 4524135 2019-11-20 00:34:37 2019-11-20 02:10:06 2019-11-20 02:40:05 0:29:59 0:18:12 0:11:47 smithi master rados/standalone/misc.yaml 1
pass 4524136 2019-11-20 00:34:38 2019-11-20 02:10:06 2019-11-20 02:50:05 0:39:59 0:24:38 0:15:21 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml fast/fast.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} 2
pass 4524137 2019-11-20 00:34:39 2019-11-20 02:10:19 2019-11-20 02:32:18 0:21:59 0:11:35 0:10:24 smithi master rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 4524138 2019-11-20 00:34:40 2019-11-20 02:11:22 2019-11-20 02:27:21 0:15:59 0:07:49 0:08:10 smithi master rados/singleton-nomsgr/{all/health-warnings.yaml rados.yaml} 1
pass 4524139 2019-11-20 00:34:42 2019-11-20 02:11:51 2019-11-20 02:59:50 0:47:59 0:19:47 0:28:12 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml mon_kv_backend/leveldb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_workunit_loadgen_mix.yaml} 2
pass 4524140 2019-11-20 00:34:43 2019-11-20 02:12:07 2019-11-20 02:34:06 0:21:59 0:09:59 0:12:00 smithi master rados/mgr/{clusters/2-node-mgr.yaml debug/mgr.yaml objectstore/bluestore-stupid.yaml tasks/module_selftest.yaml} 2
pass 4524141 2019-11-20 00:34:44 2019-11-20 02:12:09 2019-11-20 04:20:10 2:08:01 0:10:56 1:57:05 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-upmap.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 4524142 2019-11-20 00:34:45 2019-11-20 02:12:10 2019-11-20 04:38:12 2:26:02 2:01:25 0:24:37 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-upmap.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
pass 4524143 2019-11-20 00:34:46 2019-11-20 02:13:49 2019-11-20 02:37:48 0:23:59 0:14:40 0:09:19 smithi master rados/singleton/{all/osd-recovery.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
pass 4524144 2019-11-20 00:34:47 2019-11-20 02:13:49 2019-11-20 02:43:48 0:29:59 0:15:56 0:14:03 smithi master rados/multimon/{clusters/9.yaml mon_kv_backend/leveldb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/mon_recovery.yaml} 3
pass 4524145 2019-11-20 00:34:48 2019-11-20 02:13:49 2019-11-20 02:39:48 0:25:59 0:11:34 0:14:25 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml d-thrash/none.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} 2
fail 4524146 2019-11-20 00:34:49 2019-11-20 02:13:49 2019-11-20 02:35:48 0:21:59 0:02:43 0:19:16 smithi master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-upmap.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} supported/ubuntu_14.04.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

ne 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u"/sbin/pvs: unrecognized option '--select'\n Error during parsing of command line.\n")Failure object was: {'smithi062.front.sepia.ceph.com': {'msg': u'All items completed', 'changed': False, 'results': [{'ansible_loop_var': u'item', '_ansible_no_log': False, u'err': u"/sbin/pvs: unrecognized option '--select'\n Error during parsing of command line.\n", 'item': {'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}, 'changed': False, u'failed': True, '_ansible_item_label': {'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}, u'rc': 3, u'invocation': {u'module_args': {u'vg_options': u'', u'pvs': [u'/dev/nvme0n1'], u'force': False, u'vg': u'vg_nvme', u'pesize': u'4', u'pv_options': u'', u'state': u'present'}}, u'msg': u'Failed executing pvs command.'}]}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u"/sbin/pvs: unrecognized option '--select'\n Error during parsing of command line.\n")

pass 4524147 2019-11-20 00:34:50 2019-11-20 02:14:25 2019-11-20 02:42:25 0:28:00 0:14:43 0:13:17 smithi master rados/thrash-luminous/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 4524148 2019-11-20 00:34:51 2019-11-20 02:16:27 2019-11-20 02:32:26 0:15:59 0:06:54 0:09:05 smithi master rados/singleton/{all/peer.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-stupid.yaml rados.yaml} 1
pass 4524149 2019-11-20 00:34:52 2019-11-20 02:16:35 2019-11-20 03:00:35 0:44:00 0:23:39 0:20:21 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
pass 4524150 2019-11-20 00:34:53 2019-11-20 02:18:07 2019-11-20 02:36:06 0:17:59 0:07:08 0:10:51 smithi master rados/singleton-nomsgr/{all/large-omap-object-warnings.yaml rados.yaml} 1
pass 4524151 2019-11-20 00:34:54 2019-11-20 02:18:07 2019-11-20 03:02:07 0:44:00 0:26:26 0:17:34 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
pass 4524152 2019-11-20 00:34:55 2019-11-20 02:18:07 2019-11-20 02:36:07 0:18:00 0:06:32 0:11:28 smithi master rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 4524153 2019-11-20 00:34:56 2019-11-20 02:18:08 2019-11-20 02:58:07 0:39:59 0:22:34 0:17:25 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml d-require-luminous/at-mkfs.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/one.yaml workloads/rados_mon_workunits.yaml} 2
pass 4524154 2019-11-20 00:34:57 2019-11-20 02:20:06 2019-11-20 03:00:06 0:40:00 0:28:43 0:11:17 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_workunit_loadgen_mostlyread.yaml} 2
pass 4524155 2019-11-20 00:34:58 2019-11-20 02:20:09 2019-11-20 09:00:16 6:40:07 6:31:04 0:09:03 smithi master rados/objectstore/filestore-idempotent.yaml 1
pass 4524156 2019-11-20 00:34:59 2019-11-20 02:20:10 2019-11-20 03:00:09 0:39:59 0:27:56 0:12:03 smithi master rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-crush-compat.yaml fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} 2
pass 4524157 2019-11-20 00:35:00 2019-11-20 02:20:15 2019-11-20 02:56:15 0:36:00 0:24:38 0:11:22 smithi master rados/singleton/{all/radostool.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 4524158 2019-11-20 00:35:01 2019-11-20 02:22:18 2019-11-20 03:12:18 0:50:00 0:26:53 0:23:07 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-stupid.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
pass 4524159 2019-11-20 00:35:02 2019-11-20 02:22:18 2019-11-20 03:06:18 0:44:00 0:18:56 0:25:04 smithi master rados/singleton/{all/random-eio.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 2
pass 4524160 2019-11-20 00:35:03 2019-11-20 02:22:18 2019-11-20 03:06:18 0:44:00 0:27:11 0:16:49 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml fast/normal.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} 2
pass 4524161 2019-11-20 00:35:04 2019-11-20 02:22:19 2019-11-20 02:58:18 0:35:59 0:09:49 0:26:10 smithi master rados/basic-luminous/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} objectstore/bluestore-stupid.yaml rados.yaml scrub_test.yaml} 2
fail 4524163 2019-11-20 00:35:05 2019-11-20 02:22:19 2019-11-20 02:48:18 0:25:59 0:09:31 0:16:28 smithi master rados/rest/rest_test.yaml 2
Failure Reason:

Command failed (workunit test rest/test.py) on smithi003 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=799645e345cdb00b0ea5298b2a0c4d98b765e0c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rest/test.py'

pass 4524165 2019-11-20 00:35:06 2019-11-20 02:24:40 2019-11-20 03:00:39 0:35:59 0:25:21 0:10:38 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 4524167 2019-11-20 00:35:07 2019-11-20 02:26:06 2019-11-20 02:44:05 0:17:59 0:08:56 0:09:03 smithi master rados/singleton-nomsgr/{all/lazy_omap_stats_output.yaml rados.yaml} 1
pass 4524169 2019-11-20 00:35:08 2019-11-20 02:26:35 2019-11-20 02:50:34 0:23:59 0:11:59 0:12:00 smithi master rados/standalone/mon.yaml 1
pass 4524171 2019-11-20 00:35:09 2019-11-20 02:28:08 2019-11-20 06:06:11 3:38:03 3:01:25 0:36:38 smithi master ubuntu 16.04 rados/upgrade/jewel-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-luminous.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/ubuntu_latest.yaml thrashosds-health.yaml} 3
pass 4524173 2019-11-20 00:35:10 2019-11-20 02:28:26 2019-11-20 02:52:25 0:23:59 0:13:51 0:10:08 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml mon_kv_backend/leveldb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/readwrite.yaml} 2
fail 4524175 2019-11-20 00:35:11 2019-11-20 02:30:22 2019-11-20 02:54:21 0:23:59 0:12:46 0:11:13 smithi master rados/singleton/{all/rebuild-mondb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml} 1
Failure Reason:

Command failed on smithi203 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status'

pass 4524177 2019-11-20 00:35:12 2019-11-20 02:32:33 2019-11-20 02:58:32 0:25:59 0:15:03 0:10:56 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 4524179 2019-11-20 00:35:13 2019-11-20 02:32:33 2019-11-20 02:52:32 0:19:59 0:08:21 0:11:38 smithi master rados/objectstore/fusestore.yaml 1
pass 4524181 2019-11-20 00:35:14 2019-11-20 02:34:28 2019-11-20 02:58:27 0:23:59 0:15:44 0:08:15 smithi master rados/singleton/{all/recovery-preemption.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 4524183 2019-11-20 00:35:15 2019-11-20 02:36:15 2019-11-20 03:16:46 0:40:31 0:25:34 0:14:57 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported/ubuntu_latest.yaml thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 4524185 2019-11-20 00:35:16 2019-11-20 02:36:15 2019-11-20 03:00:46 0:24:31 0:12:54 0:11:37 smithi master rados/thrash-luminous/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
pass 4524187 2019-11-20 00:35:17 2019-11-20 02:36:15 2019-11-20 02:54:46 0:18:31 0:07:16 0:11:15 smithi master rados/mgr/{clusters/2-node-mgr.yaml debug/mgr.yaml objectstore/filestore-xfs.yaml tasks/workunits.yaml} 2
pass 4524189 2019-11-20 00:35:18 2019-11-20 02:38:47 2019-11-20 03:46:47 1:08:00 0:10:31 0:57:29 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 4524191 2019-11-20 00:35:19 2019-11-20 02:38:47 2019-11-20 02:58:47 0:20:00 0:07:28 0:12:32 smithi master rados/singleton-nomsgr/{all/librados_hello_world.yaml rados.yaml} 1
pass 4524193 2019-11-20 00:35:20 2019-11-20 02:41:15 2019-11-20 03:17:14 0:35:59 0:07:38 0:28:21 smithi master rados/multimon/{clusters/21.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 3
pass 4524195 2019-11-20 00:35:21 2019-11-20 02:41:15 2019-11-20 03:03:13 0:21:58 0:10:03 0:11:55 smithi master rados/singleton/{all/reg11184.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 4524197 2019-11-20 00:35:22 2019-11-20 02:41:15 2019-11-20 03:13:13 0:31:58 0:21:25 0:10:33 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} 2
pass 4524199 2019-11-20 00:35:23 2019-11-20 02:43:37 2019-11-20 03:13:36 0:29:59 0:12:09 0:17:50 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} d-require-luminous/at-end.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
pass 4524201 2019-11-20 00:35:24 2019-11-20 02:44:08 2019-11-20 03:22:08 0:38:00 0:25:30 0:12:30 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml d-require-luminous/at-end.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-stupid.yaml rados.yaml thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} 2
pass 4524203 2019-11-20 00:35:25 2019-11-20 02:44:08 2019-11-20 03:14:07 0:29:59 0:15:13 0:14:46 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/repair_test.yaml} 2
pass 4524205 2019-11-20 00:35:26 2019-11-20 02:44:09 2019-11-20 03:08:08 0:23:59 0:12:54 0:11:05 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 4524207 2019-11-20 00:35:27 2019-11-20 02:48:24 2019-11-20 03:08:41 0:20:17 0:07:48 0:12:29 smithi master rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 2
pass 4524209 2019-11-20 00:35:28 2019-11-20 02:48:24 2019-11-20 03:24:41 0:36:17 0:26:50 0:09:27 smithi master rados/singleton-nomsgr/{all/msgr.yaml rados.yaml} 1
fail 4524211 2019-11-20 00:35:29 2019-11-20 02:50:43 2019-11-20 03:10:41 0:19:58 0:08:08 0:11:50 smithi master rados/singleton/{all/rest-api.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-stupid.yaml rados.yaml} 1
Failure Reason:

Command failed (workunit test rest/test.py) on smithi203 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=799645e345cdb00b0ea5298b2a0c4d98b765e0c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rest/test.py'

pass 4524213 2019-11-20 00:35:30 2019-11-20 02:50:43 2019-11-20 03:26:41 0:35:58 0:26:01 0:09:57 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-crush-compat.yaml fast/fast.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} 2
dead 4524215 2019-11-20 00:35:31 2019-11-20 02:52:28 2019-11-20 14:54:58 12:02:30 smithi master rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-upmap.yaml fast/normal.yaml leveldb.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} 2
pass 4524217 2019-11-20 00:35:32 2019-11-20 02:54:06 2019-11-20 03:10:04 0:15:58 0:06:24 0:09:34 smithi master rados/objectstore/keyvaluedb.yaml 1
pass 4524219 2019-11-20 00:35:33 2019-11-20 02:54:48 2019-11-20 04:26:49 1:32:01 1:19:17 0:12:44 smithi master rados/standalone/osd.yaml 1
pass 4524222 2019-11-20 00:35:35 2019-11-20 02:58:07 2019-11-20 03:26:06 0:27:59 0:15:10 0:12:49 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} 2
pass 4524224 2019-11-20 00:35:36 2019-11-20 02:58:19 2019-11-20 03:20:18 0:21:59 0:11:02 0:10:57 smithi master rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 4524226 2019-11-20 00:35:37 2019-11-20 02:58:29 2019-11-20 03:34:29 0:36:00 0:17:28 0:18:32 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml mon_kv_backend/leveldb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rgw_snaps.yaml} 2
pass 4524228 2019-11-20 00:35:38 2019-11-20 02:58:49 2019-11-20 03:34:48 0:35:59 0:24:20 0:11:39 smithi master rados/singleton/{all/thrash-eio.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 2
pass 4524230 2019-11-20 00:35:39 2019-11-20 02:59:36 2019-11-20 03:35:37 0:36:01 0:25:29 0:10:32 smithi master rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml} 2
pass 4524232 2019-11-20 00:35:40 2019-11-20 03:00:07 2019-11-20 03:48:06 0:47:59 0:34:43 0:13:16 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported/centos_latest.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 4524234 2019-11-20 00:35:41 2019-11-20 03:00:11 2019-11-20 03:28:10 0:27:59 0:10:59 0:17:00 smithi master rados/thrash-luminous/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 4524236 2019-11-20 00:35:42 2019-11-20 03:01:01 2019-11-20 03:24:59 0:23:58 0:14:04 0:09:54 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
pass 4524238 2019-11-20 00:35:43 2019-11-20 03:01:35 2019-11-20 03:37:34 0:35:59 0:18:56 0:17:03 smithi master rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 2
pass 4524240 2019-11-20 00:35:44 2019-11-20 03:02:31 2019-11-20 03:24:30 0:21:59 0:09:48 0:12:11 smithi master rados/basic-luminous/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} objectstore/filestore-xfs.yaml rados.yaml scrub_test.yaml} 2
pass 4524242 2019-11-20 00:35:45 2019-11-20 03:03:16 2019-11-20 03:29:15 0:25:59 0:07:16 0:18:43 smithi master rados/mgr/{clusters/2-node-mgr.yaml debug/mgr.yaml objectstore/filestore-xfs.yaml tasks/dashboard.yaml} 2
pass 4524244 2019-11-20 00:35:46 2019-11-20 03:03:54 2019-11-20 03:41:53 0:37:59 0:24:04 0:13:55 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
pass 4524246 2019-11-20 00:35:47 2019-11-20 03:06:39 2019-11-20 06:16:41 3:10:02 0:11:30 2:58:32 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 4524248 2019-11-20 00:35:48 2019-11-20 03:07:15 2019-11-20 04:17:15 1:10:00 0:29:59 0:40:01 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-crush-compat.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
pass 4524250 2019-11-20 00:35:49 2019-11-20 03:08:43 2019-11-20 03:38:42 0:29:59 0:16:51 0:13:08 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml d-require-luminous/at-mkfs.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml thrashers/sync-many.yaml workloads/pool-create-delete.yaml} 2
pass 4524252 2019-11-20 00:35:50 2019-11-20 03:10:27 2019-11-20 03:46:26 0:35:59 0:21:29 0:14:30 smithi master rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-stupid.yaml rados.yaml} 2
pass 4524254 2019-11-20 00:35:51 2019-11-20 03:10:43 2019-11-20 03:42:42 0:31:59 0:20:49 0:11:10 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_api_tests.yaml} 2
pass 4524256 2019-11-20 00:35:52 2019-11-20 03:12:20 2019-11-20 03:52:19 0:39:59 0:27:10 0:12:49 smithi master rados/objectstore/objectcacher-stress.yaml 1
pass 4524258 2019-11-20 00:35:53 2019-11-20 03:13:38 2019-11-20 03:33:37 0:19:59 0:06:48 0:13:11 smithi master rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml} 1
pass 4524260 2019-11-20 00:35:54 2019-11-20 03:15:56 2019-11-20 03:35:55 0:19:59 0:07:14 0:12:45 smithi master rados/multimon/{clusters/3.yaml mon_kv_backend/leveldb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_clock_with_skews.yaml} 2
pass 4524262 2019-11-20 00:35:55 2019-11-20 03:16:48 2019-11-20 03:46:47 0:29:59 0:18:11 0:11:48 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml d-thrash/none.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} 2
pass 4524264 2019-11-20 00:35:56 2019-11-20 03:18:04 2019-11-20 03:56:04 0:38:00 0:22:16 0:15:44 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-crush-compat.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 4524266 2019-11-20 00:35:57 2019-11-20 03:19:47 2019-11-20 03:37:46 0:17:59 0:07:07 0:10:52 smithi master rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 4524268 2019-11-20 00:35:58 2019-11-20 03:20:48 2019-11-20 03:58:49 0:38:01 0:23:49 0:14:12 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-upmap.yaml fast/normal.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} 2
pass 4524270 2019-11-20 00:35:59 2019-11-20 03:24:42 2019-11-20 03:42:41 0:17:59 0:06:41 0:11:18 smithi master rados/singleton/{all/admin-socket.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 4524272 2019-11-20 00:36:00 2019-11-20 03:24:43 2019-11-20 04:22:43 0:58:00 0:46:28 0:11:32 smithi master rados/standalone/scrub.yaml 1
pass 4524274 2019-11-20 00:36:01 2019-11-20 03:24:43 2019-11-20 03:56:42 0:31:59 0:19:58 0:12:01 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-upmap.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
pass 4524276 2019-11-20 00:36:02 2019-11-20 03:26:25 2019-11-20 03:44:24 0:17:59 0:07:56 0:10:03 smithi master rados/singleton/{all/divergent_priors.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 4524278 2019-11-20 00:36:03 2019-11-20 03:26:43 2019-11-20 03:58:42 0:31:59 0:22:42 0:09:17 smithi master rados/singleton-nomsgr/{all/recovery-unfound-found.yaml rados.yaml} 1
pass 4524280 2019-11-20 00:36:04 2019-11-20 03:28:26 2019-11-20 03:54:25 0:25:59 0:11:51 0:14:08 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml mon_kv_backend/leveldb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_cls_all.yaml} 2
pass 4524282 2019-11-20 00:36:05 2019-11-20 03:28:30 2019-11-20 04:12:30 0:44:00 0:28:11 0:15:49 smithi master rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml fast/fast.yaml leveldb.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} 2
pass 4524284 2019-11-20 00:36:06 2019-11-20 03:29:23 2019-11-20 03:49:22 0:19:59 0:10:43 0:09:16 smithi master rados/singleton/{all/divergent_priors2.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
pass 4524285 2019-11-20 00:36:07 2019-11-20 03:29:52 2019-11-20 09:09:58 5:40:06 5:25:48 0:14:18 smithi master rados/objectstore/objectstore.yaml 1
fail 4524286 2019-11-20 00:36:08 2019-11-20 03:30:09 2019-11-20 03:50:08 0:19:59 0:02:49 0:17:10 smithi master ubuntu 14.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-crush-compat.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported/ubuntu_14.04.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

ne 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u"/sbin/pvs: unrecognized option '--select'\n Error during parsing of command line.\n")Failure object was: {'smithi065.front.sepia.ceph.com': {'msg': u'All items completed', 'changed': False, 'results': [{'ansible_loop_var': u'item', '_ansible_no_log': False, u'err': u"/sbin/pvs: unrecognized option '--select'\n Error during parsing of command line.\n", 'item': {'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}, 'changed': False, u'failed': True, '_ansible_item_label': {'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}, u'rc': 3, u'invocation': {u'module_args': {u'vg_options': u'', u'pvs': [u'/dev/nvme0n1'], u'force': False, u'vg': u'vg_nvme', u'pesize': u'4', u'pv_options': u'', u'state': u'present'}}, u'msg': u'Failed executing pvs command.'}]}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u"/sbin/pvs: unrecognized option '--select'\n Error during parsing of command line.\n")

pass 4524287 2019-11-20 00:36:09 2019-11-20 03:30:35 2019-11-20 04:08:35 0:38:00 0:12:22 0:25:38 smithi master rados/thrash-luminous/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
pass 4524288 2019-11-20 00:36:10 2019-11-20 03:32:41 2019-11-20 04:08:41 0:36:00 0:21:34 0:14:26 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
pass 4524289 2019-11-20 00:36:11 2019-11-20 03:33:15 2019-11-20 03:51:14 0:17:59 0:08:38 0:09:21 smithi master rados/singleton/{all/dump-stuck.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-stupid.yaml rados.yaml} 1
fail 4524290 2019-11-20 00:36:12 2019-11-20 03:33:39 2019-11-20 03:57:38 0:23:59 0:10:38 0:13:21 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml d-require-luminous/at-end.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml thrashers/sync.yaml workloads/rados_5925.yaml} 2
Failure Reason:

"2019-11-20 03:50:37.317970 mon.b mon.1 172.21.15.179:6789/0 39 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec. Implicated osds 5 (REQUEST_SLOW)" in cluster log

pass 4524291 2019-11-20 00:36:13 2019-11-20 03:34:00 2019-11-20 04:19:59 0:45:59 0:10:09 0:35:50 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-upmap.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
pass 4524292 2019-11-20 00:36:14 2019-11-20 03:34:30 2019-11-20 03:56:29 0:21:59 0:12:10 0:09:49 smithi master centos rados/singleton-nomsgr/{all/valgrind-leaks.yaml rados.yaml} 1
pass 4524293 2019-11-20 00:36:15 2019-11-20 03:34:48 2019-11-20 03:54:49 0:20:01 0:09:28 0:10:33 smithi master rados/mgr/{clusters/2-node-mgr.yaml debug/mgr.yaml objectstore/bluestore-bitmap.yaml tasks/failover.yaml} 2
pass 4524294 2019-11-20 00:36:16 2019-11-20 03:34:50 2019-11-20 04:26:49 0:51:59 0:12:10 0:39:49 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} d-require-luminous/at-end.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 4524295 2019-11-20 00:36:17 2019-11-20 03:35:58 2019-11-20 04:01:57 0:25:59 0:11:30 0:14:29 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/rados_python.yaml} 2
pass 4524296 2019-11-20 00:36:18 2019-11-20 03:35:58 2019-11-20 04:09:58 0:34:00 0:23:22 0:10:38 smithi master rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 4524297 2019-11-20 00:36:19 2019-11-20 03:36:10 2019-11-20 04:04:09 0:27:59 0:12:01 0:15:58 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-stupid.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache.yaml} 2
pass 4524298 2019-11-20 00:36:20 2019-11-20 03:36:27 2019-11-20 03:54:26 0:17:59 0:06:11 0:11:48 smithi master rados/singleton/{all/erasure-code-nonregression.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 4524299 2019-11-20 00:36:21 2019-11-20 03:37:34 2019-11-20 04:05:33 0:27:59 0:09:11 0:18:48 smithi master rados/multimon/{clusters/3.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/mon_recovery.yaml} 2
pass 4524300 2019-11-20 00:36:22 2019-11-20 03:37:36 2019-11-20 04:23:36 0:46:00 0:24:39 0:21:21 smithi master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} 2
pass 4524301 2019-11-20 00:36:23 2019-11-20 03:37:47 2019-11-20 06:29:49 2:52:02 2:37:42 0:14:20 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml fast/fast.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} 2
pass 4524302 2019-11-20 00:36:24 2019-11-20 03:38:59 2019-11-20 04:02:58 0:23:59 0:09:37 0:14:22 smithi master rados/basic-luminous/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} objectstore/bluestore-bitmap.yaml rados.yaml scrub_test.yaml} 2
pass 4524303 2019-11-20 00:36:25 2019-11-20 03:38:59 2019-11-20 03:56:58 0:17:59 0:07:16 0:10:43 smithi master rados/objectstore/alloc-hint.yaml 1
pass 4524304 2019-11-20 00:36:26 2019-11-20 03:38:59 2019-11-20 03:54:58 0:15:59 0:07:49 0:08:10 smithi master rados/rest/mgr-restful.yaml 1
pass 4524305 2019-11-20 00:36:27 2019-11-20 03:39:55 2019-11-20 04:13:55 0:34:00 0:22:53 0:11:07 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 4524306 2019-11-20 00:36:28 2019-11-20 03:40:47 2019-11-20 04:00:46 0:19:59 0:09:45 0:10:14 smithi master rados/singleton-nomsgr/{all/admin_socket_output.yaml rados.yaml} 1
pass 4524307 2019-11-20 00:36:29 2019-11-20 03:42:11 2019-11-20 04:00:10 0:17:59 0:07:27 0:10:32 smithi master rados/standalone/crush.yaml 1
pass 4524308 2019-11-20 00:36:30 2019-11-20 03:42:11 2019-11-20 07:24:14 3:42:03 3:16:50 0:25:13 smithi master centos 7.4 rados/upgrade/jewel-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-jewel-install/jewel.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-luminous.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} distros/centos_latest.yaml thrashosds-health.yaml} 3
pass 4524309 2019-11-20 00:36:31 2019-11-20 03:42:42 2019-11-20 04:26:42 0:44:00 0:34:13 0:09:47 smithi master rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
pass 4524310 2019-11-20 00:36:33 2019-11-20 02:43:35 2019-11-20 03:08:48 0:25:13 0:14:21 0:10:52 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml mon_kv_backend/leveldb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_stress_watch.yaml} 2
pass 4524311 2019-11-20 00:36:34 2019-11-20 03:42:44 2019-11-20 04:24:43 0:41:59 0:24:51 0:17:08 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 4524312 2019-11-20 00:36:35 2019-11-20 03:44:33 2019-11-20 04:34:33 0:50:00 0:37:08 0:12:52 smithi master rados/singleton/{all/lost-unfound.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-stupid.yaml rados.yaml} 1
pass 4524313 2019-11-20 00:36:36 2019-11-20 03:44:33 2019-11-20 04:18:39 0:34:06 0:22:41 0:11:25 smithi master ubuntu 16.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-upmap.yaml leveldb.yaml msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} supported/ubuntu_latest.yaml thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 4524314 2019-11-20 00:36:37 2019-11-20 03:45:01 2019-11-20 04:09:01 0:24:00 0:09:56 0:14:04 smithi master rados/thrash-luminous/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
pass 4524315 2019-11-20 00:36:38 2019-11-20 03:46:05 2019-11-20 04:34:04 0:47:59 0:25:23 0:22:36 smithi master rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml fast/normal.yaml leveldb.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{default.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} 2
pass 4524316 2019-11-20 00:36:39 2019-11-20 04:41:52 2019-11-20 04:57:51 0:15:59 0:07:06 0:08:53 smithi master rados/singleton/{all/max-pg-per-osd.from-mon.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 4524317 2019-11-20 00:36:40 2019-11-20 04:41:52 2019-11-20 04:59:51 0:17:59 0:07:14 0:10:45 smithi master rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml} 1
pass 4524318 2019-11-20 00:36:41 2019-11-20 04:41:59 2019-11-20 05:21:59 0:40:00 0:20:15 0:19:45 smithi master rados/monthrash/{ceph.yaml clusters/9-mons.yaml d-require-luminous/at-mkfs.yaml mon_kv_backend/rocksdb.yaml msgr-failures/mon-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} 2
pass 4524319 2019-11-20 00:36:42 2019-11-20 04:42:16 2019-11-20 05:14:15 0:31:59 0:18:12 0:13:47 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-upmap.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml thrashers/default.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} 2
pass 4524320 2019-11-20 00:36:43 2019-11-20 04:42:46 2019-11-20 05:20:45 0:37:59 0:23:58 0:14:01 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml leveldb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
pass 4524321 2019-11-20 00:36:44 2019-11-20 04:43:10 2019-11-20 05:05:09 0:21:59 0:10:35 0:11:24 smithi master rados/singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 4524322 2019-11-20 00:36:45 2019-11-20 04:43:10 2019-11-20 05:17:10 0:34:00 0:07:42 0:26:18 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_striper.yaml} 2
pass 4524323 2019-11-20 00:36:46 2019-11-20 04:44:41 2019-11-20 05:06:40 0:21:59 0:11:56 0:10:03 smithi master rados/objectstore/ceph_objectstore_tool.yaml 1
pass 4524324 2019-11-20 00:36:47 2019-11-20 04:45:10 2019-11-20 05:17:09 0:31:59 0:09:58 0:22:01 smithi master rados/mgr/{clusters/2-node-mgr.yaml debug/mgr.yaml objectstore/bluestore-comp.yaml tasks/module_selftest.yaml} 2
pass 4524325 2019-11-20 00:36:48 2019-11-20 04:45:19 2019-11-20 06:31:20 1:46:01 0:10:43 1:35:18 smithi master rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-crush-compat.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} 4
pass 4524326 2019-11-20 00:36:49 2019-11-20 04:45:35 2019-11-20 05:09:34 0:23:59 0:14:05 0:09:54 smithi master rados/singleton/{all/max-pg-per-osd.from-replica.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
pass 4524327 2019-11-20 00:36:50 2019-11-20 04:46:08 2019-11-20 05:02:07 0:15:59 0:05:50 0:10:09 smithi master rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml} 1
pass 4524328 2019-11-20 00:36:51 2019-11-20 04:46:40 2019-11-20 05:44:40 0:58:00 0:41:11 0:16:49 smithi master rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} 2
pass 4524329 2019-11-20 00:36:52 2019-11-20 04:46:53 2019-11-20 05:26:52 0:39:59 0:25:06 0:14:53 smithi master rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml fast/normal.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} 2
pass 4524330 2019-11-20 00:36:53 2019-11-20 04:47:00 2019-11-20 05:04:59 0:17:59 0:07:11 0:10:48 smithi master rados/singleton/{all/mon-auth-caps.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml} 1
pass 4524331 2019-11-20 00:36:54 2019-11-20 04:49:25 2019-11-20 05:33:24 0:43:59 0:31:04 0:12:55 smithi master rados/standalone/erasure-code.yaml 1
pass 4524332 2019-11-20 00:36:55 2019-11-20 04:49:50 2019-11-20 05:11:50 0:22:00 0:07:15 0:14:45 smithi master rados/multimon/{clusters/6.yaml mon_kv_backend/leveldb.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/mon_clock_no_skews.yaml} 2
pass 4524333 2019-11-20 00:36:56 2019-11-20 04:51:52 2019-11-20 05:13:51 0:21:59 0:11:17 0:10:42 smithi master rados/singleton/{all/mon-config-key-caps.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/filestore-xfs.yaml rados.yaml} 1
pass 4524334 2019-11-20 00:36:57 2019-11-20 04:51:55 2019-11-20 05:19:54 0:27:59 0:10:47 0:17:12 smithi master rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml d-thrash/none.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} 2
pass 4524335 2019-11-20 00:36:58 2019-11-20 04:52:12 2019-11-20 05:40:12 0:48:00 0:30:53 0:17:07 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml mon_kv_backend/leveldb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_workunit_loadgen_big.yaml} 2
pass 4524336 2019-11-20 00:36:59 2019-11-20 04:52:35 2019-11-20 05:30:34 0:37:59 0:22:25 0:15:34 smithi master rados/thrash/{0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-end.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-stupid.yaml rados.yaml rocksdb.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
pass 4524337 2019-11-20 00:37:00 2019-11-20 04:52:39 2019-11-20 05:08:38 0:15:59 0:06:35 0:09:24 smithi master rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml} 1
pass 4524338 2019-11-20 00:37:01 2019-11-20 04:52:45 2019-11-20 05:14:45 0:22:00 0:12:33 0:09:27 smithi master rados/singleton/{all/mon-config-keys.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml} 1
pass 4524339 2019-11-20 00:37:02 2019-11-20 04:54:09 2019-11-20 05:42:08 0:47:59 0:31:59 0:16:00 smithi master centos 7.4 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported/centos_latest.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
pass 4524340 2019-11-20 00:37:03 2019-11-20 04:58:10 2019-11-20 05:20:09 0:21:59 0:11:34 0:10:25 smithi master rados/thrash-luminous/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
pass 4524341 2019-11-20 00:37:04 2019-11-20 04:58:13 2019-11-20 05:16:13 0:18:00 0:06:52 0:11:08 smithi master rados/objectstore/filejournal.yaml 1
pass 4524342 2019-11-20 00:37:05 2019-11-20 04:58:30 2019-11-20 05:28:30 0:30:00 0:17:40 0:12:20 smithi master rados/monthrash/{ceph.yaml clusters/3-mons.yaml d-require-luminous/at-end.yaml mon_kv_backend/leveldb.yaml msgr-failures/few.yaml msgr/simple.yaml objectstore/bluestore-stupid.yaml rados.yaml thrashers/many.yaml workloads/rados_mon_workunits.yaml} 2
fail 4524343 2019-11-20 00:37:06 2019-11-20 04:58:31 2019-11-20 05:18:30 0:19:59 0:06:44 0:13:15 smithi master rados/singleton/{all/mon-seesaw.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
Failure Reason:

failed to reach quorum size 2 before timeout expired

pass 4524344 2019-11-20 00:37:08 2019-11-20 04:58:59 2019-11-20 05:20:58 0:21:59 0:09:52 0:12:07 smithi master rados/basic-luminous/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} objectstore/bluestore-comp.yaml rados.yaml scrub_test.yaml} 2
pass 4524345 2019-11-20 00:37:09 2019-11-20 04:59:01 2019-11-20 05:33:00 0:33:59 0:23:15 0:10:44 smithi master rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml} 1
pass 4524346 2019-11-20 00:37:10 2019-11-20 04:59:01 2019-11-20 05:39:01 0:40:00 0:23:13 0:16:47 smithi master rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-crush-compat.yaml fast/fast.yaml leveldb.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} 2
pass 4524347 2019-11-20 00:37:11 2019-11-20 04:59:40 2019-11-20 05:25:40 0:26:00 0:10:41 0:15:19 smithi master rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} d-require-luminous/at-end.yaml leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} 3
pass 4524348 2019-11-20 00:37:12 2019-11-20 04:59:40 2019-11-20 05:31:40 0:32:00 0:21:01 0:10:59 smithi master rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs-balancer-crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} 2
pass 4524349 2019-11-20 00:37:13 2019-11-20 04:59:41 2019-11-20 05:31:40 0:31:59 0:19:23 0:12:36 smithi master rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-require-luminous/at-mkfs.yaml mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/rados_workunit_loadgen_mix.yaml} 2
pass 4524350 2019-11-20 00:37:14 2019-11-20 04:59:41 2019-11-20 05:33:40 0:33:59 0:24:50 0:09:09 smithi master rados/singleton/{all/osd-backfill.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-stupid.yaml rados.yaml} 1