| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| pdonnell | 2019-09-24 18:47:10 | 2019-09-25 00:53:44 | 2019-09-25 13:45:43 | 12:51:59 | kcephfs | wip-pdonnell-testing-20190924.140036 | smithi | 4a33e73 | 202 | 41 | 7 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 4331710 |
|
2019-09-24 18:47:18 | 2019-09-24 21:54:58 | 2019-09-24 22:40:57 | 0:45:59 | 0:12:59 | 0:33:00 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 |
| pass | 4331711 |
|
2019-09-24 18:47:19 | 2019-09-24 21:54:58 | 2019-09-24 23:24:58 | 1:30:00 | 0:52:41 | 0:37:19 | smithi | master | rhel | 7.6 | kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 |
| pass | 4331712 |
|
2019-09-24 18:47:20 | 2019-09-24 21:55:08 | 2019-09-25 08:01:18 | 10:06:10 | 0:22:06 | 9:44:04 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml} | 6 |
| pass | 4331713 |
|
2019-09-24 18:47:21 | 2019-09-24 21:55:12 | 2019-09-24 22:55:12 | 1:00:00 | 0:32:43 | 0:27:17 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331714 |
|
2019-09-24 18:47:21 | 2019-09-24 21:55:13 | 2019-09-24 22:51:12 | 0:55:59 | 0:35:03 | 0:20:56 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 |
| pass | 4331715 |
|
2019-09-24 18:47:22 | 2019-09-24 21:57:18 | 2019-09-24 23:25:18 | 1:28:00 | 0:16:09 | 1:11:51 | smithi | master | centos | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml} | 6 |
| pass | 4331716 |
|
2019-09-24 18:47:23 | 2019-09-24 22:01:23 | 2019-09-24 22:47:23 | 0:46:00 | 0:28:46 | 0:17:14 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 |
| pass | 4331717 |
|
2019-09-24 18:47:24 | 2019-09-24 22:02:06 | 2019-09-24 22:42:06 | 0:40:00 | 0:27:16 | 0:12:44 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 |
| pass | 4331718 |
|
2019-09-24 18:47:25 | 2019-09-24 22:03:17 | 2019-09-25 03:27:21 | 5:24:04 | 0:31:44 | 4:52:20 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml} | 6 |
| pass | 4331719 |
|
2019-09-24 18:47:26 | 2019-09-24 22:03:17 | 2019-09-24 23:29:17 | 1:26:00 | 0:42:01 | 0:43:59 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 |
| pass | 4331720 |
|
2019-09-24 18:47:27 | 2019-09-24 22:03:17 | 2019-09-24 23:25:17 | 1:22:00 | 0:25:34 | 0:56:26 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| dead | 4331721 |
|
2019-09-24 18:47:28 | 2019-09-24 22:03:18 | 2019-09-25 10:05:30 | 12:02:12 | smithi | master | centos | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml} | — | ||
| pass | 4331722 |
|
2019-09-24 18:47:28 | 2019-09-24 22:03:26 | 2019-09-24 23:03:26 | 1:00:00 | 0:48:14 | 0:11:46 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 |
| fail | 4331723 |
|
2019-09-24 18:47:29 | 2019-09-24 22:07:14 | 2019-09-24 23:27:20 | 1:20:06 | 0:59:12 | 0:20:54 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 |
Failure Reason:
"2019-09-24T22:40:57.609547+0000 mon.b (mon.0) 155 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 1569364855 sec, osd.5 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331724 |
|
2019-09-24 18:47:30 | 2019-09-24 22:07:15 | 2019-09-25 01:41:17 | 3:34:02 | 0:38:33 | 2:55:29 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml} | 6 |
| pass | 4331725 |
|
2019-09-24 18:47:31 | 2019-09-24 22:07:24 | 2019-09-24 22:35:23 | 0:27:59 | 0:20:01 | 0:07:58 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 |
| fail | 4331726 |
|
2019-09-24 18:47:32 | 2019-09-24 22:16:07 | 2019-09-24 23:08:06 | 0:51:59 | 0:31:54 | 0:20:05 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 |
Failure Reason:
"2019-09-24T22:54:37.198118+0000 mon.b (mon.0) 155 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569365674 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331727 |
|
2019-09-24 18:47:32 | 2019-09-24 22:16:07 | 2019-09-25 01:58:09 | 3:42:02 | 0:23:50 | 3:18:12 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml} | 6 |
| pass | 4331728 |
|
2019-09-24 18:47:33 | 2019-09-24 22:16:07 | 2019-09-24 23:28:06 | 1:11:59 | 0:43:16 | 0:28:43 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331729 |
|
2019-09-24 18:47:34 | 2019-09-24 22:16:06 | 2019-09-24 22:38:05 | 0:21:59 | 0:16:01 | 0:05:58 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 |
| pass | 4331730 |
|
2019-09-24 18:47:35 | 2019-09-24 22:16:07 | 2019-09-25 00:32:08 | 2:16:01 | 1:00:19 | 1:15:42 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml} | 6 |
| pass | 4331731 |
|
2019-09-24 18:47:36 | 2019-09-24 22:16:07 | 2019-09-24 23:16:06 | 0:59:59 | 0:27:50 | 0:32:09 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331732 |
|
2019-09-24 18:47:37 | 2019-09-24 22:16:07 | 2019-09-24 23:14:07 | 0:58:00 | 0:26:40 | 0:31:20 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 |
| fail | 4331733 |
|
2019-09-24 18:47:38 | 2019-09-24 22:16:45 | 2019-09-25 02:34:48 | 4:18:03 | 0:34:47 | 3:43:16 | smithi | master | centos | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml} | 6 |
Failure Reason:
Command failed on smithi169 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' |
||||||||||||||
| pass | 4331734 |
|
2019-09-24 18:47:39 | 2019-09-24 22:16:50 | 2019-09-24 22:46:49 | 0:29:59 | 0:12:26 | 0:17:33 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 |
| fail | 4331735 |
|
2019-09-24 18:47:39 | 2019-09-24 22:16:50 | 2019-09-24 22:50:50 | 0:34:00 | 0:19:21 | 0:14:39 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 |
Failure Reason:
"2019-09-24T22:46:35.603021+0000 mon.b (mon.0) 140 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569365193 sec, osd.5 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331736 |
|
2019-09-24 18:47:40 | 2019-09-24 22:16:51 | 2019-09-24 23:10:50 | 0:53:59 | 0:34:47 | 0:19:12 | smithi | master | centos | 7.6 | kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 |
| pass | 4331737 |
|
2019-09-24 18:47:41 | 2019-09-24 22:17:05 | 2019-09-24 23:21:05 | 1:04:00 | 0:38:12 | 0:25:48 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml} | 6 |
| pass | 4331738 |
|
2019-09-24 18:47:42 | 2019-09-24 22:17:06 | 2019-09-24 23:01:05 | 0:43:59 | 0:25:05 | 0:18:54 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331739 |
|
2019-09-24 18:47:43 | 2019-09-24 22:17:09 | 2019-09-24 23:39:09 | 1:22:00 | 0:29:53 | 0:52:07 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 |
| dead | 4331740 |
|
2019-09-24 18:47:44 | 2019-09-24 22:17:23 | 2019-09-25 10:19:34 | 12:02:11 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml} | — | ||
| pass | 4331741 |
|
2019-09-24 18:47:45 | 2019-09-24 22:17:23 | 2019-09-24 23:31:22 | 1:13:59 | 0:43:13 | 0:30:46 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 |
| pass | 4331742 |
|
2019-09-24 18:47:46 | 2019-09-24 22:17:28 | 2019-09-24 23:29:28 | 1:12:00 | 0:33:34 | 0:38:26 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 |
| dead | 4331743 |
|
2019-09-24 18:47:46 | 2019-09-24 22:21:02 | 2019-09-25 10:23:14 | 12:02:12 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml} | — | ||
| pass | 4331744 |
|
2019-09-24 18:47:47 | 2019-09-24 22:21:03 | 2019-09-25 01:25:05 | 3:04:02 | 0:52:21 | 2:11:41 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 |
| pass | 4331745 |
|
2019-09-24 18:47:48 | 2019-09-24 22:21:19 | 2019-09-24 23:09:18 | 0:47:59 | 0:35:29 | 0:12:30 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331746 |
|
2019-09-24 18:47:49 | 2019-09-24 22:23:22 | 2019-09-25 05:01:28 | 6:38:06 | 0:45:21 | 5:52:45 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml} | 6 |
| fail | 4331747 |
|
2019-09-24 18:47:50 | 2019-09-24 22:23:43 | 2019-09-25 00:41:44 | 2:18:01 | 1:07:11 | 1:10:50 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 |
Failure Reason:
"2019-09-25T00:03:58.846250+0000 mon.b (mon.0) 153 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569369837 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331748 |
|
2019-09-24 18:47:51 | 2019-09-24 22:25:13 | 2019-09-24 23:19:13 | 0:54:00 | 0:37:45 | 0:16:15 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331749 |
|
2019-09-24 18:47:51 | 2019-09-24 22:25:13 | 2019-09-25 05:39:20 | 7:14:07 | 0:19:59 | 6:54:08 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml} | 6 |
| pass | 4331750 |
|
2019-09-24 18:47:52 | 2019-09-24 22:25:13 | 2019-09-24 23:05:12 | 0:39:59 | 0:14:33 | 0:25:26 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 |
| fail | 4331751 |
|
2019-09-24 18:47:53 | 2019-09-24 22:25:13 | 2019-09-25 00:29:14 | 2:04:01 | 0:39:34 | 1:24:27 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 |
Failure Reason:
"2019-09-25T00:16:49.443303+0000 mon.b (mon.0) 146 : cluster [WRN] Health check failed: 2 slow ops, oldest one blocked for 1569370606 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 4331752 |
|
2019-09-24 18:47:54 | 2019-09-24 22:25:17 | 2019-09-25 02:59:20 | 4:34:03 | 0:21:35 | 4:12:28 | smithi | master | centos | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml} | 6 |
Failure Reason:
Test failure: test_version_splitting (tasks.cephfs.test_sessionmap.TestSessionMap) |
||||||||||||||
| pass | 4331753 |
|
2019-09-24 18:47:55 | 2019-09-24 22:25:23 | 2019-09-24 23:19:23 | 0:54:00 | 0:27:31 | 0:26:29 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331754 |
|
2019-09-24 18:47:56 | 2019-09-24 22:25:27 | 2019-09-24 22:53:26 | 0:27:59 | 0:13:31 | 0:14:28 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 |
| fail | 4331755 |
|
2019-09-24 18:47:57 | 2019-09-24 22:25:28 | 2019-09-25 02:13:31 | 3:48:03 | 0:43:45 | 3:04:18 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml} | 6 |
Failure Reason:
Test failure: test_files_throttle (tasks.cephfs.test_strays.TestStrays) |
||||||||||||||
| pass | 4331756 |
|
2019-09-24 18:47:58 | 2019-09-24 22:27:34 | 2019-09-25 00:17:35 | 1:50:01 | 0:31:58 | 1:18:03 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331757 |
|
2019-09-24 18:47:58 | 2019-09-24 22:27:34 | 2019-09-25 00:25:35 | 1:58:01 | 0:31:15 | 1:26:46 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 |
| fail | 4331758 |
|
2019-09-24 18:47:59 | 2019-09-24 22:29:01 | 2019-09-25 03:07:05 | 4:38:04 | 0:14:34 | 4:23:30 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml} | 6 |
Failure Reason:
Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient) |
||||||||||||||
| pass | 4331759 |
|
2019-09-24 18:48:00 | 2019-09-24 22:29:06 | 2019-09-24 23:01:05 | 0:31:59 | 0:21:41 | 0:10:18 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 |
| pass | 4331760 |
|
2019-09-24 18:48:01 | 2019-09-24 22:29:18 | 2019-09-24 22:57:17 | 0:27:59 | 0:13:48 | 0:14:11 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 |
| pass | 4331761 |
|
2019-09-24 18:48:02 | 2019-09-24 22:29:31 | 2019-09-25 00:31:32 | 2:02:01 | 1:01:23 | 1:00:38 | smithi | master | rhel | 7.6 | kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 |
| dead | 4331762 |
|
2019-09-24 18:48:03 | 2019-09-24 22:31:27 | 2019-09-25 10:33:40 | 12:02:13 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml} | — | ||
| pass | 4331763 |
|
2019-09-24 18:48:04 | 2019-09-24 22:33:30 | 2019-09-24 23:39:30 | 1:06:00 | 0:59:31 | 0:06:29 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331764 |
|
2019-09-24 18:48:04 | 2019-09-24 22:35:17 | 2019-09-24 23:23:16 | 0:47:59 | 0:38:40 | 0:09:19 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 |
| pass | 4331765 |
|
2019-09-24 18:48:05 | 2019-09-24 22:35:17 | 2019-09-25 03:55:21 | 5:20:04 | 0:12:41 | 5:07:23 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml} | 6 |
| pass | 4331766 |
|
2019-09-24 18:48:06 | 2019-09-24 22:35:17 | 2019-09-24 23:41:17 | 1:06:00 | 0:47:45 | 0:18:15 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 |
| pass | 4331767 |
|
2019-09-24 18:48:07 | 2019-09-24 22:35:25 | 2019-09-24 23:23:24 | 0:47:59 | 0:34:37 | 0:13:22 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 |
| pass | 4331768 |
|
2019-09-24 18:48:08 | 2019-09-24 22:37:17 | 2019-09-25 04:09:22 | 5:32:05 | 0:27:55 | 5:04:10 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml} | 6 |
| pass | 4331769 |
|
2019-09-24 18:48:09 | 2019-09-24 22:37:17 | 2019-09-24 23:43:17 | 1:06:00 | 0:44:12 | 0:21:48 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 |
| pass | 4331770 |
|
2019-09-24 18:48:10 | 2019-09-24 22:37:18 | 2019-09-24 23:25:17 | 0:47:59 | 0:23:49 | 0:24:10 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| fail | 4331771 |
|
2019-09-24 18:48:11 | 2019-09-24 22:38:07 | 2019-09-25 04:38:12 | 6:00:05 | 0:57:22 | 5:02:43 | smithi | master | centos | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml} | 6 |
Failure Reason:
[Errno 104] Connection reset by peer |
||||||||||||||
| fail | 4331772 |
|
2019-09-24 18:48:12 | 2019-09-24 22:39:01 | 2019-09-24 23:59:01 | 1:20:00 | 0:58:31 | 0:21:29 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 |
Failure Reason:
"2019-09-24T23:33:33.332344+0000 mon.a (mon.0) 1825 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569368011 sec, osd.2 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331773 |
|
2019-09-24 18:48:12 | 2019-09-24 22:39:01 | 2019-09-24 23:25:01 | 0:46:00 | 0:33:18 | 0:12:42 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331774 |
|
2019-09-24 18:48:13 | 2019-09-24 22:39:12 | 2019-09-25 00:05:12 | 1:26:00 | 0:38:56 | 0:47:04 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml} | 6 |
| pass | 4331775 |
|
2019-09-24 18:48:14 | 2019-09-24 22:39:22 | 2019-09-24 23:39:22 | 1:00:00 | 0:20:34 | 0:39:26 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 |
| pass | 4331776 |
|
2019-09-24 18:48:15 | 2019-09-24 22:41:12 | 2019-09-25 00:07:13 | 1:26:01 | 0:36:14 | 0:49:47 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 |
| pass | 4331777 |
|
2019-09-24 18:48:16 | 2019-09-24 22:41:13 | 2019-09-25 09:21:23 | 10:40:10 | 0:32:41 | 10:07:29 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml} | 6 |
| pass | 4331778 |
|
2019-09-24 18:48:17 | 2019-09-24 22:42:08 | 2019-09-24 23:50:08 | 1:08:00 | 0:57:41 | 0:10:19 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331779 |
|
2019-09-24 18:48:18 | 2019-09-24 22:42:34 | 2019-09-24 23:24:34 | 0:42:00 | 0:20:29 | 0:21:31 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 |
| pass | 4331780 |
|
2019-09-24 18:48:19 | 2019-09-24 22:42:52 | 2019-09-25 03:16:55 | 4:34:03 | 0:36:49 | 3:57:14 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml} | 6 |
| pass | 4331781 |
|
2019-09-24 18:48:19 | 2019-09-24 22:44:13 | 2019-09-24 23:28:13 | 0:44:00 | 0:13:07 | 0:30:53 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331782 |
|
2019-09-24 18:48:20 | 2019-09-24 22:47:06 | 2019-09-24 23:47:06 | 1:00:00 | 0:21:37 | 0:38:23 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 |
| pass | 4331783 |
|
2019-09-24 18:48:21 | 2019-09-24 22:47:18 | 2019-09-25 03:47:22 | 5:00:04 | 0:40:36 | 4:19:28 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml} | 6 |
| pass | 4331784 |
|
2019-09-24 18:48:22 | 2019-09-24 22:47:25 | 2019-09-24 23:19:24 | 0:31:59 | 0:12:51 | 0:19:08 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 |
| pass | 4331785 |
|
2019-09-24 18:48:23 | 2019-09-24 22:51:06 | 2019-09-24 23:25:05 | 0:33:59 | 0:18:36 | 0:15:23 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 |
| pass | 4331786 |
|
2019-09-24 18:48:24 | 2019-09-24 22:51:07 | 2019-09-25 00:15:07 | 1:24:00 | 0:34:40 | 0:49:20 | smithi | master | centos | 7.6 | kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 |
| pass | 4331787 |
|
2019-09-24 18:48:25 | 2019-09-24 22:51:14 | 2019-09-25 08:33:23 | 9:42:09 | 0:23:34 | 9:18:35 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml} | 6 |
| pass | 4331788 |
|
2019-09-24 18:48:26 | 2019-09-24 22:53:20 | 2019-09-24 23:25:20 | 0:32:00 | 0:20:26 | 0:11:34 | smithi | master | centos | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331789 |
|
2019-09-24 18:48:27 | 2019-09-24 22:53:28 | 2019-09-24 23:39:27 | 0:45:59 | 0:28:12 | 0:17:47 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 |
| pass | 4331790 |
|
2019-09-24 18:48:28 | 2019-09-24 22:55:27 | 2019-09-25 03:39:31 | 4:44:04 | 0:26:36 | 4:17:28 | smithi | master | centos | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml} | 6 |
| pass | 4331791 |
|
2019-09-24 18:48:29 | 2019-09-24 22:57:27 | 2019-09-24 23:45:27 | 0:48:00 | 0:40:21 | 0:07:39 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 |
| pass | 4331792 |
|
2019-09-24 18:48:30 | 2019-09-24 22:57:28 | 2019-09-24 23:35:27 | 0:37:59 | 0:21:15 | 0:16:44 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 |
| pass | 4331793 |
|
2019-09-24 18:48:31 | 2019-09-24 22:57:27 | 2019-09-25 02:39:30 | 3:42:03 | 0:22:06 | 3:19:57 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml} | 6 |
| fail | 4331794 |
|
2019-09-24 18:48:32 | 2019-09-24 22:58:23 | 2019-09-25 00:04:23 | 1:06:00 | 0:53:18 | 0:12:42 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 |
Failure Reason:
"2019-09-24T23:31:40.411826+0000 mon.a (mon.0) 322 : cluster [WRN] Health check failed: 4 slow ops, oldest one blocked for 1569367898 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331795 |
|
2019-09-24 18:48:33 | 2019-09-24 23:01:21 | 2019-09-24 23:49:21 | 0:48:00 | 0:34:11 | 0:13:49 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331796 |
|
2019-09-24 18:48:34 | 2019-09-24 23:01:21 | 2019-09-25 08:35:30 | 9:34:09 | 0:33:37 | 9:00:32 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml} | 6 |
| pass | 4331797 |
|
2019-09-24 18:48:35 | 2019-09-24 23:01:21 | 2019-09-24 23:59:21 | 0:58:00 | 0:39:21 | 0:18:39 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 |
| pass | 4331798 |
|
2019-09-24 18:48:36 | 2019-09-24 23:03:43 | 2019-09-24 23:51:43 | 0:48:00 | 0:35:39 | 0:12:21 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331799 |
|
2019-09-24 18:48:36 | 2019-09-24 23:05:17 | 2019-09-25 02:57:20 | 3:52:03 | 0:24:58 | 3:27:05 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml} | 6 |
| fail | 4331800 |
|
2019-09-24 18:48:37 | 2019-09-24 23:05:17 | 2019-09-25 00:09:17 | 1:04:00 | 0:35:25 | 0:28:35 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 |
Failure Reason:
"2019-09-25T00:02:38.981808+0000 mon.b (mon.0) 372 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569369756 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331801 |
|
2019-09-24 18:48:38 | 2019-09-24 23:05:17 | 2019-09-25 00:43:18 | 1:38:01 | 0:26:34 | 1:11:27 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 |
| pass | 4331802 |
|
2019-09-24 18:48:39 | 2019-09-24 23:08:23 | 2019-09-25 04:04:26 | 4:56:03 | 0:26:24 | 4:29:39 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml} | 6 |
| pass | 4331803 |
|
2019-09-24 18:48:40 | 2019-09-24 23:09:20 | 2019-09-25 00:47:21 | 1:38:01 | 0:19:03 | 1:18:58 | smithi | master | ubuntu | 18.04 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331804 |
|
2019-09-24 18:48:41 | 2019-09-24 23:09:58 | 2019-09-24 23:55:58 | 0:46:00 | 0:26:57 | 0:19:03 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 |
| fail | 4331805 |
|
2019-09-24 18:48:42 | 2019-09-24 23:10:52 | 2019-09-25 00:56:53 | 1:46:01 | 0:35:04 | 1:10:57 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml} | 6 |
Failure Reason:
Test failure: test_files_throttle (tasks.cephfs.test_strays.TestStrays) |
||||||||||||||
| pass | 4331806 |
|
2019-09-24 18:48:43 | 2019-09-24 23:14:22 | 2019-09-24 23:48:21 | 0:33:59 | 0:25:45 | 0:08:14 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331807 |
|
2019-09-24 18:48:44 | 2019-09-24 23:16:01 | 2019-09-24 23:48:00 | 0:31:59 | 0:14:50 | 0:17:09 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 |
| fail | 4331808 |
|
2019-09-24 18:48:44 | 2019-09-24 23:16:08 | 2019-09-25 04:46:18 | 5:30:10 | 0:24:33 | 5:05:37 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml} | 6 |
Failure Reason:
Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient) |
||||||||||||||
| pass | 4331809 |
|
2019-09-24 18:48:45 | 2019-09-24 23:19:29 | 2019-09-25 00:01:28 | 0:41:59 | 0:30:04 | 0:11:55 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 |
| pass | 4331810 |
|
2019-09-24 18:48:46 | 2019-09-24 23:19:29 | 2019-09-25 00:29:29 | 1:10:00 | 0:30:07 | 0:39:53 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 |
| pass | 4331811 |
|
2019-09-24 18:48:47 | 2019-09-24 23:19:29 | 2019-09-25 00:49:29 | 1:30:00 | 1:00:09 | 0:29:51 | smithi | master | rhel | 7.6 | kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 |
| pass | 4331812 |
|
2019-09-24 18:48:48 | 2019-09-24 23:19:29 | 2019-09-25 04:25:33 | 5:06:04 | 0:22:27 | 4:43:37 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml} | 6 |
| pass | 4331813 |
|
2019-09-24 18:48:49 | 2019-09-24 23:19:32 | 2019-09-25 00:19:32 | 1:00:00 | 0:48:09 | 0:11:51 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331814 |
|
2019-09-24 18:48:50 | 2019-09-24 23:21:21 | 2019-09-25 00:19:21 | 0:58:00 | 0:47:18 | 0:10:42 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 |
| pass | 4331815 |
|
2019-09-24 18:48:51 | 2019-09-24 23:21:21 | 2019-09-25 01:23:22 | 2:02:01 | 0:29:18 | 1:32:43 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml} | 6 |
| pass | 4331816 |
|
2019-09-24 18:48:52 | 2019-09-24 23:23:32 | 2019-09-25 00:29:32 | 1:06:00 | 0:30:10 | 0:35:50 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 |
| pass | 4331817 |
|
2019-09-24 18:48:53 | 2019-09-24 23:23:32 | 2019-09-25 00:23:31 | 0:59:59 | 0:39:33 | 0:20:26 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 |
| pass | 4331818 |
|
2019-09-24 18:48:54 | 2019-09-24 23:24:49 | 2019-09-25 02:48:51 | 3:24:02 | 0:26:11 | 2:57:51 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml} | 6 |
| fail | 4331819 |
|
2019-09-24 18:48:55 | 2019-09-24 23:25:00 | 2019-09-25 01:03:00 | 1:38:00 | 1:03:41 | 0:34:19 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 |
Failure Reason:
"2019-09-25T00:42:29.344851+0000 mon.b (mon.0) 1653 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569372148 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331820 |
|
2019-09-24 18:48:56 | 2019-09-24 23:25:02 | 2019-09-25 00:17:02 | 0:52:00 | 0:13:47 | 0:38:13 | smithi | master | ubuntu | 18.04 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| fail | 4331821 |
|
2019-09-24 18:48:57 | 2019-09-24 23:25:07 | 2019-09-25 03:25:10 | 4:00:03 | 0:57:14 | 3:02:49 | smithi | master | centos | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml} | 6 |
Failure Reason:
[Errno 104] Connection reset by peer |
||||||||||||||
| pass | 4331822 |
|
2019-09-24 18:48:58 | 2019-09-24 23:25:19 | 2019-09-25 00:37:19 | 1:12:00 | 1:03:42 | 0:08:18 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 |
| fail | 4331823 |
|
2019-09-24 18:48:59 | 2019-09-24 23:25:19 | 2019-09-25 00:39:19 | 1:14:00 | 1:00:52 | 0:13:08 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 |
Failure Reason:
"2019-09-24T23:52:36.907536+0000 mon.a (mon.0) 561 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 180 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 4331824 |
|
2019-09-24 18:49:00 | 2019-09-24 23:25:20 | 2019-09-25 01:17:21 | 1:52:01 | 0:17:21 | 1:34:40 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml} | 6 |
Failure Reason:
{'smithi174.front.sepia.ceph.com': {'attempts': 5, 'changed': True, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}} |
||||||||||||||
| pass | 4331825 |
|
2019-09-24 18:49:00 | 2019-09-24 23:25:21 | 2019-09-25 00:35:21 | 1:10:00 | 0:26:40 | 0:43:20 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 |
| pass | 4331826 |
|
2019-09-24 18:49:01 | 2019-09-24 23:25:26 | 2019-09-24 23:55:26 | 0:30:00 | 0:18:06 | 0:11:54 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 |
| pass | 4331827 |
|
2019-09-24 18:49:02 | 2019-09-24 23:27:35 | 2019-09-25 01:47:36 | 2:20:01 | 0:22:32 | 1:57:29 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml} | 6 |
| pass | 4331828 |
|
2019-09-24 18:49:03 | 2019-09-24 23:28:08 | 2019-09-25 00:20:08 | 0:52:00 | 0:44:39 | 0:07:21 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331829 |
|
2019-09-24 18:49:04 | 2019-09-24 23:28:14 | 2019-09-25 00:08:14 | 0:40:00 | 0:31:23 | 0:08:37 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 |
| dead | 4331830 |
|
2019-09-24 18:49:05 | 2019-09-24 23:28:55 | 2019-09-25 11:31:08 | 12:02:13 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml} | — | ||
| pass | 4331831 |
|
2019-09-24 18:49:06 | 2019-09-24 23:29:19 | 2019-09-25 00:01:18 | 0:31:59 | 0:15:00 | 0:16:59 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331832 |
|
2019-09-24 18:49:07 | 2019-09-24 23:29:30 | 2019-09-25 00:17:30 | 0:48:00 | 0:30:49 | 0:17:11 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 |
| pass | 4331833 |
|
2019-09-24 18:49:07 | 2019-09-24 23:31:38 | 2019-09-25 05:13:43 | 5:42:05 | 0:27:11 | 5:14:54 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml} | 6 |
| pass | 4331834 |
|
2019-09-24 18:49:08 | 2019-09-24 23:35:43 | 2019-09-25 00:21:43 | 0:46:00 | 0:12:41 | 0:33:19 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 |
| pass | 4331835 |
|
2019-09-24 18:49:09 | 2019-09-24 23:37:17 | 2019-09-25 00:15:17 | 0:38:00 | 0:30:58 | 0:07:02 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 |
| pass | 4331836 |
|
2019-09-24 18:49:10 | 2019-09-24 23:39:25 | 2019-09-25 00:57:25 | 1:18:00 | 0:40:30 | 0:37:30 | smithi | master | rhel | 7.6 | kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 |
| pass | 4331837 |
|
2019-09-24 18:49:11 | 2019-09-24 23:39:25 | 2019-09-25 01:13:25 | 1:34:00 | 0:25:38 | 1:08:22 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml} | 6 |
| pass | 4331838 |
|
2019-09-24 18:49:12 | 2019-09-24 23:39:29 | 2019-09-25 00:23:28 | 0:43:59 | 0:33:15 | 0:10:44 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331839 |
|
2019-09-24 18:49:13 | 2019-09-24 23:39:31 | 2019-09-25 00:25:31 | 0:46:00 | 0:30:38 | 0:15:22 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 |
| pass | 4331840 |
|
2019-09-24 18:49:14 | 2019-09-24 23:41:32 | 2019-09-25 02:51:34 | 3:10:02 | 0:21:55 | 2:48:07 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml} | 6 |
| pass | 4331841 |
|
2019-09-24 18:49:14 | 2019-09-24 23:43:33 | 2019-09-25 00:39:33 | 0:56:00 | 0:45:48 | 0:10:12 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 |
| pass | 4331842 |
|
2019-09-24 18:49:15 | 2019-09-24 23:43:33 | 2019-09-25 00:33:33 | 0:50:00 | 0:24:46 | 0:25:14 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 |
| pass | 4331843 |
|
2019-09-24 18:49:16 | 2019-09-24 23:45:06 | 2019-09-25 01:43:07 | 1:58:01 | 0:38:43 | 1:19:18 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml} | 6 |
| pass | 4331844 |
|
2019-09-24 18:49:17 | 2019-09-24 23:45:29 | 2019-09-25 00:51:29 | 1:06:00 | 0:56:10 | 0:09:50 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 |
| pass | 4331845 |
|
2019-09-24 18:49:18 | 2019-09-24 23:47:35 | 2019-09-25 01:11:35 | 1:24:00 | 1:06:25 | 0:17:35 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331846 |
|
2019-09-24 18:49:19 | 2019-09-24 23:48:01 | 2019-09-25 04:04:05 | 4:16:04 | 0:31:17 | 3:44:47 | smithi | master | centos | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml} | 6 |
| pass | 4331847 |
|
2019-09-24 18:49:20 | 2019-09-24 23:48:38 | 2019-09-25 00:40:37 | 0:51:59 | 0:40:20 | 0:11:39 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 |
| fail | 4331848 |
|
2019-09-24 18:49:21 | 2019-09-24 23:49:22 | 2019-09-25 01:09:22 | 1:20:00 | 1:12:09 | 0:07:51 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 |
Failure Reason:
"2019-09-25T00:25:51.841537+0000 mon.a (mon.0) 152 : cluster [WRN] Health check failed: 80 slow ops, oldest one blocked for 182 sec, daemons [osd,0,osd,3] have slow ops. (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331849 |
|
2019-09-24 18:49:22 | 2019-09-24 23:49:22 | 2019-09-25 03:31:25 | 3:42:03 | 0:26:46 | 3:15:17 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml} | 6 |
| pass | 4331850 |
|
2019-09-24 18:49:23 | 2019-09-24 23:50:24 | 2019-09-25 00:50:23 | 0:59:59 | 0:20:13 | 0:39:46 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 |
| fail | 4331851 |
|
2019-09-24 18:49:23 | 2019-09-24 23:50:56 | 2019-09-25 00:40:55 | 0:49:59 | 0:37:51 | 0:12:08 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 |
Failure Reason:
"2019-09-25T00:26:38.169503+0000 mon.b (mon.0) 143 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569371195 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 4331852 |
|
2019-09-24 18:49:24 | 2019-09-24 23:51:59 | 2019-09-25 07:34:06 | 7:42:07 | 0:04:59 | 7:37:08 | smithi | master | centos | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml} | 6 |
Failure Reason:
bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.573396', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.jaleco.com', u' * epel: ftp.linux.ncsu.edu', u' * extras: ftp.osuosl.org', u' * updates: mirror.umd.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-09-25 07:31:51.867739', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi090.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-09-25 07:31:59.366720', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.jaleco.com\n * epel: ftp.linux.ncsu.edu\n * extras: ftp.osuosl.org\n * updates: mirror.jaleco.com\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:06.323770', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.jaleco.com', u' * epel: ftp.linux.ncsu.edu', u' * extras: ftp.osuosl.org', u' * updates: mirror.jaleco.com', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-09-25 07:31:53.042950', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi115.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-09-25 07:32:05.549221', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.jaleco.com\n * epel: ftp.linux.ncsu.edu\n * extras: ftp.osuosl.org\n * updates: mirror.jaleco.com\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:06.241507', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.jaleco.com', u' * epel: ftp.linux.ncsu.edu', u' * extras: ftp.osuosl.org', u' * updates: mirror.jaleco.com', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-09-25 07:31:59.307714', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi140.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-09-25 07:32:20.932363', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.jaleco.com\n * epel: ftp.linux.ncsu.edu\n * extras: ftp.osuosl.org\n * updates: mirror.umd.edu\nhttp://mirror.jaleco.com/centos/7.7.1908/os/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 503 - Service Unavailable\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.310845', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.jaleco.com', u' * epel: ftp.linux.ncsu.edu', u' * extras: ftp.osuosl.org', u' * updates: mirror.umd.edu', u'http://mirror.jaleco.com/centos/7.7.1908/os/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 503 - Service Unavailable', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-09-25 07:32:15.621518', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi175.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-09-25 07:32:28.271342', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.jaleco.com\n * epel: ftp.linux.ncsu.edu\n * extras: centos4.zswap.net\n * updates: mirror.jaleco.com\nhttp://mirror.jaleco.com/centos/7.7.1908/os/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 503 - Service Unavailable\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:04.997233', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.jaleco.com', u' * epel: ftp.linux.ncsu.edu', u' * extras: centos4.zswap.net', u' * updates: mirror.jaleco.com', u'http://mirror.jaleco.com/centos/7.7.1908/os/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 503 - Service Unavailable', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-09-25 07:32:23.274109', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi049.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-09-25 07:32:34.330428', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.jaleco.com\n * epel: ftp.linux.ncsu.edu\n * extras: centos4.zswap.net\n * updates: mirror.umd.edu\nhttp://mirror.jaleco.com/centos/7.7.1908/os/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 503 - Service Unavailable\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.299927', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.jaleco.com', u' * epel: ftp.linux.ncsu.edu', u' * extras: centos4.zswap.net', u' * updates: mirror.umd.edu', u'http://mirror.jaleco.com/centos/7.7.1908/os/x86_64/repodata/repomd.xml: [Errno 14] HTTP Error 503 - Service Unavailable', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-09-25 07:32:29.030501', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction') |
||||||||||||||
| pass | 4331853 |
|
2019-09-24 18:49:25 | 2019-09-24 23:53:39 | 2019-09-25 00:17:38 | 0:23:59 | 0:13:02 | 0:10:57 | smithi | master | ubuntu | 18.04 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331854 |
|
2019-09-24 18:49:26 | 2019-09-24 23:55:41 | 2019-09-25 00:25:40 | 0:29:59 | 0:15:26 | 0:14:33 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 |
| fail | 4331855 |
|
2019-09-24 18:49:27 | 2019-09-24 23:55:59 | 2019-09-25 05:40:04 | 5:44:05 | 0:22:44 | 5:21:21 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml} | 6 |
Failure Reason:
Test failure: test_files_throttle (tasks.cephfs.test_strays.TestStrays) |
||||||||||||||
| pass | 4331856 |
|
2019-09-24 18:49:28 | 2019-09-24 23:57:11 | 2019-09-25 00:33:11 | 0:36:00 | 0:26:41 | 0:09:19 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331857 |
|
2019-09-24 18:49:29 | 2019-09-24 23:59:18 | 2019-09-25 00:39:17 | 0:39:59 | 0:24:00 | 0:15:59 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 |
| fail | 4331858 |
|
2019-09-24 18:49:29 | 2019-09-24 23:59:22 | 2019-09-25 01:23:23 | 1:24:01 | 0:14:57 | 1:09:04 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml} | 6 |
Failure Reason:
Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient) |
||||||||||||||
| pass | 4331859 |
|
2019-09-24 18:49:30 | 2019-09-25 00:01:33 | 2019-09-25 00:33:32 | 0:31:59 | 0:23:32 | 0:08:27 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 |
| fail | 4331860 |
|
2019-09-24 18:49:31 | 2019-09-25 00:01:33 | 2019-09-25 00:53:33 | 0:52:00 | 0:24:04 | 0:27:56 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 |
Failure Reason:
"2019-09-25T00:49:12.032329+0000 mon.a (mon.0) 329 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569372550 sec, osd.2 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| fail | 4331861 |
|
2019-09-24 18:49:32 | 2019-09-25 00:03:22 | 2019-09-25 01:43:22 | 1:40:00 | 0:55:45 | 0:44:15 | smithi | master | rhel | 7.6 | kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 |
Failure Reason:
"2019-09-25T01:06:26.640798+0000 mon.b (mon.0) 143 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569373585 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331862 |
|
2019-09-24 18:49:33 | 2019-09-25 00:04:39 | 2019-09-25 02:20:41 | 2:16:02 | 0:33:24 | 1:42:38 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml} | 6 |
| pass | 4331863 |
|
2019-09-24 18:49:34 | 2019-09-25 00:05:13 | 2019-09-25 01:17:14 | 1:12:01 | 0:54:19 | 0:17:42 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331864 |
|
2019-09-24 18:49:35 | 2019-09-25 00:07:29 | 2019-09-25 00:57:28 | 0:49:59 | 0:35:07 | 0:14:52 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 |
| pass | 4331865 |
|
2019-09-24 18:49:36 | 2019-09-25 00:08:15 | 2019-09-25 01:20:15 | 1:12:00 | 0:12:21 | 0:59:39 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml} | 6 |
| pass | 4331866 |
|
2019-09-24 18:49:37 | 2019-09-25 00:09:33 | 2019-09-25 00:53:33 | 0:44:00 | 0:30:17 | 0:13:43 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 |
| pass | 4331867 |
|
2019-09-24 18:49:38 | 2019-09-25 00:13:31 | 2019-09-25 00:55:30 | 0:41:59 | 0:32:05 | 0:09:54 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 |
| pass | 4331868 |
|
2019-09-24 18:49:39 | 2019-09-25 00:15:23 | 2019-09-25 08:03:30 | 7:48:07 | 0:24:56 | 7:23:11 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml} | 6 |
| pass | 4331869 |
|
2019-09-24 18:49:40 | 2019-09-25 00:15:23 | 2019-09-25 01:19:23 | 1:04:00 | 0:50:17 | 0:13:43 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 |
| pass | 4331870 |
|
2019-09-24 18:49:41 | 2019-09-25 00:17:17 | 2019-09-25 00:57:16 | 0:39:59 | 0:20:42 | 0:19:17 | smithi | master | centos | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| fail | 4331871 |
|
2019-09-24 18:49:42 | 2019-09-25 00:17:31 | 2019-09-25 10:47:41 | 10:30:10 | 1:01:03 | 9:29:07 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml} | 6 |
Failure Reason:
[Errno 104] Connection reset by peer |
||||||||||||||
| fail | 4331872 |
|
2019-09-24 18:49:42 | 2019-09-25 00:17:36 | 2019-09-25 01:27:36 | 1:10:00 | 1:00:51 | 0:09:09 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 |
Failure Reason:
"2019-09-25T00:59:28.375512+0000 mon.b (mon.0) 1292 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569373167 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331873 |
|
2019-09-24 18:49:43 | 2019-09-25 00:17:39 | 2019-09-25 01:07:39 | 0:50:00 | 0:26:30 | 0:23:30 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331874 |
|
2019-09-24 18:49:44 | 2019-09-25 00:19:29 | 2019-09-25 02:21:30 | 2:02:01 | 0:32:12 | 1:29:49 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml} | 6 |
| pass | 4331875 |
|
2019-09-24 18:49:45 | 2019-09-25 00:19:29 | 2019-09-25 00:55:28 | 0:35:59 | 0:26:05 | 0:09:54 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 |
| fail | 4331876 |
|
2019-09-24 18:49:46 | 2019-09-25 00:19:33 | 2019-09-25 01:07:33 | 0:48:00 | 0:33:00 | 0:15:00 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 |
Failure Reason:
"2019-09-25T00:52:59.659698+0000 mon.a (mon.0) 160 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569372777 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331877 |
|
2019-09-24 18:49:47 | 2019-09-25 00:20:09 | 2019-09-25 07:48:16 | 7:28:07 | 0:30:46 | 6:57:21 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml} | 6 |
| pass | 4331878 |
|
2019-09-24 18:49:48 | 2019-09-25 00:21:59 | 2019-09-25 01:15:59 | 0:54:00 | 0:39:42 | 0:14:18 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331879 |
|
2019-09-24 18:49:49 | 2019-09-25 00:23:43 | 2019-09-25 00:53:42 | 0:29:59 | 0:23:07 | 0:06:52 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 |
| pass | 4331880 |
|
2019-09-24 18:49:50 | 2019-09-25 00:23:43 | 2019-09-25 09:17:52 | 8:54:09 | 0:33:58 | 8:20:11 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml} | 6 |
| pass | 4331881 |
|
2019-09-24 18:49:51 | 2019-09-25 00:25:46 | 2019-09-25 00:57:45 | 0:31:59 | 0:18:28 | 0:13:31 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331882 |
|
2019-09-24 18:49:52 | 2019-09-25 00:25:46 | 2019-09-25 00:55:46 | 0:30:00 | 0:21:13 | 0:08:47 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 |
| pass | 4331883 |
|
2019-09-24 18:49:53 | 2019-09-25 00:25:46 | 2019-09-25 03:37:48 | 3:12:02 | 0:45:35 | 2:26:27 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml} | 6 |
| pass | 4331884 |
|
2019-09-24 18:49:54 | 2019-09-25 00:29:29 | 2019-09-25 00:53:29 | 0:24:00 | 0:11:43 | 0:12:17 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 |
| pass | 4331885 |
|
2019-09-24 18:49:55 | 2019-09-25 00:29:31 | 2019-09-25 00:57:30 | 0:27:59 | 0:19:40 | 0:08:19 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 |
| pass | 4331886 |
|
2019-09-24 18:49:56 | 2019-09-25 00:29:33 | 2019-09-25 01:15:33 | 0:46:00 | 0:33:35 | 0:12:25 | smithi | master | ubuntu | 18.04 | kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 |
| pass | 4331887 |
|
2019-09-24 18:49:57 | 2019-09-25 00:31:48 | 2019-09-25 03:23:50 | 2:52:02 | 0:30:48 | 2:21:14 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml} | 6 |
| pass | 4331888 |
|
2019-09-24 18:49:58 | 2019-09-25 00:32:09 | 2019-09-25 01:00:09 | 0:28:00 | 0:16:53 | 0:11:07 | smithi | master | centos | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331889 |
|
2019-09-24 18:49:58 | 2019-09-25 00:33:27 | 2019-09-25 01:13:26 | 0:39:59 | 0:28:59 | 0:11:00 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 |
| fail | 4331890 |
|
2019-09-24 18:49:59 | 2019-09-25 00:33:34 | 2019-09-25 08:01:46 | 7:28:12 | 0:05:11 | 7:23:01 | smithi | master | centos | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml} | 6 |
Failure Reason:
d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.694032', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: linux.cc.lehigh.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.jaleco.com', u' * updates: packages.oit.ncsu.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-09-25 07:59:51.766380', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi090.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-09-25 07:59:58.826957', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: linux.cc.lehigh.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.jaleco.com\n * updates: packages.oit.ncsu.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.092466', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: linux.cc.lehigh.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.jaleco.com', u' * updates: packages.oit.ncsu.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-09-25 07:59:53.734491', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi022.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-09-25 08:00:15.819503', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: linux.cc.lehigh.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.jaleco.com\n * updates: packages.oit.ncsu.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:04.835434', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: linux.cc.lehigh.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.jaleco.com', u' * updates: packages.oit.ncsu.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-09-25 08:00:10.984069', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi115.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-09-25 08:00:21.696587', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: linux.cc.lehigh.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.jaleco.com\n * updates: packages.oit.ncsu.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:04.948286', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: linux.cc.lehigh.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.jaleco.com', u' * updates: packages.oit.ncsu.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-09-25 08:00:16.748301', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi049.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-09-25 08:00:37.682840', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: linux.cc.lehigh.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.jaleco.com\n * updates: packages.oit.ncsu.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.208325', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: linux.cc.lehigh.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.jaleco.com', u' * updates: packages.oit.ncsu.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-09-25 08:00:32.474515', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi175.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-09-25 08:00:46.396904', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: linux.cc.lehigh.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.jaleco.com\n * updates: packages.oit.ncsu.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:04.998081', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: linux.cc.lehigh.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.jaleco.com', u' * updates: packages.oit.ncsu.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8b1da60dedb7cb6a1aeb578746cd4beba4569264b77b81afe8d4f70d50e35d62-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/8a29572711847d94e9080d755e05a87b19408c297a0e2dad4970d094740e8bdb-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-09-25 08:00:41.398823', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction') |
||||||||||||||
| pass | 4331891 |
|
2019-09-24 18:50:00 | 2019-09-25 00:33:34 | 2019-09-25 01:19:34 | 0:46:00 | 0:38:42 | 0:07:18 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 |
| pass | 4331892 |
|
2019-09-24 18:50:01 | 2019-09-25 00:35:42 | 2019-09-25 01:09:40 | 0:33:58 | 0:23:02 | 0:10:56 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 |
| pass | 4331893 |
|
2019-09-24 18:50:02 | 2019-09-25 00:37:34 | 2019-09-25 04:37:37 | 4:00:03 | 0:26:16 | 3:33:47 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml} | 6 |
| pass | 4331894 |
|
2019-09-24 18:50:03 | 2019-09-25 00:39:33 | 2019-09-25 01:35:32 | 0:55:59 | 0:48:13 | 0:07:46 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 |
| pass | 4331895 |
|
2019-09-24 18:50:04 | 2019-09-25 00:39:33 | 2019-09-25 01:29:33 | 0:50:00 | 0:35:52 | 0:14:08 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331896 |
|
2019-09-24 18:50:05 | 2019-09-25 00:39:33 | 2019-09-25 05:59:37 | 5:20:04 | 0:31:34 | 4:48:30 | smithi | master | centos | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml} | 6 |
| fail | 4331897 |
|
2019-09-24 18:50:05 | 2019-09-25 00:39:34 | 2019-09-25 01:37:34 | 0:58:00 | 0:45:34 | 0:12:26 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 |
Failure Reason:
"2019-09-25T01:05:59.386471+0000 mon.b (mon.0) 155 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569373557 sec, osd.5 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331898 |
|
2019-09-24 18:50:06 | 2019-09-25 00:40:53 | 2019-09-25 01:36:53 | 0:56:00 | 0:40:05 | 0:15:55 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331899 |
|
2019-09-24 18:50:07 | 2019-09-25 00:40:57 | 2019-09-25 02:54:58 | 2:14:01 | 0:26:33 | 1:47:28 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml} | 6 |
| fail | 4331900 |
|
2019-09-24 18:50:08 | 2019-09-25 00:41:46 | 2019-09-25 01:13:45 | 0:31:59 | 0:14:48 | 0:17:11 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 |
Failure Reason:
"2019-09-25T01:05:56.597109+0000 mon.b (mon.0) 154 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569373554 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331901 |
|
2019-09-24 18:50:09 | 2019-09-25 00:43:34 | 2019-09-25 01:27:34 | 0:44:00 | 0:28:15 | 0:15:45 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 |
| pass | 4331902 |
|
2019-09-24 18:50:10 | 2019-09-25 00:47:36 | 2019-09-25 05:13:40 | 4:26:04 | 0:15:43 | 4:10:21 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml} | 6 |
| pass | 4331903 |
|
2019-09-24 18:50:11 | 2019-09-25 00:49:44 | 2019-09-25 01:15:43 | 0:25:59 | 0:16:13 | 0:09:46 | smithi | master | centos | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331904 |
|
2019-09-24 18:50:12 | 2019-09-25 00:50:25 | 2019-09-25 01:30:24 | 0:39:59 | 0:27:22 | 0:12:37 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 |
| dead | 4331905 |
|
2019-09-24 18:50:13 | 2019-09-25 00:51:43 | 2019-09-25 12:53:56 | 12:02:13 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml} | — | ||
| pass | 4331906 |
|
2019-09-24 18:50:14 | 2019-09-25 00:53:44 | 2019-09-25 01:27:43 | 0:33:59 | 0:27:45 | 0:06:14 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331907 |
|
2019-09-24 18:50:14 | 2019-09-25 00:53:44 | 2019-09-25 01:15:43 | 0:21:59 | 0:12:27 | 0:09:32 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 |
| fail | 4331908 |
|
2019-09-24 18:50:15 | 2019-09-25 00:53:44 | 2019-09-25 11:23:54 | 10:30:10 | 0:23:17 | 10:06:53 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml} | 6 |
Failure Reason:
Test failure: test_data_isolated (tasks.cephfs.test_volume_client.TestVolumeClient) |
||||||||||||||
| pass | 4331909 |
|
2019-09-24 18:50:16 | 2019-09-25 00:53:44 | 2019-09-25 01:27:43 | 0:33:59 | 0:26:06 | 0:07:53 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 |
| pass | 4331910 |
|
2019-09-24 18:50:17 | 2019-09-25 00:55:43 | 2019-09-25 01:23:43 | 0:28:00 | 0:10:55 | 0:17:05 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 |
| fail | 4331911 |
|
2019-09-24 18:50:18 | 2019-09-25 00:55:44 | 2019-09-25 02:13:44 | 1:18:00 | 1:00:41 | 0:17:19 | smithi | master | rhel | 7.6 | kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_dbench_iozone.yaml} | 4 |
Failure Reason:
"2019-09-25T01:33:37.953005+0000 mon.a (mon.0) 150 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569375216 sec, osd.0 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331912 |
|
2019-09-24 18:50:19 | 2019-09-25 00:55:47 | 2019-09-25 02:21:47 | 1:26:00 | 0:29:28 | 0:56:32 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/auto-repair.yaml} | 6 |
| pass | 4331913 |
|
2019-09-24 18:50:20 | 2019-09-25 00:57:08 | 2019-09-25 01:45:08 | 0:48:00 | 0:40:08 | 0:07:52 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331914 |
|
2019-09-24 18:50:20 | 2019-09-25 00:57:11 | 2019-09-25 01:49:11 | 0:52:00 | 0:39:43 | 0:12:17 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 |
| pass | 4331915 |
|
2019-09-24 18:50:21 | 2019-09-25 00:57:18 | 2019-09-25 02:47:18 | 1:50:00 | 0:12:22 | 1:37:38 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/backtrace.yaml} | 6 |
| pass | 4331916 |
|
2019-09-24 18:50:22 | 2019-09-25 00:57:26 | 2019-09-25 01:53:26 | 0:56:00 | 0:36:57 | 0:19:03 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 |
| pass | 4331917 |
|
2019-09-24 18:50:23 | 2019-09-25 00:57:30 | 2019-09-25 01:43:29 | 0:45:59 | 0:36:45 | 0:09:14 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 |
| pass | 4331918 |
|
2019-09-24 18:50:24 | 2019-09-25 00:57:31 | 2019-09-25 02:17:32 | 1:20:01 | 0:42:03 | 0:37:58 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-limits.yaml} | 6 |
| fail | 4331919 |
|
2019-09-24 18:50:25 | 2019-09-25 00:57:47 | 2019-09-25 02:21:47 | 1:24:00 | 1:03:18 | 0:20:42 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 |
Failure Reason:
"2019-09-25T01:40:12.240220+0000 mon.b (mon.0) 192 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569375610 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331920 |
|
2019-09-24 18:50:26 | 2019-09-25 01:00:24 | 2019-09-25 01:34:24 | 0:34:00 | 0:14:14 | 0:19:46 | smithi | master | ubuntu | 18.04 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| fail | 4331921 |
|
2019-09-24 18:50:27 | 2019-09-25 01:03:17 | 2019-09-25 09:37:25 | 8:34:08 | 0:52:52 | 7:41:16 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/client-recovery.yaml} | 6 |
Failure Reason:
[Errno 104] Connection reset by peer |
||||||||||||||
| pass | 4331922 |
|
2019-09-24 18:50:28 | 2019-09-25 01:05:03 | 2019-09-25 02:11:03 | 1:06:00 | 0:55:11 | 0:10:49 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 |
| pass | 4331923 |
|
2019-09-24 18:50:29 | 2019-09-25 01:07:49 | 2019-09-25 01:53:48 | 0:45:59 | 0:31:53 | 0:14:06 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331924 |
|
2019-09-24 18:50:30 | 2019-09-25 01:07:49 | 2019-09-25 04:35:51 | 3:28:02 | 0:25:20 | 3:02:42 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/config-commands.yaml} | 6 |
| fail | 4331925 |
|
2019-09-24 18:50:31 | 2019-09-25 01:09:37 | 2019-09-25 01:45:36 | 0:35:59 | 0:28:07 | 0:07:52 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 |
Failure Reason:
"2019-09-25T01:39:24.850840+0000 mon.a (mon.0) 165 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569375562 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331926 |
|
2019-09-24 18:50:32 | 2019-09-25 01:09:42 | 2019-09-25 01:43:41 | 0:33:59 | 0:19:19 | 0:14:40 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 |
| pass | 4331927 |
|
2019-09-24 18:50:33 | 2019-09-25 01:11:51 | 2019-09-25 02:27:51 | 1:16:00 | 0:52:59 | 0:23:01 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/damage.yaml} | 6 |
| pass | 4331928 |
|
2019-09-24 18:50:34 | 2019-09-25 01:13:41 | 2019-09-25 02:27:41 | 1:14:00 | 1:07:19 | 0:06:41 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331929 |
|
2019-09-24 18:50:35 | 2019-09-25 01:13:41 | 2019-09-25 01:49:41 | 0:36:00 | 0:26:37 | 0:09:23 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 |
| pass | 4331930 |
|
2019-09-24 18:50:36 | 2019-09-25 01:13:47 | 2019-09-25 02:15:47 | 1:02:00 | 0:53:21 | 0:08:39 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/data-scan.yaml} | 6 |
| pass | 4331931 |
|
2019-09-24 18:50:36 | 2019-09-25 01:15:48 | 2019-09-25 01:43:48 | 0:28:00 | 0:17:21 | 0:10:39 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 |
| fail | 4331932 |
|
2019-09-24 18:50:37 | 2019-09-25 01:15:49 | 2019-09-25 01:39:48 | 0:23:59 | 0:17:03 | 0:06:56 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 |
Failure Reason:
{'smithi174.front.sepia.ceph.com': {'attempts': 5, 'changed': True, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}} |
||||||||||||||
| pass | 4331933 |
|
2019-09-24 18:50:38 | 2019-09-25 01:15:49 | 2019-09-25 03:35:50 | 2:20:01 | 0:28:00 | 1:52:01 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/failover.yaml} | 6 |
| pass | 4331934 |
|
2019-09-24 18:50:39 | 2019-09-25 01:16:00 | 2019-09-25 01:45:59 | 0:29:59 | 0:12:40 | 0:17:19 | smithi | master | centos | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 |
| pass | 4331935 |
|
2019-09-24 18:50:40 | 2019-09-25 01:17:29 | 2019-09-25 01:49:29 | 0:32:00 | 0:25:58 | 0:06:02 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_direct_io.yaml} | 3 |
| pass | 4331936 |
|
2019-09-24 18:50:41 | 2019-09-25 01:17:29 | 2019-09-25 02:15:29 | 0:58:00 | 0:44:57 | 0:13:03 | smithi | master | rhel | 7.6 | kcephfs/mixed-clients/{begin.yaml clusters/1-mds-2-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient-overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml} | 4 |
| pass | 4331937 |
|
2019-09-24 18:50:42 | 2019-09-25 01:19:38 | 2019-09-25 03:29:39 | 2:10:01 | 0:31:21 | 1:38:40 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/forward-scrub.yaml} | 6 |
| pass | 4331938 |
|
2019-09-24 18:50:43 | 2019-09-25 01:19:38 | 2019-09-25 02:07:38 | 0:48:00 | 0:32:12 | 0:15:48 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/default.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331939 |
|
2019-09-24 18:50:44 | 2019-09-25 01:20:17 | 2019-09-25 02:04:17 | 0:44:00 | 0:31:11 | 0:12:49 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_kernel_untar_build.yaml} | 3 |
| pass | 4331940 |
|
2019-09-24 18:50:45 | 2019-09-25 01:23:40 | 2019-09-25 05:11:47 | 3:48:07 | 0:22:14 | 3:25:53 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/journal-repair.yaml} | 6 |
| pass | 4331941 |
|
2019-09-24 18:50:46 | 2019-09-25 01:23:40 | 2019-09-25 02:19:39 | 0:55:59 | 0:44:56 | 0:11:03 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_misc.yaml} | 3 |
| pass | 4331942 |
|
2019-09-24 18:50:47 | 2019-09-25 01:23:44 | 2019-09-25 01:55:44 | 0:32:00 | 0:20:43 | 0:11:17 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_o_trunc.yaml} | 3 |
| pass | 4331943 |
|
2019-09-24 18:50:48 | 2019-09-25 01:25:21 | 2019-09-25 02:53:21 | 1:28:00 | 0:24:48 | 1:03:12 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-flush.yaml} | 6 |
| fail | 4331944 |
|
2019-09-24 18:50:49 | 2019-09-25 01:27:36 | 2019-09-25 02:41:36 | 1:14:00 | 1:05:31 | 0:08:29 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_snaps.yaml} | 3 |
Failure Reason:
"2019-09-25T02:10:26.191410+0000 mon.a (mon.0) 350 : cluster [WRN] Health check failed: 1 slow ops, oldest one blocked for 1569377425 sec, osd.4 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331945 |
|
2019-09-24 18:50:49 | 2019-09-25 01:27:37 | 2019-09-25 02:47:38 | 1:20:01 | 1:07:23 | 0:12:38 | smithi | master | rhel | 7.6 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mds.yaml workloads/kclient_workunit_suites_ffsb.yaml} | 3 |
| pass | 4331946 |
|
2019-09-24 18:50:50 | 2019-09-25 01:27:59 | 2019-09-25 04:06:00 | 2:38:01 | 0:25:03 | 2:12:58 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/mds-full.yaml} | 6 |
| pass | 4331947 |
|
2019-09-24 18:50:51 | 2019-09-25 01:27:59 | 2019-09-25 02:27:58 | 0:59:59 | 0:40:33 | 0:19:26 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_dbench.yaml} | 3 |
| fail | 4331948 |
|
2019-09-24 18:50:52 | 2019-09-25 01:29:48 | 2019-09-25 02:45:48 | 1:16:00 | 1:04:56 | 0:11:04 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_ffsb.yaml} | 3 |
Failure Reason:
"2019-09-25T02:08:42.719557+0000 mon.b (mon.0) 474 : cluster [WRN] Health check failed: 58 slow ops, oldest one blocked for 181 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log |
||||||||||||||
| pass | 4331949 |
|
2019-09-24 18:50:53 | 2019-09-25 01:30:26 | 2019-09-25 02:24:26 | 0:54:00 | 0:21:39 | 0:32:21 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/pool-perm.yaml} | 6 |
| pass | 4331950 |
|
2019-09-24 18:50:54 | 2019-09-25 01:34:41 | 2019-09-25 02:16:40 | 0:41:59 | 0:30:31 | 0:11:28 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsstress.yaml} | 3 |
| fail | 4331951 |
|
2019-09-24 18:50:55 | 2019-09-25 01:35:34 | 2019-09-25 02:05:33 | 0:29:59 | 0:19:28 | 0:10:31 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsx.yaml} | 3 |
Failure Reason:
{'smithi174.front.sepia.ceph.com': {'attempts': 5, 'changed': True, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result"}} |
||||||||||||||
| pass | 4331952 |
|
2019-09-24 18:50:56 | 2019-09-25 01:37:08 | 2019-09-25 10:49:18 | 9:12:10 | 0:23:03 | 8:49:07 | smithi | master | ubuntu | 18.04 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/sessionmap.yaml} | 6 |
| pass | 4331953 |
|
2019-09-24 18:50:57 | 2019-09-25 01:37:36 | 2019-09-25 02:11:35 | 0:33:59 | 0:18:26 | 0:15:33 | smithi | master | ubuntu | 18.04 | kcephfs/thrash/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml thrash-health-whitelist.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrashers/mon.yaml workloads/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331954 |
|
2019-09-24 18:50:58 | 2019-09-25 01:40:03 | 2019-09-25 02:06:03 | 0:26:00 | 0:12:18 | 0:13:42 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_fsync.yaml} | 3 |
| pass | 4331955 |
|
2019-09-24 18:50:59 | 2019-09-25 01:41:32 | 2019-09-25 10:33:40 | 8:52:08 | 0:36:19 | 8:15:49 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/strays.yaml} | 6 |
| pass | 4331956 |
|
2019-09-24 18:51:00 | 2019-09-25 01:43:22 | 2019-09-25 02:17:21 | 0:33:59 | 0:26:46 | 0:07:13 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_iozone.yaml} | 3 |
| pass | 4331957 |
|
2019-09-24 18:51:00 | 2019-09-25 01:43:24 | 2019-09-25 02:27:23 | 0:43:59 | 0:12:48 | 0:31:11 | smithi | master | ubuntu | 18.04 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_suites_pjd.yaml} | 3 |
| dead | 4331958 |
|
2019-09-24 18:51:01 | 2019-09-25 01:43:31 | 2019-09-25 13:45:43 | 12:02:12 | smithi | master | rhel | 7.6 | kcephfs/recovery/{begin.yaml clusters/1-mds-4-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/volume-client.yaml} | — | ||
| pass | 4331959 |
|
2019-09-24 18:51:02 | 2019-09-25 01:43:43 | 2019-09-25 02:15:42 | 0:31:59 | 0:24:23 | 0:07:36 | smithi | master | rhel | 7.6 | kcephfs/cephfs/{begin.yaml clusters/1-mds-1-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml log-config.yaml osd-asserts.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/kclient_workunit_trivial_sync.yaml} | 3 |
Pulpito