User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|---|
kchai | 2019-10-09 15:12:02 | 2019-10-09 23:24:48 | 2019-10-10 12:53:26 | 13:28:38 | rados | wip-kefu-testing-2019-10-09-1243 | smithi | 0dca793 | 79 | 71 | 72 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
dead | 4371062 | 2019-10-09 15:12:20 | 2019-10-09 15:14:13 | 2019-10-09 15:32:12 | 0:17:59 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371063 | 2019-10-09 15:12:21 | 2019-10-09 15:16:44 | 2019-10-09 15:56:43 | 0:39:59 | 0:27:32 | 0:12:27 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/thrash-eio.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 2 | |
fail | 4371064 | 2019-10-09 15:12:22 | 2019-10-09 15:16:47 | 2019-10-09 16:06:47 | 0:50:00 | 0:35:29 | 0:14:31 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | |
Failure Reason:
"2019-10-09T15:35:23.440049+0000 mon.b (mon.1) 13 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 4371065 | 2019-10-09 15:12:23 | 2019-10-09 15:17:36 | 2019-10-09 15:39:35 | 0:21:59 | smithi | master | rhel | 7.7 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/rados_workunit_loadgen_big.yaml} | — | |||
Failure Reason:
reached maximum tries (60) after waiting for 900 seconds |
||||||||||||||
pass | 4371066 | 2019-10-09 15:12:23 | 2019-10-09 15:19:16 | 2019-10-09 15:53:15 | 0:33:59 | 0:21:27 | 0:12:32 | smithi | master | centos | 7.6 | rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/sync-many.yaml workloads/pool-create-delete.yaml} | 2 | |
pass | 4371067 | 2019-10-09 15:12:24 | 2019-10-09 15:19:25 | 2019-10-09 15:45:24 | 0:25:59 | 0:14:04 | 0:11:55 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} | 2 | |
pass | 4371068 | 2019-10-09 15:12:25 | 2019-10-09 15:19:25 | 2019-10-09 15:53:25 | 0:34:00 | 0:20:41 | 0:13:19 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 2 | |
pass | 4371069 | 2019-10-09 15:12:26 | 2019-10-09 15:19:33 | 2019-10-09 15:47:33 | 0:28:00 | 0:13:33 | 0:14:27 | smithi | master | centos | 7.6 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_7.yaml} tasks/crash.yaml} | 2 | |
fail | 4371070 | 2019-10-09 15:12:27 | 2019-10-09 15:21:35 | 2019-10-09 15:49:34 | 0:27:59 | 0:16:47 | 0:11:12 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/cosbench_64K_read_write.yaml} | 1 | |
Failure Reason:
Command failed on smithi078 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' |
||||||||||||||
dead | 4371071 | 2019-10-09 15:12:27 | 2019-10-09 15:21:46 | 2019-10-09 15:55:46 | 0:34:00 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371072 | 2019-10-09 15:12:28 | 2019-10-09 15:23:11 | 2019-10-09 15:41:10 | 0:17:59 | smithi | master | rhel | 7.7 | rados/singleton-nomsgr/{all/version-number-sanity.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371073 | 2019-10-09 15:12:29 | 2019-10-09 15:25:18 | 2019-10-09 18:25:20 | 3:00:02 | 2:43:21 | 0:16:41 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} | 2 | |
Failure Reason:
"2019-10-09T15:48:41.478512+0000 mon.b (mon.1) 112 : cluster [WRN] Health check update: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
pass | 4371074 | 2019-10-09 15:12:30 | 2019-10-09 15:25:30 | 2019-10-09 15:57:30 | 0:32:00 | 0:21:17 | 0:10:43 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 2 | |
fail | 4371075 | 2019-10-09 15:12:31 | 2019-10-09 15:25:32 | 2019-10-09 15:49:31 | 0:23:59 | 0:08:02 | 0:15:57 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/nautilus.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/few.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} | 4 | |
Failure Reason:
Command failed on smithi198 with status 1: 'sudo yum -y install ceph-daemon' |
||||||||||||||
fail | 4371076 | 2019-10-09 15:12:32 | 2019-10-09 15:25:36 | 2019-10-09 17:15:37 | 1:50:01 | 1:27:23 | 0:22:38 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_workunit_loadgen_mix.yaml} | 2 | |
Failure Reason:
"2019-10-09T15:53:38.679655+0000 mon.b (mon.0) 60 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log |
||||||||||||||
fail | 4371077 | 2019-10-09 15:12:33 | 2019-10-09 15:27:57 | 2019-10-09 18:05:59 | 2:38:02 | 2:27:13 | 0:10:49 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} | 2 | |
Failure Reason:
Command failed on smithi136 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0' |
||||||||||||||
fail | 4371078 | 2019-10-09 15:12:33 | 2019-10-09 15:27:57 | 2019-10-09 16:45:57 | 1:18:00 | 1:06:53 | 0:11:07 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
Failure Reason:
"2019-10-09T15:52:26.363307+0000 mon.a (mon.0) 119 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
dead | 4371079 | 2019-10-09 15:12:34 | 2019-10-09 15:29:54 | 2019-10-09 15:49:53 | 0:19:59 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/cosbench_64K_write.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371080 | 2019-10-09 15:12:35 | 2019-10-09 15:30:06 | 2019-10-09 19:08:09 | 3:38:03 | 3:26:29 | 0:11:34 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} | 2 | |
Failure Reason:
"2019-10-09T15:46:31.993120+0000 mon.b (mon.1) 11 : cluster [WRN] Health check update: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 4371081 | 2019-10-09 15:12:36 | 2019-10-09 15:31:44 | 2019-10-09 15:49:43 | 0:17:59 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371082 | 2019-10-09 15:12:36 | 2019-10-09 15:31:49 | 2019-10-09 15:57:48 | 0:25:59 | 0:09:14 | 0:16:45 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/alloc-hint.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
pass | 4371083 | 2019-10-09 15:12:37 | 2019-10-09 15:31:49 | 2019-10-09 15:51:48 | 0:19:59 | 0:11:46 | 0:08:13 | smithi | master | centos | 7.6 | rados/rest/{mgr-restful.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
fail | 4371084 | 2019-10-09 15:12:38 | 2019-10-09 15:32:14 | 2019-10-09 17:48:15 | 2:16:01 | 2:06:29 | 0:09:32 | smithi | master | centos | 7.6 | rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
Failure Reason:
"2019-10-09T15:48:59.828977+0000 mon.a (mon.0) 26 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
pass | 4371085 | 2019-10-09 15:12:39 | 2019-10-09 15:33:57 | 2019-10-09 16:07:56 | 0:33:59 | 0:22:27 | 0:11:32 | smithi | master | centos | rados/singleton-flat/valgrind-leaks.yaml | 1 | ||
pass | 4371086 | 2019-10-09 15:12:40 | 2019-10-09 15:34:07 | 2019-10-09 15:58:06 | 0:23:59 | 0:12:35 | 0:11:24 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/admin_socket_output.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
pass | 4371087 | 2019-10-09 15:12:41 | 2019-10-09 15:37:34 | 2019-10-09 15:59:33 | 0:21:59 | 0:10:52 | 0:11:07 | smithi | master | ubuntu | 18.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/crush.yaml} | 1 | |
dead | 4371088 | 2019-10-09 15:12:42 | 2019-10-09 15:37:34 | 2019-10-09 16:23:34 | 0:46:00 | smithi | master | rhel | 7.7 | rados/upgrade/mimic-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/mimic.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-nautilus.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} bluestore-bitmap.yaml supported-random-distro$/{rhel_7.yaml} thrashosds-health.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371089 | 2019-10-09 15:12:42 | 2019-10-09 15:41:25 | 2019-10-09 15:59:24 | 0:17:59 | smithi | master | rhel | 7.7 | rados/multimon/{clusters/3.yaml msgr-failures/few.yaml msgr/async-v2only.yaml no_pools.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/mon_clock_no_skews.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371090 | 2019-10-09 15:12:43 | 2019-10-09 15:41:28 | 2019-10-09 16:25:27 | 0:43:59 | 0:27:20 | 0:16:39 | smithi | master | centos | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} | 2 | ||
pass | 4371091 | 2019-10-09 15:12:44 | 2019-10-09 15:41:42 | 2019-10-09 15:59:41 | 0:17:59 | 0:07:42 | 0:10:17 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/admin-socket.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
fail | 4371092 | 2019-10-09 15:12:45 | 2019-10-09 23:24:48 | 2019-10-09 23:56:47 | 0:31:59 | 0:20:02 | 0:11:57 | smithi | master | ubuntu | 18.04 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} | 2 | |
Failure Reason:
Test failure: test_perf_counters_mds_get (tasks.mgr.dashboard.test_perf_counters.PerfCountersControllerTest) |
||||||||||||||
dead | 4371093 | 2019-10-09 15:12:46 | 2019-10-09 23:24:48 | 2019-10-09 23:52:47 | 0:27:59 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371094 | 2019-10-09 15:12:46 | 2019-10-09 23:24:53 | 2019-10-09 23:42:52 | 0:17:59 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371095 | 2019-10-09 15:12:47 | 2019-10-09 23:26:11 | 2019-10-09 23:44:11 | 0:18:00 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371096 | 2019-10-09 15:12:48 | 2019-10-09 23:26:35 | 2019-10-10 00:44:35 | 1:18:00 | 1:03:49 | 0:14:11 | smithi | master | centos | 7.6 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | |
Failure Reason:
Command failed on smithi202 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' |
||||||||||||||
dead | 4371097 | 2019-10-09 15:12:49 | 2019-10-09 23:26:44 | 2019-10-09 23:44:43 | 0:17:59 | smithi | master | rhel | 7.7 | rados/singleton/{all/deduptool.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371098 | 2019-10-09 15:12:50 | 2019-10-09 23:26:53 | 2019-10-09 23:44:52 | 0:17:59 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/fio_4K_rand_read.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371099 | 2019-10-09 15:12:51 | 2019-10-09 23:27:07 | 2019-10-09 23:47:06 | 0:19:59 | smithi | master | rhel | 7.7 | rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/sync.yaml workloads/rados_5925.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371100 | 2019-10-09 15:12:51 | 2019-10-09 23:28:54 | 2019-10-09 23:48:54 | 0:20:00 | smithi | master | rhel | 7.7 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/rados_workunit_loadgen_mostlyread.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371101 | 2019-10-09 15:12:52 | 2019-10-09 23:28:55 | 2019-10-10 11:31:07 | 12:02:12 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/hammer.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} | — | |||
dead | 4371102 | 2019-10-09 15:12:53 | 2019-10-09 23:29:24 | 2019-10-09 23:51:28 | 0:22:04 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/dedup_tier.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371103 | 2019-10-09 15:12:54 | 2019-10-09 23:30:51 | 2019-10-09 23:50:50 | 0:19:59 | smithi | master | rhel | 7.7 | rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371104 | 2019-10-09 15:12:55 | 2019-10-09 23:30:51 | 2019-10-09 23:50:50 | 0:19:59 | smithi | master | rhel | 7.7 | rados/singleton/{all/divergent_priors.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371105 | 2019-10-09 15:12:56 | 2019-10-09 23:30:51 | 2019-10-09 23:50:50 | 0:19:59 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371106 | 2019-10-09 15:12:56 | 2019-10-09 23:30:56 | 2019-10-09 23:54:55 | 0:23:59 | 0:11:58 | 0:12:01 | smithi | master | ubuntu | 18.04 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/failover.yaml} | 2 | |
pass | 4371107 | 2019-10-09 15:12:57 | 2019-10-09 23:32:28 | 2019-10-09 23:58:27 | 0:25:59 | 0:16:04 | 0:09:55 | smithi | master | centos | 7.6 | rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/fio_4K_rand_rw.yaml} | 1 | |
pass | 4371108 | 2019-10-09 15:12:58 | 2019-10-09 23:32:40 | 2019-10-09 23:58:39 | 0:25:59 | 0:16:11 | 0:09:48 | smithi | master | centos | 7.6 | rados/singleton/{all/divergent_priors2.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
fail | 4371109 | 2019-10-09 15:12:59 | 2019-10-09 23:34:48 | 2019-10-10 08:16:56 | 8:42:08 | 0:03:50 | 8:38:18 | smithi | master | centos | 7.6 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 4 | |
Failure Reason:
e778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.002259', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.lug.udel.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.jaleco.com', u' * updates: mirror.math.princeton.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 08:14:54.237393', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi132.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 08:14:59.240633', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.lug.udel.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.jaleco.com\n * updates: mirror.math.princeton.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.229220', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.lug.udel.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.jaleco.com', u' * updates: mirror.math.princeton.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 08:14:54.011413', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi146.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 08:14:59.531471', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.lug.udel.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.jaleco.com\n * updates: mirror.math.princeton.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.100796', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.lug.udel.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.jaleco.com', u' * updates: mirror.math.princeton.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 08:14:54.430675', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi001.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 08:15:01.817860', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: repo.miserver.it.umich.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.jaleco.com\n * updates: mirror.math.princeton.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.324968', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: repo.miserver.it.umich.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.jaleco.com', u' * updates: mirror.math.princeton.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 08:14:56.492892', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction') |
||||||||||||||
dead | 4371110 | 2019-10-09 15:13:00 | 2019-10-09 23:34:48 | 2019-10-09 23:52:48 | 0:18:00 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371111 | 2019-10-09 15:13:01 | 2019-10-09 23:34:50 | 2019-10-10 02:42:52 | 3:08:02 | 2:55:49 | 0:12:13 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 | |
Failure Reason:
"2019-10-09T23:51:26.755335+0000 mon.a (mon.0) 58 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
pass | 4371112 | 2019-10-09 15:13:02 | 2019-10-09 23:34:56 | 2019-10-10 00:04:56 | 0:30:00 | 0:19:55 | 0:10:05 | smithi | master | centos | 7.6 | rados/objectstore/{backends/ceph_objectstore_tool.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
pass | 4371113 | 2019-10-09 15:13:02 | 2019-10-09 23:36:54 | 2019-10-09 23:58:53 | 0:21:59 | 0:12:43 | 0:09:16 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/readwrite.yaml} | 2 | |
pass | 4371114 | 2019-10-09 15:13:03 | 2019-10-09 23:36:54 | 2019-10-10 00:02:53 | 0:25:59 | 0:16:52 | 0:09:07 | smithi | master | centos | 7.6 | rados/singleton/{all/dump-stuck.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
pass | 4371115 | 2019-10-09 15:13:04 | 2019-10-09 23:36:58 | 2019-10-10 00:00:57 | 0:23:59 | 0:14:59 | 0:09:00 | smithi | master | centos | 7.6 | rados/singleton-nomsgr/{all/ceph-kvstore-tool.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
fail | 4371116 | 2019-10-09 15:13:05 | 2019-10-09 23:38:42 | 2019-10-10 01:44:43 | 2:06:01 | 1:52:43 | 0:13:18 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 | |
Failure Reason:
Command failed on smithi069 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_2 16' |
||||||||||||||
pass | 4371117 | 2019-10-09 15:13:06 | 2019-10-09 23:38:42 | 2019-10-10 03:56:45 | 4:18:03 | 0:29:04 | 3:48:59 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/jewel-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 4 | |
dead | 4371118 | 2019-10-09 15:13:07 | 2019-10-09 23:38:44 | 2019-10-09 23:58:43 | 0:19:59 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/fio_4M_rand_read.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371119 | 2019-10-09 15:13:07 | 2019-10-09 23:38:52 | 2019-10-09 23:56:51 | 0:17:59 | smithi | master | rhel | 7.7 | rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371120 | 2019-10-09 15:13:08 | 2019-10-09 23:38:53 | 2019-10-10 02:36:55 | 2:58:02 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371121 | 2019-10-09 15:13:09 | 2019-10-09 23:38:56 | 2019-10-09 23:56:56 | 0:18:00 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371122 | 2019-10-09 15:13:10 | 2019-10-09 23:39:17 | 2019-10-10 00:01:16 | 0:21:59 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371123 | 2019-10-09 15:13:11 | 2019-10-09 23:40:56 | 2019-10-10 00:10:55 | 0:29:59 | 0:19:45 | 0:10:14 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 | |
pass | 4371124 | 2019-10-09 15:13:12 | 2019-10-09 23:40:56 | 2019-10-10 00:24:55 | 0:43:59 | 0:33:31 | 0:10:28 | smithi | master | ubuntu | 18.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/erasure-code.yaml} | 1 | |
pass | 4371125 | 2019-10-09 15:13:12 | 2019-10-09 23:42:54 | 2019-10-10 00:04:53 | 0:21:59 | 0:11:10 | 0:10:49 | smithi | master | ubuntu | 18.04 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/insights.yaml} | 2 | |
fail | 4371126 | 2019-10-09 15:13:13 | 2019-10-09 23:42:54 | 2019-10-10 00:54:54 | 1:12:00 | 0:59:25 | 0:12:35 | smithi | master | centos | 7.6 | rados/multimon/{clusters/6.yaml msgr-failures/many.yaml msgr/async.yaml no_pools.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} tasks/mon_clock_with_skews.yaml} | 2 | |
Failure Reason:
Command failed on smithi092 with status 1: 'sudo ceph --cluster ceph osd crush tunables default' |
||||||||||||||
fail | 4371127 | 2019-10-09 15:13:14 | 2019-10-09 23:42:54 | 2019-10-10 01:16:54 | 1:34:00 | 1:23:38 | 0:10:22 | smithi | master | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} | 2 | |||
Failure Reason:
"2019-10-09T23:59:01.324790+0000 mon.a (mon.0) 46 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
pass | 4371128 | 2019-10-09 15:13:15 | 2019-10-09 23:42:54 | 2019-10-10 00:00:53 | 0:17:59 | 0:07:39 | 0:10:20 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/erasure-code-nonregression.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
fail | 4371129 | 2019-10-09 15:13:16 | 2019-10-09 23:44:26 | 2019-10-10 00:56:26 | 1:12:00 | 0:57:28 | 0:14:32 | smithi | master | ubuntu | 18.04 | rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} | 2 | |
Failure Reason:
Command failed on smithi146 with status 1: 'sudo ceph --cluster ceph osd crush tunables default' |
||||||||||||||
dead | 4371130 | 2019-10-09 15:13:16 | 2019-10-09 23:44:26 | 2019-10-10 00:06:25 | 0:21:59 | smithi | master | rhel | 7.7 | rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371131 | 2019-10-09 15:13:17 | 2019-10-09 23:44:30 | 2019-10-10 00:26:29 | 0:41:59 | 0:30:37 | 0:11:22 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} | 2 | |
Failure Reason:
"2019-10-10T00:02:04.708892+0000 mon.b (mon.1) 40 : cluster [WRN] Health check update: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 4371132 | 2019-10-09 15:13:18 | 2019-10-09 23:44:44 | 2019-10-10 00:02:43 | 0:17:59 | smithi | master | rhel | 7.7 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/repair_test.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371133 | 2019-10-09 15:13:19 | 2019-10-09 23:44:54 | 2019-10-10 00:04:53 | 0:19:59 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/fio_4M_rand_rw.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371134 | 2019-10-09 15:13:20 | 2019-10-09 23:45:05 | 2019-10-10 00:21:04 | 0:35:59 | 0:24:49 | 0:11:10 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
dead | 4371135 | 2019-10-09 15:13:21 | 2019-10-09 23:46:49 | 2019-10-10 00:04:48 | 0:17:59 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371136 | 2019-10-09 15:13:22 | 2019-10-09 23:46:50 | 2019-10-10 11:49:02 | 12:02:12 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/few.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} | — | |||
pass | 4371137 | 2019-10-09 15:13:22 | 2019-10-09 23:46:49 | 2019-10-10 00:12:49 | 0:26:00 | 0:07:56 | 0:18:04 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/filejournal.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
fail | 4371138 | 2019-10-09 15:13:23 | 2019-10-09 23:46:49 | 2019-10-10 00:54:49 | 1:08:00 | 0:57:37 | 0:10:23 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} | 2 | |
Failure Reason:
Command failed on smithi042 with status 1: 'sudo ceph --cluster ceph osd crush tunables default' |
||||||||||||||
dead | 4371139 | 2019-10-09 15:13:24 | 2019-10-09 23:47:08 | 2019-10-10 00:05:07 | 0:17:59 | smithi | master | rhel | 7.7 | rados/singleton/{all/lost-unfound.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371140 | 2019-10-09 15:13:25 | 2019-10-09 23:48:23 | 2019-10-10 00:18:22 | 0:29:59 | 0:15:39 | 0:14:20 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/set-chunk-promote-flush.yaml} | 2 | |
dead | 4371141 | 2019-10-09 15:13:26 | 2019-10-09 23:48:48 | 2019-10-10 00:06:47 | 0:17:59 | smithi | master | rhel | 7.7 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_7.yaml} tasks/module_selftest.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371142 | 2019-10-09 15:13:27 | 2019-10-09 23:48:48 | 2019-10-10 00:14:48 | 0:26:00 | 0:12:08 | 0:13:52 | smithi | master | centos | 7.6 | rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/fio_4M_rand_write.yaml} | 1 | |
dead | 4371143 | 2019-10-09 15:13:27 | 2019-10-09 23:48:55 | 2019-10-10 00:06:54 | 0:17:59 | smithi | master | rhel | 7.7 | rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371144 | 2019-10-09 15:13:28 | 2019-10-09 23:50:59 | 2019-10-10 00:12:58 | 0:21:59 | 0:10:52 | 0:11:07 | smithi | master | centos | 7.6 | rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
pass | 4371145 | 2019-10-09 15:13:29 | 2019-10-09 23:50:59 | 2019-10-10 00:10:58 | 0:19:59 | 0:08:02 | 0:11:57 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/max-pg-per-osd.from-mon.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
dead | 4371146 | 2019-10-09 15:13:30 | 2019-10-09 23:50:59 | 2019-10-10 08:05:07 | 8:14:08 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371147 | 2019-10-09 15:13:31 | 2019-10-09 23:50:59 | 2019-10-10 01:57:00 | 2:06:01 | 1:49:16 | 0:16:45 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rgw_snaps.yaml} | 2 | |
Failure Reason:
"2019-10-10T00:11:34.641181+0000 mon.a (mon.0) 14 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
dead | 4371148 | 2019-10-09 15:13:32 | 2019-10-09 23:50:59 | 2019-10-10 00:08:58 | 0:17:59 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371149 | 2019-10-09 15:13:32 | 2019-10-09 23:51:29 | 2019-10-10 02:17:31 | 2:26:02 | 1:21:41 | 1:04:21 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} | 3 | |
Failure Reason:
Command failed on smithi148 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' |
||||||||||||||
dead | 4371150 | 2019-10-09 15:13:33 | 2019-10-09 23:52:45 | 2019-10-10 11:55:11 | 12:02:26 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} | 2 | |||
pass | 4371151 | 2019-10-09 15:13:34 | 2019-10-09 23:52:49 | 2019-10-10 00:18:48 | 0:25:59 | 0:15:21 | 0:10:38 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
fail | 4371152 | 2019-10-09 15:13:35 | 2019-10-09 23:52:49 | 2019-10-10 02:38:51 | 2:46:02 | 2:32:52 | 0:13:10 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | |
Failure Reason:
"2019-10-10T00:11:43.592558+0000 mon.b (mon.1) 29 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 4371153 | 2019-10-09 15:13:36 | 2019-10-09 23:52:50 | 2019-10-10 00:12:49 | 0:19:59 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371154 | 2019-10-09 15:13:37 | 2019-10-09 23:52:52 | 2019-10-10 00:14:51 | 0:21:59 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/radosbench_4K_rand_read.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371155 | 2019-10-09 15:13:38 | 2019-10-09 23:55:10 | 2019-10-10 08:05:17 | 8:10:07 | 0:06:56 | 8:03:11 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/luminous-v1only.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} | 4 | |
Failure Reason:
Command failed on smithi081 with status 1: 'sudo yum -y install ceph-radosgw' |
||||||||||||||
pass | 4371156 | 2019-10-09 15:13:39 | 2019-10-09 23:56:44 | 2019-10-10 00:14:43 | 0:17:59 | 0:08:46 | 0:09:13 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
dead | 4371157 | 2019-10-09 15:13:39 | 2019-10-09 23:56:49 | 2019-10-10 00:14:48 | 0:17:59 | smithi | master | rhel | 7.7 | rados/singleton/{all/max-pg-per-osd.from-replica.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371158 | 2019-10-09 15:13:40 | 2019-10-09 23:56:49 | 2019-10-10 01:04:49 | 1:08:00 | 0:56:38 | 0:11:22 | smithi | master | centos | 7.6 | rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/many.yaml workloads/rados_mon_osdmap_prune.yaml} | 2 | |
pass | 4371159 | 2019-10-09 15:13:41 | 2019-10-09 23:56:52 | 2019-10-10 00:38:52 | 0:42:00 | 0:29:24 | 0:12:36 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | |
pass | 4371160 | 2019-10-09 15:13:42 | 2019-10-09 23:56:57 | 2019-10-10 00:30:56 | 0:33:59 | 0:14:28 | 0:19:31 | smithi | master | centos | 7.6 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{centos_7.yaml} tasks/orchestrator_cli.yaml} | 2 | |
pass | 4371161 | 2019-10-09 15:13:43 | 2019-10-09 23:57:01 | 2019-10-10 02:31:03 | 2:34:02 | 2:24:53 | 0:09:09 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/filestore-idempotent-aio-journal.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
pass | 4371162 | 2019-10-09 15:13:44 | 2019-10-09 23:57:39 | 2019-10-10 00:33:39 | 0:36:00 | 0:26:49 | 0:09:11 | smithi | master | ubuntu | 18.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/misc.yaml} | 1 | |
pass | 4371163 | 2019-10-09 15:13:44 | 2019-10-09 23:58:35 | 2019-10-10 00:42:35 | 0:44:00 | 0:15:58 | 0:28:02 | smithi | master | centos | 7.6 | rados/multimon/{clusters/9.yaml msgr-failures/few.yaml msgr/async-v1only.yaml no_pools.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_7.yaml} tasks/mon_recovery.yaml} | 3 | |
fail | 4371164 | 2019-10-09 15:13:45 | 2019-10-09 23:58:35 | 2019-10-10 03:22:37 | 3:24:02 | 3:07:32 | 0:16:30 | smithi | master | centos | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} | 2 | ||
Failure Reason:
"2019-10-10T02:23:32.534737+0000 mon.a (mon.0) 368 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
pass | 4371165 | 2019-10-09 15:13:46 | 2019-10-09 23:58:41 | 2019-10-10 00:22:40 | 0:23:59 | 0:11:55 | 0:12:04 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/scrub_test.yaml} | 2 | |
pass | 4371166 | 2019-10-09 15:13:47 | 2019-10-09 23:58:45 | 2019-10-10 00:18:44 | 0:19:59 | 0:09:26 | 0:10:33 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/mon-auth-caps.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
fail | 4371167 | 2019-10-09 15:13:48 | 2019-10-09 23:58:46 | 2019-10-10 01:58:48 | 2:00:02 | 1:48:33 | 0:11:29 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} | 2 | |
Failure Reason:
"2019-10-10T00:18:13.250950+0000 mon.b (mon.0) 25 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log |
||||||||||||||
fail | 4371168 | 2019-10-09 15:13:49 | 2019-10-09 23:58:54 | 2019-10-10 02:18:55 | 2:20:01 | 2:07:40 | 0:12:21 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-small-objects-many-deletes.yaml} | 2 | |
Failure Reason:
"2019-10-10T00:17:17.091022+0000 mon.b (mon.0) 38 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log |
||||||||||||||
pass | 4371169 | 2019-10-09 15:13:49 | 2019-10-10 00:01:05 | 2019-10-10 00:21:04 | 0:19:59 | 0:11:09 | 0:08:50 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/radosbench_4K_seq_read.yaml} | 1 | |
pass | 4371170 | 2019-10-09 15:13:50 | 2019-10-10 00:01:05 | 2019-10-10 00:23:04 | 0:21:59 | 0:10:13 | 0:11:46 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/health-warnings.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
dead | 4371171 | 2019-10-09 15:13:51 | 2019-10-10 00:01:05 | 2019-10-10 00:19:04 | 0:17:59 | smithi | master | rhel | 7.7 | rados/singleton/{all/mon-config-key-caps.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371172 | 2019-10-09 15:13:52 | 2019-10-10 00:01:16 | 2019-10-10 01:51:17 | 1:50:01 | 0:39:00 | 1:11:01 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} | 2 | |
Failure Reason:
"2019-10-10T01:19:56.190731+0000 mon.b (mon.1) 32 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 4371173 | 2019-10-09 15:13:53 | 2019-10-10 00:01:17 | 2019-10-10 12:03:29 | 12:02:12 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/luminous.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | — | |||
fail | 4371174 | 2019-10-09 15:13:54 | 2019-10-10 00:02:46 | 2019-10-10 01:10:46 | 1:08:00 | 0:59:26 | 0:08:34 | smithi | master | centos | 7.6 | rados/singleton/{all/mon-config-keys.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
Failure Reason:
Command failed on smithi038 with status 1: 'sudo ceph --cluster ceph osd crush tunables default' |
||||||||||||||
pass | 4371175 | 2019-10-09 15:13:54 | 2019-10-10 00:02:46 | 2019-10-10 00:50:46 | 0:48:00 | 0:23:01 | 0:24:59 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} | 2 | |
pass | 4371176 | 2019-10-09 15:13:55 | 2019-10-10 00:02:54 | 2019-10-10 00:34:54 | 0:32:00 | 0:15:06 | 0:16:54 | smithi | master | ubuntu | 18.04 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/progress.yaml} | 2 | |
pass | 4371177 | 2019-10-09 15:13:56 | 2019-10-10 00:03:02 | 2019-10-10 00:27:02 | 0:24:00 | 0:14:48 | 0:09:12 | smithi | master | centos | 7.6 | rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/radosbench_4M_rand_read.yaml} | 1 | |
fail | 4371178 | 2019-10-09 15:13:57 | 2019-10-10 00:05:06 | 2019-10-10 01:17:06 | 1:12:00 | 0:59:46 | 0:12:14 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_api_tests.yaml} | 2 | |
Failure Reason:
"2019-10-10T00:24:14.738576+0000 mon.b (mon.0) 108 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log |
||||||||||||||
fail | 4371179 | 2019-10-09 15:13:58 | 2019-10-10 00:05:06 | 2019-10-10 03:41:09 | 3:36:03 | 3:14:43 | 0:21:20 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | |
Failure Reason:
"2019-10-10T00:31:34.249087+0000 mon.b (mon.1) 105 : cluster [WRN] Health check update: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 4371180 | 2019-10-09 15:13:59 | 2019-10-10 00:05:06 | 2019-10-10 09:27:15 | 9:22:09 | 0:53:46 | 8:28:23 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} | 3 | |
Failure Reason:
Command failed on smithi202 with status 6: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0" |
||||||||||||||
fail | 4371181 | 2019-10-09 15:14:00 | 2019-10-10 00:05:06 | 2019-10-10 01:41:07 | 1:36:01 | 1:11:48 | 0:24:13 | smithi | master | centos | 7.6 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} | 2 | |
Failure Reason:
"2019-10-10T00:37:13.178602+0000 mon.b (mon.0) 17 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log |
||||||||||||||
dead | 4371182 | 2019-10-09 15:14:00 | 2019-10-10 00:05:08 | 2019-10-10 02:35:10 | 2:30:02 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371183 | 2019-10-09 15:14:01 | 2019-10-10 00:06:40 | 2019-10-10 00:26:39 | 0:19:59 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371184 | 2019-10-09 15:14:02 | 2019-10-10 00:06:48 | 2019-10-10 01:56:49 | 1:50:01 | 1:38:17 | 0:11:44 | smithi | master | centos | 7.6 | rados/singleton/{all/mon-config.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
Failure Reason:
"2019-10-10T00:25:44.750447+0000 mon.a (mon.0) 19 : cluster [WRN] Health check update: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
pass | 4371185 | 2019-10-09 15:14:03 | 2019-10-10 00:06:56 | 2019-10-10 00:26:55 | 0:19:59 | 0:08:51 | 0:11:08 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/large-omap-object-warnings.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
dead | 4371186 | 2019-10-09 15:14:04 | 2019-10-10 00:08:38 | 2019-10-10 00:26:37 | 0:17:59 | smithi | master | rhel | 7.7 | rados/objectstore/{backends/filestore-idempotent.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371187 | 2019-10-09 15:14:05 | 2019-10-10 00:08:45 | 2019-10-10 02:46:46 | 2:38:01 | 2:24:30 | 0:13:31 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} | 2 | |
Failure Reason:
"2019-10-10T00:30:19.240530+0000 mon.a (mon.0) 54 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
pass | 4371188 | 2019-10-09 15:14:05 | 2019-10-10 00:08:52 | 2019-10-10 00:34:51 | 0:25:59 | 0:16:28 | 0:09:31 | smithi | master | centos | 7.6 | rados/singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
pass | 4371189 | 2019-10-09 15:14:06 | 2019-10-10 00:08:59 | 2019-10-10 00:32:58 | 0:23:59 | 0:13:25 | 0:10:34 | smithi | master | centos | 7.6 | rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/radosbench_4M_seq_read.yaml} | 1 | |
fail | 4371190 | 2019-10-09 15:14:07 | 2019-10-10 00:09:51 | 2019-10-10 03:03:53 | 2:54:02 | 1:00:07 | 1:53:55 | smithi | master | centos | 7.6 | rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/one.yaml workloads/rados_mon_workunits.yaml} | 2 | |
Failure Reason:
Command failed on smithi169 with status 1: 'sudo ceph --cluster ceph osd crush tunables default' |
||||||||||||||
fail | 4371191 | 2019-10-09 15:14:08 | 2019-10-10 00:10:17 | 2019-10-10 07:48:24 | 7:38:07 | 0:04:08 | 7:33:59 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/mimic-v1only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/few.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} | 4 | |
Failure Reason:
78005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.296165', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.es.its.nyu.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.atlanticmetro.net', u' * updates: mirror.vcu.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 07:47:36.601676', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi062.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 07:48:01.505429', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.es.its.nyu.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: mirror.vcu.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:22.687331', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.es.its.nyu.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.atlanticmetro.net', u' * updates: mirror.vcu.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 07:47:38.818098', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi093.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 07:48:01.631305', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.es.its.nyu.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: mirror.vcu.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:25.287796', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.es.its.nyu.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.atlanticmetro.net', u' * updates: mirror.vcu.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 07:47:36.343509', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi149.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 07:48:01.782603', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.es.its.nyu.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.atlanticmetro.net\n * updates: mirror.vcu.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:25.019599', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.es.its.nyu.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.atlanticmetro.net', u' * updates: mirror.vcu.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 07:47:36.763004', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction') |
||||||||||||||
fail | 4371192 | 2019-10-09 15:14:09 | 2019-10-10 00:10:38 | 2019-10-10 01:34:39 | 1:24:01 | 1:12:05 | 0:11:56 | smithi | master | centos | 7.6 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} | 2 | |
Failure Reason:
"2019-10-10T00:31:46.790598+0000 mon.b (mon.1) 13 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 4371193 | 2019-10-09 15:14:09 | 2019-10-10 00:11:09 | 2019-10-10 00:29:08 | 0:17:59 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371194 | 2019-10-09 15:14:10 | 2019-10-10 00:11:09 | 2019-10-10 00:39:09 | 0:28:00 | smithi | master | rhel | 7.7 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{rhel_7.yaml} tasks/prometheus.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371195 | 2019-10-09 15:14:11 | 2019-10-10 00:12:59 | 2019-10-10 00:52:59 | 0:40:00 | 0:29:47 | 0:10:13 | smithi | master | centos | 7.6 | rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
Failure Reason:
Command failed on smithi166 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 3' |
||||||||||||||
dead | 4371196 | 2019-10-09 15:14:12 | 2019-10-10 00:12:59 | 2019-10-10 12:15:21 | 12:02:22 | smithi | master | centos | 7.6 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} tasks/rados_cls_all.yaml} | 2 | |||
pass | 4371197 | 2019-10-09 15:14:13 | 2019-10-10 00:12:59 | 2019-10-10 00:52:59 | 0:40:00 | 0:29:23 | 0:10:37 | smithi | master | centos | 7.6 | rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
pass | 4371198 | 2019-10-09 15:14:14 | 2019-10-10 00:13:00 | 2019-10-10 00:42:59 | 0:29:59 | 0:09:01 | 0:20:58 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/lazy_omap_stats_output.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
pass | 4371199 | 2019-10-09 15:14:14 | 2019-10-10 00:14:57 | 2019-10-10 01:06:57 | 0:52:00 | 0:40:40 | 0:11:20 | smithi | master | ubuntu | 18.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/mon.yaml} | 1 | |
dead | 4371200 | 2019-10-09 15:14:15 | 2019-10-10 00:14:57 | 2019-10-10 12:17:10 | 12:02:13 | smithi | master | rhel | 7.7 | rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/nautilus.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-octopus.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} bluestore-bitmap.yaml supported-random-distro$/{rhel_7.yaml} thrashosds-health.yaml} | — | |||
dead | 4371201 | 2019-10-09 15:14:16 | 2019-10-10 00:14:57 | 2019-10-10 02:40:59 | 2:26:02 | smithi | master | rhel | 7.7 | rados/multimon/{clusters/21.yaml msgr-failures/many.yaml msgr/async-v2only.yaml no_pools.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/mon_clock_no_skews.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371202 | 2019-10-09 15:14:17 | 2019-10-10 00:14:57 | 2019-10-10 00:50:57 | 0:36:00 | 0:10:49 | 0:25:11 | smithi | master | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} | 2 | |||
fail | 4371203 | 2019-10-09 15:14:18 | 2019-10-10 00:16:48 | 2019-10-10 04:46:52 | 4:30:04 | 2:52:29 | 1:37:35 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 2 | |
Failure Reason:
"2019-10-10T02:04:30.279209+0000 mon.b (mon.0) 27 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log |
||||||||||||||
pass | 4371204 | 2019-10-09 15:14:19 | 2019-10-10 00:16:48 | 2019-10-10 00:40:47 | 0:23:59 | 0:13:13 | 0:10:46 | smithi | master | centos | 7.6 | rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/radosbench_4M_write.yaml} | 1 | |
dead | 4371205 | 2019-10-09 15:14:19 | 2019-10-10 00:18:36 | 2019-10-10 00:40:36 | 0:22:00 | smithi | master | rhel | 7.7 | rados/singleton/{all/osd-recovery.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371206 | 2019-10-09 15:14:20 | 2019-10-10 00:18:45 | 2019-10-10 00:44:45 | 0:26:00 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371207 | 2019-10-09 15:14:21 | 2019-10-10 00:18:49 | 2019-10-10 00:38:49 | 0:20:00 | 0:08:23 | 0:11:37 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/peer.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
pass | 4371208 | 2019-10-09 15:14:22 | 2019-10-10 00:18:52 | 2019-10-10 03:44:56 | 3:26:04 | 0:29:07 | 2:56:57 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/mimic.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 4 | |
pass | 4371209 | 2019-10-09 15:14:22 | 2019-10-10 00:19:06 | 2019-10-10 00:37:05 | 0:17:59 | 0:07:44 | 0:10:15 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/fusestore.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
fail | 4371210 | 2019-10-09 15:14:23 | 2019-10-10 00:21:18 | 2019-10-10 02:21:19 | 2:00:01 | 0:59:54 | 1:00:07 | smithi | master | centos | 7.6 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | |
Failure Reason:
Command failed on smithi035 with status 1: 'sudo ceph --cluster ceph osd crush tunables default' |
||||||||||||||
dead | 4371211 | 2019-10-09 15:14:24 | 2019-10-10 00:21:18 | 2019-10-10 00:43:18 | 0:22:00 | smithi | master | rhel | 7.7 | rados/singleton-nomsgr/{all/librados_hello_world.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371212 | 2019-10-09 15:14:25 | 2019-10-10 00:22:54 | 2019-10-10 00:58:53 | 0:35:59 | 0:15:04 | 0:20:55 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/dedup_tier.yaml} | 2 | |
pass | 4371213 | 2019-10-09 15:14:26 | 2019-10-10 00:23:06 | 2019-10-10 01:09:05 | 0:45:59 | 0:14:27 | 0:31:32 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_python.yaml} | 2 | |
fail | 4371214 | 2019-10-09 15:14:27 | 2019-10-10 00:25:12 | 2019-10-10 03:23:14 | 2:58:02 | 2:13:35 | 0:44:27 | smithi | master | centos | 7.6 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} | 3 | |
Failure Reason:
"2019-10-10T01:30:47.006869+0000 mon.a (mon.0) 224 : cluster [WRN] Health check update: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 4371215 | 2019-10-09 15:14:27 | 2019-10-10 00:26:41 | 2019-10-10 03:14:42 | 2:48:01 | 2:30:02 | 0:17:59 | smithi | master | centos | 7.6 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} | 2 | |
Failure Reason:
"2019-10-10T00:52:51.506265+0000 mon.a (mon.1) 15 : cluster [WRN] Health check update: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
pass | 4371216 | 2019-10-09 15:14:28 | 2019-10-10 00:26:41 | 2019-10-10 01:22:45 | 0:56:04 | 0:09:16 | 0:46:48 | smithi | master | ubuntu | 18.04 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/ssh_orchestrator.yaml} | 2 | |
pass | 4371217 | 2019-10-09 15:14:29 | 2019-10-10 00:26:41 | 2019-10-10 00:58:40 | 0:31:59 | 0:22:55 | 0:09:04 | smithi | master | centos | 7.6 | rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/radosbench_omap_write.yaml} | 1 | |
fail | 4371218 | 2019-10-09 15:14:30 | 2019-10-10 00:26:41 | 2019-10-10 07:54:48 | 7:28:07 | 6:28:41 | 0:59:26 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/pg-autoscaler.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 2 | |
Failure Reason:
"2019-10-10T01:32:39.274097+0000 mon.a (mon.1) 22 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 4371219 | 2019-10-09 15:14:31 | 2019-10-10 00:26:56 | 2019-10-10 03:05:03 | 2:38:07 | 2:21:05 | 0:17:02 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} | 2 | |
Failure Reason:
Command failed on smithi201 with status 6: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0" |
||||||||||||||
fail | 4371220 | 2019-10-09 15:14:32 | 2019-10-10 00:27:03 | 2019-10-10 06:51:09 | 6:24:06 | 0:03:52 | 6:20:14 | smithi | master | centos | 7.6 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 4 | |
Failure Reason:
f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.247091', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.wdc1.us.leaseweb.net', u' * epel: ftp.linux.ncsu.edu', u' * extras: packages.oit.ncsu.edu', u' * updates: mirror.math.princeton.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 06:49:05.260707', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi093.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 06:49:10.590346', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.wdc1.us.leaseweb.net\n * epel: ftp.linux.ncsu.edu\n * extras: packages.oit.ncsu.edu\n * updates: mirror.math.princeton.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.009396', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.wdc1.us.leaseweb.net', u' * epel: ftp.linux.ncsu.edu', u' * extras: packages.oit.ncsu.edu', u' * updates: mirror.math.princeton.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 06:49:05.580950', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi033.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 06:49:14.126849', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.wdc1.us.leaseweb.net\n * epel: ftp.linux.ncsu.edu\n * extras: packages.oit.ncsu.edu\n * updates: mirror.math.princeton.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.502400', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.wdc1.us.leaseweb.net', u' * epel: ftp.linux.ncsu.edu', u' * extras: packages.oit.ncsu.edu', u' * updates: mirror.math.princeton.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 06:49:08.624449', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi044.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 06:49:15.109381', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.wdc1.us.leaseweb.net\n * epel: ftp.linux.ncsu.edu\n * extras: packages.oit.ncsu.edu\n * updates: mirror.math.princeton.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.131029', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.wdc1.us.leaseweb.net', u' * epel: ftp.linux.ncsu.edu', u' * extras: packages.oit.ncsu.edu', u' * updates: mirror.math.princeton.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 06:49:09.978352', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction') |
||||||||||||||
fail | 4371221 | 2019-10-09 15:14:32 | 2019-10-10 00:29:23 | 2019-10-10 01:57:24 | 1:28:01 | 0:57:44 | 0:30:17 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=clay-k=4-m=2.yaml} | 2 | |
Failure Reason:
Command failed on smithi202 with status 1: 'sudo ceph --cluster ceph osd crush tunables default' |
||||||||||||||
dead | 4371222 | 2019-10-09 15:14:33 | 2019-10-10 00:31:11 | 2019-10-10 00:51:10 | 0:19:59 | smithi | master | rhel | 7.7 | rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371223 | 2019-10-09 15:14:34 | 2019-10-10 00:33:13 | 2019-10-10 00:57:13 | 0:24:00 | smithi | master | centos | 7.6 | rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} | 2 | |||
Failure Reason:
Command failed on smithi162 with status 1: 'sudo yum install -y kernel' |
||||||||||||||
fail | 4371224 | 2019-10-09 15:14:35 | 2019-10-10 00:33:40 | 2019-10-10 04:21:43 | 3:48:03 | 3:17:20 | 0:30:43 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 | |
Failure Reason:
Command failed (workunit test rados/test.sh) on smithi092 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0dca79308d83afd02b99aa1aa8839d156215298c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' |
||||||||||||||
pass | 4371225 | 2019-10-09 15:14:36 | 2019-10-10 00:35:04 | 2019-10-10 00:57:03 | 0:21:59 | 0:12:26 | 0:09:33 | smithi | master | centos | 7.6 | rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/sample_fio.yaml} | 1 | |
dead | 4371226 | 2019-10-09 15:14:36 | 2019-10-10 00:35:04 | 2019-10-10 00:55:03 | 0:19:59 | smithi | master | rhel | 7.7 | rados/singleton-nomsgr/{all/msgr.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371227 | 2019-10-09 15:14:37 | 2019-10-10 00:35:04 | 2019-10-10 00:57:03 | 0:21:59 | smithi | master | rhel | 7.7 | rados/singleton/{all/radostool.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371228 | 2019-10-09 15:14:38 | 2019-10-10 00:37:21 | 2019-10-10 07:35:27 | 6:58:06 | 0:04:04 | 6:54:02 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/nautilus-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 4 | |
Failure Reason:
14ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.915359', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.wdc1.us.leaseweb.net', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.clarkson.edu', u' * updates: distro.ibiblio.org', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 07:34:33.109203', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi043.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 07:34:41.254288', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.wdc1.us.leaseweb.net\n * epel: ftp.linux.ncsu.edu\n * extras: reflector.westga.edu\n * updates: mirror.cs.pitt.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.217796', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.wdc1.us.leaseweb.net', u' * epel: ftp.linux.ncsu.edu', u' * extras: reflector.westga.edu', u' * updates: mirror.cs.pitt.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 07:34:36.036492', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi205.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 07:34:53.519451', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.wdc1.us.leaseweb.net\n * epel: ftp.linux.ncsu.edu\n * extras: reflector.westga.edu\n * updates: mirror.cs.pitt.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.142603', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.wdc1.us.leaseweb.net', u' * epel: ftp.linux.ncsu.edu', u' * extras: reflector.westga.edu', u' * updates: mirror.cs.pitt.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 07:34:48.376848', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi052.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 07:34:56.420844', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.wdc1.us.leaseweb.net\n * epel: ftp.linux.ncsu.edu\n * extras: reflector.westga.edu\n * updates: mirror.cs.pitt.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.051153', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.wdc1.us.leaseweb.net', u' * epel: ftp.linux.ncsu.edu', u' * extras: reflector.westga.edu', u' * updates: mirror.cs.pitt.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 07:34:51.369691', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction') |
||||||||||||||
fail | 4371229 | 2019-10-09 15:14:39 | 2019-10-10 00:39:09 | 2019-10-10 01:13:09 | 0:34:00 | 0:22:53 | 0:11:07 | smithi | master | centos | 7.6 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml} tasks/rados_stress_watch.yaml} | 2 | |
Failure Reason:
"2019-10-10T00:58:02.155772+0000 mon.a (mon.0) 23 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
pass | 4371230 | 2019-10-09 15:14:40 | 2019-10-10 00:39:09 | 2019-10-10 02:21:10 | 1:42:01 | 1:22:02 | 0:19:59 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 | |
pass | 4371231 | 2019-10-09 15:14:40 | 2019-10-10 00:39:10 | 2019-10-10 02:11:10 | 1:32:00 | 0:11:28 | 1:20:32 | smithi | master | centos | 7.6 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{centos_7.yaml} tasks/workunits.yaml} | 2 | |
dead | 4371232 | 2019-10-09 15:14:41 | 2019-10-10 00:40:51 | 2019-10-10 01:34:51 | 0:54:00 | smithi | master | rhel | 7.7 | rados/singleton/{all/random-eio.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371233 | 2019-10-09 15:14:42 | 2019-10-10 00:40:51 | 2019-10-10 00:58:50 | 0:17:59 | smithi | master | rhel | 7.7 | rados/objectstore/{backends/keyvaluedb.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371234 | 2019-10-09 15:14:43 | 2019-10-10 00:42:50 | 2019-10-10 01:06:49 | 0:23:59 | smithi | master | rhel | 7.7 | rados/standalone/{supported-random-distro$/{rhel_7.yaml} workloads/osd.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371235 | 2019-10-09 15:14:44 | 2019-10-10 00:43:00 | 2019-10-10 01:23:00 | 0:40:00 | smithi | master | rhel | 7.7 | rados/multimon/{clusters/3.yaml msgr-failures/few.yaml msgr/async.yaml no_pools.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/mon_clock_with_skews.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371236 | 2019-10-09 15:14:45 | 2019-10-10 00:43:19 | 2019-10-10 01:49:19 | 1:06:00 | 0:50:31 | 0:15:29 | smithi | master | centos | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} | 2 | ||
Failure Reason:
Command failed on smithi140 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' |
||||||||||||||
fail | 4371237 | 2019-10-09 15:14:45 | 2019-10-10 00:44:52 | 2019-10-10 02:30:52 | 1:46:00 | 0:36:39 | 1:09:21 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 | |
Failure Reason:
"2019-10-10T02:01:08.010549+0000 mon.b (mon.0) 25 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 4371238 | 2019-10-09 15:14:46 | 2019-10-10 00:44:52 | 2019-10-10 01:06:51 | 0:21:59 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/sample_radosbench.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371239 | 2019-10-09 15:14:47 | 2019-10-10 00:49:09 | 2019-10-10 01:29:08 | 0:39:59 | 0:23:59 | 0:16:00 | smithi | master | centos | 7.6 | rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 2 | |
dead | 4371240 | 2019-10-09 15:14:48 | 2019-10-10 00:51:01 | 2019-10-10 12:53:26 | 12:02:25 | smithi | master | centos | 7.6 | rados/singleton/{all/rebuild-mondb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |||
fail | 4371241 | 2019-10-09 15:14:49 | 2019-10-10 00:51:01 | 2019-10-10 01:23:00 | 0:31:59 | 0:14:17 | 0:17:42 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | |
Failure Reason:
Command failed on smithi049 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set isaprofile name=isaprofile plugin=isa crush-failure-domain=osd k=2 technique=reed_sol_van m=1' |
||||||||||||||
fail | 4371242 | 2019-10-09 15:14:50 | 2019-10-10 00:51:01 | 2019-10-10 02:01:01 | 1:10:00 | 0:47:07 | 0:22:53 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} | 2 | |
Failure Reason:
"2019-10-10T01:22:15.011374+0000 mon.b (mon.1) 29 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 4371243 | 2019-10-09 15:14:50 | 2019-10-10 00:51:01 | 2019-10-10 05:17:04 | 4:26:03 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371244 | 2019-10-09 15:14:51 | 2019-10-10 00:51:11 | 2019-10-10 02:45:12 | 1:54:01 | 1:03:47 | 0:50:14 | smithi | master | centos | 7.6 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_7.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} | 2 | |
Failure Reason:
Command failed on smithi085 with status 1: 'sudo ceph --cluster ceph osd crush tunables default' |
||||||||||||||
pass | 4371245 | 2019-10-09 15:14:52 | 2019-10-10 00:53:15 | 2019-10-10 01:19:14 | 0:25:59 | 0:16:57 | 0:09:02 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/recovery-preemption.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
fail | 4371246 | 2019-10-09 15:14:53 | 2019-10-10 00:53:15 | 2019-10-10 02:39:16 | 1:46:01 | 0:29:57 | 1:16:04 | smithi | master | centos | 7.6 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} tasks/rados_striper.yaml} | 2 | |
Failure Reason:
"2019-10-10T02:16:37.517520+0000 mon.b (mon.0) 22 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log |
||||||||||||||
fail | 4371247 | 2019-10-09 15:14:54 | 2019-10-10 00:55:05 | 2019-10-10 04:11:07 | 3:16:02 | 0:07:53 | 3:08:09 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus-v2only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/few.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} | 4 | |
Failure Reason:
Command failed on smithi057 with status 1: 'sudo yum -y install ceph-daemon' |
||||||||||||||
fail | 4371248 | 2019-10-09 15:14:54 | 2019-10-10 00:55:05 | 2019-10-10 02:21:05 | 1:26:00 | 1:14:52 | 0:11:08 | smithi | master | centos | 7.6 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} | 2 | |
Failure Reason:
"2019-10-10T01:15:20.082670+0000 mon.b (mon.0) 26 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
pass | 4371249 | 2019-10-09 15:14:55 | 2019-10-10 00:55:05 | 2019-10-10 01:19:04 | 0:23:59 | 0:13:01 | 0:10:58 | smithi | master | centos | 7.6 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{centos_7.yaml} tasks/crash.yaml} | 2 | |
fail | 4371250 | 2019-10-09 15:14:56 | 2019-10-10 00:56:40 | 2019-10-10 01:22:40 | 0:26:00 | 0:16:04 | 0:09:56 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/cosbench_64K_read_write.yaml} | 1 | |
Failure Reason:
Command failed on smithi186 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' |
||||||||||||||
pass | 4371251 | 2019-10-09 15:14:57 | 2019-10-10 00:57:04 | 2019-10-10 01:37:04 | 0:40:00 | 0:19:03 | 0:20:57 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | 2 | |
pass | 4371252 | 2019-10-09 15:14:58 | 2019-10-10 00:57:04 | 2019-10-10 01:45:04 | 0:48:00 | 0:15:10 | 0:32:50 | smithi | master | centos | 7.6 | rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 2 | |
pass | 4371253 | 2019-10-09 15:14:58 | 2019-10-10 00:57:14 | 2019-10-10 01:39:14 | 0:42:00 | 0:17:28 | 0:24:32 | smithi | master | ubuntu | 18.04 | rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync.yaml workloads/pool-create-delete.yaml} | 2 | |
dead | 4371254 | 2019-10-09 15:14:59 | 2019-10-10 00:58:07 | 2019-10-10 01:16:06 | 0:17:59 | smithi | master | rhel | 7.7 | rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371255 | 2019-10-09 15:15:00 | 2019-10-10 00:58:42 | 2019-10-10 01:32:41 | 0:33:59 | 0:22:34 | 0:11:25 | smithi | master | centos | 7.6 | rados/singleton-nomsgr/{all/osd_stale_reads.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
dead | 4371256 | 2019-10-09 15:15:01 | 2019-10-10 00:58:52 | 2019-10-10 01:18:51 | 0:19:59 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/set-chunk-promote-flush.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
fail | 4371257 | 2019-10-09 15:15:02 | 2019-10-10 00:58:55 | 2019-10-10 05:38:58 | 4:40:03 | 0:59:33 | 3:40:30 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 4 | |
Failure Reason:
Command failed on smithi068 with status 1: 'sudo ceph --cluster ceph osd crush tunables default' |
||||||||||||||
dead | 4371258 | 2019-10-09 15:15:02 | 2019-10-10 01:02:27 | 2019-10-10 01:22:26 | 0:19:59 | smithi | master | rhel | 7.7 | rados/singleton/{all/test-crash.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371259 | 2019-10-09 15:15:03 | 2019-10-10 01:02:44 | 2019-10-10 01:42:43 | 0:39:59 | 0:28:31 | 0:11:28 | smithi | master | centos | 7.6 | rados/objectstore/{backends/objectcacher-stress.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
dead | 4371260 | 2019-10-09 15:15:04 | 2019-10-10 01:04:22 | 2019-10-10 01:28:22 | 0:24:00 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/cosbench_64K_write.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371261 | 2019-10-09 15:15:05 | 2019-10-10 01:04:51 | 2019-10-10 01:44:50 | 0:39:59 | smithi | master | rhel | 7.7 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
dead | 4371262 | 2019-10-09 15:15:06 | 2019-10-10 01:04:53 | 2019-10-10 01:28:52 | 0:23:59 | smithi | master | rhel | 7.7 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/rados_workunit_loadgen_big.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371263 | 2019-10-09 15:15:07 | 2019-10-10 01:06:11 | 2019-10-10 01:48:10 | 0:41:59 | 0:22:28 | 0:19:31 | smithi | master | centos | 7.6 | rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
fail | 4371264 | 2019-10-09 15:15:08 | 2019-10-10 01:06:51 | 2019-10-10 09:48:59 | 8:42:08 | 0:03:44 | 8:38:24 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/nautilus.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 4 | |
Failure Reason:
e778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.396182', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.cc.columbia.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.math.princeton.edu', u' * updates: mirror.umd.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 09:48:29.525606', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi138.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 09:48:36.275281', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.cc.columbia.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.math.princeton.edu\n * updates: mirror.umd.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.557774', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.cc.columbia.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.math.princeton.edu', u' * updates: mirror.umd.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 09:48:30.717507', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi199.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 09:48:36.619773', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.cc.columbia.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.math.princeton.edu\n * updates: mirror.umd.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:04.968686', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.cc.columbia.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.math.princeton.edu', u' * updates: mirror.umd.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 09:48:31.651087', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction')Failure object was: {'smithi191.front.sepia.ceph.com': {'stderr_lines': [], u'changed': False, u'end': u'2019-10-10 09:48:37.761046', '_ansible_no_log': False, u'stdout': u"Loaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirror.cc.columbia.edu\n * epel: ftp.linux.ncsu.edu\n * extras: mirror.math.princeton.edu\n * updates: mirror.umd.edu\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nTo address this issue please refer to the below wiki article \n\nhttps://wiki.centos.org/yum-errors\n\nIf above article doesn't help to resolve this issue please use https://bugs.centos.org/.\n\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nTrying other mirror.\nfailure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.\nhttp://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found\nhttp://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found", u'cmd': [u'yum-complete-transaction', u'--cleanup-only'], u'rc': 1, u'stderr': u'', u'delta': u'0:00:05.309972', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'yum-complete-transaction --cleanup-only', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, 'stdout_lines': [u'Loaded plugins: fastestmirror, langpacks, priorities', u'Determining fastest mirrors', u' * base: mirror.cc.columbia.edu', u' * epel: ftp.linux.ncsu.edu', u' * extras: mirror.math.princeton.edu', u' * updates: mirror.umd.edu', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'To address this issue please refer to the below wiki article ', u'', u'https://wiki.centos.org/yum-errors', u'', u"If above article doesn't help to resolve this issue please use https://bugs.centos.org/.", u'', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/de77d87d2df2b00b113a61b233f44a4242ed79671a51c99796b73f48c4427264-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'Trying other mirror.', u'failure: repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2 from epel: [Errno 256] No more mirrors to try.', u'http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.pnl.gov/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found', u'http://mirror.oss.ou.edu/epel/7/x86_64/repodata/60e4fb3d991f8af10614e47a1287f67b0f2c0b0f5814ae778005211e98953cb6-primary.sqlite.bz2: [Errno 14] HTTP Error 404 - Not Found'], u'start': u'2019-10-10 09:48:32.451074', u'msg': u'non-zero return code'}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'yum-complete-transaction') |
||||||||||||||
fail | 4371265 | 2019-10-09 15:15:08 | 2019-10-10 01:06:52 | 2019-10-10 01:38:52 | 0:32:00 | 0:20:03 | 0:11:57 | smithi | master | ubuntu | 18.04 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} | 2 | |
Failure Reason:
Test failure: test_perf_counters_mds_get (tasks.mgr.dashboard.test_perf_counters.PerfCountersControllerTest) |
||||||||||||||
pass | 4371266 | 2019-10-09 15:15:09 | 2019-10-10 01:06:59 | 2019-10-10 01:58:58 | 0:51:59 | 0:28:18 | 0:23:41 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} | 2 | |
pass | 4371267 | 2019-10-09 15:15:10 | 2019-10-10 01:09:09 | 2019-10-10 01:29:08 | 0:19:59 | 0:08:36 | 0:11:23 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
dead | 4371268 | 2019-10-09 15:15:11 | 2019-10-10 01:09:09 | 2019-10-10 01:33:08 | 0:23:59 | smithi | master | rhel | 7.7 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371269 | 2019-10-09 15:15:12 | 2019-10-10 01:11:01 | 2019-10-10 03:21:02 | 2:10:01 | 1:12:23 | 0:57:38 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/thrash-backfill-full.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 2 | |
fail | 4371270 | 2019-10-09 15:15:13 | 2019-10-10 01:12:43 | 2019-10-10 01:42:42 | 0:29:59 | 0:16:32 | 0:13:27 | smithi | master | ubuntu | 18.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/scrub.yaml} | 1 | |
Failure Reason:
Command failed (workunit test scrub/osd-scrub-dump.sh) on smithi018 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0dca79308d83afd02b99aa1aa8839d156215298c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh' |
||||||||||||||
dead | 4371271 | 2019-10-09 15:15:13 | 2019-10-10 01:13:05 | 2019-10-10 01:35:04 | 0:21:59 | smithi | master | rhel | 7.7 | rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/fio_4K_rand_read.yaml} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371272 | 2019-10-09 15:15:14 | 2019-10-10 01:13:10 | 2019-10-10 01:55:09 | 0:41:59 | 0:17:35 | 0:24:24 | smithi | master | centos | 7.6 | rados/multimon/{clusters/6.yaml msgr-failures/many.yaml msgr/async-v1only.yaml no_pools.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_7.yaml} tasks/mon_recovery.yaml} | 2 | |
fail | 4371273 | 2019-10-09 15:15:15 | 2019-10-10 01:16:23 | 2019-10-10 02:06:23 | 0:50:00 | 0:34:13 | 0:15:47 | smithi | master | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} | 2 | |||
Failure Reason:
"2019-10-10T01:37:37.618810+0000 mon.b (mon.1) 26 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 4371274 | 2019-10-09 15:15:16 | 2019-10-10 01:16:29 | 2019-10-10 08:54:36 | 7:38:07 | 7:13:05 | 0:25:02 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | |
Failure Reason:
"2019-10-10T01:53:33.272907+0000 mon.a (mon.0) 36 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 4371275 | 2019-10-09 15:15:17 | 2019-10-10 01:16:56 | 2019-10-10 03:56:57 | 2:40:01 | 2:07:59 | 0:32:02 | smithi | master | centos | 7.6 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} | 3 | |
Failure Reason:
"2019-10-10T01:57:35.549754+0000 mon.b (mon.1) 13 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log |
||||||||||||||
fail | 4371276 | 2019-10-09 15:15:18 | 2019-10-10 01:17:08 | 2019-10-10 03:45:09 | 2:28:01 | 1:29:59 | 0:58:02 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} | 2 | |
Failure Reason:
"2019-10-10T02:20:17.072836+0000 mon.b (mon.1) 10 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 4371277 | 2019-10-09 15:15:18 | 2019-10-10 01:19:07 | 2019-10-10 02:49:07 | 1:30:00 | 0:50:57 | 0:39:03 | smithi | master | centos | 7.6 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} | 2 | |
Failure Reason:
"2019-10-10T02:05:55.293880+0000 mon.b (mon.1) 32 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
pass | 4371278 | 2019-10-09 15:15:19 | 2019-10-10 01:19:07 | 2019-10-10 02:21:07 | 1:02:00 | 0:27:54 | 0:34:06 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/thrash-eio.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 2 | |
fail | 4371279 | 2019-10-09 15:15:20 | 2019-10-10 01:19:16 | 2019-10-10 02:11:15 | 0:51:59 | 0:26:04 | 0:25:55 | smithi | master | centos | 7.6 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} | 2 | |
Failure Reason:
Command failed on smithi095 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' |
||||||||||||||
fail | 4371280 | 2019-10-09 15:15:21 | 2019-10-10 01:22:43 | 2019-10-10 02:40:44 | 1:18:01 | 0:26:14 | 0:51:47 | smithi | master | centos | 7.6 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} tasks/rados_workunit_loadgen_mix.yaml} | 2 | |
Failure Reason:
"2019-10-10T02:23:34.162899+0000 mon.b (mon.0) 32 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log |
||||||||||||||
fail | 4371281 | 2019-10-09 15:15:22 | 2019-10-10 01:22:43 | 2019-10-10 02:06:43 | 0:44:00 | 0:32:23 | 0:11:37 | smithi | master | centos | 7.6 | rados/singleton-nomsgr/{all/recovery-unfound-found.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} | 1 | |
Failure Reason:
"2019-10-10T01:46:38.763676+0000 mon.a (mon.0) 23 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
dead | 4371282 | 2019-10-09 15:15:23 | 2019-10-10 01:22:47 | 2019-10-10 01:56:46 | 0:33:59 | smithi | master | rhel | 7.7 | rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} | — | |||
Failure Reason:
reached maximum tries (100) after waiting for 600 seconds |
||||||||||||||
pass | 4371283 | 2019-10-09 15:15:23 | 2019-10-10 01:23:01 | 2019-10-10 02:05:01 | 0:42:00 | 0:11:56 | 0:30:04 | smithi | master | ubuntu | 18.04 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/failover.yaml} | 2 |