User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|---|
sage | 2019-05-13 19:33:19 | 2019-05-13 19:43:00 | 2019-05-15 09:35:01 | 1 day, 13:52:01 | rados | wip-sage-testing-2019-05-10-1632 | smithi | dc46926 | 11 | 14 | 188 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
dead | 3954753 | 2019-05-13 19:33:33 | 2019-05-13 19:37:19 | 2019-05-14 07:41:42 | 12:04:23 | 10:14:18 | 1:50:05 | smithi | master | ubuntu | 16.04 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/few.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | — | |
Failure Reason:
"2019-05-13 21:44:06.362254 mon.a (mon.1) 395 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954754 | 2019-05-13 19:33:33 | 2019-05-13 19:39:43 | 2019-05-14 07:42:08 | 12:02:25 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 2 | |||
pass | 3954755 | 2019-05-13 19:33:34 | 2019-05-13 19:43:00 | 2019-05-13 20:00:59 | 0:17:59 | 0:06:52 | 0:11:07 | smithi | master | ubuntu | 16.04 | rados/objectstore/{backends/fusestore.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | 1 | |
dead | 3954756 | 2019-05-13 19:33:35 | 2019-05-13 19:43:09 | 2019-05-14 07:45:34 | 12:02:25 | 11:46:47 | 0:15:38 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_workunit_loadgen_mix.yaml} | 2 | |
Failure Reason:
"2019-05-13 20:14:38.005157 mon.b (mon.1) 27 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954757 | 2019-05-13 19:33:36 | 2019-05-13 19:44:59 | 2019-05-14 07:47:24 | 12:02:25 | smithi | master | rhel | 7.5 | rados/singleton/{all/mon-config.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954758 | 2019-05-13 19:33:36 | 2019-05-13 19:45:12 | 2019-05-14 07:47:37 | 12:02:25 | smithi | master | ubuntu | 16.04 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/orchestrator_cli.yaml} | 2 | |||
dead | 3954759 | 2019-05-13 19:33:37 | 2019-05-13 19:47:11 | 2019-05-14 07:49:31 | 12:02:20 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/radosbench_4K_rand_read.yaml} | 1 | |||
dead | 3954760 | 2019-05-13 19:33:38 | 2019-05-13 19:47:11 | 2019-05-14 07:49:35 | 12:02:24 | smithi | master | centos | 7.5 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-many-deletes.yaml} | 2 | |||
dead | 3954761 | 2019-05-13 19:33:39 | 2019-05-13 19:48:30 | 2019-05-14 07:50:50 | 12:02:20 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml} | 2 | |||
dead | 3954762 | 2019-05-13 19:33:39 | 2019-05-13 19:49:14 | 2019-05-14 07:51:38 | 12:02:24 | 11:42:46 | 0:19:38 | smithi | master | centos | 7.5 | rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/many.yaml workloads/pool-create-delete.yaml} | 2 | |
Failure Reason:
"2019-05-14 07:49:24.605040 mon.a (mon.1) 69 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
dead | 3954763 | 2019-05-13 19:33:40 | 2019-05-13 19:49:14 | 2019-05-14 07:51:34 | 12:02:20 | smithi | master | rhel | 7.5 | rados/singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954764 | 2019-05-13 19:33:41 | 2019-05-13 19:49:44 | 2019-05-14 07:52:05 | 12:02:21 | smithi | master | rhel | 7.5 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} | 2 | |||
dead | 3954765 | 2019-05-13 19:33:42 | 2019-05-13 19:51:09 | 2019-05-14 07:53:34 | 12:02:25 | smithi | master | rhel | 7.5 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} | 2 | |||
dead | 3954766 | 2019-05-13 19:33:42 | 2019-05-13 19:51:17 | 2019-05-14 07:53:38 | 12:02:21 | smithi | master | centos | 7.5 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 4 | |||
dead | 3954767 | 2019-05-13 19:33:43 | 2019-05-13 19:51:18 | 2019-05-14 07:53:42 | 12:02:24 | smithi | master | ubuntu | 16.04 | rados/singleton-nomsgr/{all/librados_hello_world.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | 1 | |||
dead | 3954768 | 2019-05-13 19:33:44 | 2019-05-13 19:51:21 | 2019-05-14 07:53:41 | 12:02:20 | smithi | master | rhel | 7.5 | rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954769 | 2019-05-13 19:33:45 | 2019-05-13 19:52:56 | 2019-05-14 07:55:16 | 12:02:20 | smithi | master | ubuntu | 16.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/rados_workunit_loadgen_mostlyread.yaml} | 2 | |||
dead | 3954770 | 2019-05-13 19:33:45 | 2019-05-13 19:53:18 | 2019-05-14 07:55:28 | 12:02:10 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/hammer.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} | — | |||
dead | 3954771 | 2019-05-13 19:33:46 | 2019-05-13 19:53:29 | 2019-05-14 07:55:54 | 12:02:25 | smithi | master | rhel | 7.5 | rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/radosbench_4K_seq_read.yaml} | 1 | |||
dead | 3954772 | 2019-05-13 19:33:47 | 2019-05-13 19:55:17 | 2019-05-14 07:57:42 | 12:02:25 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 | |||
dead | 3954773 | 2019-05-13 19:33:48 | 2019-05-13 19:55:18 | 2019-05-14 07:59:43 | 12:04:25 | 11:49:22 | 0:15:03 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/osd-recovery.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | — | |
Failure Reason:
"2019-05-13 20:15:59.924528 mon.b (mon.1) 47 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
fail | 3954774 | 2019-05-13 19:33:48 | 2019-05-13 19:57:21 | 2019-05-14 08:06:02 | 12:08:41 | 11:05:50 | 1:02:51 | smithi | master | ubuntu | 16.04 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/progress.yaml} | — | |
Failure Reason:
"2019-05-13 21:01:21.308381 mon.a (mon.1) 99 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
pass | 3954775 | 2019-05-13 19:33:49 | 2019-05-13 19:59:07 | 2019-05-13 20:17:06 | 0:17:59 | 0:06:26 | 0:11:33 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/keyvaluedb.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
pass | 3954776 | 2019-05-13 19:33:50 | 2019-05-13 19:59:29 | 2019-05-13 23:07:31 | 3:08:02 | 2:54:10 | 0:13:52 | smithi | master | ubuntu | 18.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/osd.yaml} | 1 | |
dead | 3954777 | 2019-05-13 19:33:51 | 2019-05-13 19:59:37 | 2019-05-14 08:02:01 | 12:02:24 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} | 3 | |||
dead | 3954778 | 2019-05-13 19:33:51 | 2019-05-13 20:01:12 | 2019-05-14 08:03:36 | 12:02:24 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | |||
dead | 3954779 | 2019-05-13 19:33:52 | 2019-05-13 20:01:33 | 2019-05-14 08:03:58 | 12:02:25 | smithi | master | rhel | 7.5 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 | |||
dead | 3954780 | 2019-05-13 19:33:53 | 2019-05-13 20:01:36 | 2019-05-14 08:04:01 | 12:02:25 | smithi | master | ubuntu | 16.04 | rados/multimon/{clusters/21.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/mon_recovery.yaml} | 3 | |||
dead | 3954781 | 2019-05-13 19:33:54 | 2019-05-13 20:02:45 | 2019-05-14 08:05:05 | 12:02:20 | 11:50:18 | 0:12:02 | smithi | master | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} | 2 | |||
Failure Reason:
SSH connection to smithi014 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954782 | 2019-05-13 19:33:54 | 2019-05-13 20:03:32 | 2019-05-14 08:05:53 | 12:02:21 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/peer.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | 1 | |||
pass | 3954783 | 2019-05-13 19:33:55 | 2019-05-13 20:03:34 | 2019-05-13 20:35:34 | 0:32:00 | 0:16:20 | 0:15:40 | smithi | master | ubuntu | 16.04 | rados/singleton-nomsgr/{all/msgr.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | 1 | |
dead | 3954784 | 2019-05-13 19:33:56 | 2019-05-13 20:05:16 | 2019-05-14 08:07:37 | 12:02:21 | smithi | master | centos | 7.5 | rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_latest.yaml} workloads/radosbench_4M_rand_read.yaml} | 1 | |||
dead | 3954785 | 2019-05-13 19:33:57 | 2019-05-13 20:05:34 | 2019-05-14 08:07:59 | 12:02:25 | smithi | master | centos | 7.5 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} | 2 | |||
dead | 3954786 | 2019-05-13 19:33:57 | 2019-05-13 20:07:17 | 2019-05-14 08:09:41 | 12:02:24 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 | |||
dead | 3954787 | 2019-05-13 19:33:58 | 2019-05-13 20:08:12 | 2019-05-14 08:10:36 | 12:02:24 | smithi | master | rhel | 7.5 | rados/singleton/{all/pg-autoscaler.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 2 | |||
dead | 3954788 | 2019-05-13 19:33:59 | 2019-05-13 20:10:18 | 2019-05-14 08:12:38 | 12:02:20 | smithi | master | centos | 7.5 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} tasks/readwrite.yaml} | 2 | |||
dead | 3954789 | 2019-05-13 19:34:00 | 2019-05-13 20:11:13 | 2019-05-14 08:13:38 | 12:02:25 | 10:33:43 | 1:28:42 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} | 4 | |
Failure Reason:
SSH connection to smithi002 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954790 | 2019-05-13 19:34:00 | 2019-05-13 20:12:19 | 2019-05-14 08:14:43 | 12:02:24 | smithi | master | ubuntu | 16.04 | rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/one.yaml workloads/rados_5925.yaml} | 2 | |||
dead | 3954791 | 2019-05-13 19:34:01 | 2019-05-13 20:12:56 | 2019-05-14 08:15:16 | 12:02:20 | smithi | master | centos | 7.5 | rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} | 1 | |||
dead | 3954792 | 2019-05-13 19:34:02 | 2019-05-13 20:14:12 | 2019-05-14 08:16:36 | 12:02:24 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} | 2 | |||
dead | 3954793 | 2019-05-13 19:34:03 | 2019-05-13 20:17:18 | 2019-05-14 08:19:43 | 12:02:25 | smithi | master | ubuntu | 16.04 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/prometheus.yaml} | 2 | |||
dead | 3954794 | 2019-05-13 19:34:03 | 2019-05-13 20:17:39 | 2019-05-14 08:19:59 | 12:02:20 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/radosbench_4M_seq_read.yaml} | 1 | |||
dead | 3954795 | 2019-05-13 19:34:04 | 2019-05-13 20:19:37 | 2019-05-14 08:21:57 | 12:02:20 | 11:47:46 | 0:14:34 | smithi | master | rhel | 7.5 | rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |
Failure Reason:
"2019-05-13 21:05:24.437258 mon.b (mon.1) 919 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954796 | 2019-05-13 19:34:05 | 2019-05-13 20:20:55 | 2019-05-14 08:23:15 | 12:02:20 | smithi | master | rhel | 7.5 | rados/singleton/{all/radostool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954797 | 2019-05-13 19:34:05 | 2019-05-13 20:23:29 | 2019-05-14 08:25:53 | 12:02:24 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | 2 | |||
dead | 3954798 | 2019-05-13 19:34:06 | 2019-05-13 20:25:29 | 2019-05-14 08:27:49 | 12:02:20 | smithi | master | rhel | 7.5 | rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 2 | |||
dead | 3954799 | 2019-05-13 19:34:07 | 2019-05-13 20:27:35 | 2019-05-14 08:29:59 | 12:02:24 | smithi | master | rhel | 7.5 | rados/objectstore/{backends/objectcacher-stress.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954800 | 2019-05-13 19:34:08 | 2019-05-13 20:29:17 | 2019-05-14 08:31:42 | 12:02:25 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} | 2 | |||
dead | 3954801 | 2019-05-13 19:34:08 | 2019-05-13 20:31:11 | 2019-05-14 08:35:37 | 12:04:26 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 4 | |||
dead | 3954802 | 2019-05-13 19:34:09 | 2019-05-13 20:33:03 | 2019-05-14 08:35:23 | 12:02:20 | 11:53:39 | 0:08:41 | smithi | master | rhel | 7.5 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/repair_test.yaml} | 2 | |
Failure Reason:
"2019-05-13 21:00:45.773872 mon.b (mon.1) 85 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954803 | 2019-05-13 19:34:10 | 2019-05-13 20:35:37 | 2019-05-14 08:37:57 | 12:02:20 | smithi | master | rhel | 7.5 | rados/singleton/{all/random-eio.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 2 | |||
dead | 3954804 | 2019-05-13 19:34:11 | 2019-05-13 20:35:37 | 2019-05-14 08:37:57 | 12:02:20 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} | 2 | |||
dead | 3954805 | 2019-05-13 19:34:11 | 2019-05-13 20:37:24 | 2019-05-14 08:39:48 | 12:02:24 | 11:18:25 | 0:43:59 | smithi | master | ubuntu | 16.04 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/jewel.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/few.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 4 | |
Failure Reason:
SSH connection to smithi023 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954806 | 2019-05-13 19:34:12 | 2019-05-13 20:39:18 | 2019-05-14 08:41:39 | 12:02:21 | smithi | master | centos | 7.5 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | |||
dead | 3954807 | 2019-05-13 19:34:13 | 2019-05-13 20:43:17 | 2019-05-14 08:45:42 | 12:02:25 | 11:22:03 | 0:40:22 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} | 3 | |
Failure Reason:
"2019-05-13 21:42:43.845839 mon.a (mon.1) 476 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954808 | 2019-05-13 19:34:14 | 2019-05-13 20:43:19 | 2019-05-14 08:45:43 | 12:02:24 | smithi | master | rhel | 7.5 | rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/radosbench_4M_write.yaml} | 1 | |||
fail | 3954809 | 2019-05-13 19:34:14 | 2019-05-13 20:48:02 | 2019-05-13 21:20:01 | 0:31:59 | 0:14:11 | 0:17:48 | smithi | master | rhel | 7.5 | rados/singleton/{all/rebuild-mondb.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |
Failure Reason:
Command failed on smithi165 with status 13: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status' |
||||||||||||||
dead | 3954810 | 2019-05-13 19:34:15 | 2019-05-13 20:50:01 | 2019-05-14 08:52:26 | 12:02:25 | 11:36:27 | 0:25:58 | smithi | master | rhel | 7.5 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_latest.yaml} tasks/ssh_orchestrator.yaml} | 2 | |
Failure Reason:
"2019-05-13 21:26:53.287524 mon.a (mon.1) 48 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954811 | 2019-05-13 19:34:16 | 2019-05-13 21:00:57 | 2019-05-14 09:03:22 | 12:02:25 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} | 2 | |||
dead | 3954812 | 2019-05-13 19:34:17 | 2019-05-13 21:07:23 | 2019-05-14 09:09:47 | 12:02:24 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=clay-k=4-m=2.yaml} | 2 | |||
pass | 3954813 | 2019-05-13 19:34:17 | 2019-05-13 21:09:08 | 2019-05-13 22:15:08 | 1:06:00 | 0:56:18 | 0:09:42 | smithi | master | ubuntu | 16.04 | rados/standalone/{supported-random-distro$/{ubuntu_16.04.yaml} workloads/scrub.yaml} | 1 | |
dead | 3954814 | 2019-05-13 19:34:18 | 2019-05-13 21:09:51 | 2019-05-14 09:12:16 | 12:02:25 | smithi | master | rhel | 7.5 | rados/multimon/{clusters/3.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/mon_clock_no_skews.yaml} | 2 | |||
dead | 3954815 | 2019-05-13 19:34:19 | 2019-05-13 21:11:45 | 2019-05-14 09:14:05 | 12:02:20 | smithi | master | centos | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} | 2 | ||||
dead | 3954816 | 2019-05-13 19:34:20 | 2019-05-13 21:13:15 | 2019-05-14 09:15:35 | 12:02:20 | 11:28:47 | 0:33:33 | smithi | master | rhel | 7.5 | rados/singleton/{all/recovery-preemption.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |
Failure Reason:
"2019-05-13 22:01:12.201912 mon.b (mon.1) 48 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954817 | 2019-05-13 19:34:20 | 2019-05-13 21:13:15 | 2019-05-14 09:15:39 | 12:02:24 | smithi | master | rhel | 7.5 | rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954818 | 2019-05-13 19:34:21 | 2019-05-13 21:13:23 | 2019-05-14 09:15:43 | 12:02:20 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | |||
dead | 3954819 | 2019-05-13 19:34:22 | 2019-05-13 21:15:33 | 2019-05-14 09:17:57 | 12:02:24 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rgw_snaps.yaml} | 2 | |||
dead | 3954820 | 2019-05-13 19:34:23 | 2019-05-13 21:17:04 | 2019-05-14 09:19:24 | 12:02:20 | smithi | master | centos | 7.5 | rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_latest.yaml} workloads/sample_fio.yaml} | 1 | |||
dead | 3954821 | 2019-05-13 19:34:23 | 2019-05-13 21:19:49 | 2019-05-14 09:22:14 | 12:02:25 | 11:39:32 | 0:22:53 | smithi | master | centos | 7.5 | rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/sync-many.yaml workloads/rados_api_tests.yaml} | 2 | |
Failure Reason:
SSH connection to smithi001 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954822 | 2019-05-13 19:34:24 | 2019-05-13 21:20:02 | 2019-05-14 09:22:27 | 12:02:25 | 11:35:32 | 0:26:53 | smithi | master | rhel | 7.5 | rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 2 | |
Failure Reason:
SSH connection to smithi077 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954823 | 2019-05-13 19:34:25 | 2019-05-13 21:25:14 | 2019-05-14 09:27:39 | 12:02:25 | 11:45:20 | 0:17:05 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} | 2 | |
Failure Reason:
"2019-05-13 21:52:23.819373 mon.a (mon.1) 192 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954824 | 2019-05-13 19:34:26 | 2019-05-13 21:27:22 | 2019-05-14 09:29:47 | 12:02:25 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/luminous-v1only.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} | 4 | |||
pass | 3954825 | 2019-05-13 19:34:26 | 2019-05-13 21:31:13 | 2019-05-14 01:47:16 | 4:16:03 | 3:58:15 | 0:17:48 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/objectstore.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |
dead | 3954826 | 2019-05-13 19:34:27 | 2019-05-13 21:31:33 | 2019-05-14 09:33:58 | 12:02:25 | smithi | master | rhel | 7.5 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{rhel_latest.yaml} tasks/workunits.yaml} | 2 | |||
dead | 3954827 | 2019-05-13 19:34:28 | 2019-05-13 21:32:23 | 2019-05-14 09:34:43 | 12:02:20 | smithi | master | rhel | 7.5 | rados/singleton/{all/test-crash.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954828 | 2019-05-13 19:34:29 | 2019-05-13 21:35:09 | 2019-05-14 09:37:29 | 12:02:20 | smithi | master | rhel | 7.5 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} | 2 | |||
dead | 3954829 | 2019-05-13 19:34:30 | 2019-05-13 21:39:22 | 2019-05-14 09:41:47 | 12:02:25 | smithi | master | rhel | 7.5 | rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/sample_radosbench.yaml} | 1 | |||
dead | 3954830 | 2019-05-13 19:34:30 | 2019-05-13 21:41:45 | 2019-05-14 09:44:05 | 12:02:20 | smithi | master | rhel | 7.5 | rados/singleton-nomsgr/{all/recovery-unfound-found.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954831 | 2019-05-13 19:34:31 | 2019-05-13 21:49:27 | 2019-05-14 09:51:56 | 12:02:29 | 10:38:10 | 1:24:19 | smithi | master | rhel | 7.5 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/scrub_test.yaml} | 2 | |
Failure Reason:
"2019-05-13 23:27:10.941603 mon.a (mon.1) 57 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954832 | 2019-05-13 19:34:32 | 2019-05-13 21:49:28 | 2019-05-14 09:51:49 | 12:02:21 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | 1 | |||
dead | 3954833 | 2019-05-13 19:34:33 | 2019-05-13 21:56:33 | 2019-05-14 09:58:53 | 12:02:20 | smithi | master | centos | 7.5 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | |||
dead | 3954834 | 2019-05-13 19:34:33 | 2019-05-13 22:03:35 | 2019-05-14 10:06:00 | 12:02:25 | smithi | master | rhel | 7.5 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} | 2 | |||
dead | 3954835 | 2019-05-13 19:34:34 | 2019-05-13 22:07:32 | 2019-05-14 10:09:56 | 12:02:24 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} | 3 | |||
dead | 3954836 | 2019-05-13 19:34:35 | 2019-05-13 22:15:19 | 2019-05-14 10:17:44 | 12:02:25 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} | 2 | |||
dead | 3954837 | 2019-05-13 19:34:36 | 2019-05-13 22:17:36 | 2019-05-14 10:20:01 | 12:02:25 | 10:30:51 | 1:31:34 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 4 | |
Failure Reason:
SSH connection to smithi164 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954838 | 2019-05-13 19:34:36 | 2019-05-13 22:58:57 | 2019-05-14 11:01:22 | 12:02:25 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} | 2 | |||
dead | 3954839 | 2019-05-13 19:34:37 | 2019-05-13 23:07:44 | 2019-05-14 11:10:03 | 12:02:19 | 3:18:20 | 8:43:59 | smithi | master | rhel | 7.5 | rados/singleton/{all/thrash-backfill-full.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 2 | |
Failure Reason:
SSH connection to smithi027 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
fail | 3954840 | 2019-05-13 19:34:38 | 2019-05-13 23:09:31 | 2019-05-14 08:09:39 | 9:00:08 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/luminous.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 2 | |||
Failure Reason:
machine smithi073.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_sage@teuthology |
||||||||||||||
dead | 3954841 | 2019-05-13 19:34:39 | 2019-05-13 23:37:33 | 2019-05-14 11:39:57 | 12:02:24 | smithi | master | rhel | 7.5 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} | 2 | |||
dead | 3954842 | 2019-05-13 19:34:39 | 2019-05-14 01:47:27 | 2019-05-14 13:49:48 | 12:02:21 | smithi | master | ubuntu | 18.04 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/crash.yaml} | 2 | |||
dead | 3954843 | 2019-05-13 19:34:40 | 2019-05-14 08:45:54 | 2019-05-14 20:48:18 | 12:02:24 | smithi | master | rhel | 7.5 | rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/cosbench_64K_read_write.yaml} | 1 | |||
dead | 3954844 | 2019-05-13 19:34:41 | 2019-05-14 08:45:58 | 2019-05-14 20:48:22 | 12:02:24 | 11:51:21 | 0:11:03 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/thrash-eio.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 2 | |
Failure Reason:
SSH connection to smithi153 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954845 | 2019-05-13 19:34:42 | 2019-05-14 08:52:38 | 2019-05-14 20:54:58 | 12:02:20 | smithi | master | rhel | 7.5 | rados/objectstore/{backends/alloc-hint.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954846 | 2019-05-13 19:34:42 | 2019-05-14 08:56:21 | 2019-05-14 20:58:46 | 12:02:25 | smithi | master | rhel | 7.5 | rados/rest/{mgr-restful.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954847 | 2019-05-13 19:34:43 | 2019-05-14 08:57:43 | 2019-05-14 21:00:04 | 12:02:21 | smithi | master | ubuntu | 18.04 | rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |||
dead | 3954848 | 2019-05-13 19:34:44 | 2019-05-14 09:03:33 | 2019-05-14 21:05:54 | 12:02:21 | smithi | master | centos | rados/singleton-flat/valgrind-leaks.yaml | 1 | ||||
dead | 3954849 | 2019-05-13 19:34:45 | 2019-05-14 09:06:05 | 2019-05-14 21:08:25 | 12:02:20 | smithi | master | ubuntu | 16.04 | rados/singleton-nomsgr/{all/admin_socket_output.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | 1 | |||
pass | 3954850 | 2019-05-13 19:34:45 | 2019-05-14 09:06:41 | 2019-05-14 09:26:41 | 0:20:00 | 0:09:57 | 0:10:03 | smithi | master | ubuntu | 16.04 | rados/standalone/{supported-random-distro$/{ubuntu_16.04.yaml} workloads/crush.yaml} | 1 | |
fail | 3954851 | 2019-05-13 19:34:46 | 2019-05-14 09:09:59 | 2019-05-14 10:23:59 | 1:14:00 | 0:10:59 | 1:03:01 | smithi | master | ubuntu | 16.04 | rados/upgrade/mimic-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/mimic.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-nautilus.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} bluestore-bitmap.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashosds-health.yaml} | 4 | |
Failure Reason:
Command failed on smithi121 with status 124: "sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_health_to_clog=true" |
||||||||||||||
dead | 3954852 | 2019-05-13 19:34:47 | 2019-05-14 09:12:28 | 2019-05-14 21:14:52 | 12:02:24 | smithi | master | rhel | 7.5 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} | 2 | |||
dead | 3954853 | 2019-05-13 19:34:48 | 2019-05-14 09:14:17 | 2019-05-14 21:16:47 | 12:02:30 | smithi | master | rhel | 7.5 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/rados_api_tests.yaml} | 2 | |||
dead | 3954854 | 2019-05-13 19:34:48 | 2019-05-14 09:15:47 | 2019-05-14 21:18:12 | 12:02:25 | smithi | master | ubuntu | 18.04 | rados/multimon/{clusters/6.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_clock_with_skews.yaml} | 2 | |||
dead | 3954855 | 2019-05-13 19:34:49 | 2019-05-14 09:15:47 | 2019-05-14 09:31:46 | 0:15:59 | smithi | master | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} | 2 | |||||
Failure Reason:
SSH connection to smithi059 was lost: 'sudo yum install -y kernel' |
||||||||||||||
fail | 3954856 | 2019-05-13 19:34:50 | 2019-05-14 09:15:47 | 2019-05-14 09:37:46 | 0:21:59 | smithi | master | ubuntu | 18.04 | rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync.yaml workloads/rados_mon_osdmap_prune.yaml} | 2 | |||
Failure Reason:
Command failed on smithi007 with status 100: 'sudo apt-get clean' |
||||||||||||||
dead | 3954857 | 2019-05-13 19:34:51 | 2019-05-14 09:18:09 | 2019-05-14 21:20:34 | 12:02:25 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | 2 | |||
dead | 3954858 | 2019-05-13 19:34:51 | 2019-05-14 09:19:36 | 2019-05-14 21:22:02 | 12:02:26 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} | 2 | |||
dead | 3954859 | 2019-05-13 19:34:52 | 2019-05-14 09:22:25 | 2019-05-14 21:24:46 | 12:02:21 | 11:51:45 | 0:10:36 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/cosbench_64K_write.yaml} | 1 | |
Failure Reason:
SSH connection to smithi001 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
fail | 3954860 | 2019-05-13 19:34:53 | 2019-05-14 09:22:28 | 2019-05-14 09:30:27 | 0:07:59 | smithi | master | centos | 7.5 | rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} | 2 | |||
Failure Reason:
Command failed on smithi007 with status 1: 'sudo package-cleanup -y --oldkernels' |
||||||||||||||
dead | 3954861 | 2019-05-13 19:34:54 | 2019-05-14 09:26:53 | 2019-05-14 21:29:18 | 12:02:25 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/mimic-v1only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/few.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 4 | |||
dead | 3954862 | 2019-05-13 19:34:54 | 2019-05-14 09:27:40 | 2019-05-14 21:30:00 | 12:02:20 | smithi | master | ubuntu | 16.04 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/dashboard.yaml} | 2 | |||
dead | 3954863 | 2019-05-13 19:34:55 | 2019-05-14 09:29:59 | 2019-05-14 09:37:58 | 0:07:59 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 2 | |||
Failure Reason:
SSH connection to smithi007 was lost: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic' |
||||||||||||||
dead | 3954864 | 2019-05-13 19:34:56 | 2019-05-14 09:29:59 | 2019-05-14 21:32:24 | 12:02:25 | 11:45:03 | 0:17:22 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | |
Failure Reason:
"2019-05-14 10:08:10.627013 mon.b (mon.1) 241 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954865 | 2019-05-13 19:34:57 | 2019-05-14 09:30:28 | 2019-05-14 21:32:49 | 12:02:21 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} | 2 | |||
dead | 3954866 | 2019-05-13 19:34:57 | 2019-05-14 09:31:58 | 2019-05-14 21:34:23 | 12:02:25 | smithi | master | rhel | 7.5 | rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954867 | 2019-05-13 19:34:58 | 2019-05-14 09:34:09 | 2019-05-14 21:36:34 | 12:02:25 | smithi | master | ubuntu | 16.04 | rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | 1 | |||
dead | 3954868 | 2019-05-13 19:34:59 | 2019-05-14 09:34:44 | 2019-05-14 21:37:10 | 12:02:26 | smithi | master | centos | 7.5 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} tasks/rados_cls_all.yaml} | 2 | |||
dead | 3954869 | 2019-05-13 19:35:00 | 2019-05-14 09:37:41 | 2019-05-14 21:40:05 | 12:02:24 | smithi | master | rhel | 7.5 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} | 3 | |||
dead | 3954870 | 2019-05-13 19:35:00 | 2019-05-14 09:37:47 | 2019-05-14 21:40:08 | 12:02:21 | smithi | master | rhel | 7.5 | rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/fio_4K_rand_read.yaml} | 1 | |||
dead | 3954871 | 2019-05-13 19:35:01 | 2019-05-14 09:37:59 | 2019-05-14 21:40:24 | 12:02:25 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/cache.yaml} | 2 | |||
dead | 3954872 | 2019-05-13 19:35:02 | 2019-05-14 09:41:59 | 2019-05-14 21:44:20 | 12:02:21 | smithi | master | centos | 7.5 | rados/singleton/{all/admin-socket.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} | 1 | |||
dead | 3954873 | 2019-05-13 19:35:03 | 2019-05-14 09:44:17 | 2019-05-14 21:46:42 | 12:02:25 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/ceph_objectstore_tool.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |||
dead | 3954874 | 2019-05-13 19:35:04 | 2019-05-14 09:52:00 | 2019-05-14 21:54:24 | 12:02:24 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} | 2 | |||
dead | 3954875 | 2019-05-13 19:35:04 | 2019-05-14 09:52:00 | 2019-05-14 21:54:21 | 12:02:21 | 8:16:32 | 3:45:49 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 4 | |
Failure Reason:
"2019-05-14 13:45:23.953110 mon.b (mon.1) 75 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954876 | 2019-05-13 19:35:05 | 2019-05-14 09:58:20 | 2019-05-14 22:00:45 | 12:02:25 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} | 2 | |||
dead | 3954877 | 2019-05-13 19:35:06 | 2019-05-14 09:58:54 | 2019-05-14 22:01:15 | 12:02:21 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/deduptool.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | 1 | |||
dead | 3954878 | 2019-05-13 19:35:07 | 2019-05-14 10:01:52 | 2019-05-14 22:04:21 | 12:02:29 | smithi | master | centos | 7.5 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{centos_latest.yaml} tasks/failover.yaml} | 2 | |||
dead | 3954879 | 2019-05-13 19:35:07 | 2019-05-14 10:06:12 | 2019-05-14 22:08:33 | 12:02:21 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/mimic.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} | 4 | |||
dead | 3954880 | 2019-05-13 19:35:08 | 2019-05-14 10:10:08 | 2019-05-14 22:12:34 | 12:02:26 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/fio_4K_rand_rw.yaml} | 1 | |||
dead | 3954881 | 2019-05-13 19:35:09 | 2019-05-14 10:10:08 | 2019-05-14 22:12:34 | 12:02:26 | smithi | master | centos | 7.5 | rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} | 2 | |||
dead | 3954882 | 2019-05-13 19:35:10 | 2019-05-14 10:17:55 | 2019-05-14 22:20:20 | 12:02:25 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/ceph-kvstore-tool.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |||
fail | 3954883 | 2019-05-13 19:35:10 | 2019-05-14 10:20:13 | 2019-05-14 22:26:39 | 12:06:26 | 11:36:18 | 0:30:08 | smithi | master | ubuntu | 16.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/rados_python.yaml} | — | |
Failure Reason:
"2019-05-14 10:55:25.958843 mon.a (mon.1) 127 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954884 | 2019-05-13 19:35:11 | 2019-05-14 10:24:12 | 2019-05-14 22:26:36 | 12:02:24 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} | 2 | |||
dead | 3954885 | 2019-05-13 19:35:12 | 2019-05-14 10:25:25 | 2019-05-14 22:27:45 | 12:02:20 | smithi | master | rhel | 7.5 | rados/singleton/{all/divergent_priors.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
pass | 3954886 | 2019-05-13 19:35:12 | 2019-05-14 10:27:18 | 2019-05-14 11:19:17 | 0:51:59 | 0:38:56 | 0:13:03 | smithi | master | rhel | 7.5 | rados/standalone/{supported-random-distro$/{rhel_latest.yaml} workloads/erasure-code.yaml} | 1 | |
dead | 3954887 | 2019-05-13 19:35:13 | 2019-05-14 10:30:10 | 2019-05-14 22:32:31 | 12:02:21 | smithi | master | centos | 7.5 | rados/multimon/{clusters/9.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} tasks/mon_recovery.yaml} | 3 | |||
dead | 3954888 | 2019-05-13 19:35:14 | 2019-05-14 10:35:45 | 2019-05-14 22:38:09 | 12:02:24 | smithi | master | centos | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} | 2 | ||||
dead | 3954889 | 2019-05-13 19:35:15 | 2019-05-14 10:35:48 | 2019-05-14 22:38:09 | 12:02:21 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 2 | |||
dead | 3954890 | 2019-05-13 19:35:16 | 2019-05-14 10:43:29 | 2019-05-14 22:45:50 | 12:02:21 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/divergent_priors2.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |||
dead | 3954891 | 2019-05-13 19:35:16 | 2019-05-14 10:43:59 | 2019-05-14 22:46:23 | 12:02:24 | smithi | master | rhel | 7.5 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} | 2 | |||
dead | 3954892 | 2019-05-13 19:35:17 | 2019-05-14 10:48:51 | 2019-05-14 22:51:11 | 12:02:20 | smithi | master | centos | 7.5 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | |||
dead | 3954893 | 2019-05-13 19:35:18 | 2019-05-14 10:51:17 | 2019-05-14 22:53:42 | 12:02:25 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/fio_4M_rand_read.yaml} | 1 | |||
dead | 3954894 | 2019-05-13 19:35:19 | 2019-05-14 10:51:40 | 2019-05-14 22:54:01 | 12:02:21 | smithi | master | centos | 7.5 | rados/singleton/{all/dump-stuck.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} | 1 | |||
dead | 3954895 | 2019-05-13 19:35:19 | 2019-05-14 10:54:11 | 2019-05-14 22:56:36 | 12:02:25 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/redirect.yaml} | 2 | |||
dead | 3954896 | 2019-05-13 19:35:20 | 2019-05-14 10:57:45 | 2019-05-14 23:00:10 | 12:02:25 | smithi | master | rhel | 7.5 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_latest.yaml} tasks/insights.yaml} | 2 | |||
dead | 3954897 | 2019-05-13 19:35:21 | 2019-05-14 11:01:35 | 2019-05-14 23:06:05 | 12:04:30 | 11:49:59 | 0:14:31 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/filejournal.yaml supported-random-distro$/{ubuntu_latest.yaml}} | — | |
Failure Reason:
SSH connection to smithi176 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954898 | 2019-05-13 19:35:22 | 2019-05-14 11:05:43 | 2019-05-14 23:08:04 | 12:02:21 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} | 3 | |||
dead | 3954899 | 2019-05-13 19:35:22 | 2019-05-14 11:08:02 | 2019-05-14 23:10:27 | 12:02:25 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 4 | |||
fail | 3954900 | 2019-05-13 19:35:23 | 2019-05-14 11:10:15 | 2019-05-14 23:14:37 | 12:04:22 | 11:14:00 | 0:50:22 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_stress_watch.yaml} | — | |
Failure Reason:
"2019-05-14 12:10:57.043471 mon.a (mon.1) 40 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
pass | 3954901 | 2019-05-13 19:35:24 | 2019-05-14 11:11:00 | 2019-05-14 11:36:59 | 0:25:59 | 0:12:31 | 0:13:28 | smithi | master | rhel | 7.5 | rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |
dead | 3954902 | 2019-05-13 19:35:25 | 2019-05-14 11:19:06 | 2019-05-14 23:21:26 | 12:02:20 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | 1 | |||
dead | 3954903 | 2019-05-13 19:35:25 | 2019-05-14 11:19:19 | 2019-05-14 23:21:43 | 12:02:24 | smithi | master | rhel | 7.5 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} | 2 | |||
dead | 3954904 | 2019-05-13 19:35:26 | 2019-05-14 11:23:52 | 2019-05-14 23:26:12 | 12:02:20 | smithi | master | rhel | 7.5 | rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954905 | 2019-05-13 19:35:27 | 2019-05-14 11:37:11 | 2019-05-14 23:39:32 | 12:02:21 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/fio_4M_rand_rw.yaml} | 1 | |||
pass | 3954906 | 2019-05-13 19:35:28 | 2019-05-14 11:40:10 | 2019-05-14 12:02:09 | 0:21:59 | 0:06:17 | 0:15:42 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/erasure-code-nonregression.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | 1 | |
dead | 3954907 | 2019-05-13 19:35:28 | 2019-05-14 11:42:13 | 2019-05-14 23:44:34 | 12:02:21 | smithi | master | rhel | 7.5 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} | 2 | |||
dead | 3954908 | 2019-05-13 19:35:29 | 2019-05-14 11:48:25 | 2019-05-14 23:50:50 | 12:02:25 | 9:59:24 | 2:03:01 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} | 2 | |
Failure Reason:
"2019-05-14 14:06:38.012100 mon.b (mon.1) 219 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954909 | 2019-05-13 19:35:30 | 2019-05-14 11:51:46 | 2019-05-14 23:53:56 | 12:02:10 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_16.04.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | — | |||
dead | 3954910 | 2019-05-13 19:35:31 | 2019-05-14 12:02:21 | 2019-05-15 00:04:46 | 12:02:25 | 10:52:24 | 1:10:01 | smithi | master | ubuntu | 16.04 | rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/many.yaml workloads/snaps-few-objects.yaml} | 2 | |
Failure Reason:
SSH connection to smithi017 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954911 | 2019-05-13 19:35:31 | 2019-05-14 12:32:00 | 2019-05-15 00:34:21 | 12:02:21 | smithi | master | ubuntu | 18.04 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/module_selftest.yaml} | 2 | |||
dead | 3954912 | 2019-05-13 19:35:32 | 2019-05-14 12:38:07 | 2019-05-15 00:40:32 | 12:02:25 | smithi | master | rhel | 7.5 | rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954913 | 2019-05-13 19:35:33 | 2019-05-14 13:03:32 | 2019-05-15 01:05:53 | 12:02:21 | 11:07:26 | 0:54:55 | smithi | master | centos | 7.5 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} tasks/rados_striper.yaml} | 2 | |
Failure Reason:
"2019-05-14 14:07:03.011729 mon.a (mon.1) 85 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954914 | 2019-05-13 19:35:34 | 2019-05-14 13:15:45 | 2019-05-15 01:18:05 | 12:02:20 | 11:46:22 | 0:15:58 | smithi | master | centos | 7.6 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/nautilus-v2only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/few.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} | — | |
Failure Reason:
SSH connection to smithi005 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954915 | 2019-05-13 19:35:35 | 2019-05-14 13:18:19 | 2019-05-15 01:20:40 | 12:02:21 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} | 2 | |||
dead | 3954916 | 2019-05-13 19:35:35 | 2019-05-14 13:22:24 | 2019-05-15 01:24:48 | 12:02:24 | smithi | master | centos | 7.5 | rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} | 1 | |||
dead | 3954917 | 2019-05-13 19:35:36 | 2019-05-14 13:25:42 | 2019-05-15 01:28:02 | 12:02:20 | smithi | master | centos | 7.5 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} | 2 | |||
dead | 3954918 | 2019-05-13 19:35:37 | 2019-05-14 13:25:54 | 2019-05-15 01:28:18 | 12:02:24 | smithi | master | ubuntu | 16.04 | rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_16.04.yaml} workloads/fio_4M_rand_write.yaml} | 1 | |||
dead | 3954919 | 2019-05-13 19:35:38 | 2019-05-14 13:30:16 | 2019-05-15 01:32:37 | 12:02:21 | smithi | master | centos | 7.5 | rados/singleton/{all/lost-unfound.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} | 1 | |||
dead | 3954920 | 2019-05-13 19:35:38 | 2019-05-14 13:37:59 | 2019-05-15 01:40:19 | 12:02:20 | smithi | master | rhel | 7.5 | rados/objectstore/{backends/filestore-idempotent-aio-journal.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
fail | 3954921 | 2019-05-13 19:35:39 | 2019-05-14 13:41:19 | 2019-05-14 14:19:19 | 0:38:00 | 0:27:16 | 0:10:44 | smithi | master | ubuntu | 18.04 | rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/misc.yaml} | 1 | |
Failure Reason:
Command failed (workunit test misc/test-ceph-helpers.sh) on smithi016 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dc46926df33c49ecb4236b8bc2f33597e45430bd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-ceph-helpers.sh' |
||||||||||||||
dead | 3954922 | 2019-05-13 19:35:40 | 2019-05-14 13:43:52 | 2019-05-15 01:46:17 | 12:02:25 | 10:30:18 | 1:32:07 | smithi | master | rhel | 7.5 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | |
Failure Reason:
"2019-05-14 15:40:26.919985 mon.b (mon.1) 25 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954923 | 2019-05-13 19:35:41 | 2019-05-14 13:43:56 | 2019-05-15 01:46:16 | 12:02:20 | smithi | master | rhel | 7.5 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} | 2 | |||
dead | 3954924 | 2019-05-13 19:35:41 | 2019-05-14 13:46:32 | 2019-05-15 01:48:57 | 12:02:25 | smithi | master | ubuntu | 16.04 | rados/multimon/{clusters/21.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/mon_clock_no_skews.yaml} | 3 | |||
dead | 3954925 | 2019-05-13 19:35:42 | 2019-05-14 13:50:00 | 2019-05-15 01:52:21 | 12:02:21 | smithi | master | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} | 2 | |||||
dead | 3954926 | 2019-05-13 19:35:43 | 2019-05-14 14:19:30 | 2019-05-15 02:21:51 | 12:02:21 | 11:55:39 | 0:06:42 | smithi | master | rhel | 7.5 | rados/singleton/{all/max-pg-per-osd.from-mon.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |
Failure Reason:
SSH connection to smithi016 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954927 | 2019-05-13 19:35:44 | 2019-05-14 15:02:28 | 2019-05-15 03:04:53 | 12:02:25 | 10:59:10 | 1:03:15 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} | 3 | |
Failure Reason:
SSH connection to smithi008 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954928 | 2019-05-13 19:35:45 | 2019-05-14 15:10:06 | 2019-05-15 03:12:27 | 12:02:21 | smithi | master | rhel | 7.5 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 2 | |||
dead | 3954929 | 2019-05-13 19:35:45 | 2019-05-14 15:54:06 | 2019-05-15 03:56:31 | 12:02:25 | smithi | master | rhel | 7.5 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{rhel_latest.yaml} tasks/orchestrator_cli.yaml} | 2 | |||
dead | 3954930 | 2019-05-13 19:35:46 | 2019-05-14 16:08:07 | 2019-05-15 04:10:27 | 12:02:20 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/radosbench_4K_rand_read.yaml} | 1 | |||
dead | 3954931 | 2019-05-13 19:35:47 | 2019-05-14 16:10:31 | 2019-05-15 04:12:56 | 12:02:25 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_workunit_loadgen_big.yaml} | 2 | |||
dead | 3954932 | 2019-05-13 19:35:48 | 2019-05-14 16:22:30 | 2019-05-15 04:24:50 | 12:02:20 | smithi | master | rhel | 7.5 | rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954933 | 2019-05-13 19:35:48 | 2019-05-14 16:26:12 | 2019-05-15 04:28:36 | 12:02:24 | smithi | master | centos | 7.5 | rados/singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} | 1 | |||
dead | 3954934 | 2019-05-13 19:35:49 | 2019-05-14 16:30:01 | 2019-05-15 04:32:21 | 12:02:20 | smithi | master | ubuntu | 16.04 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 4 | |||
dead | 3954935 | 2019-05-13 19:35:50 | 2019-05-14 16:37:37 | 2019-05-15 04:40:02 | 12:02:25 | 11:34:30 | 0:27:55 | smithi | master | centos | 7.5 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} | 2 | |
Failure Reason:
SSH connection to smithi095 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954936 | 2019-05-13 19:35:51 | 2019-05-14 16:40:53 | 2019-05-15 04:43:18 | 12:02:25 | smithi | master | centos | 7.5 | rados/singleton/{all/max-pg-per-osd.from-replica.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} | 1 | |||
dead | 3954937 | 2019-05-13 19:35:51 | 2019-05-14 16:48:19 | 2019-05-15 04:50:43 | 12:02:24 | smithi | master | centos | 7.5 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} | 2 | |||
dead | 3954938 | 2019-05-13 19:35:52 | 2019-05-14 17:10:13 | 2019-05-15 05:12:38 | 12:02:25 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph.yaml objectstore/filestore-xfs.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/radosbench_4K_seq_read.yaml} | 1 | |||
dead | 3954939 | 2019-05-13 19:35:53 | 2019-05-14 18:48:24 | 2019-05-15 06:50:49 | 12:02:25 | 11:51:29 | 0:10:56 | smithi | master | ubuntu | 18.04 | rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/one.yaml workloads/pool-create-delete.yaml} | 2 | |
Failure Reason:
"2019-05-15 06:48:35.507032 mon.a (mon.1) 77 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log |
||||||||||||||
dead | 3954940 | 2019-05-13 19:35:54 | 2019-05-14 19:25:12 | 2019-05-15 07:27:33 | 12:02:21 | 11:53:16 | 0:09:05 | smithi | master | rhel | 7.5 | rados/singleton/{all/mon-auth-caps.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | — | |
Failure Reason:
SSH connection to smithi180 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954941 | 2019-05-13 19:35:55 | 2019-05-14 19:28:40 | 2019-05-15 07:31:01 | 12:02:21 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-many-deletes.yaml} | 2 | |||
dead | 3954942 | 2019-05-13 19:35:55 | 2019-05-14 19:44:20 | 2019-05-15 07:46:41 | 12:02:21 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/filestore-idempotent.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |||
dead | 3954943 | 2019-05-13 19:35:56 | 2019-05-14 19:50:00 | 2019-05-15 07:52:25 | 12:02:25 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} | 2 | |||
fail | 3954944 | 2019-05-13 19:35:57 | 2019-05-14 19:54:01 | 2019-05-14 22:00:02 | 2:06:01 | smithi | master | rhel | 7.5 | rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} | 2 | |||
Failure Reason:
machine smithi070.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_sage@teuthology |
||||||||||||||
dead | 3954945 | 2019-05-13 19:35:58 | 2019-05-14 20:06:12 | 2019-05-15 08:08:38 | 12:02:26 | 10:41:59 | 1:20:27 | smithi | master | centos | 7.5 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} tasks/rados_workunit_loadgen_mix.yaml} | 2 | |
Failure Reason:
"2019-05-14 21:46:26.615839 mon.b (mon.1) 99 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log |
||||||||||||||
dead | 3954946 | 2019-05-13 19:35:58 | 2019-05-14 20:07:41 | 2019-05-15 08:10:07 | 12:02:26 | smithi | master | rhel | 7.5 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{rhel_latest.yaml} tasks/progress.yaml} | 2 | |||
dead | 3954947 | 2019-05-13 19:35:59 | 2019-05-14 20:34:36 | 2019-05-15 08:37:01 | 12:02:25 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} | 2 | |||
dead | 3954948 | 2019-05-13 19:36:00 | 2019-05-14 20:37:58 | 2019-05-15 08:40:24 | 12:02:26 | smithi | master | rhel | 7.5 | rados/singleton-nomsgr/{all/health-warnings.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |||
dead | 3954949 | 2019-05-13 19:36:01 | 2019-05-14 20:48:30 | 2019-05-15 08:50:55 | 12:02:25 | smithi | master | centos | 7.5 | rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} | 2 | |||
dead | 3954950 | 2019-05-13 19:36:01 | 2019-05-14 20:48:30 | 2019-05-15 08:50:56 | 12:02:26 | 11:55:07 | 0:07:19 | smithi | master | rhel | 7.5 | rados/singleton/{all/mon-config-key-caps.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | 1 | |
Failure Reason:
SSH connection to smithi153 was lost: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" |
||||||||||||||
dead | 3954951 | 2019-05-13 19:36:02 | 2019-05-14 20:55:10 | 2019-05-14 21:39:10 | 0:44:00 | smithi | master | ubuntu | 16.04 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/hammer.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{ubuntu_16.04.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} | — | |||
Failure Reason:
'ssh_keyscan smithi133.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds |
||||||||||||||
dead | 3954952 | 2019-05-13 19:36:03 | 2019-05-14 20:58:57 | 2019-05-15 09:01:22 | 12:02:25 | smithi | master | rhel | 7.5 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} | 2 | |||
dead | 3954953 | 2019-05-13 19:36:04 | 2019-05-14 21:00:16 | 2019-05-15 09:02:41 | 12:02:25 | smithi | master | rhel | 7.5 | rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/radosbench_4M_rand_read.yaml} | 1 | |||
dead | 3954954 | 2019-05-13 19:36:04 | 2019-05-14 21:06:05 | 2019-05-15 09:08:30 | 12:02:25 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/mon-config-keys.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | 1 | |||
dead | 3954955 | 2019-05-13 19:36:05 | 2019-05-14 21:08:37 | 2019-05-15 09:11:04 | 12:02:27 | smithi | master | ubuntu | 18.04 | rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} | 1 | |||
pass | 3954956 | 2019-05-13 19:36:06 | 2019-05-14 21:15:04 | 2019-05-14 22:07:04 | 0:52:00 | 0:40:15 | 0:11:45 | smithi | master | ubuntu | 16.04 | rados/standalone/{supported-random-distro$/{ubuntu_16.04.yaml} workloads/mon.yaml} | 1 | |
dead | 3954957 | 2019-05-13 19:36:07 | 2019-05-14 21:16:59 | 2019-05-14 21:58:58 | 0:41:59 | smithi | master | ubuntu | 18.04 | rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/nautilus.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-octopus.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashosds-health.yaml} | 4 | |||
Failure Reason:
SSH connection to smithi183 was lost: 'sudo apt-get update' |
||||||||||||||
dead | 3954958 | 2019-05-13 19:36:07 | 2019-05-14 21:18:23 | 2019-05-15 09:20:48 | 12:02:25 | smithi | master | centos | 7.5 | rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} | 3 | |||
fail | 3954959 | 2019-05-13 19:36:08 | 2019-05-14 21:20:45 | 2019-05-14 21:38:45 | 0:18:00 | smithi | master | rhel | 7.5 | rados/multimon/{clusters/3.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/mon_clock_with_skews.yaml} | 2 | |||
Failure Reason:
Could not reconnect to ubuntu@smithi001.front.sepia.ceph.com |
||||||||||||||
dead | 3954960 | 2019-05-13 19:36:09 | 2019-05-14 21:22:13 | 2019-05-14 21:34:12 | 0:11:59 | smithi | master | centos | rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} | 2 | ||||
Failure Reason:
SSH connection to smithi001 was lost: 'echo no | sudo yum reinstall kernel || true' |
||||||||||||||
dead | 3954961 | 2019-05-13 19:36:10 | 2019-05-14 21:24:57 | 2019-05-15 09:27:27 | 12:02:30 | smithi | master | centos | 7.5 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} | 2 | |||
fail | 3954962 | 2019-05-13 19:36:10 | 2019-05-14 21:29:30 | 2019-05-14 21:43:29 | 0:13:59 | 0:07:13 | 0:06:46 | smithi | master | rhel | 7.5 | rados/singleton/{all/mon-config.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} | — | |
Failure Reason:
u'latest', u'disablerepo': None, u'update_cache': False, u'enablerepo': u'epel', u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, '_ansible_ignore_errors': None, u'msg': u''}, {'msg': u'SSH Error: data could not be sent to remote host "smithi007.front.sepia.ceph.com". Make sure this host can be reached over ssh', 'unreachable': True, '_ansible_item_result': True, '_ansible_ignore_errors': None, 'item': u'nrpe'}, {'msg': u'SSH Error: data could not be sent to remote host "smithi007.front.sepia.ceph.com". Make sure this host can be reached over ssh', 'unreachable': True, '_ansible_item_result': True, '_ansible_ignore_errors': None, 'item': u'nagios-plugins'}, {'_ansible_parsed': True, 'changed': False, '_ansible_no_log': False, 'item': u'nagios-plugins-load', '_ansible_item_result': True, u'failed': True, u'invocation': {u'module_args': {u'allow_downgrade': False, u'name': [u'nagios-plugins-load'], u'list': None, u'install_repoquery': True, u'conf_file': None, u'disable_gpg_check': False, u'state': u'latest', u'disablerepo': None, u'update_cache': False, u'enablerepo': u'epel', u'exclude': None, u'security': False, u'validate_certs': True, u'installroot': u'/', u'skip_broken': False}}, u'msg': u'python2 bindings for rpm are needed for this module. python2 yum module is needed for this module'}]}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 218, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 190, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 28, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 217, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 101, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 57, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 225, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 123, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 67, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 249, in represent_undefined raise RepresenterError("cannot represent an object: %s" % data)RepresenterError: cannot represent an object: nagios-common |
||||||||||||||
fail | 3954963 | 2019-05-13 19:36:11 | 2019-05-14 21:30:01 | 2019-05-14 21:38:00 | 0:07:59 | smithi | master | ubuntu | 16.04 | rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/rados_workunit_loadgen_mostlyread.yaml} | 2 | |||
Failure Reason:
Stale jobs detected, aborting. |
||||||||||||||
dead | 3954964 | 2019-05-13 19:36:12 | 2019-05-14 21:32:36 | 2019-05-15 09:35:01 | 12:02:25 | smithi | master | centos | 7.5 | rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{centos_latest.yaml} tasks/prometheus.yaml} | 2 | |||
fail | 3954965 | 2019-05-13 19:36:13 | 2019-05-14 21:32:50 | 2019-05-14 21:44:49 | 0:11:59 | smithi | master | ubuntu | 16.04 | rados/singleton-nomsgr/{all/large-omap-object-warnings.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} | — | |||
Failure Reason:
machine smithi001.front.sepia.ceph.com is locked by scheduled_teuthology@teuthology, not scheduled_sage@teuthology |