User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|
sage | 2019-12-22 14:39:19 | 2019-12-22 14:40:44 | 2019-12-23 14:02:16 | 23:21:32 | rados:thrash-old-clients | wip-sage-testing-2019-12-21-2007 | smithi | 090e59a | 17 | 4 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
dead | 4626244 | 2019-12-22 14:39:25 | 2019-12-22 14:40:44 | 2019-12-23 14:02:16 | 23:21:32 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 3 | |||
fail | 4626245 | 2019-12-22 14:39:26 | 2019-12-22 14:42:14 | 2019-12-22 15:22:14 | 0:40:00 | 0:24:19 | 0:15:41 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/jewel.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after mon.a restart |
||||||||||||||
fail | 4626246 | 2019-12-22 14:39:26 | 2019-12-22 14:42:15 | 2019-12-22 15:22:14 | 0:39:59 | 0:22:10 | 0:17:49 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/luminous-v1only.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 3 | |
Failure Reason:
Command failed on smithi064 with status 1: 'CEPH_CLIENT_ID=2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op cache_try_flush 50 --op cache_flush 50 --op cache_evict 50 --op delete 50 --pool base' |
||||||||||||||
fail | 4626247 | 2019-12-22 14:39:27 | 2019-12-22 14:42:19 | 2019-12-22 15:18:19 | 0:36:00 | 0:24:23 | 0:11:37 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/luminous.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after mon.a restart |
||||||||||||||
fail | 4626248 | 2019-12-22 14:39:28 | 2019-12-22 14:42:19 | 2019-12-22 15:18:19 | 0:36:00 | 0:24:09 | 0:11:51 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/mimic-v1only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after mon.a restart |
||||||||||||||
fail | 4626249 | 2019-12-22 14:39:29 | 2019-12-22 14:42:52 | 2019-12-22 15:20:51 | 0:37:59 | 0:24:12 | 0:13:47 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/mimic.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after mon.a restart |
||||||||||||||
fail | 4626250 | 2019-12-22 14:39:30 | 2019-12-22 14:44:07 | 2019-12-22 15:30:06 | 0:45:59 | 0:16:06 | 0:29:53 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} | 3 | |
Failure Reason:
Command failed on smithi033 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph-ci/ceph:090e59a56baeb40f32bcf548848fee9551d963e1 shell -c /home/ubuntu/cephtest/ceph.conf -k /home/ubuntu/cephtest/ceph.keyring --fsid 1d91f616-24cf-11ea-8283-001a4aab830c -- ceph orchestrator mon update 2 'smithi033:[v1:172.21.15.33:6789]=b'" |
||||||||||||||
fail | 4626251 | 2019-12-22 14:39:31 | 2019-12-22 14:44:07 | 2019-12-22 15:32:07 | 0:48:00 | 0:24:39 | 0:23:21 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/nautilus-v2only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after mon.a restart |
||||||||||||||
fail | 4626252 | 2019-12-22 14:39:32 | 2019-12-22 14:44:09 | 2019-12-22 15:26:09 | 0:42:00 | 0:24:59 | 0:17:01 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 3 | |
Failure Reason:
SELinux denials found on ubuntu@smithi047.front.sepia.ceph.com: ['type=AVC msg=audit(1577027761.317:5694): avc: denied { getattr } for pid=11593 comm="logrotate" path="/var/log/ceph/708e7c42-24cd-11ea-8283-001a4aab830c/ceph.audit.log" dev="sda1" ino=527179 scontext=system_u:system_r:logrotate_t:s0-s0:c0.c1023 tcontext=system_u:object_r:container_file_t:s0 tclass=file permissive=1', 'type=AVC msg=audit(1577027761.317:5693): avc: denied { read } for pid=11593 comm="logrotate" name="708e7c42-24cd-11ea-8283-001a4aab830c" dev="sda1" ino=527174 scontext=system_u:system_r:logrotate_t:s0-s0:c0.c1023 tcontext=system_u:object_r:container_file_t:s0 tclass=dir permissive=1'] |
||||||||||||||
fail | 4626253 | 2019-12-22 14:39:33 | 2019-12-22 14:44:17 | 2019-12-22 15:08:16 | 0:23:59 | 0:10:28 | 0:13:31 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/hammer.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 3 | |
Failure Reason:
Command failed on smithi195 with status 1: 'sudo yum -y install rbd-mirror' |
||||||||||||||
dead | 4626254 | 2019-12-22 14:39:34 | 2019-12-22 14:46:28 | 2019-12-22 15:34:27 | 0:47:59 | 0:13:35 | 0:34:24 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel-v1only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} | 3 | |
Failure Reason:
SSH connection to smithi145 was lost: 'sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 35e55734-24d0-11ea-8283-001a4aab830c --force' |
||||||||||||||
dead | 4626255 | 2019-12-22 14:39:35 | 2019-12-22 14:46:28 | 2019-12-22 15:34:27 | 0:47:59 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/jewel.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 3 | |||
fail | 4626256 | 2019-12-22 14:39:37 | 2019-12-22 14:48:00 | 2019-12-22 15:24:00 | 0:36:00 | 0:24:46 | 0:11:14 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/luminous-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after mon.a restart |
||||||||||||||
fail | 4626257 | 2019-12-22 14:39:38 | 2019-12-22 14:48:11 | 2019-12-22 15:28:10 | 0:39:59 | 0:22:28 | 0:17:31 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/luminous.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 3 | |
Failure Reason:
Command failed on smithi044 with status 1: 'CEPH_CLIENT_ID=2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op cache_try_flush 50 --op cache_flush 50 --op cache_evict 50 --op delete 50 --pool base' |
||||||||||||||
fail | 4626258 | 2019-12-22 14:39:39 | 2019-12-22 14:48:17 | 2019-12-22 15:24:17 | 0:36:00 | 0:23:56 | 0:12:04 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/mimic-v1only.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after mon.a restart |
||||||||||||||
fail | 4626259 | 2019-12-22 14:39:40 | 2019-12-22 14:48:26 | 2019-12-22 15:24:25 | 0:35:59 | 0:24:24 | 0:11:35 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/mimic.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after mon.a restart |
||||||||||||||
fail | 4626260 | 2019-12-22 14:39:41 | 2019-12-22 14:50:12 | 2019-12-22 15:28:11 | 0:37:59 | 0:24:48 | 0:13:11 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus-v1only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after mon.a restart |
||||||||||||||
fail | 4626261 | 2019-12-22 14:39:42 | 2019-12-22 14:50:12 | 2019-12-22 15:36:11 | 0:45:59 | 0:24:35 | 0:21:24 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/nautilus-v2only.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after mon.a restart |
||||||||||||||
fail | 4626262 | 2019-12-22 14:39:43 | 2019-12-22 14:50:12 | 2019-12-22 15:30:11 | 0:39:59 | 0:24:32 | 0:15:27 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} | 3 | |
Failure Reason:
timed out waiting for admin_socket to appear after mon.a restart |
||||||||||||||
fail | 4626263 | 2019-12-22 14:39:44 | 2019-12-22 14:52:19 | 2019-12-22 15:16:18 | 0:23:59 | 0:10:31 | 0:13:28 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/hammer.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/radosbench.yaml} | 3 | |
Failure Reason:
Command failed on smithi008 with status 1: 'sudo yum -y install rbd-mirror' |
||||||||||||||
dead | 4626264 | 2019-12-22 14:39:45 | 2019-12-22 14:52:19 | 2019-12-22 15:34:19 | 0:42:00 | 0:14:42 | 0:27:18 | smithi | master | centos | 7.6 | rados:thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel-v1only.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} | 3 | |
Failure Reason:
SSH connection to smithi040 was lost: 'sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 092c40fe-24d0-11ea-8283-001a4aab830c --force' |