Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 3027453 2018-09-16 00:59:03 2018-09-16 01:00:27 2018-09-16 01:22:28 0:22:01 0:08:42 0:13:19 mira master rhel 7.5 rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/rados_stress_watch.yaml} 2
Failure Reason:

{'mira075.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 01:14:26.950332', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 01:14:01.942422', 'delta': '0:00:25.007910', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

fail 3027454 2018-09-16 00:59:04 2018-09-16 01:10:46 2018-09-16 01:30:48 0:20:02 0:08:47 0:11:15 mira master rhel 7.5 rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} 3
Failure Reason:

{'mira048.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 01:24:13.831503', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 01:23:48.805758', 'delta': '0:00:25.025745', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

pass 3027455 2018-09-16 00:59:04 2018-09-16 01:11:53 2018-09-16 01:43:56 0:32:03 0:25:28 0:06:35 mira master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} 2
fail 3027456 2018-09-16 00:59:05 2018-09-16 01:12:37 2018-09-16 01:26:38 0:14:01 0:02:46 0:11:15 mira master rhel 7.5 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

{'mira071.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ['Failed to set time zone: Connection timed out'], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 01:26:15.324732', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 01:25:50.257970', 'delta': '0:00:25.066762', 'stderr': 'Failed to set time zone: Connection timed out', 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

fail 3027457 2018-09-16 00:59:06 2018-09-16 01:22:33 2018-09-16 08:15:03 6:52:30 6:39:09 0:13:21 mira master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on mira006 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-kefu-testing-2018-09-14-0938 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

dead 3027458 2018-09-16 00:59:06 2018-09-16 01:26:40 2018-09-16 13:29:27 12:02:47 11:49:42 0:13:05 mira master ubuntu 18.04 rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} 2
Failure Reason:

SSH connection to mira077 was lost: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --pool-snaps --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool unique_pool_0'

fail 3027459 2018-09-16 00:59:07 2018-09-16 01:30:49 2018-09-16 01:50:50 0:20:01 0:08:31 0:11:30 mira master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/filestore-xfs.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

{'mira048.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ['Failed to set time zone: Connection timed out'], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 01:44:01.759246', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 01:43:36.744003', 'delta': '0:00:25.015243', 'stderr': 'Failed to set time zone: Connection timed out', 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

fail 3027460 2018-09-16 00:59:08 2018-09-16 01:44:06 2018-09-16 02:04:09 0:20:03 0:08:13 0:11:50 mira master ubuntu 16.04 rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore.yaml supported-random-distro$/{ubuntu_16.04.yaml} tasks/module_selftest.yaml} 2
Failure Reason:

Test failure: test_influx (tasks.mgr.test_module_selftest.TestModuleSelftest)

fail 3027461 2018-09-16 00:59:09 2018-09-16 01:50:52 2018-09-16 02:24:57 0:34:05 0:27:12 0:06:53 mira master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

ceph-objectstore-tool: exp list-pgs failure with status 1

fail 3027462 2018-09-16 00:59:09 2018-09-16 02:02:02 2018-09-16 02:22:04 0:20:02 0:08:34 0:11:28 mira master rhel 7.5 rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml leveldb.yaml msgr-failures/fastclose.yaml objectstore/bluestore.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} 2
Failure Reason:

{'mira017.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 02:16:01.228023', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 02:15:36.200702', 'delta': '0:00:25.027321', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

pass 3027463 2018-09-16 00:59:10 2018-09-16 02:04:19 2018-09-16 02:34:22 0:30:03 0:20:45 0:09:18 mira master rhel 7.5 rados/multimon/{clusters/9.yaml mon_kv_backend/rocksdb.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml} tasks/mon_recovery.yaml} 3
fail 3027465 2018-09-16 00:59:11 2018-09-16 02:10:19 2018-09-16 02:38:22 0:28:03 0:17:43 0:10:20 mira master ubuntu 16.04 rados/singleton/{all/radostool.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Command failed (workunit test rados/test_rados_tool.sh) on mira084 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-kefu-testing-2018-09-14-0938 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_rados_tool.sh'

fail 3027467 2018-09-16 00:59:11 2018-09-16 02:18:41 2018-09-16 02:52:45 0:34:04 0:23:21 0:10:43 mira master ubuntu 18.04 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on mira111 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-kefu-testing-2018-09-14-0938 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

fail 3027469 2018-09-16 00:59:12 2018-09-16 02:22:14 2018-09-16 02:42:17 0:20:03 0:08:27 0:11:36 mira master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} 2
Failure Reason:

{'mira017.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 02:36:18.429907', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 02:35:53.415991', 'delta': '0:00:25.013916', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

pass 3027471 2018-09-16 00:59:13 2018-09-16 02:24:58 2018-09-16 03:01:03 0:36:05 0:28:37 0:07:28 mira master rhel 7.5 rados/thrash-erasure-code-overwrites/{bluestore.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml leveldb.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} 2
fail 3027473 2018-09-16 00:59:14 2018-09-16 02:34:33 2018-09-16 02:54:33 0:20:00 0:08:34 0:11:26 mira master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

{'mira053.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 02:47:18.858211', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 02:46:53.845622', 'delta': '0:00:25.012589', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

fail 3027475 2018-09-16 00:59:14 2018-09-16 02:38:26 2018-09-16 04:30:37 1:52:11 1:41:28 0:10:43 mira master ubuntu 16.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{ubuntu_16.04.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} 2
Failure Reason:

reached maximum tries (800) after waiting for 4800 seconds

fail 3027477 2018-09-16 00:59:15 2018-09-16 02:42:26 2018-09-16 03:02:29 0:20:03 0:08:09 0:11:54 mira master ubuntu 18.04 rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/prometheus.yaml} 2
Failure Reason:

Test failure: test_urls (tasks.mgr.test_prometheus.TestPrometheus)

pass 3027479 2018-09-16 00:59:16 2018-09-16 02:52:54 2018-09-16 03:35:00 0:42:06 0:34:35 0:07:31 mira master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
fail 3027481 2018-09-16 00:59:17 2018-09-16 02:54:45 2018-09-16 03:32:49 0:38:04 0:26:19 0:11:45 mira master ubuntu 18.04 rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.1 restart

pass 3027483 2018-09-16 00:59:17 2018-09-16 03:01:04 2018-09-16 03:25:08 0:24:04 0:16:20 0:07:44 mira master rhel 7.5 rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{rhel_latest.yaml} tasks/workunits.yaml} 2
fail 3027485 2018-09-16 00:59:18 2018-09-16 03:02:38 2018-09-16 03:16:39 0:14:01 0:02:59 0:11:02 mira master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} 2
Failure Reason:

{'mira061.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 03:16:18.452432', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 03:15:53.440063', 'delta': '0:00:25.012369', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}, 'mira088.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 03:16:07.458306', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 03:15:42.447698', 'delta': '0:00:25.010608', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

fail 3027486 2018-09-16 00:59:19 2018-09-16 03:02:51 2018-09-16 03:20:54 0:18:03 0:08:08 0:09:55 mira master ubuntu 18.04 rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} 1
Failure Reason:

Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on mira118 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-kefu-testing-2018-09-14-0938 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh'

fail 3027488 2018-09-16 00:59:19 2018-09-16 03:16:49 2018-09-16 03:32:51 0:16:02 0:02:49 0:13:13 mira master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} 2
Failure Reason:

{'mira061.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 03:30:45.792733', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 03:30:20.774540', 'delta': '0:00:25.018193', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}, 'mira088.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 03:30:46.294923', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 03:30:21.274461', 'delta': '0:00:25.020462', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

fail 3027490 2018-09-16 00:59:20 2018-09-16 03:21:05 2018-09-16 03:53:06 0:32:01 0:23:02 0:08:59 mira master ubuntu 16.04 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore.yaml rados.yaml supported-random-distro$/{ubuntu_16.04.yaml}} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on mira118 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-kefu-testing-2018-09-14-0938 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

fail 3027492 2018-09-16 00:59:21 2018-09-16 03:25:09 2018-09-16 03:47:09 0:22:00 0:08:56 0:13:04 mira master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore-bitmap.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} 2
Failure Reason:

{'mira017.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 03:39:26.024636', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 03:39:00.999783', 'delta': '0:00:25.024853', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

fail 3027494 2018-09-16 00:59:22 2018-09-16 03:28:57 2018-09-16 03:44:57 0:16:00 0:04:52 0:11:08 mira master ubuntu 18.04 rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/misc.yaml} 1
Failure Reason:

Command failed (workunit test misc/test-ceph-helpers.sh) on mira010 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-kefu-testing-2018-09-14-0938 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-ceph-helpers.sh'

fail 3027496 2018-09-16 00:59:22 2018-09-16 03:33:00 2018-09-16 04:09:00 0:36:00 0:19:25 0:16:35 mira master centos 7.4 rados/singleton/{all/divergent_priors.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

timed out waiting for admin_socket to appear after osd.1 restart

fail 3027498 2018-09-16 00:59:23 2018-09-16 03:33:00 2018-09-16 03:47:00 0:14:00 0:02:47 0:11:13 mira master rhel 7.5 rados/singleton/{all/divergent_priors2.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_latest.yaml}} 1
Failure Reason:

{'mira061.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 03:46:12.397787', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 03:45:47.382994', 'delta': '0:00:25.014793', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

fail 3027500 2018-09-16 00:59:24 2018-09-16 03:35:03 2018-09-16 04:27:03 0:52:00 0:36:54 0:15:06 mira master centos 7.4 rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_latest.yaml}} 1
Failure Reason:

Command failed (workunit test cephtool/test.sh) on mira037 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=wip-kefu-testing-2018-09-14-0938 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh'

fail 3027502 2018-09-16 00:59:24 2018-09-16 03:44:58 2018-09-16 03:58:57 0:13:59 0:02:53 0:11:06 mira master rhel 7.5 rados/perf/{ceph.yaml objectstore/bluestore.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_latest.yaml} workloads/fio_4M_rand_rw.yaml} 1
Failure Reason:

{'mira053.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 03:58:24.006413', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 03:57:58.988643', 'delta': '0:00:25.017770', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

fail 3027504 2018-09-16 00:59:25 2018-09-16 03:45:24 2018-09-16 04:45:25 1:00:01 0:36:40 0:23:21 mira master centos rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} mon_kv_backend/rocksdb.yaml msgr-failures/few.yaml msgr/random.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} 2
Failure Reason:

Command failed on mira012 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json'

fail 3027506 2018-09-16 00:59:26 2018-09-16 03:47:01 2018-09-16 04:07:00 0:19:59 0:08:45 0:11:14 mira master rhel 7.5 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects.yaml} 2
Failure Reason:

{'mira061.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ['Failed to set time zone: Connection timed out'], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 04:00:30.698785', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 04:00:05.684197', 'delta': '0:00:25.014588', 'stderr': 'Failed to set time zone: Connection timed out', 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

fail 3027508 2018-09-16 00:59:27 2018-09-16 03:47:10 2018-09-16 04:09:10 0:22:00 0:08:36 0:13:24 mira master rhel 7.5 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/simple.yaml objectstore/bluestore.yaml rados.yaml rocksdb.yaml supported-random-distro$/{rhel_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} 2
Failure Reason:

{'mira010.front.sepia.ceph.com': {'_ansible_parsed': True, 'stderr_lines': ["Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out"], 'cmd': ['timedatectl', 'set-timezone', 'Etc/UTC'], 'end': '2018-09-16 04:01:25.259495', '_ansible_no_log': False, 'stdout': '', 'changed': True, 'invocation': {'module_args': {'creates': None, 'executable': None, 'chdir': None, '_raw_params': 'timedatectl set-timezone Etc/UTC', 'removes': None, 'warn': True, '_uses_shell': False, 'stdin': None}}, 'start': '2018-09-16 04:01:00.246074', 'delta': '0:00:25.013421', 'stderr': "Failed to set time zone: Failed to activate service 'org.freedesktop.timedate1': timed out", 'rc': 1, 'msg': 'non-zero return code', 'stdout_lines': []}}

fail 3027510 2018-09-16 00:59:27 2018-09-16 03:53:07 2018-09-16 04:19:07 0:26:00 0:16:41 0:09:19 mira master rhel 7.5 rados/mgr/{clusters/{2-node-mgr.yaml openstack.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{rhel_latest.yaml} tasks/module_selftest.yaml} 2
Failure Reason:

Test failure: test_influx (tasks.mgr.test_module_selftest.TestModuleSelftest)

fail 3027512 2018-09-16 00:59:28 2018-09-16 03:59:07 2018-09-16 04:35:07 0:36:00 0:24:09 0:11:51 mira master ubuntu 18.04 rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} leveldb.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} 2
Failure Reason:

ceph-objectstore-tool: exp list-pgs failure with status 1