Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 238090 2016-06-05 06:09:34 2016-06-05 06:10:33 2016-06-05 06:36:33 0:26:00 0:23:43 0:02:17 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 238091 2016-06-05 06:13:49 2016-06-05 06:13:49 2016-06-05 06:29:49 0:16:00 0:14:00 0:02:00 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache-agent-small.yaml} 2
fail 238092 2016-06-05 06:09:58 2016-06-05 06:14:57 2016-06-05 06:34:57 0:20:00 0:14:44 0:05:16 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache-snaps.yaml} 2
Failure Reason:

Command failed on smithi020 with status 1: 'sudo yum install ceph-radosgw -y'

fail 238093 2016-06-05 06:10:01 2016-06-05 06:15:11 2016-06-05 06:47:11 0:32:00 0:26:29 0:05:31 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi024 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=955132a8fe0a647e3f4c316b3b32dfcfe41cf5ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 238094 2016-06-05 06:10:04 2016-06-05 06:15:23 2016-06-05 06:47:23 0:32:00 0:23:29 0:08:31 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/rgw_snaps.yaml} 2
pass 238095 2016-06-05 06:10:07 2016-06-05 06:15:47 2016-06-05 06:39:47 0:24:00 0:22:05 0:01:55 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 238096 2016-06-05 06:10:09 2016-06-05 06:16:09 2016-06-05 06:38:09 0:22:00 0:19:14 0:02:46 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache-agent-small.yaml} 2
pass 238097 2016-06-05 06:10:13 2016-06-05 06:17:04 2016-06-05 06:59:05 0:42:01 0:33:38 0:08:23 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-snaps.yaml} 2
fail 238098 2016-06-05 06:10:17 2016-06-05 06:17:21 2016-06-05 06:51:22 0:34:01 0:26:19 0:07:42 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi068 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=955132a8fe0a647e3f4c316b3b32dfcfe41cf5ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 238099 2016-06-05 06:10:20 2016-06-05 06:22:14 2016-06-05 06:46:14 0:24:00 0:20:55 0:03:05 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/rgw_snaps.yaml} 2
pass 238100 2016-06-05 06:10:23 2016-06-05 06:22:47 2016-06-05 06:46:47 0:24:00 0:16:48 0:07:12 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 238101 2016-06-05 06:10:26 2016-06-05 06:24:15 2016-06-05 06:38:15 0:14:00 0:13:32 0:00:28 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-agent-small.yaml} 2
pass 238102 2016-06-05 06:10:29 2016-06-05 06:25:15 2016-06-05 07:01:16 0:36:01 0:31:16 0:04:45 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-snaps.yaml} 2
fail 238103 2016-06-05 06:10:34 2016-06-05 06:26:48 2016-06-05 07:00:48 0:34:00 0:27:15 0:06:45 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/rados_api_tests.yaml} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi001 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=955132a8fe0a647e3f4c316b3b32dfcfe41cf5ae TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'

pass 238104 2016-06-05 06:10:36 2016-06-05 06:29:49 2016-06-05 06:55:49 0:26:00 0:24:47 0:01:13 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/rgw_snaps.yaml} 2
pass 238105 2016-06-05 06:10:40 2016-06-05 06:30:03 2016-06-05 06:52:03 0:22:00 0:20:02 0:01:58 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/xfs.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/write_fadvise_dontneed.yaml} 2
pass 238106 2016-06-05 06:10:44 2016-06-05 06:30:24 2016-06-05 07:04:25 0:34:01 0:28:37 0:05:24 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
pass 238107 2016-06-05 06:10:46 2016-06-05 06:32:10 2016-06-05 07:12:11 0:40:01 0:39:23 0:00:38 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache-pool-snaps.yaml} 2
dead 238108 2016-06-05 06:10:51 2016-06-05 06:32:39 2016-06-05 18:38:23 12:05:44 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 238109 2016-06-05 06:10:55 2016-06-05 06:33:25 2016-06-05 06:55:25 0:22:00 0:16:07 0:05:53 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
pass 238110 2016-06-05 06:10:59 2016-06-05 06:35:13 2016-06-05 07:17:13 0:42:00 0:39:36 0:02:24 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
pass 238111 2016-06-05 06:11:02 2016-06-05 06:35:34 2016-06-05 07:03:34 0:28:00 0:26:03 0:01:57 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
pass 238112 2016-06-05 06:11:04 2016-06-05 06:36:46 2016-06-05 07:16:46 0:40:00 0:39:21 0:00:39 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps.yaml} 2
pass 238113 2016-06-05 06:11:09 2016-06-05 06:37:10 2016-06-05 07:25:11 0:48:01 0:44:52 0:03:09 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
fail 238114 2016-06-05 06:11:11 2016-06-05 06:38:07 2016-06-05 06:52:07 0:14:00 0:02:51 0:11:09 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
Failure Reason:

{'smithi067.front.sepia.ceph.com': {'invocation': {'module_name': 'apt', 'module_args': ''}, 'failed': True, 'parsed': False, 'msg': 'BECOME-SUCCESS-wifdoginlkxrntnbhemyrfghohyczalw\nOpenSSH_6.6.1, OpenSSL 1.0.1f 6 Jan 2014\r\ndebug1: Reading configuration data /var/lib/teuthworker/.ssh/config\r\ndebug1: /var/lib/teuthworker/.ssh/config line 1: Applying options for *\r\ndebug1: Reading configuration data /etc/ssh/ssh_config\r\ndebug1: /etc/ssh/ssh_config line 19: Applying options for *\r\ndebug1: /etc/ssh/ssh_config line 56: Applying options for smithi*\r\ndebug1: auto-mux: Trying existing master\r\ndebug1: mux_client_request_session: master session id: 2\r\nTraceback (most recent call last):\n File "<stdin>", line 2246, in <module>\n File "<stdin>", line 587, in main\n File "/usr/lib/python2.7/dist-packages/apt/cache.py", line 151, in open\n self._cache = apt_pkg.Cache(progress)\nSystemError: E:Problem renaming the file /var/cache/apt/pkgcache.bin.lQNA7m to /var/cache/apt/pkgcache.bin - rename (2: No such file or directory), W:You may want to run apt-get update to correct these problems\n'}}

pass 238115 2016-06-05 06:11:15 2016-06-05 06:38:21 2016-06-05 07:18:22 0:40:01 0:39:17 0:00:44 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
dead 238116 2016-06-05 06:11:19 2016-06-05 06:38:33 2016-06-05 18:45:22 12:06:49 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
pass 238117 2016-06-05 06:11:21 2016-06-05 06:39:47 2016-06-05 07:27:48 0:48:01 0:41:03 0:06:58 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps.yaml} 2
pass 238118 2016-06-05 06:11:24 2016-06-05 06:40:00 2016-06-05 07:24:01 0:44:01 0:38:18 0:05:43 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 238119 2016-06-05 06:11:28 2016-06-05 06:46:28 2016-06-05 07:10:28 0:24:00 0:17:41 0:06:19 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
pass 238120 2016-06-05 06:11:31 2016-06-05 06:47:00 2016-06-05 07:27:01 0:40:01 0:31:22 0:08:39 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 238121 2016-06-05 06:11:38 2016-06-05 06:47:24 2016-06-05 07:15:24 0:28:00 0:24:52 0:03:08 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
pass 238122 2016-06-05 06:11:39 2016-06-05 06:47:38 2016-06-05 07:27:38 0:40:00 0:34:43 0:05:17 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps.yaml} 2
pass 238123 2016-06-05 06:11:41 2016-06-05 06:47:53 2016-06-05 07:39:53 0:52:00 0:46:50 0:05:10 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 238124 2016-06-05 06:11:44 2016-06-05 06:51:17 2016-06-05 07:19:17 0:28:00 0:16:44 0:11:16 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
pass 238125 2016-06-05 06:11:46 2016-06-05 06:51:35 2016-06-05 07:35:36 0:44:01 0:38:00 0:06:01 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 238126 2016-06-05 06:11:49 2016-06-05 06:52:16 2016-06-05 07:30:16 0:38:00 0:31:18 0:06:42 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
pass 238127 2016-06-05 06:11:55 2016-06-05 06:52:27 2016-06-05 07:50:28 0:58:01 0:40:47 0:17:14 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache-pool-snaps.yaml} 2
dead 238128 2016-06-05 06:11:58 2016-06-05 06:55:38 2016-06-05 19:01:47 12:06:09 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 238129 2016-06-05 06:12:02 2016-06-05 06:56:02 2016-06-05 07:28:02 0:32:00 0:17:41 0:14:19 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
pass 238130 2016-06-05 06:12:04 2016-06-05 06:59:19 2016-06-05 07:39:19 0:40:00 0:38:38 0:01:22 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
pass 238131 2016-06-05 06:12:09 2016-06-05 07:01:01 2016-06-05 07:47:02 0:46:01 0:21:53 0:24:08 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
dead 238132 2016-06-05 06:12:11 2016-06-05 07:01:29 2016-06-05 19:07:30 12:06:01 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps.yaml} 2
dead 238133 2016-06-05 06:12:16 2016-06-05 07:03:46 2016-06-05 19:09:25 12:05:39 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 238134 2016-06-05 06:12:20 2016-06-05 07:04:37 2016-06-05 07:42:37 0:38:00 0:25:07 0:12:53 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
pass 238135 2016-06-05 06:12:22 2016-06-05 07:10:04 2016-06-05 07:56:05 0:46:01 0:37:43 0:08:18 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
pass 238136 2016-06-05 06:12:28 2016-06-05 07:10:43 2016-06-05 07:48:43 0:38:00 0:30:04 0:07:56 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
dead 238137 2016-06-05 06:12:33 2016-06-05 07:12:25 2016-06-05 19:18:05 12:05:40 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps.yaml} 2
pass 238138 2016-06-05 06:12:37 2016-06-05 07:15:37 2016-06-05 08:09:38 0:54:01 0:39:59 0:14:02 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 238139 2016-06-05 06:12:40 2016-06-05 07:16:59 2016-06-05 07:42:59 0:26:00 0:23:11 0:02:49 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
pass 238140 2016-06-05 06:12:42 2016-06-05 07:17:26 2016-06-05 07:51:26 0:34:00 0:33:04 0:00:56 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 238141 2016-06-05 06:12:45 2016-06-05 07:18:35 2016-06-05 07:54:35 0:36:00 0:27:33 0:08:27 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
pass 238142 2016-06-05 06:12:47 2016-06-05 07:19:30 2016-06-05 08:19:31 1:00:01 0:37:31 0:22:30 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps.yaml} 2
pass 238143 2016-06-05 06:12:55 2016-06-05 07:24:15 2016-06-05 08:26:17 1:02:02 0:43:47 0:18:15 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/default.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 238144 2016-06-05 06:12:57 2016-06-05 07:25:24 2016-06-05 07:43:23 0:17:59 0:15:41 0:02:18 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
pass 238145 2016-06-05 06:12:59 2016-06-05 07:27:14 2016-06-05 08:13:14 0:46:00 0:40:49 0:05:11 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/osd-delay.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
dead 238146 2016-06-05 06:13:02 2016-06-05 07:27:51 2016-06-05 19:34:10 12:06:19 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/mapgap.yaml workloads/cache-agent-big.yaml} 2
pass 238147 2016-06-05 06:13:04 2016-06-05 07:28:03 2016-06-05 08:18:03 0:50:00 0:37:34 0:12:26 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/cache-pool-snaps.yaml} 2
dead 238148 2016-06-05 06:13:18 2016-06-05 07:28:14 2016-06-05 19:34:53 12:06:39 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/pggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 238149 2016-06-05 06:13:22 2016-06-05 07:30:29 2016-06-05 08:40:30 1:10:01 0:19:42 0:50:19 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/morepggrow.yaml workloads/readwrite.yaml} 2
dead 238150 2016-06-05 06:13:53 2016-06-05 07:35:50 2016-06-05 19:42:37 12:06:47 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/mapgap.yaml workloads/snaps-few-objects.yaml} 2
fail 238151 2016-06-05 06:13:55 2016-06-05 07:39:32 2016-06-05 08:05:32 0:26:00 0:16:05 0:09:55 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/cache-agent-big.yaml} 2
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 10000 --objects 6600 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 1200 --op read 100 --op write 50 --op copy_from 50 --op write_excl 50 --op delete 50 --pool base'

pass 238152 2016-06-05 06:14:00 2016-06-05 07:40:06 2016-06-05 08:20:07 0:40:01 0:32:06 0:07:55 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps.yaml} 2
fail 238153 2016-06-05 06:14:02 2016-06-05 07:42:39 2016-06-05 08:22:39 0:40:00 0:31:43 0:08:17 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/morepggrow.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

managers

pass 238154 2016-06-05 06:14:05 2016-06-05 07:42:50 2016-06-05 08:10:50 0:28:00 0:18:37 0:09:23 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/mapgap.yaml workloads/readwrite.yaml} 2
dead 238155 2016-06-05 06:14:09 2016-06-05 07:43:11 2016-06-05 19:49:17 12:06:06 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/snaps-few-objects.yaml} 2
dead 238156 2016-06-05 06:14:12 2016-06-05 07:43:36 2016-06-05 19:49:51 12:06:15 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/pggrow.yaml workloads/cache-agent-big.yaml} 2
dead 238157 2016-06-05 06:14:14 2016-06-05 07:47:16 2016-06-05 19:53:37 12:06:21 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps.yaml} 2
pass 238158 2016-06-05 06:14:19 2016-06-05 07:48:56 2016-06-05 08:22:56 0:34:00 0:30:47 0:03:13 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/mapgap.yaml workloads/pool-snaps-few-objects.yaml} 2
pass 238159 2016-06-05 06:14:22 2016-06-05 07:50:40 2016-06-05 08:14:40 0:24:00 0:18:49 0:05:11 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/readwrite.yaml} 2
pass 238160 2016-06-05 06:14:25 2016-06-05 07:51:38 2016-06-05 09:05:40 1:14:02 0:36:36 0:37:26 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/pggrow.yaml workloads/snaps-few-objects.yaml} 2
dead 238161 2016-06-05 06:14:29 2016-06-05 07:54:48 2016-06-05 20:00:56 12:06:08 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/morepggrow.yaml workloads/cache-agent-big.yaml} 2
pass 238162 2016-06-05 06:14:34 2016-06-05 07:56:18 2016-06-05 08:38:18 0:42:00 0:32:15 0:09:45 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps.yaml} 2
fail 238163 2016-06-05 06:14:41 2016-06-05 07:56:30 2016-06-05 19:46:55 11:50:25 10:43:10 1:07:15 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/pool-snaps-few-objects.yaml} 2
Failure Reason:

failed to recover before timeout expired

fail 238164 2016-06-05 06:14:43 2016-06-05 08:05:46 2016-06-05 19:12:10 11:06:24 11:00:13 0:06:11 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/pggrow.yaml workloads/readwrite.yaml} 2
Failure Reason:

failed to recover before timeout expired

pass 238165 2016-06-05 06:14:53 2016-06-05 08:09:50 2016-06-05 08:47:50 0:38:00 0:33:18 0:04:42 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/morepggrow.yaml workloads/snaps-few-objects.yaml} 2
pass 238166 2016-06-05 06:14:55 2016-06-05 08:11:02 2016-06-05 08:29:02 0:18:00 0:15:54 0:02:06 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
fail 238167 2016-06-05 06:14:57 2016-06-05 08:13:27 2016-06-05 09:31:28 1:18:01 0:35:39 0:42:22 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
Failure Reason:

Socket is closed

pass 238168 2016-06-05 06:15:03 2016-06-05 08:14:53 2016-06-05 08:38:53 0:24:00 0:19:41 0:04:19 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
pass 238169 2016-06-05 06:15:08 2016-06-05 08:18:17 2016-06-05 08:52:18 0:34:01 0:28:31 0:05:30 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
pass 238170 2016-06-05 06:15:12 2016-06-05 08:19:44 2016-06-05 08:43:44 0:24:00 0:20:01 0:03:59 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
pass 238171 2016-06-05 06:15:15 2016-06-05 08:20:19 2016-06-05 09:32:21 1:12:02 0:22:53 0:49:09 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 238172 2016-06-05 06:15:19 2016-06-05 08:22:51 2016-06-05 09:00:52 0:38:01 0:35:35 0:02:26 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 238173 2016-06-05 06:15:24 2016-06-05 08:23:09 2016-06-05 09:01:09 0:38:00 0:16:53 0:21:07 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
fail 238174 2016-06-05 06:15:26 2016-06-05 08:26:29 2016-06-05 09:06:29 0:40:00 0:24:40 0:15:20 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.4 restart

fail 238175 2016-06-05 06:15:29 2016-06-05 08:29:16 2016-06-05 09:09:16 0:40:00 0:27:55 0:12:05 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/pggrow.yaml workloads/small-objects.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.4 restart

pass 238176 2016-06-05 06:15:32 2016-06-05 08:38:30 2016-06-05 08:56:30 0:18:00 0:16:22 0:01:38 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/morepggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 238177 2016-06-05 06:15:35 2016-06-05 08:39:05 2016-06-05 10:11:07 1:32:02 0:32:19 0:59:43 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/mapgap.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 238178 2016-06-05 06:15:38 2016-06-05 08:40:44 2016-06-05 09:06:44 0:26:00 0:18:19 0:07:41 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/cache.yaml} 2
fail 238179 2016-06-05 06:15:40 2016-06-05 08:43:56 2016-06-05 10:17:59 1:34:03 0:35:08 0:58:55 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/pggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.3 restart

fail 238180 2016-06-05 06:15:43 2016-06-05 08:48:02 2016-06-05 09:38:03 0:50:01 0:26:20 0:23:41 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/morepggrow.yaml workloads/small-objects.yaml} 2
Failure Reason:

Socket is closed

pass 238181 2016-06-05 06:15:48 2016-06-05 08:52:31 2016-06-05 09:14:31 0:22:00 0:16:24 0:05:36 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/mapgap.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 238182 2016-06-05 06:15:53 2016-06-05 08:56:42 2016-06-05 09:38:43 0:42:01 0:38:21 0:03:40 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/default.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 238183 2016-06-05 06:15:56 2016-06-05 09:01:04 2016-06-05 09:23:04 0:22:00 0:17:22 0:04:38 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/pggrow.yaml workloads/cache.yaml} 2
fail 238184 2016-06-05 06:16:01 2016-06-05 09:01:23 2016-06-05 10:09:24 1:08:01 0:33:00 0:35:01 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/morepggrow.yaml workloads/radosbench.yaml} 2
Failure Reason:

reached maximum tries (155) after waiting for 930 seconds

pass 238185 2016-06-05 06:16:03 2016-06-05 09:05:59 2016-06-05 09:27:58 0:21:59 0:19:37 0:02:22 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/fastclose.yaml thrashers/mapgap.yaml workloads/small-objects.yaml} 2
pass 238186 2016-06-05 06:16:07 2016-06-05 09:06:42 2016-06-05 09:32:42 0:26:00 0:18:36 0:07:24 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 238187 2016-06-05 06:16:09 2016-06-05 09:06:57 2016-06-05 09:56:58 0:50:01 0:29:20 0:20:41 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 238188 2016-06-05 06:16:10 2016-06-05 09:09:29 2016-06-05 10:05:30 0:56:01 0:17:11 0:38:50 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache.yaml} 2
pass 238189 2016-06-05 06:16:14 2016-06-05 09:12:01 2016-06-05 10:04:02 0:52:01 0:32:25 0:19:36 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/radosbench.yaml} 2
pass 238191 2016-06-05 06:16:17 2016-06-05 09:14:43 2016-06-05 09:46:44 0:32:01 0:23:51 0:08:10 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/small-objects.yaml} 2
pass 238193 2016-06-05 06:16:20 2016-06-05 09:23:18 2016-06-05 09:51:18 0:28:00 0:18:34 0:09:26 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/pggrow.yaml workloads/admin_socket_objecter_requests.yaml} 2
pass 238194 2016-06-05 06:16:22 2016-06-05 09:28:10 2016-06-05 10:30:12 1:02:02 0:37:42 0:24:20 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/morepggrow.yaml workloads/cache-pool-snaps-readproxy.yaml} 2
pass 238195 2016-06-05 06:16:25 2016-06-05 09:31:41 2016-06-05 09:51:40 0:19:59 0:13:53 0:06:06 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/mapgap.yaml workloads/cache.yaml} 2
fail 238196 2016-06-05 06:16:28 2016-06-05 09:32:35 2016-06-05 10:22:36 0:50:01 0:25:37 0:24:24 smithi master rados:thrash/{hobj-sort.yaml rados.yaml rocksdb.yaml 0-size-min-size-overrides/2-size-1-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml clusters/{fixed-2.yaml openstack.yaml} fs/ext4.yaml msgr/async.yaml msgr-failures/few.yaml thrashers/default.yaml workloads/radosbench.yaml} 2
Failure Reason:

timed out waiting for admin_socket to appear after osd.5 restart