Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version
pass 4562599 2019-12-03 00:40:02 2019-12-03 00:40:17 2019-12-03 01:02:19 0:22:02 0:11:39 0:10:23 smithi master
pass 4562600 2019-12-03 00:40:03 2019-12-03 00:41:20 2019-12-03 01:19:20 0:38:00 0:23:48 0:14:12 smithi master
pass 4562601 2019-12-03 00:40:04 2019-12-03 00:41:31 2019-12-03 01:27:31 0:46:00 0:25:52 0:20:08 smithi master
pass 4562602 2019-12-03 00:40:04 2019-12-03 00:41:35 2019-12-03 01:11:35 0:30:00 0:16:12 0:13:48 smithi master
pass 4562603 2019-12-03 00:40:05 2019-12-03 00:41:55 2019-12-03 01:05:54 0:23:59 0:10:40 0:13:19 smithi master
pass 4562604 2019-12-03 00:40:06 2019-12-03 00:42:01 2019-12-03 01:20:00 0:37:59 0:26:44 0:11:15 smithi master
pass 4562605 2019-12-03 00:40:07 2019-12-03 00:43:53 2019-12-03 01:15:52 0:31:59 0:21:30 0:10:29 smithi master
pass 4562606 2019-12-03 00:40:08 2019-12-03 00:43:54 2019-12-03 02:01:54 1:18:00 1:06:57 0:11:03 smithi master
pass 4562607 2019-12-03 00:40:09 2019-12-03 00:44:00 2019-12-03 01:13:59 0:29:59 0:20:06 0:09:53 smithi master
pass 4562608 2019-12-03 00:40:10 2019-12-03 00:44:00 2019-12-03 01:17:59 0:33:59 0:22:58 0:11:01 smithi master
pass 4562609 2019-12-03 00:40:10 2019-12-03 00:45:24 2019-12-03 01:17:23 0:31:59 0:15:02 0:16:57 smithi master
pass 4562610 2019-12-03 00:40:11 2019-12-03 00:45:34 2019-12-03 01:17:34 0:32:00 0:13:00 0:19:00 smithi master
pass 4562611 2019-12-03 00:40:12 2019-12-03 00:45:43 2019-12-03 01:17:43 0:32:00 0:22:11 0:09:49 smithi master
pass 4562612 2019-12-03 00:40:13 2019-12-03 00:45:43 2019-12-03 01:09:42 0:23:59 0:10:30 0:13:29 smithi master
pass 4562613 2019-12-03 00:40:14 2019-12-03 00:45:51 2019-12-03 01:19:50 0:33:59 0:21:40 0:12:19 smithi master
pass 4562614 2019-12-03 00:40:15 2019-12-03 00:45:53 2019-12-03 01:15:52 0:29:59 0:17:57 0:12:02 smithi master
pass 4562615 2019-12-03 00:40:15 2019-12-03 00:46:02 2019-12-03 01:16:01 0:29:59 0:18:20 0:11:39 smithi master
pass 4562616 2019-12-03 00:40:16 2019-12-03 00:47:45 2019-12-03 01:15:43 0:27:58 0:12:12 0:15:46 smithi master
pass 4562617 2019-12-03 00:40:17 2019-12-03 00:47:55 2019-12-03 01:21:59 0:34:04 0:22:54 0:11:10 smithi master
pass 4562618 2019-12-03 00:40:18 2019-12-03 00:47:56 2019-12-03 01:21:55 0:33:59 0:18:05 0:15:54 smithi master
pass 4562619 2019-12-03 00:40:18 2019-12-03 00:48:04 2019-12-03 01:44:04 0:56:00 0:42:19 0:13:41 smithi master
pass 4562620 2019-12-03 00:40:19 2019-12-03 00:48:40 2019-12-03 01:18:39 0:29:59 0:20:08 0:09:51 smithi master
pass 4562621 2019-12-03 00:40:20 2019-12-03 00:50:24 2019-12-03 01:30:23 0:39:59 0:27:57 0:12:02 smithi master
pass 4562622 2019-12-03 00:40:21 2019-12-03 00:51:08 2019-12-03 01:13:07 0:21:59 0:11:44 0:10:15 smithi master
pass 4562623 2019-12-03 00:40:22 2019-12-03 00:51:50 2019-12-03 01:23:49 0:31:59 0:19:42 0:12:17 smithi master
pass 4562624 2019-12-03 00:40:22 2019-12-03 00:51:50 2019-12-03 01:27:50 0:36:00 0:20:36 0:15:24 smithi master
pass 4562625 2019-12-03 00:40:23 2019-12-03 00:51:50 2019-12-03 01:19:49 0:27:59 0:12:56 0:15:03 smithi master
pass 4562626 2019-12-03 00:40:24 2019-12-03 00:51:55 2019-12-03 01:23:54 0:31:59 0:18:21 0:13:38 smithi master
pass 4562627 2019-12-03 00:40:25 2019-12-03 00:51:56 2019-12-03 01:33:56 0:42:00 0:28:56 0:13:04 smithi master
pass 4562628 2019-12-03 00:40:26 2019-12-03 00:52:08 2019-12-03 01:34:07 0:41:59 0:21:46 0:20:13 smithi master
pass 4562629 2019-12-03 00:40:26 2019-12-03 00:53:54 2019-12-03 01:19:53 0:25:59 0:14:00 0:11:59 smithi master
fail 4562630 2019-12-03 00:40:27 2019-12-03 00:53:54 2019-12-03 01:21:53 0:27:59 0:13:45 0:14:14 smithi master
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op delete 50 --pool unique_pool_0'

pass 4562631 2019-12-03 00:40:28 2019-12-03 00:53:54 2019-12-03 01:27:53 0:33:59 0:20:31 0:13:28 smithi master
pass 4562632 2019-12-03 00:40:29 2019-12-03 00:54:00 2019-12-03 02:28:01 1:34:01 1:13:51 0:20:10 smithi master
pass 4562633 2019-12-03 00:40:30 2019-12-03 00:54:02 2019-12-03 01:26:02 0:32:00 0:21:17 0:10:43 smithi master
pass 4562634 2019-12-03 00:40:30 2019-12-03 00:54:36 2019-12-03 01:28:35 0:33:59 0:23:12 0:10:47 smithi master
pass 4562635 2019-12-03 00:40:31 2019-12-03 00:54:45 2019-12-03 01:24:44 0:29:59 0:14:06 0:15:53 smithi master
pass 4562636 2019-12-03 00:40:32 2019-12-03 00:56:17 2019-12-03 01:44:17 0:48:00 0:31:54 0:16:06 smithi master
pass 4562637 2019-12-03 00:40:33 2019-12-03 00:56:17 2019-12-03 01:28:16 0:31:59 0:19:13 0:12:46 smithi master
pass 4562638 2019-12-03 00:40:33 2019-12-03 00:56:17 2019-12-03 01:20:16 0:23:59 0:11:21 0:12:38 smithi master
pass 4562639 2019-12-03 00:40:34 2019-12-03 00:56:35 2019-12-03 01:32:34 0:35:59 0:20:20 0:15:39 smithi master
fail 4562640 2019-12-03 00:40:35 2019-12-03 00:57:52 2019-12-03 10:42:05 9:44:13 9:26:28 0:17:45 smithi master
Failure Reason:

failed to become clean before timeout expired

pass 4562641 2019-12-03 00:40:36 2019-12-03 00:57:59 2019-12-03 01:29:58 0:31:59 0:21:28 0:10:31 smithi master
pass 4562642 2019-12-03 00:40:37 2019-12-03 00:58:01 2019-12-03 01:22:00 0:23:59 0:08:46 0:15:13 smithi master
pass 4562643 2019-12-03 00:40:37 2019-12-03 00:58:04 2019-12-03 01:48:04 0:50:00 0:24:30 0:25:30 smithi master
pass 4562644 2019-12-03 00:40:38 2019-12-03 00:58:07 2019-12-03 01:32:07 0:34:00 0:18:25 0:15:35 smithi master
pass 4562645 2019-12-03 00:40:39 2019-12-03 00:58:13 2019-12-03 02:28:13 1:30:00 1:13:37 0:16:23 smithi master
pass 4562646 2019-12-03 00:40:40 2019-12-03 00:59:56 2019-12-03 01:45:56 0:46:00 0:19:44 0:26:16 smithi master
pass 4562647 2019-12-03 00:40:41 2019-12-03 01:00:00 2019-12-03 01:35:59 0:35:59 0:23:45 0:12:14 smithi master
pass 4562648 2019-12-03 00:40:42 2019-12-03 01:00:35 2019-12-03 01:40:34 0:39:59 0:17:00 0:22:59 smithi master
pass 4562649 2019-12-03 00:40:42 2019-12-03 01:02:17 2019-12-03 01:30:16 0:27:59 0:15:23 0:12:36 smithi master
pass 4562650 2019-12-03 00:40:43 2019-12-03 01:02:17 2019-12-03 01:30:16 0:27:59 0:15:02 0:12:57 smithi master
pass 4562651 2019-12-03 00:40:44 2019-12-03 01:02:17 2019-12-03 01:26:16 0:23:59 0:12:06 0:11:53 smithi master
pass 4562652 2019-12-03 00:40:45 2019-12-03 01:02:21 2019-12-03 01:34:20 0:31:59 0:20:05 0:11:54 smithi master
pass 4562653 2019-12-03 00:40:45 2019-12-03 01:02:23 2019-12-03 01:36:22 0:33:59 0:22:31 0:11:28 smithi master
pass 4562654 2019-12-03 00:40:46 2019-12-03 01:02:36 2019-12-03 01:44:35 0:41:59 0:19:42 0:22:17 smithi master
pass 4562655 2019-12-03 00:40:47 2019-12-03 01:04:11 2019-12-03 01:34:11 0:30:00 0:10:27 0:19:33 smithi master
pass 4562656 2019-12-03 00:40:48 2019-12-03 01:04:12 2019-12-03 01:48:11 0:43:59 0:23:18 0:20:41 smithi master
pass 4562657 2019-12-03 00:40:49 2019-12-03 01:04:12 2019-12-03 01:32:11 0:27:59 0:17:34 0:10:25 smithi master
pass 4562658 2019-12-03 00:40:49 2019-12-03 01:04:11 2019-12-03 02:04:11 1:00:00 0:38:59 0:21:01 smithi master
pass 4562659 2019-12-03 00:40:50 2019-12-03 01:04:25 2019-12-03 01:44:25 0:40:00 0:20:13 0:19:47 smithi master
pass 4562660 2019-12-03 00:40:51 2019-12-03 01:04:37 2019-12-03 01:42:36 0:37:59 0:25:26 0:12:33 smithi master
pass 4562661 2019-12-03 00:40:52 2019-12-03 01:04:38 2019-12-03 01:34:37 0:29:59 0:15:28 0:14:31 smithi master
pass 4562662 2019-12-03 00:40:52 2019-12-03 01:05:59 2019-12-03 01:47:58 0:41:59 0:17:13 0:24:46 smithi master
pass 4562663 2019-12-03 00:40:53 2019-12-03 01:05:58 2019-12-03 02:09:59 1:04:01 0:41:39 0:22:22 smithi master
pass 4562664 2019-12-03 00:40:54 2019-12-03 01:05:59 2019-12-03 01:43:58 0:37:59 0:13:34 0:24:25 smithi master
pass 4562665 2019-12-03 00:40:55 2019-12-03 01:06:00 2019-12-03 01:44:00 0:38:00 0:22:09 0:15:51 smithi master
pass 4562666 2019-12-03 00:40:56 2019-12-03 01:09:05 2019-12-03 01:49:04 0:39:59 0:29:19 0:10:40 smithi master
pass 4562667 2019-12-03 00:40:56 2019-12-03 01:09:44 2019-12-03 01:41:44 0:32:00 0:20:31 0:11:29 smithi master
pass 4562668 2019-12-03 00:40:57 2019-12-03 01:11:38 2019-12-03 01:37:37 0:25:59 0:10:32 0:15:27 smithi master
pass 4562669 2019-12-03 00:40:58 2019-12-03 01:11:48 2019-12-03 02:01:48 0:50:00 0:34:21 0:15:39 smithi master
pass 4562670 2019-12-03 00:40:59 2019-12-03 01:11:59 2019-12-03 01:43:58 0:31:59 0:19:29 0:12:30 smithi master
pass 4562671 2019-12-03 00:40:59 2019-12-03 01:12:01 2019-12-03 02:16:02 1:04:01 0:51:40 0:12:21 smithi master
pass 4562672 2019-12-03 00:41:00 2019-12-03 01:13:37 2019-12-03 01:43:36 0:29:59 0:19:09 0:10:50 smithi master
pass 4562673 2019-12-03 00:41:01 2019-12-03 01:13:37 2019-12-03 01:51:36 0:37:59 0:26:28 0:11:31 smithi master
pass 4562674 2019-12-03 00:41:02 2019-12-03 01:14:00 2019-12-03 01:37:59 0:23:59 0:12:24 0:11:35 smithi master
pass 4562675 2019-12-03 00:41:03 2019-12-03 01:14:01 2019-12-03 01:50:00 0:35:59 0:21:33 0:14:26 smithi master
pass 4562676 2019-12-03 00:41:03 2019-12-03 01:15:00 2019-12-03 02:09:00 0:54:00 0:39:38 0:14:22 smithi master
pass 4562677 2019-12-03 00:41:04 2019-12-03 01:15:39 2019-12-03 01:39:38 0:23:59 0:12:40 0:11:19 smithi master
pass 4562678 2019-12-03 00:41:05 2019-12-03 01:15:45 2019-12-03 01:55:45 0:40:00 0:23:13 0:16:47 smithi master
pass 4562679 2019-12-03 00:41:06 2019-12-03 01:15:54 2019-12-03 01:51:53 0:35:59 0:22:52 0:13:07 smithi master
pass 4562680 2019-12-03 00:41:07 2019-12-03 01:15:54 2019-12-03 02:07:54 0:52:00 0:20:14 0:31:46 smithi master
pass 4562681 2019-12-03 00:41:07 2019-12-03 01:16:25 2019-12-03 01:50:25 0:34:00 0:12:39 0:21:21 smithi master
pass 4562682 2019-12-03 00:41:08 2019-12-03 01:16:25 2019-12-03 02:00:25 0:44:00 0:22:20 0:21:40 smithi master
pass 4562683 2019-12-03 00:41:09 2019-12-03 01:16:25 2019-12-03 01:56:25 0:40:00 0:19:29 0:20:31 smithi master
pass 4562684 2019-12-03 00:41:10 2019-12-03 01:17:41 2019-12-03 03:09:42 1:52:01 1:40:37 0:11:24 smithi master
pass 4562685 2019-12-03 00:41:10 2019-12-03 01:17:41 2019-12-03 01:59:41 0:42:00 0:22:42 0:19:18 smithi master
pass 4562686 2019-12-03 00:41:11 2019-12-03 01:17:44 2019-12-03 02:19:45 1:02:01 0:24:25 0:37:36 smithi master
pass 4562687 2019-12-03 00:41:12 2019-12-03 01:18:02 2019-12-03 01:56:02 0:38:00 0:13:55 0:24:05 smithi master
pass 4562688 2019-12-03 00:41:13 2019-12-03 01:18:05 2019-12-03 01:44:04 0:25:59 0:13:51 0:12:08 smithi master
pass 4562689 2019-12-03 00:41:14 2019-12-03 01:18:06 2019-12-03 01:50:05 0:31:59 0:17:32 0:14:27 smithi master
pass 4562690 2019-12-03 00:41:14 2019-12-03 01:18:41 2019-12-03 01:42:40 0:23:59 0:11:25 0:12:34 smithi master
pass 4562691 2019-12-03 00:41:15 2019-12-03 01:19:38 2019-12-03 01:51:37 0:31:59 0:22:06 0:09:53 smithi master
fail 4562692 2019-12-03 00:41:16 2019-12-03 01:19:51 2019-12-03 01:43:51 0:24:00 0:11:45 0:12:15 smithi master
Failure Reason:

Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --pool-snaps --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op cache_try_flush 50 --op cache_flush 50 --op cache_evict 50 --op delete 50 --pool base'

pass 4562693 2019-12-03 00:41:17 2019-12-03 01:19:51 2019-12-03 02:05:54 0:46:03 0:24:10 0:21:53 smithi master
pass 4562694 2019-12-03 00:41:17 2019-12-03 01:19:55 2019-12-03 01:47:54 0:27:59 0:12:05 0:15:54 smithi master
pass 4562695 2019-12-03 00:41:18 2019-12-03 01:20:02 2019-12-03 02:04:02 0:44:00 0:22:35 0:21:25 smithi master
fail 4562696 2019-12-03 00:41:19 2019-12-03 01:20:18 2019-12-03 05:20:23 4:00:05 3:49:21 0:10:44 smithi master
Failure Reason:

Command failed (workunit test rados/test.sh) on smithi097 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ec6e21159be46ae2dd2f9f08ae410cfdedcac878 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 4562697 2019-12-03 00:41:20 2019-12-03 01:22:11 2019-12-03 02:10:10 0:47:59 0:36:49 0:11:10 smithi master
pass 4562698 2019-12-03 00:41:20 2019-12-03 01:22:11 2019-12-03 01:56:10 0:33:59 0:21:03 0:12:56 smithi master
pass 4562699 2019-12-03 00:41:21 2019-12-03 01:22:11 2019-12-03 02:00:10 0:37:59 0:25:24 0:12:35 smithi master
pass 4562700 2019-12-03 00:41:22 2019-12-03 01:22:11 2019-12-03 01:50:10 0:27:59 0:14:44 0:13:15 smithi master
pass 4562701 2019-12-03 00:41:23 2019-12-03 01:24:08 2019-12-03 02:00:08 0:36:00 0:21:07 0:14:53 smithi master
pass 4562702 2019-12-03 00:41:24 2019-12-03 01:24:09 2019-12-03 01:54:08 0:29:59 0:12:40 0:17:19 smithi master
pass 4562703 2019-12-03 00:41:24 2019-12-03 01:24:08 2019-12-03 01:58:08 0:34:00 0:13:53 0:20:07 smithi master
pass 4562704 2019-12-03 00:41:25 2019-12-03 01:24:46 2019-12-03 02:10:45 0:45:59 0:21:03 0:24:56 smithi master
pass 4562705 2019-12-03 00:41:26 2019-12-03 01:26:18 2019-12-03 02:20:17 0:53:59 0:20:50 0:33:09 smithi master
pass 4562706 2019-12-03 00:41:27 2019-12-03 01:26:18 2019-12-03 02:02:17 0:35:59 0:18:27 0:17:32 smithi master
pass 4562707 2019-12-03 00:41:28 2019-12-03 01:26:18 2019-12-03 02:02:17 0:35:59 0:09:15 0:26:44 smithi master
pass 4562708 2019-12-03 00:41:28 2019-12-03 01:27:51 2019-12-03 02:07:51 0:40:00 0:27:28 0:12:32 smithi master
pass 4562709 2019-12-03 00:41:29 2019-12-03 01:27:52 2019-12-03 02:01:54 0:34:02 0:20:30 0:13:32 smithi master
pass 4562710 2019-12-03 00:41:30 2019-12-03 01:27:55 2019-12-03 02:51:56 1:24:01 1:10:23 0:13:38 smithi master
pass 4562711 2019-12-03 00:41:31 2019-12-03 01:28:19 2019-12-03 02:00:18 0:31:59 0:19:24 0:12:35 smithi master
pass 4562712 2019-12-03 00:41:32 2019-12-03 01:28:37 2019-12-03 02:04:37 0:36:00 0:23:24 0:12:36 smithi master
pass 4562713 2019-12-03 00:41:32 2019-12-03 01:29:56 2019-12-03 02:01:55 0:31:59 0:14:31 0:17:28 smithi master
pass 4562714 2019-12-03 00:41:33 2019-12-03 01:30:01 2019-12-03 02:02:00 0:31:59 0:19:21 0:12:38 smithi master
pass 4562715 2019-12-03 00:41:34 2019-12-03 01:30:18 2019-12-03 02:16:17 0:45:59 0:32:23 0:13:36 smithi master
pass 4562716 2019-12-03 00:41:35 2019-12-03 01:30:18 2019-12-03 02:08:17 0:37:59 0:12:16 0:25:43 smithi master
pass 4562717 2019-12-03 00:41:36 2019-12-03 01:30:25 2019-12-03 02:04:25 0:34:00 0:17:41 0:16:19 smithi master
pass 4562718 2019-12-03 00:41:37 2019-12-03 01:32:18 2019-12-03 02:12:23 0:40:05 0:19:53 0:20:12 smithi master
pass 4562719 2019-12-03 00:41:37 2019-12-03 01:32:18 2019-12-03 02:18:23 0:46:05 0:28:39 0:17:26 smithi master
pass 4562720 2019-12-03 00:41:38 2019-12-03 01:32:18 2019-12-03 02:04:23 0:32:05 0:11:36 0:20:29 smithi master
pass 4562721 2019-12-03 00:41:39 2019-12-03 01:32:36 2019-12-03 02:10:36 0:38:00 0:26:19 0:11:41 smithi master
pass 4562722 2019-12-03 00:41:40 2019-12-03 01:34:23 2019-12-03 02:10:24 0:36:01 0:16:14 0:19:47 smithi master
pass 4562723 2019-12-03 00:41:41 2019-12-03 01:34:23 2019-12-03 02:50:25 1:16:02 1:02:02 0:14:00 smithi master
pass 4562724 2019-12-03 00:41:41 2019-12-03 01:34:23 2019-12-03 02:10:23 0:36:00 0:26:30 0:09:30 smithi master
pass 4562725 2019-12-03 00:41:42 2019-12-03 01:34:24 2019-12-03 02:22:24 0:48:00 0:24:10 0:23:50 smithi master
pass 4562726 2019-12-03 00:41:43 2019-12-03 01:34:39 2019-12-03 02:08:38 0:33:59 0:14:15 0:19:44 smithi master
pass 4562727 2019-12-03 00:41:44 2019-12-03 01:36:27 2019-12-03 01:59:30 0:23:03 0:12:45 0:10:18 smithi master
pass 4562728 2019-12-03 00:41:45 2019-12-03 01:36:27 2019-12-03 02:21:31 0:45:04 0:24:22 0:20:42 smithi master
pass 4562729 2019-12-03 00:41:46 2019-12-03 01:38:00 2019-12-03 02:10:00 0:32:00 0:14:55 0:17:05 smithi master
pass 4562730 2019-12-03 00:41:47 2019-12-03 01:38:01 2019-12-03 02:12:00 0:33:59 0:18:09 0:15:50 smithi master
pass 4562731 2019-12-03 00:41:47 2019-12-03 01:39:32 2019-12-03 02:07:30 0:27:58 0:18:34 0:09:24 smithi master
pass 4562732 2019-12-03 00:41:48 2019-12-03 01:40:01 2019-12-03 02:20:01 0:40:00 0:17:56 0:22:04 smithi master
pass 4562733 2019-12-03 00:41:49 2019-12-03 01:40:37 2019-12-03 02:04:36 0:23:59 0:12:55 0:11:04 smithi master
pass 4562734 2019-12-03 00:41:50 2019-12-03 01:42:06 2019-12-03 02:16:06 0:34:00 0:23:04 0:10:56 smithi master
pass 4562735 2019-12-03 00:41:51 2019-12-03 01:42:39 2019-12-03 02:12:38 0:29:59 0:20:13 0:09:46 smithi master
pass 4562736 2019-12-03 00:41:51 2019-12-03 01:42:41 2019-12-03 02:44:41 1:02:00 0:42:45 0:19:15 smithi master
pass 4562737 2019-12-03 00:41:52 2019-12-03 01:43:56 2019-12-03 02:19:55 0:35:59 0:18:36 0:17:23 smithi master
pass 4562738 2019-12-03 00:41:53 2019-12-03 01:43:56 2019-12-03 02:37:56 0:54:00 0:24:03 0:29:57 smithi master
pass 4562739 2019-12-03 00:41:54 2019-12-03 01:44:00 2019-12-03 02:12:00 0:28:00 0:12:48 0:15:12 smithi master
pass 4562740 2019-12-03 00:41:55 2019-12-03 01:44:00 2019-12-03 02:22:00 0:38:00 0:22:56 0:15:04 smithi master
pass 4562741 2019-12-03 00:41:55 2019-12-03 01:44:02 2019-12-03 02:28:02 0:44:00 0:26:06 0:17:54 smithi master
pass 4562742 2019-12-03 00:41:56 2019-12-03 01:44:06 2019-12-03 02:04:05 0:19:59 0:10:10 0:09:49 smithi master
pass 4562743 2019-12-03 00:41:57 2019-12-03 01:44:06 2019-12-03 02:14:05 0:29:59 0:19:08 0:10:51 smithi master
pass 4562744 2019-12-03 00:41:58 2019-12-03 01:44:19 2019-12-03 02:18:18 0:33:59 0:21:28 0:12:31 smithi master
pass 4562745 2019-12-03 00:41:59 2019-12-03 01:44:27 2019-12-03 02:26:26 0:41:59 0:21:17 0:20:42 smithi master
pass 4562746 2019-12-03 00:41:59 2019-12-03 01:44:37 2019-12-03 02:24:37 0:40:00 0:11:46 0:28:14 smithi master
pass 4562747 2019-12-03 00:42:00 2019-12-03 01:45:52 2019-12-03 02:23:51 0:37:59 0:22:23 0:15:36 smithi master
pass 4562748 2019-12-03 00:42:01 2019-12-03 01:45:58 2019-12-03 02:29:58 0:44:00 0:19:58 0:24:02 smithi master
fail 4562749 2019-12-03 00:42:02 2019-12-03 01:48:17 2019-12-03 05:04:20 3:16:03 2:54:59 0:21:04 smithi master
Failure Reason:

reached maximum tries (500) after waiting for 3000 seconds

pass 4562750 2019-12-03 00:42:03 2019-12-03 01:48:17 2019-12-03 02:30:17 0:42:00 0:19:44 0:22:16 smithi master
pass 4562751 2019-12-03 00:42:03 2019-12-03 01:48:17 2019-12-03 02:38:17 0:50:00 0:25:10 0:24:50 smithi master
pass 4562752 2019-12-03 00:42:04 2019-12-03 01:48:17 2019-12-03 02:20:16 0:31:59 0:12:34 0:19:25 smithi master
pass 4562753 2019-12-03 00:42:05 2019-12-03 01:49:06 2019-12-03 02:21:06 0:32:00 0:20:55 0:11:05 smithi master
pass 4562754 2019-12-03 00:42:06 2019-12-03 01:50:21 2019-12-03 02:30:21 0:40:00 0:25:30 0:14:30 smithi master
pass 4562755 2019-12-03 00:42:06 2019-12-03 01:50:21 2019-12-03 02:18:21 0:28:00 0:13:04 0:14:56 smithi master
pass 4562756 2019-12-03 00:42:07 2019-12-03 01:50:21 2019-12-03 02:26:21 0:36:00 0:24:41 0:11:19 smithi master
pass 4562757 2019-12-03 00:42:08 2019-12-03 01:50:26 2019-12-03 02:28:26 0:38:00 0:20:17 0:17:43 smithi master
pass 4562758 2019-12-03 00:42:09 2019-12-03 01:51:54 2019-12-03 02:23:54 0:32:00 0:17:38 0:14:22 smithi master
pass 4562759 2019-12-03 00:42:10 2019-12-03 01:51:54 2019-12-03 02:17:54 0:26:00 0:10:00 0:16:00 smithi master
pass 4562760 2019-12-03 00:42:11 2019-12-03 01:51:55 2019-12-03 02:39:55 0:48:00 0:24:53 0:23:07 smithi master
pass 4562761 2019-12-03 00:42:12 2019-12-03 01:51:57 2019-12-03 02:31:58 0:40:01 0:20:43 0:19:18 smithi master
fail 4562762 2019-12-03 00:42:12 2019-12-03 01:54:42 2019-12-03 03:08:42 1:14:00 0:53:51 0:20:09 smithi master
Failure Reason:

"2019-12-03 02:38:39.800426 osd.1 osd.1 172.21.15.26:6808/10919 4 : cluster [WRN] Monitor daemon marked osd.1 down, but it is still running" in cluster log

pass 4562763 2019-12-03 00:42:13 2019-12-03 01:55:17 2019-12-03 02:25:17 0:30:00 0:20:03 0:09:57 smithi master
pass 4562764 2019-12-03 00:42:14 2019-12-03 01:56:07 2019-12-03 02:38:07 0:42:00 0:26:01 0:15:59 smithi master
pass 4562765 2019-12-03 00:42:15 2019-12-03 01:56:07 2019-12-03 02:24:06 0:27:59 0:13:42 0:14:17 smithi master
pass 4562766 2019-12-03 00:42:16 2019-12-03 01:56:12 2019-12-03 02:28:11 0:31:59 0:14:49 0:17:10 smithi master