Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version
pass 4371331 2019-10-09 15:42:16 2019-10-09 15:44:09 2019-10-09 16:28:09 0:44:00 0:28:29 0:15:31 smithi master centos 7.3
pass 4371333 2019-10-09 15:42:17 2019-10-09 15:45:35 2019-10-09 17:29:35 1:44:00 1:29:05 0:14:55 smithi master
pass 4371335 2019-10-09 15:42:18 2019-10-09 15:45:35 2019-10-09 17:17:35 1:32:00 1:14:19 0:17:41 smithi master
pass 4371337 2019-10-09 15:42:19 2019-10-09 15:47:34 2019-10-09 16:13:33 0:25:59 0:13:31 0:12:28 smithi master
pass 4371339 2019-10-09 15:42:20 2019-10-09 15:47:34 2019-10-09 16:07:33 0:19:59 0:09:08 0:10:51 smithi master
pass 4371341 2019-10-09 15:42:20 2019-10-09 15:49:46 2019-10-09 16:17:46 0:28:00 0:13:43 0:14:17 smithi master
pass 4371343 2019-10-09 15:42:21 2019-10-09 15:49:47 2019-10-09 19:01:49 3:12:02 2:54:09 0:17:53 smithi master
pass 4371345 2019-10-09 15:42:22 2019-10-09 15:49:47 2019-10-09 18:23:48 2:34:01 2:23:19 0:10:42 smithi master
pass 4371347 2019-10-09 15:42:23 2019-10-09 15:49:54 2019-10-09 16:15:54 0:26:00 0:15:10 0:10:50 smithi master
fail 4371349 2019-10-09 15:42:24 2019-10-09 15:51:34 2019-10-09 18:37:36 2:46:02 2:35:03 0:10:59 smithi master
Failure Reason:

Command failed on smithi168 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'

pass 4371351 2019-10-09 15:42:25 2019-10-09 15:51:49 2019-10-09 16:37:49 0:46:00 0:29:46 0:16:14 smithi master
fail 4371353 2019-10-09 15:42:25 2019-10-09 15:52:02 2019-10-09 17:10:03 1:18:01 0:17:32 1:00:29 smithi master
Failure Reason:

"2019-10-09 17:01:46.011104 mon.a mon.0 172.21.15.92:6789/0 295 : cluster [WRN] Health check failed: 14 slow requests are blocked > 32 sec. Implicated osds 10 (REQUEST_SLOW)" in cluster log

pass 4371355 2019-10-09 15:42:26 2019-10-09 15:53:43 2019-10-09 16:25:42 0:31:59 0:20:21 0:11:38 smithi master
pass 4371357 2019-10-09 15:42:27 2019-10-09 15:53:43 2019-10-09 16:25:42 0:31:59 0:18:01 0:13:58 smithi master
pass 4371359 2019-10-09 15:42:28 2019-10-09 15:53:43 2019-10-09 16:25:42 0:31:59 0:19:23 0:12:36 smithi master
pass 4371361 2019-10-09 15:42:29 2019-10-09 15:55:50 2019-10-09 16:47:50 0:52:00 0:36:29 0:15:31 smithi master
pass 4371363 2019-10-09 15:42:30 2019-10-09 15:55:51 2019-10-09 16:35:50 0:39:59 0:17:16 0:22:43 smithi master
pass 4371365 2019-10-09 15:42:30 2019-10-09 15:55:50 2019-10-09 16:27:50 0:32:00 0:17:18 0:14:42 smithi master
pass 4371367 2019-10-09 15:42:31 2019-10-09 15:56:31 2019-10-09 16:34:30 0:37:59 0:17:19 0:20:40 smithi master
pass 4371369 2019-10-09 15:42:32 2019-10-09 15:56:44 2019-10-09 16:14:44 0:18:00 0:07:05 0:10:55 smithi master
pass 4371371 2019-10-09 15:42:33 2019-10-09 15:57:45 2019-10-09 17:03:45 1:06:00 0:17:59 0:48:01 smithi master
pass 4371373 2019-10-09 15:42:33 2019-10-09 15:57:45 2019-10-09 16:15:44 0:17:59 0:07:16 0:10:43 smithi master
pass 4371375 2019-10-09 15:42:34 2019-10-09 15:57:45 2019-10-09 17:55:46 1:58:01 1:17:28 0:40:33 smithi master
pass 4371377 2019-10-09 15:42:35 2019-10-09 15:57:50 2019-10-09 16:37:49 0:39:59 0:24:00 0:15:59 smithi master centos
pass 4371379 2019-10-09 15:42:36 2019-10-09 15:58:08 2019-10-09 16:24:07 0:25:59 0:13:37 0:12:22 smithi master
pass 4371381 2019-10-09 15:42:36 2019-10-09 15:59:15 2019-10-09 19:13:18 3:14:03 2:35:03 0:39:00 smithi master
pass 4371383 2019-10-09 15:42:37 2019-10-09 15:59:26 2019-10-09 16:39:25 0:39:59 0:13:47 0:26:12 smithi master
pass 4371385 2019-10-09 15:42:38 2019-10-09 15:59:31 2019-10-09 16:37:31 0:38:00 0:14:07 0:23:53 smithi master
pass 4371387 2019-10-09 15:42:39 2019-10-09 15:59:35 2019-10-09 16:51:35 0:52:00 0:14:12 0:37:48 smithi master
pass 4371389 2019-10-09 15:42:40 2019-10-09 15:59:43 2019-10-09 16:19:42 0:19:59 0:07:04 0:12:55 smithi master
pass 4371391 2019-10-09 15:42:40 2019-10-09 15:59:46 2019-10-09 17:19:47 1:20:01 0:29:49 0:50:12 smithi master
pass 4371393 2019-10-09 15:42:41 2019-10-09 16:07:03 2019-10-09 16:55:03 0:48:00 0:27:52 0:20:08 smithi master
pass 4371395 2019-10-09 15:42:42 2019-10-09 16:07:16 2019-10-09 16:39:16 0:32:00 0:22:03 0:09:57 smithi master
pass 4371397 2019-10-09 15:42:43 2019-10-09 16:07:30 2019-10-09 16:41:30 0:34:00 0:17:19 0:16:41 smithi master
pass 4371399 2019-10-09 15:42:43 2019-10-09 16:07:34 2019-10-09 16:37:34 0:30:00 0:17:31 0:12:29 smithi master
pass 4371401 2019-10-09 15:42:44 2019-10-09 16:07:58 2019-10-09 17:09:58 1:02:00 0:17:50 0:44:10 smithi master
pass 4371403 2019-10-09 15:42:45 2019-10-09 16:09:18 2019-10-09 16:59:18 0:50:00 0:12:04 0:37:56 smithi master
pass 4371405 2019-10-09 15:42:46 2019-10-09 16:09:57 2019-10-09 18:05:57 1:56:00 1:12:47 0:43:13 smithi master
pass 4371407 2019-10-09 15:42:47 2019-10-09 16:13:48 2019-10-09 16:33:47 0:19:59 0:10:53 0:09:06 smithi master
pass 4371409 2019-10-09 15:42:47 2019-10-09 16:13:48 2019-10-09 16:29:47 0:15:59 0:07:19 0:08:40 smithi master
pass 4371411 2019-10-09 15:42:48 2019-10-09 16:14:46 2019-10-09 16:42:45 0:27:59 0:13:55 0:14:04 smithi master
pass 4371413 2019-10-09 15:42:49 2019-10-09 16:15:59 2019-10-09 16:59:58 0:43:59 0:25:18 0:18:41 smithi master
pass 4371415 2019-10-09 15:42:50 2019-10-09 16:15:59 2019-10-09 17:07:58 0:51:59 0:10:17 0:41:42 smithi master ubuntu
pass 4371417 2019-10-09 15:42:51 2019-10-09 18:38:04 2019-10-09 18:56:03 0:17:59 0:07:40 0:10:19 smithi master
pass 4371419 2019-10-09 15:42:51 2019-10-09 18:38:04 2019-10-09 19:00:03 0:21:59 0:09:15 0:12:44 smithi master
pass 4371421 2019-10-09 15:42:52 2019-10-09 18:39:22 2019-10-09 19:11:21 0:31:59 0:22:41 0:09:18 smithi master centos
pass 4371423 2019-10-09 15:42:53 2019-10-09 18:39:42 2019-10-09 19:09:41 0:29:59 0:13:50 0:16:09 smithi master
fail 4371425 2019-10-09 15:42:54 2019-10-09 18:39:45 2019-10-09 21:49:48 3:10:03 2:26:50 0:43:13 smithi master
Failure Reason:

Command failed on smithi088 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --"

pass 4371427 2019-10-09 15:42:55 2019-10-09 18:39:53 2019-10-09 19:05:53 0:26:00 0:14:34 0:11:26 smithi master
pass 4371429 2019-10-09 15:42:55 2019-10-09 18:40:06 2019-10-09 19:28:05 0:47:59 0:34:47 0:13:12 smithi master
pass 4371431 2019-10-09 15:42:56 2019-10-09 18:40:07 2019-10-09 19:10:06 0:29:59 0:17:53 0:12:06 smithi master
pass 4371433 2019-10-09 15:42:57 2019-10-09 18:40:07 2019-10-09 19:10:07 0:30:00 0:19:56 0:10:04 smithi master
pass 4371435 2019-10-09 15:42:58 2019-10-09 18:40:09 2019-10-09 20:22:10 1:42:01 1:23:46 0:18:15 smithi master
pass 4371437 2019-10-09 15:42:58 2019-10-09 18:40:17 2019-10-09 19:24:16 0:43:59 0:28:37 0:15:22 smithi master
pass 4371439 2019-10-09 15:42:59 2019-10-09 18:42:07 2019-10-09 19:14:07 0:32:00 0:18:15 0:13:45 smithi master
pass 4371441 2019-10-09 15:43:00 2019-10-09 18:42:08 2019-10-09 18:58:07 0:15:59 0:07:42 0:08:17 smithi master
pass 4371443 2019-10-09 15:43:01 2019-10-09 18:42:07 2019-10-09 19:18:12 0:36:05 0:17:18 0:18:47 smithi master
pass 4371445 2019-10-09 15:43:02 2019-10-09 18:44:12 2019-10-09 20:16:13 1:32:01 1:18:51 0:13:10 smithi master
pass 4371447 2019-10-09 15:43:02 2019-10-09 18:44:12 2019-10-09 19:12:12 0:28:00 0:15:18 0:12:42 smithi master
pass 4371449 2019-10-09 15:43:03 2019-10-09 18:44:13 2019-10-09 19:14:12 0:29:59 0:12:56 0:17:03 smithi master
pass 4371451 2019-10-09 15:43:04 2019-10-09 18:44:20 2019-10-09 19:12:19 0:27:59 0:13:03 0:14:56 smithi master
pass 4371453 2019-10-09 15:43:05 2019-10-09 18:44:21 2019-10-09 19:02:20 0:17:59 0:07:32 0:10:27 smithi master
pass 4371455 2019-10-09 15:43:06 2019-10-09 18:45:56 2019-10-09 19:15:56 0:30:00 0:15:08 0:14:52 smithi master
pass 4371457 2019-10-09 15:43:06 2019-10-09 18:45:57 2019-10-09 19:17:56 0:31:59 0:22:29 0:09:30 smithi master centos
pass 4371459 2019-10-09 15:43:07 2019-10-09 18:46:09 2019-10-09 19:36:09 0:50:00 0:14:30 0:35:30 smithi master
pass 4371461 2019-10-09 15:43:08 2019-10-09 18:46:18 2019-10-09 19:06:18 0:20:00 0:10:28 0:09:32 smithi master
pass 4371463 2019-10-09 15:43:09 2019-10-09 18:48:07 2019-10-09 19:40:07 0:52:00 0:29:39 0:22:21 smithi master
pass 4371465 2019-10-09 15:43:10 2019-10-09 18:48:08 2019-10-09 23:10:12 4:22:04 3:50:09 0:31:55 smithi master
pass 4371467 2019-10-09 15:43:10 2019-10-09 18:48:09 2019-10-09 19:50:09 1:02:00 0:17:05 0:44:55 smithi master
pass 4371469 2019-10-09 15:43:11 2019-10-09 18:48:10 2019-10-09 22:18:13 3:30:03 0:17:47 3:12:16 smithi master
pass 4371471 2019-10-09 15:43:12 2019-10-09 18:48:24 2019-10-09 19:16:24 0:28:00 0:18:12 0:09:48 smithi master
pass 4371473 2019-10-09 15:43:13 2019-10-09 18:49:29 2019-10-09 19:41:29 0:52:00 0:17:47 0:34:13 smithi master
pass 4371475 2019-10-09 15:43:13 2019-10-09 18:50:00 2019-10-09 21:34:02 2:44:02 2:33:28 0:10:34 smithi master
pass 4371477 2019-10-09 15:43:14 2019-10-09 18:50:19 2019-10-09 19:20:19 0:30:00 0:15:01 0:14:59 smithi master
fail 4371479 2019-10-09 15:43:15 2019-10-09 18:50:22 2019-10-09 21:46:24 2:56:02 2:41:53 0:14:09 smithi master
Failure Reason:

Command failed on smithi033 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'

pass 4371481 2019-10-09 15:43:16 2019-10-09 18:50:55 2019-10-09 20:32:55 1:42:00 1:24:15 0:17:45 smithi master
pass 4371483 2019-10-09 15:43:16 2019-10-09 18:52:39 2019-10-09 19:18:44 0:26:05 0:14:59 0:11:06 smithi master
pass 4371485 2019-10-09 15:43:17 2019-10-09 18:54:19 2019-10-09 20:28:19 1:34:00 1:15:41 0:18:19 smithi master
pass 4371487 2019-10-09 15:43:18 2019-10-09 18:54:23 2019-10-09 19:14:22 0:19:59 0:08:00 0:11:59 smithi master
pass 4371489 2019-10-09 15:43:19 2019-10-09 18:56:20 2019-10-09 19:36:19 0:39:59 0:13:27 0:26:32 smithi master
pass 4371491 2019-10-09 15:43:19 2019-10-09 18:56:20 2019-10-09 19:36:19 0:39:59 0:13:43 0:26:16 smithi master
pass 4371493 2019-10-09 15:43:20 2019-10-09 18:56:58 2019-10-09 19:20:57 0:23:59 0:12:34 0:11:25 smithi master
pass 4371495 2019-10-09 15:43:21 2019-10-09 18:58:10 2019-10-09 19:16:09 0:17:59 0:08:35 0:09:24 smithi master
pass 4371497 2019-10-09 15:43:22 2019-10-09 18:58:10 2019-10-09 19:18:10 0:20:00 0:07:26 0:12:34 smithi master
pass 4371499 2019-10-09 15:43:23 2019-10-09 18:58:11 2019-10-09 20:38:11 1:40:00 0:15:24 1:24:36 smithi master
pass 4371501 2019-10-09 15:43:23 2019-10-09 18:58:21 2019-10-09 20:58:22 2:00:01 0:14:26 1:45:35 smithi master ubuntu
pass 4371503 2019-10-09 15:43:24 2019-10-09 18:59:50 2019-10-09 19:43:50 0:44:00 0:32:53 0:11:07 smithi master centos
pass 4371505 2019-10-09 15:43:25 2019-10-09 19:00:04 2019-10-09 20:04:04 1:04:00 0:44:09 0:19:51 smithi master
pass 4371507 2019-10-09 15:43:26 2019-10-09 19:00:19 2019-10-09 19:32:19 0:32:00 0:17:38 0:14:22 smithi master
pass 4371509 2019-10-09 15:43:27 2019-10-09 19:00:22 2019-10-09 19:20:21 0:19:59 0:10:28 0:09:31 smithi master
pass 4371510 2019-10-09 15:43:27 2019-10-09 19:02:04 2019-10-09 21:18:06 2:16:02 1:44:49 0:31:13 smithi master
pass 4371512 2019-10-09 15:43:28 2019-10-09 19:02:05 2019-10-09 19:38:04 0:35:59 0:17:24 0:18:35 smithi master
pass 4371514 2019-10-09 15:43:29 2019-10-09 19:02:17 2019-10-09 19:30:17 0:28:00 0:17:10 0:10:50 smithi master
pass 4371516 2019-10-09 15:43:30 2019-10-09 19:02:21 2019-10-09 20:32:23 1:30:02 0:17:54 1:12:08 smithi master
pass 4371518 2019-10-09 15:43:30 2019-10-09 19:03:01 2019-10-09 19:35:01 0:32:00 0:19:41 0:12:19 smithi master
pass 4371520 2019-10-09 15:43:31 2019-10-09 19:04:29 2019-10-09 20:36:29 1:32:00 1:19:52 0:12:08 smithi master
pass 4371522 2019-10-09 15:43:32 2019-10-09 19:06:09 2019-10-09 19:32:08 0:25:59 0:13:05 0:12:54 smithi master
pass 4371525 2019-10-09 15:43:33 2019-10-09 19:06:19 2019-10-09 21:26:21 2:20:02 2:07:44 0:12:18 smithi master
pass 4371527 2019-10-09 15:43:33 2019-10-09 19:06:23 2019-10-09 20:14:23 1:08:00 0:28:21 0:39:39 smithi master
pass 4371529 2019-10-09 15:43:34 2019-10-09 19:08:24 2019-10-09 19:50:24 0:42:00 0:14:34 0:27:26 smithi master
pass 4371530 2019-10-09 15:43:35 2019-10-09 19:08:24 2019-10-09 19:28:23 0:19:59 0:10:34 0:09:25 smithi master
pass 4371533 2019-10-09 15:43:36 2019-10-09 19:09:57 2019-10-09 19:39:56 0:29:59 0:17:34 0:12:25 smithi master
pass 4371535 2019-10-09 15:43:36 2019-10-09 19:09:56 2019-10-09 19:27:56 0:18:00 0:07:34 0:10:26 smithi master
pass 4371537 2019-10-09 15:43:37 2019-10-09 19:10:07 2019-10-09 19:44:06 0:33:59 0:21:08 0:12:51 smithi master
pass 4371539 2019-10-09 15:43:38 2019-10-09 19:10:07 2019-10-09 19:36:07 0:26:00 0:16:01 0:09:59 smithi master centos
pass 4371541 2019-10-09 15:43:39 2019-10-09 19:10:08 2019-10-09 19:40:08 0:30:00 0:18:08 0:11:52 smithi master
pass 4371543 2019-10-09 15:43:40 2019-10-09 19:11:34 2019-10-09 21:01:35 1:50:01 0:17:11 1:32:50 smithi master
pass 4371545 2019-10-09 15:43:40 2019-10-09 19:11:34 2019-10-09 19:49:33 0:37:59 0:25:04 0:12:55 smithi master
pass 4371547 2019-10-09 15:43:41 2019-10-09 19:11:36 2019-10-09 19:39:35 0:27:59 0:15:17 0:12:42 smithi master
pass 4371549 2019-10-09 15:43:42 2019-10-09 19:12:06 2019-10-09 19:42:06 0:30:00 0:17:20 0:12:40 smithi master
pass 4371551 2019-10-09 15:43:43 2019-10-09 19:12:13 2019-10-09 19:50:13 0:38:00 0:17:50 0:20:10 smithi master
pass 4371553 2019-10-09 15:43:44 2019-10-09 19:12:21 2019-10-09 22:58:25 3:46:04 3:33:27 0:12:37 smithi master
pass 4371555 2019-10-09 15:43:44 2019-10-09 19:12:55 2019-10-09 19:32:54 0:19:59 0:10:40 0:09:19 smithi master
pass 4371557 2019-10-09 15:43:45 2019-10-09 19:13:19 2019-10-09 20:07:19 0:54:00 0:38:26 0:15:34 smithi master
pass 4371559 2019-10-09 15:43:46 2019-10-09 19:14:21 2019-10-09 19:46:20 0:31:59 0:22:04 0:09:55 smithi master
pass 4371561 2019-10-09 15:43:47 2019-10-09 19:14:21 2019-10-09 20:06:21 0:52:00 0:13:21 0:38:39 smithi master
pass 4371563 2019-10-09 15:43:47 2019-10-09 19:14:21 2019-10-09 20:06:21 0:52:00 0:13:34 0:38:26 smithi master
pass 4371565 2019-10-09 15:43:48 2019-10-09 19:14:21 2019-10-09 20:00:20 0:45:59 0:21:43 0:24:16 smithi master
pass 4371567 2019-10-09 15:43:49 2019-10-09 19:14:24 2019-10-09 20:44:24 1:30:00 0:19:13 1:10:47 smithi master
pass 4371569 2019-10-09 15:43:50 2019-10-09 19:16:12 2019-10-09 19:48:11 0:31:59 0:20:08 0:11:51 smithi master
pass 4371571 2019-10-09 15:43:50 2019-10-09 19:16:12 2019-10-09 19:34:11 0:17:59 0:07:48 0:10:11 smithi master
pass 4371573 2019-10-09 15:43:51 2019-10-09 19:16:25 2019-10-09 19:32:24 0:15:59 0:07:42 0:08:17 smithi master
pass 4371575 2019-10-09 15:43:52 2019-10-09 19:18:11 2019-10-09 20:06:11 0:48:00 0:17:38 0:30:22 smithi master
pass 4371577 2019-10-09 15:43:53 2019-10-09 19:18:12 2019-10-09 20:10:11 0:51:59 0:09:21 0:42:38 smithi master ubuntu
pass 4371579 2019-10-09 15:43:54 2019-10-09 19:18:13 2019-10-09 19:34:12 0:15:59 0:07:20 0:08:39 smithi master
pass 4371581 2019-10-09 15:43:54 2019-10-09 19:18:45 2019-10-09 19:42:44 0:23:59 0:12:28 0:11:31 smithi master
pass 4371583 2019-10-09 15:43:55 2019-10-09 19:20:05 2019-10-09 19:54:04 0:33:59 0:24:25 0:09:34 smithi master centos 7.3
pass 4371585 2019-10-09 15:43:56 2019-10-09 19:20:19 2019-10-09 19:48:18 0:27:59 0:12:24 0:15:35 smithi master
pass 4371587 2019-10-09 15:43:57 2019-10-09 19:20:20 2019-10-09 19:54:19 0:33:59 0:17:57 0:16:02 smithi master
pass 4371589 2019-10-09 15:43:57 2019-10-09 19:20:23 2019-10-09 20:30:23 1:10:00 0:17:44 0:52:16 smithi master
pass 4371591 2019-10-09 15:43:58 2019-10-09 19:20:59 2019-10-09 20:12:58 0:51:59 0:39:15 0:12:44 smithi master
pass 4371593 2019-10-09 15:43:59 2019-10-09 19:22:07 2019-10-09 20:00:07 0:38:00 0:13:39 0:24:21 smithi master
fail 4371595 2019-10-09 15:44:00 2019-10-09 19:24:22 2019-10-10 01:16:27 5:52:05 5:05:53 0:46:12 smithi master
Failure Reason:

Command failed on smithi037 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --"

pass 4371597 2019-10-09 15:44:01 2019-10-09 19:24:22 2019-10-09 19:56:22 0:32:00 0:19:37 0:12:23 smithi master
pass 4371599 2019-10-09 15:44:01 2019-10-09 19:24:23 2019-10-09 19:58:22 0:33:59 0:14:08 0:19:51 smithi master
pass 4371601 2019-10-09 15:44:02 2019-10-09 19:28:11 2019-10-09 19:54:10 0:25:59 0:16:51 0:09:08 smithi master
pass 4371603 2019-10-09 15:44:03 2019-10-09 19:28:11 2019-10-09 19:58:10 0:29:59 0:17:08 0:12:51 smithi master
pass 4371605 2019-10-09 15:44:04 2019-10-09 19:28:25 2019-10-09 20:52:25 1:24:00 0:19:07 1:04:53 smithi master
pass 4371607 2019-10-09 15:44:05 2019-10-09 19:30:32 2019-10-09 22:46:35 3:16:03 3:02:17 0:13:46 smithi master
pass 4371609 2019-10-09 15:44:05 2019-10-09 19:32:24 2019-10-09 20:08:23 0:35:59 0:25:31 0:10:28 smithi master
pass 4371611 2019-10-09 15:44:06 2019-10-09 19:32:24 2019-10-09 19:58:23 0:25:59 0:14:29 0:11:30 smithi master
fail 4371613 2019-10-09 15:44:07 2019-10-09 19:32:26 2019-10-09 22:28:28 2:56:02 2:40:41 0:15:21 smithi master
Failure Reason:

Command failed on smithi076 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'

pass 4371615 2019-10-09 15:44:08 2019-10-09 19:32:56 2019-10-09 20:30:56 0:58:00 0:31:47 0:26:13 smithi master
pass 4371617 2019-10-09 15:44:09 2019-10-09 19:34:27 2019-10-09 20:42:27 1:08:00 0:17:19 0:50:41 smithi master
pass 4371619 2019-10-09 15:44:09 2019-10-09 19:34:27 2019-10-09 19:56:26 0:21:59 0:12:16 0:09:43 smithi master
pass 4371621 2019-10-09 15:44:10 2019-10-09 19:35:02 2019-10-09 20:09:02 0:34:00 0:17:21 0:16:39 smithi master
pass 4371623 2019-10-09 15:44:11 2019-10-09 19:36:23 2019-10-09 19:54:22 0:17:59 0:07:29 0:10:30 smithi master
pass 4371625 2019-10-09 15:44:12 2019-10-09 19:36:23 2019-10-09 20:08:22 0:31:59 0:17:32 0:14:27 smithi master
pass 4371627 2019-10-09 15:44:13 2019-10-09 19:36:23 2019-10-09 20:14:22 0:37:59 0:24:29 0:13:30 smithi master centos 7.3
pass 4371629 2019-10-09 15:44:13 2019-10-09 19:36:23 2019-10-09 20:10:22 0:33:59 0:18:09 0:15:50 smithi master
pass 4371631 2019-10-09 15:44:14 2019-10-09 19:38:19 2019-10-09 19:54:19 0:16:00 0:06:07 0:09:53 smithi master
pass 4371633 2019-10-09 15:44:15 2019-10-09 19:38:19 2019-10-09 20:04:19 0:26:00 0:13:56 0:12:04 smithi master
pass 4371635 2019-10-09 15:44:16 2019-10-09 19:39:52 2019-10-09 20:33:51 0:53:59 0:39:57 0:14:02 smithi master
pass 4371637 2019-10-09 15:44:17 2019-10-09 19:39:57 2019-10-09 20:23:58 0:44:01 0:13:29 0:30:32 smithi master
pass 4371639 2019-10-09 15:44:18 2019-10-09 19:40:08 2019-10-09 20:14:08 0:34:00 0:14:05 0:19:55 smithi master
pass 4371641 2019-10-09 15:44:18 2019-10-09 19:40:09 2019-10-09 20:12:08 0:31:59 0:21:11 0:10:48 smithi master
pass 4371643 2019-10-09 15:44:19 2019-10-09 19:41:44 2019-10-10 01:31:50 5:50:06 3:37:08 2:12:58 smithi master
pass 4371645 2019-10-09 15:44:20 2019-10-09 19:42:02 2019-10-09 20:14:02 0:32:00 0:19:12 0:12:48 smithi master
pass 4371647 2019-10-09 15:44:21 2019-10-09 19:42:07 2019-10-09 20:12:06 0:29:59 0:14:57 0:15:02 smithi master
pass 4371649 2019-10-09 15:44:22 2019-10-09 19:43:00 2019-10-09 20:23:00 0:40:00 0:25:15 0:14:45 smithi master
pass 4371651 2019-10-09 15:44:22 2019-10-09 19:43:51 2019-10-09 19:59:50 0:15:59 0:07:25 0:08:34 smithi master
pass 4371653 2019-10-09 15:44:23 2019-10-09 19:43:51 2019-10-09 20:15:51 0:32:00 0:17:19 0:14:41 smithi master
pass 4371655 2019-10-09 15:44:24 2019-10-09 19:44:22 2019-10-09 21:10:23 1:26:01 1:09:24 0:16:37 smithi master
pass 4371657 2019-10-09 15:44:25 2019-10-09 19:44:35 2019-10-09 20:38:35 0:54:00 0:17:53 0:36:07 smithi master
pass 4371659 2019-10-09 15:44:25 2019-10-09 19:46:35 2019-10-09 20:12:34 0:25:59 0:16:16 0:09:43 smithi master
pass 4371661 2019-10-09 15:44:26 2019-10-09 19:47:34 2019-10-09 20:05:33 0:17:59 0:07:47 0:10:12 smithi master
pass 4371663 2019-10-09 15:44:27 2019-10-09 19:48:15 2019-10-09 22:02:27 2:14:12 0:18:28 1:55:44 smithi master
pass 4371665 2019-10-09 15:44:28 2019-10-09 19:48:16 2019-10-09 20:30:15 0:41:59 0:13:14 0:28:45 smithi master ubuntu
pass 4371667 2019-10-09 15:44:28 2019-10-09 19:48:19 2019-10-09 20:22:19 0:34:00 0:25:09 0:08:51 smithi master centos 7.3
pass 4371669 2019-10-09 15:44:29 2019-10-09 19:49:48 2019-10-09 20:57:48 1:08:00 0:35:55 0:32:05 smithi master
pass 4371671 2019-10-09 15:44:30 2019-10-09 19:50:10 2019-10-09 20:20:10 0:30:00 0:12:52 0:17:08 smithi master
pass 4371673 2019-10-09 15:44:31 2019-10-09 19:50:14 2019-10-09 20:18:13 0:27:59 0:13:10 0:14:49 smithi master
pass 4371675 2019-10-09 15:44:32 2019-10-09 19:50:25 2019-10-09 20:10:24 0:19:59 0:07:34 0:12:25 smithi master
pass 4371677 2019-10-09 15:44:32 2019-10-09 19:54:21 2019-10-09 20:24:21 0:30:00 0:14:05 0:15:55 smithi master
pass 4371679 2019-10-09 15:44:33 2019-10-09 19:54:21 2019-10-09 22:40:24 2:46:03 2:34:27 0:11:36 smithi master
pass 4371681 2019-10-09 15:44:34 2019-10-09 19:54:22 2019-10-09 20:22:21 0:27:59 0:15:51 0:12:08 smithi master
pass 4371683 2019-10-09 15:44:35 2019-10-09 19:54:21 2019-10-09 20:26:21 0:32:00 0:17:44 0:14:16 smithi master
pass 4371685 2019-10-09 15:44:35 2019-10-09 19:54:23 2019-10-09 20:26:22 0:31:59 0:22:10 0:09:49 smithi master
pass 4371687 2019-10-09 15:44:36 2019-10-09 19:56:37 2019-10-09 21:00:37 1:04:00 0:33:13 0:30:47 smithi master
pass 4371689 2019-10-09 15:44:37 2019-10-09 19:56:37 2019-10-09 23:48:46 3:52:09 2:53:45 0:58:24 smithi master
pass 4371691 2019-10-09 15:44:38 2019-10-09 19:58:26 2019-10-09 20:42:25 0:43:59 0:17:08 0:26:51 smithi master
pass 4371693 2019-10-09 15:44:39 2019-10-09 19:58:26 2019-10-09 20:42:26 0:44:00 0:17:26 0:26:34 smithi master
pass 4371695 2019-10-09 15:44:39 2019-10-09 19:58:26 2019-10-09 20:16:25 0:17:59 0:07:23 0:10:36 smithi master
pass 4371697 2019-10-09 15:44:40 2019-10-09 20:00:07 2019-10-09 21:00:07 1:00:00 0:18:14 0:41:46 smithi master
pass 4371699 2019-10-09 15:44:41 2019-10-09 20:00:09 2019-10-10 01:28:14 5:28:05 4:38:30 0:49:35 smithi master
pass 4371701 2019-10-09 15:44:42 2019-10-09 20:00:22 2019-10-09 20:38:26 0:38:04 0:23:51 0:14:13 smithi master
pass 4371703 2019-10-09 15:44:42 2019-10-09 20:03:51 2019-10-09 20:21:50 0:17:59 0:07:16 0:10:43 smithi master
pass 4371705 2019-10-09 15:44:43 2019-10-09 20:04:06 2019-10-09 21:32:06 1:28:00 1:15:47 0:12:13 smithi master
pass 4371707 2019-10-09 15:44:44 2019-10-09 20:04:20 2019-10-09 20:38:20 0:34:00 0:24:13 0:09:47 smithi master centos
pass 4371708 2019-10-09 15:44:45 2019-10-09 20:05:48 2019-10-09 20:49:48 0:44:00 0:13:27 0:30:33 smithi master
pass 4371709 2019-10-09 15:44:46 2019-10-09 20:06:13 2019-10-09 20:30:12 0:23:59 0:11:47 0:12:12 smithi master
pass 4371710 2019-10-09 15:44:46 2019-10-09 20:06:22 2019-10-09 20:32:21 0:25:59 0:13:45 0:12:14 smithi master
pass 4371711 2019-10-09 15:44:47 2019-10-09 20:06:22 2019-10-09 20:40:22 0:34:00 0:18:11 0:15:49 smithi master
pass 4371712 2019-10-09 15:44:48 2019-10-09 20:07:34 2019-10-09 20:39:33 0:31:59 0:18:07 0:13:52 smithi master
pass 4371713 2019-10-09 15:44:49 2019-10-09 20:08:24 2019-10-09 20:24:23 0:15:59 0:07:01 0:08:58 smithi master
pass 4371714 2019-10-09 15:44:49 2019-10-09 20:08:25 2019-10-09 21:04:24 0:55:59 0:33:35 0:22:24 smithi master
fail 4371715 2019-10-09 15:44:50 2019-10-09 20:09:18 2019-10-09 20:41:18 0:32:00 0:20:58 0:11:02 smithi master
Failure Reason:

"2019-10-09 20:23:35.340627 mon.a mon.0 172.21.15.87:6789/0 80 : cluster [WRN] Health check failed: no active mgr (MGR_DOWN)" in cluster log

pass 4371716 2019-10-09 15:44:51 2019-10-09 20:10:13 2019-10-09 21:00:13 0:50:00 0:17:08 0:32:52 smithi master
pass 4371717 2019-10-09 15:44:52 2019-10-09 20:10:38 2019-10-10 01:02:42 4:52:04 3:35:40 1:16:24 smithi master
pass 4371718 2019-10-09 15:44:53 2019-10-09 20:10:38 2019-10-09 21:38:39 1:28:01 0:17:24 1:10:37 smithi master
pass 4371719 2019-10-09 15:44:53 2019-10-09 20:12:22 2019-10-09 20:44:22 0:32:00 0:18:06 0:13:54 smithi master
pass 4371720 2019-10-09 15:44:54 2019-10-09 20:12:22 2019-10-09 21:44:23 1:32:01 1:18:12 0:13:49 smithi master
pass 4371721 2019-10-09 15:44:55 2019-10-09 20:12:36 2019-10-09 20:36:35 0:23:59 0:11:19 0:12:40 smithi master
pass 4371722 2019-10-09 15:44:56 2019-10-09 20:13:00 2019-10-09 20:30:59 0:17:59 0:07:59 0:10:00 smithi master
pass 4371723 2019-10-09 15:44:56 2019-10-09 20:14:18 2019-10-09 21:22:18 1:08:00 0:12:51 0:55:09 smithi master
pass 4371724 2019-10-09 15:44:57 2019-10-09 20:14:18 2019-10-09 20:58:18 0:44:00 0:25:16 0:18:44 smithi master
pass 4371725 2019-10-09 15:44:58 2019-10-09 20:14:18 2019-10-09 20:42:18 0:28:00 0:14:30 0:13:30 smithi master
pass 4371726 2019-10-09 15:44:59 2019-10-09 20:14:23 2019-10-09 20:56:23 0:42:00 0:15:35 0:26:25 smithi master ubuntu
fail 4371727 2019-10-09 15:44:59 2019-10-09 20:14:24 2019-10-09 22:12:25 1:58:01 1:39:23 0:18:38 smithi master
Failure Reason:

Command failed on smithi166 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'

fail 4371728 2019-10-09 15:45:00 2019-10-09 20:16:07 2019-10-09 21:16:07 1:00:00 0:27:54 0:32:06 smithi master
Failure Reason:

"2019-10-09 21:05:27.851368 mon.b mon.0 172.21.15.6:6789/0 212 : cluster [WRN] Health check failed: 236 slow requests are blocked > 32 sec. Implicated osds 6 (REQUEST_SLOW)" in cluster log

pass 4371729 2019-10-09 15:45:01 2019-10-09 20:16:14 2019-10-09 20:38:14 0:22:00 0:07:12 0:14:48 smithi master
pass 4371730 2019-10-09 15:45:02 2019-10-09 20:16:26 2019-10-09 20:42:26 0:26:00 0:09:24 0:16:36 smithi master
pass 4371731 2019-10-09 15:45:03 2019-10-09 20:18:31 2019-10-09 21:00:31 0:42:00 0:30:00 0:12:00 smithi master centos
pass 4371732 2019-10-09 15:45:03 2019-10-09 20:19:19 2019-10-09 23:29:22 3:10:03 0:14:42 2:55:21 smithi master
pass 4371733 2019-10-09 15:45:04 2019-10-09 20:20:28 2019-10-09 22:06:28 1:46:00 0:19:30 1:26:30 smithi master
pass 4371734 2019-10-09 15:45:05 2019-10-09 20:22:07 2019-10-09 21:10:07 0:48:00 0:31:31 0:16:29 smithi master
pass 4371735 2019-10-09 15:45:06 2019-10-09 20:22:11 2019-10-09 20:54:10 0:31:59 0:13:06 0:18:53 smithi master
pass 4371736 2019-10-09 15:45:06 2019-10-09 20:22:20 2019-10-09 20:50:20 0:28:00 0:16:46 0:11:14 smithi master
pass 4371737 2019-10-09 15:45:07 2019-10-09 20:22:22 2019-10-09 20:54:22 0:32:00 0:21:07 0:10:53 smithi master
pass 4371738 2019-10-09 15:45:08 2019-10-09 20:23:02 2019-10-09 21:17:03 0:54:01 0:17:56 0:36:05 smithi master
pass 4371739 2019-10-09 15:45:09 2019-10-09 20:23:31 2019-10-09 20:41:30 0:17:59 0:07:46 0:10:13 smithi master
pass 4371740 2019-10-09 15:45:09 2019-10-09 20:24:00 2019-10-09 22:30:01 2:06:01 0:17:49 1:48:12 smithi master
fail 4371741 2019-10-09 15:45:10 2019-10-09 20:24:23 2019-10-10 01:12:27 4:48:04 4:21:42 0:26:22 smithi master
Failure Reason:

"2019-10-10 00:42:58.998883 mon.b mon.0 172.21.15.58:6789/0 116 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log

pass 4371742 2019-10-09 15:45:11 2019-10-09 20:24:24 2019-10-09 22:08:25 1:44:01 1:17:43 0:26:18 smithi master
pass 4371743 2019-10-09 15:45:12 2019-10-09 20:25:20 2019-10-09 20:49:19 0:23:59 0:14:29 0:09:30 smithi master
pass 4371744 2019-10-09 15:45:12 2019-10-09 20:26:38 2019-10-09 20:56:37 0:29:59 0:13:18 0:16:41 smithi master
pass 4371745 2019-10-09 15:45:13 2019-10-09 20:26:38 2019-10-09 20:44:37 0:17:59 0:07:24 0:10:35 smithi master
pass 4371746 2019-10-09 15:45:14 2019-10-09 20:28:35 2019-10-09 21:00:35 0:32:00 0:13:54 0:18:06 smithi master
pass 4371747 2019-10-09 15:45:15 2019-10-09 20:30:29 2019-10-09 21:02:29 0:32:00 0:22:03 0:09:57 smithi master centos
pass 4371748 2019-10-09 15:45:15 2019-10-09 20:30:29 2019-10-10 00:16:34 3:46:05 0:54:23 2:51:42 smithi master
pass 4371749 2019-10-09 15:45:16 2019-10-09 20:30:29 2019-10-09 22:16:30 1:46:01 0:24:03 1:21:58 smithi master
pass 4371750 2019-10-09 15:45:17 2019-10-09 20:30:57 2019-10-09 21:10:57 0:40:00 0:18:10 0:21:50 smithi master
pass 4371751 2019-10-09 15:45:18 2019-10-09 20:31:00 2019-10-09 20:51:00 0:20:00 0:10:07 0:09:53 smithi master
pass 4371752 2019-10-09 15:45:18 2019-10-09 20:32:38 2019-10-09 21:36:38 1:04:00 0:32:35 0:31:25 smithi master
pass 4371753 2019-10-09 15:45:19 2019-10-09 20:32:38 2019-10-09 21:38:38 1:06:00 0:17:01 0:48:59 smithi master
pass 4371754 2019-10-09 15:45:20 2019-10-09 20:32:57 2019-10-09 21:08:56 0:35:59 0:14:06 0:21:53 smithi master
pass 4371755 2019-10-09 15:45:21 2019-10-09 20:34:07 2019-10-09 21:10:07 0:36:00 0:17:46 0:18:14 smithi master
pass 4371756 2019-10-09 15:45:22 2019-10-09 20:36:45 2019-10-09 21:04:44 0:27:59 0:18:30 0:09:29 smithi master
pass 4371757 2019-10-09 15:45:22 2019-10-09 20:36:45 2019-10-09 21:06:44 0:29:59 0:18:10 0:11:49 smithi master
pass 4371758 2019-10-09 15:45:23 2019-10-09 20:38:27 2019-10-09 22:00:27 1:22:00 1:12:00 0:10:00 smithi master
pass 4371759 2019-10-09 15:45:24 2019-10-09 20:38:27 2019-10-09 21:06:26 0:27:59 0:15:08 0:12:51 smithi master
pass 4371760 2019-10-09 15:45:25 2019-10-09 20:38:27 2019-10-09 22:10:28 1:32:01 1:18:56 0:13:05 smithi master
pass 4371761 2019-10-09 15:45:25 2019-10-09 20:38:28 2019-10-09 20:58:27 0:19:59 0:08:15 0:11:44 smithi master
pass 4371762 2019-10-09 15:45:26 2019-10-09 20:38:37 2019-10-09 21:10:36 0:31:59 0:13:59 0:18:00 smithi master
pass 4371763 2019-10-09 15:45:27 2019-10-09 20:39:48 2019-10-10 00:57:52 4:18:04 3:49:54 0:28:10 smithi master
pass 4371764 2019-10-09 15:45:28 2019-10-09 20:40:23 2019-10-09 21:06:22 0:25:59 0:13:21 0:12:38 smithi master
pass 4371765 2019-10-09 15:45:28 2019-10-09 20:41:34 2019-10-09 20:59:33 0:17:59 0:08:30 0:09:29 smithi master
pass 4371766 2019-10-09 15:45:29 2019-10-09 20:41:34 2019-10-09 21:01:33 0:19:59 0:07:27 0:12:32 smithi master
pass 4371767 2019-10-09 15:45:30 2019-10-09 20:42:19 2019-10-09 21:58:19 1:16:00 0:16:55 0:59:05 smithi master
pass 4371768 2019-10-09 15:45:31 2019-10-09 20:42:27 2019-10-09 21:12:26 0:29:59 0:09:32 0:20:27 smithi master ubuntu
pass 4371769 2019-10-09 15:45:31 2019-10-09 20:42:27 2019-10-09 21:20:27 0:38:00 0:26:37 0:11:23 smithi master centos
pass 4371770 2019-10-09 15:45:32 2019-10-09 20:42:27 2019-10-09 21:30:27 0:48:00 0:29:31 0:18:29 smithi master
pass 4371771 2019-10-09 15:45:33 2019-10-09 20:42:28 2019-10-09 22:48:30 2:06:02 1:11:35 0:54:27 smithi master
pass 4371772 2019-10-09 15:45:34 2019-10-09 20:44:37 2019-10-09 21:16:36 0:31:59 0:17:51 0:14:08 smithi master
pass 4371773 2019-10-09 15:45:34 2019-10-09 20:44:37 2019-10-09 21:04:36 0:19:59 0:11:04 0:08:55 smithi master
pass 4371774 2019-10-09 15:45:35 2019-10-09 20:44:39 2019-10-09 21:22:38 0:37:59 0:17:01 0:20:58 smithi master
pass 4371775 2019-10-09 15:45:36 2019-10-09 20:46:12 2019-10-09 21:14:11 0:27:59 0:16:58 0:11:01 smithi master
pass 4371776 2019-10-09 15:45:37 2019-10-09 20:47:40 2019-10-09 21:35:40 0:48:00 0:18:00 0:30:00 smithi master
pass 4371777 2019-10-09 15:45:37 2019-10-09 20:47:40 2019-10-09 21:21:39 0:33:59 0:12:46 0:21:13 smithi master
pass 4371778 2019-10-09 15:45:38 2019-10-09 20:49:35 2019-10-09 21:19:34 0:29:59 0:19:52 0:10:07 smithi master
pass 4371779 2019-10-09 15:45:39 2019-10-09 20:49:49 2019-10-09 22:25:50 1:36:01 1:14:11 0:21:50 smithi master
pass 4371780 2019-10-09 15:45:40 2019-10-09 20:50:21 2019-10-09 22:24:22 1:34:01 0:13:37 1:20:24 smithi master
pass 4371781 2019-10-09 15:45:41 2019-10-09 20:51:15 2019-10-09 21:19:15 0:28:00 0:14:00 0:14:00 smithi master
pass 4371782 2019-10-09 15:45:41 2019-10-09 20:52:41 2019-10-09 23:28:48 2:36:07 2:09:13 0:26:54 smithi master