Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version
pass 4678319 2020-01-17 18:51:31 2020-01-17 18:54:09 2020-01-17 19:30:08 0:35:59 0:25:52 0:10:07 smithi master centos 8.0
pass 4678320 2020-01-17 18:51:32 2020-01-17 18:54:09 2020-01-17 19:30:19 0:36:10 0:26:11 0:09:59 smithi master centos 8.0
pass 4678321 2020-01-17 18:51:33 2020-01-17 18:54:09 2020-01-17 19:18:09 0:24:00 0:12:54 0:11:06 smithi master ubuntu 18.04
dead 4678322 2020-01-17 18:51:34 2020-01-17 18:54:09 2020-01-17 23:28:15 4:34:06 smithi master ubuntu 18.04
pass 4678323 2020-01-17 18:51:35 2020-01-17 18:54:14 2020-01-17 19:32:17 0:38:03 0:28:30 0:09:33 smithi master centos 8.0
pass 4678324 2020-01-17 18:51:36 2020-01-17 18:54:49 2020-01-17 19:24:49 0:30:00 0:20:12 0:09:48 smithi master ubuntu 18.04
pass 4678325 2020-01-17 18:51:37 2020-01-17 18:55:15 2020-01-17 19:21:15 0:26:00 0:15:13 0:10:47 smithi master centos 8.0
pass 4678326 2020-01-17 18:51:38 2020-01-17 18:55:15 2020-01-17 19:19:15 0:24:00 0:15:40 0:08:20 smithi master centos 8.0
pass 4678327 2020-01-17 18:51:39 2020-01-17 18:55:32 2020-01-17 19:29:33 0:34:01 0:23:23 0:10:38 smithi master ubuntu 18.04
pass 4678328 2020-01-17 18:51:40 2020-01-17 18:57:20 2020-01-17 19:23:21 0:26:01 0:17:58 0:08:03 smithi master centos 8.0
fail 4678329 2020-01-17 18:51:41 2020-01-17 18:57:20 2020-01-17 19:49:26 0:52:06 0:39:09 0:12:57 smithi master centos 7.6
Failure Reason:

Command failed (osd.11) on smithi065 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid c4b34e20-395d-11ea-99db-001a4aab830c --name osd.11'

dead 4678330 2020-01-17 18:51:42 2020-01-17 18:59:30 2020-01-17 23:29:37 4:30:07 smithi master centos 8.0
pass 4678331 2020-01-17 18:51:43 2020-01-17 18:59:30 2020-01-17 19:27:30 0:28:00 0:18:56 0:09:04 smithi master centos 8.0
pass 4678332 2020-01-17 18:51:44 2020-01-17 18:59:30 2020-01-17 19:21:30 0:22:00 0:11:04 0:10:56 smithi master ubuntu 18.04
pass 4678333 2020-01-17 18:51:45 2020-01-17 19:03:36 2020-01-17 19:37:35 0:33:59 0:26:26 0:07:33 smithi master rhel 8.0
dead 4678334 2020-01-17 18:51:46 2020-01-17 19:07:05 2020-01-17 23:29:11 4:22:06 smithi master centos 8.0
dead 4678335 2020-01-17 18:51:47 2020-01-17 19:07:14 2020-01-17 23:29:21 4:22:07 smithi master ubuntu 18.04
dead 4678336 2020-01-17 18:51:48 2020-01-17 19:07:45 2020-01-17 23:27:50 4:20:05 smithi master ubuntu 18.04
dead 4678337 2020-01-17 18:51:49 2020-01-17 19:09:16 2020-01-17 23:29:21 4:20:05 smithi master centos 8.0
pass 4678338 2020-01-17 18:51:50 2020-01-17 19:09:16 2020-01-17 19:27:15 0:17:59 0:09:00 0:08:59 smithi master ubuntu 18.04
pass 4678339 2020-01-17 18:51:51 2020-01-17 19:09:22 2020-01-17 19:35:24 0:26:02 0:15:29 0:10:33 smithi master ubuntu 18.04
dead 4678340 2020-01-17 18:51:52 2020-01-17 19:09:33 2020-01-17 23:29:38 4:20:05 smithi master ubuntu 18.04
fail 4678341 2020-01-17 18:51:53 2020-01-17 19:11:07 2020-01-17 19:55:15 0:44:08 0:34:13 0:09:55 smithi master centos 8.0
Failure Reason:

Command failed (osd.1) on smithi078 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 12f26f88-3960-11ea-99db-001a4aab830c --name osd.1'

fail 4678342 2020-01-17 18:51:55 2020-01-17 19:13:12 2020-01-17 20:07:15 0:54:03 0:43:29 0:10:34 smithi master centos 8.0
Failure Reason:

Test failure: test_delete_s3 (tasks.mgr.dashboard.test_rgw.RgwUserKeyTest)

pass 4678343 2020-01-17 18:51:56 2020-01-17 19:13:12 2020-01-17 19:31:15 0:18:03 0:12:05 0:05:58 smithi master rhel 8.0
pass 4678344 2020-01-17 18:51:57 2020-01-17 19:15:38 2020-01-17 19:39:37 0:23:59 0:15:47 0:08:12 smithi master centos 8.0
pass 4678345 2020-01-17 18:51:58 2020-01-17 19:17:10 2020-01-17 20:01:15 0:44:05 0:36:00 0:08:05 smithi master centos 8.0
pass 4678346 2020-01-17 18:51:59 2020-01-17 19:17:16 2020-01-17 19:45:15 0:27:59 0:19:24 0:08:35 smithi master centos 8.0
pass 4678347 2020-01-17 18:52:00 2020-01-17 19:17:36 2020-01-17 19:41:36 0:24:00 0:13:22 0:10:38 smithi master ubuntu 18.04
pass 4678348 2020-01-17 18:52:01 2020-01-17 19:18:27 2020-01-17 19:38:27 0:20:00 0:13:23 0:06:37 smithi master rhel 8.0
fail 4678349 2020-01-17 18:52:02 2020-01-17 19:19:10 2020-01-17 20:35:17 1:16:07 1:02:41 0:13:26 smithi master ubuntu 18.04
Failure Reason:

timeout expired in wait_until_healthy

pass 4678350 2020-01-17 18:52:02 2020-01-17 19:19:16 2020-01-17 19:45:16 0:26:00 0:16:39 0:09:21 smithi master centos 8.0
pass 4678351 2020-01-17 18:52:03 2020-01-17 19:21:38 2020-01-17 19:41:38 0:20:00 0:14:26 0:05:34 smithi master rhel 8.0
dead 4678352 2020-01-17 18:52:04 2020-01-17 19:21:39 2020-01-17 23:29:43 4:08:04 3:58:31 0:09:33 smithi master ubuntu 18.04
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=21708)

pass 4678353 2020-01-17 18:52:05 2020-01-17 19:21:39 2020-01-17 19:41:38 0:19:59 0:10:03 0:09:56 smithi master ubuntu 18.04
fail 4678354 2020-01-17 18:52:06 2020-01-17 19:21:38 2020-01-17 19:41:38 0:20:00 0:12:55 0:07:05 smithi master rhel 8.0
Failure Reason:

Found coredumps on ubuntu@smithi007.front.sepia.ceph.com

fail 4678355 2020-01-17 18:52:07 2020-01-17 19:21:39 2020-01-17 19:57:38 0:35:59 0:23:04 0:12:55 smithi master centos 7.6
Failure Reason:

Command failed (osd.10) on smithi045 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 4997befc-3961-11ea-99db-001a4aab830c --name osd.10'

pass 4678356 2020-01-17 18:52:08 2020-01-17 19:23:03 2020-01-17 19:41:03 0:18:00 0:07:38 0:10:22 smithi master ubuntu 18.04
pass 4678357 2020-01-17 18:52:09 2020-01-17 19:23:03 2020-01-17 19:43:03 0:20:00 0:09:33 0:10:27 smithi master ubuntu 18.04
pass 4678358 2020-01-17 18:52:10 2020-01-17 19:23:04 2020-01-17 19:49:03 0:25:59 0:16:16 0:09:43 smithi master ubuntu 18.04
dead 4678359 2020-01-17 18:52:11 2020-01-17 19:23:04 2020-01-17 23:29:11 4:06:07 smithi master rhel 8.0
dead 4678360 2020-01-17 18:52:12 2020-01-17 19:23:04 2020-01-17 23:29:11 4:06:07 smithi master ubuntu 18.04
pass 4678361 2020-01-17 18:52:13 2020-01-17 19:23:04 2020-01-17 20:07:04 0:44:00 0:34:46 0:09:14 smithi master centos 8.0
pass 4678362 2020-01-17 18:52:14 2020-01-17 19:23:25 2020-01-17 19:51:26 0:28:01 0:19:03 0:08:58 smithi master centos 8.0
pass 4678363 2020-01-17 18:52:15 2020-01-17 19:24:55 2020-01-17 19:48:57 0:24:02 0:15:20 0:08:42 smithi master ubuntu 18.04
dead 4678364 2020-01-17 18:52:16 2020-01-17 19:24:55 2020-01-17 23:29:04 4:04:09 smithi master centos 8.0
pass 4678365 2020-01-17 18:52:17 2020-01-17 19:24:55 2020-01-17 19:48:57 0:24:02 0:18:14 0:05:48 smithi master rhel 8.0
pass 4678366 2020-01-17 18:52:18 2020-01-17 19:24:56 2020-01-17 20:50:59 1:26:03 1:18:32 0:07:31 smithi master rhel 8.0
pass 4678367 2020-01-17 18:52:19 2020-01-17 19:25:34 2020-01-17 19:51:34 0:26:00 0:17:16 0:08:44 smithi master centos 8.0
pass 4678368 2020-01-17 18:52:20 2020-01-17 19:26:55 2020-01-17 20:04:55 0:38:00 0:29:04 0:08:56 smithi master ubuntu 18.04
dead 4678369 2020-01-17 18:52:21 2020-01-17 19:26:55 2020-01-17 23:28:59 4:02:04 smithi master centos 8.0
dead 4678370 2020-01-17 18:52:22 2020-01-17 19:26:55 2020-01-17 23:29:00 4:02:05 smithi master centos 8.0
pass 4678371 2020-01-17 18:52:23 2020-01-17 19:27:16 2020-01-17 19:45:16 0:18:00 0:11:42 0:06:18 smithi master rhel 8.0
pass 4678372 2020-01-17 18:52:24 2020-01-17 19:27:31 2020-01-17 19:47:31 0:20:00 0:13:55 0:06:05 smithi master rhel 8.0
fail 4678373 2020-01-17 18:52:25 2020-01-17 19:28:55 2020-01-17 20:12:54 0:43:59 0:32:51 0:11:08 smithi master centos 8.0
Failure Reason:

"2020-01-17T20:08:52.281625+0000 mon.a (mon.0) 164 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log

dead 4678374 2020-01-17 18:52:26 2020-01-17 19:28:55 2020-01-17 23:28:59 4:00:04 smithi master rhel 8.0
fail 4678375 2020-01-17 18:52:27 2020-01-17 19:29:01 2020-01-17 20:15:00 0:45:59 0:34:58 0:11:01 smithi master centos 7.6
Failure Reason:

Command failed (osd.11) on smithi057 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 11711040-3962-11ea-99db-001a4aab830c --name osd.11'

pass 4678376 2020-01-17 18:52:28 2020-01-17 19:29:35 2020-01-17 19:51:35 0:22:00 0:15:05 0:06:55 smithi master rhel 8.0
pass 4678377 2020-01-17 18:52:29 2020-01-17 19:30:25 2020-01-17 19:56:25 0:26:00 0:16:53 0:09:07 smithi master ubuntu 18.04
fail 4678378 2020-01-17 18:52:29 2020-01-17 19:30:25 2020-01-17 22:52:30 3:22:05 3:16:20 0:05:45 smithi master rhel 8.0
Failure Reason:

Command failed (workunit test erasure-code/test-erasure-eio.sh) on smithi115 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0e8399909724f6cef6368a000f4775e02ff7c54a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh'

pass 4678379 2020-01-17 18:52:30 2020-01-17 19:30:47 2020-01-17 19:58:47 0:28:00 0:22:45 0:05:15 smithi master rhel 8.0
pass 4678380 2020-01-17 18:52:31 2020-01-17 19:31:16 2020-01-17 20:31:17 1:00:01 0:51:39 0:08:22 smithi master centos 8.0
pass 4678381 2020-01-17 18:52:32 2020-01-17 19:31:16 2020-01-17 19:49:15 0:17:59 0:08:24 0:09:35 smithi master ubuntu 18.04
dead 4678382 2020-01-17 18:52:33 2020-01-17 19:31:16 2020-01-17 23:29:21 3:58:05 smithi master rhel 8.0
pass 4678383 2020-01-17 18:52:34 2020-01-17 19:32:34 2020-01-17 20:02:34 0:30:00 0:23:18 0:06:42 smithi master rhel 8.0
dead 4678384 2020-01-17 18:52:36 2020-01-17 19:35:42 2020-01-17 23:27:50 3:52:08 smithi master centos 8.0
fail 4678385 2020-01-17 18:52:37 2020-01-17 19:37:53 2020-01-17 20:03:53 0:26:00 0:15:54 0:10:06 smithi master ubuntu 18.04
Failure Reason:

Command failed (s3 tests against rgw) on smithi121 with status 1: "S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!fails_with_subdomain'"

pass 4678386 2020-01-17 18:52:38 2020-01-17 19:38:28 2020-01-17 20:04:28 0:26:00 0:15:45 0:10:15 smithi master centos 8.0
pass 4678387 2020-01-17 18:52:39 2020-01-17 19:39:55 2020-01-17 19:55:54 0:15:59 0:10:18 0:05:41 smithi master rhel 8.0
pass 4678388 2020-01-17 18:52:40 2020-01-17 19:40:48 2020-01-17 19:58:47 0:17:59 0:08:59 0:09:00 smithi master ubuntu 18.04
pass 4678389 2020-01-17 18:52:41 2020-01-17 19:41:20 2020-01-17 20:03:19 0:21:59 0:14:06 0:07:53 smithi master centos 8.0
pass 4678390 2020-01-17 18:52:42 2020-01-17 19:41:37 2020-01-17 20:35:37 0:54:00 0:45:28 0:08:32 smithi master centos 8.0
fail 4678391 2020-01-17 18:52:42 2020-01-17 19:41:39 2020-01-17 20:21:39 0:40:00 0:28:48 0:11:12 smithi master centos 7.6
Failure Reason:

Command failed (osd.1) on smithi053 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 0254dcc0-3964-11ea-99db-001a4aab830c --name osd.1'

dead 4678392 2020-01-17 18:52:43 2020-01-17 19:41:39 2020-01-17 23:29:43 3:48:04 smithi master rhel 8.0
pass 4678393 2020-01-17 18:52:44 2020-01-17 19:41:39 2020-01-17 20:05:39 0:24:00 0:13:48 0:10:12 smithi master centos 8.0
pass 4678394 2020-01-17 18:52:45 2020-01-17 19:43:19 2020-01-17 20:05:18 0:21:59 0:13:47 0:08:12 smithi master centos 8.0
pass 4678395 2020-01-17 18:52:46 2020-01-17 19:43:19 2020-01-17 20:05:19 0:22:00 0:13:34 0:08:26 smithi master centos 8.0
pass 4678396 2020-01-17 18:52:47 2020-01-17 19:45:31 2020-01-17 20:03:31 0:18:00 0:08:58 0:09:02 smithi master ubuntu 18.04
dead 4678397 2020-01-17 18:52:48 2020-01-17 19:45:32 2020-01-17 23:29:37 3:44:05 3:35:02 0:09:03 smithi master centos 8.0
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=20191)

fail 4678398 2020-01-17 18:52:49 2020-01-17 19:45:32 2020-01-17 20:15:31 0:29:59 0:22:14 0:07:45 smithi master rhel 8.0
Failure Reason:

Command failed (osd.0) on smithi079 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid c8dc73b8-3963-11ea-99db-001a4aab830c --name osd.0'

pass 4678399 2020-01-17 18:52:50 2020-01-17 19:45:32 2020-01-17 20:25:33 0:40:01 0:29:39 0:10:22 smithi master ubuntu 18.04
pass 4678400 2020-01-17 18:52:51 2020-01-17 19:47:48 2020-01-17 20:11:48 0:24:00 0:14:00 0:10:00 smithi master centos 8.0
pass 4678401 2020-01-17 18:52:52 2020-01-17 19:49:13 2020-01-17 20:21:14 0:32:01 0:24:53 0:07:08 smithi master rhel 8.0
pass 4678402 2020-01-17 18:52:53 2020-01-17 19:49:13 2020-01-17 20:17:13 0:28:00 0:16:20 0:11:40 smithi master centos 8.0
dead 4678403 2020-01-17 18:52:55 2020-01-17 19:49:13 2020-01-17 23:29:19 3:40:06 smithi master centos 8.0
pass 4678404 2020-01-17 18:52:56 2020-01-17 19:49:16 2020-01-17 20:09:16 0:20:00 0:13:53 0:06:07 smithi master rhel 8.0
dead 4678405 2020-01-17 18:52:57 2020-01-17 19:49:28 2020-01-17 23:29:34 3:40:06 smithi master rhel 8.0
dead 4678406 2020-01-17 18:52:58 2020-01-17 19:51:44 2020-01-17 23:27:50 3:36:06 smithi master centos 8.0
pass 4678407 2020-01-17 18:52:59 2020-01-17 19:51:45 2020-01-17 20:09:44 0:17:59 0:12:00 0:05:59 smithi master rhel 8.0
pass 4678408 2020-01-17 18:53:00 2020-01-17 19:51:45 2020-01-17 20:09:44 0:17:59 0:08:24 0:09:35 smithi master ubuntu 18.04
pass 4678409 2020-01-17 18:53:00 2020-01-17 19:55:31 2020-01-17 20:25:33 0:30:02 0:19:58 0:10:04 smithi master centos 8.0
pass 4678410 2020-01-17 18:53:01 2020-01-17 19:55:55 2020-01-17 20:15:55 0:20:00 0:11:19 0:08:41 smithi master ubuntu 18.04
dead 4678411 2020-01-17 18:53:02 2020-01-17 19:56:26 2020-01-17 23:28:31 3:32:05 smithi master ubuntu 18.04
pass 4678412 2020-01-17 18:53:03 2020-01-17 19:57:36 2020-01-17 20:21:36 0:24:00 0:15:16 0:08:44 smithi master centos 8.0
pass 4678413 2020-01-17 18:53:04 2020-01-17 19:57:40 2020-01-17 20:19:39 0:21:59 0:13:45 0:08:14 smithi master centos 8.0
fail 4678414 2020-01-17 18:53:05 2020-01-17 19:59:06 2020-01-17 20:29:05 0:29:59 0:19:14 0:10:45 smithi master centos 7.6
Failure Reason:

Command failed (osd.10) on smithi018 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 356a8360-3966-11ea-99db-001a4aab830c --name osd.10'

pass 4678415 2020-01-17 18:53:06 2020-01-17 19:59:06 2020-01-17 20:17:05 0:17:59 0:09:04 0:08:55 smithi master ubuntu 18.04
pass 4678416 2020-01-17 18:53:07 2020-01-17 20:01:32 2020-01-17 20:19:33 0:18:01 0:12:12 0:05:49 smithi master rhel 8.0
pass 4678417 2020-01-17 18:53:08 2020-01-17 20:02:50 2020-01-17 20:36:50 0:34:00 0:25:16 0:08:44 smithi master centos 8.0
pass 4678418 2020-01-17 18:53:09 2020-01-17 20:03:21 2020-01-17 20:23:20 0:19:59 0:13:15 0:06:44 smithi master rhel 8.0
pass 4678419 2020-01-17 18:53:10 2020-01-17 20:03:32 2020-01-17 20:41:34 0:38:02 0:28:20 0:09:42 smithi master centos 8.0
pass 4678420 2020-01-17 18:53:11 2020-01-17 20:03:33 2020-01-17 21:05:34 1:02:01 0:52:15 0:09:46 smithi master centos 8.0
pass 4678421 2020-01-17 18:53:12 2020-01-17 20:04:09 2020-01-17 22:34:14 2:30:05 2:21:40 0:08:25 smithi master centos 8.0
pass 4678422 2020-01-17 18:53:13 2020-01-17 20:04:29 2020-01-17 20:28:28 0:23:59 0:15:52 0:08:07 smithi master centos 8.0
pass 4678423 2020-01-17 18:53:14 2020-01-17 20:04:56 2020-01-17 20:46:56 0:42:00 0:33:03 0:08:57 smithi master centos 8.0
pass 4678424 2020-01-17 18:53:15 2020-01-17 20:05:34 2020-01-17 20:23:33 0:17:59 0:07:59 0:10:00 smithi master ubuntu 18.04
pass 4678425 2020-01-17 18:53:16 2020-01-17 20:05:34 2020-01-17 20:23:34 0:18:00 0:08:57 0:09:03 smithi master ubuntu 18.04
dead 4678426 2020-01-17 18:53:17 2020-01-17 20:05:40 2020-01-17 23:29:43 3:24:03 smithi master rhel 8.0
pass 4678427 2020-01-17 18:53:18 2020-01-17 20:07:06 2020-01-17 20:41:05 0:33:59 0:29:04 0:04:55 smithi master rhel 8.0
fail 4678428 2020-01-17 18:53:19 2020-01-17 20:07:16 2020-01-17 20:57:18 0:50:02 0:37:28 0:12:34 smithi master centos 7.6
Failure Reason:

Command failed (osd.1) on smithi090 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 8c60dfd8-3967-11ea-99db-001a4aab830c --name osd.1'

pass 4678429 2020-01-17 18:53:20 2020-01-17 20:09:32 2020-01-17 20:27:33 0:18:01 0:12:11 0:05:50 smithi master rhel 8.0
pass 4678430 2020-01-17 18:53:21 2020-01-17 20:09:45 2020-01-17 20:39:46 0:30:01 0:22:53 0:07:08 smithi master rhel 8.0
pass 4678431 2020-01-17 18:53:22 2020-01-17 20:09:45 2020-01-17 20:39:46 0:30:01 0:17:14 0:12:47 smithi master centos 8.0
pass 4678432 2020-01-17 18:53:23 2020-01-17 20:12:49 2020-01-17 20:44:49 0:32:00 0:25:05 0:06:55 smithi master rhel 8.0
dead 4678433 2020-01-17 18:53:24 2020-01-17 20:12:56 2020-01-17 23:28:59 3:16:03 smithi master rhel 8.0
pass 4678434 2020-01-17 18:53:25 2020-01-17 20:15:17 2020-01-17 20:43:18 0:28:01 0:16:26 0:11:35 smithi master centos 8.0
pass 4678435 2020-01-17 18:53:26 2020-01-17 20:15:32 2020-01-17 20:59:34 0:44:02 0:35:14 0:08:48 smithi master centos 8.0
dead 4678436 2020-01-17 18:53:27 2020-01-17 20:15:56 2020-01-17 23:27:59 3:12:03 smithi master rhel 8.0
pass 4678437 2020-01-17 18:53:28 2020-01-17 20:17:03 2020-01-17 20:33:02 0:15:59 0:07:14 0:08:45 smithi master ubuntu 18.04
pass 4678438 2020-01-17 18:53:29 2020-01-17 20:17:06 2020-01-17 20:35:06 0:18:00 0:09:09 0:08:51 smithi master ubuntu 18.04
pass 4678439 2020-01-17 18:53:30 2020-01-17 20:17:14 2020-01-17 20:45:14 0:28:00 0:17:29 0:10:31 smithi master centos 8.0
pass 4678440 2020-01-17 18:53:31 2020-01-17 20:18:27 2020-01-17 20:38:27 0:20:00 0:13:00 0:07:00 smithi master rhel 8.0
pass 4678441 2020-01-17 18:53:32 2020-01-17 20:19:54 2020-01-17 20:59:53 0:39:59 0:32:17 0:07:42 smithi master centos 8.0
dead 4678442 2020-01-17 18:53:33 2020-01-17 20:19:54 2020-01-17 23:29:57 3:10:03 smithi master centos 8.0
fail 4678443 2020-01-17 18:53:34 2020-01-17 20:21:30 2020-01-17 20:41:30 0:20:00 0:11:28 0:08:32 smithi master ubuntu 18.04
Failure Reason:

Command failed (workunit test misc/ok-to-stop.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0e8399909724f6cef6368a000f4775e02ff7c54a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh'

pass 4678444 2020-01-17 18:53:35 2020-01-17 20:21:37 2020-01-17 23:11:40 2:50:03 2:40:53 0:09:10 smithi master centos 8.0
pass 4678445 2020-01-17 18:53:36 2020-01-17 20:21:40 2020-01-17 20:53:40 0:32:00 0:22:56 0:09:04 smithi master ubuntu 18.04
pass 4678446 2020-01-17 18:53:37 2020-01-17 20:23:36 2020-01-17 20:45:36 0:22:00 0:11:33 0:10:27 smithi master ubuntu 18.04
dead 4678447 2020-01-17 18:53:38 2020-01-17 20:23:36 2020-01-17 23:29:39 3:06:03 smithi master centos 8.0
fail 4678448 2020-01-17 18:53:39 2020-01-17 20:23:36 2020-01-17 20:57:36 0:34:00 0:22:39 0:11:21 smithi master centos 7.6
Failure Reason:

Command failed (osd.11) on smithi134 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid eb2cb756-3969-11ea-99db-001a4aab830c --name osd.11'

pass 4678449 2020-01-17 18:53:40 2020-01-17 20:23:38 2020-01-17 20:41:38 0:18:00 0:12:00 0:06:00 smithi master rhel 8.0
fail 4678450 2020-01-17 18:53:41 2020-01-17 20:25:52 2020-01-17 20:43:52 0:18:00 0:07:12 0:10:48 smithi master ubuntu 18.04
Failure Reason:

"2020-01-17T20:40:26.845083+0000 mon.a (mon.0) 30 : cluster [WRN] Health check failed: 2/6 mons down, quorum a,b,c,d (MON_DOWN)" in cluster log

pass 4678451 2020-01-17 18:53:42 2020-01-17 20:25:52 2020-01-17 20:41:52 0:16:00 0:07:16 0:08:44 smithi master ubuntu 18.04
pass 4678452 2020-01-17 18:53:43 2020-01-17 20:28:30 2020-01-17 20:52:30 0:24:00 0:17:20 0:06:40 smithi master rhel 8.0
pass 4678453 2020-01-17 18:53:44 2020-01-17 20:29:22 2020-01-17 21:01:21 0:31:59 0:22:05 0:09:54 smithi master ubuntu 18.04
pass 4678454 2020-01-17 18:53:45 2020-01-17 20:41:35 2020-01-17 21:01:35 0:20:00 0:11:00 0:09:00 smithi master ubuntu 18.04
dead 4678455 2020-01-17 18:53:46 2020-01-17 20:41:36 2020-01-17 23:29:38 2:48:02 smithi master centos 8.0
fail 4678456 2020-01-17 18:53:47 2020-01-17 20:41:39 2020-01-17 21:25:39 0:44:00 0:34:19 0:09:41 smithi master centos 8.0
Failure Reason:

Command failed (osd.1) on smithi103 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid a8ffc10e-396c-11ea-99db-001a4aab830c --name osd.1'

pass 4678457 2020-01-17 18:53:48 2020-01-17 20:41:53 2020-01-17 21:37:54 0:56:01 0:44:51 0:11:10 smithi master ubuntu 18.04
pass 4678458 2020-01-17 18:53:49 2020-01-17 20:43:54 2020-01-17 21:23:53 0:39:59 0:29:42 0:10:17 smithi master ubuntu 18.04
pass 4678459 2020-01-17 18:53:50 2020-01-17 20:43:56 2020-01-17 21:17:56 0:34:00 0:25:03 0:08:57 smithi master centos 8.0
pass 4678460 2020-01-17 18:53:51 2020-01-17 20:45:06 2020-01-17 22:33:10 1:48:04 1:36:02 0:12:02 smithi master ubuntu 18.04
dead 4678461 2020-01-17 18:53:52 2020-01-17 20:45:16 2020-01-17 23:29:19 2:44:03 smithi master ubuntu 18.04
pass 4678462 2020-01-17 18:53:53 2020-01-17 20:45:37 2020-01-17 21:09:36 0:23:59 0:15:06 0:08:53 smithi master ubuntu 18.04
pass 4678463 2020-01-17 18:53:54 2020-01-17 20:47:21 2020-01-17 21:07:21 0:20:00 0:10:13 0:09:47 smithi master ubuntu 18.04
pass 4678464 2020-01-17 18:53:55 2020-01-17 20:47:30 2020-01-17 21:27:30 0:40:00 0:30:35 0:09:25 smithi master centos 8.0
dead 4678465 2020-01-17 18:53:56 2020-01-17 20:51:16 2020-01-17 23:29:19 2:38:03 smithi master centos 8.0
pass 4678466 2020-01-17 18:53:57 2020-01-17 20:52:48 2020-01-17 21:16:47 0:23:59 0:15:43 0:08:16 smithi master centos 8.0
dead 4678467 2020-01-17 18:53:58 2020-01-17 20:52:48 2020-01-17 23:28:51 2:36:03 smithi master ubuntu 18.04
dead 4678468 2020-01-17 18:53:59 2020-01-17 20:53:41 2020-01-17 23:29:43 2:36:02 smithi master rhel 8.0
dead 4678469 2020-01-17 18:54:00 2020-01-17 20:57:34 2020-01-17 23:29:37 2:32:03 smithi master centos 8.0
pass 4678470 2020-01-17 18:54:01 2020-01-17 20:57:37 2020-01-17 21:19:37 0:22:00 0:12:00 0:10:00 smithi master ubuntu 18.04
pass 4678471 2020-01-17 18:54:02 2020-01-17 20:59:50 2020-01-17 21:19:50 0:20:00 0:11:05 0:08:55 smithi master ubuntu 18.04
fail 4678472 2020-01-17 18:54:03 2020-01-17 20:59:55 2020-01-17 21:43:55 0:44:00 0:32:10 0:11:50 smithi master centos 7.6
Failure Reason:

Command failed (osd.11) on smithi090 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid e4038a54-396e-11ea-99db-001a4aab830c --name osd.11'

pass 4678473 2020-01-17 18:54:04 2020-01-17 21:01:12 2020-01-17 21:17:11 0:15:59 0:07:16 0:08:43 smithi master ubuntu 18.04
pass 4678474 2020-01-17 18:54:05 2020-01-17 21:01:22 2020-01-17 21:25:22 0:24:00 0:17:28 0:06:32 smithi master rhel 8.0
pass 4678475 2020-01-17 18:54:06 2020-01-17 21:01:36 2020-01-17 21:19:35 0:17:59 0:12:24 0:05:35 smithi master rhel 8.0
pass 4678476 2020-01-17 18:54:07 2020-01-17 21:03:55 2020-01-17 21:23:54 0:19:59 0:11:13 0:08:46 smithi master ubuntu 18.04
pass 4678477 2020-01-17 18:54:08 2020-01-17 21:05:40 2020-01-17 21:33:39 0:27:59 0:17:12 0:10:47 smithi master ubuntu 18.04
dead 4678478 2020-01-17 18:54:09 2020-01-17 21:05:40 2020-01-17 23:29:42 2:24:02 smithi master centos 8.0
pass 4678479 2020-01-17 18:54:10 2020-01-17 21:05:44 2020-01-17 21:23:43 0:17:59 0:09:13 0:08:46 smithi master ubuntu 18.04
fail 4678480 2020-01-17 18:54:11 2020-01-17 21:05:44 2020-01-17 21:11:43 0:05:59 smithi master centos 8.0
Failure Reason:

Command failed on smithi200 with status 1: 'sudo yum install -y kernel'

pass 4678481 2020-01-17 18:54:12 2020-01-17 21:07:14 2020-01-17 21:27:13 0:19:59 0:13:42 0:06:17 smithi master rhel 8.0
dead 4678482 2020-01-17 18:54:13 2020-01-17 21:07:22 2020-01-17 23:29:24 2:22:02 smithi master rhel 8.0
pass 4678483 2020-01-17 18:54:14 2020-01-17 21:09:38 2020-01-17 21:33:37 0:23:59 0:13:55 0:10:04 smithi master centos 8.0
fail 4678484 2020-01-17 18:54:15 2020-01-17 21:09:46 2020-01-17 22:29:49 1:20:03 1:13:57 0:06:06 smithi master rhel 8.0
Failure Reason:

Command failed on smithi180 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

pass 4678485 2020-01-17 18:54:15 2020-01-17 21:12:01 2020-01-17 21:42:00 0:29:59 0:20:23 0:09:36 smithi master centos 8.0
pass 4678486 2020-01-17 18:54:16 2020-01-17 21:12:01 2020-01-17 21:32:00 0:19:59 0:10:19 0:09:40 smithi master ubuntu 18.04
pass 4678487 2020-01-17 18:54:17 2020-01-17 21:12:05 2020-01-17 21:48:05 0:36:00 0:26:18 0:09:42 smithi master centos 8.0
fail 4678488 2020-01-17 18:54:19 2020-01-17 21:12:57 2020-01-17 21:48:56 0:35:59 0:25:00 0:10:59 smithi master centos 7.6
Failure Reason:

Command failed (osd.11) on smithi109 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 7a96a6b2-3970-11ea-99db-001a4aab830c --name osd.11'

pass 4678489 2020-01-17 18:54:20 2020-01-17 21:12:57 2020-01-17 21:30:56 0:17:59 0:08:07 0:09:52 smithi master ubuntu 18.04
pass 4678490 2020-01-17 18:54:21 2020-01-17 21:21:32 2020-01-17 21:43:31 0:21:59 0:14:52 0:07:07 smithi master rhel 8.0
pass 4678491 2020-01-17 18:54:22 2020-01-17 21:21:37 2020-01-17 21:53:36 0:31:59 0:20:03 0:11:56 smithi master centos 8.0
pass 4678492 2020-01-17 18:54:23 2020-01-17 21:21:38 2020-01-17 21:41:37 0:19:59 0:12:24 0:07:35 smithi master rhel 8.0
fail 4678493 2020-01-17 18:54:23 2020-01-17 21:21:38 2020-01-17 22:21:38 1:00:00 0:44:58 0:15:02 smithi master ubuntu 18.04
Failure Reason:

"2020-01-17T21:53:29.551985+0000 mon.a (mon.0) 1957 : cluster [WRN] Health check failed: Telemetry requires re-opt-in (TELEMETRY_CHANGED)" in cluster log

pass 4678494 2020-01-17 18:54:24 2020-01-17 21:21:51 2020-01-17 21:47:51 0:26:00 0:13:47 0:12:13 smithi master centos 8.0
pass 4678495 2020-01-17 18:54:26 2020-01-17 21:22:27 2020-01-17 22:00:26 0:37:59 0:26:13 0:11:46 smithi master ubuntu 18.04
dead 4678496 2020-01-17 18:54:27 2020-01-17 21:22:57 2020-01-17 23:28:59 2:06:02 smithi master rhel 8.0
dead 4678497 2020-01-17 18:54:28 2020-01-17 21:23:06 2020-01-17 23:31:08 2:08:02 1:55:38 0:12:24 smithi master centos 8.0
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=23320)

fail 4678498 2020-01-17 18:54:29 2020-01-17 21:23:59 2020-01-17 22:29:59 1:06:00 0:49:56 0:16:04 smithi master rhel 8.0
Failure Reason:

Command failed on smithi200 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'

pass 4678499 2020-01-17 18:54:30 2020-01-17 21:23:59 2020-01-17 21:57:59 0:34:00 0:16:46 0:17:14 smithi master centos 8.0
pass 4678500 2020-01-17 18:54:32 2020-01-17 21:23:59 2020-01-17 21:45:59 0:22:00 0:09:56 0:12:04 smithi master ubuntu 18.04
pass 4678501 2020-01-17 18:54:33 2020-01-17 21:24:40 2020-01-17 21:54:40 0:30:00 0:19:43 0:10:17 smithi master ubuntu 18.04
pass 4678502 2020-01-17 18:54:34 2020-01-17 21:25:38 2020-01-17 21:59:38 0:34:00 0:26:20 0:07:40 smithi master rhel 8.0
fail 4678503 2020-01-17 18:54:35 2020-01-17 21:25:40 2020-01-17 22:09:40 0:44:00 0:24:09 0:19:51 smithi master ubuntu 18.04
Failure Reason:

"2020-01-17T22:02:16.619472+0000 mds.a (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi039:z (7389), after 301.033 seconds" in cluster log

pass 4678504 2020-01-17 18:54:36 2020-01-17 21:27:29 2020-01-17 21:59:29 0:32:00 0:20:38 0:11:22 smithi master centos 8.0
pass 4678505 2020-01-17 18:54:37 2020-01-17 21:27:31 2020-01-17 22:11:32 0:44:01 0:26:43 0:17:18 smithi master centos 8.0
dead 4678506 2020-01-17 18:54:38 2020-01-17 21:31:12 2020-01-17 23:29:14 1:58:02 1:49:03 0:08:59 smithi master centos 8.0
Failure Reason:

psutil.NoSuchProcess process no longer exists (pid=694)

dead 4678507 2020-01-17 18:54:39 2020-01-17 21:32:01 2020-01-17 23:28:02 1:56:01 smithi master centos 8.0
pass 4678508 2020-01-17 18:54:40 2020-01-17 21:33:53 2020-01-17 22:27:53 0:54:00 0:36:17 0:17:43 smithi master centos 8.0
fail 4678509 2020-01-17 18:54:41 2020-01-17 21:33:53 2020-01-17 22:17:53 0:44:00 0:23:42 0:20:18 smithi master centos 7.6
Failure Reason:

Command failed (osd.1) on smithi104 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid cbce5e0e-3974-11ea-99db-001a4aab830c --name osd.1'

dead 4678510 2020-01-17 18:54:42 2020-01-17 21:35:43 2020-01-17 23:27:44 1:52:01 smithi master ubuntu 18.04
pass 4678511 2020-01-17 18:54:43 2020-01-17 21:37:55 2020-01-17 22:11:55 0:34:00 0:20:16 0:13:44 smithi master ubuntu 18.04
pass 4678512 2020-01-17 18:54:44 2020-01-17 21:41:53 2020-01-17 22:05:53 0:24:00 0:15:45 0:08:15 smithi master centos 8.0
dead 4678513 2020-01-17 18:54:45 2020-01-17 21:42:01 2020-01-17 23:28:02 1:46:01 smithi master ubuntu 18.04
fail 4678514 2020-01-17 18:54:46 2020-01-17 21:43:47 2020-01-17 22:19:49 0:36:02 0:21:50 0:14:12 smithi master ubuntu 18.04
Failure Reason:

Command failed (osd.1) on smithi181 with status 1: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid e066417e-3974-11ea-99db-001a4aab830c --name osd.1'

pass 4678515 2020-01-17 18:54:47 2020-01-17 21:45:44 2020-01-17 22:31:45 0:46:01 0:35:33 0:10:28 smithi master centos 8.0
pass 4678516 2020-01-17 18:54:49 2020-01-17 21:46:00 2020-01-17 22:19:59 0:33:59 0:23:54 0:10:05 smithi master ubuntu 18.04
pass 4678517 2020-01-17 18:54:50 2020-01-17 22:19:51 2020-01-17 22:35:50 0:15:59 0:09:47 0:06:12 smithi master rhel 8.0
pass 4678518 2020-01-17 18:54:51 2020-01-17 22:19:55 2020-01-17 22:45:54 0:25:59 0:14:34 0:11:25 smithi master centos 8.0
pass 4678519 2020-01-17 18:54:51 2020-01-17 22:20:01 2020-01-17 22:46:00 0:25:59 0:20:33 0:05:26 smithi master rhel 8.0
pass 4678520 2020-01-17 18:54:52 2020-01-17 22:20:09 2020-01-17 22:40:08 0:19:59 0:08:05 0:11:54 smithi master ubuntu 18.04
pass 4678521 2020-01-17 18:54:53 2020-01-17 22:20:11 2020-01-17 22:54:11 0:34:00 0:25:47 0:08:13 smithi master rhel 8.0
pass 4678522 2020-01-17 18:54:54 2020-01-17 22:20:11 2020-01-17 22:42:11 0:22:00 0:08:58 0:13:02 smithi master ubuntu 18.04
pass 4678523 2020-01-17 18:54:56 2020-01-17 22:21:53 2020-01-17 22:55:53 0:34:00 0:24:29 0:09:31 smithi master centos 8.0
pass 4678524 2020-01-17 18:54:57 2020-01-17 22:21:53 2020-01-17 22:45:53 0:24:00 0:10:50 0:13:10 smithi master ubuntu 18.04
pass 4678525 2020-01-17 18:54:58 2020-01-17 22:23:28 2020-01-17 22:59:28 0:36:00 0:22:54 0:13:06 smithi master rhel 8.0
fail 4678526 2020-01-17 18:54:59 2020-01-17 22:23:40 2020-01-17 23:15:40 0:52:00 0:35:03 0:16:57 smithi master centos 7.6
Failure Reason:

Command failed (osd.11) on smithi025 with status 125: 'sudo /home/ubuntu/cephtest/cephadm logs -f --fsid 556a4726-397b-11ea-99db-001a4aab830c --name osd.11'

pass 4678527 2020-01-17 18:55:00 2020-01-17 22:24:07 2020-01-17 22:50:07 0:26:00 0:10:58 0:15:02 smithi master ubuntu 18.04
pass 4678528 2020-01-17 18:55:01 2020-01-17 22:25:31 2020-01-17 22:57:31 0:32:00 0:19:19 0:12:41 smithi master ubuntu 18.04
dead 4678529 2020-01-17 18:55:02 2020-01-17 22:28:08 2020-01-17 23:28:09 1:00:01 smithi master centos 8.0
dead 4678530 2020-01-17 18:55:03 2020-01-17 22:29:29 2020-01-17 23:29:29 1:00:00 smithi master ubuntu 18.04
pass 4678531 2020-01-17 18:55:04 2020-01-17 22:29:50 2020-01-17 23:01:50 0:32:00 0:16:32 0:15:28 smithi master centos 8.0
dead 4678532 2020-01-17 18:55:05 2020-01-17 22:30:00 2020-01-17 23:30:01 1:00:01 smithi master centos 8.0
pass 4678533 2020-01-17 18:55:06 2020-01-17 22:30:43 2020-01-17 22:46:43 0:16:00 0:10:27 0:05:33 smithi master rhel 8.0
dead 4678534 2020-01-17 18:55:07 2020-01-17 22:32:01 2020-01-17 23:28:01 0:56:00 smithi master centos 8.0
pass 4678535 2020-01-17 18:55:08 2020-01-17 22:32:01 2020-01-17 22:56:01 0:24:00 0:15:38 0:08:22 smithi master centos 8.0
dead 4678536 2020-01-17 18:55:09 2020-01-17 22:32:24 2020-01-17 23:28:24 0:56:00 smithi master centos 8.0
dead 4678537 2020-01-17 18:55:10 2020-01-17 22:33:26 2020-01-17 23:29:26 0:56:00 smithi master centos 8.0
pass 4678538 2020-01-17 18:55:11 2020-01-17 22:34:15 2020-01-17 22:56:14 0:21:59 0:10:09 0:11:50 smithi master ubuntu 18.04