| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
|---|---|---|---|---|---|---|---|---|---|---|---|
| pdonnell | 2019-08-22 16:32:25 | 2019-08-22 17:05:49 | 2019-08-23 05:14:34 | 12:08:45 | multimds | wip-pdonnell-testing-20190821.221010 | smithi | 9428423 | 6 | 42 | 1 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| fail | 4241536 |
|
2019-08-22 16:32:35 | 2019-08-22 17:05:49 | 2019-08-22 17:53:49 | 0:48:00 | 0:29:53 | 0:18:07 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T17:44:38.243788+0000 mon.b (mon.0) 724 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241537 |
|
2019-08-22 16:32:36 | 2019-08-22 17:05:49 | 2019-08-22 17:41:48 | 0:35:59 | 0:26:59 | 0:09:00 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2019-08-22T17:27:57.343495+0000 mon.b (mon.0) 660 : cluster [WRN] Health check failed: 4 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241538 |
|
2019-08-22 16:32:37 | 2019-08-22 17:05:49 | 2019-08-22 17:51:50 | 0:46:01 | 0:31:10 | 0:14:51 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T17:41:08.280827+0000 mon.a (mon.0) 820 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241539 |
|
2019-08-22 16:32:38 | 2019-08-22 17:05:54 | 2019-08-22 20:05:56 | 3:00:02 | 0:30:26 | 2:29:36 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T19:54:27.544782+0000 mon.b (mon.0) 876 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| pass | 4241540 |
|
2019-08-22 16:32:39 | 2019-08-22 17:06:22 | 2019-08-22 17:38:22 | 0:32:00 | 0:15:44 | 0:16:16 | smithi | master | centos | 7.6 | multimds/thrash/{begin.yaml ceph-thrash/mds.yaml clusters/9-mds-3-standby.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml thrash/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} thrash_debug.yaml} tasks/cfuse_workunit_suites_pjd.yaml} | 3 |
| fail | 4241541 |
|
2019-08-22 16:32:39 | 2019-08-22 17:07:58 | 2019-08-22 17:43:57 | 0:35:59 | 0:22:17 | 0:13:42 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2019-08-22T17:35:47.346821+0000 mon.b (mon.0) 945 : cluster [WRN] Health check failed: 4 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| pass | 4241542 |
|
2019-08-22 16:32:40 | 2019-08-22 17:07:58 | 2019-08-22 17:51:58 | 0:44:00 | 0:23:41 | 0:20:19 | smithi | master | ubuntu | 18.04 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 |
| fail | 4241543 |
|
2019-08-22 16:32:41 | 2019-08-22 17:08:03 | 2019-08-22 17:54:03 | 0:46:00 | 0:30:12 | 0:15:48 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T17:44:53.384355+0000 mon.a (mon.0) 987 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241544 |
|
2019-08-22 16:32:42 | 2019-08-22 17:08:08 | 2019-08-22 18:40:08 | 1:32:00 | 0:29:08 | 1:02:52 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T18:30:54.207813+0000 mon.a (mon.0) 809 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241545 |
|
2019-08-22 16:32:43 | 2019-08-22 17:08:12 | 2019-08-22 19:32:13 | 2:24:01 | 1:15:53 | 1:08:08 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/kclient/{kernel-testing.yaml mount.yaml ms-die-on-skipped.yaml} objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
SSH connection to smithi027 was lost: 'sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0' |
||||||||||||||
| fail | 4241546 |
|
2019-08-22 16:32:44 | 2019-08-22 17:08:18 | 2019-08-22 18:40:18 | 1:32:00 | 0:26:27 | 1:05:33 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2019-08-22T18:27:07.557555+0000 mon.b (mon.0) 626 : cluster [WRN] Health check failed: 6 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241547 |
|
2019-08-22 16:32:45 | 2019-08-22 17:08:19 | 2019-08-22 18:08:18 | 0:59:59 | 0:27:50 | 0:32:09 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T17:59:40.415993+0000 mon.b (mon.0) 726 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241548 |
|
2019-08-22 16:32:45 | 2019-08-22 17:10:20 | 2019-08-22 18:08:20 | 0:58:00 | 0:23:55 | 0:34:05 | smithi | master | ubuntu | 18.04 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T17:56:55.353368+0000 mon.b (mon.0) 892 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241549 |
|
2019-08-22 16:32:46 | 2019-08-22 17:10:48 | 2019-08-22 18:18:48 | 1:08:00 | 0:22:08 | 0:45:52 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2019-08-22T18:10:24.968099+0000 mon.a (mon.0) 1065 : cluster [WRN] Health check failed: 4 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241550 |
|
2019-08-22 16:32:47 | 2019-08-22 17:11:57 | 2019-08-22 18:05:56 | 0:53:59 | 0:47:53 | 0:06:06 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_misc.yaml} | 3 |
Failure Reason:
SELinux denials found on ubuntu@smithi154.front.sepia.ceph.com: ['type=AVC msg=audit(1566494395.268:3308): avc: denied { ioctl } for pid=29955 comm="smartd" path="/dev/nvme0" dev="devtmpfs" ino=15784 ioctlcmd=4e40 scontext=system_u:system_r:fsdaemon_t:s0 tcontext=system_u:object_r:nvme_device_t:s0 tclass=chr_file permissive=1', 'type=AVC msg=audit(1566496195.551:7461): avc: denied { read } for pid=29955 comm="smartd" name="nvme0" dev="devtmpfs" ino=15784 scontext=system_u:system_r:fsdaemon_t:s0 tcontext=system_u:object_r:nvme_device_t:s0 tclass=chr_file permissive=1', 'type=AVC msg=audit(1566494395.268:3307): avc: denied { read } for pid=29955 comm="smartd" name="nvme0" dev="devtmpfs" ino=15784 scontext=system_u:system_r:fsdaemon_t:s0 tcontext=system_u:object_r:nvme_device_t:s0 tclass=chr_file permissive=1', 'type=AVC msg=audit(1566494395.268:3307): avc: denied { open } for pid=29955 comm="smartd" path="/dev/nvme0" dev="devtmpfs" ino=15784 scontext=system_u:system_r:fsdaemon_t:s0 tcontext=system_u:object_r:nvme_device_t:s0 tclass=chr_file permissive=1', 'type=AVC msg=audit(1566496195.551:7461): avc: denied { open } for pid=29955 comm="smartd" path="/dev/nvme0" dev="devtmpfs" ino=15784 scontext=system_u:system_r:fsdaemon_t:s0 tcontext=system_u:object_r:nvme_device_t:s0 tclass=chr_file permissive=1', 'type=AVC msg=audit(1566496195.551:7462): avc: denied { ioctl } for pid=29955 comm="smartd" path="/dev/nvme0" dev="devtmpfs" ino=15784 ioctlcmd=4e41 scontext=system_u:system_r:fsdaemon_t:s0 tcontext=system_u:object_r:nvme_device_t:s0 tclass=chr_file permissive=1'] |
||||||||||||||
| dead | 4241551 |
|
2019-08-22 16:32:48 | 2019-08-22 17:12:07 | 2019-08-23 05:14:34 | 12:02:27 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 | ||
| fail | 4241552 |
|
2019-08-22 16:32:49 | 2019-08-22 17:12:28 | 2019-08-22 18:44:28 | 1:32:00 | 0:27:14 | 1:04:46 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T18:35:52.634131+0000 mon.b (mon.0) 1317 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241553 |
|
2019-08-22 16:32:50 | 2019-08-22 17:12:39 | 2019-08-22 19:00:40 | 1:48:01 | 1:40:18 | 0:07:43 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 |
Failure Reason:
"2019-08-22T17:38:58.943286+0000 mon.b (mon.0) 321 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| fail | 4241554 |
|
2019-08-22 16:32:50 | 2019-08-22 17:13:53 | 2019-08-22 17:57:52 | 0:43:59 | 0:20:42 | 0:23:17 | smithi | master | ubuntu | 18.04 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T17:50:45.130657+0000 mon.a (mon.0) 815 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241555 |
|
2019-08-22 16:32:51 | 2019-08-22 17:13:53 | 2019-08-22 18:11:52 | 0:57:59 | 0:26:12 | 0:31:47 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2019-08-22T17:57:55.208733+0000 mon.a (mon.0) 755 : cluster [WRN] Health check failed: 7 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241556 |
|
2019-08-22 16:32:52 | 2019-08-22 17:13:54 | 2019-08-22 20:27:56 | 3:14:02 | 0:26:19 | 2:47:43 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T20:20:11.013253+0000 mon.b (mon.0) 729 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| pass | 4241557 |
|
2019-08-22 16:32:53 | 2019-08-22 17:14:04 | 2019-08-22 19:58:05 | 2:44:01 | 0:55:16 | 1:48:45 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/kclient/{kernel-testing.yaml mount.yaml ms-die-on-skipped.yaml} objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
| fail | 4241558 |
|
2019-08-22 16:32:54 | 2019-08-22 17:14:10 | 2019-08-22 17:54:10 | 0:40:00 | 0:23:34 | 0:16:26 | smithi | master | ubuntu | 18.04 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T17:44:55.066601+0000 mon.b (mon.0) 899 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241559 |
|
2019-08-22 16:32:54 | 2019-08-22 17:14:12 | 2019-08-22 19:42:14 | 2:28:02 | 2:05:46 | 0:22:16 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
Command failed (workunit test suites/fsstress.sh) on smithi009 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=942842351423e592236e9735a3e301d729fbbc19 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' |
||||||||||||||
| fail | 4241560 |
|
2019-08-22 16:32:55 | 2019-08-22 17:15:48 | 2019-08-22 18:59:49 | 1:44:01 | 0:23:32 | 1:20:29 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2019-08-22T18:49:48.588659+0000 mon.a (mon.0) 818 : cluster [WRN] Health check failed: 4 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241561 |
|
2019-08-22 16:32:56 | 2019-08-22 17:16:27 | 2019-08-22 18:58:28 | 1:42:01 | 0:29:20 | 1:12:41 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T18:48:25.510981+0000 mon.b (mon.0) 1320 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241562 |
|
2019-08-22 16:32:57 | 2019-08-22 17:16:44 | 2019-08-22 22:14:49 | 4:58:05 | 3:29:26 | 1:28:39 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
| fail | 4241563 |
|
2019-08-22 16:32:58 | 2019-08-22 17:17:34 | 2019-08-22 18:09:34 | 0:52:00 | 0:29:18 | 0:22:42 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T17:59:33.473504+0000 mon.a (mon.0) 837 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| pass | 4241564 |
|
2019-08-22 16:32:59 | 2019-08-22 17:17:47 | 2019-08-22 18:11:47 | 0:54:00 | 0:31:56 | 0:22:04 | smithi | master | centos | 7.6 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 |
| fail | 4241565 |
|
2019-08-22 16:32:59 | 2019-08-22 17:17:55 | 2019-08-22 19:53:56 | 2:36:01 | 2:21:55 | 0:14:06 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
Failure Reason:
Command failed (workunit test suites/fsstress.sh) on smithi106 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=942842351423e592236e9735a3e301d729fbbc19 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh' |
||||||||||||||
| fail | 4241566 |
|
2019-08-22 16:33:00 | 2019-08-22 17:18:04 | 2019-08-22 19:44:06 | 2:26:02 | 0:27:18 | 1:58:44 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2019-08-22T19:30:02.608963+0000 mon.a (mon.0) 738 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241567 |
|
2019-08-22 16:33:01 | 2019-08-22 17:18:19 | 2019-08-22 18:08:24 | 0:50:05 | 0:28:07 | 0:21:58 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T17:59:34.837628+0000 mon.a (mon.0) 834 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241568 |
|
2019-08-22 16:33:02 | 2019-08-22 17:18:50 | 2019-08-22 20:56:54 | 3:38:04 | 3:31:06 | 0:06:58 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
| fail | 4241569 |
|
2019-08-22 16:33:03 | 2019-08-22 17:19:34 | 2019-08-22 18:21:34 | 1:02:00 | 0:29:20 | 0:32:40 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T18:10:29.224624+0000 mon.b (mon.0) 867 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241570 |
|
2019-08-22 16:33:04 | 2019-08-22 17:20:44 | 2019-08-22 19:24:45 | 2:04:01 | 1:38:28 | 0:25:33 | smithi | master | centos | 7.6 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{centos_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 |
Failure Reason:
"2019-08-22T18:04:15.422018+0000 mon.b (mon.0) 194 : cluster [WRN] Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST)" in cluster log |
||||||||||||||
| fail | 4241571 |
|
2019-08-22 16:33:04 | 2019-08-22 17:21:40 | 2019-08-22 21:25:44 | 4:04:04 | 3:31:48 | 0:32:16 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} | 3 | |
| fail | 4241572 |
|
2019-08-22 16:33:05 | 2019-08-22 17:22:18 | 2019-08-22 18:24:18 | 1:02:00 | 0:22:55 | 0:39:05 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2019-08-22T18:13:39.373577+0000 mon.a (mon.0) 861 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241573 |
|
2019-08-22 16:33:06 | 2019-08-22 17:23:50 | 2019-08-22 18:17:50 | 0:54:00 | 0:30:10 | 0:23:50 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/filestore-xfs.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T18:05:30.762054+0000 mon.b (mon.0) 886 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241574 |
|
2019-08-22 16:33:07 | 2019-08-22 17:24:04 | 2019-08-22 18:18:03 | 0:53:59 | 0:32:47 | 0:21:12 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 |
Failure Reason:
SELinux denials found on ubuntu@smithi138.front.sepia.ceph.com: ['type=AVC msg=audit(1566497563.644:6737): avc: denied { read } for pid=8603 comm="smartd" name="nvme0" dev="devtmpfs" ino=704 scontext=system_u:system_r:fsdaemon_t:s0 tcontext=system_u:object_r:nvme_device_t:s0 tclass=chr_file permissive=1', 'type=AVC msg=audit(1566497563.644:6737): avc: denied { open } for pid=8603 comm="smartd" path="/dev/nvme0" dev="devtmpfs" ino=704 scontext=system_u:system_r:fsdaemon_t:s0 tcontext=system_u:object_r:nvme_device_t:s0 tclass=chr_file permissive=1', 'type=AVC msg=audit(1566497563.644:6738): avc: denied { ioctl } for pid=8603 comm="smartd" path="/dev/nvme0" dev="devtmpfs" ino=704 ioctlcmd=4e41 scontext=system_u:system_r:fsdaemon_t:s0 tcontext=system_u:object_r:nvme_device_t:s0 tclass=chr_file permissive=1'] |
||||||||||||||
| fail | 4241575 |
|
2019-08-22 16:33:08 | 2019-08-22 17:24:05 | 2019-08-22 19:46:06 | 2:22:01 | 0:22:48 | 1:59:13 | smithi | master | ubuntu | 18.04 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{ubuntu_latest.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T19:38:04.236514+0000 mon.a (mon.0) 826 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241576 |
|
2019-08-22 16:33:08 | 2019-08-22 17:25:28 | 2019-08-22 18:49:28 | 1:24:00 | 0:28:15 | 0:55:45 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2019-08-22T18:35:01.412837+0000 mon.a (mon.0) 980 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241577 |
|
2019-08-22 16:33:09 | 2019-08-22 17:26:07 | 2019-08-22 18:02:06 | 0:35:59 | 0:27:47 | 0:08:12 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T17:52:01.166863+0000 mon.b (mon.0) 733 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| pass | 4241578 |
|
2019-08-22 16:33:10 | 2019-08-22 17:27:08 | 2019-08-22 19:15:08 | 1:48:00 | 0:52:10 | 0:55:50 | smithi | master | centos | multimds/verify/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml overrides/{fuse-default-perm-no.yaml verify/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml}} tasks/cfuse_workunit_suites_dbench.yaml validater/valgrind.yaml} | 3 | |
| fail | 4241579 |
|
2019-08-22 16:33:11 | 2019-08-22 17:28:05 | 2019-08-22 18:18:05 | 0:50:00 | 0:30:19 | 0:19:41 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T18:07:50.469881+0000 mon.a (mon.0) 994 : cluster [WRN] Health check failed: 2 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| pass | 4241580 |
|
2019-08-22 16:33:12 | 2019-08-22 17:28:07 | 2019-08-22 18:14:07 | 0:46:00 | 0:36:08 | 0:09:52 | smithi | master | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_fsx.yaml} | 3 | ||
| fail | 4241581 |
|
2019-08-22 16:33:13 | 2019-08-22 17:29:56 | 2019-08-22 18:21:56 | 0:52:00 | 0:21:47 | 0:30:13 | smithi | master | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 | ||
Failure Reason:
"2019-08-22T18:14:10.374919+0000 mon.b (mon.0) 1053 : cluster [WRN] Health check failed: 6 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241582 |
|
2019-08-22 16:33:14 | 2019-08-22 17:29:56 | 2019-08-22 19:03:56 | 1:34:00 | 0:07:58 | 1:26:02 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/3-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/kclient/{mount.yaml overrides/{distro/random/{k-testing.yaml supported$/{rhel_7.yaml}} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_blogbench.yaml} | 3 |
Failure Reason:
equire(inj.CERT_SORTER).force_cert_check()', u' File "/usr/lib64/python2.7/site-packages/subscription_manager/injection.py", line 106, in require', u' return FEATURES.require(feature, *args, **kwargs)', u' File "/usr/lib64/python2.7/site-packages/subscription_manager/injection.py", line 80, in require', u' self.providers[feature] = provider(*args, **kwargs)', u' File "/usr/lib64/python2.7/site-packages/subscription_manager/cert_sorter.py", line 325, in __init__', u' super(CertSorter, self).__init__(on_date)', u' File "/usr/lib64/python2.7/site-packages/subscription_manager/cert_sorter.py", line 65, in __init__', u' self.load()', u' File "/usr/lib64/python2.7/site-packages/subscription_manager/cert_sorter.py", line 111, in load', u' self._parse_server_status()', u' File "/usr/lib64/python2.7/site-packages/subscription_manager/cert_sorter.py", line 137, in _parse_server_status', u" self.valid_products = status['compliantProducts']", u"KeyError: 'compliantProducts'"], u'changed': True, u'stdout': u'', u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'subscription-manager repos --enable rhel-7-server-optional-rpms', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, u'delta': u'0:00:01.199109', 'stdout_lines': [], '_ansible_item_label': u'rhel-7-server-optional-rpms', 'ansible_loop_var': u'item', u'end': u'2019-08-22 18:56:53.345928', '_ansible_no_log': False, u'start': u'2019-08-22 18:56:52.146819', u'failed': True, u'cmd': [u'subscription-manager', u'repos', u'--enable', u'rhel-7-server-optional-rpms'], 'item': u'rhel-7-server-optional-rpms', u'stderr': u'Traceback (most recent call last):\n File "/sbin/subscription-manager", line 9, in <module>\n load_entry_point(\'subscription-manager==1.21.10\', \'console_scripts\', \'subscription-manager\')()\n File "/usr/lib64/python2.7/site-packages/subscription_manager/scripts/subscription_manager.py", line 85, in main\n return managercli.ManagerCLI().main()\n File "/usr/lib64/python2.7/site-packages/subscription_manager/managercli.py", line 2667, in main\n ret = CLI.main(self)\n File "/usr/lib64/python2.7/site-packages/subscription_manager/cli.py", line 183, in main\n return cmd.main()\n File "/usr/lib64/python2.7/site-packages/subscription_manager/managercli.py", line 501, in main\n return_code = self._do_command()\n File "/usr/lib64/python2.7/site-packages/subscription_manager/managercli.py", line 2028, in _do_command\n self._request_validity_check()\n File "/usr/lib64/python2.7/site-packages/subscription_manager/managercli.py", line 284, in _request_validity_check\n inj.require(inj.CERT_SORTER).force_cert_check()\n File "/usr/lib64/python2.7/site-packages/subscription_manager/injection.py", line 106, in require\n return FEATURES.require(feature, *args, **kwargs)\n File "/usr/lib64/python2.7/site-packages/subscription_manager/injection.py", line 80, in require\n self.providers[feature] = provider(*args, **kwargs)\n File "/usr/lib64/python2.7/site-packages/subscription_manager/cert_sorter.py", line 325, in __init__\n super(CertSorter, self).__init__(on_date)\n File "/usr/lib64/python2.7/site-packages/subscription_manager/cert_sorter.py", line 65, in __init__\n self.load()\n File "/usr/lib64/python2.7/site-packages/subscription_manager/cert_sorter.py", line 111, in load\n self._parse_server_status()\n File "/usr/lib64/python2.7/site-packages/subscription_manager/cert_sorter.py", line 137, in _parse_server_status\n self.valid_products = status[\'compliantProducts\']\nKeyError: \'compliantProducts\'', u'rc': 1, u'msg': u'non-zero return code'}, {'stderr_lines': [], u'changed': True, u'stdout': u"Repository 'rhel-7-server-extras-rpms' is enabled for this system.", u'delta': u'0:00:01.627398', 'stdout_lines': [u"Repository 'rhel-7-server-extras-rpms' is enabled for this system."], '_ansible_item_label': u'rhel-7-server-extras-rpms', 'ansible_loop_var': u'item', u'end': u'2019-08-22 18:56:55.167924', '_ansible_no_log': False, 'item': u'rhel-7-server-extras-rpms', u'cmd': [u'subscription-manager', u'repos', u'--enable', u'rhel-7-server-extras-rpms'], 'failed': False, u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'subscription-manager repos --enable rhel-7-server-extras-rpms', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, u'start': u'2019-08-22 18:56:53.540526'}, {'stderr_lines': [], u'changed': True, u'stdout': u"Repository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system.", u'delta': u'0:00:01.934682', 'stdout_lines': [u"Repository 'rhel-ha-for-rhel-7-server-rpms' is enabled for this system."], '_ansible_item_label': u'rhel-ha-for-rhel-7-server-rpms', 'ansible_loop_var': u'item', u'end': u'2019-08-22 18:56:57.264900', '_ansible_no_log': False, 'item': u'rhel-ha-for-rhel-7-server-rpms', u'cmd': [u'subscription-manager', u'repos', u'--enable', u'rhel-ha-for-rhel-7-server-rpms'], 'failed': False, u'stderr': u'', u'rc': 0, u'invocation': {u'module_args': {u'warn': True, u'executable': None, u'_uses_shell': False, u'strip_empty_ends': True, u'_raw_params': u'subscription-manager repos --enable rhel-ha-for-rhel-7-server-rpms', u'removes': None, u'argv': None, u'creates': None, u'chdir': None, u'stdin_add_newline': True, u'stdin': None}}, u'start': u'2019-08-22 18:56:55.330218'}]}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 219, in represent_list return self.represent_sequence(u'tag:yaml.org,2002:seq', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 102, in represent_sequence node_item = self.represent_data(item) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'rhel-7-server-rpms') |
||||||||||||||
| fail | 4241583 |
|
2019-08-22 16:33:15 | 2019-08-22 17:29:56 | 2019-08-22 18:25:56 | 0:56:00 | 0:29:38 | 0:26:22 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-bitmap.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cephfs_test_snapshots.yaml} | 3 |
Failure Reason:
"2019-08-22T18:13:37.967977+0000 mon.a (mon.0) 1349 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH)" in cluster log |
||||||||||||||
| fail | 4241584 |
|
2019-08-22 16:33:15 | 2019-08-22 17:30:08 | 2019-08-22 19:58:09 | 2:28:01 | 1:46:30 | 0:41:31 | smithi | master | rhel | 7.6 | multimds/basic/{begin.yaml clusters/9-mds.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/kclient/{mount.yaml overrides/{distro/rhel/{k-distro.yaml rhel_7.yaml} ms-die-on-skipped.yaml}} objectstore-ec/bluestore-comp-ec-root.yaml overrides/{basic/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} fuse-default-perm-no.yaml} q_check_counter/check_counter.yaml tasks/cfuse_workunit_suites_ffsb.yaml} | 3 |
Failure Reason:
"2019-08-22T18:27:05.151297+0000 mon.a (mon.0) 348 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
Pulpito