| User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail |
|---|---|---|---|---|---|---|---|---|---|---|
| mchangir | 2021-02-09 11:41:14 | 2021-02-13 22:25:46 | 2021-02-14 02:26:09 | 4:00:23 | fs:workload | wip-mchangir-mds-scrub-error-with-background-task | smithi | 48eb49c | 39 | 11 |
| Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| pass | 5871826 |
|
2021-02-09 11:41:22 | 2021-02-13 22:25:46 | 2021-02-13 23:15:05 | 0:49:19 | 0:42:29 | 0:06:50 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/fs/misc}} | 3 |
| fail | 5871827 |
|
2021-02-09 11:41:23 | 2021-02-13 22:25:47 | 2021-02-13 23:05:11 | 0:39:24 | 0:31:04 | 0:08:20 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/blogbench}} | 3 |
Failure Reason:
"2021-02-13T22:47:50.861509+0000 mds.b (mds.0) 34 : cluster [WRN] Scrub error on inode 0x10000000416 (~mds0/stray0/10000000416) see mds.b log and `damage ls` output for details" in cluster log |
||||||||||||||
| fail | 5871828 |
|
2021-02-09 11:41:23 | 2021-02-13 22:25:47 | 2021-02-13 23:25:06 | 0:59:19 | 0:53:11 | 0:06:08 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/ffsb}} | 3 |
Failure Reason:
"2021-02-13T22:46:31.603992+0000 mon.a (mon.0) 312 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 5871829 |
|
2021-02-09 11:41:24 | 2021-02-13 22:25:48 | 2021-02-13 22:53:08 | 0:27:20 | 0:15:26 | 0:11:54 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/fsstress}} | 3 |
| pass | 5871830 |
|
2021-02-09 11:41:25 | 2021-02-13 22:27:29 | 2021-02-13 22:46:37 | 0:19:08 | 0:13:03 | 0:06:05 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/fsync-tester}} | 3 |
| pass | 5871831 |
|
2021-02-09 11:41:26 | 2021-02-13 22:27:39 | 2021-02-13 23:33:24 | 1:05:45 | 0:56:11 | 0:09:34 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/iogen}} | 3 |
| pass | 5871832 |
|
2021-02-09 11:41:26 | 2021-02-13 22:27:50 | 2021-02-13 22:47:18 | 0:19:28 | 0:13:20 | 0:06:08 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/pjd}} | 3 |
| fail | 5871833 |
|
2021-02-09 11:41:27 | 2021-02-13 22:28:01 | 2021-02-14 00:08:11 | 1:40:10 | 1:29:44 | 0:10:26 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/fs/misc}} | 3 |
Failure Reason:
"2021-02-13T23:10:02.623074+0000 mds.f (mds.0) 179 : cluster [WRN] Scrub error on inode 0x1000001026b (~mds0/stray4/1000001026b) see mds.f log and `damage ls` output for details" in cluster log |
||||||||||||||
| pass | 5871834 |
|
2021-02-09 11:41:28 | 2021-02-13 22:28:31 | 2021-02-13 23:10:18 | 0:41:47 | 0:35:18 | 0:06:29 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/blogbench}} | 3 |
| fail | 5871835 |
|
2021-02-09 11:41:29 | 2021-02-13 22:29:12 | 2021-02-13 23:32:46 | 1:03:34 | 0:53:17 | 0:10:17 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/ffsb}} | 3 |
Failure Reason:
"2021-02-13T22:54:16.471669+0000 mon.a (mon.0) 297 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 5871836 |
|
2021-02-09 11:41:30 | 2021-02-13 22:29:13 | 2021-02-13 22:53:17 | 0:24:04 | 0:16:44 | 0:07:20 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/fsstress}} | 3 |
| pass | 5871837 |
|
2021-02-09 11:41:30 | 2021-02-13 22:29:54 | 2021-02-13 22:54:38 | 0:24:44 | 0:13:13 | 0:11:31 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/fsync-tester}} | 3 |
| pass | 5871838 |
|
2021-02-09 11:41:31 | 2021-02-13 22:31:05 | 2021-02-13 23:28:16 | 0:57:11 | 0:49:49 | 0:07:22 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/iogen}} | 3 |
| pass | 5871839 |
|
2021-02-09 11:41:32 | 2021-02-13 22:31:06 | 2021-02-13 22:54:45 | 0:23:39 | 0:13:31 | 0:10:08 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/pjd}} | 3 |
| pass | 5871840 |
|
2021-02-09 11:41:33 | 2021-02-13 22:31:06 | 2021-02-13 23:10:45 | 0:39:39 | 0:32:07 | 0:07:32 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/fs/misc}} | 3 |
| pass | 5871841 |
|
2021-02-09 11:41:33 | 2021-02-13 22:31:27 | 2021-02-13 23:07:30 | 0:36:03 | 0:26:41 | 0:09:22 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/blogbench}} | 3 |
| pass | 5871842 |
|
2021-02-09 11:41:34 | 2021-02-13 22:31:57 | 2021-02-13 23:07:21 | 0:35:24 | 0:27:54 | 0:07:30 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/ffsb}} | 3 |
| pass | 5871843 |
|
2021-02-09 11:41:35 | 2021-02-13 22:32:18 | 2021-02-13 22:58:48 | 0:26:30 | 0:15:37 | 0:10:53 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/fsstress}} | 3 |
| pass | 5871844 |
|
2021-02-09 11:41:36 | 2021-02-13 22:33:09 | 2021-02-13 22:53:27 | 0:20:18 | 0:12:45 | 0:07:33 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/fsync-tester}} | 3 |
| pass | 5871845 |
|
2021-02-09 11:41:37 | 2021-02-13 22:34:09 | 2021-02-13 23:28:46 | 0:54:37 | 0:44:05 | 0:10:32 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/iogen}} | 3 |
| pass | 5871846 |
|
2021-02-09 11:41:37 | 2021-02-13 22:34:40 | 2021-02-13 22:54:11 | 0:19:31 | 0:13:07 | 0:06:24 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/pjd}} | 3 |
| fail | 5871847 |
|
2021-02-09 11:41:38 | 2021-02-13 22:34:41 | 2021-02-14 02:05:42 | 3:31:01 | 3:20:28 | 0:10:33 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/fs/misc}} | 3 |
Failure Reason:
Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi025 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=48eb49ceadaa78add4f8846a100235cc4c86181c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh' |
||||||||||||||
| fail | 5871848 |
|
2021-02-09 11:41:39 | 2021-02-13 22:35:31 | 2021-02-13 23:05:21 | 0:29:50 | 0:23:20 | 0:06:30 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/blogbench}} | 3 |
Failure Reason:
"2021-02-13T22:54:56.418846+0000 mds.b (mds.0) 39 : cluster [WRN] Scrub error on inode 0x10000000534 (~mds0/stray3/10000000534) see mds.b log and `damage ls` output for details" in cluster log |
||||||||||||||
| pass | 5871849 |
|
2021-02-09 11:41:40 | 2021-02-13 22:36:22 | 2021-02-13 23:21:56 | 0:45:34 | 0:35:35 | 0:09:59 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/ffsb}} | 3 |
| pass | 5871850 |
|
2021-02-09 11:41:41 | 2021-02-13 22:36:52 | 2021-02-13 22:58:23 | 0:21:31 | 0:15:09 | 0:06:22 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/fsstress}} | 3 |
| pass | 5871851 |
|
2021-02-09 11:41:41 | 2021-02-13 22:37:03 | 2021-02-13 22:59:10 | 0:22:07 | 0:12:39 | 0:09:28 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/fsync-tester}} | 3 |
| fail | 5871852 |
|
2021-02-09 11:41:42 | 2021-02-13 22:37:33 | 2021-02-13 23:42:31 | 1:04:58 | 0:58:37 | 0:06:21 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/iogen}} | 3 |
Failure Reason:
The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'} |
||||||||||||||
| pass | 5871853 |
|
2021-02-09 11:41:43 | 2021-02-13 22:37:44 | 2021-02-13 23:02:02 | 0:24:18 | 0:14:45 | 0:09:33 | smithi | master | ubuntu | 20.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/pjd}} | 3 |
| pass | 5871854 |
|
2021-02-09 11:41:44 | 2021-02-13 22:38:35 | 2021-02-14 00:46:54 | 2:08:19 | 1:57:20 | 0:10:59 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/fs/misc}} | 3 |
| fail | 5871855 |
|
2021-02-09 11:41:45 | 2021-02-13 22:39:36 | 2021-02-14 00:04:27 | 1:24:51 | 1:12:37 | 0:12:14 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/blogbench}} | 3 |
Failure Reason:
Command failed on smithi039 with status 1: 'sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp' |
||||||||||||||
| pass | 5871856 |
|
2021-02-09 11:41:45 | 2021-02-13 22:40:46 | 2021-02-13 23:57:00 | 1:16:14 | 1:03:34 | 0:12:40 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/ffsb}} | 3 |
| pass | 5871857 |
|
2021-02-09 11:41:46 | 2021-02-13 22:41:47 | 2021-02-13 23:11:45 | 0:29:58 | 0:19:53 | 0:10:05 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/fsstress}} | 3 |
| pass | 5871858 |
|
2021-02-09 11:41:47 | 2021-02-13 22:42:48 | 2021-02-13 23:22:42 | 0:39:54 | 0:31:46 | 0:08:08 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/fsync-tester}} | 3 |
| pass | 5871859 |
|
2021-02-09 11:41:48 | 2021-02-13 22:43:28 | 2021-02-14 00:03:01 | 1:19:33 | 1:09:35 | 0:09:58 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/iogen}} | 3 |
| pass | 5871860 |
|
2021-02-09 11:41:48 | 2021-02-13 22:43:59 | 2021-02-13 23:05:23 | 0:21:24 | 0:13:05 | 0:08:19 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/pjd}} | 3 |
| pass | 5871861 |
|
2021-02-09 11:41:49 | 2021-02-13 22:46:20 | 2021-02-13 23:49:40 | 1:03:20 | 0:53:17 | 0:10:03 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/fs/misc}} | 3 |
| pass | 5871862 |
|
2021-02-09 11:41:50 | 2021-02-13 22:46:40 | 2021-02-13 23:18:20 | 0:31:40 | 0:24:49 | 0:06:51 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/blogbench}} | 3 |
| fail | 5871863 |
|
2021-02-09 11:41:51 | 2021-02-13 22:47:11 | 2021-02-14 00:02:22 | 1:15:11 | 1:04:20 | 0:10:51 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/ffsb}} | 3 |
Failure Reason:
"2021-02-13T23:14:19.801481+0000 mon.a (mon.0) 239 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log |
||||||||||||||
| pass | 5871864 |
|
2021-02-09 11:41:52 | 2021-02-13 22:47:22 | 2021-02-13 23:15:59 | 0:28:37 | 0:17:01 | 0:11:36 | smithi | master | ubuntu | 18.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/fsstress}} | 3 |
| pass | 5871865 |
|
2021-02-09 11:41:52 | 2021-02-13 22:47:53 | 2021-02-13 23:15:17 | 0:27:24 | 0:16:34 | 0:10:50 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/fsync-tester}} | 3 |
| pass | 5871866 |
|
2021-02-09 11:41:53 | 2021-02-13 22:48:24 | 2021-02-14 00:01:56 | 1:13:32 | 1:04:42 | 0:08:50 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/iogen}} | 3 |
| pass | 5871867 |
|
2021-02-09 11:41:54 | 2021-02-13 22:50:45 | 2021-02-13 23:20:03 | 0:29:18 | 0:18:32 | 0:10:46 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/pjd}} | 3 |
| fail | 5871868 |
|
2021-02-09 11:41:55 | 2021-02-13 22:50:46 | 2021-02-14 02:26:09 | 3:35:23 | 3:22:19 | 0:13:04 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/fs/misc}} | 3 |
Failure Reason:
Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi072 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=48eb49ceadaa78add4f8846a100235cc4c86181c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh' |
||||||||||||||
| fail | 5871869 |
|
2021-02-09 11:41:56 | 2021-02-13 22:52:06 | 2021-02-13 23:25:55 | 0:33:49 | 0:23:32 | 0:10:17 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/blogbench}} | 3 |
Failure Reason:
"2021-02-13T23:19:25.541801+0000 mds.a (mds.0) 49 : cluster [WRN] Scrub error on inode 0x1000000050b (~mds0/stray2/1000000050b) see mds.a log and `damage ls` output for details" in cluster log |
||||||||||||||
| pass | 5871870 |
|
2021-02-09 11:41:56 | 2021-02-13 22:52:47 | 2021-02-13 23:36:10 | 0:43:23 | 0:33:16 | 0:10:07 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/ffsb}} | 3 |
| pass | 5871871 |
|
2021-02-09 11:41:57 | 2021-02-13 22:53:07 | 2021-02-13 23:22:19 | 0:29:12 | 0:18:38 | 0:10:34 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/fsstress}} | 3 |
| pass | 5871872 |
|
2021-02-09 11:41:58 | 2021-02-13 22:53:18 | 2021-02-13 23:14:58 | 0:21:40 | 0:14:25 | 0:07:15 | smithi | master | rhel | 8.3 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/suites/fsync-tester}} | 3 |
| pass | 5871873 |
|
2021-02-09 11:41:59 | 2021-02-13 22:53:18 | 2021-02-13 23:50:38 | 0:57:20 | 0:46:02 | 0:11:18 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/iogen}} | 3 |
| pass | 5871874 |
|
2021-02-09 11:41:59 | 2021-02-13 22:53:29 | 2021-02-13 23:18:16 | 0:24:47 | 0:11:38 | 0:13:09 | smithi | master | ubuntu | 18.04 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/yes tasks/{0-check-counter workunit/suites/pjd}} | 3 |
| pass | 5871875 |
|
2021-02-09 11:42:00 | 2021-02-13 22:54:19 | 2021-02-13 23:46:49 | 0:52:30 | 0:41:02 | 0:11:28 | smithi | master | centos | 8.2 | fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/1 scrub/yes tasks/{0-check-counter workunit/fs/misc}} | 3 |
Pulpito