Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
fail 6055371 2021-04-18 07:02:55 2021-04-26 21:20:43 2021-04-26 21:47:23 0:26:40 0:11:04 0:15:36 gibba master ubuntu 20.04 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 2
Failure Reason:

"2021-04-26T21:41:23.396372+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055372 2021-04-18 07:02:56 2021-04-26 21:25:04 2021-04-26 22:02:08 0:37:04 0:26:57 0:10:07 gibba master rhel 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} 2
Failure Reason:

"2021-04-26T21:46:58.364089+0000 mgr.x (mgr.4126) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055373 2021-04-18 07:02:57 2021-04-26 21:29:05 2021-04-26 21:56:07 0:27:02 0:21:04 0:05:58 gibba master rhel 8.3 rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6055374 2021-04-18 07:02:57 2021-04-26 21:29:05 2021-04-26 22:08:30 0:39:25 0:21:25 0:18:00 gibba master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} 2
fail 6055375 2021-04-18 07:02:58 2021-04-26 21:36:57 2021-04-26 22:10:30 0:33:33 0:15:56 0:17:37 gibba master rhel 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

"2021-04-26T22:05:59.596631+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055376 2021-04-18 07:02:59 2021-04-26 21:47:32 2021-04-26 22:12:30 0:24:58 0:16:35 0:08:23 gibba master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} 1
Failure Reason:

"2021-04-26T22:10:05.902062+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055377 2021-04-18 07:03:00 2021-04-26 21:47:32 2021-04-26 22:06:44 0:19:12 0:07:24 0:11:48 gibba master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_5925} 2
pass 6055378 2021-04-18 07:03:01 2021-04-26 21:49:28 2021-04-26 22:04:30 0:15:02 0:06:43 0:08:19 gibba master ubuntu 20.04 rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
pass 6055379 2021-04-18 07:03:02 2021-04-26 21:49:29 2021-04-26 22:20:31 0:31:02 0:16:32 0:14:30 gibba master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/rgw 3-final} 2
fail 6055380 2021-04-18 07:03:03 2021-04-26 21:57:30 2021-04-26 22:20:49 0:23:19 0:08:40 0:14:39 gibba master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/prometheus} 2
Failure Reason:

"2021-04-26T22:16:27.533027+0000 mgr.z (mgr.4135) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055381 2021-04-18 07:03:04 2021-04-26 22:02:11 2021-04-26 22:31:58 0:29:47 0:18:12 0:11:35 gibba master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects} 2
Failure Reason:

"2021-04-26T22:19:14.495709+0000 mgr.x (mgr.4126) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055382 2021-04-18 07:03:05 2021-04-26 22:04:32 2021-04-26 22:50:12 0:45:40 0:30:48 0:14:52 gibba master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/none thrashosds-health workloads/snaps-few-objects} 3
pass 6055383 2021-04-18 07:03:05 2021-04-26 22:08:40 2021-04-26 22:30:17 0:21:37 0:14:46 0:06:51 gibba master rhel 8.3 rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 mon_election/classic start} 2
pass 6055384 2021-04-18 07:03:06 2021-04-26 22:09:30 2021-04-26 22:45:27 0:35:57 0:25:05 0:10:52 gibba master centos 8.3 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} 2
pass 6055385 2021-04-18 07:03:07 2021-04-26 22:10:40 2021-04-27 00:22:28 2:11:48 2:05:47 0:06:01 gibba master rhel 8.3 rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} 1
pass 6055386 2021-04-18 07:03:08 2021-04-26 22:10:41 2021-04-26 22:33:26 0:22:45 0:14:21 0:08:24 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm} 1
pass 6055387 2021-04-18 07:03:09 2021-04-26 22:10:41 2021-04-26 22:27:58 0:17:17 0:07:54 0:09:23 gibba master centos 8.3 rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
fail 6055388 2021-04-18 07:03:10 2021-04-26 22:10:41 2021-04-26 22:53:28 0:42:47 0:22:56 0:19:51 gibba master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

"2021-04-26T22:34:52.745380+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055389 2021-04-18 07:03:11 2021-04-26 22:20:35 2021-04-26 22:56:13 0:35:38 0:25:50 0:09:48 gibba master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} 2
Failure Reason:

"2021-04-26T22:35:40.776152+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055390 2021-04-18 07:03:12 2021-04-26 22:20:55 2021-04-27 00:08:16 1:47:21 1:37:33 0:09:48 gibba master ubuntu 20.04 rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/osd} 1
pass 6055391 2021-04-18 07:03:13 2021-04-26 22:20:55 2021-04-26 22:45:25 0:24:30 0:08:05 0:16:25 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/fio_4M_rand_read} 1
pass 6055392 2021-04-18 07:03:13 2021-04-26 22:28:07 2021-04-26 23:11:32 0:43:25 0:31:27 0:11:58 gibba master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} 2
pass 6055393 2021-04-18 07:03:14 2021-04-26 22:30:18 2021-04-26 22:57:01 0:26:43 0:15:52 0:10:51 gibba master ubuntu 20.04 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6055394 2021-04-18 07:03:15 2021-04-26 22:32:08 2021-04-26 23:02:13 0:30:05 0:19:38 0:10:27 gibba master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_kubic_stable fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
fail 6055395 2021-04-18 07:03:16 2021-04-26 22:33:29 2021-04-26 23:12:22 0:38:53 0:16:16 0:22:37 gibba master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/libcephsqlite} 2
Failure Reason:

"2021-04-26T22:59:06.656784+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055396 2021-04-18 07:03:17 2021-04-26 22:45:35 2021-04-26 23:10:26 0:24:51 0:18:29 0:06:22 gibba master rhel 8.3 rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
fail 6055397 2021-04-18 07:03:17 2021-04-26 22:45:35 2021-04-26 23:23:39 0:38:04 0:22:54 0:15:10 gibba master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} 2
Failure Reason:

"2021-04-26T23:05:59.978368+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055398 2021-04-18 07:03:18 2021-04-26 22:50:22 2021-04-26 23:16:30 0:26:08 0:13:15 0:12:53 gibba master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} 2
pass 6055399 2021-04-18 07:03:19 2021-04-26 22:53:32 2021-04-26 23:08:28 0:14:56 0:06:21 0:08:35 gibba master centos 8.3 rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6055400 2021-04-18 07:03:20 2021-04-26 22:53:33 2021-04-26 23:11:31 0:17:58 0:05:27 0:12:31 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm_repos} 1
dead 6055401 2021-04-18 07:03:21 2021-04-26 22:56:23 2021-04-27 11:11:35 12:15:12 gibba master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

hit max job timeout

fail 6055402 2021-04-18 07:03:21 2021-04-26 23:02:14 2021-04-26 23:41:24 0:39:10 0:23:33 0:15:37 gibba master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/valgrind} 2
Failure Reason:

"2021-04-26T23:32:32.912877+0000 mgr.x (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055403 2021-04-18 07:03:22 2021-04-26 23:08:35 2021-04-26 23:28:27 0:19:52 0:06:27 0:13:25 gibba master centos 8.3 rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} 3
Failure Reason:

"2021-04-26T23:26:46.871106+0000 mgr.x (mgr.34116) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055404 2021-04-18 07:03:23 2021-04-26 23:11:40 2021-04-26 23:43:25 0:31:45 0:25:34 0:06:11 gibba master rhel 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} 2
Failure Reason:

"2021-04-26T23:29:59.741463+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055405 2021-04-18 07:03:24 2021-04-26 23:12:31 2021-04-26 23:49:25 0:36:54 0:26:53 0:10:01 gibba master centos 8.3 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
Failure Reason:

"2021-04-26T23:30:12.840216+0000 mgr.x (mgr.6816) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055406 2021-04-18 07:03:25 2021-04-26 23:12:31 2021-04-26 23:37:42 0:25:11 0:12:21 0:12:50 gibba master ubuntu 20.04 rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} 1
pass 6055407 2021-04-18 07:03:25 2021-04-26 23:16:39 2021-04-26 23:53:24 0:36:45 0:17:46 0:18:59 gibba master rhel 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
pass 6055408 2021-04-18 07:03:26 2021-04-26 23:28:36 2021-04-26 23:49:44 0:21:08 0:12:22 0:08:46 gibba master ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/basic 3-final} 2
fail 6055409 2021-04-18 07:03:27 2021-04-26 23:28:36 2021-04-27 00:20:10 0:51:34 0:32:25 0:19:09 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} 2
Failure Reason:

"2021-04-26T23:58:44.281532+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055410 2021-04-18 07:03:28 2021-04-26 23:41:30 2021-04-27 00:00:01 0:18:31 0:06:55 0:11:36 gibba master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/workunits} 2
Failure Reason:

"2021-04-26T23:57:34.297465+0000 mgr.z (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055411 2021-04-18 07:03:31 2021-04-26 23:43:30 2021-04-27 00:28:54 0:45:24 0:32:13 0:13:11 gibba master rhel 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_api_tests} 2
pass 6055412 2021-04-18 07:03:32 2021-04-26 23:49:38 2021-04-27 00:13:54 0:24:16 0:14:17 0:09:59 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/fio_4M_rand_rw} 1
pass 6055413 2021-04-18 07:03:32 2021-04-26 23:49:49 2021-04-27 01:44:02 1:54:13 1:44:33 0:09:40 gibba master ubuntu 20.04 rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/scrub} 1
pass 6055414 2021-04-18 07:03:33 2021-04-26 23:49:49 2021-04-27 00:26:10 0:36:21 0:22:54 0:13:27 gibba master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/classic} 2
pass 6055415 2021-04-18 07:03:34 2021-04-26 23:53:26 2021-04-27 00:36:54 0:43:28 0:33:53 0:09:35 gibba master ubuntu 20.04 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
dead 6055416 2021-04-18 07:03:35 2021-04-26 23:53:27 2021-04-27 00:18:12 0:24:45 gibba master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} 3
Failure Reason:

Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds

fail 6055417 2021-04-18 07:03:36 2021-04-27 00:00:06 2021-04-27 00:48:56 0:48:50 0:28:59 0:19:51 gibba master rhel 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
Failure Reason:

"2021-04-27T00:31:46.934203+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055418 2021-04-18 07:03:37 2021-04-27 00:13:57 2021-04-27 00:55:08 0:41:11 0:31:01 0:10:10 gibba master rhel 8.3 rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
pass 6055419 2021-04-18 07:03:38 2021-04-27 00:18:30 2021-04-27 01:13:59 0:55:29 0:44:57 0:10:32 gibba master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} 2
pass 6055420 2021-04-18 07:03:38 2021-04-27 00:18:30 2021-04-27 00:39:00 0:20:30 0:12:26 0:08:04 gibba master rhel 8.3 rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} 1
fail 6055421 2021-04-18 07:03:39 2021-04-27 00:20:23 2021-04-27 00:45:53 0:25:30 0:17:40 0:07:50 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} 2
Failure Reason:

"2021-04-27T00:40:03.256318+0000 mgr.y (mgr.4120) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055422 2021-04-18 07:03:40 2021-04-27 00:22:38 2021-04-27 00:52:01 0:29:23 0:14:21 0:15:02 gibba master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 6055423 2021-04-18 07:03:41 2021-04-27 00:26:19 2021-04-27 01:01:58 0:35:39 0:23:28 0:12:11 gibba master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
fail 6055424 2021-04-18 07:03:42 2021-04-27 00:29:04 2021-04-27 01:11:59 0:42:55 0:23:09 0:19:46 gibba master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_api_tests} 2
Failure Reason:

"2021-04-27T00:52:28.942363+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055425 2021-04-18 07:03:43 2021-04-27 00:39:04 2021-04-27 01:06:28 0:27:24 0:14:07 0:13:17 gibba master rhel 8.3 rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6055426 2021-04-18 07:03:44 2021-04-27 00:46:01 2021-04-27 01:34:59 0:48:58 0:40:40 0:08:18 gibba master ubuntu 20.04 rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} 1
pass 6055427 2021-04-18 07:03:45 2021-04-27 00:46:01 2021-04-27 01:15:36 0:29:35 0:19:02 0:10:33 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_orch_cli} 1
fail 6055428 2021-04-18 07:03:46 2021-04-27 00:49:01 2021-04-27 01:50:33 1:01:32 0:48:13 0:13:19 gibba master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} 2
Failure Reason:

"2021-04-27T01:06:16.773051+0000 mgr.x (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055429 2021-04-18 07:03:47 2021-04-27 00:52:07 2021-04-27 01:18:25 0:26:18 0:13:42 0:12:36 gibba master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/iscsi 3-final} 2
pass 6055430 2021-04-18 07:03:48 2021-04-27 00:55:18 2021-04-27 01:29:42 0:34:24 0:18:18 0:16:06 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/fio_4M_rand_write} 1
fail 6055431 2021-04-18 07:03:48 2021-04-27 01:02:05 2021-04-27 02:06:34 1:04:29 0:49:32 0:14:57 gibba master centos 8.3 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8} tasks/dashboard} 2
Failure Reason:

"2021-04-27T01:20:53.679054+0000 mgr.z (mgr.4123) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055432 2021-04-18 07:03:49 2021-04-27 01:06:36 2021-04-27 01:38:34 0:31:58 0:20:20 0:11:38 gibba master rhel 8.3 rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6055433 2021-04-18 07:03:50 2021-04-27 01:12:08 2021-04-27 01:30:44 0:18:36 0:09:38 0:08:58 gibba master centos 8.3 rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/crush} 1
pass 6055434 2021-04-18 07:03:51 2021-04-27 01:12:09 2021-04-27 02:50:13 1:38:04 1:27:35 0:10:29 gibba master ubuntu 18.04 rados/upgrade/pacific-x/parallel/{0-start 1-tasks distro1$/{ubuntu_18.04} mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
pass 6055435 2021-04-18 07:03:52 2021-04-27 01:14:01 2021-04-27 02:03:17 0:49:16 0:38:28 0:10:48 gibba master rhel 8.3 rados/cephadm/with-work/{0-distro/rhel_8.3_kubic_stable fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 6055436 2021-04-18 07:03:53 2021-04-27 01:18:28 2021-04-27 01:46:32 0:28:04 0:21:11 0:06:53 gibba master rhel 8.3 rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 1
pass 6055437 2021-04-18 07:03:54 2021-04-27 01:18:29 2021-04-27 01:58:33 0:40:04 0:16:51 0:23:13 gibba master rhel 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
fail 6055438 2021-04-18 07:03:55 2021-04-27 01:35:02 2021-04-27 08:05:57 6:30:55 6:12:37 0:18:18 gibba master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} 2
Failure Reason:

Command failed (workunit test rados/test.sh) on gibba018 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6adfd148cc792c27e30c9664da5f2a1a3a2d4e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

pass 6055439 2021-04-18 07:03:56 2021-04-27 01:44:08 2021-04-27 02:15:42 0:31:34 0:16:16 0:15:18 gibba master centos 8.2 rados/cephadm/dashboard/{0-distro/centos_8.2_kubic_stable task/test_e2e} 2
fail 6055440 2021-04-18 07:03:57 2021-04-27 01:50:42 2021-04-27 02:27:44 0:37:02 0:22:12 0:14:50 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} 2
Failure Reason:

"2021-04-27T02:15:59.457157+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055441 2021-04-18 07:03:58 2021-04-27 01:58:35 2021-04-27 02:20:14 0:21:39 0:06:19 0:15:20 gibba master centos 8.3 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} 3
fail 6055442 2021-04-18 07:03:59 2021-04-27 02:03:27 2021-04-27 02:35:24 0:31:57 0:19:56 0:12:01 gibba master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
Failure Reason:

"2021-04-27T02:20:21.636795+0000 mgr.y (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055443 2021-04-18 07:04:00 2021-04-27 02:06:36 2021-04-27 02:43:32 0:36:56 0:11:15 0:25:41 gibba master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

"2021-04-27T02:38:26.434710+0000 mgr.y (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055444 2021-04-18 07:04:01 2021-04-27 02:20:19 2021-04-27 02:41:39 0:21:20 0:10:13 0:11:07 gibba master ubuntu 18.04 rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_18.04} 2-node-mgr orchestrator_cli} 2
Failure Reason:

"2021-04-27T02:35:56.189503+0000 mgr.y (mgr.4099) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055445 2021-04-18 07:04:02 2021-04-27 02:20:20 2021-04-27 02:48:14 0:27:54 0:14:10 0:13:44 gibba master rhel 8.3 rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} 1
fail 6055446 2021-04-18 07:04:03 2021-04-27 02:27:51 2021-04-27 02:56:14 0:28:23 0:14:53 0:13:30 gibba master rhel 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/crash} 2
Failure Reason:

"2021-04-27T02:52:43.052688+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055447 2021-04-18 07:04:04 2021-04-27 02:35:32 2021-04-27 02:54:14 0:18:42 0:13:18 0:05:24 gibba master rhel 8.3 rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 6055448 2021-04-18 07:04:05 2021-04-27 02:35:32 2021-04-27 03:31:26 0:55:54 0:38:40 0:17:14 gibba master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} 2
pass 6055449 2021-04-18 07:04:05 2021-04-27 02:41:46 2021-04-27 03:04:44 0:22:58 0:11:52 0:11:06 gibba master centos 8.2 rados/cephadm/smoke/{distro/centos_8.2_kubic_stable fixed-2 mon_election/classic start} 2
pass 6055450 2021-04-18 07:04:06 2021-04-27 02:43:36 2021-04-27 03:35:27 0:51:51 0:36:27 0:15:24 gibba master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} 3
pass 6055451 2021-04-18 07:04:08 2021-04-27 02:48:23 2021-04-27 03:10:56 0:22:33 0:10:55 0:11:38 gibba master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} 2
pass 6055452 2021-04-18 07:04:08 2021-04-27 02:50:23 2021-04-27 03:19:07 0:28:44 0:18:21 0:10:23 gibba master rhel 8.3 rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} 1
fail 6055453 2021-04-18 07:04:09 2021-04-27 02:54:18 2021-04-27 03:19:10 0:24:52 0:13:01 0:11:51 gibba master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_cls_all} 2
Failure Reason:

"2021-04-27T03:10:23.711091+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055454 2021-04-18 07:04:10 2021-04-27 02:56:31 2021-04-27 03:43:27 0:46:56 0:28:44 0:18:12 gibba master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} 2
pass 6055455 2021-04-18 07:04:11 2021-04-27 03:04:59 2021-04-27 03:31:53 0:26:54 0:14:09 0:12:45 gibba master rhel 8.3 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6055456 2021-04-18 07:04:12 2021-04-27 03:11:06 2021-04-27 03:39:54 0:28:48 0:14:39 0:14:09 gibba master rhel 8.3 rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 2
pass 6055457 2021-04-18 07:04:13 2021-04-27 03:19:12 2021-04-27 03:40:20 0:21:08 0:11:30 0:09:38 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4K_rand_read} 1
pass 6055458 2021-04-18 07:04:13 2021-04-27 03:19:12 2021-04-27 04:04:19 0:45:07 0:36:34 0:08:33 gibba master ubuntu 20.04 rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/erasure-code} 1
pass 6055459 2021-04-18 07:04:15 2021-04-27 03:19:13 2021-04-27 03:48:13 0:29:00 0:08:02 0:20:58 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_adoption} 1
fail 6055460 2021-04-18 07:04:16 2021-04-27 03:31:31 2021-04-27 04:09:41 0:38:10 0:27:47 0:10:23 gibba master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

"2021-04-27T03:46:29.544563+0000 mgr.y (mgr.4115) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055461 2021-04-18 07:04:16 2021-04-27 03:32:02 2021-04-27 04:03:38 0:31:36 0:16:11 0:15:25 gibba master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} 2
Failure Reason:

"2021-04-27T03:49:51.707146+0000 mgr.x (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055462 2021-04-18 07:04:17 2021-04-27 03:35:36 2021-04-27 04:15:52 0:40:16 0:25:00 0:15:16 gibba master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/connectivity} 2
fail 6055463 2021-04-18 07:04:18 2021-04-27 03:39:57 2021-04-27 04:15:52 0:35:55 0:28:39 0:07:16 gibba master rhel 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} 2
Failure Reason:

"2021-04-27T03:58:15.667798+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055464 2021-04-18 07:04:19 2021-04-27 03:40:28 2021-04-27 04:04:16 0:23:48 0:15:06 0:08:42 gibba master rhel 8.3 rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 2
pass 6055465 2021-04-18 07:04:20 2021-04-27 03:43:29 2021-04-27 04:05:40 0:22:11 0:07:37 0:14:34 gibba master centos 8.3 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6055466 2021-04-18 07:04:20 2021-04-27 03:48:15 2021-04-27 04:24:42 0:36:27 0:12:22 0:24:05 gibba master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable 1-start 2-services/mirror 3-final} 2
fail 6055467 2021-04-18 07:04:21 2021-04-27 04:03:48 2021-04-27 04:36:04 0:32:16 0:21:00 0:11:16 gibba master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} 2
Failure Reason:

"2021-04-27T04:19:10.486719+0000 mgr.x (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055468 2021-04-18 07:04:22 2021-04-27 04:04:19 2021-04-27 04:26:54 0:22:35 0:14:51 0:07:44 gibba master rhel 8.3 rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 mon_election/connectivity start} 2
fail 6055469 2021-04-18 07:04:23 2021-04-27 04:05:49 2021-04-27 04:39:40 0:33:51 0:10:05 0:23:46 gibba master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

"2021-04-27T04:33:46.005537+0000 mgr.y (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055470 2021-04-18 07:04:24 2021-04-27 04:15:54 2021-04-27 05:01:51 0:45:57 0:25:22 0:20:35 gibba master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
fail 6055471 2021-04-18 07:04:25 2021-04-27 04:24:43 2021-04-27 06:09:58 1:45:15 1:33:16 0:11:59 gibba master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

"2021-04-27T04:51:14.320822+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055472 2021-04-18 07:04:26 2021-04-27 04:27:04 2021-04-27 04:57:35 0:30:31 0:15:16 0:15:15 gibba master rhel 8.3 rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 2
fail 6055473 2021-04-18 07:04:27 2021-04-27 04:36:12 2021-04-27 05:18:26 0:42:14 0:31:45 0:10:29 gibba master rhel 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} 2
Failure Reason:

"2021-04-27T04:57:20.017702+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055474 2021-04-18 07:04:28 2021-04-27 04:39:46 2021-04-27 04:56:25 0:16:39 0:07:13 0:09:26 gibba master centos 8.3 rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 1
pass 6055475 2021-04-18 07:04:28 2021-04-27 04:39:46 2021-04-27 05:02:25 0:22:39 0:14:21 0:08:18 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm} 1
pass 6055476 2021-04-18 07:04:29 2021-04-27 04:39:46 2021-04-27 04:54:24 0:14:38 0:05:28 0:09:10 gibba master centos 8.3 rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
fail 6055477 2021-04-18 07:04:31 2021-04-27 04:39:46 2021-04-27 05:19:47 0:40:01 0:12:14 0:27:47 gibba master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} 2
Failure Reason:

"2021-04-27T05:10:57.403477+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055478 2021-04-18 07:04:32 2021-04-27 04:56:25 2021-04-27 05:15:17 0:18:52 0:09:17 0:09:35 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_4K_seq_read} 1
fail 6055479 2021-04-18 07:04:33 2021-04-27 04:57:35 2021-04-27 05:25:18 0:27:43 0:16:51 0:10:52 gibba master rhel 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/failover} 2
Failure Reason:

"2021-04-27T05:19:40.491635+0000 mgr.z (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055480 2021-04-18 07:04:34 2021-04-27 08:46:54 2021-04-27 09:03:51 0:16:57 0:08:43 0:08:14 gibba master ubuntu 20.04 rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/mgr} 1
pass 6055481 2021-04-18 07:04:34 2021-04-27 08:46:54 2021-04-27 09:20:50 0:33:56 0:20:25 0:13:31 gibba master ubuntu 18.04 rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
fail 6055482 2021-04-18 07:04:35 2021-04-27 08:51:40 2021-04-27 09:26:58 0:35:18 0:23:51 0:11:27 gibba master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} 2
Failure Reason:

"2021-04-27T09:06:24.766959+0000 mgr.y (mgr.4120) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055483 2021-04-18 07:04:36 2021-04-27 08:51:41 2021-04-27 09:30:07 0:38:26 0:31:31 0:06:55 gibba master rhel 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} 2
pass 6055484 2021-04-18 07:04:37 2021-04-27 08:53:03 2021-04-27 09:22:07 0:29:04 0:23:40 0:05:24 gibba master rhel 8.3 rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} 1
pass 6055485 2021-04-18 07:04:38 2021-04-27 08:53:03 2021-04-27 10:29:33 1:36:30 1:18:50 0:17:40 gibba master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} 3
pass 6055486 2021-04-18 07:04:39 2021-04-27 09:00:01 2021-04-27 09:59:07 0:59:06 0:32:14 0:26:52 gibba master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} 2
pass 6055487 2021-04-18 07:04:40 2021-04-27 09:18:09 2021-04-27 09:43:07 0:24:58 0:18:12 0:06:46 gibba master rhel 8.3 rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
pass 6055488 2021-04-18 07:04:41 2021-04-27 09:18:09 2021-04-27 09:33:22 0:15:13 0:05:48 0:09:25 gibba master ubuntu 20.04 rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6055489 2021-04-18 07:04:41 2021-04-27 09:18:09 2021-04-27 09:43:56 0:25:47 0:17:18 0:08:29 gibba master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/rgw-ingress 3-final} 2
fail 6055490 2021-04-18 07:04:42 2021-04-27 09:21:00 2021-04-27 10:02:26 0:41:26 0:28:41 0:12:45 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps} 2
Failure Reason:

"2021-04-27T09:44:24.941048+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055491 2021-04-18 07:04:43 2021-04-27 09:27:08 2021-04-27 10:06:26 0:39:18 0:32:20 0:06:58 gibba master rhel 8.3 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2021-04-27T09:47:59.095406+0000 mgr.x (mgr.6312) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055492 2021-04-18 07:04:44 2021-04-27 09:27:08 2021-04-27 09:53:32 0:26:24 0:13:05 0:13:19 gibba master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2
fail 6055493 2021-04-18 07:04:45 2021-04-27 09:30:17 2021-04-27 10:23:07 0:52:50 0:28:58 0:23:52 gibba master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

"2021-04-27T09:58:11.244316+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055494 2021-04-18 07:04:46 2021-04-27 09:43:17 2021-04-27 10:09:00 0:25:43 0:16:17 0:09:26 gibba master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} 1
Failure Reason:

"2021-04-27T10:06:56.013898+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055495 2021-04-18 07:04:47 2021-04-27 09:43:58 2021-04-27 10:35:34 0:51:36 0:31:39 0:19:57 gibba master centos 8.3 rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} 2
pass 6055496 2021-04-18 07:04:48 2021-04-27 09:53:37 2021-04-27 10:08:21 0:14:44 0:06:57 0:07:47 gibba master centos 8.3 rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
pass 6055497 2021-04-18 07:04:48 2021-04-27 09:53:38 2021-04-27 10:14:07 0:20:29 0:05:17 0:15:12 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm_repos} 1
pass 6055498 2021-04-18 07:04:49 2021-04-27 09:59:15 2021-04-27 10:17:06 0:17:51 0:09:40 0:08:11 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4M_rand_read} 1
fail 6055499 2021-04-18 07:04:50 2021-04-27 09:59:15 2021-04-27 10:25:18 0:26:03 0:16:35 0:09:28 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache} 2
Failure Reason:

"2021-04-27T10:19:53.178100+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055500 2021-04-18 07:04:51 2021-04-27 10:02:35 2021-04-27 10:41:58 0:39:23 0:25:49 0:13:34 gibba master ubuntu 20.04 rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/misc} 1
pass 6055501 2021-04-18 07:04:52 2021-04-27 10:06:31 2021-04-27 10:42:27 0:35:56 0:24:13 0:11:43 gibba master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/classic} 2
fail 6055502 2021-04-18 07:04:52 2021-04-27 10:09:01 2021-04-27 10:42:27 0:33:26 0:15:06 0:18:20 gibba master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} 2
Failure Reason:

"2021-04-27T10:31:51.350689+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055503 2021-04-18 07:04:53 2021-04-27 10:17:15 2021-04-27 10:48:46 0:31:31 0:16:52 0:14:39 gibba master ubuntu 20.04 rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

timed out waiting for admin_socket to appear after osd.0 restart

fail 6055504 2021-04-18 07:04:54 2021-04-27 10:23:16 2021-04-27 10:50:47 0:27:31 0:09:20 0:18:11 gibba master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

"2021-04-27T10:46:01.221249+0000 mgr.x (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055505 2021-04-18 07:04:55 2021-04-27 10:29:43 2021-04-27 11:10:21 0:40:38 0:30:46 0:09:52 gibba master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} 2
pass 6055506 2021-04-18 07:04:56 2021-04-27 10:29:44 2021-04-27 10:54:47 0:25:03 0:14:05 0:10:58 gibba master rhel 8.3 rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} 1
pass 6055507 2021-04-18 07:04:57 2021-04-27 10:35:35 2021-04-27 11:03:43 0:28:08 0:15:26 0:12:42 gibba master rhel 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
fail 6055508 2021-04-18 07:04:57 2021-04-27 10:42:32 2021-04-27 11:01:43 0:19:11 0:09:29 0:09:42 gibba master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} 2
Failure Reason:

"2021-04-27T10:57:02.385012+0000 mgr.x (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055509 2021-04-18 07:05:59 2021-04-27 10:42:32 2021-04-27 11:08:21 0:25:49 0:12:40 0:13:09 gibba master rhel 8.3 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 2
Failure Reason:

"2021-04-27T11:05:41.463644+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055510 2021-04-18 07:06:03 2021-04-27 10:48:54 2021-04-27 11:28:22 0:39:28 0:28:01 0:11:27 gibba master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} 2
Failure Reason:

"2021-04-27T11:05:11.458919+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055511 2021-04-18 07:06:04 2021-04-27 10:50:57 2021-04-27 11:14:21 0:23:24 0:16:15 0:07:09 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/dedup-io-mixed} 2
Failure Reason:

"2021-04-27T11:08:17.477860+0000 mgr.x (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055512 2021-04-18 07:06:04 2021-04-27 10:50:57 2021-04-27 11:45:05 0:54:08 0:33:36 0:20:32 gibba master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
fail 6055513 2021-04-18 07:06:05 2021-04-27 11:01:51 2021-04-27 11:22:23 0:20:32 0:08:51 0:11:41 gibba master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/insights} 2
Failure Reason:

"2021-04-27T11:17:19.628762+0000 mgr.x (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055514 2021-04-18 07:06:06 2021-04-27 11:03:49 2021-04-27 11:36:45 0:32:56 0:27:28 0:05:28 gibba master rhel 8.3 rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
pass 6055515 2021-04-18 07:06:07 2021-04-27 11:03:49 2021-04-27 13:10:46 2:06:57 1:48:49 0:18:08 gibba master rhel 8.3 rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{rhel_8}} 1
fail 6055516 2021-04-18 07:06:08 2021-04-27 11:03:49 2021-04-27 11:42:22 0:38:33 0:23:55 0:14:38 gibba master ubuntu 20.04 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
Failure Reason:

"2021-04-27T11:22:30.203866+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

dead 6055517 2021-04-18 07:06:08 2021-04-27 11:08:32 2021-04-27 11:22:49 0:14:17 gibba master ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/rgw 3-final} 2
Failure Reason:

SSH connection to gibba015 was lost: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic'

pass 6055518 2021-04-18 07:06:09 2021-04-27 11:09:42 2021-04-27 11:50:26 0:40:44 0:30:17 0:10:27 gibba master ubuntu 20.04 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/snaps-few-objects} 2
fail 6055519 2021-04-18 07:06:10 2021-04-27 11:10:22 2021-04-27 11:18:49 0:08:27 gibba master centos 8.3 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Command failed on gibba008 with status 100: 'sudo apt-get clean'

dead 6055520 2021-04-18 07:06:11 2021-04-27 11:10:23 2021-04-27 11:18:49 0:08:26 gibba master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} 3
Failure Reason:

SSH connection to gibba008 was lost: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic'

pass 6055521 2021-04-18 07:06:12 2021-04-27 11:11:53 2021-04-27 11:37:38 0:25:45 0:13:34 0:12:11 gibba master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
dead 6055522 2021-04-18 07:06:13 2021-04-27 11:14:28 2021-04-27 11:29:40 0:15:12 gibba master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/dedup-io-snaps} 2
Failure Reason:

SSH connection to gibba032 was lost: 'uname -r'

dead 6055523 2021-04-18 07:06:14 2021-04-27 11:18:58 2021-04-27 11:29:43 0:10:45 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4M_seq_read} 1
Failure Reason:

SSH connection to gibba015 was lost: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic'

fail 6055524 2021-04-18 07:06:14 2021-04-27 11:18:58 2021-04-27 11:45:04 0:26:06 0:14:01 0:12:05 gibba master centos 8.3 rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/mon} 1
Failure Reason:

Command failed (workunit test mon/mon-bind.sh) on gibba044 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6adfd148cc792c27e30c9664da5f2a1a3a2d4e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh'

fail 6055525 2021-04-18 07:06:15 2021-04-27 11:22:30 2021-04-27 11:29:44 0:07:14 gibba master ubuntu 20.04 rados/upgrade/pacific-x/rgw-multisite/{clusters frontend overrides realm supported-random-distro$/{ubuntu_latest} tasks upgrade/secondary} 2
Failure Reason:

Command failed on gibba015 with status 100: 'sudo apt-get clean'

pass 6055526 2021-04-18 07:06:16 2021-04-27 11:22:50 2021-04-27 11:49:07 0:26:17 0:13:57 0:12:20 gibba master rhel 8.3 rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} 2
pass 6055527 2021-04-18 07:06:17 2021-04-27 11:28:27 2021-04-27 11:55:07 0:26:40 0:18:33 0:08:07 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_orch_cli} 1
pass 6055528 2021-04-18 07:06:18 2021-04-27 11:28:27 2021-04-27 11:46:10 0:17:43 0:07:40 0:10:03 gibba master centos 8.3 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} 1
fail 6055529 2021-04-18 07:06:19 2021-04-27 11:29:49 2021-04-27 12:07:17 0:37:28 0:30:23 0:07:05 gibba master rhel 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

"2021-04-27T11:47:21.347109+0000 mgr.x (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055530 2021-04-18 07:06:20 2021-04-27 11:29:49 2021-04-27 12:00:26 0:30:37 0:12:48 0:17:49 gibba master centos 8.2 rados/cephadm/smoke/{distro/centos_8.2_kubic_stable fixed-2 mon_election/connectivity start} 2
fail 6055531 2021-04-18 07:06:21 2021-04-27 11:37:39 2021-04-27 12:19:36 0:41:57 0:32:07 0:09:50 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} 2
Failure Reason:

"2021-04-27T11:59:31.963640+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055532 2021-04-18 07:06:22 2021-04-27 11:42:25 2021-04-27 11:59:57 0:17:32 0:09:11 0:08:21 gibba master rhel 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_striper} 2
Failure Reason:

"2021-04-27T11:58:12.902334+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055533 2021-04-18 07:06:23 2021-04-27 11:45:05 2021-04-27 12:40:18 0:55:13 0:45:56 0:09:17 gibba master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} 2
pass 6055534 2021-04-18 07:06:24 2021-04-27 11:45:05 2021-04-27 12:06:53 0:21:48 0:14:29 0:07:19 gibba master rhel 8.3 rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} 1
pass 6055535 2021-04-18 07:06:25 2021-04-27 11:46:26 2021-04-27 12:06:17 0:19:51 0:08:02 0:11:49 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_adoption} 1
fail 6055536 2021-04-18 07:06:26 2021-04-27 11:49:50 2021-04-27 12:10:47 0:20:57 0:14:48 0:06:09 gibba master rhel 8.3 rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2021-04-27T12:06:55.417818+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055537 2021-04-18 07:06:27 2021-04-27 11:49:50 2021-04-27 12:23:36 0:33:46 0:16:09 0:17:37 gibba master rhel 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

"2021-04-27T12:18:27.913211+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055538 2021-04-18 07:06:28 2021-04-27 12:00:03 2021-04-27 12:33:37 0:33:34 0:24:23 0:09:11 gibba master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/rados_api_tests} 2
Failure Reason:

"2021-04-27T12:14:40.458881+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055539 2021-04-18 07:06:29 2021-04-27 12:00:33 2021-04-27 12:29:37 0:29:04 0:12:52 0:16:12 gibba master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/basic 3-final} 2
pass 6055540 2021-04-18 07:06:30 2021-04-27 12:06:27 2021-04-27 12:27:37 0:21:10 0:11:15 0:09:55 gibba master centos 8.3 rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} 1
pass 6055541 2021-04-18 07:06:31 2021-04-27 12:06:58 2021-04-27 12:50:45 0:43:47 0:28:29 0:15:18 gibba master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
fail 6055542 2021-04-18 07:06:31 2021-04-27 12:10:58 2021-04-27 13:13:09 1:02:11 0:42:46 0:19:25 gibba master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

"2021-04-27T12:47:35.140873+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055543 2021-04-18 07:06:32 2021-04-27 12:19:39 2021-04-27 12:40:33 0:20:54 0:08:55 0:11:59 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_4M_write} 1
pass 6055544 2021-04-18 07:06:33 2021-04-27 12:23:40 2021-04-27 14:10:26 1:46:46 1:37:22 0:09:24 gibba master centos 8.3 rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/osd-backfill} 1
pass 6055545 2021-04-18 07:06:34 2021-04-27 12:23:40 2021-04-27 12:46:45 0:23:05 0:13:01 0:10:04 gibba master rhel 8.3 rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} 3
fail 6055546 2021-04-18 07:06:35 2021-04-27 12:27:42 2021-04-27 14:34:33 2:06:51 1:53:56 0:12:55 gibba master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} 2
Failure Reason:

"2021-04-27T12:44:44.542524+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055547 2021-04-18 07:06:36 2021-04-27 12:29:38 2021-04-27 13:04:46 0:35:08 0:19:54 0:15:14 gibba master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/module_selftest} 2
Failure Reason:

"2021-04-27T12:48:16.902571+0000 mgr.z (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055548 2021-04-18 07:06:36 2021-04-27 12:33:46 2021-04-27 13:11:31 0:37:45 0:22:25 0:15:20 gibba master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/connectivity} 2
pass 6055549 2021-04-18 07:06:37 2021-04-27 12:40:28 2021-04-27 15:39:01 2:58:33 2:30:53 0:27:40 gibba master ubuntu 20.04 rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{ubuntu_latest}} 1
pass 6055550 2021-04-18 07:06:38 2021-04-27 12:40:38 2021-04-27 13:14:35 0:33:57 0:21:50 0:12:07 gibba master rhel 8.3 rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} 1
fail 6055551 2021-04-18 07:06:39 2021-04-27 12:46:47 2021-04-27 13:26:47 0:40:00 0:28:19 0:11:41 gibba master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} 2
Failure Reason:

"2021-04-27T13:02:35.884848+0000 mgr.x (mgr.4099) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055552 2021-04-18 07:06:40 2021-04-27 12:46:47 2021-04-27 13:20:04 0:33:17 0:20:21 0:12:56 gibba master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_kubic_stable fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
pass 6055553 2021-04-18 07:06:40 2021-04-27 12:50:55 2021-04-27 13:33:15 0:42:20 0:23:35 0:18:45 gibba master rhel 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/one workloads/pool-create-delete} 2
pass 6055554 2021-04-18 07:06:41 2021-04-27 13:04:48 2021-04-27 14:46:57 1:42:09 1:30:38 0:11:31 gibba master rhel 8.3 rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} 2
pass 6055555 2021-04-18 07:06:42 2021-04-27 13:10:53 2021-04-27 14:04:28 0:53:35 0:40:27 0:13:08 gibba master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} 3
pass 6055556 2021-04-18 07:06:43 2021-04-27 13:13:14 2021-04-27 13:35:43 0:22:29 0:14:53 0:07:36 gibba master rhel 8.3 rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 mon_election/classic start} 2
fail 6055557 2021-04-18 07:06:44 2021-04-27 13:14:45 2021-04-27 13:58:25 0:43:40 0:27:51 0:15:49 gibba master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} 2
Failure Reason:

"2021-04-27T13:33:47.209173+0000 mgr.x (mgr.4115) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055558 2021-04-18 07:06:44 2021-04-27 13:20:10 2021-04-27 14:04:25 0:44:15 0:31:18 0:12:57 gibba master rhel 8.3 rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} 2
pass 6055559 2021-04-18 07:06:45 2021-04-27 13:26:52 2021-04-27 13:56:26 0:29:34 0:13:59 0:15:35 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm} 1
fail 6055560 2021-04-18 07:06:46 2021-04-27 13:33:24 2021-04-27 15:23:01 1:49:37 1:36:35 0:13:02 gibba master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench} 2
Failure Reason:

"2021-04-27T13:50:15.987970+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055561 2021-04-18 07:06:47 2021-04-27 13:35:54 2021-04-27 14:32:08 0:56:14 0:29:12 0:27:02 gibba master rhel 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

"2021-04-27T14:14:01.787018+0000 mgr.y (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055562 2021-04-18 07:06:47 2021-04-27 13:56:33 2021-04-27 14:34:08 0:37:35 0:25:56 0:11:39 gibba master centos 8.3 rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} 2
pass 6055563 2021-04-18 07:06:48 2021-04-27 13:58:35 2021-04-27 14:24:59 0:26:24 0:11:19 0:15:05 gibba master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable 1-start 2-services/iscsi 3-final} 2
fail 6055564 2021-04-18 07:06:49 2021-04-27 14:04:26 2021-04-27 14:42:09 0:37:43 0:25:58 0:11:45 gibba master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} 2
Failure Reason:

"2021-04-27T14:19:52.728863+0000 mgr.y (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055565 2021-04-18 07:06:50 2021-04-27 14:04:36 2021-04-27 17:13:47 3:09:11 2:51:38 0:17:33 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_omap_write} 1
Failure Reason:

reached maximum tries (1550) after waiting for 9300 seconds

pass 6055566 2021-04-18 07:06:51 2021-04-27 14:04:37 2021-04-27 15:55:03 1:50:26 1:35:50 0:14:36 gibba master centos 8.3 rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/osd} 1
pass 6055567 2021-04-18 07:06:51 2021-04-27 14:10:27 2021-04-27 15:03:32 0:53:05 0:27:59 0:25:06 gibba master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} 2
pass 6055568 2021-04-18 07:06:52 2021-04-27 14:25:05 2021-04-27 14:57:24 0:32:19 0:15:54 0:16:25 gibba master ubuntu 20.04 rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
fail 6055569 2021-04-18 07:06:53 2021-04-27 14:32:16 2021-04-27 14:55:25 0:23:09 0:11:22 0:11:47 gibba master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect} 2
Failure Reason:

"2021-04-27T14:49:00.092414+0000 mgr.x (mgr.4144) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055570 2021-04-18 07:06:54 2021-04-27 14:34:17 2021-04-27 15:05:25 0:31:08 0:11:24 0:19:44 gibba master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

"2021-04-27T15:00:30.372781+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055571 2021-04-18 07:06:55 2021-04-27 14:42:17 2021-04-27 15:14:08 0:31:51 0:18:04 0:13:47 gibba master centos 8.3 rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} 2
pass 6055572 2021-04-18 07:06:55 2021-04-27 14:47:00 2021-04-27 15:39:04 0:52:04 0:38:10 0:13:54 gibba master rhel 8.3 rados/cephadm/with-work/{0-distro/rhel_8.3_kubic_stable fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} 2
pass 6055573 2021-04-18 07:06:56 2021-04-27 14:55:33 2021-04-27 15:31:03 0:35:30 0:25:40 0:09:50 gibba master ubuntu 20.04 rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
pass 6055574 2021-04-18 07:06:57 2021-04-27 14:55:33 2021-04-27 15:27:44 0:32:11 0:13:47 0:18:24 gibba master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} 2
pass 6055575 2021-04-18 07:06:58 2021-04-27 15:03:38 2021-04-27 15:27:01 0:23:23 0:15:46 0:07:37 gibba master rhel 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
fail 6055576 2021-04-18 07:06:59 2021-04-27 15:05:29 2021-04-27 15:29:02 0:23:33 0:13:29 0:10:04 gibba master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep} 2
Failure Reason:

"2021-04-27T15:19:51.207132+0000 mgr.x (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055577 2021-04-18 07:06:59 2021-04-27 15:05:29 2021-04-27 15:49:48 0:44:19 0:25:19 0:19:00 gibba master centos 8.3 rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_8}} 1
fail 6055578 2021-04-18 07:07:00 2021-04-27 15:14:15 2021-04-27 15:46:25 0:32:10 0:12:55 0:19:15 gibba master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/progress} 2
Failure Reason:

Test failure: test_pool_removal (tasks.mgr.test_progress.TestProgress)

pass 6055579 2021-04-18 07:07:01 2021-04-27 15:23:08 2021-04-27 15:38:09 0:15:01 0:05:41 0:09:20 gibba master ubuntu 20.04 rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} 1
pass 6055580 2021-04-18 07:07:02 2021-04-27 15:23:08 2021-04-27 15:58:25 0:35:17 0:19:25 0:15:52 gibba master ubuntu 20.04 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} 3
fail 6055581 2021-04-18 07:07:03 2021-04-27 15:27:09 2021-04-27 15:56:42 0:29:33 0:19:17 0:10:16 gibba master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} 2
Failure Reason:

"2021-04-27T15:42:10.310530+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055582 2021-04-18 07:07:04 2021-04-27 15:27:49 2021-04-27 15:48:25 0:20:36 0:08:52 0:11:44 gibba master ubuntu 20.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests} 2
Failure Reason:

"2021-04-27T15:43:57.670014+0000 mgr.x (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055583 2021-04-18 07:07:04 2021-04-27 15:29:10 2021-04-27 15:46:25 0:17:15 0:05:34 0:11:41 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm_repos} 1
pass 6055584 2021-04-18 07:07:05 2021-04-27 15:31:11 2021-04-27 16:16:08 0:44:57 0:30:14 0:14:43 gibba master rhel 8.3 rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 2
fail 6055585 2021-04-18 07:07:06 2021-04-27 15:39:06 2021-04-27 16:05:57 0:26:51 0:17:37 0:09:14 gibba master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} 2
Failure Reason:

"2021-04-27T15:53:00.687718+0000 mgr.x (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055586 2021-04-18 07:07:09 2021-04-27 15:39:06 2021-04-27 16:22:13 0:43:07 0:25:42 0:17:25 gibba master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/classic} 2
pass 6055587 2021-04-18 07:07:09 2021-04-27 15:46:35 2021-04-27 16:07:08 0:20:33 0:08:42 0:11:51 gibba master centos 8.3 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_5925} 2
pass 6055588 2021-04-18 07:07:10 2021-04-27 15:48:26 2021-04-27 16:09:32 0:21:06 0:12:28 0:08:38 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/sample_fio} 1
pass 6055589 2021-04-18 07:07:11 2021-04-27 15:48:26 2021-04-27 16:24:13 0:35:47 0:16:00 0:19:47 gibba master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} 3
fail 6055590 2021-04-18 07:07:12 2021-04-27 15:56:47 2021-04-27 16:17:18 0:20:31 0:12:52 0:07:39 gibba master centos 8.3 rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/scrub} 1
Failure Reason:

Command failed (workunit test scrub/osd-recovery-scrub.sh) on gibba041 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6adfd148cc792c27e30c9664da5f2a1a3a2d4e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh'

pass 6055591 2021-04-18 07:07:12 2021-04-27 15:56:47 2021-04-27 16:19:16 0:22:29 0:12:20 0:10:09 gibba master centos 8.3 rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} 1
pass 6055592 2021-04-18 07:07:13 2021-04-27 15:58:27 2021-04-27 16:19:19 0:20:52 0:15:02 0:05:50 gibba master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/mirror 3-final} 2
pass 6055593 2021-04-18 07:07:14 2021-04-27 15:58:28 2021-04-27 16:30:48 0:32:20 0:19:01 0:13:19 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} 2
pass 6055594 2021-04-18 07:07:15 2021-04-27 16:06:00 2021-04-27 16:24:13 0:18:13 0:07:21 0:10:52 gibba master centos 8.3 rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} 1
pass 6055595 2021-04-18 07:07:16 2021-04-27 16:07:11 2021-04-27 16:50:30 0:43:19 0:31:45 0:11:34 gibba master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} 2
fail 6055596 2021-04-18 07:07:16 2021-04-27 16:09:42 2021-04-27 16:53:05 0:43:23 0:27:31 0:15:52 gibba master centos 8.3 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

"2021-04-27T16:30:19.771025+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055597 2021-04-18 07:07:17 2021-04-27 16:16:16 2021-04-27 16:44:24 0:28:08 0:14:24 0:13:44 gibba master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} 2
pass 6055598 2021-04-18 07:07:18 2021-04-28 00:24:59 2021-04-28 00:45:26 0:20:27 0:14:19 0:06:08 gibba master rhel 8.3 rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
fail 6055599 2021-04-18 07:07:19 2021-04-28 00:24:59 2021-04-28 00:57:03 0:32:04 0:19:17 0:12:47 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/set-chunks-read} 2
Failure Reason:

"2021-04-28T00:46:27.829280+0000 mgr.x (mgr.4099) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055600 2021-04-18 07:07:20 2021-04-28 00:29:01 2021-04-28 00:43:59 0:14:58 0:06:27 0:08:31 gibba master centos 8.3 rados/singleton/{all/admin-socket mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} 1
pass 6055601 2021-04-18 07:07:20 2021-04-28 00:29:01 2021-04-28 00:57:03 0:28:02 0:18:32 0:09:30 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_orch_cli} 1
fail 6055602 2021-04-18 07:07:21 2021-04-28 00:29:01 2021-04-28 01:01:04 0:32:03 0:10:20 0:21:43 gibba master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

"2021-04-28T00:56:43.547297+0000 mgr.y (mgr.4130) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055603 2021-04-18 07:07:22 2021-04-28 00:39:22 2021-04-28 01:17:05 0:37:43 0:21:04 0:16:39 gibba master ubuntu 18.04 rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} 2
pass 6055604 2021-04-18 07:07:23 2021-04-28 00:45:29 2021-04-28 01:16:21 0:30:52 0:09:11 0:21:41 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/sample_radosbench} 1
fail 6055605 2021-04-18 07:07:24 2021-04-28 00:57:03 2021-04-28 01:54:49 0:57:46 0:46:58 0:10:48 gibba master ubuntu 20.04 rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/dashboard} 2
Failure Reason:

"2021-04-28T01:11:07.630983+0000 mgr.z (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055606 2021-04-18 07:07:25 2021-04-28 00:57:14 2021-04-28 01:14:22 0:17:08 0:06:52 0:10:16 gibba master ubuntu 20.04 rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} 1
pass 6055607 2021-04-18 07:07:25 2021-04-28 00:59:12 2021-04-28 01:20:22 0:21:10 0:14:17 0:06:53 gibba master rhel 8.3 rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} 1
pass 6055608 2021-04-18 07:07:26 2021-04-28 00:59:12 2021-04-28 01:22:22 0:23:10 0:12:44 0:10:26 gibba master ubuntu 20.04 rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6055609 2021-04-18 07:07:27 2021-04-28 01:01:08 2021-04-28 01:22:22 0:21:14 0:16:16 0:04:58 gibba master rhel 8.3 rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/crush} 1
pass 6055610 2021-04-18 07:07:28 2021-04-28 01:01:09 2021-04-28 02:33:04 1:31:55 1:21:59 0:09:56 gibba master ubuntu 18.04 rados/upgrade/pacific-x/parallel/{0-start 1-tasks distro1$/{ubuntu_18.04} mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} 2
fail 6055611 2021-04-18 07:07:29 2021-04-28 01:01:09 2021-04-28 01:28:22 0:27:13 0:16:41 0:10:32 gibba master centos 8.3 rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} 1
Failure Reason:

"2021-04-28T01:26:11.082469+0000 mgr.y (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055612 2021-04-18 07:07:30 2021-04-28 01:03:09 2021-04-28 01:43:43 0:40:34 0:20:03 0:20:31 gibba master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-balanced} 2
Failure Reason:

"2021-04-28T01:29:09.190902+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055613 2021-04-18 07:07:30 2021-04-28 01:14:31 2021-04-28 01:33:42 0:19:11 0:06:55 0:12:16 gibba master centos 8.3 rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
fail 6055614 2021-04-18 07:07:31 2021-04-28 01:16:22 2021-04-28 01:30:03 0:13:41 gibba master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} 2
Failure Reason:

Could not reconnect to ubuntu@gibba008.front.sepia.ceph.com

fail 6055615 2021-04-18 07:07:32 2021-04-28 01:17:13 2021-04-28 01:41:46 0:24:33 0:07:37 0:16:56 gibba master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/prometheus} 2
Failure Reason:

"2021-04-28T01:36:50.024765+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055616 2021-04-18 07:07:33 2021-04-28 01:22:32 2021-04-28 01:48:49 0:26:17 0:16:26 0:09:51 gibba master ubuntu 18.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 1-start 2-services/rgw-ingress 3-final} 2
pass 6055617 2021-04-18 07:07:34 2021-04-28 01:23:43 2021-04-28 02:11:18 0:47:35 0:30:21 0:17:14 gibba master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
fail 6055618 2021-04-18 07:07:34 2021-04-28 01:30:12 2021-04-28 03:13:03 1:42:51 1:28:55 0:13:56 gibba master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} 2
Failure Reason:

"2021-04-28T01:58:24.556840+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

dead 6055619 2021-04-18 07:07:37 2021-04-28 01:33:48 2021-04-28 13:59:47 12:25:59 gibba master centos 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} 2
Failure Reason:

hit max job timeout

pass 6055620 2021-04-18 07:07:38 2021-04-28 01:41:53 2021-04-28 02:02:36 0:20:43 0:12:39 0:08:04 gibba master rhel 8.3 rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 2
fail 6055621 2021-04-18 07:07:39 2021-04-28 01:43:53 2021-04-28 02:15:00 0:31:07 0:18:12 0:12:55 gibba master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} 2
Failure Reason:

"2021-04-28T02:00:20.511776+0000 mgr.y (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055622 2021-04-18 07:07:39 2021-04-28 01:45:53 2021-04-28 02:15:29 0:29:36 0:16:26 0:13:10 gibba master centos 8.2 rados/cephadm/dashboard/{0-distro/centos_8.2_kubic_stable task/test_e2e} 2
pass 6055623 2021-04-18 07:07:40 2021-04-28 01:48:54 2021-04-28 02:15:55 0:27:01 0:14:06 0:12:55 gibba master rhel 8.3 rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
fail 6055624 2021-04-18 07:07:41 2021-04-28 01:54:52 2021-04-28 02:33:30 0:38:38 0:25:00 0:13:38 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} 2
Failure Reason:

"2021-04-28T02:20:19.637389+0000 mgr.y (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055625 2021-04-18 07:07:42 2021-04-28 02:02:43 2021-04-28 02:17:55 0:15:12 0:06:59 0:08:13 gibba master ubuntu 20.04 rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
fail 6055626 2021-04-18 07:07:43 2021-04-28 02:02:43 2021-04-28 02:32:07 0:29:24 0:10:37 0:18:47 gibba master centos 8.2 rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.2_kubic_stable} 2-node-mgr orchestrator_cli} 2
Failure Reason:

"2021-04-28T02:26:33.821139+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055627 2021-04-18 07:07:44 2021-04-28 02:11:18 2021-04-28 02:56:33 0:45:15 0:34:19 0:10:56 gibba master rhel 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_api_tests} 2
pass 6055628 2021-04-18 07:07:44 2021-04-28 02:15:09 2021-04-28 03:01:02 0:45:53 0:34:02 0:11:51 gibba master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} 3
pass 6055629 2021-04-18 07:07:45 2021-04-28 02:15:30 2021-04-28 02:39:26 0:23:56 0:11:59 0:11:57 gibba master centos 8.2 rados/cephadm/smoke/{distro/centos_8.2_kubic_stable fixed-2 mon_election/classic start} 2
pass 6055630 2021-04-18 07:07:46 2021-04-28 02:17:56 2021-04-28 03:12:20 0:54:24 0:31:10 0:23:14 gibba master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} 2
fail 6055631 2021-04-18 07:07:47 2021-04-28 02:32:17 2021-04-28 03:03:05 0:30:48 0:20:01 0:10:47 gibba master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects} 2
Failure Reason:

"2021-04-28T02:47:54.067369+0000 mgr.y (mgr.4098) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055632 2021-04-18 07:07:48 2021-04-28 02:33:07 2021-04-28 02:54:17 0:21:10 0:14:39 0:06:31 gibba master rhel 8.3 rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} 1
fail 6055633 2021-04-18 07:07:49 2021-04-28 02:33:37 2021-04-28 02:54:22 0:20:45 0:13:46 0:06:59 gibba master rhel 8.3 rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2021-04-28T02:50:31.684309+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055634 2021-04-18 07:07:49 2021-04-28 02:33:38 2021-04-28 03:05:03 0:31:25 0:15:11 0:16:14 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/cosbench_64K_read_write} 1
fail 6055635 2021-04-18 07:07:50 2021-04-28 02:39:36 2021-04-28 03:26:37 0:47:01 0:20:52 0:26:09 gibba master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

"2021-04-28T03:09:18.894779+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055636 2021-04-18 07:07:51 2021-04-28 02:54:28 2021-04-28 03:40:38 0:46:10 0:37:52 0:08:18 gibba master centos 8.3 rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/erasure-code} 1
pass 6055637 2021-04-18 07:07:52 2021-04-28 02:54:28 2021-04-28 03:18:36 0:24:08 0:08:52 0:15:16 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_adoption} 1
fail 6055638 2021-04-18 07:07:53 2021-04-28 02:59:05 2021-04-28 03:24:36 0:25:31 0:15:17 0:10:14 gibba master rhel 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

"2021-04-28T03:21:21.627358+0000 mgr.x (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055639 2021-04-18 07:07:53 2021-04-28 03:03:21 2021-04-28 03:22:36 0:19:15 0:12:01 0:07:14 gibba master rhel 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/readwrite} 2
Failure Reason:

"2021-04-28T03:18:25.935886+0000 mgr.x (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055640 2021-04-18 07:07:54 2021-04-28 03:05:11 2021-04-28 03:47:41 0:42:30 0:24:13 0:18:17 gibba master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/connectivity} 2
pass 6055641 2021-04-18 07:07:55 2021-04-28 03:12:29 2021-04-28 03:30:05 0:17:36 0:07:47 0:09:49 gibba master ubuntu 20.04 rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} 1
fail 6055642 2021-04-18 07:07:56 2021-04-28 03:13:09 2021-04-28 03:49:33 0:36:24 0:20:57 0:15:27 gibba master centos 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} 2
Failure Reason:

"2021-04-28T03:33:42.225140+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055643 2021-04-18 07:07:57 2021-04-28 03:18:45 2021-04-28 03:41:00 0:22:15 0:13:50 0:08:25 gibba master rhel 8.3 rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
pass 6055644 2021-04-18 07:07:57 2021-04-28 03:22:37 2021-04-28 03:41:31 0:18:54 0:09:39 0:09:15 gibba master ubuntu 20.04 rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} 1
pass 6055645 2021-04-18 07:07:58 2021-04-28 03:22:38 2021-04-28 03:49:36 0:26:58 0:14:48 0:12:10 gibba master ubuntu 20.04 rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 1-start 2-services/rgw 3-final} 2
fail 6055646 2021-04-18 07:07:59 2021-04-28 03:24:38 2021-04-28 03:43:21 0:18:43 0:07:53 0:10:50 gibba master centos 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/workunits} 2
Failure Reason:

"2021-04-28T03:40:15.094630+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055647 2021-04-18 07:08:00 2021-04-28 03:24:39 2021-04-28 03:53:21 0:28:42 0:16:16 0:12:26 gibba master rhel 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
fail 6055648 2021-04-18 07:08:01 2021-04-28 03:30:10 2021-04-28 04:01:53 0:31:43 0:11:10 0:20:33 gibba master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} 2
Failure Reason:

"2021-04-28T03:56:13.878945+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055649 2021-04-18 07:08:02 2021-04-28 03:41:04 2021-04-28 04:04:04 0:23:00 0:14:51 0:08:09 gibba master rhel 8.3 rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 mon_election/connectivity start} 2
fail 6055650 2021-04-18 07:08:03 2021-04-28 03:43:25 2021-04-28 04:03:40 0:20:15 0:05:20 0:14:55 gibba master ubuntu 20.04 rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} 2
Failure Reason:

"2021-04-28T04:02:07.255344+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

fail 6055651 2021-04-18 07:08:04 2021-04-28 03:47:50 2021-04-28 04:23:16 0:35:26 0:22:02 0:13:24 gibba master ubuntu 20.04 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} 2
Failure Reason:

"2021-04-28T04:05:15.676565+0000 mgr.y (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055652 2021-04-18 07:08:04 2021-04-28 03:49:40 2021-04-28 04:45:21 0:55:41 0:47:07 0:08:34 gibba master ubuntu 20.04 rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} 1
fail 6055653 2021-04-18 07:08:05 2021-04-28 03:49:40 2021-04-28 04:29:01 0:39:21 0:32:37 0:06:44 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} 2
Failure Reason:

"2021-04-28T04:07:05.961976+0000 mgr.x (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055654 2021-04-18 07:08:06 2021-04-28 03:49:41 2021-04-28 04:08:41 0:19:00 0:04:54 0:14:06 gibba master ubuntu 20.04 rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
pass 6055655 2021-04-18 07:08:07 2021-04-28 03:53:30 2021-04-28 04:30:40 0:37:10 0:27:11 0:09:59 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_cephadm} 1
pass 6055656 2021-04-18 07:08:08 2021-04-28 03:53:30 2021-04-28 04:29:01 0:35:31 0:25:22 0:10:09 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/cosbench_64K_write} 1
pass 6055657 2021-04-18 07:08:09 2021-04-28 03:53:30 2021-04-28 04:18:49 0:25:19 0:08:35 0:16:44 gibba master ubuntu 20.04 rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/mgr} 1
pass 6055658 2021-04-18 07:08:10 2021-04-28 04:01:55 2021-04-28 05:01:47 0:59:52 0:39:01 0:20:51 gibba master centos 8.3 rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
pass 6055659 2021-04-18 07:08:11 2021-04-28 04:03:51 2021-04-28 04:46:40 0:42:49 0:32:32 0:10:17 gibba master ubuntu 20.04 rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} 2
pass 6055660 2021-04-18 07:08:11 2021-04-28 04:04:12 2021-04-28 06:09:34 2:05:22 1:40:38 0:24:44 gibba master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} 3
pass 6055661 2021-04-18 07:08:12 2021-04-28 09:30:58 2021-04-28 09:50:24 0:19:26 0:12:44 0:06:42 gibba master rhel 8.3 rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} 1
dead 6055662 2021-04-18 07:08:13 2021-04-28 09:31:09 2021-04-28 09:32:09 0:01:00 gibba master centos 8.3 rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

fail 6055663 2021-04-18 07:08:14 2021-04-28 09:31:09 2021-04-28 10:09:08 0:37:59 0:31:50 0:06:09 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} 2
Failure Reason:

"2021-04-28T09:49:23.250749+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055664 2021-04-18 07:08:15 2021-04-28 09:31:49 2021-04-28 10:36:30 1:04:41 0:46:27 0:18:14 gibba master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} 2
dead 6055665 2021-04-18 07:08:15 2021-04-28 09:40:52 2021-04-28 09:41:52 0:01:00 gibba master centos 8.3 rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055666 2021-04-18 07:08:16 2021-04-28 09:40:52 2021-04-28 09:51:26 0:10:34 gibba master rhel 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055667 2021-04-18 07:08:17 2021-04-28 09:50:27 2021-04-28 09:52:52 0:02:25 gibba master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055668 2021-04-18 07:08:18 2021-04-28 09:51:52 2021-04-28 09:53:58 0:02:06 gibba master ubuntu 18.04 rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055669 2021-04-18 07:08:19 2021-04-28 09:52:58 2021-04-28 09:55:08 0:02:10 gibba master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055670 2021-04-18 07:08:20 2021-04-28 09:54:09 2021-04-28 10:10:12 0:16:03 gibba master ubuntu 20.04 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

Error reimaging machines: Failed to power on gibba021

pass 6055671 2021-04-18 07:08:20 2021-04-28 10:09:12 2021-04-28 11:26:34 1:17:22 1:09:36 0:07:46 gibba master rhel 8.3 rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} 1
pass 6055672 2021-04-18 07:08:21 2021-04-28 10:10:23 2021-04-28 10:24:46 0:14:23 0:05:28 0:08:55 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/classic task/test_cephadm_repos} 1
dead 6055673 2021-04-18 07:08:22 2021-04-28 10:10:23 2021-04-28 10:11:23 0:01:00 gibba master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055674 2021-04-18 07:08:23 2021-04-28 10:10:23 2021-04-28 10:12:24 0:02:01 gibba master ubuntu 20.04 rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

pass 6055675 2021-04-18 07:08:24 2021-04-28 10:11:24 2021-04-28 10:28:30 0:17:06 0:07:19 0:09:47 gibba master centos 8.3 rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} 1
pass 6055676 2021-04-18 07:08:25 2021-04-28 10:11:34 2021-04-28 10:36:03 0:24:29 0:11:43 0:12:46 gibba master centos 8.2 rados/cephadm/smoke-roleless/{0-distro/centos_8.2_kubic_stable 1-start 2-services/basic 3-final} 2
pass 6055677 2021-04-18 07:08:25 2021-04-28 10:15:15 2021-04-28 10:34:30 0:19:15 0:09:58 0:09:17 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/fio_4K_rand_read} 1
pass 6055678 2021-04-18 07:08:26 2021-04-28 10:15:15 2021-04-28 10:51:54 0:36:39 0:26:59 0:09:40 gibba master centos 8.3 rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/misc} 1
dead 6055679 2021-04-18 07:08:27 2021-04-28 10:15:15 2021-04-28 10:25:49 0:10:34 gibba master centos 8.3 rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055680 2021-04-18 07:08:28 2021-04-28 10:24:49 2021-04-28 10:26:59 0:02:10 gibba master rhel 8.3 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/crash} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055681 2021-04-18 07:08:29 2021-04-28 10:25:59 2021-04-28 10:28:00 0:02:01 gibba master rhel 8.3 rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055682 2021-04-18 07:08:30 2021-04-28 10:27:00 2021-04-28 10:29:00 0:02:00 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055683 2021-04-18 07:08:30 2021-04-28 10:28:00 2021-04-28 10:30:10 0:02:10 gibba master ubuntu 20.04 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba021

fail 6055684 2021-04-18 07:08:31 2021-04-28 10:29:11 2021-04-28 11:20:33 0:51:22 0:40:19 0:11:03 gibba master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} 2
Failure Reason:

"2021-04-28T10:56:27.822872+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

dead 6055685 2021-04-18 07:08:32 2021-04-28 10:30:21 2021-04-28 10:31:21 0:01:00 gibba master rhel 8.3 rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055686 2021-04-18 07:08:33 2021-04-28 10:30:21 2021-04-28 10:35:33 0:05:12 gibba master centos 8.2 rados/cephadm/with-work/{0-distro/centos_8.2_kubic_stable fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

pass 6055687 2021-04-18 07:08:34 2021-04-28 10:34:33 2021-04-28 11:02:42 0:28:09 0:20:02 0:08:07 gibba master rhel 8.3 rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} 3
fail 6055688 2021-04-18 07:08:35 2021-04-28 10:36:03 2021-04-28 11:09:56 0:33:53 0:20:42 0:13:11 gibba master centos 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} 2
Failure Reason:

"2021-04-28T10:53:07.783491+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055689 2021-04-18 07:08:36 2021-04-28 10:36:34 2021-04-28 11:24:35 0:48:01 0:27:02 0:20:59 gibba master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} 2
dead 6055690 2021-04-18 07:08:36 2021-04-28 10:47:35 2021-04-28 10:48:35 0:01:00 gibba master rhel 8.3 rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055691 2021-04-18 07:08:37 2021-04-28 10:47:35 2021-04-28 10:53:10 0:05:35 gibba master centos 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055692 2021-04-18 07:08:38 2021-04-28 10:52:03 2021-04-28 10:54:34 0:02:31 gibba master centos 8.3 rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055693 2021-04-18 07:08:39 2021-04-28 10:53:34 2021-04-28 10:55:42 0:02:08 gibba master ubuntu 20.04 rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055694 2021-04-18 07:08:40 2021-04-28 10:54:42 2021-04-28 10:57:39 0:02:57 gibba master ubuntu 20.04 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

pass 6055695 2021-04-18 07:08:40 2021-04-28 10:55:54 2021-04-28 11:37:03 0:41:09 0:23:10 0:17:59 gibba master ubuntu 18.04 rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} 3
pass 6055696 2021-04-18 07:08:41 2021-04-28 11:02:50 2021-04-28 11:21:36 0:18:46 0:13:29 0:05:17 gibba master rhel 8.3 rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} 1
dead 6055697 2021-04-18 07:08:42 2021-04-28 11:02:50 2021-04-28 11:03:50 0:01:00 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_orch_cli} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055698 2021-04-18 07:08:43 2021-04-28 11:02:50 2021-04-28 11:04:50 0:02:00 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/fio_4K_rand_rw} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055699 2021-04-18 07:08:44 2021-04-28 11:03:51 2021-04-28 11:05:52 0:02:01 gibba master centos 8.3 rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mon} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

pass 6055700 2021-04-18 07:08:45 2021-04-28 11:04:51 2021-04-28 11:44:02 0:39:11 0:23:31 0:15:40 gibba master ubuntu 20.04 rados/upgrade/pacific-x/rgw-multisite/{clusters frontend overrides realm supported-random-distro$/{ubuntu_latest} tasks upgrade/primary} 2
dead 6055701 2021-04-18 07:08:46 2021-04-28 11:10:06 2021-04-28 11:11:06 0:01:00 gibba master centos 8.3 rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

pass 6055702 2021-04-18 07:08:47 2021-04-28 11:10:06 2021-04-28 11:41:23 0:31:17 0:14:42 0:16:35 gibba master rhel 8.3 rados/cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable 1-start 2-services/iscsi 3-final} 2
dead 6055703 2021-04-18 07:08:47 2021-04-28 12:34:04 2021-04-28 12:36:05 0:02:01 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-small} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055704 2021-04-18 07:08:48 2021-04-28 12:35:05 2021-04-28 12:37:12 0:02:07 gibba master ubuntu 20.04 rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055705 2021-04-18 07:08:49 2021-04-28 12:36:11 2021-04-28 12:45:33 0:09:22 gibba master centos 8.3 rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} 4
Failure Reason:

Error reimaging machines: Failed to power on gibba021

fail 6055706 2021-04-18 07:08:50 2021-04-28 12:44:33 2021-04-28 13:05:39 0:21:06 0:14:18 0:06:48 gibba master rhel 8.3 rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} 1
Failure Reason:

"2021-04-28T13:03:02.091531+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

pass 6055707 2021-04-18 07:08:51 2021-04-28 12:45:33 2021-04-28 13:07:47 0:22:14 0:12:14 0:10:00 gibba master centos 8.2 rados/cephadm/smoke/{distro/centos_8.2_kubic_stable fixed-2 mon_election/connectivity start} 2
pass 6055708 2021-04-18 07:08:51 2021-04-28 12:45:44 2021-04-28 14:57:20 2:11:36 2:04:20 0:07:16 gibba master rhel 8.3 rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} 1
dead 6055709 2021-04-18 07:08:52 2021-04-28 12:45:44 2021-04-28 12:47:39 0:01:55 gibba master ubuntu 20.04 rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055710 2021-04-18 07:08:53 2021-04-28 12:45:44 2021-04-28 12:48:47 0:03:03 gibba master centos 8.2 rados/cephadm/thrash/{0-distro/centos_8.2_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055711 2021-04-18 07:08:54 2021-04-28 12:47:47 2021-04-28 12:50:41 0:02:54 gibba master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055712 2021-04-18 07:08:55 2021-04-28 12:49:00 2021-04-28 12:51:59 0:02:59 gibba master ubuntu 20.04 rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/failover} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055713 2021-04-18 07:08:56 2021-04-28 12:51:00 2021-04-28 12:53:00 0:02:00 gibba master ubuntu 20.04 rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

pass 6055714 2021-04-18 07:08:57 2021-04-28 12:52:00 2021-04-28 13:09:40 0:17:40 0:08:11 0:09:29 gibba master centos 8.2 rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable mon_election/connectivity task/test_adoption} 1
fail 6055715 2021-04-18 07:08:57 2021-04-28 12:52:11 2021-04-28 13:41:42 0:49:31 0:32:24 0:17:07 gibba master rhel 8.3 rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} 2
Failure Reason:

"2021-04-28T13:14:32.216956+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

dead 6055716 2021-04-18 07:08:58 2021-04-28 12:57:25 2021-04-28 13:00:15 0:02:50 gibba master centos 8.3 rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} 3
Failure Reason:

Error reimaging machines: Failed to power on gibba021

fail 6055717 2021-04-18 07:08:59 2021-04-28 12:59:16 2021-04-28 13:29:38 0:30:22 0:16:02 0:14:20 gibba master centos 8.3 rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} 2
Failure Reason:

"2021-04-28T13:15:17.366558+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log

dead 6055718 2021-04-18 07:09:00 2021-04-28 13:00:26 2021-04-28 13:01:26 0:01:00 gibba master ubuntu 20.04 rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

pass 6055719 2021-04-18 07:09:01 2021-04-28 13:00:27 2021-04-28 13:37:33 0:37:06 0:25:15 0:11:51 gibba master ubuntu 20.04 rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/connectivity} 2
dead 6055720 2021-04-18 07:09:02 2021-04-28 13:01:17 2021-04-28 13:02:27 0:01:10 gibba master ubuntu 18.04 rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/fio_4M_rand_read} 1
Failure Reason:

Error reimaging machines: Failed to power on gibba021

dead 6055721 2021-04-18 07:09:02 2021-04-28 13:01:27 2021-04-28 13:06:48 0:05:21 gibba master centos 8.3 rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/libcephsqlite} 2
Failure Reason:

Error reimaging machines: Failed to power on gibba021

fail 6055722 2021-04-18 07:09:03 2021-04-28 13:05:49 2021-04-28 13:26:43 0:20:54 gibba master rhel 8.3 rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} 3
Failure Reason:

'NoneType' object has no attribute 'get'

dead 6055723 2021-04-18 07:09:04 2021-04-28 13:07:49 2021-04-28 13:14:44 0:06:55 gibba master rhel 8.3 rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} 2
Failure Reason:

Error reimaging machines: 'NoneType' object has no attribute 'get'