User | Scheduled | Started | Updated | Runtime | Suite | Branch | Machine Type | Revision | Pass | Fail | Dead |
---|---|---|---|---|---|---|---|---|---|---|---|
yuriw | 2021-04-07 14:21:13 | 2021-04-07 14:38:04 | 2021-04-07 20:56:11 | 6:18:07 | rados | wip-yuri8-testing-2021-04-06-1934-nautilus | smithi | 72757fb | 170 | 3 | 50 |
Status | Job ID | Links | Posted | Started | Updated | Runtime |
Duration |
In Waiting |
Machine | Teuthology Branch | OS Type | OS Version | Description | Nodes |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
pass | 6027051 | 2021-04-07 14:22:14 | 2021-04-07 14:38:04 | 2021-04-07 15:09:29 | 0:31:25 | 0:21:34 | 0:09:51 | smithi | master | centos | 7.8 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 | |
pass | 6027052 | 2021-04-07 14:22:15 | 2021-04-07 14:38:05 | 2021-04-07 14:59:32 | 0:21:27 | 0:10:44 | 0:10:43 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} | 2 | |
dead | 6027053 | 2021-04-07 14:22:16 | 2021-04-07 14:38:05 | 2021-04-07 14:49:32 | 0:11:27 | 0:03:43 | 0:07:44 | smithi | master | rhel | 7.9 | rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi198.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027054 | 2021-04-07 14:22:17 | 2021-04-07 14:38:26 | 2021-04-07 15:26:28 | 0:48:02 | 0:36:20 | 0:11:42 | smithi | master | centos | 7.8 | rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} | 2 | |
pass | 6027055 | 2021-04-07 14:22:18 | 2021-04-07 14:38:46 | 2021-04-07 15:00:08 | 0:21:22 | 0:12:20 | 0:09:02 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph distros/ubuntu_latest objectstore/filestore-xfs openstack settings/optimized workloads/fio_4M_rand_read} | 1 | |
dead | 6027056 | 2021-04-07 14:22:19 | 2021-04-07 14:38:47 | 2021-04-07 14:51:10 | 0:12:23 | 0:03:48 | 0:08:35 | smithi | master | rhel | 7.9 | rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_7} tasks/dashboard} | 2 | |
Failure Reason:
{'smithi148.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi170.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027057 | 2021-04-07 14:22:21 | 2021-04-07 14:39:48 | 2021-04-07 15:17:40 | 0:37:52 | 0:28:08 | 0:09:44 | smithi | master | ubuntu | 18.04 | rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 6027058 | 2021-04-07 14:22:22 | 2021-04-07 14:39:48 | 2021-04-07 15:16:04 | 0:36:16 | 0:24:39 | 0:11:37 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} | 2 | |
pass | 6027059 | 2021-04-07 14:22:23 | 2021-04-07 14:40:21 | 2021-04-07 15:11:33 | 0:31:12 | 0:21:48 | 0:09:24 | smithi | master | ubuntu | 16.04 | rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} thrashers/sync workloads/rados_api_tests} | 2 | |
dead | 6027060 | 2021-04-07 14:22:24 | 2021-04-07 14:40:22 | 2021-04-07 14:52:13 | 0:11:51 | 0:03:55 | 0:07:56 | smithi | master | rhel | 7.9 | rados/singleton/{all/thrash-backfill-full msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_7}} | 2 | |
Failure Reason:
{'smithi090.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi058.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027061 | 2021-04-07 14:22:26 | 2021-04-07 14:40:32 | 2021-04-07 15:13:29 | 0:32:57 | 0:20:52 | 0:12:05 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} | 2 | |
pass | 6027062 | 2021-04-07 14:22:27 | 2021-04-07 14:41:44 | 2021-04-07 15:06:04 | 0:24:20 | 0:11:10 | 0:13:10 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
dead | 6027063 | 2021-04-07 14:22:28 | 2021-04-07 14:41:54 | 2021-04-07 14:53:05 | 0:11:11 | 0:03:55 | 0:07:16 | smithi | master | rhel | 7.9 | rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi047.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027064 | 2021-04-07 14:22:30 | 2021-04-07 14:42:05 | 2021-04-07 15:27:38 | 0:45:33 | 0:35:30 | 0:10:03 | smithi | master | centos | 7.8 | rados/singleton/{all/thrash-eio msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} | 2 | |
pass | 6027065 | 2021-04-07 14:22:31 | 2021-04-07 14:42:25 | 2021-04-07 15:20:05 | 0:37:40 | 0:28:35 | 0:09:05 | smithi | master | ubuntu | 16.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_16.04} tasks/module_selftest} | 2 | |
pass | 6027066 | 2021-04-07 14:22:33 | 2021-04-07 14:42:25 | 2021-04-07 15:37:31 | 0:55:06 | 0:41:59 | 0:13:07 | smithi | master | ubuntu | 16.04 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_16.04} msgr-failures/osd-delay msgr/async-v1only rados thrashers/mapgap thrashosds-health workloads/radosbench} | 4 | |
pass | 6027067 | 2021-04-07 14:22:34 | 2021-04-07 14:43:40 | 2021-04-07 15:00:08 | 0:16:28 | 0:06:20 | 0:10:08 | smithi | master | ubuntu | 18.04 | rados/multimon/{clusters/3 msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} | 2 | |
dead | 6027068 | 2021-04-07 14:22:35 | 2021-04-07 14:44:20 | 2021-04-07 14:55:26 | 0:11:06 | 0:03:48 | 0:07:18 | smithi | master | rhel | 7.9 | rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{rhel_7} tasks/rados_python} | 2 | |
Failure Reason:
{'smithi184.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi205.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027069 | 2021-04-07 14:22:36 | 2021-04-07 14:44:20 | 2021-04-07 15:15:29 | 0:31:09 | 0:21:40 | 0:09:29 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/cache-snaps} | 2 | |
pass | 6027070 | 2021-04-07 14:22:37 | 2021-04-07 14:44:20 | 2021-04-07 15:04:17 | 0:19:57 | 0:09:32 | 0:10:25 | smithi | master | ubuntu | 16.04 | rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-bitmap openstack settings/optimized workloads/fio_4M_rand_rw} | 1 | |
dead | 6027071 | 2021-04-07 14:22:39 | 2021-04-07 14:45:18 | 2021-04-07 14:56:34 | 0:11:16 | 0:03:44 | 0:07:32 | smithi | master | rhel | 7.9 | rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi063.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027072 | 2021-04-07 14:22:41 | 2021-04-07 14:45:18 | 2021-04-07 15:09:29 | 0:24:11 | 0:10:37 | 0:13:34 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} | 3 | |
pass | 6027073 | 2021-04-07 14:22:42 | 2021-04-07 14:49:01 | 2021-04-07 15:26:49 | 0:37:48 | 0:26:11 | 0:11:37 | smithi | master | centos | 7.8 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
pass | 6027074 | 2021-04-07 14:22:44 | 2021-04-07 14:49:42 | 2021-04-07 15:24:28 | 0:34:46 | 0:23:01 | 0:11:45 | smithi | master | centos | 7.8 | rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/few msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} | 2 | |
pass | 6027075 | 2021-04-07 14:22:45 | 2021-04-07 14:51:14 | 2021-04-07 15:21:30 | 0:30:16 | 0:19:32 | 0:10:44 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects} | 2 | |
pass | 6027076 | 2021-04-07 14:22:46 | 2021-04-07 14:51:45 | 2021-04-07 15:44:44 | 0:52:59 | 0:45:09 | 0:07:50 | smithi | master | ubuntu | 16.04 | rados/standalone/{supported-random-distro$/{ubuntu_16.04} workloads/mon} | 1 | |
pass | 6027077 | 2021-04-07 14:22:47 | 2021-04-07 14:51:45 | 2021-04-07 15:24:42 | 0:32:57 | 0:22:54 | 0:10:03 | smithi | master | centos | 7.8 | rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/many msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{centos_latest}} | 2 | |
pass | 6027078 | 2021-04-07 14:22:48 | 2021-04-07 14:51:45 | 2021-04-07 15:13:28 | 0:21:43 | 0:11:57 | 0:09:46 | smithi | master | rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} | 2 | |||
pass | 6027079 | 2021-04-07 14:22:50 | 2021-04-07 14:51:46 | 2021-04-07 15:14:28 | 0:22:42 | 0:12:07 | 0:10:35 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} | 2 | |
pass | 6027080 | 2021-04-07 14:22:51 | 2021-04-07 14:52:16 | 2021-04-07 15:12:51 | 0:20:35 | 0:12:56 | 0:07:39 | smithi | master | centos | 7.8 | rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 6027081 | 2021-04-07 14:22:52 | 2021-04-07 14:52:16 | 2021-04-07 15:16:04 | 0:23:48 | 0:13:23 | 0:10:25 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-comp-lz4 openstack settings/optimized workloads/fio_4M_rand_write} | 1 | |
pass | 6027082 | 2021-04-07 14:22:53 | 2021-04-07 14:52:34 | 2021-04-07 15:42:31 | 0:49:57 | 0:38:29 | 0:11:28 | smithi | master | ubuntu | 18.04 | rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} | 2 | |
pass | 6027083 | 2021-04-07 14:22:54 | 2021-04-07 14:52:34 | 2021-04-07 15:12:56 | 0:20:22 | 0:11:38 | 0:08:44 | smithi | master | centos | 7.8 | rados/singleton/{all/watch-notify-same-primary msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 6027084 | 2021-04-07 14:22:56 | 2021-04-07 14:52:35 | 2021-04-07 15:53:36 | 1:01:01 | 0:49:23 | 0:11:38 | smithi | master | ubuntu | 16.04 | rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_16.04} tasks/dashboard} | 2 | |
pass | 6027085 | 2021-04-07 14:22:57 | 2021-04-07 14:54:24 | 2021-04-07 15:18:46 | 0:24:22 | 0:12:37 | 0:11:45 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
pass | 6027086 | 2021-04-07 14:22:59 | 2021-04-07 14:55:16 | 2021-04-07 15:22:29 | 0:27:13 | 0:17:04 | 0:10:09 | smithi | master | centos | 7.8 | rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} tasks/rados_stress_watch} | 2 | |
pass | 6027087 | 2021-04-07 14:23:00 | 2021-04-07 14:55:37 | 2021-04-07 15:17:22 | 0:21:45 | 0:12:16 | 0:09:29 | smithi | master | ubuntu | 16.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_16.04} tasks/orchestrator_cli} | 2 | |
pass | 6027088 | 2021-04-07 14:23:01 | 2021-04-07 14:55:47 | 2021-04-07 15:32:59 | 0:37:12 | 0:27:43 | 0:09:29 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} | 2 | |
pass | 6027089 | 2021-04-07 14:23:02 | 2021-04-07 14:56:08 | 2021-04-07 15:12:46 | 0:16:38 | 0:08:38 | 0:08:00 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/admin-socket msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04}} | 1 | |
pass | 6027090 | 2021-04-07 14:23:04 | 2021-04-07 14:56:08 | 2021-04-07 15:18:28 | 0:22:20 | 0:10:45 | 0:11:35 | smithi | master | centos | 7.8 | rados/multimon/{clusters/6 msgr-failures/many msgr/random no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews} | 2 | |
pass | 6027091 | 2021-04-07 14:23:05 | 2021-04-07 14:57:08 | 2021-04-07 15:17:29 | 0:20:21 | 0:09:32 | 0:10:49 | smithi | master | centos | 7.8 | rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_latest}} | 1 | |
dead | 6027092 | 2021-04-07 14:23:06 | 2021-04-07 14:58:09 | 2021-04-07 15:09:21 | 0:11:12 | 0:04:33 | 0:06:39 | smithi | master | rhel | 7.9 | rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi190.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027093 | 2021-04-07 14:23:08 | 2021-04-07 14:58:09 | 2021-04-07 15:15:40 | 0:17:31 | 0:08:42 | 0:08:49 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 6027094 | 2021-04-07 14:23:09 | 2021-04-07 14:58:12 | 2021-04-07 15:36:04 | 0:37:52 | 0:25:30 | 0:12:22 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} | 3 | |
pass | 6027095 | 2021-04-07 14:23:10 | 2021-04-07 14:58:22 | 2021-04-07 15:37:07 | 0:38:45 | 0:28:07 | 0:10:38 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
pass | 6027096 | 2021-04-07 14:23:12 | 2021-04-07 14:59:37 | 2021-04-07 15:37:23 | 0:37:46 | 0:27:21 | 0:10:25 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} | 2 | |
dead | 6027097 | 2021-04-07 14:23:13 | 2021-04-07 14:59:48 | 2021-04-07 15:10:43 | 0:10:55 | 0:04:36 | 0:06:19 | smithi | master | rhel | 7.9 | rados/singleton/{all/deduptool msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi137.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027098 | 2021-04-07 14:23:15 | 2021-04-07 14:59:48 | 2021-04-07 15:20:28 | 0:20:40 | 0:13:31 | 0:07:09 | smithi | master | ubuntu | 16.04 | rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-comp-snappy openstack settings/optimized workloads/radosbench_4K_rand_read} | 1 | |
dead | 6027099 | 2021-04-07 14:23:17 | 2021-04-07 14:59:48 | 2021-04-07 15:11:36 | 0:11:48 | 0:04:27 | 0:07:21 | smithi | master | rhel | 7.9 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_7} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} | 2 | |
Failure Reason:
{'smithi111.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi196.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
dead | 6027100 | 2021-04-07 14:23:18 | 2021-04-07 15:00:09 | 2021-04-07 15:11:21 | 0:11:12 | 0:04:37 | 0:06:35 | smithi | master | rhel | 7.9 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_7} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} | 2 | |
Failure Reason:
{'smithi142.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi121.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
fail | 6027101 | 2021-04-07 14:23:20 | 2021-04-07 15:00:09 | 2021-04-07 15:33:24 | 0:33:15 | 0:16:14 | 0:17:01 | smithi | master | centos | 7.8 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/hammer backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{centos_latest} msgr-failures/fastclose msgr/async rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} | 4 | |
Failure Reason:
"2021-04-07 15:29:10.542019 mon.a (mon.0) 19 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log |
||||||||||||||
pass | 6027102 | 2021-04-07 14:23:21 | 2021-04-07 15:04:11 | 2021-04-07 15:21:22 | 0:17:11 | 0:08:59 | 0:08:12 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/divergent_priors msgr-failures/many msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_16.04}} | 1 | |
pass | 6027103 | 2021-04-07 14:23:22 | 2021-04-07 15:04:22 | 2021-04-07 15:22:59 | 0:18:37 | 0:08:06 | 0:10:31 | smithi | master | ubuntu | 16.04 | rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} tasks/rados_striper} | 2 | |
pass | 6027104 | 2021-04-07 14:23:23 | 2021-04-07 15:05:43 | 2021-04-07 15:55:33 | 0:49:50 | 0:40:00 | 0:09:50 | smithi | master | centos | 7.8 | rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/random objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/valgrind} | 2 | |
pass | 6027105 | 2021-04-07 14:23:25 | 2021-04-07 15:06:04 | 2021-04-07 18:17:25 | 3:11:21 | 3:02:52 | 0:08:29 | smithi | master | ubuntu | 16.04 | rados/standalone/{supported-random-distro$/{ubuntu_16.04} workloads/osd} | 1 | |
pass | 6027106 | 2021-04-07 14:23:26 | 2021-04-07 15:06:04 | 2021-04-07 15:55:09 | 0:49:05 | 0:39:15 | 0:09:50 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_16.04} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} | 2 | |
pass | 6027107 | 2021-04-07 14:23:28 | 2021-04-07 15:06:05 | 2021-04-07 15:30:31 | 0:24:26 | 0:10:43 | 0:13:43 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
dead | 6027108 | 2021-04-07 14:23:29 | 2021-04-07 15:06:26 | 2021-04-07 15:18:43 | 0:12:17 | 0:03:39 | 0:08:38 | smithi | master | rhel | 7.9 | rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_7} thrashers/many workloads/rados_mon_workunits} | 2 | |
Failure Reason:
{'smithi180.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi008.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027109 | 2021-04-07 14:23:31 | 2021-04-07 15:07:46 | 2021-04-07 15:25:03 | 0:17:17 | 0:08:03 | 0:09:14 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/divergent_priors2 msgr-failures/few msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 6027110 | 2021-04-07 14:23:32 | 2021-04-07 15:07:46 | 2021-04-07 15:42:53 | 0:35:07 | 0:25:06 | 0:10:01 | smithi | master | ubuntu | 16.04 | rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{ubuntu_16.04}} | 1 | |
pass | 6027111 | 2021-04-07 14:23:33 | 2021-04-07 15:09:31 | 2021-04-07 15:35:09 | 0:25:38 | 0:15:33 | 0:10:05 | smithi | master | ubuntu | 18.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/progress} | 2 | |
pass | 6027112 | 2021-04-07 14:23:34 | 2021-04-07 15:09:32 | 2021-04-07 15:29:34 | 0:20:02 | 0:10:27 | 0:09:35 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-comp-zlib openstack settings/optimized workloads/radosbench_4K_seq_read} | 1 | |
dead | 6027113 | 2021-04-07 14:23:36 | 2021-04-07 15:09:32 | 2021-04-07 15:20:22 | 0:10:50 | 0:03:41 | 0:07:09 | smithi | master | rhel | 7.9 | rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_7} tasks/dashboard} | 2 | |
Failure Reason:
{'smithi190.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi005.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027114 | 2021-04-07 14:23:37 | 2021-04-07 15:09:33 | 2021-04-07 15:31:31 | 0:21:58 | 0:12:36 | 0:09:22 | smithi | master | centos | 7.8 | rados/singleton/{all/dump-stuck msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} | 1 | |
dead | 6027115 | 2021-04-07 14:23:38 | 2021-04-07 15:10:23 | 2021-04-07 15:22:11 | 0:11:48 | 0:03:52 | 0:07:56 | smithi | master | rhel | 7.9 | rados/multimon/{clusters/9 msgr-failures/few msgr/simple no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_7} tasks/mon_recovery} | 3 | |
Failure Reason:
{'smithi121.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi137.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi142.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
dead | 6027116 | 2021-04-07 14:23:39 | 2021-04-07 15:11:24 | 2021-04-07 15:22:41 | 0:11:17 | 0:03:54 | 0:07:23 | smithi | master | rhel | 7.9 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{rhel_7} thrashers/pggrow thrashosds-health workloads/radosbench} | 2 | |
Failure Reason:
{'smithi139.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi112.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027117 | 2021-04-07 14:23:41 | 2021-04-07 15:11:34 | 2021-04-07 15:48:31 | 0:36:57 | 0:28:45 | 0:08:12 | smithi | master | centos | 7.8 | rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_latest}} | 1 | |
pass | 6027118 | 2021-04-07 14:23:42 | 2021-04-07 15:11:34 | 2021-04-07 15:36:56 | 0:25:22 | 0:13:34 | 0:11:48 | smithi | master | centos | 7.8 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} | 3 | |
pass | 6027119 | 2021-04-07 14:23:43 | 2021-04-07 15:11:45 | 2021-04-07 15:50:31 | 0:38:46 | 0:27:05 | 0:11:41 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
pass | 6027120 | 2021-04-07 14:23:44 | 2021-04-07 15:12:47 | 2021-04-07 15:52:05 | 0:39:18 | 0:29:36 | 0:09:42 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} | 2 | |
pass | 6027121 | 2021-04-07 14:23:46 | 2021-04-07 15:12:58 | 2021-04-07 15:54:32 | 0:41:34 | 0:32:56 | 0:08:38 | smithi | master | centos | 7.8 | rados/singleton/{all/ec-lost-unfound msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} | 1 | |
dead | 6027122 | 2021-04-07 14:23:48 | 2021-04-07 15:13:35 | 2021-04-07 15:24:37 | 0:11:02 | 0:03:55 | 0:07:07 | smithi | master | rhel | 7.9 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_7} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} | 2 | |
Failure Reason:
{'smithi093.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi143.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
dead | 6027123 | 2021-04-07 14:23:49 | 2021-04-07 15:13:35 | 2021-04-07 15:25:22 | 0:11:47 | 0:04:04 | 0:07:43 | smithi | master | rhel | 7.9 | rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{rhel_7}} | 2 | |
Failure Reason:
{'smithi014.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi051.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027124 | 2021-04-07 14:23:50 | 2021-04-07 15:14:34 | 2021-04-07 15:36:30 | 0:21:56 | 0:11:53 | 0:10:03 | smithi | master | ubuntu | 16.04 | rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-comp-zstd openstack settings/optimized workloads/radosbench_4M_rand_read} | 1 | |
pass | 6027125 | 2021-04-07 14:23:52 | 2021-04-07 15:14:35 | 2021-04-07 15:36:04 | 0:21:29 | 0:11:41 | 0:09:48 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/redirect} | 2 | |
pass | 6027126 | 2021-04-07 14:23:53 | 2021-04-07 15:14:35 | 2021-04-07 15:30:27 | 0:15:52 | 0:05:54 | 0:09:58 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/erasure-code-nonregression msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04}} | 1 | |
pass | 6027127 | 2021-04-07 14:23:55 | 2021-04-07 15:15:36 | 2021-04-07 15:37:10 | 0:21:34 | 0:11:09 | 0:10:25 | smithi | master | rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/simple objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/lockdep} | 2 | |||
pass | 6027128 | 2021-04-07 14:23:57 | 2021-04-07 15:15:46 | 2021-04-07 15:52:43 | 0:36:57 | 0:26:11 | 0:10:46 | smithi | master | ubuntu | 16.04 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/jewel backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_16.04} msgr-failures/few msgr/random rados thrashers/none thrashosds-health workloads/snaps-few-objects} | 4 | |
pass | 6027129 | 2021-04-07 14:23:58 | 2021-04-07 15:15:46 | 2021-04-07 15:34:46 | 0:19:00 | 0:10:22 | 0:08:38 | smithi | master | ubuntu | 16.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_16.04} tasks/prometheus} | 2 | |
dead | 6027130 | 2021-04-07 14:24:00 | 2021-04-07 15:15:47 | 2021-04-07 15:27:01 | 0:11:14 | 0:03:47 | 0:07:27 | smithi | master | rhel | 7.9 | rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi071.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027131 | 2021-04-07 14:24:01 | 2021-04-07 15:16:07 | 2021-04-07 15:46:58 | 0:30:51 | 0:20:44 | 0:10:07 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} | 2 | |
pass | 6027132 | 2021-04-07 14:24:03 | 2021-04-07 15:16:07 | 2021-04-07 15:39:24 | 0:23:17 | 0:10:12 | 0:13:05 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
pass | 6027133 | 2021-04-07 14:24:04 | 2021-04-07 15:17:38 | 2021-04-07 15:51:19 | 0:33:41 | 0:24:38 | 0:09:03 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/lost-unfound-delete msgr-failures/few msgr/random objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 6027134 | 2021-04-07 14:24:05 | 2021-04-07 15:17:38 | 2021-04-07 16:03:37 | 0:45:59 | 0:34:24 | 0:11:35 | smithi | master | centos | 7.8 | rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/one workloads/snaps-few-objects} | 2 | |
pass | 6027135 | 2021-04-07 14:24:07 | 2021-04-07 15:18:29 | 2021-04-07 15:46:37 | 0:28:08 | 0:16:19 | 0:11:49 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} | 2 | |
dead | 6027136 | 2021-04-07 14:24:08 | 2021-04-07 15:18:50 | 2021-04-07 15:27:31 | 0:08:41 | 0:03:37 | 0:05:04 | smithi | master | rhel | 7.9 | rados/standalone/{supported-random-distro$/{rhel_7} workloads/scrub} | 1 | |
Failure Reason:
{'smithi180.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027137 | 2021-04-07 14:24:09 | 2021-04-07 15:18:50 | 2021-04-07 15:48:05 | 0:29:15 | 0:19:13 | 0:10:02 | smithi | master | ubuntu | 16.04 | rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_16.04} tasks/rados_workunit_loadgen_mix} | 2 | |
pass | 6027138 | 2021-04-07 14:24:11 | 2021-04-07 15:18:50 | 2021-04-07 15:38:51 | 0:20:01 | 0:10:37 | 0:09:24 | smithi | master | centos | 7.8 | rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 6027139 | 2021-04-07 14:24:12 | 2021-04-07 15:20:11 | 2021-04-07 15:36:59 | 0:16:48 | 0:09:20 | 0:07:28 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-hybrid openstack settings/optimized workloads/radosbench_4M_seq_read} | 1 | |
pass | 6027140 | 2021-04-07 14:24:13 | 2021-04-07 15:20:11 | 2021-04-07 15:53:02 | 0:32:51 | 0:24:44 | 0:08:07 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/lost-unfound msgr-failures/many msgr/simple objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04}} | 1 | |
pass | 6027141 | 2021-04-07 14:24:15 | 2021-04-07 15:20:32 | 2021-04-07 16:33:22 | 1:12:50 | 1:03:40 | 0:09:10 | smithi | master | centos | 7.8 | rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_latest} tasks/dashboard} | 2 | |
fail | 6027142 | 2021-04-07 14:24:16 | 2021-04-07 15:20:32 | 2021-04-07 15:39:03 | 0:18:31 | 0:06:48 | 0:11:43 | smithi | master | ubuntu | 18.04 | rados/multimon/{clusters/21 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} | 3 | |
Failure Reason:
"2021-04-07 15:37:25.598610 mon.a (mon.0) 20 : cluster [WRN] Health check failed: 2/21 mons down, quorum a,b,c,d,e,f,g,h,i,j,k,m,n,o,p,q,r,s,t (MON_DOWN)" in cluster log |
||||||||||||||
pass | 6027143 | 2021-04-07 14:24:17 | 2021-04-07 15:21:33 | 2021-04-07 20:56:11 | 5:34:38 | 4:59:35 | 0:35:03 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} | 1 | |
dead | 6027144 | 2021-04-07 14:24:18 | 2021-04-07 15:21:43 | 2021-04-07 15:33:08 | 0:11:25 | 0:03:48 | 0:07:37 | smithi | master | rhel | 7.9 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_7} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} | 3 | |
Failure Reason:
{'smithi096.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi153.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi033.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027145 | 2021-04-07 14:24:19 | 2021-04-07 15:21:54 | 2021-04-07 15:57:09 | 0:35:15 | 0:25:42 | 0:09:33 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
dead | 6027146 | 2021-04-07 14:24:21 | 2021-04-07 15:22:14 | 2021-04-07 15:33:00 | 0:10:46 | 0:03:40 | 0:07:06 | smithi | master | rhel | 7.9 | rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi137.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027147 | 2021-04-07 14:24:22 | 2021-04-07 15:22:14 | 2021-04-07 15:49:30 | 0:27:16 | 0:17:04 | 0:10:12 | smithi | master | centos | 7.8 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} | 2 | |
pass | 6027148 | 2021-04-07 14:24:23 | 2021-04-07 15:22:35 | 2021-04-07 15:58:04 | 0:35:29 | 0:24:56 | 0:10:33 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} | 2 | |
pass | 6027149 | 2021-04-07 14:24:25 | 2021-04-07 15:22:45 | 2021-04-07 15:42:53 | 0:20:08 | 0:10:16 | 0:09:52 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 6027150 | 2021-04-07 14:24:27 | 2021-04-07 15:23:06 | 2021-04-07 15:58:48 | 0:35:42 | 0:25:14 | 0:10:28 | smithi | master | centos | 7.8 | rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/valgrind} | 2 | |
pass | 6027151 | 2021-04-07 14:24:29 | 2021-04-07 15:23:37 | 2021-04-07 15:44:43 | 0:21:06 | 0:10:42 | 0:10:24 | smithi | master | centos | 7.8 | rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} tasks/ssh_orchestrator} | 2 | |
pass | 6027152 | 2021-04-07 14:24:30 | 2021-04-07 15:23:47 | 2021-04-07 15:40:43 | 0:16:56 | 0:09:26 | 0:07:30 | smithi | master | ubuntu | 16.04 | rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-stupid openstack settings/optimized workloads/radosbench_4M_write} | 1 | |
pass | 6027153 | 2021-04-07 14:24:31 | 2021-04-07 15:23:47 | 2021-04-07 16:03:32 | 0:39:45 | 0:29:44 | 0:10:01 | smithi | master | centos | 7.8 | rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 6027154 | 2021-04-07 14:24:32 | 2021-04-07 15:24:38 | 2021-04-07 15:58:36 | 0:33:58 | 0:23:22 | 0:10:36 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} | 2 | |
pass | 6027155 | 2021-04-07 14:24:34 | 2021-04-07 15:24:48 | 2021-04-07 15:48:20 | 0:23:32 | 0:10:43 | 0:12:49 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
pass | 6027156 | 2021-04-07 14:24:35 | 2021-04-07 15:25:09 | 2021-04-07 15:50:20 | 0:25:11 | 0:15:57 | 0:09:14 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-delay msgr/random objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} | 2 | |
pass | 6027157 | 2021-04-07 14:24:36 | 2021-04-07 15:25:29 | 2021-04-07 15:46:19 | 0:20:50 | 0:10:09 | 0:10:41 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 6027158 | 2021-04-07 14:24:38 | 2021-04-07 15:26:32 | 2021-04-07 15:50:20 | 0:23:48 | 0:13:12 | 0:10:36 | smithi | master | ubuntu | 18.04 | rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} | 2 | |
pass | 6027159 | 2021-04-07 14:24:40 | 2021-04-07 15:26:52 | 2021-04-07 15:55:09 | 0:28:17 | 0:15:14 | 0:13:03 | smithi | master | centos | 7.8 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{centos_latest} msgr-failures/osd-delay msgr/simple rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} | 4 | |
dead | 6027160 | 2021-04-07 14:24:42 | 2021-04-07 15:27:43 | 2021-04-07 15:36:57 | 0:09:14 | 0:03:41 | 0:05:33 | smithi | master | rhel | 7.9 | rados/singleton/{all/mon-auth-caps msgr-failures/many msgr/random objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi155.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027161 | 2021-04-07 14:24:44 | 2021-04-07 15:27:43 | 2021-04-07 16:00:17 | 0:32:34 | 0:19:03 | 0:13:31 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/simple objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_16.04} thrashers/none thrashosds-health workloads/small-objects} | 2 | |
dead | 6027162 | 2021-04-07 14:24:45 | 2021-04-07 15:30:34 | 2021-04-07 15:41:10 | 0:10:36 | 0:03:42 | 0:06:54 | smithi | master | rhel | 7.9 | rados/multimon/{clusters/3 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_7} tasks/mon_clock_with_skews} | 2 | |
Failure Reason:
{'smithi036.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi045.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027163 | 2021-04-07 14:24:47 | 2021-04-07 15:30:34 | 2021-04-07 15:49:48 | 0:19:14 | 0:10:43 | 0:08:31 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph distros/ubuntu_latest objectstore/filestore-xfs openstack settings/optimized workloads/sample_fio} | 1 | |
pass | 6027164 | 2021-04-07 14:24:48 | 2021-04-07 15:30:35 | 2021-04-07 16:36:11 | 1:05:36 | 0:53:34 | 0:12:02 | smithi | master | ubuntu | 16.04 | rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_16.04} tasks/dashboard} | 2 | |
pass | 6027165 | 2021-04-07 14:24:49 | 2021-04-07 15:31:35 | 2021-04-07 15:50:42 | 0:19:07 | 0:07:12 | 0:11:55 | smithi | master | ubuntu | 18.04 | rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 6027166 | 2021-04-07 14:24:51 | 2021-04-07 15:33:06 | 2021-04-07 15:54:01 | 0:20:55 | 0:11:13 | 0:09:42 | smithi | master | centos | 7.8 | rados/rest/{mgr-restful supported-random-distro$/{centos_latest}} | 1 | |
pass | 6027167 | 2021-04-07 14:24:52 | 2021-04-07 15:33:06 | 2021-04-07 16:11:38 | 0:38:32 | 0:30:01 | 0:08:31 | smithi | master | ubuntu | 16.04 | rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04}} | 1 | |
pass | 6027168 | 2021-04-07 14:24:53 | 2021-04-07 15:33:06 | 2021-04-07 15:59:35 | 0:26:29 | 0:17:19 | 0:09:10 | smithi | master | centos | 7.8 | rados/singleton-flat/valgrind-leaks | 1 | |
pass | 6027169 | 2021-04-07 14:24:54 | 2021-04-07 15:33:17 | 2021-04-07 16:00:04 | 0:26:47 | 0:17:10 | 0:09:37 | smithi | master | centos | 7.8 | rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{centos_latest}} | 1 | |
dead | 6027170 | 2021-04-07 14:24:56 | 2021-04-07 15:33:17 | 2021-04-07 15:42:26 | 0:09:09 | 0:03:36 | 0:05:33 | smithi | master | rhel | 7.9 | rados/standalone/{supported-random-distro$/{rhel_7} workloads/crush} | 1 | |
Failure Reason:
{'smithi153.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027171 | 2021-04-07 14:24:57 | 2021-04-07 15:33:17 | 2021-04-07 15:54:06 | 0:20:49 | 0:09:56 | 0:10:53 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} | 3 | |
pass | 6027172 | 2021-04-07 14:24:58 | 2021-04-07 15:33:28 | 2021-04-07 16:07:34 | 0:34:06 | 0:24:01 | 0:10:05 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
pass | 6027173 | 2021-04-07 14:24:59 | 2021-04-07 15:34:18 | 2021-04-07 16:04:15 | 0:29:57 | 0:18:55 | 0:11:02 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} | 2 | |
dead | 6027174 | 2021-04-07 14:25:00 | 2021-04-07 15:34:50 | 2021-04-07 15:47:19 | 0:12:29 | 0:03:53 | 0:08:36 | smithi | master | rhel | 7.9 | rados/upgrade/mimic-x-singleton/{0-cluster/{openstack start} 1-install/mimic 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-nautilus 8-workload/{rbd-python rgw-swift snaps-many-objects} supported-random-distro$/{rhel_7} thrashosds-health} | 4 | |
Failure Reason:
{'smithi166.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi115.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi035.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi058.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027175 | 2021-04-07 14:25:01 | 2021-04-07 15:36:11 | 2021-04-07 15:54:23 | 0:18:12 | 0:09:31 | 0:08:41 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/mon-config-key-caps msgr-failures/few msgr/simple objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_16.04}} | 1 | |
dead | 6027176 | 2021-04-07 14:25:02 | 2021-04-07 15:36:11 | 2021-04-07 15:47:18 | 0:11:07 | 0:03:49 | 0:07:18 | smithi | master | rhel | 7.9 | rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_7} tasks/readwrite} | 2 | |
Failure Reason:
{'smithi098.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi073.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027177 | 2021-04-07 14:25:04 | 2021-04-07 15:36:11 | 2021-04-07 16:54:48 | 1:18:37 | 1:07:08 | 0:11:29 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/pggrow thrashosds-health workloads/ec-radosbench} | 2 | |
dead | 6027178 | 2021-04-07 14:25:05 | 2021-04-07 15:36:32 | 2021-04-07 15:48:15 | 0:11:43 | 0:03:53 | 0:07:50 | smithi | master | rhel | 7.9 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_7} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} | 2 | |
Failure Reason:
{'smithi155.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi031.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027179 | 2021-04-07 14:25:06 | 2021-04-07 15:37:02 | 2021-04-07 15:58:16 | 0:21:14 | 0:10:55 | 0:10:19 | smithi | master | centos | 7.8 | rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_latest} tasks/workunits} | 2 | |
pass | 6027180 | 2021-04-07 14:25:07 | 2021-04-07 15:37:02 | 2021-04-07 15:57:52 | 0:20:50 | 0:12:37 | 0:08:13 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/mon-config-keys msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04}} | 1 | |
pass | 6027181 | 2021-04-07 14:25:09 | 2021-04-07 15:37:03 | 2021-04-07 16:06:51 | 0:29:48 | 0:19:34 | 0:10:14 | smithi | master | rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/lockdep} | 2 | |||
pass | 6027182 | 2021-04-07 14:25:10 | 2021-04-07 15:37:13 | 2021-04-07 16:04:51 | 0:27:38 | 0:15:38 | 0:12:00 | smithi | master | centos | 7.8 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
pass | 6027183 | 2021-04-07 14:25:11 | 2021-04-07 15:37:33 | 2021-04-07 15:56:28 | 0:18:55 | 0:09:54 | 0:09:01 | smithi | master | ubuntu | 16.04 | rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-bitmap openstack settings/optimized workloads/sample_radosbench} | 1 | |
pass | 6027184 | 2021-04-07 14:25:12 | 2021-04-07 15:37:34 | 2021-04-07 15:54:27 | 0:16:53 | 0:07:48 | 0:09:05 | smithi | master | ubuntu | 16.04 | rados/singleton/{all/mon-config msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04}} | 1 | |
pass | 6027185 | 2021-04-07 14:25:14 | 2021-04-07 15:37:34 | 2021-04-07 16:00:42 | 0:23:08 | 0:12:30 | 0:10:38 | smithi | master | centos | 7.8 | rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/sync workloads/rados_5925} | 2 | |
dead | 6027186 | 2021-04-07 14:25:15 | 2021-04-07 15:37:34 | 2021-04-07 15:49:57 | 0:12:23 | 0:03:51 | 0:08:32 | smithi | master | rhel | 7.9 | rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi057.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027187 | 2021-04-07 14:25:16 | 2021-04-07 15:38:56 | 2021-04-07 16:01:56 | 0:23:00 | 0:12:56 | 0:10:04 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} | 2 | |
pass | 6027188 | 2021-04-07 14:25:17 | 2021-04-07 15:39:06 | 2021-04-07 16:05:10 | 0:26:04 | 0:16:02 | 0:10:02 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} | 2 | |
dead | 6027189 | 2021-04-07 14:25:18 | 2021-04-07 15:39:26 | 2021-04-07 15:50:41 | 0:11:15 | 0:03:46 | 0:07:29 | smithi | master | rhel | 7.9 | rados/singleton/{all/osd-backfill msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi150.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
dead | 6027190 | 2021-04-07 14:25:20 | 2021-04-07 15:39:27 | 2021-04-07 15:50:20 | 0:10:53 | 0:03:49 | 0:07:04 | smithi | master | rhel | 7.9 | rados/multimon/{clusters/6 msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_7} tasks/mon_recovery} | 2 | |
Failure Reason:
{'smithi070.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi124.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
dead | 6027191 | 2021-04-07 14:25:21 | 2021-04-07 15:39:27 | 2021-04-07 15:51:42 | 0:12:15 | 0:03:41 | 0:08:34 | smithi | master | rhel | 7.9 | rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi082.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027192 | 2021-04-07 14:25:22 | 2021-04-07 15:40:47 | 2021-04-07 16:12:26 | 0:31:39 | 0:21:37 | 0:10:02 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} | 2 | |
pass | 6027193 | 2021-04-07 14:25:23 | 2021-04-07 15:40:48 | 2021-04-07 16:21:33 | 0:40:45 | 0:28:02 | 0:12:43 | smithi | master | centos | 7.8 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} | 3 | |
pass | 6027194 | 2021-04-07 14:25:24 | 2021-04-07 15:42:29 | 2021-04-07 16:16:29 | 0:34:00 | 0:23:37 | 0:10:23 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
pass | 6027195 | 2021-04-07 14:25:25 | 2021-04-07 15:42:39 | 2021-04-07 16:30:15 | 0:47:36 | 0:32:50 | 0:14:46 | smithi | master | centos | 7.8 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/hammer backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_latest} msgr-failures/fastclose msgr/simple rados thrashers/careful thrashosds-health workloads/cache-snaps} | 4 | |
pass | 6027196 | 2021-04-07 14:25:26 | 2021-04-07 15:46:36 | 2021-04-07 16:10:13 | 0:23:37 | 0:15:32 | 0:08:05 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/osd-recovery-incomplete msgr-failures/few msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 6027197 | 2021-04-07 14:25:27 | 2021-04-07 15:46:46 | 2021-04-07 16:10:52 | 0:24:06 | 0:15:11 | 0:08:55 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-comp-lz4 openstack settings/optimized workloads/cosbench_64K_read_write} | 1 | |
pass | 6027198 | 2021-04-07 14:25:28 | 2021-04-07 15:46:47 | 2021-04-07 16:18:00 | 0:31:13 | 0:22:13 | 0:09:00 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} | 2 | |
pass | 6027199 | 2021-04-07 14:25:29 | 2021-04-07 15:47:07 | 2021-04-07 16:12:24 | 0:25:17 | 0:15:39 | 0:09:38 | smithi | master | centos | 7.8 | rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_latest} tasks/crash} | 2 | |
dead | 6027200 | 2021-04-07 14:25:30 | 2021-04-07 15:47:27 | 2021-04-07 15:58:11 | 0:10:44 | 0:03:47 | 0:06:57 | smithi | master | rhel | 7.9 | rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_7} tasks/dashboard} | 2 | |
Failure Reason:
{'smithi166.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi058.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
dead | 6027201 | 2021-04-07 14:25:31 | 2021-04-07 15:47:28 | 2021-04-07 15:56:21 | 0:08:53 | 0:03:42 | 0:05:11 | smithi | master | rhel | 7.9 | rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi098.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027202 | 2021-04-07 14:25:32 | 2021-04-07 15:47:28 | 2021-04-07 16:12:24 | 0:24:56 | 0:15:48 | 0:09:08 | smithi | master | centos | 7.8 | rados/singleton/{all/osd-recovery msgr-failures/many msgr/simple objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} | 1 | |
dead | 6027203 | 2021-04-07 14:25:33 | 2021-04-07 15:47:28 | 2021-04-07 15:57:22 | 0:09:54 | 0:03:41 | 0:06:13 | smithi | master | rhel | 7.9 | rados/standalone/{supported-random-distro$/{rhel_7} workloads/erasure-code} | 1 | |
Failure Reason:
{'smithi204.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027204 | 2021-04-07 14:25:35 | 2021-04-07 15:48:09 | 2021-04-07 16:13:37 | 0:25:28 | 0:12:40 | 0:12:48 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
pass | 6027205 | 2021-04-07 14:25:35 | 2021-04-07 15:48:29 | 2021-04-07 16:28:09 | 0:39:40 | 0:29:08 | 0:10:32 | smithi | master | centos | 7.8 | rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_cls_all validater/valgrind} | 2 | |
pass | 6027206 | 2021-04-07 14:25:37 | 2021-04-07 15:48:29 | 2021-04-07 16:21:33 | 0:33:04 | 0:23:54 | 0:09:10 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/few msgr/random objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/cache-agent-big} | 2 | |
dead | 6027207 | 2021-04-07 14:25:38 | 2021-04-07 15:48:40 | 2021-04-07 16:00:28 | 0:11:48 | 0:03:43 | 0:08:05 | smithi | master | rhel | 7.9 | rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_7} tasks/rgw_snaps} | 2 | |
Failure Reason:
{'smithi205.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi184.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027208 | 2021-04-07 14:25:39 | 2021-04-07 15:49:40 | 2021-04-07 16:36:54 | 0:47:14 | 0:38:47 | 0:08:27 | smithi | master | centos | 7.8 | rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 6027209 | 2021-04-07 14:25:40 | 2021-04-07 15:49:51 | 2021-04-07 16:29:34 | 0:39:43 | 0:28:57 | 0:10:46 | smithi | master | centos | 7.8 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} | 2 | |
pass | 6027210 | 2021-04-07 14:25:41 | 2021-04-07 15:50:21 | 2021-04-07 16:11:12 | 0:20:51 | 0:11:47 | 0:09:04 | smithi | master | centos | 7.8 | rados/singleton/{all/peer msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} | 1 | |
pass | 6027211 | 2021-04-07 14:25:42 | 2021-04-07 15:50:21 | 2021-04-07 16:23:39 | 0:33:18 | 0:22:37 | 0:10:41 | smithi | master | ubuntu | 18.04 | rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} | 2 | |
pass | 6027212 | 2021-04-07 14:25:43 | 2021-04-07 15:50:22 | 2021-04-07 16:15:12 | 0:24:50 | 0:17:33 | 0:07:17 | smithi | master | ubuntu | 16.04 | rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-comp-snappy openstack settings/optimized workloads/cosbench_64K_write} | 1 | |
pass | 6027213 | 2021-04-07 14:25:44 | 2021-04-07 15:50:22 | 2021-04-07 16:20:06 | 0:29:44 | 0:19:15 | 0:10:29 | smithi | master | centos | 7.8 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-delay msgr/simple objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} | 2 | |
dead | 6027214 | 2021-04-07 14:25:46 | 2021-04-07 15:50:33 | 2021-04-07 16:01:13 | 0:10:40 | 0:03:55 | 0:06:45 | smithi | master | rhel | 7.9 | rados/singleton/{all/pg-autoscaler-progress-off msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_7}} | 2 | |
Failure Reason:
{'smithi057.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi044.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027215 | 2021-04-07 14:25:47 | 2021-04-07 15:50:33 | 2021-04-07 16:07:36 | 0:17:03 | 0:08:27 | 0:08:36 | smithi | master | ubuntu | 16.04 | rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{ubuntu_16.04}} | 1 | |
pass | 6027216 | 2021-04-07 14:25:48 | 2021-04-07 15:50:43 | 2021-04-07 16:13:01 | 0:22:18 | 0:10:55 | 0:11:23 | smithi | master | centos | 7.8 | rados/multimon/{clusters/9 msgr-failures/few msgr/random no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} | 3 | |
pass | 6027217 | 2021-04-07 14:25:49 | 2021-04-07 15:51:44 | 2021-04-07 16:14:53 | 0:23:09 | 0:13:36 | 0:09:33 | smithi | master | ubuntu | 16.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_16.04} tasks/failover} | 2 | |
dead | 6027218 | 2021-04-07 14:25:50 | 2021-04-07 15:52:14 | 2021-04-07 16:03:38 | 0:11:24 | 0:04:03 | 0:07:21 | smithi | master | rhel | 7.9 | rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi105.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027219 | 2021-04-07 14:25:51 | 2021-04-07 15:52:45 | 2021-04-07 16:13:49 | 0:21:04 | 0:10:54 | 0:10:10 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} | 3 | |
pass | 6027220 | 2021-04-07 14:25:52 | 2021-04-07 15:52:45 | 2021-04-07 16:28:54 | 0:36:09 | 0:25:47 | 0:10:22 | smithi | master | centos | 7.8 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
pass | 6027221 | 2021-04-07 14:25:53 | 2021-04-07 15:53:46 | 2021-04-07 16:17:06 | 0:23:20 | 0:13:31 | 0:09:49 | smithi | master | centos | 7.8 | rados/singleton/{all/pg-autoscaler msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} | 2 | |
dead | 6027222 | 2021-04-07 14:25:54 | 2021-04-07 15:54:06 | 2021-04-07 16:05:08 | 0:11:02 | 0:04:23 | 0:06:39 | smithi | master | rhel | 7.9 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_7} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} | 2 | |
Failure Reason:
{'smithi173.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi052.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027223 | 2021-04-07 14:25:55 | 2021-04-07 15:54:16 | 2021-04-07 16:13:32 | 0:19:16 | 0:10:06 | 0:09:10 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} | 2 | |
pass | 6027224 | 2021-04-07 14:25:56 | 2021-04-07 15:54:27 | 2021-04-07 16:34:30 | 0:40:03 | 0:29:39 | 0:10:24 | smithi | master | centos | 7.8 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} | 2 | |
pass | 6027225 | 2021-04-07 14:25:57 | 2021-04-07 15:54:37 | 2021-04-07 16:16:52 | 0:22:15 | 0:13:13 | 0:09:02 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-comp-zlib openstack settings/optimized workloads/fio_4K_rand_read} | 1 | |
pass | 6027226 | 2021-04-07 14:25:59 | 2021-04-07 15:55:19 | 2021-04-07 16:54:48 | 0:59:29 | 0:51:00 | 0:08:29 | smithi | master | ubuntu | 16.04 | rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_16.04} tasks/dashboard} | 2 | |
pass | 6027227 | 2021-04-07 14:26:00 | 2021-04-07 15:55:20 | 2021-04-07 16:18:54 | 0:23:34 | 0:12:09 | 0:11:25 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_16.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
pass | 6027228 | 2021-04-07 14:26:01 | 2021-04-07 15:55:40 | 2021-04-07 16:11:04 | 0:15:24 | 0:06:51 | 0:08:33 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/pg-removal-interruption msgr-failures/many msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 6027229 | 2021-04-07 14:26:02 | 2021-04-07 15:55:40 | 2021-04-07 17:11:01 | 1:15:21 | 1:03:00 | 0:12:21 | smithi | master | ubuntu | 16.04 | rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/jewel backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_16.04} msgr-failures/few msgr/async-v1only rados thrashers/default thrashosds-health workloads/radosbench} | 4 | |
pass | 6027230 | 2021-04-07 14:26:04 | 2021-04-07 15:57:11 | 2021-04-07 16:19:37 | 0:22:26 | 0:11:12 | 0:11:14 | smithi | master | rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/random objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} | 2 | |||
dead | 6027231 | 2021-04-07 14:26:05 | 2021-04-07 15:58:01 | 2021-04-07 16:08:58 | 0:10:57 | 0:04:03 | 0:06:54 | smithi | master | rhel | 7.9 | rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi166.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027232 | 2021-04-07 14:26:06 | 2021-04-07 15:58:12 | 2021-04-07 16:20:53 | 0:22:41 | 0:14:03 | 0:08:38 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/radostool msgr-failures/few msgr/simple objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 6027233 | 2021-04-07 14:26:07 | 2021-04-07 15:58:12 | 2021-04-07 16:27:34 | 0:29:22 | 0:19:58 | 0:09:24 | smithi | master | ubuntu | 18.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps} | 2 | |
pass | 6027234 | 2021-04-07 14:26:08 | 2021-04-07 15:58:13 | 2021-04-07 17:00:49 | 1:02:36 | 0:51:49 | 0:10:47 | smithi | master | ubuntu | 18.04 | rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} | 2 | |
dead | 6027235 | 2021-04-07 14:26:09 | 2021-04-07 15:58:23 | 2021-04-07 16:09:47 | 0:11:24 | 0:03:50 | 0:07:34 | smithi | master | rhel | 7.9 | rados/standalone/{supported-random-distro$/{rhel_7} workloads/mgr} | 1 | |
Failure Reason:
{'smithi123.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027236 | 2021-04-07 14:26:10 | 2021-04-07 15:58:44 | 2021-04-07 16:23:46 | 0:25:02 | 0:15:48 | 0:09:14 | smithi | master | ubuntu | 16.04 | rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-comp-zstd openstack settings/optimized workloads/fio_4K_rand_rw} | 1 | |
pass | 6027237 | 2021-04-07 14:26:11 | 2021-04-07 15:58:44 | 2021-04-07 16:36:31 | 0:37:47 | 0:26:55 | 0:10:52 | smithi | master | centos | 7.8 | rados/singleton/{all/random-eio msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}} | 2 | |
pass | 6027238 | 2021-04-07 14:26:12 | 2021-04-07 15:58:55 | 2021-04-07 16:30:59 | 0:32:04 | 0:22:26 | 0:09:38 | smithi | master | ubuntu | 16.04 | rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_16.04} tasks/rados_api_tests} | 2 | |
fail | 6027239 | 2021-04-07 14:26:13 | 2021-04-07 16:00:07 | 2021-04-07 16:28:11 | 0:28:04 | 0:16:42 | 0:11:22 | smithi | master | centos | 7.8 | rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_latest} tasks/insights} | 2 | |
Failure Reason:
"2021-04-07 16:26:12.779109 mds.c (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi163:y (4597), after 302.125 seconds" in cluster log |
||||||||||||||
pass | 6027240 | 2021-04-07 14:26:14 | 2021-04-07 16:00:27 | 2021-04-07 16:19:42 | 0:19:15 | 0:07:49 | 0:11:26 | smithi | master | ubuntu | 16.04 | rados/multimon/{clusters/21 msgr-failures/many msgr/simple no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_16.04} tasks/mon_clock_with_skews} | 3 | |
pass | 6027241 | 2021-04-07 14:26:15 | 2021-04-07 16:00:48 | 2021-04-07 16:36:31 | 0:35:43 | 0:25:39 | 0:10:04 | smithi | master | centos | 7.8 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps} | 2 | |
dead | 6027242 | 2021-04-07 14:26:17 | 2021-04-07 16:01:19 | 2021-04-07 16:12:06 | 0:10:47 | 0:03:58 | 0:06:49 | smithi | master | rhel | 7.9 | rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi184.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
dead | 6027243 | 2021-04-07 14:26:18 | 2021-04-07 16:01:19 | 2021-04-07 16:13:06 | 0:11:47 | 0:04:18 | 0:07:29 | smithi | master | rhel | 7.9 | rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/random objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi175.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027244 | 2021-04-07 14:26:19 | 2021-04-07 16:02:00 | 2021-04-07 16:17:20 | 0:15:20 | 0:06:47 | 0:08:33 | smithi | master | ubuntu | 18.04 | rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 6027245 | 2021-04-07 14:26:20 | 2021-04-07 16:02:00 | 2021-04-07 16:41:30 | 0:39:30 | 0:26:01 | 0:13:29 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} | 3 | |
pass | 6027246 | 2021-04-07 14:26:22 | 2021-04-07 16:03:42 | 2021-04-07 16:42:11 | 0:38:29 | 0:28:27 | 0:10:02 | smithi | master | centos | 7.8 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
dead | 6027247 | 2021-04-07 14:26:23 | 2021-04-07 16:04:22 | 2021-04-07 16:16:02 | 0:11:40 | 0:04:13 | 0:07:27 | smithi | master | rhel | 7.9 | rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_7} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} | 2 | |
Failure Reason:
{'smithi079.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi092.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
dead | 6027248 | 2021-04-07 14:26:24 | 2021-04-07 16:04:53 | 2021-04-07 16:15:20 | 0:10:27 | 0:04:28 | 0:05:59 | smithi | master | rhel | 7.9 | rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi038.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
dead | 6027249 | 2021-04-07 14:26:25 | 2021-04-07 16:04:53 | 2021-04-07 16:15:46 | 0:10:53 | 0:04:15 | 0:06:38 | smithi | master | rhel | 7.9 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_7} thrashers/fastread thrashosds-health workloads/ec-small-objects} | 2 | |
Failure Reason:
{'smithi170.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi037.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027250 | 2021-04-07 14:26:26 | 2021-04-07 16:04:54 | 2021-04-07 16:30:53 | 0:25:59 | 0:12:21 | 0:13:38 | smithi | master | ubuntu | 16.04 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
pass | 6027251 | 2021-04-07 14:26:27 | 2021-04-07 16:05:14 | 2021-04-07 16:28:13 | 0:22:59 | 0:12:57 | 0:10:02 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 6027252 | 2021-04-07 14:26:28 | 2021-04-07 16:06:55 | 2021-04-07 16:26:20 | 0:19:25 | 0:09:00 | 0:10:25 | smithi | master | ubuntu | 18.04 | rados/perf/{ceph distros/ubuntu_latest objectstore/bluestore-hybrid openstack settings/optimized workloads/fio_4M_rand_read} | 1 | |
dead | 6027253 | 2021-04-07 14:26:29 | 2021-04-07 16:06:55 | 2021-04-07 16:18:55 | 0:12:00 | 0:03:44 | 0:08:16 | smithi | master | rhel | 7.9 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/random objectstore/bluestore-stupid rados supported-random-distro$/{rhel_7} thrashers/careful thrashosds-health workloads/cache} | 2 | |
Failure Reason:
{'smithi107.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi006.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027254 | 2021-04-07 14:26:30 | 2021-04-07 16:07:37 | 2021-04-07 16:58:49 | 0:51:12 | 0:40:26 | 0:10:46 | smithi | master | centos | 7.8 | rados/verify/{ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/simple objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} | 2 | |
pass | 6027255 | 2021-04-07 14:26:31 | 2021-04-07 16:09:07 | 2021-04-07 17:20:18 | 1:11:11 | 1:00:02 | 0:11:09 | smithi | master | centos | 7.8 | rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{centos_latest} tasks/dashboard} | 2 | |
pass | 6027256 | 2021-04-07 14:26:32 | 2021-04-07 16:10:18 | 2021-04-07 16:33:00 | 0:22:42 | 0:11:10 | 0:11:32 | smithi | master | ubuntu | 18.04 | rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} | 2 | |
pass | 6027257 | 2021-04-07 14:26:34 | 2021-04-07 16:11:09 | 2021-04-07 16:34:53 | 0:23:44 | 0:13:30 | 0:10:14 | smithi | master | centos | 7.8 | rados/singleton/{all/resolve_stuck_peering msgr-failures/few msgr/random objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} | 2 | |
pass | 6027258 | 2021-04-07 14:26:35 | 2021-04-07 16:11:39 | 2021-04-07 16:50:35 | 0:38:56 | 0:28:07 | 0:10:49 | smithi | master | ubuntu | 18.04 | rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/random objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} | 2 | |
pass | 6027259 | 2021-04-07 14:26:36 | 2021-04-07 16:12:30 | 2021-04-07 16:40:11 | 0:27:41 | 0:16:14 | 0:11:27 | smithi | master | ubuntu | 16.04 | rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_16.04} msgr-failures/osd-delay msgr/async rados thrashers/mapgap thrashosds-health workloads/rbd_cls} | 4 | |
pass | 6027260 | 2021-04-07 14:26:37 | 2021-04-07 16:12:30 | 2021-04-07 16:30:09 | 0:17:39 | 0:08:31 | 0:09:08 | smithi | master | ubuntu | 16.04 | rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{ubuntu_16.04}} | 1 | |
dead | 6027261 | 2021-04-07 14:26:38 | 2021-04-07 16:13:10 | 2021-04-07 16:24:32 | 0:11:22 | 0:04:05 | 0:07:17 | smithi | master | rhel | 7.9 | rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/few msgr/simple objectstore/filestore-xfs rados supported-random-distro$/{rhel_7} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} | 2 | |
Failure Reason:
{'smithi150.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi082.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027262 | 2021-04-07 14:26:39 | 2021-04-07 16:13:11 | 2021-04-07 16:50:54 | 0:37:43 | 0:27:49 | 0:09:54 | smithi | master | ubuntu | 16.04 | rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_16.04} tasks/module_selftest} | 2 | |
dead | 6027263 | 2021-04-07 14:26:41 | 2021-04-07 16:13:41 | 2021-04-07 16:24:31 | 0:10:50 | 0:04:05 | 0:06:45 | smithi | master | rhel | 7.9 | rados/singleton/{all/test-crash msgr-failures/many msgr/simple objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi143.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
dead | 6027264 | 2021-04-07 14:26:42 | 2021-04-07 16:13:41 | 2021-04-07 16:24:51 | 0:11:10 | 0:04:06 | 0:07:04 | smithi | master | rhel | 7.9 | rados/standalone/{supported-random-distro$/{rhel_7} workloads/misc} | 1 | |
Failure Reason:
{'smithi093.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027265 | 2021-04-07 14:26:43 | 2021-04-07 16:13:42 | 2021-04-07 16:36:31 | 0:22:49 | 0:13:00 | 0:09:49 | smithi | master | centos | 7.8 | rados/multimon/{clusters/3 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/mon_recovery} | 2 | |
pass | 6027266 | 2021-04-07 14:26:44 | 2021-04-07 16:13:42 | 2021-04-07 16:35:01 | 0:21:19 | 0:11:17 | 0:10:02 | smithi | master | ubuntu | 16.04 | rados/perf/{ceph distros/ubuntu_16.04 objectstore/bluestore-stupid openstack settings/optimized workloads/fio_4M_rand_rw} | 1 | |
dead | 6027267 | 2021-04-07 14:26:45 | 2021-04-07 16:13:43 | 2021-04-07 16:24:46 | 0:11:03 | 0:04:09 | 0:06:54 | smithi | master | rhel | 7.9 | rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_7}} | 1 | |
Failure Reason:
{'smithi077.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |
||||||||||||||
pass | 6027268 | 2021-04-07 14:26:47 | 2021-04-07 16:13:53 | 2021-04-07 16:36:31 | 0:22:38 | 0:11:09 | 0:11:29 | smithi | master | ubuntu | 18.04 | rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} | 3 | |
pass | 6027269 | 2021-04-07 14:26:48 | 2021-04-07 16:15:04 | 2021-04-07 16:56:48 | 0:41:44 | 0:31:29 | 0:10:15 | smithi | master | centos | 7.8 | rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} | 2 | |
pass | 6027270 | 2021-04-07 14:26:49 | 2021-04-07 16:15:14 | 2021-04-07 16:38:31 | 0:23:17 | 0:14:23 | 0:08:54 | smithi | master | ubuntu | 18.04 | rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} | 1 | |
pass | 6027271 | 2021-04-07 14:26:50 | 2021-04-07 16:15:24 | 2021-04-07 16:48:01 | 0:32:37 | 0:21:50 | 0:10:47 | smithi | master | ubuntu | 16.04 | rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_16.04} thrashers/mapgap thrashosds-health workloads/rados_api_tests} | 2 | |
pass | 6027272 | 2021-04-07 14:26:52 | 2021-04-07 16:15:55 | 2021-04-07 16:56:01 | 0:40:06 | 0:29:54 | 0:10:12 | smithi | master | centos | 7.8 | rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} | 2 | |
dead | 6027273 | 2021-04-07 14:26:53 | 2021-04-07 16:16:05 | 2021-04-07 16:28:40 | 0:12:35 | 0:04:30 | 0:08:05 | smithi | master | rhel | 7.9 | rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_7} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} | 4 | |
Failure Reason:
{'smithi187.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi151.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi197.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi042.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} |