Name Machine Type Up Locked Locked Since Locked By OS Type OS Version Arch Description
smithi172.front.sepia.ceph.com smithi True True 2021-03-06 05:46:07.187793 scheduled_teuthology@teuthology ubuntu 16.04 x86_64 /home/teuthworker/archive/teuthology-2021-03-06_04:20:24-upgrade:mimic-x-nautilus-distro-basic-smithi/5941215
Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
running 5941215 2021-03-06 04:20:56 2021-03-06 05:45:27 2021-03-06 07:15:51 1:31:50 smithi master ubuntu 16.04 upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-msgr2 4-nautilus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check rgw_swift} objectstore/filestore-xfs supported-all-distro/ubuntu_16.04} 4
fail 5941202 2021-03-06 04:20:49 2021-03-06 05:24:35 2021-03-06 05:45:59 0:21:24 0:08:18 0:13:06 smithi master ubuntu 18.04 upgrade:luminous-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/luminous 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-msgr2 6-nautilus 7-final-workload/{rgw-swift snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest thrashosds-health} 5
Failure Reason:

Command failed on smithi039 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json'

pass 5940674 2021-03-06 03:17:04 2021-03-06 04:19:40 2021-03-06 05:29:51 1:10:11 0:58:22 0:11:49 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
pass 5940478 2021-03-05 23:58:21 2021-03-06 01:57:15 2021-03-06 03:17:46 1:20:31 1:07:49 0:12:42 smithi master ubuntu 16.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{ubuntu_16.04} workloads/dynamic_features} 3
pass 5940381 2021-03-05 23:57:30 2021-03-06 01:13:38 2021-03-06 01:57:01 0:43:23 0:32:55 0:10:28 smithi master centos 7.8 rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} thrashers/many workloads/rados_mon_workunits} 2
pass 5940338 2021-03-05 23:57:10 2021-03-06 00:54:54 2021-03-06 01:13:43 0:18:49 0:11:35 0:07:14 smithi master ubuntu rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs thrashers/default thrashosds-health workloads/rbd_fsx_nbd} 3
pass 5940278 2021-03-05 23:56:48 2021-03-06 00:34:35 2021-03-06 00:55:12 0:20:37 0:12:40 0:07:57 smithi master rhel 7.9 rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_7} tasks/crash} 2
pass 5939700 2021-03-05 14:55:39 2021-03-05 20:05:32 2021-03-05 20:54:03 0:48:31 0:41:13 0:07:18 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} 2
pass 5939649 2021-03-05 14:54:58 2021-03-05 19:41:50 2021-03-05 20:06:09 0:24:19 0:17:19 0:07:00 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} 2
pass 5939609 2021-03-05 14:54:26 2021-03-05 19:21:15 2021-03-05 19:42:39 0:21:24 0:15:08 0:06:16 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect} 2
pass 5939530 2021-03-05 14:53:24 2021-03-05 18:40:05 2021-03-05 19:21:17 0:41:12 0:32:59 0:08:13 smithi master ubuntu 18.04 rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/snaps-few-objects} 2
pass 5939480 2021-03-05 14:52:45 2021-03-05 18:14:07 2021-03-05 18:41:36 0:27:29 0:18:48 0:08:41 smithi master centos 8.2 rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_orch_cli} 1
pass 5939436 2021-03-05 14:52:09 2021-03-05 17:50:01 2021-03-05 18:14:35 0:24:34 0:17:45 0:06:49 smithi master ubuntu 18.04 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-localized} 2
pass 5939384 2021-03-05 14:51:29 2021-03-05 17:12:02 2021-03-05 17:50:53 0:38:51 0:30:21 0:08:30 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} 2
pass 5939310 2021-03-05 14:50:31 2021-03-05 15:49:38 2021-03-05 16:50:30 1:00:52 0:50:15 0:10:37 smithi master centos 8.2 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} 2
pass 5939284 2021-03-05 14:50:10 2021-03-05 15:27:26 2021-03-05 15:51:04 0:23:38 0:15:58 0:07:40 smithi master rhel 8.3 rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} 2
pass 5939259 2021-03-05 14:49:49 2021-03-05 14:54:12 2021-03-05 15:27:45 0:33:33 0:26:41 0:06:52 smithi master ubuntu 18.04 rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} 2
fail 5939223 2021-03-05 13:27:14 2021-03-05 13:29:08 2021-03-05 14:32:36 1:03:28 0:55:43 0:07:45 smithi master rhel 8.3 fs:workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/suites/ffsb}} 3
Failure Reason:

"2021-03-05T13:50:16.778415+0000 mon.a (mon.0) 308 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log

pass 5939124 2021-03-05 12:05:38 2021-03-05 12:46:25 2021-03-05 13:29:25 0:43:00 0:34:52 0:08:08 smithi master rhel 8.3 rados:cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} 2
pass 5938900 2021-03-05 06:29:13 2021-03-05 08:40:50 2021-03-05 09:50:36 1:09:46 1:01:58 0:07:48 smithi master rhel 8.3 fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 scrub/no tasks/{0-check-counter workunit/suites/fsx}} 3