Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6996905 2022-08-28 08:32:42 2022-08-28 08:38:54 2022-08-28 09:17:13 0:38:19 0:27:27 0:10:52 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} 3
pass 6996906 2022-08-28 08:32:46 2022-08-28 08:38:55 2022-08-28 08:58:07 0:19:12 0:10:25 0:08:47 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
pass 6996907 2022-08-28 08:32:50 2022-08-28 08:38:55 2022-08-28 09:14:16 0:35:21 0:24:53 0:10:28 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
pass 6996908 2022-08-28 08:32:53 2022-08-28 08:38:56 2022-08-28 09:00:58 0:22:02 0:11:38 0:10:24 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
pass 6996909 2022-08-28 08:32:57 2022-08-28 08:38:56 2022-08-28 09:18:15 0:39:19 0:29:59 0:09:20 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_fio} 3
pass 6996910 2022-08-28 08:33:01 2022-08-28 08:38:57 2022-08-28 09:16:24 0:37:27 0:27:49 0:09:38 smithi main ubuntu 20.04 rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_bonnie} 3
pass 6996911 2022-08-28 08:33:05 2022-08-28 08:38:57 2022-08-28 11:28:52 2:49:55 2:39:58 0:09:57 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-stupid 4-supported-random-distro$/{ubuntu_latest} 5-pool/none 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
pass 6996912 2022-08-28 08:33:09 2022-08-28 08:38:58 2022-08-28 12:49:00 4:10:02 4:00:27 0:09:35 smithi main ubuntu 20.04 rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1_luks1} 3
fail 6996913 2022-08-28 08:33:13 2022-08-28 08:39:18 2022-08-28 09:25:11 0:45:53 0:34:34 0:11:19 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} 3
Failure Reason:

"2022-08-28T09:06:06.301726+0000 mon.a (mon.0) 380 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 6996914 2022-08-28 08:33:16 2022-08-28 08:39:49 2022-08-28 09:06:59 0:27:10 0:17:37 0:09:33 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} 2
pass 6996915 2022-08-28 08:33:19 2022-08-28 08:39:59 2022-08-28 13:28:44 4:48:45 4:38:31 0:10:14 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} 3
pass 6996916 2022-08-28 08:33:22 2022-08-28 08:40:30 2022-08-28 09:01:35 0:21:05 0:11:43 0:09:22 smithi main ubuntu 20.04 rbd/singleton/{all/read-flags-writeback objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6996917 2022-08-28 08:33:26 2022-08-28 08:40:40 2022-08-28 09:26:15 0:45:35 0:35:57 0:09:38 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} 3
pass 6996918 2022-08-28 08:33:30 2022-08-28 08:40:51 2022-08-28 09:02:10 0:21:19 0:12:33 0:08:46 smithi main ubuntu 20.04 rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/rbd_cls_tests} 1
pass 6996919 2022-08-28 08:33:33 2022-08-28 08:40:51 2022-08-28 09:46:23 1:05:32 0:56:34 0:08:58 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
fail 6996920 2022-08-28 08:33:36 2022-08-28 08:41:02 2022-08-28 08:56:10 0:15:08 0:08:06 0:07:02 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/python_api_tests_with_defaults} 1
Failure Reason:

Command failed on smithi189 with status 1: 'sudo yum -y install ceph-test'

fail 6996921 2022-08-28 08:33:40 2022-08-28 08:41:12 2022-08-28 09:27:29 0:46:17 0:35:32 0:10:45 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} 3
Failure Reason:

"2022-08-28T09:07:32.631463+0000 mon.a (mon.0) 344 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY)" in cluster log

fail 6996922 2022-08-28 08:33:43 2022-08-28 08:41:22 2022-08-28 09:17:04 0:35:42 0:25:20 0:10:22 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
Failure Reason:

"2022-08-28T08:59:34.286644+0000 mon.a (mon.0) 101 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6996923 2022-08-28 08:33:46 2022-08-28 08:41:23 2022-08-28 09:22:44 0:41:21 0:30:55 0:10:26 smithi main ubuntu 20.04 rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} 2
fail 6996924 2022-08-28 08:33:49 2022-08-28 08:41:23 2022-08-28 09:06:57 0:25:34 0:18:22 0:07:12 smithi main centos 8.stream rbd/iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} 3
Failure Reason:

Command failed on smithi103 with status 1: 'sudo yum -y install ceph-test'

pass 6996925 2022-08-28 08:33:53 2022-08-28 08:41:34 2022-08-28 09:13:25 0:31:51 0:20:55 0:10:56 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
pass 6996926 2022-08-28 08:33:56 2022-08-28 08:41:44 2022-08-28 09:44:18 1:02:34 0:51:26 0:11:08 smithi main ubuntu 20.04 rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/c_api_tests_with_defaults} 2
pass 6996927 2022-08-28 08:33:58 2022-08-28 08:42:14 2022-08-28 09:24:55 0:42:41 0:31:19 0:11:22 smithi main ubuntu 20.04 rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} 4
pass 6996928 2022-08-28 08:34:01 2022-08-28 08:43:25 2022-08-28 09:19:04 0:35:39 0:24:41 0:10:58 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/fsx} 3
pass 6996929 2022-08-28 08:34:04 2022-08-28 08:43:45 2022-08-28 09:21:48 0:38:03 0:26:51 0:11:12 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} 2
pass 6996930 2022-08-28 08:34:07 2022-08-28 08:43:46 2022-08-28 09:07:36 0:23:50 0:13:07 0:10:43 smithi main ubuntu 20.04 rbd/singleton/{all/read-flags-writethrough objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6996931 2022-08-28 08:34:10 2022-08-28 08:43:56 2022-08-28 09:07:26 0:23:30 0:14:31 0:08:59 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_luks_encryption} 1
pass 6996932 2022-08-28 08:34:13 2022-08-28 08:44:07 2022-08-28 09:27:02 0:42:55 0:30:33 0:12:22 smithi main ubuntu 20.04 rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} 3
pass 6996933 2022-08-28 08:34:16 2022-08-28 08:45:17 2022-08-28 09:21:02 0:35:45 0:26:07 0:09:38 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests} 3
pass 6996934 2022-08-28 08:34:19 2022-08-28 08:45:37 2022-08-28 09:30:18 0:44:41 0:33:30 0:11:11 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_journal} 2
pass 6996935 2022-08-28 08:34:21 2022-08-28 08:46:18 2022-08-28 14:52:46 6:06:28 5:56:51 0:09:37 smithi main ubuntu 20.04 rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1_luks2} 3
pass 6996936 2022-08-28 08:34:25 2022-08-28 08:46:48 2022-08-28 09:23:29 0:36:41 0:23:00 0:13:41 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_defaults} 3
pass 6996937 2022-08-28 08:34:28 2022-08-28 08:48:19 2022-08-28 10:28:43 1:40:24 1:29:43 0:10:41 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} 3
pass 6996938 2022-08-28 08:34:31 2022-08-28 08:48:50 2022-08-28 09:24:26 0:35:36 0:24:56 0:10:40 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} 3
pass 6996939 2022-08-28 08:34:34 2022-08-28 08:48:50 2022-08-28 09:10:49 0:21:59 0:12:18 0:09:41 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
pass 6996940 2022-08-28 08:34:36 2022-08-28 08:49:31 2022-08-28 10:29:00 1:39:29 1:27:38 0:11:51 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/filestore-xfs 4-supported-random-distro$/{ubuntu_latest} 5-pool/replicated-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
pass 6996941 2022-08-28 08:34:39 2022-08-28 08:50:02 2022-08-28 09:10:30 0:20:28 0:10:58 0:09:30 smithi main ubuntu 20.04 rbd/singleton/{all/snap-diff objectstore/filestore-xfs openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6996942 2022-08-28 08:34:42 2022-08-28 08:50:02 2022-08-28 09:35:51 0:45:49 0:29:12 0:16:37 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_fio} 3
pass 6996943 2022-08-28 08:34:45 2022-08-28 08:56:15 2022-08-28 09:17:25 0:21:10 0:09:33 0:11:37 smithi main ubuntu 20.04 rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/rbd_lock_and_fence} 1
pass 6996944 2022-08-28 08:34:47 2022-08-28 08:58:06 2022-08-28 09:39:22 0:41:16 0:27:21 0:13:55 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} 3
pass 6996945 2022-08-28 08:34:51 2022-08-28 09:01:06 2022-08-28 09:36:03 0:34:57 0:23:03 0:11:54 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} 2
fail 6996946 2022-08-28 08:34:54 2022-08-28 09:01:37 2022-08-28 09:58:38 0:57:01 0:45:14 0:11:47 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
Failure Reason:

"2022-08-28T09:22:04.663132+0000 mon.a (mon.0) 265 : cluster [WRN] Health check failed: Degraded data redundancy: 2/7480 objects degraded (0.027%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6996947 2022-08-28 08:34:57 2022-08-28 09:04:20 2022-08-28 09:26:31 0:22:11 0:10:19 0:11:52 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} 3
fail 6996948 2022-08-28 08:35:00 2022-08-28 09:07:01 2022-08-28 09:35:16 0:28:15 0:18:05 0:10:10 smithi main ubuntu 20.04 rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} 3
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

fail 6996949 2022-08-28 08:35:02 2022-08-28 09:07:32 2022-08-28 09:20:51 0:13:19 0:06:54 0:06:25 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/python_api_tests_with_journaling} 1
Failure Reason:

Command failed on smithi078 with status 1: 'sudo yum -y install ceph-test'

fail 6996950 2022-08-28 08:35:05 2022-08-28 09:07:42 2022-08-28 09:36:46 0:29:04 0:18:00 0:11:04 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_nocache} 2
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

pass 6996951 2022-08-28 08:35:07 2022-08-28 09:08:42 2022-08-28 09:53:43 0:45:01 0:29:56 0:15:05 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} 3
pass 6996952 2022-08-28 08:35:10 2022-08-28 09:13:33 2022-08-28 09:50:52 0:37:19 0:27:59 0:09:20 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_migration} 1
pass 6996953 2022-08-28 08:35:13 2022-08-28 09:13:34 2022-08-28 11:05:58 1:52:24 1:42:13 0:10:11 smithi main ubuntu 20.04 rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2} 3
pass 6996954 2022-08-28 08:35:15 2022-08-28 09:14:24 2022-08-28 09:35:53 0:21:29 0:08:42 0:12:47 smithi main ubuntu 20.04 rbd/singleton/{all/verify_pool objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6996955 2022-08-28 08:35:17 2022-08-28 09:16:25 2022-08-28 09:49:27 0:33:02 0:24:18 0:08:44 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
pass 6996956 2022-08-28 08:35:20 2022-08-28 09:16:25 2022-08-28 10:03:28 0:47:03 0:35:22 0:11:41 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} 3
pass 6996957 2022-08-28 08:35:22 2022-08-28 09:17:16 2022-08-28 11:30:55 2:13:39 2:04:30 0:09:09 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} 3
pass 6996958 2022-08-28 08:35:25 2022-08-28 09:17:26 2022-08-28 10:47:48 1:30:22 1:19:32 0:10:50 smithi main ubuntu 20.04 rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/qemu_xfstests} 2
pass 6996959 2022-08-28 08:35:27 2022-08-28 09:18:17 2022-08-28 09:48:36 0:30:19 0:18:48 0:11:31 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/fsx} 3
pass 6996960 2022-08-28 08:35:30 2022-08-28 09:19:07 2022-08-28 09:52:23 0:33:16 0:20:48 0:12:28 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests} 3
pass 6996961 2022-08-28 08:35:33 2022-08-28 09:20:58 2022-08-28 09:54:37 0:33:39 0:22:53 0:10:46 smithi main ubuntu 20.04 rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_bonnie} 3
pass 6996962 2022-08-28 08:35:36 2022-08-28 09:21:08 2022-08-28 12:01:18 2:40:10 2:27:25 0:12:45 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-bitmap 4-supported-random-distro$/{ubuntu_latest} 5-pool/ec-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
pass 6996963 2022-08-28 08:35:39 2022-08-28 09:22:49 2022-08-28 09:55:00 0:32:11 0:17:51 0:14:20 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-ha-workunit} 2
pass 6996964 2022-08-28 08:35:42 2022-08-28 09:23:39 2022-08-28 09:40:40 0:17:01 0:08:28 0:08:33 smithi main ubuntu 20.04 rbd/singleton/{all/admin_socket objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6996965 2022-08-28 08:35:45 2022-08-28 09:23:40 2022-08-28 09:48:01 0:24:21 0:12:50 0:11:31 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_rate_limit} 2
pass 6996966 2022-08-28 08:35:47 2022-08-28 09:24:30 2022-08-28 09:56:39 0:32:09 0:20:54 0:11:15 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_defaults} 3
pass 6996967 2022-08-28 08:35:50 2022-08-28 09:25:01 2022-08-28 09:43:58 0:18:57 0:09:57 0:09:00 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
pass 6996968 2022-08-28 08:35:53 2022-08-28 09:25:01 2022-08-28 09:53:02 0:28:01 0:17:36 0:10:25 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
pass 6996969 2022-08-28 08:35:55 2022-08-28 09:25:22 2022-08-28 09:57:32 0:32:10 0:21:06 0:11:04 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} 3
pass 6996970 2022-08-28 08:35:58 2022-08-28 09:26:02 2022-08-28 09:55:52 0:29:50 0:20:02 0:09:48 smithi main ubuntu 20.04 rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/rbd_python_api_tests_old_format} 1
pass 6996971 2022-08-28 08:36:01 2022-08-28 09:26:23 2022-08-28 11:30:20 2:03:57 1:53:20 0:10:37 smithi main ubuntu 20.04 rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2_luks1} 3
pass 6996972 2022-08-28 08:36:03 2022-08-28 09:26:33 2022-08-28 10:38:19 1:11:46 1:01:51 0:09:55 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
fail 6996973 2022-08-28 08:36:05 2022-08-28 09:26:34 2022-08-28 09:40:19 0:13:45 0:07:08 0:06:37 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/rbd_mirror} 1
Failure Reason:

Command failed on smithi186 with status 1: 'sudo yum -y install ceph-test'

pass 6996974 2022-08-28 08:36:08 2022-08-28 09:27:04 2022-08-28 10:07:37 0:40:33 0:29:10 0:11:23 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_fio} 3
pass 6996975 2022-08-28 08:36:10 2022-08-28 09:27:35 2022-08-28 10:02:56 0:35:21 0:24:50 0:10:31 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
pass 6996976 2022-08-28 08:36:13 2022-08-28 09:27:35 2022-08-28 12:04:55 2:37:20 2:25:31 0:11:49 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} 3
pass 6996977 2022-08-28 08:36:15 2022-08-28 09:29:06 2022-08-28 10:08:37 0:39:31 0:27:36 0:11:55 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} 3
pass 6996978 2022-08-28 08:36:17 2022-08-28 09:30:26 2022-08-28 09:47:51 0:17:25 0:08:34 0:08:51 smithi main ubuntu 20.04 rbd/singleton/{all/formatted-output objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} 1
fail 6996979 2022-08-28 08:36:20 2022-08-28 09:30:27 2022-08-28 10:05:06 0:34:39 0:18:55 0:15:44 smithi main ubuntu 20.04 rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} 3
Failure Reason:

"2022-08-28T09:53:12.301996+0000 mon.a (mon.0) 115 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6996980 2022-08-28 08:36:22 2022-08-28 09:35:18 2022-08-28 10:15:35 0:40:17 0:29:50 0:10:27 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} 3
pass 6996981 2022-08-28 08:36:23 2022-08-28 09:35:58 2022-08-28 09:55:31 0:19:33 0:10:17 0:09:16 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/journal} 2
pass 6996982 2022-08-28 08:36:26 2022-08-28 09:36:09 2022-08-28 10:09:25 0:33:16 0:22:58 0:10:18 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
pass 6996983 2022-08-28 08:36:29 2022-08-28 09:36:09 2022-08-28 09:56:51 0:20:42 0:10:18 0:10:24 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} 2
pass 6996984 2022-08-28 08:36:31 2022-08-28 09:36:50 2022-08-28 10:25:44 0:48:54 0:35:53 0:13:01 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} 3
pass 6996985 2022-08-28 08:36:33 2022-08-28 09:39:31 2022-08-28 10:13:37 0:34:06 0:20:07 0:13:59 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/fsx} 3
pass 6996986 2022-08-28 08:36:36 2022-08-28 09:44:02 2022-08-28 10:05:47 0:21:45 0:12:21 0:09:24 smithi main ubuntu 20.04 rbd/singleton/{all/merge_diff objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6996987 2022-08-28 08:36:39 2022-08-28 09:44:22 2022-08-28 13:26:59 3:42:37 3:29:07 0:13:30 smithi main ubuntu 20.04 rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2_luks2} 3
pass 6996988 2022-08-28 08:36:41 2022-08-28 09:46:33 2022-08-28 11:49:42 2:03:09 1:52:27 0:10:42 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-lz4 4-supported-random-distro$/{ubuntu_latest} 5-pool/none 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
pass 6996989 2022-08-28 08:36:43 2022-08-28 09:48:03 2022-08-28 10:10:10 0:22:07 0:11:44 0:10:23 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} 3
pass 6996990 2022-08-28 08:36:46 2022-08-28 09:48:44 2022-08-28 11:02:15 1:13:31 1:00:56 0:12:35 smithi main ubuntu 20.04 rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/8G 7-workloads/fio} 2
pass 6996991 2022-08-28 08:36:48 2022-08-28 09:50:54 2022-08-28 10:21:58 0:31:04 0:20:36 0:10:28 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests} 3
pass 6996992 2022-08-28 08:36:50 2022-08-28 09:52:25 2022-08-28 10:24:39 0:32:14 0:21:02 0:11:12 smithi main ubuntu 20.04 rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/rbd_api_tests_old_format} 1
pass 6996993 2022-08-28 08:36:52 2022-08-28 09:53:05 2022-08-28 10:12:38 0:19:33 0:09:18 0:10:15 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_groups} 1
pass 6996994 2022-08-28 08:36:54 2022-08-28 09:53:06 2022-08-28 13:40:16 3:47:10 3:36:10 0:11:00 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} 3
pass 6996995 2022-08-28 08:36:57 2022-08-28 09:53:46 2022-08-28 10:36:21 0:42:35 0:32:23 0:10:12 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6996996 2022-08-28 08:36:59 2022-08-28 09:54:47 2022-08-28 13:10:38 3:15:51 3:02:06 0:13:45 smithi main ubuntu 20.04 rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} 3
fail 6996997 2022-08-28 08:37:01 2022-08-28 09:55:07 2022-08-28 10:10:19 0:15:12 0:08:08 0:07:04 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/c_api_tests} 1
Failure Reason:

Command failed on smithi033 with status 1: 'sudo yum -y install ceph-test'

pass 6996998 2022-08-28 08:37:03 2022-08-28 09:55:08 2022-08-28 10:27:36 0:32:28 0:21:44 0:10:44 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_defaults} 3
pass 6996999 2022-08-28 08:37:05 2022-08-28 10:12:43 2022-08-28 10:55:23 0:42:40 0:31:40 0:11:00 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests} 2
pass 6997000 2022-08-28 08:37:06 2022-08-28 10:13:44 2022-08-28 10:31:40 0:17:56 0:08:58 0:08:58 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
pass 6997001 2022-08-28 08:37:09 2022-08-28 10:13:44 2022-08-28 10:47:21 0:33:37 0:21:09 0:12:28 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} 3
pass 6997002 2022-08-28 08:37:11 2022-08-28 10:15:45 2022-08-28 10:39:10 0:23:25 0:09:03 0:14:22 smithi main ubuntu 20.04 rbd/singleton/{all/mon-command-help objectstore/bluestore-comp-zstd openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6997003 2022-08-28 08:37:12 2022-08-28 10:19:46 2022-08-28 10:41:34 0:21:48 0:10:34 0:11:14 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} 2
pass 6997004 2022-08-28 08:37:14 2022-08-28 10:22:06 2022-08-28 11:06:06 0:44:00 0:29:13 0:14:47 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_fio} 3
pass 6997005 2022-08-28 08:37:16 2022-08-28 10:25:47 2022-08-28 16:25:01 5:59:14 5:48:36 0:10:38 smithi main ubuntu 20.04 rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_none_luks1} 3
pass 6997006 2022-08-28 08:37:18 2022-08-28 10:27:08 2022-08-28 11:07:04 0:39:56 0:29:47 0:10:09 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} 3
pass 6997007 2022-08-28 08:37:20 2022-08-28 10:27:39 2022-08-28 11:08:28 0:40:49 0:29:27 0:11:22 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} 3
pass 6997008 2022-08-28 08:37:22 2022-08-28 10:28:49 2022-08-28 11:00:59 0:32:10 0:22:27 0:09:43 smithi main ubuntu 20.04 rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_bonnie} 3
pass 6997009 2022-08-28 08:37:24 2022-08-28 10:29:10 2022-08-28 10:50:51 0:21:41 0:10:03 0:11:38 smithi main ubuntu 20.04 rbd/singleton/{all/permissions objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6997010 2022-08-28 08:37:26 2022-08-28 10:31:50 2022-08-28 11:09:57 0:38:07 0:23:04 0:15:03 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
pass 6997011 2022-08-28 08:37:28 2022-08-28 10:36:21 2022-08-28 11:09:50 0:33:29 0:21:59 0:11:30 smithi main ubuntu 20.04 rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{ubuntu_latest} workloads/fio_on_immutable_object_cache} 2
pass 6997012 2022-08-28 08:37:30 2022-08-28 10:38:22 2022-08-28 11:11:18 0:32:56 0:19:54 0:13:02 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
pass 6997013 2022-08-28 08:37:32 2022-08-28 10:41:43 2022-08-28 11:29:00 0:47:17 0:31:31 0:15:46 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read} 2
fail 6997014 2022-08-28 08:37:35 2022-08-28 10:47:24 2022-08-28 13:13:30 2:26:06 2:14:46 0:11:20 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} 3
Failure Reason:

"2022-08-28T11:04:47.108393+0000 mon.a (mon.0) 228 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6997015 2022-08-28 08:37:37 2022-08-28 10:47:55 2022-08-28 11:47:10 0:59:15 0:41:31 0:17:44 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-hybrid pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} 3
pass 6997016 2022-08-28 08:37:39 2022-08-28 10:55:26 2022-08-28 13:24:58 2:29:32 2:14:03 0:15:29 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-snappy 4-supported-random-distro$/{ubuntu_latest} 5-pool/replicated-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
fail 6997017 2022-08-28 08:37:41 2022-08-28 11:01:07 2022-08-28 11:20:26 0:19:19 0:09:31 0:09:48 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
Failure Reason:

"2022-08-28T11:17:03.833532+0000 mon.a (mon.0) 107 : cluster [WRN] Health check failed: Degraded data redundancy: 1/4 objects degraded (25.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6997018 2022-08-28 08:37:43 2022-08-28 11:01:08 2022-08-28 11:38:24 0:37:16 0:21:05 0:16:11 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/fsx} 3
pass 6997019 2022-08-28 08:37:45 2022-08-28 11:06:09 2022-08-28 11:25:37 0:19:28 0:10:24 0:09:04 smithi main ubuntu 20.04 rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/rbd_cls_tests} 1
pass 6997020 2022-08-28 08:37:48 2022-08-28 11:06:09 2022-08-28 12:07:42 1:01:33 0:50:46 0:10:47 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6997021 2022-08-28 08:37:50 2022-08-28 11:06:09 2022-08-28 11:21:00 0:14:51 0:07:15 0:07:36 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/c_api_tests_with_defaults} 1
Failure Reason:

Command failed on smithi134 with status 1: 'sudo yum -y install ceph-test'

pass 6997022 2022-08-28 08:37:52 2022-08-28 11:06:10 2022-08-28 11:38:31 0:32:21 0:22:06 0:10:15 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} 2
pass 6997023 2022-08-28 08:37:54 2022-08-28 11:07:10 2022-08-28 11:40:10 0:33:00 0:20:52 0:12:08 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-stupid pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests} 3
fail 6997024 2022-08-28 08:37:56 2022-08-28 11:08:31 2022-08-28 12:35:34 1:27:03 1:17:46 0:09:17 smithi main ubuntu 20.04 rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/5G 7-workloads/qemu_xfstests} 2
Failure Reason:

Command failed on smithi059 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'

pass 6997025 2022-08-28 08:37:58 2022-08-28 11:08:31 2022-08-28 11:30:56 0:22:25 0:10:48 0:11:37 smithi main ubuntu 20.04 rbd/singleton/{all/qemu-iotests-no-cache objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6997026 2022-08-28 08:38:00 2022-08-28 11:09:22 2022-08-28 13:05:30 1:56:08 1:45:40 0:10:28 smithi main ubuntu 20.04 rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_none_luks2} 3
pass 6997027 2022-08-28 08:38:02 2022-08-28 11:09:52 2022-08-28 11:40:56 0:31:04 0:20:35 0:10:29 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_defaults} 3
pass 6997028 2022-08-28 08:38:04 2022-08-28 11:11:23 2022-08-28 11:30:51 0:19:28 0:09:17 0:10:11 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
pass 6997029 2022-08-28 08:38:06 2022-08-28 11:11:23 2022-08-28 11:43:12 0:31:49 0:16:55 0:14:54 smithi main ubuntu 20.04 rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/filestore-xfs pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} 3
fail 6997030 2022-08-28 08:38:07 2022-08-28 11:15:04 2022-08-28 14:41:55 3:26:51 3:12:35 0:14:16 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests_journaling} 2
Failure Reason:

Command failed (workunit test rbd/test_librbd.sh) on smithi037 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6222ec4babe11d4e6d65e2e056cfaf265efd024c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=125 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh'

pass 6997031 2022-08-28 08:38:09 2022-08-28 11:20:35 2022-08-28 12:02:48 0:42:13 0:24:25 0:17:48 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-bitmap pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} 3
pass 6997032 2022-08-28 08:38:11 2022-08-28 11:28:57 2022-08-28 12:08:41 0:39:44 0:30:20 0:09:24 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-lz4 pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_fio} 3
pass 6997033 2022-08-28 08:38:13 2022-08-28 11:29:07 2022-08-28 14:26:26 2:57:19 2:45:39 0:11:40 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} 3
pass 6997034 2022-08-28 08:38:15 2022-08-28 11:30:28 2022-08-28 11:54:16 0:23:48 0:14:13 0:09:35 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} 3
pass 6997035 2022-08-28 08:38:17 2022-08-28 11:30:58 2022-08-28 11:54:39 0:23:41 0:14:41 0:09:00 smithi main ubuntu 20.04 rbd/singleton/{all/qemu-iotests-writearound objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} 1
fail 6997036 2022-08-28 08:38:19 2022-08-28 11:30:59 2022-08-28 12:16:23 0:45:24 0:29:56 0:15:28 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} 3
Failure Reason:

"2022-08-28T11:58:09.921969+0000 mon.a (mon.0) 329 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log

pass 6997037 2022-08-28 08:38:20 2022-08-28 11:36:10 2022-08-28 11:57:18 0:21:08 0:12:35 0:08:33 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_luks_encryption} 1
pass 6997038 2022-08-28 08:38:22 2022-08-28 11:36:10 2022-08-28 14:48:58 3:12:48 3:00:27 0:12:21 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zlib 4-supported-random-distro$/{ubuntu_latest} 5-pool/ec-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
pass 6997039 2022-08-28 08:38:24 2022-08-28 11:38:31 2022-08-28 12:14:08 0:35:37 0:25:13 0:10:24 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-fast-diff} 2
pass 6997040 2022-08-28 08:38:26 2022-08-28 11:38:41 2022-08-28 12:21:51 0:43:10 0:32:24 0:10:46 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} 3
pass 6997041 2022-08-28 08:38:28 2022-08-28 11:40:12 2022-08-28 12:20:35 0:40:23 0:29:42 0:10:41 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
pass 6997042 2022-08-28 08:38:30 2022-08-28 11:41:03 2022-08-28 12:02:20 0:21:17 0:11:50 0:09:27 smithi main ubuntu 20.04 rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/rbd_lock_and_fence} 1
pass 6997043 2022-08-28 08:38:32 2022-08-28 11:41:03 2022-08-28 13:31:28 1:50:25 1:36:52 0:13:33 smithi main ubuntu 20.04 rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1} 3
pass 6997044 2022-08-28 08:38:34 2022-08-28 11:43:14 2022-08-28 12:36:53 0:53:39 0:40:41 0:12:58 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-fsx-workunit} 2
pass 6997045 2022-08-28 08:38:36 2022-08-28 11:47:15 2022-08-28 15:15:30 3:28:15 3:15:58 0:12:17 smithi main ubuntu 20.04 rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} 3
fail 6997046 2022-08-28 08:38:38 2022-08-28 11:49:45 2022-08-28 12:04:12 0:14:27 0:07:33 0:06:54 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/c_api_tests_with_journaling} 1
Failure Reason:

Command failed on smithi032 with status 1: 'sudo yum -y install ceph-test'

pass 6997047 2022-08-28 08:38:39 2022-08-28 11:49:46 2022-08-28 12:36:01 0:46:15 0:34:22 0:11:53 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} 3
pass 6997048 2022-08-28 08:38:41 2022-08-28 11:50:36 2022-08-28 12:33:39 0:43:03 0:29:36 0:13:27 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_api_tests_no_locking} 2
pass 6997049 2022-08-28 08:38:43 2022-08-28 11:54:17 2022-08-28 12:13:23 0:19:06 0:09:47 0:09:19 smithi main ubuntu 20.04 rbd/singleton/{all/qemu-iotests-writeback objectstore/filestore-xfs openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6997050 2022-08-28 08:38:44 2022-08-28 11:54:18 2022-08-28 12:24:38 0:30:20 0:19:38 0:10:42 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/fsx} 3
pass 6997051 2022-08-28 08:38:46 2022-08-28 11:54:58 2022-08-28 12:30:09 0:35:11 0:20:18 0:14:53 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests} 3
pass 6997052 2022-08-28 08:38:47 2022-08-28 11:57:59 2022-08-28 15:33:49 3:35:50 3:21:32 0:14:18 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} 3
pass 6997053 2022-08-28 08:38:49 2022-08-28 12:01:20 2022-08-28 12:32:39 0:31:19 0:20:26 0:10:53 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_defaults} 3
pass 6997054 2022-08-28 08:38:50 2022-08-28 12:02:51 2022-08-28 12:22:41 0:19:50 0:08:38 0:11:12 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
pass 6997055 2022-08-28 08:38:52 2022-08-28 12:05:01 2022-08-28 12:32:39 0:27:38 0:15:32 0:12:06 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
pass 6997056 2022-08-28 08:38:54 2022-08-28 12:07:12 2022-08-28 12:53:11 0:45:59 0:36:27 0:09:32 smithi main ubuntu 20.04 rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/recovery} 2
pass 6997057 2022-08-28 08:38:55 2022-08-28 12:07:43 2022-08-28 12:38:16 0:30:33 0:20:18 0:10:15 smithi main ubuntu 20.04 rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} 4
pass 6997058 2022-08-28 08:38:56 2022-08-28 12:08:43 2022-08-28 12:40:55 0:32:12 0:20:59 0:11:13 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-journaling} 2
pass 6997059 2022-08-28 08:38:58 2022-08-28 12:09:34 2022-08-28 12:31:13 0:21:39 0:09:07 0:12:32 smithi main ubuntu 20.04 rbd/singleton/{all/qemu-iotests-writethrough objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6997060 2022-08-28 08:39:00 2022-08-28 12:11:44 2022-08-28 12:41:38 0:29:54 0:19:57 0:09:57 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_migration} 1
pass 6997061 2022-08-28 08:39:01 2022-08-28 12:11:44 2022-08-28 12:41:37 0:29:53 0:16:59 0:12:54 smithi main ubuntu 20.04 rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_bonnie} 3
pass 6997062 2022-08-28 08:39:03 2022-08-28 12:14:15 2022-08-28 12:46:30 0:32:15 0:19:59 0:12:16 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} 3
pass 6997063 2022-08-28 08:39:04 2022-08-28 12:16:26 2022-08-28 12:47:38 0:31:12 0:15:50 0:15:22 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writearound} 2
pass 6997064 2022-08-28 08:39:06 2022-08-28 12:21:57 2022-08-28 16:10:42 3:48:45 3:37:17 0:11:28 smithi main ubuntu 20.04 rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1_luks1} 3
pass 6997065 2022-08-28 08:39:08 2022-08-28 12:22:48 2022-08-28 13:04:30 0:41:42 0:28:43 0:12:59 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_fio} 3
pass 6997066 2022-08-28 08:39:09 2022-08-28 12:24:48 2022-08-28 14:32:41 2:07:53 1:51:25 0:16:28 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-comp-zstd 4-supported-random-distro$/{ubuntu_latest} 5-pool/none 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
pass 6997067 2022-08-28 08:39:11 2022-08-28 12:30:19 2022-08-28 12:59:57 0:29:38 0:19:49 0:09:49 smithi main ubuntu 20.04 rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/rbd_python_api_tests_old_format} 1
pass 6997068 2022-08-28 08:39:12 2022-08-28 12:30:30 2022-08-28 13:10:10 0:39:40 0:27:44 0:11:56 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} 3
pass 6997069 2022-08-28 08:39:14 2022-08-28 12:32:40 2022-08-28 13:40:40 1:08:00 0:57:47 0:10:13 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} 2
fail 6997070 2022-08-28 08:39:15 2022-08-28 12:32:41 2022-08-28 12:45:11 0:12:30 0:07:16 0:05:14 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/fsx} 1
Failure Reason:

Command failed on smithi005 with status 1: 'sudo yum -y install ceph-test'

pass 6997071 2022-08-28 08:39:17 2022-08-28 12:32:41 2022-08-28 13:06:08 0:33:27 0:24:41 0:08:46 smithi main ubuntu 20.04 rbd/singleton/{all/qos objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6997072 2022-08-28 08:39:18 2022-08-28 13:08:05 1491 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
pass 6997073 2022-08-28 08:39:20 2022-08-28 12:32:42 2022-08-28 13:15:03 0:42:21 0:28:51 0:13:30 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} 3
fail 6997074 2022-08-28 08:39:21 2022-08-28 12:35:43 2022-08-28 12:49:44 0:14:01 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} 3
Failure Reason:

Cannot connect to remote host smithi078

pass 6997075 2022-08-28 08:39:22 2022-08-28 12:36:03 2022-08-28 13:22:37 0:46:34 0:34:55 0:11:39 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} 3
pass 6997076 2022-08-28 08:39:24 2022-08-28 12:36:54 2022-08-28 13:09:56 0:33:02 0:21:52 0:11:10 smithi main ubuntu 20.04 rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} 3
pass 6997077 2022-08-28 08:39:25 2022-08-28 12:38:24 2022-08-28 13:11:38 0:33:14 0:21:47 0:11:27 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-minimum} 2
pass 6997078 2022-08-28 08:39:27 2022-08-28 12:40:15 2022-08-28 13:04:27 0:24:12 0:13:17 0:10:55 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} 2
pass 6997079 2022-08-28 08:39:28 2022-08-28 12:41:05 2022-08-28 13:03:13 0:22:08 0:10:48 0:11:20 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} 3
pass 6997080 2022-08-28 08:39:29 2022-08-28 12:41:16 2022-08-28 13:11:42 0:30:26 0:19:11 0:11:15 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/fsx} 3
pass 6997081 2022-08-28 08:39:30 2022-08-28 12:41:46 2022-08-28 17:06:09 4:24:23 4:13:03 0:11:20 smithi main ubuntu 20.04 rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-snappy pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks1_luks2} 3
pass 6997082 2022-08-28 08:39:32 2022-08-28 12:42:17 2022-08-28 13:20:07 0:37:50 0:25:16 0:12:34 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
pass 6997083 2022-08-28 08:39:33 2022-08-28 12:45:18 2022-08-28 13:16:47 0:31:29 0:20:22 0:11:07 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests} 3
pass 6997084 2022-08-28 08:39:34 2022-08-28 12:46:38 2022-08-28 13:05:26 0:18:48 0:08:35 0:10:13 smithi main ubuntu 20.04 rbd/singleton/{all/rbd-vs-unmanaged-snaps objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6997085 2022-08-28 08:39:35 2022-08-28 12:47:49 2022-08-28 13:07:11 0:19:22 0:08:50 0:10:32 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
pass 6997086 2022-08-28 08:39:37 2022-08-28 12:47:49 2022-08-28 13:20:55 0:33:06 0:20:49 0:12:17 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_defaults} 3
pass 6997087 2022-08-28 08:39:38 2022-08-28 12:49:10 2022-08-28 15:13:28 2:24:18 2:14:39 0:09:39 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-hybrid 4-supported-random-distro$/{ubuntu_latest} 5-pool/replicated-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
pass 6997088 2022-08-28 08:39:39 2022-08-28 12:49:50 2022-08-28 14:14:51 1:25:01 1:12:16 0:12:45 smithi main ubuntu 20.04 rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/1G 7-workloads/qemu_xfstests} 2
pass 6997089 2022-08-28 08:39:41 2022-08-28 12:53:21 2022-08-28 13:35:17 0:41:56 0:21:14 0:20:42 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} 3
pass 6997090 2022-08-28 08:39:42 2022-08-28 13:03:23 2022-08-28 13:32:49 0:29:26 0:20:28 0:08:58 smithi main ubuntu 20.04 rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/rbd_api_tests_old_format} 1
pass 6997091 2022-08-28 08:39:44 2022-08-28 13:03:23 2022-08-28 16:10:15 3:06:52 2:55:25 0:11:27 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} 3
pass 6997092 2022-08-28 08:39:45 2022-08-28 13:04:34 2022-08-28 13:47:57 0:43:23 0:34:20 0:09:03 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-workunit} 2
pass 6997093 2022-08-28 08:39:46 2022-08-28 13:04:34 2022-08-28 14:59:08 1:54:34 1:43:38 0:10:56 smithi main ubuntu 20.04 rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} 3
fail 6997094 2022-08-28 08:39:48 2022-08-28 13:05:34 2022-08-28 13:20:49 0:15:15 0:07:26 0:07:49 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/python_api_tests} 1
Failure Reason:

Command failed on smithi160 with status 1: 'sudo yum -y install ceph-test'

pass 6997095 2022-08-28 08:39:49 2022-08-28 13:05:35 2022-08-28 13:32:41 0:27:06 0:15:23 0:11:43 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writethrough} 2
pass 6997096 2022-08-28 08:39:51 2022-08-28 13:07:15 2022-08-28 13:47:44 0:40:29 0:28:26 0:12:03 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_fio} 3
pass 6997097 2022-08-28 08:39:52 2022-08-28 13:10:06 2022-08-28 14:03:34 0:53:28 0:42:59 0:10:29 smithi main ubuntu 20.04 rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6997098 2022-08-28 08:39:53 2022-08-28 13:10:06 2022-08-28 14:17:40 1:07:34 0:57:35 0:09:59 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} 2
pass 6997099 2022-08-28 08:39:55 2022-08-28 13:10:17 2022-08-28 15:30:07 2:19:50 2:06:49 0:13:01 smithi main ubuntu 20.04 rbd/encryption/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2} 3
fail 6997100 2022-08-28 08:39:56 2022-08-28 13:10:47 2022-08-28 13:49:46 0:38:59 0:28:03 0:10:56 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} 3
Failure Reason:

"2022-08-28T13:40:23.679306+0000 mon.a (mon.0) 716 : cluster [WRN] Health check failed: Degraded data redundancy: 1/198 objects degraded (0.505%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6997101 2022-08-28 08:39:57 2022-08-28 13:11:48 2022-08-28 13:45:08 0:33:20 0:22:56 0:10:24 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
pass 6997102 2022-08-28 08:39:59 2022-08-28 13:11:48 2022-08-28 14:51:23 1:39:35 1:30:37 0:08:58 smithi main ubuntu 20.04 rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{ubuntu_latest} workloads/qemu_on_immutable_object_cache_and_thrash} 2
pass 6997103 2022-08-28 08:40:00 2022-08-28 13:11:48 2022-08-28 13:36:50 0:25:02 0:14:25 0:10:37 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
fail 6997104 2022-08-28 08:40:02 2022-08-28 13:54:28 1809 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} 3
Failure Reason:

"2022-08-28T13:44:54.275880+0000 mon.a (mon.0) 748 : cluster [WRN] Health check failed: Degraded data redundancy: 10/3156 objects degraded (0.317%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6997105 2022-08-28 08:40:03 2022-08-28 13:15:10 2022-08-28 13:36:58 0:21:48 0:08:56 0:12:52 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_groups} 1
pass 6997106 2022-08-28 08:40:04 2022-08-28 13:16:50 2022-08-28 14:11:43 0:54:53 0:41:18 0:13:35 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} 3
pass 6997107 2022-08-28 08:40:06 2022-08-28 13:20:11 2022-08-28 13:40:22 0:20:11 0:09:35 0:10:36 smithi main ubuntu 20.04 rbd/singleton/{all/rbd_tasks objectstore/bluestore-comp-zstd openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6997108 2022-08-28 08:40:07 2022-08-28 13:20:51 2022-08-28 13:54:48 0:33:57 0:23:13 0:10:44 smithi main ubuntu 20.04 rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_bonnie} 3
fail 6997109 2022-08-28 08:40:08 2022-08-28 13:21:02 2022-08-28 13:50:20 0:29:18 0:18:02 0:11:16 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_copy_on_read} 2
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

fail 6997110 2022-08-28 08:40:10 2022-08-28 13:22:43 2022-08-28 13:54:51 0:32:08 0:18:21 0:13:47 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/fsx} 3
Failure Reason:

"2022-08-28T13:42:20.619449+0000 mon.a (mon.0) 203 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6997111 2022-08-28 08:40:11 2022-08-28 13:25:03 2022-08-28 15:41:21 2:16:18 2:04:12 0:12:06 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} 3
Failure Reason:

Command failed on smithi196 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'

fail 6997112 2022-08-28 08:40:12 2022-08-28 13:27:04 2022-08-28 13:56:58 0:29:54 0:18:25 0:11:29 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests} 3
Failure Reason:

reached maximum tries (90) after waiting for 540 seconds

pass 6997113 2022-08-28 08:40:13 2022-08-28 13:38:18 2022-08-28 15:54:36 2:16:18 2:09:21 0:06:57 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-low-osd-mem-target 4-supported-random-distro$/{ubuntu_latest} 5-pool/ec-data-pool 6-prepare/raw-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
pass 6997114 2022-08-28 08:40:15 2022-08-28 13:38:18 2022-08-28 14:06:12 0:27:54 0:21:25 0:06:29 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} 2
pass 6997115 2022-08-28 08:40:16 2022-08-28 13:38:19 2022-08-28 13:51:53 0:13:34 0:06:50 0:06:44 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
fail 6997116 2022-08-28 08:40:17 2022-08-28 13:38:19 2022-08-28 13:53:38 0:15:19 0:08:09 0:07:10 smithi main ubuntu 20.04 rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/rbd_cls_tests} 1
Failure Reason:

"2022-08-28T13:48:46.770727+0000 mon.a (mon.0) 103 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6997117 2022-08-28 08:40:19 2022-08-28 13:38:19 2022-08-28 15:47:54 2:09:35 2:03:50 0:05:45 smithi main ubuntu 20.04 rbd/encryption/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2_luks1} 3
pass 6997118 2022-08-28 08:40:20 2022-08-28 13:38:20 2022-08-28 14:32:05 0:53:45 0:47:02 0:06:43 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} 2
fail 6997119 2022-08-28 08:40:21 2022-08-28 13:38:20 2022-08-28 13:48:51 0:10:31 0:04:15 0:06:16 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/python_api_tests_with_defaults} 1
Failure Reason:

Command failed on smithi043 with status 1: 'sudo yum -y install ceph-test'

fail 6997120 2022-08-28 08:40:22 2022-08-28 13:38:21 2022-08-28 13:47:49 0:09:28 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_defaults} 3
Failure Reason:

Stale jobs detected, aborting.

dead 6997121 2022-08-28 08:40:24 2022-08-28 13:38:21 2022-08-28 13:38:23 0:00:02 smithi main ubuntu 20.04 rbd/singleton/{all/rbdmap_RBDMAPFILE objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} 1
Failure Reason:

Error reimaging machines: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/host/181/task

dead 6997122 2022-08-28 08:40:25 2022-08-28 13:38:21 2022-08-28 13:56:23 0:18:02 0:09:50 0:08:12 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} 3
Failure Reason:

{'smithi027.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'module_stderr': "Warning: Permanently added 'smithi027.front.sepia.ceph.com,172.21.15.27' (ECDSA) to the list of known hosts.\r\nControlSocket /home/teuthworker/.ansible/cp/657cd48989 already exists, disabling multiplexing\r\nConnection to smithi027.front.sepia.ceph.com closed.\r\n", 'module_stdout': "/usr/bin/python: can't open file '/home/ubuntu/.ansible/tmp/ansible-tmp-1661694360.3271577-367-69952422520776/AnsiballZ_apt.py': [Errno 2] No such file or directory\r\n", 'msg': 'MODULE FAILURE\nSee stdout/stderr for the exact error', 'rc': 2}}

pass 6997123 2022-08-28 08:40:26 2022-08-28 13:38:32 2022-08-28 13:58:26 0:19:54 0:10:53 0:09:01 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} 3
dead 6997124 2022-08-28 08:40:27 2022-08-28 13:40:22 2022-08-28 13:46:08 0:05:46 smithi main ubuntu 20.04 rbd/pwl-cache/home/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/8G 7-workloads/c_api_tests_with_defaults} 2
Failure Reason:

Error reimaging machines: 'ssh_keyscan smithi062.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds

pass 6997125 2022-08-28 08:40:29 2022-08-28 13:40:23 2022-08-28 13:54:30 0:14:07 0:07:19 0:06:48 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
fail 6997126 2022-08-28 08:40:30 2022-08-28 13:40:43 2022-08-28 13:55:15 0:14:32 smithi main ubuntu 20.04 rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_fsstress} 3
Failure Reason:

Command failed on smithi062 with status 100: 'sudo apt-get update'

fail 6997127 2022-08-28 08:40:31 2022-08-28 13:47:49 2022-08-28 13:55:15 0:07:26 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_fio} 3
Failure Reason:

Cannot connect to remote host smithi062

fail 6997128 2022-08-28 08:40:32 2022-08-28 13:47:59 2022-08-28 13:57:54 0:09:55 0:03:03 0:06:52 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_deep_copy} 2
Failure Reason:

{'smithi027.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi027.front.sepia.ceph.com port 22: No route to host'}}

pass 6997129 2022-08-28 08:40:34 2022-08-28 13:48:00 2022-08-28 14:21:31 0:33:31 0:25:10 0:08:21 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} 3
pass 6997130 2022-08-28 08:40:35 2022-08-28 13:49:50 2022-08-28 14:02:38 0:12:48 0:06:23 0:06:25 smithi main ubuntu 20.04 rbd/singleton/{all/read-flags-no-cache objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6997131 2022-08-28 08:40:36 2022-08-28 13:49:50 2022-08-28 14:19:49 0:29:59 0:22:30 0:07:29 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
pass 6997132 2022-08-28 08:40:37 2022-08-28 13:50:21 2022-08-28 17:33:24 3:43:03 3:34:01 0:09:02 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features_no_cache} 3
pass 6997133 2022-08-28 08:40:38 2022-08-28 13:53:42 2022-08-28 14:30:19 0:36:37 0:29:26 0:07:11 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} 3
pass 6997134 2022-08-28 08:40:39 2022-08-28 13:54:32 2022-08-28 14:24:27 0:29:55 0:22:04 0:07:51 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-min-compat-client-octopus} 2
dead 6997135 2022-08-28 08:40:41 2022-08-28 13:54:53 2022-08-29 02:07:12 12:12:19 smithi main ubuntu 20.04 rbd/encryption/{cache/writethrough clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_luks2_luks2} 3
Failure Reason:

hit max job timeout

pass 6997136 2022-08-28 08:40:42 2022-08-28 13:54:53 2022-08-28 14:36:52 0:41:59 0:33:50 0:08:09 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} 3
fail 6997137 2022-08-28 08:40:43 2022-08-28 13:55:23 2022-08-28 14:06:52 0:11:29 0:03:12 0:08:17 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/bluestore-stupid 4-supported-random-distro$/{ubuntu_latest} 5-pool/none 6-prepare/qcow2-file 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
Failure Reason:

{'smithi062.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi062.front.sepia.ceph.com port 22: No route to host'}}

dead 6997138 2022-08-28 08:40:44 2022-08-28 13:55:24 2022-08-28 14:07:12 0:11:48 0:02:27 0:09:21 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/fsx} 3
Failure Reason:

{'smithi027.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'ignore_selinux_state': False, 'name': 'nagios_run_sudo', 'persistent': True, 'state': True}}, 'msg': 'Failed to manage policy for boolean nagios_run_sudo: [Errno 11] Resource temporarily unavailable'}}

dead 6997139 2022-08-28 08:40:46 2022-08-28 13:56:24 2022-08-28 13:57:29 0:01:05 smithi main ubuntu 20.04 rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/rbd_lock_and_fence} 1
Failure Reason:

Error reimaging machines: Failed to power on smithi062

pass 6997140 2022-08-28 08:40:47 2022-08-28 13:56:25 2022-08-28 14:52:16 0:55:51 0:48:34 0:07:17 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} 2
fail 6997141 2022-08-28 08:40:48 2022-08-28 13:57:05 2022-08-28 14:05:33 0:08:28 smithi main ubuntu 20.04 rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests} 3
Failure Reason:

Stale jobs detected, aborting.

fail 6997142 2022-08-28 08:40:49 2022-08-28 13:57:35 2022-08-28 14:11:20 0:13:45 0:05:46 0:07:59 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/python_api_tests_with_journaling} 1
Failure Reason:

{'smithi027.front.sepia.ceph.com': {'changed': True, 'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-JRbnY7JM70kcvHM9XWvYlN9fJz6H92Dvl3g6XIX34gvBIK8hz34RRqMeOdcnQS86'], 'labels': [], 'masters': [], 'uuids': ['8d05c3fb-c4ed-4752-a3b1-f38fe93ce78c']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': 'dd if=/dev/zero of=/dev/dm-1 bs=1M count=110', 'delta': '0:00:00.144681', 'end': '2022-08-28 14:06:22.611702', 'failed': False, 'invocation': {'module_args': {'_raw_params': 'dd if=/dev/zero of=/dev/dm-1 bs=1M count=110', '_uses_shell': True, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': {'key': 'dm-1', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-JRbnY7JM70kcvHM9XWvYlN9fJz6H92Dvl3g6XIX34gvBIK8hz34RRqMeOdcnQS86'], 'labels': [], 'masters': [], 'uuids': ['8d05c3fb-c4ed-4752-a3b1-f38fe93ce78c']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'msg': '', 'rc': 0, 'start': '2022-08-28 14:06:22.467021', 'stderr': '110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.14178 s, 814 MB/s', 'stderr_lines': ['110+0 records in', '110+0 records out', '115343360 bytes (115 MB, 110 MiB) copied, 0.14178 s, 814 MB/s'], 'stdout': '', 'stdout_lines': []}, {'_ansible_item_label': {'key': 'nvme0n1', 'value': {'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'links': {'ids': ['lvm-pv-uuid-37exo5-mXLC-jWYS-UqEs-1Wxd-cYu1-Ifo2Uh', 'nvme-INTEL_SSDPEDMD400G4_CVFT5331001C400BGN', 'nvme-nvme.8086-43564654353333313030314334303042474e-494e54454c205353445045444d443430304734-00000001'], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'uuids': []}, 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': 'dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110', 'delta': '0:00:00.039258', 'end': '2022-08-28 14:06:23.032011', 'failed': False, 'invocation': {'module_args': {'_raw_params': 'dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110', '_uses_shell': True, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': {'key': 'nvme0n1', 'value': {'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'links': {'ids': ['lvm-pv-uuid-37exo5-mXLC-jWYS-UqEs-1Wxd-cYu1-Ifo2Uh', 'nvme-INTEL_SSDPEDMD400G4_CVFT5331001C400BGN', 'nvme-nvme.8086-43564654353333313030314334303042474e-494e54454c205353445045444d443430304734-00000001'], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'uuids': []}, 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'msg': '', 'rc': 0, 'start': '2022-08-28 14:06:22.992753', 'stderr': '110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0363846 s, 3.2 GB/s', 'stderr_lines': ['110+0 records in', '110+0 records out', '115343360 bytes (115 MB, 110 MiB) copied, 0.0363846 s, 3.2 GB/s'], 'stdout': '', 'stdout_lines': []}, {'_ansible_item_label': {'key': 'dm-4', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-JRbnY7JM70kcvHM9XWvYlN9fJz6H92DvOOWKOxsmCg9f1yy98KdQXxEpoepfJ8qu'], 'labels': [], 'masters': [], 'uuids': ['e367e152-26d7-41ca-bcd6-6dbfd82c3cd3']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': True, 'cmd': 'dd if=/dev/zero of=/dev/dm-4 bs=1M count=110', 'delta': '0:00:00.140690', 'end': '2022-08-28 14:06:23.547126', 'failed': False, 'invocation': {'module_args': {'_raw_params': 'dd if=/dev/zero of=/dev/dm-4 bs=1M count=110', '_uses_shell': True, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'item': {'key': 'dm-4', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-JRbnY7JM70kcvHM9XWvYlN9fJz6H92DvOOWKOxsmCg9f1yy98KdQXxEpoepfJ8qu'], 'labels': [], 'masters': [], 'uuids': ['e367e152-26d7-41ca-bcd6-6dbfd82c3cd3']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'msg': '', 'rc': 0, 'start': '2022-08-28 14:06:23.406436', 'stderr': '110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137846 s, 837 MB/s', 'stderr_lines': ['110+0 records in', '110+0 records out', '115343360 bytes (115 MB, 110 MiB) copied, 0.137846 s, 837 MB/s'], 'stdout': '', 'stdout_lines': []}, {'_ansible_item_label': {'key': 'dm-2', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-JRbnY7JM70kcvHM9XWvYlN9fJz6H92Dv0S7uYu10Fla3kgmBLA0V4XzArmbX9yk5'], 'labels': [], 'masters': [], 'uuids': ['62f7d547-14a5-4f2e-bad6-bc404c253832']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item', 'item': {'key': 'dm-2', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-JRbnY7JM70kcvHM9XWvYlN9fJz6H92Dv0S7uYu10Fla3kgmBLA0V4XzArmbX9yk5'], 'labels': [], 'masters': [], 'uuids': ['62f7d547-14a5-4f2e-bad6-bc404c253832']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi027.front.sepia.ceph.com port 22: No route to host', 'unreachable': True}, {'_ansible_item_label': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-JRbnY7JM70kcvHM9XWvYlN9fJz6H92DvKdnv6gFLwibEqzajMRfERp36UatEQJvM'], 'labels': [], 'masters': [], 'uuids': ['6f554a93-32de-4df9-a633-dacf4dc206ff']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item', 'item': {'key': 'dm-0', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-JRbnY7JM70kcvHM9XWvYlN9fJz6H92DvKdnv6gFLwibEqzajMRfERp36UatEQJvM'], 'labels': [], 'masters': [], 'uuids': ['6f554a93-32de-4df9-a633-dacf4dc206ff']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi027.front.sepia.ceph.com port 22: No route to host', 'unreachable': True}, {'_ansible_item_label': {'key': 'sda', 'value': {'holders': [], 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4H3N7', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4H3N7', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4H3N7', 'scsi-35000c500871b45cd', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4H3N7', 'wwn-0x5000c500871b45cd'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'ST1000NM0033-9ZM', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4H3N7-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4H3N7-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4H3N7-part1', 'scsi-35000c500871b45cd-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4H3N7-part1', 'wwn-0x5000c500871b45cd-part1'], 'labels': [], 'masters': [], 'uuids': ['5e467449-8f2e-4298-a324-2eafe9800a37']}, 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'start': '2048', 'uuid': '5e467449-8f2e-4298-a324-2eafe9800a37'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'serial': 'Z1W4H3N7', 'size': '931.51 GB', 'support_discard': '0', 'vendor': 'ATA', 'virtual': 1, 'wwn': '0x5000c500871b45cd'}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'item': {'key': 'sda', 'value': {'holders': [], 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4H3N7', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4H3N7', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4H3N7', 'scsi-35000c500871b45cd', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4H3N7', 'wwn-0x5000c500871b45cd'], 'labels': [], 'masters': [], 'uuids': []}, 'model': 'ST1000NM0033-9ZM', 'partitions': {'sda1': {'holders': [], 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4H3N7-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4H3N7-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4H3N7-part1', 'scsi-35000c500871b45cd-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4H3N7-part1', 'wwn-0x5000c500871b45cd-part1'], 'labels': [], 'masters': [], 'uuids': ['5e467449-8f2e-4298-a324-2eafe9800a37']}, 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'start': '2048', 'uuid': '5e467449-8f2e-4298-a324-2eafe9800a37'}}, 'removable': '0', 'rotational': '1', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'serial': 'Z1W4H3N7', 'size': '931.51 GB', 'support_discard': '0', 'vendor': 'ATA', 'virtual': 1, 'wwn': '0x5000c500871b45cd'}}, 'skip_reason': 'Conditional result was False', 'skipped': True}, {'_ansible_item_label': {'key': 'dm-3', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-JRbnY7JM70kcvHM9XWvYlN9fJz6H92Dvb7HQd57fF0AdCL2vzZvc6WtjdTzdjDPa'], 'labels': [], 'masters': [], 'uuids': ['a6b5a54a-572b-4cc7-9be5-51b71b9046df']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'ansible_loop_var': 'item', 'item': {'key': 'dm-3', 'value': {'holders': [], 'host': '', 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-JRbnY7JM70kcvHM9XWvYlN9fJz6H92Dvb7HQd57fF0AdCL2vzZvc6WtjdTzdjDPa'], 'labels': [], 'masters': [], 'uuids': ['a6b5a54a-572b-4cc7-9be5-51b71b9046df']}, 'model': None, 'partitions': {}, 'removable': '0', 'rotational': '0', 'sas_address': None, 'sas_device_handle': None, 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'support_discard': '512', 'vendor': None, 'virtual': 1}}, 'msg': "Failed to connect to the host via ssh: Warning: Permanently added 'smithi027.front.sepia.ceph.com,172.21.15.27' (ECDSA) to the list of known hosts.\r\nubuntu@smithi027.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive).", 'unreachable': True}]}}

pass 6997143 2022-08-28 08:40:51 2022-08-28 13:57:56 2022-08-28 14:24:30 0:26:34 0:18:06 0:08:28 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_journal} 2
pass 6997144 2022-08-28 08:40:52 2022-08-28 13:58:26 2022-08-28 14:11:51 0:13:25 0:06:32 0:06:53 smithi main ubuntu 20.04 rbd/singleton/{all/read-flags-writeback objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} 1
pass 6997145 2022-08-28 08:40:53 2022-08-28 13:58:27 2022-08-28 14:29:02 0:30:35 0:18:33 0:12:02 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests} 3
dead 6997146 2022-08-28 08:40:54 2022-08-28 14:03:38 2022-08-28 14:14:13 0:10:35 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} 1
Failure Reason:

SSH connection to smithi062 was lost: 'sudo apt-get update'

pass 6997147 2022-08-28 08:40:56 2022-08-28 14:05:38 2022-08-28 14:28:08 0:22:30 0:13:53 0:08:37 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nbd} 3
fail 6997148 2022-08-28 08:40:57 2022-08-28 14:06:19 2022-08-28 14:28:19 0:22:00 0:14:52 0:07:08 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_luks_encryption} 1
Failure Reason:

"2022-08-28T14:17:52.612249+0000 mon.a (mon.0) 98 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6997149 2022-08-28 08:40:58 2022-08-28 14:06:19 2022-08-28 14:14:14 0:07:55 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zstd pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_defaults} 3
Failure Reason:

Command failed on smithi062 with status 100: 'sudo apt-get clean'

dead 6997150 2022-08-28 08:40:59 2022-08-28 14:07:00 2022-08-28 14:22:16 0:15:16 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} 3
Failure Reason:

Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds

pass 6997151 2022-08-28 08:41:00 2022-08-28 14:07:20 2022-08-28 14:37:26 0:30:06 0:18:53 0:11:13 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} 3
pass 6997152 2022-08-28 08:41:02 2022-08-28 14:11:51 2022-08-28 14:41:35 0:29:44 0:21:07 0:08:37 smithi main ubuntu 20.04 rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} 2
pass 6997153 2022-08-28 08:41:03 2022-08-28 14:14:22 2022-08-28 18:36:34 4:22:12 4:15:29 0:06:43 smithi main ubuntu 20.04 rbd/encryption/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_xfstests_none_luks1} 3
pass 6997154 2022-08-28 08:41:04 2022-08-28 14:14:52 2022-08-28 14:28:09 0:13:17 0:06:27 0:06:50 smithi main ubuntu 20.04 rbd/singleton/{all/read-flags-writethrough objectstore/filestore-xfs openstack supported-random-distro$/{ubuntu_latest}} 1
fail 6997155 2022-08-28 08:41:05 2022-08-28 14:14:52 2022-08-28 14:43:30 0:28:38 0:16:14 0:12:24 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_fio} 3
Failure Reason:

"2022-08-28T14:31:33.158528+0000 mon.a (mon.0) 121 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6997156 2022-08-28 08:41:06 2022-08-28 14:19:53 2022-08-28 15:46:55 1:27:02 1:19:37 0:07:25 smithi main ubuntu 20.04 rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/rwl 6-cache-size/5G 7-workloads/qemu_xfstests} 2
pass 6997157 2022-08-28 08:41:08 2022-08-28 14:21:34 2022-08-28 14:48:30 0:26:56 0:18:35 0:08:21 smithi main ubuntu 20.04 rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_bonnie} 3
pass 6997158 2022-08-28 08:41:09 2022-08-28 14:22:34 2022-08-28 14:42:48 0:20:14 0:10:13 0:10:01 smithi main ubuntu 20.04 rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_nocache} 2
pass 6997159 2022-08-28 08:41:10 2022-08-28 14:24:35 2022-08-28 14:58:26 0:33:51 0:26:47 0:07:04 smithi main ubuntu 20.04 rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests} 3
pass 6997160 2022-08-28 08:41:11 2022-08-28 14:24:35 2022-08-28 14:58:11 0:33:36 0:24:00 0:09:36 smithi main ubuntu 20.04 rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} 1
pass 6997161 2022-08-28 08:41:13 2022-08-28 14:26:36 2022-08-28 15:02:03 0:35:27 0:27:35 0:07:52 smithi main ubuntu 20.04 rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} 3
pass 6997162 2022-08-28 08:41:14 2022-08-28 14:28:17 2022-08-28 15:57:29 1:29:12 1:23:36 0:05:36 smithi main ubuntu 20.04 rbd/migration/{1-base/install 2-clusters/{fixed-3 openstack} 3-objectstore/filestore-xfs 4-supported-random-distro$/{ubuntu_latest} 5-pool/replicated-data-pool 6-prepare/qcow2-http 7-io-workloads/qemu_xfstests 8-migrate-workloads/execute 9-cleanup/cleanup} 3
pass 6997163 2022-08-28 08:41:15 2022-08-28 14:28:17 2022-08-28 14:54:31 0:26:14 0:19:07 0:07:07 smithi main ubuntu 20.04 rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/rbd_python_api_tests_old_format} 1
fail 6997164 2022-08-28 08:41:16 2022-08-28 14:28:27 2022-08-28 15:22:37 0:54:10 0:47:32 0:06:38 smithi main ubuntu 20.04 rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} 2
Failure Reason:

"2022-08-28T14:40:48.685755+0000 mon.a (mon.0) 106 : cluster [WRN] Health check failed: Degraded data redundancy: 2/4 objects degraded (50.000%), 1 pg degraded (PG_DEGRADED)" in cluster log

fail 6997165 2022-08-28 08:41:18 2022-08-28 14:29:08 2022-08-28 14:39:49 0:10:41 0:04:19 0:06:22 smithi main centos 8.stream rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/rbd_mirror} 1
Failure Reason:

Command failed on smithi017 with status 1: 'sudo yum -y install ceph-test'

pass 6997166 2022-08-28 08:41:19 2022-08-28 14:29:08 2022-08-28 14:42:49 0:13:41 0:06:50 0:06:51 smithi main ubuntu 20.04 rbd/singleton/{all/snap-diff objectstore/bluestore-bitmap openstack supported-random-distro$/{ubuntu_latest}} 1
fail 6997167 2022-08-28 08:41:20 2022-08-28 14:29:28 2022-08-28 15:12:16 0:42:48 0:34:19 0:08:29 smithi main ubuntu 20.04 rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_journaling} 3
Failure Reason:

"2022-08-28T14:56:25.584254+0000 mon.a (mon.0) 854 : cluster [WRN] Health check failed: Degraded data redundancy: 1/1472 objects degraded (0.068%), 1 pg degraded (PG_DEGRADED)" in cluster log

pass 6997168 2022-08-28 08:41:21 2022-08-28 14:30:29 2022-08-28 14:47:39 0:17:10 0:08:25 0:08:45 smithi main ubuntu 20.04 rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_nbd} 3
pass 6997169 2022-08-28 08:41:22 2022-08-28 14:32:10 2022-08-28 15:12:17 0:40:07 0:32:44 0:07:23 smithi main ubuntu 20.04 rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/filestore-xfs pool/ec-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_migration} 1
pass 6997170 2022-08-28 08:41:24 2022-08-28 14:32:50 2022-08-28 17:02:55 2:30:05 2:18:52 0:11:13 smithi main ubuntu 20.04 rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} 3
pass 6997171 2022-08-28 08:41:25 2022-08-28 14:37:01 2022-08-28 15:00:58 0:23:57 0:16:36 0:07:21 smithi main ubuntu 20.04 rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-comp-lz4 pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/fsx} 3