Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6700441 2022-02-22 05:15:31 2022-02-27 22:06:08 2022-02-27 22:25:29 0:19:21 0:09:12 0:10:09 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_deep_flatten} 1
pass 6700442 2022-02-22 05:15:32 2022-02-27 22:06:18 2022-02-27 22:36:54 0:30:36 0:19:35 0:11:01 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6700443 2022-02-22 05:15:33 2022-02-27 22:07:09 2022-02-27 22:49:44 0:42:35 0:30:31 0:12:04 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_fio} 3
pass 6700444 2022-02-22 05:15:34 2022-02-27 22:08:19 2022-02-27 22:39:02 0:30:43 0:18:10 0:12:33 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_data_pool} 3
fail 6700445 2022-02-22 05:15:34 2022-02-27 22:09:30 2022-02-28 02:55:06 4:45:36 4:32:24 0:13:12 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{secure} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi165 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude5pn5vsw_ -r -- '-g auto -g blockdev -x clone'"

pass 6700446 2022-02-22 05:15:35 2022-02-27 22:11:11 2022-02-27 23:10:33 0:59:22 0:48:58 0:10:24 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_fio} 3
fail 6700447 2022-02-22 05:15:36 2022-02-27 22:11:11 2022-02-27 22:19:05 0:07:54 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major

pass 6700448 2022-02-22 05:15:37 2022-02-27 22:11:51 2022-02-27 22:31:13 0:19:22 0:08:59 0:10:23 smithi master krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} 1
pass 6700449 2022-02-22 05:15:37 2022-02-27 22:11:52 2022-02-27 22:33:38 0:21:46 0:11:35 0:10:11 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6700450 2022-02-22 05:15:38 2022-02-27 22:12:02 2022-02-27 22:42:19 0:30:17 0:19:17 0:11:00 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6700451 2022-02-22 05:15:39 2022-02-27 22:12:12 2022-02-27 22:35:11 0:22:59 0:11:11 0:11:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} 3
pass 6700452 2022-02-22 05:15:40 2022-02-27 22:13:33 2022-02-27 22:42:28 0:28:55 0:11:28 0:17:27 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6700453 2022-02-22 05:15:41 2022-02-27 22:17:34 2022-02-27 23:10:41 0:53:07 0:41:14 0:11:53 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6700454 2022-02-22 05:15:41 2022-02-27 22:19:14 2022-02-27 22:45:09 0:25:55 0:14:11 0:11:44 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6700455 2022-02-22 05:15:42 2022-02-27 22:19:35 2022-02-27 22:38:34 0:18:59 0:09:43 0:09:16 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_discard} 1
pass 6700456 2022-02-22 05:15:43 2022-02-27 22:19:35 2022-02-27 22:47:57 0:28:22 0:16:13 0:12:09 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6700457 2022-02-22 05:15:44 2022-02-27 22:20:36 2022-02-27 22:44:28 0:23:52 0:11:32 0:12:20 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} 3
pass 6700458 2022-02-22 05:15:44 2022-02-27 22:20:46 2022-02-27 23:50:35 1:29:49 1:17:51 0:11:58 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6700459 2022-02-22 05:15:45 2022-02-27 22:21:17 2022-02-27 23:11:04 0:49:47 0:36:10 0:13:37 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6700460 2022-02-22 05:15:46 2022-02-27 22:22:17 2022-02-27 22:48:09 0:25:52 0:14:55 0:10:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6700461 2022-02-22 05:15:47 2022-02-27 22:22:28 2022-02-27 22:45:17 0:22:49 0:11:42 0:11:07 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6700462 2022-02-22 05:15:47 2022-02-27 22:22:58 2022-02-27 22:44:37 0:21:39 0:11:20 0:10:19 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} 3
pass 6700463 2022-02-22 05:15:48 2022-02-27 22:23:08 2022-02-27 22:43:49 0:20:41 0:08:44 0:11:57 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} 1
pass 6700464 2022-02-22 05:15:49 2022-02-27 22:24:19 2022-02-27 22:56:13 0:31:54 0:21:18 0:10:36 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
dead 6700465 2022-02-22 05:15:50 2022-02-27 22:24:39 2022-02-27 22:42:32 0:17:53 0:04:21 0:13:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_symlinks} 3
Failure Reason:

{'smithi131.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': True, 'force_apt_get': False, 'install_recommends': None, 'name': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python-ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'], 'only_upgrade': False, 'package': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python-ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'], 'policy_rc_d': None, 'purge': False, 'state': 'absent', 'update_cache': None, 'upgrade': None}}, 'msg': "'apt-get remove 'librbd1' 'librados2'' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7375 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n", 'rc': 100, 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7375 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7375 (apt-get)', 'E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?'], 'stdout': '', 'stdout_lines': []}}

pass 6700466 2022-02-22 05:15:50 2022-02-27 22:27:00 2022-02-27 22:50:17 0:23:17 0:10:44 0:12:33 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6700467 2022-02-22 05:15:51 2022-02-27 22:28:20 2022-02-27 22:54:14 0:25:54 0:15:57 0:09:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_concurrent} 3
pass 6700468 2022-02-22 05:15:52 2022-02-27 22:28:41 2022-02-27 22:50:44 0:22:03 0:10:51 0:11:12 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6700469 2022-02-22 05:15:52 2022-02-27 22:28:41 2022-02-27 22:59:50 0:31:09 0:18:48 0:12:21 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6700470 2022-02-22 05:15:53 2022-02-27 22:30:32 2022-02-27 22:52:44 0:22:12 0:10:25 0:11:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_image_read} 3
pass 6700471 2022-02-22 05:15:54 2022-02-27 22:31:22 2022-02-27 22:52:27 0:21:05 0:08:33 0:12:32 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_modprobe} 1
pass 6700472 2022-02-22 05:15:55 2022-02-27 22:33:13 2022-02-27 22:59:24 0:26:11 0:14:58 0:11:13 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6700473 2022-02-22 05:15:55 2022-02-27 22:33:43 2022-02-27 23:51:34 1:17:51 1:07:16 0:10:35 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6700474 2022-02-22 05:15:56 2022-02-27 22:33:54 2022-02-27 22:56:48 0:22:54 0:10:10 0:12:44 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_kernel} 3
fail 6700475 2022-02-22 05:15:57 2022-02-27 22:35:14 2022-02-27 23:03:16 0:28:02 0:17:34 0:10:28 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2022-02-27T22:54:26.163285+0000 osd.1 (osd.1) 3 : cluster [WRN] slow request osd_op(client.4337.0:7933 2.6 2:7fb3f263:::rbd_data.11411fd821d.0000000000000004:head [zero 229376~4096] snapc 0=[] ondisk+write+known_if_redirected e21) initiated 2022-02-27T22:53:55.292986+0000 currently started" in cluster log

pass 6700476 2022-02-22 05:15:58 2022-02-27 22:35:15 2022-02-27 22:58:42 0:23:27 0:09:39 0:13:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6700477 2022-02-22 05:15:58 2022-02-27 22:36:55 2022-02-27 23:05:31 0:28:36 0:15:39 0:12:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_unmap} 3
pass 6700478 2022-02-22 05:15:59 2022-02-27 22:37:16 2022-02-27 22:59:45 0:22:29 0:11:13 0:11:16 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6700479 2022-02-22 05:16:00 2022-02-27 22:38:16 2022-02-27 23:16:14 0:37:58 0:26:11 0:11:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_simple_big} 3
pass 6700480 2022-02-22 05:16:01 2022-02-27 22:38:57 2022-02-27 22:57:39 0:18:42 0:08:37 0:10:05 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_msgr_segments} 1
pass 6700481 2022-02-22 05:16:01 2022-02-27 22:38:57 2022-02-27 23:14:40 0:35:43 0:24:16 0:11:27 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6700482 2022-02-22 05:16:02 2022-02-27 22:39:07 2022-02-27 23:22:40 0:43:33 0:30:03 0:13:30 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
pass 6700483 2022-02-22 05:16:03 2022-02-27 22:42:28 2022-02-27 23:15:57 0:33:29 0:23:00 0:10:29 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} 3
pass 6700484 2022-02-22 05:16:04 2022-02-27 22:42:39 2022-02-27 23:05:22 0:22:43 0:11:05 0:11:38 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6700485 2022-02-22 05:16:04 2022-02-27 22:42:39 2022-02-27 23:14:18 0:31:39 0:19:00 0:12:39 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6700486 2022-02-22 05:16:05 2022-02-27 22:44:29 2022-02-27 23:06:07 0:21:38 0:11:25 0:10:13 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_fallocate} 3
pass 6700487 2022-02-22 05:16:06 2022-02-27 22:44:40 2022-02-27 23:06:34 0:21:54 0:11:26 0:10:28 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6700488 2022-02-22 05:16:07 2022-02-27 22:45:00 2022-02-27 23:36:50 0:51:50 0:41:04 0:10:46 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6700489 2022-02-22 05:16:08 2022-02-27 22:45:11 2022-02-27 23:11:34 0:26:23 0:14:13 0:12:10 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6700490 2022-02-22 05:16:08 2022-02-27 22:45:21 2022-02-27 23:04:51 0:19:30 0:08:59 0:10:31 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} 1
pass 6700491 2022-02-22 05:16:09 2022-02-27 22:45:21 2022-02-27 23:16:07 0:30:46 0:17:49 0:12:57 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6700492 2022-02-22 05:16:10 2022-02-27 22:46:42 2022-02-27 23:09:35 0:22:53 0:11:23 0:11:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_namespaces} 3
pass 6700493 2022-02-22 05:16:11 2022-02-27 22:48:02 2022-02-28 00:03:57 1:15:55 1:04:24 0:11:31 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6700494 2022-02-22 05:16:11 2022-02-27 22:48:13 2022-02-27 23:39:16 0:51:03 0:38:42 0:12:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6700495 2022-02-22 05:16:12 2022-02-27 22:49:53 2022-02-27 23:16:29 0:26:36 0:15:09 0:11:27 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6700496 2022-02-22 05:16:13 2022-02-27 22:50:24 2022-02-27 23:14:59 0:24:35 0:13:05 0:11:30 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6700497 2022-02-22 05:16:14 2022-02-27 22:50:54 2022-02-27 23:13:51 0:22:57 0:11:22 0:11:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netns} 3
pass 6700498 2022-02-22 05:16:15 2022-02-27 22:52:35 2022-02-27 23:12:14 0:19:39 0:08:59 0:10:40 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_read_only} 1
pass 6700499 2022-02-22 05:16:15 2022-02-27 22:52:45 2022-02-27 23:23:11 0:30:26 0:18:45 0:11:41 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6700500 2022-02-22 05:16:16 2022-02-28 00:01:35 3370 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
pass 6700501 2022-02-22 05:16:17 2022-02-27 22:53:46 2022-02-27 23:15:55 0:22:09 0:11:27 0:10:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6700502 2022-02-22 05:16:18 2022-02-27 22:54:17 2022-02-27 23:18:52 0:24:35 0:11:01 0:13:34 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6700503 2022-02-22 05:16:18 2022-02-27 22:56:17 2022-02-27 23:24:33 0:28:16 0:15:45 0:12:31 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_concurrent} 3
pass 6700504 2022-02-22 05:16:19 2022-02-27 22:56:58 2022-02-27 23:18:46 0:21:48 0:10:11 0:11:37 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6700505 2022-02-22 05:16:20 2022-02-27 22:57:18 2022-02-27 23:30:36 0:33:18 0:19:52 0:13:26 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6700506 2022-02-22 05:16:21 2022-02-27 22:58:49 2022-02-27 23:21:06 0:22:17 0:10:52 0:11:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} 3
pass 6700507 2022-02-22 05:16:21 2022-02-27 22:59:29 2022-02-27 23:18:19 0:18:50 0:09:34 0:09:16 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_whole_object_zeroout} 1
pass 6700508 2022-02-22 05:16:22 2022-02-27 22:59:29 2022-02-27 23:29:21 0:29:52 0:18:57 0:10:55 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6700509 2022-02-22 05:16:23 2022-02-27 22:59:50 2022-02-27 23:21:21 0:21:31 0:10:10 0:11:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_kernel} 3
pass 6700510 2022-02-22 05:16:23 2022-02-27 23:00:01 2022-02-27 23:31:06 0:31:05 0:16:16 0:14:49 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6700511 2022-02-22 05:16:24 2022-02-27 23:03:22 2022-02-27 23:28:07 0:24:45 0:10:02 0:14:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6700512 2022-02-22 05:16:25 2022-02-27 23:05:22 2022-02-27 23:33:55 0:28:33 0:15:32 0:13:01 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} 3
pass 6700513 2022-02-22 05:16:26 2022-02-27 23:05:43 2022-02-27 23:29:43 0:24:00 0:11:38 0:12:22 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6700514 2022-02-22 05:16:27 2022-02-27 23:06:14 2022-02-27 23:48:14 0:42:00 0:29:31 0:12:29 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_simple_big} 3
pass 6700515 2022-02-22 05:16:27 2022-02-27 23:06:35 2022-02-27 23:26:02 0:19:27 0:08:57 0:10:30 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} 1
pass 6700516 2022-02-22 05:16:28 2022-02-27 23:06:35 2022-02-27 23:43:09 0:36:34 0:22:16 0:14:18 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6700517 2022-02-22 05:16:29 2022-02-27 23:09:36 2022-02-27 23:53:19 0:43:43 0:31:05 0:12:38 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_fio} 3
pass 6700518 2022-02-22 05:16:30 2022-02-27 23:09:46 2022-02-27 23:39:26 0:29:40 0:18:23 0:11:17 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_data_pool} 3
pass 6700519 2022-02-22 05:16:30 2022-02-27 23:10:07 2022-02-27 23:31:59 0:21:52 0:09:09 0:12:43 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
pass 6700520 2022-02-22 05:16:31 2022-02-27 23:10:37 2022-02-27 23:44:17 0:33:40 0:22:25 0:11:15 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
pass 6700521 2022-02-22 05:16:32 2022-02-27 23:10:48 2022-02-27 23:34:40 0:23:52 0:11:38 0:12:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6700522 2022-02-22 05:16:33 2022-02-27 23:10:58 2022-02-27 23:40:45 0:29:47 0:18:37 0:11:10 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6700523 2022-02-22 05:16:33 2022-02-27 23:11:08 2022-02-27 23:33:57 0:22:49 0:11:16 0:11:33 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_fallocate} 3
pass 6700524 2022-02-22 05:16:34 2022-02-27 23:11:39 2022-02-27 23:35:18 0:23:39 0:11:31 0:12:08 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6700525 2022-02-22 05:16:35 2022-02-27 23:12:19 2022-02-28 00:05:35 0:53:16 0:41:01 0:12:15 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6700526 2022-02-22 05:16:36 2022-02-27 23:14:00 2022-02-27 23:38:14 0:24:14 0:13:46 0:10:28 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6700527 2022-02-22 05:16:36 2022-02-27 23:14:20 2022-02-27 23:33:36 0:19:16 0:09:27 0:09:49 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_discard} 1
pass 6700528 2022-02-22 05:16:37 2022-02-27 23:14:21 2022-02-27 23:42:11 0:27:50 0:17:52 0:09:58 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6700529 2022-02-22 05:16:38 2022-02-27 23:14:41 2022-02-28 00:37:15 1:22:34 1:10:25 0:12:09 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6700530 2022-02-22 05:16:39 2022-02-27 23:15:01 2022-02-27 23:39:26 0:24:25 0:11:43 0:12:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_namespaces} 3
pass 6700531 2022-02-22 05:16:39 2022-02-27 23:16:02 2022-02-28 00:37:57 1:21:55 1:10:38 0:11:17 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6700532 2022-02-22 05:16:40 2022-02-27 23:16:02 2022-02-28 00:03:04 0:47:02 0:35:48 0:11:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6700533 2022-02-22 05:16:41 2022-02-27 23:16:13 2022-02-27 23:41:38 0:25:25 0:14:51 0:10:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6700534 2022-02-22 05:16:41 2022-02-27 23:16:23 2022-02-27 23:38:32 0:22:09 0:11:27 0:10:42 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6700535 2022-02-22 05:16:42 2022-02-27 23:16:33 2022-02-27 23:40:25 0:23:52 0:11:07 0:12:45 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netns} 3
pass 6700536 2022-02-22 05:16:43 2022-02-27 23:18:54 2022-02-27 23:38:28 0:19:34 0:08:58 0:10:36 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_huge_image} 1
pass 6700537 2022-02-22 05:16:44 2022-02-27 23:18:54 2022-02-27 23:54:18 0:35:24 0:24:46 0:10:38 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6700538 2022-02-22 05:16:44 2022-02-27 23:18:54 2022-02-27 23:44:50 0:25:56 0:11:40 0:14:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6700539 2022-02-22 05:16:45 2022-02-27 23:21:15 2022-02-27 23:42:42 0:21:27 0:10:33 0:10:54 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6700540 2022-02-22 05:16:46 2022-02-27 23:21:26 2022-02-27 23:48:57 0:27:31 0:15:37 0:11:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
pass 6700541 2022-02-22 05:16:47 2022-02-27 23:22:46 2022-02-27 23:44:42 0:21:56 0:10:19 0:11:37 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6700542 2022-02-22 05:16:47 2022-02-27 23:23:17 2022-02-27 23:55:30 0:32:13 0:18:34 0:13:39 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6700543 2022-02-22 05:16:48 2022-02-27 23:24:37 2022-02-27 23:51:02 0:26:25 0:10:45 0:15:40 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_image_read} 3
pass 6700544 2022-02-22 05:16:49 2022-02-27 23:28:08 2022-02-27 23:47:35 0:19:27 0:08:24 0:11:03 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} 1
pass 6700545 2022-02-22 05:16:50 2022-02-27 23:28:08 2022-02-27 23:58:50 0:30:42 0:19:33 0:11:09 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6700546 2022-02-22 05:16:50 2022-02-27 23:29:29 2022-02-27 23:51:17 0:21:48 0:10:26 0:11:22 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} 3
pass 6700547 2022-02-22 05:16:51 2022-02-27 23:29:49 2022-02-28 00:00:33 0:30:44 0:17:59 0:12:45 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6700548 2022-02-22 05:16:52 2022-02-27 23:30:40 2022-02-27 23:53:01 0:22:21 0:10:33 0:11:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6700549 2022-02-22 05:16:53 2022-02-27 23:31:10 2022-02-27 23:57:25 0:26:15 0:15:05 0:11:10 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_unmap} 3
dead 6700550 2022-02-22 05:16:53 2022-02-27 23:32:01 2022-02-27 23:50:18 0:18:17 0:04:20 0:13:57 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

{'smithi090.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': True, 'force_apt_get': False, 'install_recommends': None, 'name': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python-ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'], 'only_upgrade': False, 'package': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python-ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'], 'policy_rc_d': None, 'purge': False, 'state': 'absent', 'update_cache': None, 'upgrade': None}}, 'msg': "'apt-get remove 'librbd1' 'librados2'' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7398 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n", 'rc': 100, 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7398 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7398 (apt-get)', 'E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?'], 'stdout': '', 'stdout_lines': []}}

pass 6700551 2022-02-22 05:16:54 2022-02-27 23:34:01 2022-02-28 00:16:24 0:42:23 0:30:08 0:12:15 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} 3
pass 6700552 2022-02-22 05:16:55 2022-02-27 23:34:01 2022-02-27 23:53:19 0:19:18 0:09:10 0:10:08 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_msgr_segments} 1
pass 6700553 2022-02-22 05:16:56 2022-02-27 23:34:02 2022-02-28 00:08:33 0:34:31 0:23:33 0:10:58 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6700554 2022-02-22 05:16:56 2022-02-27 23:34:42 2022-02-28 00:18:22 0:43:40 0:30:19 0:13:21 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_fio} 3
pass 6700555 2022-02-22 05:16:57 2022-02-27 23:35:23 2022-02-28 00:10:29 0:35:06 0:22:55 0:12:11 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_data_pool} 3
fail 6700556 2022-02-22 05:16:58 2022-02-27 23:36:53 2022-02-28 04:34:59 4:58:06 4:45:30 0:12:36 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{secure} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi160 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludee_7f1jxh -r -- '-g auto -g blockdev -x clone'"

pass 6700557 2022-02-22 05:16:59 2022-02-27 23:38:34 2022-02-28 00:50:18 1:11:44 1:01:04 0:10:40 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6700558 2022-02-22 05:16:59 2022-02-27 23:38:34 2022-02-28 00:00:46 0:22:12 0:10:53 0:11:19 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6700559 2022-02-22 05:17:00 2022-02-27 23:39:25 2022-02-28 00:09:10 0:29:45 0:18:19 0:11:26 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6700560 2022-02-22 05:17:01 2022-02-27 23:39:35 2022-02-28 00:02:58 0:23:23 0:11:30 0:11:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} 3
pass 6700561 2022-02-22 05:17:02 2022-02-27 23:39:35 2022-02-28 00:02:05 0:22:30 0:11:36 0:10:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6700562 2022-02-22 05:17:02 2022-02-27 23:40:36 2022-02-28 00:32:21 0:51:45 0:40:33 0:11:12 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6700563 2022-02-22 05:17:03 2022-02-27 23:40:46 2022-02-28 00:05:11 0:24:25 0:13:53 0:10:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6700564 2022-02-22 05:17:04 2022-02-27 23:41:47 2022-02-28 00:01:44 0:19:57 0:09:02 0:10:55 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_parent_overlap} 1
dead 6700565 2022-02-22 05:17:05 2022-02-27 23:42:17 2022-02-27 23:58:07 0:15:50 0:04:20 0:11:30 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
Failure Reason:

{'smithi084.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': True, 'force_apt_get': False, 'install_recommends': None, 'name': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python-ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'], 'only_upgrade': False, 'package': ['ceph', 'ceph-common', 'libcephfs1', 'radosgw', 'python-ceph', 'python-rados', 'python-cephfs', 'python-rbd', 'librbd1', 'librados2', 'ceph-fs-common-dbg', 'ceph-fs-common', 'openmpi-common'], 'policy_rc_d': None, 'purge': False, 'state': 'absent', 'update_cache': None, 'upgrade': None}}, 'msg': "'apt-get remove 'librbd1' 'librados2'' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7375 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n", 'rc': 100, 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7375 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 7375 (apt-get)', 'E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?'], 'stdout': '', 'stdout_lines': []}}

pass 6700566 2022-02-22 05:17:06 2022-02-27 23:42:47 2022-02-28 00:04:49 0:22:02 0:10:53 0:11:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} 3
pass 6700567 2022-02-22 05:17:06 2022-02-27 23:43:18 2022-02-28 00:59:50 1:16:32 1:04:33 0:11:59 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6700568 2022-02-22 05:17:07 2022-02-27 23:44:18 2022-02-28 00:42:15 0:57:57 0:46:39 0:11:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6700569 2022-02-22 05:17:08 2022-02-27 23:44:49 2022-02-28 00:10:36 0:25:47 0:14:56 0:10:51 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6700570 2022-02-22 05:17:09 2022-02-27 23:44:59 2022-02-28 00:09:11 0:24:12 0:11:57 0:12:15 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6700571 2022-02-22 05:17:09 2022-02-27 23:47:40 2022-02-28 00:09:54 0:22:14 0:11:02 0:11:12 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} 3
pass 6700572 2022-02-22 05:17:10 2022-02-27 23:48:20 2022-02-28 00:08:34 0:20:14 0:09:04 0:11:10 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} 1
pass 6700573 2022-02-22 05:17:11 2022-02-27 23:49:01 2022-02-28 00:30:27 0:41:26 0:29:36 0:11:50 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6700574 2022-02-22 05:17:12 2022-02-27 23:50:21 2022-02-28 00:12:04 0:21:43 0:11:12 0:10:31 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6700575 2022-02-22 05:17:12 2022-02-27 23:50:42 2022-02-28 00:13:51 0:23:09 0:10:27 0:12:42 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
fail 6700576 2022-02-22 05:17:13 2022-02-27 23:51:12 2022-02-28 03:13:01 3:21:49 3:11:41 0:10:08 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_concurrent} 3
Failure Reason:

Command failed (workunit test rbd/concurrent.sh) on smithi141 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7516df7fec9d21581a28fd4addedfd8e4c26f0d9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh'

pass 6700577 2022-02-22 05:17:14 2022-02-27 23:51:22 2022-02-28 00:13:22 0:22:00 0:10:21 0:11:39 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6700578 2022-02-22 05:17:15 2022-02-27 23:51:43 2022-02-28 00:24:56 0:33:13 0:20:30 0:12:43 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6700579 2022-02-22 05:17:15 2022-02-27 23:53:03 2022-02-28 00:14:54 0:21:51 0:10:55 0:10:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_image_read} 3
pass 6700580 2022-02-22 05:17:16 2022-02-27 23:53:24 2022-02-28 00:12:44 0:19:20 0:09:10 0:10:10 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_whole_object_zeroout} 1
pass 6700581 2022-02-22 05:17:17 2022-02-27 23:53:24 2022-02-28 00:19:50 0:26:26 0:14:55 0:11:31 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6700582 2022-02-22 05:17:18 2022-02-27 23:54:25 2022-02-28 00:53:09 0:58:44 0:47:08 0:11:36 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
pass 6700583 2022-02-22 05:17:18 2022-02-27 23:55:35 2022-02-28 00:18:54 0:23:19 0:10:11 0:13:08 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_kernel} 3
pass 6700584 2022-02-22 05:17:19 2022-02-27 23:57:26 2022-02-28 00:25:24 0:27:58 0:16:22 0:11:36 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6700585 2022-02-22 05:17:20 2022-02-27 23:58:16 2022-02-28 00:18:26 0:20:10 0:09:45 0:10:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6700586 2022-02-22 05:17:21 2022-02-27 23:58:57 2022-02-28 00:28:30 0:29:33 0:15:08 0:14:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_unmap} 3
pass 6700587 2022-02-22 05:17:21 2022-02-28 00:00:37 2022-02-28 00:24:15 0:23:38 0:11:30 0:12:08 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6700588 2022-02-22 05:17:22 2022-02-28 00:00:48 2022-02-28 00:39:20 0:38:32 0:27:19 0:11:13 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_simple_big} 3
pass 6700589 2022-02-22 05:17:23 2022-02-28 00:01:38 2022-02-28 00:21:02 0:19:24 0:09:25 0:09:59 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_deep_flatten} 1
pass 6700590 2022-02-22 05:17:23 2022-02-28 00:01:39 2022-02-28 00:37:40 0:36:01 0:24:12 0:11:49 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6700591 2022-02-22 05:17:24 2022-02-28 00:02:09 2022-02-28 00:44:18 0:42:09 0:30:52 0:11:17 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} 3
pass 6700592 2022-02-22 05:17:25 2022-02-28 00:03:00 2022-02-28 00:32:39 0:29:39 0:18:32 0:11:07 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} 3
pass 6700593 2022-02-22 05:17:26 2022-02-28 00:03:10 2022-02-28 00:23:22 0:20:12 0:08:57 0:11:15 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
pass 6700594 2022-02-22 05:17:26 2022-02-28 00:03:10 2022-02-28 00:37:47 0:34:37 0:22:39 0:11:58 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
pass 6700595 2022-02-22 05:17:27 2022-02-28 00:04:01 2022-02-28 00:28:26 0:24:25 0:11:31 0:12:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6700596 2022-02-22 05:17:28 2022-02-28 00:04:51 2022-02-28 00:34:32 0:29:41 0:19:00 0:10:41 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6700597 2022-02-22 05:17:29 2022-02-28 00:05:12 2022-02-28 00:27:22 0:22:10 0:10:54 0:11:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_fallocate} 3
pass 6700598 2022-02-22 05:17:29 2022-02-28 00:05:42 2022-02-28 00:30:21 0:24:39 0:11:17 0:13:22 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6700599 2022-02-22 05:17:30 2022-02-28 00:08:33 2022-02-28 01:00:46 0:52:13 0:41:28 0:10:45 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6700600 2022-02-22 05:17:31 2022-02-28 00:09:14 2022-02-28 00:34:47 0:25:33 0:13:30 0:12:03 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
pass 6700601 2022-02-22 05:17:32 2022-02-28 00:09:14 2022-02-28 00:30:45 0:21:31 0:09:40 0:11:51 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} 1
pass 6700602 2022-02-22 05:17:32 2022-02-28 00:09:14 2022-02-28 00:35:43 0:26:29 0:15:33 0:10:56 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6700603 2022-02-22 05:17:33 2022-02-28 00:10:05 2022-02-28 00:32:09 0:22:04 0:11:22 0:10:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_namespaces} 3
pass 6700604 2022-02-22 05:17:34 2022-02-28 00:10:35 2022-02-28 01:30:24 1:19:49 1:09:01 0:10:48 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6700605 2022-02-22 05:17:35 2022-02-28 00:10:46 2022-02-28 00:59:31 0:48:45 0:35:52 0:12:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6700606 2022-02-22 05:17:36 2022-02-28 00:12:06 2022-02-28 00:39:09 0:27:03 0:14:41 0:12:22 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6700607 2022-02-22 05:17:36 2022-02-28 00:13:27 2022-02-28 00:38:52 0:25:25 0:11:34 0:13:51 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6700608 2022-02-22 05:17:37 2022-02-28 00:13:57 2022-02-28 00:36:30 0:22:33 0:10:55 0:11:38 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netns} 3
pass 6700609 2022-02-22 05:17:38 2022-02-28 00:14:58 2022-02-28 00:34:12 0:19:14 0:08:40 0:10:34 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_huge_image} 1
pass 6700610 2022-02-22 05:17:39 2022-02-28 00:14:58 2022-02-28 00:50:45 0:35:47 0:21:53 0:13:54 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6700611 2022-02-22 05:17:39 2022-02-28 00:16:29 2022-02-28 01:22:11 1:05:42 0:55:31 0:10:11 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{prefer-crc} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6700612 2022-02-22 05:17:40 2022-02-28 00:16:39 2022-02-28 00:40:48 0:24:09 0:11:12 0:12:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6700613 2022-02-22 05:17:41 2022-02-28 00:17:00 2022-02-28 00:39:59 0:22:59 0:10:35 0:12:24 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6700614 2022-02-22 05:17:42 2022-02-28 00:18:30 2022-02-28 00:47:29 0:28:59 0:15:58 0:13:01 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_concurrent} 3
pass 6700615 2022-02-22 05:17:42 2022-02-28 00:18:31 2022-02-28 00:40:21 0:21:50 0:10:29 0:11:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6700616 2022-02-22 05:17:43 2022-02-28 00:19:01 2022-02-28 00:49:17 0:30:16 0:19:02 0:11:14 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6700617 2022-02-22 05:17:44 2022-02-28 00:19:52 2022-02-28 00:45:28 0:25:36 0:10:15 0:15:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
pass 6700618 2022-02-22 05:17:45 2022-02-28 00:23:23 2022-02-28 00:42:47 0:19:24 0:08:26 0:10:58 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_modprobe} 1
pass 6700619 2022-02-22 05:17:46 2022-02-28 00:23:23 2022-02-28 00:53:52 0:30:29 0:19:21 0:11:08 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6700620 2022-02-22 05:17:47 2022-02-28 00:24:23 2022-02-28 00:47:08 0:22:45 0:10:14 0:12:31 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_kernel} 3
pass 6700621 2022-02-22 05:17:47 2022-02-28 00:25:04 2022-02-28 00:52:51 0:27:47 0:17:29 0:10:18 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6700622 2022-02-22 05:17:48 2022-02-28 00:25:34 2022-02-28 00:47:06 0:21:32 0:09:42 0:11:50 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6700623 2022-02-22 05:17:49 2022-02-28 00:27:25 2022-02-28 00:54:27 0:27:02 0:15:06 0:11:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} 3
pass 6700624 2022-02-22 05:17:50 2022-02-28 00:28:35 2022-02-28 00:50:02 0:21:27 0:11:33 0:09:54 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6700625 2022-02-22 05:17:51 2022-02-28 00:28:36 2022-02-28 01:08:21 0:39:45 0:27:04 0:12:41 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_simple_big} 3
pass 6700626 2022-02-22 05:17:51 2022-02-28 00:30:26 2022-02-28 00:50:01 0:19:35 0:08:44 0:10:51 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} 1
pass 6700627 2022-02-22 05:17:52 2022-02-28 00:30:36 2022-02-28 01:09:05 0:38:29 0:26:13 0:12:16 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
fail 6700628 2022-02-22 05:17:53 2022-02-28 00:30:47 2022-02-28 01:15:52 0:45:05 0:32:58 0:12:07 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_fio} 3
Failure Reason:

"2022-02-28T01:07:02.639114+0000 mon.a (mon.0) 175 : cluster [WRN] Health check failed: 0 slow ops, oldest one blocked for 30 sec, osd.3 has slow ops (SLOW_OPS)" in cluster log

pass 6700629 2022-02-22 05:17:54 2022-02-28 00:32:17 2022-02-28 01:06:00 0:33:43 0:22:46 0:10:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_data_pool} 3
pass 6700630 2022-02-22 05:17:54 2022-02-28 00:32:28 2022-02-28 00:54:15 0:21:47 0:11:12 0:10:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6700631 2022-02-22 05:17:55 2022-02-28 00:32:48 2022-02-28 01:04:02 0:31:14 0:19:02 0:12:12 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6700632 2022-02-22 05:17:56 2022-02-28 00:34:39 2022-02-28 00:56:22 0:21:43 0:11:28 0:10:15 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_fallocate} 3
pass 6700633 2022-02-22 05:17:57 2022-02-28 00:34:49 2022-02-28 00:57:21 0:22:32 0:11:39 0:10:53 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6700634 2022-02-22 05:17:58 2022-02-28 00:35:50 2022-02-28 01:28:15 0:52:25 0:40:40 0:11:45 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6700635 2022-02-22 05:17:58 2022-02-28 00:36:40 2022-02-28 01:03:30 0:26:50 0:14:03 0:12:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6700636 2022-02-22 05:17:59 2022-02-28 00:37:21 2022-02-28 00:56:39 0:19:18 0:08:56 0:10:22 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_parent_overlap} 1
pass 6700637 2022-02-22 05:18:00 2022-02-28 00:37:21 2022-02-28 01:05:13 0:27:52 0:16:55 0:10:57 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6700638 2022-02-22 05:18:01 2022-02-28 00:37:41 2022-02-28 01:39:35 1:01:54 0:50:51 0:11:03 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 6700639 2022-02-22 05:18:01 2022-02-28 00:37:52 2022-02-28 00:59:41 0:21:49 0:10:51 0:10:58 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_namespaces} 3
pass 6700640 2022-02-22 05:18:02 2022-02-28 00:38:02 2022-02-28 01:57:47 1:19:45 1:04:51 0:14:54 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6700641 2022-02-22 05:18:03 2022-02-28 00:39:02 2022-02-28 01:30:52 0:51:50 0:40:07 0:11:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6700642 2022-02-22 05:18:04 2022-02-28 00:39:13 2022-02-28 01:07:07 0:27:54 0:15:05 0:12:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6700643 2022-02-22 05:18:04 2022-02-28 00:39:23 2022-02-28 01:05:34 0:26:11 0:12:41 0:13:30 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6700644 2022-02-22 05:18:05 2022-02-28 00:40:04 2022-02-28 01:03:47 0:23:43 0:11:27 0:12:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netns} 3
pass 6700645 2022-02-22 05:18:06 2022-02-28 00:40:24 2022-02-28 01:02:10 0:21:46 0:09:26 0:12:20 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_read_only} 1
pass 6700646 2022-02-22 05:18:07 2022-02-28 00:40:54 2022-02-28 01:15:52 0:34:58 0:23:17 0:11:41 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6700647 2022-02-22 05:18:07 2022-02-28 00:42:25 2022-02-28 01:04:34 0:22:09 0:11:17 0:10:52 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6700648 2022-02-22 05:18:08 2022-02-28 00:42:55 2022-02-28 01:05:49 0:22:54 0:10:34 0:12:20 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6700649 2022-02-22 05:18:09 2022-02-28 00:44:26 2022-02-28 01:13:43 0:29:17 0:16:42 0:12:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} 3
pass 6700650 2022-02-22 05:18:10 2022-02-28 00:45:36 2022-02-28 01:10:49 0:25:13 0:10:16 0:14:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6700651 2022-02-22 05:18:10 2022-02-28 00:47:07 2022-02-28 01:21:10 0:34:03 0:20:32 0:13:31 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6700652 2022-02-22 05:18:11 2022-02-28 00:47:17 2022-02-28 01:14:37 0:27:20 0:11:50 0:15:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_image_read} 3
pass 6700653 2022-02-22 05:18:12 2022-02-28 00:47:38 2022-02-28 01:10:36 0:22:58 0:10:07 0:12:51 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} 1
pass 6700654 2022-02-22 05:18:13 2022-02-28 00:49:18 2022-02-28 01:21:37 0:32:19 0:19:04 0:13:15 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6700655 2022-02-22 05:18:13 2022-02-28 00:50:09 2022-02-28 01:13:51 0:23:42 0:10:41 0:13:01 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} 3
pass 6700656 2022-02-22 05:18:14 2022-02-28 00:50:09 2022-02-28 01:18:01 0:27:52 0:16:16 0:11:36 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6700657 2022-02-22 05:18:15 2022-02-28 00:50:19 2022-02-28 01:15:05 0:24:46 0:10:41 0:14:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_snapshot_io} 3
dead 6700658 2022-02-22 05:18:16 2022-02-28 00:50:50 2022-02-28 00:54:25 0:03:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_unmap} 3
Failure Reason:

Error reimaging machines: Failed to power on smithi053

pass 6700659 2022-02-22 05:18:17 2022-02-28 00:53:00 2022-02-28 01:16:46 0:23:46 0:11:48 0:11:58 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6700660 2022-02-22 05:18:17 2022-02-28 00:53:11 2022-02-28 01:35:26 0:42:15 0:29:34 0:12:41 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} 3