Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6652556 2022-02-01 05:15:34 2022-02-01 13:11:26 2022-02-01 13:30:52 0:19:26 0:10:00 0:09:26 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_deep_flatten} 1
pass 6652557 2022-02-01 05:15:35 2022-02-01 13:11:26 2022-02-01 13:41:31 0:30:05 0:19:35 0:10:30 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6652558 2022-02-01 05:15:36 2022-02-01 13:11:56 2022-02-01 13:53:59 0:42:03 0:32:02 0:10:01 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_fio} 3
pass 6652559 2022-02-01 05:15:36 2022-02-01 13:12:27 2022-02-01 13:40:43 0:28:16 0:18:26 0:09:50 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_data_pool} 3
fail 6652560 2022-02-01 05:15:37 2022-02-01 13:13:07 2022-02-01 17:59:55 4:46:48 4:35:27 0:11:21 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{prefer-crc} msgr-failures/few tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi172 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeloc2ab0p -r -- '-g auto -g blockdev -x clone'"

pass 6652561 2022-02-01 05:15:38 2022-02-01 13:13:48 2022-02-01 14:19:44 1:05:56 0:49:58 0:15:58 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_fio} 3
fail 6652562 2022-02-01 05:15:39 2022-02-01 13:17:18 2022-02-01 13:26:00 0:08:42 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} 2
Failure Reason:

Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major

pass 6652563 2022-02-01 05:15:40 2022-02-01 13:18:09 2022-02-01 13:37:47 0:19:38 0:09:08 0:10:30 smithi master krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} 1
pass 6652564 2022-02-01 05:15:40 2022-02-01 13:18:09 2022-02-01 13:45:24 0:27:15 0:11:55 0:15:20 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_exclusive_option} 3
fail 6652565 2022-02-01 05:15:41 2022-02-01 13:23:50 2022-02-01 13:58:17 0:34:27 0:19:51 0:14:36 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2022-02-01T13:50:27.789931+0000 mon.a (mon.0) 213 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 6652566 2022-02-01 05:15:42 2022-02-01 13:26:01 2022-02-01 13:52:33 0:26:32 0:11:50 0:14:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_fallocate} 3
pass 6652567 2022-02-01 05:15:43 2022-02-01 13:28:51 2022-02-01 13:52:33 0:23:42 0:11:45 0:11:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_huge_osdmap} 3
fail 6652568 2022-02-01 05:15:44 2022-02-01 13:28:52 2022-02-01 17:00:37 3:31:45 3:18:02 0:13:43 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
Failure Reason:

Command failed (workunit test suites/dbench.sh) on smithi175 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9f723519257eca039126a20aa6a2a7d2dbfb5dba TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh'

pass 6652569 2022-02-01 05:15:44 2022-02-01 13:30:02 2022-02-01 13:56:27 0:26:25 0:14:19 0:12:06 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
fail 6652570 2022-02-01 05:15:45 2022-02-01 13:30:43 2022-02-01 13:52:24 0:21:41 0:10:18 0:11:23 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_discard} 1
Failure Reason:

Command failed on smithi122 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t'

pass 6652571 2022-02-01 05:15:46 2022-02-01 13:30:43 2022-02-01 14:02:08 0:31:25 0:17:24 0:14:01 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6652572 2022-02-01 05:15:47 2022-02-01 13:34:14 2022-02-01 13:57:42 0:23:28 0:11:46 0:11:42 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_namespaces} 3
pass 6652573 2022-02-01 05:15:47 2022-02-01 13:36:04 2022-02-01 15:01:47 1:25:43 1:12:09 0:13:34 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
pass 6652574 2022-02-01 05:15:48 2022-02-01 13:37:55 2022-02-01 14:30:15 0:52:20 0:37:49 0:14:31 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6652575 2022-02-01 05:15:49 2022-02-01 13:40:45 2022-02-01 14:09:11 0:28:26 0:16:05 0:12:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6652576 2022-02-01 05:15:50 2022-02-01 13:41:36 2022-02-01 14:08:52 0:27:16 0:12:28 0:14:48 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6652577 2022-02-01 05:15:51 2022-02-01 13:45:27 2022-02-01 14:18:02 0:32:35 0:11:39 0:20:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netns} 3
pass 6652578 2022-02-01 05:15:51 2022-02-01 13:52:28 2022-02-01 14:14:12 0:21:44 0:09:06 0:12:38 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_huge_image} 1
pass 6652579 2022-02-01 05:15:52 2022-02-01 13:52:38 2022-02-01 14:28:18 0:35:40 0:22:38 0:13:02 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6652580 2022-02-01 05:15:53 2022-02-01 13:52:39 2022-02-01 14:17:37 0:24:58 0:12:13 0:12:45 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6652581 2022-02-01 05:15:54 2022-02-01 13:54:09 2022-02-01 14:20:09 0:26:00 0:11:26 0:14:34 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6652582 2022-02-01 05:15:55 2022-02-01 13:56:30 2022-02-01 14:24:35 0:28:05 0:16:16 0:11:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_concurrent} 3
pass 6652583 2022-02-01 05:15:55 2022-02-01 13:57:00 2022-02-01 14:19:32 0:22:32 0:10:42 0:11:50 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6652584 2022-02-01 05:15:56 2022-02-01 13:57:51 2022-02-01 14:30:11 0:32:20 0:19:24 0:12:56 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6652585 2022-02-01 05:15:57 2022-02-01 13:58:21 2022-02-01 14:24:05 0:25:44 0:11:13 0:14:31 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_image_read} 3
pass 6652586 2022-02-01 05:15:58 2022-02-01 14:02:12 2022-02-01 14:21:46 0:19:34 0:09:19 0:10:15 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_modprobe} 1
pass 6652587 2022-02-01 05:15:59 2022-02-01 14:02:12 2022-02-01 14:33:41 0:31:29 0:15:50 0:15:39 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6652588 2022-02-01 05:15:59 2022-02-01 14:05:53 2022-02-01 15:24:51 1:18:58 1:05:24 0:13:34 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{secure} thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6652589 2022-02-01 05:16:00 2022-02-01 14:06:44 2022-02-01 14:30:21 0:23:37 0:10:50 0:12:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_kernel} 3
fail 6652590 2022-02-01 05:16:01 2022-02-01 14:08:54 2022-02-01 14:38:49 0:29:55 0:17:18 0:12:37 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

"2022-02-01T14:27:31.233143+0000 mon.a (mon.0) 16 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 6652591 2022-02-01 05:16:02 2022-02-01 14:09:15 2022-02-01 14:39:17 0:30:02 0:10:14 0:19:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_snapshot_io} 3
fail 6652592 2022-02-01 05:16:03 2022-02-01 14:17:46 2022-02-01 14:45:45 0:27:59 0:15:39 0:12:20 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_unmap} 3
Failure Reason:

"2022-02-01T14:36:07.313010+0000 mon.a (mon.0) 16 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log

pass 6652593 2022-02-01 05:16:03 2022-02-01 14:18:06 2022-02-01 14:41:13 0:23:07 0:11:46 0:11:21 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6652594 2022-02-01 05:16:04 2022-02-01 14:19:37 2022-02-01 14:57:57 0:38:20 0:27:32 0:10:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_simple_big} 3
pass 6652595 2022-02-01 05:16:05 2022-02-01 14:19:47 2022-02-01 14:39:22 0:19:35 0:09:01 0:10:34 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_msgr_segments} 1
pass 6652596 2022-02-01 05:16:06 2022-02-01 14:19:48 2022-02-01 14:56:02 0:36:14 0:24:20 0:11:54 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6652597 2022-02-01 05:16:07 2022-02-01 14:20:18 2022-02-01 15:04:25 0:44:07 0:30:44 0:13:23 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_fio} 3
pass 6652598 2022-02-01 05:16:07 2022-02-01 14:41:22 2022-02-01 15:19:20 0:37:58 0:23:09 0:14:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_data_pool} 3
pass 6652599 2022-02-01 05:16:08 2022-02-01 14:45:53 2022-02-01 15:17:52 0:31:59 0:11:39 0:20:20 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6652600 2022-02-01 05:16:09 2022-02-01 14:56:05 2022-02-01 15:30:14 0:34:09 0:19:21 0:14:48 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6652601 2022-02-01 05:16:10 2022-02-01 14:58:05 2022-02-01 15:25:50 0:27:45 0:12:02 0:15:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_fallocate} 3
pass 6652602 2022-02-01 05:16:11 2022-02-01 15:01:56 2022-02-01 15:25:46 0:23:50 0:11:44 0:12:06 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6652603 2022-02-01 05:16:12 2022-02-01 15:01:57 2022-02-01 15:56:02 0:54:05 0:41:56 0:12:09 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6652604 2022-02-01 05:16:12 2022-02-01 15:04:27 2022-02-01 15:32:49 0:28:22 0:14:21 0:14:01 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6652605 2022-02-01 05:16:13 2022-02-01 15:07:28 2022-02-01 15:27:06 0:19:38 0:09:39 0:09:59 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_parent_overlap} 1
pass 6652606 2022-02-01 05:16:14 2022-02-01 15:07:38 2022-02-01 15:39:15 0:31:37 0:18:00 0:13:37 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6652607 2022-02-01 05:16:15 2022-02-01 15:09:19 2022-02-01 15:33:03 0:23:44 0:11:47 0:11:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_namespaces} 3
fail 6652608 2022-02-01 05:16:15 2022-02-01 15:09:29 2022-02-01 18:43:48 3:34:19 3:22:02 0:12:17 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

Command failed (workunit test suites/ffsb.sh) on smithi189 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9f723519257eca039126a20aa6a2a7d2dbfb5dba TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh'

pass 6652609 2022-02-01 05:16:16 2022-02-01 15:09:49 2022-02-01 16:02:09 0:52:20 0:39:06 0:13:14 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6652610 2022-02-01 05:16:17 2022-02-01 15:10:00 2022-02-01 15:48:41 0:38:41 0:26:30 0:12:11 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6652611 2022-02-01 05:16:18 2022-02-01 15:10:20 2022-02-01 15:37:41 0:27:21 0:13:35 0:13:46 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6652612 2022-02-01 05:16:19 2022-02-01 15:11:31 2022-02-01 15:36:19 0:24:48 0:11:43 0:13:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_netns} 3
pass 6652613 2022-02-01 05:16:19 2022-02-01 15:12:51 2022-02-01 15:32:26 0:19:35 0:09:37 0:09:58 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_read_only} 1
pass 6652614 2022-02-01 05:16:20 2022-02-01 15:12:51 2022-02-01 15:49:43 0:36:52 0:19:16 0:17:36 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6652615 2022-02-01 05:16:21 2022-02-01 15:25:55 2022-02-01 16:31:52 1:05:57 0:53:48 0:12:09 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/pggrow thrashosds-health workloads/rbd_fio} 3
pass 6652616 2022-02-01 05:16:22 2022-02-01 15:25:56 2022-02-01 15:52:22 0:26:26 0:11:49 0:14:37 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6652617 2022-02-01 05:16:22 2022-02-01 15:30:16 2022-02-01 15:54:14 0:23:58 0:10:40 0:13:18 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6652618 2022-02-01 05:16:23 2022-02-01 15:32:27 2022-02-01 16:00:22 0:27:55 0:16:25 0:11:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_concurrent} 3
pass 6652619 2022-02-01 05:16:24 2022-02-01 15:32:58 2022-02-01 15:54:50 0:21:52 0:10:29 0:11:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6652620 2022-02-01 05:16:25 2022-02-01 15:33:08 2022-02-01 16:08:19 0:35:11 0:20:15 0:14:56 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6652621 2022-02-01 05:16:26 2022-02-01 15:36:29 2022-02-01 16:00:07 0:23:38 0:10:57 0:12:41 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_image_read} 3
pass 6652622 2022-02-01 05:16:26 2022-02-01 15:37:49 2022-02-01 15:58:47 0:20:58 0:09:34 0:11:24 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_whole_object_zeroout} 1
pass 6652623 2022-02-01 05:16:27 2022-02-01 15:40:21 2022-02-01 16:10:01 0:29:40 0:19:16 0:10:24 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6652624 2022-02-01 05:16:28 2022-02-01 16:00:57 2022-02-01 16:28:36 0:27:39 0:13:15 0:14:24 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_kernel} 3
pass 6652625 2022-02-01 05:16:29 2022-02-01 16:00:57 2022-02-01 16:30:22 0:29:25 0:18:19 0:11:06 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6652626 2022-02-01 05:16:29 2022-02-01 16:00:58 2022-02-01 16:26:03 0:25:05 0:11:32 0:13:33 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6652627 2022-02-01 05:16:30 2022-02-01 16:00:58 2022-02-01 16:34:07 0:33:09 0:19:25 0:13:44 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_map_unmap} 3
pass 6652628 2022-02-01 05:16:31 2022-02-01 16:00:58 2022-02-01 16:26:21 0:25:23 0:14:37 0:10:46 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6652629 2022-02-01 05:16:32 2022-02-01 16:00:59 2022-02-01 16:42:29 0:41:30 0:31:23 0:10:07 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_simple_big} 3
pass 6652630 2022-02-01 05:16:33 2022-02-01 16:00:59 2022-02-01 16:22:24 0:21:25 0:10:17 0:11:08 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_deep_flatten} 1
pass 6652631 2022-02-01 05:16:33 2022-02-01 16:00:59 2022-02-01 16:40:26 0:39:27 0:23:46 0:15:41 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6652632 2022-02-01 05:16:34 2022-02-01 16:01:00 2022-02-01 16:45:00 0:44:00 0:32:57 0:11:03 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_fio} 3
pass 6652633 2022-02-01 05:16:35 2022-02-01 16:01:00 2022-02-01 16:36:42 0:35:42 0:20:43 0:14:59 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_data_pool} 3
pass 6652634 2022-02-01 05:16:36 2022-02-01 16:01:00 2022-02-01 16:28:02 0:27:02 0:11:54 0:15:08 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} 2
pass 6652635 2022-02-01 05:16:36 2022-02-01 16:01:01 2022-02-01 16:41:47 0:40:46 0:26:48 0:13:58 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} 3
pass 6652636 2022-02-01 05:16:37 2022-02-01 16:01:01 2022-02-01 16:29:57 0:28:56 0:13:56 0:15:00 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_exclusive_option} 3
fail 6652637 2022-02-01 05:16:38 2022-02-01 16:01:01 2022-02-01 16:40:11 0:39:10 0:23:45 0:15:25 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
Failure Reason:

"2022-02-01T16:32:01.952957+0000 osd.1 (osd.1) 3 : cluster [WRN] slow request osd_op(client.4410.0:50777 2.4 2:25c5070a:::rbd_data.10e5e21c4801.00000000000004c5:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1507328~4096 in=4096b] snapc 0=[] RETRY=16 ondisk+retry+write+known_if_redirected e21) initiated 2022-02-01T16:31:31.647652+0000 currently waiting for sub ops" in cluster log

pass 6652638 2022-02-01 05:16:39 2022-02-01 16:01:02 2022-02-01 16:44:07 0:43:05 0:27:42 0:15:23 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_fallocate} 3
pass 6652639 2022-02-01 05:16:40 2022-02-01 16:01:02 2022-02-01 16:29:52 0:28:50 0:15:18 0:13:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6652640 2022-02-01 05:16:40 2022-02-01 16:01:02 2022-02-01 17:01:04 1:00:02 0:44:50 0:15:12 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6652641 2022-02-01 05:16:41 2022-02-01 16:02:13 2022-02-01 16:32:15 0:30:02 0:16:23 0:13:39 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
fail 6652642 2022-02-01 05:16:42 2022-02-01 16:04:43 2022-02-01 16:30:24 0:25:41 0:11:08 0:14:33 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_discard} 1
Failure Reason:

Command failed on smithi118 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t'

pass 6652643 2022-02-01 05:16:43 2022-02-01 16:38:46 2022-02-01 17:12:50 0:34:04 0:19:01 0:15:03 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6652644 2022-02-01 05:16:43 2022-02-01 16:41:04 2022-02-01 17:58:55 1:17:51 1:04:24 0:13:27 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6652645 2022-02-01 05:16:44 2022-02-01 16:41:04 2022-02-01 17:11:38 0:30:34 0:16:13 0:14:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_namespaces} 3
fail 6652646 2022-02-01 05:16:45 2022-02-01 16:41:04 2022-02-01 18:07:34 1:26:30 1:13:49 0:12:41 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

"2022-02-01T17:26:54.809821+0000 osd.1 (osd.1) 3 : cluster [WRN] slow request osd_op(client.4410.0:373990 2.4 2:3f3036dd:::rbd_data.1156d9cadc6.00000000000010ed:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1695744~4096 in=4096b] snapc 0=[] ondisk+write+known_if_redirected e23) initiated 2022-02-01T17:26:24.640514+0000 currently waiting for sub ops" in cluster log

pass 6652647 2022-02-01 05:16:46 2022-02-01 16:41:55 2022-02-01 17:34:06 0:52:11 0:38:50 0:13:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6652648 2022-02-01 05:16:47 2022-02-01 16:42:35 2022-02-01 17:13:16 0:30:41 0:17:44 0:12:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6652649 2022-02-01 05:16:47 2022-02-01 16:43:46 2022-02-01 17:11:02 0:27:16 0:13:59 0:13:17 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6652650 2022-02-01 05:16:48 2022-02-01 16:44:16 2022-02-01 17:23:08 0:38:52 0:26:04 0:12:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_netns} 3
pass 6652651 2022-02-01 05:16:49 2022-02-01 16:45:07 2022-02-01 17:06:52 0:21:45 0:11:37 0:10:08 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_huge_image} 1
pass 6652652 2022-02-01 05:16:50 2022-02-01 16:45:07 2022-02-01 17:23:22 0:38:15 0:24:58 0:13:17 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6652653 2022-02-01 05:16:50 2022-02-01 16:47:38 2022-02-01 17:15:50 0:28:12 0:14:31 0:13:41 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_symlinks} 3
pass 6652654 2022-02-01 05:16:51 2022-02-01 16:50:18 2022-02-01 17:16:41 0:26:23 0:14:53 0:11:30 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6652655 2022-02-01 05:16:52 2022-02-01 16:50:29 2022-02-01 17:21:35 0:31:06 0:18:17 0:12:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_concurrent} 3
pass 6652656 2022-02-01 05:16:53 2022-02-01 16:50:49 2022-02-01 17:15:46 0:24:57 0:11:52 0:13:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6652657 2022-02-01 05:16:53 2022-02-01 16:51:39 2022-02-01 17:24:50 0:33:11 0:21:09 0:12:02 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6652658 2022-02-01 05:16:54 2022-02-01 16:53:30 2022-02-01 17:17:55 0:24:25 0:13:10 0:11:15 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_image_read} 3
pass 6652659 2022-02-01 05:16:55 2022-02-01 16:54:10 2022-02-01 17:15:23 0:21:13 0:10:21 0:10:52 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_modprobe} 1
pass 6652660 2022-02-01 05:16:56 2022-02-01 16:54:11 2022-02-01 17:27:48 0:33:37 0:21:23 0:12:14 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6652661 2022-02-01 05:16:57 2022-02-01 16:56:01 2022-02-01 17:18:44 0:22:43 0:11:19 0:11:24 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_kernel} 3
pass 6652662 2022-02-01 05:16:57 2022-02-01 16:56:52 2022-02-01 17:27:20 0:30:28 0:18:14 0:12:14 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6652663 2022-02-01 05:16:58 2022-02-01 16:57:42 2022-02-01 17:20:01 0:22:19 0:10:30 0:11:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6652664 2022-02-01 05:16:59 2022-02-01 16:58:03 2022-02-01 17:26:48 0:28:45 0:16:18 0:12:27 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_map_unmap} 3
pass 6652665 2022-02-01 05:17:00 2022-02-01 16:59:13 2022-02-01 17:24:58 0:25:45 0:12:33 0:13:12 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
fail 6652666 2022-02-01 05:17:01 2022-02-01 17:00:44 2022-02-01 20:28:43 3:27:59 3:16:25 0:11:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_simple_big} 3
Failure Reason:

Command failed (workunit test rbd/simple_big.sh) on smithi139 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9f723519257eca039126a20aa6a2a7d2dbfb5dba TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/simple_big.sh'

pass 6652667 2022-02-01 05:17:01 2022-02-01 17:00:54 2022-02-01 17:20:33 0:19:39 0:09:25 0:10:14 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_msgr_segments} 1
pass 6652668 2022-02-01 05:17:02 2022-02-01 17:01:04 2022-02-01 17:39:47 0:38:43 0:25:24 0:13:19 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6652669 2022-02-01 05:17:03 2022-02-01 17:01:25 2022-02-01 17:45:15 0:43:50 0:31:42 0:12:08 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_fio} 3
pass 6652670 2022-02-01 05:17:04 2022-02-01 17:01:35 2022-02-01 17:36:04 0:34:29 0:23:24 0:11:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_data_pool} 3
fail 6652671 2022-02-01 05:17:04 2022-02-01 17:02:26 2022-02-01 22:07:53 5:05:27 4:52:48 0:12:39 smithi master krbd/singleton/{bluestore-bitmap conf ms_mode$/{legacy} msgr-failures/many tasks/rbd_xfstests} 4
Failure Reason:

Command failed on smithi132 with status 1: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeaide_y0e -r -- '-g auto -g blockdev -x clone'"

pass 6652672 2022-02-01 05:17:05 2022-02-01 17:04:06 2022-02-01 18:11:17 1:07:11 0:52:49 0:14:22 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6652673 2022-02-01 05:17:06 2022-02-01 17:05:17 2022-02-01 17:32:25 0:27:08 0:11:27 0:15:41 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6652674 2022-02-01 05:17:07 2022-02-01 17:06:47 2022-02-01 17:42:42 0:35:55 0:18:54 0:17:01 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6652675 2022-02-01 05:17:08 2022-02-01 17:08:18 2022-02-01 17:37:02 0:28:44 0:11:57 0:16:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_fallocate} 3
pass 6652676 2022-02-01 05:17:08 2022-02-01 17:09:38 2022-02-01 17:41:56 0:32:18 0:11:48 0:20:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6652677 2022-02-01 05:17:09 2022-02-01 17:11:09 2022-02-01 18:10:11 0:59:02 0:41:14 0:17:48 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6652678 2022-02-01 05:17:10 2022-02-01 17:11:39 2022-02-01 17:41:27 0:29:48 0:14:20 0:15:28 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6652679 2022-02-01 05:17:11 2022-02-01 17:12:20 2022-02-01 17:38:47 0:26:27 0:09:16 0:17:11 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_parent_overlap} 1
pass 6652680 2022-02-01 05:17:11 2022-02-01 17:13:00 2022-02-01 17:48:59 0:35:59 0:18:14 0:17:45 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
fail 6652681 2022-02-01 05:17:12 2022-02-01 17:13:20 2022-02-01 17:28:11 0:14:51 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_namespaces} 3
Failure Reason:

Command failed on smithi137 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

fail 6652682 2022-02-01 05:17:13 2022-02-01 17:15:31 2022-02-01 17:27:31 0:12:00 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

Command failed on smithi145 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

fail 6652683 2022-02-01 05:17:14 2022-02-01 17:15:51 2022-02-01 17:27:58 0:12:07 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_enumerate} 3
Failure Reason:

Command failed on smithi118 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

pass 6652684 2022-02-01 05:17:15 2022-02-01 17:15:52 2022-02-01 17:42:54 0:27:02 0:15:25 0:11:37 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6652685 2022-02-01 05:17:15 2022-02-01 17:16:42 2022-02-01 17:41:46 0:25:04 0:13:32 0:11:32 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
fail 6652686 2022-02-01 05:17:16 2022-02-01 17:18:03 2022-02-01 17:28:52 0:10:49 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_netns} 3
Failure Reason:

Command failed on smithi153 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

fail 6652687 2022-02-01 05:17:17 2022-02-01 17:18:53 2022-02-01 17:26:41 0:07:48 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_read_only} 1
Failure Reason:

Command failed on smithi148 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

fail 6652688 2022-02-01 05:17:18 2022-02-01 17:18:53 2022-02-01 17:29:59 0:11:06 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{crc} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
Failure Reason:

Command failed on smithi185 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

pass 6652689 2022-02-01 05:17:19 2022-02-01 17:20:04 2022-02-01 17:44:34 0:24:30 0:11:42 0:12:48 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_udev_symlinks} 3
fail 6652690 2022-02-01 05:17:19 2022-02-01 17:23:17 2022-02-01 17:33:13 0:09:56 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

Command failed on smithi016 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

pass 6652691 2022-02-01 05:17:20 2022-02-01 17:23:28 2022-02-01 17:52:22 0:28:54 0:16:25 0:12:29 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_concurrent} 3
pass 6652692 2022-02-01 05:17:21 2022-02-01 17:24:58 2022-02-01 17:49:26 0:24:28 0:10:32 0:13:56 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_huge_tickets} 3
fail 6652693 2022-02-01 05:17:22 2022-02-01 17:24:59 2022-02-01 17:36:27 0:11:28 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
Failure Reason:

Command failed on smithi101 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

fail 6652694 2022-02-01 05:17:22 2022-02-01 17:26:49 2022-02-01 17:37:10 0:10:21 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_image_read} 3
Failure Reason:

Command failed on smithi164 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

fail 6652695 2022-02-01 05:17:23 2022-02-01 17:27:30 2022-02-01 17:37:08 0:09:38 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_whole_object_zeroout} 1
Failure Reason:

Command failed on smithi148 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

fail 6652696 2022-02-01 05:17:24 2022-02-01 17:27:30 2022-02-01 17:37:03 0:09:33 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
Failure Reason:

Command failed on smithi104 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

fail 6652697 2022-02-01 05:17:25 2022-02-01 17:27:40 2022-02-01 17:37:39 0:09:59 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{crc} thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} 3
Failure Reason:

Command failed on smithi041 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

fail 6652698 2022-02-01 05:17:26 2022-02-01 17:27:51 2022-02-01 17:37:56 0:10:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_kernel} 3
Failure Reason:

Command failed on smithi138 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

fail 6652699 2022-02-01 05:17:26 2022-02-01 17:28:01 2022-02-01 17:38:58 0:10:57 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
Failure Reason:

Command failed on smithi137 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

fail 6652700 2022-02-01 05:17:27 2022-02-01 17:28:21 2022-02-01 17:38:47 0:10:26 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_snapshot_io} 3
Failure Reason:

Command failed on smithi153 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

fail 6652701 2022-02-01 05:17:28 2022-02-01 17:29:02 2022-02-01 17:39:47 0:10:45 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_map_unmap} 3
Failure Reason:

Command failed on smithi169 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

fail 6652702 2022-02-01 05:17:29 2022-02-01 17:30:02 2022-02-01 17:39:56 0:09:54 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
Failure Reason:

Command failed on smithi060 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

pass 6652703 2022-02-01 05:17:30 2022-02-01 17:30:33 2022-02-01 18:12:28 0:41:55 0:28:23 0:13:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_simple_big} 3
fail 6652704 2022-02-01 05:17:30 2022-02-01 17:32:33 2022-02-01 17:42:00 0:09:27 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_deep_flatten} 1
Failure Reason:

Command failed on smithi173 with status 128: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main'

pass 6652705 2022-02-01 05:17:31 2022-02-01 17:32:34 2022-02-01 18:10:43 0:38:09 0:26:50 0:11:19 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
dead 6652706 2022-02-01 05:17:32 2022-02-01 17:33:14 2022-02-02 00:12:13 6:38:59 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_fio} 3
Failure Reason:

hit max job timeout

pass 6652707 2022-02-01 05:17:33 2022-02-01 17:33:35 2022-02-01 18:05:39 0:32:04 0:20:00 0:12:04 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_data_pool} 3
pass 6652708 2022-02-01 05:17:34 2022-02-01 17:34:15 2022-02-01 17:55:33 0:21:18 0:09:43 0:11:35 smithi master krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} 2
pass 6652709 2022-02-01 05:17:34 2022-02-01 17:36:05 2022-02-01 18:10:06 0:34:01 0:23:05 0:10:56 smithi master krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} 3
pass 6652710 2022-02-01 05:17:35 2022-02-01 17:36:36 2022-02-01 18:12:32 0:35:56 0:23:51 0:12:05 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_exclusive_option} 3
pass 6652711 2022-02-01 05:17:36 2022-02-01 17:37:06 2022-02-01 18:08:46 0:31:40 0:20:50 0:10:50 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_kernel_untar_build} 3
pass 6652712 2022-02-01 05:17:37 2022-02-01 17:37:07 2022-02-01 18:00:45 0:23:38 0:11:29 0:12:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_fallocate} 3
pass 6652713 2022-02-01 05:17:38 2022-02-01 17:37:17 2022-02-01 18:01:31 0:24:14 0:12:28 0:11:46 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_huge_osdmap} 3
pass 6652714 2022-02-01 05:17:38 2022-02-01 17:37:47 2022-02-01 18:31:54 0:54:07 0:42:20 0:11:47 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_dbench} 3
pass 6652715 2022-02-01 05:17:39 2022-02-01 17:37:58 2022-02-01 18:04:35 0:26:37 0:14:01 0:12:36 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_latest_osdmap_on_map} 3
fail 6652716 2022-02-01 05:17:40 2022-02-01 17:38:48 2022-02-01 18:00:28 0:21:40 0:10:20 0:11:20 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_discard} 1
Failure Reason:

Command failed on smithi161 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t'

pass 6652717 2022-02-01 05:17:41 2022-02-01 17:38:48 2022-02-01 18:05:27 0:26:39 0:15:30 0:11:09 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{crc} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6652718 2022-02-01 05:17:41 2022-02-01 17:38:59 2022-02-01 18:03:37 0:24:38 0:12:22 0:12:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_namespaces} 3
dead 6652719 2022-02-01 05:17:42 2022-02-01 17:39:49 2022-02-01 17:56:06 0:16:17 0:04:54 0:11:23 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_ffsb} 3
Failure Reason:

Failure object was: {'smithi157.front.sepia.ceph.com': {'cache_updated': False, 'stdout': '', 'stderr': 'W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6816 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'rc': 100, 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': True, 'force_apt_get': False, 'policy_rc_d': None, 'package': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-venv', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'libfcgi0ldbl', 'python-dev', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common', 'libgnutls30'], 'autoclean': False, 'install_recommends': None, 'name': ['mpich', 'qemu-system-x86', 'lttng-tools', 'libtool-bin', 'docker.io', 'python3-nose', 'python3-venv', 'python3-virtualenv', 'python3-configobj', 'python3-gevent', 'python3-numpy', 'python3-matplotlib', 'python3-setuptools', 'libfcgi0ldbl', 'python-dev', 'libev-dev', 'perl', 'libwww-perl', 'lsb-release', 'build-essential', 'sysstat', 'gdb', 'libedit2', 'cryptsetup-bin', 'xfsprogs', 'gdisk', 'parted', 'libuuid1', 'libatomic-ops-dev', 'git-core', 'attr', 'dbench', 'bonnie++', 'valgrind', 'ant', 'libtool', 'automake', 'gettext', 'uuid-dev', 'libacl1-dev', 'bc', 'xfsdump', 'xfslibs-dev', 'libattr1-dev', 'quota', 'libcap2-bin', 'libncurses5-dev', 'lvm2', 'vim', 'pdsh', 'blktrace', 'genisoimage', 'libjson-xs-perl', 'xml-twig-tools', 'default-jdk', 'junit4', 'tgt', 'open-iscsi', 'cifs-utils', 'ipcalc', 'nfs-common', 'nfs-kernel-server', 'software-properties-common', 'libgnutls30'], 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': None, 'update_cache': None, 'default_release': None, 'only_upgrade': False, 'deb': None, 'cache_valid_time': 0}}, 'cache_update_time': 1643737924, 'msg': '\'/usr/bin/apt-get -y -o "Dpkg::Options::=--force-confdef" -o "Dpkg::Options::=--force-confold" --force-yes install \'qemu-system-x86\' \'git-core\'\' failed: W: --force-yes is deprecated, use one of the options starting with --allow instead.\nE: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6816 (apt-get)\nE: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?\n', 'stdout_lines': [], 'stderr_lines': ['W: --force-yes is deprecated, use one of the options starting with --allow instead.', 'E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 6816 (apt-get)', 'E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it?'], '_ansible_no_log': False, 'changed': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'cache_update_time')

pass 6652720 2022-02-01 05:17:43 2022-02-01 17:39:49 2022-02-01 18:29:26 0:49:37 0:38:39 0:10:58 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_enumerate} 3
pass 6652721 2022-02-01 05:17:44 2022-02-01 17:40:00 2022-02-01 18:06:45 0:26:45 0:15:42 0:11:03 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netlink_enobufs} 3
pass 6652722 2022-02-01 05:17:44 2022-02-01 17:41:30 2022-02-01 18:05:32 0:24:02 0:12:36 0:11:26 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress} 3
pass 6652723 2022-02-01 05:17:45 2022-02-01 17:41:51 2022-02-01 18:03:44 0:21:53 0:11:28 0:10:25 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_netns} 3
pass 6652724 2022-02-01 05:17:46 2022-02-01 17:42:01 2022-02-01 18:04:42 0:22:41 0:09:46 0:12:55 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_huge_image} 1
pass 6652725 2022-02-01 05:17:47 2022-02-01 17:42:01 2022-02-01 18:17:15 0:35:14 0:22:25 0:12:49 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{secure} objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} 3
pass 6652726 2022-02-01 05:17:48 2022-02-01 17:42:52 2022-02-01 18:49:07 1:06:15 0:54:52 0:11:23 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} 3
pass 6652727 2022-02-01 05:17:48 2022-02-01 17:43:02 2022-02-01 18:09:33 0:26:31 0:11:57 0:14:34 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_udev_symlinks} 3
dead 6652728 2022-02-01 05:17:49 2022-02-01 17:44:43 2022-02-01 18:03:00 0:18:17 0:05:12 0:13:05 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} 3
Failure Reason:

{'Failure object was': {'smithi037.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"}

pass 6652729 2022-02-01 05:17:50 2022-02-01 17:45:24 2022-02-01 18:13:04 0:27:40 0:16:02 0:11:38 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_concurrent} 3
pass 6652730 2022-02-01 05:17:51 2022-02-01 17:45:24 2022-02-01 18:10:44 0:25:20 0:11:07 0:14:13 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_huge_tickets} 3
pass 6652731 2022-02-01 05:17:52 2022-02-01 17:49:05 2022-02-01 18:22:00 0:32:55 0:19:20 0:13:35 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_fsx} 3
pass 6652732 2022-02-01 05:17:52 2022-02-01 17:49:35 2022-02-01 18:15:50 0:26:15 0:11:06 0:15:09 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_image_read} 3
pass 6652733 2022-02-01 05:17:53 2022-02-01 17:52:26 2022-02-01 18:11:56 0:19:30 0:09:00 0:10:30 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_modprobe} 1
pass 6652734 2022-02-01 05:17:54 2022-02-01 17:52:27 2022-02-01 18:23:56 0:31:29 0:20:29 0:11:00 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{secure} objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} 3
pass 6652735 2022-02-01 05:17:55 2022-02-01 17:52:27 2022-02-01 18:18:29 0:26:02 0:10:46 0:15:16 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_kernel} 3
pass 6652736 2022-02-01 05:17:55 2022-02-01 17:56:08 2022-02-01 18:26:39 0:30:31 0:17:47 0:12:44 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_iozone} 3
pass 6652737 2022-02-01 05:17:56 2022-02-01 17:58:58 2022-02-01 18:21:35 0:22:37 0:11:19 0:11:18 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_snapshot_io} 3
pass 6652738 2022-02-01 05:17:57 2022-02-01 17:59:59 2022-02-01 18:27:35 0:27:36 0:15:49 0:11:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_map_unmap} 3
pass 6652739 2022-02-01 05:17:58 2022-02-01 17:59:59 2022-02-01 18:24:31 0:24:32 0:12:26 0:12:06 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_trivial_sync} 3
pass 6652740 2022-02-01 05:17:59 2022-02-01 18:00:50 2022-02-01 18:39:29 0:38:39 0:27:07 0:11:32 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_simple_big} 3
pass 6652741 2022-02-01 05:17:59 2022-02-01 18:01:40 2022-02-01 18:23:15 0:21:35 0:09:40 0:11:55 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_msgr_segments} 1
pass 6652742 2022-02-01 05:18:00 2022-02-01 18:01:41 2022-02-01 18:40:34 0:38:53 0:26:43 0:12:10 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{legacy} objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} 3
pass 6652743 2022-02-01 05:18:01 2022-02-01 18:59:40 2022-02-01 19:42:16 0:42:36 0:30:50 0:11:46 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_fio} 3
pass 6652744 2022-02-01 05:18:02 2022-02-01 19:00:31 2022-02-01 19:35:15 0:34:44 0:23:14 0:11:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_data_pool} 3
pass 6652745 2022-02-01 05:18:02 2022-02-01 19:01:21 2022-02-01 19:22:58 0:21:37 0:11:46 0:09:51 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_exclusive_option} 3
pass 6652746 2022-02-01 05:18:03 2022-02-01 19:01:32 2022-02-01 19:32:28 0:30:56 0:19:33 0:11:23 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_kernel_untar_build} 3
pass 6652747 2022-02-01 05:18:04 2022-02-01 19:02:22 2022-02-01 19:29:00 0:26:38 0:12:09 0:14:29 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_fallocate} 3
pass 6652748 2022-02-01 05:18:05 2022-02-01 19:05:33 2022-02-01 19:29:50 0:24:17 0:11:42 0:12:35 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_huge_osdmap} 3
pass 6652749 2022-02-01 05:18:06 2022-02-01 19:05:43 2022-02-01 20:00:29 0:54:46 0:41:15 0:13:31 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_suites_dbench} 3
pass 6652750 2022-02-01 05:18:06 2022-02-01 19:08:44 2022-02-01 19:35:04 0:26:20 0:14:34 0:11:46 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/krbd_latest_osdmap_on_map} 3
pass 6652751 2022-02-01 05:18:07 2022-02-01 19:09:24 2022-02-01 19:30:03 0:20:39 0:09:14 0:11:25 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/crc tasks/krbd_parent_overlap} 1
pass 6652752 2022-02-01 05:18:08 2022-02-01 19:10:25 2022-02-01 19:38:43 0:28:18 0:16:35 0:11:43 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} 3
pass 6652753 2022-02-01 05:18:09 2022-02-01 19:10:45 2022-02-01 20:10:50 1:00:05 0:48:35 0:11:30 smithi master krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/upmap thrashosds-health workloads/rbd_fio} 3
pass 6652754 2022-02-01 05:18:10 2022-02-01 19:11:26 2022-02-01 19:36:26 0:25:00 0:12:06 0:12:54 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/krbd_namespaces} 3
pass 6652755 2022-02-01 05:18:10 2022-02-01 19:11:36 2022-02-01 20:28:00 1:16:24 1:04:35 0:11:49 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/few tasks/rbd_workunit_suites_ffsb} 3
pass 6652756 2022-02-01 05:18:11 2022-02-01 19:12:26 2022-02-01 20:06:33 0:54:07 0:42:40 0:11:27 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/krbd_udev_enumerate} 3
pass 6652757 2022-02-01 05:18:12 2022-02-01 19:12:57 2022-02-01 19:46:38 0:33:41 0:23:04 0:10:37 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/krbd_udev_netlink_enobufs} 3
pass 6652758 2022-02-01 05:18:13 2022-02-01 19:13:07 2022-02-01 19:36:49 0:23:42 0:12:50 0:10:52 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/many tasks/rbd_workunit_suites_fsstress} 3
pass 6652759 2022-02-01 05:18:13 2022-02-01 19:13:08 2022-02-01 19:37:58 0:24:50 0:11:38 0:13:12 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/krbd_udev_netns} 3
pass 6652760 2022-02-01 05:18:14 2022-02-01 19:14:08 2022-02-01 19:35:43 0:21:35 0:09:41 0:11:54 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/legacy tasks/krbd_read_only} 1
pass 6652761 2022-02-01 05:18:15 2022-02-01 19:14:08 2022-02-01 19:48:32 0:34:24 0:22:08 0:12:16 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map ms_mode$/{prefer-crc} objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} 3
pass 6652762 2022-02-01 05:18:16 2022-02-01 19:14:09 2022-02-01 19:38:53 0:24:44 0:11:47 0:12:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/krbd_udev_symlinks} 3
pass 6652763 2022-02-01 05:18:16 2022-02-01 19:15:29 2022-02-01 19:39:34 0:24:05 0:10:46 0:13:19 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} 3
pass 6652764 2022-02-01 05:18:17 2022-02-01 19:15:40 2022-02-01 19:44:23 0:28:43 0:16:37 0:12:06 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_concurrent} 3
pass 6652765 2022-02-01 05:18:18 2022-02-01 19:16:30 2022-02-01 19:39:48 0:23:18 0:10:35 0:12:43 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/few tasks/rbd_huge_tickets} 3
pass 6652766 2022-02-01 05:18:19 2022-02-01 19:18:01 2022-02-01 19:51:27 0:33:26 0:20:31 0:12:55 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/legacy msgr-failures/many tasks/rbd_workunit_suites_fsx} 3
pass 6652767 2022-02-01 05:18:20 2022-02-01 19:18:41 2022-02-01 19:44:49 0:26:08 0:11:31 0:14:37 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/many tasks/rbd_image_read} 3
pass 6652768 2022-02-01 05:18:20 2022-02-01 19:20:42 2022-02-01 19:42:52 0:22:10 0:09:46 0:12:24 smithi master krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf ms_mode/secure tasks/krbd_whole_object_zeroout} 1
pass 6652769 2022-02-01 05:18:21 2022-02-01 19:20:42 2022-02-01 19:52:41 0:31:59 0:18:22 0:13:37 smithi master krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map ms_mode$/{legacy} objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} 3
pass 6652770 2022-02-01 05:18:22 2022-02-01 19:21:53 2022-02-01 19:43:25 0:21:32 0:10:47 0:10:45 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/few tasks/rbd_kernel} 3
pass 6652771 2022-02-01 05:18:23 2022-02-01 19:21:53 2022-02-01 19:50:44 0:28:51 0:16:49 0:12:02 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/secure msgr-failures/few tasks/rbd_workunit_suites_iozone} 3
pass 6652772 2022-02-01 05:18:24 2022-02-01 19:23:03 2022-02-01 19:44:52 0:21:49 0:10:19 0:11:30 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/crc msgr-failures/many tasks/rbd_map_snapshot_io} 3
pass 6652773 2022-02-01 05:18:24 2022-02-01 19:23:14 2022-02-01 19:53:58 0:30:44 0:15:47 0:14:57 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/legacy msgr-failures/few tasks/rbd_map_unmap} 3
pass 6652774 2022-02-01 05:18:25 2022-02-01 19:25:35 2022-02-01 19:50:16 0:24:41 0:12:29 0:12:12 smithi master krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf ms_mode/crc msgr-failures/many tasks/rbd_workunit_trivial_sync} 3
pass 6652775 2022-02-01 05:18:26 2022-02-01 19:27:05 2022-02-01 20:25:36 0:58:31 0:46:44 0:11:47 smithi master krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph ms_mode/secure msgr-failures/many tasks/rbd_simple_big} 3