Status Job ID Links Posted Started Updated
Runtime
Duration
In Waiting
Machine Teuthology Branch OS Type OS Version Description Nodes
pass 6784656 2022-04-09 16:48:20 2022-04-09 16:49:25 2022-04-09 17:20:18 0:30:53 0:23:58 0:06:55 smithi master centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-pacific 1-client 2-upgrade 3-compat_client/no}} 3
pass 6784657 2022-04-09 16:48:21 2022-04-09 16:49:25 2022-04-09 17:25:16 0:35:51 0:28:19 0:07:32 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6784658 2022-04-09 16:48:22 2022-04-09 16:49:35 2022-04-09 17:04:11 0:14:36 0:09:05 0:05:31 smithi master centos 8.stream fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-pacific 1-upgrade}} 1
dead 6784659 2022-04-09 16:48:23 2022-04-09 16:49:36 2022-04-09 23:30:27 6:40:51 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

hit max job timeout

pass 6784660 2022-04-09 16:48:24 2022-04-09 16:49:56 2022-04-09 17:23:02 0:33:06 0:27:21 0:05:45 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
fail 6784661 2022-04-09 16:48:25 2022-04-09 16:50:07 2022-04-09 17:12:43 0:22:36 0:13:36 0:09:00 smithi master centos 8.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-pacific 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
Failure Reason:

client still has session: {'id': 4501, 'entity': {'name': {'type': 'client', 'num': 4501}, 'addr': {'type': 'v1', 'addr': '172.21.15.142:0', 'nonce': 641241820}}, 'state': 'open', 'num_leases': 0, 'num_caps': 1, 'request_load_avg': 0, 'uptime': 108.097969706, 'requests_in_flight': 0, 'num_completed_requests': 0, 'num_completed_flushes': 0, 'reconnecting': False, 'recall_caps': {'value': 0, 'halflife': 60}, 'release_caps': {'value': 0, 'halflife': 60}, 'recall_caps_throttle': {'value': 0, 'halflife': 1.5}, 'recall_caps_throttle2o': {'value': 0, 'halflife': 0.5}, 'session_cache_liveness': {'value': 0.7807811090249575, 'halflife': 300}, 'cap_acquisition': {'value': 0, 'halflife': 10}, 'delegated_inos': [], 'inst': 'client.4501 v1:172.21.15.142:0/641241820', 'completed_requests': [], 'prealloc_inos': [], 'client_metadata': {'client_features': {'feature_bits': '0x000000000000ffff'}, 'metric_spec': {'metric_flags': {'feature_bits': '0x00000000000003ff'}}, 'ceph_sha1': 'ac978832a85a67de60a49b34ed497d7075f4b151', 'ceph_version': 'ceph version 16.2.7-864-gac978832 (ac978832a85a67de60a49b34ed497d7075f4b151) pacific (stable)', 'entity_id': '1', 'hostname': 'smithi142', 'mount_point': '/home/ubuntu/cephtest/mnt.1', 'pid': '29138', 'root': '/'}}

pass 6784662 2022-04-09 16:48:26 2022-04-09 16:51:37 2022-04-09 17:30:21 0:38:44 0:29:56 0:08:48 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6784663 2022-04-09 16:48:27 2022-04-09 16:52:58 2022-04-09 17:28:42 0:35:44 0:27:37 0:08:07 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6784664 2022-04-09 16:48:28 2022-04-09 16:53:38 2022-04-09 17:37:47 0:44:09 0:29:46 0:14:23 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
fail 6784665 2022-04-09 16:48:29 2022-04-09 17:00:09 2022-04-09 17:28:37 0:28:28 0:18:52 0:09:36 smithi master centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-pacific 1-client 2-upgrade 3-compat_client/quincy}} 3
Failure Reason:

client still has session: {'id': 4516, 'entity': {'name': {'type': 'client', 'num': 4516}, 'addr': {'type': 'v1', 'addr': '172.21.15.33:0', 'nonce': 1073069903}}, 'state': 'open', 'num_leases': 0, 'num_caps': 1, 'request_load_avg': 0, 'uptime': 21.268529393, 'requests_in_flight': 0, 'num_completed_requests': 0, 'num_completed_flushes': 1, 'reconnecting': False, 'recall_caps': {'value': 0, 'halflife': 60}, 'release_caps': {'value': 0, 'halflife': 60}, 'recall_caps_throttle': {'value': 0, 'halflife': 1.5}, 'recall_caps_throttle2o': {'value': 0, 'halflife': 0.5}, 'session_cache_liveness': {'value': 0.9682004690815017, 'halflife': 300}, 'cap_acquisition': {'value': 0, 'halflife': 10}, 'delegated_inos': [], 'inst': 'client.4516 v1:172.21.15.33:0/1073069903', 'completed_requests': [], 'prealloc_inos': [{'start': '0x10000000004', 'length': 500}, {'start': '0x10000001dc3', 'length': 403}, {'start': '0x10000002340', 'length': 501}], 'client_metadata': {'client_features': {'feature_bits': '0x000000000000ffff'}, 'metric_spec': {'metric_flags': {'feature_bits': '0x00000000000003ff'}}, 'ceph_sha1': 'ac978832a85a67de60a49b34ed497d7075f4b151', 'ceph_version': 'ceph version 16.2.7-864-gac978832 (ac978832a85a67de60a49b34ed497d7075f4b151) pacific (stable)', 'entity_id': '0', 'hostname': 'smithi033', 'mount_point': '/home/ubuntu/cephtest/mnt.0', 'pid': '28981', 'root': '/'}}

pass 6784666 2022-04-09 16:48:30 2022-04-09 17:03:30 2022-04-09 17:38:41 0:35:11 0:28:49 0:06:22 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6784667 2022-04-09 16:48:32 2022-04-09 17:03:40 2022-04-09 17:41:02 0:37:22 0:29:43 0:07:39 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6784668 2022-04-09 16:48:33 2022-04-09 17:04:01 2022-04-09 17:37:15 0:33:14 0:24:41 0:08:33 smithi master centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-pacific 1-client 2-upgrade 3-compat_client/no}} 3
pass 6784669 2022-04-09 16:48:34 2022-04-09 17:05:21 2022-04-09 17:46:26 0:41:05 0:33:26 0:07:39 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6784670 2022-04-09 16:48:35 2022-04-09 17:06:42 2022-04-09 17:39:49 0:33:07 0:27:25 0:05:42 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
fail 6784671 2022-04-09 16:48:36 2022-04-09 17:06:43 2022-04-09 17:24:42 0:17:59 0:09:23 0:08:36 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
Failure Reason:

Command failed on smithi083 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 436d68e4-b829-11ec-8c37-001a4aab830c -- ceph orch daemon add osd smithi083:vg_nvme/lv_4'

fail 6784672 2022-04-09 16:48:37 2022-04-09 17:07:33 2022-04-09 17:30:51 0:23:18 0:13:42 0:09:36 smithi master centos 8.stream fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-pacific 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} 3
Failure Reason:

client still has session: {'id': 4489, 'entity': {'name': {'type': 'client', 'num': 4489}, 'addr': {'type': 'v1', 'addr': '172.21.15.201:0', 'nonce': 3023239548}}, 'state': 'open', 'num_leases': 0, 'num_caps': 1, 'request_load_avg': 0, 'uptime': 109.600596954, 'requests_in_flight': 0, 'num_completed_requests': 0, 'num_completed_flushes': 0, 'reconnecting': False, 'recall_caps': {'value': 0, 'halflife': 60}, 'release_caps': {'value': 0, 'halflife': 60}, 'recall_caps_throttle': {'value': 0, 'halflife': 1.5}, 'recall_caps_throttle2o': {'value': 0, 'halflife': 0.5}, 'session_cache_liveness': {'value': 0.7780786779283213, 'halflife': 300}, 'cap_acquisition': {'value': 0, 'halflife': 10}, 'delegated_inos': [], 'inst': 'client.4489 v1:172.21.15.201:0/3023239548', 'completed_requests': [], 'prealloc_inos': [], 'client_metadata': {'client_features': {'feature_bits': '0x000000000000ffff'}, 'metric_spec': {'metric_flags': {'feature_bits': '0x00000000000003ff'}}, 'ceph_sha1': 'ac978832a85a67de60a49b34ed497d7075f4b151', 'ceph_version': 'ceph version 16.2.7-864-gac978832 (ac978832a85a67de60a49b34ed497d7075f4b151) pacific (stable)', 'entity_id': '1', 'hostname': 'smithi201', 'mount_point': '/home/ubuntu/cephtest/mnt.1', 'pid': '28965', 'root': '/'}}

pass 6784673 2022-04-09 16:48:38 2022-04-09 17:09:54 2022-04-09 17:44:47 0:34:53 0:28:12 0:06:41 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6784674 2022-04-09 16:48:39 2022-04-09 17:09:54 2022-04-09 17:48:34 0:38:40 0:31:06 0:07:34 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6784675 2022-04-09 16:48:40 2022-04-09 17:10:44 2022-04-09 17:47:14 0:36:30 0:28:31 0:07:59 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
fail 6784676 2022-04-09 16:48:41 2022-04-09 17:11:45 2022-04-09 17:37:32 0:25:47 0:18:10 0:07:37 smithi master centos 8.stream fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-pacific 1-client 2-upgrade 3-compat_client/quincy}} 3
Failure Reason:

client still has session: {'id': 4436, 'entity': {'name': {'type': 'client', 'num': 4436}, 'addr': {'type': 'v1', 'addr': '172.21.15.92:0', 'nonce': 2103573859}}, 'state': 'open', 'num_leases': 0, 'num_caps': 1, 'request_load_avg': 0, 'uptime': 24.965434588, 'requests_in_flight': 0, 'num_completed_requests': 0, 'num_completed_flushes': 1, 'reconnecting': False, 'recall_caps': {'value': 0, 'halflife': 60}, 'release_caps': {'value': 0, 'halflife': 60}, 'recall_caps_throttle': {'value': 0, 'halflife': 1.5}, 'recall_caps_throttle2o': {'value': 0, 'halflife': 0.5}, 'session_cache_liveness': {'value': 0.9661446610170541, 'halflife': 300}, 'cap_acquisition': {'value': 0, 'halflife': 10}, 'delegated_inos': [], 'inst': 'client.4436 v1:172.21.15.92:0/2103573859', 'completed_requests': [], 'prealloc_inos': [{'start': '0x10000000004', 'length': 500}, {'start': '0x10000007555', 'length': 35}, {'start': '0x1000000776d', 'length': 501}], 'client_metadata': {'client_features': {'feature_bits': '0x000000000000ffff'}, 'metric_spec': {'metric_flags': {'feature_bits': '0x00000000000003ff'}}, 'ceph_sha1': 'ac978832a85a67de60a49b34ed497d7075f4b151', 'ceph_version': 'ceph version 16.2.7-864-gac978832 (ac978832a85a67de60a49b34ed497d7075f4b151) pacific (stable)', 'entity_id': '0', 'hostname': 'smithi092', 'mount_point': '/home/ubuntu/cephtest/mnt.0', 'pid': '28987', 'root': '/'}}

pass 6784677 2022-04-09 16:48:42 2022-04-09 17:12:25 2022-04-09 17:50:02 0:37:37 0:30:55 0:06:42 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2
pass 6784678 2022-04-09 16:48:43 2022-04-09 17:12:56 2022-04-09 17:48:53 0:35:57 0:27:54 0:08:03 smithi master centos 8.stream fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} 2