The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1375, in test_verify_session_record_table_inter_vn
self.setup_and_create_streams(self.res.vn1_vm1_fixture, self.res.vn2_vm2_fixture)
File "/contrail-test/serial_scripts/analytics/base.py", line 170, in setup_and_create_streams
self.stop_traffic(traffic_obj)
File "/contrail-test/common/base.py", line 798, in stop_traffic
assert sent and recv, "Packets not %s"%msg
AssertionError: Packets not transferred between 50.249.119.67 and 207.0.65.67, proto udp sport 8000 and dport 9000
2025-07-23 17:23:01,534 - DEBUG - Skipping xmpp flap check
2025-07-23 17:23:01,534 - INFO -
2025-07-23 17:23:01,534 - INFO - END TEST : test_verify_session_record_table_inter_vn : FAILED[0:00:50]
2025-07-23 17:23:01,534 - INFO - --------------------------------------------------------------------------------
2025-07-23 17:23:01,537 - INFO - ================================================================================
2025-07-23 17:23:01,537 - INFO - STARTING TEST : test_verify_session_sampling_teardown
2025-07-23 17:23:01,537 - INFO - TEST DESCRIPTION :
1.query client session samples
2.query server session samples
3.query client session to get number of sessions exported
4.query session record table for teardown bytes/pkts
5.query sample count after teardown on server side
2025-07-23 17:23:02,853 - DEBUG - Skipping xmpp flap check
2025-07-23 17:23:02,853 - INFO - Initial checks done. Running the testcase now
2025-07-23 17:23:02,853 - INFO -
2025-07-23 17:23:03,075 - INFO - Setting flow export rate: 100
2025-07-23 17:23:03,123 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None]
2025-07-23 17:23:03,477 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'd614c6a2-d54a-4367-89cc-899118c069a8', 'name': 'ctest-vn1-69207859', 'tenant_id': '514661696f5b4fa39c1d7ff0c7b6c581', 'project_id': '514661696f5b4fa39c1d7ff0c7b6c581', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['a67dce26-a556-4c72-8292-611febabfa78'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'ctest-vn1-69207859'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '50.249.119.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2025-07-23 17:23:03,680 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '1144255e-fc91-43a1-acd3-6fa298dc3908', 'name': 'ctest-vn2-14059966', 'tenant_id': '514661696f5b4fa39c1d7ff0c7b6c581', 'project_id': '514661696f5b4fa39c1d7ff0c7b6c581', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['aa74b662-e6dd-453f-8ed4-0bf6b123659c'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'ctest-vn2-14059966'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '207.0.65.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2025-07-23 17:23:03,771 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:23:03,795 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:23:03,810 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:23:03,922 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:23:03,938 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:23:03,949 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:23:03,960 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:23:03,970 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c362d9c1-76a2-4085-8596-c4ae33d6abca
2025-07-23 17:23:03,978 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:23:03,978 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:23:03,989 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:23:04,006 - INFO - Verified VN network id 12 for VN d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:23:04,006 - INFO - Verifications in API Server for VN ctest-vn1-69207859 passed
2025-07-23 17:23:04,006 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:23:04,020 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:23:04,029 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:23:04,039 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c362d9c1-76a2-4085-8596-c4ae33d6abca
2025-07-23 17:23:04,052 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15426173026316206951', 'uuid-lslong': '9929462534723627432'}, 'enable': 'true', 'created': '2025-07-23T17:20:53', 'last-modified': '2025-07-23T17:23:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.624808'}
2025-07-23 17:23:04,058 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:23:04,065 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15426173026316206951', 'uuid-lslong': '9929462534723627432'}, 'enable': 'true', 'created': '2025-07-23T17:20:53', 'last-modified': '2025-07-23T17:23:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.634690'}
2025-07-23 17:23:04,072 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:23:04,078 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15426173026316206951', 'uuid-lslong': '9929462534723627432'}, 'enable': 'true', 'created': '2025-07-23T17:20:53', 'last-modified': '2025-07-23T17:23:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.648301'}
2025-07-23 17:23:04,085 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:23:04,085 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-69207859 passed
2025-07-23 17:23:04,085 - DEBUG - ====Verifying policy data for ctest-vn1-69207859 in API_Server ======
2025-07-23 17:23:04,085 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:23:04,091 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:23:04,104 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:23:04,196 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:23:04,208 - DEBUG - ==>Verifying data for policy with id: 809063cb-c85e-43f6-b624-4aec75c5ad30, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'policy1']
2025-07-23 17:23:04,208 - INFO - VN ctest-vn1-69207859 Policy verification: verify_vn_policy_in_api_server, status: True
2025-07-23 17:23:04,208 - DEBUG - Verifying the vn in opserver
2025-07-23 17:23:04,208 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 virtual network link through opserver 10.0.0.23
2025-07-23 17:23:04,208 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-23 17:23:04,221 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859?flat'}
2025-07-23 17:23:04,221 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 virtual network link through opserver 10.0.0.249
2025-07-23 17:23:04,221 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-07-23 17:23:04,235 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859?flat'}
2025-07-23 17:23:04,235 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 virtual network link through opserver 10.0.0.73
2025-07-23 17:23:04,236 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks
2025-07-23 17:23:04,251 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859?flat'}
2025-07-23 17:23:04,251 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 is found in opserver
2025-07-23 17:23:04,272 - DEBUG - VRF ids for VN ctest-vn1-69207859: {'10.0.0.130': '2'}
2025-07-23 17:23:04,272 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:23:04,279 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:23:04,293 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:23:04,392 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:23:04,407 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:23:04,418 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:23:04,426 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:23:04,437 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c0f1fd7a-e321-407e-8a1a-7f31f2ff27a3
2025-07-23 17:23:04,445 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:23:04,445 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:23:04,456 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:23:04,474 - INFO - Verified VN network id 13 for VN 1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:23:04,474 - INFO - Verifications in API Server for VN ctest-vn2-14059966 passed
2025-07-23 17:23:04,474 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:23:04,485 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:23:04,493 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:23:04,502 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c0f1fd7a-e321-407e-8a1a-7f31f2ff27a3
2025-07-23 17:23:04,515 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1244160486955631521', 'uuid-lslong': '12453420138749507848'}, 'enable': 'true', 'created': '2025-07-23T17:21:34', 'last-modified': '2025-07-23T17:23:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.873256'}
2025-07-23 17:23:04,522 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:23:04,528 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1244160486955631521', 'uuid-lslong': '12453420138749507848'}, 'enable': 'true', 'created': '2025-07-23T17:21:34', 'last-modified': '2025-07-23T17:23:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.883947'}
2025-07-23 17:23:04,536 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:23:04,542 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1244160486955631521', 'uuid-lslong': '12453420138749507848'}, 'enable': 'true', 'created': '2025-07-23T17:21:34', 'last-modified': '2025-07-23T17:23:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.899360'}
2025-07-23 17:23:04,548 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:23:04,548 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-14059966 passed
2025-07-23 17:23:04,548 - DEBUG - ====Verifying policy data for ctest-vn2-14059966 in API_Server ======
2025-07-23 17:23:04,548 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:23:04,555 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:23:04,567 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:23:04,661 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:23:04,672 - DEBUG - ==>Verifying data for policy with id: 809063cb-c85e-43f6-b624-4aec75c5ad30, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'policy1']
2025-07-23 17:23:04,672 - INFO - VN ctest-vn2-14059966 Policy verification: verify_vn_policy_in_api_server, status: True
2025-07-23 17:23:04,673 - DEBUG - Verifying the vn in opserver
2025-07-23 17:23:04,673 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 virtual network link through opserver 10.0.0.23
2025-07-23 17:23:04,673 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-23 17:23:04,686 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966?flat'}
2025-07-23 17:23:04,686 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 virtual network link through opserver 10.0.0.249
2025-07-23 17:23:04,686 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-07-23 17:23:04,700 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966?flat'}
2025-07-23 17:23:04,700 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 virtual network link through opserver 10.0.0.73
2025-07-23 17:23:04,701 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks
2025-07-23 17:23:04,716 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966?flat'}
2025-07-23 17:23:04,716 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 is found in opserver
2025-07-23 17:23:04,735 - DEBUG - VRF ids for VN ctest-vn2-14059966: {'10.0.0.50': '2', '10.0.0.130': '3'}
2025-07-23 17:23:04,736 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:23:04,744 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:23:04,756 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:23:04,851 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:23:04,862 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:23:04,873 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:23:04,883 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:23:04,892 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c362d9c1-76a2-4085-8596-c4ae33d6abca
2025-07-23 17:23:04,901 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:23:04,901 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:23:04,914 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:23:04,933 - INFO - Verified VN network id 12 for VN d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:23:04,933 - INFO - Verifications in API Server for VN ctest-vn1-69207859 passed
2025-07-23 17:23:04,933 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:23:04,945 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:23:04,954 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:23:04,963 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c362d9c1-76a2-4085-8596-c4ae33d6abca
2025-07-23 17:23:04,980 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15426173026316206951', 'uuid-lslong': '9929462534723627432'}, 'enable': 'true', 'created': '2025-07-23T17:20:53', 'last-modified': '2025-07-23T17:23:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.551103'}
2025-07-23 17:23:04,986 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:23:04,993 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15426173026316206951', 'uuid-lslong': '9929462534723627432'}, 'enable': 'true', 'created': '2025-07-23T17:20:53', 'last-modified': '2025-07-23T17:23:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.562045'}
2025-07-23 17:23:05,003 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:23:05,009 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15426173026316206951', 'uuid-lslong': '9929462534723627432'}, 'enable': 'true', 'created': '2025-07-23T17:20:53', 'last-modified': '2025-07-23T17:23:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.579308'}
2025-07-23 17:23:05,016 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:23:05,016 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-69207859 passed
2025-07-23 17:23:05,016 - DEBUG - ====Verifying policy data for ctest-vn1-69207859 in API_Server ======
2025-07-23 17:23:05,016 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:23:05,024 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:23:05,041 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:23:05,141 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:23:05,154 - DEBUG - ==>Verifying data for policy with id: 809063cb-c85e-43f6-b624-4aec75c5ad30, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'policy1']
2025-07-23 17:23:05,155 - INFO - VN ctest-vn1-69207859 Policy verification: verify_vn_policy_in_api_server, status: True
2025-07-23 17:23:05,155 - DEBUG - Verifying the vn in opserver
2025-07-23 17:23:05,155 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 virtual network link through opserver 10.0.0.23
2025-07-23 17:23:05,155 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-23 17:23:05,168 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859?flat'}
2025-07-23 17:23:05,168 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 virtual network link through opserver 10.0.0.249
2025-07-23 17:23:05,168 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-07-23 17:23:05,183 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859?flat'}
2025-07-23 17:23:05,184 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 virtual network link through opserver 10.0.0.73
2025-07-23 17:23:05,184 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks
2025-07-23 17:23:05,199 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859?flat'}
2025-07-23 17:23:05,199 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 is found in opserver
2025-07-23 17:23:05,219 - DEBUG - VRF ids for VN ctest-vn1-69207859: {'10.0.0.130': '2'}
2025-07-23 17:23:05,220 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:23:05,226 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:23:05,239 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:23:05,337 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:23:05,352 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:23:05,364 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:23:05,374 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:23:05,383 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c0f1fd7a-e321-407e-8a1a-7f31f2ff27a3
2025-07-23 17:23:05,392 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:23:05,392 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:23:05,405 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:23:05,423 - INFO - Verified VN network id 13 for VN 1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:23:05,423 - INFO - Verifications in API Server for VN ctest-vn2-14059966 passed
2025-07-23 17:23:05,424 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:23:05,434 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:23:05,443 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:23:05,452 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c0f1fd7a-e321-407e-8a1a-7f31f2ff27a3
2025-07-23 17:23:05,464 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1244160486955631521', 'uuid-lslong': '12453420138749507848'}, 'enable': 'true', 'created': '2025-07-23T17:21:34', 'last-modified': '2025-07-23T17:23:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.822305'}
2025-07-23 17:23:05,472 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:23:05,479 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1244160486955631521', 'uuid-lslong': '12453420138749507848'}, 'enable': 'true', 'created': '2025-07-23T17:21:34', 'last-modified': '2025-07-23T17:23:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.833956'}
2025-07-23 17:23:05,486 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:23:05,494 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1244160486955631521', 'uuid-lslong': '12453420138749507848'}, 'enable': 'true', 'created': '2025-07-23T17:21:34', 'last-modified': '2025-07-23T17:23:03', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.850991'}
2025-07-23 17:23:05,503 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:23:05,503 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-14059966 passed
2025-07-23 17:23:05,503 - DEBUG - ====Verifying policy data for ctest-vn2-14059966 in API_Server ======
2025-07-23 17:23:05,503 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:23:05,511 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:23:05,524 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:23:05,619 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:23:05,633 - DEBUG - ==>Verifying data for policy with id: 809063cb-c85e-43f6-b624-4aec75c5ad30, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'policy1']
2025-07-23 17:23:05,633 - INFO - VN ctest-vn2-14059966 Policy verification: verify_vn_policy_in_api_server, status: True
2025-07-23 17:23:05,633 - DEBUG - Verifying the vn in opserver
2025-07-23 17:23:05,633 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 virtual network link through opserver 10.0.0.23
2025-07-23 17:23:05,634 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-23 17:23:05,648 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966?flat'}
2025-07-23 17:23:05,648 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 virtual network link through opserver 10.0.0.249
2025-07-23 17:23:05,648 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-07-23 17:23:05,664 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966?flat'}
2025-07-23 17:23:05,664 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 virtual network link through opserver 10.0.0.73
2025-07-23 17:23:05,664 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks
2025-07-23 17:23:05,679 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966?flat'}
2025-07-23 17:23:05,679 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 is found in opserver
2025-07-23 17:23:05,700 - DEBUG - VRF ids for VN ctest-vn2-14059966: {'10.0.0.50': '2', '10.0.0.130': '3'}
2025-07-23 17:23:05,700 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:23:05,708 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:23:05,725 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:23:05,825 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/caceb590-56a3-4192-8a0e-168f70d06940
2025-07-23 17:23:05,837 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/caceb590-56a3-4192-8a0e-168f70d06940
2025-07-23 17:23:05,849 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dcfb532a-a05c-45a4-903d-a3d88496010d
2025-07-23 17:23:05,862 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dcfb532a-a05c-45a4-903d-a3d88496010d
2025-07-23 17:23:05,871 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6b6b89ba-4f16-4af5-b1fc-dae241270822
2025-07-23 17:23:05,881 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-23 17:23:05,881 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/caceb590-56a3-4192-8a0e-168f70d06940
2025-07-23 17:23:05,895 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dcfb532a-a05c-45a4-903d-a3d88496010d
2025-07-23 17:23:05,912 - INFO - Verified VN network id 14 for VN caceb590-56a3-4192-8a0e-168f70d06940
2025-07-23 17:23:05,913 - INFO - Verifications in API Server for VN ctest-fip_vn-27357845 passed
2025-07-23 17:23:05,913 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/caceb590-56a3-4192-8a0e-168f70d06940
2025-07-23 17:23:05,925 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dcfb532a-a05c-45a4-903d-a3d88496010d
2025-07-23 17:23:05,934 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dcfb532a-a05c-45a4-903d-a3d88496010d
2025-07-23 17:23:05,946 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6b6b89ba-4f16-4af5-b1fc-dae241270822
2025-07-23 17:23:05,964 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14613817472397296018', 'uuid-lslong': '9947913432236845376'}, 'enable': 'true', 'created': '2025-07-23T17:21:35', 'last-modified': '2025-07-23T17:21:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:01:30.543203'}
2025-07-23 17:23:05,972 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-23 17:23:05,980 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14613817472397296018', 'uuid-lslong': '9947913432236845376'}, 'enable': 'true', 'created': '2025-07-23T17:21:35', 'last-modified': '2025-07-23T17:21:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:01:30.559457'}
2025-07-23 17:23:05,987 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-23 17:23:05,993 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14613817472397296018', 'uuid-lslong': '9947913432236845376'}, 'enable': 'true', 'created': '2025-07-23T17:21:35', 'last-modified': '2025-07-23T17:21:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:01:30.573415'}
2025-07-23 17:23:06,000 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-23 17:23:06,000 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-27357845 passed
2025-07-23 17:23:06,001 - DEBUG - ====Verifying policy data for ctest-fip_vn-27357845 in API_Server ======
2025-07-23 17:23:06,001 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:23:06,008 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:23:06,020 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:23:06,114 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/caceb590-56a3-4192-8a0e-168f70d06940
2025-07-23 17:23:06,129 - DEBUG - =>VN ctest-fip_vn-27357845 has no policy to be verified
2025-07-23 17:23:06,129 - DEBUG - Verifying the vn in opserver
2025-07-23 17:23:06,129 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845 virtual network link through opserver 10.0.0.23
2025-07-23 17:23:06,129 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-23 17:23:06,148 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845?flat'}
2025-07-23 17:23:06,148 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845 virtual network link through opserver 10.0.0.249
2025-07-23 17:23:06,148 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-07-23 17:23:06,168 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845?flat'}
2025-07-23 17:23:06,168 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845 virtual network link through opserver 10.0.0.73
2025-07-23 17:23:06,168 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks
2025-07-23 17:23:06,182 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845?flat'}
2025-07-23 17:23:06,182 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845 is found in opserver
2025-07-23 17:23:06,206 - DEBUG - VRF ids for VN ctest-fip_vn-27357845: {'10.0.0.50': '3'}
2025-07-23 17:23:06,206 - INFO - start time= 1753291386206944
2025-07-23 17:23:06,207 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 207.0.65.67, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-07-23 17:23:06,207 - DEBUG - ping -s 56 -c 3 -W 1 207.0.65.67
2025-07-23 17:23:08,505 - DEBUG - PING 207.0.65.67 (207.0.65.67): 56 data bytes
64 bytes from 207.0.65.67: seq=0 ttl=63 time=6.541 ms
64 bytes from 207.0.65.67: seq=1 ttl=63 time=2.049 ms
64 bytes from 207.0.65.67: seq=2 ttl=63 time=2.043 ms
--- 207.0.65.67 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 2.043/3.544/6.541 ms
2025-07-23 17:23:08,505 - INFO - Ping to IP 207.0.65.67 from VM ctest-vn1_vm1-67376429 passed
2025-07-23 17:23:18,506 - INFO - Verify session samples and teardown pkts
2025-07-23 17:23:18,506 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.23
2025-07-23 17:23:18,510 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1753291386206944, 'end_time': 1753291398510538, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2025-07-23 17:23:19,531 - DEBUG - [{'T': 1753291387016466}, {'T': 1753291388016570}, {'T': 1753291389016668}]
2025-07-23 17:23:19,532 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1753291386206944, 'end_time': 1753291399532083, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'}
2025-07-23 17:23:20,554 - DEBUG - [{'T': 1753291387034752}, {'T': 1753291388035059}, {'T': 1753291389035625}]
2025-07-23 17:23:20,554 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1753291386206944, 'end_time': 1753291400554482, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2025-07-23 17:23:21,576 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'sample_count': 3}]
2025-07-23 17:23:21,576 - INFO - wait for the flows to get expire
2025-07-23 17:26:41,577 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3704-2:Compute:contrail-vrouter-agent:0?flat
2025-07-23 17:26:41,673 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3704-2?flat
2025-07-23 17:26:41,758 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionRecordTable', 'start_time': 1753291386206944, 'end_time': 1753291601758243, 'select_fields': ['vn', 'remote_vn', 'forward_teardown_pkts', 'reverse_teardown_pkts'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2025-07-23 17:26:42,828 - DEBUG - [{'forward_flow_uuid': '118777d5-f6c4-4d83-b426-0b2642c1c84b', 'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'reverse_flow_uuid': 'c0fde2dc-db9f-45e1-85d8-f660a42384af', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'forward_teardown_pkts': 3, 'reverse_teardown_pkts': 3}]
2025-07-23 17:26:42,828 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1753291386206944, 'end_time': 1753291602828868, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2025-07-23 17:26:43,912 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1753291386206944, 'end_time': 1753291603912219, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'}
2025-07-23 17:26:44,947 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'sample_count': 4}]
2025-07-23 17:26:45,459 - INFO - Deleted policy policy1
2025-07-23 17:26:45,615 - INFO - Setting flow export rate: None
2025-07-23 17:26:46,973 - DEBUG - Skipping xmpp flap check
2025-07-23 17:26:46,973 - INFO - END TEST : test_verify_session_sampling_teardown : PASSED[0:03:45]
2025-07-23 17:26:46,973 - INFO - --------------------------------------------------------------------------------
2025-07-23 17:26:46,976 - INFO - ================================================================================
2025-07-23 17:26:46,976 - INFO - STARTING TEST : test_verify_session_series_table_inter_vn
2025-07-23 17:26:46,976 - INFO - TEST DESCRIPTION : Verify session series table ,generated stats between different vns
1.query client session samples
2.query for server ports
3.sort results by server_port column
4.verify granularity with T=10
5.verify sampled bytes
6.verify logged bytes
7.query and verify filter by action
2025-07-23 17:26:48,293 - DEBUG - Skipping xmpp flap check
2025-07-23 17:26:48,293 - INFO - Initial checks done. Running the testcase now
2025-07-23 17:26:48,293 - INFO -
2025-07-23 17:26:48,515 - INFO - Setting flow export rate: 100
2025-07-23 17:26:48,563 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None]
2025-07-23 17:26:48,923 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'd614c6a2-d54a-4367-89cc-899118c069a8', 'name': 'ctest-vn1-69207859', 'tenant_id': '514661696f5b4fa39c1d7ff0c7b6c581', 'project_id': '514661696f5b4fa39c1d7ff0c7b6c581', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['a67dce26-a556-4c72-8292-611febabfa78'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'ctest-vn1-69207859'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '50.249.119.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2025-07-23 17:26:49,130 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '1144255e-fc91-43a1-acd3-6fa298dc3908', 'name': 'ctest-vn2-14059966', 'tenant_id': '514661696f5b4fa39c1d7ff0c7b6c581', 'project_id': '514661696f5b4fa39c1d7ff0c7b6c581', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['aa74b662-e6dd-453f-8ed4-0bf6b123659c'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'ctest-vn2-14059966'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '207.0.65.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2025-07-23 17:26:49,237 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:26:49,274 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:26:49,320 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:26:49,409 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:26:49,436 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:26:49,451 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:26:49,467 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:26:49,478 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c362d9c1-76a2-4085-8596-c4ae33d6abca
2025-07-23 17:26:49,485 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:26:49,485 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:26:49,496 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:26:49,514 - INFO - Verified VN network id 12 for VN d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:26:49,514 - INFO - Verifications in API Server for VN ctest-vn1-69207859 passed
2025-07-23 17:26:49,514 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:26:49,528 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:26:49,537 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:26:49,546 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c362d9c1-76a2-4085-8596-c4ae33d6abca
2025-07-23 17:26:49,560 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15426173026316206951', 'uuid-lslong': '9929462534723627432'}, 'enable': 'true', 'created': '2025-07-23T17:20:53', 'last-modified': '2025-07-23T17:26:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.682568'}
2025-07-23 17:26:49,568 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:26:49,576 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15426173026316206951', 'uuid-lslong': '9929462534723627432'}, 'enable': 'true', 'created': '2025-07-23T17:20:53', 'last-modified': '2025-07-23T17:26:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.692867'}
2025-07-23 17:26:49,585 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:26:49,591 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15426173026316206951', 'uuid-lslong': '9929462534723627432'}, 'enable': 'true', 'created': '2025-07-23T17:20:53', 'last-modified': '2025-07-23T17:26:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.698971'}
2025-07-23 17:26:49,600 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:26:49,600 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-69207859 passed
2025-07-23 17:26:49,600 - DEBUG - ====Verifying policy data for ctest-vn1-69207859 in API_Server ======
2025-07-23 17:26:49,601 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:26:49,608 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:26:49,621 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:26:49,716 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:26:49,727 - DEBUG - ==>Verifying data for policy with id: f2ebd51d-0d6e-4d63-aba2-45ab0fb28198, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'policy1']
2025-07-23 17:26:49,727 - INFO - VN ctest-vn1-69207859 Policy verification: verify_vn_policy_in_api_server, status: True
2025-07-23 17:26:49,727 - DEBUG - Verifying the vn in opserver
2025-07-23 17:26:49,727 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 virtual network link through opserver 10.0.0.23
2025-07-23 17:26:49,727 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-23 17:26:49,741 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859?flat'}
2025-07-23 17:26:49,741 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 virtual network link through opserver 10.0.0.249
2025-07-23 17:26:49,741 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-07-23 17:26:49,795 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859?flat'}
2025-07-23 17:26:49,795 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 virtual network link through opserver 10.0.0.73
2025-07-23 17:26:49,795 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks
2025-07-23 17:26:49,848 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859?flat'}
2025-07-23 17:26:49,848 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 is found in opserver
2025-07-23 17:26:49,871 - DEBUG - VRF ids for VN ctest-vn1-69207859: {'10.0.0.130': '2'}
2025-07-23 17:26:49,871 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:26:49,877 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:26:49,893 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:26:49,982 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:26:50,003 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:26:50,016 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:26:50,026 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:26:50,035 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c0f1fd7a-e321-407e-8a1a-7f31f2ff27a3
2025-07-23 17:26:50,042 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:26:50,043 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:26:50,053 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:26:50,075 - INFO - Verified VN network id 13 for VN 1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:26:50,075 - INFO - Verifications in API Server for VN ctest-vn2-14059966 passed
2025-07-23 17:26:50,076 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:26:50,092 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:26:50,100 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:26:50,108 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c0f1fd7a-e321-407e-8a1a-7f31f2ff27a3
2025-07-23 17:26:50,121 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1244160486955631521', 'uuid-lslong': '12453420138749507848'}, 'enable': 'true', 'created': '2025-07-23T17:21:34', 'last-modified': '2025-07-23T17:26:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.027719'}
2025-07-23 17:26:50,127 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:26:50,134 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1244160486955631521', 'uuid-lslong': '12453420138749507848'}, 'enable': 'true', 'created': '2025-07-23T17:21:34', 'last-modified': '2025-07-23T17:26:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.033899'}
2025-07-23 17:26:50,141 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:26:50,148 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1244160486955631521', 'uuid-lslong': '12453420138749507848'}, 'enable': 'true', 'created': '2025-07-23T17:21:34', 'last-modified': '2025-07-23T17:26:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.046912'}
2025-07-23 17:26:50,156 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:26:50,156 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-14059966 passed
2025-07-23 17:26:50,157 - DEBUG - ====Verifying policy data for ctest-vn2-14059966 in API_Server ======
2025-07-23 17:26:50,157 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:26:50,164 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:26:50,177 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:26:50,286 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:26:50,298 - DEBUG - ==>Verifying data for policy with id: f2ebd51d-0d6e-4d63-aba2-45ab0fb28198, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'policy1']
2025-07-23 17:26:50,298 - INFO - VN ctest-vn2-14059966 Policy verification: verify_vn_policy_in_api_server, status: True
2025-07-23 17:26:50,298 - DEBUG - Verifying the vn in opserver
2025-07-23 17:26:50,298 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 virtual network link through opserver 10.0.0.23
2025-07-23 17:26:50,298 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-23 17:26:50,313 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966?flat'}
2025-07-23 17:26:50,313 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 virtual network link through opserver 10.0.0.249
2025-07-23 17:26:50,313 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-07-23 17:26:50,368 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966?flat'}
2025-07-23 17:26:50,368 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 virtual network link through opserver 10.0.0.73
2025-07-23 17:26:50,368 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks
2025-07-23 17:26:50,382 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966?flat'}
2025-07-23 17:26:50,382 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 is found in opserver
2025-07-23 17:26:50,398 - DEBUG - VRF ids for VN ctest-vn2-14059966: {'10.0.0.50': '2', '10.0.0.130': '3'}
2025-07-23 17:26:50,398 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:26:50,404 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:26:50,416 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:26:50,515 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:26:50,527 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:26:50,539 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:26:50,549 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:26:50,561 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c362d9c1-76a2-4085-8596-c4ae33d6abca
2025-07-23 17:26:50,570 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:26:50,570 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:26:50,584 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:26:50,605 - INFO - Verified VN network id 12 for VN d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:26:50,605 - INFO - Verifications in API Server for VN ctest-vn1-69207859 passed
2025-07-23 17:26:50,605 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:26:50,619 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:26:50,629 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:26:50,639 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c362d9c1-76a2-4085-8596-c4ae33d6abca
2025-07-23 17:26:50,654 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15426173026316206951', 'uuid-lslong': '9929462534723627432'}, 'enable': 'true', 'created': '2025-07-23T17:20:53', 'last-modified': '2025-07-23T17:26:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.776185'}
2025-07-23 17:26:50,661 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:26:50,668 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15426173026316206951', 'uuid-lslong': '9929462534723627432'}, 'enable': 'true', 'created': '2025-07-23T17:20:53', 'last-modified': '2025-07-23T17:26:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.785018'}
2025-07-23 17:26:50,676 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:26:50,683 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15426173026316206951', 'uuid-lslong': '9929462534723627432'}, 'enable': 'true', 'created': '2025-07-23T17:20:53', 'last-modified': '2025-07-23T17:26:48', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.790175'}
2025-07-23 17:26:50,690 - DEBUG - Route Targets: ['target:64512:8000005']
2025-07-23 17:26:50,690 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-69207859 passed
2025-07-23 17:26:50,690 - DEBUG - ====Verifying policy data for ctest-vn1-69207859 in API_Server ======
2025-07-23 17:26:50,690 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:26:50,697 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:26:50,713 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:26:50,807 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/d614c6a2-d54a-4367-89cc-899118c069a8
2025-07-23 17:26:50,825 - DEBUG - ==>Verifying data for policy with id: f2ebd51d-0d6e-4d63-aba2-45ab0fb28198, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'policy1']
2025-07-23 17:26:50,825 - INFO - VN ctest-vn1-69207859 Policy verification: verify_vn_policy_in_api_server, status: True
2025-07-23 17:26:50,825 - DEBUG - Verifying the vn in opserver
2025-07-23 17:26:50,825 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 virtual network link through opserver 10.0.0.23
2025-07-23 17:26:50,825 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-23 17:26:50,844 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859?flat'}
2025-07-23 17:26:50,844 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 virtual network link through opserver 10.0.0.249
2025-07-23 17:26:50,844 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-07-23 17:26:50,902 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859?flat'}
2025-07-23 17:26:50,902 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 virtual network link through opserver 10.0.0.73
2025-07-23 17:26:50,902 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks
2025-07-23 17:26:50,967 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859?flat'}
2025-07-23 17:26:50,967 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859 is found in opserver
2025-07-23 17:26:50,986 - DEBUG - VRF ids for VN ctest-vn1-69207859: {'10.0.0.130': '2'}
2025-07-23 17:26:50,986 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:26:50,993 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:26:51,007 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:26:51,104 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:26:51,118 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:26:51,129 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:26:51,138 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:26:51,145 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c0f1fd7a-e321-407e-8a1a-7f31f2ff27a3
2025-07-23 17:26:51,153 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:26:51,153 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:26:51,163 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:26:51,180 - INFO - Verified VN network id 13 for VN 1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:26:51,181 - INFO - Verifications in API Server for VN ctest-vn2-14059966 passed
2025-07-23 17:26:51,181 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:26:51,192 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:26:51,200 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:26:51,208 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/c0f1fd7a-e321-407e-8a1a-7f31f2ff27a3
2025-07-23 17:26:51,219 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1244160486955631521', 'uuid-lslong': '12453420138749507848'}, 'enable': 'true', 'created': '2025-07-23T17:21:34', 'last-modified': '2025-07-23T17:26:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.126956'}
2025-07-23 17:26:51,227 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:26:51,234 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1244160486955631521', 'uuid-lslong': '12453420138749507848'}, 'enable': 'true', 'created': '2025-07-23T17:21:34', 'last-modified': '2025-07-23T17:26:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.133524'}
2025-07-23 17:26:51,244 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:26:51,252 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1244160486955631521', 'uuid-lslong': '12453420138749507848'}, 'enable': 'true', 'created': '2025-07-23T17:21:34', 'last-modified': '2025-07-23T17:26:49', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:02.150987'}
2025-07-23 17:26:51,264 - DEBUG - Route Targets: ['target:64512:8000006']
2025-07-23 17:26:51,264 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-14059966 passed
2025-07-23 17:26:51,264 - DEBUG - ====Verifying policy data for ctest-vn2-14059966 in API_Server ======
2025-07-23 17:26:51,264 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:26:51,272 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:26:51,284 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:26:51,383 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/1144255e-fc91-43a1-acd3-6fa298dc3908
2025-07-23 17:26:51,395 - DEBUG - ==>Verifying data for policy with id: f2ebd51d-0d6e-4d63-aba2-45ab0fb28198, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-66692629', 'policy1']
2025-07-23 17:26:51,395 - INFO - VN ctest-vn2-14059966 Policy verification: verify_vn_policy_in_api_server, status: True
2025-07-23 17:26:51,395 - DEBUG - Verifying the vn in opserver
2025-07-23 17:26:51,395 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 virtual network link through opserver 10.0.0.23
2025-07-23 17:26:51,395 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-23 17:26:51,409 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966?flat'}
2025-07-23 17:26:51,409 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 virtual network link through opserver 10.0.0.249
2025-07-23 17:26:51,409 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-07-23 17:26:51,424 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966?flat'}
2025-07-23 17:26:51,424 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 virtual network link through opserver 10.0.0.73
2025-07-23 17:26:51,424 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks
2025-07-23 17:26:51,439 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966?flat'}
2025-07-23 17:26:51,439 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966 is found in opserver
2025-07-23 17:26:51,460 - DEBUG - VRF ids for VN ctest-vn2-14059966: {'10.0.0.50': '2', '10.0.0.130': '3'}
2025-07-23 17:26:51,460 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:26:51,466 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:26:51,479 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:26:51,578 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/caceb590-56a3-4192-8a0e-168f70d06940
2025-07-23 17:26:51,590 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/caceb590-56a3-4192-8a0e-168f70d06940
2025-07-23 17:26:51,600 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dcfb532a-a05c-45a4-903d-a3d88496010d
2025-07-23 17:26:51,611 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dcfb532a-a05c-45a4-903d-a3d88496010d
2025-07-23 17:26:51,620 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6b6b89ba-4f16-4af5-b1fc-dae241270822
2025-07-23 17:26:51,627 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-23 17:26:51,627 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/caceb590-56a3-4192-8a0e-168f70d06940
2025-07-23 17:26:51,638 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dcfb532a-a05c-45a4-903d-a3d88496010d
2025-07-23 17:26:51,656 - INFO - Verified VN network id 14 for VN caceb590-56a3-4192-8a0e-168f70d06940
2025-07-23 17:26:51,656 - INFO - Verifications in API Server for VN ctest-fip_vn-27357845 passed
2025-07-23 17:26:51,656 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/caceb590-56a3-4192-8a0e-168f70d06940
2025-07-23 17:26:51,667 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dcfb532a-a05c-45a4-903d-a3d88496010d
2025-07-23 17:26:51,675 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dcfb532a-a05c-45a4-903d-a3d88496010d
2025-07-23 17:26:51,683 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6b6b89ba-4f16-4af5-b1fc-dae241270822
2025-07-23 17:26:51,697 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14613817472397296018', 'uuid-lslong': '9947913432236845376'}, 'enable': 'true', 'created': '2025-07-23T17:21:35', 'last-modified': '2025-07-23T17:21:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:05:16.275498'}
2025-07-23 17:26:51,703 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-23 17:26:51,710 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14613817472397296018', 'uuid-lslong': '9947913432236845376'}, 'enable': 'true', 'created': '2025-07-23T17:21:35', 'last-modified': '2025-07-23T17:21:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:05:16.290146'}
2025-07-23 17:26:51,717 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-23 17:26:51,724 - DEBUG - Control-node 10.0.0.73 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-66692629', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14613817472397296018', 'uuid-lslong': '9947913432236845376'}, 'enable': 'true', 'created': '2025-07-23T17:21:35', 'last-modified': '2025-07-23T17:21:35', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:05:16.304000'}
2025-07-23 17:26:51,730 - DEBUG - Route Targets: ['target:64512:8000007']
2025-07-23 17:26:51,731 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-27357845 passed
2025-07-23 17:26:51,731 - DEBUG - ====Verifying policy data for ctest-fip_vn-27357845 in API_Server ======
2025-07-23 17:26:51,731 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:26:51,738 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:26:51,752 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:26:51,857 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/caceb590-56a3-4192-8a0e-168f70d06940
2025-07-23 17:26:51,867 - DEBUG - =>VN ctest-fip_vn-27357845 has no policy to be verified
2025-07-23 17:26:51,867 - DEBUG - Verifying the vn in opserver
2025-07-23 17:26:51,867 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845 virtual network link through opserver 10.0.0.23
2025-07-23 17:26:51,867 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-07-23 17:26:51,881 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845?flat'}
2025-07-23 17:26:51,881 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845 virtual network link through opserver 10.0.0.249
2025-07-23 17:26:51,881 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks
2025-07-23 17:26:51,897 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845?flat'}
2025-07-23 17:26:51,897 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845 virtual network link through opserver 10.0.0.73
2025-07-23 17:26:51,898 - DEBUG - Requesting: http://10.0.0.73:8081/analytics/uves/virtual-networks
2025-07-23 17:26:51,912 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845', 'href': 'http://10.0.0.73:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845?flat'}
2025-07-23 17:26:51,912 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845 is found in opserver
2025-07-23 17:26:51,932 - DEBUG - VRF ids for VN ctest-fip_vn-27357845: {'10.0.0.50': '3'}
2025-07-23 17:26:51,932 - INFO - start time= 1753291611932881
2025-07-23 17:26:51,933 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-23 17:26:51,933 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-23 17:26:51,933 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoserver.py already copied to 207.0.65.67
2025-07-23 17:26:51,933 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoserver.py --start_port 9000 --end_port 9000 --pid_file /tmp/server-ctest-random-37109708.pid --stats_file /tmp/server-ctest-random-37109708.stats 0<&- &> /tmp/server-ctest-random-37109708.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-07-23 17:26:51,933 - DEBUG - nohup python /tmp/udpechoserver.py --start_port 9000 --end_port 9000 --pid_file /tmp/server-ctest-random-37109708.pid --stats_file /tmp/server-ctest-random-37109708.stats 0<&- &> /tmp/server-ctest-random-37109708.log &
2025-07-23 17:26:52,200 - DEBUG - None
2025-07-23 17:26:52,200 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-23 17:26:52,200 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoclient.py already copied to 50.249.119.67
2025-07-23 17:26:52,200 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoclient.py --servers 207.0.65.67 --sport 8000 --dports 9000 --retry --count 100 --pid_file /tmp/client-ctest-random-37109708.pid --stats_file /tmp/client-ctest-random-37109708.stats 0<&- &> /tmp/client-ctest-random-37109708.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-07-23 17:26:52,200 - DEBUG - nohup python /tmp/udpechoclient.py --servers 207.0.65.67 --sport 8000 --dports 9000 --retry --count 100 --pid_file /tmp/client-ctest-random-37109708.pid --stats_file /tmp/client-ctest-random-37109708.stats 0<&- &> /tmp/client-ctest-random-37109708.log &
2025-07-23 17:26:52,416 - DEBUG - None
2025-07-23 17:26:52,416 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-23 17:26:52,417 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-23 17:26:52,417 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoserver.py already copied to 207.0.65.67
2025-07-23 17:26:52,417 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoserver.py --start_port 9001 --end_port 9001 --pid_file /tmp/server-ctest-random-14335380.pid --stats_file /tmp/server-ctest-random-14335380.stats 0<&- &> /tmp/server-ctest-random-14335380.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-07-23 17:26:52,417 - DEBUG - nohup python /tmp/udpechoserver.py --start_port 9001 --end_port 9001 --pid_file /tmp/server-ctest-random-14335380.pid --stats_file /tmp/server-ctest-random-14335380.stats 0<&- &> /tmp/server-ctest-random-14335380.log &
2025-07-23 17:26:52,679 - DEBUG - None
2025-07-23 17:26:52,679 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-23 17:26:52,679 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoclient.py already copied to 50.249.119.67
2025-07-23 17:26:52,679 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoclient.py --servers 207.0.65.67 --sport 8000 --dports 9001 --retry --count 100 --pid_file /tmp/client-ctest-random-14335380.pid --stats_file /tmp/client-ctest-random-14335380.stats 0<&- &> /tmp/client-ctest-random-14335380.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-07-23 17:26:52,679 - DEBUG - nohup python /tmp/udpechoclient.py --servers 207.0.65.67 --sport 8000 --dports 9001 --retry --count 100 --pid_file /tmp/client-ctest-random-14335380.pid --stats_file /tmp/client-ctest-random-14335380.stats 0<&- &> /tmp/client-ctest-random-14335380.log &
2025-07-23 17:26:52,894 - DEBUG - None
2025-07-23 17:26:52,894 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-23 17:26:52,894 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-23 17:26:52,894 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoserver.py already copied to 207.0.65.67
2025-07-23 17:26:52,894 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoserver.py --start_port 9003 --end_port 9003 --pid_file /tmp/server-ctest-random-08703386.pid --stats_file /tmp/server-ctest-random-08703386.stats 0<&- &> /tmp/server-ctest-random-08703386.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-07-23 17:26:52,894 - DEBUG - nohup python /tmp/udpechoserver.py --start_port 9003 --end_port 9003 --pid_file /tmp/server-ctest-random-08703386.pid --stats_file /tmp/server-ctest-random-08703386.stats 0<&- &> /tmp/server-ctest-random-08703386.log &
2025-07-23 17:26:53,133 - DEBUG - None
2025-07-23 17:26:53,134 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-07-23 17:26:53,134 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoclient.py already copied to 50.249.119.67
2025-07-23 17:26:53,134 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoclient.py --servers 207.0.65.67 --sport 8000 --dports 9003 --retry --count 100 --pid_file /tmp/client-ctest-random-08703386.pid --stats_file /tmp/client-ctest-random-08703386.stats 0<&- &> /tmp/client-ctest-random-08703386.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-07-23 17:26:53,134 - DEBUG - nohup python /tmp/udpechoclient.py --servers 207.0.65.67 --sport 8000 --dports 9003 --retry --count 100 --pid_file /tmp/client-ctest-random-08703386.pid --stats_file /tmp/client-ctest-random-08703386.stats 0<&- &> /tmp/client-ctest-random-08703386.log &
2025-07-23 17:26:53,340 - DEBUG - None
2025-07-23 17:27:03,340 - DEBUG - Running remote_cmd, Cmd : kill $(cat /tmp/client-ctest-random-37109708.pid); sync; cat /tmp/client-ctest-random-37109708.stats, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.130, gateway password: c0ntrail123
2025-07-23 17:27:03,341 - DEBUG - kill $(cat /tmp/client-ctest-random-37109708.pid); sync; cat /tmp/client-ctest-random-37109708.stats
2025-07-23 17:27:03,655 - DEBUG - cat: can't open '/tmp/client-ctest-random-37109708.pid': No such file or directory
sh: you need to specify whom to kill
cat: can't open '/tmp/client-ctest-random-37109708.stats': No such file or directory
2025-07-23 17:27:03,655 - DEBUG - Running remote_cmd, Cmd : kill $(cat /tmp/server-ctest-random-37109708.pid); sync; cat /tmp/server-ctest-random-37109708.stats, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-07-23 17:27:03,655 - DEBUG - kill $(cat /tmp/server-ctest-random-37109708.pid); sync; cat /tmp/server-ctest-random-37109708.stats
2025-07-23 17:27:04,006 - DEBUG - cat: can't open '/tmp/server-ctest-random-37109708.pid': No such file or directory
sh: you need to specify whom to kill
cat: can't open '/tmp/server-ctest-random-37109708.stats': No such file or directory
2025-07-23 17:27:04,006 - INFO - Client - Sent: 0, Received: 0
2025-07-23 17:27:04,006 - INFO - Server - Sent: 0, Received: 0
2025-07-23 17:27:04,514 - INFO - Deleted policy policy1
2025-07-23 17:27:04,688 - INFO - Setting flow export rate: None
2025-07-23 17:27:06,029 - ERROR - AssertionError
Python 3.6.8: /usr/bin/python3
Wed Jul 23 17:27:04 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/serial_scripts/analytics/test_analytics_resource.py in test_verify_session_series_table_inter_vn(self=)
1336 start_time = self.analytics_obj.getstarttime(vm_node_ip)
1337 self.logger.info("start time= %s" % (start_time))
1338 self.setup_and_create_streams(self.res.vn1_vm1_fixture, self.res.vn2_vm2_fixture)
1339 src_vn = self.res.vn1_fixture.vn_fq_name
1340 dst_vn = self.res.vn2_fixture.vn_fq_name
self =
self.setup_and_create_streams = >
self.res =
self.res.vn1_vm1_fixture =
self.res.vn2_vm2_fixture =
/contrail-test/serial_scripts/analytics/base.py in setup_and_create_streams(self=, src_vm=, dst_vm=, sport=8000, dport=9003, count=100)
168 time.sleep(10)
169 for traffic_obj in traffic_objs:
170 self.stop_traffic(traffic_obj)
171
172 #end setup_create_streams
self =
self.stop_traffic = >
traffic_obj =
/contrail-test/common/base.py in stop_traffic(self=, traffic_obj=, expectation=True, unidirection=False, partial=False)
796 assert False, "No drops observed in packets %s"%msg
797 elif expectation:
798 assert sent and recv, "Packets not %s"%msg
799 if recv*100/float(sent) < 90:
800 assert False, "Packets not %s"%msg
sent = 0
recv = 0
msg = 'transferred between 50.249.119.67 and 207.0.65.67, proto udp sport 8000 and dport 9000'
AssertionError: Packets not transferred between 50.249.119.67 and 207.0.65.67, proto udp sport 8000 and dport 9000
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ('Packets not transferred between 50.249.119.67 and 207.0.65.67, proto udp sport 8000 and dport 9000',)
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1338, in test_verify_session_series_table_inter_vn
self.setup_and_create_streams(self.res.vn1_vm1_fixture, self.res.vn2_vm2_fixture)
File "/contrail-test/serial_scripts/analytics/base.py", line 170, in setup_and_create_streams
self.stop_traffic(traffic_obj)
File "/contrail-test/common/base.py", line 798, in stop_traffic
assert sent and recv, "Packets not %s"%msg
AssertionError: Packets not transferred between 50.249.119.67 and 207.0.65.67, proto udp sport 8000 and dport 9000
2025-07-23 17:27:06,029 - DEBUG - Skipping xmpp flap check
2025-07-23 17:27:06,030 - INFO -
2025-07-23 17:27:06,030 - INFO - END TEST : test_verify_session_series_table_inter_vn : FAILED[0:00:20]
2025-07-23 17:27:06,030 - INFO - --------------------------------------------------------------------------------
2025-07-23 17:27:06,032 - INFO - Deleting VM mltf_vm
2025-07-23 17:27:06,116 - INFO - Deleting VM ctest-fvn_vm1-39751392
2025-07-23 17:27:06,192 - INFO - Deleting VM ctest-vn2_vm2-90695044
2025-07-23 17:27:06,255 - INFO - Deleting VN ctest-fip_vn-27357845
2025-07-23 17:27:06,300 - DEBUG - VN caceb590-56a3-4192-8a0e-168f70d06940 still in use: Unable to complete operation on network caceb590-56a3-4192-8a0e-168f70d06940. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-a0d2ae31-4ba3-4cee-8bbd-3b691e0f3237']
2025-07-23 17:27:06,300 - WARNING - Deleting VN ctest-fip_vn-27357845 failed..Will retry
2025-07-23 17:27:08,475 - DEBUG - Response for deleting network ()
2025-07-23 17:27:08,476 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dcfb532a-a05c-45a4-903d-a3d88496010d
2025-07-23 17:27:08,482 - DEBUG - Response Code: 404
2025-07-23 17:27:08,482 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:27:08,491 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:27:08,513 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:27:08,606 - INFO - Validated that VN ctest-fip_vn-27357845 is not found in API Server
2025-07-23 17:27:08,631 - DEBUG - VN ctest-fip_vn-27357845 is not present in Agent 10.0.0.50
2025-07-23 17:27:08,646 - DEBUG - VN ctest-fip_vn-27357845 is not present in Agent 10.0.0.130
2025-07-23 17:27:08,646 - INFO - Validated that VN ctest-fip_vn-27357845 is not in any agent
2025-07-23 17:27:08,654 - DEBUG - VRF 3 is not seen in agent 10.0.0.50
2025-07-23 17:27:08,661 - DEBUG - Vrouter 10.0.0.50 does not have vrf 3 for VN ctest-fip_vn-27357845
2025-07-23 17:27:08,661 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-fip_vn-27357845
2025-07-23 17:27:08,689 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-27357845 info
2025-07-23 17:27:08,689 - INFO - Deleting VN ctest-vn2-14059966
2025-07-23 17:27:08,890 - DEBUG - Response for deleting network ()
2025-07-23 17:27:08,890 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/64e8a927-7412-407c-b0b9-ebeab9d2fccd
2025-07-23 17:27:08,898 - DEBUG - Response Code: 404
2025-07-23 17:27:08,898 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:27:08,906 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:27:08,921 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:27:09,045 - INFO - Validated that VN ctest-vn2-14059966 is not found in API Server
2025-07-23 17:27:09,069 - DEBUG - VN ctest-vn2-14059966 is not present in Agent 10.0.0.50
2025-07-23 17:27:09,081 - DEBUG - VN ctest-vn2-14059966 is not present in Agent 10.0.0.130
2025-07-23 17:27:09,081 - INFO - Validated that VN ctest-vn2-14059966 is not in any agent
2025-07-23 17:27:09,094 - DEBUG - VRF 2 is not seen in agent 10.0.0.50
2025-07-23 17:27:09,109 - DEBUG - Vrouter 10.0.0.50 does not have vrf 2 for VN ctest-vn2-14059966
2025-07-23 17:27:09,116 - DEBUG - VRF 3 is not seen in agent 10.0.0.130
2025-07-23 17:27:09,123 - DEBUG - Vrouter 10.0.0.130 does not have vrf 3 for VN ctest-vn2-14059966
2025-07-23 17:27:09,123 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn2-14059966
2025-07-23 17:27:09,146 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-14059966 info
2025-07-23 17:27:09,146 - INFO - Deleting VM ctest-vn1_vm2-79743215
2025-07-23 17:27:09,223 - INFO - Deleting VM ctest-vn1_vm1-67376429
2025-07-23 17:27:09,294 - INFO - Deleting VN ctest-vn1-69207859
2025-07-23 17:27:09,341 - DEBUG - VN d614c6a2-d54a-4367-89cc-899118c069a8 still in use: Unable to complete operation on network d614c6a2-d54a-4367-89cc-899118c069a8. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-e3f48f7a-3294-4803-bed0-73fb8efbdd3e']
2025-07-23 17:27:09,342 - WARNING - Deleting VN ctest-vn1-69207859 failed..Will retry
2025-07-23 17:27:11,497 - DEBUG - Response for deleting network ()
2025-07-23 17:27:11,497 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/53420d3e-f3be-4b27-946f-3d94299e9810
2025-07-23 17:27:11,504 - DEBUG - Response Code: 404
2025-07-23 17:27:11,504 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-07-23 17:27:11,511 - DEBUG - Requesting: http://10.0.0.23:8082/domain/85afe8be-97e7-4e27-9667-ee7272dde692
2025-07-23 17:27:11,532 - DEBUG - Requesting: http://10.0.0.23:8082/project/51466169-6f5b-4fa3-9c1d-7ff0c7b6c581
2025-07-23 17:27:11,638 - INFO - Validated that VN ctest-vn1-69207859 is not found in API Server
2025-07-23 17:27:11,665 - DEBUG - VN ctest-vn1-69207859 is not present in Agent 10.0.0.50
2025-07-23 17:27:11,676 - DEBUG - VN ctest-vn1-69207859 is not present in Agent 10.0.0.130
2025-07-23 17:27:11,676 - INFO - Validated that VN ctest-vn1-69207859 is not in any agent
2025-07-23 17:27:11,681 - DEBUG - VRF 2 is not seen in agent 10.0.0.130
2025-07-23 17:27:11,687 - DEBUG - Vrouter 10.0.0.130 does not have vrf 2 for VN ctest-vn1-69207859
2025-07-23 17:27:11,687 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-66692629:ctest-vn1-69207859
2025-07-23 17:27:11,709 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-69207859 info
2025-07-23 17:27:12,442 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-66692629, ID : 51466169-6f5b-4fa3-9c1d-7ff0c7b6c581