The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1375, in test_verify_session_record_table_inter_vn
self.setup_and_create_streams(self.res.vn1_vm1_fixture, self.res.vn2_vm2_fixture)
File "/contrail-test/serial_scripts/analytics/base.py", line 170, in setup_and_create_streams
self.stop_traffic(traffic_obj)
File "/contrail-test/common/base.py", line 798, in stop_traffic
assert sent and recv, "Packets not %s"%msg
AssertionError: Packets not transferred between 213.132.235.67 and 102.9.147.67, proto udp sport 8000 and dport 9000
2025-08-11 03:35:43,877 - DEBUG - Skipping xmpp flap check
2025-08-11 03:35:43,877 - INFO -
2025-08-11 03:35:43,877 - INFO - END TEST : test_verify_session_record_table_inter_vn : FAILED[0:00:48]
2025-08-11 03:35:43,877 - INFO - --------------------------------------------------------------------------------
2025-08-11 03:35:43,880 - INFO - ================================================================================
2025-08-11 03:35:43,880 - INFO - STARTING TEST : test_verify_session_sampling_teardown
2025-08-11 03:35:43,880 - INFO - TEST DESCRIPTION :
1.query client session samples
2.query server session samples
3.query client session to get number of sessions exported
4.query session record table for teardown bytes/pkts
5.query sample count after teardown on server side
2025-08-11 03:35:45,120 - DEBUG - Skipping xmpp flap check
2025-08-11 03:35:45,120 - INFO - Initial checks done. Running the testcase now
2025-08-11 03:35:45,120 - INFO -
2025-08-11 03:35:45,330 - INFO - Setting flow export rate: 100
2025-08-11 03:35:45,383 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None]
2025-08-11 03:35:45,696 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'b5c98a57-3f59-4d06-bca0-3101ca0999bf', 'name': 'ctest-vn1-61012477', 'tenant_id': 'ae6c737608474083a1e517bbbe92a09c', 'project_id': 'ae6c737608474083a1e517bbbe92a09c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['cd5cd9e4-cccc-4ed7-a62c-0d68c82510e9'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'ctest-vn1-61012477'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '213.132.235.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2025-08-11 03:35:45,874 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '55bf2525-4bd4-4919-b2c9-2f65290a7f7d', 'name': 'ctest-vn2-64555423', 'tenant_id': 'ae6c737608474083a1e517bbbe92a09c', 'project_id': 'ae6c737608474083a1e517bbbe92a09c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['90a02520-5d05-4e74-844b-9e36e7b4a4a8'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'ctest-vn2-64555423'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '102.9.147.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2025-08-11 03:35:45,981 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:35:45,988 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:35:46,001 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:35:46,078 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:35:46,093 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:35:46,103 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:35:46,112 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:35:46,119 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/1c0ce28f-27c6-4141-991f-ecc5d4a113b2
2025-08-11 03:35:46,128 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:35:46,128 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:35:46,138 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:35:46,153 - INFO - Verified VN network id 14 for VN b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:35:46,153 - INFO - Verifications in API Server for VN ctest-vn1-61012477 passed
2025-08-11 03:35:46,153 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:35:46,162 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:35:46,170 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:35:46,178 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/1c0ce28f-27c6-4141-991f-ecc5d4a113b2
2025-08-11 03:35:46,191 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13099153098513403142', 'uuid-lslong': '13591917559158512063'}, 'enable': 'true', 'created': '2025-08-11T03:33:34', 'last-modified': '2025-08-11T03:35:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.532387'}
2025-08-11 03:35:46,198 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:35:46,204 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13099153098513403142', 'uuid-lslong': '13591917559158512063'}, 'enable': 'true', 'created': '2025-08-11T03:33:34', 'last-modified': '2025-08-11T03:35:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.545504'}
2025-08-11 03:35:46,210 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:35:46,216 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13099153098513403142', 'uuid-lslong': '13591917559158512063'}, 'enable': 'true', 'created': '2025-08-11T03:33:34', 'last-modified': '2025-08-11T03:35:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.560359'}
2025-08-11 03:35:46,221 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:35:46,221 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-61012477 passed
2025-08-11 03:35:46,221 - DEBUG - ====Verifying policy data for ctest-vn1-61012477 in API_Server ======
2025-08-11 03:35:46,221 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:35:46,227 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:35:46,237 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:35:46,325 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:35:46,335 - DEBUG - ==>Verifying data for policy with id: 16b5a99d-3258-49e4-b28f-390321260f58, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'policy1']
2025-08-11 03:35:46,335 - INFO - VN ctest-vn1-61012477 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-11 03:35:46,335 - DEBUG - Verifying the vn in opserver
2025-08-11 03:35:46,335 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 virtual network link through opserver 10.0.0.23
2025-08-11 03:35:46,335 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-11 03:35:46,346 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477?flat'}
2025-08-11 03:35:46,346 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 virtual network link through opserver 10.0.0.38
2025-08-11 03:35:46,346 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-11 03:35:46,357 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477?flat'}
2025-08-11 03:35:46,357 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 virtual network link through opserver 10.0.0.141
2025-08-11 03:35:46,357 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2025-08-11 03:35:46,368 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477?flat'}
2025-08-11 03:35:46,368 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 is found in opserver
2025-08-11 03:35:46,379 - DEBUG - VRF ids for VN ctest-vn1-61012477: {'10.0.0.65': '2'}
2025-08-11 03:35:46,379 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:35:46,384 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:35:46,408 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:35:46,508 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:35:46,522 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:35:46,533 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:35:46,541 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:35:46,550 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6fcdb019-74d7-41a2-ac0e-adb56db488ac
2025-08-11 03:35:46,556 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:35:46,556 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:35:46,567 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:35:46,582 - INFO - Verified VN network id 15 for VN 55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:35:46,582 - INFO - Verifications in API Server for VN ctest-vn2-64555423 passed
2025-08-11 03:35:46,582 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:35:46,593 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:35:46,602 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:35:46,609 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6fcdb019-74d7-41a2-ac0e-adb56db488ac
2025-08-11 03:35:46,620 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6178698055891831065', 'uuid-lslong': '12882880320596770685'}, 'enable': 'true', 'created': '2025-08-11T03:34:17', 'last-modified': '2025-08-11T03:35:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.776751'}
2025-08-11 03:35:46,626 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:35:46,633 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6178698055891831065', 'uuid-lslong': '12882880320596770685'}, 'enable': 'true', 'created': '2025-08-11T03:34:17', 'last-modified': '2025-08-11T03:35:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.791805'}
2025-08-11 03:35:46,639 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:35:46,645 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6178698055891831065', 'uuid-lslong': '12882880320596770685'}, 'enable': 'true', 'created': '2025-08-11T03:34:17', 'last-modified': '2025-08-11T03:35:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.800762'}
2025-08-11 03:35:46,651 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:35:46,651 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-64555423 passed
2025-08-11 03:35:46,651 - DEBUG - ====Verifying policy data for ctest-vn2-64555423 in API_Server ======
2025-08-11 03:35:46,652 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:35:46,656 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:35:46,667 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:35:46,760 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:35:46,770 - DEBUG - ==>Verifying data for policy with id: 16b5a99d-3258-49e4-b28f-390321260f58, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'policy1']
2025-08-11 03:35:46,771 - INFO - VN ctest-vn2-64555423 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-11 03:35:46,771 - DEBUG - Verifying the vn in opserver
2025-08-11 03:35:46,771 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 virtual network link through opserver 10.0.0.23
2025-08-11 03:35:46,771 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-11 03:35:46,781 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423?flat'}
2025-08-11 03:35:46,781 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 virtual network link through opserver 10.0.0.38
2025-08-11 03:35:46,781 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-11 03:35:46,793 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423?flat'}
2025-08-11 03:35:46,793 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 virtual network link through opserver 10.0.0.141
2025-08-11 03:35:46,793 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2025-08-11 03:35:46,804 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423?flat'}
2025-08-11 03:35:46,804 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 is found in opserver
2025-08-11 03:35:46,815 - DEBUG - VRF ids for VN ctest-vn2-64555423: {'10.0.0.57': '2', '10.0.0.65': '3'}
2025-08-11 03:35:46,816 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:35:46,822 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:35:46,836 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:35:46,922 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:35:46,935 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:35:46,945 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:35:46,952 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:35:46,960 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/1c0ce28f-27c6-4141-991f-ecc5d4a113b2
2025-08-11 03:35:46,966 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:35:46,966 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:35:46,976 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:35:46,992 - INFO - Verified VN network id 14 for VN b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:35:46,992 - INFO - Verifications in API Server for VN ctest-vn1-61012477 passed
2025-08-11 03:35:46,992 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:35:47,002 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:35:47,009 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:35:47,017 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/1c0ce28f-27c6-4141-991f-ecc5d4a113b2
2025-08-11 03:35:47,028 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13099153098513403142', 'uuid-lslong': '13591917559158512063'}, 'enable': 'true', 'created': '2025-08-11T03:33:34', 'last-modified': '2025-08-11T03:35:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.372056'}
2025-08-11 03:35:47,036 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:35:47,041 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13099153098513403142', 'uuid-lslong': '13591917559158512063'}, 'enable': 'true', 'created': '2025-08-11T03:33:34', 'last-modified': '2025-08-11T03:35:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.382712'}
2025-08-11 03:35:47,048 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:35:47,053 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13099153098513403142', 'uuid-lslong': '13591917559158512063'}, 'enable': 'true', 'created': '2025-08-11T03:33:34', 'last-modified': '2025-08-11T03:35:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.397648'}
2025-08-11 03:35:47,059 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:35:47,059 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-61012477 passed
2025-08-11 03:35:47,059 - DEBUG - ====Verifying policy data for ctest-vn1-61012477 in API_Server ======
2025-08-11 03:35:47,059 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:35:47,064 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:35:47,075 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:35:47,164 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:35:47,175 - DEBUG - ==>Verifying data for policy with id: 16b5a99d-3258-49e4-b28f-390321260f58, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'policy1']
2025-08-11 03:35:47,175 - INFO - VN ctest-vn1-61012477 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-11 03:35:47,175 - DEBUG - Verifying the vn in opserver
2025-08-11 03:35:47,175 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 virtual network link through opserver 10.0.0.23
2025-08-11 03:35:47,175 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-11 03:35:47,186 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477?flat'}
2025-08-11 03:35:47,186 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 virtual network link through opserver 10.0.0.38
2025-08-11 03:35:47,186 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-11 03:35:47,202 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477?flat'}
2025-08-11 03:35:47,202 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 virtual network link through opserver 10.0.0.141
2025-08-11 03:35:47,202 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2025-08-11 03:35:47,215 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477?flat'}
2025-08-11 03:35:47,215 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 is found in opserver
2025-08-11 03:35:47,225 - DEBUG - VRF ids for VN ctest-vn1-61012477: {'10.0.0.65': '2'}
2025-08-11 03:35:47,225 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:35:47,230 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:35:47,242 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:35:47,335 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:35:47,345 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:35:47,354 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:35:47,361 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:35:47,368 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6fcdb019-74d7-41a2-ac0e-adb56db488ac
2025-08-11 03:35:47,374 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:35:47,374 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:35:47,383 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:35:47,397 - INFO - Verified VN network id 15 for VN 55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:35:47,398 - INFO - Verifications in API Server for VN ctest-vn2-64555423 passed
2025-08-11 03:35:47,398 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:35:47,407 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:35:47,414 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:35:47,421 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6fcdb019-74d7-41a2-ac0e-adb56db488ac
2025-08-11 03:35:47,432 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6178698055891831065', 'uuid-lslong': '12882880320596770685'}, 'enable': 'true', 'created': '2025-08-11T03:34:17', 'last-modified': '2025-08-11T03:35:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.589294'}
2025-08-11 03:35:47,439 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:35:47,444 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6178698055891831065', 'uuid-lslong': '12882880320596770685'}, 'enable': 'true', 'created': '2025-08-11T03:34:17', 'last-modified': '2025-08-11T03:35:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.603587'}
2025-08-11 03:35:47,451 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:35:47,457 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6178698055891831065', 'uuid-lslong': '12882880320596770685'}, 'enable': 'true', 'created': '2025-08-11T03:34:17', 'last-modified': '2025-08-11T03:35:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.612719'}
2025-08-11 03:35:47,464 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:35:47,464 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-64555423 passed
2025-08-11 03:35:47,464 - DEBUG - ====Verifying policy data for ctest-vn2-64555423 in API_Server ======
2025-08-11 03:35:47,464 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:35:47,469 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:35:47,479 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:35:47,564 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:35:47,575 - DEBUG - ==>Verifying data for policy with id: 16b5a99d-3258-49e4-b28f-390321260f58, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'policy1']
2025-08-11 03:35:47,575 - INFO - VN ctest-vn2-64555423 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-11 03:35:47,575 - DEBUG - Verifying the vn in opserver
2025-08-11 03:35:47,575 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 virtual network link through opserver 10.0.0.23
2025-08-11 03:35:47,575 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-11 03:35:47,586 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423?flat'}
2025-08-11 03:35:47,586 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 virtual network link through opserver 10.0.0.38
2025-08-11 03:35:47,586 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-11 03:35:47,597 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423?flat'}
2025-08-11 03:35:47,597 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 virtual network link through opserver 10.0.0.141
2025-08-11 03:35:47,597 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2025-08-11 03:35:47,608 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423?flat'}
2025-08-11 03:35:47,608 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 is found in opserver
2025-08-11 03:35:47,619 - DEBUG - VRF ids for VN ctest-vn2-64555423: {'10.0.0.57': '2', '10.0.0.65': '3'}
2025-08-11 03:35:47,619 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:35:47,624 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:35:47,635 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:35:47,721 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/325dc905-cc07-4d7e-b3e9-f077ef09c670
2025-08-11 03:35:47,732 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/325dc905-cc07-4d7e-b3e9-f077ef09c670
2025-08-11 03:35:47,749 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8af9240e-00eb-49b5-bede-67021405dfb6
2025-08-11 03:35:47,758 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8af9240e-00eb-49b5-bede-67021405dfb6
2025-08-11 03:35:47,767 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/4c910204-376a-4af5-86b4-e6eb6d624883
2025-08-11 03:35:47,774 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-11 03:35:47,774 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/325dc905-cc07-4d7e-b3e9-f077ef09c670
2025-08-11 03:35:47,782 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8af9240e-00eb-49b5-bede-67021405dfb6
2025-08-11 03:35:47,797 - INFO - Verified VN network id 16 for VN 325dc905-cc07-4d7e-b3e9-f077ef09c670
2025-08-11 03:35:47,797 - INFO - Verifications in API Server for VN ctest-fip_vn-12892766 passed
2025-08-11 03:35:47,797 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/325dc905-cc07-4d7e-b3e9-f077ef09c670
2025-08-11 03:35:47,807 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8af9240e-00eb-49b5-bede-67021405dfb6
2025-08-11 03:35:47,813 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8af9240e-00eb-49b5-bede-67021405dfb6
2025-08-11 03:35:47,821 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/4c910204-376a-4af5-86b4-e6eb6d624883
2025-08-11 03:35:47,838 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3629277901465537918', 'uuid-lslong': '12964157400264853104'}, 'enable': 'true', 'created': '2025-08-11T03:34:18', 'last-modified': '2025-08-11T03:34:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:01:29.152795'}
2025-08-11 03:35:47,844 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-11 03:35:47,850 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3629277901465537918', 'uuid-lslong': '12964157400264853104'}, 'enable': 'true', 'created': '2025-08-11T03:34:18', 'last-modified': '2025-08-11T03:34:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:01:29.160440'}
2025-08-11 03:35:47,856 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-11 03:35:47,862 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3629277901465537918', 'uuid-lslong': '12964157400264853104'}, 'enable': 'true', 'created': '2025-08-11T03:34:18', 'last-modified': '2025-08-11T03:34:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:01:29.175382'}
2025-08-11 03:35:47,868 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-11 03:35:47,868 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-12892766 passed
2025-08-11 03:35:47,869 - DEBUG - ====Verifying policy data for ctest-fip_vn-12892766 in API_Server ======
2025-08-11 03:35:47,869 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:35:47,874 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:35:47,885 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:35:47,968 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/325dc905-cc07-4d7e-b3e9-f077ef09c670
2025-08-11 03:35:47,979 - DEBUG - =>VN ctest-fip_vn-12892766 has no policy to be verified
2025-08-11 03:35:47,979 - DEBUG - Verifying the vn in opserver
2025-08-11 03:35:47,979 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766 virtual network link through opserver 10.0.0.23
2025-08-11 03:35:47,979 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-11 03:35:47,989 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766?flat'}
2025-08-11 03:35:47,989 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766 virtual network link through opserver 10.0.0.38
2025-08-11 03:35:47,990 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-11 03:35:48,001 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766?flat'}
2025-08-11 03:35:48,001 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766 virtual network link through opserver 10.0.0.141
2025-08-11 03:35:48,001 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2025-08-11 03:35:48,013 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766?flat'}
2025-08-11 03:35:48,013 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766 is found in opserver
2025-08-11 03:35:48,024 - DEBUG - VRF ids for VN ctest-fip_vn-12892766: {'10.0.0.57': '3'}
2025-08-11 03:35:48,024 - INFO - start time= 1754883348024361
2025-08-11 03:35:48,024 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 102.9.147.67, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-08-11 03:35:48,024 - DEBUG - ping -s 56 -c 3 -W 1 102.9.147.67
2025-08-11 03:35:50,255 - DEBUG - PING 102.9.147.67 (102.9.147.67): 56 data bytes
64 bytes from 102.9.147.67: seq=0 ttl=63 time=3.424 ms
64 bytes from 102.9.147.67: seq=1 ttl=63 time=1.281 ms
64 bytes from 102.9.147.67: seq=2 ttl=63 time=0.952 ms
--- 102.9.147.67 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.952/1.885/3.424 ms
2025-08-11 03:35:50,255 - INFO - Ping to IP 102.9.147.67 from VM ctest-vn1_vm1-12224247 passed
2025-08-11 03:36:00,256 - INFO - Verify session samples and teardown pkts
2025-08-11 03:36:00,256 - INFO - Verifying SessionSeriesTable through opserver 10.0.0.23
2025-08-11 03:36:00,260 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1754883348024361, 'end_time': 1754883360260753, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2025-08-11 03:36:01,279 - DEBUG - [{'T': 1754883348321827}, {'T': 1754883349321860}, {'T': 1754883350321914}]
2025-08-11 03:36:01,279 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1754883348024361, 'end_time': 1754883361279488, 'select_fields': ['T'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'}
2025-08-11 03:36:02,298 - DEBUG - [{'T': 1754883348997080}, {'T': 1754883349997138}, {'T': 1754883350997204}]
2025-08-11 03:36:02,298 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1754883348024361, 'end_time': 1754883362298291, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2025-08-11 03:36:03,317 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'sample_count': 3}]
2025-08-11 03:36:03,318 - INFO - wait for the flows to get expire
2025-08-11 03:39:23,319 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-3794-2:Compute:contrail-vrouter-agent:0?flat
2025-08-11 03:39:23,406 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3794-2?flat
2025-08-11 03:39:23,446 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionRecordTable', 'start_time': 1754883348024361, 'end_time': 1754883563446494, 'select_fields': ['vn', 'remote_vn', 'forward_teardown_pkts', 'reverse_teardown_pkts'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2025-08-11 03:39:24,504 - DEBUG - [{'forward_flow_uuid': '64e388b0-22e0-492c-9875-bad33a712ef0', 'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'reverse_flow_uuid': 'd09673cd-c3a0-49c2-b8b9-95cf20feaaf0', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'forward_teardown_pkts': 3, 'reverse_teardown_pkts': 3}]
2025-08-11 03:39:24,504 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1754883348024361, 'end_time': 1754883564504884, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'client'}
2025-08-11 03:39:25,525 - DEBUG - Posting: http://10.0.0.23:8081/analytics/query, payload {'table': 'SessionSeriesTable', 'start_time': 1754883348024361, 'end_time': 1754883565525503, 'select_fields': ['vn', 'remote_vn', 'sample_count'], 'where': [[{'name': 'vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'op': 1, 'value2': None}, {'name': 'remote_vn', 'value': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'op': 1, 'value2': None}, {'name': 'protocol', 'value': '1', 'op': 1, 'value2': None}]], 'session_type': 'server'}
2025-08-11 03:39:26,591 - DEBUG - [{'remote_vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'vn': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'sample_count': 4}]
2025-08-11 03:39:27,059 - INFO - Deleted policy policy1
2025-08-11 03:39:27,211 - INFO - Setting flow export rate: None
2025-08-11 03:39:28,476 - DEBUG - Skipping xmpp flap check
2025-08-11 03:39:28,476 - INFO - END TEST : test_verify_session_sampling_teardown : PASSED[0:03:45]
2025-08-11 03:39:28,476 - INFO - --------------------------------------------------------------------------------
2025-08-11 03:39:28,479 - INFO - ================================================================================
2025-08-11 03:39:28,479 - INFO - STARTING TEST : test_verify_session_series_table_inter_vn
2025-08-11 03:39:28,479 - INFO - TEST DESCRIPTION : Verify session series table ,generated stats between different vns
1.query client session samples
2.query for server ports
3.sort results by server_port column
4.verify granularity with T=10
5.verify sampled bytes
6.verify logged bytes
7.query and verify filter by action
2025-08-11 03:39:29,724 - DEBUG - Skipping xmpp flap check
2025-08-11 03:39:29,725 - INFO - Initial checks done. Running the testcase now
2025-08-11 03:39:29,725 - INFO -
2025-08-11 03:39:29,939 - INFO - Setting flow export rate: 100
2025-08-11 03:39:29,987 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = udp, src_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = -1, end_port = -1], application = [], dst_addresses = [subnet = None, virtual_network = any, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = -1, end_port = -1], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None]
2025-08-11 03:39:30,300 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': 'b5c98a57-3f59-4d06-bca0-3101ca0999bf', 'name': 'ctest-vn1-61012477', 'tenant_id': 'ae6c737608474083a1e517bbbe92a09c', 'project_id': 'ae6c737608474083a1e517bbbe92a09c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['cd5cd9e4-cccc-4ed7-a62c-0d68c82510e9'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'ctest-vn1-61012477'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '213.132.235.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2025-08-11 03:39:30,511 - DEBUG - Response for mapping policy(s) with vn {'network': {'id': '55bf2525-4bd4-4919-b2c9-2f65290a7f7d', 'name': 'ctest-vn2-64555423', 'tenant_id': 'ae6c737608474083a1e517bbbe92a09c', 'project_id': 'ae6c737608474083a1e517bbbe92a09c', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': ['90a02520-5d05-4e74-844b-9e36e7b4a4a8'], 'fq_name': ['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'ctest-vn2-64555423'], 'policys': [['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'policy1']], 'subnet_ipam': [{'subnet_cidr': '102.9.147.64/26', 'ipam_fq_name': ['default-domain', 'default-project', 'default-network-ipam']}], 'port_security_enabled': True, 'description': ''}}
2025-08-11 03:39:30,626 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:39:30,659 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:39:30,698 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:39:30,796 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:39:30,809 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:39:30,819 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:39:30,829 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:39:30,836 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/1c0ce28f-27c6-4141-991f-ecc5d4a113b2
2025-08-11 03:39:30,843 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:39:30,843 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:39:30,852 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:39:30,867 - INFO - Verified VN network id 14 for VN b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:39:30,867 - INFO - Verifications in API Server for VN ctest-vn1-61012477 passed
2025-08-11 03:39:30,867 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:39:30,878 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:39:30,888 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:39:30,897 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/1c0ce28f-27c6-4141-991f-ecc5d4a113b2
2025-08-11 03:39:30,910 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13099153098513403142', 'uuid-lslong': '13591917559158512063'}, 'enable': 'true', 'created': '2025-08-11T03:33:34', 'last-modified': '2025-08-11T03:39:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.638328'}
2025-08-11 03:39:30,917 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:39:30,924 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13099153098513403142', 'uuid-lslong': '13591917559158512063'}, 'enable': 'true', 'created': '2025-08-11T03:33:34', 'last-modified': '2025-08-11T03:39:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.649662'}
2025-08-11 03:39:30,930 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:39:30,937 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13099153098513403142', 'uuid-lslong': '13591917559158512063'}, 'enable': 'true', 'created': '2025-08-11T03:33:34', 'last-modified': '2025-08-11T03:39:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.665559'}
2025-08-11 03:39:30,943 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:39:30,943 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-61012477 passed
2025-08-11 03:39:30,943 - DEBUG - ====Verifying policy data for ctest-vn1-61012477 in API_Server ======
2025-08-11 03:39:30,943 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:39:30,949 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:39:30,961 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:39:31,053 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:39:31,063 - DEBUG - ==>Verifying data for policy with id: 9b5b4143-fec3-472a-9832-9c66e37ac588, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'policy1']
2025-08-11 03:39:31,063 - INFO - VN ctest-vn1-61012477 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-11 03:39:31,063 - DEBUG - Verifying the vn in opserver
2025-08-11 03:39:31,063 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 virtual network link through opserver 10.0.0.23
2025-08-11 03:39:31,064 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-11 03:39:31,075 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477?flat'}
2025-08-11 03:39:31,075 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 virtual network link through opserver 10.0.0.38
2025-08-11 03:39:31,075 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-11 03:39:31,125 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477?flat'}
2025-08-11 03:39:31,125 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 virtual network link through opserver 10.0.0.141
2025-08-11 03:39:31,125 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2025-08-11 03:39:31,173 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477?flat'}
2025-08-11 03:39:31,173 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 is found in opserver
2025-08-11 03:39:31,184 - DEBUG - VRF ids for VN ctest-vn1-61012477: {'10.0.0.65': '2'}
2025-08-11 03:39:31,184 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:39:31,190 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:39:31,201 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:39:31,291 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:39:31,307 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:39:31,317 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:39:31,325 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:39:31,333 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6fcdb019-74d7-41a2-ac0e-adb56db488ac
2025-08-11 03:39:31,340 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:39:31,340 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:39:31,350 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:39:31,365 - INFO - Verified VN network id 15 for VN 55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:39:31,365 - INFO - Verifications in API Server for VN ctest-vn2-64555423 passed
2025-08-11 03:39:31,365 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:39:31,375 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:39:31,383 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:39:31,392 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6fcdb019-74d7-41a2-ac0e-adb56db488ac
2025-08-11 03:39:31,406 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6178698055891831065', 'uuid-lslong': '12882880320596770685'}, 'enable': 'true', 'created': '2025-08-11T03:34:17', 'last-modified': '2025-08-11T03:39:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.932812'}
2025-08-11 03:39:31,413 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:39:31,420 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6178698055891831065', 'uuid-lslong': '12882880320596770685'}, 'enable': 'true', 'created': '2025-08-11T03:34:17', 'last-modified': '2025-08-11T03:39:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.956346'}
2025-08-11 03:39:31,427 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:39:31,433 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6178698055891831065', 'uuid-lslong': '12882880320596770685'}, 'enable': 'true', 'created': '2025-08-11T03:34:17', 'last-modified': '2025-08-11T03:39:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.973118'}
2025-08-11 03:39:31,439 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:39:31,439 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-64555423 passed
2025-08-11 03:39:31,439 - DEBUG - ====Verifying policy data for ctest-vn2-64555423 in API_Server ======
2025-08-11 03:39:31,439 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:39:31,445 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:39:31,457 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:39:31,547 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:39:31,557 - DEBUG - ==>Verifying data for policy with id: 9b5b4143-fec3-472a-9832-9c66e37ac588, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'policy1']
2025-08-11 03:39:31,557 - INFO - VN ctest-vn2-64555423 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-11 03:39:31,557 - DEBUG - Verifying the vn in opserver
2025-08-11 03:39:31,558 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 virtual network link through opserver 10.0.0.23
2025-08-11 03:39:31,558 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-11 03:39:31,569 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423?flat'}
2025-08-11 03:39:31,569 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 virtual network link through opserver 10.0.0.38
2025-08-11 03:39:31,569 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-11 03:39:31,615 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423?flat'}
2025-08-11 03:39:31,615 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 virtual network link through opserver 10.0.0.141
2025-08-11 03:39:31,616 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2025-08-11 03:39:31,663 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423?flat'}
2025-08-11 03:39:31,663 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 is found in opserver
2025-08-11 03:39:31,675 - DEBUG - VRF ids for VN ctest-vn2-64555423: {'10.0.0.57': '2', '10.0.0.65': '3'}
2025-08-11 03:39:31,675 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:39:31,681 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:39:31,692 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:39:31,799 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:39:31,812 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:39:31,824 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:39:31,834 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:39:31,842 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/1c0ce28f-27c6-4141-991f-ecc5d4a113b2
2025-08-11 03:39:31,848 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:39:31,848 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:39:31,857 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:39:31,872 - INFO - Verified VN network id 14 for VN b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:39:31,872 - INFO - Verifications in API Server for VN ctest-vn1-61012477 passed
2025-08-11 03:39:31,872 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:39:31,883 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:39:31,891 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:39:31,900 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/1c0ce28f-27c6-4141-991f-ecc5d4a113b2
2025-08-11 03:39:31,914 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13099153098513403142', 'uuid-lslong': '13591917559158512063'}, 'enable': 'true', 'created': '2025-08-11T03:33:34', 'last-modified': '2025-08-11T03:39:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.640996'}
2025-08-11 03:39:31,920 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:39:31,926 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13099153098513403142', 'uuid-lslong': '13591917559158512063'}, 'enable': 'true', 'created': '2025-08-11T03:33:34', 'last-modified': '2025-08-11T03:39:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.652037'}
2025-08-11 03:39:31,932 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:39:31,938 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13099153098513403142', 'uuid-lslong': '13591917559158512063'}, 'enable': 'true', 'created': '2025-08-11T03:33:34', 'last-modified': '2025-08-11T03:39:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.666809'}
2025-08-11 03:39:31,944 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 03:39:31,944 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn1-61012477 passed
2025-08-11 03:39:31,944 - DEBUG - ====Verifying policy data for ctest-vn1-61012477 in API_Server ======
2025-08-11 03:39:31,944 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:39:31,949 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:39:31,960 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:39:32,051 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/b5c98a57-3f59-4d06-bca0-3101ca0999bf
2025-08-11 03:39:32,061 - DEBUG - ==>Verifying data for policy with id: 9b5b4143-fec3-472a-9832-9c66e37ac588, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'policy1']
2025-08-11 03:39:32,061 - INFO - VN ctest-vn1-61012477 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-11 03:39:32,061 - DEBUG - Verifying the vn in opserver
2025-08-11 03:39:32,061 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 virtual network link through opserver 10.0.0.23
2025-08-11 03:39:32,061 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-11 03:39:32,073 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477?flat'}
2025-08-11 03:39:32,073 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 virtual network link through opserver 10.0.0.38
2025-08-11 03:39:32,073 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-11 03:39:32,118 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477?flat'}
2025-08-11 03:39:32,119 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 virtual network link through opserver 10.0.0.141
2025-08-11 03:39:32,119 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2025-08-11 03:39:32,166 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477?flat'}
2025-08-11 03:39:32,166 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477 is found in opserver
2025-08-11 03:39:32,177 - DEBUG - VRF ids for VN ctest-vn1-61012477: {'10.0.0.65': '2'}
2025-08-11 03:39:32,177 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:39:32,184 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:39:32,195 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:39:32,284 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:39:32,295 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:39:32,304 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:39:32,313 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:39:32,321 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6fcdb019-74d7-41a2-ac0e-adb56db488ac
2025-08-11 03:39:32,327 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:39:32,327 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:39:32,336 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:39:32,350 - INFO - Verified VN network id 15 for VN 55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:39:32,351 - INFO - Verifications in API Server for VN ctest-vn2-64555423 passed
2025-08-11 03:39:32,351 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:39:32,360 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:39:32,367 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:39:32,374 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/6fcdb019-74d7-41a2-ac0e-adb56db488ac
2025-08-11 03:39:32,386 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6178698055891831065', 'uuid-lslong': '12882880320596770685'}, 'enable': 'true', 'created': '2025-08-11T03:34:17', 'last-modified': '2025-08-11T03:39:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.912531'}
2025-08-11 03:39:32,393 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:39:32,398 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6178698055891831065', 'uuid-lslong': '12882880320596770685'}, 'enable': 'true', 'created': '2025-08-11T03:34:17', 'last-modified': '2025-08-11T03:39:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.934760'}
2025-08-11 03:39:32,405 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:39:32,410 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6178698055891831065', 'uuid-lslong': '12882880320596770685'}, 'enable': 'true', 'created': '2025-08-11T03:34:17', 'last-modified': '2025-08-11T03:39:30', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:01.950717'}
2025-08-11 03:39:32,416 - DEBUG - Route Targets: ['target:64512:8000006']
2025-08-11 03:39:32,417 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn2-64555423 passed
2025-08-11 03:39:32,417 - DEBUG - ====Verifying policy data for ctest-vn2-64555423 in API_Server ======
2025-08-11 03:39:32,417 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:39:32,422 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:39:32,433 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:39:32,518 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/55bf2525-4bd4-4919-b2c9-2f65290a7f7d
2025-08-11 03:39:32,535 - DEBUG - ==>Verifying data for policy with id: 9b5b4143-fec3-472a-9832-9c66e37ac588, fqn: ['default-domain', 'ctest-AnalyticsTestSanityWithResource-87051251', 'policy1']
2025-08-11 03:39:32,535 - INFO - VN ctest-vn2-64555423 Policy verification: verify_vn_policy_in_api_server, status: True
2025-08-11 03:39:32,535 - DEBUG - Verifying the vn in opserver
2025-08-11 03:39:32,535 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 virtual network link through opserver 10.0.0.23
2025-08-11 03:39:32,536 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-11 03:39:32,547 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423?flat'}
2025-08-11 03:39:32,547 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 virtual network link through opserver 10.0.0.38
2025-08-11 03:39:32,547 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-11 03:39:32,557 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423?flat'}
2025-08-11 03:39:32,557 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 virtual network link through opserver 10.0.0.141
2025-08-11 03:39:32,558 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2025-08-11 03:39:32,569 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423?flat'}
2025-08-11 03:39:32,569 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423 is found in opserver
2025-08-11 03:39:32,579 - DEBUG - VRF ids for VN ctest-vn2-64555423: {'10.0.0.57': '2', '10.0.0.65': '3'}
2025-08-11 03:39:32,579 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:39:32,585 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:39:32,595 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:39:32,685 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/325dc905-cc07-4d7e-b3e9-f077ef09c670
2025-08-11 03:39:32,696 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/325dc905-cc07-4d7e-b3e9-f077ef09c670
2025-08-11 03:39:32,706 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8af9240e-00eb-49b5-bede-67021405dfb6
2025-08-11 03:39:32,713 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8af9240e-00eb-49b5-bede-67021405dfb6
2025-08-11 03:39:32,720 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/4c910204-376a-4af5-86b4-e6eb6d624883
2025-08-11 03:39:32,728 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-11 03:39:32,728 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/325dc905-cc07-4d7e-b3e9-f077ef09c670
2025-08-11 03:39:32,737 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8af9240e-00eb-49b5-bede-67021405dfb6
2025-08-11 03:39:32,751 - INFO - Verified VN network id 16 for VN 325dc905-cc07-4d7e-b3e9-f077ef09c670
2025-08-11 03:39:32,751 - INFO - Verifications in API Server for VN ctest-fip_vn-12892766 passed
2025-08-11 03:39:32,751 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/325dc905-cc07-4d7e-b3e9-f077ef09c670
2025-08-11 03:39:32,761 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8af9240e-00eb-49b5-bede-67021405dfb6
2025-08-11 03:39:32,770 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8af9240e-00eb-49b5-bede-67021405dfb6
2025-08-11 03:39:32,778 - DEBUG - Requesting: http://10.0.0.23:8082/route-target/4c910204-376a-4af5-86b4-e6eb6d624883
2025-08-11 03:39:32,795 - DEBUG - Control-node 10.0.0.23 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3629277901465537918', 'uuid-lslong': '12964157400264853104'}, 'enable': 'true', 'created': '2025-08-11T03:34:18', 'last-modified': '2025-08-11T03:34:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:05:14.107637'}
2025-08-11 03:39:32,803 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-11 03:39:32,809 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766', 'interests': '0', 'advertised': '0', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3629277901465537918', 'uuid-lslong': '12964157400264853104'}, 'enable': 'true', 'created': '2025-08-11T03:34:18', 'last-modified': '2025-08-11T03:34:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:05:14.119399'}
2025-08-11 03:39:32,815 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-11 03:39:32,822 - DEBUG - Control-node 10.0.0.141 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsTestSanityWithResource-87051251', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3629277901465537918', 'uuid-lslong': '12964157400264853104'}, 'enable': 'true', 'created': '2025-08-11T03:34:18', 'last-modified': '2025-08-11T03:34:18', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:05:14.134936'}
2025-08-11 03:39:32,828 - DEBUG - Route Targets: ['target:64512:8000007']
2025-08-11 03:39:32,829 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-fip_vn-12892766 passed
2025-08-11 03:39:32,829 - DEBUG - ====Verifying policy data for ctest-fip_vn-12892766 in API_Server ======
2025-08-11 03:39:32,829 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:39:32,835 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:39:32,847 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:39:32,944 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-network/325dc905-cc07-4d7e-b3e9-f077ef09c670
2025-08-11 03:39:32,953 - DEBUG - =>VN ctest-fip_vn-12892766 has no policy to be verified
2025-08-11 03:39:32,953 - DEBUG - Verifying the vn in opserver
2025-08-11 03:39:32,953 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766 virtual network link through opserver 10.0.0.23
2025-08-11 03:39:32,954 - DEBUG - Requesting: http://10.0.0.23:8081/analytics/uves/virtual-networks
2025-08-11 03:39:32,964 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766', 'href': 'http://10.0.0.23:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766?flat'}
2025-08-11 03:39:32,965 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766 virtual network link through opserver 10.0.0.38
2025-08-11 03:39:32,965 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-11 03:39:32,976 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766?flat'}
2025-08-11 03:39:32,976 - DEBUG - Verifying the default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766 virtual network link through opserver 10.0.0.141
2025-08-11 03:39:32,976 - DEBUG - Requesting: http://10.0.0.141:8081/analytics/uves/virtual-networks
2025-08-11 03:39:32,987 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766', 'href': 'http://10.0.0.141:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766?flat'}
2025-08-11 03:39:32,987 - INFO - Validated that VN default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766 is found in opserver
2025-08-11 03:39:32,998 - DEBUG - VRF ids for VN ctest-fip_vn-12892766: {'10.0.0.57': '3'}
2025-08-11 03:39:32,998 - INFO - start time= 1754883572998804
2025-08-11 03:39:32,998 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 03:39:32,999 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 03:39:32,999 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoserver.py already copied to 102.9.147.67
2025-08-11 03:39:32,999 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoserver.py --start_port 9000 --end_port 9000 --pid_file /tmp/server-ctest-random-43917311.pid --stats_file /tmp/server-ctest-random-43917311.stats 0<&- &> /tmp/server-ctest-random-43917311.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-11 03:39:32,999 - DEBUG - nohup python /tmp/udpechoserver.py --start_port 9000 --end_port 9000 --pid_file /tmp/server-ctest-random-43917311.pid --stats_file /tmp/server-ctest-random-43917311.stats 0<&- &> /tmp/server-ctest-random-43917311.log &
2025-08-11 03:39:33,201 - DEBUG - None
2025-08-11 03:39:33,201 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 03:39:33,201 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoclient.py already copied to 213.132.235.67
2025-08-11 03:39:33,201 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoclient.py --servers 102.9.147.67 --sport 8000 --dports 9000 --retry --count 100 --pid_file /tmp/client-ctest-random-43917311.pid --stats_file /tmp/client-ctest-random-43917311.stats 0<&- &> /tmp/client-ctest-random-43917311.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-08-11 03:39:33,201 - DEBUG - nohup python /tmp/udpechoclient.py --servers 102.9.147.67 --sport 8000 --dports 9000 --retry --count 100 --pid_file /tmp/client-ctest-random-43917311.pid --stats_file /tmp/client-ctest-random-43917311.stats 0<&- &> /tmp/client-ctest-random-43917311.log &
2025-08-11 03:39:33,406 - DEBUG - None
2025-08-11 03:39:33,406 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 03:39:33,406 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 03:39:33,406 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoserver.py already copied to 102.9.147.67
2025-08-11 03:39:33,406 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoserver.py --start_port 9001 --end_port 9001 --pid_file /tmp/server-ctest-random-72407538.pid --stats_file /tmp/server-ctest-random-72407538.stats 0<&- &> /tmp/server-ctest-random-72407538.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-11 03:39:33,406 - DEBUG - nohup python /tmp/udpechoserver.py --start_port 9001 --end_port 9001 --pid_file /tmp/server-ctest-random-72407538.pid --stats_file /tmp/server-ctest-random-72407538.stats 0<&- &> /tmp/server-ctest-random-72407538.log &
2025-08-11 03:39:33,609 - DEBUG - None
2025-08-11 03:39:33,609 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 03:39:33,609 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoclient.py already copied to 213.132.235.67
2025-08-11 03:39:33,609 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoclient.py --servers 102.9.147.67 --sport 8000 --dports 9001 --retry --count 100 --pid_file /tmp/client-ctest-random-72407538.pid --stats_file /tmp/client-ctest-random-72407538.stats 0<&- &> /tmp/client-ctest-random-72407538.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-08-11 03:39:33,609 - DEBUG - nohup python /tmp/udpechoclient.py --servers 102.9.147.67 --sport 8000 --dports 9001 --retry --count 100 --pid_file /tmp/client-ctest-random-72407538.pid --stats_file /tmp/client-ctest-random-72407538.stats 0<&- &> /tmp/client-ctest-random-72407538.log &
2025-08-11 03:39:33,810 - DEBUG - None
2025-08-11 03:39:33,810 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 03:39:33,810 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 03:39:33,810 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoserver.py already copied to 102.9.147.67
2025-08-11 03:39:33,810 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoserver.py --start_port 9003 --end_port 9003 --pid_file /tmp/server-ctest-random-75724521.pid --stats_file /tmp/server-ctest-random-75724521.stats 0<&- &> /tmp/server-ctest-random-75724521.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-11 03:39:33,810 - DEBUG - nohup python /tmp/udpechoserver.py --start_port 9003 --end_port 9003 --pid_file /tmp/server-ctest-random-75724521.pid --stats_file /tmp/server-ctest-random-75724521.stats 0<&- &> /tmp/server-ctest-random-75724521.log &
2025-08-11 03:39:34,014 - DEBUG - None
2025-08-11 03:39:34,014 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 03:39:34,014 - DEBUG - File /contrail-test/tcutils/traffic_utils/../udpechoclient.py already copied to 213.132.235.67
2025-08-11 03:39:34,014 - DEBUG - Running remote_cmd, Cmd : python /tmp/udpechoclient.py --servers 102.9.147.67 --sport 8000 --dports 9003 --retry --count 100 --pid_file /tmp/client-ctest-random-75724521.pid --stats_file /tmp/client-ctest-random-75724521.stats 0<&- &> /tmp/client-ctest-random-75724521.log, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-08-11 03:39:34,014 - DEBUG - nohup python /tmp/udpechoclient.py --servers 102.9.147.67 --sport 8000 --dports 9003 --retry --count 100 --pid_file /tmp/client-ctest-random-75724521.pid --stats_file /tmp/client-ctest-random-75724521.stats 0<&- &> /tmp/client-ctest-random-75724521.log &
2025-08-11 03:39:34,214 - DEBUG - None
2025-08-11 03:39:44,215 - DEBUG - Running remote_cmd, Cmd : kill $(cat /tmp/client-ctest-random-43917311.pid); sync; cat /tmp/client-ctest-random-43917311.stats, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-08-11 03:39:44,215 - DEBUG - kill $(cat /tmp/client-ctest-random-43917311.pid); sync; cat /tmp/client-ctest-random-43917311.stats
2025-08-11 03:39:44,497 - DEBUG - cat: can't open '/tmp/client-ctest-random-43917311.pid': No such file or directory
sh: you need to specify whom to kill
cat: can't open '/tmp/client-ctest-random-43917311.stats': No such file or directory
2025-08-11 03:39:44,497 - DEBUG - Running remote_cmd, Cmd : kill $(cat /tmp/server-ctest-random-43917311.pid); sync; cat /tmp/server-ctest-random-43917311.stats, host_string: cirros@169.254.0.3, password: gocubsgogateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-11 03:39:44,497 - DEBUG - kill $(cat /tmp/server-ctest-random-43917311.pid); sync; cat /tmp/server-ctest-random-43917311.stats
2025-08-11 03:39:44,786 - DEBUG - cat: can't open '/tmp/server-ctest-random-43917311.pid': No such file or directory
sh: you need to specify whom to kill
cat: can't open '/tmp/server-ctest-random-43917311.stats': No such file or directory
2025-08-11 03:39:44,786 - INFO - Client - Sent: 0, Received: 0
2025-08-11 03:39:44,786 - INFO - Server - Sent: 0, Received: 0
2025-08-11 03:39:45,236 - INFO - Deleted policy policy1
2025-08-11 03:39:45,399 - INFO - Setting flow export rate: None
2025-08-11 03:39:46,644 - ERROR - AssertionError
Python 3.6.8: /usr/bin/python3
Mon Aug 11 03:39:44 2025
A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.
/contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function =
self =
args = ()
kwargs = {}
/contrail-test/serial_scripts/analytics/test_analytics_resource.py in test_verify_session_series_table_inter_vn(self=)
1336 start_time = self.analytics_obj.getstarttime(vm_node_ip)
1337 self.logger.info("start time= %s" % (start_time))
1338 self.setup_and_create_streams(self.res.vn1_vm1_fixture, self.res.vn2_vm2_fixture)
1339 src_vn = self.res.vn1_fixture.vn_fq_name
1340 dst_vn = self.res.vn2_fixture.vn_fq_name
self =
self.setup_and_create_streams = >
self.res =
self.res.vn1_vm1_fixture =
self.res.vn2_vm2_fixture =
/contrail-test/serial_scripts/analytics/base.py in setup_and_create_streams(self=, src_vm=, dst_vm=, sport=8000, dport=9003, count=100)
168 time.sleep(10)
169 for traffic_obj in traffic_objs:
170 self.stop_traffic(traffic_obj)
171
172 #end setup_create_streams
self =
self.stop_traffic = >
traffic_obj =
/contrail-test/common/base.py in stop_traffic(self=, traffic_obj=, expectation=True, unidirection=False, partial=False)
796 assert False, "No drops observed in packets %s"%msg
797 elif expectation:
798 assert sent and recv, "Packets not %s"%msg
799 if recv*100/float(sent) < 90:
800 assert False, "Packets not %s"%msg
sent = 0
recv = 0
msg = 'transferred between 213.132.235.67 and 102.9.147.67, proto udp sport 8000 and dport 9000'
AssertionError: Packets not transferred between 213.132.235.67 and 102.9.147.67, proto udp sport 8000 and dport 9000
__cause__ = None
__class__ =
__context__ = None
__delattr__ =
__dict__ = {}
__dir__ =
__doc__ = 'Assertion failed.'
__eq__ =
__format__ =
__ge__ =
__getattribute__ =
__gt__ =
__hash__ =
__init__ =
__init_subclass__ =
__le__ =
__lt__ =
__ne__ =
__new__ =
__reduce__ =
__reduce_ex__ =
__repr__ =
__setattr__ =
__setstate__ =
__sizeof__ =
__str__ =
__subclasshook__ =
__suppress_context__ = False
__traceback__ =
args = ('Packets not transferred between 213.132.235.67 and 102.9.147.67, proto udp sport 8000 and dport 9000',)
with_traceback =
The above is a description of an error in a Python program. Here is
the original traceback:
Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/serial_scripts/analytics/test_analytics_resource.py", line 1338, in test_verify_session_series_table_inter_vn
self.setup_and_create_streams(self.res.vn1_vm1_fixture, self.res.vn2_vm2_fixture)
File "/contrail-test/serial_scripts/analytics/base.py", line 170, in setup_and_create_streams
self.stop_traffic(traffic_obj)
File "/contrail-test/common/base.py", line 798, in stop_traffic
assert sent and recv, "Packets not %s"%msg
AssertionError: Packets not transferred between 213.132.235.67 and 102.9.147.67, proto udp sport 8000 and dport 9000
2025-08-11 03:39:46,645 - DEBUG - Skipping xmpp flap check
2025-08-11 03:39:46,645 - INFO -
2025-08-11 03:39:46,646 - INFO - END TEST : test_verify_session_series_table_inter_vn : FAILED[0:00:18]
2025-08-11 03:39:46,646 - INFO - --------------------------------------------------------------------------------
2025-08-11 03:39:46,648 - INFO - Deleting VM mltf_vm
2025-08-11 03:39:46,727 - INFO - Deleting VM ctest-fvn_vm1-52782486
2025-08-11 03:39:46,806 - INFO - Deleting VM ctest-vn2_vm2-18938745
2025-08-11 03:39:46,882 - INFO - Deleting VN ctest-fip_vn-12892766
2025-08-11 03:39:46,930 - DEBUG - VN 325dc905-cc07-4d7e-b3e9-f077ef09c670 still in use: Unable to complete operation on network 325dc905-cc07-4d7e-b3e9-f077ef09c670. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-b39a3f00-7397-4d33-b36f-49e323ab69f8']
2025-08-11 03:39:46,930 - WARNING - Deleting VN ctest-fip_vn-12892766 failed..Will retry
2025-08-11 03:39:49,122 - DEBUG - Response for deleting network ()
2025-08-11 03:39:49,122 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/8af9240e-00eb-49b5-bede-67021405dfb6
2025-08-11 03:39:49,130 - DEBUG - Response Code: 404
2025-08-11 03:39:49,130 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:39:49,139 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:39:49,197 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:39:49,289 - INFO - Validated that VN ctest-fip_vn-12892766 is not found in API Server
2025-08-11 03:39:49,305 - DEBUG - VN ctest-fip_vn-12892766 is not present in Agent 10.0.0.57
2025-08-11 03:39:49,320 - DEBUG - VN ctest-fip_vn-12892766 is not present in Agent 10.0.0.65
2025-08-11 03:39:49,320 - INFO - Validated that VN ctest-fip_vn-12892766 is not in any agent
2025-08-11 03:39:49,328 - DEBUG - VRF 3 is not seen in agent 10.0.0.57
2025-08-11 03:39:49,336 - DEBUG - Vrouter 10.0.0.57 does not have vrf 3 for VN ctest-fip_vn-12892766
2025-08-11 03:39:49,336 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-fip_vn-12892766
2025-08-11 03:39:49,366 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-fip_vn-12892766 info
2025-08-11 03:39:49,366 - INFO - Deleting VN ctest-vn2-64555423
2025-08-11 03:39:49,537 - DEBUG - Response for deleting network ()
2025-08-11 03:39:49,537 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/b1e72472-8f5b-4469-bb6b-96a2eea8a46b
2025-08-11 03:39:49,546 - DEBUG - Response Code: 404
2025-08-11 03:39:49,546 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:39:49,554 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:39:49,605 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:39:49,700 - INFO - Validated that VN ctest-vn2-64555423 is not found in API Server
2025-08-11 03:39:49,712 - DEBUG - VN ctest-vn2-64555423 is not present in Agent 10.0.0.57
2025-08-11 03:39:49,724 - DEBUG - VN ctest-vn2-64555423 is not present in Agent 10.0.0.65
2025-08-11 03:39:49,724 - INFO - Validated that VN ctest-vn2-64555423 is not in any agent
2025-08-11 03:39:49,730 - DEBUG - VRF 2 is not seen in agent 10.0.0.57
2025-08-11 03:39:49,738 - DEBUG - Vrouter 10.0.0.57 does not have vrf 2 for VN ctest-vn2-64555423
2025-08-11 03:39:49,745 - DEBUG - VRF 3 is not seen in agent 10.0.0.65
2025-08-11 03:39:49,751 - DEBUG - Vrouter 10.0.0.65 does not have vrf 3 for VN ctest-vn2-64555423
2025-08-11 03:39:49,751 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn2-64555423
2025-08-11 03:39:49,775 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn2-64555423 info
2025-08-11 03:39:49,775 - INFO - Deleting VM ctest-vn1_vm2-69335465
2025-08-11 03:39:49,864 - INFO - Deleting VM ctest-vn1_vm1-12224247
2025-08-11 03:39:49,935 - INFO - Deleting VN ctest-vn1-61012477
2025-08-11 03:39:49,983 - DEBUG - VN b5c98a57-3f59-4d06-bca0-3101ca0999bf still in use: Unable to complete operation on network b5c98a57-3f59-4d06-bca0-3101ca0999bf. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-fec3311c-2304-4502-816b-1c10e4de0f8b']
2025-08-11 03:39:49,983 - WARNING - Deleting VN ctest-vn1-61012477 failed..Will retry
2025-08-11 03:39:52,343 - DEBUG - Response for deleting network ()
2025-08-11 03:39:52,343 - DEBUG - Requesting: http://10.0.0.23:8082/routing-instance/dec5e5c6-bb3e-40c2-9610-4b54612c2677
2025-08-11 03:39:52,353 - DEBUG - Response Code: 404
2025-08-11 03:39:52,353 - DEBUG - Requesting: http://10.0.0.23:8082/domains
2025-08-11 03:39:52,373 - DEBUG - Requesting: http://10.0.0.23:8082/domain/e652ea40-e608-445e-8759-8973ddbd3f22
2025-08-11 03:39:52,395 - DEBUG - Requesting: http://10.0.0.23:8082/project/ae6c7376-0847-4083-a1e5-17bbbe92a09c
2025-08-11 03:39:52,514 - INFO - Validated that VN ctest-vn1-61012477 is not found in API Server
2025-08-11 03:39:52,528 - DEBUG - VN ctest-vn1-61012477 is not present in Agent 10.0.0.57
2025-08-11 03:39:52,556 - DEBUG - VN ctest-vn1-61012477 is not present in Agent 10.0.0.65
2025-08-11 03:39:52,556 - INFO - Validated that VN ctest-vn1-61012477 is not in any agent
2025-08-11 03:39:52,568 - DEBUG - VRF 2 is not seen in agent 10.0.0.65
2025-08-11 03:39:52,581 - DEBUG - Vrouter 10.0.0.65 does not have vrf 2 for VN ctest-vn1-61012477
2025-08-11 03:39:52,581 - INFO - Validated that all vrouters do not have the route table for VN default-domain:ctest-AnalyticsTestSanityWithResource-87051251:ctest-vn1-61012477
2025-08-11 03:39:52,621 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn1-61012477 info
2025-08-11 03:39:53,603 - INFO - Deleted project: ctest-AnalyticsTestSanityWithResource-87051251, ID : ae6c7376-0847-4083-a1e5-17bbbe92a09c