2026-02-10 02:42:31,120 - INFO - Using existing project ['default-domain', 'k8s-default'](b4d54c2c-393b-4e6a-976e-f6602b109f87) 2026-02-10 02:42:31,141 - DEBUG - Namespace ctest-new-default-57251293 not present 2026-02-10 02:42:31,165 - INFO - Created namespace ctest-new-default-57251293 2026-02-10 02:42:34,169 - DEBUG - Namespace ctest-non-default-35197082 not present 2026-02-10 02:42:34,178 - INFO - Created namespace ctest-non-default-35197082 2026-02-10 02:42:37,322 - DEBUG - Pod ctest-pod-54393323 not present 2026-02-10 02:42:37,323 - INFO - Creating Pod ctest-pod-54393323 2026-02-10 02:42:37,418 - DEBUG - Pod : ctest-pod-54393323 UUID is 8b5f0496-fa53-4007-90ae-bd5222bed372 2026-02-10 02:42:37,427 - DEBUG - Pod ctest-pod-77355542 not present 2026-02-10 02:42:37,428 - INFO - Creating Pod ctest-pod-77355542 2026-02-10 02:42:37,489 - DEBUG - Pod : ctest-pod-77355542 UUID is a616bf1c-6dcd-4c9d-b782-0cb7455e39f7 2026-02-10 02:42:37,500 - DEBUG - Pod ctest-pod-56133465 not present 2026-02-10 02:42:37,500 - INFO - Creating Pod ctest-pod-56133465 2026-02-10 02:42:37,541 - DEBUG - Pod : ctest-pod-56133465 UUID is 9933cc78-67cd-41ab-97e2-7c51b955dda0 2026-02-10 02:42:37,543 - DEBUG - Pod ctest-pod-73206377 not present 2026-02-10 02:42:37,544 - INFO - Creating Pod ctest-pod-73206377 2026-02-10 02:42:37,568 - DEBUG - Pod : ctest-pod-73206377 UUID is 78630641-8d08-4f0f-858e-d267f8fb3f6c 2026-02-10 02:42:37,570 - DEBUG - Pod ctest-pod-43466392 not present 2026-02-10 02:42:37,571 - INFO - Creating Pod ctest-pod-43466392 2026-02-10 02:42:37,613 - DEBUG - Pod : ctest-pod-43466392 UUID is 27dee42f-b964-48b3-ab40-27dd7cda40c8 2026-02-10 02:42:37,617 - DEBUG - Pod ctest-pod-96945387 not present 2026-02-10 02:42:37,618 - INFO - Creating Pod ctest-pod-96945387 2026-02-10 02:42:37,650 - DEBUG - Pod : ctest-pod-96945387 UUID is b1c27fb1-9ab6-4d47-b08d-8d5a5ae68cdc 2026-02-10 02:42:37,652 - DEBUG - Pod ctest-pod-90882811 not present 2026-02-10 02:42:37,652 - INFO - Creating Pod ctest-pod-90882811 2026-02-10 02:42:37,675 - DEBUG - Pod : ctest-pod-90882811 UUID is 25673a7e-2da2-4786-bf84-500dcd7ff505 2026-02-10 02:42:37,678 - DEBUG - Pod ctest-pod-90381784 not present 2026-02-10 02:42:37,678 - INFO - Creating Pod ctest-pod-90381784 2026-02-10 02:42:37,716 - DEBUG - Pod : ctest-pod-90381784 UUID is 2692d339-6f81-420e-8ea0-ebc40cc29236 2026-02-10 02:42:38,016 - INFO - Project default-domain:k8s-ctest-new-default-57251293 for Namespace ctest-new-default-57251293 is seen in contrail-api 2026-02-10 02:42:38,021 - DEBUG - Project uuid in Contrail is 83d4ee7e-cc42-479b-ab94-9c4a1d473dfa 2026-02-10 02:42:38,253 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=484eb692-9f8d-4a80-a4fe-3f48aae7c7e8 2026-02-10 02:42:38,260 - INFO - Namespace ctest-new-default-57251293 with uuid 484eb692-9f8d-4a80-a4fe-3f48aae7c7e8 found in kube manager 2026-02-10 02:42:38,260 - INFO - Namespace ctest-new-default-57251293 verification passed 2026-02-10 02:42:38,635 - INFO - Project default-domain:k8s-ctest-non-default-35197082 for Namespace ctest-non-default-35197082 is seen in contrail-api 2026-02-10 02:42:38,635 - DEBUG - Project uuid in Contrail is 2aa0190a-faf5-49cb-9711-887a5f3472db 2026-02-10 02:42:38,635 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NamespaceDatabaseList?namespace_uuid=330ff5fb-9005-4bc6-a73b-a28d83675d21 2026-02-10 02:42:38,640 - INFO - Namespace ctest-non-default-35197082 with uuid 330ff5fb-9005-4bc6-a73b-a28d83675d21 found in kube manager 2026-02-10 02:42:38,640 - INFO - Namespace ctest-non-default-35197082 verification passed 2026-02-10 02:42:38,650 - DEBUG - Pod ctest-pod-54393323 not in running state.Currently in Pending 2026-02-10 02:42:43,668 - DEBUG - Pod ctest-pod-54393323 not in running state.Currently in Pending 2026-02-10 02:42:48,680 - INFO - Pod ctest-pod-54393323 is in running state.Got IP 10.47.255.251 2026-02-10 02:42:48,693 - DEBUG - Pod ctest-pod-54393323 has vmi 2a3bd07e-062a-11f1-b9ed-fa163e6b97c1 2026-02-10 02:42:48,693 - INFO - Verified pod ctest-pod-54393323 in contrail-api 2026-02-10 02:42:48,710 - DEBUG - VMI 2a3bd07e-062a-11f1-b9ed-fa163e6b97c1 is active in agent 10.0.0.24 2026-02-10 02:42:48,710 - INFO - Verified Pod ctest-pod-54393323 in agent 10.0.0.24 2026-02-10 02:42:48,710 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=8b5f0496-fa53-4007-90ae-bd5222bed372 2026-02-10 02:42:48,714 - INFO - Pod ctest-pod-54393323 with uuid 8b5f0496-fa53-4007-90ae-bd5222bed372 found in kube manager 2026-02-10 02:42:48,714 - INFO - Pod ctest-pod-54393323 verification passed 2026-02-10 02:42:48,724 - INFO - Pod ctest-pod-77355542 is in running state.Got IP 10.47.255.250 2026-02-10 02:42:48,779 - DEBUG - Pod ctest-pod-77355542 has vmi 2aca2a0e-062a-11f1-b9ed-fa163e6b97c1 2026-02-10 02:42:48,779 - INFO - Verified pod ctest-pod-77355542 in contrail-api 2026-02-10 02:42:48,791 - DEBUG - VMI 2aca2a0e-062a-11f1-b9ed-fa163e6b97c1 is active in agent 10.0.0.24 2026-02-10 02:42:48,791 - INFO - Verified Pod ctest-pod-77355542 in agent 10.0.0.24 2026-02-10 02:42:48,791 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=a616bf1c-6dcd-4c9d-b782-0cb7455e39f7 2026-02-10 02:42:48,796 - INFO - Pod ctest-pod-77355542 with uuid a616bf1c-6dcd-4c9d-b782-0cb7455e39f7 found in kube manager 2026-02-10 02:42:48,796 - INFO - Pod ctest-pod-77355542 verification passed 2026-02-10 02:42:48,806 - DEBUG - Pod ctest-pod-56133465 not in running state.Currently in Pending 2026-02-10 02:42:53,813 - INFO - Pod ctest-pod-56133465 is in running state.Got IP 10.47.255.249 2026-02-10 02:42:53,825 - DEBUG - Pod ctest-pod-56133465 has vmi 2b594324-062a-11f1-b9ed-fa163e6b97c1 2026-02-10 02:42:53,825 - INFO - Verified pod ctest-pod-56133465 in contrail-api 2026-02-10 02:42:53,837 - DEBUG - VMI 2b594324-062a-11f1-b9ed-fa163e6b97c1 is active in agent 10.0.0.24 2026-02-10 02:42:53,837 - INFO - Verified Pod ctest-pod-56133465 in agent 10.0.0.24 2026-02-10 02:42:53,837 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=9933cc78-67cd-41ab-97e2-7c51b955dda0 2026-02-10 02:42:53,841 - INFO - Pod ctest-pod-56133465 with uuid 9933cc78-67cd-41ab-97e2-7c51b955dda0 found in kube manager 2026-02-10 02:42:53,841 - INFO - Pod ctest-pod-56133465 verification passed 2026-02-10 02:42:53,847 - INFO - Pod ctest-pod-73206377 is in running state.Got IP 10.47.255.248 2026-02-10 02:42:53,899 - DEBUG - Pod ctest-pod-73206377 has vmi 2bc38356-062a-11f1-b9ed-fa163e6b97c1 2026-02-10 02:42:53,899 - INFO - Verified pod ctest-pod-73206377 in contrail-api 2026-02-10 02:42:53,910 - DEBUG - VMI 2bc38356-062a-11f1-b9ed-fa163e6b97c1 is active in agent 10.0.0.24 2026-02-10 02:42:53,911 - INFO - Verified Pod ctest-pod-73206377 in agent 10.0.0.24 2026-02-10 02:42:53,911 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=78630641-8d08-4f0f-858e-d267f8fb3f6c 2026-02-10 02:42:53,915 - INFO - Pod ctest-pod-73206377 with uuid 78630641-8d08-4f0f-858e-d267f8fb3f6c found in kube manager 2026-02-10 02:42:53,915 - INFO - Pod ctest-pod-73206377 verification passed 2026-02-10 02:42:53,921 - INFO - Pod ctest-pod-43466392 is in running state.Got IP 10.47.255.247 2026-02-10 02:42:53,935 - DEBUG - Pod ctest-pod-43466392 has vmi 2c3565f2-062a-11f1-b9ed-fa163e6b97c1 2026-02-10 02:42:53,935 - INFO - Verified pod ctest-pod-43466392 in contrail-api 2026-02-10 02:42:53,947 - DEBUG - VMI 2c3565f2-062a-11f1-b9ed-fa163e6b97c1 is active in agent 10.0.0.24 2026-02-10 02:42:53,947 - INFO - Verified Pod ctest-pod-43466392 in agent 10.0.0.24 2026-02-10 02:42:53,947 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=27dee42f-b964-48b3-ab40-27dd7cda40c8 2026-02-10 02:42:53,951 - INFO - Pod ctest-pod-43466392 with uuid 27dee42f-b964-48b3-ab40-27dd7cda40c8 found in kube manager 2026-02-10 02:42:53,951 - INFO - Pod ctest-pod-43466392 verification passed 2026-02-10 02:42:53,956 - DEBUG - Pod ctest-pod-90882811 not in running state.Currently in Pending 2026-02-10 02:42:58,964 - INFO - Pod ctest-pod-90882811 is in running state.Got IP 10.47.255.245 2026-02-10 02:42:59,019 - DEBUG - Pod ctest-pod-90882811 has vmi 2d170de0-062a-11f1-b9ed-fa163e6b97c1 2026-02-10 02:42:59,019 - INFO - Verified pod ctest-pod-90882811 in contrail-api 2026-02-10 02:42:59,030 - DEBUG - VMI 2d170de0-062a-11f1-b9ed-fa163e6b97c1 is active in agent 10.0.0.24 2026-02-10 02:42:59,030 - INFO - Verified Pod ctest-pod-90882811 in agent 10.0.0.24 2026-02-10 02:42:59,031 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=25673a7e-2da2-4786-bf84-500dcd7ff505 2026-02-10 02:42:59,035 - INFO - Pod ctest-pod-90882811 with uuid 25673a7e-2da2-4786-bf84-500dcd7ff505 found in kube manager 2026-02-10 02:42:59,035 - INFO - Pod ctest-pod-90882811 verification passed 2026-02-10 02:42:59,044 - INFO - Pod ctest-pod-96945387 is in running state.Got IP 10.47.255.246 2026-02-10 02:42:59,059 - DEBUG - Pod ctest-pod-96945387 has vmi 2ca6288c-062a-11f1-b9ed-fa163e6b97c1 2026-02-10 02:42:59,059 - INFO - Verified pod ctest-pod-96945387 in contrail-api 2026-02-10 02:42:59,070 - DEBUG - VMI 2ca6288c-062a-11f1-b9ed-fa163e6b97c1 is active in agent 10.0.0.24 2026-02-10 02:42:59,071 - INFO - Verified Pod ctest-pod-96945387 in agent 10.0.0.24 2026-02-10 02:42:59,071 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=b1c27fb1-9ab6-4d47-b08d-8d5a5ae68cdc 2026-02-10 02:42:59,074 - INFO - Pod ctest-pod-96945387 with uuid b1c27fb1-9ab6-4d47-b08d-8d5a5ae68cdc found in kube manager 2026-02-10 02:42:59,074 - INFO - Pod ctest-pod-96945387 verification passed 2026-02-10 02:42:59,081 - INFO - Pod ctest-pod-90381784 is in running state.Got IP 10.47.255.244 2026-02-10 02:42:59,134 - DEBUG - Pod ctest-pod-90381784 has vmi 2d7e2426-062a-11f1-b9ed-fa163e6b97c1 2026-02-10 02:42:59,134 - INFO - Verified pod ctest-pod-90381784 in contrail-api 2026-02-10 02:42:59,145 - DEBUG - VMI 2d7e2426-062a-11f1-b9ed-fa163e6b97c1 is active in agent 10.0.0.24 2026-02-10 02:42:59,146 - INFO - Verified Pod ctest-pod-90381784 in agent 10.0.0.24 2026-02-10 02:42:59,146 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_VirtualMachineDatabaseList?x=2692d339-6f81-420e-8ea0-ebc40cc29236 2026-02-10 02:42:59,149 - INFO - Pod ctest-pod-90381784 with uuid 2692d339-6f81-420e-8ea0-ebc40cc29236 found in kube manager 2026-02-10 02:42:59,149 - INFO - Pod ctest-pod-90381784 verification passed 2026-02-10 02:42:59,150 - INFO - ================================================================================ 2026-02-10 02:42:59,150 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-02-10 02:42:59,150 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-02-10 02:42:59,319 - DEBUG - Nothing to compare xmpp stats {'10.0.0.24': {'10.0.0.49': '0'}} with 2026-02-10 02:42:59,319 - INFO - Initial checks done. Running the testcase now 2026-02-10 02:42:59,319 - INFO - 2026-02-10 02:42:59,371 - DEBUG - [Pod ctest-pod-54393323] Cmd: echo ctest-pod-54393323 > /usr/share/nginx/html/index.html, Output: 2026-02-10 02:42:59,429 - DEBUG - [Pod ctest-pod-77355542] Cmd: echo ctest-pod-77355542 > /usr/share/nginx/html/index.html, Output: 2026-02-10 02:42:59,485 - DEBUG - [Pod ctest-pod-56133465] Cmd: echo ctest-pod-56133465 > /usr/share/nginx/html/index.html, Output: 2026-02-10 02:42:59,521 - DEBUG - [Pod ctest-pod-73206377] Cmd: echo ctest-pod-73206377 > /usr/share/nginx/html/index.html, Output: 2026-02-10 02:42:59,524 - DEBUG - Service ctest-nginx-svc-18854712 not present 2026-02-10 02:42:59,524 - INFO - Creating service ctest-nginx-svc-18854712 2026-02-10 02:42:59,538 - INFO - Created Service ctest-nginx-svc-18854712 2026-02-10 02:42:59,551 - WARNING - Service UUID a929063f-8aaf-4c7d-bbd0-2473f2e47848 not yet found in contrail-api 2026-02-10 02:43:00,592 - INFO - Validated that Service ctest-nginx-svc-18854712 is seen in contrail-api 2026-02-10 02:43:00,592 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_LoadbalancerDatabaseList?x=a929063f-8aaf-4c7d-bbd0-2473f2e47848 2026-02-10 02:43:00,598 - INFO - Service ctest-nginx-svc-18854712 with uuid a929063f-8aaf-4c7d-bbd0-2473f2e47848 found in kube manager 2026-02-10 02:43:00,598 - INFO - Service ctest-nginx-svc-18854712 verification passed 2026-02-10 02:43:01,670 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) ctest-pod-54393323 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,670 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 passed 2026-02-10 02:43:01,670 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) ctest-pod-54393323 writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,723 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: ctest-pod-54393323 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,723 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 passed 2026-02-10 02:43:01,723 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: ctest-pod-54393323 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,780 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: ctest-pod-54393323 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,780 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 passed 2026-02-10 02:43:01,780 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: ctest-pod-54393323 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,827 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: ctest-pod-54393323 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,827 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 passed 2026-02-10 02:43:01,827 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: ctest-pod-54393323 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,880 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: ctest-pod-77355542 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,880 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 passed 2026-02-10 02:43:01,881 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: ctest-pod-77355542 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,881 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-54393323': 4, 'ctest-pod-77355542': 1} 2026-02-10 02:43:01,918 - DEBUG - [Pod ctest-pod-90882811] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: ctest-pod-54393323 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,918 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 passed 2026-02-10 02:43:01,919 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd output: ctest-pod-54393323 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,975 - DEBUG - [Pod ctest-pod-90882811] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: ctest-pod-77355542 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,975 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 passed 2026-02-10 02:43:01,975 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd output: ctest-pod-77355542 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:01,975 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-54393323': 1, 'ctest-pod-77355542': 1} 2026-02-10 02:43:01,980 - DEBUG - Network policy ingress-on-service not present 2026-02-10 02:43:01,981 - INFO - Creating Network Policy ingress-on-service 2026-02-10 02:43:01,997 - INFO - Network policy found in k8s 2026-02-10 02:43:01,997 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5cd6c9d1-9af0-462d-aca3-461e6c40b5d0 2026-02-10 02:43:02,003 - INFO - Network Policy ingress-on-service with uuid 5cd6c9d1-9af0-462d-aca3-461e6c40b5d0 found in kube manager 2026-02-10 02:43:02,035 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-02-10 02:43:02,035 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-02-10 02:43:02,035 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5cd6c9d1-9af0-462d-aca3-461e6c40b5d0 2026-02-10 02:43:02,063 - WARNING - Network policy with name ingress-on-service not found in agent 2026-02-10 02:43:04,063 - DEBUG - Requesting: http://10.0.0.49:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5cd6c9d1-9af0-462d-aca3-461e6c40b5d0 2026-02-10 02:43:04,091 - INFO - Network policy with name ingress-on-service found in agent 2026-02-10 02:43:04,091 - INFO - Network Policy ingress-on-service verification passed 2026-02-10 02:43:09,147 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:09,147 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:09,147 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:14,195 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:14,195 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:14,195 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:19,245 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:19,245 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:19,245 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:24,297 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:24,297 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:24,297 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:29,354 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:29,354 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:29,355 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:34,406 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:34,406 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:34,406 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:39,458 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:39,458 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:39,458 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:44,506 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:44,506 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:44,506 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:49,569 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:49,569 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:49,569 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:54,621 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:54,621 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:54,621 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:54,621 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-54393323': 0, 'ctest-pod-77355542': 0} 2026-02-10 02:43:54,688 - DEBUG - [Pod ctest-pod-96945387] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-54393323 2026-02-10 02:43:54,688 - DEBUG - [Pod Pod ctest-pod-96945387] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 passed 2026-02-10 02:43:54,688 - DEBUG - [Pod Pod ctest-pod-96945387] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-54393323 2026-02-10 02:43:54,739 - DEBUG - [Pod ctest-pod-96945387] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: ctest-pod-77355542 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:54,739 - DEBUG - [Pod Pod ctest-pod-96945387] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 passed 2026-02-10 02:43:54,739 - DEBUG - [Pod Pod ctest-pod-96945387] Cmd output: ctest-pod-77355542 Connecting to 10.111.24.202:80 (10.111.24.202:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-02-10 02:43:54,739 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-54393323': 1, 'ctest-pod-77355542': 1} 2026-02-10 02:43:59,789 - DEBUG - [Pod ctest-pod-90882811] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:59,789 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:43:59,789 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:04,838 - DEBUG - [Pod ctest-pod-90882811] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:04,838 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:04,838 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:09,893 - DEBUG - [Pod ctest-pod-90882811] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:09,894 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:09,894 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:14,945 - DEBUG - [Pod ctest-pod-90882811] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:14,945 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:14,945 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:19,989 - DEBUG - [Pod ctest-pod-90882811] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:19,989 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:19,989 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:25,041 - DEBUG - [Pod ctest-pod-90882811] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:25,041 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:25,041 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:30,085 - DEBUG - [Pod ctest-pod-90882811] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:30,085 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:30,085 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:35,138 - DEBUG - [Pod ctest-pod-90882811] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:35,138 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:35,138 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:40,186 - DEBUG - [Pod ctest-pod-90882811] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:40,186 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:40,186 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:45,237 - DEBUG - [Pod ctest-pod-90882811] Cmd: wget http://10.111.24.202:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:45,237 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd wget http://10.111.24.202:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:45,237 - DEBUG - [Pod Pod ctest-pod-90882811] Cmd output: Connecting to 10.111.24.202:80 (10.111.24.202:80) wget: download timed out 2026-02-10 02:44:45,237 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-54393323': 0, 'ctest-pod-77355542': 0} 2026-02-10 02:44:47,298 - DEBUG - [Pod ctest-pod-96945387] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.767 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.076 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.306/0.767 ms 2026-02-10 02:44:47,298 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-96945387 with expectation True passed 2026-02-10 02:44:49,350 - DEBUG - [Pod ctest-pod-43466392] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.669 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.102 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.082/0.284/0.669 ms 2026-02-10 02:44:49,350 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-43466392 with expectation True passed 2026-02-10 02:44:51,399 - DEBUG - [Pod ctest-pod-90882811] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.969 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.097 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.378/0.969 ms 2026-02-10 02:44:51,399 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-90882811 with expectation True passed 2026-02-10 02:44:51,453 - DEBUG - [Pod ctest-pod-96945387] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:44:51,454 - DEBUG - [Pod Pod ctest-pod-96945387] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2026-02-10 02:44:51,454 - DEBUG - [Pod Pod ctest-pod-96945387] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:44:51,454 - INFO - wget check of of http://10.47.255.251 from ctest-pod-96945387 passed 2026-02-10 02:44:51,506 - DEBUG - [Pod ctest-pod-96945387] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:44:51,506 - DEBUG - [Pod Pod ctest-pod-96945387] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 02:44:51,506 - DEBUG - [Pod Pod ctest-pod-96945387] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:44:51,506 - INFO - wget check of of http://10.47.255.250 from ctest-pod-96945387 passed 2026-02-10 02:44:51,556 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:44:51,556 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 02:44:51,556 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:44:51,556 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-43466392 failed 2026-02-10 02:44:53,605 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:44:53,605 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 02:44:53,605 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:44:53,605 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-43466392 failed 2026-02-10 02:44:55,656 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:44:55,656 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 02:44:55,657 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:44:55,657 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-43466392 failed 2026-02-10 02:44:57,709 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:44:57,709 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 02:44:57,709 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:44:57,709 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-43466392 failed 2026-02-10 02:44:59,752 - WARNING - ApiException is caught (0) Reason: Handshake status 404 Not Found . Retrying... 2026-02-10 02:45:04,814 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:04,814 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 02:45:04,815 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:04,815 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-43466392 failed 2026-02-10 02:45:06,866 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:06,866 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 02:45:06,866 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:06,866 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-43466392 failed 2026-02-10 02:45:08,909 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:08,909 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 02:45:08,909 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:08,909 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-43466392 failed 2026-02-10 02:45:10,962 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:10,963 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 02:45:10,963 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:10,963 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-43466392 failed 2026-02-10 02:45:13,019 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:13,019 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 02:45:13,019 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:13,019 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-43466392 failed 2026-02-10 02:45:15,076 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:15,076 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 02:45:15,076 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:15,076 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-43466392 failed 2026-02-10 02:45:17,132 - DEBUG - [Pod ctest-pod-43466392] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:17,132 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2026-02-10 02:45:17,132 - DEBUG - [Pod Pod ctest-pod-43466392] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2026-02-10 02:45:17,132 - WARNING - wget check of of http://10.47.255.250 from ctest-pod-43466392 failed 2026-02-10 02:45:17,137 - INFO - Deleting Network Policy : ingress-on-service 2026-02-10 02:45:17,137 - INFO - Deleting service : ctest-nginx-svc-18854712 2026-02-10 02:45:17,322 - ERROR - AssertionError Python 3.9.21: /usr/bin/python3 Tue Feb 10 02:45:17 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/k8s_scripts/test_policy.py in test_ingress_rule_on_pod_with_service(self=) 2859 assert self.validate_wget(self.client2_pod_ns1, url1) 2860 assert self.validate_wget(self.client2_pod_ns1, url2) 2861 assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False) 2862 assert self.validate_wget(self.client2_pod_ns2, url1, expectation=False) 2863 # Updating the policy and adding the namespace selector self = self.validate_wget = .deco_retry....ice[ci_k8s_sanity,k8s_sanity] id=0x7f816c6d1ac0>> self.client1_pod_ns1 = url2 = 'http://10.47.255.250' expectation undefined AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/k8s_scripts/test_policy.py", line 2861, in test_ingress_rule_on_pod_with_service assert self.validate_wget(self.client1_pod_ns1, url2, expectation=False) AssertionError 2026-02-10 02:45:17,329 - DEBUG - No XMPP flaps were noticed during the test 2026-02-10 02:45:17,329 - INFO -
2026-02-10 02:45:17,329 - INFO - END TEST : test_ingress_rule_on_pod_with_service : FAILED[0:02:18]
2026-02-10 02:45:17,329 - INFO - -------------------------------------------------------------------------------- 2026-02-10 02:45:17,335 - INFO - Deleting pod ctest-new-default-57251293:ctest-pod-54393323 2026-02-10 02:45:17,336 - INFO - Deleting pod ctest-new-default-57251293:ctest-pod-77355542 2026-02-10 02:45:17,336 - INFO - Deleting pod ctest-non-default-35197082:ctest-pod-56133465 2026-02-10 02:45:17,336 - INFO - Deleting pod ctest-non-default-35197082:ctest-pod-73206377 2026-02-10 02:45:17,337 - INFO - Deleting pod ctest-new-default-57251293:ctest-pod-43466392 2026-02-10 02:45:17,337 - INFO - Deleting pod ctest-new-default-57251293:ctest-pod-96945387 2026-02-10 02:45:17,337 - INFO - Deleting pod ctest-non-default-35197082:ctest-pod-90882811 2026-02-10 02:45:17,338 - INFO - Deleting pod ctest-non-default-35197082:ctest-pod-90381784 2026-02-10 02:45:17,496 - WARNING - Pod uuid 78630641-8d08-4f0f-858e-d267f8fb3f6c is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:17,498 - WARNING - Pod uuid 27dee42f-b964-48b3-ab40-27dd7cda40c8 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:17,499 - WARNING - Pod uuid 9933cc78-67cd-41ab-97e2-7c51b955dda0 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:17,499 - WARNING - Pod uuid a616bf1c-6dcd-4c9d-b782-0cb7455e39f7 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:17,499 - WARNING - Pod uuid b1c27fb1-9ab6-4d47-b08d-8d5a5ae68cdc is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:17,500 - WARNING - Pod uuid 8b5f0496-fa53-4007-90ae-bd5222bed372 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:17,501 - WARNING - Pod uuid 2692d339-6f81-420e-8ea0-ebc40cc29236 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:17,501 - WARNING - Pod uuid 25673a7e-2da2-4786-bf84-500dcd7ff505 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:22,521 - WARNING - Pod uuid 25673a7e-2da2-4786-bf84-500dcd7ff505 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:22,524 - DEBUG - Pod 9933cc78-67cd-41ab-97e2-7c51b955dda0 is not in agent 10.0.0.24 VM list 2026-02-10 02:45:22,526 - WARNING - Pod uuid b1c27fb1-9ab6-4d47-b08d-8d5a5ae68cdc is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:22,526 - DEBUG - Pod 8b5f0496-fa53-4007-90ae-bd5222bed372 is not in agent 10.0.0.24 VM list 2026-02-10 02:45:22,528 - WARNING - Pod uuid 2692d339-6f81-420e-8ea0-ebc40cc29236 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:22,528 - DEBUG - Pod a616bf1c-6dcd-4c9d-b782-0cb7455e39f7 is not in agent 10.0.0.24 VM list 2026-02-10 02:45:22,529 - DEBUG - Pod 78630641-8d08-4f0f-858e-d267f8fb3f6c is not in agent 10.0.0.24 VM list 2026-02-10 02:45:22,531 - WARNING - Pod uuid 27dee42f-b964-48b3-ab40-27dd7cda40c8 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:22,539 - DEBUG - VMI 2b594324-062a-11f1-b9ed-fa163e6b97c1 is removed from agent 10.0.0.24 2026-02-10 02:45:22,540 - INFO - Verified that pod ctest-pod-56133465 is removed in agent 2026-02-10 02:45:22,541 - DEBUG - VMI 2aca2a0e-062a-11f1-b9ed-fa163e6b97c1 is removed from agent 10.0.0.24 2026-02-10 02:45:22,541 - INFO - Verified that pod ctest-pod-77355542 is removed in agent 2026-02-10 02:45:22,542 - DEBUG - VMI 2a3bd07e-062a-11f1-b9ed-fa163e6b97c1 is removed from agent 10.0.0.24 2026-02-10 02:45:22,542 - INFO - Verified that pod ctest-pod-54393323 is removed in agent 2026-02-10 02:45:22,542 - DEBUG - VMI 2bc38356-062a-11f1-b9ed-fa163e6b97c1 is removed from agent 10.0.0.24 2026-02-10 02:45:22,542 - INFO - Verified that pod ctest-pod-73206377 is removed in agent 2026-02-10 02:45:27,531 - WARNING - Pod uuid 25673a7e-2da2-4786-bf84-500dcd7ff505 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:27,538 - WARNING - Pod uuid b1c27fb1-9ab6-4d47-b08d-8d5a5ae68cdc is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:27,542 - WARNING - Pod uuid 27dee42f-b964-48b3-ab40-27dd7cda40c8 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:27,543 - WARNING - Pod uuid 2692d339-6f81-420e-8ea0-ebc40cc29236 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:32,538 - WARNING - Pod uuid 25673a7e-2da2-4786-bf84-500dcd7ff505 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:32,545 - WARNING - Pod uuid b1c27fb1-9ab6-4d47-b08d-8d5a5ae68cdc is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:32,553 - WARNING - Pod uuid 2692d339-6f81-420e-8ea0-ebc40cc29236 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:32,553 - WARNING - Pod uuid 27dee42f-b964-48b3-ab40-27dd7cda40c8 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:37,544 - WARNING - Pod uuid 25673a7e-2da2-4786-bf84-500dcd7ff505 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:37,550 - WARNING - Pod uuid b1c27fb1-9ab6-4d47-b08d-8d5a5ae68cdc is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:37,562 - WARNING - Pod uuid 2692d339-6f81-420e-8ea0-ebc40cc29236 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:37,563 - WARNING - Pod uuid 27dee42f-b964-48b3-ab40-27dd7cda40c8 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:42,554 - WARNING - Pod uuid 25673a7e-2da2-4786-bf84-500dcd7ff505 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:42,557 - WARNING - Pod uuid b1c27fb1-9ab6-4d47-b08d-8d5a5ae68cdc is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:42,570 - WARNING - Pod uuid 2692d339-6f81-420e-8ea0-ebc40cc29236 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:42,571 - WARNING - Pod uuid 27dee42f-b964-48b3-ab40-27dd7cda40c8 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:47,595 - WARNING - Pod uuid b1c27fb1-9ab6-4d47-b08d-8d5a5ae68cdc is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:47,596 - WARNING - Pod uuid 27dee42f-b964-48b3-ab40-27dd7cda40c8 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:47,597 - WARNING - Pod uuid 2692d339-6f81-420e-8ea0-ebc40cc29236 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:47,597 - WARNING - Pod uuid 25673a7e-2da2-4786-bf84-500dcd7ff505 is still seen in agent 10.0.0.24 VM list 2026-02-10 02:45:52,617 - DEBUG - Pod 27dee42f-b964-48b3-ab40-27dd7cda40c8 is not in agent 10.0.0.24 VM list 2026-02-10 02:45:52,620 - DEBUG - Pod 2692d339-6f81-420e-8ea0-ebc40cc29236 is not in agent 10.0.0.24 VM list 2026-02-10 02:45:52,622 - DEBUG - Pod b1c27fb1-9ab6-4d47-b08d-8d5a5ae68cdc is not in agent 10.0.0.24 VM list 2026-02-10 02:45:52,624 - DEBUG - Pod 25673a7e-2da2-4786-bf84-500dcd7ff505 is not in agent 10.0.0.24 VM list 2026-02-10 02:45:52,634 - DEBUG - VMI 2d7e2426-062a-11f1-b9ed-fa163e6b97c1 is removed from agent 10.0.0.24 2026-02-10 02:45:52,634 - INFO - Verified that pod ctest-pod-90381784 is removed in agent 2026-02-10 02:45:52,635 - DEBUG - VMI 2d170de0-062a-11f1-b9ed-fa163e6b97c1 is removed from agent 10.0.0.24 2026-02-10 02:45:52,636 - INFO - Verified that pod ctest-pod-90882811 is removed in agent 2026-02-10 02:45:52,636 - DEBUG - VMI 2c3565f2-062a-11f1-b9ed-fa163e6b97c1 is removed from agent 10.0.0.24 2026-02-10 02:45:52,636 - INFO - Verified that pod ctest-pod-43466392 is removed in agent 2026-02-10 02:45:52,636 - DEBUG - VMI 2ca6288c-062a-11f1-b9ed-fa163e6b97c1 is removed from agent 10.0.0.24 2026-02-10 02:45:52,636 - INFO - Verified that pod ctest-pod-96945387 is removed in agent 2026-02-10 02:45:52,636 - INFO - Deleting namespace ctest-non-default-35197082 2026-02-10 02:45:52,672 - DEBUG - Namespace ctest-non-default-35197082 still in k8s 2026-02-10 02:45:54,677 - DEBUG - Namespace ctest-non-default-35197082 still in k8s 2026-02-10 02:45:56,682 - DEBUG - Namespace ctest-non-default-35197082 still in k8s 2026-02-10 02:45:58,687 - DEBUG - Namespace ctest-non-default-35197082 is not in k8s 2026-02-10 02:45:58,687 - DEBUG - No need to check project deletion in contrail-api 2026-02-10 02:45:58,687 - INFO - Deleting namespace ctest-new-default-57251293 2026-02-10 02:45:58,697 - DEBUG - Namespace ctest-new-default-57251293 still in k8s 2026-02-10 02:46:00,703 - DEBUG - Namespace ctest-new-default-57251293 still in k8s 2026-02-10 02:46:02,708 - DEBUG - Namespace ctest-new-default-57251293 still in k8s 2026-02-10 02:46:04,712 - DEBUG - Namespace ctest-new-default-57251293 is not in k8s 2026-02-10 02:46:04,712 - DEBUG - No need to check project deletion in contrail-api