2026-03-05 01:44:52,374 - INFO - Using existing project ['default-domain', 'k8s-default'](1034e79d-df62-4019-9087-126393eb9448) 2026-03-05 01:44:52,396 - DEBUG - Namespace ctest-new-default-90892559 not present 2026-03-05 01:44:52,407 - INFO - Created namespace ctest-new-default-90892559 2026-03-05 01:44:55,415 - DEBUG - Namespace ctest-non-default-96682546 not present 2026-03-05 01:44:55,426 - INFO - Created namespace ctest-non-default-96682546 2026-03-05 01:44:58,449 - DEBUG - Pod ctest-pod-73053300 not present 2026-03-05 01:44:58,450 - INFO - Creating Pod ctest-pod-73053300 2026-03-05 01:44:58,510 - DEBUG - Pod : ctest-pod-73053300 UUID is e29aabe1-6319-4139-b8ce-b2050209ce90 2026-03-05 01:44:58,534 - DEBUG - Pod ctest-pod-42638101 not present 2026-03-05 01:44:58,534 - INFO - Creating Pod ctest-pod-42638101 2026-03-05 01:44:58,566 - DEBUG - Pod : ctest-pod-42638101 UUID is c96dc270-95c0-44c9-834e-372657665bbe 2026-03-05 01:44:58,572 - DEBUG - Pod ctest-pod-30833125 not present 2026-03-05 01:44:58,572 - INFO - Creating Pod ctest-pod-30833125 2026-03-05 01:44:58,605 - DEBUG - Pod : ctest-pod-30833125 UUID is fd24100e-fa74-4dea-a7fa-82c0747339e3 2026-03-05 01:44:58,610 - DEBUG - Pod ctest-pod-13703469 not present 2026-03-05 01:44:58,610 - INFO - Creating Pod ctest-pod-13703469 2026-03-05 01:44:58,635 - DEBUG - Pod : ctest-pod-13703469 UUID is aee9cb5e-835f-4742-a042-952f699dc883 2026-03-05 01:44:58,641 - DEBUG - Pod ctest-pod-33304098 not present 2026-03-05 01:44:58,642 - INFO - Creating Pod ctest-pod-33304098 2026-03-05 01:44:58,661 - DEBUG - Pod : ctest-pod-33304098 UUID is 7cb9911f-5e10-492a-ac5e-369090e0f645 2026-03-05 01:44:58,664 - DEBUG - Pod ctest-pod-63241857 not present 2026-03-05 01:44:58,664 - INFO - Creating Pod ctest-pod-63241857 2026-03-05 01:44:58,702 - DEBUG - Pod : ctest-pod-63241857 UUID is 8991df8b-2668-486d-8fb7-10a0d6b75942 2026-03-05 01:44:58,704 - DEBUG - Pod ctest-pod-01081847 not present 2026-03-05 01:44:58,704 - INFO - Creating Pod ctest-pod-01081847 2026-03-05 01:44:58,733 - DEBUG - Pod : ctest-pod-01081847 UUID is 800da67e-862c-4274-aba3-bdf6ccd970a8 2026-03-05 01:44:58,735 - DEBUG - Pod ctest-pod-87014062 not present 2026-03-05 01:44:58,735 - INFO - Creating Pod ctest-pod-87014062 2026-03-05 01:44:58,754 - DEBUG - Pod : ctest-pod-87014062 UUID is c3a9c236-8215-4bfb-83b6-ad5112a400fb 2026-03-05 01:44:58,928 - INFO - Project default-domain:k8s-ctest-new-default-90892559 for Namespace ctest-new-default-90892559 is seen in contrail-api 2026-03-05 01:44:58,928 - DEBUG - Project uuid in Contrail is a450750f-8644-4717-913f-d901440a09e9 2026-03-05 01:44:59,109 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=8fa1f3db-66ee-4450-9968-77249898a30a 2026-03-05 01:44:59,116 - INFO - Namespace ctest-new-default-90892559 with uuid 8fa1f3db-66ee-4450-9968-77249898a30a found in kube manager 2026-03-05 01:44:59,116 - INFO - Namespace ctest-new-default-90892559 verification passed 2026-03-05 01:44:59,370 - INFO - Project default-domain:k8s-ctest-non-default-96682546 for Namespace ctest-non-default-96682546 is seen in contrail-api 2026-03-05 01:44:59,370 - DEBUG - Project uuid in Contrail is 29b8a2bd-0b9f-4261-ad4e-c4cda2c39386 2026-03-05 01:44:59,370 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NamespaceDatabaseList?namespace_uuid=3542e172-6f3a-45c7-b34b-bcb599b3452d 2026-03-05 01:44:59,374 - INFO - Namespace ctest-non-default-96682546 with uuid 3542e172-6f3a-45c7-b34b-bcb599b3452d found in kube manager 2026-03-05 01:44:59,374 - INFO - Namespace ctest-non-default-96682546 verification passed 2026-03-05 01:44:59,384 - DEBUG - Pod ctest-pod-73053300 not in running state.Currently in Pending 2026-03-05 01:45:04,390 - DEBUG - Pod ctest-pod-73053300 not in running state.Currently in Pending 2026-03-05 01:45:09,397 - INFO - Pod ctest-pod-73053300 is in running state.Got IP 10.47.255.251 2026-03-05 01:45:09,411 - DEBUG - Pod ctest-pod-73053300 has vmi ebe304f6-1834-11f1-b4c4-fa163e29b957 2026-03-05 01:45:09,411 - INFO - Verified pod ctest-pod-73053300 in contrail-api 2026-03-05 01:45:09,425 - DEBUG - VMI ebe304f6-1834-11f1-b4c4-fa163e29b957 is active in agent 10.0.0.240 2026-03-05 01:45:09,425 - INFO - Verified Pod ctest-pod-73053300 in agent 10.0.0.240 2026-03-05 01:45:09,426 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=e29aabe1-6319-4139-b8ce-b2050209ce90 2026-03-05 01:45:09,431 - INFO - Pod ctest-pod-73053300 with uuid e29aabe1-6319-4139-b8ce-b2050209ce90 found in kube manager 2026-03-05 01:45:09,431 - INFO - Pod ctest-pod-73053300 verification passed 2026-03-05 01:45:09,439 - INFO - Pod ctest-pod-42638101 is in running state.Got IP 10.47.255.250 2026-03-05 01:45:09,498 - DEBUG - Pod ctest-pod-42638101 has vmi ec53d50a-1834-11f1-b4c4-fa163e29b957 2026-03-05 01:45:09,498 - INFO - Verified pod ctest-pod-42638101 in contrail-api 2026-03-05 01:45:09,507 - DEBUG - VMI ec53d50a-1834-11f1-b4c4-fa163e29b957 is active in agent 10.0.0.240 2026-03-05 01:45:09,507 - INFO - Verified Pod ctest-pod-42638101 in agent 10.0.0.240 2026-03-05 01:45:09,508 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=c96dc270-95c0-44c9-834e-372657665bbe 2026-03-05 01:45:09,512 - INFO - Pod ctest-pod-42638101 with uuid c96dc270-95c0-44c9-834e-372657665bbe found in kube manager 2026-03-05 01:45:09,512 - INFO - Pod ctest-pod-42638101 verification passed 2026-03-05 01:45:09,523 - DEBUG - Pod ctest-pod-30833125 not in running state.Currently in Pending 2026-03-05 01:45:14,533 - INFO - Pod ctest-pod-30833125 is in running state.Got IP 10.47.255.249 2026-03-05 01:45:14,545 - DEBUG - Pod ctest-pod-30833125 has vmi ecdd4592-1834-11f1-b4c4-fa163e29b957 2026-03-05 01:45:14,545 - INFO - Verified pod ctest-pod-30833125 in contrail-api 2026-03-05 01:45:14,556 - DEBUG - VMI ecdd4592-1834-11f1-b4c4-fa163e29b957 is active in agent 10.0.0.240 2026-03-05 01:45:14,557 - INFO - Verified Pod ctest-pod-30833125 in agent 10.0.0.240 2026-03-05 01:45:14,557 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=fd24100e-fa74-4dea-a7fa-82c0747339e3 2026-03-05 01:45:14,560 - INFO - Pod ctest-pod-30833125 with uuid fd24100e-fa74-4dea-a7fa-82c0747339e3 found in kube manager 2026-03-05 01:45:14,560 - INFO - Pod ctest-pod-30833125 verification passed 2026-03-05 01:45:14,566 - INFO - Pod ctest-pod-13703469 is in running state.Got IP 10.47.255.248 2026-03-05 01:45:14,618 - DEBUG - Pod ctest-pod-13703469 has vmi ed5962d0-1834-11f1-b4c4-fa163e29b957 2026-03-05 01:45:14,618 - INFO - Verified pod ctest-pod-13703469 in contrail-api 2026-03-05 01:45:14,630 - DEBUG - VMI ed5962d0-1834-11f1-b4c4-fa163e29b957 is active in agent 10.0.0.240 2026-03-05 01:45:14,630 - INFO - Verified Pod ctest-pod-13703469 in agent 10.0.0.240 2026-03-05 01:45:14,631 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=aee9cb5e-835f-4742-a042-952f699dc883 2026-03-05 01:45:14,634 - INFO - Pod ctest-pod-13703469 with uuid aee9cb5e-835f-4742-a042-952f699dc883 found in kube manager 2026-03-05 01:45:14,634 - INFO - Pod ctest-pod-13703469 verification passed 2026-03-05 01:45:14,639 - INFO - Pod ctest-pod-33304098 is in running state.Got IP 10.47.255.247 2026-03-05 01:45:14,650 - DEBUG - Pod ctest-pod-33304098 has vmi ede7e78a-1834-11f1-b4c4-fa163e29b957 2026-03-05 01:45:14,650 - INFO - Verified pod ctest-pod-33304098 in contrail-api 2026-03-05 01:45:14,662 - DEBUG - VMI ede7e78a-1834-11f1-b4c4-fa163e29b957 is active in agent 10.0.0.240 2026-03-05 01:45:14,662 - INFO - Verified Pod ctest-pod-33304098 in agent 10.0.0.240 2026-03-05 01:45:14,662 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=7cb9911f-5e10-492a-ac5e-369090e0f645 2026-03-05 01:45:14,666 - INFO - Pod ctest-pod-33304098 with uuid 7cb9911f-5e10-492a-ac5e-369090e0f645 found in kube manager 2026-03-05 01:45:14,667 - INFO - Pod ctest-pod-33304098 verification passed 2026-03-05 01:45:14,678 - DEBUG - Pod ctest-pod-01081847 not in running state.Currently in Pending 2026-03-05 01:45:19,684 - INFO - Pod ctest-pod-01081847 is in running state.Got IP 10.47.255.245 2026-03-05 01:45:19,694 - DEBUG - Pod ctest-pod-01081847 has vmi eecd2778-1834-11f1-b4c4-fa163e29b957 2026-03-05 01:45:19,694 - INFO - Verified pod ctest-pod-01081847 in contrail-api 2026-03-05 01:45:19,705 - DEBUG - VMI eecd2778-1834-11f1-b4c4-fa163e29b957 is active in agent 10.0.0.240 2026-03-05 01:45:19,705 - INFO - Verified Pod ctest-pod-01081847 in agent 10.0.0.240 2026-03-05 01:45:19,705 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=800da67e-862c-4274-aba3-bdf6ccd970a8 2026-03-05 01:45:19,709 - INFO - Pod ctest-pod-01081847 with uuid 800da67e-862c-4274-aba3-bdf6ccd970a8 found in kube manager 2026-03-05 01:45:19,709 - INFO - Pod ctest-pod-01081847 verification passed 2026-03-05 01:45:19,714 - INFO - Pod ctest-pod-63241857 is in running state.Got IP 10.47.255.246 2026-03-05 01:45:19,768 - DEBUG - Pod ctest-pod-63241857 has vmi ee59cfbc-1834-11f1-b4c4-fa163e29b957 2026-03-05 01:45:19,768 - INFO - Verified pod ctest-pod-63241857 in contrail-api 2026-03-05 01:45:19,780 - DEBUG - VMI ee59cfbc-1834-11f1-b4c4-fa163e29b957 is active in agent 10.0.0.240 2026-03-05 01:45:19,781 - INFO - Verified Pod ctest-pod-63241857 in agent 10.0.0.240 2026-03-05 01:45:19,781 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=8991df8b-2668-486d-8fb7-10a0d6b75942 2026-03-05 01:45:19,785 - INFO - Pod ctest-pod-63241857 with uuid 8991df8b-2668-486d-8fb7-10a0d6b75942 found in kube manager 2026-03-05 01:45:19,785 - INFO - Pod ctest-pod-63241857 verification passed 2026-03-05 01:45:19,790 - INFO - Pod ctest-pod-87014062 is in running state.Got IP 10.47.255.244 2026-03-05 01:45:19,843 - DEBUG - Pod ctest-pod-87014062 has vmi ef4bdfe6-1834-11f1-b4c4-fa163e29b957 2026-03-05 01:45:19,843 - INFO - Verified pod ctest-pod-87014062 in contrail-api 2026-03-05 01:45:19,857 - DEBUG - VMI ef4bdfe6-1834-11f1-b4c4-fa163e29b957 is active in agent 10.0.0.240 2026-03-05 01:45:19,857 - INFO - Verified Pod ctest-pod-87014062 in agent 10.0.0.240 2026-03-05 01:45:19,857 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_VirtualMachineDatabaseList?x=c3a9c236-8215-4bfb-83b6-ad5112a400fb 2026-03-05 01:45:19,860 - INFO - Pod ctest-pod-87014062 with uuid c3a9c236-8215-4bfb-83b6-ad5112a400fb found in kube manager 2026-03-05 01:45:19,860 - INFO - Pod ctest-pod-87014062 verification passed 2026-03-05 01:45:19,861 - INFO - ================================================================================ 2026-03-05 01:45:19,861 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2026-03-05 01:45:19,861 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2026-03-05 01:45:20,093 - DEBUG - Nothing to compare xmpp stats {'10.0.0.240': {'10.0.0.27': '0'}} with 2026-03-05 01:45:20,093 - INFO - Initial checks done. Running the testcase now 2026-03-05 01:45:20,093 - INFO - 2026-03-05 01:45:20,158 - DEBUG - [Pod ctest-pod-73053300] Cmd: echo ctest-pod-73053300 > /usr/share/nginx/html/index.html, Output: 2026-03-05 01:45:20,209 - DEBUG - [Pod ctest-pod-42638101] Cmd: echo ctest-pod-42638101 > /usr/share/nginx/html/index.html, Output: 2026-03-05 01:45:20,268 - DEBUG - [Pod ctest-pod-30833125] Cmd: echo ctest-pod-30833125 > /usr/share/nginx/html/index.html, Output: 2026-03-05 01:45:20,331 - DEBUG - [Pod ctest-pod-13703469] Cmd: echo ctest-pod-13703469 > /usr/share/nginx/html/index.html, Output: 2026-03-05 01:45:20,334 - DEBUG - Service ctest-nginx-svc-55517963 not present 2026-03-05 01:45:20,334 - INFO - Creating service ctest-nginx-svc-55517963 2026-03-05 01:45:20,353 - INFO - Created Service ctest-nginx-svc-55517963 2026-03-05 01:45:20,359 - WARNING - Service UUID bbea0924-028b-4e2e-b26f-db365ee1560a not yet found in contrail-api 2026-03-05 01:45:21,404 - INFO - Validated that Service ctest-nginx-svc-55517963 is seen in contrail-api 2026-03-05 01:45:21,404 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_LoadbalancerDatabaseList?x=bbea0924-028b-4e2e-b26f-db365ee1560a 2026-03-05 01:45:21,414 - INFO - Service ctest-nginx-svc-55517963 with uuid bbea0924-028b-4e2e-b26f-db365ee1560a found in kube manager 2026-03-05 01:45:21,414 - INFO - Service ctest-nginx-svc-55517963 verification passed 2026-03-05 01:45:21,483 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-42638101 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:45:21,484 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 passed 2026-03-05 01:45:21,484 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: ctest-pod-42638101 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:45:21,541 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-42638101 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:45:21,541 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 passed 2026-03-05 01:45:21,541 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: ctest-pod-42638101 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:45:21,597 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-73053300 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:45:21,597 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 passed 2026-03-05 01:45:21,597 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: ctest-pod-73053300 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:45:21,597 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-73053300': 1, 'ctest-pod-42638101': 2} 2026-03-05 01:45:21,655 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-73053300 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:45:21,655 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 passed 2026-03-05 01:45:21,655 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: ctest-pod-73053300 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:45:21,704 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-73053300 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:45:21,704 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 passed 2026-03-05 01:45:21,705 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: ctest-pod-73053300 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:45:21,765 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-42638101 2026-03-05 01:45:21,765 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 passed 2026-03-05 01:45:21,765 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-42638101 2026-03-05 01:45:21,766 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-73053300': 2, 'ctest-pod-42638101': 1} 2026-03-05 01:45:21,768 - DEBUG - Network policy ingress-on-service not present 2026-03-05 01:45:21,769 - INFO - Creating Network Policy ingress-on-service 2026-03-05 01:45:21,777 - INFO - Network policy found in k8s 2026-03-05 01:45:21,778 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=38cc724e-c3fb-45bf-b168-097a2989a4e9 2026-03-05 01:45:21,782 - INFO - Network Policy ingress-on-service with uuid 38cc724e-c3fb-45bf-b168-097a2989a4e9 found in kube manager 2026-03-05 01:45:21,806 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2026-03-05 01:45:21,806 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2026-03-05 01:45:21,807 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=38cc724e-c3fb-45bf-b168-097a2989a4e9 2026-03-05 01:45:21,828 - WARNING - Network policy with name ingress-on-service not found in agent 2026-03-05 01:45:23,829 - DEBUG - Requesting: http://10.0.0.27:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=38cc724e-c3fb-45bf-b168-097a2989a4e9 2026-03-05 01:45:23,856 - INFO - Network policy with name ingress-on-service found in agent 2026-03-05 01:45:23,856 - INFO - Network Policy ingress-on-service verification passed 2026-03-05 01:45:28,913 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:45:28,913 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:45:28,913 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:45:33,955 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:45:33,955 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:45:33,955 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:45:39,006 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:45:39,006 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:45:39,006 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:45:44,062 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:45:44,062 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:45:44,062 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:45:49,113 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:45:49,114 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:45:49,114 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:45:54,170 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:45:54,170 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:45:54,170 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:45:59,222 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:45:59,223 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:45:59,223 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:04,274 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:04,274 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:46:04,274 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:09,327 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:09,328 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:46:09,328 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:14,382 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:14,382 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:46:14,382 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:14,382 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-73053300': 0, 'ctest-pod-42638101': 0} 2026-03-05 01:46:14,457 - DEBUG - [Pod ctest-pod-63241857] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-73053300 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:46:14,458 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 passed 2026-03-05 01:46:14,458 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd output: ctest-pod-73053300 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:46:14,513 - DEBUG - [Pod ctest-pod-63241857] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-42638101 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:46:14,513 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 passed 2026-03-05 01:46:14,513 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd output: ctest-pod-42638101 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:46:14,513 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-73053300': 1, 'ctest-pod-42638101': 1} 2026-03-05 01:46:19,568 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:19,568 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:46:19,568 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:24,626 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:24,626 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:46:24,626 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:29,678 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:29,678 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:46:29,678 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:34,723 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:34,723 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:46:34,723 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:39,770 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:39,770 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:46:39,770 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:44,819 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:44,819 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:46:44,819 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:49,866 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:49,866 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:46:49,866 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:54,918 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:54,918 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:46:54,918 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:59,971 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:46:59,972 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:46:59,972 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:05,025 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:05,026 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:47:05,026 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:05,026 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-73053300': 0, 'ctest-pod-42638101': 0} 2026-03-05 01:47:07,084 - DEBUG - [Pod ctest-pod-63241857] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.471 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.088 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.209/0.471 ms 2026-03-05 01:47:07,084 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-63241857 with expectation True passed 2026-03-05 01:47:09,134 - DEBUG - [Pod ctest-pod-33304098] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.892 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.346/0.892 ms 2026-03-05 01:47:09,134 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-33304098 with expectation True passed 2026-03-05 01:47:11,186 - DEBUG - [Pod ctest-pod-01081847] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.670 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.070/0.273/0.670 ms 2026-03-05 01:47:11,186 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01081847 with expectation True passed 2026-03-05 01:47:11,241 - DEBUG - [Pod ctest-pod-63241857] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-73053300 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:47:11,241 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed 2026-03-05 01:47:11,241 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd output: ctest-pod-73053300 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:47:11,241 - INFO - wget check of of http://10.47.255.251 from ctest-pod-63241857 passed 2026-03-05 01:47:11,296 - DEBUG - [Pod ctest-pod-63241857] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-42638101 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:47:11,296 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-05 01:47:11,296 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd output: ctest-pod-42638101 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:47:11,296 - INFO - wget check of of http://10.47.255.250 from ctest-pod-63241857 passed 2026-03-05 01:47:16,370 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-03-05 01:47:16,371 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed. 2026-03-05 01:47:16,371 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-03-05 01:47:16,371 - INFO - wget check of of http://10.47.255.250 from ctest-pod-33304098 passed 2026-03-05 01:47:21,429 - DEBUG - [Pod ctest-pod-87014062] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-03-05 01:47:21,429 - DEBUG - [Pod Pod ctest-pod-87014062] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 failed. 2026-03-05 01:47:21,429 - DEBUG - [Pod Pod ctest-pod-87014062] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2026-03-05 01:47:21,429 - INFO - wget check of of http://10.47.255.251 from ctest-pod-87014062 passed 2026-03-05 01:47:21,439 - INFO - Updating Network Policy ingress-on-service 2026-03-05 01:47:26,501 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:26,502 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:47:26,502 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:31,555 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:31,556 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:47:31,556 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:36,607 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:36,607 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:47:36,607 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:41,658 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:41,658 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:47:41,658 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:46,705 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:46,706 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:47:46,706 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:51,759 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:51,759 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:47:51,759 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:56,805 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:47:56,805 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:47:56,806 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:48:01,858 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:48:01,858 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:48:01,858 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:48:06,905 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:48:06,906 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:48:06,906 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:48:11,961 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:48:11,962 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 failed. 2026-03-05 01:48:11,962 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.97.79.251:80 (10.97.79.251:80) wget: download timed out 2026-03-05 01:48:11,962 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-73053300': 0, 'ctest-pod-42638101': 0} 2026-03-05 01:48:12,022 - DEBUG - [Pod ctest-pod-63241857] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-42638101 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:12,022 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 passed 2026-03-05 01:48:12,022 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd output: ctest-pod-42638101 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:12,057 - DEBUG - [Pod ctest-pod-63241857] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-42638101 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:12,057 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 passed 2026-03-05 01:48:12,057 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd output: ctest-pod-42638101 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:12,108 - DEBUG - [Pod ctest-pod-63241857] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-73053300 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:12,108 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 passed 2026-03-05 01:48:12,108 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd output: ctest-pod-73053300 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:12,108 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-73053300': 1, 'ctest-pod-42638101': 2} 2026-03-05 01:48:12,160 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-73053300 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:12,160 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 passed 2026-03-05 01:48:12,160 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: ctest-pod-73053300 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:12,226 - DEBUG - [Pod ctest-pod-01081847] Cmd: wget http://10.97.79.251:80/ -O - -T 5 -t 1 , Output: ctest-pod-42638101 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:12,226 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd wget http://10.97.79.251:80/ -O - -T 5 -t 1 passed 2026-03-05 01:48:12,226 - DEBUG - [Pod Pod ctest-pod-01081847] Cmd output: ctest-pod-42638101 Connecting to 10.97.79.251:80 (10.97.79.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:12,226 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-73053300': 1, 'ctest-pod-42638101': 1} 2026-03-05 01:48:14,270 - DEBUG - [Pod ctest-pod-63241857] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.797 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.073 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.083 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.073/0.317/0.797 ms 2026-03-05 01:48:14,270 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-63241857 with expectation True passed 2026-03-05 01:48:16,325 - DEBUG - [Pod ctest-pod-33304098] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.009 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.066 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.062 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.062/0.379/1.009 ms 2026-03-05 01:48:16,325 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-33304098 with expectation True passed 2026-03-05 01:48:18,374 - DEBUG - [Pod ctest-pod-01081847] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.899 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.094 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.069/0.354/0.899 ms 2026-03-05 01:48:18,374 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-01081847 with expectation True passed 2026-03-05 01:48:18,451 - DEBUG - [Pod ctest-pod-63241857] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-73053300 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:18,451 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed 2026-03-05 01:48:18,451 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd output: ctest-pod-73053300 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:18,451 - INFO - wget check of of http://10.47.255.251 from ctest-pod-63241857 passed 2026-03-05 01:48:18,507 - DEBUG - [Pod ctest-pod-63241857] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: ctest-pod-42638101 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:18,507 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 passed 2026-03-05 01:48:18,507 - DEBUG - [Pod Pod ctest-pod-63241857] Cmd output: ctest-pod-42638101 Connecting to 10.47.255.250 (10.47.255.250:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:18,507 - INFO - wget check of of http://10.47.255.250 from ctest-pod-63241857 passed 2026-03-05 01:48:23,554 - DEBUG - [Pod ctest-pod-33304098] Cmd: wget http://10.47.255.250 -O - -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-03-05 01:48:23,554 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd wget http://10.47.255.250 -O - -T 5 -t 1 failed. 2026-03-05 01:48:23,554 - DEBUG - [Pod Pod ctest-pod-33304098] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2026-03-05 01:48:23,554 - INFO - wget check of of http://10.47.255.250 from ctest-pod-33304098 passed 2026-03-05 01:48:23,607 - DEBUG - [Pod ctest-pod-87014062] Cmd: wget http://10.47.255.251 -O - -T 5 -t 1 , Output: ctest-pod-73053300 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:23,607 - DEBUG - [Pod Pod ctest-pod-87014062] Cmd wget http://10.47.255.251 -O - -T 5 -t 1 passed 2026-03-05 01:48:23,607 - DEBUG - [Pod Pod ctest-pod-87014062] Cmd output: ctest-pod-73053300 Connecting to 10.47.255.251 (10.47.255.251:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2026-03-05 01:48:23,607 - INFO - wget check of of http://10.47.255.251 from ctest-pod-87014062 passed 2026-03-05 01:48:23,607 - INFO - Deleting Network Policy : ingress-on-service 2026-03-05 01:48:23,608 - INFO - Deleting service : ctest-nginx-svc-55517963 2026-03-05 01:48:23,837 - DEBUG - No XMPP flaps were noticed during the test 2026-03-05 01:48:23,837 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:04] 2026-03-05 01:48:23,837 - INFO - -------------------------------------------------------------------------------- 2026-03-05 01:48:23,841 - INFO - Deleting pod ctest-new-default-90892559:ctest-pod-73053300 2026-03-05 01:48:23,841 - INFO - Deleting pod ctest-new-default-90892559:ctest-pod-42638101 2026-03-05 01:48:23,842 - INFO - Deleting pod ctest-non-default-96682546:ctest-pod-30833125 2026-03-05 01:48:23,842 - INFO - Deleting pod ctest-non-default-96682546:ctest-pod-13703469 2026-03-05 01:48:23,842 - INFO - Deleting pod ctest-new-default-90892559:ctest-pod-33304098 2026-03-05 01:48:23,843 - INFO - Deleting pod ctest-new-default-90892559:ctest-pod-63241857 2026-03-05 01:48:23,843 - INFO - Deleting pod ctest-non-default-96682546:ctest-pod-01081847 2026-03-05 01:48:23,843 - INFO - Deleting pod ctest-non-default-96682546:ctest-pod-87014062 2026-03-05 01:48:23,955 - WARNING - Pod uuid c3a9c236-8215-4bfb-83b6-ad5112a400fb is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:23,956 - WARNING - Pod uuid 7cb9911f-5e10-492a-ac5e-369090e0f645 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:23,957 - WARNING - Pod uuid 800da67e-862c-4274-aba3-bdf6ccd970a8 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:23,957 - WARNING - Pod uuid aee9cb5e-835f-4742-a042-952f699dc883 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:23,957 - WARNING - Pod uuid e29aabe1-6319-4139-b8ce-b2050209ce90 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:23,958 - WARNING - Pod uuid c96dc270-95c0-44c9-834e-372657665bbe is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:23,958 - WARNING - Pod uuid fd24100e-fa74-4dea-a7fa-82c0747339e3 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:23,958 - WARNING - Pod uuid 8991df8b-2668-486d-8fb7-10a0d6b75942 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:28,985 - DEBUG - Pod e29aabe1-6319-4139-b8ce-b2050209ce90 is not in agent 10.0.0.240 VM list 2026-03-05 01:48:28,986 - WARNING - Pod uuid 7cb9911f-5e10-492a-ac5e-369090e0f645 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:28,986 - WARNING - Pod uuid 800da67e-862c-4274-aba3-bdf6ccd970a8 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:28,987 - WARNING - Pod uuid c3a9c236-8215-4bfb-83b6-ad5112a400fb is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:28,987 - DEBUG - Pod fd24100e-fa74-4dea-a7fa-82c0747339e3 is not in agent 10.0.0.240 VM list 2026-03-05 01:48:28,988 - WARNING - Pod uuid 8991df8b-2668-486d-8fb7-10a0d6b75942 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:28,988 - DEBUG - Pod aee9cb5e-835f-4742-a042-952f699dc883 is not in agent 10.0.0.240 VM list 2026-03-05 01:48:28,990 - DEBUG - Pod c96dc270-95c0-44c9-834e-372657665bbe is not in agent 10.0.0.240 VM list 2026-03-05 01:48:29,005 - DEBUG - VMI ecdd4592-1834-11f1-b4c4-fa163e29b957 is removed from agent 10.0.0.240 2026-03-05 01:48:29,005 - INFO - Verified that pod ctest-pod-30833125 is removed in agent 2026-03-05 01:48:29,006 - DEBUG - VMI ebe304f6-1834-11f1-b4c4-fa163e29b957 is removed from agent 10.0.0.240 2026-03-05 01:48:29,006 - INFO - Verified that pod ctest-pod-73053300 is removed in agent 2026-03-05 01:48:29,007 - DEBUG - VMI ec53d50a-1834-11f1-b4c4-fa163e29b957 is removed from agent 10.0.0.240 2026-03-05 01:48:29,007 - INFO - Verified that pod ctest-pod-42638101 is removed in agent 2026-03-05 01:48:29,007 - DEBUG - VMI ed5962d0-1834-11f1-b4c4-fa163e29b957 is removed from agent 10.0.0.240 2026-03-05 01:48:29,007 - INFO - Verified that pod ctest-pod-13703469 is removed in agent 2026-03-05 01:48:34,006 - WARNING - Pod uuid 7cb9911f-5e10-492a-ac5e-369090e0f645 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:34,007 - WARNING - Pod uuid c3a9c236-8215-4bfb-83b6-ad5112a400fb is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:34,008 - WARNING - Pod uuid 8991df8b-2668-486d-8fb7-10a0d6b75942 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:34,008 - WARNING - Pod uuid 800da67e-862c-4274-aba3-bdf6ccd970a8 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:39,019 - WARNING - Pod uuid 7cb9911f-5e10-492a-ac5e-369090e0f645 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:39,021 - WARNING - Pod uuid 800da67e-862c-4274-aba3-bdf6ccd970a8 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:39,021 - WARNING - Pod uuid 8991df8b-2668-486d-8fb7-10a0d6b75942 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:39,021 - WARNING - Pod uuid c3a9c236-8215-4bfb-83b6-ad5112a400fb is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:44,032 - WARNING - Pod uuid 800da67e-862c-4274-aba3-bdf6ccd970a8 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:44,033 - WARNING - Pod uuid c3a9c236-8215-4bfb-83b6-ad5112a400fb is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:44,033 - WARNING - Pod uuid 8991df8b-2668-486d-8fb7-10a0d6b75942 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:44,034 - WARNING - Pod uuid 7cb9911f-5e10-492a-ac5e-369090e0f645 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:49,049 - WARNING - Pod uuid 7cb9911f-5e10-492a-ac5e-369090e0f645 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:49,050 - WARNING - Pod uuid c3a9c236-8215-4bfb-83b6-ad5112a400fb is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:49,051 - WARNING - Pod uuid 8991df8b-2668-486d-8fb7-10a0d6b75942 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:49,051 - WARNING - Pod uuid 800da67e-862c-4274-aba3-bdf6ccd970a8 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:54,094 - WARNING - Pod uuid 7cb9911f-5e10-492a-ac5e-369090e0f645 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:54,097 - WARNING - Pod uuid c3a9c236-8215-4bfb-83b6-ad5112a400fb is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:54,098 - WARNING - Pod uuid 8991df8b-2668-486d-8fb7-10a0d6b75942 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:54,098 - WARNING - Pod uuid 800da67e-862c-4274-aba3-bdf6ccd970a8 is still seen in agent 10.0.0.240 VM list 2026-03-05 01:48:59,102 - DEBUG - Pod 7cb9911f-5e10-492a-ac5e-369090e0f645 is not in agent 10.0.0.240 VM list 2026-03-05 01:48:59,112 - DEBUG - Pod 8991df8b-2668-486d-8fb7-10a0d6b75942 is not in agent 10.0.0.240 VM list 2026-03-05 01:48:59,113 - DEBUG - Pod c3a9c236-8215-4bfb-83b6-ad5112a400fb is not in agent 10.0.0.240 VM list 2026-03-05 01:48:59,115 - DEBUG - Pod 800da67e-862c-4274-aba3-bdf6ccd970a8 is not in agent 10.0.0.240 VM list 2026-03-05 01:48:59,116 - DEBUG - VMI ede7e78a-1834-11f1-b4c4-fa163e29b957 is removed from agent 10.0.0.240 2026-03-05 01:48:59,116 - INFO - Verified that pod ctest-pod-33304098 is removed in agent 2026-03-05 01:48:59,123 - DEBUG - VMI ee59cfbc-1834-11f1-b4c4-fa163e29b957 is removed from agent 10.0.0.240 2026-03-05 01:48:59,123 - INFO - Verified that pod ctest-pod-63241857 is removed in agent 2026-03-05 01:48:59,124 - DEBUG - VMI eecd2778-1834-11f1-b4c4-fa163e29b957 is removed from agent 10.0.0.240 2026-03-05 01:48:59,124 - INFO - Verified that pod ctest-pod-01081847 is removed in agent 2026-03-05 01:48:59,124 - DEBUG - VMI ef4bdfe6-1834-11f1-b4c4-fa163e29b957 is removed from agent 10.0.0.240 2026-03-05 01:48:59,124 - INFO - Verified that pod ctest-pod-87014062 is removed in agent 2026-03-05 01:48:59,124 - INFO - Deleting namespace ctest-non-default-96682546 2026-03-05 01:48:59,132 - DEBUG - Namespace ctest-non-default-96682546 still in k8s 2026-03-05 01:49:01,136 - DEBUG - Namespace ctest-non-default-96682546 still in k8s 2026-03-05 01:49:03,140 - DEBUG - Namespace ctest-non-default-96682546 still in k8s 2026-03-05 01:49:05,144 - DEBUG - Namespace ctest-non-default-96682546 is not in k8s 2026-03-05 01:49:05,144 - DEBUG - No need to check project deletion in contrail-api 2026-03-05 01:49:05,144 - INFO - Deleting namespace ctest-new-default-90892559 2026-03-05 01:49:05,158 - DEBUG - Namespace ctest-new-default-90892559 still in k8s 2026-03-05 01:49:07,162 - DEBUG - Namespace ctest-new-default-90892559 still in k8s 2026-03-05 01:49:09,165 - DEBUG - Namespace ctest-new-default-90892559 still in k8s 2026-03-05 01:49:11,169 - DEBUG - Namespace ctest-new-default-90892559 is not in k8s 2026-03-05 01:49:11,169 - DEBUG - No need to check project deletion in contrail-api