2025-05-28 18:37:49,393 - INFO - Using existing project ['default-domain', 'k8s-default'](49e7b080-a5d1-45e6-8ef3-1ddfe1ebbbf1) 2025-05-28 18:37:49,411 - DEBUG - Namespace ctest-new-default-21928649 not present 2025-05-28 18:37:49,418 - INFO - Created namespace ctest-new-default-21928649 2025-05-28 18:37:52,422 - DEBUG - Namespace ctest-non-default-08749424 not present 2025-05-28 18:37:52,429 - INFO - Created namespace ctest-non-default-08749424 2025-05-28 18:37:55,446 - DEBUG - Pod ctest-pod-67271962 not present 2025-05-28 18:37:55,446 - INFO - Creating Pod ctest-pod-67271962 2025-05-28 18:37:55,466 - DEBUG - Node for Pod ctest-pod-67271962 not yet populated 2025-05-28 18:37:58,474 - DEBUG - Pod : ctest-pod-67271962 UUID is 084485ef-ac15-4c0e-94e1-5790cef5b1bf 2025-05-28 18:37:58,477 - DEBUG - Pod ctest-pod-94730292 not present 2025-05-28 18:37:58,477 - INFO - Creating Pod ctest-pod-94730292 2025-05-28 18:37:58,495 - DEBUG - Pod : ctest-pod-94730292 UUID is e8df4cf3-1ad1-4748-9bb2-46b0690418d3 2025-05-28 18:37:58,500 - DEBUG - Pod ctest-pod-80074052 not present 2025-05-28 18:37:58,500 - INFO - Creating Pod ctest-pod-80074052 2025-05-28 18:37:58,537 - DEBUG - Pod : ctest-pod-80074052 UUID is 8fba448b-de29-463a-9c3c-eb59144e70b3 2025-05-28 18:37:58,542 - DEBUG - Pod ctest-pod-28483877 not present 2025-05-28 18:37:58,542 - INFO - Creating Pod ctest-pod-28483877 2025-05-28 18:37:58,561 - DEBUG - Pod : ctest-pod-28483877 UUID is 6c5c94cf-eb9d-4c21-867e-7e52010160fb 2025-05-28 18:37:58,572 - DEBUG - Pod ctest-pod-87940678 not present 2025-05-28 18:37:58,573 - INFO - Creating Pod ctest-pod-87940678 2025-05-28 18:37:58,593 - DEBUG - Pod : ctest-pod-87940678 UUID is dd1955cc-e93a-489d-a7de-d57d7002263c 2025-05-28 18:37:58,596 - DEBUG - Pod ctest-pod-75931456 not present 2025-05-28 18:37:58,596 - INFO - Creating Pod ctest-pod-75931456 2025-05-28 18:37:58,617 - DEBUG - Pod : ctest-pod-75931456 UUID is ac84dc6d-f6ed-4b29-895e-fc8c74071271 2025-05-28 18:37:58,621 - DEBUG - Pod ctest-pod-59769844 not present 2025-05-28 18:37:58,621 - INFO - Creating Pod ctest-pod-59769844 2025-05-28 18:37:58,646 - DEBUG - Pod : ctest-pod-59769844 UUID is e7b8e984-be43-4d4c-897f-cf59ccb00110 2025-05-28 18:37:58,650 - DEBUG - Pod ctest-pod-69934473 not present 2025-05-28 18:37:58,650 - INFO - Creating Pod ctest-pod-69934473 2025-05-28 18:37:58,674 - DEBUG - Pod : ctest-pod-69934473 UUID is 1435ff60-5b0d-4531-8b48-4f50ca281c9f 2025-05-28 18:37:58,922 - INFO - Project default-domain:k8s-ctest-new-default-21928649 for Namespace ctest-new-default-21928649 is seen in contrail-api 2025-05-28 18:37:58,922 - DEBUG - Project uuid in Contrail is 1a57c5e2-879c-4b45-872d-8792cd24b3ca 2025-05-28 18:37:59,176 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=fe65eb13-f497-4170-a4a8-f4a4825877fd 2025-05-28 18:37:59,181 - INFO - Namespace ctest-new-default-21928649 with uuid fe65eb13-f497-4170-a4a8-f4a4825877fd found in kube manager 2025-05-28 18:37:59,181 - INFO - Namespace ctest-new-default-21928649 verification passed 2025-05-28 18:37:59,347 - INFO - Project default-domain:k8s-ctest-non-default-08749424 for Namespace ctest-non-default-08749424 is seen in contrail-api 2025-05-28 18:37:59,347 - DEBUG - Project uuid in Contrail is 00e71e06-4248-4229-a30d-046deb7e49d9 2025-05-28 18:37:59,347 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=3e63f527-2cc4-459b-b238-c8af98af9f6f 2025-05-28 18:37:59,354 - INFO - Namespace ctest-non-default-08749424 with uuid 3e63f527-2cc4-459b-b238-c8af98af9f6f found in kube manager 2025-05-28 18:37:59,354 - INFO - Namespace ctest-non-default-08749424 verification passed 2025-05-28 18:37:59,359 - DEBUG - Pod ctest-pod-67271962 not in running state.Currently in Pending 2025-05-28 18:38:04,367 - DEBUG - Pod ctest-pod-67271962 not in running state.Currently in Pending 2025-05-28 18:38:09,373 - INFO - Pod ctest-pod-67271962 is in running state.Got IP 10.47.255.251 2025-05-28 18:38:09,431 - DEBUG - Pod ctest-pod-67271962 has vmi dfbc50f2-3bf2-11f0-a825-fa163ed2d7a3 2025-05-28 18:38:09,431 - INFO - Verified pod ctest-pod-67271962 in contrail-api 2025-05-28 18:38:09,445 - DEBUG - VMI dfbc50f2-3bf2-11f0-a825-fa163ed2d7a3 is active in agent 10.0.0.33 2025-05-28 18:38:09,445 - INFO - Verified Pod ctest-pod-67271962 in agent 10.0.0.33 2025-05-28 18:38:09,446 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=084485ef-ac15-4c0e-94e1-5790cef5b1bf 2025-05-28 18:38:09,450 - INFO - Pod ctest-pod-67271962 with uuid 084485ef-ac15-4c0e-94e1-5790cef5b1bf found in kube manager 2025-05-28 18:38:09,450 - INFO - Pod ctest-pod-67271962 verification passed 2025-05-28 18:38:09,456 - INFO - Pod ctest-pod-94730292 is in running state.Got IP 10.47.255.250 2025-05-28 18:38:09,470 - DEBUG - Pod ctest-pod-94730292 has vmi e0c1b302-3bf2-11f0-a825-fa163ed2d7a3 2025-05-28 18:38:09,470 - INFO - Verified pod ctest-pod-94730292 in contrail-api 2025-05-28 18:38:09,482 - DEBUG - VMI e0c1b302-3bf2-11f0-a825-fa163ed2d7a3 is active in agent 10.0.0.33 2025-05-28 18:38:09,483 - INFO - Verified Pod ctest-pod-94730292 in agent 10.0.0.33 2025-05-28 18:38:09,483 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=e8df4cf3-1ad1-4748-9bb2-46b0690418d3 2025-05-28 18:38:09,487 - INFO - Pod ctest-pod-94730292 with uuid e8df4cf3-1ad1-4748-9bb2-46b0690418d3 found in kube manager 2025-05-28 18:38:09,488 - INFO - Pod ctest-pod-94730292 verification passed 2025-05-28 18:38:09,493 - DEBUG - Pod ctest-pod-80074052 not in running state.Currently in Pending 2025-05-28 18:38:14,499 - INFO - Pod ctest-pod-80074052 is in running state.Got IP 10.47.255.249 2025-05-28 18:38:14,559 - DEBUG - Pod ctest-pod-80074052 has vmi e17cb706-3bf2-11f0-a825-fa163ed2d7a3 2025-05-28 18:38:14,559 - INFO - Verified pod ctest-pod-80074052 in contrail-api 2025-05-28 18:38:14,574 - DEBUG - VMI e17cb706-3bf2-11f0-a825-fa163ed2d7a3 is active in agent 10.0.0.33 2025-05-28 18:38:14,574 - INFO - Verified Pod ctest-pod-80074052 in agent 10.0.0.33 2025-05-28 18:38:14,574 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=8fba448b-de29-463a-9c3c-eb59144e70b3 2025-05-28 18:38:14,578 - INFO - Pod ctest-pod-80074052 with uuid 8fba448b-de29-463a-9c3c-eb59144e70b3 found in kube manager 2025-05-28 18:38:14,579 - INFO - Pod ctest-pod-80074052 verification passed 2025-05-28 18:38:14,585 - INFO - Pod ctest-pod-28483877 is in running state.Got IP 10.47.255.248 2025-05-28 18:38:14,599 - DEBUG - Pod ctest-pod-28483877 has vmi e1f93790-3bf2-11f0-a825-fa163ed2d7a3 2025-05-28 18:38:14,599 - INFO - Verified pod ctest-pod-28483877 in contrail-api 2025-05-28 18:38:14,611 - DEBUG - VMI e1f93790-3bf2-11f0-a825-fa163ed2d7a3 is active in agent 10.0.0.33 2025-05-28 18:38:14,611 - INFO - Verified Pod ctest-pod-28483877 in agent 10.0.0.33 2025-05-28 18:38:14,611 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=6c5c94cf-eb9d-4c21-867e-7e52010160fb 2025-05-28 18:38:14,616 - INFO - Pod ctest-pod-28483877 with uuid 6c5c94cf-eb9d-4c21-867e-7e52010160fb found in kube manager 2025-05-28 18:38:14,616 - INFO - Pod ctest-pod-28483877 verification passed 2025-05-28 18:38:14,623 - INFO - Pod ctest-pod-87940678 is in running state.Got IP 10.47.255.247 2025-05-28 18:38:14,680 - DEBUG - Pod ctest-pod-87940678 has vmi e287901c-3bf2-11f0-a825-fa163ed2d7a3 2025-05-28 18:38:14,680 - INFO - Verified pod ctest-pod-87940678 in contrail-api 2025-05-28 18:38:14,692 - DEBUG - VMI e287901c-3bf2-11f0-a825-fa163ed2d7a3 is active in agent 10.0.0.33 2025-05-28 18:38:14,693 - INFO - Verified Pod ctest-pod-87940678 in agent 10.0.0.33 2025-05-28 18:38:14,693 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=dd1955cc-e93a-489d-a7de-d57d7002263c 2025-05-28 18:38:14,697 - INFO - Pod ctest-pod-87940678 with uuid dd1955cc-e93a-489d-a7de-d57d7002263c found in kube manager 2025-05-28 18:38:14,697 - INFO - Pod ctest-pod-87940678 verification passed 2025-05-28 18:38:14,703 - INFO - Pod ctest-pod-59769844 is in running state.Got IP 10.47.255.245 2025-05-28 18:38:14,759 - DEBUG - Pod ctest-pod-59769844 has vmi e389a14e-3bf2-11f0-a825-fa163ed2d7a3 2025-05-28 18:38:14,759 - INFO - Verified pod ctest-pod-59769844 in contrail-api 2025-05-28 18:38:14,774 - DEBUG - VMI e389a14e-3bf2-11f0-a825-fa163ed2d7a3 is active in agent 10.0.0.33 2025-05-28 18:38:14,774 - INFO - Verified Pod ctest-pod-59769844 in agent 10.0.0.33 2025-05-28 18:38:14,774 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=e7b8e984-be43-4d4c-897f-cf59ccb00110 2025-05-28 18:38:14,779 - INFO - Pod ctest-pod-59769844 with uuid e7b8e984-be43-4d4c-897f-cf59ccb00110 found in kube manager 2025-05-28 18:38:14,779 - INFO - Pod ctest-pod-59769844 verification passed 2025-05-28 18:38:14,848 - INFO - Pod ctest-pod-75931456 is in running state.Got IP 10.47.255.246 2025-05-28 18:38:14,861 - DEBUG - Pod ctest-pod-75931456 has vmi e3126336-3bf2-11f0-a825-fa163ed2d7a3 2025-05-28 18:38:14,861 - INFO - Verified pod ctest-pod-75931456 in contrail-api 2025-05-28 18:38:14,875 - DEBUG - VMI e3126336-3bf2-11f0-a825-fa163ed2d7a3 is active in agent 10.0.0.33 2025-05-28 18:38:14,875 - INFO - Verified Pod ctest-pod-75931456 in agent 10.0.0.33 2025-05-28 18:38:14,875 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=ac84dc6d-f6ed-4b29-895e-fc8c74071271 2025-05-28 18:38:14,880 - INFO - Pod ctest-pod-75931456 with uuid ac84dc6d-f6ed-4b29-895e-fc8c74071271 found in kube manager 2025-05-28 18:38:14,880 - INFO - Pod ctest-pod-75931456 verification passed 2025-05-28 18:38:14,885 - INFO - Pod ctest-pod-69934473 is in running state.Got IP 10.47.255.244 2025-05-28 18:38:14,959 - DEBUG - Pod ctest-pod-69934473 has vmi e4056fc2-3bf2-11f0-a825-fa163ed2d7a3 2025-05-28 18:38:14,959 - INFO - Verified pod ctest-pod-69934473 in contrail-api 2025-05-28 18:38:14,971 - DEBUG - VMI e4056fc2-3bf2-11f0-a825-fa163ed2d7a3 is active in agent 10.0.0.33 2025-05-28 18:38:14,972 - INFO - Verified Pod ctest-pod-69934473 in agent 10.0.0.33 2025-05-28 18:38:14,972 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=1435ff60-5b0d-4531-8b48-4f50ca281c9f 2025-05-28 18:38:14,977 - INFO - Pod ctest-pod-69934473 with uuid 1435ff60-5b0d-4531-8b48-4f50ca281c9f found in kube manager 2025-05-28 18:38:14,977 - INFO - Pod ctest-pod-69934473 verification passed 2025-05-28 18:38:14,977 - INFO - ================================================================================ 2025-05-28 18:38:14,977 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-05-28 18:38:14,977 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-05-28 18:38:15,209 - DEBUG - Nothing to compare xmpp stats {'10.0.0.33': {'10.0.0.50': '0'}} with 2025-05-28 18:38:15,210 - INFO - Initial checks done. Running the testcase now 2025-05-28 18:38:15,210 - INFO - 2025-05-28 18:38:15,291 - DEBUG - [Pod ctest-pod-67271962] Cmd: echo ctest-pod-67271962 > /usr/share/nginx/html/index.html, Output: 2025-05-28 18:38:15,395 - DEBUG - [Pod ctest-pod-94730292] Cmd: echo ctest-pod-94730292 > /usr/share/nginx/html/index.html, Output: 2025-05-28 18:38:15,453 - DEBUG - [Pod ctest-pod-80074052] Cmd: echo ctest-pod-80074052 > /usr/share/nginx/html/index.html, Output: 2025-05-28 18:38:15,517 - DEBUG - [Pod ctest-pod-28483877] Cmd: echo ctest-pod-28483877 > /usr/share/nginx/html/index.html, Output: 2025-05-28 18:38:15,520 - DEBUG - Service ctest-nginx-svc-73023549 not present 2025-05-28 18:38:15,520 - INFO - Creating service ctest-nginx-svc-73023549 2025-05-28 18:38:15,551 - INFO - Created Service ctest-nginx-svc-73023549 2025-05-28 18:38:15,565 - WARNING - Service UUID 456b2193-2c44-4c1f-970e-d8a6ea657006 not yet found in contrail-api 2025-05-28 18:38:16,571 - INFO - Validated that Service ctest-nginx-svc-73023549 is seen in contrail-api 2025-05-28 18:38:16,572 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=456b2193-2c44-4c1f-970e-d8a6ea657006 2025-05-28 18:38:16,579 - INFO - Service ctest-nginx-svc-73023549 with uuid 456b2193-2c44-4c1f-970e-d8a6ea657006 found in kube manager 2025-05-28 18:38:16,579 - INFO - Service ctest-nginx-svc-73023549 verification passed 2025-05-28 18:38:17,657 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94730292 2025-05-28 18:38:17,657 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:38:17,657 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94730292 2025-05-28 18:38:17,700 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:38:17,700 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:38:17,700 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:38:17,700 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67271962': 1, 'ctest-pod-94730292': 1} 2025-05-28 18:38:17,748 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:38:17,748 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:38:17,748 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:38:17,801 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:38:17,801 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:38:17,801 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:38:17,851 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:38:17,851 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:38:17,851 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:38:17,884 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:38:17,884 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:38:17,884 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:38:17,945 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: ctest-pod-94730292 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:38:17,945 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:38:17,945 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: ctest-pod-94730292 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:38:17,945 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67271962': 4, 'ctest-pod-94730292': 1} 2025-05-28 18:38:17,948 - DEBUG - Network policy ingress-on-service not present 2025-05-28 18:38:17,949 - INFO - Creating Network Policy ingress-on-service 2025-05-28 18:38:17,960 - INFO - Network policy found in k8s 2025-05-28 18:38:17,960 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=567f0109-f2b7-4318-9db0-08a19e92b3ef 2025-05-28 18:38:17,965 - INFO - Network Policy ingress-on-service with uuid 567f0109-f2b7-4318-9db0-08a19e92b3ef found in kube manager 2025-05-28 18:38:17,996 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-05-28 18:38:17,996 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-05-28 18:38:17,996 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=567f0109-f2b7-4318-9db0-08a19e92b3ef 2025-05-28 18:38:18,025 - WARNING - Network policy with name ingress-on-service not found in agent 2025-05-28 18:38:20,026 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=567f0109-f2b7-4318-9db0-08a19e92b3ef 2025-05-28 18:38:20,057 - INFO - Network policy with name ingress-on-service found in agent 2025-05-28 18:38:20,057 - INFO - Network Policy ingress-on-service verification passed 2025-05-28 18:38:25,109 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:25,109 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:25,109 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:30,165 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:30,165 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:30,165 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:35,223 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:35,223 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:35,223 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:40,274 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:40,274 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:40,274 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:45,329 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:45,329 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:45,329 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:50,378 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:50,378 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:50,378 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:55,434 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:55,434 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:38:55,434 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:00,482 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:00,482 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:00,482 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:05,529 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:05,529 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:05,529 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:10,585 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:10,585 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:10,585 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:10,585 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67271962': 0, 'ctest-pod-94730292': 0} 2025-05-28 18:39:10,636 - DEBUG - [Pod ctest-pod-75931456] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: ctest-pod-94730292 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:39:10,637 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:39:10,637 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd output: ctest-pod-94730292 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:39:10,687 - DEBUG - [Pod ctest-pod-75931456] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94730292 2025-05-28 18:39:10,687 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:39:10,687 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94730292 2025-05-28 18:39:10,735 - DEBUG - [Pod ctest-pod-75931456] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:39:10,735 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:39:10,735 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:39:10,735 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67271962': 1, 'ctest-pod-94730292': 2} 2025-05-28 18:39:15,781 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:15,781 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:15,781 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:20,832 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:20,833 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:20,833 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:25,880 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:25,880 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:25,880 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:30,935 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:30,935 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:30,935 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:35,983 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:35,985 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:35,985 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:41,037 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:41,037 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:41,037 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:46,089 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:46,089 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:46,089 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:51,141 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:51,141 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:51,142 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:56,194 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:56,194 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:39:56,194 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:01,237 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:01,237 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:01,237 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:01,237 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67271962': 0, 'ctest-pod-94730292': 0} 2025-05-28 18:40:03,289 - DEBUG - [Pod ctest-pod-75931456] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.599 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.059 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.057 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.057/0.238/0.599 ms 2025-05-28 18:40:03,289 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-75931456 with expectation True passed 2025-05-28 18:40:05,342 - DEBUG - [Pod ctest-pod-87940678] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.840 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.079 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.330/0.840 ms 2025-05-28 18:40:05,342 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-87940678 with expectation True passed 2025-05-28 18:40:07,393 - DEBUG - [Pod ctest-pod-59769844] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.145 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.052 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.061 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.052/0.419/1.145 ms 2025-05-28 18:40:07,393 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-59769844 with expectation True passed 2025-05-28 18:40:07,452 - DEBUG - [Pod ctest-pod-75931456] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 18:40:07,452 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-28 18:40:07,452 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 18:40:07,452 - INFO - wget check of of http://10.47.255.251 from ctest-pod-75931456 passed 2025-05-28 18:40:07,515 - DEBUG - [Pod ctest-pod-75931456] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 18:40:07,515 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-28 18:40:07,515 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 18:40:07,515 - INFO - wget check of of http://10.47.255.250 from ctest-pod-75931456 passed 2025-05-28 18:40:11,147 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-05-28 18:40:21,204 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-28 18:40:21,205 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-28 18:40:21,205 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-28 18:40:21,205 - INFO - wget check of of http://10.47.255.250 from ctest-pod-87940678 passed 2025-05-28 18:40:26,254 - DEBUG - [Pod ctest-pod-69934473] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-28 18:40:26,254 - DEBUG - [Pod Pod ctest-pod-69934473] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-28 18:40:26,254 - DEBUG - [Pod Pod ctest-pod-69934473] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-05-28 18:40:26,254 - INFO - wget check of of http://10.47.255.251 from ctest-pod-69934473 passed 2025-05-28 18:40:26,262 - INFO - Updating Network Policy ingress-on-service 2025-05-28 18:40:31,324 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:31,324 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:31,324 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:36,377 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:36,377 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:36,377 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:41,426 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:41,426 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:41,426 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:46,489 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:46,489 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:46,489 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:51,550 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:51,550 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:51,550 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:56,596 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:56,596 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:40:56,596 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:41:01,641 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:41:01,641 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:41:01,641 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:41:06,693 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:41:06,693 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:41:06,693 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:41:11,742 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:41:11,742 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:41:11,742 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:41:16,792 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:41:16,792 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:41:16,793 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) wget: download timed out 2025-05-28 18:41:16,793 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-67271962': 0, 'ctest-pod-94730292': 0} 2025-05-28 18:41:16,838 - DEBUG - [Pod ctest-pod-75931456] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: ctest-pod-94730292 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:41:16,838 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:41:16,838 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd output: ctest-pod-94730292 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:41:16,889 - DEBUG - [Pod ctest-pod-75931456] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:41:16,889 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:41:16,889 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:41:16,889 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67271962': 1, 'ctest-pod-94730292': 1} 2025-05-28 18:41:16,943 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: ctest-pod-94730292 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:41:16,943 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:41:16,943 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: ctest-pod-94730292 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:41:16,990 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94730292 2025-05-28 18:41:16,990 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:41:16,990 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-94730292 2025-05-28 18:41:17,044 - DEBUG - [Pod ctest-pod-59769844] Cmd: wget http://10.97.65.255:80/ -O - -T 5 -t 1 , Output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:41:17,044 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd wget http://10.97.65.255:80/ -O - -T 5 -t 1 passed 2025-05-28 18:41:17,044 - DEBUG - [Pod Pod ctest-pod-59769844] Cmd output: ctest-pod-67271962 Connecting to 10.97.65.255:80 (10.97.65.255:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-05-28 18:41:17,044 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-67271962': 1, 'ctest-pod-94730292': 2} 2025-05-28 18:41:19,089 - DEBUG - [Pod ctest-pod-75931456] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.790 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.055 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.076 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.055/0.307/0.790 ms 2025-05-28 18:41:19,089 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-75931456 with expectation True passed 2025-05-28 18:41:21,137 - DEBUG - [Pod ctest-pod-87940678] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.856 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.063 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.059 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.059/0.326/0.856 ms 2025-05-28 18:41:21,137 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-87940678 with expectation True passed 2025-05-28 18:41:23,189 - DEBUG - [Pod ctest-pod-59769844] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.884 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.057 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.057/0.337/0.884 ms 2025-05-28 18:41:23,189 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-59769844 with expectation True passed 2025-05-28 18:41:23,238 - DEBUG - [Pod ctest-pod-75931456] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 18:41:23,238 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-28 18:41:23,238 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 18:41:23,238 - INFO - wget check of of http://10.47.255.251 from ctest-pod-75931456 passed 2025-05-28 18:41:23,295 - DEBUG - [Pod ctest-pod-75931456] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 18:41:23,295 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-05-28 18:41:23,295 - DEBUG - [Pod Pod ctest-pod-75931456] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 18:41:23,295 - INFO - wget check of of http://10.47.255.250 from ctest-pod-75931456 passed 2025-05-28 18:41:28,347 - DEBUG - [Pod ctest-pod-87940678] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-28 18:41:28,347 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-28 18:41:28,347 - DEBUG - [Pod Pod ctest-pod-87940678] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-05-28 18:41:28,347 - INFO - wget check of of http://10.47.255.250 from ctest-pod-87940678 passed 2025-05-28 18:41:28,400 - DEBUG - [Pod ctest-pod-69934473] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 18:41:28,400 - DEBUG - [Pod Pod ctest-pod-69934473] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-05-28 18:41:28,400 - DEBUG - [Pod Pod ctest-pod-69934473] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-05-28 18:41:28,400 - INFO - wget check of of http://10.47.255.251 from ctest-pod-69934473 passed 2025-05-28 18:41:28,400 - INFO - Deleting Network Policy : ingress-on-service 2025-05-28 18:41:28,401 - INFO - Deleting service : ctest-nginx-svc-73023549 2025-05-28 18:41:28,634 - DEBUG - No XMPP flaps were noticed during the test
2025-05-28 18:41:28,634 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2025-05-28 18:41:28,634 - INFO - -------------------------------------------------------------------------------- 2025-05-28 18:41:28,639 - INFO - Deleting pod ctest-new-default-21928649:ctest-pod-67271962 2025-05-28 18:41:28,640 - INFO - Deleting pod ctest-new-default-21928649:ctest-pod-94730292 2025-05-28 18:41:28,640 - INFO - Deleting pod ctest-non-default-08749424:ctest-pod-80074052 2025-05-28 18:41:28,640 - INFO - Deleting pod ctest-non-default-08749424:ctest-pod-28483877 2025-05-28 18:41:28,641 - INFO - Deleting pod ctest-new-default-21928649:ctest-pod-87940678 2025-05-28 18:41:28,641 - INFO - Deleting pod ctest-new-default-21928649:ctest-pod-75931456 2025-05-28 18:41:28,641 - INFO - Deleting pod ctest-non-default-08749424:ctest-pod-59769844 2025-05-28 18:41:28,642 - INFO - Deleting pod ctest-non-default-08749424:ctest-pod-69934473 2025-05-28 18:41:28,728 - WARNING - Pod uuid 084485ef-ac15-4c0e-94e1-5790cef5b1bf is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:28,735 - WARNING - Pod uuid dd1955cc-e93a-489d-a7de-d57d7002263c is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:28,781 - WARNING - Pod uuid ac84dc6d-f6ed-4b29-895e-fc8c74071271 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:28,781 - WARNING - Pod uuid e8df4cf3-1ad1-4748-9bb2-46b0690418d3 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:28,782 - WARNING - Pod uuid e7b8e984-be43-4d4c-897f-cf59ccb00110 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:28,782 - WARNING - Pod uuid 8fba448b-de29-463a-9c3c-eb59144e70b3 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:28,782 - WARNING - Pod uuid 1435ff60-5b0d-4531-8b48-4f50ca281c9f is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:28,783 - WARNING - Pod uuid 6c5c94cf-eb9d-4c21-867e-7e52010160fb is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:33,738 - WARNING - Pod uuid 084485ef-ac15-4c0e-94e1-5790cef5b1bf is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:33,743 - WARNING - Pod uuid dd1955cc-e93a-489d-a7de-d57d7002263c is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:33,809 - WARNING - Pod uuid e7b8e984-be43-4d4c-897f-cf59ccb00110 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:33,811 - DEBUG - Pod 6c5c94cf-eb9d-4c21-867e-7e52010160fb is not in agent 10.0.0.33 VM list 2025-05-28 18:41:33,812 - WARNING - Pod uuid 1435ff60-5b0d-4531-8b48-4f50ca281c9f is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:33,813 - DEBUG - Pod 8fba448b-de29-463a-9c3c-eb59144e70b3 is not in agent 10.0.0.33 VM list 2025-05-28 18:41:33,814 - WARNING - Pod uuid ac84dc6d-f6ed-4b29-895e-fc8c74071271 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:33,814 - DEBUG - Pod e8df4cf3-1ad1-4748-9bb2-46b0690418d3 is not in agent 10.0.0.33 VM list 2025-05-28 18:41:33,826 - DEBUG - VMI e1f93790-3bf2-11f0-a825-fa163ed2d7a3 is removed from agent 10.0.0.33 2025-05-28 18:41:33,826 - INFO - Verified that pod ctest-pod-28483877 is removed in agent 2025-05-28 18:41:33,828 - DEBUG - VMI e17cb706-3bf2-11f0-a825-fa163ed2d7a3 is removed from agent 10.0.0.33 2025-05-28 18:41:33,828 - INFO - Verified that pod ctest-pod-80074052 is removed in agent 2025-05-28 18:41:33,828 - DEBUG - VMI e0c1b302-3bf2-11f0-a825-fa163ed2d7a3 is removed from agent 10.0.0.33 2025-05-28 18:41:33,828 - INFO - Verified that pod ctest-pod-94730292 is removed in agent 2025-05-28 18:41:38,754 - WARNING - Pod uuid dd1955cc-e93a-489d-a7de-d57d7002263c is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:38,756 - WARNING - Pod uuid 084485ef-ac15-4c0e-94e1-5790cef5b1bf is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:38,817 - WARNING - Pod uuid e7b8e984-be43-4d4c-897f-cf59ccb00110 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:38,825 - WARNING - Pod uuid 1435ff60-5b0d-4531-8b48-4f50ca281c9f is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:38,826 - WARNING - Pod uuid ac84dc6d-f6ed-4b29-895e-fc8c74071271 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:43,770 - WARNING - Pod uuid dd1955cc-e93a-489d-a7de-d57d7002263c is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:43,771 - WARNING - Pod uuid 084485ef-ac15-4c0e-94e1-5790cef5b1bf is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:43,825 - WARNING - Pod uuid e7b8e984-be43-4d4c-897f-cf59ccb00110 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:43,837 - WARNING - Pod uuid 1435ff60-5b0d-4531-8b48-4f50ca281c9f is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:43,838 - WARNING - Pod uuid ac84dc6d-f6ed-4b29-895e-fc8c74071271 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:48,781 - WARNING - Pod uuid dd1955cc-e93a-489d-a7de-d57d7002263c is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:48,783 - WARNING - Pod uuid 084485ef-ac15-4c0e-94e1-5790cef5b1bf is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:48,833 - WARNING - Pod uuid e7b8e984-be43-4d4c-897f-cf59ccb00110 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:48,849 - WARNING - Pod uuid 1435ff60-5b0d-4531-8b48-4f50ca281c9f is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:48,850 - WARNING - Pod uuid ac84dc6d-f6ed-4b29-895e-fc8c74071271 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:53,794 - WARNING - Pod uuid dd1955cc-e93a-489d-a7de-d57d7002263c is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:53,796 - WARNING - Pod uuid 084485ef-ac15-4c0e-94e1-5790cef5b1bf is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:53,846 - WARNING - Pod uuid e7b8e984-be43-4d4c-897f-cf59ccb00110 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:53,859 - WARNING - Pod uuid 1435ff60-5b0d-4531-8b48-4f50ca281c9f is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:53,860 - WARNING - Pod uuid ac84dc6d-f6ed-4b29-895e-fc8c74071271 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:58,806 - WARNING - Pod uuid 084485ef-ac15-4c0e-94e1-5790cef5b1bf is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:58,807 - WARNING - Pod uuid dd1955cc-e93a-489d-a7de-d57d7002263c is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:58,853 - WARNING - Pod uuid e7b8e984-be43-4d4c-897f-cf59ccb00110 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:58,871 - WARNING - Pod uuid 1435ff60-5b0d-4531-8b48-4f50ca281c9f is still seen in agent 10.0.0.33 VM list 2025-05-28 18:41:58,872 - WARNING - Pod uuid ac84dc6d-f6ed-4b29-895e-fc8c74071271 is still seen in agent 10.0.0.33 VM list 2025-05-28 18:42:03,820 - DEBUG - Pod 084485ef-ac15-4c0e-94e1-5790cef5b1bf is not in agent 10.0.0.33 VM list 2025-05-28 18:42:03,821 - DEBUG - Pod dd1955cc-e93a-489d-a7de-d57d7002263c is not in agent 10.0.0.33 VM list 2025-05-28 18:42:03,831 - DEBUG - VMI e287901c-3bf2-11f0-a825-fa163ed2d7a3 is removed from agent 10.0.0.33 2025-05-28 18:42:03,831 - INFO - Verified that pod ctest-pod-87940678 is removed in agent 2025-05-28 18:42:03,832 - DEBUG - VMI dfbc50f2-3bf2-11f0-a825-fa163ed2d7a3 is removed from agent 10.0.0.33 2025-05-28 18:42:03,832 - INFO - Verified that pod ctest-pod-67271962 is removed in agent 2025-05-28 18:42:03,861 - DEBUG - Pod e7b8e984-be43-4d4c-897f-cf59ccb00110 is not in agent 10.0.0.33 VM list 2025-05-28 18:42:03,867 - DEBUG - VMI e389a14e-3bf2-11f0-a825-fa163ed2d7a3 is removed from agent 10.0.0.33 2025-05-28 18:42:03,867 - INFO - Verified that pod ctest-pod-59769844 is removed in agent 2025-05-28 18:42:03,884 - DEBUG - Pod ac84dc6d-f6ed-4b29-895e-fc8c74071271 is not in agent 10.0.0.33 VM list 2025-05-28 18:42:03,886 - DEBUG - Pod 1435ff60-5b0d-4531-8b48-4f50ca281c9f is not in agent 10.0.0.33 VM list 2025-05-28 18:42:03,896 - DEBUG - VMI e3126336-3bf2-11f0-a825-fa163ed2d7a3 is removed from agent 10.0.0.33 2025-05-28 18:42:03,896 - INFO - Verified that pod ctest-pod-75931456 is removed in agent 2025-05-28 18:42:03,896 - DEBUG - VMI e4056fc2-3bf2-11f0-a825-fa163ed2d7a3 is removed from agent 10.0.0.33 2025-05-28 18:42:03,896 - INFO - Verified that pod ctest-pod-69934473 is removed in agent 2025-05-28 18:42:03,896 - INFO - Deleting namespace ctest-non-default-08749424 2025-05-28 18:42:03,914 - DEBUG - Namespace ctest-non-default-08749424 still in k8s 2025-05-28 18:42:05,919 - DEBUG - Namespace ctest-non-default-08749424 still in k8s 2025-05-28 18:42:07,924 - DEBUG - Namespace ctest-non-default-08749424 still in k8s 2025-05-28 18:42:09,929 - DEBUG - Namespace ctest-non-default-08749424 is not in k8s 2025-05-28 18:42:09,929 - DEBUG - No need to check project deletion in contrail-api 2025-05-28 18:42:09,929 - INFO - Deleting namespace ctest-new-default-21928649 2025-05-28 18:42:09,943 - DEBUG - Namespace ctest-new-default-21928649 still in k8s 2025-05-28 18:42:11,947 - DEBUG - Namespace ctest-new-default-21928649 still in k8s 2025-05-28 18:42:13,952 - DEBUG - Namespace ctest-new-default-21928649 still in k8s 2025-05-28 18:42:15,955 - DEBUG - Namespace ctest-new-default-21928649 is not in k8s 2025-05-28 18:42:15,955 - DEBUG - No need to check project deletion in contrail-api