2025-05-12 02:14:03,021 - INFO - Using existing project ['default-domain', 'k8s-default'](e4255bfb-f2e5-4895-86fe-7bf4b30a1974)
2025-05-12 02:14:03,042 - DEBUG - Namespace ctest-new-default-52502018 not present
2025-05-12 02:14:03,051 - INFO - Created namespace ctest-new-default-52502018
2025-05-12 02:14:06,057 - DEBUG - Namespace ctest-non-default-15984615 not present
2025-05-12 02:14:06,067 - INFO - Created namespace ctest-non-default-15984615
2025-05-12 02:14:09,092 - DEBUG - Pod ctest-pod-30486063 not present
2025-05-12 02:14:09,092 - INFO - Creating Pod ctest-pod-30486063
2025-05-12 02:14:09,114 - DEBUG - Pod : ctest-pod-30486063 UUID is a382190b-c7a5-4478-a59d-fb94109fecac
2025-05-12 02:14:09,117 - DEBUG - Pod ctest-pod-42767967 not present
2025-05-12 02:14:09,117 - INFO - Creating Pod ctest-pod-42767967
2025-05-12 02:14:09,156 - DEBUG - Pod : ctest-pod-42767967 UUID is c8d0b703-fd33-452d-8158-8072278d4d14
2025-05-12 02:14:09,162 - DEBUG - Pod ctest-pod-88123328 not present
2025-05-12 02:14:09,162 - INFO - Creating Pod ctest-pod-88123328
2025-05-12 02:14:09,196 - DEBUG - Pod : ctest-pod-88123328 UUID is 2f15e5ea-b1ee-48e9-a5ae-90b7062e2c68
2025-05-12 02:14:09,204 - DEBUG - Pod ctest-pod-99815627 not present
2025-05-12 02:14:09,205 - INFO - Creating Pod ctest-pod-99815627
2025-05-12 02:14:09,239 - DEBUG - Pod : ctest-pod-99815627 UUID is 919f389b-1092-42c1-9aad-e67e710d527d
2025-05-12 02:14:09,242 - DEBUG - Pod ctest-pod-77630598 not present
2025-05-12 02:14:09,242 - INFO - Creating Pod ctest-pod-77630598
2025-05-12 02:14:09,267 - DEBUG - Pod : ctest-pod-77630598 UUID is ff4a9257-3dda-42ea-9cd8-9edd01364fc5
2025-05-12 02:14:09,269 - DEBUG - Pod ctest-pod-90345863 not present
2025-05-12 02:14:09,269 - INFO - Creating Pod ctest-pod-90345863
2025-05-12 02:14:09,287 - DEBUG - Pod : ctest-pod-90345863 UUID is c26aec25-1bd3-43fb-88a9-33f7923c5c2b
2025-05-12 02:14:09,289 - DEBUG - Pod ctest-pod-24962504 not present
2025-05-12 02:14:09,289 - INFO - Creating Pod ctest-pod-24962504
2025-05-12 02:14:09,307 - DEBUG - Pod : ctest-pod-24962504 UUID is 6b7ba119-1c69-49f4-a96f-a5aa2c4b8bba
2025-05-12 02:14:09,311 - DEBUG - Pod ctest-pod-11659096 not present
2025-05-12 02:14:09,311 - INFO - Creating Pod ctest-pod-11659096
2025-05-12 02:14:09,331 - DEBUG - Pod : ctest-pod-11659096 UUID is d0286550-59de-4ea7-8f23-a3d680fa5b08
2025-05-12 02:14:09,518 - INFO - Project default-domain:k8s-ctest-new-default-52502018 for Namespace ctest-new-default-52502018 is seen in contrail-api
2025-05-12 02:14:09,518 - DEBUG - Project uuid in Contrail is 69d02764-2c49-4403-860d-2e261a1d71bb
2025-05-12 02:14:09,691 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NamespaceDatabaseList?namespace_uuid=64515132-a54e-45c8-b908-984b280f1db6
2025-05-12 02:14:09,700 - INFO - Namespace ctest-new-default-52502018 with uuid 64515132-a54e-45c8-b908-984b280f1db6 found in kube manager
2025-05-12 02:14:09,700 - INFO - Namespace ctest-new-default-52502018 verification passed
2025-05-12 02:14:09,897 - INFO - Project default-domain:k8s-ctest-non-default-15984615 for Namespace ctest-non-default-15984615 is seen in contrail-api
2025-05-12 02:14:09,897 - DEBUG - Project uuid in Contrail is 99a40174-95b7-4298-ac6c-3ce7753616a7
2025-05-12 02:14:09,897 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NamespaceDatabaseList?namespace_uuid=023c0408-d5ec-4077-8e4f-a57b9879806e
2025-05-12 02:14:09,903 - INFO - Namespace ctest-non-default-15984615 with uuid 023c0408-d5ec-4077-8e4f-a57b9879806e found in kube manager
2025-05-12 02:14:09,903 - INFO - Namespace ctest-non-default-15984615 verification passed
2025-05-12 02:14:09,909 - DEBUG - Pod ctest-pod-30486063 not in running state.Currently in Pending
2025-05-12 02:14:14,916 - DEBUG - Pod ctest-pod-30486063 not in running state.Currently in Pending
2025-05-12 02:14:19,922 - INFO - Pod ctest-pod-30486063 is in running state.Got IP 10.47.255.251
2025-05-12 02:14:19,935 - DEBUG - Pod ctest-pod-30486063 has vmi cac56144-2ed6-11f0-9952-fa163eab6970
2025-05-12 02:14:19,935 - INFO - Verified pod ctest-pod-30486063 in contrail-api
2025-05-12 02:14:19,946 - DEBUG - VMI cac56144-2ed6-11f0-9952-fa163eab6970 is active in agent 10.0.0.56
2025-05-12 02:14:19,947 - INFO - Verified Pod ctest-pod-30486063 in agent 10.0.0.56
2025-05-12 02:14:19,947 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=a382190b-c7a5-4478-a59d-fb94109fecac
2025-05-12 02:14:19,952 - INFO - Pod ctest-pod-30486063 with uuid a382190b-c7a5-4478-a59d-fb94109fecac found in kube manager
2025-05-12 02:14:19,952 - INFO - Pod ctest-pod-30486063 verification passed
2025-05-12 02:14:19,957 - DEBUG - Pod ctest-pod-42767967 not in running state.Currently in Pending
2025-05-12 02:14:24,970 - INFO - Pod ctest-pod-42767967 is in running state.Got IP 10.47.255.250
2025-05-12 02:14:24,983 - DEBUG - Pod ctest-pod-42767967 has vmi cb451128-2ed6-11f0-9952-fa163eab6970
2025-05-12 02:14:24,983 - INFO - Verified pod ctest-pod-42767967 in contrail-api
2025-05-12 02:14:24,997 - DEBUG - VMI cb451128-2ed6-11f0-9952-fa163eab6970 is active in agent 10.0.0.56
2025-05-12 02:14:24,997 - INFO - Verified Pod ctest-pod-42767967 in agent 10.0.0.56
2025-05-12 02:14:24,997 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=c8d0b703-fd33-452d-8158-8072278d4d14
2025-05-12 02:14:25,002 - INFO - Pod ctest-pod-42767967 with uuid c8d0b703-fd33-452d-8158-8072278d4d14 found in kube manager
2025-05-12 02:14:25,002 - INFO - Pod ctest-pod-42767967 verification passed
2025-05-12 02:14:25,009 - INFO - Pod ctest-pod-88123328 is in running state.Got IP 10.47.255.249
2025-05-12 02:14:25,067 - DEBUG - Pod ctest-pod-88123328 has vmi cbea4044-2ed6-11f0-9952-fa163eab6970
2025-05-12 02:14:25,067 - INFO - Verified pod ctest-pod-88123328 in contrail-api
2025-05-12 02:14:25,084 - DEBUG - VMI cbea4044-2ed6-11f0-9952-fa163eab6970 is active in agent 10.0.0.56
2025-05-12 02:14:25,084 - INFO - Verified Pod ctest-pod-88123328 in agent 10.0.0.56
2025-05-12 02:14:25,084 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=2f15e5ea-b1ee-48e9-a5ae-90b7062e2c68
2025-05-12 02:14:25,100 - INFO - Pod ctest-pod-88123328 with uuid 2f15e5ea-b1ee-48e9-a5ae-90b7062e2c68 found in kube manager
2025-05-12 02:14:25,101 - INFO - Pod ctest-pod-88123328 verification passed
2025-05-12 02:14:25,107 - INFO - Pod ctest-pod-99815627 is in running state.Got IP 10.47.255.248
2025-05-12 02:14:25,122 - DEBUG - Pod ctest-pod-99815627 has vmi cc6ef212-2ed6-11f0-9952-fa163eab6970
2025-05-12 02:14:25,122 - INFO - Verified pod ctest-pod-99815627 in contrail-api
2025-05-12 02:14:25,143 - DEBUG - VMI cc6ef212-2ed6-11f0-9952-fa163eab6970 is active in agent 10.0.0.56
2025-05-12 02:14:25,143 - INFO - Verified Pod ctest-pod-99815627 in agent 10.0.0.56
2025-05-12 02:14:25,143 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=919f389b-1092-42c1-9aad-e67e710d527d
2025-05-12 02:14:25,149 - INFO - Pod ctest-pod-99815627 with uuid 919f389b-1092-42c1-9aad-e67e710d527d found in kube manager
2025-05-12 02:14:25,149 - INFO - Pod ctest-pod-99815627 verification passed
2025-05-12 02:14:25,156 - INFO - Pod ctest-pod-77630598 is in running state.Got IP 10.47.255.247
2025-05-12 02:14:25,214 - DEBUG - Pod ctest-pod-77630598 has vmi ccf99ac0-2ed6-11f0-9952-fa163eab6970
2025-05-12 02:14:25,214 - INFO - Verified pod ctest-pod-77630598 in contrail-api
2025-05-12 02:14:25,228 - DEBUG - VMI ccf99ac0-2ed6-11f0-9952-fa163eab6970 is active in agent 10.0.0.56
2025-05-12 02:14:25,229 - INFO - Verified Pod ctest-pod-77630598 in agent 10.0.0.56
2025-05-12 02:14:25,229 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=ff4a9257-3dda-42ea-9cd8-9edd01364fc5
2025-05-12 02:14:25,235 - INFO - Pod ctest-pod-77630598 with uuid ff4a9257-3dda-42ea-9cd8-9edd01364fc5 found in kube manager
2025-05-12 02:14:25,235 - INFO - Pod ctest-pod-77630598 verification passed
2025-05-12 02:14:25,244 - INFO - Pod ctest-pod-24962504 is in running state.Got IP 10.47.255.245
2025-05-12 02:14:25,265 - DEBUG - Pod ctest-pod-24962504 has vmi cde4efac-2ed6-11f0-9952-fa163eab6970
2025-05-12 02:14:25,265 - INFO - Verified pod ctest-pod-24962504 in contrail-api
2025-05-12 02:14:25,283 - DEBUG - VMI cde4efac-2ed6-11f0-9952-fa163eab6970 is active in agent 10.0.0.56
2025-05-12 02:14:25,283 - INFO - Verified Pod ctest-pod-24962504 in agent 10.0.0.56
2025-05-12 02:14:25,283 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=6b7ba119-1c69-49f4-a96f-a5aa2c4b8bba
2025-05-12 02:14:25,291 - INFO - Pod ctest-pod-24962504 with uuid 6b7ba119-1c69-49f4-a96f-a5aa2c4b8bba found in kube manager
2025-05-12 02:14:25,291 - INFO - Pod ctest-pod-24962504 verification passed
2025-05-12 02:14:25,395 - DEBUG - Pod ctest-pod-90345863 not in running state.Currently in Pending
2025-05-12 02:14:30,403 - INFO - Pod ctest-pod-90345863 is in running state.Got IP 10.47.255.246
2025-05-12 02:14:30,458 - DEBUG - Pod ctest-pod-90345863 has vmi cd6e19d6-2ed6-11f0-9952-fa163eab6970
2025-05-12 02:14:30,458 - INFO - Verified pod ctest-pod-90345863 in contrail-api
2025-05-12 02:14:30,472 - DEBUG - VMI cd6e19d6-2ed6-11f0-9952-fa163eab6970 is active in agent 10.0.0.56
2025-05-12 02:14:30,472 - INFO - Verified Pod ctest-pod-90345863 in agent 10.0.0.56
2025-05-12 02:14:30,472 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=c26aec25-1bd3-43fb-88a9-33f7923c5c2b
2025-05-12 02:14:30,477 - INFO - Pod ctest-pod-90345863 with uuid c26aec25-1bd3-43fb-88a9-33f7923c5c2b found in kube manager
2025-05-12 02:14:30,477 - INFO - Pod ctest-pod-90345863 verification passed
2025-05-12 02:14:30,482 - INFO - Pod ctest-pod-11659096 is in running state.Got IP 10.47.255.244
2025-05-12 02:14:30,496 - DEBUG - Pod ctest-pod-11659096 has vmi ce502dd0-2ed6-11f0-9952-fa163eab6970
2025-05-12 02:14:30,496 - INFO - Verified pod ctest-pod-11659096 in contrail-api
2025-05-12 02:14:30,510 - DEBUG - VMI ce502dd0-2ed6-11f0-9952-fa163eab6970 is active in agent 10.0.0.56
2025-05-12 02:14:30,510 - INFO - Verified Pod ctest-pod-11659096 in agent 10.0.0.56
2025-05-12 02:14:30,510 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_VirtualMachineDatabaseList?x=d0286550-59de-4ea7-8f23-a3d680fa5b08
2025-05-12 02:14:30,514 - INFO - Pod ctest-pod-11659096 with uuid d0286550-59de-4ea7-8f23-a3d680fa5b08 found in kube manager
2025-05-12 02:14:30,514 - INFO - Pod ctest-pod-11659096 verification passed
2025-05-12 02:14:30,514 - INFO - ================================================================================
2025-05-12 02:14:30,515 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-05-12 02:14:30,515 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-05-12 02:14:30,757 - DEBUG - Nothing to compare xmpp stats {'10.0.0.56': {'10.0.0.129': '0'}} with
2025-05-12 02:14:30,757 - INFO - Initial checks done. Running the testcase now
2025-05-12 02:14:30,757 - INFO -
2025-05-12 02:14:30,808 - DEBUG - [Pod ctest-pod-30486063] Cmd: echo ctest-pod-30486063 > /usr/share/nginx/html/index.html, Output:
2025-05-12 02:14:30,873 - DEBUG - [Pod ctest-pod-42767967] Cmd: echo ctest-pod-42767967 > /usr/share/nginx/html/index.html, Output:
2025-05-12 02:14:30,930 - DEBUG - [Pod ctest-pod-88123328] Cmd: echo ctest-pod-88123328 > /usr/share/nginx/html/index.html, Output:
2025-05-12 02:14:30,989 - DEBUG - [Pod ctest-pod-99815627] Cmd: echo ctest-pod-99815627 > /usr/share/nginx/html/index.html, Output:
2025-05-12 02:14:30,992 - DEBUG - Service ctest-nginx-svc-40950932 not present
2025-05-12 02:14:30,992 - INFO - Creating service ctest-nginx-svc-40950932
2025-05-12 02:14:31,004 - INFO - Created Service ctest-nginx-svc-40950932
2025-05-12 02:14:31,017 - WARNING - Service UUID 91e54509-f20e-4ff9-bb47-03abc7df54dd not yet found in contrail-api
2025-05-12 02:14:32,024 - INFO - Validated that Service ctest-nginx-svc-40950932 is seen in contrail-api
2025-05-12 02:14:32,024 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_LoadbalancerDatabaseList?x=91e54509-f20e-4ff9-bb47-03abc7df54dd
2025-05-12 02:14:32,029 - INFO - Service ctest-nginx-svc-40950932 with uuid 91e54509-f20e-4ff9-bb47-03abc7df54dd found in kube manager
2025-05-12 02:14:32,029 - INFO - Service ctest-nginx-svc-40950932 verification passed
2025-05-12 02:14:33,098 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42767967
2025-05-12 02:14:33,098 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:14:33,098 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42767967
2025-05-12 02:14:33,157 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-42767967
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:14:33,158 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:14:33,158 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: ctest-pod-42767967
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:14:33,214 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-42767967
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:14:33,214 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:14:33,214 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: ctest-pod-42767967
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:14:33,271 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-30486063
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:14:33,271 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:14:33,271 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: ctest-pod-30486063
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:14:33,271 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30486063': 1, 'ctest-pod-42767967': 3}
2025-05-12 02:14:33,344 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-42767967
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:14:33,344 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:14:33,344 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: ctest-pod-42767967
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:14:33,400 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-30486063
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:14:33,400 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:14:33,400 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: ctest-pod-30486063
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:14:33,400 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30486063': 1, 'ctest-pod-42767967': 1}
2025-05-12 02:14:33,403 - DEBUG - Network policy ingress-on-service not present
2025-05-12 02:14:33,403 - INFO - Creating Network Policy ingress-on-service
2025-05-12 02:14:33,424 - INFO - Network policy found in k8s
2025-05-12 02:14:33,424 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=295ac19f-3e84-4cbb-b112-533c3edbecaf
2025-05-12 02:14:33,431 - INFO - Network Policy ingress-on-service with uuid 295ac19f-3e84-4cbb-b112-533c3edbecaf found in kube manager
2025-05-12 02:14:33,466 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-05-12 02:14:33,467 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-05-12 02:14:33,467 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=295ac19f-3e84-4cbb-b112-533c3edbecaf
2025-05-12 02:14:33,500 - WARNING - Network policy with name ingress-on-service not found in agent
2025-05-12 02:14:35,501 - DEBUG - Requesting: http://10.0.0.129:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=295ac19f-3e84-4cbb-b112-533c3edbecaf
2025-05-12 02:14:35,533 - INFO - Network policy with name ingress-on-service found in agent
2025-05-12 02:14:35,533 - INFO - Network Policy ingress-on-service verification passed
2025-05-12 02:14:40,587 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:14:40,588 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:14:40,588 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:14:45,642 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:14:45,642 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:14:45,642 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:14:50,698 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:14:50,698 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:14:50,698 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:14:55,904 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:14:55,904 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:14:55,905 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:00,957 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:00,957 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:00,957 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:06,026 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:06,026 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:06,026 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:11,075 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:11,075 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:11,075 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:16,126 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:16,126 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:16,126 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:21,177 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:21,178 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:21,178 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:26,234 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:26,234 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:26,234 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:26,234 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-30486063': 0, 'ctest-pod-42767967': 0}
2025-05-12 02:15:26,300 - DEBUG - [Pod ctest-pod-90345863] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42767967
2025-05-12 02:15:26,300 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:15:26,300 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-42767967
2025-05-12 02:15:26,351 - DEBUG - [Pod ctest-pod-90345863] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-30486063
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:15:26,352 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:15:26,352 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd output: ctest-pod-30486063
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:15:26,352 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30486063': 1, 'ctest-pod-42767967': 1}
2025-05-12 02:15:31,402 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:31,402 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:31,402 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:36,466 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:36,466 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:36,466 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:41,521 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:41,521 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:41,521 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:46,586 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:46,586 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:46,586 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:51,639 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:51,639 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:51,639 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:56,699 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:56,699 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:15:56,699 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:01,763 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:01,763 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:01,763 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:06,823 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:06,823 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:06,823 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:11,877 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:11,877 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:11,877 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:16,930 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:16,930 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:16,930 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:16,930 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-30486063': 0, 'ctest-pod-42767967': 0}
2025-05-12 02:16:18,982 - DEBUG - [Pod ctest-pod-90345863] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.041 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.103 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.103 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.103/0.415/1.041 ms
2025-05-12 02:16:18,983 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-90345863 with expectation True passed
2025-05-12 02:16:21,034 - DEBUG - [Pod ctest-pod-77630598] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.046 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.093 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.407/1.046 ms
2025-05-12 02:16:21,034 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-77630598 with expectation True passed
2025-05-12 02:16:23,086 - DEBUG - [Pod ctest-pod-24962504] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.390 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.140 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.086/0.538/1.390 ms
2025-05-12 02:16:23,086 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-24962504 with expectation True passed
2025-05-12 02:16:23,140 - DEBUG - [Pod ctest-pod-90345863] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-12 02:16:23,140 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-05-12 02:16:23,140 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-12 02:16:23,140 - INFO - wget check of of http://10.47.255.251 from ctest-pod-90345863 passed
2025-05-12 02:16:23,183 - DEBUG - [Pod ctest-pod-90345863] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-12 02:16:23,183 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-05-12 02:16:23,183 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-12 02:16:23,183 - INFO - wget check of of http://10.47.255.250 from ctest-pod-90345863 passed
2025-05-12 02:16:28,238 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-12 02:16:28,238 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-12 02:16:28,238 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-12 02:16:28,238 - INFO - wget check of of http://10.47.255.250 from ctest-pod-77630598 passed
2025-05-12 02:16:33,303 - DEBUG - [Pod ctest-pod-11659096] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-05-12 02:16:33,303 - DEBUG - [Pod Pod ctest-pod-11659096] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-05-12 02:16:33,303 - DEBUG - [Pod Pod ctest-pod-11659096] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-05-12 02:16:33,303 - INFO - wget check of of http://10.47.255.251 from ctest-pod-11659096 passed
2025-05-12 02:16:33,320 - INFO - Updating Network Policy ingress-on-service
2025-05-12 02:16:38,382 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:38,382 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:38,383 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:43,442 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:43,443 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:43,443 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:48,498 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:48,498 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:48,498 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:53,553 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:53,554 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:53,554 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:58,606 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:58,606 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:16:58,606 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:03,661 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:03,662 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:03,662 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:08,714 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:08,714 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:08,714 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:13,767 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:13,767 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:13,767 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:15,305 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-05-12 02:17:25,369 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:25,369 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:25,369 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:30,421 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:30,421 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:30,421 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
wget: download timed out
2025-05-12 02:17:30,421 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-30486063': 0, 'ctest-pod-42767967': 0}
2025-05-12 02:17:30,483 - DEBUG - [Pod ctest-pod-90345863] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30486063
2025-05-12 02:17:30,483 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:17:30,483 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-30486063
2025-05-12 02:17:30,539 - DEBUG - [Pod ctest-pod-90345863] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-30486063
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:17:30,540 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:17:30,540 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd output: ctest-pod-30486063
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:17:30,594 - DEBUG - [Pod ctest-pod-90345863] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-42767967
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:17:30,595 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:17:30,595 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd output: ctest-pod-42767967
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:17:30,595 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30486063': 2, 'ctest-pod-42767967': 1}
2025-05-12 02:17:30,653 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-42767967
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:17:30,653 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:17:30,653 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: ctest-pod-42767967
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:17:30,708 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: ctest-pod-42767967
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:17:30,708 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:17:30,708 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: ctest-pod-42767967
Connecting to 10.102.232.9:80 (10.102.232.9:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:17:30,767 - DEBUG - [Pod ctest-pod-24962504] Cmd: wget http://10.102.232.9:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
ctest-pod-30486063
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:17:30,767 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd wget http://10.102.232.9:80/ -O - -T 5 -t 1 passed
2025-05-12 02:17:30,767 - DEBUG - [Pod Pod ctest-pod-24962504] Cmd output: Connecting to 10.102.232.9:80 (10.102.232.9:80)
ctest-pod-30486063
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-12 02:17:30,767 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-30486063': 1, 'ctest-pod-42767967': 2}
2025-05-12 02:17:32,813 - DEBUG - [Pod ctest-pod-90345863] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.447 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.095 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.206/0.447 ms
2025-05-12 02:17:32,814 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-90345863 with expectation True passed
2025-05-12 02:17:34,869 - DEBUG - [Pod ctest-pod-77630598] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.831 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.107 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.087/0.341/0.831 ms
2025-05-12 02:17:34,869 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-77630598 with expectation True passed
2025-05-12 02:17:36,926 - DEBUG - [Pod ctest-pod-24962504] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.338 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.074 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.086 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.074/0.499/1.338 ms
2025-05-12 02:17:36,926 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-24962504 with expectation True passed
2025-05-12 02:17:36,980 - DEBUG - [Pod ctest-pod-90345863] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-12 02:17:36,980 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-05-12 02:17:36,980 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-12 02:17:36,980 - INFO - wget check of of http://10.47.255.251 from ctest-pod-90345863 passed
2025-05-12 02:17:37,032 - DEBUG - [Pod ctest-pod-90345863] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-12 02:17:37,032 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-05-12 02:17:37,032 - DEBUG - [Pod Pod ctest-pod-90345863] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-12 02:17:37,032 - INFO - wget check of of http://10.47.255.250 from ctest-pod-90345863 passed
2025-05-12 02:17:42,087 - DEBUG - [Pod ctest-pod-77630598] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-12 02:17:42,087 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-12 02:17:42,087 - DEBUG - [Pod Pod ctest-pod-77630598] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-12 02:17:42,087 - INFO - wget check of of http://10.47.255.250 from ctest-pod-77630598 passed
2025-05-12 02:17:42,152 - DEBUG - [Pod ctest-pod-11659096] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-12 02:17:42,152 - DEBUG - [Pod Pod ctest-pod-11659096] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-05-12 02:17:42,153 - DEBUG - [Pod Pod ctest-pod-11659096] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-12 02:17:42,153 - INFO - wget check of of http://10.47.255.251 from ctest-pod-11659096 passed
2025-05-12 02:17:42,153 - INFO - Deleting Network Policy : ingress-on-service
2025-05-12 02:17:42,153 - INFO - Deleting service : ctest-nginx-svc-40950932
2025-05-12 02:17:42,395 - DEBUG - No XMPP flaps were noticed during the test
2025-05-12 02:17:42,395 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:12]
2025-05-12 02:17:42,395 - INFO - --------------------------------------------------------------------------------
2025-05-12 02:17:42,400 - INFO - Deleting pod ctest-new-default-52502018:ctest-pod-30486063
2025-05-12 02:17:42,400 - INFO - Deleting pod ctest-new-default-52502018:ctest-pod-42767967
2025-05-12 02:17:42,400 - INFO - Deleting pod ctest-non-default-15984615:ctest-pod-88123328
2025-05-12 02:17:42,401 - INFO - Deleting pod ctest-non-default-15984615:ctest-pod-99815627
2025-05-12 02:17:42,401 - INFO - Deleting pod ctest-new-default-52502018:ctest-pod-77630598
2025-05-12 02:17:42,401 - INFO - Deleting pod ctest-new-default-52502018:ctest-pod-90345863
2025-05-12 02:17:42,402 - INFO - Deleting pod ctest-non-default-15984615:ctest-pod-24962504
2025-05-12 02:17:42,402 - INFO - Deleting pod ctest-non-default-15984615:ctest-pod-11659096
2025-05-12 02:17:42,567 - WARNING - Pod uuid 2f15e5ea-b1ee-48e9-a5ae-90b7062e2c68 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:42,569 - WARNING - Pod uuid 919f389b-1092-42c1-9aad-e67e710d527d is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:42,570 - WARNING - Pod uuid a382190b-c7a5-4478-a59d-fb94109fecac is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:42,570 - WARNING - Pod uuid ff4a9257-3dda-42ea-9cd8-9edd01364fc5 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:42,570 - WARNING - Pod uuid 6b7ba119-1c69-49f4-a96f-a5aa2c4b8bba is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:42,571 - WARNING - Pod uuid c26aec25-1bd3-43fb-88a9-33f7923c5c2b is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:42,571 - WARNING - Pod uuid c8d0b703-fd33-452d-8158-8072278d4d14 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:42,595 - WARNING - Pod uuid d0286550-59de-4ea7-8f23-a3d680fa5b08 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:47,601 - WARNING - Pod uuid c26aec25-1bd3-43fb-88a9-33f7923c5c2b is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:47,601 - WARNING - Pod uuid 6b7ba119-1c69-49f4-a96f-a5aa2c4b8bba is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:47,602 - DEBUG - Pod 919f389b-1092-42c1-9aad-e67e710d527d is not in agent 10.0.0.56 VM list
2025-05-12 02:17:47,603 - DEBUG - Pod 2f15e5ea-b1ee-48e9-a5ae-90b7062e2c68 is not in agent 10.0.0.56 VM list
2025-05-12 02:17:47,605 - DEBUG - Pod a382190b-c7a5-4478-a59d-fb94109fecac is not in agent 10.0.0.56 VM list
2025-05-12 02:17:47,607 - WARNING - Pod uuid ff4a9257-3dda-42ea-9cd8-9edd01364fc5 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:47,609 - DEBUG - Pod c8d0b703-fd33-452d-8158-8072278d4d14 is not in agent 10.0.0.56 VM list
2025-05-12 02:17:47,631 - DEBUG - VMI cac56144-2ed6-11f0-9952-fa163eab6970 is removed from agent 10.0.0.56
2025-05-12 02:17:47,631 - INFO - Verified that pod ctest-pod-30486063 is removed in agent
2025-05-12 02:17:47,632 - WARNING - Pod uuid d0286550-59de-4ea7-8f23-a3d680fa5b08 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:47,634 - DEBUG - VMI cb451128-2ed6-11f0-9952-fa163eab6970 is removed from agent 10.0.0.56
2025-05-12 02:17:47,634 - INFO - Verified that pod ctest-pod-42767967 is removed in agent
2025-05-12 02:17:47,634 - DEBUG - VMI cbea4044-2ed6-11f0-9952-fa163eab6970 is removed from agent 10.0.0.56
2025-05-12 02:17:47,634 - INFO - Verified that pod ctest-pod-88123328 is removed in agent
2025-05-12 02:17:47,635 - DEBUG - VMI cc6ef212-2ed6-11f0-9952-fa163eab6970 is removed from agent 10.0.0.56
2025-05-12 02:17:47,635 - INFO - Verified that pod ctest-pod-99815627 is removed in agent
2025-05-12 02:17:52,617 - WARNING - Pod uuid c26aec25-1bd3-43fb-88a9-33f7923c5c2b is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:52,617 - WARNING - Pod uuid 6b7ba119-1c69-49f4-a96f-a5aa2c4b8bba is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:52,618 - WARNING - Pod uuid ff4a9257-3dda-42ea-9cd8-9edd01364fc5 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:52,638 - WARNING - Pod uuid d0286550-59de-4ea7-8f23-a3d680fa5b08 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:57,632 - WARNING - Pod uuid c26aec25-1bd3-43fb-88a9-33f7923c5c2b is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:57,634 - WARNING - Pod uuid ff4a9257-3dda-42ea-9cd8-9edd01364fc5 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:57,634 - WARNING - Pod uuid 6b7ba119-1c69-49f4-a96f-a5aa2c4b8bba is still seen in agent 10.0.0.56 VM list
2025-05-12 02:17:57,646 - WARNING - Pod uuid d0286550-59de-4ea7-8f23-a3d680fa5b08 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:18:02,658 - WARNING - Pod uuid c26aec25-1bd3-43fb-88a9-33f7923c5c2b is still seen in agent 10.0.0.56 VM list
2025-05-12 02:18:02,661 - WARNING - Pod uuid 6b7ba119-1c69-49f4-a96f-a5aa2c4b8bba is still seen in agent 10.0.0.56 VM list
2025-05-12 02:18:02,661 - WARNING - Pod uuid ff4a9257-3dda-42ea-9cd8-9edd01364fc5 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:18:02,663 - WARNING - Pod uuid d0286550-59de-4ea7-8f23-a3d680fa5b08 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:18:07,683 - WARNING - Pod uuid c26aec25-1bd3-43fb-88a9-33f7923c5c2b is still seen in agent 10.0.0.56 VM list
2025-05-12 02:18:07,685 - WARNING - Pod uuid d0286550-59de-4ea7-8f23-a3d680fa5b08 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:18:07,685 - WARNING - Pod uuid 6b7ba119-1c69-49f4-a96f-a5aa2c4b8bba is still seen in agent 10.0.0.56 VM list
2025-05-12 02:18:07,685 - WARNING - Pod uuid ff4a9257-3dda-42ea-9cd8-9edd01364fc5 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:18:12,738 - WARNING - Pod uuid ff4a9257-3dda-42ea-9cd8-9edd01364fc5 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:18:12,739 - WARNING - Pod uuid c26aec25-1bd3-43fb-88a9-33f7923c5c2b is still seen in agent 10.0.0.56 VM list
2025-05-12 02:18:12,740 - WARNING - Pod uuid 6b7ba119-1c69-49f4-a96f-a5aa2c4b8bba is still seen in agent 10.0.0.56 VM list
2025-05-12 02:18:12,741 - WARNING - Pod uuid d0286550-59de-4ea7-8f23-a3d680fa5b08 is still seen in agent 10.0.0.56 VM list
2025-05-12 02:18:17,758 - DEBUG - Pod ff4a9257-3dda-42ea-9cd8-9edd01364fc5 is not in agent 10.0.0.56 VM list
2025-05-12 02:18:17,762 - DEBUG - Pod d0286550-59de-4ea7-8f23-a3d680fa5b08 is not in agent 10.0.0.56 VM list
2025-05-12 02:18:17,763 - DEBUG - Pod 6b7ba119-1c69-49f4-a96f-a5aa2c4b8bba is not in agent 10.0.0.56 VM list
2025-05-12 02:18:17,765 - DEBUG - Pod c26aec25-1bd3-43fb-88a9-33f7923c5c2b is not in agent 10.0.0.56 VM list
2025-05-12 02:18:17,784 - DEBUG - VMI ce502dd0-2ed6-11f0-9952-fa163eab6970 is removed from agent 10.0.0.56
2025-05-12 02:18:17,784 - INFO - Verified that pod ctest-pod-11659096 is removed in agent
2025-05-12 02:18:17,784 - DEBUG - VMI ccf99ac0-2ed6-11f0-9952-fa163eab6970 is removed from agent 10.0.0.56
2025-05-12 02:18:17,785 - INFO - Verified that pod ctest-pod-77630598 is removed in agent
2025-05-12 02:18:17,786 - DEBUG - VMI cde4efac-2ed6-11f0-9952-fa163eab6970 is removed from agent 10.0.0.56
2025-05-12 02:18:17,786 - INFO - Verified that pod ctest-pod-24962504 is removed in agent
2025-05-12 02:18:17,787 - DEBUG - VMI cd6e19d6-2ed6-11f0-9952-fa163eab6970 is removed from agent 10.0.0.56
2025-05-12 02:18:17,787 - INFO - Verified that pod ctest-pod-90345863 is removed in agent
2025-05-12 02:18:17,787 - INFO - Deleting namespace ctest-non-default-15984615
2025-05-12 02:18:17,806 - DEBUG - Namespace ctest-non-default-15984615 still in k8s
2025-05-12 02:18:19,811 - DEBUG - Namespace ctest-non-default-15984615 still in k8s
2025-05-12 02:18:21,815 - DEBUG - Namespace ctest-non-default-15984615 still in k8s
2025-05-12 02:18:23,819 - DEBUG - Namespace ctest-non-default-15984615 is not in k8s
2025-05-12 02:18:23,819 - DEBUG - No need to check project deletion in contrail-api
2025-05-12 02:18:23,819 - INFO - Deleting namespace ctest-new-default-52502018
2025-05-12 02:18:23,826 - DEBUG - Namespace ctest-new-default-52502018 still in k8s
2025-05-12 02:18:25,831 - DEBUG - Namespace ctest-new-default-52502018 still in k8s
2025-05-12 02:18:27,836 - DEBUG - Namespace ctest-new-default-52502018 still in k8s
2025-05-12 02:18:29,840 - DEBUG - Namespace ctest-new-default-52502018 is not in k8s
2025-05-12 02:18:29,840 - DEBUG - No need to check project deletion in contrail-api