2025-04-09 12:41:52,890 - INFO - Using existing project ['default-domain', 'k8s-default'](b9b06e48-a4c6-4871-8cf7-937965e5d3ed)
2025-04-09 12:41:52,915 - DEBUG - Namespace ctest-new-default-39622616 not present
2025-04-09 12:41:52,922 - INFO - Created namespace ctest-new-default-39622616
2025-04-09 12:41:55,927 - DEBUG - Namespace ctest-non-default-65346425 not present
2025-04-09 12:41:55,944 - INFO - Created namespace ctest-non-default-65346425
2025-04-09 12:41:58,968 - DEBUG - Pod ctest-pod-78948979 not present
2025-04-09 12:41:58,968 - INFO - Creating Pod ctest-pod-78948979
2025-04-09 12:41:58,994 - DEBUG - Pod : ctest-pod-78948979 UUID is c1d14fe4-ca07-43f5-b5e6-88926983cb87
2025-04-09 12:41:58,996 - DEBUG - Pod ctest-pod-95783104 not present
2025-04-09 12:41:58,997 - INFO - Creating Pod ctest-pod-95783104
2025-04-09 12:41:59,043 - DEBUG - Pod : ctest-pod-95783104 UUID is c59f0193-e44e-4853-ab58-0db0f1d76275
2025-04-09 12:41:59,045 - DEBUG - Pod ctest-pod-43443297 not present
2025-04-09 12:41:59,046 - INFO - Creating Pod ctest-pod-43443297
2025-04-09 12:41:59,081 - DEBUG - Pod : ctest-pod-43443297 UUID is 1d0899da-416c-439a-9c14-a9b618a2c4af
2025-04-09 12:41:59,085 - DEBUG - Pod ctest-pod-34760394 not present
2025-04-09 12:41:59,085 - INFO - Creating Pod ctest-pod-34760394
2025-04-09 12:41:59,145 - DEBUG - Pod : ctest-pod-34760394 UUID is 127041ac-bf39-4fe3-82bd-929a8f7208a6
2025-04-09 12:41:59,147 - DEBUG - Pod ctest-pod-31148144 not present
2025-04-09 12:41:59,148 - INFO - Creating Pod ctest-pod-31148144
2025-04-09 12:41:59,169 - DEBUG - Pod : ctest-pod-31148144 UUID is 319f9940-5284-48b4-8409-44355b87bf2d
2025-04-09 12:41:59,171 - DEBUG - Pod ctest-pod-40622306 not present
2025-04-09 12:41:59,171 - INFO - Creating Pod ctest-pod-40622306
2025-04-09 12:41:59,187 - DEBUG - Pod : ctest-pod-40622306 UUID is 1379a7c7-323f-438c-98e3-91a78b157143
2025-04-09 12:41:59,191 - DEBUG - Pod ctest-pod-65503372 not present
2025-04-09 12:41:59,191 - INFO - Creating Pod ctest-pod-65503372
2025-04-09 12:41:59,222 - DEBUG - Pod : ctest-pod-65503372 UUID is bf31ecae-be10-4f6d-a0e0-22c0b8cff322
2025-04-09 12:41:59,224 - DEBUG - Pod ctest-pod-59537517 not present
2025-04-09 12:41:59,225 - INFO - Creating Pod ctest-pod-59537517
2025-04-09 12:41:59,241 - DEBUG - Pod : ctest-pod-59537517 UUID is 3c9e907b-d488-47b4-ac35-2097790fbab5
2025-04-09 12:41:59,441 - INFO - Project default-domain:k8s-ctest-new-default-39622616 for Namespace ctest-new-default-39622616 is seen in contrail-api
2025-04-09 12:41:59,441 - DEBUG - Project uuid in Contrail is 4d5d6420-bb5e-421a-a3a9-f31c2a47e772
2025-04-09 12:41:59,649 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=94023391-fd39-48e3-a61f-ad612ff9a541
2025-04-09 12:41:59,653 - INFO - Namespace ctest-new-default-39622616 with uuid 94023391-fd39-48e3-a61f-ad612ff9a541 found in kube manager
2025-04-09 12:41:59,653 - INFO - Namespace ctest-new-default-39622616 verification passed
2025-04-09 12:41:59,905 - INFO - Project default-domain:k8s-ctest-non-default-65346425 for Namespace ctest-non-default-65346425 is seen in contrail-api
2025-04-09 12:41:59,905 - DEBUG - Project uuid in Contrail is 939a5176-4070-4b48-840c-3f3bba68f6b6
2025-04-09 12:41:59,905 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NamespaceDatabaseList?namespace_uuid=d09ab779-d449-417b-b063-8c766593982a
2025-04-09 12:41:59,916 - INFO - Namespace ctest-non-default-65346425 with uuid d09ab779-d449-417b-b063-8c766593982a found in kube manager
2025-04-09 12:41:59,917 - INFO - Namespace ctest-non-default-65346425 verification passed
2025-04-09 12:41:59,931 - DEBUG - Pod ctest-pod-78948979 not in running state.Currently in Pending
2025-04-09 12:42:04,947 - DEBUG - Pod ctest-pod-78948979 not in running state.Currently in Pending
2025-04-09 12:42:09,955 - INFO - Pod ctest-pod-78948979 is in running state.Got IP 10.47.255.251
2025-04-09 12:42:10,023 - DEBUG - Pod ctest-pod-78948979 has vmi 0847b676-1540-11f0-bcd7-fa163e0b7df1
2025-04-09 12:42:10,023 - INFO - Verified pod ctest-pod-78948979 in contrail-api
2025-04-09 12:42:10,039 - DEBUG - VMI 0847b676-1540-11f0-bcd7-fa163e0b7df1 is active in agent 10.0.0.46
2025-04-09 12:42:10,039 - INFO - Verified Pod ctest-pod-78948979 in agent 10.0.0.46
2025-04-09 12:42:10,039 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=c1d14fe4-ca07-43f5-b5e6-88926983cb87
2025-04-09 12:42:10,044 - INFO - Pod ctest-pod-78948979 with uuid c1d14fe4-ca07-43f5-b5e6-88926983cb87 found in kube manager
2025-04-09 12:42:10,044 - INFO - Pod ctest-pod-78948979 verification passed
2025-04-09 12:42:10,050 - INFO - Pod ctest-pod-95783104 is in running state.Got IP 10.47.255.250
2025-04-09 12:42:10,064 - DEBUG - Pod ctest-pod-95783104 has vmi 08cc3892-1540-11f0-bcd7-fa163e0b7df1
2025-04-09 12:42:10,064 - INFO - Verified pod ctest-pod-95783104 in contrail-api
2025-04-09 12:42:10,076 - DEBUG - VMI 08cc3892-1540-11f0-bcd7-fa163e0b7df1 is active in agent 10.0.0.46
2025-04-09 12:42:10,076 - INFO - Verified Pod ctest-pod-95783104 in agent 10.0.0.46
2025-04-09 12:42:10,077 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=c59f0193-e44e-4853-ab58-0db0f1d76275
2025-04-09 12:42:10,081 - INFO - Pod ctest-pod-95783104 with uuid c59f0193-e44e-4853-ab58-0db0f1d76275 found in kube manager
2025-04-09 12:42:10,081 - INFO - Pod ctest-pod-95783104 verification passed
2025-04-09 12:42:10,088 - INFO - Pod ctest-pod-43443297 is in running state.Got IP 10.47.255.249
2025-04-09 12:42:10,148 - DEBUG - Pod ctest-pod-43443297 has vmi 0996b52c-1540-11f0-bcd7-fa163e0b7df1
2025-04-09 12:42:10,148 - INFO - Verified pod ctest-pod-43443297 in contrail-api
2025-04-09 12:42:10,181 - DEBUG - VMI 0996b52c-1540-11f0-bcd7-fa163e0b7df1 is active in agent 10.0.0.46
2025-04-09 12:42:10,181 - INFO - Verified Pod ctest-pod-43443297 in agent 10.0.0.46
2025-04-09 12:42:10,181 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=1d0899da-416c-439a-9c14-a9b618a2c4af
2025-04-09 12:42:10,186 - INFO - Pod ctest-pod-43443297 with uuid 1d0899da-416c-439a-9c14-a9b618a2c4af found in kube manager
2025-04-09 12:42:10,186 - INFO - Pod ctest-pod-43443297 verification passed
2025-04-09 12:42:10,192 - INFO - Pod ctest-pod-34760394 is in running state.Got IP 10.47.255.248
2025-04-09 12:42:10,207 - DEBUG - Pod ctest-pod-34760394 has vmi 0a1b82ac-1540-11f0-bcd7-fa163e0b7df1
2025-04-09 12:42:10,207 - INFO - Verified pod ctest-pod-34760394 in contrail-api
2025-04-09 12:42:10,223 - DEBUG - VMI 0a1b82ac-1540-11f0-bcd7-fa163e0b7df1 is active in agent 10.0.0.46
2025-04-09 12:42:10,223 - INFO - Verified Pod ctest-pod-34760394 in agent 10.0.0.46
2025-04-09 12:42:10,224 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=127041ac-bf39-4fe3-82bd-929a8f7208a6
2025-04-09 12:42:10,230 - INFO - Pod ctest-pod-34760394 with uuid 127041ac-bf39-4fe3-82bd-929a8f7208a6 found in kube manager
2025-04-09 12:42:10,230 - INFO - Pod ctest-pod-34760394 verification passed
2025-04-09 12:42:10,238 - DEBUG - Pod ctest-pod-31148144 not in running state.Currently in Pending
2025-04-09 12:42:15,246 - DEBUG - Pod ctest-pod-31148144 not in running state.Currently in Pending
2025-04-09 12:42:20,253 - INFO - Pod ctest-pod-31148144 is in running state.Got IP 10.47.255.247
2025-04-09 12:42:20,311 - DEBUG - Pod ctest-pod-31148144 has vmi 0ab8a6ae-1540-11f0-bcd7-fa163e0b7df1
2025-04-09 12:42:20,311 - INFO - Verified pod ctest-pod-31148144 in contrail-api
2025-04-09 12:42:20,327 - DEBUG - VMI 0ab8a6ae-1540-11f0-bcd7-fa163e0b7df1 is active in agent 10.0.0.46
2025-04-09 12:42:20,327 - INFO - Verified Pod ctest-pod-31148144 in agent 10.0.0.46
2025-04-09 12:42:20,327 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=319f9940-5284-48b4-8409-44355b87bf2d
2025-04-09 12:42:20,333 - INFO - Pod ctest-pod-31148144 with uuid 319f9940-5284-48b4-8409-44355b87bf2d found in kube manager
2025-04-09 12:42:20,333 - INFO - Pod ctest-pod-31148144 verification passed
2025-04-09 12:42:20,417 - INFO - Pod ctest-pod-65503372 is in running state.Got IP 10.47.255.245
2025-04-09 12:42:20,433 - DEBUG - Pod ctest-pod-65503372 has vmi 0bb9feea-1540-11f0-bcd7-fa163e0b7df1
2025-04-09 12:42:20,433 - INFO - Verified pod ctest-pod-65503372 in contrail-api
2025-04-09 12:42:20,447 - DEBUG - VMI 0bb9feea-1540-11f0-bcd7-fa163e0b7df1 is active in agent 10.0.0.46
2025-04-09 12:42:20,447 - INFO - Verified Pod ctest-pod-65503372 in agent 10.0.0.46
2025-04-09 12:42:20,447 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=bf31ecae-be10-4f6d-a0e0-22c0b8cff322
2025-04-09 12:42:20,452 - INFO - Pod ctest-pod-65503372 with uuid bf31ecae-be10-4f6d-a0e0-22c0b8cff322 found in kube manager
2025-04-09 12:42:20,452 - INFO - Pod ctest-pod-65503372 verification passed
2025-04-09 12:42:20,458 - INFO - Pod ctest-pod-40622306 is in running state.Got IP 10.47.255.246
2025-04-09 12:42:20,515 - DEBUG - Pod ctest-pod-40622306 has vmi 0b3bb710-1540-11f0-bcd7-fa163e0b7df1
2025-04-09 12:42:20,515 - INFO - Verified pod ctest-pod-40622306 in contrail-api
2025-04-09 12:42:20,530 - DEBUG - VMI 0b3bb710-1540-11f0-bcd7-fa163e0b7df1 is active in agent 10.0.0.46
2025-04-09 12:42:20,530 - INFO - Verified Pod ctest-pod-40622306 in agent 10.0.0.46
2025-04-09 12:42:20,530 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=1379a7c7-323f-438c-98e3-91a78b157143
2025-04-09 12:42:20,535 - INFO - Pod ctest-pod-40622306 with uuid 1379a7c7-323f-438c-98e3-91a78b157143 found in kube manager
2025-04-09 12:42:20,535 - INFO - Pod ctest-pod-40622306 verification passed
2025-04-09 12:42:20,540 - INFO - Pod ctest-pod-59537517 is in running state.Got IP 10.47.255.244
2025-04-09 12:42:20,556 - DEBUG - Pod ctest-pod-59537517 has vmi 0c3208e0-1540-11f0-bcd7-fa163e0b7df1
2025-04-09 12:42:20,556 - INFO - Verified pod ctest-pod-59537517 in contrail-api
2025-04-09 12:42:20,572 - DEBUG - VMI 0c3208e0-1540-11f0-bcd7-fa163e0b7df1 is active in agent 10.0.0.46
2025-04-09 12:42:20,572 - INFO - Verified Pod ctest-pod-59537517 in agent 10.0.0.46
2025-04-09 12:42:20,572 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_VirtualMachineDatabaseList?x=3c9e907b-d488-47b4-ac35-2097790fbab5
2025-04-09 12:42:20,578 - INFO - Pod ctest-pod-59537517 with uuid 3c9e907b-d488-47b4-ac35-2097790fbab5 found in kube manager
2025-04-09 12:42:20,578 - INFO - Pod ctest-pod-59537517 verification passed
2025-04-09 12:42:20,578 - INFO - ================================================================================
2025-04-09 12:42:20,578 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-09 12:42:20,578 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-09 12:42:20,826 - DEBUG - Nothing to compare xmpp stats {'10.0.0.46': {'10.0.0.22': '0'}} with
2025-04-09 12:42:20,826 - INFO - Initial checks done. Running the testcase now
2025-04-09 12:42:20,826 - INFO -
2025-04-09 12:42:20,889 - DEBUG - [Pod ctest-pod-78948979] Cmd: echo ctest-pod-78948979 > /usr/share/nginx/html/index.html, Output:
2025-04-09 12:42:20,956 - DEBUG - [Pod ctest-pod-95783104] Cmd: echo ctest-pod-95783104 > /usr/share/nginx/html/index.html, Output:
2025-04-09 12:42:21,013 - DEBUG - [Pod ctest-pod-43443297] Cmd: echo ctest-pod-43443297 > /usr/share/nginx/html/index.html, Output:
2025-04-09 12:42:21,080 - DEBUG - [Pod ctest-pod-34760394] Cmd: echo ctest-pod-34760394 > /usr/share/nginx/html/index.html, Output:
2025-04-09 12:42:21,082 - DEBUG - Service ctest-nginx-svc-64707375 not present
2025-04-09 12:42:21,083 - INFO - Creating service ctest-nginx-svc-64707375
2025-04-09 12:42:21,105 - INFO - Created Service ctest-nginx-svc-64707375
2025-04-09 12:42:21,115 - WARNING - Service UUID b99933f0-4f71-4c50-a7c8-2aca49552bbd not yet found in contrail-api
2025-04-09 12:42:22,124 - INFO - Validated that Service ctest-nginx-svc-64707375 is seen in contrail-api
2025-04-09 12:42:22,124 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_LoadbalancerDatabaseList?x=b99933f0-4f71-4c50-a7c8-2aca49552bbd
2025-04-09 12:42:22,130 - INFO - Service ctest-nginx-svc-64707375 with uuid b99933f0-4f71-4c50-a7c8-2aca49552bbd found in kube manager
2025-04-09 12:42:22,130 - INFO - Service ctest-nginx-svc-64707375 verification passed
2025-04-09 12:42:23,229 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95783104
2025-04-09 12:42:23,229 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 passed
2025-04-09 12:42:23,230 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95783104
2025-04-09 12:42:23,288 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95783104
2025-04-09 12:42:23,288 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 passed
2025-04-09 12:42:23,288 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95783104
2025-04-09 12:42:23,345 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-78948979
2025-04-09 12:42:23,345 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 passed
2025-04-09 12:42:23,345 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-78948979
2025-04-09 12:42:23,345 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78948979': 1, 'ctest-pod-95783104': 2}
2025-04-09 12:42:23,440 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: ctest-pod-78948979
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:42:23,440 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 passed
2025-04-09 12:42:23,440 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: ctest-pod-78948979
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:42:23,506 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: ctest-pod-95783104
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:42:23,506 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 passed
2025-04-09 12:42:23,506 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: ctest-pod-95783104
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:42:23,506 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78948979': 1, 'ctest-pod-95783104': 1}
2025-04-09 12:42:23,509 - DEBUG - Network policy ingress-on-service not present
2025-04-09 12:42:23,510 - INFO - Creating Network Policy ingress-on-service
2025-04-09 12:42:23,521 - INFO - Network policy found in k8s
2025-04-09 12:42:23,521 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=698f7727-b0d9-462e-958a-e1c5d57c5aa4
2025-04-09 12:42:23,535 - INFO - Network Policy ingress-on-service with uuid 698f7727-b0d9-462e-958a-e1c5d57c5aa4 found in kube manager
2025-04-09 12:42:23,578 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-09 12:42:23,579 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-09 12:42:23,579 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=698f7727-b0d9-462e-958a-e1c5d57c5aa4
2025-04-09 12:42:23,615 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-09 12:42:25,616 - DEBUG - Requesting: http://10.0.0.22:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=698f7727-b0d9-462e-958a-e1c5d57c5aa4
2025-04-09 12:42:25,664 - INFO - Network policy with name ingress-on-service found in agent
2025-04-09 12:42:25,664 - INFO - Network Policy ingress-on-service verification passed
2025-04-09 12:42:30,731 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:30,732 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:30,732 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:35,798 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:35,798 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:35,798 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:40,872 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:40,872 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:40,872 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:45,968 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:45,968 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:45,968 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:51,055 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:51,055 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:51,055 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:56,132 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:56,132 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:42:56,132 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:01,214 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:01,215 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:01,215 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:06,290 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:06,290 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:06,290 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:11,351 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:11,351 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:11,351 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:16,411 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:16,411 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:16,411 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:16,411 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-78948979': 0, 'ctest-pod-95783104': 0}
2025-04-09 12:43:16,483 - DEBUG - [Pod ctest-pod-40622306] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-78948979
2025-04-09 12:43:16,483 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 passed
2025-04-09 12:43:16,483 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-78948979
2025-04-09 12:43:16,551 - DEBUG - [Pod ctest-pod-40622306] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: ctest-pod-95783104
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:43:16,551 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 passed
2025-04-09 12:43:16,551 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd output: ctest-pod-95783104
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:43:16,551 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78948979': 1, 'ctest-pod-95783104': 1}
2025-04-09 12:43:21,619 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:21,619 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:21,619 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:26,683 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:26,683 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:26,683 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:31,773 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:31,773 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:31,773 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:36,848 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:36,848 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:36,848 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:41,917 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:41,917 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:41,917 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:46,989 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:46,989 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:46,989 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:52,072 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:52,072 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:52,072 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:57,163 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:57,163 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:43:57,163 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:02,228 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:02,228 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:02,228 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:07,295 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:07,295 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:07,295 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:07,295 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-78948979': 0, 'ctest-pod-95783104': 0}
2025-04-09 12:44:09,380 - DEBUG - [Pod ctest-pod-40622306] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.657 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.101 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.090 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.090/0.282/0.657 ms
2025-04-09 12:44:09,380 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-40622306 with expectation True passed
2025-04-09 12:44:11,447 - DEBUG - [Pod ctest-pod-31148144] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.900 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.083 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.355/0.900 ms
2025-04-09 12:44:11,447 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-31148144 with expectation True passed
2025-04-09 12:44:13,543 - DEBUG - [Pod ctest-pod-65503372] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.990 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.386/0.990 ms
2025-04-09 12:44:13,543 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65503372 with expectation True passed
2025-04-09 12:44:13,614 - DEBUG - [Pod ctest-pod-40622306] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 12:44:13,614 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-09 12:44:13,614 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 12:44:13,614 - INFO - wget check of of http://10.47.255.251 from ctest-pod-40622306 passed
2025-04-09 12:44:13,694 - DEBUG - [Pod ctest-pod-40622306] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 12:44:13,694 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-09 12:44:13,695 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 12:44:13,695 - INFO - wget check of of http://10.47.255.250 from ctest-pod-40622306 passed
2025-04-09 12:44:18,427 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-04-09 12:44:28,496 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-09 12:44:28,496 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-09 12:44:28,496 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-09 12:44:28,496 - INFO - wget check of of http://10.47.255.250 from ctest-pod-31148144 passed
2025-04-09 12:44:33,585 - DEBUG - [Pod ctest-pod-59537517] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-09 12:44:33,585 - DEBUG - [Pod Pod ctest-pod-59537517] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-09 12:44:33,585 - DEBUG - [Pod Pod ctest-pod-59537517] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-09 12:44:33,585 - INFO - wget check of of http://10.47.255.251 from ctest-pod-59537517 passed
2025-04-09 12:44:33,594 - INFO - Updating Network Policy ingress-on-service
2025-04-09 12:44:38,685 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:38,685 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:38,685 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:43,749 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:43,749 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:43,749 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:48,811 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:48,811 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:48,811 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:53,884 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:53,884 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:53,884 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:58,952 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:58,952 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:44:58,952 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:04,030 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:04,030 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:04,030 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:09,111 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:09,111 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:09,111 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:14,188 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:14,188 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:14,188 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:19,253 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:19,253 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:19,253 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:24,325 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:24,325 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:24,325 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
wget: download timed out
2025-04-09 12:45:24,325 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-78948979': 0, 'ctest-pod-95783104': 0}
2025-04-09 12:45:24,391 - DEBUG - [Pod ctest-pod-40622306] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: ctest-pod-95783104
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:45:24,392 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 passed
2025-04-09 12:45:24,392 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd output: ctest-pod-95783104
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:45:24,446 - DEBUG - [Pod ctest-pod-40622306] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95783104
2025-04-09 12:45:24,446 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 passed
2025-04-09 12:45:24,446 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd output: Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-95783104
2025-04-09 12:45:24,521 - DEBUG - [Pod ctest-pod-40622306] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: ctest-pod-95783104
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:45:24,521 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 passed
2025-04-09 12:45:24,521 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd output: ctest-pod-95783104
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:45:24,580 - DEBUG - [Pod ctest-pod-40622306] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: ctest-pod-78948979
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:45:24,580 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 passed
2025-04-09 12:45:24,580 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd output: ctest-pod-78948979
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:45:24,580 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78948979': 1, 'ctest-pod-95783104': 3}
2025-04-09 12:45:24,629 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: ctest-pod-95783104
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:45:24,629 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 passed
2025-04-09 12:45:24,629 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: ctest-pod-95783104
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:45:24,697 - DEBUG - [Pod ctest-pod-65503372] Cmd: wget http://10.99.9.94:80/ -O - -T 5 -t 1 , Output: ctest-pod-78948979
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:45:24,697 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd wget http://10.99.9.94:80/ -O - -T 5 -t 1 passed
2025-04-09 12:45:24,697 - DEBUG - [Pod Pod ctest-pod-65503372] Cmd output: ctest-pod-78948979
Connecting to 10.99.9.94:80 (10.99.9.94:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-09 12:45:24,697 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-78948979': 1, 'ctest-pod-95783104': 1}
2025-04-09 12:45:26,754 - DEBUG - [Pod ctest-pod-40622306] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.779 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.095 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.147 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.095/0.340/0.779 ms
2025-04-09 12:45:26,754 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-40622306 with expectation True passed
2025-04-09 12:45:28,823 - DEBUG - [Pod ctest-pod-31148144] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.538 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.068 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.103 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.068/0.236/0.538 ms
2025-04-09 12:45:28,824 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-31148144 with expectation True passed
2025-04-09 12:45:30,907 - DEBUG - [Pod ctest-pod-65503372] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.241 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.073 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.073/0.470/1.241 ms
2025-04-09 12:45:30,907 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-65503372 with expectation True passed
2025-04-09 12:45:30,992 - DEBUG - [Pod ctest-pod-40622306] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 12:45:30,992 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-09 12:45:30,992 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 12:45:30,992 - INFO - wget check of of http://10.47.255.251 from ctest-pod-40622306 passed
2025-04-09 12:45:31,058 - DEBUG - [Pod ctest-pod-40622306] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 12:45:31,058 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-09 12:45:31,058 - DEBUG - [Pod Pod ctest-pod-40622306] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 12:45:31,058 - INFO - wget check of of http://10.47.255.250 from ctest-pod-40622306 passed
2025-04-09 12:45:36,119 - DEBUG - [Pod ctest-pod-31148144] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-09 12:45:36,119 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-09 12:45:36,119 - DEBUG - [Pod Pod ctest-pod-31148144] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-09 12:45:36,119 - INFO - wget check of of http://10.47.255.250 from ctest-pod-31148144 passed
2025-04-09 12:45:36,185 - DEBUG - [Pod ctest-pod-59537517] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 12:45:36,186 - DEBUG - [Pod Pod ctest-pod-59537517] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-09 12:45:36,186 - DEBUG - [Pod Pod ctest-pod-59537517] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-09 12:45:36,186 - INFO - wget check of of http://10.47.255.251 from ctest-pod-59537517 passed
2025-04-09 12:45:36,186 - INFO - Deleting Network Policy : ingress-on-service
2025-04-09 12:45:36,186 - INFO - Deleting service : ctest-nginx-svc-64707375
2025-04-09 12:45:36,446 - DEBUG - No XMPP flaps were noticed during the test
2025-04-09 12:45:36,446 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:16]
2025-04-09 12:45:36,447 - INFO - --------------------------------------------------------------------------------
2025-04-09 12:45:36,457 - INFO - Deleting pod ctest-new-default-39622616:ctest-pod-78948979
2025-04-09 12:45:36,459 - INFO - Deleting pod ctest-new-default-39622616:ctest-pod-95783104
2025-04-09 12:45:36,459 - INFO - Deleting pod ctest-non-default-65346425:ctest-pod-43443297
2025-04-09 12:45:36,460 - INFO - Deleting pod ctest-non-default-65346425:ctest-pod-34760394
2025-04-09 12:45:36,460 - INFO - Deleting pod ctest-new-default-39622616:ctest-pod-31148144
2025-04-09 12:45:36,460 - INFO - Deleting pod ctest-new-default-39622616:ctest-pod-40622306
2025-04-09 12:45:36,461 - INFO - Deleting pod ctest-non-default-65346425:ctest-pod-65503372
2025-04-09 12:45:36,461 - INFO - Deleting pod ctest-non-default-65346425:ctest-pod-59537517
2025-04-09 12:45:36,672 - WARNING - Pod uuid 3c9e907b-d488-47b4-ac35-2097790fbab5 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:36,673 - WARNING - Pod uuid 1d0899da-416c-439a-9c14-a9b618a2c4af is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:36,673 - WARNING - Pod uuid 1379a7c7-323f-438c-98e3-91a78b157143 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:36,673 - WARNING - Pod uuid 127041ac-bf39-4fe3-82bd-929a8f7208a6 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:36,674 - WARNING - Pod uuid bf31ecae-be10-4f6d-a0e0-22c0b8cff322 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:36,674 - WARNING - Pod uuid 319f9940-5284-48b4-8409-44355b87bf2d is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:36,674 - WARNING - Pod uuid c59f0193-e44e-4853-ab58-0db0f1d76275 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:36,674 - WARNING - Pod uuid c1d14fe4-ca07-43f5-b5e6-88926983cb87 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:41,707 - DEBUG - Pod 127041ac-bf39-4fe3-82bd-929a8f7208a6 is not in agent 10.0.0.46 VM list
2025-04-09 12:45:41,709 - WARNING - Pod uuid bf31ecae-be10-4f6d-a0e0-22c0b8cff322 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:41,709 - WARNING - Pod uuid 1379a7c7-323f-438c-98e3-91a78b157143 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:41,712 - WARNING - Pod uuid 319f9940-5284-48b4-8409-44355b87bf2d is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:41,712 - DEBUG - Pod c59f0193-e44e-4853-ab58-0db0f1d76275 is not in agent 10.0.0.46 VM list
2025-04-09 12:45:41,714 - DEBUG - Pod c1d14fe4-ca07-43f5-b5e6-88926983cb87 is not in agent 10.0.0.46 VM list
2025-04-09 12:45:41,715 - DEBUG - Pod 1d0899da-416c-439a-9c14-a9b618a2c4af is not in agent 10.0.0.46 VM list
2025-04-09 12:45:41,716 - WARNING - Pod uuid 3c9e907b-d488-47b4-ac35-2097790fbab5 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:41,729 - DEBUG - VMI 08cc3892-1540-11f0-bcd7-fa163e0b7df1 is removed from agent 10.0.0.46
2025-04-09 12:45:41,729 - INFO - Verified that pod ctest-pod-95783104 is removed in agent
2025-04-09 12:45:41,730 - DEBUG - VMI 0a1b82ac-1540-11f0-bcd7-fa163e0b7df1 is removed from agent 10.0.0.46
2025-04-09 12:45:41,730 - INFO - Verified that pod ctest-pod-34760394 is removed in agent
2025-04-09 12:45:41,731 - DEBUG - VMI 0996b52c-1540-11f0-bcd7-fa163e0b7df1 is removed from agent 10.0.0.46
2025-04-09 12:45:41,731 - INFO - Verified that pod ctest-pod-43443297 is removed in agent
2025-04-09 12:45:41,732 - DEBUG - VMI 0847b676-1540-11f0-bcd7-fa163e0b7df1 is removed from agent 10.0.0.46
2025-04-09 12:45:41,732 - INFO - Verified that pod ctest-pod-78948979 is removed in agent
2025-04-09 12:45:46,734 - WARNING - Pod uuid 1379a7c7-323f-438c-98e3-91a78b157143 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:46,736 - WARNING - Pod uuid 319f9940-5284-48b4-8409-44355b87bf2d is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:46,737 - WARNING - Pod uuid 3c9e907b-d488-47b4-ac35-2097790fbab5 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:46,737 - WARNING - Pod uuid bf31ecae-be10-4f6d-a0e0-22c0b8cff322 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:51,753 - WARNING - Pod uuid 1379a7c7-323f-438c-98e3-91a78b157143 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:51,756 - WARNING - Pod uuid bf31ecae-be10-4f6d-a0e0-22c0b8cff322 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:51,756 - WARNING - Pod uuid 3c9e907b-d488-47b4-ac35-2097790fbab5 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:51,757 - WARNING - Pod uuid 319f9940-5284-48b4-8409-44355b87bf2d is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:56,783 - WARNING - Pod uuid 1379a7c7-323f-438c-98e3-91a78b157143 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:56,786 - WARNING - Pod uuid 319f9940-5284-48b4-8409-44355b87bf2d is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:56,787 - WARNING - Pod uuid 3c9e907b-d488-47b4-ac35-2097790fbab5 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:45:56,787 - WARNING - Pod uuid bf31ecae-be10-4f6d-a0e0-22c0b8cff322 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:46:01,794 - WARNING - Pod uuid 1379a7c7-323f-438c-98e3-91a78b157143 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:46:01,806 - WARNING - Pod uuid 3c9e907b-d488-47b4-ac35-2097790fbab5 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:46:01,807 - WARNING - Pod uuid 319f9940-5284-48b4-8409-44355b87bf2d is still seen in agent 10.0.0.46 VM list
2025-04-09 12:46:01,809 - WARNING - Pod uuid bf31ecae-be10-4f6d-a0e0-22c0b8cff322 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:46:06,832 - WARNING - Pod uuid 3c9e907b-d488-47b4-ac35-2097790fbab5 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:46:06,832 - WARNING - Pod uuid 1379a7c7-323f-438c-98e3-91a78b157143 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:46:06,833 - WARNING - Pod uuid bf31ecae-be10-4f6d-a0e0-22c0b8cff322 is still seen in agent 10.0.0.46 VM list
2025-04-09 12:46:06,834 - WARNING - Pod uuid 319f9940-5284-48b4-8409-44355b87bf2d is still seen in agent 10.0.0.46 VM list
2025-04-09 12:46:11,854 - DEBUG - Pod 1379a7c7-323f-438c-98e3-91a78b157143 is not in agent 10.0.0.46 VM list
2025-04-09 12:46:11,856 - DEBUG - Pod 3c9e907b-d488-47b4-ac35-2097790fbab5 is not in agent 10.0.0.46 VM list
2025-04-09 12:46:11,860 - DEBUG - Pod bf31ecae-be10-4f6d-a0e0-22c0b8cff322 is not in agent 10.0.0.46 VM list
2025-04-09 12:46:11,861 - DEBUG - Pod 319f9940-5284-48b4-8409-44355b87bf2d is not in agent 10.0.0.46 VM list
2025-04-09 12:46:11,877 - DEBUG - VMI 0b3bb710-1540-11f0-bcd7-fa163e0b7df1 is removed from agent 10.0.0.46
2025-04-09 12:46:11,877 - INFO - Verified that pod ctest-pod-40622306 is removed in agent
2025-04-09 12:46:11,877 - DEBUG - VMI 0c3208e0-1540-11f0-bcd7-fa163e0b7df1 is removed from agent 10.0.0.46
2025-04-09 12:46:11,877 - INFO - Verified that pod ctest-pod-59537517 is removed in agent
2025-04-09 12:46:11,880 - DEBUG - VMI 0bb9feea-1540-11f0-bcd7-fa163e0b7df1 is removed from agent 10.0.0.46
2025-04-09 12:46:11,880 - INFO - Verified that pod ctest-pod-65503372 is removed in agent
2025-04-09 12:46:11,880 - DEBUG - VMI 0ab8a6ae-1540-11f0-bcd7-fa163e0b7df1 is removed from agent 10.0.0.46
2025-04-09 12:46:11,880 - INFO - Verified that pod ctest-pod-31148144 is removed in agent
2025-04-09 12:46:11,880 - INFO - Deleting namespace ctest-non-default-65346425
2025-04-09 12:46:11,892 - DEBUG - Namespace ctest-non-default-65346425 still in k8s
2025-04-09 12:46:13,896 - DEBUG - Namespace ctest-non-default-65346425 still in k8s
2025-04-09 12:46:15,901 - DEBUG - Namespace ctest-non-default-65346425 still in k8s
2025-04-09 12:46:17,905 - DEBUG - Namespace ctest-non-default-65346425 is not in k8s
2025-04-09 12:46:17,905 - DEBUG - No need to check project deletion in contrail-api
2025-04-09 12:46:17,905 - INFO - Deleting namespace ctest-new-default-39622616
2025-04-09 12:46:17,922 - DEBUG - Namespace ctest-new-default-39622616 still in k8s
2025-04-09 12:46:19,927 - DEBUG - Namespace ctest-new-default-39622616 still in k8s
2025-04-09 12:46:21,938 - DEBUG - Namespace ctest-new-default-39622616 still in k8s
2025-04-09 12:46:23,942 - DEBUG - Namespace ctest-new-default-39622616 is not in k8s
2025-04-09 12:46:23,942 - DEBUG - No need to check project deletion in contrail-api