2025-06-30 17:13:59,974 - INFO - Using existing project ['default-domain', 'k8s-default'](57f72c25-5885-4947-b22d-1effb0803f33)
2025-06-30 17:13:59,997 - DEBUG - Namespace ctest-new-default-84330585 not present
2025-06-30 17:14:00,009 - INFO - Created namespace ctest-new-default-84330585
2025-06-30 17:14:03,020 - DEBUG - Namespace ctest-non-default-29157026 not present
2025-06-30 17:14:03,050 - INFO - Created namespace ctest-non-default-29157026
2025-06-30 17:14:06,106 - DEBUG - Pod ctest-pod-11717738 not present
2025-06-30 17:14:06,107 - INFO - Creating Pod ctest-pod-11717738
2025-06-30 17:14:06,170 - DEBUG - Pod : ctest-pod-11717738 UUID is 453309b3-a057-400c-9d09-c4708601dce5
2025-06-30 17:14:06,174 - DEBUG - Pod ctest-pod-59384131 not present
2025-06-30 17:14:06,174 - INFO - Creating Pod ctest-pod-59384131
2025-06-30 17:14:06,197 - DEBUG - Pod : ctest-pod-59384131 UUID is 1b7efcb3-d5d4-4289-80b0-861af3719b56
2025-06-30 17:14:06,213 - DEBUG - Pod ctest-pod-54614198 not present
2025-06-30 17:14:06,213 - INFO - Creating Pod ctest-pod-54614198
2025-06-30 17:14:06,237 - DEBUG - Pod : ctest-pod-54614198 UUID is 2e655df6-39ff-4bc9-80b2-b563c9f6689a
2025-06-30 17:14:06,243 - DEBUG - Pod ctest-pod-64619147 not present
2025-06-30 17:14:06,243 - INFO - Creating Pod ctest-pod-64619147
2025-06-30 17:14:06,263 - DEBUG - Pod : ctest-pod-64619147 UUID is a6bd8fd1-cab2-433e-8813-e4d3384c0bb9
2025-06-30 17:14:06,265 - DEBUG - Pod ctest-pod-96994045 not present
2025-06-30 17:14:06,266 - INFO - Creating Pod ctest-pod-96994045
2025-06-30 17:14:06,284 - DEBUG - Pod : ctest-pod-96994045 UUID is 1c6f2cf7-19c7-4a2c-9eb8-eefe45b24e2a
2025-06-30 17:14:06,286 - DEBUG - Pod ctest-pod-72547048 not present
2025-06-30 17:14:06,286 - INFO - Creating Pod ctest-pod-72547048
2025-06-30 17:14:06,313 - DEBUG - Pod : ctest-pod-72547048 UUID is 950e99f4-0c37-4e6e-b410-42aa3f6e321b
2025-06-30 17:14:06,315 - DEBUG - Pod ctest-pod-56772761 not present
2025-06-30 17:14:06,316 - INFO - Creating Pod ctest-pod-56772761
2025-06-30 17:14:06,342 - DEBUG - Pod : ctest-pod-56772761 UUID is 94e5dc7b-c962-4616-9b28-828fb7722a01
2025-06-30 17:14:06,347 - DEBUG - Pod ctest-pod-32105288 not present
2025-06-30 17:14:06,347 - INFO - Creating Pod ctest-pod-32105288
2025-06-30 17:14:06,366 - DEBUG - Pod : ctest-pod-32105288 UUID is 01b4f920-3d5a-451c-9256-97e8ef3a69bd
2025-06-30 17:14:06,512 - INFO - Project default-domain:k8s-ctest-new-default-84330585 for Namespace ctest-new-default-84330585 is seen in contrail-api
2025-06-30 17:14:06,512 - DEBUG - Project uuid in Contrail is 95d81fbe-ecab-4947-9f8b-9fa4380d1e04
2025-06-30 17:14:06,698 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=2f8e3efd-44f9-4a00-99e5-d79b57c581fc
2025-06-30 17:14:06,704 - INFO - Namespace ctest-new-default-84330585 with uuid 2f8e3efd-44f9-4a00-99e5-d79b57c581fc found in kube manager
2025-06-30 17:14:06,704 - INFO - Namespace ctest-new-default-84330585 verification passed
2025-06-30 17:14:06,924 - INFO - Project default-domain:k8s-ctest-non-default-29157026 for Namespace ctest-non-default-29157026 is seen in contrail-api
2025-06-30 17:14:06,925 - DEBUG - Project uuid in Contrail is b3464693-0bc9-4285-9857-415c27e7d4ae
2025-06-30 17:14:06,925 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NamespaceDatabaseList?namespace_uuid=826287b3-0caa-4ce1-af2e-89ef01b247a5
2025-06-30 17:14:06,934 - INFO - Namespace ctest-non-default-29157026 with uuid 826287b3-0caa-4ce1-af2e-89ef01b247a5 found in kube manager
2025-06-30 17:14:06,934 - INFO - Namespace ctest-non-default-29157026 verification passed
2025-06-30 17:14:06,941 - DEBUG - Pod ctest-pod-11717738 not in running state.Currently in Pending
2025-06-30 17:14:11,947 - DEBUG - Pod ctest-pod-11717738 not in running state.Currently in Pending
2025-06-30 17:14:16,972 - DEBUG - Pod ctest-pod-11717738 not in running state.Currently in Pending
2025-06-30 17:14:21,986 - INFO - Pod ctest-pod-11717738 is in running state.Got IP 10.47.255.251
2025-06-30 17:14:22,025 - DEBUG - Pod ctest-pod-11717738 has vmi a1bdce0a-55d5-11f0-b7a3-fa163eaa053a
2025-06-30 17:14:22,025 - INFO - Verified pod ctest-pod-11717738 in contrail-api
2025-06-30 17:14:22,039 - DEBUG - VMI a1bdce0a-55d5-11f0-b7a3-fa163eaa053a is active in agent 10.0.0.22
2025-06-30 17:14:22,039 - INFO - Verified Pod ctest-pod-11717738 in agent 10.0.0.22
2025-06-30 17:14:22,039 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=453309b3-a057-400c-9d09-c4708601dce5
2025-06-30 17:14:22,046 - INFO - Pod ctest-pod-11717738 with uuid 453309b3-a057-400c-9d09-c4708601dce5 found in kube manager
2025-06-30 17:14:22,047 - INFO - Pod ctest-pod-11717738 verification passed
2025-06-30 17:14:22,058 - INFO - Pod ctest-pod-59384131 is in running state.Got IP 10.47.255.250
2025-06-30 17:14:22,117 - DEBUG - Pod ctest-pod-59384131 has vmi a23835dc-55d5-11f0-b7a3-fa163eaa053a
2025-06-30 17:14:22,118 - INFO - Verified pod ctest-pod-59384131 in contrail-api
2025-06-30 17:14:22,137 - DEBUG - VMI a23835dc-55d5-11f0-b7a3-fa163eaa053a is active in agent 10.0.0.22
2025-06-30 17:14:22,137 - INFO - Verified Pod ctest-pod-59384131 in agent 10.0.0.22
2025-06-30 17:14:22,137 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=1b7efcb3-d5d4-4289-80b0-861af3719b56
2025-06-30 17:14:22,143 - INFO - Pod ctest-pod-59384131 with uuid 1b7efcb3-d5d4-4289-80b0-861af3719b56 found in kube manager
2025-06-30 17:14:22,143 - INFO - Pod ctest-pod-59384131 verification passed
2025-06-30 17:14:22,156 - INFO - Pod ctest-pod-54614198 is in running state.Got IP 10.47.255.249
2025-06-30 17:14:22,175 - DEBUG - Pod ctest-pod-54614198 has vmi a2eadb4c-55d5-11f0-b7a3-fa163eaa053a
2025-06-30 17:14:22,175 - INFO - Verified pod ctest-pod-54614198 in contrail-api
2025-06-30 17:14:22,192 - DEBUG - VMI a2eadb4c-55d5-11f0-b7a3-fa163eaa053a is active in agent 10.0.0.22
2025-06-30 17:14:22,192 - INFO - Verified Pod ctest-pod-54614198 in agent 10.0.0.22
2025-06-30 17:14:22,193 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=2e655df6-39ff-4bc9-80b2-b563c9f6689a
2025-06-30 17:14:22,201 - INFO - Pod ctest-pod-54614198 with uuid 2e655df6-39ff-4bc9-80b2-b563c9f6689a found in kube manager
2025-06-30 17:14:22,201 - INFO - Pod ctest-pod-54614198 verification passed
2025-06-30 17:14:22,208 - INFO - Pod ctest-pod-64619147 is in running state.Got IP 10.47.255.248
2025-06-30 17:14:22,269 - DEBUG - Pod ctest-pod-64619147 has vmi a35edfce-55d5-11f0-b7a3-fa163eaa053a
2025-06-30 17:14:22,269 - INFO - Verified pod ctest-pod-64619147 in contrail-api
2025-06-30 17:14:22,287 - DEBUG - VMI a35edfce-55d5-11f0-b7a3-fa163eaa053a is active in agent 10.0.0.22
2025-06-30 17:14:22,287 - INFO - Verified Pod ctest-pod-64619147 in agent 10.0.0.22
2025-06-30 17:14:22,287 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=a6bd8fd1-cab2-433e-8813-e4d3384c0bb9
2025-06-30 17:14:22,294 - INFO - Pod ctest-pod-64619147 with uuid a6bd8fd1-cab2-433e-8813-e4d3384c0bb9 found in kube manager
2025-06-30 17:14:22,294 - INFO - Pod ctest-pod-64619147 verification passed
2025-06-30 17:14:22,309 - DEBUG - Pod ctest-pod-96994045 not in running state.Currently in Pending
2025-06-30 17:14:27,323 - INFO - Pod ctest-pod-96994045 is in running state.Got IP 10.47.255.247
2025-06-30 17:14:27,357 - DEBUG - Pod ctest-pod-96994045 has vmi a3ddd96e-55d5-11f0-b7a3-fa163eaa053a
2025-06-30 17:14:27,358 - INFO - Verified pod ctest-pod-96994045 in contrail-api
2025-06-30 17:14:27,381 - DEBUG - VMI a3ddd96e-55d5-11f0-b7a3-fa163eaa053a is active in agent 10.0.0.22
2025-06-30 17:14:27,381 - INFO - Verified Pod ctest-pod-96994045 in agent 10.0.0.22
2025-06-30 17:14:27,382 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=1c6f2cf7-19c7-4a2c-9eb8-eefe45b24e2a
2025-06-30 17:14:27,393 - INFO - Pod ctest-pod-96994045 with uuid 1c6f2cf7-19c7-4a2c-9eb8-eefe45b24e2a found in kube manager
2025-06-30 17:14:27,394 - INFO - Pod ctest-pod-96994045 verification passed
2025-06-30 17:14:27,405 - INFO - Pod ctest-pod-56772761 is in running state.Got IP 10.47.255.245
2025-06-30 17:14:27,438 - DEBUG - Pod ctest-pod-56772761 has vmi a4c59736-55d5-11f0-b7a3-fa163eaa053a
2025-06-30 17:14:27,438 - INFO - Verified pod ctest-pod-56772761 in contrail-api
2025-06-30 17:14:27,462 - DEBUG - VMI a4c59736-55d5-11f0-b7a3-fa163eaa053a is active in agent 10.0.0.22
2025-06-30 17:14:27,463 - INFO - Verified Pod ctest-pod-56772761 in agent 10.0.0.22
2025-06-30 17:14:27,463 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=94e5dc7b-c962-4616-9b28-828fb7722a01
2025-06-30 17:14:27,470 - INFO - Pod ctest-pod-56772761 with uuid 94e5dc7b-c962-4616-9b28-828fb7722a01 found in kube manager
2025-06-30 17:14:27,470 - INFO - Pod ctest-pod-56772761 verification passed
2025-06-30 17:14:27,481 - INFO - Pod ctest-pod-72547048 is in running state.Got IP 10.47.255.246
2025-06-30 17:14:27,545 - DEBUG - Pod ctest-pod-72547048 has vmi a44e7a98-55d5-11f0-b7a3-fa163eaa053a
2025-06-30 17:14:27,545 - INFO - Verified pod ctest-pod-72547048 in contrail-api
2025-06-30 17:14:27,563 - DEBUG - VMI a44e7a98-55d5-11f0-b7a3-fa163eaa053a is active in agent 10.0.0.22
2025-06-30 17:14:27,564 - INFO - Verified Pod ctest-pod-72547048 in agent 10.0.0.22
2025-06-30 17:14:27,564 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=950e99f4-0c37-4e6e-b410-42aa3f6e321b
2025-06-30 17:14:27,573 - INFO - Pod ctest-pod-72547048 with uuid 950e99f4-0c37-4e6e-b410-42aa3f6e321b found in kube manager
2025-06-30 17:14:27,574 - INFO - Pod ctest-pod-72547048 verification passed
2025-06-30 17:14:27,588 - INFO - Pod ctest-pod-32105288 is in running state.Got IP 10.47.255.244
2025-06-30 17:14:27,621 - DEBUG - Pod ctest-pod-32105288 has vmi a538721a-55d5-11f0-b7a3-fa163eaa053a
2025-06-30 17:14:27,622 - INFO - Verified pod ctest-pod-32105288 in contrail-api
2025-06-30 17:14:27,637 - DEBUG - VMI a538721a-55d5-11f0-b7a3-fa163eaa053a is active in agent 10.0.0.22
2025-06-30 17:14:27,637 - INFO - Verified Pod ctest-pod-32105288 in agent 10.0.0.22
2025-06-30 17:14:27,637 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_VirtualMachineDatabaseList?x=01b4f920-3d5a-451c-9256-97e8ef3a69bd
2025-06-30 17:14:27,643 - INFO - Pod ctest-pod-32105288 with uuid 01b4f920-3d5a-451c-9256-97e8ef3a69bd found in kube manager
2025-06-30 17:14:27,643 - INFO - Pod ctest-pod-32105288 verification passed
2025-06-30 17:14:27,643 - INFO - ================================================================================
2025-06-30 17:14:27,643 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-06-30 17:14:27,644 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-06-30 17:14:27,901 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.33': '0'}} with
2025-06-30 17:14:27,901 - INFO - Initial checks done. Running the testcase now
2025-06-30 17:14:27,901 - INFO -
2025-06-30 17:14:27,962 - DEBUG - [Pod ctest-pod-11717738] Cmd: echo ctest-pod-11717738 > /usr/share/nginx/html/index.html, Output:
2025-06-30 17:14:28,058 - DEBUG - [Pod ctest-pod-59384131] Cmd: echo ctest-pod-59384131 > /usr/share/nginx/html/index.html, Output:
2025-06-30 17:14:28,119 - DEBUG - [Pod ctest-pod-54614198] Cmd: echo ctest-pod-54614198 > /usr/share/nginx/html/index.html, Output:
2025-06-30 17:14:28,183 - DEBUG - [Pod ctest-pod-64619147] Cmd: echo ctest-pod-64619147 > /usr/share/nginx/html/index.html, Output:
2025-06-30 17:14:28,187 - DEBUG - Service ctest-nginx-svc-43554002 not present
2025-06-30 17:14:28,187 - INFO - Creating service ctest-nginx-svc-43554002
2025-06-30 17:14:28,206 - INFO - Created Service ctest-nginx-svc-43554002
2025-06-30 17:14:28,215 - WARNING - Service UUID f749e772-181b-446e-8a27-4adb98bd2391 not yet found in contrail-api
2025-06-30 17:14:29,224 - INFO - Validated that Service ctest-nginx-svc-43554002 is seen in contrail-api
2025-06-30 17:14:29,224 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_LoadbalancerDatabaseList?x=f749e772-181b-446e-8a27-4adb98bd2391
2025-06-30 17:14:29,231 - INFO - Service ctest-nginx-svc-43554002 with uuid f749e772-181b-446e-8a27-4adb98bd2391 found in kube manager
2025-06-30 17:14:29,231 - INFO - Service ctest-nginx-svc-43554002 verification passed
2025-06-30 17:14:30,316 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-59384131
2025-06-30 17:14:30,316 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:14:30,317 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-59384131
2025-06-30 17:14:30,405 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:14:30,405 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:14:30,405 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:14:30,483 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: ctest-pod-11717738
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:14:30,484 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:14:30,484 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: ctest-pod-11717738
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:14:30,484 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11717738': 1, 'ctest-pod-59384131': 2}
2025-06-30 17:14:30,572 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:14:30,572 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:14:30,572 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:14:30,649 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:14:30,649 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:14:30,649 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:14:30,716 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: ctest-pod-11717738
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:14:30,717 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:14:30,717 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: ctest-pod-11717738
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:14:30,717 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11717738': 1, 'ctest-pod-59384131': 2}
2025-06-30 17:14:30,723 - DEBUG - Network policy ingress-on-service not present
2025-06-30 17:14:30,724 - INFO - Creating Network Policy ingress-on-service
2025-06-30 17:14:30,827 - INFO - Network policy found in k8s
2025-06-30 17:14:30,827 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5d26467b-d8be-4d62-a949-34295335d73b
2025-06-30 17:14:30,843 - INFO - Network Policy ingress-on-service with uuid 5d26467b-d8be-4d62-a949-34295335d73b found in kube manager
2025-06-30 17:14:30,910 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-06-30 17:14:30,911 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-06-30 17:14:30,911 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5d26467b-d8be-4d62-a949-34295335d73b
2025-06-30 17:14:30,954 - WARNING - Network policy with name ingress-on-service not found in agent
2025-06-30 17:14:32,955 - DEBUG - Requesting: http://10.0.0.33:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=5d26467b-d8be-4d62-a949-34295335d73b
2025-06-30 17:14:33,007 - INFO - Network policy with name ingress-on-service found in agent
2025-06-30 17:14:33,008 - INFO - Network Policy ingress-on-service verification passed
2025-06-30 17:14:38,096 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:14:38,096 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:14:38,096 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:14:43,157 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:14:43,157 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:14:43,157 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:14:48,241 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:14:48,242 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:14:48,242 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:14:50,734 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-06-30 17:15:00,841 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:00,841 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:00,841 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:05,910 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:05,910 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:05,910 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:10,980 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:10,980 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:10,980 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:16,036 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:16,037 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:16,037 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:21,108 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:21,108 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:21,109 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:26,186 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:26,187 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:26,187 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:31,245 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:31,245 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:31,245 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:31,245 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-11717738': 0, 'ctest-pod-59384131': 0}
2025-06-30 17:15:31,353 - DEBUG - [Pod ctest-pod-72547048] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:15:31,354 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:15:31,354 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:15:31,424 - DEBUG - [Pod ctest-pod-72547048] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:15:31,425 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:15:31,425 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:15:31,487 - DEBUG - [Pod ctest-pod-72547048] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: ctest-pod-11717738
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:15:31,487 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:15:31,488 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd output: ctest-pod-11717738
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:15:31,488 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11717738': 1, 'ctest-pod-59384131': 2}
2025-06-30 17:15:36,553 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:36,553 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:36,554 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:41,626 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:41,626 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:41,626 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:46,697 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:46,697 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:46,697 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:51,794 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:51,794 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:51,794 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:56,877 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:56,878 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:15:56,878 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:01,950 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:01,950 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:01,950 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:07,022 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:07,022 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:07,022 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:12,096 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:12,096 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:12,096 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:17,153 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:17,153 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:17,153 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:22,231 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:22,231 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:22,231 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:22,232 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-11717738': 0, 'ctest-pod-59384131': 0}
2025-06-30 17:16:24,307 - DEBUG - [Pod ctest-pod-72547048] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.176 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.191 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.160 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.160/0.509/1.176 ms
2025-06-30 17:16:24,308 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-72547048 with expectation True passed
2025-06-30 17:16:26,378 - DEBUG - [Pod ctest-pod-96994045] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.815 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.080 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.077/0.657/1.815 ms
2025-06-30 17:16:26,378 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-96994045 with expectation True passed
2025-06-30 17:16:28,452 - DEBUG - [Pod ctest-pod-56772761] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.570 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.084/0.248/0.570 ms
2025-06-30 17:16:28,452 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-56772761 with expectation True passed
2025-06-30 17:16:28,527 - DEBUG - [Pod ctest-pod-72547048] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-30 17:16:28,527 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-06-30 17:16:28,527 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-30 17:16:28,527 - INFO - wget check of of http://10.47.255.251 from ctest-pod-72547048 passed
2025-06-30 17:16:28,624 - DEBUG - [Pod ctest-pod-72547048] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-30 17:16:28,624 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-06-30 17:16:28,624 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-30 17:16:28,624 - INFO - wget check of of http://10.47.255.250 from ctest-pod-72547048 passed
2025-06-30 17:16:33,677 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-30 17:16:33,678 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-30 17:16:33,678 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-30 17:16:33,678 - INFO - wget check of of http://10.47.255.250 from ctest-pod-96994045 passed
2025-06-30 17:16:38,750 - DEBUG - [Pod ctest-pod-32105288] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-06-30 17:16:38,750 - DEBUG - [Pod Pod ctest-pod-32105288] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-06-30 17:16:38,750 - DEBUG - [Pod Pod ctest-pod-32105288] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-06-30 17:16:38,750 - INFO - wget check of of http://10.47.255.251 from ctest-pod-32105288 passed
2025-06-30 17:16:38,770 - INFO - Updating Network Policy ingress-on-service
2025-06-30 17:16:43,837 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:43,837 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:43,837 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:48,905 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:48,905 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:48,905 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:53,989 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:53,990 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:53,990 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:59,062 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:59,062 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:16:59,062 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:04,129 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:04,130 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:04,130 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:09,191 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:09,191 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:09,191 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:14,266 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:14,266 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:14,267 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:19,337 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:19,338 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:19,338 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:24,409 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:24,409 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:24,409 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:29,489 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:29,489 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:29,490 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
wget: download timed out
2025-06-30 17:17:29,490 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-11717738': 0, 'ctest-pod-59384131': 0}
2025-06-30 17:17:29,573 - DEBUG - [Pod ctest-pod-72547048] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: ctest-pod-11717738
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:17:29,574 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:17:29,574 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd output: ctest-pod-11717738
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:17:29,651 - DEBUG - [Pod ctest-pod-72547048] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: ctest-pod-11717738
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:17:29,652 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:17:29,652 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd output: ctest-pod-11717738
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:17:29,736 - DEBUG - [Pod ctest-pod-72547048] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:17:29,736 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:17:29,736 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:17:29,736 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11717738': 2, 'ctest-pod-59384131': 1}
2025-06-30 17:17:29,815 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:17:29,816 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:17:29,816 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:17:29,881 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:17:29,881 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:17:29,881 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: ctest-pod-59384131
Connecting to 10.102.230.217:80 (10.102.230.217:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:17:29,952 - DEBUG - [Pod ctest-pod-56772761] Cmd: wget http://10.102.230.217:80/ -O - -T 5 -t 1 , Output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
ctest-pod-11717738
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:17:29,953 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd wget http://10.102.230.217:80/ -O - -T 5 -t 1 passed
2025-06-30 17:17:29,953 - DEBUG - [Pod Pod ctest-pod-56772761] Cmd output: Connecting to 10.102.230.217:80 (10.102.230.217:80)
ctest-pod-11717738
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-06-30 17:17:29,953 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-11717738': 1, 'ctest-pod-59384131': 2}
2025-06-30 17:17:32,042 - DEBUG - [Pod ctest-pod-72547048] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.672 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.091 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.072/0.278/0.672 ms
2025-06-30 17:17:32,042 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-72547048 with expectation True passed
2025-06-30 17:17:34,119 - DEBUG - [Pod ctest-pod-96994045] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.429 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.071 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.190/0.429 ms
2025-06-30 17:17:34,119 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-96994045 with expectation True passed
2025-06-30 17:17:36,185 - DEBUG - [Pod ctest-pod-56772761] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.539 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.069 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.069/0.232/0.539 ms
2025-06-30 17:17:36,185 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-56772761 with expectation True passed
2025-06-30 17:17:36,241 - DEBUG - [Pod ctest-pod-72547048] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-30 17:17:36,241 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-06-30 17:17:36,241 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-30 17:17:36,242 - INFO - wget check of of http://10.47.255.251 from ctest-pod-72547048 passed
2025-06-30 17:17:36,304 - DEBUG - [Pod ctest-pod-72547048] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-30 17:17:36,304 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-06-30 17:17:36,304 - DEBUG - [Pod Pod ctest-pod-72547048] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-30 17:17:36,304 - INFO - wget check of of http://10.47.255.250 from ctest-pod-72547048 passed
2025-06-30 17:17:41,377 - DEBUG - [Pod ctest-pod-96994045] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-30 17:17:41,377 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-30 17:17:41,377 - DEBUG - [Pod Pod ctest-pod-96994045] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-06-30 17:17:41,377 - INFO - wget check of of http://10.47.255.250 from ctest-pod-96994045 passed
2025-06-30 17:17:41,458 - DEBUG - [Pod ctest-pod-32105288] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-30 17:17:41,458 - DEBUG - [Pod Pod ctest-pod-32105288] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-06-30 17:17:41,459 - DEBUG - [Pod Pod ctest-pod-32105288] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-06-30 17:17:41,459 - INFO - wget check of of http://10.47.255.251 from ctest-pod-32105288 passed
2025-06-30 17:17:41,459 - INFO - Deleting Network Policy : ingress-on-service
2025-06-30 17:17:41,461 - INFO - Deleting service : ctest-nginx-svc-43554002
2025-06-30 17:17:41,851 - DEBUG - No XMPP flaps were noticed during the test
2025-06-30 17:17:41,851 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:14]
2025-06-30 17:17:41,851 - INFO - --------------------------------------------------------------------------------
2025-06-30 17:17:41,870 - INFO - Deleting pod ctest-new-default-84330585:ctest-pod-11717738
2025-06-30 17:17:41,871 - INFO - Deleting pod ctest-new-default-84330585:ctest-pod-59384131
2025-06-30 17:17:41,872 - INFO - Deleting pod ctest-non-default-29157026:ctest-pod-54614198
2025-06-30 17:17:41,873 - INFO - Deleting pod ctest-non-default-29157026:ctest-pod-64619147
2025-06-30 17:17:41,874 - INFO - Deleting pod ctest-new-default-84330585:ctest-pod-96994045
2025-06-30 17:17:41,875 - INFO - Deleting pod ctest-new-default-84330585:ctest-pod-72547048
2025-06-30 17:17:41,876 - INFO - Deleting pod ctest-non-default-29157026:ctest-pod-56772761
2025-06-30 17:17:41,877 - INFO - Deleting pod ctest-non-default-29157026:ctest-pod-32105288
2025-06-30 17:17:42,083 - WARNING - Pod uuid 01b4f920-3d5a-451c-9256-97e8ef3a69bd is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:42,085 - WARNING - Pod uuid 2e655df6-39ff-4bc9-80b2-b563c9f6689a is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:42,086 - WARNING - Pod uuid a6bd8fd1-cab2-433e-8813-e4d3384c0bb9 is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:42,087 - WARNING - Pod uuid 950e99f4-0c37-4e6e-b410-42aa3f6e321b is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:42,088 - WARNING - Pod uuid 453309b3-a057-400c-9d09-c4708601dce5 is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:42,089 - WARNING - Pod uuid 1c6f2cf7-19c7-4a2c-9eb8-eefe45b24e2a is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:42,091 - WARNING - Pod uuid 94e5dc7b-c962-4616-9b28-828fb7722a01 is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:42,091 - WARNING - Pod uuid 1b7efcb3-d5d4-4289-80b0-861af3719b56 is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:47,130 - DEBUG - Pod 453309b3-a057-400c-9d09-c4708601dce5 is not in agent 10.0.0.22 VM list
2025-06-30 17:17:47,152 - WARNING - Pod uuid 950e99f4-0c37-4e6e-b410-42aa3f6e321b is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:47,153 - DEBUG - Pod 2e655df6-39ff-4bc9-80b2-b563c9f6689a is not in agent 10.0.0.22 VM list
2025-06-30 17:17:47,157 - DEBUG - Pod 1b7efcb3-d5d4-4289-80b0-861af3719b56 is not in agent 10.0.0.22 VM list
2025-06-30 17:17:47,161 - WARNING - Pod uuid 1c6f2cf7-19c7-4a2c-9eb8-eefe45b24e2a is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:47,162 - WARNING - Pod uuid 94e5dc7b-c962-4616-9b28-828fb7722a01 is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:47,163 - WARNING - Pod uuid 01b4f920-3d5a-451c-9256-97e8ef3a69bd is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:47,164 - DEBUG - Pod a6bd8fd1-cab2-433e-8813-e4d3384c0bb9 is not in agent 10.0.0.22 VM list
2025-06-30 17:17:47,187 - DEBUG - VMI a2eadb4c-55d5-11f0-b7a3-fa163eaa053a is removed from agent 10.0.0.22
2025-06-30 17:17:47,187 - INFO - Verified that pod ctest-pod-54614198 is removed in agent
2025-06-30 17:17:47,188 - DEBUG - VMI a1bdce0a-55d5-11f0-b7a3-fa163eaa053a is removed from agent 10.0.0.22
2025-06-30 17:17:47,188 - INFO - Verified that pod ctest-pod-11717738 is removed in agent
2025-06-30 17:17:47,192 - DEBUG - VMI a23835dc-55d5-11f0-b7a3-fa163eaa053a is removed from agent 10.0.0.22
2025-06-30 17:17:47,192 - INFO - Verified that pod ctest-pod-59384131 is removed in agent
2025-06-30 17:17:47,193 - DEBUG - VMI a35edfce-55d5-11f0-b7a3-fa163eaa053a is removed from agent 10.0.0.22
2025-06-30 17:17:47,193 - INFO - Verified that pod ctest-pod-64619147 is removed in agent
2025-06-30 17:17:52,185 - WARNING - Pod uuid 950e99f4-0c37-4e6e-b410-42aa3f6e321b is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:52,207 - WARNING - Pod uuid 94e5dc7b-c962-4616-9b28-828fb7722a01 is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:52,208 - WARNING - Pod uuid 01b4f920-3d5a-451c-9256-97e8ef3a69bd is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:52,209 - WARNING - Pod uuid 1c6f2cf7-19c7-4a2c-9eb8-eefe45b24e2a is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:57,198 - WARNING - Pod uuid 950e99f4-0c37-4e6e-b410-42aa3f6e321b is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:57,229 - WARNING - Pod uuid 94e5dc7b-c962-4616-9b28-828fb7722a01 is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:57,234 - WARNING - Pod uuid 01b4f920-3d5a-451c-9256-97e8ef3a69bd is still seen in agent 10.0.0.22 VM list
2025-06-30 17:17:57,236 - WARNING - Pod uuid 1c6f2cf7-19c7-4a2c-9eb8-eefe45b24e2a is still seen in agent 10.0.0.22 VM list
2025-06-30 17:18:02,209 - WARNING - Pod uuid 950e99f4-0c37-4e6e-b410-42aa3f6e321b is still seen in agent 10.0.0.22 VM list
2025-06-30 17:18:02,240 - WARNING - Pod uuid 94e5dc7b-c962-4616-9b28-828fb7722a01 is still seen in agent 10.0.0.22 VM list
2025-06-30 17:18:02,251 - WARNING - Pod uuid 01b4f920-3d5a-451c-9256-97e8ef3a69bd is still seen in agent 10.0.0.22 VM list
2025-06-30 17:18:02,252 - WARNING - Pod uuid 1c6f2cf7-19c7-4a2c-9eb8-eefe45b24e2a is still seen in agent 10.0.0.22 VM list
2025-06-30 17:18:07,229 - WARNING - Pod uuid 950e99f4-0c37-4e6e-b410-42aa3f6e321b is still seen in agent 10.0.0.22 VM list
2025-06-30 17:18:07,260 - WARNING - Pod uuid 94e5dc7b-c962-4616-9b28-828fb7722a01 is still seen in agent 10.0.0.22 VM list
2025-06-30 17:18:07,274 - WARNING - Pod uuid 01b4f920-3d5a-451c-9256-97e8ef3a69bd is still seen in agent 10.0.0.22 VM list
2025-06-30 17:18:07,278 - WARNING - Pod uuid 1c6f2cf7-19c7-4a2c-9eb8-eefe45b24e2a is still seen in agent 10.0.0.22 VM list
2025-06-30 17:18:12,253 - WARNING - Pod uuid 950e99f4-0c37-4e6e-b410-42aa3f6e321b is still seen in agent 10.0.0.22 VM list
2025-06-30 17:18:12,277 - WARNING - Pod uuid 94e5dc7b-c962-4616-9b28-828fb7722a01 is still seen in agent 10.0.0.22 VM list
2025-06-30 17:18:12,297 - WARNING - Pod uuid 01b4f920-3d5a-451c-9256-97e8ef3a69bd is still seen in agent 10.0.0.22 VM list
2025-06-30 17:18:12,300 - WARNING - Pod uuid 1c6f2cf7-19c7-4a2c-9eb8-eefe45b24e2a is still seen in agent 10.0.0.22 VM list
2025-06-30 17:18:17,269 - DEBUG - Pod 950e99f4-0c37-4e6e-b410-42aa3f6e321b is not in agent 10.0.0.22 VM list
2025-06-30 17:18:17,287 - DEBUG - VMI a44e7a98-55d5-11f0-b7a3-fa163eaa053a is removed from agent 10.0.0.22
2025-06-30 17:18:17,287 - INFO - Verified that pod ctest-pod-72547048 is removed in agent
2025-06-30 17:18:17,296 - DEBUG - Pod 94e5dc7b-c962-4616-9b28-828fb7722a01 is not in agent 10.0.0.22 VM list
2025-06-30 17:18:17,318 - DEBUG - VMI a4c59736-55d5-11f0-b7a3-fa163eaa053a is removed from agent 10.0.0.22
2025-06-30 17:18:17,318 - INFO - Verified that pod ctest-pod-56772761 is removed in agent
2025-06-30 17:18:17,323 - DEBUG - Pod 01b4f920-3d5a-451c-9256-97e8ef3a69bd is not in agent 10.0.0.22 VM list
2025-06-30 17:18:17,329 - DEBUG - Pod 1c6f2cf7-19c7-4a2c-9eb8-eefe45b24e2a is not in agent 10.0.0.22 VM list
2025-06-30 17:18:17,348 - DEBUG - VMI a3ddd96e-55d5-11f0-b7a3-fa163eaa053a is removed from agent 10.0.0.22
2025-06-30 17:18:17,348 - INFO - Verified that pod ctest-pod-96994045 is removed in agent
2025-06-30 17:18:17,351 - DEBUG - VMI a538721a-55d5-11f0-b7a3-fa163eaa053a is removed from agent 10.0.0.22
2025-06-30 17:18:17,351 - INFO - Verified that pod ctest-pod-32105288 is removed in agent
2025-06-30 17:18:17,352 - INFO - Deleting namespace ctest-non-default-29157026
2025-06-30 17:18:17,404 - DEBUG - Namespace ctest-non-default-29157026 still in k8s
2025-06-30 17:18:19,416 - DEBUG - Namespace ctest-non-default-29157026 still in k8s
2025-06-30 17:18:21,428 - DEBUG - Namespace ctest-non-default-29157026 still in k8s
2025-06-30 17:18:23,437 - DEBUG - Namespace ctest-non-default-29157026 is not in k8s
2025-06-30 17:18:23,437 - DEBUG - No need to check project deletion in contrail-api
2025-06-30 17:18:23,437 - INFO - Deleting namespace ctest-new-default-84330585
2025-06-30 17:18:23,447 - DEBUG - Namespace ctest-new-default-84330585 still in k8s
2025-06-30 17:18:25,459 - DEBUG - Namespace ctest-new-default-84330585 still in k8s
2025-06-30 17:18:27,473 - DEBUG - Namespace ctest-new-default-84330585 still in k8s
2025-06-30 17:18:29,482 - DEBUG - Namespace ctest-new-default-84330585 is not in k8s
2025-06-30 17:18:29,483 - DEBUG - No need to check project deletion in contrail-api