2025-04-23 15:22:42,996 - INFO - Using existing project ['default-domain', 'k8s-default'](54fb7218-d757-4dcb-a98d-54cc96c3ffc8)
2025-04-23 15:22:43,018 - DEBUG - Namespace ctest-new-default-36137089 not present
2025-04-23 15:22:43,026 - INFO - Created namespace ctest-new-default-36137089
2025-04-23 15:22:46,030 - DEBUG - Namespace ctest-non-default-90118976 not present
2025-04-23 15:22:46,040 - INFO - Created namespace ctest-non-default-90118976
2025-04-23 15:22:49,058 - DEBUG - Pod ctest-pod-87086648 not present
2025-04-23 15:22:49,059 - INFO - Creating Pod ctest-pod-87086648
2025-04-23 15:22:49,086 - DEBUG - Pod : ctest-pod-87086648 UUID is ff8e00a3-ba96-4b0f-8be6-1b4952ba2931
2025-04-23 15:22:49,088 - DEBUG - Pod ctest-pod-12099261 not present
2025-04-23 15:22:49,089 - INFO - Creating Pod ctest-pod-12099261
2025-04-23 15:22:49,119 - DEBUG - Pod : ctest-pod-12099261 UUID is 8756f2c0-856b-4786-800e-e4e18cc4fbff
2025-04-23 15:22:49,133 - DEBUG - Pod ctest-pod-15312961 not present
2025-04-23 15:22:49,134 - INFO - Creating Pod ctest-pod-15312961
2025-04-23 15:22:49,162 - DEBUG - Pod : ctest-pod-15312961 UUID is c05d8a2e-a03b-428f-8b7b-351d2a7f8ce8
2025-04-23 15:22:49,165 - DEBUG - Pod ctest-pod-34799483 not present
2025-04-23 15:22:49,166 - INFO - Creating Pod ctest-pod-34799483
2025-04-23 15:22:49,186 - DEBUG - Pod : ctest-pod-34799483 UUID is 71544471-4b1a-4046-b1bf-4caeb3372beb
2025-04-23 15:22:49,194 - DEBUG - Pod ctest-pod-57104502 not present
2025-04-23 15:22:49,195 - INFO - Creating Pod ctest-pod-57104502
2025-04-23 15:22:49,223 - DEBUG - Pod : ctest-pod-57104502 UUID is ee99bc97-ce9a-4d3a-91c7-bc8ad64275bf
2025-04-23 15:22:49,225 - DEBUG - Pod ctest-pod-09732307 not present
2025-04-23 15:22:49,225 - INFO - Creating Pod ctest-pod-09732307
2025-04-23 15:22:49,245 - DEBUG - Pod : ctest-pod-09732307 UUID is a3043235-41f7-4b6b-a5ec-b44535e138f9
2025-04-23 15:22:49,249 - DEBUG - Pod ctest-pod-04646836 not present
2025-04-23 15:22:49,249 - INFO - Creating Pod ctest-pod-04646836
2025-04-23 15:22:49,266 - DEBUG - Pod : ctest-pod-04646836 UUID is 71842439-3e90-49ce-869b-750b017e855d
2025-04-23 15:22:49,268 - DEBUG - Pod ctest-pod-98420373 not present
2025-04-23 15:22:49,269 - INFO - Creating Pod ctest-pod-98420373
2025-04-23 15:22:49,286 - DEBUG - Pod : ctest-pod-98420373 UUID is c13c9cf6-218a-4765-a95d-b405f3c396ec
2025-04-23 15:22:49,462 - INFO - Project default-domain:k8s-ctest-new-default-36137089 for Namespace ctest-new-default-36137089 is seen in contrail-api
2025-04-23 15:22:49,462 - DEBUG - Project uuid in Contrail is 8ea1dc42-0f5b-497d-8afb-3a6d56626730
2025-04-23 15:22:49,664 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=791f309c-02b9-48c2-b5ff-4057ad434ef7
2025-04-23 15:22:49,670 - INFO - Namespace ctest-new-default-36137089 with uuid 791f309c-02b9-48c2-b5ff-4057ad434ef7 found in kube manager
2025-04-23 15:22:49,671 - INFO - Namespace ctest-new-default-36137089 verification passed
2025-04-23 15:22:49,900 - INFO - Project default-domain:k8s-ctest-non-default-90118976 for Namespace ctest-non-default-90118976 is seen in contrail-api
2025-04-23 15:22:49,900 - DEBUG - Project uuid in Contrail is c7607d45-5deb-4b1d-8a36-679122e26e2f
2025-04-23 15:22:49,901 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=637ee554-b146-4e8a-9b85-12d81727944a
2025-04-23 15:22:49,908 - INFO - Namespace ctest-non-default-90118976 with uuid 637ee554-b146-4e8a-9b85-12d81727944a found in kube manager
2025-04-23 15:22:49,908 - INFO - Namespace ctest-non-default-90118976 verification passed
2025-04-23 15:22:49,918 - DEBUG - Pod ctest-pod-87086648 not in running state.Currently in Pending
2025-04-23 15:22:54,934 - DEBUG - Pod ctest-pod-87086648 not in running state.Currently in Pending
2025-04-23 15:22:59,941 - INFO - Pod ctest-pod-87086648 is in running state.Got IP 10.47.255.251
2025-04-23 15:23:00,000 - DEBUG - Pod ctest-pod-87086648 has vmi d1dcdf4a-2056-11f0-9ac2-fa163e980c20
2025-04-23 15:23:00,000 - INFO - Verified pod ctest-pod-87086648 in contrail-api
2025-04-23 15:23:00,014 - DEBUG - VMI d1dcdf4a-2056-11f0-9ac2-fa163e980c20 is active in agent 10.0.0.49
2025-04-23 15:23:00,014 - INFO - Verified Pod ctest-pod-87086648 in agent 10.0.0.49
2025-04-23 15:23:00,014 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=ff8e00a3-ba96-4b0f-8be6-1b4952ba2931
2025-04-23 15:23:00,019 - INFO - Pod ctest-pod-87086648 with uuid ff8e00a3-ba96-4b0f-8be6-1b4952ba2931 found in kube manager
2025-04-23 15:23:00,019 - INFO - Pod ctest-pod-87086648 verification passed
2025-04-23 15:23:00,025 - DEBUG - Pod ctest-pod-12099261 not in running state.Currently in Pending
2025-04-23 15:23:05,031 - INFO - Pod ctest-pod-12099261 is in running state.Got IP 10.47.255.250
2025-04-23 15:23:05,044 - DEBUG - Pod ctest-pod-12099261 has vmi d25ec546-2056-11f0-9ac2-fa163e980c20
2025-04-23 15:23:05,044 - INFO - Verified pod ctest-pod-12099261 in contrail-api
2025-04-23 15:23:05,057 - DEBUG - VMI d25ec546-2056-11f0-9ac2-fa163e980c20 is active in agent 10.0.0.49
2025-04-23 15:23:05,057 - INFO - Verified Pod ctest-pod-12099261 in agent 10.0.0.49
2025-04-23 15:23:05,057 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=8756f2c0-856b-4786-800e-e4e18cc4fbff
2025-04-23 15:23:05,062 - INFO - Pod ctest-pod-12099261 with uuid 8756f2c0-856b-4786-800e-e4e18cc4fbff found in kube manager
2025-04-23 15:23:05,062 - INFO - Pod ctest-pod-12099261 verification passed
2025-04-23 15:23:05,067 - INFO - Pod ctest-pod-15312961 is in running state.Got IP 10.47.255.249
2025-04-23 15:23:05,124 - DEBUG - Pod ctest-pod-15312961 has vmi d2fbc882-2056-11f0-9ac2-fa163e980c20
2025-04-23 15:23:05,124 - INFO - Verified pod ctest-pod-15312961 in contrail-api
2025-04-23 15:23:05,137 - DEBUG - VMI d2fbc882-2056-11f0-9ac2-fa163e980c20 is active in agent 10.0.0.49
2025-04-23 15:23:05,137 - INFO - Verified Pod ctest-pod-15312961 in agent 10.0.0.49
2025-04-23 15:23:05,137 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=c05d8a2e-a03b-428f-8b7b-351d2a7f8ce8
2025-04-23 15:23:05,142 - INFO - Pod ctest-pod-15312961 with uuid c05d8a2e-a03b-428f-8b7b-351d2a7f8ce8 found in kube manager
2025-04-23 15:23:05,142 - INFO - Pod ctest-pod-15312961 verification passed
2025-04-23 15:23:05,148 - INFO - Pod ctest-pod-34799483 is in running state.Got IP 10.47.255.248
2025-04-23 15:23:05,161 - DEBUG - Pod ctest-pod-34799483 has vmi d37688c4-2056-11f0-9ac2-fa163e980c20
2025-04-23 15:23:05,161 - INFO - Verified pod ctest-pod-34799483 in contrail-api
2025-04-23 15:23:05,175 - DEBUG - VMI d37688c4-2056-11f0-9ac2-fa163e980c20 is active in agent 10.0.0.49
2025-04-23 15:23:05,175 - INFO - Verified Pod ctest-pod-34799483 in agent 10.0.0.49
2025-04-23 15:23:05,175 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=71544471-4b1a-4046-b1bf-4caeb3372beb
2025-04-23 15:23:05,180 - INFO - Pod ctest-pod-34799483 with uuid 71544471-4b1a-4046-b1bf-4caeb3372beb found in kube manager
2025-04-23 15:23:05,180 - INFO - Pod ctest-pod-34799483 verification passed
2025-04-23 15:23:05,185 - DEBUG - Pod ctest-pod-57104502 not in running state.Currently in Pending
2025-04-23 15:23:10,192 - INFO - Pod ctest-pod-57104502 is in running state.Got IP 10.47.255.247
2025-04-23 15:23:10,256 - DEBUG - Pod ctest-pod-57104502 has vmi d411030e-2056-11f0-9ac2-fa163e980c20
2025-04-23 15:23:10,256 - INFO - Verified pod ctest-pod-57104502 in contrail-api
2025-04-23 15:23:10,270 - DEBUG - VMI d411030e-2056-11f0-9ac2-fa163e980c20 is active in agent 10.0.0.49
2025-04-23 15:23:10,271 - INFO - Verified Pod ctest-pod-57104502 in agent 10.0.0.49
2025-04-23 15:23:10,271 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=ee99bc97-ce9a-4d3a-91c7-bc8ad64275bf
2025-04-23 15:23:10,276 - INFO - Pod ctest-pod-57104502 with uuid ee99bc97-ce9a-4d3a-91c7-bc8ad64275bf found in kube manager
2025-04-23 15:23:10,277 - INFO - Pod ctest-pod-57104502 verification passed
2025-04-23 15:23:10,288 - INFO - Pod ctest-pod-04646836 is in running state.Got IP 10.47.255.245
2025-04-23 15:23:10,321 - DEBUG - Pod ctest-pod-04646836 has vmi d50a9e50-2056-11f0-9ac2-fa163e980c20
2025-04-23 15:23:10,321 - INFO - Verified pod ctest-pod-04646836 in contrail-api
2025-04-23 15:23:10,350 - DEBUG - VMI d50a9e50-2056-11f0-9ac2-fa163e980c20 is active in agent 10.0.0.49
2025-04-23 15:23:10,350 - INFO - Verified Pod ctest-pod-04646836 in agent 10.0.0.49
2025-04-23 15:23:10,350 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=71842439-3e90-49ce-869b-750b017e855d
2025-04-23 15:23:10,355 - INFO - Pod ctest-pod-04646836 with uuid 71842439-3e90-49ce-869b-750b017e855d found in kube manager
2025-04-23 15:23:10,355 - INFO - Pod ctest-pod-04646836 verification passed
2025-04-23 15:23:10,361 - INFO - Pod ctest-pod-09732307 is in running state.Got IP 10.47.255.246
2025-04-23 15:23:10,432 - DEBUG - Pod ctest-pod-09732307 has vmi d4972c5e-2056-11f0-9ac2-fa163e980c20
2025-04-23 15:23:10,432 - INFO - Verified pod ctest-pod-09732307 in contrail-api
2025-04-23 15:23:10,445 - DEBUG - VMI d4972c5e-2056-11f0-9ac2-fa163e980c20 is active in agent 10.0.0.49
2025-04-23 15:23:10,445 - INFO - Verified Pod ctest-pod-09732307 in agent 10.0.0.49
2025-04-23 15:23:10,445 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=a3043235-41f7-4b6b-a5ec-b44535e138f9
2025-04-23 15:23:10,450 - INFO - Pod ctest-pod-09732307 with uuid a3043235-41f7-4b6b-a5ec-b44535e138f9 found in kube manager
2025-04-23 15:23:10,450 - INFO - Pod ctest-pod-09732307 verification passed
2025-04-23 15:23:10,455 - INFO - Pod ctest-pod-98420373 is in running state.Got IP 10.47.255.244
2025-04-23 15:23:10,471 - DEBUG - Pod ctest-pod-98420373 has vmi d58bee60-2056-11f0-9ac2-fa163e980c20
2025-04-23 15:23:10,471 - INFO - Verified pod ctest-pod-98420373 in contrail-api
2025-04-23 15:23:10,485 - DEBUG - VMI d58bee60-2056-11f0-9ac2-fa163e980c20 is active in agent 10.0.0.49
2025-04-23 15:23:10,485 - INFO - Verified Pod ctest-pod-98420373 in agent 10.0.0.49
2025-04-23 15:23:10,485 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=c13c9cf6-218a-4765-a95d-b405f3c396ec
2025-04-23 15:23:10,490 - INFO - Pod ctest-pod-98420373 with uuid c13c9cf6-218a-4765-a95d-b405f3c396ec found in kube manager
2025-04-23 15:23:10,490 - INFO - Pod ctest-pod-98420373 verification passed
2025-04-23 15:23:10,490 - INFO - ================================================================================
2025-04-23 15:23:10,490 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-04-23 15:23:10,490 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-04-23 15:23:10,734 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.0.0.50': '0'}} with
2025-04-23 15:23:10,734 - INFO - Initial checks done. Running the testcase now
2025-04-23 15:23:10,734 - INFO -
2025-04-23 15:23:10,793 - DEBUG - [Pod ctest-pod-87086648] Cmd: echo ctest-pod-87086648 > /usr/share/nginx/html/index.html, Output:
2025-04-23 15:23:10,852 - DEBUG - [Pod ctest-pod-12099261] Cmd: echo ctest-pod-12099261 > /usr/share/nginx/html/index.html, Output:
2025-04-23 15:23:10,912 - DEBUG - [Pod ctest-pod-15312961] Cmd: echo ctest-pod-15312961 > /usr/share/nginx/html/index.html, Output:
2025-04-23 15:23:10,969 - DEBUG - [Pod ctest-pod-34799483] Cmd: echo ctest-pod-34799483 > /usr/share/nginx/html/index.html, Output:
2025-04-23 15:23:10,973 - DEBUG - Service ctest-nginx-svc-45262210 not present
2025-04-23 15:23:10,973 - INFO - Creating service ctest-nginx-svc-45262210
2025-04-23 15:23:10,988 - INFO - Created Service ctest-nginx-svc-45262210
2025-04-23 15:23:11,021 - WARNING - Service UUID 9147a84f-7a06-4433-8552-b99c2d3285d2 not yet found in contrail-api
2025-04-23 15:23:12,030 - INFO - Validated that Service ctest-nginx-svc-45262210 is seen in contrail-api
2025-04-23 15:23:12,030 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=9147a84f-7a06-4433-8552-b99c2d3285d2
2025-04-23 15:23:12,034 - INFO - Service ctest-nginx-svc-45262210 with uuid 9147a84f-7a06-4433-8552-b99c2d3285d2 found in kube manager
2025-04-23 15:23:12,034 - INFO - Service ctest-nginx-svc-45262210 verification passed
2025-04-23 15:23:13,130 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-12099261
2025-04-23 15:23:13,131 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:23:13,131 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-12099261
2025-04-23 15:23:13,192 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
ctest-pod-87086648
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:23:13,192 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:23:13,192 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
ctest-pod-87086648
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:23:13,192 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-87086648': 1, 'ctest-pod-12099261': 1}
2025-04-23 15:23:13,263 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-87086648
2025-04-23 15:23:13,264 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:23:13,264 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-87086648
2025-04-23 15:23:13,320 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:23:13,320 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:23:13,320 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:23:13,382 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: ctest-pod-12099261
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:23:13,382 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:23:13,382 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: ctest-pod-12099261
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:23:13,382 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-87086648': 2, 'ctest-pod-12099261': 1}
2025-04-23 15:23:13,386 - DEBUG - Network policy ingress-on-service not present
2025-04-23 15:23:13,453 - INFO - Creating Network Policy ingress-on-service
2025-04-23 15:23:13,472 - INFO - Network policy found in k8s
2025-04-23 15:23:13,472 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=583fca23-a12d-437e-a409-16e7a2b6e84a
2025-04-23 15:23:13,479 - INFO - Network Policy ingress-on-service with uuid 583fca23-a12d-437e-a409-16e7a2b6e84a found in kube manager
2025-04-23 15:23:13,545 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-04-23 15:23:13,545 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-04-23 15:23:13,545 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=583fca23-a12d-437e-a409-16e7a2b6e84a
2025-04-23 15:23:13,581 - WARNING - Network policy with name ingress-on-service not found in agent
2025-04-23 15:23:15,582 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=583fca23-a12d-437e-a409-16e7a2b6e84a
2025-04-23 15:23:15,614 - INFO - Network policy with name ingress-on-service found in agent
2025-04-23 15:23:15,615 - INFO - Network Policy ingress-on-service verification passed
2025-04-23 15:23:20,669 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:20,669 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:20,669 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:25,722 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:25,722 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:25,722 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:30,773 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:30,773 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:30,773 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:35,826 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:35,826 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:35,826 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:40,878 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:40,878 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:40,878 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:45,929 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:45,929 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:45,929 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:50,981 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:50,981 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:50,981 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:56,033 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:56,033 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:23:56,033 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:01,098 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:01,098 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:01,098 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:06,151 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:06,151 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:06,151 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:06,151 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-87086648': 0, 'ctest-pod-12099261': 0}
2025-04-23 15:24:06,212 - DEBUG - [Pod ctest-pod-09732307] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: ctest-pod-12099261
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:24:06,212 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:24:06,212 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd output: ctest-pod-12099261
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:24:06,285 - DEBUG - [Pod ctest-pod-09732307] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: ctest-pod-12099261
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:24:06,285 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:24:06,285 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd output: ctest-pod-12099261
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:24:06,350 - DEBUG - [Pod ctest-pod-09732307] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:24:06,350 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:24:06,350 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:24:06,350 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-87086648': 1, 'ctest-pod-12099261': 2}
2025-04-23 15:24:10,895 - WARNING - ApiException is caught (0)
Reason: Connection is already closed.
. Retrying...
2025-04-23 15:24:20,967 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:20,967 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:20,967 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:26,022 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:26,022 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:26,022 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:31,078 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:31,078 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:31,078 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:36,133 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:36,134 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:36,134 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:41,185 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:41,185 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:41,185 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:46,234 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:46,234 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:46,234 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:51,287 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:51,287 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:51,288 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:56,341 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:56,341 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:24:56,341 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:01,393 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:01,394 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:01,394 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:06,456 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:06,456 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:06,456 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:06,456 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-87086648': 0, 'ctest-pod-12099261': 0}
2025-04-23 15:25:08,510 - DEBUG - [Pod ctest-pod-09732307] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.703 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.100 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.293/0.703 ms
2025-04-23 15:25:08,510 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-09732307 with expectation True passed
2025-04-23 15:25:10,563 - DEBUG - [Pod ctest-pod-57104502] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.884 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.058 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.058/0.343/0.884 ms
2025-04-23 15:25:10,563 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-57104502 with expectation True passed
2025-04-23 15:25:12,622 - DEBUG - [Pod ctest-pod-04646836] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.347 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.499/1.347 ms
2025-04-23 15:25:12,622 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-04646836 with expectation True passed
2025-04-23 15:25:12,676 - DEBUG - [Pod ctest-pod-09732307] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 15:25:12,676 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-23 15:25:12,676 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 15:25:12,676 - INFO - wget check of of http://10.47.255.251 from ctest-pod-09732307 passed
2025-04-23 15:25:12,729 - DEBUG - [Pod ctest-pod-09732307] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 15:25:12,729 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-23 15:25:12,729 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 15:25:12,729 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09732307 passed
2025-04-23 15:25:17,782 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 15:25:17,782 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 15:25:17,782 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 15:25:17,782 - INFO - wget check of of http://10.47.255.250 from ctest-pod-57104502 passed
2025-04-23 15:25:22,837 - DEBUG - [Pod ctest-pod-98420373] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-23 15:25:22,838 - DEBUG - [Pod Pod ctest-pod-98420373] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-23 15:25:22,838 - DEBUG - [Pod Pod ctest-pod-98420373] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-04-23 15:25:22,838 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98420373 passed
2025-04-23 15:25:22,847 - INFO - Updating Network Policy ingress-on-service
2025-04-23 15:25:27,913 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:27,913 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:27,913 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:32,966 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:32,966 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:32,966 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:38,018 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:38,018 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:38,018 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:43,086 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:43,086 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:43,086 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:48,134 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:48,134 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:48,134 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:53,193 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:53,194 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:53,194 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:58,247 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:58,247 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:25:58,248 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:26:03,297 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:26:03,297 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:26:03,297 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:26:08,358 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:26:08,358 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:26:08,358 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:26:13,410 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:26:13,410 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:26:13,410 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.97.28.85:80 (10.97.28.85:80)
wget: download timed out
2025-04-23 15:26:13,410 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-87086648': 0, 'ctest-pod-12099261': 0}
2025-04-23 15:26:13,460 - DEBUG - [Pod ctest-pod-09732307] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,460 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:26:13,460 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,512 - DEBUG - [Pod ctest-pod-09732307] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: ctest-pod-12099261
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,512 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:26:13,512 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd output: ctest-pod-12099261
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,512 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-87086648': 1, 'ctest-pod-12099261': 1}
2025-04-23 15:26:13,564 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,564 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:26:13,564 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,624 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,624 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:26:13,624 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,690 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,690 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:26:13,690 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,743 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,743 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:26:13,743 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: ctest-pod-87086648
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,800 - DEBUG - [Pod ctest-pod-04646836] Cmd: wget http://10.97.28.85:80/ -O - -T 5 -t 1 , Output: ctest-pod-12099261
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,800 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd wget http://10.97.28.85:80/ -O - -T 5 -t 1 passed
2025-04-23 15:26:13,800 - DEBUG - [Pod Pod ctest-pod-04646836] Cmd output: ctest-pod-12099261
Connecting to 10.97.28.85:80 (10.97.28.85:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-04-23 15:26:13,800 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-87086648': 4, 'ctest-pod-12099261': 1}
2025-04-23 15:26:15,858 - DEBUG - [Pod ctest-pod-09732307] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.615 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.075 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.078 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.075/0.256/0.615 ms
2025-04-23 15:26:15,858 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-09732307 with expectation True passed
2025-04-23 15:26:17,909 - DEBUG - [Pod ctest-pod-57104502] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.938 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.070 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.092 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.366/0.938 ms
2025-04-23 15:26:17,910 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-57104502 with expectation True passed
2025-04-23 15:26:19,958 - DEBUG - [Pod ctest-pod-04646836] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.026 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.082 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.080/0.396/1.026 ms
2025-04-23 15:26:19,958 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-04646836 with expectation True passed
2025-04-23 15:26:20,014 - DEBUG - [Pod ctest-pod-09732307] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 15:26:20,014 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-23 15:26:20,014 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 15:26:20,014 - INFO - wget check of of http://10.47.255.251 from ctest-pod-09732307 passed
2025-04-23 15:26:20,069 - DEBUG - [Pod ctest-pod-09732307] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 15:26:20,070 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-04-23 15:26:20,070 - DEBUG - [Pod Pod ctest-pod-09732307] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 15:26:20,070 - INFO - wget check of of http://10.47.255.250 from ctest-pod-09732307 passed
2025-04-23 15:26:25,121 - DEBUG - [Pod ctest-pod-57104502] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 15:26:25,121 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 15:26:25,121 - DEBUG - [Pod Pod ctest-pod-57104502] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-04-23 15:26:25,121 - INFO - wget check of of http://10.47.255.250 from ctest-pod-57104502 passed
2025-04-23 15:26:25,175 - DEBUG - [Pod ctest-pod-98420373] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 15:26:25,175 - DEBUG - [Pod Pod ctest-pod-98420373] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-04-23 15:26:25,175 - DEBUG - [Pod Pod ctest-pod-98420373] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-04-23 15:26:25,175 - INFO - wget check of of http://10.47.255.251 from ctest-pod-98420373 passed
2025-04-23 15:26:25,176 - INFO - Deleting Network Policy : ingress-on-service
2025-04-23 15:26:25,176 - INFO - Deleting service : ctest-nginx-svc-45262210
2025-04-23 15:26:25,407 - DEBUG - No XMPP flaps were noticed during the test
2025-04-23 15:26:25,407 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:15]
2025-04-23 15:26:25,407 - INFO - --------------------------------------------------------------------------------
2025-04-23 15:26:25,414 - INFO - Deleting pod ctest-new-default-36137089:ctest-pod-87086648
2025-04-23 15:26:25,415 - INFO - Deleting pod ctest-new-default-36137089:ctest-pod-12099261
2025-04-23 15:26:25,415 - INFO - Deleting pod ctest-non-default-90118976:ctest-pod-15312961
2025-04-23 15:26:25,415 - INFO - Deleting pod ctest-non-default-90118976:ctest-pod-34799483
2025-04-23 15:26:25,416 - INFO - Deleting pod ctest-new-default-36137089:ctest-pod-57104502
2025-04-23 15:26:25,416 - INFO - Deleting pod ctest-new-default-36137089:ctest-pod-09732307
2025-04-23 15:26:25,416 - INFO - Deleting pod ctest-non-default-90118976:ctest-pod-04646836
2025-04-23 15:26:25,417 - INFO - Deleting pod ctest-non-default-90118976:ctest-pod-98420373
2025-04-23 15:26:25,595 - WARNING - Pod uuid a3043235-41f7-4b6b-a5ec-b44535e138f9 is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:25,595 - WARNING - Pod uuid c05d8a2e-a03b-428f-8b7b-351d2a7f8ce8 is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:25,596 - WARNING - Pod uuid ff8e00a3-ba96-4b0f-8be6-1b4952ba2931 is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:25,596 - WARNING - Pod uuid 71544471-4b1a-4046-b1bf-4caeb3372beb is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:25,597 - WARNING - Pod uuid ee99bc97-ce9a-4d3a-91c7-bc8ad64275bf is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:25,601 - WARNING - Pod uuid 71842439-3e90-49ce-869b-750b017e855d is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:25,601 - WARNING - Pod uuid c13c9cf6-218a-4765-a95d-b405f3c396ec is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:25,601 - WARNING - Pod uuid 8756f2c0-856b-4786-800e-e4e18cc4fbff is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:30,635 - DEBUG - Pod 71544471-4b1a-4046-b1bf-4caeb3372beb is not in agent 10.0.0.49 VM list
2025-04-23 15:26:30,637 - WARNING - Pod uuid c13c9cf6-218a-4765-a95d-b405f3c396ec is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:30,637 - DEBUG - Pod c05d8a2e-a03b-428f-8b7b-351d2a7f8ce8 is not in agent 10.0.0.49 VM list
2025-04-23 15:26:30,639 - WARNING - Pod uuid ee99bc97-ce9a-4d3a-91c7-bc8ad64275bf is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:30,639 - WARNING - Pod uuid a3043235-41f7-4b6b-a5ec-b44535e138f9 is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:30,640 - DEBUG - Pod ff8e00a3-ba96-4b0f-8be6-1b4952ba2931 is not in agent 10.0.0.49 VM list
2025-04-23 15:26:30,641 - WARNING - Pod uuid 71842439-3e90-49ce-869b-750b017e855d is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:30,643 - DEBUG - Pod 8756f2c0-856b-4786-800e-e4e18cc4fbff is not in agent 10.0.0.49 VM list
2025-04-23 15:26:30,660 - DEBUG - VMI d2fbc882-2056-11f0-9ac2-fa163e980c20 is removed from agent 10.0.0.49
2025-04-23 15:26:30,660 - INFO - Verified that pod ctest-pod-15312961 is removed in agent
2025-04-23 15:26:30,660 - DEBUG - VMI d37688c4-2056-11f0-9ac2-fa163e980c20 is removed from agent 10.0.0.49
2025-04-23 15:26:30,660 - INFO - Verified that pod ctest-pod-34799483 is removed in agent
2025-04-23 15:26:30,662 - DEBUG - VMI d25ec546-2056-11f0-9ac2-fa163e980c20 is removed from agent 10.0.0.49
2025-04-23 15:26:30,662 - INFO - Verified that pod ctest-pod-12099261 is removed in agent
2025-04-23 15:26:30,663 - DEBUG - VMI d1dcdf4a-2056-11f0-9ac2-fa163e980c20 is removed from agent 10.0.0.49
2025-04-23 15:26:30,663 - INFO - Verified that pod ctest-pod-87086648 is removed in agent
2025-04-23 15:26:35,658 - WARNING - Pod uuid a3043235-41f7-4b6b-a5ec-b44535e138f9 is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:35,659 - WARNING - Pod uuid c13c9cf6-218a-4765-a95d-b405f3c396ec is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:35,661 - WARNING - Pod uuid 71842439-3e90-49ce-869b-750b017e855d is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:35,661 - WARNING - Pod uuid ee99bc97-ce9a-4d3a-91c7-bc8ad64275bf is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:40,677 - WARNING - Pod uuid c13c9cf6-218a-4765-a95d-b405f3c396ec is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:40,679 - WARNING - Pod uuid 71842439-3e90-49ce-869b-750b017e855d is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:40,680 - WARNING - Pod uuid ee99bc97-ce9a-4d3a-91c7-bc8ad64275bf is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:40,680 - WARNING - Pod uuid a3043235-41f7-4b6b-a5ec-b44535e138f9 is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:45,698 - WARNING - Pod uuid 71842439-3e90-49ce-869b-750b017e855d is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:45,698 - WARNING - Pod uuid c13c9cf6-218a-4765-a95d-b405f3c396ec is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:45,701 - WARNING - Pod uuid a3043235-41f7-4b6b-a5ec-b44535e138f9 is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:45,701 - WARNING - Pod uuid ee99bc97-ce9a-4d3a-91c7-bc8ad64275bf is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:50,720 - WARNING - Pod uuid ee99bc97-ce9a-4d3a-91c7-bc8ad64275bf is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:50,721 - WARNING - Pod uuid c13c9cf6-218a-4765-a95d-b405f3c396ec is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:50,721 - WARNING - Pod uuid 71842439-3e90-49ce-869b-750b017e855d is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:50,722 - WARNING - Pod uuid a3043235-41f7-4b6b-a5ec-b44535e138f9 is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:55,804 - WARNING - Pod uuid a3043235-41f7-4b6b-a5ec-b44535e138f9 is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:55,804 - WARNING - Pod uuid ee99bc97-ce9a-4d3a-91c7-bc8ad64275bf is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:55,806 - WARNING - Pod uuid 71842439-3e90-49ce-869b-750b017e855d is still seen in agent 10.0.0.49 VM list
2025-04-23 15:26:55,807 - WARNING - Pod uuid c13c9cf6-218a-4765-a95d-b405f3c396ec is still seen in agent 10.0.0.49 VM list
2025-04-23 15:27:00,830 - DEBUG - Pod ee99bc97-ce9a-4d3a-91c7-bc8ad64275bf is not in agent 10.0.0.49 VM list
2025-04-23 15:27:00,831 - DEBUG - Pod a3043235-41f7-4b6b-a5ec-b44535e138f9 is not in agent 10.0.0.49 VM list
2025-04-23 15:27:00,833 - DEBUG - Pod 71842439-3e90-49ce-869b-750b017e855d is not in agent 10.0.0.49 VM list
2025-04-23 15:27:00,837 - DEBUG - Pod c13c9cf6-218a-4765-a95d-b405f3c396ec is not in agent 10.0.0.49 VM list
2025-04-23 15:27:00,851 - DEBUG - VMI d411030e-2056-11f0-9ac2-fa163e980c20 is removed from agent 10.0.0.49
2025-04-23 15:27:00,851 - INFO - Verified that pod ctest-pod-57104502 is removed in agent
2025-04-23 15:27:00,854 - DEBUG - VMI d58bee60-2056-11f0-9ac2-fa163e980c20 is removed from agent 10.0.0.49
2025-04-23 15:27:00,854 - INFO - Verified that pod ctest-pod-98420373 is removed in agent
2025-04-23 15:27:00,854 - DEBUG - VMI d50a9e50-2056-11f0-9ac2-fa163e980c20 is removed from agent 10.0.0.49
2025-04-23 15:27:00,854 - INFO - Verified that pod ctest-pod-04646836 is removed in agent
2025-04-23 15:27:00,855 - DEBUG - VMI d4972c5e-2056-11f0-9ac2-fa163e980c20 is removed from agent 10.0.0.49
2025-04-23 15:27:00,855 - INFO - Verified that pod ctest-pod-09732307 is removed in agent
2025-04-23 15:27:00,855 - INFO - Deleting namespace ctest-non-default-90118976
2025-04-23 15:27:00,870 - DEBUG - Namespace ctest-non-default-90118976 still in k8s
2025-04-23 15:27:02,875 - DEBUG - Namespace ctest-non-default-90118976 still in k8s
2025-04-23 15:27:04,879 - DEBUG - Namespace ctest-non-default-90118976 still in k8s
2025-04-23 15:27:06,883 - DEBUG - Namespace ctest-non-default-90118976 is not in k8s
2025-04-23 15:27:06,883 - DEBUG - No need to check project deletion in contrail-api
2025-04-23 15:27:06,883 - INFO - Deleting namespace ctest-new-default-36137089
2025-04-23 15:27:06,892 - DEBUG - Namespace ctest-new-default-36137089 still in k8s
2025-04-23 15:27:08,900 - DEBUG - Namespace ctest-new-default-36137089 still in k8s
2025-04-23 15:27:10,914 - DEBUG - Namespace ctest-new-default-36137089 still in k8s
2025-04-23 15:27:12,918 - DEBUG - Namespace ctest-new-default-36137089 is not in k8s
2025-04-23 15:27:12,918 - DEBUG - No need to check project deletion in contrail-api