2025-05-15 02:01:17,350 - INFO - Using existing project ['default-domain', 'k8s-default'](04cfb0ab-abf9-40cc-8c7d-62e0a805b281)
2025-05-15 02:01:17,376 - DEBUG - Namespace ctest-new-default-54618605 not present
2025-05-15 02:01:17,395 - INFO - Created namespace ctest-new-default-54618605
2025-05-15 02:01:20,402 - DEBUG - Namespace ctest-non-default-16394235 not present
2025-05-15 02:01:20,479 - INFO - Created namespace ctest-non-default-16394235
2025-05-15 02:01:23,508 - DEBUG - Pod ctest-pod-16395722 not present
2025-05-15 02:01:23,508 - INFO - Creating Pod ctest-pod-16395722
2025-05-15 02:01:23,556 - DEBUG - Pod : ctest-pod-16395722 UUID is a58c261b-4ef6-43c4-9075-ccfcb4a94938
2025-05-15 02:01:23,562 - DEBUG - Pod ctest-pod-68285685 not present
2025-05-15 02:01:23,563 - INFO - Creating Pod ctest-pod-68285685
2025-05-15 02:01:23,686 - DEBUG - Pod : ctest-pod-68285685 UUID is 63933d99-dc2b-4bee-88e6-81772a25d8aa
2025-05-15 02:01:23,690 - DEBUG - Pod ctest-pod-70533498 not present
2025-05-15 02:01:23,691 - INFO - Creating Pod ctest-pod-70533498
2025-05-15 02:01:23,887 - DEBUG - Pod : ctest-pod-70533498 UUID is d791934a-c558-4c44-af3e-52b85a24c8ff
2025-05-15 02:01:23,966 - DEBUG - Pod ctest-pod-46133041 not present
2025-05-15 02:01:23,966 - INFO - Creating Pod ctest-pod-46133041
2025-05-15 02:01:24,018 - DEBUG - Pod : ctest-pod-46133041 UUID is e228e9cd-67ae-4e84-a2cc-edb2dc7ebccd
2025-05-15 02:01:24,030 - DEBUG - Pod ctest-pod-04101895 not present
2025-05-15 02:01:24,031 - INFO - Creating Pod ctest-pod-04101895
2025-05-15 02:01:24,063 - DEBUG - Pod : ctest-pod-04101895 UUID is 72d5dca2-5d40-46ee-afd9-1155d29b04db
2025-05-15 02:01:24,067 - DEBUG - Pod ctest-pod-70702992 not present
2025-05-15 02:01:24,067 - INFO - Creating Pod ctest-pod-70702992
2025-05-15 02:01:24,111 - DEBUG - Pod : ctest-pod-70702992 UUID is c6a20957-4c42-44bf-b5d7-63a1e285685a
2025-05-15 02:01:24,118 - DEBUG - Pod ctest-pod-46130807 not present
2025-05-15 02:01:24,119 - INFO - Creating Pod ctest-pod-46130807
2025-05-15 02:01:24,151 - DEBUG - Pod : ctest-pod-46130807 UUID is 3cf9362b-9f1a-4127-9d77-f925b3f4ef37
2025-05-15 02:01:24,154 - DEBUG - Pod ctest-pod-62838710 not present
2025-05-15 02:01:24,155 - INFO - Creating Pod ctest-pod-62838710
2025-05-15 02:01:24,183 - DEBUG - Pod : ctest-pod-62838710 UUID is 52169e00-0765-4a8c-8d50-954920bda759
2025-05-15 02:01:24,577 - INFO - Project default-domain:k8s-ctest-new-default-54618605 for Namespace ctest-new-default-54618605 is seen in contrail-api
2025-05-15 02:01:24,577 - DEBUG - Project uuid in Contrail is e222a69b-6897-43ab-bf21-41779245a1e3
2025-05-15 02:01:24,947 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NamespaceDatabaseList?namespace_uuid=ca763274-eba1-45c1-8a92-a126dafdad85
2025-05-15 02:01:24,959 - INFO - Namespace ctest-new-default-54618605 with uuid ca763274-eba1-45c1-8a92-a126dafdad85 found in kube manager
2025-05-15 02:01:24,959 - INFO - Namespace ctest-new-default-54618605 verification passed
2025-05-15 02:01:25,466 - INFO - Project default-domain:k8s-ctest-non-default-16394235 for Namespace ctest-non-default-16394235 is seen in contrail-api
2025-05-15 02:01:25,466 - DEBUG - Project uuid in Contrail is b033c4e1-be51-46f0-bde8-ce3a8377a6fa
2025-05-15 02:01:25,466 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NamespaceDatabaseList?namespace_uuid=333913f3-d7e8-4ad4-aed0-fcc842d92e6a
2025-05-15 02:01:25,478 - INFO - Namespace ctest-non-default-16394235 with uuid 333913f3-d7e8-4ad4-aed0-fcc842d92e6a found in kube manager
2025-05-15 02:01:25,479 - INFO - Namespace ctest-non-default-16394235 verification passed
2025-05-15 02:01:25,504 - DEBUG - Pod ctest-pod-16395722 not in running state.Currently in Pending
2025-05-15 02:01:30,519 - DEBUG - Pod ctest-pod-16395722 not in running state.Currently in Pending
2025-05-15 02:01:35,527 - INFO - Pod ctest-pod-16395722 is in running state.Got IP 10.47.255.251
2025-05-15 02:01:35,544 - DEBUG - Pod ctest-pod-16395722 has vmi 82738022-3130-11f0-ab63-fa163e7eaf52
2025-05-15 02:01:35,544 - INFO - Verified pod ctest-pod-16395722 in contrail-api
2025-05-15 02:01:35,561 - DEBUG - VMI 82738022-3130-11f0-ab63-fa163e7eaf52 is active in agent 10.0.0.27
2025-05-15 02:01:35,561 - INFO - Verified Pod ctest-pod-16395722 in agent 10.0.0.27
2025-05-15 02:01:35,561 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=a58c261b-4ef6-43c4-9075-ccfcb4a94938
2025-05-15 02:01:35,567 - INFO - Pod ctest-pod-16395722 with uuid a58c261b-4ef6-43c4-9075-ccfcb4a94938 found in kube manager
2025-05-15 02:01:35,567 - INFO - Pod ctest-pod-16395722 verification passed
2025-05-15 02:01:35,575 - DEBUG - Pod ctest-pod-68285685 not in running state.Currently in Pending
2025-05-15 02:01:40,582 - INFO - Pod ctest-pod-68285685 is in running state.Got IP 10.47.255.250
2025-05-15 02:01:40,598 - DEBUG - Pod ctest-pod-68285685 has vmi 832824a0-3130-11f0-ab63-fa163e7eaf52
2025-05-15 02:01:40,598 - INFO - Verified pod ctest-pod-68285685 in contrail-api
2025-05-15 02:01:40,613 - DEBUG - VMI 832824a0-3130-11f0-ab63-fa163e7eaf52 is active in agent 10.0.0.27
2025-05-15 02:01:40,613 - INFO - Verified Pod ctest-pod-68285685 in agent 10.0.0.27
2025-05-15 02:01:40,613 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=63933d99-dc2b-4bee-88e6-81772a25d8aa
2025-05-15 02:01:40,619 - INFO - Pod ctest-pod-68285685 with uuid 63933d99-dc2b-4bee-88e6-81772a25d8aa found in kube manager
2025-05-15 02:01:40,619 - INFO - Pod ctest-pod-68285685 verification passed
2025-05-15 02:01:40,624 - DEBUG - Pod ctest-pod-70533498 not in running state.Currently in Pending
2025-05-15 02:01:45,633 - INFO - Pod ctest-pod-70533498 is in running state.Got IP 10.47.255.249
2025-05-15 02:01:45,694 - DEBUG - Pod ctest-pod-70533498 has vmi 83de5144-3130-11f0-ab63-fa163e7eaf52
2025-05-15 02:01:45,694 - INFO - Verified pod ctest-pod-70533498 in contrail-api
2025-05-15 02:01:45,708 - DEBUG - VMI 83de5144-3130-11f0-ab63-fa163e7eaf52 is active in agent 10.0.0.27
2025-05-15 02:01:45,709 - INFO - Verified Pod ctest-pod-70533498 in agent 10.0.0.27
2025-05-15 02:01:45,709 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=d791934a-c558-4c44-af3e-52b85a24c8ff
2025-05-15 02:01:45,714 - INFO - Pod ctest-pod-70533498 with uuid d791934a-c558-4c44-af3e-52b85a24c8ff found in kube manager
2025-05-15 02:01:45,714 - INFO - Pod ctest-pod-70533498 verification passed
2025-05-15 02:01:45,720 - INFO - Pod ctest-pod-46133041 is in running state.Got IP 10.47.255.248
2025-05-15 02:01:45,735 - DEBUG - Pod ctest-pod-46133041 has vmi 845e3d0a-3130-11f0-ab63-fa163e7eaf52
2025-05-15 02:01:45,735 - INFO - Verified pod ctest-pod-46133041 in contrail-api
2025-05-15 02:01:45,750 - DEBUG - VMI 845e3d0a-3130-11f0-ab63-fa163e7eaf52 is active in agent 10.0.0.27
2025-05-15 02:01:45,751 - INFO - Verified Pod ctest-pod-46133041 in agent 10.0.0.27
2025-05-15 02:01:45,751 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=e228e9cd-67ae-4e84-a2cc-edb2dc7ebccd
2025-05-15 02:01:45,757 - INFO - Pod ctest-pod-46133041 with uuid e228e9cd-67ae-4e84-a2cc-edb2dc7ebccd found in kube manager
2025-05-15 02:01:45,757 - INFO - Pod ctest-pod-46133041 verification passed
2025-05-15 02:01:45,763 - INFO - Pod ctest-pod-04101895 is in running state.Got IP 10.47.255.247
2025-05-15 02:01:45,818 - DEBUG - Pod ctest-pod-04101895 has vmi 84e0a088-3130-11f0-ab63-fa163e7eaf52
2025-05-15 02:01:45,819 - INFO - Verified pod ctest-pod-04101895 in contrail-api
2025-05-15 02:01:45,834 - DEBUG - VMI 84e0a088-3130-11f0-ab63-fa163e7eaf52 is active in agent 10.0.0.27
2025-05-15 02:01:45,834 - INFO - Verified Pod ctest-pod-04101895 in agent 10.0.0.27
2025-05-15 02:01:45,834 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=72d5dca2-5d40-46ee-afd9-1155d29b04db
2025-05-15 02:01:45,839 - INFO - Pod ctest-pod-04101895 with uuid 72d5dca2-5d40-46ee-afd9-1155d29b04db found in kube manager
2025-05-15 02:01:45,840 - INFO - Pod ctest-pod-04101895 verification passed
2025-05-15 02:01:45,847 - INFO - Pod ctest-pod-46130807 is in running state.Got IP 10.47.255.245
2025-05-15 02:01:45,902 - DEBUG - Pod ctest-pod-46130807 has vmi 85d9db76-3130-11f0-ab63-fa163e7eaf52
2025-05-15 02:01:45,902 - INFO - Verified pod ctest-pod-46130807 in contrail-api
2025-05-15 02:01:45,917 - DEBUG - VMI 85d9db76-3130-11f0-ab63-fa163e7eaf52 is active in agent 10.0.0.27
2025-05-15 02:01:45,917 - INFO - Verified Pod ctest-pod-46130807 in agent 10.0.0.27
2025-05-15 02:01:45,917 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=3cf9362b-9f1a-4127-9d77-f925b3f4ef37
2025-05-15 02:01:45,922 - INFO - Pod ctest-pod-46130807 with uuid 3cf9362b-9f1a-4127-9d77-f925b3f4ef37 found in kube manager
2025-05-15 02:01:45,922 - INFO - Pod ctest-pod-46130807 verification passed
2025-05-15 02:01:45,928 - INFO - Pod ctest-pod-70702992 is in running state.Got IP 10.47.255.246
2025-05-15 02:01:45,943 - DEBUG - Pod ctest-pod-70702992 has vmi 85623828-3130-11f0-ab63-fa163e7eaf52
2025-05-15 02:01:45,943 - INFO - Verified pod ctest-pod-70702992 in contrail-api
2025-05-15 02:01:45,958 - DEBUG - VMI 85623828-3130-11f0-ab63-fa163e7eaf52 is active in agent 10.0.0.27
2025-05-15 02:01:45,958 - INFO - Verified Pod ctest-pod-70702992 in agent 10.0.0.27
2025-05-15 02:01:45,958 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=c6a20957-4c42-44bf-b5d7-63a1e285685a
2025-05-15 02:01:45,966 - INFO - Pod ctest-pod-70702992 with uuid c6a20957-4c42-44bf-b5d7-63a1e285685a found in kube manager
2025-05-15 02:01:45,966 - INFO - Pod ctest-pod-70702992 verification passed
2025-05-15 02:01:45,973 - INFO - Pod ctest-pod-62838710 is in running state.Got IP 10.47.255.244
2025-05-15 02:01:46,031 - DEBUG - Pod ctest-pod-62838710 has vmi 8664f0bc-3130-11f0-ab63-fa163e7eaf52
2025-05-15 02:01:46,031 - INFO - Verified pod ctest-pod-62838710 in contrail-api
2025-05-15 02:01:46,046 - DEBUG - VMI 8664f0bc-3130-11f0-ab63-fa163e7eaf52 is active in agent 10.0.0.27
2025-05-15 02:01:46,047 - INFO - Verified Pod ctest-pod-62838710 in agent 10.0.0.27
2025-05-15 02:01:46,047 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_VirtualMachineDatabaseList?x=52169e00-0765-4a8c-8d50-954920bda759
2025-05-15 02:01:46,052 - INFO - Pod ctest-pod-62838710 with uuid 52169e00-0765-4a8c-8d50-954920bda759 found in kube manager
2025-05-15 02:01:46,052 - INFO - Pod ctest-pod-62838710 verification passed
2025-05-15 02:01:46,052 - INFO - ================================================================================
2025-05-15 02:01:46,052 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-05-15 02:01:46,052 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-05-15 02:01:46,283 - DEBUG - Nothing to compare xmpp stats {'10.0.0.27': {'10.0.0.241': '0'}} with
2025-05-15 02:01:46,283 - INFO - Initial checks done. Running the testcase now
2025-05-15 02:01:46,283 - INFO -
2025-05-15 02:01:46,345 - DEBUG - [Pod ctest-pod-16395722] Cmd: echo ctest-pod-16395722 > /usr/share/nginx/html/index.html, Output:
2025-05-15 02:01:46,404 - DEBUG - [Pod ctest-pod-68285685] Cmd: echo ctest-pod-68285685 > /usr/share/nginx/html/index.html, Output:
2025-05-15 02:01:46,465 - DEBUG - [Pod ctest-pod-70533498] Cmd: echo ctest-pod-70533498 > /usr/share/nginx/html/index.html, Output:
2025-05-15 02:01:46,533 - DEBUG - [Pod ctest-pod-46133041] Cmd: echo ctest-pod-46133041 > /usr/share/nginx/html/index.html, Output:
2025-05-15 02:01:46,536 - DEBUG - Service ctest-nginx-svc-22910492 not present
2025-05-15 02:01:46,537 - INFO - Creating service ctest-nginx-svc-22910492
2025-05-15 02:01:46,552 - INFO - Created Service ctest-nginx-svc-22910492
2025-05-15 02:01:46,559 - WARNING - Service UUID 64208eb4-20c8-4609-87cf-c2922d80edcb not yet found in contrail-api
2025-05-15 02:01:47,566 - INFO - Validated that Service ctest-nginx-svc-22910492 is seen in contrail-api
2025-05-15 02:01:47,566 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_LoadbalancerDatabaseList?x=64208eb4-20c8-4609-87cf-c2922d80edcb
2025-05-15 02:01:47,571 - INFO - Service ctest-nginx-svc-22910492 with uuid 64208eb4-20c8-4609-87cf-c2922d80edcb found in kube manager
2025-05-15 02:01:47,571 - INFO - Service ctest-nginx-svc-22910492 verification passed
2025-05-15 02:01:48,638 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% ctest-pod-16395722
|********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:48,638 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:01:48,638 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% ctest-pod-16395722
|********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:48,694 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-16395722
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:48,695 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:01:48,695 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: ctest-pod-16395722
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:48,759 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-16395722
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:48,759 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:01:48,759 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: ctest-pod-16395722
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:48,817 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:48,818 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:01:48,818 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:48,818 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16395722': 3, 'ctest-pod-68285685': 1}
2025-05-15 02:01:48,876 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:48,876 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:01:48,876 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:48,988 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:48,988 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:01:48,988 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:49,046 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-16395722
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:49,046 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:01:49,046 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: ctest-pod-16395722
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:01:49,046 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16395722': 1, 'ctest-pod-68285685': 2}
2025-05-15 02:01:49,054 - DEBUG - Network policy ingress-on-service not present
2025-05-15 02:01:49,054 - INFO - Creating Network Policy ingress-on-service
2025-05-15 02:01:49,072 - INFO - Network policy found in k8s
2025-05-15 02:01:49,073 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ec67f6de-8fc3-40b3-8799-ac5cd8694956
2025-05-15 02:01:49,081 - INFO - Network Policy ingress-on-service with uuid ec67f6de-8fc3-40b3-8799-ac5cd8694956 found in kube manager
2025-05-15 02:01:49,118 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-05-15 02:01:49,118 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-05-15 02:01:49,118 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ec67f6de-8fc3-40b3-8799-ac5cd8694956
2025-05-15 02:01:49,149 - WARNING - Network policy with name ingress-on-service not found in agent
2025-05-15 02:01:51,150 - DEBUG - Requesting: http://10.0.0.241:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=ec67f6de-8fc3-40b3-8799-ac5cd8694956
2025-05-15 02:01:51,195 - INFO - Network policy with name ingress-on-service found in agent
2025-05-15 02:01:51,196 - INFO - Network Policy ingress-on-service verification passed
2025-05-15 02:01:56,250 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:01:56,251 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:01:56,251 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:01,307 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:01,307 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:01,307 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:06,358 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:06,358 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:06,358 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:11,406 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:11,406 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:11,406 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:16,462 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:16,462 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:16,462 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:21,524 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:21,524 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:21,524 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:26,579 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:26,579 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:26,579 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:31,634 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:31,634 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:31,634 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:36,692 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:36,693 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:36,693 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:41,753 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:41,753 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:41,753 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:41,754 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16395722': 0, 'ctest-pod-68285685': 0}
2025-05-15 02:02:41,822 - DEBUG - [Pod ctest-pod-70702992] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:02:41,822 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:02:41,822 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:02:41,880 - DEBUG - [Pod ctest-pod-70702992] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:02:41,880 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:02:41,880 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:02:41,937 - DEBUG - [Pod ctest-pod-70702992] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:02:41,937 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:02:41,937 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:02:41,996 - DEBUG - [Pod ctest-pod-70702992] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-16395722
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:02:41,997 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:02:41,997 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd output: ctest-pod-16395722
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:02:41,997 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16395722': 1, 'ctest-pod-68285685': 3}
2025-05-15 02:02:47,056 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:47,056 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:47,056 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:52,114 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:52,114 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:52,114 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:57,166 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:57,166 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:02:57,166 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:02,222 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:02,222 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:02,222 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:07,265 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:07,266 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:07,266 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:12,317 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:12,317 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:12,317 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:17,375 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:17,376 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:17,376 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:22,426 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:22,426 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:22,426 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:27,479 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:27,479 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:27,479 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:32,537 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:32,537 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:32,537 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:32,537 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16395722': 0, 'ctest-pod-68285685': 0}
2025-05-15 02:03:34,598 - DEBUG - [Pod ctest-pod-70702992] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.672 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.115 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.099 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.099/0.295/0.672 ms
2025-05-15 02:03:34,598 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-70702992 with expectation True passed
2025-05-15 02:03:36,655 - DEBUG - [Pod ctest-pod-04101895] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.083 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.081 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.133 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.081/0.432/1.083 ms
2025-05-15 02:03:36,655 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-04101895 with expectation True passed
2025-05-15 02:03:38,712 - DEBUG - [Pod ctest-pod-46130807] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.817 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.085 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.107 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.085/0.669/1.817 ms
2025-05-15 02:03:38,712 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-46130807 with expectation True passed
2025-05-15 02:03:38,785 - DEBUG - [Pod ctest-pod-70702992] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-15 02:03:38,785 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-05-15 02:03:38,785 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-15 02:03:38,785 - INFO - wget check of of http://10.47.255.251 from ctest-pod-70702992 passed
2025-05-15 02:03:38,838 - DEBUG - [Pod ctest-pod-70702992] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-15 02:03:38,839 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-05-15 02:03:38,839 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-15 02:03:38,839 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70702992 passed
2025-05-15 02:03:43,893 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-15 02:03:43,893 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-15 02:03:43,893 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-15 02:03:43,893 - INFO - wget check of of http://10.47.255.250 from ctest-pod-04101895 passed
2025-05-15 02:03:48,945 - DEBUG - [Pod ctest-pod-62838710] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-05-15 02:03:48,945 - DEBUG - [Pod Pod ctest-pod-62838710] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-05-15 02:03:48,945 - DEBUG - [Pod Pod ctest-pod-62838710] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-05-15 02:03:48,945 - INFO - wget check of of http://10.47.255.251 from ctest-pod-62838710 passed
2025-05-15 02:03:48,954 - INFO - Updating Network Policy ingress-on-service
2025-05-15 02:03:54,020 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:54,020 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:54,020 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:59,069 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:59,069 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:03:59,069 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:04,128 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:04,128 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:04,128 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:09,175 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:09,175 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:09,175 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:14,230 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:14,230 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:14,230 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:19,287 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:19,287 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:19,287 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:24,331 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:24,331 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:24,331 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:29,402 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:29,402 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:29,402 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:34,453 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:34,453 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:34,454 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:39,522 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:39,522 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:39,523 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
wget: download timed out
2025-05-15 02:04:39,523 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-16395722': 0, 'ctest-pod-68285685': 0}
2025-05-15 02:04:39,584 - DEBUG - [Pod ctest-pod-70702992] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
ctest-pod-16395722
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:04:39,584 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:04:39,584 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd output: Connecting to 10.96.150.33:80 (10.96.150.33:80)
ctest-pod-16395722
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:04:39,644 - DEBUG - [Pod ctest-pod-70702992] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-16395722
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:04:39,645 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:04:39,645 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd output: ctest-pod-16395722
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:04:39,700 - DEBUG - [Pod ctest-pod-70702992] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:04:39,700 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:04:39,700 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:04:39,700 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16395722': 2, 'ctest-pod-68285685': 1}
2025-05-15 02:04:39,760 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:04:39,760 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:04:39,760 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: ctest-pod-68285685
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:04:39,812 - DEBUG - [Pod ctest-pod-46130807] Cmd: wget http://10.96.150.33:80/ -O - -T 5 -t 1 , Output: ctest-pod-16395722
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:04:39,812 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd wget http://10.96.150.33:80/ -O - -T 5 -t 1 passed
2025-05-15 02:04:39,812 - DEBUG - [Pod Pod ctest-pod-46130807] Cmd output: ctest-pod-16395722
Connecting to 10.96.150.33:80 (10.96.150.33:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-05-15 02:04:39,813 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-16395722': 1, 'ctest-pod-68285685': 1}
2025-05-15 02:04:41,867 - DEBUG - [Pod ctest-pod-70702992] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.676 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.084 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.149 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.084/0.303/0.676 ms
2025-05-15 02:04:41,867 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-70702992 with expectation True passed
2025-05-15 02:04:43,919 - DEBUG - [Pod ctest-pod-04101895] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.603 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.100 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.083/0.595/1.603 ms
2025-05-15 02:04:43,919 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-04101895 with expectation True passed
2025-05-15 02:04:45,974 - DEBUG - [Pod ctest-pod-46130807] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.805 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.084 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.089 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.084/0.326/0.805 ms
2025-05-15 02:04:45,974 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-46130807 with expectation True passed
2025-05-15 02:04:46,033 - DEBUG - [Pod ctest-pod-70702992] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-15 02:04:46,034 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-05-15 02:04:46,034 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-15 02:04:46,034 - INFO - wget check of of http://10.47.255.251 from ctest-pod-70702992 passed
2025-05-15 02:04:46,096 - DEBUG - [Pod ctest-pod-70702992] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-15 02:04:46,096 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-05-15 02:04:46,096 - DEBUG - [Pod Pod ctest-pod-70702992] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-15 02:04:46,096 - INFO - wget check of of http://10.47.255.250 from ctest-pod-70702992 passed
2025-05-15 02:04:51,155 - DEBUG - [Pod ctest-pod-04101895] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-15 02:04:51,155 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-15 02:04:51,155 - DEBUG - [Pod Pod ctest-pod-04101895] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-05-15 02:04:51,155 - INFO - wget check of of http://10.47.255.250 from ctest-pod-04101895 passed
2025-05-15 02:04:51,214 - DEBUG - [Pod ctest-pod-62838710] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-15 02:04:51,214 - DEBUG - [Pod Pod ctest-pod-62838710] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-05-15 02:04:51,214 - DEBUG - [Pod Pod ctest-pod-62838710] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-05-15 02:04:51,214 - INFO - wget check of of http://10.47.255.251 from ctest-pod-62838710 passed
2025-05-15 02:04:51,215 - INFO - Deleting Network Policy : ingress-on-service
2025-05-15 02:04:51,215 - INFO - Deleting service : ctest-nginx-svc-22910492
2025-05-15 02:04:51,482 - DEBUG - No XMPP flaps were noticed during the test
2025-05-15 02:04:51,482 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:05]
2025-05-15 02:04:51,483 - INFO - --------------------------------------------------------------------------------
2025-05-15 02:04:51,488 - INFO - Deleting pod ctest-new-default-54618605:ctest-pod-16395722
2025-05-15 02:04:51,488 - INFO - Deleting pod ctest-new-default-54618605:ctest-pod-68285685
2025-05-15 02:04:51,489 - INFO - Deleting pod ctest-non-default-16394235:ctest-pod-70533498
2025-05-15 02:04:51,489 - INFO - Deleting pod ctest-non-default-16394235:ctest-pod-46133041
2025-05-15 02:04:51,489 - INFO - Deleting pod ctest-new-default-54618605:ctest-pod-04101895
2025-05-15 02:04:51,490 - INFO - Deleting pod ctest-new-default-54618605:ctest-pod-70702992
2025-05-15 02:04:51,490 - INFO - Deleting pod ctest-non-default-16394235:ctest-pod-46130807
2025-05-15 02:04:51,491 - INFO - Deleting pod ctest-non-default-16394235:ctest-pod-62838710
2025-05-15 02:04:51,676 - WARNING - Pod uuid 3cf9362b-9f1a-4127-9d77-f925b3f4ef37 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:04:51,679 - WARNING - Pod uuid a58c261b-4ef6-43c4-9075-ccfcb4a94938 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:04:51,681 - WARNING - Pod uuid c6a20957-4c42-44bf-b5d7-63a1e285685a is still seen in agent 10.0.0.27 VM list
2025-05-15 02:04:51,766 - WARNING - Pod uuid 52169e00-0765-4a8c-8d50-954920bda759 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:04:51,767 - WARNING - Pod uuid 63933d99-dc2b-4bee-88e6-81772a25d8aa is still seen in agent 10.0.0.27 VM list
2025-05-15 02:04:51,768 - WARNING - Pod uuid d791934a-c558-4c44-af3e-52b85a24c8ff is still seen in agent 10.0.0.27 VM list
2025-05-15 02:04:51,769 - WARNING - Pod uuid e228e9cd-67ae-4e84-a2cc-edb2dc7ebccd is still seen in agent 10.0.0.27 VM list
2025-05-15 02:04:51,770 - WARNING - Pod uuid 72d5dca2-5d40-46ee-afd9-1155d29b04db is still seen in agent 10.0.0.27 VM list
2025-05-15 02:04:56,696 - WARNING - Pod uuid 3cf9362b-9f1a-4127-9d77-f925b3f4ef37 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:04:56,698 - DEBUG - Pod a58c261b-4ef6-43c4-9075-ccfcb4a94938 is not in agent 10.0.0.27 VM list
2025-05-15 02:04:56,699 - WARNING - Pod uuid c6a20957-4c42-44bf-b5d7-63a1e285685a is still seen in agent 10.0.0.27 VM list
2025-05-15 02:04:56,706 - DEBUG - VMI 82738022-3130-11f0-ab63-fa163e7eaf52 is removed from agent 10.0.0.27
2025-05-15 02:04:56,706 - INFO - Verified that pod ctest-pod-16395722 is removed in agent
2025-05-15 02:04:56,793 - DEBUG - Pod d791934a-c558-4c44-af3e-52b85a24c8ff is not in agent 10.0.0.27 VM list
2025-05-15 02:04:56,794 - WARNING - Pod uuid 52169e00-0765-4a8c-8d50-954920bda759 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:04:56,797 - DEBUG - Pod e228e9cd-67ae-4e84-a2cc-edb2dc7ebccd is not in agent 10.0.0.27 VM list
2025-05-15 02:04:56,799 - WARNING - Pod uuid 72d5dca2-5d40-46ee-afd9-1155d29b04db is still seen in agent 10.0.0.27 VM list
2025-05-15 02:04:56,800 - WARNING - Pod uuid 63933d99-dc2b-4bee-88e6-81772a25d8aa is still seen in agent 10.0.0.27 VM list
2025-05-15 02:04:56,809 - DEBUG - VMI 83de5144-3130-11f0-ab63-fa163e7eaf52 is removed from agent 10.0.0.27
2025-05-15 02:04:56,809 - INFO - Verified that pod ctest-pod-70533498 is removed in agent
2025-05-15 02:04:56,810 - DEBUG - VMI 845e3d0a-3130-11f0-ab63-fa163e7eaf52 is removed from agent 10.0.0.27
2025-05-15 02:04:56,810 - INFO - Verified that pod ctest-pod-46133041 is removed in agent
2025-05-15 02:05:01,707 - WARNING - Pod uuid 3cf9362b-9f1a-4127-9d77-f925b3f4ef37 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:01,708 - WARNING - Pod uuid c6a20957-4c42-44bf-b5d7-63a1e285685a is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:01,805 - WARNING - Pod uuid 52169e00-0765-4a8c-8d50-954920bda759 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:01,814 - WARNING - Pod uuid 72d5dca2-5d40-46ee-afd9-1155d29b04db is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:01,814 - WARNING - Pod uuid 63933d99-dc2b-4bee-88e6-81772a25d8aa is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:06,720 - WARNING - Pod uuid 3cf9362b-9f1a-4127-9d77-f925b3f4ef37 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:06,722 - WARNING - Pod uuid c6a20957-4c42-44bf-b5d7-63a1e285685a is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:06,813 - WARNING - Pod uuid 52169e00-0765-4a8c-8d50-954920bda759 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:06,826 - WARNING - Pod uuid 72d5dca2-5d40-46ee-afd9-1155d29b04db is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:06,827 - WARNING - Pod uuid 63933d99-dc2b-4bee-88e6-81772a25d8aa is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:11,737 - WARNING - Pod uuid c6a20957-4c42-44bf-b5d7-63a1e285685a is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:11,739 - WARNING - Pod uuid 3cf9362b-9f1a-4127-9d77-f925b3f4ef37 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:11,823 - WARNING - Pod uuid 52169e00-0765-4a8c-8d50-954920bda759 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:11,839 - WARNING - Pod uuid 63933d99-dc2b-4bee-88e6-81772a25d8aa is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:11,840 - WARNING - Pod uuid 72d5dca2-5d40-46ee-afd9-1155d29b04db is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:16,752 - WARNING - Pod uuid 3cf9362b-9f1a-4127-9d77-f925b3f4ef37 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:16,753 - WARNING - Pod uuid c6a20957-4c42-44bf-b5d7-63a1e285685a is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:16,831 - WARNING - Pod uuid 52169e00-0765-4a8c-8d50-954920bda759 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:16,857 - WARNING - Pod uuid 63933d99-dc2b-4bee-88e6-81772a25d8aa is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:16,858 - WARNING - Pod uuid 72d5dca2-5d40-46ee-afd9-1155d29b04db is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:21,784 - WARNING - Pod uuid c6a20957-4c42-44bf-b5d7-63a1e285685a is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:21,784 - WARNING - Pod uuid 3cf9362b-9f1a-4127-9d77-f925b3f4ef37 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:21,917 - WARNING - Pod uuid 52169e00-0765-4a8c-8d50-954920bda759 is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:21,919 - WARNING - Pod uuid 63933d99-dc2b-4bee-88e6-81772a25d8aa is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:21,919 - WARNING - Pod uuid 72d5dca2-5d40-46ee-afd9-1155d29b04db is still seen in agent 10.0.0.27 VM list
2025-05-15 02:05:26,799 - DEBUG - Pod 3cf9362b-9f1a-4127-9d77-f925b3f4ef37 is not in agent 10.0.0.27 VM list
2025-05-15 02:05:26,802 - DEBUG - Pod c6a20957-4c42-44bf-b5d7-63a1e285685a is not in agent 10.0.0.27 VM list
2025-05-15 02:05:26,814 - DEBUG - VMI 85623828-3130-11f0-ab63-fa163e7eaf52 is removed from agent 10.0.0.27
2025-05-15 02:05:26,815 - INFO - Verified that pod ctest-pod-70702992 is removed in agent
2025-05-15 02:05:26,816 - DEBUG - VMI 85d9db76-3130-11f0-ab63-fa163e7eaf52 is removed from agent 10.0.0.27
2025-05-15 02:05:26,816 - INFO - Verified that pod ctest-pod-46130807 is removed in agent
2025-05-15 02:05:26,935 - DEBUG - Pod 63933d99-dc2b-4bee-88e6-81772a25d8aa is not in agent 10.0.0.27 VM list
2025-05-15 02:05:26,937 - DEBUG - Pod 52169e00-0765-4a8c-8d50-954920bda759 is not in agent 10.0.0.27 VM list
2025-05-15 02:05:26,938 - DEBUG - Pod 72d5dca2-5d40-46ee-afd9-1155d29b04db is not in agent 10.0.0.27 VM list
2025-05-15 02:05:26,952 - DEBUG - VMI 832824a0-3130-11f0-ab63-fa163e7eaf52 is removed from agent 10.0.0.27
2025-05-15 02:05:26,952 - INFO - Verified that pod ctest-pod-68285685 is removed in agent
2025-05-15 02:05:26,954 - DEBUG - VMI 8664f0bc-3130-11f0-ab63-fa163e7eaf52 is removed from agent 10.0.0.27
2025-05-15 02:05:26,954 - INFO - Verified that pod ctest-pod-62838710 is removed in agent
2025-05-15 02:05:26,955 - DEBUG - VMI 84e0a088-3130-11f0-ab63-fa163e7eaf52 is removed from agent 10.0.0.27
2025-05-15 02:05:26,955 - INFO - Verified that pod ctest-pod-04101895 is removed in agent
2025-05-15 02:05:26,955 - INFO - Deleting namespace ctest-non-default-16394235
2025-05-15 02:05:26,966 - DEBUG - Namespace ctest-non-default-16394235 still in k8s
2025-05-15 02:05:28,971 - DEBUG - Namespace ctest-non-default-16394235 still in k8s
2025-05-15 02:05:30,977 - DEBUG - Namespace ctest-non-default-16394235 still in k8s
2025-05-15 02:05:32,983 - DEBUG - Namespace ctest-non-default-16394235 is not in k8s
2025-05-15 02:05:32,983 - DEBUG - No need to check project deletion in contrail-api
2025-05-15 02:05:32,983 - INFO - Deleting namespace ctest-new-default-54618605
2025-05-15 02:05:32,996 - DEBUG - Namespace ctest-new-default-54618605 still in k8s
2025-05-15 02:05:35,002 - DEBUG - Namespace ctest-new-default-54618605 still in k8s
2025-05-15 02:05:37,019 - DEBUG - Namespace ctest-new-default-54618605 still in k8s
2025-05-15 02:05:39,023 - DEBUG - Namespace ctest-new-default-54618605 is not in k8s
2025-05-15 02:05:39,023 - DEBUG - No need to check project deletion in contrail-api