2025-09-25 01:37:06,886 - INFO - Using existing project ['default-domain', 'k8s-default'](237b141e-8cf5-4cc0-860f-6b76d4ba2cbc)
2025-09-25 01:37:06,904 - DEBUG - Namespace ctest-new-default-14158848 not present
2025-09-25 01:37:06,913 - INFO - Created namespace ctest-new-default-14158848
2025-09-25 01:37:09,916 - DEBUG - Namespace ctest-non-default-18636157 not present
2025-09-25 01:37:09,924 - INFO - Created namespace ctest-non-default-18636157
2025-09-25 01:37:12,948 - DEBUG - Pod ctest-pod-10766785 not present
2025-09-25 01:37:12,949 - INFO - Creating Pod ctest-pod-10766785
2025-09-25 01:37:12,972 - DEBUG - Pod : ctest-pod-10766785 UUID is 625ad9b1-44ae-464a-9dcc-e2ada58ac231
2025-09-25 01:37:12,975 - DEBUG - Pod ctest-pod-86575130 not present
2025-09-25 01:37:12,976 - INFO - Creating Pod ctest-pod-86575130
2025-09-25 01:37:12,998 - DEBUG - Pod : ctest-pod-86575130 UUID is b3dd19a0-70f4-42a0-9544-6248f00fe11a
2025-09-25 01:37:13,000 - DEBUG - Pod ctest-pod-38514088 not present
2025-09-25 01:37:13,000 - INFO - Creating Pod ctest-pod-38514088
2025-09-25 01:37:13,026 - DEBUG - Pod : ctest-pod-38514088 UUID is 40be8114-af1f-4fc3-9b0e-ff384c2563aa
2025-09-25 01:37:13,029 - DEBUG - Pod ctest-pod-70866797 not present
2025-09-25 01:37:13,030 - INFO - Creating Pod ctest-pod-70866797
2025-09-25 01:37:13,064 - DEBUG - Pod : ctest-pod-70866797 UUID is 2d449ff4-384a-49a7-89a6-44bdd1edfe04
2025-09-25 01:37:13,066 - DEBUG - Pod ctest-pod-43907752 not present
2025-09-25 01:37:13,066 - INFO - Creating Pod ctest-pod-43907752
2025-09-25 01:37:13,085 - DEBUG - Pod : ctest-pod-43907752 UUID is 8f45bcd2-be8d-400e-b48b-6537685ab664
2025-09-25 01:37:13,087 - DEBUG - Pod ctest-pod-62656396 not present
2025-09-25 01:37:13,087 - INFO - Creating Pod ctest-pod-62656396
2025-09-25 01:37:13,108 - DEBUG - Pod : ctest-pod-62656396 UUID is 41fedabb-33b6-4e6e-9eb3-2581cce977d7
2025-09-25 01:37:13,110 - DEBUG - Pod ctest-pod-19989554 not present
2025-09-25 01:37:13,111 - INFO - Creating Pod ctest-pod-19989554
2025-09-25 01:37:13,133 - DEBUG - Pod : ctest-pod-19989554 UUID is 0a736bf9-f7a5-45d7-b794-c2f3ac3242de
2025-09-25 01:37:13,135 - DEBUG - Pod ctest-pod-09410854 not present
2025-09-25 01:37:13,136 - INFO - Creating Pod ctest-pod-09410854
2025-09-25 01:37:13,158 - DEBUG - Pod : ctest-pod-09410854 UUID is 8e9ac253-0893-4b7f-95c9-63cd0bc5d0fd
2025-09-25 01:37:13,320 - INFO - Project default-domain:k8s-ctest-new-default-14158848 for Namespace ctest-new-default-14158848 is seen in contrail-api
2025-09-25 01:37:13,320 - DEBUG - Project uuid in Contrail is 98b8ece9-8834-49ee-bc70-e68d08416ae7
2025-09-25 01:37:13,481 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=5430b399-9bcc-4e3f-b3a6-50c68b47c346
2025-09-25 01:37:13,485 - INFO - Namespace ctest-new-default-14158848 with uuid 5430b399-9bcc-4e3f-b3a6-50c68b47c346 found in kube manager
2025-09-25 01:37:13,485 - INFO - Namespace ctest-new-default-14158848 verification passed
2025-09-25 01:37:13,693 - INFO - Project default-domain:k8s-ctest-non-default-18636157 for Namespace ctest-non-default-18636157 is seen in contrail-api
2025-09-25 01:37:13,693 - DEBUG - Project uuid in Contrail is 6ff3768b-394f-4070-a9d5-86c90aaccd9b
2025-09-25 01:37:13,693 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NamespaceDatabaseList?namespace_uuid=4bfc2514-2930-48a2-a4af-251385ba9319
2025-09-25 01:37:13,698 - INFO - Namespace ctest-non-default-18636157 with uuid 4bfc2514-2930-48a2-a4af-251385ba9319 found in kube manager
2025-09-25 01:37:13,698 - INFO - Namespace ctest-non-default-18636157 verification passed
2025-09-25 01:37:13,703 - DEBUG - Pod ctest-pod-10766785 not in running state.Currently in Pending
2025-09-25 01:37:18,711 - DEBUG - Pod ctest-pod-10766785 not in running state.Currently in Pending
2025-09-25 01:37:23,717 - DEBUG - Pod ctest-pod-10766785 not in running state.Currently in Pending
2025-09-25 01:37:28,732 - INFO - Pod ctest-pod-10766785 is in running state.Got IP 10.47.255.251
2025-09-25 01:37:28,753 - DEBUG - Pod ctest-pod-10766785 has vmi 29fefbb8-99b0-11f0-91be-fa163e650e71
2025-09-25 01:37:28,754 - INFO - Verified pod ctest-pod-10766785 in contrail-api
2025-09-25 01:37:28,765 - DEBUG - VMI 29fefbb8-99b0-11f0-91be-fa163e650e71 is active in agent 10.0.0.22
2025-09-25 01:37:28,765 - INFO - Verified Pod ctest-pod-10766785 in agent 10.0.0.22
2025-09-25 01:37:28,765 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=625ad9b1-44ae-464a-9dcc-e2ada58ac231
2025-09-25 01:37:28,769 - INFO - Pod ctest-pod-10766785 with uuid 625ad9b1-44ae-464a-9dcc-e2ada58ac231 found in kube manager
2025-09-25 01:37:28,769 - INFO - Pod ctest-pod-10766785 verification passed
2025-09-25 01:37:28,775 - INFO - Pod ctest-pod-86575130 is in running state.Got IP 10.47.255.250
2025-09-25 01:37:28,829 - DEBUG - Pod ctest-pod-86575130 has vmi 2a700b82-99b0-11f0-91be-fa163e650e71
2025-09-25 01:37:28,829 - INFO - Verified pod ctest-pod-86575130 in contrail-api
2025-09-25 01:37:28,839 - DEBUG - VMI 2a700b82-99b0-11f0-91be-fa163e650e71 is active in agent 10.0.0.22
2025-09-25 01:37:28,840 - INFO - Verified Pod ctest-pod-86575130 in agent 10.0.0.22
2025-09-25 01:37:28,840 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=b3dd19a0-70f4-42a0-9544-6248f00fe11a
2025-09-25 01:37:28,844 - INFO - Pod ctest-pod-86575130 with uuid b3dd19a0-70f4-42a0-9544-6248f00fe11a found in kube manager
2025-09-25 01:37:28,844 - INFO - Pod ctest-pod-86575130 verification passed
2025-09-25 01:37:28,850 - INFO - Pod ctest-pod-38514088 is in running state.Got IP 10.47.255.249
2025-09-25 01:37:28,904 - DEBUG - Pod ctest-pod-38514088 has vmi 2b02edc6-99b0-11f0-91be-fa163e650e71
2025-09-25 01:37:28,904 - INFO - Verified pod ctest-pod-38514088 in contrail-api
2025-09-25 01:37:28,916 - DEBUG - VMI 2b02edc6-99b0-11f0-91be-fa163e650e71 is active in agent 10.0.0.22
2025-09-25 01:37:28,916 - INFO - Verified Pod ctest-pod-38514088 in agent 10.0.0.22
2025-09-25 01:37:28,916 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=40be8114-af1f-4fc3-9b0e-ff384c2563aa
2025-09-25 01:37:28,920 - INFO - Pod ctest-pod-38514088 with uuid 40be8114-af1f-4fc3-9b0e-ff384c2563aa found in kube manager
2025-09-25 01:37:28,920 - INFO - Pod ctest-pod-38514088 verification passed
2025-09-25 01:37:28,926 - INFO - Pod ctest-pod-70866797 is in running state.Got IP 10.47.255.248
2025-09-25 01:37:28,944 - DEBUG - Pod ctest-pod-70866797 has vmi 2b741938-99b0-11f0-91be-fa163e650e71
2025-09-25 01:37:28,944 - INFO - Verified pod ctest-pod-70866797 in contrail-api
2025-09-25 01:37:28,955 - DEBUG - VMI 2b741938-99b0-11f0-91be-fa163e650e71 is active in agent 10.0.0.22
2025-09-25 01:37:28,955 - INFO - Verified Pod ctest-pod-70866797 in agent 10.0.0.22
2025-09-25 01:37:28,955 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=2d449ff4-384a-49a7-89a6-44bdd1edfe04
2025-09-25 01:37:28,959 - INFO - Pod ctest-pod-70866797 with uuid 2d449ff4-384a-49a7-89a6-44bdd1edfe04 found in kube manager
2025-09-25 01:37:28,959 - INFO - Pod ctest-pod-70866797 verification passed
2025-09-25 01:37:28,964 - INFO - Pod ctest-pod-43907752 is in running state.Got IP 10.47.255.247
2025-09-25 01:37:29,016 - DEBUG - Pod ctest-pod-43907752 has vmi 2bed047e-99b0-11f0-91be-fa163e650e71
2025-09-25 01:37:29,016 - INFO - Verified pod ctest-pod-43907752 in contrail-api
2025-09-25 01:37:29,027 - DEBUG - VMI 2bed047e-99b0-11f0-91be-fa163e650e71 is active in agent 10.0.0.22
2025-09-25 01:37:29,027 - INFO - Verified Pod ctest-pod-43907752 in agent 10.0.0.22
2025-09-25 01:37:29,027 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=8f45bcd2-be8d-400e-b48b-6537685ab664
2025-09-25 01:37:29,030 - INFO - Pod ctest-pod-43907752 with uuid 8f45bcd2-be8d-400e-b48b-6537685ab664 found in kube manager
2025-09-25 01:37:29,030 - INFO - Pod ctest-pod-43907752 verification passed
2025-09-25 01:37:29,037 - INFO - Pod ctest-pod-19989554 is in running state.Got IP 10.47.255.245
2025-09-25 01:37:29,049 - DEBUG - Pod ctest-pod-19989554 has vmi 2ccbf314-99b0-11f0-91be-fa163e650e71
2025-09-25 01:37:29,049 - INFO - Verified pod ctest-pod-19989554 in contrail-api
2025-09-25 01:37:29,059 - DEBUG - VMI 2ccbf314-99b0-11f0-91be-fa163e650e71 is active in agent 10.0.0.22
2025-09-25 01:37:29,059 - INFO - Verified Pod ctest-pod-19989554 in agent 10.0.0.22
2025-09-25 01:37:29,060 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=0a736bf9-f7a5-45d7-b794-c2f3ac3242de
2025-09-25 01:37:29,063 - INFO - Pod ctest-pod-19989554 with uuid 0a736bf9-f7a5-45d7-b794-c2f3ac3242de found in kube manager
2025-09-25 01:37:29,063 - INFO - Pod ctest-pod-19989554 verification passed
2025-09-25 01:37:29,068 - DEBUG - Pod ctest-pod-62656396 not in running state.Currently in Pending
2025-09-25 01:37:34,075 - INFO - Pod ctest-pod-62656396 is in running state.Got IP 10.47.255.246
2025-09-25 01:37:34,085 - DEBUG - Pod ctest-pod-62656396 has vmi 2c575798-99b0-11f0-91be-fa163e650e71
2025-09-25 01:37:34,085 - INFO - Verified pod ctest-pod-62656396 in contrail-api
2025-09-25 01:37:34,095 - DEBUG - VMI 2c575798-99b0-11f0-91be-fa163e650e71 is active in agent 10.0.0.22
2025-09-25 01:37:34,096 - INFO - Verified Pod ctest-pod-62656396 in agent 10.0.0.22
2025-09-25 01:37:34,096 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=41fedabb-33b6-4e6e-9eb3-2581cce977d7
2025-09-25 01:37:34,099 - INFO - Pod ctest-pod-62656396 with uuid 41fedabb-33b6-4e6e-9eb3-2581cce977d7 found in kube manager
2025-09-25 01:37:34,099 - INFO - Pod ctest-pod-62656396 verification passed
2025-09-25 01:37:34,104 - INFO - Pod ctest-pod-09410854 is in running state.Got IP 10.47.255.244
2025-09-25 01:37:34,159 - DEBUG - Pod ctest-pod-09410854 has vmi 2d3c4830-99b0-11f0-91be-fa163e650e71
2025-09-25 01:37:34,159 - INFO - Verified pod ctest-pod-09410854 in contrail-api
2025-09-25 01:37:34,169 - DEBUG - VMI 2d3c4830-99b0-11f0-91be-fa163e650e71 is active in agent 10.0.0.22
2025-09-25 01:37:34,170 - INFO - Verified Pod ctest-pod-09410854 in agent 10.0.0.22
2025-09-25 01:37:34,170 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_VirtualMachineDatabaseList?x=8e9ac253-0893-4b7f-95c9-63cd0bc5d0fd
2025-09-25 01:37:34,173 - INFO - Pod ctest-pod-09410854 with uuid 8e9ac253-0893-4b7f-95c9-63cd0bc5d0fd found in kube manager
2025-09-25 01:37:34,173 - INFO - Pod ctest-pod-09410854 verification passed
2025-09-25 01:37:34,173 - INFO - ================================================================================
2025-09-25 01:37:34,173 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-09-25 01:37:34,174 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-09-25 01:37:34,408 - DEBUG - Nothing to compare xmpp stats {'10.0.0.22': {'10.0.0.50': '0'}} with
2025-09-25 01:37:34,408 - INFO - Initial checks done. Running the testcase now
2025-09-25 01:37:34,409 - INFO -
2025-09-25 01:37:34,478 - DEBUG - [Pod ctest-pod-10766785] Cmd: echo ctest-pod-10766785 > /usr/share/nginx/html/index.html, Output:
2025-09-25 01:37:34,533 - DEBUG - [Pod ctest-pod-86575130] Cmd: echo ctest-pod-86575130 > /usr/share/nginx/html/index.html, Output:
2025-09-25 01:37:34,592 - DEBUG - [Pod ctest-pod-38514088] Cmd: echo ctest-pod-38514088 > /usr/share/nginx/html/index.html, Output:
2025-09-25 01:37:34,647 - DEBUG - [Pod ctest-pod-70866797] Cmd: echo ctest-pod-70866797 > /usr/share/nginx/html/index.html, Output:
2025-09-25 01:37:34,650 - DEBUG - Service ctest-nginx-svc-71908597 not present
2025-09-25 01:37:34,650 - INFO - Creating service ctest-nginx-svc-71908597
2025-09-25 01:37:34,673 - INFO - Created Service ctest-nginx-svc-71908597
2025-09-25 01:37:34,682 - WARNING - Service UUID e334823d-ea38-4351-86a9-04060c56961f not yet found in contrail-api
2025-09-25 01:37:35,693 - INFO - Validated that Service ctest-nginx-svc-71908597 is seen in contrail-api
2025-09-25 01:37:35,693 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_LoadbalancerDatabaseList?x=e334823d-ea38-4351-86a9-04060c56961f
2025-09-25 01:37:35,697 - INFO - Service ctest-nginx-svc-71908597 with uuid e334823d-ea38-4351-86a9-04060c56961f found in kube manager
2025-09-25 01:37:35,697 - INFO - Service ctest-nginx-svc-71908597 verification passed
2025-09-25 01:37:35,765 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:37:35,765 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:37:35,765 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:37:35,821 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-86575130
2025-09-25 01:37:35,821 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:37:35,821 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-86575130
2025-09-25 01:37:35,877 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:37:35,877 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:37:35,877 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:37:35,935 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-86575130
2025-09-25 01:37:35,935 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:37:35,935 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-86575130
2025-09-25 01:37:35,999 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-10766785
2025-09-25 01:37:35,999 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:37:35,999 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-10766785
2025-09-25 01:37:35,999 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10766785': 1, 'ctest-pod-86575130': 4}
2025-09-25 01:37:36,064 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:37:36,065 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:37:36,065 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:37:36,124 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-10766785
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:37:36,124 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:37:36,124 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: ctest-pod-10766785
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:37:36,124 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10766785': 1, 'ctest-pod-86575130': 1}
2025-09-25 01:37:36,127 - DEBUG - Network policy ingress-on-service not present
2025-09-25 01:37:36,127 - INFO - Creating Network Policy ingress-on-service
2025-09-25 01:37:36,137 - INFO - Network policy found in k8s
2025-09-25 01:37:36,137 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6f5b7302-83ef-4237-8e34-d06b53ab2f01
2025-09-25 01:37:36,141 - INFO - Network Policy ingress-on-service with uuid 6f5b7302-83ef-4237-8e34-d06b53ab2f01 found in kube manager
2025-09-25 01:37:36,166 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-09-25 01:37:36,166 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-09-25 01:37:36,166 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6f5b7302-83ef-4237-8e34-d06b53ab2f01
2025-09-25 01:37:36,188 - WARNING - Network policy with name ingress-on-service not found in agent
2025-09-25 01:37:38,189 - DEBUG - Requesting: http://10.0.0.50:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=6f5b7302-83ef-4237-8e34-d06b53ab2f01
2025-09-25 01:37:38,212 - INFO - Network policy with name ingress-on-service found in agent
2025-09-25 01:37:38,212 - INFO - Network Policy ingress-on-service verification passed
2025-09-25 01:37:43,259 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:37:43,259 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:37:43,259 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:37:48,306 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:37:48,306 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:37:48,306 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:37:53,359 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:37:53,359 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:37:53,360 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:37:58,428 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:37:58,429 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:37:58,429 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:03,478 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:03,478 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:03,479 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:08,532 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:08,533 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:08,533 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:13,595 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:13,595 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:13,595 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:18,650 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:18,650 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:18,650 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:23,702 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:23,702 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:23,702 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:28,755 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:28,755 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:28,755 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:28,755 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-10766785': 0, 'ctest-pod-86575130': 0}
2025-09-25 01:38:28,820 - DEBUG - [Pod ctest-pod-62656396] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-10766785
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:38:28,820 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:38:28,820 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd output: ctest-pod-10766785
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:38:28,879 - DEBUG - [Pod ctest-pod-62656396] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:38:28,880 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:38:28,880 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:38:28,880 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10766785': 1, 'ctest-pod-86575130': 1}
2025-09-25 01:38:33,929 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:33,929 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:33,929 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:38,983 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:38,983 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:38,983 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:44,035 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:44,035 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:44,035 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:49,082 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:49,082 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:49,082 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:54,134 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:54,134 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:54,135 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:59,191 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:59,192 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:38:59,192 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:04,239 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:04,239 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:04,239 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:09,292 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:09,293 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:09,293 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:14,347 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:14,347 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:14,347 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:19,402 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:19,402 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:19,402 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:19,402 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-10766785': 0, 'ctest-pod-86575130': 0}
2025-09-25 01:39:21,454 - DEBUG - [Pod ctest-pod-62656396] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.008 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.109 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.086/0.401/1.008 ms
2025-09-25 01:39:21,455 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-62656396 with expectation True passed
2025-09-25 01:39:23,506 - DEBUG - [Pod ctest-pod-43907752] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.487 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.095 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.552/1.487 ms
2025-09-25 01:39:23,506 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-43907752 with expectation True passed
2025-09-25 01:39:25,557 - DEBUG - [Pod ctest-pod-19989554] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.439 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.204/0.439 ms
2025-09-25 01:39:25,558 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-19989554 with expectation True passed
2025-09-25 01:39:25,616 - DEBUG - [Pod ctest-pod-62656396] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:39:25,616 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-09-25 01:39:25,616 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:39:25,616 - INFO - wget check of of http://10.47.255.251 from ctest-pod-62656396 passed
2025-09-25 01:39:25,668 - DEBUG - [Pod ctest-pod-62656396] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:39:25,668 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-09-25 01:39:25,668 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:39:25,668 - INFO - wget check of of http://10.47.255.250 from ctest-pod-62656396 passed
2025-09-25 01:39:30,719 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-25 01:39:30,719 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-25 01:39:30,719 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-25 01:39:30,719 - INFO - wget check of of http://10.47.255.250 from ctest-pod-43907752 passed
2025-09-25 01:39:35,776 - DEBUG - [Pod ctest-pod-09410854] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-09-25 01:39:35,777 - DEBUG - [Pod Pod ctest-pod-09410854] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-09-25 01:39:35,777 - DEBUG - [Pod Pod ctest-pod-09410854] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
wget: download timed out
2025-09-25 01:39:35,777 - INFO - wget check of of http://10.47.255.251 from ctest-pod-09410854 passed
2025-09-25 01:39:35,794 - INFO - Updating Network Policy ingress-on-service
2025-09-25 01:39:40,858 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:40,858 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:40,858 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:45,907 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:45,907 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:45,907 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:50,962 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:50,962 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:50,962 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:56,019 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:56,019 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:39:56,019 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:01,080 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:01,080 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:01,080 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:06,131 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:06,131 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:06,131 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:11,191 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:11,191 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:11,191 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:16,246 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:16,246 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:16,246 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:21,306 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:21,306 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:21,306 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:26,359 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:26,359 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:26,359 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
wget: download timed out
2025-09-25 01:40:26,359 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-10766785': 0, 'ctest-pod-86575130': 0}
2025-09-25 01:40:26,412 - DEBUG - [Pod ctest-pod-62656396] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-10766785
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:40:26,412 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:40:26,412 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd output: ctest-pod-10766785
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:40:26,469 - DEBUG - [Pod ctest-pod-62656396] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-10766785
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:40:26,469 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:40:26,469 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd output: ctest-pod-10766785
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:40:26,520 - DEBUG - [Pod ctest-pod-62656396] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:40:26,520 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:40:26,520 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:40:26,520 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10766785': 2, 'ctest-pod-86575130': 1}
2025-09-25 01:40:26,576 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:40:26,576 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:40:26,576 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:40:26,631 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:40:26,632 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:40:26,632 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: ctest-pod-86575130
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:40:26,684 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-86575130
2025-09-25 01:40:26,684 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:40:26,684 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-86575130
2025-09-25 01:40:26,736 - DEBUG - [Pod ctest-pod-19989554] Cmd: wget http://10.110.9.69:80/ -O - -T 5 -t 1 , Output: ctest-pod-10766785
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:40:26,737 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd wget http://10.110.9.69:80/ -O - -T 5 -t 1 passed
2025-09-25 01:40:26,737 - DEBUG - [Pod Pod ctest-pod-19989554] Cmd output: ctest-pod-10766785
Connecting to 10.110.9.69:80 (10.110.9.69:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:40:26,737 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-10766785': 1, 'ctest-pod-86575130': 3}
2025-09-25 01:40:28,790 - DEBUG - [Pod ctest-pod-62656396] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes
64 bytes from 10.47.255.247: seq=0 ttl=63 time=0.493 ms
64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.078 ms
64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.098 ms
--- 10.47.255.247 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.078/0.223/0.493 ms
2025-09-25 01:40:28,791 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-62656396 with expectation True passed
2025-09-25 01:40:30,842 - DEBUG - [Pod ctest-pod-43907752] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.301 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.086 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.106 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.086/0.497/1.301 ms
2025-09-25 01:40:30,843 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-43907752 with expectation True passed
2025-09-25 01:40:32,903 - DEBUG - [Pod ctest-pod-19989554] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.012 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.097 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.110 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.097/0.406/1.012 ms
2025-09-25 01:40:32,904 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-19989554 with expectation True passed
2025-09-25 01:40:32,958 - DEBUG - [Pod ctest-pod-62656396] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:40:32,958 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-09-25 01:40:32,958 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:40:32,958 - INFO - wget check of of http://10.47.255.251 from ctest-pod-62656396 passed
2025-09-25 01:40:33,006 - DEBUG - [Pod ctest-pod-62656396] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:40:33,006 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-09-25 01:40:33,007 - DEBUG - [Pod Pod ctest-pod-62656396] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:40:33,007 - INFO - wget check of of http://10.47.255.250 from ctest-pod-62656396 passed
2025-09-25 01:40:38,054 - DEBUG - [Pod ctest-pod-43907752] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-25 01:40:38,054 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-25 01:40:38,055 - DEBUG - [Pod Pod ctest-pod-43907752] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-25 01:40:38,055 - INFO - wget check of of http://10.47.255.250 from ctest-pod-43907752 passed
2025-09-25 01:40:38,112 - DEBUG - [Pod ctest-pod-09410854] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:40:38,112 - DEBUG - [Pod Pod ctest-pod-09410854] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed
2025-09-25 01:40:38,112 - DEBUG - [Pod Pod ctest-pod-09410854] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:40:38,112 - INFO - wget check of of http://10.47.255.251 from ctest-pod-09410854 passed
2025-09-25 01:40:38,112 - INFO - Deleting Network Policy : ingress-on-service
2025-09-25 01:40:38,112 - INFO - Deleting service : ctest-nginx-svc-71908597
2025-09-25 01:40:38,341 - DEBUG - No XMPP flaps were noticed during the test
2025-09-25 01:40:38,341 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:04]
2025-09-25 01:40:38,341 - INFO - --------------------------------------------------------------------------------
2025-09-25 01:40:38,345 - INFO - Deleting pod ctest-new-default-14158848:ctest-pod-10766785
2025-09-25 01:40:38,345 - INFO - Deleting pod ctest-new-default-14158848:ctest-pod-86575130
2025-09-25 01:40:38,346 - INFO - Deleting pod ctest-non-default-18636157:ctest-pod-38514088
2025-09-25 01:40:38,346 - INFO - Deleting pod ctest-non-default-18636157:ctest-pod-70866797
2025-09-25 01:40:38,346 - INFO - Deleting pod ctest-new-default-14158848:ctest-pod-43907752
2025-09-25 01:40:38,346 - INFO - Deleting pod ctest-new-default-14158848:ctest-pod-62656396
2025-09-25 01:40:38,347 - INFO - Deleting pod ctest-non-default-18636157:ctest-pod-19989554
2025-09-25 01:40:38,347 - INFO - Deleting pod ctest-non-default-18636157:ctest-pod-09410854
2025-09-25 01:40:38,462 - WARNING - Pod uuid 0a736bf9-f7a5-45d7-b794-c2f3ac3242de is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:38,465 - WARNING - Pod uuid 625ad9b1-44ae-464a-9dcc-e2ada58ac231 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:38,466 - WARNING - Pod uuid b3dd19a0-70f4-42a0-9544-6248f00fe11a is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:38,500 - WARNING - Pod uuid 2d449ff4-384a-49a7-89a6-44bdd1edfe04 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:38,501 - WARNING - Pod uuid 41fedabb-33b6-4e6e-9eb3-2581cce977d7 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:38,503 - WARNING - Pod uuid 8e9ac253-0893-4b7f-95c9-63cd0bc5d0fd is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:38,503 - WARNING - Pod uuid 40be8114-af1f-4fc3-9b0e-ff384c2563aa is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:38,504 - WARNING - Pod uuid 8f45bcd2-be8d-400e-b48b-6537685ab664 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:43,471 - WARNING - Pod uuid 0a736bf9-f7a5-45d7-b794-c2f3ac3242de is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:43,473 - DEBUG - Pod 625ad9b1-44ae-464a-9dcc-e2ada58ac231 is not in agent 10.0.0.22 VM list
2025-09-25 01:40:43,475 - WARNING - Pod uuid b3dd19a0-70f4-42a0-9544-6248f00fe11a is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:43,479 - DEBUG - VMI 29fefbb8-99b0-11f0-91be-fa163e650e71 is removed from agent 10.0.0.22
2025-09-25 01:40:43,479 - INFO - Verified that pod ctest-pod-10766785 is removed in agent
2025-09-25 01:40:43,516 - WARNING - Pod uuid 8f45bcd2-be8d-400e-b48b-6537685ab664 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:43,516 - WARNING - Pod uuid 8e9ac253-0893-4b7f-95c9-63cd0bc5d0fd is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:43,516 - DEBUG - Pod 2d449ff4-384a-49a7-89a6-44bdd1edfe04 is not in agent 10.0.0.22 VM list
2025-09-25 01:40:43,518 - DEBUG - Pod 40be8114-af1f-4fc3-9b0e-ff384c2563aa is not in agent 10.0.0.22 VM list
2025-09-25 01:40:43,519 - WARNING - Pod uuid 41fedabb-33b6-4e6e-9eb3-2581cce977d7 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:43,525 - DEBUG - VMI 2b02edc6-99b0-11f0-91be-fa163e650e71 is removed from agent 10.0.0.22
2025-09-25 01:40:43,525 - INFO - Verified that pod ctest-pod-38514088 is removed in agent
2025-09-25 01:40:43,525 - DEBUG - VMI 2b741938-99b0-11f0-91be-fa163e650e71 is removed from agent 10.0.0.22
2025-09-25 01:40:43,525 - INFO - Verified that pod ctest-pod-70866797 is removed in agent
2025-09-25 01:40:48,480 - WARNING - Pod uuid 0a736bf9-f7a5-45d7-b794-c2f3ac3242de is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:48,481 - WARNING - Pod uuid b3dd19a0-70f4-42a0-9544-6248f00fe11a is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:48,527 - WARNING - Pod uuid 8e9ac253-0893-4b7f-95c9-63cd0bc5d0fd is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:48,527 - WARNING - Pod uuid 8f45bcd2-be8d-400e-b48b-6537685ab664 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:48,528 - WARNING - Pod uuid 41fedabb-33b6-4e6e-9eb3-2581cce977d7 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:53,494 - WARNING - Pod uuid 0a736bf9-f7a5-45d7-b794-c2f3ac3242de is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:53,494 - WARNING - Pod uuid b3dd19a0-70f4-42a0-9544-6248f00fe11a is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:53,541 - WARNING - Pod uuid 8f45bcd2-be8d-400e-b48b-6537685ab664 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:53,544 - WARNING - Pod uuid 8e9ac253-0893-4b7f-95c9-63cd0bc5d0fd is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:53,545 - WARNING - Pod uuid 41fedabb-33b6-4e6e-9eb3-2581cce977d7 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:58,507 - WARNING - Pod uuid 0a736bf9-f7a5-45d7-b794-c2f3ac3242de is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:58,508 - WARNING - Pod uuid b3dd19a0-70f4-42a0-9544-6248f00fe11a is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:58,549 - WARNING - Pod uuid 8f45bcd2-be8d-400e-b48b-6537685ab664 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:58,555 - WARNING - Pod uuid 8e9ac253-0893-4b7f-95c9-63cd0bc5d0fd is still seen in agent 10.0.0.22 VM list
2025-09-25 01:40:58,557 - WARNING - Pod uuid 41fedabb-33b6-4e6e-9eb3-2581cce977d7 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:41:03,521 - WARNING - Pod uuid b3dd19a0-70f4-42a0-9544-6248f00fe11a is still seen in agent 10.0.0.22 VM list
2025-09-25 01:41:03,522 - WARNING - Pod uuid 0a736bf9-f7a5-45d7-b794-c2f3ac3242de is still seen in agent 10.0.0.22 VM list
2025-09-25 01:41:03,562 - WARNING - Pod uuid 8f45bcd2-be8d-400e-b48b-6537685ab664 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:41:03,566 - WARNING - Pod uuid 8e9ac253-0893-4b7f-95c9-63cd0bc5d0fd is still seen in agent 10.0.0.22 VM list
2025-09-25 01:41:03,567 - WARNING - Pod uuid 41fedabb-33b6-4e6e-9eb3-2581cce977d7 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:41:08,548 - WARNING - Pod uuid 0a736bf9-f7a5-45d7-b794-c2f3ac3242de is still seen in agent 10.0.0.22 VM list
2025-09-25 01:41:08,548 - WARNING - Pod uuid b3dd19a0-70f4-42a0-9544-6248f00fe11a is still seen in agent 10.0.0.22 VM list
2025-09-25 01:41:08,570 - WARNING - Pod uuid 8f45bcd2-be8d-400e-b48b-6537685ab664 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:41:08,577 - WARNING - Pod uuid 41fedabb-33b6-4e6e-9eb3-2581cce977d7 is still seen in agent 10.0.0.22 VM list
2025-09-25 01:41:08,577 - WARNING - Pod uuid 8e9ac253-0893-4b7f-95c9-63cd0bc5d0fd is still seen in agent 10.0.0.22 VM list
2025-09-25 01:41:13,557 - DEBUG - Pod b3dd19a0-70f4-42a0-9544-6248f00fe11a is not in agent 10.0.0.22 VM list
2025-09-25 01:41:13,562 - DEBUG - Pod 0a736bf9-f7a5-45d7-b794-c2f3ac3242de is not in agent 10.0.0.22 VM list
2025-09-25 01:41:13,569 - DEBUG - VMI 2a700b82-99b0-11f0-91be-fa163e650e71 is removed from agent 10.0.0.22
2025-09-25 01:41:13,569 - INFO - Verified that pod ctest-pod-86575130 is removed in agent
2025-09-25 01:41:13,570 - DEBUG - VMI 2ccbf314-99b0-11f0-91be-fa163e650e71 is removed from agent 10.0.0.22
2025-09-25 01:41:13,571 - INFO - Verified that pod ctest-pod-19989554 is removed in agent
2025-09-25 01:41:13,575 - DEBUG - Pod 8f45bcd2-be8d-400e-b48b-6537685ab664 is not in agent 10.0.0.22 VM list
2025-09-25 01:41:13,581 - DEBUG - VMI 2bed047e-99b0-11f0-91be-fa163e650e71 is removed from agent 10.0.0.22
2025-09-25 01:41:13,581 - INFO - Verified that pod ctest-pod-43907752 is removed in agent
2025-09-25 01:41:13,587 - DEBUG - Pod 41fedabb-33b6-4e6e-9eb3-2581cce977d7 is not in agent 10.0.0.22 VM list
2025-09-25 01:41:13,588 - DEBUG - Pod 8e9ac253-0893-4b7f-95c9-63cd0bc5d0fd is not in agent 10.0.0.22 VM list
2025-09-25 01:41:13,596 - DEBUG - VMI 2c575798-99b0-11f0-91be-fa163e650e71 is removed from agent 10.0.0.22
2025-09-25 01:41:13,596 - INFO - Verified that pod ctest-pod-62656396 is removed in agent
2025-09-25 01:41:13,596 - DEBUG - VMI 2d3c4830-99b0-11f0-91be-fa163e650e71 is removed from agent 10.0.0.22
2025-09-25 01:41:13,597 - INFO - Verified that pod ctest-pod-09410854 is removed in agent
2025-09-25 01:41:13,597 - INFO - Deleting namespace ctest-non-default-18636157
2025-09-25 01:41:13,612 - DEBUG - Namespace ctest-non-default-18636157 still in k8s
2025-09-25 01:41:15,616 - DEBUG - Namespace ctest-non-default-18636157 still in k8s
2025-09-25 01:41:17,623 - DEBUG - Namespace ctest-non-default-18636157 still in k8s
2025-09-25 01:41:19,629 - DEBUG - Namespace ctest-non-default-18636157 is not in k8s
2025-09-25 01:41:19,629 - DEBUG - No need to check project deletion in contrail-api
2025-09-25 01:41:19,629 - INFO - Deleting namespace ctest-new-default-14158848
2025-09-25 01:41:19,649 - DEBUG - Namespace ctest-new-default-14158848 still in k8s
2025-09-25 01:41:21,654 - DEBUG - Namespace ctest-new-default-14158848 still in k8s
2025-09-25 01:41:23,666 - DEBUG - Namespace ctest-new-default-14158848 still in k8s
2025-09-25 01:41:25,669 - DEBUG - Namespace ctest-new-default-14158848 is not in k8s
2025-09-25 01:41:25,669 - DEBUG - No need to check project deletion in contrail-api