2025-09-25 01:23:37,461 - INFO - Using existing project ['default-domain', 'k8s-default'](f5fdc19a-2b96-4f1d-9663-531520d367f8)
2025-09-25 01:23:37,482 - DEBUG - Namespace ctest-new-default-04899317 not present
2025-09-25 01:23:37,488 - INFO - Created namespace ctest-new-default-04899317
2025-09-25 01:23:40,493 - DEBUG - Namespace ctest-non-default-04317751 not present
2025-09-25 01:23:40,500 - INFO - Created namespace ctest-non-default-04317751
2025-09-25 01:23:43,517 - DEBUG - Pod ctest-pod-26639544 not present
2025-09-25 01:23:43,518 - INFO - Creating Pod ctest-pod-26639544
2025-09-25 01:23:43,543 - DEBUG - Pod : ctest-pod-26639544 UUID is 7499298a-6577-4e39-b1fd-3c4387a15fac
2025-09-25 01:23:43,549 - DEBUG - Pod ctest-pod-72201957 not present
2025-09-25 01:23:43,549 - INFO - Creating Pod ctest-pod-72201957
2025-09-25 01:23:43,576 - DEBUG - Pod : ctest-pod-72201957 UUID is 2895c6d4-14c9-486e-b123-b0bbe6edc0d1
2025-09-25 01:23:43,586 - DEBUG - Pod ctest-pod-85377725 not present
2025-09-25 01:23:43,586 - INFO - Creating Pod ctest-pod-85377725
2025-09-25 01:23:43,623 - DEBUG - Pod : ctest-pod-85377725 UUID is 58f41c7d-f1a8-43c1-8d68-08f16d5cd0f7
2025-09-25 01:23:43,628 - DEBUG - Pod ctest-pod-40287959 not present
2025-09-25 01:23:43,628 - INFO - Creating Pod ctest-pod-40287959
2025-09-25 01:23:43,647 - DEBUG - Pod : ctest-pod-40287959 UUID is 1671ae70-acf4-4bd1-9c3a-ec22293fc092
2025-09-25 01:23:43,651 - DEBUG - Pod ctest-pod-11194382 not present
2025-09-25 01:23:43,652 - INFO - Creating Pod ctest-pod-11194382
2025-09-25 01:23:43,675 - DEBUG - Pod : ctest-pod-11194382 UUID is c05aa5e7-081d-43e9-add1-49dffc5efcdd
2025-09-25 01:23:43,682 - DEBUG - Pod ctest-pod-13689507 not present
2025-09-25 01:23:43,682 - INFO - Creating Pod ctest-pod-13689507
2025-09-25 01:23:43,706 - DEBUG - Pod : ctest-pod-13689507 UUID is 84d2b697-d945-453a-9eb3-00091eddf2d1
2025-09-25 01:23:43,711 - DEBUG - Pod ctest-pod-47923012 not present
2025-09-25 01:23:43,711 - INFO - Creating Pod ctest-pod-47923012
2025-09-25 01:23:43,729 - DEBUG - Pod : ctest-pod-47923012 UUID is 2932d5f4-ba73-4783-a8c5-eac2c4bb08b9
2025-09-25 01:23:43,734 - DEBUG - Pod ctest-pod-64823220 not present
2025-09-25 01:23:43,734 - INFO - Creating Pod ctest-pod-64823220
2025-09-25 01:23:43,754 - DEBUG - Pod : ctest-pod-64823220 UUID is 6729be51-a55a-4bc8-8add-04e5398b54b1
2025-09-25 01:23:44,014 - INFO - Project default-domain:k8s-ctest-new-default-04899317 for Namespace ctest-new-default-04899317 is seen in contrail-api
2025-09-25 01:23:44,014 - DEBUG - Project uuid in Contrail is 76505653-ee2c-4c39-abf7-5be9ae864a60
2025-09-25 01:23:44,174 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=e77b6680-862a-4a91-954a-fced24b102cb
2025-09-25 01:23:44,178 - INFO - Namespace ctest-new-default-04899317 with uuid e77b6680-862a-4a91-954a-fced24b102cb found in kube manager
2025-09-25 01:23:44,178 - INFO - Namespace ctest-new-default-04899317 verification passed
2025-09-25 01:23:44,540 - INFO - Project default-domain:k8s-ctest-non-default-04317751 for Namespace ctest-non-default-04317751 is seen in contrail-api
2025-09-25 01:23:44,540 - DEBUG - Project uuid in Contrail is 4c84c77b-5b26-46c9-8412-83f43c2d9ead
2025-09-25 01:23:44,540 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NamespaceDatabaseList?namespace_uuid=c6317973-8982-4187-9650-cf4b3cd18368
2025-09-25 01:23:44,548 - INFO - Namespace ctest-non-default-04317751 with uuid c6317973-8982-4187-9650-cf4b3cd18368 found in kube manager
2025-09-25 01:23:44,548 - INFO - Namespace ctest-non-default-04317751 verification passed
2025-09-25 01:23:44,562 - DEBUG - Pod ctest-pod-26639544 not in running state.Currently in Pending
2025-09-25 01:23:49,569 - DEBUG - Pod ctest-pod-26639544 not in running state.Currently in Pending
2025-09-25 01:23:54,576 - DEBUG - Pod ctest-pod-26639544 not in running state.Currently in Pending
2025-09-25 01:23:59,583 - INFO - Pod ctest-pod-26639544 is in running state.Got IP 10.47.255.250
2025-09-25 01:23:59,634 - DEBUG - Pod ctest-pod-26639544 has vmi 48720cf4-99ae-11f0-a653-02424d755861
2025-09-25 01:23:59,634 - INFO - Verified pod ctest-pod-26639544 in contrail-api
2025-09-25 01:23:59,646 - DEBUG - VMI 48720cf4-99ae-11f0-a653-02424d755861 is active in agent 10.0.0.48
2025-09-25 01:23:59,646 - INFO - Verified Pod ctest-pod-26639544 in agent 10.0.0.48
2025-09-25 01:23:59,646 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=7499298a-6577-4e39-b1fd-3c4387a15fac
2025-09-25 01:23:59,650 - INFO - Pod ctest-pod-26639544 with uuid 7499298a-6577-4e39-b1fd-3c4387a15fac found in kube manager
2025-09-25 01:23:59,650 - INFO - Pod ctest-pod-26639544 verification passed
2025-09-25 01:23:59,659 - INFO - Pod ctest-pod-72201957 is in running state.Got IP 10.47.255.249
2025-09-25 01:23:59,751 - DEBUG - Pod ctest-pod-72201957 has vmi 4924f63e-99ae-11f0-a653-02424d755861
2025-09-25 01:23:59,751 - INFO - Verified pod ctest-pod-72201957 in contrail-api
2025-09-25 01:23:59,759 - DEBUG - VMI 4924f63e-99ae-11f0-a653-02424d755861 is active in agent 10.0.0.48
2025-09-25 01:23:59,760 - INFO - Verified Pod ctest-pod-72201957 in agent 10.0.0.48
2025-09-25 01:23:59,760 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=2895c6d4-14c9-486e-b123-b0bbe6edc0d1
2025-09-25 01:23:59,763 - INFO - Pod ctest-pod-72201957 with uuid 2895c6d4-14c9-486e-b123-b0bbe6edc0d1 found in kube manager
2025-09-25 01:23:59,763 - INFO - Pod ctest-pod-72201957 verification passed
2025-09-25 01:23:59,769 - INFO - Pod ctest-pod-85377725 is in running state.Got IP 10.47.255.248
2025-09-25 01:23:59,862 - DEBUG - Pod ctest-pod-85377725 has vmi 4a13d1aa-99ae-11f0-a653-02424d755861
2025-09-25 01:23:59,862 - INFO - Verified pod ctest-pod-85377725 in contrail-api
2025-09-25 01:23:59,871 - DEBUG - VMI 4a13d1aa-99ae-11f0-a653-02424d755861 is active in agent 10.0.0.48
2025-09-25 01:23:59,871 - INFO - Verified Pod ctest-pod-85377725 in agent 10.0.0.48
2025-09-25 01:23:59,871 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=58f41c7d-f1a8-43c1-8d68-08f16d5cd0f7
2025-09-25 01:23:59,875 - INFO - Pod ctest-pod-85377725 with uuid 58f41c7d-f1a8-43c1-8d68-08f16d5cd0f7 found in kube manager
2025-09-25 01:23:59,875 - INFO - Pod ctest-pod-85377725 verification passed
2025-09-25 01:23:59,881 - DEBUG - Pod ctest-pod-40287959 not in running state.Currently in Pending
2025-09-25 01:24:04,889 - INFO - Pod ctest-pod-40287959 is in running state.Got IP 10.47.255.247
2025-09-25 01:24:04,942 - DEBUG - Pod ctest-pod-40287959 has vmi 4ac314b2-99ae-11f0-a653-02424d755861
2025-09-25 01:24:04,942 - INFO - Verified pod ctest-pod-40287959 in contrail-api
2025-09-25 01:24:04,953 - DEBUG - VMI 4ac314b2-99ae-11f0-a653-02424d755861 is active in agent 10.0.0.48
2025-09-25 01:24:04,954 - INFO - Verified Pod ctest-pod-40287959 in agent 10.0.0.48
2025-09-25 01:24:04,954 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=1671ae70-acf4-4bd1-9c3a-ec22293fc092
2025-09-25 01:24:04,958 - INFO - Pod ctest-pod-40287959 with uuid 1671ae70-acf4-4bd1-9c3a-ec22293fc092 found in kube manager
2025-09-25 01:24:04,958 - INFO - Pod ctest-pod-40287959 verification passed
2025-09-25 01:24:04,967 - INFO - Pod ctest-pod-11194382 is in running state.Got IP 10.47.255.246
2025-09-25 01:24:05,060 - DEBUG - Pod ctest-pod-11194382 has vmi 4bb2d272-99ae-11f0-a653-02424d755861
2025-09-25 01:24:05,060 - INFO - Verified pod ctest-pod-11194382 in contrail-api
2025-09-25 01:24:05,074 - DEBUG - VMI 4bb2d272-99ae-11f0-a653-02424d755861 is active in agent 10.0.0.48
2025-09-25 01:24:05,074 - INFO - Verified Pod ctest-pod-11194382 in agent 10.0.0.48
2025-09-25 01:24:05,074 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=c05aa5e7-081d-43e9-add1-49dffc5efcdd
2025-09-25 01:24:05,078 - INFO - Pod ctest-pod-11194382 with uuid c05aa5e7-081d-43e9-add1-49dffc5efcdd found in kube manager
2025-09-25 01:24:05,078 - INFO - Pod ctest-pod-11194382 verification passed
2025-09-25 01:24:05,085 - DEBUG - Pod ctest-pod-47923012 not in running state.Currently in Pending
2025-09-25 01:24:10,094 - INFO - Pod ctest-pod-47923012 is in running state.Got IP 10.47.255.244
2025-09-25 01:24:10,147 - DEBUG - Pod ctest-pod-47923012 has vmi 4d4790c8-99ae-11f0-a653-02424d755861
2025-09-25 01:24:10,147 - INFO - Verified pod ctest-pod-47923012 in contrail-api
2025-09-25 01:24:10,158 - DEBUG - VMI 4d4790c8-99ae-11f0-a653-02424d755861 is active in agent 10.0.0.48
2025-09-25 01:24:10,158 - INFO - Verified Pod ctest-pod-47923012 in agent 10.0.0.48
2025-09-25 01:24:10,158 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=2932d5f4-ba73-4783-a8c5-eac2c4bb08b9
2025-09-25 01:24:10,161 - INFO - Pod ctest-pod-47923012 with uuid 2932d5f4-ba73-4783-a8c5-eac2c4bb08b9 found in kube manager
2025-09-25 01:24:10,162 - INFO - Pod ctest-pod-47923012 verification passed
2025-09-25 01:24:10,168 - INFO - Pod ctest-pod-13689507 is in running state.Got IP 10.47.255.245
2025-09-25 01:24:10,260 - DEBUG - Pod ctest-pod-13689507 has vmi 4c852650-99ae-11f0-a653-02424d755861
2025-09-25 01:24:10,260 - INFO - Verified pod ctest-pod-13689507 in contrail-api
2025-09-25 01:24:10,272 - DEBUG - VMI 4c852650-99ae-11f0-a653-02424d755861 is active in agent 10.0.0.48
2025-09-25 01:24:10,272 - INFO - Verified Pod ctest-pod-13689507 in agent 10.0.0.48
2025-09-25 01:24:10,272 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=84d2b697-d945-453a-9eb3-00091eddf2d1
2025-09-25 01:24:10,276 - INFO - Pod ctest-pod-13689507 with uuid 84d2b697-d945-453a-9eb3-00091eddf2d1 found in kube manager
2025-09-25 01:24:10,276 - INFO - Pod ctest-pod-13689507 verification passed
2025-09-25 01:24:10,282 - INFO - Pod ctest-pod-64823220 is in running state.Got IP 10.47.255.243
2025-09-25 01:24:10,375 - DEBUG - Pod ctest-pod-64823220 has vmi 4e0dfbc8-99ae-11f0-a653-02424d755861
2025-09-25 01:24:10,375 - INFO - Verified pod ctest-pod-64823220 in contrail-api
2025-09-25 01:24:10,384 - DEBUG - VMI 4e0dfbc8-99ae-11f0-a653-02424d755861 is active in agent 10.0.0.48
2025-09-25 01:24:10,384 - INFO - Verified Pod ctest-pod-64823220 in agent 10.0.0.48
2025-09-25 01:24:10,384 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_VirtualMachineDatabaseList?x=6729be51-a55a-4bc8-8add-04e5398b54b1
2025-09-25 01:24:10,388 - INFO - Pod ctest-pod-64823220 with uuid 6729be51-a55a-4bc8-8add-04e5398b54b1 found in kube manager
2025-09-25 01:24:10,388 - INFO - Pod ctest-pod-64823220 verification passed
2025-09-25 01:24:10,388 - INFO - ================================================================================
2025-09-25 01:24:10,388 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service
2025-09-25 01:24:10,388 - INFO - TEST DESCRIPTION :
Verify that ingress rules on a pod work fine when pods are accessed via a service
Steps:
1. Create a service in namespace 1 over a pod which are endpoints of a service
2. Create a network policy to allow 1 pod of namespace 1 as ingress.
3. Verify that service respond correctly to the specified pod in the policy and
service do not respond to anyone else.
4. Extend the policy and add the namespaceselector as namespace 2.
5. Verify that service become accessible to the pods of namespace 2.
2025-09-25 01:24:10,670 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.0.0.48': '1'}} with
2025-09-25 01:24:10,671 - INFO - Initial checks done. Running the testcase now
2025-09-25 01:24:10,671 - INFO -
2025-09-25 01:24:10,736 - DEBUG - [Pod ctest-pod-26639544] Cmd: echo ctest-pod-26639544 > /usr/share/nginx/html/index.html, Output:
2025-09-25 01:24:10,803 - DEBUG - [Pod ctest-pod-72201957] Cmd: echo ctest-pod-72201957 > /usr/share/nginx/html/index.html, Output:
2025-09-25 01:24:10,879 - DEBUG - [Pod ctest-pod-85377725] Cmd: echo ctest-pod-85377725 > /usr/share/nginx/html/index.html, Output:
2025-09-25 01:24:10,946 - DEBUG - [Pod ctest-pod-40287959] Cmd: echo ctest-pod-40287959 > /usr/share/nginx/html/index.html, Output:
2025-09-25 01:24:10,949 - DEBUG - Service ctest-nginx-svc-79147782 not present
2025-09-25 01:24:10,950 - INFO - Creating service ctest-nginx-svc-79147782
2025-09-25 01:24:10,966 - INFO - Created Service ctest-nginx-svc-79147782
2025-09-25 01:24:10,974 - WARNING - Service UUID 37954317-ecb3-4cd4-866f-62a7b82879ee not yet found in contrail-api
2025-09-25 01:24:11,980 - INFO - Validated that Service ctest-nginx-svc-79147782 is seen in contrail-api
2025-09-25 01:24:11,980 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_LoadbalancerDatabaseList?x=37954317-ecb3-4cd4-866f-62a7b82879ee
2025-09-25 01:24:11,983 - INFO - Service ctest-nginx-svc-79147782 with uuid 37954317-ecb3-4cd4-866f-62a7b82879ee found in kube manager
2025-09-25 01:24:11,983 - INFO - Service ctest-nginx-svc-79147782 verification passed
2025-09-25 01:24:13,078 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
ctest-pod-72201957
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:24:13,078 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:24:13,078 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
ctest-pod-72201957
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:24:13,163 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26639544
2025-09-25 01:24:13,163 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:24:13,163 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26639544
2025-09-25 01:24:13,163 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-26639544': 1, 'ctest-pod-72201957': 1}
2025-09-25 01:24:13,248 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26639544
2025-09-25 01:24:13,248 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:24:13,248 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26639544
2025-09-25 01:24:13,319 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26639544
2025-09-25 01:24:13,319 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:24:13,319 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26639544
2025-09-25 01:24:13,382 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26639544
2025-09-25 01:24:13,382 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:24:13,382 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26639544
2025-09-25 01:24:13,447 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
ctest-pod-72201957
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:24:13,447 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:24:13,447 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
ctest-pod-72201957
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:24:13,447 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-26639544': 3, 'ctest-pod-72201957': 1}
2025-09-25 01:24:13,450 - DEBUG - Network policy ingress-on-service not present
2025-09-25 01:24:13,451 - INFO - Creating Network Policy ingress-on-service
2025-09-25 01:24:13,463 - INFO - Network policy found in k8s
2025-09-25 01:24:13,463 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f60faf2f-4a7c-4099-b701-3fd487ecfcc2
2025-09-25 01:24:13,468 - INFO - Network Policy ingress-on-service with uuid f60faf2f-4a7c-4099-b701-3fd487ecfcc2 found in kube manager
2025-09-25 01:24:13,493 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent
2025-09-25 01:24:13,493 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8
2025-09-25 01:24:13,493 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f60faf2f-4a7c-4099-b701-3fd487ecfcc2
2025-09-25 01:24:13,516 - WARNING - Network policy with name ingress-on-service not found in agent
2025-09-25 01:24:15,517 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f60faf2f-4a7c-4099-b701-3fd487ecfcc2
2025-09-25 01:24:15,536 - WARNING - Network policy with name ingress-on-service not found in agent
2025-09-25 01:24:17,537 - DEBUG - Requesting: http://10.0.0.48:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=f60faf2f-4a7c-4099-b701-3fd487ecfcc2
2025-09-25 01:24:17,558 - INFO - Network policy with name ingress-on-service found in agent
2025-09-25 01:24:17,558 - INFO - Network Policy ingress-on-service verification passed
2025-09-25 01:24:22,624 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:22,624 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:22,624 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:27,726 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:27,726 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:27,726 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:32,792 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:32,792 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:32,792 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:37,862 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:37,862 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:37,862 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:42,954 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:42,954 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:42,954 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:48,033 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:48,033 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:48,033 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:53,099 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:53,099 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:53,099 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:58,178 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:58,178 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:24:58,178 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:03,258 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:03,258 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:03,258 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:08,324 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:08,324 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:08,324 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:08,324 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-26639544': 0, 'ctest-pod-72201957': 0}
2025-09-25 01:25:08,410 - DEBUG - [Pod ctest-pod-13689507] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
ctest-pod-26639544
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:25:08,410 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:25:08,411 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
ctest-pod-26639544
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:25:08,484 - DEBUG - [Pod ctest-pod-13689507] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-72201957
Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:25:08,484 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:25:08,484 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd output: ctest-pod-72201957
Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:25:08,484 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-26639544': 1, 'ctest-pod-72201957': 1}
2025-09-25 01:25:13,547 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:13,547 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:13,547 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:18,623 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:18,623 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:18,623 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:23,687 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:23,687 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:23,687 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:28,761 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:28,761 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:28,761 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:33,822 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:33,822 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:33,822 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:38,898 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:38,899 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:38,899 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:44,086 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:44,086 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:44,086 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:49,175 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:49,175 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:49,175 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:54,245 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:54,245 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:54,245 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:59,313 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:59,313 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:59,313 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:25:59,313 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-26639544': 0, 'ctest-pod-72201957': 0}
2025-09-25 01:26:01,384 - DEBUG - [Pod ctest-pod-13689507] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.667 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.087 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.070 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.274/0.667 ms
2025-09-25 01:26:01,384 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-13689507 with expectation True passed
2025-09-25 01:26:03,455 - DEBUG - [Pod ctest-pod-11194382] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.662 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.064 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.103 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.064/0.276/0.662 ms
2025-09-25 01:26:03,455 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-11194382 with expectation True passed
2025-09-25 01:26:05,533 - DEBUG - [Pod ctest-pod-47923012] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.328 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.070 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.070/0.490/1.328 ms
2025-09-25 01:26:05,533 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-47923012 with expectation True passed
2025-09-25 01:26:05,599 - DEBUG - [Pod ctest-pod-13689507] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:26:05,599 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-09-25 01:26:05,599 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:26:05,600 - INFO - wget check of of http://10.47.255.250 from ctest-pod-13689507 passed
2025-09-25 01:26:05,711 - DEBUG - [Pod ctest-pod-13689507] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:26:05,711 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2025-09-25 01:26:05,711 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:26:05,711 - INFO - wget check of of http://10.47.255.249 from ctest-pod-13689507 passed
2025-09-25 01:26:10,780 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-09-25 01:26:10,780 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-09-25 01:26:10,780 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-09-25 01:26:10,780 - INFO - wget check of of http://10.47.255.249 from ctest-pod-11194382 passed
2025-09-25 01:26:15,858 - DEBUG - [Pod ctest-pod-64823220] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-25 01:26:15,858 - DEBUG - [Pod Pod ctest-pod-64823220] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-25 01:26:15,858 - DEBUG - [Pod Pod ctest-pod-64823220] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
wget: download timed out
2025-09-25 01:26:15,858 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64823220 passed
2025-09-25 01:26:15,868 - INFO - Updating Network Policy ingress-on-service
2025-09-25 01:26:20,949 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:20,949 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:20,949 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:26,020 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:26,020 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:26,020 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:31,095 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:31,095 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:31,095 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:36,203 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:36,204 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:36,204 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:41,323 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:41,323 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:41,323 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:46,530 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:46,530 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:46,530 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:51,604 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:51,604 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:51,604 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:56,679 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:56,679 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:26:56,679 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:27:01,763 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:27:01,763 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:27:01,763 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:27:06,831 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:27:06,832 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:27:06,832 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
wget: download timed out
2025-09-25 01:27:06,832 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-26639544': 0, 'ctest-pod-72201957': 0}
2025-09-25 01:27:06,900 - DEBUG - [Pod ctest-pod-13689507] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
ctest-pod-26639544
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:27:06,901 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:27:06,901 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
ctest-pod-26639544
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:27:06,975 - DEBUG - [Pod ctest-pod-13689507] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
ctest-pod-26639544
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:27:06,975 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:27:06,975 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
ctest-pod-26639544
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:27:07,046 - DEBUG - [Pod ctest-pod-13689507] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: ctest-pod-26639544
Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:27:07,046 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:27:07,046 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd output: ctest-pod-26639544
Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:27:07,120 - DEBUG - [Pod ctest-pod-13689507] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-72201957
2025-09-25 01:27:07,120 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:27:07,120 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-72201957
2025-09-25 01:27:07,120 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-26639544': 3, 'ctest-pod-72201957': 1}
2025-09-25 01:27:07,192 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
ctest-pod-72201957
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:27:07,192 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:27:07,192 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
ctest-pod-72201957
- 100% |********************************| 19 0:00:00 ETA
written to stdout
2025-09-25 01:27:07,259 - DEBUG - [Pod ctest-pod-47923012] Cmd: wget http://10.103.34.90:80/ -O - -T 5 -t 1 , Output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26639544
2025-09-25 01:27:07,259 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd wget http://10.103.34.90:80/ -O - -T 5 -t 1 passed
2025-09-25 01:27:07,259 - DEBUG - [Pod Pod ctest-pod-47923012] Cmd output: Connecting to 10.103.34.90:80 (10.103.34.90:80)
writing to stdout
- 100% |********************************| 19 0:00:00 ETA
written to stdout
ctest-pod-26639544
2025-09-25 01:27:07,259 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-26639544': 1, 'ctest-pod-72201957': 1}
2025-09-25 01:27:09,332 - DEBUG - [Pod ctest-pod-13689507] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes
64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.472 ms
64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.076 ms
64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms
--- 10.47.255.246 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.076/0.214/0.472 ms
2025-09-25 01:27:09,333 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-13689507 with expectation True passed
2025-09-25 01:27:11,416 - DEBUG - [Pod ctest-pod-11194382] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=0.402 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.071 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.077 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.071/0.183/0.402 ms
2025-09-25 01:27:11,416 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-11194382 with expectation True passed
2025-09-25 01:27:13,483 - DEBUG - [Pod ctest-pod-47923012] Cmd: ping -c 3 10.47.255.245, Output: PING 10.47.255.245 (10.47.255.245): 56 data bytes
64 bytes from 10.47.255.245: seq=0 ttl=63 time=1.745 ms
64 bytes from 10.47.255.245: seq=1 ttl=63 time=0.072 ms
64 bytes from 10.47.255.245: seq=2 ttl=63 time=0.065 ms
--- 10.47.255.245 ping statistics ---
3 packets transmitted, 3 packets received, 0% packet loss
round-trip min/avg/max = 0.065/0.627/1.745 ms
2025-09-25 01:27:13,483 - INFO - Ping check to IP 10.47.255.245 from pod ctest-pod-47923012 with expectation True passed
2025-09-25 01:27:13,555 - DEBUG - [Pod ctest-pod-13689507] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:27:13,555 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-09-25 01:27:13,555 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:27:13,555 - INFO - wget check of of http://10.47.255.250 from ctest-pod-13689507 passed
2025-09-25 01:27:13,631 - DEBUG - [Pod ctest-pod-13689507] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:27:13,631 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 passed
2025-09-25 01:27:13,631 - DEBUG - [Pod Pod ctest-pod-13689507] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:27:13,631 - INFO - wget check of of http://10.47.255.249 from ctest-pod-13689507 passed
2025-09-25 01:27:18,702 - DEBUG - [Pod ctest-pod-11194382] Cmd: wget http://10.47.255.249 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-09-25 01:27:18,702 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd wget http://10.47.255.249 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-09-25 01:27:18,702 - DEBUG - [Pod Pod ctest-pod-11194382] Cmd output: Connecting to 10.47.255.249 (10.47.255.249:80)
wget: download timed out
2025-09-25 01:27:18,702 - INFO - wget check of of http://10.47.255.249 from ctest-pod-11194382 passed
2025-09-25 01:27:18,773 - DEBUG - [Pod ctest-pod-64823220] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:27:18,773 - DEBUG - [Pod Pod ctest-pod-64823220] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed
2025-09-25 01:27:18,773 - DEBUG - [Pod Pod ctest-pod-64823220] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80)
saving to '/dev/null'
null 100% |********************************| 19 0:00:00 ETA
'/dev/null' saved
2025-09-25 01:27:18,774 - INFO - wget check of of http://10.47.255.250 from ctest-pod-64823220 passed
2025-09-25 01:27:18,774 - INFO - Deleting Network Policy : ingress-on-service
2025-09-25 01:27:18,774 - INFO - Deleting service : ctest-nginx-svc-79147782
2025-09-25 01:27:19,327 - DEBUG - No XMPP flaps were noticed during the test
2025-09-25 01:27:19,327 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:09]
2025-09-25 01:27:19,327 - INFO - --------------------------------------------------------------------------------
2025-09-25 01:27:19,332 - INFO - Deleting pod ctest-new-default-04899317:ctest-pod-26639544
2025-09-25 01:27:19,333 - INFO - Deleting pod ctest-new-default-04899317:ctest-pod-72201957
2025-09-25 01:27:19,333 - INFO - Deleting pod ctest-non-default-04317751:ctest-pod-85377725
2025-09-25 01:27:19,334 - INFO - Deleting pod ctest-non-default-04317751:ctest-pod-40287959
2025-09-25 01:27:19,334 - INFO - Deleting pod ctest-new-default-04899317:ctest-pod-11194382
2025-09-25 01:27:19,334 - INFO - Deleting pod ctest-new-default-04899317:ctest-pod-13689507
2025-09-25 01:27:19,335 - INFO - Deleting pod ctest-non-default-04317751:ctest-pod-47923012
2025-09-25 01:27:19,335 - INFO - Deleting pod ctest-non-default-04317751:ctest-pod-64823220
2025-09-25 01:27:19,373 - WARNING - Pod uuid 7499298a-6577-4e39-b1fd-3c4387a15fac is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:19,472 - WARNING - Pod uuid 1671ae70-acf4-4bd1-9c3a-ec22293fc092 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:19,474 - WARNING - Pod uuid 58f41c7d-f1a8-43c1-8d68-08f16d5cd0f7 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:19,474 - WARNING - Pod uuid c05aa5e7-081d-43e9-add1-49dffc5efcdd is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:19,475 - WARNING - Pod uuid 2895c6d4-14c9-486e-b123-b0bbe6edc0d1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:19,475 - WARNING - Pod uuid 84d2b697-d945-453a-9eb3-00091eddf2d1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:19,476 - WARNING - Pod uuid 6729be51-a55a-4bc8-8add-04e5398b54b1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:19,476 - WARNING - Pod uuid 2932d5f4-ba73-4783-a8c5-eac2c4bb08b9 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:24,380 - DEBUG - Pod 7499298a-6577-4e39-b1fd-3c4387a15fac is not in agent 10.0.0.48 VM list
2025-09-25 01:27:24,386 - WARNING - VMI 48720cf4-99ae-11f0-a653-02424d755861 of Pod ctest-pod-26639544 is still seen in agent 10.0.0.48
2025-09-25 01:27:24,386 - DEBUG - [{'index': '7', 'name': 'tapeth0-749929', 'uuid': '48720cf4-99ae-11f0-a653-02424d755861', 'vrf_name': '--ERROR--', 'active': 'Inactive < vn-null vrf-null os-state-down ipv4_inactive ipv6_inactive l2_inactive >', 'ipv4_active': 'Ipv4 Inactive < vn-null vrf-null os-state-down l3-disabled >', 'l2_active': 'L2 Inactive < vn-null vrf-null os-state-down l2-disabled >', 'ip6_active': 'Ipv6 Inactive < vn-null vrf-null os-state-down l3-disabled no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '-1', 'l2_label': '-1', 'vxlan_id': '0', 'vn_name': None, 'vm_uuid': None, 'vm_name': None, 'ip_addr': '10.47.255.250', 'mac_addr': '02:48:72:0c:f4:99', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.7', 'service_vlan_list': None, 'os_ifindex': '26', 'fabric_port': 'FabricPort', 'alloc_linklocal_ip': 'LL-Disable', 'analyzer_name': None, 'config_name': None, 'sg_uuid_list': [], 'static_route_list': None, 'vm_project_uuid': '00000000-0000-0000-0000-000000000000', 'admin_state': 'Enabled', 'flow_key_idx': '0', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Invalid', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Inactive', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []}]
2025-09-25 01:27:24,485 - DEBUG - Pod 1671ae70-acf4-4bd1-9c3a-ec22293fc092 is not in agent 10.0.0.48 VM list
2025-09-25 01:27:24,500 - WARNING - Pod uuid 84d2b697-d945-453a-9eb3-00091eddf2d1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:24,500 - WARNING - Pod uuid c05aa5e7-081d-43e9-add1-49dffc5efcdd is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:24,500 - DEBUG - Pod 2895c6d4-14c9-486e-b123-b0bbe6edc0d1 is not in agent 10.0.0.48 VM list
2025-09-25 01:27:24,507 - DEBUG - VMI 4ac314b2-99ae-11f0-a653-02424d755861 is removed from agent 10.0.0.48
2025-09-25 01:27:24,507 - INFO - Verified that pod ctest-pod-40287959 is removed in agent
2025-09-25 01:27:24,508 - WARNING - Pod uuid 2932d5f4-ba73-4783-a8c5-eac2c4bb08b9 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:24,509 - DEBUG - Pod 58f41c7d-f1a8-43c1-8d68-08f16d5cd0f7 is not in agent 10.0.0.48 VM list
2025-09-25 01:27:24,510 - WARNING - Pod uuid 6729be51-a55a-4bc8-8add-04e5398b54b1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:24,517 - DEBUG - VMI 4a13d1aa-99ae-11f0-a653-02424d755861 is removed from agent 10.0.0.48
2025-09-25 01:27:24,517 - INFO - Verified that pod ctest-pod-85377725 is removed in agent
2025-09-25 01:27:24,517 - DEBUG - VMI 4924f63e-99ae-11f0-a653-02424d755861 is removed from agent 10.0.0.48
2025-09-25 01:27:24,517 - INFO - Verified that pod ctest-pod-72201957 is removed in agent
2025-09-25 01:27:29,392 - DEBUG - Pod 7499298a-6577-4e39-b1fd-3c4387a15fac is not in agent 10.0.0.48 VM list
2025-09-25 01:27:29,398 - DEBUG - VMI 48720cf4-99ae-11f0-a653-02424d755861 is removed from agent 10.0.0.48
2025-09-25 01:27:29,398 - INFO - Verified that pod ctest-pod-26639544 is removed in agent
2025-09-25 01:27:29,510 - WARNING - Pod uuid c05aa5e7-081d-43e9-add1-49dffc5efcdd is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:29,511 - WARNING - Pod uuid 84d2b697-d945-453a-9eb3-00091eddf2d1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:29,518 - WARNING - Pod uuid 2932d5f4-ba73-4783-a8c5-eac2c4bb08b9 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:29,523 - WARNING - Pod uuid 6729be51-a55a-4bc8-8add-04e5398b54b1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:34,521 - WARNING - Pod uuid c05aa5e7-081d-43e9-add1-49dffc5efcdd is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:34,522 - WARNING - Pod uuid 84d2b697-d945-453a-9eb3-00091eddf2d1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:34,526 - WARNING - Pod uuid 2932d5f4-ba73-4783-a8c5-eac2c4bb08b9 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:34,530 - WARNING - Pod uuid 6729be51-a55a-4bc8-8add-04e5398b54b1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:39,531 - WARNING - Pod uuid 84d2b697-d945-453a-9eb3-00091eddf2d1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:39,532 - WARNING - Pod uuid c05aa5e7-081d-43e9-add1-49dffc5efcdd is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:39,543 - WARNING - Pod uuid 2932d5f4-ba73-4783-a8c5-eac2c4bb08b9 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:39,546 - WARNING - Pod uuid 6729be51-a55a-4bc8-8add-04e5398b54b1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:44,540 - WARNING - Pod uuid 84d2b697-d945-453a-9eb3-00091eddf2d1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:44,541 - WARNING - Pod uuid c05aa5e7-081d-43e9-add1-49dffc5efcdd is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:44,548 - WARNING - Pod uuid 2932d5f4-ba73-4783-a8c5-eac2c4bb08b9 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:44,551 - WARNING - Pod uuid 6729be51-a55a-4bc8-8add-04e5398b54b1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:49,547 - WARNING - Pod uuid 84d2b697-d945-453a-9eb3-00091eddf2d1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:49,548 - WARNING - Pod uuid c05aa5e7-081d-43e9-add1-49dffc5efcdd is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:49,554 - WARNING - Pod uuid 2932d5f4-ba73-4783-a8c5-eac2c4bb08b9 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:49,556 - WARNING - Pod uuid 6729be51-a55a-4bc8-8add-04e5398b54b1 is still seen in agent 10.0.0.48 VM list
2025-09-25 01:27:54,559 - DEBUG - Pod c05aa5e7-081d-43e9-add1-49dffc5efcdd is not in agent 10.0.0.48 VM list
2025-09-25 01:27:54,561 - DEBUG - Pod 84d2b697-d945-453a-9eb3-00091eddf2d1 is not in agent 10.0.0.48 VM list
2025-09-25 01:27:54,563 - DEBUG - Pod 2932d5f4-ba73-4783-a8c5-eac2c4bb08b9 is not in agent 10.0.0.48 VM list
2025-09-25 01:27:54,566 - DEBUG - Pod 6729be51-a55a-4bc8-8add-04e5398b54b1 is not in agent 10.0.0.48 VM list
2025-09-25 01:27:54,569 - DEBUG - VMI 4bb2d272-99ae-11f0-a653-02424d755861 is removed from agent 10.0.0.48
2025-09-25 01:27:54,570 - INFO - Verified that pod ctest-pod-11194382 is removed in agent
2025-09-25 01:27:54,575 - DEBUG - VMI 4e0dfbc8-99ae-11f0-a653-02424d755861 is removed from agent 10.0.0.48
2025-09-25 01:27:54,575 - INFO - Verified that pod ctest-pod-64823220 is removed in agent
2025-09-25 01:27:54,575 - DEBUG - VMI 4d4790c8-99ae-11f0-a653-02424d755861 is removed from agent 10.0.0.48
2025-09-25 01:27:54,575 - INFO - Verified that pod ctest-pod-47923012 is removed in agent
2025-09-25 01:27:54,575 - DEBUG - VMI 4c852650-99ae-11f0-a653-02424d755861 is removed from agent 10.0.0.48
2025-09-25 01:27:54,575 - INFO - Verified that pod ctest-pod-13689507 is removed in agent
2025-09-25 01:27:54,576 - INFO - Deleting namespace ctest-non-default-04317751
2025-09-25 01:27:54,585 - DEBUG - Namespace ctest-non-default-04317751 still in k8s
2025-09-25 01:27:56,597 - DEBUG - Namespace ctest-non-default-04317751 still in k8s
2025-09-25 01:27:58,601 - DEBUG - Namespace ctest-non-default-04317751 still in k8s
2025-09-25 01:28:00,606 - DEBUG - Namespace ctest-non-default-04317751 is not in k8s
2025-09-25 01:28:00,606 - DEBUG - No need to check project deletion in contrail-api
2025-09-25 01:28:00,606 - INFO - Deleting namespace ctest-new-default-04899317
2025-09-25 01:28:00,616 - DEBUG - Namespace ctest-new-default-04899317 still in k8s
2025-09-25 01:28:02,622 - DEBUG - Namespace ctest-new-default-04899317 still in k8s
2025-09-25 01:28:04,627 - DEBUG - Namespace ctest-new-default-04899317 still in k8s
2025-09-25 01:28:06,630 - DEBUG - Namespace ctest-new-default-04899317 is not in k8s
2025-09-25 01:28:06,630 - DEBUG - No need to check project deletion in contrail-api