2025-07-04 15:33:20,259 - INFO - Using existing project ['default-domain', 'k8s-default'](385e674f-7ecd-4142-8db7-6c3d81aa8e70) 2025-07-04 15:33:20,278 - DEBUG - Namespace ctest-new-default-43211198 not present 2025-07-04 15:33:20,286 - INFO - Created namespace ctest-new-default-43211198 2025-07-04 15:33:23,291 - DEBUG - Namespace ctest-non-default-37058757 not present 2025-07-04 15:33:23,307 - INFO - Created namespace ctest-non-default-37058757 2025-07-04 15:33:26,329 - DEBUG - Pod ctest-pod-62795294 not present 2025-07-04 15:33:26,329 - INFO - Creating Pod ctest-pod-62795294 2025-07-04 15:33:26,372 - DEBUG - Pod : ctest-pod-62795294 UUID is d0ef660e-26df-41b3-ae16-3f044d1e5a0e 2025-07-04 15:33:26,374 - DEBUG - Pod ctest-pod-95512747 not present 2025-07-04 15:33:26,375 - INFO - Creating Pod ctest-pod-95512747 2025-07-04 15:33:26,402 - DEBUG - Pod : ctest-pod-95512747 UUID is 00964e9c-d546-4b18-8248-574bafbe5856 2025-07-04 15:33:26,405 - DEBUG - Pod ctest-pod-86833934 not present 2025-07-04 15:33:26,405 - INFO - Creating Pod ctest-pod-86833934 2025-07-04 15:33:26,453 - DEBUG - Pod : ctest-pod-86833934 UUID is 4eee2f0e-4f2b-4182-8a20-7446b174b3f4 2025-07-04 15:33:26,455 - DEBUG - Pod ctest-pod-04840857 not present 2025-07-04 15:33:26,455 - INFO - Creating Pod ctest-pod-04840857 2025-07-04 15:33:26,483 - DEBUG - Pod : ctest-pod-04840857 UUID is 99683e6a-b2e8-49b0-9aca-5834c3a64e84 2025-07-04 15:33:26,485 - DEBUG - Pod ctest-pod-62972684 not present 2025-07-04 15:33:26,485 - INFO - Creating Pod ctest-pod-62972684 2025-07-04 15:33:26,502 - DEBUG - Pod : ctest-pod-62972684 UUID is 504384aa-b892-4786-a411-b3df8eebb624 2025-07-04 15:33:26,509 - DEBUG - Pod ctest-pod-88553670 not present 2025-07-04 15:33:26,509 - INFO - Creating Pod ctest-pod-88553670 2025-07-04 15:33:26,534 - DEBUG - Pod : ctest-pod-88553670 UUID is d5ce66bf-251a-48bb-b4b0-6c41271300a8 2025-07-04 15:33:26,537 - DEBUG - Pod ctest-pod-23103771 not present 2025-07-04 15:33:26,537 - INFO - Creating Pod ctest-pod-23103771 2025-07-04 15:33:26,556 - DEBUG - Pod : ctest-pod-23103771 UUID is 0cdba8f4-7c5f-4be1-85b9-5df3d7aed63c 2025-07-04 15:33:26,559 - DEBUG - Pod ctest-pod-39703166 not present 2025-07-04 15:33:26,560 - INFO - Creating Pod ctest-pod-39703166 2025-07-04 15:33:26,579 - DEBUG - Pod : ctest-pod-39703166 UUID is 2dc2f63b-eb58-470e-993b-3bf85cc945c1 2025-07-04 15:33:26,766 - INFO - Project default-domain:k8s-ctest-new-default-43211198 for Namespace ctest-new-default-43211198 is seen in contrail-api 2025-07-04 15:33:26,766 - DEBUG - Project uuid in Contrail is cb1d4aaf-3ead-4ef0-9d4a-59c117aa9e2f 2025-07-04 15:33:26,965 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=7192d4df-9bd3-4364-b866-d8e6cf252d88 2025-07-04 15:33:26,970 - INFO - Namespace ctest-new-default-43211198 with uuid 7192d4df-9bd3-4364-b866-d8e6cf252d88 found in kube manager 2025-07-04 15:33:26,971 - INFO - Namespace ctest-new-default-43211198 verification passed 2025-07-04 15:33:27,168 - INFO - Project default-domain:k8s-ctest-non-default-37058757 for Namespace ctest-non-default-37058757 is seen in contrail-api 2025-07-04 15:33:27,169 - DEBUG - Project uuid in Contrail is ed32dee1-3e47-458d-b4e4-01137a22064e 2025-07-04 15:33:27,169 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NamespaceDatabaseList?namespace_uuid=d2442599-0a18-4f36-a29f-8ce0a8c4ab14 2025-07-04 15:33:27,176 - INFO - Namespace ctest-non-default-37058757 with uuid d2442599-0a18-4f36-a29f-8ce0a8c4ab14 found in kube manager 2025-07-04 15:33:27,176 - INFO - Namespace ctest-non-default-37058757 verification passed 2025-07-04 15:33:27,181 - DEBUG - Pod ctest-pod-62795294 not in running state.Currently in Pending 2025-07-04 15:33:32,188 - DEBUG - Pod ctest-pod-62795294 not in running state.Currently in Pending 2025-07-04 15:33:37,195 - DEBUG - Pod ctest-pod-62795294 not in running state.Currently in Pending 2025-07-04 15:33:42,202 - INFO - Pod ctest-pod-62795294 is in running state.Got IP 10.47.255.251 2025-07-04 15:33:42,216 - DEBUG - Pod ctest-pod-62795294 has vmi 3b632334-58ec-11f0-9db9-fa163ea91488 2025-07-04 15:33:42,216 - INFO - Verified pod ctest-pod-62795294 in contrail-api 2025-07-04 15:33:42,235 - DEBUG - VMI 3b632334-58ec-11f0-9db9-fa163ea91488 is active in agent 10.0.0.73 2025-07-04 15:33:42,236 - INFO - Verified Pod ctest-pod-62795294 in agent 10.0.0.73 2025-07-04 15:33:42,236 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=d0ef660e-26df-41b3-ae16-3f044d1e5a0e 2025-07-04 15:33:42,242 - INFO - Pod ctest-pod-62795294 with uuid d0ef660e-26df-41b3-ae16-3f044d1e5a0e found in kube manager 2025-07-04 15:33:42,242 - INFO - Pod ctest-pod-62795294 verification passed 2025-07-04 15:33:42,248 - INFO - Pod ctest-pod-95512747 is in running state.Got IP 10.47.255.250 2025-07-04 15:33:42,303 - DEBUG - Pod ctest-pod-95512747 has vmi 3be362b0-58ec-11f0-9db9-fa163ea91488 2025-07-04 15:33:42,303 - INFO - Verified pod ctest-pod-95512747 in contrail-api 2025-07-04 15:33:42,318 - DEBUG - VMI 3be362b0-58ec-11f0-9db9-fa163ea91488 is active in agent 10.0.0.73 2025-07-04 15:33:42,318 - INFO - Verified Pod ctest-pod-95512747 in agent 10.0.0.73 2025-07-04 15:33:42,318 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=00964e9c-d546-4b18-8248-574bafbe5856 2025-07-04 15:33:42,324 - INFO - Pod ctest-pod-95512747 with uuid 00964e9c-d546-4b18-8248-574bafbe5856 found in kube manager 2025-07-04 15:33:42,324 - INFO - Pod ctest-pod-95512747 verification passed 2025-07-04 15:33:42,330 - INFO - Pod ctest-pod-86833934 is in running state.Got IP 10.47.255.249 2025-07-04 15:33:42,383 - DEBUG - Pod ctest-pod-86833934 has vmi 3c808536-58ec-11f0-9db9-fa163ea91488 2025-07-04 15:33:42,383 - INFO - Verified pod ctest-pod-86833934 in contrail-api 2025-07-04 15:33:42,398 - DEBUG - VMI 3c808536-58ec-11f0-9db9-fa163ea91488 is active in agent 10.0.0.73 2025-07-04 15:33:42,399 - INFO - Verified Pod ctest-pod-86833934 in agent 10.0.0.73 2025-07-04 15:33:42,399 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=4eee2f0e-4f2b-4182-8a20-7446b174b3f4 2025-07-04 15:33:42,403 - INFO - Pod ctest-pod-86833934 with uuid 4eee2f0e-4f2b-4182-8a20-7446b174b3f4 found in kube manager 2025-07-04 15:33:42,403 - INFO - Pod ctest-pod-86833934 verification passed 2025-07-04 15:33:42,408 - INFO - Pod ctest-pod-04840857 is in running state.Got IP 10.47.255.248 2025-07-04 15:33:42,421 - DEBUG - Pod ctest-pod-04840857 has vmi 3cf61b48-58ec-11f0-9db9-fa163ea91488 2025-07-04 15:33:42,422 - INFO - Verified pod ctest-pod-04840857 in contrail-api 2025-07-04 15:33:42,435 - DEBUG - VMI 3cf61b48-58ec-11f0-9db9-fa163ea91488 is active in agent 10.0.0.73 2025-07-04 15:33:42,436 - INFO - Verified Pod ctest-pod-04840857 in agent 10.0.0.73 2025-07-04 15:33:42,436 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=99683e6a-b2e8-49b0-9aca-5834c3a64e84 2025-07-04 15:33:42,440 - INFO - Pod ctest-pod-04840857 with uuid 99683e6a-b2e8-49b0-9aca-5834c3a64e84 found in kube manager 2025-07-04 15:33:42,440 - INFO - Pod ctest-pod-04840857 verification passed 2025-07-04 15:33:42,446 - INFO - Pod ctest-pod-62972684 is in running state.Got IP 10.47.255.247 2025-07-04 15:33:42,506 - DEBUG - Pod ctest-pod-62972684 has vmi 3d7e5436-58ec-11f0-9db9-fa163ea91488 2025-07-04 15:33:42,506 - INFO - Verified pod ctest-pod-62972684 in contrail-api 2025-07-04 15:33:42,525 - DEBUG - VMI 3d7e5436-58ec-11f0-9db9-fa163ea91488 is active in agent 10.0.0.73 2025-07-04 15:33:42,525 - INFO - Verified Pod ctest-pod-62972684 in agent 10.0.0.73 2025-07-04 15:33:42,525 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=504384aa-b892-4786-a411-b3df8eebb624 2025-07-04 15:33:42,529 - INFO - Pod ctest-pod-62972684 with uuid 504384aa-b892-4786-a411-b3df8eebb624 found in kube manager 2025-07-04 15:33:42,529 - INFO - Pod ctest-pod-62972684 verification passed 2025-07-04 15:33:42,605 - DEBUG - Pod ctest-pod-23103771 not in running state.Currently in Pending 2025-07-04 15:33:47,612 - INFO - Pod ctest-pod-23103771 is in running state.Got IP 10.47.255.245 2025-07-04 15:33:47,625 - DEBUG - Pod ctest-pod-23103771 has vmi 3e6d56da-58ec-11f0-9db9-fa163ea91488 2025-07-04 15:33:47,625 - INFO - Verified pod ctest-pod-23103771 in contrail-api 2025-07-04 15:33:47,640 - DEBUG - VMI 3e6d56da-58ec-11f0-9db9-fa163ea91488 is active in agent 10.0.0.73 2025-07-04 15:33:47,640 - INFO - Verified Pod ctest-pod-23103771 in agent 10.0.0.73 2025-07-04 15:33:47,640 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=0cdba8f4-7c5f-4be1-85b9-5df3d7aed63c 2025-07-04 15:33:47,645 - INFO - Pod ctest-pod-23103771 with uuid 0cdba8f4-7c5f-4be1-85b9-5df3d7aed63c found in kube manager 2025-07-04 15:33:47,645 - INFO - Pod ctest-pod-23103771 verification passed 2025-07-04 15:33:47,650 - INFO - Pod ctest-pod-88553670 is in running state.Got IP 10.47.255.246 2025-07-04 15:33:47,707 - DEBUG - Pod ctest-pod-88553670 has vmi 3df8abaa-58ec-11f0-9db9-fa163ea91488 2025-07-04 15:33:47,707 - INFO - Verified pod ctest-pod-88553670 in contrail-api 2025-07-04 15:33:47,721 - DEBUG - VMI 3df8abaa-58ec-11f0-9db9-fa163ea91488 is active in agent 10.0.0.73 2025-07-04 15:33:47,721 - INFO - Verified Pod ctest-pod-88553670 in agent 10.0.0.73 2025-07-04 15:33:47,722 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=d5ce66bf-251a-48bb-b4b0-6c41271300a8 2025-07-04 15:33:47,727 - INFO - Pod ctest-pod-88553670 with uuid d5ce66bf-251a-48bb-b4b0-6c41271300a8 found in kube manager 2025-07-04 15:33:47,727 - INFO - Pod ctest-pod-88553670 verification passed 2025-07-04 15:33:47,733 - INFO - Pod ctest-pod-39703166 is in running state.Got IP 10.47.255.244 2025-07-04 15:33:47,791 - DEBUG - Pod ctest-pod-39703166 has vmi 3edf3d22-58ec-11f0-9db9-fa163ea91488 2025-07-04 15:33:47,791 - INFO - Verified pod ctest-pod-39703166 in contrail-api 2025-07-04 15:33:47,807 - DEBUG - VMI 3edf3d22-58ec-11f0-9db9-fa163ea91488 is active in agent 10.0.0.73 2025-07-04 15:33:47,807 - INFO - Verified Pod ctest-pod-39703166 in agent 10.0.0.73 2025-07-04 15:33:47,807 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_VirtualMachineDatabaseList?x=2dc2f63b-eb58-470e-993b-3bf85cc945c1 2025-07-04 15:33:47,813 - INFO - Pod ctest-pod-39703166 with uuid 2dc2f63b-eb58-470e-993b-3bf85cc945c1 found in kube manager 2025-07-04 15:33:47,813 - INFO - Pod ctest-pod-39703166 verification passed 2025-07-04 15:33:47,813 - INFO - ================================================================================ 2025-07-04 15:33:47,813 - INFO - STARTING TEST : test_ingress_rule_on_pod_with_service 2025-07-04 15:33:47,814 - INFO - TEST DESCRIPTION : Verify that ingress rules on a pod work fine when pods are accessed via a service Steps: 1. Create a service in namespace 1 over a pod which are endpoints of a service 2. Create a network policy to allow 1 pod of namespace 1 as ingress. 3. Verify that service respond correctly to the specified pod in the policy and service do not respond to anyone else. 4. Extend the policy and add the namespaceselector as namespace 2. 5. Verify that service become accessible to the pods of namespace 2. 2025-07-04 15:33:48,064 - DEBUG - Nothing to compare xmpp stats {'10.0.0.73': {'10.0.0.57': '0'}} with 2025-07-04 15:33:48,064 - INFO - Initial checks done. Running the testcase now 2025-07-04 15:33:48,064 - INFO - 2025-07-04 15:33:48,123 - DEBUG - [Pod ctest-pod-62795294] Cmd: echo ctest-pod-62795294 > /usr/share/nginx/html/index.html, Output: 2025-07-04 15:33:48,178 - DEBUG - [Pod ctest-pod-95512747] Cmd: echo ctest-pod-95512747 > /usr/share/nginx/html/index.html, Output: 2025-07-04 15:33:48,239 - DEBUG - [Pod ctest-pod-86833934] Cmd: echo ctest-pod-86833934 > /usr/share/nginx/html/index.html, Output: 2025-07-04 15:33:48,274 - DEBUG - [Pod ctest-pod-04840857] Cmd: echo ctest-pod-04840857 > /usr/share/nginx/html/index.html, Output: 2025-07-04 15:33:48,283 - DEBUG - Service ctest-nginx-svc-86294012 not present 2025-07-04 15:33:48,283 - INFO - Creating service ctest-nginx-svc-86294012 2025-07-04 15:33:48,309 - INFO - Created Service ctest-nginx-svc-86294012 2025-07-04 15:33:48,326 - WARNING - Service UUID cf723d4b-a1aa-4b82-a1ff-8abf1bb5b3c9 not yet found in contrail-api 2025-07-04 15:33:49,336 - INFO - Validated that Service ctest-nginx-svc-86294012 is seen in contrail-api 2025-07-04 15:33:49,336 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_LoadbalancerDatabaseList?x=cf723d4b-a1aa-4b82-a1ff-8abf1bb5b3c9 2025-07-04 15:33:49,341 - INFO - Service ctest-nginx-svc-86294012 with uuid cf723d4b-a1aa-4b82-a1ff-8abf1bb5b3c9 found in kube manager 2025-07-04 15:33:49,341 - INFO - Service ctest-nginx-svc-86294012 verification passed 2025-07-04 15:33:50,448 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-95512747 2025-07-04 15:33:50,448 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:33:50,448 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout ctest-pod-95512747 2025-07-04 15:33:50,497 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-95512747 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,498 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:33:50,498 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: ctest-pod-95512747 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,550 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,551 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:33:50,551 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,551 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62795294': 1, 'ctest-pod-95512747': 2} 2025-07-04 15:33:50,604 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,604 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:33:50,604 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,660 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,661 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:33:50,661 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,724 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,724 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:33:50,724 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,779 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,779 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:33:50,779 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,840 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,840 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:33:50,841 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,905 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,905 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:33:50,905 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,958 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-95512747 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,958 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:33:50,958 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: ctest-pod-95512747 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:33:50,958 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62795294': 6, 'ctest-pod-95512747': 1} 2025-07-04 15:33:50,961 - DEBUG - Network policy ingress-on-service not present 2025-07-04 15:33:50,962 - INFO - Creating Network Policy ingress-on-service 2025-07-04 15:33:50,978 - INFO - Network policy found in k8s 2025-07-04 15:33:50,978 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=018cec9c-67e8-4f49-9594-f80b3f5b4885 2025-07-04 15:33:50,983 - INFO - Network Policy ingress-on-service with uuid 018cec9c-67e8-4f49-9594-f80b3f5b4885 found in kube manager 2025-07-04 15:33:51,023 - INFO - Network policy with name default-policy-management:k8s-allowall found in agent 2025-07-04 15:33:51,024 - INFO - Network policy with name default-policy-management:k8s-allowall associated with default ks8 2025-07-04 15:33:51,024 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=018cec9c-67e8-4f49-9594-f80b3f5b4885 2025-07-04 15:33:51,054 - WARNING - Network policy with name ingress-on-service not found in agent 2025-07-04 15:33:53,055 - DEBUG - Requesting: http://10.0.0.57:8108/Snh_NetworkPolicyDatabaseList?network_policy_uuid=018cec9c-67e8-4f49-9594-f80b3f5b4885 2025-07-04 15:33:53,091 - INFO - Network policy with name ingress-on-service found in agent 2025-07-04 15:33:53,091 - INFO - Network Policy ingress-on-service verification passed 2025-07-04 15:33:58,155 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:33:58,155 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:33:58,155 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:03,212 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:03,212 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:03,213 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:08,259 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:08,259 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:08,259 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:13,321 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:13,321 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:13,321 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:18,379 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:18,379 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:18,379 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:23,427 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:23,427 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:23,427 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:28,478 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:28,478 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:28,478 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:33,523 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:33,523 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:33,523 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:38,575 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:38,575 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:38,575 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:43,623 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:43,623 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:43,623 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:43,624 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62795294': 0, 'ctest-pod-95512747': 0} 2025-07-04 15:34:43,679 - DEBUG - [Pod ctest-pod-88553670] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-95512747 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:34:43,679 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:34:43,679 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd output: ctest-pod-95512747 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:34:43,731 - DEBUG - [Pod ctest-pod-88553670] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:34:43,731 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:34:43,731 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:34:43,731 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62795294': 1, 'ctest-pod-95512747': 1} 2025-07-04 15:34:48,785 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:48,785 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:48,785 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:53,836 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:53,836 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:53,836 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:58,888 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:58,889 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:34:58,889 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:03,937 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:03,937 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:03,937 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:08,990 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:08,990 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:08,990 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:14,045 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:14,045 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:14,045 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:19,096 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:19,096 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:19,096 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:24,145 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:24,145 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:24,145 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:29,204 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:29,204 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:29,204 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:34,252 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:34,252 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:34,252 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:34,252 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62795294': 0, 'ctest-pod-95512747': 0} 2025-07-04 15:35:36,305 - DEBUG - [Pod ctest-pod-88553670] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.485 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.071 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.091 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.071/0.549/1.485 ms 2025-07-04 15:35:36,305 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-88553670 with expectation True passed 2025-07-04 15:35:38,355 - DEBUG - [Pod ctest-pod-62972684] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.986 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.083 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.087 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.083/0.385/0.986 ms 2025-07-04 15:35:38,355 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-62972684 with expectation True passed 2025-07-04 15:35:40,414 - DEBUG - [Pod ctest-pod-23103771] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=1.338 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.089 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.096 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.089/0.507/1.338 ms 2025-07-04 15:35:40,414 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23103771 with expectation True passed 2025-07-04 15:35:40,466 - DEBUG - [Pod ctest-pod-88553670] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:35:40,466 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-04 15:35:40,466 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:35:40,466 - INFO - wget check of of http://10.47.255.251 from ctest-pod-88553670 passed 2025-07-04 15:35:40,526 - DEBUG - [Pod ctest-pod-88553670] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:35:40,526 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-07-04 15:35:40,526 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:35:40,526 - INFO - wget check of of http://10.47.255.250 from ctest-pod-88553670 passed 2025-07-04 15:35:45,577 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-04 15:35:45,577 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-04 15:35:45,578 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-04 15:35:45,578 - INFO - wget check of of http://10.47.255.250 from ctest-pod-62972684 passed 2025-07-04 15:35:50,624 - DEBUG - [Pod ctest-pod-39703166] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-04 15:35:50,624 - DEBUG - [Pod Pod ctest-pod-39703166] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-04 15:35:50,624 - DEBUG - [Pod Pod ctest-pod-39703166] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) wget: download timed out 2025-07-04 15:35:50,624 - INFO - wget check of of http://10.47.255.251 from ctest-pod-39703166 passed 2025-07-04 15:35:50,634 - INFO - Updating Network Policy ingress-on-service 2025-07-04 15:35:55,697 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:55,697 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:35:55,697 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:00,745 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:00,745 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:00,745 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:05,798 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:05,798 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:05,798 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:10,853 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:10,853 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:10,853 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:15,901 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:15,901 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:15,901 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:20,969 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:20,969 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:20,969 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:26,015 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:26,015 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:26,016 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:31,056 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:31,056 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:31,056 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:33,853 - WARNING - ApiException is caught (0) Reason: Connection is already closed. . Retrying... 2025-07-04 15:36:43,921 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:43,921 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:43,921 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:48,981 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:48,981 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 failed. Output :Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:48,981 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.111.103.222:80 (10.111.103.222:80) wget: download timed out 2025-07-04 15:36:48,981 - INFO - As expected, responses not seen from podsHits : {'ctest-pod-62795294': 0, 'ctest-pod-95512747': 0} 2025-07-04 15:36:49,036 - DEBUG - [Pod ctest-pod-88553670] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:36:49,036 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:36:49,036 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:36:49,093 - DEBUG - [Pod ctest-pod-88553670] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:36:49,093 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:36:49,093 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:36:49,129 - DEBUG - [Pod ctest-pod-88553670] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-95512747 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:36:49,129 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:36:49,129 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd output: ctest-pod-95512747 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:36:49,129 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62795294': 2, 'ctest-pod-95512747': 1} 2025-07-04 15:36:49,178 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:36:49,178 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:36:49,178 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:36:49,231 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:36:49,231 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:36:49,231 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: ctest-pod-62795294 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:36:49,278 - DEBUG - [Pod ctest-pod-23103771] Cmd: wget http://10.111.103.222:80/ -O - -T 5 -t 1 , Output: ctest-pod-95512747 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:36:49,278 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd wget http://10.111.103.222:80/ -O - -T 5 -t 1 passed 2025-07-04 15:36:49,278 - DEBUG - [Pod Pod ctest-pod-23103771] Cmd output: ctest-pod-95512747 Connecting to 10.111.103.222:80 (10.111.103.222:80) writing to stdout - 100% |********************************| 19 0:00:00 ETA written to stdout 2025-07-04 15:36:49,278 - INFO - Responses seen from all pods, lb seems fine.Hits : {'ctest-pod-62795294': 2, 'ctest-pod-95512747': 1} 2025-07-04 15:36:51,331 - DEBUG - [Pod ctest-pod-88553670] Cmd: ping -c 3 10.47.255.247, Output: PING 10.47.255.247 (10.47.255.247): 56 data bytes 64 bytes from 10.47.255.247: seq=0 ttl=63 time=1.243 ms 64 bytes from 10.47.255.247: seq=1 ttl=63 time=0.076 ms 64 bytes from 10.47.255.247: seq=2 ttl=63 time=0.095 ms --- 10.47.255.247 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.076/0.471/1.243 ms 2025-07-04 15:36:51,331 - INFO - Ping check to IP 10.47.255.247 from pod ctest-pod-88553670 with expectation True passed 2025-07-04 15:36:53,410 - DEBUG - [Pod ctest-pod-62972684] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.491 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.078 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.080 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.078/0.216/0.491 ms 2025-07-04 15:36:53,410 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-62972684 with expectation True passed 2025-07-04 15:36:55,464 - DEBUG - [Pod ctest-pod-23103771] Cmd: ping -c 3 10.47.255.246, Output: PING 10.47.255.246 (10.47.255.246): 56 data bytes 64 bytes from 10.47.255.246: seq=0 ttl=63 time=0.745 ms 64 bytes from 10.47.255.246: seq=1 ttl=63 time=0.077 ms 64 bytes from 10.47.255.246: seq=2 ttl=63 time=0.105 ms --- 10.47.255.246 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.077/0.309/0.745 ms 2025-07-04 15:36:55,464 - INFO - Ping check to IP 10.47.255.246 from pod ctest-pod-23103771 with expectation True passed 2025-07-04 15:36:55,520 - DEBUG - [Pod ctest-pod-88553670] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:36:55,520 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-04 15:36:55,520 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:36:55,520 - INFO - wget check of of http://10.47.255.251 from ctest-pod-88553670 passed 2025-07-04 15:36:55,574 - DEBUG - [Pod ctest-pod-88553670] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:36:55,574 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 passed 2025-07-04 15:36:55,574 - DEBUG - [Pod Pod ctest-pod-88553670] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:36:55,574 - INFO - wget check of of http://10.47.255.250 from ctest-pod-88553670 passed 2025-07-04 15:37:00,626 - DEBUG - [Pod ctest-pod-62972684] Cmd: wget http://10.47.255.250 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-04 15:37:00,626 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd wget http://10.47.255.250 -O /dev/null -T 5 -t 1 failed. Output :Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-04 15:37:00,626 - DEBUG - [Pod Pod ctest-pod-62972684] Cmd output: Connecting to 10.47.255.250 (10.47.255.250:80) wget: download timed out 2025-07-04 15:37:00,626 - INFO - wget check of of http://10.47.255.250 from ctest-pod-62972684 passed 2025-07-04 15:37:00,691 - DEBUG - [Pod ctest-pod-39703166] Cmd: wget http://10.47.255.251 -O /dev/null -T 5 -t 1 , Output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:37:00,691 - DEBUG - [Pod Pod ctest-pod-39703166] Cmd wget http://10.47.255.251 -O /dev/null -T 5 -t 1 passed 2025-07-04 15:37:00,691 - DEBUG - [Pod Pod ctest-pod-39703166] Cmd output: Connecting to 10.47.255.251 (10.47.255.251:80) saving to '/dev/null' null 100% |********************************| 19 0:00:00 ETA '/dev/null' saved 2025-07-04 15:37:00,691 - INFO - wget check of of http://10.47.255.251 from ctest-pod-39703166 passed 2025-07-04 15:37:00,691 - INFO - Deleting Network Policy : ingress-on-service 2025-07-04 15:37:00,692 - INFO - Deleting service : ctest-nginx-svc-86294012 2025-07-04 15:37:00,919 - DEBUG - No XMPP flaps were noticed during the test
2025-07-04 15:37:00,919 - INFO - END TEST : test_ingress_rule_on_pod_with_service : PASSED[0:03:13]
2025-07-04 15:37:00,919 - INFO - -------------------------------------------------------------------------------- 2025-07-04 15:37:00,924 - INFO - Deleting pod ctest-new-default-43211198:ctest-pod-62795294 2025-07-04 15:37:00,925 - INFO - Deleting pod ctest-new-default-43211198:ctest-pod-95512747 2025-07-04 15:37:00,925 - INFO - Deleting pod ctest-non-default-37058757:ctest-pod-86833934 2025-07-04 15:37:00,925 - INFO - Deleting pod ctest-non-default-37058757:ctest-pod-04840857 2025-07-04 15:37:00,925 - INFO - Deleting pod ctest-new-default-43211198:ctest-pod-62972684 2025-07-04 15:37:00,926 - INFO - Deleting pod ctest-new-default-43211198:ctest-pod-88553670 2025-07-04 15:37:00,926 - INFO - Deleting pod ctest-non-default-37058757:ctest-pod-23103771 2025-07-04 15:37:00,926 - INFO - Deleting pod ctest-non-default-37058757:ctest-pod-39703166 2025-07-04 15:37:01,019 - WARNING - Pod uuid d0ef660e-26df-41b3-ae16-3f044d1e5a0e is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:01,020 - WARNING - Pod uuid 504384aa-b892-4786-a411-b3df8eebb624 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:01,043 - WARNING - Pod uuid 4eee2f0e-4f2b-4182-8a20-7446b174b3f4 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:01,043 - WARNING - Pod uuid 99683e6a-b2e8-49b0-9aca-5834c3a64e84 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:01,044 - WARNING - Pod uuid 00964e9c-d546-4b18-8248-574bafbe5856 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:01,045 - WARNING - Pod uuid 0cdba8f4-7c5f-4be1-85b9-5df3d7aed63c is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:01,046 - WARNING - Pod uuid d5ce66bf-251a-48bb-b4b0-6c41271300a8 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:01,046 - WARNING - Pod uuid 2dc2f63b-eb58-470e-993b-3bf85cc945c1 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:06,032 - WARNING - Pod uuid 504384aa-b892-4786-a411-b3df8eebb624 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:06,033 - DEBUG - Pod d0ef660e-26df-41b3-ae16-3f044d1e5a0e is not in agent 10.0.0.73 VM list 2025-07-04 15:37:06,041 - DEBUG - VMI 3b632334-58ec-11f0-9db9-fa163ea91488 is removed from agent 10.0.0.73 2025-07-04 15:37:06,041 - INFO - Verified that pod ctest-pod-62795294 is removed in agent 2025-07-04 15:37:06,060 - DEBUG - Pod 4eee2f0e-4f2b-4182-8a20-7446b174b3f4 is not in agent 10.0.0.73 VM list 2025-07-04 15:37:06,074 - WARNING - Pod uuid 0cdba8f4-7c5f-4be1-85b9-5df3d7aed63c is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:06,074 - DEBUG - Pod 99683e6a-b2e8-49b0-9aca-5834c3a64e84 is not in agent 10.0.0.73 VM list 2025-07-04 15:37:06,076 - DEBUG - Pod 00964e9c-d546-4b18-8248-574bafbe5856 is not in agent 10.0.0.73 VM list 2025-07-04 15:37:06,087 - DEBUG - VMI 3c808536-58ec-11f0-9db9-fa163ea91488 is removed from agent 10.0.0.73 2025-07-04 15:37:06,087 - INFO - Verified that pod ctest-pod-86833934 is removed in agent 2025-07-04 15:37:06,087 - WARNING - Pod uuid 2dc2f63b-eb58-470e-993b-3bf85cc945c1 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:06,088 - WARNING - Pod uuid d5ce66bf-251a-48bb-b4b0-6c41271300a8 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:06,143 - DEBUG - VMI 3cf61b48-58ec-11f0-9db9-fa163ea91488 is removed from agent 10.0.0.73 2025-07-04 15:37:06,143 - INFO - Verified that pod ctest-pod-04840857 is removed in agent 2025-07-04 15:37:06,144 - DEBUG - VMI 3be362b0-58ec-11f0-9db9-fa163ea91488 is removed from agent 10.0.0.73 2025-07-04 15:37:06,144 - INFO - Verified that pod ctest-pod-95512747 is removed in agent 2025-07-04 15:37:11,042 - WARNING - Pod uuid 504384aa-b892-4786-a411-b3df8eebb624 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:11,082 - WARNING - Pod uuid 0cdba8f4-7c5f-4be1-85b9-5df3d7aed63c is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:11,099 - WARNING - Pod uuid d5ce66bf-251a-48bb-b4b0-6c41271300a8 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:11,100 - WARNING - Pod uuid 2dc2f63b-eb58-470e-993b-3bf85cc945c1 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:16,050 - WARNING - Pod uuid 504384aa-b892-4786-a411-b3df8eebb624 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:16,100 - WARNING - Pod uuid 0cdba8f4-7c5f-4be1-85b9-5df3d7aed63c is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:16,111 - WARNING - Pod uuid 2dc2f63b-eb58-470e-993b-3bf85cc945c1 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:16,112 - WARNING - Pod uuid d5ce66bf-251a-48bb-b4b0-6c41271300a8 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:21,059 - WARNING - Pod uuid 504384aa-b892-4786-a411-b3df8eebb624 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:21,107 - WARNING - Pod uuid 0cdba8f4-7c5f-4be1-85b9-5df3d7aed63c is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:21,122 - WARNING - Pod uuid d5ce66bf-251a-48bb-b4b0-6c41271300a8 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:21,123 - WARNING - Pod uuid 2dc2f63b-eb58-470e-993b-3bf85cc945c1 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:26,070 - WARNING - Pod uuid 504384aa-b892-4786-a411-b3df8eebb624 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:26,115 - WARNING - Pod uuid 0cdba8f4-7c5f-4be1-85b9-5df3d7aed63c is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:26,134 - WARNING - Pod uuid d5ce66bf-251a-48bb-b4b0-6c41271300a8 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:26,135 - WARNING - Pod uuid 2dc2f63b-eb58-470e-993b-3bf85cc945c1 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:31,079 - WARNING - Pod uuid 504384aa-b892-4786-a411-b3df8eebb624 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:31,160 - WARNING - Pod uuid 0cdba8f4-7c5f-4be1-85b9-5df3d7aed63c is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:31,161 - WARNING - Pod uuid 2dc2f63b-eb58-470e-993b-3bf85cc945c1 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:31,161 - WARNING - Pod uuid d5ce66bf-251a-48bb-b4b0-6c41271300a8 is still seen in agent 10.0.0.73 VM list 2025-07-04 15:37:36,088 - DEBUG - Pod 504384aa-b892-4786-a411-b3df8eebb624 is not in agent 10.0.0.73 VM list 2025-07-04 15:37:36,095 - DEBUG - VMI 3d7e5436-58ec-11f0-9db9-fa163ea91488 is removed from agent 10.0.0.73 2025-07-04 15:37:36,095 - INFO - Verified that pod ctest-pod-62972684 is removed in agent 2025-07-04 15:37:36,176 - DEBUG - Pod 0cdba8f4-7c5f-4be1-85b9-5df3d7aed63c is not in agent 10.0.0.73 VM list 2025-07-04 15:37:36,179 - DEBUG - Pod 2dc2f63b-eb58-470e-993b-3bf85cc945c1 is not in agent 10.0.0.73 VM list 2025-07-04 15:37:36,180 - DEBUG - Pod d5ce66bf-251a-48bb-b4b0-6c41271300a8 is not in agent 10.0.0.73 VM list 2025-07-04 15:37:36,190 - DEBUG - VMI 3e6d56da-58ec-11f0-9db9-fa163ea91488 is removed from agent 10.0.0.73 2025-07-04 15:37:36,190 - INFO - Verified that pod ctest-pod-23103771 is removed in agent 2025-07-04 15:37:36,191 - DEBUG - VMI 3df8abaa-58ec-11f0-9db9-fa163ea91488 is removed from agent 10.0.0.73 2025-07-04 15:37:36,191 - INFO - Verified that pod ctest-pod-88553670 is removed in agent 2025-07-04 15:37:36,192 - DEBUG - VMI 3edf3d22-58ec-11f0-9db9-fa163ea91488 is removed from agent 10.0.0.73 2025-07-04 15:37:36,192 - INFO - Verified that pod ctest-pod-39703166 is removed in agent 2025-07-04 15:37:36,192 - INFO - Deleting namespace ctest-non-default-37058757 2025-07-04 15:37:36,212 - DEBUG - Namespace ctest-non-default-37058757 still in k8s 2025-07-04 15:37:38,218 - DEBUG - Namespace ctest-non-default-37058757 still in k8s 2025-07-04 15:37:40,223 - DEBUG - Namespace ctest-non-default-37058757 still in k8s 2025-07-04 15:37:42,227 - DEBUG - Namespace ctest-non-default-37058757 is not in k8s 2025-07-04 15:37:42,227 - DEBUG - No need to check project deletion in contrail-api 2025-07-04 15:37:42,227 - INFO - Deleting namespace ctest-new-default-43211198 2025-07-04 15:37:42,239 - DEBUG - Namespace ctest-new-default-43211198 still in k8s 2025-07-04 15:37:44,246 - DEBUG - Namespace ctest-new-default-43211198 still in k8s 2025-07-04 15:37:46,251 - DEBUG - Namespace ctest-new-default-43211198 still in k8s 2025-07-04 15:37:48,254 - DEBUG - Namespace ctest-new-default-43211198 is not in k8s 2025-07-04 15:37:48,254 - DEBUG - No need to check project deletion in contrail-api